1
|
Donggui C, Jingan S, Ruiming W. Differences in perceptual representations in multilinguals' first, second, and third language. Front Hum Neurosci 2024; 18:1408411. [PMID: 39010892 PMCID: PMC11246912 DOI: 10.3389/fnhum.2024.1408411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Accepted: 06/19/2024] [Indexed: 07/17/2024] Open
Abstract
Two experiments were conducted to investigate the differences in perceptual representations among multilingual individuals. In Experiment 1, the immediate sentence-picture verification paradigm was used to investigate perceptual representations in the working memory stage. The results suggest a match effect within the first language (Cantonese), but not within the second language (Mandarin) or the third language (English), showing perceptual representations only in first language comprehension. In Experiment 2, the delayed sentence-picture verification paradigm was used to investigate perceptual representations in long-term memory. Similarly, the results suggest a match effect within the first language (Mandarin), but not within the second language (English). The findings of both experiments suggest that the first language was perceptually represented, regardless of whether it was Cantonese or Mandarin, regardless of the processing in working memory or long-term memory. No evidence was found for perceptual representations in the later-learned languages, regardless of high or low proficiency. Our study has implications for theories of language comprehension and embodied cognition.
Collapse
Affiliation(s)
- Chen Donggui
- School of Foreign Languages, Guangdong Polytechnic Normal University, Guangzhou, China
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, Ministry of Education, & Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Su Jingan
- Guangzhou No.18 Middle School, Guangzhou, China
| | - Wang Ruiming
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, Ministry of Education, & Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| |
Collapse
|
2
|
van Zuijlen SJA, Singh S, Gunawan K, Pecher D, Zeelenberg R. Automatic mental simulation in native and non-native speakers. Mem Cognit 2024; 52:1152-1163. [PMID: 38353910 PMCID: PMC11315732 DOI: 10.3758/s13421-024-01533-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/24/2023] [Indexed: 08/10/2024]
Abstract
Pictures of objects are verified faster when they match the implied orientation, shape, and color in a sentence-picture verification task, suggesting that people mentally simulate these features during language comprehension. Previous studies had an unintended correlation between match status and the required response, which may have influenced participants' responses by eliciting strategic use of this correlation. We removed this correlation by including color-matching filler trials and investigated if the color-match effect was still obtained. In both a native sample (Experiment 1) and a non-native sample (Experiment 2), we found strong evidence for a color-match advantage on median reaction time and error rates. Our results are consistent with the view that color is automatically simulated during language comprehension as predicted by the grounded cognition framework.
Collapse
Affiliation(s)
- Samuel J A van Zuijlen
- Erasmus University, Woudestein T13-31, PO Box 1738, 3000, DR, Rotterdam, the Netherlands
| | - Sharon Singh
- Erasmus University, Woudestein T13-31, PO Box 1738, 3000, DR, Rotterdam, the Netherlands
| | - Kevin Gunawan
- Erasmus University, Woudestein T13-31, PO Box 1738, 3000, DR, Rotterdam, the Netherlands
| | - Diane Pecher
- Erasmus University, Woudestein T13-31, PO Box 1738, 3000, DR, Rotterdam, the Netherlands
| | - René Zeelenberg
- Erasmus University, Woudestein T13-31, PO Box 1738, 3000, DR, Rotterdam, the Netherlands.
| |
Collapse
|
3
|
Tang D, Li X, Fu Y, Wang H, Li X, Parviainen T, Kärkkäinen T. Neural correlates of emotion-label vs. emotion-laden word processing in late bilinguals: evidence from an ERP study. Cogn Emot 2024:1-18. [PMID: 38738622 DOI: 10.1080/02699931.2024.2352584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 03/19/2024] [Indexed: 05/14/2024]
Abstract
The brain processes underlying the distinction between emotion-label words (e.g. happy, sad) and emotion-laden words (e.g. successful, failed) remain inconclusive in bilingualism research. The present study aims to directly compare the processing of these two types of emotion words in both the first language (L1) and second language (L2) by recording event-related potentials (ERP) from late Chinese-English bilinguals during a lexical decision task. The results revealed that in the early word processing stages, the N170 emotion effect emerged only for L1 negative emotion-laden words and L2 negative emotion-label words. In addition, larger early posterior negativity (EPN) was elicited by emotion-laden words than emotion-label words in both L1 and L2. In the later processing stages, the N400 emotion effect was evident for L1 emotion words, excluding positive emotion-laden words, while it was absent in L2. Notably, L1 emotion words elicited enhanced N400 and attenuated late positive complex (LPC) compared to those in L2. Taken together, these findings confirmed the engagement of emotion, and highlighted the modulation of emotion word type and valence on word processing in both early and late processing stages. Different neural mechanisms between L1 and L2 in processing written emotion words were elucidated.
Collapse
Affiliation(s)
- Dong Tang
- School of Foreign Languages, Dalian University of Technology, Dalian, People's Republic of China
- Faculty of Information Technology, University of Jyväskylä, Jyväskylä, Finland
| | - Xueqiao Li
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Yang Fu
- School of International Studies, Zhejiang University, Hangzhou, People's Republic of China
| | - Huili Wang
- School of Foreign Languages, Hangzhou City University, Hangzhou, People's Republic of China
| | - Xueyan Li
- School of Foreign Languages, Dalian University of Technology, Dalian, People's Republic of China
| | - Tiina Parviainen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Tommi Kärkkäinen
- Faculty of Information Technology, University of Jyväskylä, Jyväskylä, Finland
| |
Collapse
|
4
|
Malyshevskaya A, Fischer MH, Shtyrov Y, Myachykov A. Horizontal mapping of time-related words in first and second language. Sci Rep 2024; 14:9675. [PMID: 38678052 PMCID: PMC11055926 DOI: 10.1038/s41598-024-60062-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 04/17/2024] [Indexed: 04/29/2024] Open
Abstract
The existence of a consistent horizontal spatial-conceptual mapping for words denoting time is a well-established phenomenon. For example, words related to the past or future (e.g., yesterday/tomorrow) facilitate respective leftward/rightward attentional shifts and responses, suggesting the visual-spatial grounding of temporal semantics, at least in the native language (L1). To examine whether similar horizontal bias also accompanies access to time-related words in a second language (L2), we tested 53 Russian-English (Experiment 1) and 48 German-English (Experiment 2) bilinguals, who classified randomly presented L1 and L2 time-related words as past- or future-related using left or right response keys. The predicted spatial congruency effect was registered in all tested languages and, furthermore, was positively associated with higher L2 proficiency in Experiment 2. Our findings (1) support the notion of horizontal spatial-conceptual mapping in diverse L1s, (2) demonstrate the existence of a similar spatial bias when processing temporal words in L2, and (3) show that the strength of time-space association in L2 may depend on individual L2 proficiency.
Collapse
Affiliation(s)
- Anastasia Malyshevskaya
- Potsdam Embodied Cognition Group, Cognitive Sciences, University of Potsdam, Karl-Liebknecht-Str. 24/25, 14476, Potsdam-Golm, Germany.
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Krivokolenniy Pereulok 3, Entrance 2, 101000, Moscow, Russian Federation.
| | - Martin H Fischer
- Potsdam Embodied Cognition Group, Cognitive Sciences, University of Potsdam, Karl-Liebknecht-Str. 24/25, 14476, Potsdam-Golm, Germany
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Institute for Clinical Medicine, Aarhus University, Universitetsbyen 3, Bldg. 1719, 8000, Aarhus, Denmark
| | - Andriy Myachykov
- Department of Psychology, Northumbria University, Northumberland Building, Newcastle Upon Tyne, NE1 8ST, UK
| |
Collapse
|
5
|
Zhang Y, Chen S, Peng Y, Yang X, Yang J. The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization. Behav Sci (Basel) 2024; 14:268. [PMID: 38667064 PMCID: PMC11047514 DOI: 10.3390/bs14040268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 03/17/2024] [Accepted: 03/20/2024] [Indexed: 04/29/2024] Open
Abstract
The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.
Collapse
Affiliation(s)
| | - Shifa Chen
- College of Foreign Languages, Ocean University of China, Qingdao 266100, China; (Y.Z.); (X.Y.); (J.Y.)
| | - Yule Peng
- College of Foreign Languages, Ocean University of China, Qingdao 266100, China; (Y.Z.); (X.Y.); (J.Y.)
| | | | | |
Collapse
|
6
|
Monaco E, Mouthon M, Britz J, Sato S, Stefanos-Yakoub I, Annoni JM, Jost LB. Embodiment of action-related language in the native and a late foreign language - An fMRI-study. BRAIN AND LANGUAGE 2023; 244:105312. [PMID: 37579516 DOI: 10.1016/j.bandl.2023.105312] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 08/05/2023] [Accepted: 08/07/2023] [Indexed: 08/16/2023]
Abstract
Theories of embodied cognition postulate that language processing activates similar sensory-motor structures as when interacting with the environment. Only little is known about the neural substrate of embodiment in a foreign language (L2) as compared to the mother tongue (L1). In this fMRI study, we investigated embodiment of motor and non-motor action verbs in L1 and L2 including 31 late bilinguals. Half had German as L1 and French as L2, and the other half vice-versa. We collapsed across languages to avoid the confound between language and order of language acquisition. Region of interest analyses showed stronger activation in motor regions during L2 than during L1 processing, independently of the motor-relatedness of the verbs. Moreover, a stronger involvement of motor regions for motor-related as compared to non-motor-related verbs, similarly for L1 and L2, was found. Overall, the similarity between L1 and L2 embodiment seems to depend on individual and contextual factors.
Collapse
Affiliation(s)
- E Monaco
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - M Mouthon
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - J Britz
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - S Sato
- Department of Psychology, University of Fribourg, Switzerland
| | - I Stefanos-Yakoub
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - J M Annoni
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - L B Jost
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland.
| |
Collapse
|
7
|
Schütt E, Dudschig C, Bergen BK, Kaup B. Sentence-based mental simulations: Evidence from behavioral experiments using garden-path sentences. Mem Cognit 2023; 51:952-965. [PMID: 36307639 PMCID: PMC10129931 DOI: 10.3758/s13421-022-01367-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/11/2022] [Indexed: 11/07/2022]
Abstract
Language comprehenders activate mental representations of sensorimotor experiences related to the content of utterances they process. However, it is still unclear whether these sensorimotor simulations are driven by associations with words or by a more complex process of meaning composition into larger linguistic expressions, such as sentences. In two experiments, we investigated whether comprehenders indeed create sentence-based simulations. Materials were constructed such that simulation effects could only emerge from sentence meaning and not from word-based associations alone. We additionally asked when during sentence processing these simulations are constructed, using a garden-path paradigm. Participants read either a garden-path sentence (e.g., "As Mary ate the egg was in the fridge") or a corresponding unambiguous control with the same meaning and words (e.g., "The egg was in the fridge as Mary ate"). Participants then judged whether a depicted entity was mentioned in the sentence or not. In both experiments, picture response times were faster when the picture was compatible (vs. incompatible) with the sentence-based interpretation of the target entity (e.g., both for garden-path and control sentence: an unpeeled egg), suggesting that participants created simulations based on the sentence content and only operating over the sentence as a whole.
Collapse
Affiliation(s)
- Emanuel Schütt
- Department of Psychology, Language and Cognition Research Group, University of Tübingen, Schleichstr. 4, 72076, Tübingen, Germany.
| | - Carolin Dudschig
- Department of Psychology, Language and Cognition Research Group, University of Tübingen, Schleichstr. 4, 72076, Tübingen, Germany
| | - Benjamin K Bergen
- Department of Cognitive Science, University of California at San Diego, La Jolla, CA, USA
| | - Barbara Kaup
- Department of Psychology, Language and Cognition Research Group, University of Tübingen, Schleichstr. 4, 72076, Tübingen, Germany
| |
Collapse
|
8
|
Replacing vertical actions by mouse movements: a web-suited paradigm for investigating vertical spatial associations. PSYCHOLOGICAL RESEARCH 2023; 87:194-209. [PMID: 35132464 PMCID: PMC8821857 DOI: 10.1007/s00426-022-01650-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 01/19/2022] [Indexed: 01/27/2023]
Abstract
The number of web-based studies in experimental psychology has been growing tremendously throughout the last few years. However, a straightforward web-based implementation does not exist for all types of experimental paradigms. In the current paper, we focus on how vertical response movements-which play a crucial role in spatial cognition and language research-can be translated into a web-based setup. Specifically, we introduce a web-suited counterpart of the vertical Stroop task (e.g., Fox & Shor, in Bull Psychon Soc 7:187-189, 1976; Lachmair et al., in Psychon Bull Rev 18:1180-1188, 2011; Thornton et al., in J Exp Psychol Hum Percept Perform 39:964-973, 2013). We employed nouns referring to entities typically located in lower or upper vertical space (e.g., "worm" and "bird", respectively) in Experiments 1 and 2, and emotional valence words associated with a crouched or an upward bodily posture (e.g., "sadness" and "excitement", respectively) in Experiment 3. Depending on the font color, our participants used their mouse to drag the words to the lower or upper screen location. Across all experiments, we consistently observed congruency effects analogous to those obtained with the lab paradigm using actual vertical arm movements. Consequently, we conclude that our web-suited paradigm establishes a reliable approach to examining vertical spatial associations.
Collapse
|
9
|
Bai Y, He W. Involvement of the sensorimotor system in less advanced L2 processing: Evidence from a semantic category decision task. Front Psychol 2022; 13:980967. [DOI: 10.3389/fpsyg.2022.980967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 09/20/2022] [Indexed: 12/04/2022] Open
Abstract
There is increasing evidence indicating that the sensorimotor system is involved in advanced L2 processing, which raises the question of what role sensorimotor information plays in the course of less advanced L2 comprehension. In the current study, two experiments were conducted using a lexical decision task (LDT) and semantic category task (SCT). The results showed that, in the LDT, a task more likely to result in participants making judgments based on the physical properties of words (e.g., familiarity, orthography), “up” words (e.g., sun, plane) did not result in faster upward than downward responses, and “down” words (e.g., tunnel, cave) also did not result in faster downward than upward responses. In the SCT, compatibility effects were found; specifically, searching for the up target after “up” words was faster than after “down” words and searching for the bottom target after “down” words was faster than after “upward-pointing” words. Hence, we concluded that L2 sensorimotor association, at least for L2 with low proficiency, not automatic in nature and is dependent upon deeper semantic task demands.
Collapse
|
10
|
Wang M, Li L, Xie J, Wang Y, Chen Y, Wang R. Positive Valence Bias in L2 Vocabulary Acquisition: Evidence From Chinese Emotion Idioms. Front Psychol 2022; 13:783604. [PMID: 35369182 PMCID: PMC8966680 DOI: 10.3389/fpsyg.2022.783604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Accepted: 01/24/2022] [Indexed: 11/25/2022] Open
Abstract
Positive valence bias refers to speakers responding faster to positive than negative information in L2 emotion words. Few researchers paid attention to the initial learning phase of L2 Chinese emotion idioms in which whether positive valence bias was acquired, based on the three-stage model of L2 vocabulary acquisition. Besides, whether the semantic information would modulate positive valence bias at the initial learning phase remained unclear. This study reports two experiments on speakers learning Chinese as a second language (CSL) to investigate positive valence bias in the initial learning phase of new Chinese emotion idioms and the modulation of semantic information on positive valence bias. Chinese as a second language speakers, who had acquired new Chinese emotion idioms and passed the test for learned Chinese idioms with a high accuracy rate before formal experiments, participated in Experiments 1 and 2. In Experiment 1, target materials were new Chinese idioms with positive and negative information. Positive valence bias at the initial learning phase of Chinese idioms was investigated with valence judgments. Experiment 2 used a semantic relatedness decision task further to explore the semantic effect on positive valence bias. The result in the first experiment showed that positive valence bias appeared in Chinese emotion idioms even at the initial learning phase of the acquisition. Meanwhile, semantic information of Chinese emotion idioms appeared to affect positive valence bias in the infant learning phase in Experiment 2. The findings revealed that semantic information would affect the performance of positive valence bias, suggesting that the semantic processing would automatically access the valence at the infant learning phase L2 Chinese emotion idioms. The research results provided evidence that positive valence bias would form in the infant learning phase of Chinese emotion idiom acquisition, based on the L2 vocabulary acquisition model.
Collapse
Affiliation(s)
- Mengxing Wang
- School of Foreign Studies, South China Normal University, Guangzhou, China.,The Key Laboratory of Chinese Learning and International Promotion, and College of International Culture, South China Normal University, Guangzhou, China
| | - Li Li
- The Key Laboratory of Chinese Learning and International Promotion, and College of International Culture, South China Normal University, Guangzhou, China
| | - Jiushu Xie
- School of Psychology, Nanjing Normal University, Nanjing, China
| | - Yaoyao Wang
- The Key Laboratory of Chinese Learning and International Promotion, and College of International Culture, South China Normal University, Guangzhou, China.,Lijin Primary School, Shenzhen, China
| | - Yao Chen
- School of Foreign Studies, South China Normal University, Guangzhou, China.,The Key Laboratory of Chinese Learning and International Promotion, and College of International Culture, South China Normal University, Guangzhou, China
| | - Ruiming Wang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University), Ministry of Education, Guangzhou, China
| |
Collapse
|
11
|
Kang X, Ge H. Tracking Object-State Representations During Real-Time Language Comprehension by Native and Non-native Speakers of English. Front Psychol 2022; 13:819243. [PMID: 35310281 PMCID: PMC8931953 DOI: 10.3389/fpsyg.2022.819243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2021] [Accepted: 02/08/2022] [Indexed: 11/16/2022] Open
Abstract
The present "visual world" eye-tracking study examined the time-course of how native and non-native speakers keep track of implied object-state representations during real-time language processing. Fifty-two native speakers of English and 46 non-native speakers with advanced English proficiency joined this study. They heard short stories describing a target object (e.g., an onion) either having undergone a substantial change-of-state (e.g., chop the onion) or a minimal change-of-state (e.g., weigh the onion) while their eye movements toward competing object-states (e.g., a chopped onion vs. an intact onion) and two unrelated distractors were tracked. We found that both groups successfully directed their visual attention toward the end-state of the target object that was implied in the linguistic context. However, neither group showed anticipatory eye movements toward the implied object-state when hearing the critical verb (e.g., "weigh/chop"). Only native English speakers but not non-native speakers showed a bias in visual attention during the determiner ("the") before the noun (e.g., "onion"). Our results suggested that although native and non-native speakers of English largely overlapped in their time-courses of keeping track of object-state representations during real-time language comprehension, non-native speakers showed a short delay in updating the implied object-state representations.
Collapse
Affiliation(s)
- Xin Kang
- Research Centre for Language, Cognition and Language Application, Chongqing University, Chongqing, China
- School of Foreign Languages and Cultures, Chongqing University, Chongqing, China
| | - Haoyan Ge
- School of Education and Languages, Hong Kong Metropolitan University, Hong Kong, Hong Kong SAR, China
| |
Collapse
|
12
|
SHI R, XIE J, YANG M, WANG R. The influence of language and context on sensorimotor simulation of concrete concepts. ACTA PSYCHOLOGICA SINICA 2022. [DOI: 10.3724/sp.j.1041.2022.00583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
13
|
Günther F, Press SA, Dudschig C, Kaup B. The limits of automatic sensorimotor processing during word processing: investigations with repeated linguistic experience, memory consolidation during sleep, and rich linguistic learning contexts. PSYCHOLOGICAL RESEARCH 2021; 86:1792-1803. [PMID: 34853868 PMCID: PMC9363289 DOI: 10.1007/s00426-021-01620-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Accepted: 11/10/2021] [Indexed: 12/04/2022]
Abstract
While a number of studies have repeatedly demonstrated an automatic activation of sensorimotor experience during language processing in the form of action-congruency effects, as predicted by theories of grounded cognition, more recent research has not found these effects for words that were just learned from linguistic input alone, without sensorimotor experience with their referents. In the present study, we investigate whether this absence of effects can be attributed to a lack of repeated experience and consolidation of the associations between words and sensorimotor experience in memory. To address these issues, we conducted four experiments in which (1 and 2) participants engaged in two separate learning phases in which they learned novel words from language alone, with an intervening period of memory-consolidating sleep, and (3 and 4) we employed familiar words whose referents speakers have no direct experience with (such as plankton). However, we again did not observe action-congruency effects in subsequent test phases in any of the experiments. This indicates that direct sensorimotor experience with word referents is a necessary requirement for automatic sensorimotor activation during word processing.
Collapse
|
14
|
Hamedi SM, Pishghadam R. Visual Attention and Lexical Involvement in L1 and L2 Word Processing: Emotional Stroop Effect. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2021; 50:585-602. [PMID: 32529535 DOI: 10.1007/s10936-020-09709-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Given the fact that the process of engaging and interacting with the text is not only the function of a reader but also the text itself, the current study attempts to examine the role of the type of the word in the attentional engagement. More specifically, the present investigation aims to verify the interplay of sensorimotor information, emotions, and the linguistic information in the word processing. In so doing, for the scale validation, a sample of 220 Iranian English as a Foreign Language (EFL) learners from different language institutes were requested to complete the newly designed Persian and English lexical involvement scales. The results of Structural Equation Modeling (SEM) supported the factor structure and the reliability of the measures. Moreover, using Emotional Stroop task in the experimental set up, the results revealed that there is a strong positive relationship between lexical involvement and visual attentional engagement in L1(Persian). The association was conversely negative in L2 (English). Finally, the statistical analysis indicates that the lexical stimuli differ regarding their magnitude of lexical involvement in L1 and L2.
Collapse
Affiliation(s)
| | - Reza Pishghadam
- Language Education, Ferdowsi University of Mashhad, Mashad, Iran.
| |
Collapse
|
15
|
fMRI evidence reveals emotional biases in bilingual decision making. Brain Struct Funct 2021; 226:1405-1421. [PMID: 33675396 DOI: 10.1007/s00429-021-02246-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 02/26/2021] [Indexed: 01/16/2023]
Abstract
Research indicates that the foreign language effect on decision making can be partially explained by a reduction in emotional response in the second language. In this fMRI study, we aimed at elucidating the neural mechanisms underpinning the interaction between language and emotion in decision making. Across multiple trials, Chinese-English bilinguals were asked to decide whether to gamble in a Gambling task, and received feedbacks either in L1 (Chinese) or in L2 (English). If they gambled, feedbacks were either positively or negatively valenced words; if they did not gamble, feedback was the word 'safe'. We assessed how emotionally valenced words were processed in the two languages, and how this processing influenced subsequent decision making. Overall, we found evidence that in L2 context, but not in L1 context, loss aversion was mediated by the dorsolateral prefrontal cortex (dlPFC) which also showed strong functional connectivity with the visual cortex, suggesting an avoidance mechanism for negative stimuli in L2. However, we also found an enhanced response to positive feedbacks in L2 compared to L1, as evidenced by greater activation of the hippocampus for win feedbacks compared to safe feedbacks in L2, eventually resulting in a greater tendency to gamble. Thus, foreign language influenced decision making by both regulating emotional response to negative stimuli and enhancing emotional response to positive stimuli. This study helps unveiling the neural bases of the interaction between language and emotion in the foreign language context.
Collapse
|
16
|
Kaye LK, Rodriguez-Cuadrado S, Malone SA, Wall HJ, Gaunt E, Mulvey AL, Graham C. How emotional are emoji?: Exploring the effect of emotional valence on the processing of emoji stimuli. COMPUTERS IN HUMAN BEHAVIOR 2021. [DOI: 10.1016/j.chb.2020.106648] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
17
|
Tse CS, Huang Y, Zeng T, Zhou Y, Chan YL. The influence of congruency proportion, target eccentricity, and valence strength on the spatial-valence metaphoric congruency effect in a word valence judgment task. PSYCHOLOGICAL RESEARCH 2020; 85:2610-2635. [PMID: 33025209 PMCID: PMC7538056 DOI: 10.1007/s00426-020-01422-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2019] [Accepted: 09/14/2020] [Indexed: 01/03/2023]
Abstract
In a word valence judgment task, positive words (e.g., excellence) are judged faster when presented at the top (congruent position) than at the bottom of the screen (incongruent position), whereas the opposite pattern occurs for negative words (e.g., disaster). This spatial-valence metaphoric congruency effect reflects top-positive/bottom-negative metaphoric association and may be attributed to at least three possible mechanisms: spreading activation between spatial and valence concepts (activation account), epistemic function that a conceptual metaphor serves to reduce the uncertainty associated with valence concepts (epistemic account), and/or the extent to which spatial-valence metaphoric association is relevant to task demand (relevance account). In three experiments, we manipulated congruency proportion, target eccentricity, and valence strength in a word valence judgment task to test these three possible accounts. Results showed that the metaphoric congruency effect was larger when a high (vs. equal) proportion of targets appears in congruent, relative to incongruent, position, and for targets with strong (vs. weak) valence. However, the effect in reaction time measure was not modulated by whether the target appeared in the position being near vs. far away from the center of the screen. The overall findings are better accommodated by the relevance account. The implications of the current findings on other theoretical accounts, such as Conceptual Metaphor Theory and polarity correspondence account, are also discussed.
Collapse
Affiliation(s)
- Chi-Shing Tse
- Department of Educational Psychology, The Chinese University of Hong Kong, New Territories, Hong Kong, China.
- Centre for Learning Sciences and Technologies, The Chinese University of Hong Kong, Hong Kong, China.
| | - Yanli Huang
- School of Psychology, Nanjing Normal University, Nanjing, China
| | - Taoran Zeng
- Department of Educational Psychology, The Chinese University of Hong Kong, New Territories, Hong Kong, China
- Department of Sports Science and Physical Education, The Chinese University of Hong Kong, Hong Kong, China
| | - Yanyun Zhou
- Department of Educational Psychology, The Chinese University of Hong Kong, New Territories, Hong Kong, China
| | - Yuen-Lai Chan
- Department of Educational Psychology, The Chinese University of Hong Kong, New Territories, Hong Kong, China
| |
Collapse
|
18
|
How words ripple through bilingual hands: Motor-language coupling during L1 and L2 writing. Neuropsychologia 2020; 146:107563. [PMID: 32682797 DOI: 10.1016/j.neuropsychologia.2020.107563] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Revised: 07/11/2020] [Accepted: 07/13/2020] [Indexed: 11/22/2022]
Abstract
The speed of our hand movements can be affected by concurrent processing of manual action verbs (MaVs). Whereas this phenomenon is well established for native languages (L1s), it remains underexplored in late foreign languages (L2s), especially during highly automatized tasks. Here we timed keystroke activity while Spanish-English bilinguals copied MaVs, non-manual action verbs, and non-action verbs in their L1 and L2. Motor planning and execution dynamics were indexed by first-letter lag (the time-lapse between word presentation and first keystroke) and whole-word lag (the time-lapse between first and last keystroke), respectively. Despite yielding no effects on motor planning, MaVs facilitated typing execution in L1 but delayed it in L2, irrespective of the subjects' typing skills, age of L2 learning, and L2 competence. Therefore, motor-language coupling effects seem to be present in both languages though they can arise differently in each. These results extend language grounding models, illuminating the role of embodied mechanisms throughout life.
Collapse
|
19
|
Macedonia M, Lehner AE, Repetto C. Positive effects of grasping virtual objects on memory for novel words in a second language. Sci Rep 2020; 10:10760. [PMID: 32612096 PMCID: PMC7329851 DOI: 10.1038/s41598-020-67539-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2019] [Accepted: 06/09/2020] [Indexed: 11/19/2022] Open
Abstract
Theories of embodied cognition describe language processing and representation as inherently connected to the sensorimotor experiences collected during acquisition. While children grasp their world, collect bodily experiences and name them, in second language (L2), students learn bilingual word lists. Experimental evidence shows that embodiment by mean of gestures enhances memory for words in L2. However, no study has been conducted on the effects of grasping in L2. In a virtual scenario, we trained 46 participants on 18 two- and three-syllabic words of Vimmi, an artificial corpus created for experimental purposes. The words were assigned concrete meanings of graspable objects. Six words were learned audio-visually, by reading the words projected on the wall and by hearing them. Another 6 words were trained by observation of virtual objects. Another 6 words were learned by observation and additional grasping the virtual objects. Thereafter participants were subministered free, cued recall, and reaction time tests in order to assess the word retention and the word recognition. After 30 days, the recall tests were repeated remotely to assess the memory in the long term. The results show that grasping of virtual objects can lead to superior memory performance and to lower reaction times during recognition.
Collapse
Affiliation(s)
- M Macedonia
- Department of Information Engineering, Johannes Kepler University, Linz, Austria.
- Linz Center of Mechatronics GmbH, Johannes Kepler University, Linz, Austria.
- Lise Meitner Research Group "Cognition and Plasticity", Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - A E Lehner
- Department of Linguistics, University of Vienna, Vienna, Austria
| | - C Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
| |
Collapse
|
20
|
Birba A, Beltrán D, Martorell Caro M, Trevisan P, Kogan B, Sedeño L, Ibáñez A, García AM. Motor-system dynamics during naturalistic reading of action narratives in first and second language. Neuroimage 2020; 216:116820. [PMID: 32278096 PMCID: PMC7412856 DOI: 10.1016/j.neuroimage.2020.116820] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 02/06/2020] [Accepted: 03/27/2020] [Indexed: 12/12/2022] Open
Abstract
Do embodied semantic systems play different roles depending on when and how well a given language was learned? Emergent evidence suggests that this is the case for isolated, decontextualized stimuli, but no study has addressed the issue considering naturalistic narratives. Seeking to bridge this gap, we assessed motor-system dynamics in 26 Spanish-English bilinguals as they engaged in free, unconstrained reading of naturalistic action texts (ATs, highlighting the characters’ movements) and neutral texts (NTs, featuring low motility) in their first and second language (L1, L2). To explore functional connectivity spread over each reading session, we recorded ongoing high-density electroencephalographic signals and subjected them to functional connectivity analysis via a spatial clustering approach. Results showed that, in L1, AT (relative to NT) reading involved increased connectivity between left and right central electrodes consistently implicated in action-related processes, as well as distinct source-level modulations in motor regions. In L2, despite null group-level effects, enhanced motor-related connectivity during AT reading correlated positively with L2 proficiency and negatively with age of L2 learning. Taken together, these findings suggest that action simulations during unconstrained narrative reading involve neural couplings between motor-sensitive mechanisms, in proportion to how consolidated a language is. More generally, such evidence addresses recent calls to test the ecological validity of motor-resonance effects while offering new insights on their relation with experiential variables.
Collapse
Affiliation(s)
- Agustina Birba
- Universidad de San Andrés, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, C1425FQB, Argentina
| | - David Beltrán
- Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, Tenerife, 3820, Spain
| | - Miguel Martorell Caro
- Universidad de San Andrés, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, C1425FQB, Argentina
| | | | - Boris Kogan
- Institute of Basic and Applied Psychology and Technology (IPSIBAT), National University of Mar del Plata, Buenos Aires, Argentina; National Agency of Scientific and Technological Promotion (ANPCyT), Buenos Aires, Argentina
| | - Lucas Sedeño
- National Scientific and Technical Research Council (CONICET), Buenos Aires, C1425FQB, Argentina
| | - Agustín Ibáñez
- Universidad de San Andrés, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, C1425FQB, Argentina; Centre of Excellence in Cognition and Its Disorders, Australian Research Council (ARC), Sydney, NSW, 2109, Australia; Center for Social and Cognitive Neuroscience (CSCN), School of Psychology, Universidad Adolfo Ibáñez, Santiago de Chile, 7550344, Chile; Universidad Autónoma del Caribe, Barranquilla, 08002, Colombia
| | - Adolfo M García
- Universidad de San Andrés, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, C1425FQB, Argentina; Faculty of Education, National University of Cuyo, Mendoza, M5502JMA, Argentina; Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, Santiago, Chile.
| |
Collapse
|
21
|
Chen D, Wang R, Zhang J, Liu C. Perceptual Representations in L1, L2 and L3 Comprehension: Delayed Sentence-Picture Verification. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2020; 49:41-57. [PMID: 31468246 DOI: 10.1007/s10936-019-09670-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
We used delayed sentence-picture verification tasks to investigate multilingual perceptual representations. In experiment 1, participants listened to sentences with implied shapes. After a 10-min interval, they judged whether pictures had been mentioned in the preceding sentences or not. Results in experiment 1 showed significant match effect in L1, but not in high proficient L2 or low proficient L3. In experiment 2, Participants listened to one language block, then immediately judged one picture block, totally three language-picture blocks. Results in experiment 2 were parallel to results in experiment 1. Our study supports the view of distributed conception: L2 and L3 are associated with less perceptual symbols than L1, indicating great impact of acquisition styles on perceptual representations. Our results show little impact of language proficiency levels on perceptual representations in delayed tasks.
Collapse
Affiliation(s)
- Donggui Chen
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Zhongshan Street West, 55, Tianhe District, Guangzhou, 510613, China
- School of Foreign Languages, Guangdong Polytechnic Normal University, Guangzhou, China
| | - Ruiming Wang
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Zhongshan Street West, 55, Tianhe District, Guangzhou, 510613, China.
| | - Jinqiao Zhang
- College of Chinese Language and Culture, Jinan University, Guangzhou, China
| | - Cong Liu
- Department of Psychology, Qingdao University, Qingdao, 266071, China
| |
Collapse
|
22
|
Too late to be grounded? Motor resonance for action words acquired after middle childhood. Brain Cogn 2019; 138:105509. [PMID: 31855702 DOI: 10.1016/j.bandc.2019.105509] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 11/23/2019] [Accepted: 12/04/2019] [Indexed: 11/22/2022]
Abstract
Though well established for languages acquired in infancy, the role of embodied mechanisms remains poorly understood for languages learned in middle childhood and adulthood. To bridge this gap, we examined 34 experiments that assessed sensorimotor resonance during processing of action-related words in real and artificial languages acquired since age 7 and into adulthood. Evidence from late bilinguals indicates that foreign-language action words modulate neural activity in motor circuits and predictably facilitate or delay physical movements (even in an effector-specific fashion), with outcomes that prove partly sensitive to language proficiency. Also, data from newly learned vocabularies suggest that embodied effects emerge after brief periods of adult language exposure, remain stable through time, and hinge on the performance of bodily movements (and, seemingly, on action observation, too). In sum, our work shows that infant language exposure is not indispensable for the recruitment of embodied mechanisms during language processing, a finding that carries non-trivial theoretical, pedagogical, and clinical implications for neurolinguistics, in general, and bilingualism research, in particular.
Collapse
|
23
|
Zhao T, Huang Y, Chen D, Jiao L, Marmolejo-Ramos F, Wang R, Xie J. The modality switching costs of Chinese-English bilinguals in the processing of L1 and L2. Q J Exp Psychol (Hove) 2019; 73:396-412. [PMID: 31552800 DOI: 10.1177/1747021819878089] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Modality switching cost indicates that people's performance becomes worse when they judge sequential information that is related to different sensory modalities than judging information that is related to the same modality. In this study, we conducted three experiments on proficient and non-proficient bilingual individuals to investigate the modality switching costs in L1 and L2 processing separately. In Experiment 1, materials were L1 and L2 words that were either conceptually related to a visual modality (e.g., light) or related to an auditory modality (e.g., song). The modality switching costs were investigated in a lexical decision task in both L1 and L2. Experiment 2 further explored the modality switching costs while weakening the activation level of the perceptual modality by adding a set of fillers. Experiment 3 used a word-naming task to explore the modality switching effect in language production in L1 and L2. Results of these experiments showed that the modality switching costs appeared in both language comprehension and production in L1 and L2 conditions. The magnitude of the modality switching costs was conditionally modulated by the L2 proficiency level, such as in the L2 condition in Experiment 1 and in both L1 and L2 conditions in Experiment 3. These results suggest that sensorimotor simulation is involved in not only language comprehension but also language production. The sensorimotor simulation that is acquired in L1 can be transferred to L2.
Collapse
Affiliation(s)
- Tianyang Zhao
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Yanli Huang
- School of Psychology, Nanjing Normal University, Nanjing, China
| | - Donggui Chen
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Lu Jiao
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Fernando Marmolejo-Ramos
- Gösta Ekman's Laboratory, Department of Psychology, Stockholm University, Stockholm, Sweden.,Centre for Change and Complexity in Learning, University of South Australia, Adelaide, SA, Australia
| | - Ruiming Wang
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou, China
| | - Jiushu Xie
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
24
|
Monaco E, Jost LB, Gygax PM, Annoni JM. Embodied Semantics in a Second Language: Critical Review and Clinical Implications. Front Hum Neurosci 2019; 13:110. [PMID: 30983983 PMCID: PMC6449436 DOI: 10.3389/fnhum.2019.00110] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2018] [Accepted: 03/12/2019] [Indexed: 12/20/2022] Open
Abstract
The role of the sensorimotor system in second language (L2) semantic processing as well as its clinical implications for bilingual patients has hitherto been neglected. We offer an overview of the issues at stake in this under-investigated field, presenting the theoretical and clinical relevance of studying L2 embodiment and reviewing the few studies on this topic. We highlight that (a) the sensorimotor network is involved in L2 processing, and that (b) in most studies, L2 is differently embodied than L1, reflected in a lower degree or in a different pattern of L2 embodiment. Importantly, we outline critical issues to be addressed in order to guide future research. We also delineate the subsequent steps needed to confirm or dismiss the value of language therapeutic approaches based on embodiment theories as a complement of speech and language therapies in adult bilinguals.
Collapse
Affiliation(s)
- Elisa Monaco
- Laboratory for Cognitive and Neurological Sciences, Neurology Unit, Medicine Section, Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Lea B. Jost
- Laboratory for Cognitive and Neurological Sciences, Neurology Unit, Medicine Section, Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Pascal M. Gygax
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Jean-Marie Annoni
- Laboratory for Cognitive and Neurological Sciences, Neurology Unit, Medicine Section, Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
- Neurology Unit, Fribourg Cantonal Hospital, Fribourg, Switzerland
| |
Collapse
|
25
|
Kühne K, Gianelli C. Is Embodied Cognition Bilingual? Current Evidence and Perspectives of the Embodied Cognition Approach to Bilingual Language Processing. Front Psychol 2019; 10:108. [PMID: 30787892 PMCID: PMC6373578 DOI: 10.3389/fpsyg.2019.00108] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2017] [Accepted: 01/14/2019] [Indexed: 11/21/2022] Open
Abstract
Accumulating behavioral and neurophysiological evidence supports the idea of language being grounded in sensorimotor processes, with indications of a functional role of motor, sensory and emotional systems in processing both concrete and abstract linguistic concepts. However, most of the available studies focused on native language speakers (L1), with only a limited number of investigations testing embodied language processing in the case of a second language (L2). In this paper we review the available evidence on embodied effects in L2 and discuss their possible integration into existing models of linguistic processing in L1 and L2. Finally, we discuss possible avenues for future research towards an integrated model of L1 and L2 sensorimotor and emotional grounding.
Collapse
Affiliation(s)
| | - Claudia Gianelli
- Division of Cognitive Sciences, University of Potsdam, Potsdam, Germany
| |
Collapse
|
26
|
The bidirectional congruency effect of brightness-valence metaphoric association in the Stroop-like and priming paradigms. Acta Psychol (Amst) 2018; 189:76-92. [PMID: 29108645 DOI: 10.1016/j.actpsy.2017.10.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2017] [Revised: 09/05/2017] [Accepted: 10/17/2017] [Indexed: 11/22/2022] Open
Abstract
The conceptual metaphor theory (Lakoff & Johnson, 1980, 1999) postulates a unidirectional metaphoric association between abstract and concrete concepts: sensorimotor experience activated by concrete concepts facilitates the processing of abstract concepts, but not the other way around. However, this unidirectional view has been challenged by studies that reported a bidirectional metaphoric association. In three experiments, we tested the directionality of the brightness-valence metaphoric association, using Stroop-like paradigm, priming paradigm, and Stroop-like paradigm with a go/no-go manipulation. Both mean and vincentile analyses of reaction time data were performed. We showed that the directionality of brightness-valence metaphoric congruency effect could be modulated by the activation level of the brightness/valence information. Both brightness-to-valence and valence-to-brightness metaphoric congruency effects occurred in the priming paradigm, which could be attributed to the presentation of prime that pre-activated the brightness or valence information. However, in the Stroop-like paradigm the metaphoric congruency effect was only observed in the brightness-to-valence direction, but not in the valence-to-brightness direction. When the go/no-go manipulation was used to boost the activation of word meaning in the Stroop-like paradigm, the valence-to-brightness metaphoric congruency effect was observed. Vincentile analyses further revealed that valence-to-brightness metaphoric congruency effect approached significance in the Stroop-like paradigm when participants' reaction times were slower (at around 490ms). The implications of the current findings on the conceptual metaphor theory and embodied cognition are discussed.
Collapse
|
27
|
Ahlberg DK, Bischoff H, Strozyk JV, Bryant D, Kaup B. How do German bilingual schoolchildren process German prepositions? - A study on language-motor interactions. PLoS One 2018. [PMID: 29538404 PMCID: PMC5851577 DOI: 10.1371/journal.pone.0193349] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
While much support is found for embodied language processing in a first language (L1), evidence for embodiment in second language (L2) processing is rather sparse. In a recent study, we found support for L2 embodiment, but also an influence of L1 on L2 processing in adult learners. In the present study, we compared bilingual schoolchildren who speak German as one of their languages with monolingual German schoolchildren. We presented the German prepositions auf (on), über (above), and unter (under) in a Stroop-like task. Upward or downward responses were made depending on the font colour, resulting in compatible and incompatible trials. We found compatibility effects for all children, but in contrast to the adult sample, there were no processing differences between the children depending on the nature of their other language, suggesting that the processing of German prepositions of bilingual children is embodied in a similar way as in monolingual German children.
Collapse
Affiliation(s)
| | - Heike Bischoff
- Institute of German Language and Literature, Eberhard Karls University, Tübingen, Germany
| | | | - Doreen Bryant
- Institute of German Language and Literature, Eberhard Karls University, Tübingen, Germany
| | - Barbara Kaup
- Department of Psychology, Eberhard Karls University, Tübingen, Germany
| |
Collapse
|
28
|
Günther F, Dudschig C, Kaup B. Symbol Grounding Without Direct Experience: Do Words Inherit Sensorimotor Activation From Purely Linguistic Context? Cogn Sci 2017; 42 Suppl 2:336-374. [PMID: 29052241 DOI: 10.1111/cogs.12549] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2017] [Revised: 07/30/2017] [Accepted: 08/14/2017] [Indexed: 11/30/2022]
Abstract
Theories of embodied cognition assume that concepts are grounded in non-linguistic, sensorimotor experience. In support of this assumption, previous studies have shown that upwards response movements are faster than downwards movements after participants have been presented with words whose referents are typically located in the upper vertical space (and vice versa for downwards responses). This is taken as evidence that processing these words reactivates sensorimotor experiential traces. This congruency effect was also found for novel words, after participants learned these words as labels for novel objects that they encountered either in their upper or lower visual field. While this indicates that direct experience with a word's referent is sufficient to evoke said congruency effects, the present study investigates whether this direct experience is also a necessary condition. To this end, we conducted five experiments in which participants learned novel words from purely linguistic input: Novel words were presented in pairs with real up- or down-words (Experiment 1); they were presented in natural sentences where they replaced these real words (Experiment 2); they were presented as new labels for these real words (Experiment 3); and they were presented as labels for novel combined concepts based on these real words (Experiment 4 and 5). In all five experiments, we did not find any congruency effects elicited by the novel words; however, participants were always able to make correct explicit judgements about the vertical dimension associated to the novel words. These results suggest that direct experience is necessary for reactivating experiential traces, but this reactivation is not a necessary condition for understanding (in the sense of storing and accessing) the corresponding aspects of word meaning.
Collapse
Affiliation(s)
| | | | - Barbara Kaup
- Department of Psychology, University of Tübingen
| |
Collapse
|
29
|
Fan L, Xu Q, Wang X, Xu F, Yang Y, Lu Z. The automatic activation of emotion words measured using the emotional face-word Stroop task in late Chinese–English bilinguals. Cogn Emot 2017; 32:315-324. [DOI: 10.1080/02699931.2017.1303451] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Lin Fan
- National Research Centre for Foreign Language Education, Beijing Foreign Studies University, Beijing, People’s Republic of China
| | - Qiang Xu
- Department of Psychology, Ningbo University, Ningbo, People’s Republic of China
| | - Xiaoxi Wang
- College of Foreign Language and Literature, Ningbo University, Ningbo, People’s Republic of China
| | - Fei Xu
- Department of English, Qingdao University of Science and Technology, Gaomi, People’s Republic of China
| | - Yaping Yang
- Department of Psychology, Ningbo University, Ningbo, People’s Republic of China
| | - Zhi Lu
- Collaborative Innovation Center for Language Research and Services, Guangdong University of Foreign Studies, Guangzhou, People’s Republic of China
| |
Collapse
|
30
|
Morawetz C, Oganian Y, Schlickeiser U, Jacobs AM, Heekeren HR. Second Language Use Facilitates Implicit Emotion Regulation via Content Labeling. Front Psychol 2017; 8:366. [PMID: 28360873 PMCID: PMC5352656 DOI: 10.3389/fpsyg.2017.00366] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2016] [Accepted: 02/27/2017] [Indexed: 12/14/2022] Open
Abstract
Previous studies reported that negative stimuli induced less affect in bilinguals when stimuli were presented in bilinguals’ second, weaker language (L2) than when they were presented in their native language (L1). This effect of L2 use was attributed to increased emotional distance as well as to increased levels of cognitive control during L2 use. Here we investigated how explicit (cognitive reappraisal, i.e., reinterpreting the meaning of the emotional stimulus to alter its emotional impact) and implicit (content labeling, i.e., categorizing the content of the image; and emotion labeling, i.e., naming the emotion induced by the emotional stimulus) emotion regulation strategies are altered in an L2 (English) context in German native speakers with medium to high proficiency in their L2. While previous studies used linguistic stimuli, such as words, to induce affect, here we used images to test whether reduced affect could also be observed for non-linguistic stimuli when presented in an L2 context. We hypothesized that the previously implicated increase in emotional distance and cognitive control in an L2 would result in an L2 advantage in emotion regulation (i.e., leading to less negative emotions compared to an L1 context), by strengthening the effect of linguistic re-evaluation on the evoked emotions. Using a classic emotion regulation paradigm, we examined changes in subjective emotional state ratings during reappraisal, emotion labeling and content labeling in a L1 and L2 context. We found that the strength of evoked affective responses did not depend on the language context in which an image was presented. Crucially, content labeling in L2 was more effective than in L1, whereas emotion labeling did not differ between languages. Overall, evoked responses were regulated most effectively through explicit emotion regulation (reappraisal) in L1 and L2 context. These results demonstrate an L2 advantage effect for emotion regulation through content labeling and suggest that L2 context alters sub-processes implicated in content labeling but not emotion labeling.
Collapse
Affiliation(s)
- Carmen Morawetz
- Department of Education and Psychology, Freie Universität Berlin, BerlinGermany; Center for Cognitive Neuroscience Berlin, Freie Universität Berlin, BerlinGermany
| | - Yulia Oganian
- Department of Education and Psychology, Freie Universität Berlin, BerlinGermany; Bernstein Center for Computational Neuroscience Berlin, BerlinGermany
| | - Ulrike Schlickeiser
- Department of Education and Psychology, Freie Universität Berlin, Berlin Germany
| | - Arthur M Jacobs
- Department of Education and Psychology, Freie Universität Berlin, BerlinGermany; Center for Cognitive Neuroscience Berlin, Freie Universität Berlin, BerlinGermany
| | - Hauke R Heekeren
- Department of Education and Psychology, Freie Universität Berlin, BerlinGermany; Center for Cognitive Neuroscience Berlin, Freie Universität Berlin, BerlinGermany
| |
Collapse
|
31
|
Fan L, Xu Q, Wang X, Zhang F, Yang Y, Liu X. Neural Correlates of Task-Irrelevant First and Second Language Emotion Words - Evidence from the Emotional Face-Word Stroop Task. Front Psychol 2016; 7:1672. [PMID: 27847485 PMCID: PMC5088204 DOI: 10.3389/fpsyg.2016.01672] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2016] [Accepted: 10/11/2016] [Indexed: 11/13/2022] Open
Abstract
Emotionally valenced words have thus far not been empirically examined in a bilingual population with the emotional face-word Stroop paradigm. Chinese-English bilinguals were asked to identify the facial expressions of emotion with their first (L1) or second (L2) language task-irrelevant emotion words superimposed on the face pictures. We attempted to examine how the emotional content of words modulated behavioral performance and cerebral functioning in the bilinguals' two languages. The results indicated that there were significant congruency effects for both L1 and L2 emotion words, and that identifiable differences in the magnitude of the Stroop effect between the two languages were also observed, suggesting L1 is more capable of activating the emotional response to word stimuli. For event-related potentials data, an N350-550 effect was observed only in the L1 task with greater negativity for incongruent than congruent trials. The size of the N350-550 effect differed across languages, whereas no identifiable language distinction was observed in the effect of conflict slow potential (conflict SP). Finally, more pronounced negative amplitude at 230-330 ms was observed in L1 than in L2, but only for incongruent trials. This negativity, likened to an orthographic decoding N250, may reflect the extent of attention to emotion word processing at word-form level, while the N350-550 reflects a complicated set of processes in the conflict processing. Overall, the face-word congruency effect has reflected identifiable language distinction at 230-330 and 350-550 ms, which provides supporting evidence for the theoretical proposals assuming attenuated emotionality of L2 processing.
Collapse
Affiliation(s)
- Lin Fan
- National Research Centre for Foreign Language Education, Beijing Foreign Studies UniversityBeijing, China
| | - Qiang Xu
- Department of Psychology, Ningbo UniversityNingbo, China
| | - Xiaoxi Wang
- College of Foreign Language and Literature, Ningbo UniversityNingbo, China
| | - Feng Zhang
- Department of Psychology, Ningbo UniversityNingbo, China
| | - Yaping Yang
- Department of Psychology, Ningbo UniversityNingbo, China
| | - Xiaoping Liu
- School of English Studies, Tianjin Foreign Studies UniversityTianjin, China
| |
Collapse
|
32
|
Adams AM. How Language Is Embodied in Bilinguals and Children with Specific Language Impairment. Front Psychol 2016; 7:1209. [PMID: 27582716 PMCID: PMC4987363 DOI: 10.3389/fpsyg.2016.01209] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2016] [Accepted: 08/02/2016] [Indexed: 11/13/2022] Open
Abstract
This manuscript explores the role of embodied views of language comprehension and production in bilingualism and specific language impairment. Reconceptualizing popular models of bilingual language processing, the embodied theory is first extended to this area. Issues such as semantic grounding in a second language and potential differences between early and late acquisition of a second language are discussed. Predictions are made about how this theory informs novel ways of thinking about teaching a second language. Secondly, the comorbidity of speech, language, and motor impairments and how embodiment theory informs the discussion of the etiology of these impairments is examined. A hypothesis is presented suggesting that what is often referred to as specific language impairment may not be so specific due to widespread subclinical motor deficits in this population. Predictions are made about how weaknesses and instabilities in speech motor control, even at a subclinical level, may disrupt the neural network that connects acoustic input, articulatory motor plans, and semantics. Finally, I make predictions about how this information informs clinical practice for professionals such as speech language pathologists and occupational and physical therapists. These new hypotheses are placed within the larger framework of the body of work pertaining to semantic grounding, action-based language acquisition, and action-perception links that underlie language learning and conceptual grounding.
Collapse
Affiliation(s)
- Ashley M Adams
- Bilingual Language and Literacy Laboratory, Speech and Hearing Department, Arizona State University Tempe, AZ, USA
| |
Collapse
|
33
|
Dudschig C, de la Vega I, Kaup B. To fly or not to fly? The automatic influence of negation on language–space associations. Cogn Process 2015; 16 Suppl 1:203-7. [DOI: 10.1007/s10339-015-0700-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
34
|
Do we embody second language? Evidence for 'partial' simulation during processing of a second language. Brain Cogn 2015; 99:8-16. [PMID: 26188846 DOI: 10.1016/j.bandc.2015.06.006] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2014] [Revised: 06/18/2015] [Accepted: 06/23/2015] [Indexed: 11/20/2022]
Abstract
The present paper investigates whether the processing of emotion language in the context of a second language (L2) entails motor simulations and whether simulation models extend to negation also for L2. Participants were exposed to sentences in L2 describing emotional expressions while facial muscle activity was continuously measured. Sentences mapped either directly upon the zygomatic muscle (e.g., "I am smiling") or did not (e.g., "I am frowning"), and were presented in the affirmative and negative form. Similarly to studies involving first language (L1), the zygomatic muscle was activated when reading affirmative sentences relevant to the muscle. In contrast, and differently from what previously observed in L1, reading sentences in the negative form ("I am not smiling") did not lead to relaxation/inhibition of the zygomatic muscle. These results extend the simulation models to the comprehension of L2 but they also provide important constraints and contribute to the debate about grounding of the abstract and concrete concepts.
Collapse
|
35
|
Contrasting vertical and horizontal representations of affect in emotional visual search. Psychon Bull Rev 2015; 23:62-73. [DOI: 10.3758/s13423-015-0884-6] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
36
|
Dudschig C, de la Vega I, Kaup B. What's up? Emotion-specific activation of vertical space during language processing. Acta Psychol (Amst) 2015; 156:143-55. [PMID: 25454886 DOI: 10.1016/j.actpsy.2014.09.015] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2013] [Revised: 09/20/2014] [Accepted: 09/29/2014] [Indexed: 11/29/2022] Open
Abstract
The relationship between language processing and vertical space has been shown for various groups of words including valence words, implicit location words, and words referring to religious concepts. However, it remains unclear whether these are single phenomena or whether there is an underlying common mechanism. Here, we show that the evaluation of word valence interacts with motor responses in the vertical dimension, with positive (negative) evaluations facilitating upward (downward) responses. When valence evaluation was not required, implicit location words (e.g., bird, shoe) influenced motor responses whereas valence words (e.g., kiss, hate) did not. Importantly, a subset of specific emotional valence words that are commonly associated with particular bodily postures (e.g., proud→upright; sad→slouched) did automatically influence motor responses. Together, this suggests that while the vertical spatial dimension is not directly activated by word valence, it is activated when processing words referring to emotional states with stereotypical bodily-postures. These results provide strong evidence that the activation of spatial associations during language processing is experience-specific in nature and cannot be explained with reference to a general mapping between all valence words and space (i.e., all positive and negative words generally relate to spatial processing). These findings support the experiential view of language comprehension, suggesting that the automatic reactivation of bodily experiences is limited to word groups referring to emotions or entities directly associated with spatial experiences (e.g., posture or location in the world).
Collapse
|
37
|
Wolter S, Dudschig C, de la Vega I, Kaup B. Musical metaphors: evidence for a spatial grounding of non-literal sentences describing auditory events. Acta Psychol (Amst) 2015; 156:126-35. [PMID: 25443988 DOI: 10.1016/j.actpsy.2014.09.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2013] [Revised: 09/09/2014] [Accepted: 09/18/2014] [Indexed: 11/16/2022] Open
Abstract
This study investigated whether the spatial terms high and low, when used in sentence contexts implying a non-literal interpretation, trigger similar spatial associations as would have been expected from the literal meaning of the words. In three experiments, participants read sentences describing either a high or a low auditory event (e.g., The soprano sings a high aria vs. The pianist plays a low note). In all Experiments, participants were asked to judge (yes/no) whether the sentences were meaningful by means of up/down (Experiments 1 and 2) or left/right (Experiment 3) key press responses. Contrary to previous studies reporting that metaphorical language understanding differs from literal language understanding with regard to simulation effects, the results show compatibility effects between sentence implied pitch height and response location. The results are in line with grounded models of language comprehension proposing that sensory motor experiences are being elicited when processing literal as well as non-literal sentences.
Collapse
|
38
|
Macedonia M. Bringing back the body into the mind: gestures enhance word learning in foreign language. Front Psychol 2014; 5:1467. [PMID: 25538671 PMCID: PMC4260465 DOI: 10.3389/fpsyg.2014.01467] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2014] [Accepted: 11/29/2014] [Indexed: 01/13/2023] Open
Abstract
Foreign language education in the twenty-first century still teaches vocabulary mainly through reading and listening activities. This is due to the link between teaching practice and traditional philosophy of language, where language is considered to be an abstract phenomenon of the mind. However, a number of studies have shown that accompanying words or phrases of a foreign language with gestures leads to better memory results. In this paper, I review behavioral research on the positive effects of gestures on memory. Then I move to the factors that have been addressed as contributing to the effect, and I embed the reviewed evidence in the theoretical framework of embodiment. Finally, I argue that gestures accompanying foreign language vocabulary learning create embodied representations of those words. I conclude by advocating the use of gestures in future language education as a learning tool that enhances the mind.
Collapse
Affiliation(s)
- Manuela Macedonia
- Information Engineering, Johannes Kepler Universität Linz, Linz, Austria
- Neural Mechanisms of Human Communication, Max Planck Institute for Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
39
|
Dudschig C, de la Vega I, De Filippis M, Kaup B. Language and vertical space: On the automaticity of language action interconnections. Cortex 2014; 58:151-60. [DOI: 10.1016/j.cortex.2014.06.003] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2013] [Revised: 12/18/2013] [Accepted: 06/04/2014] [Indexed: 10/25/2022]
|