1
|
Molinaro N, Nara S, Carreiras M. Early language dissociation in bilingual minds: magnetoencephalography evidence through a machine learning approach. Cereb Cortex 2024; 34:bhae053. [PMID: 38367613 DOI: 10.1093/cercor/bhae053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 01/26/2024] [Accepted: 01/27/2024] [Indexed: 02/19/2024] Open
Abstract
Does neural activity reveal how balanced bilinguals choose languages? Despite using diverse neuroimaging techniques, prior studies haven't provided a definitive solution to this problem. Nonetheless, studies involving direct brain stimulation in bilinguals have identified distinct brain regions associated with language production in different languages. In this magnetoencephalography study with 45 proficient Spanish-Basque bilinguals, we investigated language selection during covert picture naming and word reading tasks. Participants were prompted to name line drawings or read words if the color of the stimulus changed to green, in 10% of trials. The task was performed either in Spanish or Basque. Despite similar sensor-level evoked activity for both languages in both tasks, decoding analyses revealed language-specific classification ~100 ms post-stimulus onset. During picture naming, right occipital-temporal sensors predominantly contributed to language decoding, while left occipital-temporal sensors were crucial for decoding during word reading. Cross-task decoding analysis unveiled robust generalization effects from picture naming to word reading. Our methodology involved a fine-grained examination of neural responses using magnetoencephalography, offering insights into the dynamics of language processing in bilinguals. This study refines our understanding of the neural underpinnings of language selection and bridges the gap between non-invasive and invasive experimental evidence in bilingual language production.
Collapse
Affiliation(s)
- Nicola Molinaro
- Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009, Donostia/San Sebastian, Spain
- Ikerbasque, Basque Foundation for Science, 48009, Bilbao, Spain
| | - Sanjeev Nara
- Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009, Donostia/San Sebastian, Spain
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-Universität Gießen (University of Giessen), 35392, Gießen, Germany
| | - Manuel Carreiras
- Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009, Donostia/San Sebastian, Spain
- Ikerbasque, Basque Foundation for Science, 48009, Bilbao, Spain
- University of the Basque Country. UPV/EHU, 48940, Leioa, Spain
| |
Collapse
|
2
|
Tang X, Zhang J, Liu L, Yang M, Li S, Chen J, Ma Y, Zhang J, Liu H, Lu C, Ding G. Distinct brain state dynamics of native and second language processing during narrative listening in late bilinguals. Neuroimage 2023; 280:120359. [PMID: 37661079 DOI: 10.1016/j.neuroimage.2023.120359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 07/01/2023] [Accepted: 08/31/2023] [Indexed: 09/05/2023] Open
Abstract
The process of complex cognition, which includes language processing, is dynamic in nature and involves various network modes or cognitive modes. This dynamic process can be manifested by a set of brain states and transitions between them. Previous neuroimaging studies have shed light on how bilingual brains support native language (L1) and second language (L2) through a shared network. However, the mechanism through which this shared brain network enables L1 and L2 processing remains unknown. This study examined this issue by testing the hypothesis that L1 and L2 processing is associated with distinct brain state dynamics in terms of brain state integration and transition flexibility. A group of late Chinese-English bilinguals was scanned using functional magnetic resonance imaging (fMRI) while listening to eight short narratives in Chinese (L1) and English (L2). Brain state dynamics were modeled using the leading eigenvector dynamic analysis framework. The results show that L1 processing involves more integrated states and frequent transitions between integrated and segregated states, while L2 processing involves more segregated states and fewer transitions. Our work provides insight into the dynamic process of narrative listening comprehension in late bilinguals and sheds new light on the neural representation of language processing and related disorders.
Collapse
Affiliation(s)
- Xiangrong Tang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Juan Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China; Beijing Institute of Graphic Communication, Beijing 102600, China
| | - Lanfang Liu
- Department of Psychology, Faculty of Arts and Sciences, Beijing Normal University at Zhuhai, Zhuhai 519087, China; Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University at Zhuhai, Zhuhai 519087, China.
| | - Menghan Yang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China; Department of Psychological and Brain Sciences, Dartmouth College, Hanover NH 03755, USA
| | - Shijie Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Jie Chen
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China; Faculty of Psychology, Beijing Normal University, Beijing 100875, China
| | - Yumeng Ma
- Department of Neuroscience, Physiology and Pharmacology, University College London, London WC1E 6BT, UK; Department of Psychology, Emory University, Atlanta GA 30322, USA
| | - Jia Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China; School of Psychology, Beijing Language and Culture University, Beijing 100083, China
| | - Haiyi Liu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Chunming Lu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Guosheng Ding
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China.
| |
Collapse
|
3
|
Kemmerer D. Grounded Cognition Entails Linguistic Relativity: A Neglected Implication of a Major Semantic Theory. Top Cogn Sci 2023; 15:615-647. [PMID: 36228603 DOI: 10.1111/tops.12628] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 09/14/2022] [Accepted: 10/22/2022] [Indexed: 12/11/2022]
Abstract
According to the popular Grounded Cognition Model (GCM), the sensory and motor features of concepts, including word meanings, are stored directly within neural systems for perception and action. More precisely, the core claim is that these concrete conceptual features reuse some of the same modality-specific representations that serve to categorize experiences involving the relevant kinds of objects and events. Research in semantic typology, however, has shown that word meanings vary significantly across the roughly 6500 languages in the world. I argue that this crosslinguistic semantic diversity has significant yet previously unrecognized theoretical consequences for the GCM. In particular, to accommodate the typological data, the GCM must assume that the concrete features of word meanings are not merely stored within sensory/motor brain systems, but are represented there in ways that are, to a nontrivial degree, language-specific. Moreover, it must assume that these conceptual representations are also activated during the nonlinguistic processing of the relevant kinds of objects and events (e.g., during visual perception and action planning); otherwise, they would not really be grounded, which is to say, embedded inside sensory/motor systems. Crucially, however, such activations would constitute what is traditionally called linguistic relativity-that is, the influence of language-specific semantic structures on other forms of cognition. The overarching aim of this paper is to elaborate this argument more fully and explore its repercussions. To that end, I discuss in greater detail the key aspects of the GCM, the evidence for crosslinguistic semantic diversity, pertinent work on linguistic relativity, the central claim that the GCM entails linguistic relativity, some initial supporting results, and some important limitations and future directions.
Collapse
Affiliation(s)
- David Kemmerer
- Department of Speech, Language, and Hearing Sciences, Purdue University
- Department of Psychological Sciences, Purdue University
| |
Collapse
|
4
|
Li H, Cao Y, Chen C, Liu X, Zhang S, Mei L. The depth of semantic processing modulates cross-language pattern similarity in Chinese-English bilinguals. Hum Brain Mapp 2023; 44:2085-2098. [PMID: 36579666 PMCID: PMC9980893 DOI: 10.1002/hbm.26195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 11/22/2022] [Accepted: 12/16/2022] [Indexed: 12/30/2022] Open
Abstract
Previous studies have investigated factors related to the degree of cross-language overlap in brain activations in bilinguals/multilinguals. However, it is still unclear whether and how the depth of semantic processing (a critical task-related factor) affects the neural pattern similarity between native and second languages. To address this question, 26 Chinese-English bilinguals were scanned with fMRI while performing a word naming task (i.e., a task with shallow semantic processing) and a semantic judgment task (i.e., a task with deep semantic processing) in both native and second languages. Based on three sets of representational similarity analysis (whole brain, ROI-based, and within-language vs. cross-language semantic representation), we found that select regions in the reading brain network showed higher cross-language pattern similarity and higher cross-language semantic representations during deep semantic processing than during shallow semantic processing. These results suggest that compared to shallow semantic processing, deep semantic processing may lead to greater language-independent processing (i.e., cross-language semantic representation) and cross-language pattern similarity, and provide direct quantitative neuroimaging evidence for cognitive models of bilingual lexical memory.
Collapse
Affiliation(s)
- Huiling Li
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Ying Cao
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Chuansheng Chen
- Department of Psychological Science, University of California, Irvine, California, USA
| | - Xiaoyu Liu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Shuo Zhang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Leilei Mei
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou, China
| |
Collapse
|
5
|
Blasi DE, Henrich J, Adamou E, Kemmerer D, Majid A. Over-reliance on English hinders cognitive science. Trends Cogn Sci 2022; 26:1153-1170. [PMID: 36253221 DOI: 10.1016/j.tics.2022.09.015] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 09/19/2022] [Accepted: 09/22/2022] [Indexed: 11/05/2022]
Abstract
English is the dominant language in the study of human cognition and behavior: the individuals studied by cognitive scientists, as well as most of the scientists themselves, are frequently English speakers. However, English differs from other languages in ways that have consequences for the whole of the cognitive sciences, reaching far beyond the study of language itself. Here, we review an emerging body of evidence that highlights how the particular characteristics of English and the linguistic habits of English speakers bias the field by both warping research programs (e.g., overemphasizing features and mechanisms present in English over others) and overgeneralizing observations from English speakers' behaviors, brains, and cognition to our entire species. We propose mitigating strategies that could help avoid some of these pitfalls.
Collapse
Affiliation(s)
- Damián E Blasi
- Department of Human Evolutionary Biology, Harvard University, 11 Divinity Street, 02138 Cambridge, MA, USA; Department of Linguistic and Cultural Evolution, Max Planck Institute for Evolutionary Anthropology, Deutscher Pl. 6, 04103 Leipzig, Germany; Human Relations Area Files, 755 Prospect Street, New Haven, CT 06511-1225, USA.
| | - Joseph Henrich
- Department of Human Evolutionary Biology, Harvard University, 11 Divinity Street, 02138 Cambridge, MA, USA
| | - Evangelia Adamou
- Languages and Cultures of Oral Tradition lab, National Center for Scientific Research (CNRS), 7 Rue Guy Môquet, 94801 Villejuif, France
| | - David Kemmerer
- Department of Speech, Language, and Hearing Sciences, Purdue University, 715 Clinic Drive, West Lafayette, IN 47907, USA; Department of Psychological Sciences, Purdue University, 703 3rd Street, West Lafayette, IN 47907, USA
| | - Asifa Majid
- Department of Experimental Psychology, University of Oxford, Woodstock Road, Oxford OX2 6GG, UK.
| |
Collapse
|
6
|
Lai CH, Hsieh SK, Lee CL, Su LIW, Liu TH, Lu CR, Tsai IN, Chou TL. Neuro-Cognitive Differences in Semantic Processing Between Native Speakers and Proficient Learners of Mandarin Chinese. Front Psychol 2021; 12:781304. [PMID: 34867693 PMCID: PMC8637610 DOI: 10.3389/fpsyg.2021.781304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 10/28/2021] [Indexed: 11/21/2022] Open
Abstract
The present study aimed to investigate the neural mechanism underlying semantic processing in Mandarin Chinese adult learners, focusing on the learners who were Indo-European language speakers with advanced levels of proficiency in Mandarin Chinese. We used functional magnetic resonance imaging technique and a semantic judgment task to test 24 Mandarin Chinese adult learners (L2 group) and 26 Mandarin Chinese adult native speakers (L1 group) as a control group. In the task, participants were asked to indicate whether two-character pairs were related in meaning. Compared to the L1 group, the L2 group had greater activation in the bilateral occipital regions, including the fusiform gyrus and middle occipital gyrus, as well as the right superior parietal lobule. On the other hand, less activation in the bilateral temporal regions was found in the L2 group relative to the L1 group. Correlation analysis further revealed that, within the L2 group, increased activation in the left middle temporal gyrus/superior temporal gyrus (M/STG, BA 21) was correlated with higher accuracy in the semantic judgment task as well as better scores in the two vocabulary tests, the Assessment of Chinese character list for grade 3 to grade 9 (A39) and the Peabody Picture Vocabulary Test-Revised. In addition, functional connectivity analysis showed that connectivity strength between the left fusiform gyrus and left ventral inferior frontal gyrus (IFG, BA 47) was modulated by the accuracy in the semantic judgment task in the L1 group. By contrast, this modulation effect was weaker in the L2 group. Taken together, our study suggests that Mandarin Chinese adult learners rely on greater recruitment of the bilateral occipital regions to process orthographic information to access the meaning of Chinese characters. Also, our correlation results provide convergent evidence that the left M/STG (BA 21) plays a crucial role in the storage of semantic knowledge for readers to access to conceptual information. Moreover, the connectivity results indicate that the left ventral pathway (left fusiform gyrus-left ventral IFG) is associated with orthographic-semantic processing in Mandarin Chinese. However, this semantic-related ventral pathway might require more time and language experience to be developed, especially for the late adult learners of Mandarin Chinese.
Collapse
Affiliation(s)
- Chia-Ho Lai
- Department of Psychology, New York University, New York, NY, United States.,Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Shu-Kai Hsieh
- Graduate Institute of Linguistics, National Taiwan University, Taipei, Taiwan
| | - Chia-Lin Lee
- Department of Psychology, National Taiwan University, Taipei, Taiwan.,Graduate Institute of Linguistics, National Taiwan University, Taipei, Taiwan
| | - Lily I-Wen Su
- Graduate Institute of Linguistics, National Taiwan University, Taipei, Taiwan
| | - Te-Hsin Liu
- Graduate Program of Teaching Chinese as a Second Language, National Taiwan University, Taipei, Taiwan
| | - Chia-Rung Lu
- Graduate Institute of Linguistics, National Taiwan University, Taipei, Taiwan
| | - I-Ni Tsai
- Graduate Program of Teaching Chinese as a Second Language, National Taiwan University, Taipei, Taiwan
| | - Tai-Li Chou
- Department of Psychology, National Taiwan University, Taipei, Taiwan.,Graduate Institute of Linguistics, National Taiwan University, Taipei, Taiwan.,Neurobiology and Cognitive Science Center, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
7
|
Nichols ES, Gao Y, Fregni S, Liu L, Joanisse MF. Individual differences in representational similarity of first and second languages in the bilingual brain. Hum Brain Mapp 2021; 42:5433-5445. [PMID: 34469016 PMCID: PMC8519873 DOI: 10.1002/hbm.25633] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 07/22/2021] [Accepted: 08/06/2021] [Indexed: 01/15/2023] Open
Abstract
Current theories of bilingualism disagree on the extent to which separate brain regions are used to maintain or process one's first and second language. The present study took a novel multivariate approach to address this question. We examined whether bilinguals maintain distinct neural representations of two languages; specifically, we tested whether brain areas that are involved in processing word meaning in either language are reliably representing each language differently, and whether language representation is influenced by individual differences in proficiency level and age of acquisition (AoA) of L2. Thirty‐one English–Mandarin bilingual adults performed a picture–word matching task in both languages. We then used representational similarity analysis to examine which brain regions reliably showed different patterns of activity for each language. We found that both proficiency and AoA predicted dissimilarity between language representations in several brain areas within the language network as well as several regions of the ventral visual pathway, demonstrating that top‐down language knowledge and individual language experience shapes concept representation in this processing stream. The results support the model of an integrated language system in bilinguals, along with a novel description of how representations for each language change with proficiency level and L2 AoA.
Collapse
Affiliation(s)
- Emily S Nichols
- Department of Applied Psychology, Faculty of Education, The University of Western Ontario, London, Canada.,Brain and Mind Institute, The University of Western Ontario, London, Canada
| | - Yue Gao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Sofia Fregni
- Faculty of Psychology, Dresden University of Technology, Dresden, Germany
| | - Li Liu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Marc F Joanisse
- Brain and Mind Institute, The University of Western Ontario, London, Canada.,Department of Psychology, The University of Western Ontario, London, Canada
| |
Collapse
|