1
|
Botch TL, Finn ES. Neural Representations of Concreteness and Concrete Concepts Are Specific to the Individual. J Neurosci 2024; 44:e0288242024. [PMID: 39349055 DOI: 10.1523/jneurosci.0288-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 08/29/2024] [Accepted: 09/09/2024] [Indexed: 10/02/2024] Open
Abstract
Different people listening to the same story may converge upon a largely shared interpretation while still developing idiosyncratic experiences atop that shared foundation. What linguistic properties support this individualized experience of natural language? Here, we investigate how the "concrete-abstract" axis-the extent to which a word is grounded in sensory experience-relates to within- and across-subject variability in the neural representations of language. Leveraging a dataset of human participants of both sexes who each listened to four auditory stories while undergoing functional magnetic resonance imaging, we demonstrate that neural representations of "concreteness" are both reliable across stories and relatively unique to individuals, while neural representations of "abstractness" are variable both within individuals and across the population. Using natural language processing tools, we show that concrete words exhibit similar neural representations despite spanning larger distances within a high-dimensional semantic space, which potentially reflects an underlying representational signature of sensory experience-namely, imageability-shared by concrete words but absent from abstract words. Our findings situate the concrete-abstract axis as a core dimension that supports both shared and individualized representations of natural language.
Collapse
Affiliation(s)
- Thomas L Botch
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
| | - Emily S Finn
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
| |
Collapse
|
2
|
Thye M, Hoffman P, Mirman D. "All the Stars Will Be Wells with a Rusty Pulley": Neural Processing of the Social and Pragmatic Content in a Narrative. J Cogn Neurosci 2024; 36:2495-2517. [PMID: 39106161 DOI: 10.1162/jocn_a_02228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/09/2024]
Abstract
Making sense of natural language and narratives requires building and manipulating a situation model by adding incoming information to the model and using the context stored in the model to comprehend subsequent details and events. Situation model maintenance is supported by the default mode network (DMN), but comprehension of the individual moments in the narrative relies on access to the conceptual store within the semantic system. The present study examined how these systems are engaged by different narrative content to investigate whether highly informative, or semantic, content is a particularly strong driver of semantic system activation compared with contextually driven content that requires using the situation model, which might instead engage DMN regions. The study further investigated which subregions of the graded semantic hub in the left anterior temporal lobe (ATL) were engaged by the type of narrative content. To do this, we quantified the semantic, pragmatic, social, ambiguous, and emotional content for each sentence in a complete narrative, the English translation of The Little Prince. Increased activation in the transmodal hub in the ventral ATL was only observed for high semantic (i.e., informative) relative to low semantic sentences. Activation in the dorsolateral and ventrolateral ATL subregions was observed for both high relative to low semantic and social content sentences, but the ventrolateral ATL effects were more extensive in the social condition. There was high correspondence between the social and pragmatic content results, particularly in the ventrolateral ATL. We argue that the ventrolateral ATL may be particularly engaged by internal, or endogenous, processing demands, aided by functional connections between the anterior middle temporal gyrus and the DMN. Pragmatic and social content may have driven endogenous processing given the pervasive and plot-progressing nature of this content in the narrative. We put forward a revised account of how the semantic system is engaged in naturalistic contexts, a critical step toward better understanding real-world semantic and social processing.
Collapse
|
3
|
Coventry KR, Diessel H. Spatial communication systems and action. Trends Cogn Sci 2024:S1364-6613(24)00262-6. [PMID: 39462694 DOI: 10.1016/j.tics.2024.10.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Revised: 10/01/2024] [Accepted: 10/01/2024] [Indexed: 10/29/2024]
Abstract
Spatial cognition is fundamental to our species. One might therefore expect that spatial communication systems would have evolved to make common distinctions. However, many have argued that spatial communication systems exhibit considerable cross-linguistic diversity, challenging the view that space structures language. We review recent work on spatial communication that merits revisiting the relationship between language and space. We provide a framework that places action as the driver of spatial communication systems across languages, in which spatial demonstratives - the earliest spatial terms - play a fundamental role in honing attention and theory of mind capacities that are crucial for language and cognition more broadly. We discuss how demonstratives emerged early in language evolution to serve a combination of spatial, social, and functional needs.
Collapse
|
4
|
Billot A, Jhingan N, Varkanitsa M, Blank I, Ryskin R, Kiran S, Fedorenko E. The language network ages well: Preserved selectivity, lateralization, and within-network functional synchronization in older brains. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.10.23.619954. [PMID: 39484368 PMCID: PMC11527140 DOI: 10.1101/2024.10.23.619954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/03/2024]
Abstract
Healthy aging is associated with structural and functional brain changes. However, cognitive abilities differ from one another in how they change with age: whereas executive functions, like working memory, show age-related decline, aspects of linguistic processing remain relatively preserved (Hartshorne et al., 2015). This heterogeneity of the cognitive-behavioral landscape in aging predicts differences among brain networks in whether and how they should change with age. To evaluate this prediction, we used individual-subject fMRI analyses ('precision fMRI') to examine the language-selective network (Fedorenko et al., 2024) and the Multiple Demand (MD) network, which supports executive functions (Duncan et al., 2020), in older adults (n=77) relative to young controls (n=470). In line with past claims, relative to young adults, the MD network of older adults shows weaker and less spatially extensive activations during an executive function task and reduced within-network functional synchronization. However, in stark contrast to the MD network, we find remarkable preservation of the language network in older adults. Their language network responds to language as strongly and selectively as in younger adults, and is similarly lateralized and internally synchronized. In other words, the language network of older adults looks indistinguishable from that of younger adults. Our findings align with behavioral preservation of language skills in aging and suggest that some networks remain young-like, at least on standard measures of function and connectivity.
Collapse
Affiliation(s)
- Anne Billot
- Department of Neurology, Massachusetts General Hospital & Harvard Medical School; Boston, MA 02114
- Center for Brain Science, Harvard University, Cambridge, MA 02138
| | - Niharika Jhingan
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | - Maria Varkanitsa
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA 02215
| | - Idan Blank
- Department of Psychology and Department of Linguistics, University of California Los Angeles, Los Angeles, CA 90095
| | - Rachel Ryskin
- Department of Cognitive & Information Sciences, University of California Merced, Merced, CA 95343
| | - Swathi Kiran
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA 02215
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| |
Collapse
|
5
|
Garcia M, Kelly C. 3D CNN for neuropsychiatry: Predicting Autism with interpretable Deep Learning applied to minimally preprocessed structural MRI data. PLoS One 2024; 19:e0276832. [PMID: 39432512 PMCID: PMC11493284 DOI: 10.1371/journal.pone.0276832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 08/06/2024] [Indexed: 10/23/2024] Open
Abstract
Predictive modeling approaches are enabling progress toward robust and reproducible brain-based markers of neuropsychiatric conditions by leveraging the power of multivariate analyses of large datasets. While deep learning (DL) offers another promising avenue to further advance progress, there are challenges related to implementation in 3D (best for MRI) and interpretability. Here, we address these challenges and describe an interpretable predictive pipeline for inferring Autism diagnosis using 3D DL applied to minimally processed structural MRI scans. We trained 3D DL models to predict Autism diagnosis using the openly available ABIDE I and II datasets (n = 1329, split into training, validation, and test sets). Importantly, we did not perform transformation to template space, to reduce bias and maximize sensitivity to structural alterations associated with Autism. Our models attained predictive accuracies equivalent to those of previous machine learning (ML) studies, while side-stepping the time- and resource-demanding requirement to first normalize data to a template. Our interpretation step, which identified brain regions that contributed most to accurate inference, revealed regional Autism-related alterations that were highly consistent with the literature, encompassing a left-lateralized network of regions supporting language processing. We have openly shared our code and models to enable further progress towards remaining challenges, such as the clinical heterogeneity of Autism and site effects, and to enable the extension of our method to other neuropsychiatric conditions.
Collapse
Affiliation(s)
- Mélanie Garcia
- Department of Psychiatry at the School of Medicine, Trinity College Dublin, Dublin, Ireland
- Trinity College Institute of Neuroscience, Trinity College, Dublin, Ireland
| | - Clare Kelly
- Department of Psychiatry at the School of Medicine, Trinity College Dublin, Dublin, Ireland
- Trinity College Institute of Neuroscience, Trinity College, Dublin, Ireland
- School of Psychology, Trinity College Dublin, Dublin, Ireland
| |
Collapse
|
6
|
Yang T, Fan X, Hou B, Wang J, Chen X. Linguistic network in early deaf individuals: A neuroimaging meta-analysis. Neuroimage 2024; 299:120720. [PMID: 38971484 DOI: 10.1016/j.neuroimage.2024.120720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 07/01/2024] [Accepted: 07/03/2024] [Indexed: 07/08/2024] Open
Abstract
This meta-analysis summarizes evidence from 44 neuroimaging experiments and characterizes the general linguistic network in early deaf individuals. Meta-analytic comparisons with hearing individuals found that a specific set of regions (in particular the left inferior frontal gyrus and posterior middle temporal gyrus) participates in supramodal language processing. In addition to previously described modality-specific differences, the present study showed that the left calcarine gyrus and the right caudate were additionally recruited in deaf compared with hearing individuals. In addition, this study showed that the bilateral posterior superior temporal gyrus is shaped by cross-modal plasticity, whereas the left frontotemporal areas are shaped by early language experience. Although an overall left-lateralized pattern for language processing was observed in the early deaf individuals, regional lateralization was altered in the inferior frontal gyrus and anterior temporal lobe. These findings indicate that the core language network functions in a modality-independent manner, and provide a foundation for determining the contributions of sensory and linguistic experiences in shaping the neural bases of language processing.
Collapse
Affiliation(s)
- Tengyu Yang
- Department of Otolaryngology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, PR China
| | - Xinmiao Fan
- Department of Otolaryngology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, PR China
| | - Bo Hou
- Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, PR China
| | - Jian Wang
- Department of Otolaryngology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, PR China.
| | - Xiaowei Chen
- Department of Otolaryngology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, PR China.
| |
Collapse
|
7
|
Regev TI, Casto C, Hosseini EA, Adamek M, Ritaccio AL, Willie JT, Brunner P, Fedorenko E. Neural populations in the language network differ in the size of their temporal receptive windows. Nat Hum Behav 2024; 8:1924-1942. [PMID: 39187713 DOI: 10.1038/s41562-024-01944-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 07/03/2024] [Indexed: 08/28/2024]
Abstract
Despite long knowing what brain areas support language comprehension, our knowledge of the neural computations that these frontal and temporal regions implement remains limited. One important unresolved question concerns functional differences among the neural populations that comprise the language network. Here we leveraged the high spatiotemporal resolution of human intracranial recordings (n = 22) to examine responses to sentences and linguistically degraded conditions. We discovered three response profiles that differ in their temporal dynamics. These profiles appear to reflect different temporal receptive windows, with average windows of about 1, 4 and 6 words, respectively. Neural populations exhibiting these profiles are interleaved across the language network, which suggests that all language regions have direct access to distinct, multiscale representations of linguistic input-a property that may be critical for the efficiency and robustness of language processing.
Collapse
Affiliation(s)
- Tamar I Regev
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Colton Casto
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Program in Speech and Hearing Bioscience and Technology (SHBT), Harvard University, Boston, MA, USA.
- Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Allston, MA, USA.
| | - Eghbal A Hosseini
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Markus Adamek
- National Center for Adaptive Neurotechnologies, Albany, NY, USA
- Department of Neurosurgery, Washington University School of Medicine, St Louis, MO, USA
| | | | - Jon T Willie
- National Center for Adaptive Neurotechnologies, Albany, NY, USA
- Department of Neurosurgery, Washington University School of Medicine, St Louis, MO, USA
| | - Peter Brunner
- National Center for Adaptive Neurotechnologies, Albany, NY, USA
- Department of Neurosurgery, Washington University School of Medicine, St Louis, MO, USA
- Department of Neurology, Albany Medical College, Albany, NY, USA
| | - Evelina Fedorenko
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Program in Speech and Hearing Bioscience and Technology (SHBT), Harvard University, Boston, MA, USA.
| |
Collapse
|
8
|
Amelink JS, Postema MC, Kong XZ, Schijven D, Carrión-Castillo A, Soheili-Nezhad S, Sha Z, Molz B, Joliot M, Fisher SE, Francks C. Imaging genetics of language network functional connectivity reveals links with language-related abilities, dyslexia and handedness. Commun Biol 2024; 7:1209. [PMID: 39342056 PMCID: PMC11438961 DOI: 10.1038/s42003-024-06890-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Accepted: 09/12/2024] [Indexed: 10/01/2024] Open
Abstract
Language is supported by a distributed network of brain regions with a particular contribution from the left hemisphere. A multi-level understanding of this network requires studying its genetic architecture. We used resting-state imaging data from 29,681 participants (UK Biobank) to measure connectivity between 18 left-hemisphere regions involved in multimodal sentence-level processing, as well as their right-hemisphere homotopes, and interhemispheric connections. Multivariate genome-wide association analysis of this total network, based on genetic variants with population frequencies >1%, identified 14 genomic loci, of which three were also associated with asymmetry of intrahemispheric connectivity. Polygenic dispositions to lower language-related abilities, dyslexia and left-handedness were associated with generally reduced leftward asymmetry of functional connectivity. Exome-wide association analysis based on rare, protein-altering variants (frequencies <1%) suggested 7 additional genes. These findings shed new light on genetic contributions to language network organization and related behavioural traits.
Collapse
Affiliation(s)
- Jitse S Amelink
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Merel C Postema
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Xiang-Zhen Kong
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Department of Psychology and Behavioural Sciences, Zhejiang University, Hangzhou, China
- Department of Psychiatry of Sir Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Dick Schijven
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Amaia Carrión-Castillo
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Basque Center on Cognition, Brain and Language (BCBL), Donostia-San Sebastián, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Spain
| | - Sourena Soheili-Nezhad
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Zhiqiang Sha
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Barbara Molz
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Marc Joliot
- Groupe d'Imagerie Neurofonctionnelle, Institut des Maladies Neurodégénératives, UMR5293, Commissariat à L'énergie Atomique et aux Énergies Alternatives, CNRS, Université de Bordeaux, Bordeaux, France
| | - Simon E Fisher
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Clyde Francks
- Language and Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
- Department of Cognitive Neuroscience, Radboud University Medical Center, Nijmegen, The Netherlands.
| |
Collapse
|
9
|
Yang M, Liu Y, Yue Z, Yang G, Jiang X, Cai Y, Zhang Y, Yang X, Li D, Chen L. Transcranial photobiomodulation on the left inferior frontal gyrus enhances Mandarin Chinese L1 and L2 complex sentence processing performances. BRAIN AND LANGUAGE 2024; 256:105458. [PMID: 39197357 DOI: 10.1016/j.bandl.2024.105458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Revised: 07/09/2024] [Accepted: 08/21/2024] [Indexed: 09/01/2024]
Abstract
This study investigated the causal enhancing effect of transcranial photobiomodulation (tPBM) over the left inferior frontal gyrus (LIFG) on syntactically complex Mandarin Chinese first language (L1) and second language (L2) sentence processing performances. Two (L1 and L2) groups of participants (thirty per group) were recruited to receive the double-blind, sham-controlled tPBM intervention via LIFG, followed by the sentence processing, the verbal working memory (WM), and the visual WM tasks. Results revealed a consistent pattern for both groups: (a) tPBM enhanced sentence processing performance but not verbal WM for linear processing of unstructured sequences and visual WM performances; (b) Participants with lower sentence processing performances under sham tPBM benefited more from active tPBM. Taken together, the current study substantiated that tPBM enhanced L1 and L2 sentence processing, and would serve as a promising and cost-effective noninvasive brain stimulation (NIBS) tool for future applications on upregulating the human language faculty.
Collapse
Affiliation(s)
- Mingchuan Yang
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Yang Liu
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Zhaoqian Yue
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Guang Yang
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Xu Jiang
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Yimin Cai
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Yuqi Zhang
- School of Chinese as a Second Language, Peking University, Beijing 100871, China
| | - Xiujie Yang
- Faculty of Psychology, Beijing Normal University, Beijing 100875, China.
| | - Dongwei Li
- Department of Psychology, Faculty of Arts and Sciences, Beijing Normal University, Zhuhai 519087, China; Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing 100875, China.
| | - Luyao Chen
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Institute of Educational System Science, Beijing Normal University, Beijing 100875, China.
| |
Collapse
|
10
|
Bickel B, Giraud AL, Zuberbühler K, van Schaik CP. Language follows a distinct mode of extra-genomic evolution. Phys Life Rev 2024; 50:211-225. [PMID: 39153248 DOI: 10.1016/j.plrev.2024.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Accepted: 08/02/2024] [Indexed: 08/19/2024]
Abstract
As one of the most specific, yet most diverse of human behaviors, language is shaped by both genomic and extra-genomic evolution. Sharing methods and models between these modes of evolution has significantly advanced our understanding of language and inspired generalized theories of its evolution. Progress is hampered, however, by the fact that the extra-genomic evolution of languages, i.e. linguistic evolution, maps only partially to other forms of evolution. Contrasting it with the biological evolution of eukaryotes and the cultural evolution of technology as the best understood models, we show that linguistic evolution is special by yielding a stationary dynamic rather than stable solutions, and that this dynamic allows the use of language change for social differentiation while maintaining its global adaptiveness. Linguistic evolution furthermore differs from technological evolution by requiring vertical transmission, allowing the reconstruction of phylogenies; and it differs from eukaryotic biological evolution by foregoing a genotype vs phenotype distinction, allowing deliberate and biased change. Recognising these differences will improve our empirical tools and open new avenues for analyzing how linguistic, cultural, and biological evolution interacted with each other when language emerged in the hominin lineage. Importantly, our framework will help to cope with unprecedented scientific and ethical challenges that presently arise from how rapid cultural evolution impacts language, most urgently from interventional clinical tools for language disorders, potential epigenetic effects of technology on language, artificial intelligence and linguistic communicators, and global losses of linguistic diversity and identity. Beyond language, the distinctions made here allow identifying variation in other forms of biological and cultural evolution, developing new perspectives for empirical research.
Collapse
Affiliation(s)
- Balthasar Bickel
- Department of Comparative Language Science, University of Zurich, Switzerland; Center for the Interdisciplinary Study of Language Evolution (ISLE), University of Zurich, Switzerland.
| | - Anne-Lise Giraud
- Department of Basic Neurosciences, University of Geneva, Switzerland; Institut de l'Audition, Institut Pasteur, INSERM, Université Paris Cité, France
| | - Klaus Zuberbühler
- Center for the Interdisciplinary Study of Language Evolution (ISLE), University of Zurich, Switzerland; Institute of Biology, University of Neuchâtel, Switzerland; School of Psychology and Neuroscience, University of St Andrews, United Kingdom
| | - Carel P van Schaik
- Center for the Interdisciplinary Study of Language Evolution (ISLE), University of Zurich, Switzerland; Department of Evolutionary Biology and Environmental Science, University of Zurich, Switzerland; Max Planck Institute for Animal Behavior, Konstanz, Germany
| |
Collapse
|
11
|
Nau M, Schmid AC, Kaplan SM, Baker CI, Kravitz DJ. Centering cognitive neuroscience on task demands and generalization. Nat Neurosci 2024; 27:1656-1667. [PMID: 39075326 DOI: 10.1038/s41593-024-01711-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 06/17/2024] [Indexed: 07/31/2024]
Abstract
Cognitive neuroscience seeks generalizable theories explaining the relationship between behavioral, physiological and mental states. In pursuit of such theories, we propose a theoretical and empirical framework that centers on understanding task demands and the mutual constraints they impose on behavior and neural activity. Task demands emerge from the interaction between an agent's sensory impressions, goals and behavior, which jointly shape the activity and structure of the nervous system on multiple spatiotemporal scales. Understanding this interaction requires multitask studies that vary more than one experimental component (for example, stimuli and instructions) combined with dense behavioral and neural sampling and explicit testing for generalization across tasks and data modalities. By centering task demands rather than mental processes that tasks are assumed to engage, this framework paves the way for the discovery of new generalizable concepts unconstrained by existing taxonomies, and moves cognitive neuroscience toward an action-oriented, dynamic and integrated view of the brain.
Collapse
Affiliation(s)
- Matthias Nau
- Laboratory of Brain and Cognition, National Institutes of Health, Bethesda, MD, USA.
| | - Alexandra C Schmid
- Laboratory of Brain and Cognition, National Institutes of Health, Bethesda, MD, USA
| | - Simon M Kaplan
- Department of Psychological & Brain Sciences, The George Washington University, Washington, DC, USA
| | - Chris I Baker
- Laboratory of Brain and Cognition, National Institutes of Health, Bethesda, MD, USA.
| | - Dwight J Kravitz
- Department of Psychological & Brain Sciences, The George Washington University, Washington, DC, USA.
- Division of Behavioral and Cognitive Sciences, Directorate for Social, Behavioral, and Economic Sciences, US National Science Foundation, Arlington, VA, USA.
| |
Collapse
|
12
|
Zhang J, Chen J, Ding G. Universality and language specificity of brain reading networks: A developmental perspective. Dev Sci 2024; 27:e13379. [PMID: 36899475 DOI: 10.1111/desc.13379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 01/11/2023] [Accepted: 02/03/2023] [Indexed: 03/12/2023]
Abstract
The development of reading networks across different languages and cultures provides an important window to address gene-culture interactions in brain functionality development. Previous meta-analyses have explored the neural correlates of reading in different languages with diverse orthographic transparencies. However, it remains unknown whether the neural topographic relationship of different languages varies when taking development into account. To address this issue, we conducted meta-analyses of neuroimaging studies with approaches of activation likelihood estimation and seed-based effect size mapping and focused on two highly contrasting languages, Chinese and English. The meta-analyses covered 61 studies of Chinese reading and 64 studies of English reading by native speakers. The brain reading networks of child and adult readers were further separately analyzed and compared to explore the developmental effects. The results revealed that the commonalities and differences in reading networks for Chinese and English were inconsistent between children and adults. In addition, the reading networks converged with development, and the effects of writing systems on brain function organizations were more salient in the initial stages of reading. An interesting finding was that the left inferior parietal lobule demonstrated increased effect sizes in adults compared with children in both Chinese and English reading, indicating a common developmental feature of reading mechanisms across the two languages. These findings provide new insights into the functional evolution and cultural modulation of brain reading networks. RESEARCH HIGHLIGHTS: Meta-analyses with approaches of activation likelihood estimation and seed-based effect size mapping were performed to evaluate the developmental characteristics of brain reading networks. The engagement of universal and language-specific reading networks was different between children and adults, and the reading networks converged with increased reading experience. Overall the middle/inferior occipital and inferior/middle frontal gyrus were specific to Chinese and the middle temporal, right inferior frontal gyrus were specific to English. The left inferior parietal lobule was engaged more in adults than children in Chinese and English reading, demonstrating a common developmental feature of reading mechanisms.
Collapse
Affiliation(s)
- Jia Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Jie Chen
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Guosheng Ding
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| |
Collapse
|
13
|
Čeko M, Hirshfield L, Doherty E, Southwell R, D'Mello SK. Cortical cognitive processing during reading captured using functional-near infrared spectroscopy. Sci Rep 2024; 14:19483. [PMID: 39174562 PMCID: PMC11341567 DOI: 10.1038/s41598-024-69630-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 08/07/2024] [Indexed: 08/24/2024] Open
Abstract
Neuroimaging studies using functional magnetic resonance imaging (fMRI) have provided unparalleled insights into the fundamental neural mechanisms underlying human cognitive processing, such as high-level linguistic processes during reading. Here, we build upon this prior work to capture sentence reading comprehension outside the MRI scanner using functional near infra-red spectroscopy (fNIRS) in a large sample of participants (n = 82). We observed increased task-related hemodynamic responses in prefrontal and temporal cortical regions during sentence-level reading relative to the control condition (a list of non-words), replicating prior fMRI work on cortical recruitment associated with high-level linguistic processing during reading comprehension. These results lay the groundwork towards developing adaptive systems to support novice readers and language learners by targeting the underlying cognitive processes. This work also contributes to bridging the gap between laboratory findings and more real-world applications in the realm of cognitive neuroscience.
Collapse
Affiliation(s)
- Marta Čeko
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA.
| | - Leanne Hirshfield
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA.
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA.
| | - Emily Doherty
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| | - Rosy Southwell
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA
| | - Sidney K D'Mello
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| |
Collapse
|
14
|
Wong MMK, Sha Z, Lütje L, Kong XZ, van Heukelum S, van de Berg WDJ, Jonkman LE, Fisher SE, Francks C. The neocortical infrastructure for language involves region-specific patterns of laminar gene expression. Proc Natl Acad Sci U S A 2024; 121:e2401687121. [PMID: 39133845 PMCID: PMC11348331 DOI: 10.1073/pnas.2401687121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Accepted: 06/27/2024] [Indexed: 08/29/2024] Open
Abstract
The language network of the human brain has core components in the inferior frontal cortex and superior/middle temporal cortex, with left-hemisphere dominance in most people. Functional specialization and interconnectivity of these neocortical regions is likely to be reflected in their molecular and cellular profiles. Excitatory connections between cortical regions arise and innervate according to layer-specific patterns. Here, we generated a gene expression dataset from human postmortem cortical tissue samples from core language network regions, using spatial transcriptomics to discriminate gene expression across cortical layers. Integration of these data with existing single-cell expression data identified 56 genes that showed differences in laminar expression profiles between the frontal and temporal language cortex together with upregulation in layer II/III and/or layer V/VI excitatory neurons. Based on data from large-scale genome-wide screening in the population, DNA variants within these 56 genes showed set-level associations with interindividual variation in structural connectivity between the left-hemisphere frontal and temporal language cortex, and with the brain-related disorders dyslexia and schizophrenia which often involve affected language. These findings identify region-specific patterns of laminar gene expression as a feature of the brain's language network.
Collapse
Affiliation(s)
- Maggie M. K. Wong
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
| | - Zhiqiang Sha
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
| | - Lukas Lütje
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
| | - Xiang-Zhen Kong
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou310058, China
- State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou311121, China
| | - Sabrina van Heukelum
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen6525 GA, The Netherlands
| | - Wilma D. J. van de Berg
- Section Clinical Neuroanatomy and Biobanking, Department of Anatomy and Neurosciences, Amsterdam University Medical Center, Location Vrije Universiteit Amsterdam, Amsterdam1007 MB, The Netherlands
- Neurodegeneration, Amsterdam Neuroscience, Amsterdam1007 MB, The Netherlands
| | - Laura E. Jonkman
- Section Clinical Neuroanatomy and Biobanking, Department of Anatomy and Neurosciences, Amsterdam University Medical Center, Location Vrije Universiteit Amsterdam, Amsterdam1007 MB, The Netherlands
- Neurodegeneration, Amsterdam Neuroscience, Amsterdam1007 MB, The Netherlands
- Brain Imaging, Amsterdam Neuroscience, Amsterdam1007 MB, The Netherlands
| | - Simon E. Fisher
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen6525 GA, The Netherlands
| | - Clyde Francks
- Language & Genetics Department, Max Planck Institute for Psycholinguistics, Nijmegen6525XD, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen6525 GA, The Netherlands
- Department of Cognitive Neuroscience, Radboud University Medical Center, Nijmegen6525 GA, The Netherlands
| |
Collapse
|
15
|
Tuckute G, Kanwisher N, Fedorenko E. Language in Brains, Minds, and Machines. Annu Rev Neurosci 2024; 47:277-301. [PMID: 38669478 DOI: 10.1146/annurev-neuro-120623-101142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/28/2024]
Abstract
It has long been argued that only humans could produce and understand language. But now, for the first time, artificial language models (LMs) achieve this feat. Here we survey the new purchase LMs are providing on the question of how language is implemented in the brain. We discuss why, a priori, LMs might be expected to share similarities with the human language system. We then summarize evidence that LMs represent linguistic information similarly enough to humans to enable relatively accurate brain encoding and decoding during language processing. Finally, we examine which LM properties-their architecture, task performance, or training-are critical for capturing human neural responses to language and review studies using LMs as in silico model organisms for testing hypotheses about language. These ongoing investigations bring us closer to understanding the representations and processes that underlie our ability to comprehend sentences and express thoughts in language.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA;
| | - Nancy Kanwisher
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA;
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA;
| |
Collapse
|
16
|
Silva AB, Liu JR, Metzger SL, Bhaya-Grossman I, Dougherty ME, Seaton MP, Littlejohn KT, Tu-Chan A, Ganguly K, Moses DA, Chang EF. A bilingual speech neuroprosthesis driven by cortical articulatory representations shared between languages. Nat Biomed Eng 2024; 8:977-991. [PMID: 38769157 DOI: 10.1038/s41551-024-01207-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 04/01/2024] [Indexed: 05/22/2024]
Abstract
Advancements in decoding speech from brain activity have focused on decoding a single language. Hence, the extent to which bilingual speech production relies on unique or shared cortical activity across languages has remained unclear. Here, we leveraged electrocorticography, along with deep-learning and statistical natural-language models of English and Spanish, to record and decode activity from speech-motor cortex of a Spanish-English bilingual with vocal-tract and limb paralysis into sentences in either language. This was achieved without requiring the participant to manually specify the target language. Decoding models relied on shared vocal-tract articulatory representations across languages, which allowed us to build a syllable classifier that generalized across a shared set of English and Spanish syllables. Transfer learning expedited training of the bilingual decoder by enabling neural data recorded in one language to improve decoding in the other language. Overall, our findings suggest shared cortical articulatory representations that persist after paralysis and enable the decoding of multiple languages without the need to train separate language-specific decoders.
Collapse
Affiliation(s)
- Alexander B Silva
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- University of California, Berkeley - University of California, San Francisco Graduate Program in Bioengineering, Berkeley, CA, USA
| | - Jessie R Liu
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- University of California, Berkeley - University of California, San Francisco Graduate Program in Bioengineering, Berkeley, CA, USA
| | - Sean L Metzger
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- University of California, Berkeley - University of California, San Francisco Graduate Program in Bioengineering, Berkeley, CA, USA
| | - Ilina Bhaya-Grossman
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- University of California, Berkeley - University of California, San Francisco Graduate Program in Bioengineering, Berkeley, CA, USA
| | - Maximilian E Dougherty
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Margaret P Seaton
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Kaylo T Littlejohn
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Berkeley, CA, USA
| | - Adelyn Tu-Chan
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
| | - Karunesh Ganguly
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
| | - David A Moses
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
| | - Edward F Chang
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA.
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA.
- University of California, Berkeley - University of California, San Francisco Graduate Program in Bioengineering, Berkeley, CA, USA.
| |
Collapse
|
17
|
Kurth F, Schijven D, van den Heuvel OA, Hoogman M, van Rooij D, Stein DJ, Buitelaar JK, Bölte S, Auzias G, Kushki A, Venkatasubramanian G, Rubia K, Bollmann S, Isaksson J, Jaspers‐Fayer F, Marsh R, Batistuzzo MC, Arnold PD, Bressan RA, Stewart SE, Gruner P, Sorensen L, Pan PM, Silk TJ, Gur RC, Cubillo AI, Haavik J, O'Gorman Tuura RL, Hartman CA, Calvo R, McGrath J, Calderoni S, Jackowski A, Chantiluke KC, Satterthwaite TD, Busatto GF, Nigg JT, Gur RE, Retico A, Tosetti M, Gallagher L, Szeszko PR, Neufeld J, Ortiz AE, Ghisleni C, Lazaro L, Hoekstra PJ, Anagnostou E, Hoekstra L, Simpson B, Plessen JK, Deruelle C, Soreni N, James A, Narayanaswamy J, Reddy JY, Fitzgerald J, Bellgrove MA, Salum GA, Janssen J, Muratori F, Vila M, Giral MG, Ameis SH, Bosco P, Remnélius KL, Huyser C, Pariente JC, Jalbrzikowski M, Rosa PG, O'Hearn KM, Ehrlich S, Mollon J, Zugman A, Christakou A, Arango C, Fisher SE, Kong X, Franke B, Medland SE, Thomopoulos SI, Jahanshad N, Glahn DC, Thompson PM, Francks C, Luders E. Large-scale analysis of structural brain asymmetries during neurodevelopment: Associations with age and sex in 4265 children and adolescents. Hum Brain Mapp 2024; 45:e26754. [PMID: 39046031 PMCID: PMC11267452 DOI: 10.1002/hbm.26754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 04/29/2024] [Accepted: 05/23/2024] [Indexed: 07/25/2024] Open
Abstract
Only a small number of studies have assessed structural differences between the two hemispheres during childhood and adolescence. However, the existing findings lack consistency or are restricted to a particular brain region, a specific brain feature, or a relatively narrow age range. Here, we investigated associations between brain asymmetry and age as well as sex in one of the largest pediatric samples to date (n = 4265), aged 1-18 years, scanned at 69 sites participating in the ENIGMA (Enhancing NeuroImaging Genetics through Meta-Analysis) consortium. Our study revealed that significant brain asymmetries already exist in childhood, but their magnitude and direction depend on the brain region examined and the morphometric measurement used (cortical volume or thickness, regional surface area, or subcortical volume). With respect to effects of age, some asymmetries became weaker over time while others became stronger; sometimes they even reversed direction. With respect to sex differences, the total number of regions exhibiting significant asymmetries was larger in females than in males, while the total number of measurements indicating significant asymmetries was larger in males (as we obtained more than one measurement per cortical region). The magnitude of the significant asymmetries was also greater in males. However, effect sizes for both age effects and sex differences were small. Taken together, these findings suggest that cerebral asymmetries are an inherent organizational pattern of the brain that manifests early in life. Overall, brain asymmetry appears to be relatively stable throughout childhood and adolescence, with some differential effects in males and females.
Collapse
Affiliation(s)
- F. Kurth
- School of PsychologyUniversity of AucklandAucklandNew Zealand
- Institute of Diagnostic and Interventional Radiology, Jena University HospitalJenaGermany
| | - D. Schijven
- Language and Genetics DepartmentMax Planck Institute for PsycholinguisticsNijmegenThe Netherlands
| | - O. A. van den Heuvel
- Department of PsychiatryAmsterdam University Medical CenterAmsterdamThe Netherlands
| | - M. Hoogman
- Department of PsychiatryRadboud University Medical CenterNijmegenThe Netherlands
- Department of Human GeneticsRadboud University Medical CenterNijmegenThe Netherlands
- Donders Institute for Brain, Cognition and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - D. van Rooij
- Donders Institute for Brain, Cognition and Behavior, Department of Cognitive NeuroscienceRadboud University Medical CenterNijmegenThe Netherlands
| | - D. J. Stein
- SAMRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry & Neuroscience InstituteUniversity of Cape TownCape TownSouth Africa
| | - J. K. Buitelaar
- Donders Institute for Brain, Cognition and BehaviourRadboud UniversityNijmegenThe Netherlands
- Department of Cognitive NeuroscienceRadboudumcNijmegenThe Netherlands
| | - S. Bölte
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's HealthKarolinska Institutet & Stockholm Health Care Services, Region StockholmStockholmSweden
- Curtin Autism Research Group, Curtin School of Allied HealthCurtin UniversityPerthAustralia
| | - G. Auzias
- Institut de neurosciences de la Timone UMR 7289, Aix‐Marseille Université & CNRSMarseilleFrance
| | - A. Kushki
- Holland Bloorview Kids Rehabilitation Hospital, Institute for Biomedical EngineeringUniversity of TorontoTorontoCanada
| | - G. Venkatasubramanian
- National Institute of Mental Health and Neuro Sciences (NIMHANS)BengaluruIndia
- Department of Psychiatry, Temerty Faculty of MedicineUniversity of TorontoTorontoCanada
| | - K. Rubia
- Institute of Psychiatry, Psychology & NeuroscienceKing's College LondonLondonUK
| | - S. Bollmann
- School of Information Technology and Electrical EngineeringThe University of QueenslandBrisbaneAustralia
| | - J. Isaksson
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's HealthKarolinska Institutet & Stockholm Health Care Services, Region StockholmStockholmSweden
- Child and Adolescent Psychiatry Unit, Department of Medical SciencesUppsala UniversityUppsalaSweden
| | - F. Jaspers‐Fayer
- BC Children's Research Institute and the University of British ColumbiaVancouverCanada
| | - R. Marsh
- Department of PsychiatryColumbia University Irving Medical Center and the New York State Psychiatric InstituteNew YorkNew YorkUSA
| | - M. C. Batistuzzo
- Department & Institute of PsychiatryUniversity of Sao Paulo, Medical SchoolSao PauloBrazil
- Department of Methods and Techniques in PsychologyPontifical Catholic UniversitySao PauloBrazil
| | - P. D. Arnold
- The Mathison Centre for Mental Health Research & Education, Hotchkiss Brain InstituteUniversity of CalgaryCalgaryCanada
| | - R. A. Bressan
- Federal University of São PauloSão PauloBrazil
- Instituto Ame Sua MenteSão PauloBrazil
| | - S. E. Stewart
- British Columbia Children's Hospital, British Columbia Mental Health and Substance Use ServicesUniversity of British ColumbiaVancouverCanada
| | - P. Gruner
- Department of PsychiatryYale UniversityNew HavenConnecticutUSA
| | - L. Sorensen
- Department of Biological and Medical PsychologyUniversity of BergenBergenNorway
| | - P. M. Pan
- Laboratório de Neurociências Integrativas (LINC), Departamento de PsiquiatriaUniversidade Federal de São Paulo (UNIFESP)São PauloBrazil
- Instituto Nacional de siquiatria do Desenvolvimento (INPD)São PauloBrazil
| | - T. J. Silk
- Centre for Social and Early Emotional Development and School of PsychologyDeakin UniversityGeelongAustralia
- Murdoch Children's Research InstituteMelbourneAustralia
| | - R. C. Gur
- Department of Psychiatry, Section on Neurodevelopment and Psychosis and the Lifespan Brain Institute, Perelman School of MedicineUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - A. I. Cubillo
- Institute of Psychiatry, Psychology and NeuroscienceKing's College LondonLondonUK
| | - J. Haavik
- Department of BiomedicineUniversity of BergenBergenNorway
- Division of PsychiatryHaukeland University HospitalBergenNorway
| | - R. L. O'Gorman Tuura
- Center for MR Research, University Children's Hospital ZurichUniversity of ZurichZurichSwitzerland
| | - C. A. Hartman
- Interdisciplinary Center Psychopathology and Emotion Regulation, Department of Psychiatry, University of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
| | - R. Calvo
- Department of Child and Adolescent Psychiatry and Psychology, Neuroscience InstituteHospital ClinicBarcelonaSpain
- School of MedicineUniversity of BarcelonaBarcelonaSpain
- Centro de Investigación Biomédica en Red Salud Mental (CIBERSAM)BarcelonaSpain
- Institute d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS)BarcelonaSpain
| | - J. McGrath
- Department of PsychiatryTrinity College DublinDublinIreland
| | - S. Calderoni
- IRCCS Stella Maris FoundationPisaItaly
- Department of Clinical and Experimental MedicineUniversity of PisaPisaItaly
| | - A. Jackowski
- Department of PsychiatryUNIFESPSão PauloBrazil
- Department of EducationICT and Learning, Østfold University CollegeHaldenNorway
| | - K. C. Chantiluke
- Institute of Psychiatry, Psychology & NeuroscienceKing's College LondonLondonUK
| | - T. D. Satterthwaite
- Department of Psychiatry, Perelman School of MedicineUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
- Lifespan Brain InstituteUniversity of Pennsylvania & Children's Hospital of PhiladelphiaPhiladelphiaPennsylvaniaUSA
- Center for Biomedical Image Computing and Analytics, Perelman School of MedicineUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - G. F. Busatto
- Department of Psychiatry, Faculty of MedicineUniversity of São PauloSão PauloBrazil
| | - J. T. Nigg
- Department of Psychiatry and Center for ADHD ResearchOregon Health & Science UniversityPortlandOregonUSA
| | - R. E. Gur
- Department of Psychiatry, The Penn‐CHOP Lifespan Brain InstituteUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - A. Retico
- Pisa DivisionNational Institute for Nuclear Physics (INFN)PisaItaly
| | | | - L. Gallagher
- Department of PsychiatryTrinity College DublinDublinIreland
- The Hospital for Sick childrenTorontoCanada
- The Centre for Addiction and Mental Health TorontoTorontoCanada
- Department of PsychiatryUniversity of TorontoTorontoCanada
| | - P. R. Szeszko
- Department of PsychiatryIcahn School of Medicine at Mount SinaiNew YorkNew YorkUSA
- Department of NeuroscienceIcahn School of Medicine at Mount SinaiNew YorkNew YorkUSA
- Mental Illness Research, Education and Clinical Center (MIRECC)James J. Peters VA Medical CenterNew YorkNew YorkUSA
| | - J. Neufeld
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's HealthKarolinska Institutet & Stockholm Health Care Services, Region StockholmStockholmSweden
- Swedish Collegium for Advanced Study (SCAS)UppsalaSweden
| | - A. E. Ortiz
- Department of Child and Adolescent Psychiatry and Psychology, Neuroscience InstituteHospital ClinicBarcelonaSpain
- Institute d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS)BarcelonaSpain
| | - C. Ghisleni
- Center for MR Research, University Children's Hospital ZurichUniversity of ZurichZurichSwitzerland
| | - L. Lazaro
- Department of Child and Adolescent Psychiatry and Psychology, Neuroscience InstituteHospital ClinicBarcelonaSpain
- School of MedicineUniversity of BarcelonaBarcelonaSpain
- Centro de Investigación Biomédica en Red Salud Mental (CIBERSAM)BarcelonaSpain
- Institute d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS)BarcelonaSpain
| | - P. J. Hoekstra
- Department of Child and Adolescent Psychiatry & Accare Child Study CenterUniversity of Groningen, University Medical Center GroningenGroningenThe Netherlands
| | - E. Anagnostou
- Holland Bloorview Kids Rehabilitation Hospital, Department of Pediatrics, Temetry School of MedicineUniversity of TorontoTorontoCanada
| | - L. Hoekstra
- Karakter University Center for Child and Adolescent PsychiatryNijmegenThe Netherlands
- Donders Center for Cognitive NeuroimagingNijmegenThe Netherlands
- Radboud University Medical CenterNijmegenThe Netherlands
| | - B. Simpson
- New York State Psychiatric Institute/CUIMCNew YorkNew YorkUSA
| | - J. K. Plessen
- Division of Child and Adolescent Psychiatry, Department of PsychiatryUniversity Hospital LausanneLausanneSwitzerland
| | - C. Deruelle
- Institut de neurosciences de la Timone UMR 7289, Aix‐Marseille Université & CNRSMarseilleFrance
| | - N. Soreni
- Pediatric OCD Consultation ClinicSJHHamiltonCanada
- Department of Psychiatry and Behavioral Neurosciences and Offord Child StudiesMcMaster UniversityHamiltonCanada
| | - A. James
- Department of PsychiatryUniversity of OxfordOxfordUK
| | - J. Narayanaswamy
- National Institute of Mental Health and Neuro Sciences (NIMHANS)BengaluruIndia
| | - J. Y. Reddy
- National Institute of Mental Health and Neuro Sciences (NIMHANS)BengaluruIndia
| | | | - M. A. Bellgrove
- School of Psychological Sciences and Turner Institute for Brain and Mental HealthMonash UniversityMelbourneAustralia
| | - G. A. Salum
- Graduate Program of Psychiatry and Behavioral SciencesUniversidade Federal do Rio Grande do Sul, Hospital de Clínicas de Porto AlegrePorto AlegreBrazil
- Child Mind InstituteNew YorkNew YorkUSA
| | - J. Janssen
- Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental HealthHospital General Universitario Gregorio Marañón, IiSGM, CIBERSAMMadridSpain
| | | | - M. Vila
- Department of Child and Adolescent Psychiatry and Psychology, Neuroscience InstituteHospital ClinicBarcelonaSpain
| | - M. Garcia Giral
- Department of Child and Adolescent Psychiatry and Psychology, Neuroscience InstituteHospital ClinicBarcelonaSpain
| | - S. H. Ameis
- Campbell Family Mental Health Research InstituteCentre for Addiction and Mental HealthTorontoCanada
- Temerty Faculty of Medicine, Department of PsychiatryUniversity of TorontoTorontoCanada
| | - P. Bosco
- IRCCS Stella Maris FoundationPisaItaly
| | - K. Lundin Remnélius
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's HealthKarolinska Institutet & Stockholm Health Care Services, Region StockholmStockholmSweden
| | - C. Huyser
- Academic Center Child and Youth PsychiatryLevvelAmsterdamThe Netherlands
- Department of Child and Adolescent PsychiatryAmsterdamUMCAmsterdamThe Netherlands
| | - J. C. Pariente
- Magnetic Resonance Image Core FacilityInstitut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS)BarcelonaSpain
| | - M. Jalbrzikowski
- Department of Psychiatry and Behavioral SciencesBoston Children's HospitalBostonMassachusettsUSA
- Department of PsychiatryHarvard Medical SchoolBostonMassachusettsUSA
| | - P. G. Rosa
- Laboratory of Psychiatric Neuroimaging (LIM‐21), Departamento e Instituto de Psiquiatria, Hospital das Clinicas HCFMUSP, Faculdade de MedicinaUniversidade de Sao PauloSao PauloBrazil
| | - K. M. O'Hearn
- Atrium Health Wake Forest Baptist Medical CenterWinston‐SalemNorth CarolinaUSA
| | - S. Ehrlich
- Division of Psychological and Social Medicine and Developmental Neurosciences & Department of Child and Adolescent PsychiatryFaculty of Medicine, TU DresdenDresdenGermany
| | - J. Mollon
- Boston Children's HospitalHarvard Medical SchoolBostonMassachusettsUSA
| | - A. Zugman
- National Institutes of Health/National Institute of Mental HealthBethesdaMarylandUSA
| | - A. Christakou
- Institute of Psychiatry, Psychology and NeuroscienceKing's College LondonLondonUK
- Centre for Integrative Neuroscience and Neurodynamics, School of Psychology and Clinical Language SciencesUniversity of ReadingReadingUK
| | - C. Arango
- Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, IiSGM, School of MedicineUniversidad Complutense, CIBERSAMMadridSpain
| | - S. E. Fisher
- Language and Genetics DepartmentMax Planck Institute for PsycholinguisticsNijmegenThe Netherlands
- Donders Institute for Brain, Cognition and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - X. Kong
- Department of Psychology and Behavioral SciencesZhejiang UniversityHangzhouChina
- Department of Psychiatry of Sir Run Run Shaw HospitalZhejiang University School of MedicineHangzhouChina
| | - B. Franke
- Department of PsychiatryRadboud University Medical CenterNijmegenThe Netherlands
- Department of Human GeneticsRadboud University Medical CenterNijmegenThe Netherlands
- Donders Institute for Brain, Cognition and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - S. E. Medland
- QIMR Berghofer Medical Research InstituteHerstonAustralia
| | - S. I. Thomopoulos
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of MedicineUniversity of Southern CaliforniaMarina del ReyCaliforniaUSA
| | - N. Jahanshad
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of MedicineUniversity of Southern CaliforniaMarina del ReyCaliforniaUSA
| | - D. C. Glahn
- Department of PsychiatryHarvard Medical SchoolBostonMassachusettsUSA
- Tommy Fuss Center for Neuropsychiatric Disease Research, Boston Children's HospitalBostonMassachusettsUSA
| | - P. M. Thompson
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of MedicineUniversity of Southern CaliforniaMarina del ReyCaliforniaUSA
| | - C. Francks
- Language and Genetics DepartmentMax Planck Institute for PsycholinguisticsNijmegenThe Netherlands
- Department of Human GeneticsRadboud University Medical CenterNijmegenThe Netherlands
- Donders Institute for Brain, Cognition and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - E. Luders
- School of PsychologyUniversity of AucklandAucklandNew Zealand
- Swedish Collegium for Advanced Study (SCAS)UppsalaSweden
- Department of Women's and Children's HealthUppsala UniversityUppsalaSweden
- Laboratory of Neuro Imaging, Keck School of MedicineUniversity of Southern CaliforniaLos AngelesCaliforniaUSA
| |
Collapse
|
18
|
Tang X, Turesky TK, Escalante ES, Loh MY, Xia M, Yu X, Gaab N. Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills. Dev Cogn Neurosci 2024; 68:101405. [PMID: 38875769 PMCID: PMC11225703 DOI: 10.1016/j.dcn.2024.101405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 04/30/2024] [Accepted: 06/06/2024] [Indexed: 06/16/2024] Open
Abstract
Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.
Collapse
Affiliation(s)
- Xinyi Tang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Ted K Turesky
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| | - Elizabeth S Escalante
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA; Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27514, USA
| | - Megan Yf Loh
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| | - Mingrui Xia
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Xi Yu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| | - Nadine Gaab
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| |
Collapse
|
19
|
te Rietmolen N, Mercier MR, Trébuchon A, Morillon B, Schön D. Speech and music recruit frequency-specific distributed and overlapping cortical networks. eLife 2024; 13:RP94509. [PMID: 39038076 PMCID: PMC11262799 DOI: 10.7554/elife.94509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/24/2024] Open
Abstract
To what extent does speech and music processing rely on domain-specific and domain-general neural networks? Using whole-brain intracranial EEG recordings in 18 epilepsy patients listening to natural, continuous speech or music, we investigated the presence of frequency-specific and network-level brain activity. We combined it with a statistical approach in which a clear operational distinction is made between shared, preferred, and domain-selective neural responses. We show that the majority of focal and network-level neural activity is shared between speech and music processing. Our data also reveal an absence of anatomical regional selectivity. Instead, domain-selective neural responses are restricted to distributed and frequency-specific coherent oscillations, typical of spectral fingerprints. Our work highlights the importance of considering natural stimuli and brain dynamics in their full complexity to map cognitive and brain functions.
Collapse
Affiliation(s)
- Noémie te Rietmolen
- Institute for Language, Communication, and the Brain, Aix-Marseille UniversityMarseilleFrance
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des SystèmesMarseilleFrance
| | - Manuel R Mercier
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des SystèmesMarseilleFrance
| | - Agnès Trébuchon
- Institute for Language, Communication, and the Brain, Aix-Marseille UniversityMarseilleFrance
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des SystèmesMarseilleFrance
- APHM, Hôpital de la Timone, Service de Neurophysiologie CliniqueMarseilleFrance
| | - Benjamin Morillon
- Institute for Language, Communication, and the Brain, Aix-Marseille UniversityMarseilleFrance
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des SystèmesMarseilleFrance
| | - Daniele Schön
- Institute for Language, Communication, and the Brain, Aix-Marseille UniversityMarseilleFrance
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des SystèmesMarseilleFrance
| |
Collapse
|
20
|
Seghier ML, Boudelaa S. Constraining current neuroanatomical models of reading: the view from Arabic. Brain Struct Funct 2024:10.1007/s00429-024-02827-y. [PMID: 38969935 DOI: 10.1007/s00429-024-02827-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 06/17/2024] [Indexed: 07/07/2024]
Abstract
There is a growing interest in imaging understudied orthographies to unravel their neuronal correlates and their implications for existing computational and neuroanatomical models. Here, we review current brain mapping literature about Arabic words. We first offer a succinct description of some unique linguistic features of Arabic that challenge current cognitive models of reading. We then appraise the existing functional neuroimaging studies that investigated written Arabic word processing. Our review revealed that (1) Arabic is still understudied, (2) the most investigated features concerned the effects of vowelling and diglossia in Arabic reading, (3) findings were not always discussed in the light of existing reading models such as the dual route cascaded, the triangle, and the connectionist dual process models, and (4) current evidence is unreliable when it comes to the exact neuronal pathways that sustain Arabic word processing. Overall, despite the fact that Arabic has some unique linguistic features that challenge and ultimately enrich current reading models, the existing functional neuroimaging literature falls short of offering a reliable evidence about brain networks of Arabic reading. We conclude by highlighting the need for more systematic studies of the linguistic features of Arabic to build theoretical and neuroanatomical models that are concurrently specific and general.
Collapse
Affiliation(s)
- Mohamed L Seghier
- Department of Biomedical Engineering and Biotechnology, Khalifa University of Science and Technology, Abu Dhabi, UAE.
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, UAE.
| | - Sami Boudelaa
- Department of Cognitive Sciences, United Arab Emirates University, Al Ain, UAE.
| |
Collapse
|
21
|
Ocklenburg S, Mundorf A, Gerrits R, Karlsson EM, Papadatou-Pastou M, Vingerhoets G. Clinical implications of brain asymmetries. Nat Rev Neurol 2024; 20:383-394. [PMID: 38783057 DOI: 10.1038/s41582-024-00974-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/08/2024] [Indexed: 05/25/2024]
Abstract
No two human brains are alike, and with the rise of precision medicine in neurology, we are seeing an increased emphasis on understanding the individual variability in brain structure and function that renders every brain unique. Functional and structural brain asymmetries are a fundamental principle of brain organization, and recent research suggests substantial individual variability in these asymmetries that needs to be considered in clinical practice. In this Review, we provide an overview of brain asymmetries, variations in such asymmetries and their relevance in the clinical context. We review recent findings on brain asymmetries in neuropsychiatric and neurodevelopmental disorders, as well as in specific learning disabilities, with an emphasis on large-scale database studies and meta-analyses. We also highlight the relevance of asymmetries for disease symptom onset in neurodegenerative diseases and their implications for lateralized treatments, including brain stimulation. We conclude that alterations in brain asymmetry are not sufficiently specific to act as diagnostic biomarkers but can serve as meaningful symptom or treatment response biomarkers in certain contexts. On the basis of these insights, we provide several recommendations for neurological clinical practice.
Collapse
Affiliation(s)
- Sebastian Ocklenburg
- Department of Psychology, MSH Medical School Hamburg, Hamburg, Germany.
- ICAN Institute for Cognitive and Affective Neuroscience, MSH Medical School Hamburg, Hamburg, Germany.
- Biopsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany.
| | - Annakarina Mundorf
- ISM Institute for Systems Medicine and Department of Human Medicine, MSH Medical School Hamburg, Hamburg, Germany
- Division of Cognitive Neuroscience, Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Robin Gerrits
- Department of Experimental-Clinical and Health Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging (GIfMI), Ghent University, Ghent, Belgium
| | - Emma M Karlsson
- Department of Experimental-Clinical and Health Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging (GIfMI), Ghent University, Ghent, Belgium
| | - Marietta Papadatou-Pastou
- National and Kapodistrian University of Athens, Athens, Greece
- Biomedical Research Foundation, Academy of Athens, Athens, Greece
| | - Guy Vingerhoets
- Department of Experimental-Clinical and Health Psychology, Ghent University, Ghent, Belgium
- Ghent Institute for Functional and Metabolic Imaging (GIfMI), Ghent University, Ghent, Belgium
| |
Collapse
|
22
|
Besso L, Larivière S, Roes M, Sanford N, Percival C, Damascelli M, Momeni A, Lavigne K, Menon M, Aleman A, Ćurčić-Blake B, Woodward TS. Hypoactivation of the language network during auditory imagery contributes to hallucinations in Schizophrenia. Psychiatry Res Neuroimaging 2024; 341:111824. [PMID: 38754348 DOI: 10.1016/j.pscychresns.2024.111824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 04/20/2024] [Accepted: 05/01/2024] [Indexed: 05/18/2024]
Abstract
Auditory verbal hallucinations (AVHs) involve perceptions, often voices, in the absence of external stimuli, and rank among the most common symptoms of schizophrenia. Metrical stress evaluation requires determination of the stronger syllable in words, and therefore requires auditory imagery, of interest for investigation of hallucinations in schizophrenia. The current functional magnetic resonance imaging study provides an updated whole-brain network analysis of a previously published study on metrical stress, which showed reduced directed connections between Broca's and Wernicke's regions of interest (ROIs) for hallucinations. Three functional brain networks were extracted, with the language network (LN) showing an earlier and shallower blood-oxygen-level dependent (BOLD) response for hallucinating patients, in the auditory imagery condition only (the reduced activation for hallucinations observed in the original ROI-based results were not specific to the imagery condition). This suggests that hypoactivation of the LN during internal auditory imagery may contribute to the propensity to hallucinate. This accords with cognitive accounts holding that an impaired balance between internal and external linguistic processes (underactivity in networks involved in internal auditory imagery and overactivity in networks involved in speech perception) contributes to our understanding of the biological underpinnings of hallucinations.
Collapse
Affiliation(s)
- Luca Besso
- BC Mental Health and Addictions Research Institute, Provincial Health Services Authority, Vancouver, BC, Canada; Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada
| | - Sara Larivière
- Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Meighen Roes
- BC Mental Health and Addictions Research Institute, Provincial Health Services Authority, Vancouver, BC, Canada; Department of Psychology, University of British Columbia, Vancouver, BC, Canada
| | - Nicole Sanford
- Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada
| | - Chantal Percival
- BC Mental Health and Addictions Research Institute, Provincial Health Services Authority, Vancouver, BC, Canada; Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada; Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Matteo Damascelli
- School of Population and Public Health, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Ava Momeni
- BC Mental Health and Addictions Research Institute, Provincial Health Services Authority, Vancouver, BC, Canada; Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada
| | - Katie Lavigne
- Douglas Research Centre, Montreal, Quebec, Canada; Department of Psychiatry, McGill University, Montreal, Quebec, Canada
| | - Mahesh Menon
- Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada
| | - André Aleman
- Department of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Branislava Ćurčić-Blake
- Department of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Todd S Woodward
- BC Mental Health and Addictions Research Institute, Provincial Health Services Authority, Vancouver, BC, Canada; Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada.
| |
Collapse
|
23
|
Kauf C, Kim HS, Lee EJ, Jhingan N, Selena She J, Taliaferro M, Gibson E, Fedorenko E. Linguistic inputs must be syntactically parsable to fully engage the language network. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.21.599332. [PMID: 38948870 PMCID: PMC11212959 DOI: 10.1101/2024.06.21.599332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Human language comprehension is remarkably robust to ill-formed inputs (e.g., word transpositions). This robustness has led some to argue that syntactic parsing is largely an illusion, and that incremental comprehension is more heuristic, shallow, and semantics-based than is often assumed. However, the available data are also consistent with the possibility that humans always perform rule-like symbolic parsing and simply deploy error correction mechanisms to reconstruct ill-formed inputs when needed. We put these hypotheses to a new stringent test by examining brain responses to a) stimuli that should pose a challenge for syntactic reconstruction but allow for complex meanings to be built within local contexts through associative/shallow processing (sentences presented in a backward word order), and b) grammatically well-formed but semantically implausible sentences that should impede semantics-based heuristic processing. Using a novel behavioral syntactic reconstruction paradigm, we demonstrate that backward-presented sentences indeed impede the recovery of grammatical structure during incremental comprehension. Critically, these backward-presented stimuli elicit a relatively low response in the language areas, as measured with fMRI. In contrast, semantically implausible but grammatically well-formed sentences elicit a response in the language areas similar in magnitude to naturalistic (plausible) sentences. In other words, the ability to build syntactic structures during incremental language processing is both necessary and sufficient to fully engage the language network. Taken together, these results provide strongest to date support for a generalized reliance of human language comprehension on syntactic parsing.
Collapse
Affiliation(s)
- Carina Kauf
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Hee So Kim
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Elizabeth J. Lee
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Niharika Jhingan
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Jingyuan Selena She
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Maya Taliaferro
- Department of Psychology, New York University, New York, NY 10012 USA
| | - Edward Gibson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138 USA
| |
Collapse
|
24
|
Hiersche KJ, Schettini E, Li J, Saygin ZM. Functional dissociation of the language network and other cognition in early childhood. Hum Brain Mapp 2024; 45:e26757. [PMID: 38888027 PMCID: PMC11184366 DOI: 10.1002/hbm.26757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 05/28/2024] [Accepted: 05/29/2024] [Indexed: 06/20/2024] Open
Abstract
Is language distinct from other cognition during development? Does neural machinery for language emerge from general-purpose neural mechanisms, becoming tuned for language after years of experience and maturation? Answering these questions will shed light on the origins of domain-specificity in the brain. We address these questions using precision fMRI, scanning young children (35 months to 9 years of age) on an auditory language localizer, spatial working memory localizer (engaging the domain-general multiple demand [MD] network), and a resting-state scan. We create subject-specific functional regions of interest for each network and examine their selectivity, specificity, and functional connectivity. We find young children show domain-specific, left-lateralized language activation, and that the language network is not responsive to domain-general cognitive load. Additionally, the cortically adjacent MD network is selective to cognitive load, but not to language. These networks show higher within versus between-network functional connectivity. This connectivity is stable across ages (examined cross-sectionally and longitudinally), whereas language responses increase with age and across time within subject, reflecting a domain-specific developmental change. Overall, we provide evidence for a double dissociation of the language and MD network throughout development, in both their function and connectivity. These findings suggest that domain-specificity, even for uniquely human cognition like language, develops early and distinctly from mechanisms that presumably support other human cognition.
Collapse
Affiliation(s)
- K. J. Hiersche
- Department of PsychologyThe Ohio State UniversityColumbusOhioUSA
- Center for Cognitive and Behavioral Brain Imaging, The Ohio State UniversityColumbusOhioUSA
| | - E. Schettini
- Department of PsychologyThe Ohio State UniversityColumbusOhioUSA
- Center for Cognitive and Behavioral Brain Imaging, The Ohio State UniversityColumbusOhioUSA
| | - J. Li
- Department of PsychologyThe Ohio State UniversityColumbusOhioUSA
- Center for Cognitive and Behavioral Brain Imaging, The Ohio State UniversityColumbusOhioUSA
| | - Z. M. Saygin
- Department of PsychologyThe Ohio State UniversityColumbusOhioUSA
- Center for Cognitive and Behavioral Brain Imaging, The Ohio State UniversityColumbusOhioUSA
| |
Collapse
|
25
|
Ozernov-Palchik O, O’Brien AM, Jiachen Lee E, Richardson H, Romeo R, Lipkin B, Small H, Capella J, Nieto-Castañón A, Saxe R, Gabrieli JDE, Fedorenko E. Precision fMRI reveals that the language network exhibits adult-like left-hemispheric lateralization by 4 years of age. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.15.594172. [PMID: 38798360 PMCID: PMC11118489 DOI: 10.1101/2024.05.15.594172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
Left hemisphere damage in adulthood often leads to linguistic deficits, but many cases of early damage leave linguistic processing preserved, and a functional language system can develop in the right hemisphere. To explain this early apparent equipotentiality of the two hemispheres for language, some have proposed that the language system is bilateral during early development and only becomes left-lateralized with age. We examined language lateralization using functional magnetic resonance imaging with two large pediatric cohorts (total n=273 children ages 4-16; n=107 adults). Strong, adult-level left-hemispheric lateralization (in activation volume and response magnitude) was evident by age 4. Thus, although the right hemisphere can take over language function in some cases of early brain damage, and although some features of the language system do show protracted development (magnitude of language response and strength of inter-regional correlations in the language network), the left-hemisphere bias for language is robustly present by 4 years of age. These results call for alternative accounts of early equipotentiality of the two hemispheres for language.
Collapse
Affiliation(s)
- Ola Ozernov-Palchik
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Amanda M. O’Brien
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| | - Elizabeth Jiachen Lee
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Hilary Richardson
- School of Philosophy, Psychology, and Language Sciences, University of Edinburgh, Edinburgh, EH8 9JZ, United Kingdom
| | - Rachel Romeo
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD 20742, United States
| | - Benjamin Lipkin
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Hannah Small
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD, 21218, United States
| | - Jimmy Capella
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States
| | | | - Rebecca Saxe
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - John D. E. Gabrieli
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Evelina Fedorenko
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| |
Collapse
|
26
|
Tang X, Turesky TK, Escalante ES, Loh MY, Xia M, Yu X, Gaab N. Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.06.22.546194. [PMID: 38895379 PMCID: PMC11185523 DOI: 10.1101/2023.06.22.546194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.
Collapse
Affiliation(s)
- Xinyi Tang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China, 100875
| | - Ted K. Turesky
- Harvard Graduate School of Education, Harvard University, Cambridge, Massachusetts, USA, 02138
| | - Elizabeth S. Escalante
- Harvard Graduate School of Education, Harvard University, Cambridge, Massachusetts, USA, 02138
| | - Megan Yf Loh
- Harvard Graduate School of Education, Harvard University, Cambridge, Massachusetts, USA, 02138
| | - Mingrui Xia
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China, 100875
| | - Xi Yu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China, 100875
| | - Nadine Gaab
- Harvard Graduate School of Education, Harvard University, Cambridge, Massachusetts, USA, 02138
| |
Collapse
|
27
|
Wolna A, Szewczyk J, Diaz M, Domagalik A, Szwed M, Wodniecka Z. Tracking Components of Bilingual Language Control in Speech Production: An fMRI Study Using Functional Localizers. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:315-340. [PMID: 38832359 PMCID: PMC11093400 DOI: 10.1162/nol_a_00128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 11/13/2023] [Indexed: 06/05/2024]
Abstract
When bilingual speakers switch back to speaking in their native language (L1) after having used their second language (L2), they often experience difficulty in retrieving words in their L1. This phenomenon is referred to as the L2 after-effect. We used the L2 after-effect as a lens to explore the neural bases of bilingual language control mechanisms. Our goal was twofold: first, to explore whether bilingual language control draws on domain-general or language-specific mechanisms; second, to investigate the precise mechanism(s) that drive the L2 after-effect. We used a precision fMRI approach based on functional localizers to measure the extent to which the brain activity that reflects the L2 after-effect overlaps with the language network (Fedorenko et al., 2010) and the domain-general multiple demand network (Duncan, 2010), as well as three task-specific networks that tap into interference resolution, lexical retrieval, and articulation. Forty-two Polish-English bilinguals participated in the study. Our results show that the L2 after-effect reflects increased engagement of domain-general but not language-specific resources. Furthermore, contrary to previously proposed interpretations, we did not find evidence that the effect reflects increased difficulty related to lexical access, articulation, and the resolution of lexical interference. We propose that difficulty of speech production in the picture naming paradigm-manifested as the L2 after-effect-reflects interference at a nonlinguistic level of task schemas or a general increase of cognitive control engagement during speech production in L1 after L2.
Collapse
Affiliation(s)
- Agata Wolna
- Institute of Psychology, Jagiellonian University, Kraków, Poland
| | - Jakub Szewczyk
- Institute of Psychology, Jagiellonian University, Kraków, Poland
- Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Michele Diaz
- Social, Life, and Engineering Sciences Imaging Center, Pennsylvania State University, Pennsylvania, USA
| | | | - Marcin Szwed
- Institute of Psychology, Jagiellonian University, Kraków, Poland
| | - Zofia Wodniecka
- Institute of Psychology, Jagiellonian University, Kraków, Poland
| |
Collapse
|
28
|
Shain C, Kean H, Casto C, Lipkin B, Affourtit J, Siegelman M, Mollica F, Fedorenko E. Distributed Sensitivity to Syntax and Semantics throughout the Language Network. J Cogn Neurosci 2024; 36:1427-1471. [PMID: 38683732 DOI: 10.1162/jocn_a_02164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.
Collapse
Affiliation(s)
| | - Hope Kean
- Massachusetts Institute of Technology
| | | | | | | | | | | | | |
Collapse
|
29
|
Veljanoski D, Ng XY, Hill CS, Jamjoom AAB. Theory and evidence-base for a digital platform for the delivery of language tests during awake craniotomy and collaborative brain mapping. BMJ SURGERY, INTERVENTIONS, & HEALTH TECHNOLOGIES 2024; 6:e000234. [PMID: 38756704 PMCID: PMC11097893 DOI: 10.1136/bmjsit-2023-000234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Accepted: 03/20/2024] [Indexed: 05/18/2024] Open
Abstract
Objectives Build the theoretical and evidence-base for a digital platform (map-OR) which delivers intraoperative language tests during awake craniotomy and facilitates collaborative sharing of brain mapping data. Design Mixed methodology study including two scoping reviews, international survey, synthesis of development guiding principles and a risk assessment using failure modes and effects analysis. Setting The two scoping reviews examined the literature published in the English language. International survey was completed by members of awake craniotomy teams from 14 countries. Main outcome measures Scoping review 1: number of technologies described for language mapping during awake craniotomy. Scoping review 2: barriers and facilitators to adopting novel technology in surgery. International survey: degree of language mapping technology penetration into clinical practice. Results A total of 12 research articles describing 6 technologies were included. The technologies required a range of hardware components including portable devices, virtual reality headsets and large integrated multiscreen stacks. The facilitators and barriers of technology adoption in surgery were extracted from 11 studies and mapped onto the 4 Unified Theory of Acceptance and Use of Technology constructs. A total of 37 awake craniotomy teams from 14 countries completed the survey. Of the responses, 20 (54.1%) delivered their language tests digitally, 10 (27.0%) delivered tests using cards and 7 (18.9%) used a combination of both. The most commonly used devices were tablet computers (67.7%; n=21) and the most common software used was Microsoft PowerPoint (60.6%; n=20). Four key risks for the proposed digital platform were identified, the highest risk being a software and internet connectivity failure during surgery. Conclusions This work represents a rigorous and structured approach to the development of a digital platform for standardized intraoperative language testing during awake craniotomy and for collaborative sharing of brain mapping data. Trial registration number Scoping review protocol registrations in OSF registries (scoping review 1: osf.io/su9xm; scoping review 2: osf.io/x4wsc).
Collapse
Affiliation(s)
| | - Xin Yi Ng
- Department of Medicine, Arrowe Park Hospital, Wirral, UK
| | - Ciaran Scott Hill
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Aimun A B Jamjoom
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
- Department of Neurosurgery, Barking Havering and Redbridge Hospitals NHS Trust, Romford, UK
| |
Collapse
|
30
|
Fedorenko E, Ivanova AA, Regev TI. The language network as a natural kind within the broader landscape of the human brain. Nat Rev Neurosci 2024; 25:289-312. [PMID: 38609551 DOI: 10.1038/s41583-024-00802-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/23/2024] [Indexed: 04/14/2024]
Abstract
Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- The Program in Speech and Hearing in Bioscience and Technology, Harvard University, Cambridge, MA, USA.
| | - Anna A Ivanova
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Tamar I Regev
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
31
|
Ocklenburg S, Guo ZV. Cross-hemispheric communication: Insights on lateralized brain functions. Neuron 2024; 112:1222-1234. [PMID: 38458199 DOI: 10.1016/j.neuron.2024.02.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 12/13/2023] [Accepted: 02/12/2024] [Indexed: 03/10/2024]
Abstract
On the surface, the two hemispheres of vertebrate brains look almost perfectly symmetrical, but several motor, sensory, and cognitive systems show a deeply lateralized organization. Importantly, the two hemispheres are connected by various commissures, white matter tracts that cross the brain's midline and enable cross-hemispheric communication. Cross-hemispheric communication has been suggested to play an important role in the emergence of lateralized brain functions. Here, we review current advances in understanding cross-hemispheric communication that have been made using modern neuroscientific tools in rodents and other model species, such as genetic labeling, large-scale recordings of neuronal activity, spatiotemporally precise perturbation, and quantitative behavior analyses. These findings suggest that the emergence of lateralized brain functions cannot be fully explained by largely static factors such as genetic variation and differences in structural brain asymmetries. In addition, learning-dependent asymmetric interactions between the left and right hemispheres shape lateralized brain functions.
Collapse
Affiliation(s)
- Sebastian Ocklenburg
- Department of Psychology, MSH Medical School Hamburg, Hamburg, Germany; ICAN Institute for Cognitive and Affective Neuroscience, MSH Medical School Hamburg, Hamburg, Germany; Biopsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany.
| | - Zengcai V Guo
- School of Medicine, Tsinghua University, Beijing 100084, China; Tsinghua-Peking Joint Center for Life Sciences, Beijing 100084, China; IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, China.
| |
Collapse
|
32
|
Casilio M, Kasdan AV, Schneck SM, Entrup JL, Levy DF, Crouch K, Wilson SM. Situating word deafness within aphasia recovery: A case report. Cortex 2024; 173:96-119. [PMID: 38387377 PMCID: PMC11073474 DOI: 10.1016/j.cortex.2023.12.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 10/02/2023] [Accepted: 12/26/2023] [Indexed: 02/24/2024]
Abstract
Word deafness is a rare neurological disorder often observed following bilateral damage to superior temporal cortex and canonically defined as an auditory modality-specific deficit in word comprehension. The extent to which word deafness is dissociable from aphasia remains unclear given its heterogeneous presentation, and some have consequently posited that word deafness instead represents a stage in recovery from aphasia, where auditory and linguistic processing are affected to varying degrees and improve at differing rates. Here, we report a case of an individual (Mr. C) with bilateral temporal lobe lesions whose presentation evolved from a severe aphasia to an atypical form of word deafness, where auditory linguistic processing was impaired at the sentence level and beyond. We first reconstructed in detail Mr. C's stroke recovery through medical record review and supplemental interviewing. Then, using behavioral testing and multimodal neuroimaging, we documented a predominant auditory linguistic deficit in sentence and narrative comprehension-with markedly reduced behavioral performance and absent brain activation in the language network in the spoken modality exclusively. In contrast, Mr. C displayed near-unimpaired behavioral performance and robust brain activations in the language network for the linguistic processing of words, irrespective of modality. We argue that these findings not only support the view of word deafness as a stage in aphasia recovery but also further instantiate the important role of left superior temporal cortex in auditory linguistic processing.
Collapse
Affiliation(s)
| | - Anna V Kasdan
- Vanderbilt University Medical Center, Nashville, TN, USA; Vanderbilt Brain Institute, TN, USA
| | | | | | - Deborah F Levy
- Vanderbilt University Medical Center, Nashville, TN, USA
| | - Kelly Crouch
- Vanderbilt University Medical Center, Nashville, TN, USA
| | - Stephen M Wilson
- Vanderbilt University Medical Center, Nashville, TN, USA; School of Health and Rehabilitation Sciences, University of Queensland, Brisbane, QLD, Australia
| |
Collapse
|
33
|
Kauf C, Tuckute G, Levy R, Andreas J, Fedorenko E. Lexical-Semantic Content, Not Syntactic Structure, Is the Main Contributor to ANN-Brain Similarity of fMRI Responses in the Language Network. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:7-42. [PMID: 38645614 PMCID: PMC11025651 DOI: 10.1162/nol_a_00116] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 07/11/2023] [Indexed: 04/23/2024]
Abstract
Representations from artificial neural network (ANN) language models have been shown to predict human brain activity in the language network. To understand what aspects of linguistic stimuli contribute to ANN-to-brain similarity, we used an fMRI data set of responses to n = 627 naturalistic English sentences (Pereira et al., 2018) and systematically manipulated the stimuli for which ANN representations were extracted. In particular, we (i) perturbed sentences' word order, (ii) removed different subsets of words, or (iii) replaced sentences with other sentences of varying semantic similarity. We found that the lexical-semantic content of the sentence (largely carried by content words) rather than the sentence's syntactic form (conveyed via word order or function words) is primarily responsible for the ANN-to-brain similarity. In follow-up analyses, we found that perturbation manipulations that adversely affect brain predictivity also lead to more divergent representations in the ANN's embedding space and decrease the ANN's ability to predict upcoming tokens in those stimuli. Further, results are robust as to whether the mapping model is trained on intact or perturbed stimuli and whether the ANN sentence representations are conditioned on the same linguistic context that humans saw. The critical result-that lexical-semantic content is the main contributor to the similarity between ANN representations and neural ones-aligns with the idea that the goal of the human language system is to extract meaning from linguistic strings. Finally, this work highlights the strength of systematic experimental manipulations for evaluating how close we are to accurate and generalizable models of the human language network.
Collapse
Affiliation(s)
- Carina Kauf
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Roger Levy
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Jacob Andreas
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA, USA
| |
Collapse
|
34
|
Schneider JM, Scott TL, Legault J, Qi Z. Limited but specific engagement of the mature language network during linguistic statistical learning. Cereb Cortex 2024; 34:bhae123. [PMID: 38566510 PMCID: PMC10987970 DOI: 10.1093/cercor/bhae123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 03/04/2024] [Accepted: 03/05/2024] [Indexed: 04/04/2024] Open
Abstract
Statistical learning (SL) is the ability to detect and learn regularities from input and is foundational to language acquisition. Despite the dominant role of SL as a theoretical construct for language development, there is a lack of direct evidence supporting the shared neural substrates underlying language processing and SL. It is also not clear whether the similarities, if any, are related to linguistic processing, or statistical regularities in general. The current study tests whether the brain regions involved in natural language processing are similarly recruited during auditory, linguistic SL. Twenty-two adults performed an auditory linguistic SL task, an auditory nonlinguistic SL task, and a passive story listening task as their neural activation was monitored. Within the language network, the left posterior temporal gyrus showed sensitivity to embedded speech regularities during auditory, linguistic SL, but not auditory, nonlinguistic SL. Using a multivoxel pattern similarity analysis, we uncovered similarities between the neural representation of auditory, linguistic SL, and language processing within the left posterior temporal gyrus. No other brain regions showed similarities between linguistic SL and language comprehension, suggesting that a shared neurocomputational process for auditory SL and natural language processing within the left posterior temporal gyrus is specific to linguistic stimuli.
Collapse
Affiliation(s)
- Julie M Schneider
- Department of Communication Sciences and Disorders, Louisiana State University, 77 Hatcher Hall, Field House Dr., Baton Rouge, LA 70803, United States
- Department of Linguistics & Cognitive Science, University of Delaware, 125 E Main St, Newark, DE 19716, United States
| | - Terri L Scott
- School of Medicine, University of California San Francisco, 533 Parnassus Ave, San Francisco, CA 94143, United States
| | - Jennifer Legault
- Department of Psychology, Elizabethtown College, One Alpha Dr, Elizabethtown, PA 17022, United States
| | - Zhenghan Qi
- Department of Linguistics & Cognitive Science, University of Delaware, 125 E Main St, Newark, DE 19716, United States
- Bouvé College of Health Sciences, Northeastern University, 360 Huntington Ave, Boston, MA 02115, United States
| |
Collapse
|
35
|
Desbordes T, King JR, Dehaene S. Tracking the neural codes for words and phrases during semantic composition, working-memory storage, and retrieval. Cell Rep 2024; 43:113847. [PMID: 38412098 DOI: 10.1016/j.celrep.2024.113847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 11/02/2023] [Accepted: 02/07/2024] [Indexed: 02/29/2024] Open
Abstract
The ability to compose successive words into a meaningful phrase is a characteristic feature of human cognition, yet its neural mechanisms remain incompletely understood. Here, we analyze the cortical mechanisms of semantic composition using magnetoencephalography (MEG) while participants read one-word, two-word, and five-word noun phrases and compared them with a subsequent image. Decoding of MEG signals revealed three processing stages. During phrase comprehension, the representation of individual words was sustained for a variable duration depending on phrasal context. During the delay period, the word code was replaced by a working-memory code whose activation increased with semantic complexity. Finally, the speed and accuracy of retrieval depended on semantic complexity and was faster for surface than for deep semantic properties. In conclusion, we propose that the brain initially encodes phrases using factorized dimensions for successive words but later compresses them in working memory and requires a period of decompression to access them.
Collapse
Affiliation(s)
- Théo Desbordes
- Meta AI, Paris, France; Cognitive Neuroimaging Unit, NeuroSpin Center, 91191 Gif-sur-Yvette, France.
| | - Jean-Rémi King
- Meta AI, Paris, France; École Normale Supérieure, PSL University, Paris, France
| | - Stanislas Dehaene
- Université Paris Saclay, INSERM, CEA, Cognitive Neuroimaging Unit, NeuroSpin Center, 91191 Gif-sur-Yvette, France; Collège de France, PSL University, Paris, France
| |
Collapse
|
36
|
Thye M, Hoffman P, Mirman D. The neural basis of naturalistic semantic and social cognition. Sci Rep 2024; 14:6796. [PMID: 38514738 PMCID: PMC10957894 DOI: 10.1038/s41598-024-56897-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Accepted: 03/11/2024] [Indexed: 03/23/2024] Open
Abstract
Decoding social environments and engaging meaningfully with other people are critical aspects of human cognition. Multiple cognitive systems, including social and semantic cognition, work alongside each other to support these processes. This study investigated shared processing between social and semantic systems using neuroimaging data collected during movie-viewing, which captures the multimodal environment in which social knowledge is exchanged. Semantic and social content from movie events (event-level) and movie transcripts (word-level) were used in parametric modulation analyses to test (1) the degree to which semantic and social information is processed within each respective network and (2) engagement of the same cross-network regions or the same domain-general hub located within the semantic network during semantic and social processing. Semantic word and event-level content engaged the same fronto-temporo-parietal network and a portion of the semantic hub in the anterior temporal lobe (ATL). Social word and event-level content engaged the supplementary motor area and right angular gyrus within the social network, but only social words engaged the domain-general semantic hub in left ATL. There was evidence of shared processing between the social and semantic systems in the dorsolateral portion of right ATL which was engaged by word and event-level semantic and social content. Overlap between the semantic and social word and event results was highly variable within and across participants, with the most consistent loci of overlap occurring in left inferior frontal, bilateral precentral and supramarginal gyri for social and semantic words and in bilateral superior temporal gyrus extending from ATL posteriorly into supramarginal gyri for social and semantic events. These results indicate a complex pattern of shared and distinct regions for social and semantic cognition during naturalistic processing. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on October 11, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/ACWQY .
Collapse
Affiliation(s)
- Melissa Thye
- Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, UK.
| | - Paul Hoffman
- Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, UK
| | - Daniel Mirman
- Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, UK
| |
Collapse
|
37
|
Dureux A, Zanini A, Everling S. Mapping of facial and vocal processing in common marmosets with ultra-high field fMRI. Commun Biol 2024; 7:317. [PMID: 38480875 PMCID: PMC10937914 DOI: 10.1038/s42003-024-06002-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 03/01/2024] [Indexed: 03/17/2024] Open
Abstract
Primate communication relies on multimodal cues, such as vision and audition, to facilitate the exchange of intentions, enable social interactions, avoid predators, and foster group cohesion during daily activities. Understanding the integration of facial and vocal signals is pivotal to comprehend social interaction. In this study, we acquire whole-brain ultra-high field (9.4 T) fMRI data from awake marmosets (Callithrix jacchus) to explore brain responses to unimodal and combined facial and vocal stimuli. Our findings reveal that the multisensory condition not only intensifies activations in the occipito-temporal face patches and auditory voice patches but also engages a more extensive network that includes additional parietal, prefrontal and cingulate areas, compared to the summed responses of the unimodal conditions. By uncovering the neural network underlying multisensory audiovisual integration in marmosets, this study highlights the efficiency and adaptability of the marmoset brain in processing facial and vocal social signals, providing significant insights into primate social communication.
Collapse
Affiliation(s)
- Audrey Dureux
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, University of Western Ontario, London, ON, N6A 5K8, Canada.
| | - Alessandro Zanini
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, University of Western Ontario, London, ON, N6A 5K8, Canada
| | - Stefan Everling
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, University of Western Ontario, London, ON, N6A 5K8, Canada
- Department of Physiology and Pharmacology, University of Western Ontario, London, ON, N6A 5K8, Canada
| |
Collapse
|
38
|
Regev TI, Kim HS, Chen X, Affourtit J, Schipper AE, Bergen L, Mahowald K, Fedorenko E. High-level language brain regions process sublexical regularities. Cereb Cortex 2024; 34:bhae077. [PMID: 38494886 PMCID: PMC11486690 DOI: 10.1093/cercor/bhae077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 02/05/2024] [Accepted: 02/07/2024] [Indexed: 03/19/2024] Open
Abstract
A network of left frontal and temporal brain regions supports language processing. This "core" language network stores our knowledge of words and constructions as well as constraints on how those combine to form sentences. However, our linguistic knowledge additionally includes information about phonemes and how they combine to form phonemic clusters, syllables, and words. Are phoneme combinatorics also represented in these language regions? Across five functional magnetic resonance imaging experiments, we investigated the sensitivity of high-level language processing brain regions to sublexical linguistic regularities by examining responses to diverse nonwords-sequences of phonemes that do not constitute real words (e.g. punes, silory, flope). We establish robust responses in the language network to visually (experiment 1a, n = 605) and auditorily (experiments 1b, n = 12, and 1c, n = 13) presented nonwords. In experiment 2 (n = 16), we find stronger responses to nonwords that are more well-formed, i.e. obey the phoneme-combinatorial constraints of English. Finally, in experiment 3 (n = 14), we provide suggestive evidence that the responses in experiments 1 and 2 are not due to the activation of real words that share some phonology with the nonwords. The results suggest that sublexical regularities are stored and processed within the same fronto-temporal network that supports lexical and syntactic processes.
Collapse
Affiliation(s)
- Tamar I Regev
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Hee So Kim
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Xuanyi Chen
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Cognitive Sciences, Rice University, Houston, TX 77005, United States
| | - Josef Affourtit
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Abigail E Schipper
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Leon Bergen
- Department of Linguistics, University of California San Diego, San Diego CA 92093, United States
| | - Kyle Mahowald
- Department of Linguistics, University of Texas at Austin, Austin, TX 78712, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- The Harvard Program in Speech and Hearing Bioscience and Technology, Boston, MA 02115, United States
| |
Collapse
|
39
|
Tuckute G, Sathe A, Srikant S, Taliaferro M, Wang M, Schrimpf M, Kay K, Fedorenko E. Driving and suppressing the human language network using large language models. Nat Hum Behav 2024; 8:544-561. [PMID: 38172630 DOI: 10.1038/s41562-023-01783-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 11/10/2023] [Indexed: 01/05/2024]
Abstract
Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of the brain response associated with each sentence. We then use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress the activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also non-invasively control neural activity in higher-level cortical areas, such as the language network.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Aalok Sathe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Shashank Srikant
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
- MIT-IBM Watson AI Lab, Cambridge, MA, USA
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Mingye Wang
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Martin Schrimpf
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Quest for Intelligence, Massachusetts Institute of Technology, Cambridge, MA, USA
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Kendrick Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA, USA.
| |
Collapse
|
40
|
Malik-Moraleda S, Jouravlev O, Taliaferro M, Mineroff Z, Cucu T, Mahowald K, Blank IA, Fedorenko E. Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI. Cereb Cortex 2024; 34:bhae049. [PMID: 38466812 PMCID: PMC10928488 DOI: 10.1093/cercor/bhae049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 01/24/2024] [Accepted: 01/25/2024] [Indexed: 03/13/2024] Open
Abstract
How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g. related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages coexist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.
Collapse
Affiliation(s)
- Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114, United States
| | - Olessia Jouravlev
- Department of Cognitive Science, Carleton University, Ottawa K1S 5B6, Canada
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| | - Zachary Mineroff
- Eberly Center, Carnegie Mellon University, Pittsburgh, PA 15289, United States
| | - Theodore Cucu
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15289, United States
| | - Kyle Mahowald
- Department of Linguistics, The University of Texas at Austin, Austin, TX 78712, United States
| | - Idan A Blank
- Department of Psychology, University of California Los Angeles, Los Angeles, CA 90095, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114, United States
| |
Collapse
|
41
|
Arvidsson C, Torubarova E, Pereira A, Uddén J. Conversational production and comprehension: fMRI-evidence reminiscent of but deviant from the classical Broca-Wernicke model. Cereb Cortex 2024; 34:bhae073. [PMID: 38501383 PMCID: PMC10949358 DOI: 10.1093/cercor/bhae073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 02/02/2024] [Accepted: 02/03/2024] [Indexed: 03/20/2024] Open
Abstract
A key question in research on the neurobiology of language is to which extent the language production and comprehension systems share neural infrastructure, but this question has not been addressed in the context of conversation. We utilized a public fMRI dataset where 24 participants engaged in unscripted conversations with a confederate outside the scanner, via an audio-video link. We provide evidence indicating that the two systems share neural infrastructure in the left-lateralized perisylvian language network, but diverge regarding the level of activation in regions within the network. Activity in the left inferior frontal gyrus was stronger in production compared to comprehension, while comprehension showed stronger recruitment of the left anterior middle temporal gyrus and superior temporal sulcus, compared to production. Although our results are reminiscent of the classical Broca-Wernicke model, the anterior (rather than posterior) temporal activation is a notable difference from that model. This is one of the findings that may be a consequence of the conversational setting, another being that conversational production activated what we interpret as higher-level socio-pragmatic processes. In conclusion, we present evidence for partial overlap and functional asymmetry of the neural infrastructure of production and comprehension, in the above-mentioned frontal vs temporal regions during conversation.
Collapse
Affiliation(s)
- Caroline Arvidsson
- Department of Linguistics, Stockholm University, Universitetsvägen 10 C, 114 18 Stockholm, Sweden
| | - Ekaterina Torubarova
- Division of Speech, Music, and Hearing, KTH Royal Institute of Technology, Lindstedtsvägen 24, 114 28 Stockholm, Sweden
| | - André Pereira
- Division of Speech, Music, and Hearing, KTH Royal Institute of Technology, Lindstedtsvägen 24, 114 28 Stockholm, Sweden
| | - Julia Uddén
- Department of Linguistics, Stockholm University, Universitetsvägen 10 C, 114 18 Stockholm, Sweden
- Department of Psychology, Stockholm University, Albanovägen 12, 114 19 Stockholm, Sweden
| |
Collapse
|
42
|
Malik-Moraleda S, Jouravlev O, Taliaferro M, Mineroff Z, Cucu T, Mahowald K, Blank IA, Fedorenko E. Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.01.19.524657. [PMID: 36711949 PMCID: PMC9882290 DOI: 10.1101/2023.01.19.524657] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher-proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g., related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages co-exist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.
Collapse
Affiliation(s)
- Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| | - Olessia Jouravlev
- Department of Cognitive Science, Carleton University, Ottawa, Canada, K1S 5B6
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | | | - Theodore Cucu
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15289
| | - Kyle Mahowald
- Department of Linguistics, The University of Texas at Austin, Austin, TX 78712
| | - Idan A. Blank
- Department of Psychology, University of California Los Angeles, CA 90095
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| |
Collapse
|
43
|
Kokkinos V, Seimenis I. Concordance of verbal memory and language fMRI lateralization in people with epilepsy. J Neuroimaging 2024; 34:95-107. [PMID: 37968766 DOI: 10.1111/jon.13171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Revised: 10/29/2023] [Accepted: 11/01/2023] [Indexed: 11/17/2023] Open
Abstract
BACKGROUND AND PURPOSE This work investigates verbal memory functional MRI (fMRI) versus language fMRI in terms of lateralization, and assesses the validity of performing word recognition during the functional scan. METHODS Thirty patients with a diagnosis of epilepsy underwent verbal memory, visuospatial memory, and language fMRI. We used word encoding, word recognition, image encoding, and image recognition memory tasks, and semantic description, reading comprehension, and listening comprehension language tasks. We used three common lateralization metrics: network spatial distribution, maximum statistical value, and laterality index (LI). RESULTS Lateralization of signal spatial distribution resulted in poor similarity between verbal memory and language fMRI tasks. Signal maximum lateralization showed significant (>.8) but not perfect (1) similarity. Word encoding LI showed significant correlation only with listening comprehension LI (p = .016). Word recognition LI was significantly correlated with expressive language semantic description LI (p = .024) and receptive language reading and listening comprehension LIs (p = .015 and p = .019, respectively). There was no correlation between LIs of the visuospatial tasks and LIs of the language tasks. CONCLUSIONS Our results support the association between language and verbal memory lateralization, optimally determined by LI quantification, and the introduction of quantitative means for language fMRI interpretation in clinical settings where verbal memory lateralization is imperative.
Collapse
Affiliation(s)
- Vasileios Kokkinos
- Comprehensive Epilepsy Center, Northwestern Memorial Hospital, Chicago, Illinois, USA
- Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
- Department of Medicine, School of Health Sciences, Democritus University of Thrace, Alexandroupoli, Greece
| | - Ioannis Seimenis
- Department of Medicine, School of Health Sciences, Democritus University of Thrace, Alexandroupoli, Greece
- Medical School, National and Kapodistrian University of Athens, Athens, Greece
| |
Collapse
|
44
|
Olson HA, Chen EM, Lydic KO, Saxe RR. Left-Hemisphere Cortical Language Regions Respond Equally to Observed Dialogue and Monologue. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:575-610. [PMID: 38144236 PMCID: PMC10745132 DOI: 10.1162/nol_a_00123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 09/20/2023] [Indexed: 12/26/2023]
Abstract
Much of the language we encounter in our everyday lives comes in the form of conversation, yet the majority of research on the neural basis of language comprehension has used input from only one speaker at a time. Twenty adults were scanned while passively observing audiovisual conversations using functional magnetic resonance imaging. In a block-design task, participants watched 20 s videos of puppets speaking either to another puppet (the dialogue condition) or directly to the viewer (the monologue condition), while the audio was either comprehensible (played forward) or incomprehensible (played backward). Individually functionally localized left-hemisphere language regions responded more to comprehensible than incomprehensible speech but did not respond differently to dialogue than monologue. In a second task, participants watched videos (1-3 min each) of two puppets conversing with each other, in which one puppet was comprehensible while the other's speech was reversed. All participants saw the same visual input but were randomly assigned which character's speech was comprehensible. In left-hemisphere cortical language regions, the time course of activity was correlated only among participants who heard the same character speaking comprehensibly, despite identical visual input across all participants. For comparison, some individually localized theory of mind regions and right-hemisphere homologues of language regions responded more to dialogue than monologue in the first task, and in the second task, activity in some regions was correlated across all participants regardless of which character was speaking comprehensibly. Together, these results suggest that canonical left-hemisphere cortical language regions are not sensitive to differences between observed dialogue and monologue.
Collapse
|
45
|
Peterson M, Braga RM, Floris DL, Nielsen JA. Evidence for a Compensatory Relationship between Left- and Right-Lateralized Brain Networks. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.08.570817. [PMID: 38106130 PMCID: PMC10723397 DOI: 10.1101/2023.12.08.570817] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
The two hemispheres of the human brain are functionally asymmetric. At the network level, the language network exhibits left-hemisphere lateralization. While this asymmetry is widely replicated, the extent to which other functional networks demonstrate lateralization remains a subject of Investigation. Additionally, it is unknown how the lateralization of one functional network may affect the lateralization of other networks within individuals. We quantified lateralization for each of 17 networks by computing the relative surface area on the left and right cerebral hemispheres. After examining the ecological, convergent, and external validity and test-retest reliability of this surface area-based measure of lateralization, we addressed two hypotheses across multiple datasets (Human Connectome Project = 553, Human Connectome Project-Development = 343, Natural Scenes Dataset = 8). First, we hypothesized that networks associated with language, visuospatial attention, and executive control would show the greatest lateralization. Second, we hypothesized that relationships between lateralized networks would follow a dependent relationship such that greater left-lateralization of a network would be associated with greater right-lateralization of a different network within individuals, and that this pattern would be systematic across individuals. A language network was among the three networks identified as being significantly left-lateralized, and attention and executive control networks were among the five networks identified as being significantly right-lateralized. Next, correlation matrices, an exploratory factor analysis, and confirmatory factor analyses were used to test the second hypothesis and examine the organization of lateralized networks. We found general support for a dependent relationship between highly left- and right-lateralized networks, meaning that across subjects, greater left lateralization of a given network (such as a language network) was linked to greater right lateralization of another network (such as a ventral attention/salience network) and vice versa. These results further our understanding of brain organization at the macro-scale network level in individuals, carrying specific relevance for neurodevelopmental conditions characterized by disruptions in lateralization such as autism and schizophrenia.
Collapse
Affiliation(s)
- Madeline Peterson
- Department of Psychology, Brigham Young University, Provo, UT, 84602, USA
| | - Rodrigo M. Braga
- Department of Neurology, Northwestern University Feinberg School of Medicine, Chicago, IL, 60611, USA
| | - Dorothea L. Floris
- Methods of Plasticity Research, Department of Psychology, University of Zurich, Zurich, Switzerland
- Department of Cognitive Neuroscience, Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands
| | - Jared A. Nielsen
- Department of Psychology, Brigham Young University, Provo, UT, 84602, USA
- Neuroscience Center, Brigham Young University, Provo, UT, 84604, USA
| |
Collapse
|
46
|
McMahon E, Bonner MF, Isik L. Hierarchical organization of social action features along the lateral visual pathway. Curr Biol 2023; 33:5035-5047.e8. [PMID: 37918399 PMCID: PMC10841461 DOI: 10.1016/j.cub.2023.10.015] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 09/01/2023] [Accepted: 10/10/2023] [Indexed: 11/04/2023]
Abstract
Recent theoretical work has argued that in addition to the classical ventral (what) and dorsal (where/how) visual streams, there is a third visual stream on the lateral surface of the brain specialized for processing social information. Like visual representations in the ventral and dorsal streams, representations in the lateral stream are thought to be hierarchically organized. However, no prior studies have comprehensively investigated the organization of naturalistic, social visual content in the lateral stream. To address this question, we curated a naturalistic stimulus set of 250 3-s videos of two people engaged in everyday actions. Each clip was richly annotated for its low-level visual features, mid-level scene and object properties, visual social primitives (including the distance between people and the extent to which they were facing), and high-level information about social interactions and affective content. Using a condition-rich fMRI experiment and a within-subject encoding model approach, we found that low-level visual features are represented in early visual cortex (EVC) and middle temporal (MT) area, mid-level visual social features in extrastriate body area (EBA) and lateral occipital complex (LOC), and high-level social interaction information along the superior temporal sulcus (STS). Communicative interactions, in particular, explained unique variance in regions of the STS after accounting for variance explained by all other labeled features. Taken together, these results provide support for representation of increasingly abstract social visual content-consistent with hierarchical organization-along the lateral visual stream and suggest that recognizing communicative actions may be a key computational goal of the lateral visual pathway.
Collapse
Affiliation(s)
- Emalie McMahon
- Department of Cognitive Science, Zanvyl Krieger School of Arts & Sciences, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA.
| | - Michael F Bonner
- Department of Cognitive Science, Zanvyl Krieger School of Arts & Sciences, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA
| | - Leyla Isik
- Department of Cognitive Science, Zanvyl Krieger School of Arts & Sciences, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA; Department of Biomedical Engineering, Whiting School of Engineering, Johns Hopkins University, Suite 400 West, Wyman Park Building, 3400 N. Charles Street, Baltimore, MD 21218, USA
| |
Collapse
|
47
|
van der Burght CL, Friederici AD, Maran M, Papitto G, Pyatigorskaya E, Schroën JAM, Trettenbrein PC, Zaccarella E. Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language. J Cogn Neurosci 2023; 35:2067-2088. [PMID: 37713672 DOI: 10.1162/jocn_a_02058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023]
Abstract
The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.
Collapse
Affiliation(s)
| | - Angela D Friederici
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Matteo Maran
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Giorgio Papitto
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Elena Pyatigorskaya
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Joëlle A M Schroën
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Patrick C Trettenbrein
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
- University of Göttingen, Göttingen, Germany
| | - Emiliano Zaccarella
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
48
|
Martelletti DM, Luzuriaga M, Furman M. 'What makes you say so?' Metacognition improves the sustained learning of inferential reading skills in English as a second language. Trends Neurosci Educ 2023; 33:100213. [PMID: 38049292 DOI: 10.1016/j.tine.2023.100213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 09/11/2023] [Accepted: 09/12/2023] [Indexed: 12/06/2023]
Abstract
PURPOSE This quasi-experimental study investigates the impact of enhancing metacognition in learning inferential reading skills in English as a second language. PROCEDURES Six Grade 4 classes were randomly assigned to two groups. The "Control group" received an instructional unit on inferential reading skills. The "Metacognition group" received the same unit, including metacognitive activities. Students were assessed in metacognitive and inferential reading skills before (pre-test), immediately after (post-test) and four weeks after the intervention (deferred test). FINDINGS Metacognitive strategy instruction enhanced student learning of inferential reading skills and its sustainability in time. The Metacognition group attained a significantly higher average score in deploying metacognitive skills both in the post and deferred tests, indicating that the intervention was effective, as intended, to this end. While both groups significantly improved their proficiency in inferential reading skills after working with the provided instructional unit, there was a significant difference in the Metacognition group, which outperformed the Control one, even more strongly in the deferred test. CONCLUSIONS Findings support the importance of deliberately promoting metacognition as it positively impacts learning outcomes and sustainability.
Collapse
Affiliation(s)
| | - Mariana Luzuriaga
- School of Education, Universidad de San Andres, Buenos Aires, Argentina; School of Education, Universidad de San Andres, Buenos Aires, CONICET, Argentina
| | - Melina Furman
- School of Education, Universidad de San Andres, Buenos Aires, Argentina; School of Education, Universidad de San Andres, Buenos Aires, CONICET, Argentina.
| |
Collapse
|
49
|
García AM, de Leon J, Tee BL, Blasi DE, Gorno-Tempini ML. Speech and language markers of neurodegeneration: a call for global equity. Brain 2023; 146:4870-4879. [PMID: 37497623 PMCID: PMC10690018 DOI: 10.1093/brain/awad253] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 06/29/2023] [Accepted: 07/15/2023] [Indexed: 07/28/2023] Open
Abstract
In the field of neurodegeneration, speech and language assessments are useful for diagnosing aphasic syndromes and for characterizing other disorders. As a complement to classic tests, scalable and low-cost digital tools can capture relevant anomalies automatically, potentially supporting the quest for globally equitable markers of brain health. However, this promise remains unfulfilled due to limited linguistic diversity in scientific works and clinical instruments. Here we argue for cross-linguistic research as a core strategy to counter this problem. First, we survey the contributions of linguistic assessments in the study of primary progressive aphasia and the three most prevalent neurodegenerative disorders worldwide-Alzheimer's disease, Parkinson's disease, and behavioural variant frontotemporal dementia. Second, we address two forms of linguistic unfairness in the literature: the neglect of most of the world's 7000 languages and the preponderance of English-speaking cohorts. Third, we review studies showing that linguistic dysfunctions in a given disorder may vary depending on the patient's language and that English speakers offer a suboptimal benchmark for other language groups. Finally, we highlight different approaches, tools and initiatives for cross-linguistic research, identifying core challenges for their deployment. Overall, we seek to inspire timely actions to counter a looming source of inequity in behavioural neurology.
Collapse
Affiliation(s)
- Adolfo M García
- Global Brain Health Institute, University of California, San Francisco, CA 94143, USA
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires B1644BID, Argentina
- Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, Santiago 9160000, Chile
- Latin American Brain Health (BrainLat) Institute, Universidad Adolfo Ibáñez, Avenida Diagonal Las Torres 2640 (7941169), Santiago, Peñalolén, Región Metropolitana, Chile
| | - Jessica de Leon
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, CA 94143, USA
| | - Boon Lead Tee
- Global Brain Health Institute, University of California, San Francisco, CA 94143, USA
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, CA 94143, USA
| | - Damián E Blasi
- Data Science Initiative, Harvard University, Cambridge, MA 02138, USA
- Department of Human Evolutionary Biology, Harvard University, Cambridge, MA 02138, USA
- Department of Linguistic and Cultural Evolution, Max Planck Institute for the Science of Human History, Jena 07745, Germany
| | - Maria Luisa Gorno-Tempini
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, CA 94143, USA
| |
Collapse
|
50
|
Wang J, Lin H, Cai Q. How Grammar Conveys Meaning: Language-Specific Spatial Encoding Patterns and Cross-Language Commonality in Higher-Order Neural Space. J Neurosci 2023; 43:7831-7841. [PMID: 37714708 PMCID: PMC10648508 DOI: 10.1523/jneurosci.0599-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 09/03/2023] [Accepted: 09/11/2023] [Indexed: 09/17/2023] Open
Abstract
Languages come in different forms but have shared meanings to convey. Some meanings are expressed by sentence structure and morphologic inflections rather than content words, such as indicating time frame using tense. This fMRI study investigates whether there is cross-language common representation of grammatical meanings that can be identified from neural signatures in the bilingual human brain. Based on the representations in intersentence neural similarity space, identifying grammatical construction of a sentence in one language by models trained on the other language resulted in reliable accuracy. By contrast, cross-language identification of grammatical construction by spatially matched activation patterns was only marginally accurate. Brain locations representing grammatical meaning in the two languages were interleaved in common regions bilaterally. The locations of voxels representing grammatical features in the second language were more varied across individuals than voxels representing the first language. These findings suggest grammatical meaning is represented by language-specific activation patterns, which is different from lexical semantics. Commonality of grammatical meaning is neurally reflected only in the interstimulus similarity space.SIGNIFICANCE STATEMENT Whether human brain encodes sentence-level meanings beyond content words in different languages similarly has been a long-standing question. We characterize the neural representations of similar grammatical meanings in different languages. Using complementary analytic approaches on fMRI data, we show that the same grammatical meaning is neurally represented as the common pattern of neural distances between sentences. The results suggest the possibility of identifying specific grammatical meaning expressed by different morphologic and syntactic implementations of different languages. The neural realization of grammatical meanings is constrained by the specific language being used, but the relationships between the neural representations of sentences are preserved across languages. These findings have some theoretical implications on a distinction between grammar and lexical meanings.
Collapse
Affiliation(s)
- Jing Wang
- Key Laboratory of Brain Functional Genomics (MOE & STCSM), Affiliated Mental Health Center (ECNU), Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 20062, China
- Shanghai Changning Mental Health Center, Shanghai 200335, China
- Shanghai Center for Brain Science and Brain-Inspired Technology, East China Normal University, Shanghai 200062, China
| | - Hui Lin
- Shanghai Key Laboratory of Artificial Intelligence in Learning and Cognitive Science, LAIX Inc., Shanghai 200090, China
| | - Qing Cai
- Key Laboratory of Brain Functional Genomics (MOE & STCSM), Affiliated Mental Health Center (ECNU), Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 20062, China
- Shanghai Changning Mental Health Center, Shanghai 200335, China
- Shanghai Center for Brain Science and Brain-Inspired Technology, East China Normal University, Shanghai 200062, China
- New York University-ECNU Institute of Brain and Cognitive Science, New York University, Shanghai 200062, China
| |
Collapse
|