1
|
Castellucci GA, Kovach CK, Tabasi F, Christianson D, Greenlee JDW, Long MA. Stimulation of caudal inferior and middle frontal gyri disrupts planning during spoken interaction. Curr Biol 2024; 34:2719-2727.e5. [PMID: 38823382 PMCID: PMC11187660 DOI: 10.1016/j.cub.2024.04.080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2024] [Revised: 03/06/2024] [Accepted: 04/30/2024] [Indexed: 06/03/2024]
Abstract
Turn-taking is a central feature of conversation across languages and cultures.1,2,3,4 This key social behavior requires numerous sensorimotor and cognitive operations1,5,6 that can be organized into three general phases: comprehension of a partner's turn, preparation of a speaker's own turn, and execution of that turn. Using intracranial electrocorticography, we recently demonstrated that neural activity related to these phases is functionally distinct during turn-taking.7 In particular, networks active during the perceptual and articulatory stages of turn-taking consisted of structures known to be important for speech-related sensory and motor processing,8,9,10,11,12,13,14,15,16,17 while putative planning dynamics were most regularly observed in the caudal inferior frontal gyrus (cIFG) and the middle frontal gyrus (cMFG). To test if these structures are necessary for planning during spoken interaction, we used direct electrical stimulation (DES) to transiently perturb cortical function in neurosurgical patient-volunteers performing a question-answer task.7,18,19 We found that stimulating the cIFG and cMFG led to various response errors9,13,20,21 but not gross articulatory deficits, which instead resulted from DES of structures involved in motor control8,13,20,22 (e.g., the precentral gyrus). Furthermore, perturbation of the cIFG and cMFG delayed inter-speaker timing-consistent with slowed planning-while faster responses could result from stimulation of sites located in other areas. Taken together, our findings suggest that the cIFG and cMFG contain critical preparatory circuits that are relevant for interactive language use.
Collapse
Affiliation(s)
- Gregg A Castellucci
- NYU Neuroscience Institute and Department of Otolaryngology, New York University Langone Medical Center, New York, NY 10016, USA; Center for Neural Science, New York University, New York, NY 10003, USA
| | - Christopher K Kovach
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA
| | - Farhad Tabasi
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA
| | - David Christianson
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA
| | - Jeremy D W Greenlee
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA 52242, USA; Iowa Neuroscience Institute, Iowa City, IA 52242, USA
| | - Michael A Long
- NYU Neuroscience Institute and Department of Otolaryngology, New York University Langone Medical Center, New York, NY 10016, USA; Center for Neural Science, New York University, New York, NY 10003, USA.
| |
Collapse
|
2
|
Ozernov-Palchik O, O'Brien AM, Lee EJ, Richardson H, Romeo R, Lipkin B, Small H, Capella J, Nieto-Castañón A, Saxe R, Gabrieli JDE, Fedorenko E. Precision fMRI reveals that the language network exhibits adult-like left-hemispheric lateralization by 4 years of age. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.15.594172. [PMID: 38798360 PMCID: PMC11118489 DOI: 10.1101/2024.05.15.594172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
Left hemisphere damage in adulthood often leads to linguistic deficits, but many cases of early damage leave linguistic processing preserved, and a functional language system can develop in the right hemisphere. To explain this early apparent equipotentiality of the two hemispheres for language, some have proposed that the language system is bilateral during early development and only becomes left-lateralized with age. We examined language lateralization using functional magnetic resonance imaging with two large pediatric cohorts (total n=273 children ages 4-16; n=107 adults). Strong, adult-level left-hemispheric lateralization (in activation volume and response magnitude) was evident by age 4. Thus, although the right hemisphere can take over language function in some cases of early brain damage, and although some features of the language system do show protracted development (magnitude of language response and strength of inter-regional correlations in the language network), the left-hemisphere bias for language is robustly present by 4 years of age. These results call for alternative accounts of early equipotentiality of the two hemispheres for language. Significance Statement Language is the most canonical function that shows a strong hemispheric asymmetry in adult brains. However, whether the language system is already lateralized to the left hemisphere early in development has long been debated, given that early left-hemisphere damage often leaves language processing unimpaired. We examined the developmental trajectory of language lateralization in two large-scale pediatric datasets using robust individual-subject fMRI approaches. We found that the language system exhibits adult-like left-hemispheric lateralization by age 4, although other aspects of the neural infrastructure for language show a clear change between age 4 and late childhood. These findings challengethe claim that the language system is bilateral during early development and call for alternative accounts of early hemispheric equipotentiality for language.
Collapse
|
3
|
Tang X, Turesky TK, Escalante ES, Loh MY, Xia M, Yu X, Gaab N. Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.06.22.546194. [PMID: 38895379 PMCID: PMC11185523 DOI: 10.1101/2023.06.22.546194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition. Highlights Clustering analyses revealed a modular language network in the infant brainInfant language network characteristics associate with school-age reading outcomesThese longitudinal associations are mediated by kindergarten-age phonological skills.
Collapse
|
4
|
Rangus I, Rios AS, Horn A, Fritsch M, Khalil A, Villringer K, Udke B, Ihrke M, Grittner U, Galinovic I, Al-Fatly B, Endres M, Kufner A, Nolte CH. Fronto-thalamic networks and the left ventral thalamic nuclei play a key role in aphasia after thalamic stroke. Commun Biol 2024; 7:700. [PMID: 38849518 PMCID: PMC11161613 DOI: 10.1038/s42003-024-06399-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Accepted: 05/29/2024] [Indexed: 06/09/2024] Open
Abstract
Thalamic aphasia results from focal thalamic lesions that cause dysfunction of remote but functionally connected cortical areas due to language network perturbation. However, specific local and network-level neural substrates of thalamic aphasia remain incompletely understood. Using lesion symptom mapping, we demonstrate that lesions in the left ventrolateral and ventral anterior thalamic nucleus are most strongly associated with aphasia in general and with impaired semantic and phonemic fluency and complex comprehension in particular. Lesion network mapping (using a normative connectome based on fMRI data from 1000 healthy individuals) reveals a Thalamic aphasia network encompassing widespread left-hemispheric cerebral connections, with Broca's area showing the strongest associations, followed by the superior and middle frontal gyri, precentral and paracingulate gyri, and globus pallidus. Our results imply the critical involvement of the left ventrolateral and left ventral anterior thalamic nuclei in engaging left frontal cortical areas, especially Broca's area, during language processing.
Collapse
Affiliation(s)
- Ida Rangus
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany.
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany.
| | - Ana Sofia Rios
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
| | - Andreas Horn
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit experimenteller Neurologie, Movement Disorder and Neuromodulation Unit, Berlin, Germany
- Department of Neurology, Harvard Medical School, Boston, MA, USA
- Center for Brain Circuit Therapeutics, Brigham and Women's Hospital, Boston, MA, USA
- Department of Neurology, Brigham and Women's Hospital, Boston, MA, USA
| | - Merve Fritsch
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Psychiatrie und Psychotherapie, Berlin, Germany
| | - Ahmed Khalil
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany
| | - Kersten Villringer
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany
| | - Birgit Udke
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Audiologie und Phoniatrie, Berlin, Germany
| | - Manuela Ihrke
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Audiologie und Phoniatrie, Berlin, Germany
| | - Ulrike Grittner
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institut für Biometrie und klinische Epidemiologie, Berlin, Germany
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Ivana Galinovic
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany
| | - Bassam Al-Fatly
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit experimenteller Neurologie, Movement Disorder and Neuromodulation Unit, Berlin, Germany
| | - Matthias Endres
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
- German Center for Cardiovascular Research (Deutsches Zentrum für Herz Kreislauferkrankungen, DZHK), Partner Site Berlin, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, NeuroCure Cluster of Excellence, NeuroCure Clinical Research Center (NCRC), Berlin, Germany
- German Center for Neurodegenerative Diseases (Deutsches Zentrum für Neurodegenerative Erkrankungen, DZNE), Partner Site Berlin, Berlin, Germany
| | - Anna Kufner
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany
| | - Christian H Nolte
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Neurologie mit Experimenteller Neurologie, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Center for Stroke Research Berlin (CSB), Berlin, Germany
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
- German Center for Cardiovascular Research (Deutsches Zentrum für Herz Kreislauferkrankungen, DZHK), Partner Site Berlin, Berlin, Germany
| |
Collapse
|
5
|
Tang X, Turesky TK, Escalante ES, Loh MY, Xia M, Yu X, Gaab N. Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills. Dev Cogn Neurosci 2024; 68:101405. [PMID: 38875769 DOI: 10.1016/j.dcn.2024.101405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 04/30/2024] [Accepted: 06/06/2024] [Indexed: 06/16/2024] Open
Abstract
Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.
Collapse
Affiliation(s)
- Xinyi Tang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Ted K Turesky
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| | - Elizabeth S Escalante
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA; Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC 27514, USA
| | - Megan Yf Loh
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| | - Mingrui Xia
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Xi Yu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| | - Nadine Gaab
- Harvard Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| |
Collapse
|
6
|
Shain C, Kean H, Casto C, Lipkin B, Affourtit J, Siegelman M, Mollica F, Fedorenko E. Distributed Sensitivity to Syntax and Semantics throughout the Language Network. J Cogn Neurosci 2024; 36:1427-1471. [PMID: 38683732 DOI: 10.1162/jocn_a_02164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.
Collapse
Affiliation(s)
| | - Hope Kean
- Massachusetts Institute of Technology
| | | | | | | | | | | | | |
Collapse
|
7
|
Fedorenko E, Piantadosi ST, Gibson EAF. Language is primarily a tool for communication rather than thought. Nature 2024; 630:575-586. [PMID: 38898296 DOI: 10.1038/s41586-024-07522-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 05/03/2024] [Indexed: 06/21/2024]
Abstract
Language is a defining characteristic of our species, but the function, or functions, that it serves has been debated for centuries. Here we bring recent evidence from neuroscience and allied disciplines to argue that in modern humans, language is a tool for communication, contrary to a prominent view that we use language for thinking. We begin by introducing the brain network that supports linguistic ability in humans. We then review evidence for a double dissociation between language and thought, and discuss several properties of language that suggest that it is optimized for communication. We conclude that although the emergence of language has unquestionably transformed human culture, language does not appear to be a prerequisite for complex thought, including symbolic thought. Instead, language is a powerful tool for the transmission of cultural knowledge; it plausibly co-evolved with our thinking and reasoning capacities, and only reflects, rather than gives rise to, the signature sophistication of human cognition.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Massachusetts Institute of Technology, Cambridge, MA, USA.
- Speech and Hearing in Bioscience and Technology Program at Harvard University, Boston, MA, USA.
| | | | | |
Collapse
|
8
|
Dworetsky A, Seitzman BA, Adeyemo B, Nielsen AN, Hatoum AS, Smith DM, Nichols TE, Neta M, Petersen SE, Gratton C. Two common and distinct forms of variation in human functional brain networks. Nat Neurosci 2024; 27:1187-1198. [PMID: 38689142 DOI: 10.1038/s41593-024-01618-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 03/07/2024] [Indexed: 05/02/2024]
Abstract
The cortex has a characteristic layout with specialized functional areas forming distributed large-scale networks. However, substantial work shows striking variation in this organization across people, which relates to differences in behavior. While most previous work treats individual differences as linked to boundary shifts between the borders of regions, here we show that cortical 'variants' also occur at a distance from their typical position, forming ectopic intrusions. Both 'border' and 'ectopic' variants are common across individuals, but differ in their location, network associations, properties of subgroups of individuals, activations during tasks, and prediction of behavioral phenotypes. Border variants also track significantly more with shared genetics than ectopic variants, suggesting a closer link between ectopic variants and environmental influences. This work argues that these two dissociable forms of variation-border shifts and ectopic intrusions-must be separately accounted for in the analysis of individual differences in cortical systems across people.
Collapse
Affiliation(s)
- Ally Dworetsky
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, USA
- Department of Psychology, Florida State University, Tallahassee, FL, USA
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Benjamin A Seitzman
- Department of Radiation Oncology, Washington University School of Medicine, St. Louis, MO, USA
| | - Babatunde Adeyemo
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA
| | - Ashley N Nielsen
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA
| | - Alexander S Hatoum
- Department of Psychological and Brain Sciences, Washington University School of Medicine, St. Louis, MO, USA
| | - Derek M Smith
- Department of Psychology, Northwestern University, Evanston, IL, USA
- Department of Neurology, Division of Cognitive Neurology/Neuropsychology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Thomas E Nichols
- Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, Nuffield Department of Population Health, University of Oxford, Oxford, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Maital Neta
- Department of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA
- Center for Brain, Biology, and Behavior, University of Nebraska-Lincoln, Lincoln, NE, USA
| | - Steven E Petersen
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, USA
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA
- Department of Psychological and Brain Sciences, Washington University School of Medicine, St. Louis, MO, USA
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO, USA
- Department of Biomedical Engineering, Washington University School of Medicine, St. Louis, MO, USA
| | - Caterina Gratton
- Department of Psychology, Florida State University, Tallahassee, FL, USA.
- Department of Psychology, Northwestern University, Evanston, IL, USA.
- Neuroscience Program, Florida State University, Tallahassee, FL, USA.
- Department of Neurology, Northwestern University, Evanston, IL, USA.
- Interdepartmental Neuroscience Program, Northwestern University, Evanston, IL, USA.
| |
Collapse
|
9
|
Kurteff GL, Field AM, Asghar S, Tyler-Kabara EC, Clarke D, Weiner HL, Anderson AE, Watrous AJ, Buchanan RJ, Modur PN, Hamilton LS. Processing of auditory feedback in perisylvian and insular cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.14.593257. [PMID: 38798574 PMCID: PMC11118286 DOI: 10.1101/2024.05.14.593257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
When we speak, we not only make movements with our mouth, lips, and tongue, but we also hear the sound of our own voice. Thus, speech production in the brain involves not only controlling the movements we make, but also auditory and sensory feedback. Auditory responses are typically suppressed during speech production compared to perception, but how this manifests across space and time is unclear. Here we recorded intracranial EEG in seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy who performed a reading/listening task to investigate how other auditory responses are modulated during speech production. We identified onset and sustained responses to speech in bilateral auditory cortex, with a selective suppression of onset responses during speech production. Onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, the posterior insula responded at sentence onset for both perception and production, suggesting a role in multisensory integration during feedback control.
Collapse
Affiliation(s)
- Garret Lynn Kurteff
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
| | - Alyssa M. Field
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
| | - Saman Asghar
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Elizabeth C. Tyler-Kabara
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Department of Pediatrics, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Dave Clarke
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Department of Pediatrics, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Howard L. Weiner
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Anne E. Anderson
- Department of Pediatrics, Baylor College of Medicine, Houston, TX, USA
| | - Andrew J. Watrous
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Robert J. Buchanan
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Pradeep N. Modur
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Liberty S. Hamilton
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Lead contact
| |
Collapse
|
10
|
Riveland R, Pouget A. Natural language instructions induce compositional generalization in networks of neurons. Nat Neurosci 2024; 27:988-999. [PMID: 38499855 DOI: 10.1038/s41593-024-01607-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2023] [Accepted: 02/15/2024] [Indexed: 03/20/2024]
Abstract
A fundamental human cognitive feat is to interpret linguistic instructions in order to perform novel tasks without explicit task experience. Yet, the neural computations that might be used to accomplish this remain poorly understood. We use advances in natural language processing to create a neural model of generalization based on linguistic instructions. Models are trained on a set of common psychophysical tasks, and receive instructions embedded by a pretrained language model. Our best models can perform a previously unseen task with an average performance of 83% correct based solely on linguistic instructions (that is, zero-shot learning). We found that language scaffolds sensorimotor representations such that activity for interrelated tasks shares a common geometry with the semantic representations of instructions, allowing language to cue the proper composition of practiced skills in unseen settings. We show how this model generates a linguistic description of a novel task it has identified using only motor feedback, which can subsequently guide a partner model to perform the task. Our models offer several experimentally testable predictions outlining how linguistic information must be represented to facilitate flexible and general cognition in the human brain.
Collapse
Affiliation(s)
- Reidar Riveland
- Department of Basic Neuroscience, University of Geneva, Geneva, Switzerland.
| | - Alexandre Pouget
- Department of Basic Neuroscience, University of Geneva, Geneva, Switzerland
| |
Collapse
|
11
|
Zhu QQ, Tian S, Zhang L, Ding HY, Gao YX, Tang Y, Yang X, Zhu Y, Qi M. Altered dynamic amplitude of low-frequency fluctuation in individuals at high risk for Alzheimer's disease. Eur J Neurosci 2024; 59:2391-2402. [PMID: 38314647 DOI: 10.1111/ejn.16267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 01/12/2024] [Accepted: 01/14/2024] [Indexed: 02/06/2024]
Abstract
The brain's dynamic spontaneous neural activity is significant in supporting cognition; however, how brain dynamics go awry in subjective cognitive decline (SCD) and mild cognitive impairment (MCI) remains unclear. Thus, the current study aimed to investigate the dynamic amplitude of low-frequency fluctuation (dALFF) alterations in patients at high risk for Alzheimer's disease and to explore its correlation with clinical cognitive assessment scales, to identify an early imaging sign for these special populations. A total of 152 participants, including 72 SCD patients, 44 MCI patients and 36 healthy controls (HCs), underwent a resting-state functional magnetic resonance imaging and were assessed with various neuropsychological tests. The dALFF was measured using sliding-window analysis. We employed canonical correlation analysis (CCA) to examine the bi-multivariate correlations between neuropsychological scales and altered dALFF among multiple regions in SCD and MCI patients. Compared to those in the HC group, both the MCI and SCD groups showed higher dALFF values in the right opercular inferior frontal gyrus (voxel P < .001, cluster P < .05, correction). Moreover, the CCA models revealed that behavioural tests relevant to inattention correlated with the dALFF of the right middle frontal gyrus and right opercular inferior frontal gyrus, which are involved in frontoparietal networks (R = .43, P = .024). In conclusion, the brain dynamics of neural activity in frontal areas provide insights into the shared neural basis underlying SCD and MCI.
Collapse
Affiliation(s)
- Qin-Qin Zhu
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Shui Tian
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Ling Zhang
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Hong-Yuan Ding
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Ya-Xin Gao
- Rehabilitation Center, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou Municipal Hospital, Suzhou, China
| | - Yin Tang
- Department of Medical imaging, Jingjiang People's Hospital, Jingjiang, China
| | - Xi Yang
- School of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
| | - Yi Zhu
- Rehabilitation Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Ming Qi
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| |
Collapse
|
12
|
León-Cabrera P, Hjortdal A, Berthelsen SG, Rodríguez-Fornells A, Roll M. Neurophysiological signatures of prediction in language: A critical review of anticipatory negativities. Neurosci Biobehav Rev 2024; 160:105624. [PMID: 38492763 DOI: 10.1016/j.neubiorev.2024.105624] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 02/09/2024] [Accepted: 03/13/2024] [Indexed: 03/18/2024]
Abstract
Recent event-related potential (ERP) studies in language comprehension converge in finding anticipatory negativities preceding words or word segments that can be pre-activated based on either sentence contexts or phonological cues. We review these findings from different paradigms in the light of evidence from other cognitive domains in which slow negative potentials have long been associated with anticipatory processes and discuss their potential underlying mechanisms. We propose that this family of anticipatory negativities captures common mechanisms associated with the pre-activation of linguistic information both within words and within sentences. Future studies could utilize these anticipatory negativities in combination with other, well-established ERPs, to simultaneously track prediction-related processes emerging at different time intervals (before and after the perception of pre-activated input) and with distinct time courses (shorter-lived and longer-lived cognitive operations).
Collapse
Affiliation(s)
- Patricia León-Cabrera
- Cognition and Brain Plasticity Unit, Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain; Department of Basic Sciences, Universitat Internacional de Catalunya, Sant Cugat del Vallès, Barcelona, Spain.
| | - Anna Hjortdal
- Centre for Languages and Literature (SOL), Lund University, Lund, Sweden
| | - Sabine Gosselke Berthelsen
- Centre for Languages and Literature (SOL), Lund University, Lund, Sweden; Department of Nordic Studies and Linguistics (NorS), University of Copenhagen, Copenhagen, Denmark
| | - Antoni Rodríguez-Fornells
- Cognition and Brain Plasticity Unit, Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain; Institut d'Investigació Biomèdica de Bellvitge (IDIBELL), Hospitalet de Llobregat, Barcelona, Spain; Catalan Institution for Research and Advanced Studies (ICREA), Barcelona, Spain
| | - Mikael Roll
- Centre for Languages and Literature (SOL), Lund University, Lund, Sweden.
| |
Collapse
|
13
|
Fedorenko E, Ivanova AA, Regev TI. The language network as a natural kind within the broader landscape of the human brain. Nat Rev Neurosci 2024; 25:289-312. [PMID: 38609551 DOI: 10.1038/s41583-024-00802-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/23/2024] [Indexed: 04/14/2024]
Abstract
Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- The Program in Speech and Hearing in Bioscience and Technology, Harvard University, Cambridge, MA, USA.
| | - Anna A Ivanova
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Tamar I Regev
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
14
|
Day TKM, Hermosillo R, Conan G, Randolph A, Perrone A, Earl E, Byington N, Hendrickson TJ, Elison JT, Fair DA, Feczko E. Multi-level fMRI analysis applied to hemispheric specialization in the language network, functional areas, and their behavioral correlations in the ABCD sample. Dev Cogn Neurosci 2024; 66:101355. [PMID: 38354531 PMCID: PMC10875197 DOI: 10.1016/j.dcn.2024.101355] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 01/06/2024] [Accepted: 02/03/2024] [Indexed: 02/16/2024] Open
Abstract
Prior research suggests that the organization of the language network in the brain is left-dominant and becomes more lateralized with age and increasing language skill. The age at which specific components of the language network become adult-like varies depending on the abilities they subserve. So far, a large, developmental study has not included a language task paradigm, so we introduce a method to study resting-state laterality in the Adolescent Brain Cognitive Development (ABCD) study. Our approach mixes source timeseries between left and right homotopes of the (1) inferior frontal and (2) middle temporal gyri and (3) a region we term "Wernicke's area" near the supramarginal gyrus. Our large subset sample size of ABCD (n = 6153) allows improved reliability and validity compared to previous, smaller studies of brain-behavior associations. We show that behavioral metrics from the NIH Youth Toolbox and other resources are differentially related to tasks with a larger linguistic component over ones with less (e.g., executive function-dominant tasks). These baseline characteristics of hemispheric specialization in youth are critical for future work determining the correspondence of lateralization with language onset in earlier stages of development.
Collapse
Affiliation(s)
- Trevor K M Day
- Institute of Child Development, University of Minnesota, Minneapolis, MN, USA; Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA.
| | - Robert Hermosillo
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA; Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - Gregory Conan
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA
| | - Anita Randolph
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA; Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - Anders Perrone
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA
| | - Eric Earl
- Data Science & Sharing Team, National Institute of Mental Health, Bethesda, MD, USA
| | - Nora Byington
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA
| | - Timothy J Hendrickson
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA; Informatics Institute, University of Minnesota, Minneapolis, MN, USA
| | - Jed T Elison
- Institute of Child Development, University of Minnesota, Minneapolis, MN, USA; Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA; Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - Damien A Fair
- Institute of Child Development, University of Minnesota, Minneapolis, MN, USA; Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA; Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - Eric Feczko
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA; Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
15
|
Menks WM, Ekerdt C, Lemhöfer K, Kidd E, Fernández G, McQueen JM, Janzen G. Developmental changes in brain activation during novel grammar learning in 8-25-year-olds. Dev Cogn Neurosci 2024; 66:101347. [PMID: 38277712 PMCID: PMC10839867 DOI: 10.1016/j.dcn.2024.101347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 01/12/2024] [Accepted: 01/17/2024] [Indexed: 01/28/2024] Open
Abstract
While it is well established that grammar learning success varies with age, the cause of this developmental change is largely unknown. This study examined functional MRI activation across a broad developmental sample of 165 Dutch-speaking individuals (8-25 years) as they were implicitly learning a new grammatical system. This approach allowed us to assess the direct effects of age on grammar learning ability while exploring its neural correlates. In contrast to the alleged advantage of children language learners over adults, we found that adults outperformed children. Moreover, our behavioral data showed a sharp discontinuity in the relationship between age and grammar learning performance: there was a strong positive linear correlation between 8 and 15.4 years of age, after which age had no further effect. Neurally, our data indicate two important findings: (i) during grammar learning, adults and children activate similar brain regions, suggesting continuity in the neural networks that support initial grammar learning; and (ii) activation level is age-dependent, with children showing less activation than older participants. We suggest that these age-dependent processes may constrain developmental effects in grammar learning. The present study provides new insights into the neural basis of age-related differences in grammar learning in second language acquisition.
Collapse
Affiliation(s)
- W M Menks
- Donders Institute for Brain, Cognition and Behaviour, Radboud University and Radboud University Medical Center, Nijmegen, the Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands.
| | - C Ekerdt
- Donders Institute for Brain, Cognition and Behaviour, Radboud University and Radboud University Medical Center, Nijmegen, the Netherlands
| | - K Lemhöfer
- Donders Institute for Brain, Cognition and Behaviour, Radboud University and Radboud University Medical Center, Nijmegen, the Netherlands
| | - E Kidd
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; ARC Centre of Excellence for the Dynamics of Language, Australian National University, Canberra, Australia; School of Literature, Languages, and Linguistics, Australian National University, Canberra, Australia
| | - G Fernández
- Donders Institute for Brain, Cognition and Behaviour, Radboud University and Radboud University Medical Center, Nijmegen, the Netherlands
| | - J M McQueen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University and Radboud University Medical Center, Nijmegen, the Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
| | - G Janzen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University and Radboud University Medical Center, Nijmegen, the Netherlands; Behavioural Science Institute, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
16
|
Li Z, Zhang D. How does the human brain process noisy speech in real life? Insights from the second-person neuroscience perspective. Cogn Neurodyn 2024; 18:371-382. [PMID: 38699619 PMCID: PMC11061069 DOI: 10.1007/s11571-022-09924-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/20/2022] [Accepted: 12/19/2022] [Indexed: 01/07/2023] Open
Abstract
Comprehending speech with the existence of background noise is of great importance for human life. In the past decades, a large number of psychological, cognitive and neuroscientific research has explored the neurocognitive mechanisms of speech-in-noise comprehension. However, as limited by the low ecological validity of the speech stimuli and the experimental paradigm, as well as the inadequate attention on the high-order linguistic and extralinguistic processes, there remains much unknown about how the brain processes noisy speech in real-life scenarios. A recently emerging approach, i.e., the second-person neuroscience approach, provides a novel conceptual framework. It measures both of the speaker's and the listener's neural activities, and estimates the speaker-listener neural coupling with regarding of the speaker's production-related neural activity as a standardized reference. The second-person approach not only promotes the use of naturalistic speech but also allows for free communication between speaker and listener as in a close-to-life context. In this review, we first briefly review the previous discoveries about how the brain processes speech in noise; then, we introduce the principles and advantages of the second-person neuroscience approach and discuss its implications to unravel the linguistic and extralinguistic processes during speech-in-noise comprehension; finally, we conclude by proposing some critical issues and calls for more research interests in the second-person approach, which would further extend the present knowledge about how people comprehend speech in noise.
Collapse
Affiliation(s)
- Zhuoran Li
- Department of Psychology, School of Social Sciences, Tsinghua University, Room 334, Mingzhai Building, Beijing, 100084 China
- Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, 100084 China
| | - Dan Zhang
- Department of Psychology, School of Social Sciences, Tsinghua University, Room 334, Mingzhai Building, Beijing, 100084 China
- Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, 100084 China
| |
Collapse
|
17
|
Keller TA, Mason RA, Legg AE, Just MA. The neural and cognitive basis of expository text comprehension. NPJ SCIENCE OF LEARNING 2024; 9:21. [PMID: 38514702 PMCID: PMC10957871 DOI: 10.1038/s41539-024-00232-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 02/26/2024] [Indexed: 03/23/2024]
Abstract
As science and technology rapidly progress, it becomes increasingly important to understand how individuals comprehend expository technical texts that explain these advances. This study examined differences in individual readers' technical comprehension performance and differences among texts, using functional brain imaging to measure regional brain activity while students read passages on technical topics and then took a comprehension test. Better comprehension of the technical passages was related to higher activation in regions of the left inferior frontal gyrus, left superior parietal lobe, bilateral dorsolateral prefrontal cortex, and bilateral hippocampus. These areas are associated with the construction of a mental model of the passage and with the integration of new and prior knowledge in memory. Poorer comprehension of the passages was related to greater activation of the ventromedial prefrontal cortex and the precuneus, areas involved in autobiographical and episodic memory retrieval. More comprehensible passages elicited more brain activation associated with establishing links among different types of information in the text and activation associated with establishing conceptual coherence within the text representation. These findings converge with previous behavioral research in their implications for teaching technical learners to become better comprehenders and for improving the structure of instructional texts, to facilitate scientific and technological comprehension.
Collapse
Affiliation(s)
- Timothy A Keller
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA.
| | - Robert A Mason
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Aliza E Legg
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Marcel Adam Just
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| |
Collapse
|
18
|
Regev TI, Kim HS, Chen X, Affourtit J, Schipper AE, Bergen L, Mahowald K, Fedorenko E. High-level language brain regions process sublexical regularities. Cereb Cortex 2024; 34:bhae077. [PMID: 38494886 DOI: 10.1093/cercor/bhae077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 02/05/2024] [Accepted: 02/07/2024] [Indexed: 03/19/2024] Open
Abstract
A network of left frontal and temporal brain regions supports language processing. This "core" language network stores our knowledge of words and constructions as well as constraints on how those combine to form sentences. However, our linguistic knowledge additionally includes information about phonemes and how they combine to form phonemic clusters, syllables, and words. Are phoneme combinatorics also represented in these language regions? Across five functional magnetic resonance imaging experiments, we investigated the sensitivity of high-level language processing brain regions to sublexical linguistic regularities by examining responses to diverse nonwords-sequences of phonemes that do not constitute real words (e.g. punes, silory, flope). We establish robust responses in the language network to visually (experiment 1a, n = 605) and auditorily (experiments 1b, n = 12, and 1c, n = 13) presented nonwords. In experiment 2 (n = 16), we find stronger responses to nonwords that are more well-formed, i.e. obey the phoneme-combinatorial constraints of English. Finally, in experiment 3 (n = 14), we provide suggestive evidence that the responses in experiments 1 and 2 are not due to the activation of real words that share some phonology with the nonwords. The results suggest that sublexical regularities are stored and processed within the same fronto-temporal network that supports lexical and syntactic processes.
Collapse
Affiliation(s)
- Tamar I Regev
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Hee So Kim
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Xuanyi Chen
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Cognitive Sciences, Rice University, Houston, TX 77005, United States
| | - Josef Affourtit
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Abigail E Schipper
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Leon Bergen
- Department of Linguistics, University of California San Diego, San Diego CA 92093, United States
| | - Kyle Mahowald
- Department of Linguistics, University of Texas at Austin, Austin, TX 78712, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- The Harvard Program in Speech and Hearing Bioscience and Technology, Boston, MA 02115, United States
| |
Collapse
|
19
|
Tuckute G, Sathe A, Srikant S, Taliaferro M, Wang M, Schrimpf M, Kay K, Fedorenko E. Driving and suppressing the human language network using large language models. Nat Hum Behav 2024; 8:544-561. [PMID: 38172630 DOI: 10.1038/s41562-023-01783-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 11/10/2023] [Indexed: 01/05/2024]
Abstract
Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of the brain response associated with each sentence. We then use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress the activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also non-invasively control neural activity in higher-level cortical areas, such as the language network.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Aalok Sathe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Shashank Srikant
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
- MIT-IBM Watson AI Lab, Cambridge, MA, USA
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Mingye Wang
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Martin Schrimpf
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Quest for Intelligence, Massachusetts Institute of Technology, Cambridge, MA, USA
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Kendrick Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA, USA.
| |
Collapse
|
20
|
Malik-Moraleda S, Jouravlev O, Taliaferro M, Mineroff Z, Cucu T, Mahowald K, Blank IA, Fedorenko E. Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI. Cereb Cortex 2024; 34:bhae049. [PMID: 38466812 PMCID: PMC10928488 DOI: 10.1093/cercor/bhae049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 01/24/2024] [Accepted: 01/25/2024] [Indexed: 03/13/2024] Open
Abstract
How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g. related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages coexist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.
Collapse
Affiliation(s)
- Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114, United States
| | - Olessia Jouravlev
- Department of Cognitive Science, Carleton University, Ottawa K1S 5B6, Canada
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| | - Zachary Mineroff
- Eberly Center, Carnegie Mellon University, Pittsburgh, PA 15289, United States
| | - Theodore Cucu
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15289, United States
| | - Kyle Mahowald
- Department of Linguistics, The University of Texas at Austin, Austin, TX 78712, United States
| | - Idan A Blank
- Department of Psychology, University of California Los Angeles, Los Angeles, CA 90095, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114, United States
| |
Collapse
|
21
|
Malik-Moraleda S, Jouravlev O, Taliaferro M, Mineroff Z, Cucu T, Mahowald K, Blank IA, Fedorenko E. Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.01.19.524657. [PMID: 36711949 PMCID: PMC9882290 DOI: 10.1101/2023.01.19.524657] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher-proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g., related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages co-exist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.
Collapse
Affiliation(s)
- Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| | - Olessia Jouravlev
- Department of Cognitive Science, Carleton University, Ottawa, Canada, K1S 5B6
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | | | - Theodore Cucu
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15289
| | - Kyle Mahowald
- Department of Linguistics, The University of Texas at Austin, Austin, TX 78712
| | - Idan A. Blank
- Department of Psychology, University of California Los Angeles, CA 90095
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| |
Collapse
|
22
|
Vitória MA, Fernandes FG, van den Boom M, Ramsey N, Raemaekers M. Decoding Single and Paired Phonemes Using 7T Functional MRI. Brain Topogr 2024:10.1007/s10548-024-01034-6. [PMID: 38261272 DOI: 10.1007/s10548-024-01034-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 01/12/2024] [Indexed: 01/24/2024]
Abstract
Several studies have shown that mouth movements related to the pronunciation of individual phonemes are represented in the sensorimotor cortex. This would theoretically allow for brain computer interfaces that are capable of decoding continuous speech by training classifiers based on the activity in the sensorimotor cortex related to the production of individual phonemes. To address this, we investigated the decodability of trials with individual and paired phonemes (pronounced consecutively with one second interval) using activity in the sensorimotor cortex. Fifteen participants pronounced 3 different phonemes and 3 combinations of two of the same phonemes in a 7T functional MRI experiment. We confirmed that support vector machine (SVM) classification of single and paired phonemes was possible. Importantly, by combining classifiers trained on single phonemes, we were able to classify paired phonemes with an accuracy of 53% (33% chance level), demonstrating that activity of isolated phonemes is present and distinguishable in combined phonemes. A SVM searchlight analysis showed that the phoneme representations are widely distributed in the ventral sensorimotor cortex. These findings provide insights about the neural representations of single and paired phonemes. Furthermore, it supports the notion that speech BCI may be feasible based on machine learning algorithms trained on individual phonemes using intracranial electrode grids.
Collapse
Affiliation(s)
- Maria Araújo Vitória
- Brain Center Rudolf Magnus, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Francisco Guerreiro Fernandes
- Brain Center Rudolf Magnus, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Max van den Boom
- Brain Center Rudolf Magnus, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA
| | - Nick Ramsey
- Brain Center Rudolf Magnus, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Mathijs Raemaekers
- Brain Center Rudolf Magnus, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands.
| |
Collapse
|
23
|
Riccardi N, Zhao X, den Ouden DB, Fridriksson J, Desai RH, Wang Y. Network-based statistics distinguish anomic and Broca's aphasia. Brain Struct Funct 2023:10.1007/s00429-023-02738-4. [PMID: 38160205 DOI: 10.1007/s00429-023-02738-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 11/21/2023] [Indexed: 01/03/2024]
Abstract
INTRODUCTION Aphasia is a speech-language impairment commonly caused by damage to the left hemisphere. The neural mechanisms that underpin different types of aphasia and their symptoms are still not fully understood. This study aims to identify differences in resting-state functional connectivity between anomic and Broca's aphasia measured through resting-state functional magnetic resonance imaging (rs-fMRI). METHODS We used the network-based statistic (NBS) method, as well as voxel- and connectome-based lesion symptom mapping (V-, CLSM), to identify distinct neural correlates of the anomic and Broca's groups. To control for lesion effect, we included lesion volume as a covariate in both the NBS method and LSM. RESULTS NBS identified a subnetwork located in the dorsal language stream bilaterally, including supramarginal gyrus, primary sensory, motor, and auditory cortices, and insula. The connections in the subnetwork were weaker in the Broca's group than the anomic group. The properties of the subnetwork were examined through complex network measures, which indicated that regions in right inferior frontal sulcus, right paracentral lobule, and bilateral superior temporal gyrus exhibit intensive interaction. Left superior temporal gyrus, right postcentral gyrus, and left supramarginal gyrus play an important role in information flow and overall communication efficiency. Disruption of this network underlies the constellation of symptoms associated with Broca's aphasia. Whole-brain CLSM did not detect any significant connections, suggesting an advantage of NBS when thousands of connections are considered. However, CLSM identified connections that differentiated Broca's from anomic aphasia when analysis was restricted to a hypothesized network of interest. DISCUSSION We identified novel signatures of resting-state brain network differences between groups of individuals with anomic and Broca's aphasia. We identified a subnetwork of connections that statistically differentiated the resting-state brain networks of the two groups, in comparison with standard CLSM results that yielded isolated connections. Network-level analyses are useful tools for the investigation of the neural correlates of language deficits post-stroke.
Collapse
Affiliation(s)
- Nicholas Riccardi
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Xingpei Zhao
- Department of Epidemiology and Biostatistics, University of South Carolina, Columbia, SC, USA
| | - Dirk-Bart den Ouden
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, USA
| | - Julius Fridriksson
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, USA
| | - Rutvik H Desai
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Yuan Wang
- Department of Epidemiology and Biostatistics, University of South Carolina, Columbia, SC, USA.
| |
Collapse
|
24
|
Olson HA, Chen EM, Lydic KO, Saxe RR. Left-Hemisphere Cortical Language Regions Respond Equally to Observed Dialogue and Monologue. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:575-610. [PMID: 38144236 PMCID: PMC10745132 DOI: 10.1162/nol_a_00123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 09/20/2023] [Indexed: 12/26/2023]
Abstract
Much of the language we encounter in our everyday lives comes in the form of conversation, yet the majority of research on the neural basis of language comprehension has used input from only one speaker at a time. Twenty adults were scanned while passively observing audiovisual conversations using functional magnetic resonance imaging. In a block-design task, participants watched 20 s videos of puppets speaking either to another puppet (the dialogue condition) or directly to the viewer (the monologue condition), while the audio was either comprehensible (played forward) or incomprehensible (played backward). Individually functionally localized left-hemisphere language regions responded more to comprehensible than incomprehensible speech but did not respond differently to dialogue than monologue. In a second task, participants watched videos (1-3 min each) of two puppets conversing with each other, in which one puppet was comprehensible while the other's speech was reversed. All participants saw the same visual input but were randomly assigned which character's speech was comprehensible. In left-hemisphere cortical language regions, the time course of activity was correlated only among participants who heard the same character speaking comprehensibly, despite identical visual input across all participants. For comparison, some individually localized theory of mind regions and right-hemisphere homologues of language regions responded more to dialogue than monologue in the first task, and in the second task, activity in some regions was correlated across all participants regardless of which character was speaking comprehensibly. Together, these results suggest that canonical left-hemisphere cortical language regions are not sensitive to differences between observed dialogue and monologue.
Collapse
|
25
|
Castellucci GA, Kovach CK, Tabasi F, Christianson D, Greenlee JD, Long MA. A frontal cortical network is critical for language planning during spoken interaction. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.26.554639. [PMID: 37693383 PMCID: PMC10491113 DOI: 10.1101/2023.08.26.554639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
Many brain areas exhibit activity correlated with language planning, but the impact of these dynamics on spoken interaction remains unclear. Here we use direct electrical stimulation to transiently perturb cortical function in neurosurgical patient-volunteers performing a question-answer task. Stimulating structures involved in speech motor function evoked diverse articulatory deficits, while perturbations of caudal inferior and middle frontal gyri - which exhibit preparatory activity during conversational turn-taking - led to response errors. Perturbation of the same planning-related frontal regions slowed inter-speaker timing, while faster responses could result from stimulation of sites located in other areas. Taken together, these findings further indicate that caudal inferior and middle frontal gyri constitute a critical planning network essential for interactive language use.
Collapse
|
26
|
Pitcher D, Sliwinska MW, Kaiser D. TMS disruption of the lateral prefrontal cortex increases neural activity in the default mode network when naming facial expressions. Soc Cogn Affect Neurosci 2023; 18:nsad072. [PMID: 38048419 PMCID: PMC10695328 DOI: 10.1093/scan/nsad072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Revised: 10/17/2023] [Accepted: 11/15/2023] [Indexed: 12/06/2023] Open
Abstract
Recognizing facial expressions is dependent on multiple brain networks specialized for different cognitive functions. In the current study, participants (N = 20) were scanned using functional magnetic resonance imaging (fMRI), while they performed a covert facial expression naming task. Immediately prior to scanning thetaburst transcranial magnetic stimulation (TMS) was delivered over the right lateral prefrontal cortex (PFC), or the vertex control site. A group whole-brain analysis revealed that TMS induced opposite effects in the neural responses across different brain networks. Stimulation of the right PFC (compared to stimulation of the vertex) decreased neural activity in the left lateral PFC but increased neural activity in three nodes of the default mode network (DMN): the right superior frontal gyrus, right angular gyrus and the bilateral middle cingulate gyrus. A region of interest analysis showed that TMS delivered over the right PFC reduced neural activity across all functionally localised face areas (including in the PFC) compared to TMS delivered over the vertex. These results suggest that visually recognizing facial expressions is dependent on the dynamic interaction of the face-processing network and the DMN. Our study also demonstrates the utility of combined TMS/fMRI studies for revealing the dynamic interactions between different functional brain networks.
Collapse
Affiliation(s)
- David Pitcher
- Department of Psychology, University of York, Heslington, York YO105DD, UK
| | | | - Daniel Kaiser
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-Universität Gießen, Gießen 35392, Germany
- Center for Mind, Brain and Behaviour, Philipps-Universität Marburg, and Justus-Liebig-Universität Gießen, Marburg 35032, Germany
| |
Collapse
|
27
|
Diveica V, Riedel MC, Salo T, Laird AR, Jackson RL, Binney RJ. Graded functional organization in the left inferior frontal gyrus: evidence from task-free and task-based functional connectivity. Cereb Cortex 2023; 33:11384-11399. [PMID: 37833772 PMCID: PMC10690868 DOI: 10.1093/cercor/bhad373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 08/17/2023] [Accepted: 09/18/2023] [Indexed: 10/15/2023] Open
Abstract
The left inferior frontal gyrus has been ascribed key roles in numerous cognitive domains, such as language and executive function. However, its functional organization is unclear. Possibilities include a singular domain-general function, or multiple functions that can be mapped onto distinct subregions. Furthermore, spatial transition in function may be either abrupt or graded. The present study explored the topographical organization of the left inferior frontal gyrus using a bimodal data-driven approach. We extracted functional connectivity gradients from (i) resting-state fMRI time-series and (ii) coactivation patterns derived meta-analytically from heterogenous sets of task data. We then sought to characterize the functional connectivity differences underpinning these gradients with seed-based resting-state functional connectivity, meta-analytic coactivation modeling and functional decoding analyses. Both analytic approaches converged on graded functional connectivity changes along 2 main organizational axes. An anterior-posterior gradient shifted from being preferentially associated with high-level control networks (anterior functional connectivity) to being more tightly coupled with perceptually driven networks (posterior). A second dorsal-ventral axis was characterized by higher connectivity with domain-general control networks on one hand (dorsal functional connectivity), and with the semantic network, on the other (ventral). These results provide novel insights into an overarching graded functional organization of the functional connectivity that explains its role in multiple cognitive domains.
Collapse
Affiliation(s)
- Veronica Diveica
- Department of Psychology & Cognitive Neuroscience Institute, Bangor University, Bangor, Wales LL57 2AS, United Kingdom
- Department of Neurology and Neurosurgery & Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
| | - Michael C Riedel
- Department of Physics, Florida International University, Miami, FL 33199, United States
| | - Taylor Salo
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, 19104, United States
| | - Angela R Laird
- Department of Physics, Florida International University, Miami, FL 33199, United States
| | - Rebecca L Jackson
- Department of Psychology & York Biomedical Research Institute, University of York, York, YO10 5DD, United Kingdom
| | - Richard J Binney
- Department of Psychology & Cognitive Neuroscience Institute, Bangor University, Bangor, Wales LL57 2AS, United Kingdom
| |
Collapse
|
28
|
Guan M, Xie Y, Li C, Zhang T, Ma C, Wang Z, Ma Z, Wang H, Fang P. Rich-club reorganization of white matter structural network in schizophrenia patients with auditory verbal hallucinations following 1 Hz rTMS treatment. Neuroimage Clin 2023; 40:103546. [PMID: 37988997 PMCID: PMC10701084 DOI: 10.1016/j.nicl.2023.103546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 11/17/2023] [Accepted: 11/17/2023] [Indexed: 11/23/2023]
Abstract
The human brain comprises a large-scale structural network of regions and interregional pathways, including a selectively defined set of highly central and interconnected hub regions, often referred to as the "rich club", which may play a pivotal role in the integrative processes of the brain. A quintessential symptom of schizophrenia, auditory verbal hallucinations (AVH) have shown a decrease in severity following low-frequency repetitive transcranial magnetic stimulation (rTMS). However, the underlying mechanism of rTMS in treating AVH remains elusive. This study investigated the effect of low-frequency rTMS on the rich-club organization within the brain in patients diagnosed with schizophrenia who experience AVH using diffusion tensor imaging data. Through by constructing structural connectivity networks, we identified several critical rich hub nodes, which constituted a rich-club subnetwork, predominantly located in the prefrontal cortices. Notably, our findings revealed enhanced connection strength and density within the rich-club subnetwork following rTMS treatment. Furthermore, we found that the decreased connectivity within the subnetwork components, including the rich-club subnetwork, was notably enhanced in patients following rTMS treatment. In particular, the increased connectivity strength of the right median superior frontal gyrus, which functions as a critical local bridge, with the right postcentral gyrus exhibited a significant correlation with improvements in both positive symptoms and AVH. These findings provide valuable insights into the role of rTMS in inducing reorganizational changes within the rich-club structural network in schizophrenia and shed light on potential mechanisms through which rTMS may alleviate AVH.
Collapse
Affiliation(s)
- Muzhen Guan
- Department of Mental Health, Xi'an Medical College, Xi'an, China.
| | - Yuanjun Xie
- Military Medical Psychology School, Fourth Military Medical University, Xi'an, China; Department of Radiology, Xijing Hospital, Fourth Military Medical University, Xi'an, China.
| | - Chenxi Li
- Military Medical Psychology School, Fourth Military Medical University, Xi'an, China
| | - Tian Zhang
- Military Medical Psychology School, Fourth Military Medical University, Xi'an, China
| | - Chaozong Ma
- Military Medical Psychology School, Fourth Military Medical University, Xi'an, China
| | - Zhongheng Wang
- Department of Psychiatry, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Zhujing Ma
- Department of Psychiatry, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Huaning Wang
- Department of Psychiatry, Xijing Hospital, Fourth Military Medical University, Xi'an, China.
| | - Peng Fang
- Military Medical Psychology School, Fourth Military Medical University, Xi'an, China.
| |
Collapse
|
29
|
Tuckute G, Sathe A, Srikant S, Taliaferro M, Wang M, Schrimpf M, Kay K, Fedorenko E. Driving and suppressing the human language network using large language models. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.16.537080. [PMID: 37090673 PMCID: PMC10120732 DOI: 10.1101/2023.04.16.537080] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Transformer models such as GPT generate human-like language and are highly predictive of human brain responses to language. Here, using fMRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of brain response associated with each sentence. Then, we use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also noninvasively control neural activity in higher-level cortical areas, like the language network.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Aalok Sathe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Shashank Srikant
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- MIT-IBM Watson AI Lab, Cambridge, MA 02142, USA
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Mingye Wang
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Martin Schrimpf
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Quest for Intelligence, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Kendrick Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455 USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138 USA
| |
Collapse
|
30
|
Ness T, Langlois VJ, Kim AE, Novick JM. The State of Cognitive Control in Language Processing. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2023:17456916231197122. [PMID: 37819251 DOI: 10.1177/17456916231197122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
Understanding language requires readers and listeners to cull meaning from fast-unfolding messages that often contain conflicting cues pointing to incompatible ways of interpreting the input (e.g., "The cat was chased by the mouse"). This article reviews mounting evidence from multiple methods demonstrating that cognitive control plays an essential role in resolving conflict during language comprehension. How does cognitive control accomplish this task? Psycholinguistic proposals have conspicuously failed to address this question. We introduce an account in which cognitive control aids language processing when cues conflict by sending top-down biasing signals that strengthen the interpretation supported by the most reliable evidence available. We also provide a computationally plausible model that solves the critical problem of how cognitive control "knows" which way to direct its biasing signal by allowing linguistic knowledge itself to issue crucial guidance. Such a mental architecture can explain a range of experimental findings, including how moment-to-moment shifts in cognitive-control state-its level of activity within a person-directly impact how quickly and successfully language comprehension is achieved.
Collapse
Affiliation(s)
- Tal Ness
- Department of Hearing and Speech Sciences and Program in Neuroscience and Cognitive Science, University of Maryland, College Park
| | - Valerie J Langlois
- Institute for Cognitive Science and Department of Psychology and Neuroscience, University of Colorado, Boulder
| | - Albert E Kim
- Institute for Cognitive Science and Department of Psychology and Neuroscience, University of Colorado, Boulder
| | - Jared M Novick
- Department of Hearing and Speech Sciences and Program in Neuroscience and Cognitive Science, University of Maryland, College Park
| |
Collapse
|
31
|
Benn Y, Ivanova AA, Clark O, Mineroff Z, Seikus C, Silva JS, Varley R, Fedorenko E. The language network is not engaged in object categorization. Cereb Cortex 2023; 33:10380-10400. [PMID: 37557910 PMCID: PMC10545444 DOI: 10.1093/cercor/bhad289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 07/12/2023] [Accepted: 07/13/2023] [Indexed: 08/11/2023] Open
Abstract
The relationship between language and thought is the subject of long-standing debate. One claim states that language facilitates categorization of objects based on a certain feature (e.g. color) through the use of category labels that reduce interference from other, irrelevant features. Therefore, language impairment is expected to affect categorization of items grouped by a single feature (low-dimensional categories, e.g. "Yellow Things") more than categorization of items that share many features (high-dimensional categories, e.g. "Animals"). To test this account, we conducted two behavioral studies with individuals with aphasia and an fMRI experiment with healthy adults. The aphasia studies showed that selective low-dimensional categorization impairment was present in some, but not all, individuals with severe anomia and was not characteristic of aphasia in general. fMRI results revealed little activity in language-responsive brain regions during both low- and high-dimensional categorization; instead, categorization recruited the domain-general multiple-demand network (involved in wide-ranging cognitive tasks). Combined, results demonstrate that the language system is not implicated in object categorization. Instead, selective low-dimensional categorization impairment might be caused by damage to brain regions responsible for cognitive control. Our work adds to the growing evidence of the dissociation between the language system and many cognitive tasks in adults.
Collapse
Affiliation(s)
- Yael Benn
- Department of Psychology, Manchester Metropolitan University, Manchester M15 6BH, United Kingdom
| | - Anna A Ivanova
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| | - Oliver Clark
- Department of Psychology, Manchester Metropolitan University, Manchester M15 6BH, United Kingdom
| | - Zachary Mineroff
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| | - Chloe Seikus
- Division of Psychology & Language Sciences, University College London, London WC1E 6BT, UK
| | - Jack Santos Silva
- Division of Psychology & Language Sciences, University College London, London WC1E 6BT, UK
| | - Rosemary Varley
- Division of Psychology & Language Sciences, University College London, London WC1E 6BT, UK
| | - Evelina Fedorenko
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| |
Collapse
|
32
|
Barany DA, Lacey S, Matthews KL, Nygaard LC, Sathian K. Neural basis of sound-symbolic pseudoword-shape correspondences. Neuropsychologia 2023; 188:108657. [PMID: 37543139 PMCID: PMC10529692 DOI: 10.1016/j.neuropsychologia.2023.108657] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 06/23/2023] [Accepted: 08/02/2023] [Indexed: 08/07/2023]
Abstract
Non-arbitrary mapping between the sound of a word and its meaning, termed sound symbolism, is commonly studied through crossmodal correspondences between sounds and visual shapes, e.g., auditory pseudowords, like 'mohloh' and 'kehteh', are matched to rounded and pointed visual shapes, respectively. Here, we used functional magnetic resonance imaging (fMRI) during a crossmodal matching task to investigate the hypotheses that sound symbolism (1) involves language processing; (2) depends on multisensory integration; (3) reflects embodiment of speech in hand movements. These hypotheses lead to corresponding neuroanatomical predictions of crossmodal congruency effects in (1) the language network; (2) areas mediating multisensory processing, including visual and auditory cortex; (3) regions responsible for sensorimotor control of the hand and mouth. Right-handed participants (n = 22) encountered audiovisual stimuli comprising a simultaneously presented visual shape (rounded or pointed) and an auditory pseudoword ('mohloh' or 'kehteh') and indicated via a right-hand keypress whether the stimuli matched or not. Reaction times were faster for congruent than incongruent stimuli. Univariate analysis showed that activity was greater for the congruent compared to the incongruent condition in the left primary and association auditory cortex, and left anterior fusiform/parahippocampal gyri. Multivoxel pattern analysis revealed higher classification accuracy for the audiovisual stimuli when congruent than when incongruent, in the pars opercularis of the left inferior frontal (Broca's area), the left supramarginal, and the right mid-occipital gyri. These findings, considered in relation to the neuroanatomical predictions, support the first two hypotheses and suggest that sound symbolism involves both language processing and multisensory integration.
Collapse
Affiliation(s)
- Deborah A Barany
- Department of Kinesiology, University of Georgia and Augusta University/University of Georgia Medical Partnership, Athens, GA, 30602, USA
| | - Simon Lacey
- Department of Neurology, Penn State College of Medicine, Hershey, PA, 17033-0859, USA; Department of Neural & Behavioral Sciences, Penn State College of Medicine, Hershey, PA, 17033-0859, USA; Department of Psychology, Penn State College of Liberal Arts, University Park, PA, 16802, USA
| | - Kaitlyn L Matthews
- Department of Psychology, Emory University, Atlanta, GA, 30322, USA; Present address: Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, 63130, USA
| | - Lynne C Nygaard
- Department of Psychology, Emory University, Atlanta, GA, 30322, USA
| | - K Sathian
- Department of Neurology, Penn State College of Medicine, Hershey, PA, 17033-0859, USA; Department of Neural & Behavioral Sciences, Penn State College of Medicine, Hershey, PA, 17033-0859, USA; Department of Psychology, Penn State College of Liberal Arts, University Park, PA, 16802, USA.
| |
Collapse
|
33
|
Silcox JW, Mickey B, Payne BR. Disruption to left inferior frontal cortex modulates semantic prediction effects in reading and subsequent memory: Evidence from simultaneous TMS-EEG. Psychophysiology 2023; 60:e14312. [PMID: 37203307 DOI: 10.1111/psyp.14312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 01/25/2023] [Accepted: 03/21/2023] [Indexed: 05/20/2023]
Abstract
Readers use prior context to predict features of upcoming words. When predictions are accurate, this increases the efficiency of comprehension. However, little is known about the fate of predictable and unpredictable words in memory or the neural systems governing these processes. Several theories suggest that the speech production system, including the left inferior frontal cortex (LIFC), is recruited for prediction but evidence that LIFC plays a causal role is lacking. We first examined the effects of predictability on memory and then tested the role of posterior LIFC using transcranial magnetic stimulation (TMS). In Experiment 1, participants read category cues, followed by a predictable, unpredictable, or incongruent target word for later recall. We observed a predictability benefit to memory, with predictable words remembered better than unpredictable words. In Experiment 2, participants performed the same task with electroencephalography (EEG) while undergoing event-related TMS over posterior LIFC using a protocol known to disrupt speech production, or over the right hemisphere homologue as an active control site. Under control stimulation, predictable words were better recalled than unpredictable words, replicating Experiment 1. This predictability benefit to memory was eliminated under LIFC stimulation. Moreover, while an a priori ROI-based analysis did not yield evidence for a reduction in the N400 predictability effect, mass-univariate analyses did suggest that the N400 predictability effect was reduced in spatial and temporal extent under LIFC stimulation. Collectively, these results provide causal evidence that the LIFC is recruited for prediction during silent reading, consistent with prediction-through-production accounts.
Collapse
Affiliation(s)
- Jack W Silcox
- Department of Psychology, University of Utah, Salt Lake City, Utah, USA
| | - Brian Mickey
- Department of Psychiatry, Huntsman Mental Health Institute, University of Utah, Salt Lake City, Utah, USA
- Neuroscience Program, University of Utah, Salt Lake City, Utah, USA
| | - Brennan R Payne
- Department of Psychology, University of Utah, Salt Lake City, Utah, USA
- Neuroscience Program, University of Utah, Salt Lake City, Utah, USA
| |
Collapse
|
34
|
Malik-Moraleda S, Taliaferro M, Shannon S, Jhingan N, Swords S, Peterson DJ, Frommer P, Okrand M, Sams J, Cardwell R, Freeman C, Fedorenko E. Constructed languages are processed by the same brain mechanisms as natural languages. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.28.550667. [PMID: 37546901 PMCID: PMC10402139 DOI: 10.1101/2023.07.28.550667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
What constitutes a language? Natural languages share some features with other domains: from math, to music, to gesture. However, the brain mechanisms that process linguistic input are highly specialized, showing little or no response to diverse non-linguistic tasks. Here, we examine constructed languages (conlangs) to ask whether they draw on the same neural mechanisms as natural languages, or whether they instead pattern with domains like math and logic. Using individual-subject fMRI analyses, we show that understanding conlangs recruits the same brain areas as natural language comprehension. This result holds for Esperanto (n=19 speakers)- created to resemble natural languages-and fictional conlangs (Klingon (n=10), Na'vi (n=9), High Valyrian (n=3), and Dothraki (n=3)), created to differ from natural languages, and suggests that conlangs and natural languages share critical features and that the notable differences between conlangs and natural language are not consequential for the cognitive and neural mechanisms that they engage.
Collapse
Affiliation(s)
- Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | - Steve Shannon
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | - Niharika Jhingan
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | - Sara Swords
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
| | | | - Paul Frommer
- Marshall School of Business, University of Southern California, Los Angeles, CA 90089
| | | | | | | | | | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114
| |
Collapse
|
35
|
Desbordes T, Lakretz Y, Chanoine V, Oquab M, Badier JM, Trébuchon A, Carron R, Bénar CG, Dehaene S, King JR. Dimensionality and Ramping: Signatures of Sentence Integration in the Dynamics of Brains and Deep Language Models. J Neurosci 2023; 43:5350-5364. [PMID: 37217308 PMCID: PMC10359032 DOI: 10.1523/jneurosci.1163-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 02/07/2023] [Accepted: 02/19/2023] [Indexed: 05/24/2023] Open
Abstract
A sentence is more than the sum of its words: its meaning depends on how they combine with one another. The brain mechanisms underlying such semantic composition remain poorly understood. To shed light on the neural vector code underlying semantic composition, we introduce two hypotheses: (1) the intrinsic dimensionality of the space of neural representations should increase as a sentence unfolds, paralleling the growing complexity of its semantic representation; and (2) this progressive integration should be reflected in ramping and sentence-final signals. To test these predictions, we designed a dataset of closely matched normal and jabberwocky sentences (composed of meaningless pseudo words) and displayed them to deep language models and to 11 human participants (5 men and 6 women) monitored with simultaneous MEG and intracranial EEG. In both deep language models and electrophysiological data, we found that representational dimensionality was higher for meaningful sentences than jabberwocky. Furthermore, multivariate decoding of normal versus jabberwocky confirmed three dynamic patterns: (1) a phasic pattern following each word, peaking in temporal and parietal areas; (2) a ramping pattern, characteristic of bilateral inferior and middle frontal gyri; and (3) a sentence-final pattern in left superior frontal gyrus and right orbitofrontal cortex. These results provide a first glimpse into the neural geometry of semantic integration and constrain the search for a neural code of linguistic composition.SIGNIFICANCE STATEMENT Starting from general linguistic concepts, we make two sets of predictions in neural signals evoked by reading multiword sentences. First, the intrinsic dimensionality of the representation should grow with additional meaningful words. Second, the neural dynamics should exhibit signatures of encoding, maintaining, and resolving semantic composition. We successfully validated these hypotheses in deep neural language models, artificial neural networks trained on text and performing very well on many natural language processing tasks. Then, using a unique combination of MEG and intracranial electrodes, we recorded high-resolution brain data from human participants while they read a controlled set of sentences. Time-resolved dimensionality analysis showed increasing dimensionality with meaning, and multivariate decoding allowed us to isolate the three dynamical patterns we had hypothesized.
Collapse
Affiliation(s)
- Théo Desbordes
- Meta AI Research, Paris 75002, France; and Cognitive Neuroimaging Unit NeuroSpin center, 91191, Gif-sur-Yvette, France
| | - Yair Lakretz
- Cognitive Neuroimaging Unit NeuroSpin center, Gif-sur-Yvette, 91191, France
| | - Valérie Chanoine
- Institute of Language, Communication and the Brain, Aix-en-Provence, 13100, France; and Aix-Marseille Université, Centre National de la Recherche Scientifique, LPL, Aix-en-Provence, 13100, France
| | | | - Jean-Michel Badier
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale, CNRS, LPL, Aix-en-Provence 13100; and Inst Neurosci Syst, Marseille, 13005, France
| | - Agnès Trébuchon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale, CNRS, LPL, Aix-en-Provence 13100, France; and Inst Neurosci Syst, Marseille, 13005, France; and Assistance Publique Hopitaux de Marseille, Timone hospital, Epileptology and Cerebral Rythmology, Marseille, 13385, France
| | - Romain Carron
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale, CNRS, LPL, Aix-en-Provence 13100, France; and Inst Neurosci Syst, Marseille, 13005, France; and Assistance Publique Hopitaux de Marseille, Timone hospital, Functional and Stereotactic Neurosurgery, Marseille, 13385, France
| | - Christian-G Bénar
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale, CNRS, LPL, Aix-en-Provence 13100, France; and Inst Neurosci Syst, Marseille, 13005, France
| | - Stanislas Dehaene
- Université Paris Saclay, Institut National de la Santé et de la Recherche Médicale, Commissariat à l'Energie Atomique, Cognitive Neuroimaging Unit, NeuroSpin center, Saclay, 91191, France; and Collège de France, PSL University, Paris, 75231, France
| | - Jean-Rémi King
- Meta AI Research, Paris 75002, France; and Cognitive Neuroimaging Unit NeuroSpin center, 91191, Gif-sur-Yvette, France
- LSP, École normale supérieure, PSL (Paris Sciences & Lettres) University, CNRS, 75005 Paris, France
| |
Collapse
|
36
|
Zhao Z, Lu J, Wu J. Fiber Tractography-Based Cortical Language Mapping for Speech Output. World Neurosurg 2023; 175:151-152. [PMID: 37105893 DOI: 10.1016/j.wneu.2023.03.139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/08/2023]
Affiliation(s)
- Zehao Zhao
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai, China; Brain Function Laboratory, Neurosurgical Institute of Fudan University, Shanghai, China
| | - Junfeng Lu
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai, China; Brain Function Laboratory, Neurosurgical Institute of Fudan University, Shanghai, China
| | - Jinsong Wu
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai, China; Brain Function Laboratory, Neurosurgical Institute of Fudan University, Shanghai, China
| |
Collapse
|
37
|
Unger N, Haeck M, Eickhoff SB, Camilleri JA, Dickscheid T, Mohlberg H, Bludau S, Caspers S, Amunts K. Cytoarchitectonic mapping of the human frontal operculum-New correlates for a variety of brain functions. Front Hum Neurosci 2023; 17:1087026. [PMID: 37448625 PMCID: PMC10336231 DOI: 10.3389/fnhum.2023.1087026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Accepted: 04/18/2023] [Indexed: 07/15/2023] Open
Abstract
The human frontal operculum (FOp) is a brain region that covers parts of the ventral frontal cortex next to the insula. Functional imaging studies showed activations in this region in tasks related to language, somatosensory, and cognitive functions. While the precise cytoarchitectonic areas that correlate to these processes have not yet been revealed, earlier receptorarchitectonic analysis resulted in a detailed parcellation of the FOp. We complemented this analysis by a cytoarchitectonic study of a sample of ten postmortem brains and mapped the posterior FOp in serial, cell-body stained histological sections using image analysis and multivariate statistics. Three new areas were identified: Op5 represents the most posterior area, followed by Op6 and the most anterior region Op7. Areas Op5-Op7 approach the insula, up to the circular sulcus. Area 44 of Broca's region, the most ventral part of premotor area 6, and parts of the parietal operculum are dorso-laterally adjacent to Op5-Op7. The areas did not show any interhemispheric or sex differences. Three-dimensional probability maps and a maximum probability map were generated in stereotaxic space, and then used, in a first proof-of-concept-study, for functional decoding and analysis of structural and functional connectivity. Functional decoding revealed different profiles of cytoarchitectonically identified Op5-Op7. While left Op6 was active in music cognition, right Op5 was involved in chewing/swallowing and sexual processing. Both areas showed activation during the exercise of isometric force in muscles. An involvement in the coordination of flexion/extension could be shown for the right Op6. Meta-analytic connectivity modeling revealed various functional connections of the FOp areas within motor and somatosensory networks, with the most evident connection with the music/language network for Op6 left. The new cytoarchitectonic maps are part of Julich-Brain, and publicly available to serve as a basis for future analyses of structural-functional relationships in this region.
Collapse
Affiliation(s)
- Nina Unger
- Cécile and Oskar Vogt Institute for Brain Research, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| | | | - Simon B. Eickhoff
- Institute of Neuroscience and Medicine (INM-7), Research Centre Jülich, Jülich, Germany
- Institute for Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Julia A. Camilleri
- Institute of Neuroscience and Medicine (INM-7), Research Centre Jülich, Jülich, Germany
- Institute for Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Timo Dickscheid
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute of Computer Science, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Hartmut Mohlberg
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| | - Sebastian Bludau
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| | - Svenja Caspers
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute for Anatomy I, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Katrin Amunts
- Cécile and Oskar Vogt Institute for Brain Research, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| |
Collapse
|
38
|
Barany DA, Lacey S, Matthews KL, Nygaard LC, Sathian K. Neural Basis Of Sound-Symbolic Pseudoword-Shape Correspondences. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.14.536865. [PMID: 37425853 PMCID: PMC10327042 DOI: 10.1101/2023.04.14.536865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Non-arbitrary mapping between the sound of a word and its meaning, termed sound symbolism, is commonly studied through crossmodal correspondences between sounds and visual shapes, e.g., auditory pseudowords, like 'mohloh' and 'kehteh', are matched to rounded and pointed visual shapes, respectively. Here, we used functional magnetic resonance imaging (fMRI) during a crossmodal matching task to investigate the hypotheses that sound symbolism (1) involves language processing; (2) depends on multisensory integration; (3) reflects embodiment of speech in hand movements. These hypotheses lead to corresponding neuroanatomical predictions of crossmodal congruency effects in (1) the language network; (2) areas mediating multisensory processing, including visual and auditory cortex; (3) regions responsible for sensorimotor control of the hand and mouth. Right-handed participants ( n = 22) encountered audiovisual stimuli comprising a simultaneously presented visual shape (rounded or pointed) and an auditory pseudoword ('mohloh' or 'kehteh') and indicated via a right-hand keypress whether the stimuli matched or not. Reaction times were faster for congruent than incongruent stimuli. Univariate analysis showed that activity was greater for the congruent compared to the incongruent condition in the left primary and association auditory cortex, and left anterior fusiform/parahippocampal gyri. Multivoxel pattern analysis revealed higher classification accuracy for the audiovisual stimuli when congruent than when incongruent, in the pars opercularis of the left inferior frontal (Broca's area), the left supramarginal, and the right mid-occipital gyri. These findings, considered in relation to the neuroanatomical predictions, support the first two hypotheses and suggest that sound symbolism involves both language processing and multisensory integration. HIGHLIGHTS fMRI investigation of sound-symbolic correspondences between auditory pseudowords and visual shapesFaster reaction times for congruent than incongruent audiovisual stimuliGreater activation in auditory and visual cortices for congruent stimuliHigher classification accuracy for congruent stimuli in language and visual areasSound symbolism involves language processing and multisensory integration.
Collapse
Affiliation(s)
- Deborah A. Barany
- Department of Kinesiology, University of Georgia and Augusta University/University of Georgia Medical Partnership, Athens, GA, 30602, USA
| | - Simon Lacey
- Department of Neurology, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA 17033-0859, USA
- Department of Neural & Behavioral Sciences, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA 17033-0859, USA
- Department of Psychology, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA 17033-0859, USA
| | - Kaitlyn L. Matthews
- Department of Psychology, Emory University, Atlanta, GA 30322, USA
- Present address: Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130
| | - Lynne C. Nygaard
- Department of Psychology, Emory University, Atlanta, GA 30322, USA
| | - K. Sathian
- Department of Neurology, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA 17033-0859, USA
- Department of Neural & Behavioral Sciences, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA 17033-0859, USA
- Department of Psychology, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA 17033-0859, USA
| |
Collapse
|
39
|
Lawrence A, Carvajal M, Ormsby J. Beyond Broca's and Wernicke's: Functional Mapping of Ancillary Language Centers Prior to Brain Tumor Surgery. Tomography 2023; 9:1254-1275. [PMID: 37489468 PMCID: PMC10366753 DOI: 10.3390/tomography9040100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 06/21/2023] [Accepted: 06/23/2023] [Indexed: 07/26/2023] Open
Abstract
Functional MRI is a well-established tool used for pre-surgical planning to help the neurosurgeon have a roadmap of critical functional areas that should be avoided, if possible, during surgery to minimize morbidity for patients with brain tumors (though this also has applications for surgical resection of epileptogenic tissue and vascular lesions). This article reviews the locations of secondary language centers within the brain along with imaging findings to help improve our confidence in our knowledge on language lateralization. Brief overviews of these language centers and their contributions to the language networks will be discussed. These language centers include primary language centers of "Broca's Area" and "Wernicke's Area". However, there are multiple secondary language centers such as the dorsal lateral prefrontal cortex (DLPFC), frontal eye fields, pre- supplemental motor area (pre-SMA), Basal Temporal Language Area (BTLA), along with other areas of activation. Knowing these foci helps to increase self-assurance when discussing the nature of laterality with the neurosurgeon. By knowing secondary language centers for language lateralization, via fMRI, one can feel confident on providing neurosurgeon colleagues with appropriate information on the laterality of language in preparation for surgery.
Collapse
Affiliation(s)
- Ashley Lawrence
- Center for Neuropsychological Services, University of New Mexico, MSC 10 5530 1 University of New Mexico, Albuquerque, NM 87131-5001, USA
| | - Michael Carvajal
- Center for Neuropsychological Services, University of New Mexico, MSC 10 5530 1 University of New Mexico, Albuquerque, NM 87131-5001, USA
| | - Jacob Ormsby
- Department of Radiology, University of New Mexico, MSC 10 5530 1 University of New Mexico, Albuquerque, NM 87131-5001, USA
| |
Collapse
|
40
|
Chen X, Affourtit J, Ryskin R, Regev TI, Norman-Haignere S, Jouravlev O, Malik-Moraleda S, Kean H, Varley R, Fedorenko E. The human language system, including its inferior frontal component in "Broca's area," does not support music perception. Cereb Cortex 2023; 33:7904-7929. [PMID: 37005063 PMCID: PMC10505454 DOI: 10.1093/cercor/bhad087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Revised: 01/02/2023] [Accepted: 01/03/2023] [Indexed: 04/04/2023] Open
Abstract
Language and music are two human-unique capacities whose relationship remains debated. Some have argued for overlap in processing mechanisms, especially for structure processing. Such claims often concern the inferior frontal component of the language system located within "Broca's area." However, others have failed to find overlap. Using a robust individual-subject fMRI approach, we examined the responses of language brain regions to music stimuli, and probed the musical abilities of individuals with severe aphasia. Across 4 experiments, we obtained a clear answer: music perception does not engage the language system, and judgments about music structure are possible even in the presence of severe damage to the language network. In particular, the language regions' responses to music are generally low, often below the fixation baseline, and never exceed responses elicited by nonmusic auditory conditions, like animal sounds. Furthermore, the language regions are not sensitive to music structure: they show low responses to both intact and structure-scrambled music, and to melodies with vs. without structural violations. Finally, in line with past patient investigations, individuals with aphasia, who cannot judge sentence grammaticality, perform well on melody well-formedness judgments. Thus, the mechanisms that process structure in language do not appear to process music, including music syntax.
Collapse
Affiliation(s)
- Xuanyi Chen
- Department of Cognitive Sciences, Rice University, TX 77005, United States
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Josef Affourtit
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Rachel Ryskin
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Cognitive & Information Sciences, University of California, Merced, Merced, CA 95343, United States
| | - Tamar I Regev
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Samuel Norman-Haignere
- Department of Biostatistics & Computational Biology, University of Rochester Medical Center, Rochester, NY, United States
- Department of Neuroscience, University of Rochester Medical Center, Rochester, NY, United States
- Department of Biomedical Engineering, University of Rochester, Rochester, NY, United States
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, United States
| | - Olessia Jouravlev
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Cognitive Science, Carleton University, Ottawa, ON, Canada
| | - Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| | - Hope Kean
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Rosemary Varley
- Psychology & Language Sciences, UCL, London, WCN1 1PF, United Kingdom
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| |
Collapse
|
41
|
López-Barroso D, Paredes-Pacheco J, Torres-Prioris MJ, Dávila G, Berthier ML. Brain structural and functional correlates of the heterogenous progression of mixed transcortical aphasia. Brain Struct Funct 2023:10.1007/s00429-023-02655-6. [PMID: 37256346 DOI: 10.1007/s00429-023-02655-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 05/13/2023] [Indexed: 06/01/2023]
Abstract
Mixed transcortical aphasia (MTCA) is characterized by non-fluent speech and comprehension deficits coexisting with preserved repetition. MTCA may evolve to less severe variants of aphasias or even to full language recovery. Mechanistically, MCTA has traditionally been attributed to a disconnection between the spared left perisylvian language network (PSLN) responsible for preserved verbal repetition, and damaged left extrasylvian networks, which are responsible for language production and comprehension impairments. However, despite significant advances in in vivo neuroimaging, the structural and functional status of the PSLN network in MTCA and its evolution has not been investigated. Thus, the aim of the present study is to examine the status of the PSLN, both in terms of its functional activity and structural integrity, in four cases who developed acute post-stroke MTCA and progressed to different types of aphasia. For it, we conducted a neuroimaging-behavioral study performed in the chronic stage of four patients. The behavioral profile of MTCA persisted in one patient, whereas the other three patients progressed to less severe types of aphasias. Neuroimaging findings suggest that preserved verbal repetition in MTCA does not always depend on the optimal status of the PSLN and its dorsal connections. Instead, the right hemisphere or the left ventral pathway may also play a role in supporting verbal repetition. The variability in the clinical evolution of MTCA may be explained by the varying degree of PSLN alteration and individual premorbid neuroanatomical language substrates. This study offers a fresh perspective of MTCA through the lens of modern neuroscience and unveils novel insights into the neural underpinnings of repetition.
Collapse
Affiliation(s)
- Diana López-Barroso
- Cognitive Neurology and Aphasia Unit, Centro de Investigaciones Médico-Sanitarias (CIMES), University of Malaga, Malaga, Spain
- Research Laboratory on the Neuroscience of Language, Faculty of Psychology and Speech Therapy, University of Malaga, Malaga, Spain
- Instituto de Investigación Biomédica de Málaga - IBIMA, Malaga, Spain
- Department of Psychobiology and Methodology of Behavioural Sciences, Faculty of Psychology, University of Malaga, Malaga, Spain
| | - José Paredes-Pacheco
- Radiology and Psychiatry Department, Faculty of Medicine, Universidade de Santiago de Compostela, Santiago de Compostela, Spain
- Molecular Imaging Unit, Centro de Investigaciones Médico-Sanitarias (CIMES), General Foundation of the University of Malaga, Malaga, Spain
| | - María José Torres-Prioris
- Cognitive Neurology and Aphasia Unit, Centro de Investigaciones Médico-Sanitarias (CIMES), University of Malaga, Malaga, Spain
- Research Laboratory on the Neuroscience of Language, Faculty of Psychology and Speech Therapy, University of Malaga, Malaga, Spain
- Instituto de Investigación Biomédica de Málaga - IBIMA, Malaga, Spain
- Department of Psychobiology and Methodology of Behavioural Sciences, Faculty of Psychology, University of Malaga, Malaga, Spain
| | - Guadalupe Dávila
- Cognitive Neurology and Aphasia Unit, Centro de Investigaciones Médico-Sanitarias (CIMES), University of Malaga, Malaga, Spain
- Research Laboratory on the Neuroscience of Language, Faculty of Psychology and Speech Therapy, University of Malaga, Malaga, Spain
- Instituto de Investigación Biomédica de Málaga - IBIMA, Malaga, Spain
- Department of Psychobiology and Methodology of Behavioural Sciences, Faculty of Psychology, University of Malaga, Malaga, Spain
| | - Marcelo L Berthier
- Cognitive Neurology and Aphasia Unit, Centro de Investigaciones Médico-Sanitarias (CIMES), University of Malaga, Malaga, Spain.
- Research Laboratory on the Neuroscience of Language, Faculty of Psychology and Speech Therapy, University of Malaga, Malaga, Spain.
- Instituto de Investigación Biomédica de Málaga - IBIMA, Malaga, Spain.
| |
Collapse
|
42
|
Cope TE, Sohoglu E, Peterson KA, Jones PS, Rua C, Passamonti L, Sedley W, Post B, Coebergh J, Butler CR, Garrard P, Abdel-Aziz K, Husain M, Griffiths TD, Patterson K, Davis MH, Rowe JB. Temporal lobe perceptual predictions for speech are instantiated in motor cortex and reconciled by inferior frontal cortex. Cell Rep 2023; 42:112422. [PMID: 37099422 DOI: 10.1016/j.celrep.2023.112422] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Revised: 12/23/2022] [Accepted: 04/05/2023] [Indexed: 04/27/2023] Open
Abstract
Humans use predictions to improve speech perception, especially in noisy environments. Here we use 7-T functional MRI (fMRI) to decode brain representations of written phonological predictions and degraded speech signals in healthy humans and people with selective frontal neurodegeneration (non-fluent variant primary progressive aphasia [nfvPPA]). Multivariate analyses of item-specific patterns of neural activation indicate dissimilar representations of verified and violated predictions in left inferior frontal gyrus, suggestive of processing by distinct neural populations. In contrast, precentral gyrus represents a combination of phonological information and weighted prediction error. In the presence of intact temporal cortex, frontal neurodegeneration results in inflexible predictions. This manifests neurally as a failure to suppress incorrect predictions in anterior superior temporal gyrus and reduced stability of phonological representations in precentral gyrus. We propose a tripartite speech perception network in which inferior frontal gyrus supports prediction reconciliation in echoic memory, and precentral gyrus invokes a motor model to instantiate and refine perceptual predictions for speech.
Collapse
Affiliation(s)
- Thomas E Cope
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK; Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, UK; Cambridge University Hospitals NHS Trust, Cambridge CB2 0QQ, UK.
| | - Ediz Sohoglu
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, UK; School of Psychology, University of Sussex, Brighton BN1 9RH, UK
| | - Katie A Peterson
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK; Department of Radiology, University of Cambridge, Cambridge CB2 0QQ, UK
| | - P Simon Jones
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK
| | - Catarina Rua
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK
| | - Luca Passamonti
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK
| | - William Sedley
- Biosciences Institute, Newcastle University, Newcastle upon Tyne NE2 4HH, UK
| | - Brechtje Post
- Theoretical and Applied Linguistics, Faculty of Modern & Medieval Languages & Linguistics, University of Cambridge, Cambridge CB3 9DA, UK
| | - Jan Coebergh
- Ashford and St Peter's Hospital, Ashford TW15 3AA, UK; St George's Hospital, London SW17 0QT, UK
| | - Christopher R Butler
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, UK; Faculty of Medicine, Department of Brain Sciences, Imperial College London, London W12 0NN, UK
| | - Peter Garrard
- St George's Hospital, London SW17 0QT, UK; Molecular and Clinical Sciences Research Institute, St. George's, University of London, London SW17 0RE, UK
| | - Khaled Abdel-Aziz
- Ashford and St Peter's Hospital, Ashford TW15 3AA, UK; St George's Hospital, London SW17 0QT, UK
| | - Masud Husain
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, UK
| | - Timothy D Griffiths
- Biosciences Institute, Newcastle University, Newcastle upon Tyne NE2 4HH, UK
| | - Karalyn Patterson
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK; Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, UK
| | - Matthew H Davis
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, UK
| | - James B Rowe
- Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 0SZ, UK; Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, UK; Cambridge University Hospitals NHS Trust, Cambridge CB2 0QQ, UK
| |
Collapse
|
43
|
Liu Y, Gao C, Wang P, Friederici AD, Zaccarella E, Chen L. Exploring the neurobiology of Merge at a basic level: insights from a novel artificial grammar paradigm. Front Psychol 2023; 14:1151518. [PMID: 37287773 PMCID: PMC10242141 DOI: 10.3389/fpsyg.2023.1151518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Accepted: 05/09/2023] [Indexed: 06/09/2023] Open
Abstract
Introduction Human language allows us to generate an infinite number of linguistic expressions. It's proposed that this competence is based on a binary syntactic operation, Merge, combining two elements to form a new constituent. An increasing number of recent studies have shifted from complex syntactic structures to two-word constructions to investigate the neural representation of this operation at the most basic level. Methods This fMRI study aimed to develop a highly flexible artificial grammar paradigm for testing the neurobiology of human syntax at a basic level. During scanning, participants had to apply abstract syntactic rules to assess whether a given two-word artificial phrase could be further merged with a third word. To control for lower-level template-matching and working memory strategies, an additional non-mergeable word-list task was set up. Results Behavioral data indicated that participants complied with the experiment. Whole brain and region of interest (ROI) analyses were performed under the contrast of "structure > word-list." Whole brain analysis confirmed significant involvement of the posterior inferior frontal gyrus [pIFG, corresponding to Brodmann area (BA) 44]. Furthermore, both the signal intensity in Broca's area and the behavioral performance showed significant correlations with natural language performance in the same participants. ROI analysis within the language atlas and anatomically defined Broca's area revealed that only the pIFG was reliably activated. Discussion Taken together, these results support the notion that Broca's area, particularly BA 44, works as a combinatorial engine where words are merged together according to syntactic information. Furthermore, this study suggests that the present artificial grammar may serve as promising material for investigating the neurobiological basis of syntax, fostering future cross-species studies.
Collapse
Affiliation(s)
- Yang Liu
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing, China
| | - Chenyang Gao
- School of Global Education and Development, University of Chinese Academy of Social Sciences, Beijing, China
| | - Peng Wang
- Method and Development Group (MEG and Cortical Networks), Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Institute of Psychology, University of Greifswald, Greifswald, Germany
- Institute of Psychology, University of Regensburg, Regensburg, Germany
| | - Angela D. Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Luyao Chen
- Max Planck Partner Group, School of International Chinese Language Education, Beijing Normal University, Beijing, China
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Institute of Educational System Science, Beijing Normal University, Beijing, China
| |
Collapse
|
44
|
Nguyen T, Behrens M, Broscheid KC, Bielitzki R, Weber S, Libnow S, Malczewski V, Baldauf L, Milberger X, Jassmann L, Wustmann A, Meiler K, Drange S, Franke J, Schega L. Associations between gait performance and pain intensity, psychosocial factors, executive functions as well as prefrontal cortex activity in chronic low back pain patients: A cross-sectional fNIRS study. Front Med (Lausanne) 2023; 10:1147907. [PMID: 37215712 PMCID: PMC10196398 DOI: 10.3389/fmed.2023.1147907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Accepted: 03/13/2023] [Indexed: 05/24/2023] Open
Abstract
Introduction Activities of daily living, such as walking, are impaired in chronic low back pain (CLBP) patients compared to healthy individuals. Thereby, pain intensity, psychosocial factors, cognitive functioning and prefrontal cortex (PFC) activity during walking might be related to gait performance during single and dual task walking (STW, DTW). However, to the best of our knowledge, these associations have not yet been explored in a large sample of CLBP patients. Method Gait kinematics (inertial measurement units) and PFC activity (functional near-infrared spectroscopy) during STW and DTW were measured in 108 CLBP patients (79 females, 29 males). Additionally, pain intensity, kinesiophobia, pain coping strategies, depression and executive functioning were quantified and correlation coefficients were calculated to determine the associations between parameters. Results The gait parameters showed small correlations with acute pain intensity, pain coping strategies and depression. Stride length and velocity during STW and DTW were (slightly to moderately) positively correlated with executive function test performance. Specific small to moderate correlations were found between the gait parameters and dorsolateral PFC activity during STW and DTW. Conclusion Patients with higher acute pain intensity and better coping skills demonstrated slower and less variable gait, which might reflect a pain minimization strategy. Psychosocial factors seem to play no or only a minor role, while good executive functions might be a prerequisite for a better gait performance in CLBP patients. The specific associations between gait parameters and PFC activity during walking indicate that the availability and utilization of brain resources are crucial for a good gait performance.
Collapse
Affiliation(s)
- Toan Nguyen
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Martin Behrens
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Kim-Charline Broscheid
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Robert Bielitzki
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Saskia Weber
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Saskia Libnow
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Victoria Malczewski
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Lukas Baldauf
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Xenia Milberger
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Lena Jassmann
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| | - Anne Wustmann
- Department of Orthopaedic Surgery, Klinikum Magdeburg gGmbH, Magdeburg, Germany
| | - Katharina Meiler
- Department of Orthopaedic Surgery, Klinikum Magdeburg gGmbH, Magdeburg, Germany
| | - Steffen Drange
- Department of Orthopaedic Surgery, Klinikum Magdeburg gGmbH, Magdeburg, Germany
| | - Jörg Franke
- Department of Orthopaedic Surgery, Klinikum Magdeburg gGmbH, Magdeburg, Germany
| | - Lutz Schega
- Department of Sport Science, Institute III, Otto von Guericke University Magdeburg, Magdeburg, Germany
| |
Collapse
|
45
|
Hickok G, Venezia J, Teghipco A. Beyond Broca: neural architecture and evolution of a dual motor speech coordination system. Brain 2023; 146:1775-1790. [PMID: 36746488 PMCID: PMC10411947 DOI: 10.1093/brain/awac454] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 11/04/2022] [Accepted: 11/19/2022] [Indexed: 02/08/2023] Open
Abstract
Classical neural architecture models of speech production propose a single system centred on Broca's area coordinating all the vocal articulators from lips to larynx. Modern evidence has challenged both the idea that Broca's area is involved in motor speech coordination and that there is only one coordination network. Drawing on a wide range of evidence, here we propose a dual speech coordination model in which laryngeal control of pitch-related aspects of prosody and song are coordinated by a hierarchically organized dorsolateral system while supralaryngeal articulation at the phonetic/syllabic level is coordinated by a more ventral system posterior to Broca's area. We argue further that these two speech production subsystems have distinguishable evolutionary histories and discuss the implications for models of language evolution.
Collapse
Affiliation(s)
- Gregory Hickok
- Department of Cognitive Sciences, University of California, Irvine, CA 92697, USA
- Department of Language Science, University of California, Irvine, CA 92697, USA
| | - Jonathan Venezia
- Auditory Research Laboratory, VA Loma Linda Healthcare System, Loma Linda, CA 92357, USA
- Department of Otolaryngology—Head and Neck Surgery, Loma Linda University School of Medicine, Loma Linda, CA 92350, USA
| | - Alex Teghipco
- Department of Psychology, University of South Carolina, Columbia, SC 29208, USA
| |
Collapse
|
46
|
Hauptman M, Blank I, Fedorenko E. Non-literal language processing is jointly supported by the language and theory of mind networks: Evidence from a novel meta-analytic fMRI approach. Cortex 2023; 162:96-114. [PMID: 37023480 PMCID: PMC10210011 DOI: 10.1016/j.cortex.2023.01.013] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 11/08/2022] [Accepted: 01/11/2023] [Indexed: 03/12/2023]
Abstract
Going beyond the literal meaning of language is key to communicative success. However, the mechanisms that support non-literal inferences remain debated. Using a novel meta-analytic approach, we evaluate the contribution of linguistic, social-cognitive, and executive mechanisms to non-literal interpretation. We identified 74 fMRI experiments (n = 1,430 participants) from 2001 to 2021 that contrasted non-literal language comprehension with a literal control condition, spanning ten phenomena (e.g., metaphor, irony, indirect speech). Applying the activation likelihood estimation approach to the 825 activation peaks yielded six left-lateralized clusters. We then evaluated the locations of both the individual-study peaks and the clusters against probabilistic functional atlases (cf. anatomical locations, as is typically done) for three candidate brain networks-the language-selective network (Fedorenko, Behr, & Kanwisher, 2011), which supports language processing, the Theory of Mind (ToM) network (Saxe & Kanwisher, 2003), which supports social inferences, and the domain-general Multiple-Demand (MD) network (Duncan, 2010), which supports executive control. These atlases were created by overlaying individual activation maps of participants who performed robust and extensively validated 'localizer' tasks that selectively target each network in question (n = 806 for language; n = 198 for ToM; n = 691 for MD). We found that both the individual-study peaks and the ALE clusters fell primarily within the language network and the ToM network. These results suggest that non-literal processing is supported by both i) mechanisms that process literal linguistic meaning, and ii) mechanisms that support general social inference. They thus undermine a strong divide between literal and non-literal aspects of language and challenge the claim that non-literal processing requires additional executive resources.
Collapse
Affiliation(s)
- Miriam Hauptman
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Department of Psychological & Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA.
| | - Idan Blank
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Department of Psychology, UCLA, Los Angeles, CA 90095, USA; Department of Linguistics, UCLA, Los Angeles, CA 90095, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Program in Speech and Hearing in Bioscience and Technology, Harvard University, Boston, MA 02114, USA.
| |
Collapse
|
47
|
Rogenmoser L, Mouthon M, Etter F, Kamber J, Annoni JM, Schwab S. The processing of stress in a foreign language modulates functional antagonism between default mode and attention network regions. Neuropsychologia 2023; 185:108572. [PMID: 37119986 DOI: 10.1016/j.neuropsychologia.2023.108572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 04/19/2023] [Accepted: 04/26/2023] [Indexed: 05/01/2023]
Abstract
Lexical stress is an essential element of prosody. Mastering this prosodic feature is challenging, especially in a free-stress foreign language for individuals native to a fixed-stress language, a phenomenon referred to as stress deafness. By using functional magnetic resonance imaging, we elucidated the neuronal underpinnings of stress processing in a free-stress foreign language, and determined the underlying mechanism of stress deafness. Here, we contrasted behavioral and hemodynamic responses revealed by native speakers of a free-stress (German; N = 38) and a fixed-stress (French; N = 47) language while discriminating pairs of words in a free-stress foreign language (Spanish). Consistent with the stress deafness phenomenon, French speakers performed worse than German speakers in discriminating Spanish words based on cues of stress but not of vowel. Whole-brain analyses revealed widespread bilateral networks (cerebral regions including frontal, temporal and parietal areas as well as insular, subcortical and cerebellar structures), overlapping with the ones previously associated with stress processing within native languages. Moreover, our results provide evidence that the structures pertaining to a right-lateralized attention system (i.e., middle frontal gyrus, anterior insula) and the Default Mode Network modulate stress processing as a function of the performance level. In comparison to the German speakers, the French speakers activated the attention system and deactivated the Default Mode Network to a stronger degree, reflecting attentive engagement, likely a compensatory mechanism underlying the "stress-deaf" brain. The mechanism modulating stress processing argues for a rightward lateralization, indeed overlapping with the location covered by the dorsal stream but remaining unspecific to speech.
Collapse
Affiliation(s)
- Lars Rogenmoser
- Department of French, Université de Fribourg, Beauregard 11-13, 1700, Fribourg, Switzerland.
| | - Michael Mouthon
- Neurology-Laboratory for Cognitive and Neurological Sciences, University of Fribourg, Chemin Du Musée, 1700, Fribourg, Switzerland.
| | - Faustine Etter
- Department of French, Université de Fribourg, Beauregard 11-13, 1700, Fribourg, Switzerland.
| | - Julie Kamber
- Department of French, Université de Fribourg, Beauregard 11-13, 1700, Fribourg, Switzerland.
| | - Jean-Marie Annoni
- Neurology-Laboratory for Cognitive and Neurological Sciences, University of Fribourg, Chemin Du Musée, 1700, Fribourg, Switzerland.
| | - Sandra Schwab
- Department of French, Université de Fribourg, Beauregard 11-13, 1700, Fribourg, Switzerland; Institute of French, University of Bern, Längassstrasse 49, 3012, Bern, Switzerland; Computational Linguistics / Phonetics and Speech Sciences, University of Zurich, Andreastrasse 15, 8050, Zurich, Switzerland.
| |
Collapse
|
48
|
Hu J, Small H, Kean H, Takahashi A, Zekelman L, Kleinman D, Ryan E, Nieto-Castañón A, Ferreira V, Fedorenko E. Precision fMRI reveals that the language-selective network supports both phrase-structure building and lexical access during language production. Cereb Cortex 2023; 33:4384-4404. [PMID: 36130104 PMCID: PMC10110436 DOI: 10.1093/cercor/bhac350] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 08/01/2022] [Accepted: 08/02/2022] [Indexed: 11/13/2022] Open
Abstract
A fronto-temporal brain network has long been implicated in language comprehension. However, this network's role in language production remains debated. In particular, it remains unclear whether all or only some language regions contribute to production, and which aspects of production these regions support. Across 3 functional magnetic resonance imaging experiments that rely on robust individual-subject analyses, we characterize the language network's response to high-level production demands. We report 3 novel results. First, sentence production, spoken or typed, elicits a strong response throughout the language network. Second, the language network responds to both phrase-structure building and lexical access demands, although the response to phrase-structure building is stronger and more spatially extensive, present in every language region. Finally, contra some proposals, we find no evidence of brain regions-within or outside the language network-that selectively support phrase-structure building in production relative to comprehension. Instead, all language regions respond more strongly during production than comprehension, suggesting that production incurs a greater cost for the language network. Together, these results align with the idea that language comprehension and production draw on the same knowledge representations, which are stored in a distributed manner within the language-selective network and are used to both interpret and generate linguistic utterances.
Collapse
Affiliation(s)
- Jennifer Hu
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Hannah Small
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218, United States
| | - Hope Kean
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Atsushi Takahashi
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Leo Zekelman
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| | | | - Elizabeth Ryan
- St. George’s Medical School, St. George’s University, Grenada, West Indies
| | - Alfonso Nieto-Castañón
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA 02215, United States
| | - Victor Ferreira
- Department of Psychology, UCSD, La Jolla, CA 92093, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| |
Collapse
|
49
|
Vives ML, de Bruin D, van Baar JM, FeldmanHall O, Bhandari A. Uncertainty aversion predicts the neural expansion of semantic representations. Nat Hum Behav 2023; 7:765-775. [PMID: 36997668 DOI: 10.1038/s41562-023-01561-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Accepted: 02/17/2023] [Indexed: 04/01/2023]
Abstract
Correctly identifying the meaning of a stimulus requires activating the appropriate semantic representation among many alternatives. One way to reduce this uncertainty is to differentiate semantic representations from each other, thereby expanding the semantic space. Here, in four experiments, we test this semantic-expansion hypothesis, finding that uncertainty-averse individuals exhibit increasingly differentiated and separated semantic representations. This effect is mirrored at the neural level, where uncertainty aversion predicts greater distances between activity patterns in the left inferior frontal gyrus when reading words, and enhanced sensitivity to the semantic ambiguity of these words in the ventromedial prefrontal cortex. Two direct tests of the behavioural consequences of semantic expansion further reveal that uncertainty-averse individuals exhibit reduced semantic interference and poorer generalization. Together, these findings show that the internal structure of our semantic representations acts as an organizing principle to make the world more identifiable.
Collapse
Affiliation(s)
- Marc-Lluís Vives
- Department of Cognitive, Linguistic, Psychological Sciences, Brown University, Providence, RI, USA.
- Department of Psychology, Leiden University, Leiden, The Netherlands.
| | - Daantje de Bruin
- Department of Cognitive, Linguistic, Psychological Sciences, Brown University, Providence, RI, USA
| | - Jeroen M van Baar
- Trimbos Institute, Netherlands Institute for Mental Health and Addiction, Utrecht, The Netherlands
| | - Oriel FeldmanHall
- Department of Cognitive, Linguistic, Psychological Sciences, Brown University, Providence, RI, USA.
- Robert J. and Nancy D. Carney Institute for Brain Science, Brown University, Providence, RI, USA.
| | - Apoorva Bhandari
- Department of Cognitive, Linguistic, Psychological Sciences, Brown University, Providence, RI, USA.
| |
Collapse
|
50
|
Bruffaerts R, Pongos A, Shain C, Lipkin B, Siegelman M, Wens V, Sjøgård M, Pantazis D, Blank I, Goldman S, De Tiège X, Fedorenko E. Functional identification of language-responsive channels in individual participants in MEG investigations. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.23.533424. [PMID: 36993378 PMCID: PMC10055362 DOI: 10.1101/2023.03.23.533424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Making meaningful inferences about the functional architecture of the language system requires the ability to refer to the same neural units across individuals and studies. Traditional brain imaging approaches align and average brains together in a common space. However, lateral frontal and temporal cortex, where the language system resides, is characterized by high structural and functional inter-individual variability. This variability reduces the sensitivity and functional resolution of group-averaging analyses. This problem is compounded by the fact that language areas often lay in close proximity to regions of other large-scale networks with different functional profiles. A solution inspired by other fields of cognitive neuroscience (e.g., vision) is to identify language areas functionally in each individual brain using a 'localizer' task (e.g., a language comprehension task). This approach has proven productive in fMRI, yielding a number of discoveries about the language system, and has been successfully extended to intracranial recording investigations. Here, we apply this approach to MEG. Across two experiments (one in Dutch speakers, n=19; one in English speakers, n=23), we examined neural responses to the processing of sentences and a control condition (nonword sequences). We demonstrated that the neural response to language is spatially consistent at the individual level. The language-responsive sensors of interest were, as expected, less responsive to the nonwords condition. Clear inter-individual differences were present in the topography of the neural response to language, leading to greater sensitivity when the data were analyzed at the individual level compared to the group level. Thus, as in fMRI, functional localization yields benefits in MEG and thus opens the door to probing fine-grained distinctions in space and time in future MEG investigations of language processing.
Collapse
Affiliation(s)
- Rose Bruffaerts
- Computational Neurology, Experimental Neurobiology Unit (ENU), Department of Biomedical Sciences, University of Antwerp, Belgium; Department of Neurosciences, KU Leuven, Belgium
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Alvince Pongos
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Bioengineering, UC Berkeley-UCSF, San Francisco, CA, USA
| | - Cory Shain
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Benjamin Lipkin
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Matthew Siegelman
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Psychology, Columbia University, New York, NY, USA
| | - Vincent Wens
- Department of Functional Neuroimaging, Service of Nuclear Medicine, CUB Hôpital Erasme, Université libre de Bruxelles, Brussels, Belgium
| | - Martin Sjøgård
- Department of Functional Neuroimaging, Service of Nuclear Medicine, CUB Hôpital Erasme, Université libre de Bruxelles, Brussels, Belgium
| | - Dimitrios Pantazis
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Idan Blank
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Psychology, University of California Los Angeles, CA, USA
| | - Serge Goldman
- Department of Functional Neuroimaging, Service of Nuclear Medicine, CUB Hôpital Erasme, Université libre de Bruxelles, Brussels, Belgium
| | - Xavier De Tiège
- Department of Functional Neuroimaging, Service of Nuclear Medicine, CUB Hôpital Erasme, Université libre de Bruxelles, Brussels, Belgium
| | - Evelina Fedorenko
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|