1
|
Obrig H, Regenbrecht F, Pino D, Krause CD. Verbal short term memory contribution to sentence comprehension decreases with increasing syntactic complexity in people with aphasia. Neuroimage 2024:120730. [PMID: 39009249 DOI: 10.1016/j.neuroimage.2024.120730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Revised: 06/20/2024] [Accepted: 07/10/2024] [Indexed: 07/17/2024] Open
Abstract
Sentence comprehension requires the integration of linguistic units presented in a temporal sequence based on a non-linear underlying syntactic structure. While it is uncontroversial that storage is mandatory for this process, there are opposing views regarding the relevance of general short-term-/working-memory capacities (STM/WM) versus language specific resources. Here we report results from 43 participants with an acquired brain lesion in the extended left hemispheric language network and resulting language deficits, who performed a sentence-to-picture matching task and an experimental task assessing phonological short-term memory. The sentence task systematically varied syntactic complexity (embedding depth and argument order) while lengths, number of propositions and plausibility were kept constant. Clinical data including digit-/ block-spans and lesion size and site were additionally used in the analyses. Correlational analyses confirm that performance on STM/WM-tasks (experimental task and digit-span) are the only two relevant predictors for correct sentence-picture-matching, while reaction times only depended on age and lesion size. Notably increasing syntactic complexity reduced the correlational strength speaking for the additional recruitment of language specific resources independent of more general verbal STM/WM capacities, when resolving complex syntactic structure. The complementary lesion-behaviour analysis yielded different lesion volumes correlating with either the sentence-task or the STM-task. Factoring out STM measures lesions in the anterior temporal lobe correlated a larger decrease in accuracy with increasing syntactic complexity. We conclude that overall sentence comprehension depends on STM/WM capacity, while increases in syntactic complexity tax another independent cognitive resource.
Collapse
Affiliation(s)
- Hellmuth Obrig
- Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology & Department of Neurology, 04103 Leipzig, Germany; Clinic for Cognitive Neurology, University Hospital & Faculty of Medicine, 04103 Leipzig, Germany.
| | - Frank Regenbrecht
- Clinic for Cognitive Neurology, University Hospital & Faculty of Medicine, 04103 Leipzig, Germany
| | - Danièle Pino
- Clinic for Cognitive Neurology, University Hospital & Faculty of Medicine, 04103 Leipzig, Germany
| | - Carina D Krause
- Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology & Department of Neurology, 04103 Leipzig, Germany; International Max Planck Research School on Neuroscience of Communication: Function, Structure, and Plasticity IMPRS NeuroComm https://imprs-neurocom.mpg.de/home
| |
Collapse
|
2
|
Jamali M, Grannan B, Cai J, Khanna AR, Muñoz W, Caprara I, Paulk AC, Cash SS, Fedorenko E, Williams ZM. Semantic encoding during language comprehension at single-cell resolution. Nature 2024; 631:610-616. [PMID: 38961302 PMCID: PMC11254762 DOI: 10.1038/s41586-024-07643-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Accepted: 05/31/2024] [Indexed: 07/05/2024]
Abstract
From sequences of speech sounds1,2 or letters3, humans can extract rich and nuanced meaning through language. This capacity is essential for human communication. Yet, despite a growing understanding of the brain areas that support linguistic and semantic processing4-12, the derivation of linguistic meaning in neural tissue at the cellular level and over the timescale of action potentials remains largely unknown. Here we recorded from single cells in the left language-dominant prefrontal cortex as participants listened to semantically diverse sentences and naturalistic stories. By tracking their activities during natural speech processing, we discover a fine-scale cortical representation of semantic information by individual neurons. These neurons responded selectively to specific word meanings and reliably distinguished words from nonwords. Moreover, rather than responding to the words as fixed memory representations, their activities were highly dynamic, reflecting the words' meanings based on their specific sentence contexts and independent of their phonetic form. Collectively, we show how these cell ensembles accurately predicted the broad semantic categories of the words as they were heard in real time during speech and how they tracked the sentences in which they appeared. We also show how they encoded the hierarchical structure of these meaning representations and how these representations mapped onto the cell population. Together, these findings reveal a finely detailed cortical organization of semantic representations at the neuron scale in humans and begin to illuminate the cellular-level processing of meaning during language comprehension.
Collapse
Affiliation(s)
- Mohsen Jamali
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Benjamin Grannan
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Jing Cai
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Arjun R Khanna
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - William Muñoz
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Irene Caprara
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Ziv M Williams
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
- Harvard-MIT Division of Health Sciences and Technology, Boston, MA, USA.
- Harvard Medical School, Program in Neuroscience, Boston, MA, USA.
| |
Collapse
|
3
|
Kauf C, Kim HS, Lee EJ, Jhingan N, Selena She J, Taliaferro M, Gibson E, Fedorenko E. Linguistic inputs must be syntactically parsable to fully engage the language network. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.21.599332. [PMID: 38948870 PMCID: PMC11212959 DOI: 10.1101/2024.06.21.599332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Human language comprehension is remarkably robust to ill-formed inputs (e.g., word transpositions). This robustness has led some to argue that syntactic parsing is largely an illusion, and that incremental comprehension is more heuristic, shallow, and semantics-based than is often assumed. However, the available data are also consistent with the possibility that humans always perform rule-like symbolic parsing and simply deploy error correction mechanisms to reconstruct ill-formed inputs when needed. We put these hypotheses to a new stringent test by examining brain responses to a) stimuli that should pose a challenge for syntactic reconstruction but allow for complex meanings to be built within local contexts through associative/shallow processing (sentences presented in a backward word order), and b) grammatically well-formed but semantically implausible sentences that should impede semantics-based heuristic processing. Using a novel behavioral syntactic reconstruction paradigm, we demonstrate that backward-presented sentences indeed impede the recovery of grammatical structure during incremental comprehension. Critically, these backward-presented stimuli elicit a relatively low response in the language areas, as measured with fMRI. In contrast, semantically implausible but grammatically well-formed sentences elicit a response in the language areas similar in magnitude to naturalistic (plausible) sentences. In other words, the ability to build syntactic structures during incremental language processing is both necessary and sufficient to fully engage the language network. Taken together, these results provide strongest to date support for a generalized reliance of human language comprehension on syntactic parsing.
Collapse
Affiliation(s)
- Carina Kauf
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Hee So Kim
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Elizabeth J. Lee
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Niharika Jhingan
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Jingyuan Selena She
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Maya Taliaferro
- Department of Psychology, New York University, New York, NY 10012 USA
| | - Edward Gibson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138 USA
| |
Collapse
|
4
|
Morgan AM, Devinsky O, Doyle WK, Dugan P, Friedman D, Flinker A. A low-activity cortical network selectively encodes syntax. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.20.599931. [PMID: 38948730 PMCID: PMC11212956 DOI: 10.1101/2024.06.20.599931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Syntax, the abstract structure of language, is a hallmark of human cognition. Despite its importance, its neural underpinnings remain obscured by inherent limitations of non-invasive brain measures and a near total focus on comprehension paradigms. Here, we address these limitations with high-resolution neurosurgical recordings (electrocorticography) and a controlled sentence production experiment. We uncover three syntactic networks that are broadly distributed across traditional language regions, but with focal concentrations in middle and inferior frontal gyri. In contrast to previous findings from comprehension studies, these networks process syntax mostly to the exclusion of words and meaning, supporting a cognitive architecture with a distinct syntactic system. Most strikingly, our data reveal an unexpected property of syntax: it is encoded independent of neural activity levels. We propose that this "low-activity coding" scheme represents a novel mechanism for encoding information, reserved for higher-order cognition more broadly.
Collapse
Affiliation(s)
- Adam M. Morgan
- Neurology Department, NYU Grossman School of Medicine, 550 1st Ave, New York, 10016, NY, USA
| | - Orrin Devinsky
- Neurosurgery Department, NYU Grossman School of Medicine, 550 1st Ave, New York, 10016, NY, USA
| | - Werner K. Doyle
- Neurology Department, NYU Grossman School of Medicine, 550 1st Ave, New York, 10016, NY, USA
| | - Patricia Dugan
- Neurology Department, NYU Grossman School of Medicine, 550 1st Ave, New York, 10016, NY, USA
| | - Daniel Friedman
- Neurology Department, NYU Grossman School of Medicine, 550 1st Ave, New York, 10016, NY, USA
| | - Adeen Flinker
- Neurology Department, NYU Grossman School of Medicine, 550 1st Ave, New York, 10016, NY, USA
- Biomedical Engineering Department, NYU Tandon School of Engineering, 6 MetroTech Center Ave, Brooklyn, 11201, NY, USA
| |
Collapse
|
5
|
Shain C, Kean H, Casto C, Lipkin B, Affourtit J, Siegelman M, Mollica F, Fedorenko E. Distributed Sensitivity to Syntax and Semantics throughout the Language Network. J Cogn Neurosci 2024; 36:1427-1471. [PMID: 38683732 DOI: 10.1162/jocn_a_02164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.
Collapse
Affiliation(s)
| | - Hope Kean
- Massachusetts Institute of Technology
| | | | | | | | | | | | | |
Collapse
|
6
|
Mohammadi Y, Graversen C, Manresa JB, Østergaard J, Andersen OK. Effects of Background Noise and Linguistic Violations on Frontal Theta Oscillations During Effortful Listening. Ear Hear 2024; 45:721-729. [PMID: 38287477 DOI: 10.1097/aud.0000000000001464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2024]
Abstract
OBJECTIVES Background noise and linguistic violations have been shown to increase the listening effort. The present study aims to examine the effects of the interaction between background noise and linguistic violations on subjective listening effort and frontal theta oscillations during effortful listening. DESIGN Thirty-two normal-hearing listeners participated in this study. The linguistic violation was operationalized as sentences versus random words (strings). Behavioral and electroencephalography data were collected while participants listened to sentences and strings in background noise at different signal to noise ratios (SNRs) (-9, -6, -3, 0 dB), maintained them in memory for about 3 sec in the presence of background noise, and then chose the correct sequence of words from a base matrix of words. RESULTS Results showed the interaction effects of SNR and speech type on effort ratings. Although strings were inherently more effortful than sentences, decreasing SNR from 0 to -9 dB (in 3 dB steps), increased effort rating more for sentences than strings in each step, suggesting the more pronounced effect of noise on sentence processing that strings in low SNRs. Results also showed a significant interaction between SNR and speech type on frontal theta event-related synchronization during the retention interval. This interaction indicated that strings exhibited higher frontal theta event-related synchronization than sentences at SNR of 0 dB, suggesting increased verbal working memory demand for strings under challenging listening conditions. CONCLUSIONS The study demonstrated that the interplay between linguistic violation and background noise shapes perceived effort and cognitive load during speech comprehension under challenging listening conditions. The differential impact of noise on processing sentences versus strings highlights the influential role of context and cognitive resource allocation in the processing of speech.
Collapse
Affiliation(s)
- Yousef Mohammadi
- Department of Health Science and Technology, Integrative Neuroscience, Aalborg University, Aalborg, Denmark
| | - Carina Graversen
- Department of Health Science and Technology, Integrative Neuroscience, Aalborg University, Aalborg, Denmark
- Department of Health Science and Technology, Center for Neuroplasticity and Pain, Aalborg University, Aalborg, Denmark
| | - José Biurrun Manresa
- Department of Health Science and Technology, Center for Neuroplasticity and Pain, Aalborg University, Aalborg, Denmark
- Institute for Research and Development in Bioengineering and Bioinformatics, National Scientific and Technical Research Council (CONICET) - National University of Entre Ríos (UNER), Oro Verde, Argentina
| | - Jan Østergaard
- Department of Electronic Systems, Aalborg University, Aalborg, Denmark
| | - Ole Kæseler Andersen
- Department of Health Science and Technology, Integrative Neuroscience, Aalborg University, Aalborg, Denmark
- Department of Health Science and Technology, Center for Neuroplasticity and Pain, Aalborg University, Aalborg, Denmark
| |
Collapse
|
7
|
Cai J, Hadjinicolaou AE, Paulk AC, Soper DJ, Xia T, Williams ZM, Cash SS. Natural language processing models reveal neural dynamics of human conversation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.03.10.531095. [PMID: 36945468 PMCID: PMC10028965 DOI: 10.1101/2023.03.10.531095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2023]
Abstract
Through conversation, humans relay complex information through the alternation of speech production and comprehension. The neural mechanisms that underlie these complementary processes or through which information is precisely conveyed by language, however, remain poorly understood. Here, we used pretrained deep learning natural language processing models in combination with intracranial neuronal recordings to discover neural signals that reliably reflect speech production, comprehension, and their transitions during natural conversation between individuals. Our findings indicate that neural activities that encoded linguistic information were broadly distributed throughout frontotemporal areas across multiple frequency bands. We also find that these activities were specific to the words and sentences being conveyed and that they were dependent on the word's specific context and order. Finally, we demonstrate that these neural patterns partially overlapped during language production and comprehension and that listener-speaker transitions were associated with specific, time-aligned changes in neural activity. Collectively, our findings reveal a dynamical organization of neural activities that subserve language production and comprehension during natural conversation and harness the use of deep learning models in understanding the neural mechanisms underlying human language.
Collapse
Affiliation(s)
- Jing Cai
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Alex E. Hadjinicolaou
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Angelique C. Paulk
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Daniel J. Soper
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Tian Xia
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Ziv M. Williams
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA
- Harvard-MIT Division of Health Sciences and Technology, Boston, MA
- Harvard Medical School, Program in Neuroscience, Boston, MA
- These authors contributed equally
| | - Sydney S. Cash
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA
- Harvard-MIT Division of Health Sciences and Technology, Boston, MA
- These authors contributed equally
| |
Collapse
|
8
|
Liu YF, Wilson C, Bedny M. Contribution of the language network to the comprehension of Python programming code. BRAIN AND LANGUAGE 2024; 251:105392. [PMID: 38387220 DOI: 10.1016/j.bandl.2024.105392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 02/08/2024] [Accepted: 02/14/2024] [Indexed: 02/24/2024]
Abstract
Does the perisylvian language network contribute to comprehension of programming languages, like Python? Univariate neuroimaging studies find high responses to code in fronto-parietal executive areas but not in fronto-temporal language areas, suggesting the language network does little. We used multivariate-pattern-analysis to test whether the language network encodes Python functions. Python programmers read functions while undergoing fMRI. A linear SVM decoded for-loops from if-conditionals based on activity in lateral temporal (LT) language cortex. In searchlight analysis, decoding accuracy was higher in LT language cortex than anywhere else. Follow up analysis showed that decoding was not driven by presence of different words across functions, "for" vs "if," but by compositional program properties. Finally, univariate responses to code peaked earlier in LT language-cortex than in the fronto-parietal network. We propose that the language system forms initial "surface meaning" representations of programs, which input to the reasoning network for processing of algorithms.
Collapse
Affiliation(s)
- Yun-Fei Liu
- Department of Psychological and Brain Sciences, Johns Hopkins Universtiy, 232 Ames Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA.
| | - Colin Wilson
- Department of Cognitive Science, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA
| | - Marina Bedny
- Department of Psychological and Brain Sciences, Johns Hopkins Universtiy, 232 Ames Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA
| |
Collapse
|
9
|
Malik-Moraleda S, Jouravlev O, Taliaferro M, Mineroff Z, Cucu T, Mahowald K, Blank IA, Fedorenko E. Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI. Cereb Cortex 2024; 34:bhae049. [PMID: 38466812 PMCID: PMC10928488 DOI: 10.1093/cercor/bhae049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 01/24/2024] [Accepted: 01/25/2024] [Indexed: 03/13/2024] Open
Abstract
How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g. related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages coexist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.
Collapse
Affiliation(s)
- Saima Malik-Moraleda
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114, United States
| | - Olessia Jouravlev
- Department of Cognitive Science, Carleton University, Ottawa K1S 5B6, Canada
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| | - Zachary Mineroff
- Eberly Center, Carnegie Mellon University, Pittsburgh, PA 15289, United States
| | - Theodore Cucu
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15289, United States
| | - Kyle Mahowald
- Department of Linguistics, The University of Texas at Austin, Austin, TX 78712, United States
| | - Idan A Blank
- Department of Psychology, University of California Los Angeles, Los Angeles, CA 90095, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Boston, MA 02114, United States
| |
Collapse
|
10
|
Liu X, Howell P. Can listeners predict whether or not a stutter follows a stretch of fluent speech? JOURNAL OF FLUENCY DISORDERS 2024; 79:106038. [PMID: 38290224 DOI: 10.1016/j.jfludis.2024.106038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 01/12/2024] [Accepted: 01/17/2024] [Indexed: 02/01/2024]
Abstract
PURPOSE Neurophysiological studies report that people who stutter (PWS) exhibit enhanced motor preparation before they stutter. This motor preparation pattern raises the possibility of detecting upcoming stutter moments before they actually occur. This study examined whether these motor preparation differences are detectable by listeners in the corresponding acoustic signal, thereby allowing them to predict upcoming stuttering moments. If so, features in these acoustic patterns could potentially be employed by computational procedures to automate detection of upcoming stutters and to target auditory feedback alterations specifically on these locations. METHODS Forty healthy normal-hearing participants (aged 18-30) listened to seemingly fluent speech extracts each of which was either followed by a fluent (control condition) or stuttered (experimental condition) moment after the fluent extract. Participants listened to each extract and rated the likelihood of the speaker stuttering on the next word on a scale of 1 (very unlikely) to 7 (very likely) as to whether they thought there was a subsequent stutter. Several measures were made on the speech extracts which were examined either as control requirements to ensure no differences between experimental and control material or as covariates to assess any effects they had on judgments between the two conditions. RESULTS Listeners gave significantly higher stutter-likelihood ratings for speech originally followed by a stuttered moment although effects were small. CONCLUSIONS Naive listeners rated speech extracts that were subsequently followed by stuttered moments as more likely to be followed by a stutter than those that were followed by fluent words after the effects of significant covariates were excluded.
Collapse
Affiliation(s)
- Xena Liu
- Department of Experimental Psychology, University College London, 26 Bedford Way, London WC1H 0AP, UK.
| | - Peter Howell
- Department of Experimental Psychology, University College London, 26 Bedford Way, London WC1H 0AP, UK.
| |
Collapse
|
11
|
Krämer C, Stumme J, da Costa Campos L, Dellani P, Rubbert C, Caspers J, Caspers S, Jockwitz C. Prediction of cognitive performance differences in older age from multimodal neuroimaging data. GeroScience 2024; 46:283-308. [PMID: 37308769 PMCID: PMC10828156 DOI: 10.1007/s11357-023-00831-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 05/17/2023] [Indexed: 06/14/2023] Open
Abstract
Differences in brain structure and functional and structural network architecture have been found to partly explain cognitive performance differences in older ages. Thus, they may serve as potential markers for these differences. Initial unimodal studies, however, have reported mixed prediction results of selective cognitive variables based on these brain features using machine learning (ML). Thus, the aim of the current study was to investigate the general validity of cognitive performance prediction from imaging data in healthy older adults. In particular, the focus was with examining whether (1) multimodal information, i.e., region-wise grey matter volume (GMV), resting-state functional connectivity (RSFC), and structural connectivity (SC) estimates, may improve predictability of cognitive targets, (2) predictability differences arise for global cognition and distinct cognitive profiles, and (3) results generalize across different ML approaches in 594 healthy older adults (age range: 55-85 years) from the 1000BRAINS study. Prediction potential was examined for each modality and all multimodal combinations, with and without confound (i.e., age, education, and sex) regression across different analytic options, i.e., variations in algorithms, feature sets, and multimodal approaches (i.e., concatenation vs. stacking). Results showed that prediction performance differed considerably between deconfounding strategies. In the absence of demographic confounder control, successful prediction of cognitive performance could be observed across analytic choices. Combination of different modalities tended to marginally improve predictability of cognitive performance compared to single modalities. Importantly, all previously described effects vanished in the strict confounder control condition. Despite a small trend for a multimodal benefit, developing a biomarker for cognitive aging remains challenging.
Collapse
Affiliation(s)
- Camilla Krämer
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute for Anatomy I, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Johanna Stumme
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute for Anatomy I, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Lucas da Costa Campos
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute for Anatomy I, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Paulo Dellani
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute for Anatomy I, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Christian Rubbert
- Department of Diagnostic and Interventional Radiology, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Julian Caspers
- Department of Diagnostic and Interventional Radiology, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Svenja Caspers
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
- Institute for Anatomy I, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Christiane Jockwitz
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany.
- Institute for Anatomy I, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany.
| |
Collapse
|
12
|
van der Burght CL, Friederici AD, Maran M, Papitto G, Pyatigorskaya E, Schroën JAM, Trettenbrein PC, Zaccarella E. Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language. J Cogn Neurosci 2023; 35:2067-2088. [PMID: 37713672 DOI: 10.1162/jocn_a_02058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023]
Abstract
The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.
Collapse
Affiliation(s)
| | - Angela D Friederici
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Matteo Maran
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Giorgio Papitto
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Elena Pyatigorskaya
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Joëlle A M Schroën
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Patrick C Trettenbrein
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
- University of Göttingen, Göttingen, Germany
| | - Emiliano Zaccarella
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
13
|
Desai RH, Hackett CT, Johari K, Lai VT, Riccardi N. Spatiotemporal characteristics of the neural representation of event concepts. BRAIN AND LANGUAGE 2023; 246:105328. [PMID: 37847931 PMCID: PMC10873121 DOI: 10.1016/j.bandl.2023.105328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 09/25/2023] [Accepted: 10/01/2023] [Indexed: 10/19/2023]
Abstract
Events are a fundamentally important part of our understanding of the world. How lexical concepts denoting events are represented in the brain remains controversial. We conducted two experiments using event and object nouns matched on a range of psycholinguistic variables, including concreteness, to examine spatial and temporal characteristics of event concepts. Both experiments used magnitude and valence tasks on event and object nouns. The fMRI experiment revealed a distributed set of regions for events, including the angular gyrus, anterior temporal lobe, and posterior cingulate across tasks. In the EEG experiment, events and objects differed in amplitude within the 300-500 ms window. Together these results shed light into the spatiotemporal characteristics of event concept representation and show that event concepts are represented in the putative hubs of the semantic system. While these hubs are typically associated with object semantics, they also represent events, and have a likely role in temporal integration.
Collapse
Affiliation(s)
- Rutvik H Desai
- Department of Psychology, University of South Carolina, United States; Institute for Mind and Brain, University of South Carolina, United States.
| | | | - Karim Johari
- Department of Communication Sciences & Disorders, Louisiana State University, United States
| | - Vicky T Lai
- Department of Psychology, University of Arizona, United States
| | - Nicholas Riccardi
- Department of Psychology, University of South Carolina, United States
| |
Collapse
|
14
|
Zhang G, Xu Y, Wang X, Li J, Shi W, Bi Y, Lin N. A social-semantic working-memory account for two canonical language areas. Nat Hum Behav 2023; 7:1980-1997. [PMID: 37735521 DOI: 10.1038/s41562-023-01704-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 08/22/2023] [Indexed: 09/23/2023]
Abstract
Language and social cognition are traditionally studied as separate cognitive domains, yet accumulative studies reveal overlapping neural correlates at the left ventral temporoparietal junction (vTPJ) and the left lateral anterior temporal lobe (lATL), which have been attributed to sentence processing and social concept activation. We propose a common cognitive component underlying both effects: social-semantic working memory. We confirmed two key predictions of our hypothesis using functional MRI. First, the left vTPJ and lATL showed sensitivity to sentences only when the sentences conveyed social meaning; second, these regions showed persistent social-semantic-selective activity after the linguistic stimuli disappeared. We additionally found that both regions were sensitive to the socialness of non-linguistic stimuli and were more tightly connected with the social-semantic-processing areas than with the sentence-processing areas. The converging evidence indicates the social-semantic working-memory function of the left vTPJ and lATL and challenges the general-semantic and/or syntactic accounts for the neural activity of these regions.
Collapse
Affiliation(s)
- Guangyao Zhang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
- IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
- Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| | - Yangwen Xu
- Center for Mind/Brain Sciences, University of Trento, Trento, Italy
| | - Xiuyi Wang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Jixing Li
- Department of Linguistics and Translation, City University of Hong Kong, Hong Kong SAR, China
| | - Weiting Shi
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Yanchao Bi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
- IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
- Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| | - Nan Lin
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China.
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
15
|
Graessner A, Duchow C, Zaccarella E, Friederici AD, Obrig H, Hartwigsen G. Electrophysiological correlates of basic semantic composition in people with aphasia. Neuroimage Clin 2023; 40:103516. [PMID: 37769366 PMCID: PMC10540050 DOI: 10.1016/j.nicl.2023.103516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 09/21/2023] [Accepted: 09/22/2023] [Indexed: 09/30/2023]
Abstract
The neuroanatomical correlates of basic semantic composition have been investigated in previous neuroimaging and lesion studies, but research on the electrophysiology of the involved processes is scarce. A large literature on sentence-level event-related potentials (ERPs) during semantic processing has identified at least two relevant components - the N400 and the P600. Other studies demonstrated that these components are reduced and/or delayed in people with aphasia (PWA). However, it remains to be shown if these findings generalize beyond the sentence level. Specifically, it is an open question if an alteration in ERP responses in PWA can also be observed during basic semantic composition, providing a potential future diagnostic tool. The present study aimed to elucidate the electrophysiological dynamics of basic semantic composition in a group of post-stroke PWA. We included 20 PWA and 20 age-matched controls (mean age 58 years) and measured ERP responses while they performed a plausibility judgment task on two-word phrases that were either meaningful ("anxious horse"), anomalous ("anxious wood") or had the noun replaced by a pseudoword ("anxious gufel"). The N400 effect for anomalous versus meaningful phrases was similar in both groups. In contrast, unlike the control group, PWA did not show an N400 effect between pseudoword and meaningful phrases. Moreover, both groups exhibited a parietal P600 effect towards pseudoword phrases, while PWA showed an additional P600 over frontal electrodes. Finally, PWA showed an inverse correlation between the magnitude of the N400 and P600 effects: PWA exhibiting no or even reversed N400 effects towards anomalous and pseudoword phrases showed a stronger P600 effect. These results may reflect a compensatory mechanism which allows PWA to arrive at the correct interpretation of the phrase. When compositional processing capacities are impaired in the early N400 time-window, PWA may make use of a more elaborate re-analysis process reflected in the P600.
Collapse
Affiliation(s)
- Astrid Graessner
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Caroline Duchow
- Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Angela D Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Hellmuth Obrig
- Clinic for Cognitive Neurology, University Hospital Leipzig, Germany; Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Gesa Hartwigsen
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
16
|
Wang J, Wang X, Zou J, Duan J, Shen Z, Xu N, Chen Y, Zhang J, He H, Bi Y, Ding N. Neural substrate underlying the learning of a passage with unfamiliar vocabulary and syntax. Cereb Cortex 2023; 33:10036-10046. [PMID: 37491998 DOI: 10.1093/cercor/bhad263] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 06/26/2023] [Accepted: 06/27/2023] [Indexed: 07/27/2023] Open
Abstract
Speech comprehension is a complex process involving multiple stages, such as decoding of phonetic units, recognizing words, and understanding sentences and passages. In this study, we identify cortical networks beyond basic phonetic processing using a novel passage learning paradigm. Participants learn to comprehend a story composed of syllables of their native language, but containing unfamiliar vocabulary and syntax. Three learning methods are employed, each resulting in some degree of learning within a 12-min learning session. Functional magnetic resonance imaging results reveal that, when listening to the same story, the classic temporal-frontal language network is significantly enhanced by learning. Critically, activation of the left anterior and posterior temporal lobe correlates with the learning outcome that is assessed behaviorally through, e.g. word recognition and passage comprehension tests. This study demonstrates that a brief learning session is sufficient to induce neural plasticity in the left temporal lobe, which underlies the transformation from phonetic units to the units of meaning, such as words and sentences.
Collapse
Affiliation(s)
- Jing Wang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Xiaosha Wang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Jiajie Zou
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Jipeng Duan
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Zhuowen Shen
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Nannan Xu
- School of Linguistic Sciences and Arts, Jiangsu Normal University, Xuzhou 221009, China
| | - Yan Chen
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Jianfeng Zhang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Hongjian He
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
| | - Yanchao Bi
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China
| | - Nai Ding
- Key Laboratory for Biomedical Engineering of Ministry of Education, Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China
- MOE Frontier Science Center for Brain Science & Brain-machine Integration, Zhejiang University, Hangzhou 310027, China
| |
Collapse
|
17
|
Hussain I, Jany R, Boyer R, Azad AKM, Alyami SA, Park SJ, Hasan MM, Hossain MA. An Explainable EEG-Based Human Activity Recognition Model Using Machine-Learning Approach and LIME. SENSORS (BASEL, SWITZERLAND) 2023; 23:7452. [PMID: 37687908 PMCID: PMC10490625 DOI: 10.3390/s23177452] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 08/06/2023] [Accepted: 08/24/2023] [Indexed: 09/10/2023]
Abstract
Electroencephalography (EEG) is a non-invasive method employed to discern human behaviors by monitoring the neurological responses during cognitive and motor tasks. Machine learning (ML) represents a promising tool for the recognition of human activities (HAR), and eXplainable artificial intelligence (XAI) can elucidate the role of EEG features in ML-based HAR models. The primary objective of this investigation is to investigate the feasibility of an EEG-based ML model for categorizing everyday activities, such as resting, motor, and cognitive tasks, and interpreting models clinically through XAI techniques to explicate the EEG features that contribute the most to different HAR states. The study involved an examination of 75 healthy individuals with no prior diagnosis of neurological disorders. EEG recordings were obtained during the resting state, as well as two motor control states (walking and working tasks), and a cognition state (reading task). Electrodes were placed in specific regions of the brain, including the frontal, central, temporal, and occipital lobes (Fz, C1, C2, T7, T8, Oz). Several ML models were trained using EEG data for activity recognition and LIME (Local Interpretable Model-Agnostic Explanations) was employed for interpreting clinically the most influential EEG spectral features in HAR models. The classification results of the HAR models, particularly the Random Forest and Gradient Boosting models, demonstrated outstanding performances in distinguishing the analyzed human activities. The ML models exhibited alignment with EEG spectral bands in the recognition of human activity, a finding supported by the XAI explanations. To sum up, incorporating eXplainable Artificial Intelligence (XAI) into Human Activity Recognition (HAR) studies may improve activity monitoring for patient recovery, motor imagery, the healthcare metaverse, and clinical virtual reality settings.
Collapse
Affiliation(s)
- Iqram Hussain
- Department of Anesthesiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA
| | - Rafsan Jany
- Department of Computer Science and Engineering, Islamic University and Technology (IUT), Gazipur 1704, Bangladesh; (R.J.); (M.A.H.)
| | - Richard Boyer
- Department of Anesthesiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA
| | - AKM Azad
- Department of Mathematics and Statistics, Al-Imam Muhammad Ibn Saud Islamic University (IMSIU), Riyadh 13318, Saudi Arabia; (A.A.); (S.A.A.)
| | - Salem A. Alyami
- Department of Mathematics and Statistics, Al-Imam Muhammad Ibn Saud Islamic University (IMSIU), Riyadh 13318, Saudi Arabia; (A.A.); (S.A.A.)
| | - Se Jin Park
- Sewon Intelligence Ltd., Seoul 04512, Republic of Korea;
| | - Md Mehedi Hasan
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka 1000, Bangladesh;
| | - Md Azam Hossain
- Department of Computer Science and Engineering, Islamic University and Technology (IUT), Gazipur 1704, Bangladesh; (R.J.); (M.A.H.)
| |
Collapse
|
18
|
Sheng Y, Yang S, Rao J, Zhang Q, Li J, Wang D, Zheng W. Age of Bilingual Onset Shapes the Dynamics of Functional Connectivity and Laterality in the Resting-State. Brain Sci 2023; 13:1231. [PMID: 37759832 PMCID: PMC10526135 DOI: 10.3390/brainsci13091231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 08/11/2023] [Accepted: 08/21/2023] [Indexed: 09/29/2023] Open
Abstract
Bilingualism is known to enhance cognitive function and flexibility of the brain. However, it is not clear how bilingual experience affects the time-varying functional network and whether these changes depend on the age of bilingual onset. This study intended to investigate the bilingual-related dynamic functional connectivity (dFC) based on the resting-state functional magnetic resonance images, including 23 early bilinguals (EBs), 30 late bilinguals (LBs), and 31 English monolinguals. The analysis identified two dFC states, and LBs showed more transitions between these states than monolinguals. Moreover, more frequent left-right switches were found in functional laterality in prefrontal, lateral temporal, lateral occipital, and inferior parietal cortices in EBs compared with LB and monolingual cohorts, and the laterality changes in the anterior superior temporal cortex were negatively correlated with L2 proficiency. These findings highlight how the age of L2 acquisition affects cortico-cortical dFC pattern and provide insight into the neural mechanisms of bilingualism.
Collapse
Affiliation(s)
- Yucen Sheng
- School of Foreign Languages, Lanzhou Jiaotong University, Lanzhou 730070, China
| | - Songyu Yang
- Gansu Provincial Key Laboratory of Wearable Computing, School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Juan Rao
- School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
| | - Qin Zhang
- Gansu Provincial Key Laboratory of Wearable Computing, School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Jialong Li
- Gansu Provincial Key Laboratory of Wearable Computing, School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Dianjian Wang
- School of Foreign Languages, Lanzhou Jiaotong University, Lanzhou 730070, China
| | - Weihao Zheng
- Gansu Provincial Key Laboratory of Wearable Computing, School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| |
Collapse
|
19
|
Mohammadi Y, Graversen C, Østergaard J, Andersen OK, Reichenbach T. Phase-locking of Neural Activity to the Envelope of Speech in the Delta Frequency Band Reflects Differences between Word Lists and Sentences. J Cogn Neurosci 2023; 35:1301-1311. [PMID: 37379482 DOI: 10.1162/jocn_a_02016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/30/2023]
Abstract
The envelope of a speech signal is tracked by neural activity in the cerebral cortex. The cortical tracking occurs mainly in two frequency bands, theta (4-8 Hz) and delta (1-4 Hz). Tracking in the faster theta band has been mostly associated with lower-level acoustic processing, such as the parsing of syllables, whereas the slower tracking in the delta band relates to higher-level linguistic information of words and word sequences. However, much regarding the more specific association between cortical tracking and acoustic as well as linguistic processing remains to be uncovered. Here, we recorded EEG responses to both meaningful sentences and random word lists in different levels of signal-to-noise ratios (SNRs) that lead to different levels of speech comprehension as well as listening effort. We then related the neural signals to the acoustic stimuli by computing the phase-locking value (PLV) between the EEG recordings and the speech envelope. We found that the PLV in the delta band increases with increasing SNR for sentences but not for the random word lists, showing that the PLV in this frequency band reflects linguistic information. When attempting to disentangle the effects of SNR, speech comprehension, and listening effort, we observed a trend that the PLV in the delta band might reflect listening effort rather than the other two variables, although the effect was not statistically significant. In summary, our study shows that the PLV in the delta band reflects linguistic information and might be related to listening effort.
Collapse
|
20
|
Chou T, Deckersbach T, Dougherty DD, Hooley JM. The default mode network and rumination in individuals at risk for depression. Soc Cogn Affect Neurosci 2023; 18:nsad032. [PMID: 37261927 PMCID: PMC10634292 DOI: 10.1093/scan/nsad032] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 04/17/2023] [Accepted: 05/27/2023] [Indexed: 06/03/2023] Open
Abstract
The default mode network (DMN) is a network of brain regions active during rest and self-referential thinking. Individuals with major depressive disorder (MDD) show increased or decreased DMN activity relative to controls. DMN activity has been linked to a tendency to ruminate in MDD. It is unclear if individuals who are at risk for, but who have no current or past history of depression, also show differential DMN activity associated with rumination. We investigated whether females with high levels of neuroticism with no current or lifetime mood or anxiety disorders (n = 25) show increased DMN activation, specifically when processing negative self-referential information, compared with females with average levels of neuroticism (n = 28). Participants heard criticism and praise during functional magnetic resonance imaging (MRI) scans in a 3T Siemens Prisma scanner. The at-risk group showed greater activation in two DMN regions, the medial prefrontal cortex and the inferior parietal lobule (IPL), after hearing criticism, but not praise (relative to females with average levels of neuroticism). Criticism-specific activation in the IPL was significantly correlated with rumination. Individuals at risk for depression may, therefore, have an underlying neurocognitive vulnerability to use a brain network typically involved in thinking about oneself to preferentially ruminate about negative, rather than positive, information.
Collapse
Affiliation(s)
- Tina Chou
- Department of Psychiatry, Massachusetts General
Hospital, Charlestown, MA 02129, USA
- Department of Psychology, Harvard
University, Cambridge, MA 02138, USA
| | - Thilo Deckersbach
- Department of Psychology, University of Applied
Sciences, Diploma Hochschule, Bad Sooden-Allendorf 37242, Germany
| | - Darin D Dougherty
- Department of Psychiatry, Massachusetts General
Hospital, Charlestown, MA 02129, USA
| | - Jill M Hooley
- Department of Psychology, Harvard
University, Cambridge, MA 02138, USA
| |
Collapse
|
21
|
Zhu H, Fitzhugh MC, Keator LM, Johnson L, Rorden C, Bonilha L, Fridriksson J, Rogalsky C. How can graph theory inform the dual-stream model of speech processing? a resting-state fMRI study of post-stroke aphasia. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.17.537216. [PMID: 37131756 PMCID: PMC10153155 DOI: 10.1101/2023.04.17.537216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
The dual-stream model of speech processing has been proposed to represent the cortical networks involved in speech comprehension and production. Although it is arguably the prominent neuroanatomical model of speech processing, it is not yet known if the dual-stream model represents actual intrinsic functional brain networks. Furthermore, it is unclear how disruptions after a stroke to the functional connectivity of the dual-stream model's regions are related to specific types of speech production and comprehension impairments seen in aphasia. To address these questions, in the present study, we examined two independent resting-state fMRI datasets: (1) 28 neurotypical matched controls and (2) 28 chronic left-hemisphere stroke survivors with aphasia collected at another site. Structural MRI, as well as language and cognitive behavioral assessments, were collected. Using standard functional connectivity measures, we successfully identified an intrinsic resting-state network amongst the dual-stream model's regions in the control group. We then used both standard functional connectivity analyses and graph theory approaches to determine how the functional connectivity of the dual-stream network differs in individuals with post-stroke aphasia, and how this connectivity may predict performance on clinical aphasia assessments. Our findings provide strong evidence that the dual-stream model is an intrinsic network as measured via resting-state MRI, and that weaker functional connectivity of the hub nodes of the dual-stream network defined by graph theory methods, but not overall average network connectivity, is weaker in the stroke group than in the control participants. Also, the functional connectivity of the hub nodes predicted specific types of impairments on clinical assessments. In particular, the relative strength of connectivity of the right hemisphere's homologues of the left dorsal stream hubs to the left dorsal hubs versus right ventral stream hubs is a particularly strong predictor of post-stroke aphasia severity and symptomology.
Collapse
|
22
|
Sugimoto H, Abe MS, Otake-Matsuura M. Word-producing brain: Contribution of the left anterior middle temporal gyrus to word production patterns in spoken language. BRAIN AND LANGUAGE 2023; 238:105233. [PMID: 36842390 DOI: 10.1016/j.bandl.2023.105233] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2022] [Revised: 12/27/2022] [Accepted: 02/01/2023] [Indexed: 06/18/2023]
Abstract
Vocabulary is based on semantic knowledge. The anterior temporal lobe (ATL) has been considered an essential region for processing semantic knowledge; nonetheless, the association between word production patterns and the structural and functional characteristics of the ATL remains unclear. To examine this, we analyzed over one million words from group conversations among community-dwelling older adults and their multimodal magnetic resonance imaging data. A quantitative index for the word production patterns, namely the exponent β of Heaps' law, positively correlated with the left anterior middle temporal gyrus volume. Moreover, β negatively correlated with its resting-state functional connectivity with the precuneus. There was no significant correlation with the diffusion tensor imaging metrics in any fiber. These findings suggest that the vocabulary richness in spoken language depends on the brain status characterized by the semantic knowledge-related brain structure and its activation dissimilarity with the precuneus, a core region of the default mode network.
Collapse
Affiliation(s)
- Hikaru Sugimoto
- RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Building, 15th floor, 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan.
| | - Masato S Abe
- RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Building, 15th floor, 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan; Faculty of Culture and Information Science, Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe-shi, Kyoto-fu 610-0394, Japan.
| | - Mihoko Otake-Matsuura
- RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Building, 15th floor, 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan.
| |
Collapse
|
23
|
Hardy SM, Jensen O, Wheeldon L, Mazaheri A, Segaert K. Modulation in alpha band activity reflects syntax composition: an MEG study of minimal syntactic binding. Cereb Cortex 2023; 33:497-511. [PMID: 35311899 PMCID: PMC9890467 DOI: 10.1093/cercor/bhac080] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 02/06/2022] [Accepted: 02/07/2022] [Indexed: 02/05/2023] Open
Abstract
Successful sentence comprehension requires the binding, or composition, of multiple words into larger structures to establish meaning. Using magnetoencephalography, we investigated the neural mechanisms involved in binding at the syntax level, in a task where contributions from semantics were minimized. Participants were auditorily presented with minimal sentences that required binding (pronoun and pseudo-verb with the corresponding morphological inflection; "she grushes") and pseudo-verb wordlists that did not require binding ("cugged grushes"). Relative to no binding, we found that syntactic binding was associated with a modulation in alpha band (8-12 Hz) activity in left-lateralized language regions. First, we observed a significantly smaller increase in alpha power around the presentation of the target word ("grushes") that required binding (-0.05 to 0.1 s), which we suggest reflects an expectation of binding to occur. Second, during binding of the target word (0.15-0.25 s), we observed significantly decreased alpha phase-locking between the left inferior frontal gyrus and the left middle/inferior temporal cortex, which we suggest reflects alpha-driven cortical disinhibition serving to strengthen communication within the syntax composition neural network. Altogether, our findings highlight the critical role of rapid spatial-temporal alpha band activity in controlling the allocation, transfer, and coordination of the brain's resources during syntax composition.
Collapse
Affiliation(s)
- Sophie M Hardy
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
- Department of Psychology, University of Warwick, Coventry CV4 7AL, UK
| | - Ole Jensen
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
| | - Linda Wheeldon
- Department of Foreign Languages and Translations, University of Agder, Kristiansand 4630, Norway
| | - Ali Mazaheri
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
- School of Psychology, University of Birmingham, Birmingham B15 2TT, UK
| | - Katrien Segaert
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
- School of Psychology, University of Birmingham, Birmingham B15 2TT, UK
| |
Collapse
|
24
|
Coexistence of the social semantic effect and non-semantic effect in the default mode network. Brain Struct Funct 2023; 228:321-339. [PMID: 35394555 DOI: 10.1007/s00429-022-02476-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Accepted: 02/23/2022] [Indexed: 01/07/2023]
Abstract
Neuroimaging studies have found both semantic and non-semantic effects in the default mode network (DMN), leading to an intense debate on the role of the DMN in semantic processes. Four different views have been proposed: (1) the general semantic view holds that the DMN contains several hub regions supporting general semantic processes; (2) the non-semantic view holds that the semantic effects observed in the DMN (especially the ventral angular gyrus) are confounded by difficulty and do not reflect semantic processing per se; (3) the multifunction view holds that the same areas in the DMN can support both semantic and non-semantic functions; and (4) the multisystem view holds that the DMN contains multiple subnetworks supporting different aspects of semantic processes separately. Using an fMRI experiment, we found that in one of the subnetworks of the DMN, called the social semantic network, all areas showed social semantic activation and difficulty-induced deactivation. The distributions of two non-semantic effects, that is, difficulty-induced and task-induced deactivations, showed dissociation in the DMN. In the bilateral angular gyri, the ventral subdivisions showed social semantic activation independent of difficulty, while the dorsal subdivisions showed no semantic effect but difficulty-induced activation. Our findings provide two insights into the semantic and non-semantic functions of the DMN, which are consistent with both the multisystem and multifunction views: first, the same areas of the DMN can support both social semantic and non-semantic functions; second, similar to the multiple semantic effects of the DMN, the non-semantic effects also vary across its subsystems.
Collapse
|
25
|
Schell M, Friederici AD, Zaccarella E. Neural classification maps for distinct word combinations in Broca's area. Front Hum Neurosci 2022; 16:930849. [PMID: 36405085 PMCID: PMC9671167 DOI: 10.3389/fnhum.2022.930849] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 09/08/2022] [Indexed: 11/16/2023] Open
Abstract
Humans are equipped with the remarkable ability to comprehend an infinite number of utterances. Relations between grammatical categories restrict the way words combine into phrases and sentences. How the brain recognizes different word combinations remains largely unknown, although this is a necessary condition for combinatorial unboundedness in language. Here, we used functional magnetic resonance imaging and multivariate pattern analysis to explore whether distinct neural populations of a known language network hub-Broca's area-are specialized for recognizing distinct simple word combinations. The phrases consisted of a noun (flag) occurring either with a content word, an adjective (green flag), or with a function word, a determiner (that flag). The key result is that the distribution of neural populations classifying word combination in Broca's area seems sensitive to neuroanatomical subdivisions within this area, irrespective of task. The information patterns for adjective + noun were localized in its anterior part (BA45) whereas those for determiner + noun were localized in its posterior part (BA44). Our findings provide preliminary answers to the fundamental question of how lexical and grammatical category information interact during simple word combination, with the observation that Broca's area is sensitive to the recognition of categorical relationships during combinatory processing, based on different demands placed on syntactic and semantic information. This supports the hypothesis that the combinatorial power of language consists of some neural computation capturing phrasal differences when processing linguistic input.
Collapse
Affiliation(s)
- Marianne Schell
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Angela D. Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
26
|
Broderick MP, Zuk NJ, Anderson AJ, Lalor EC. More than words: Neurophysiological correlates of semantic dissimilarity depend on comprehension of the speech narrative. Eur J Neurosci 2022; 56:5201-5214. [PMID: 35993240 DOI: 10.1111/ejn.15805] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 08/15/2022] [Accepted: 08/18/2022] [Indexed: 12/14/2022]
Abstract
Speech comprehension relies on the ability to understand words within a coherent context. Recent studies have attempted to obtain electrophysiological indices of this process by modelling how brain activity is affected by a word's semantic dissimilarity to preceding words. Although the resulting indices appear robust and are strongly modulated by attention, it remains possible that, rather than capturing the contextual understanding of words, they may actually reflect word-to-word changes in semantic content without the need for a narrative-level understanding on the part of the listener. To test this, we recorded electroencephalography from subjects who listened to speech presented in either its original, narrative form, or after scrambling the word order by varying amounts. This manipulation affected the ability of subjects to comprehend the speech narrative but not the ability to recognise individual words. Neural indices of semantic understanding and low-level acoustic processing were derived for each scrambling condition using the temporal response function. Signatures of semantic processing were observed when speech was unscrambled or minimally scrambled and subjects understood the speech. The same markers were absent for higher scrambling levels as speech comprehension dropped. In contrast, word recognition remained high and neural measures related to envelope tracking did not vary significantly across scrambling conditions. This supports the previous claim that electrophysiological indices based on the semantic dissimilarity of words to their context reflect a listener's understanding of those words relative to that context. It also highlights the relative insensitivity of neural measures of low-level speech processing to speech comprehension.
Collapse
Affiliation(s)
- Michael P Broderick
- School of Engineering, Trinity Centre for Biomedical Engineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
| | - Nathaniel J Zuk
- School of Engineering, Trinity Centre for Biomedical Engineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
| | - Andrew J Anderson
- Del Monte Institute for Neuroscience, Department of Neuroscience, Department of Biomedical Engineering, University of Rochester, Rochester, New York, USA
| | - Edmund C Lalor
- School of Engineering, Trinity Centre for Biomedical Engineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland.,Del Monte Institute for Neuroscience, Department of Neuroscience, Department of Biomedical Engineering, University of Rochester, Rochester, New York, USA
| |
Collapse
|
27
|
Shain C, Blank IA, Fedorenko E, Gibson E, Schuler W. Robust Effects of Working Memory Demand during Naturalistic Language Comprehension in Language-Selective Cortex. J Neurosci 2022; 42:7412-7430. [PMID: 36002263 PMCID: PMC9525168 DOI: 10.1523/jneurosci.1894-21.2022] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 07/06/2022] [Accepted: 07/11/2022] [Indexed: 11/21/2022] Open
Abstract
To understand language, we must infer structured meanings from real-time auditory or visual signals. Researchers have long focused on word-by-word structure building in working memory as a mechanism that might enable this feat. However, some have argued that language processing does not typically involve rich word-by-word structure building, and/or that apparent working memory effects are underlyingly driven by surprisal (how predictable a word is in context). Consistent with this alternative, some recent behavioral studies of naturalistic language processing that control for surprisal have not shown clear working memory effects. In this fMRI study, we investigate a range of theory-driven predictors of word-by-word working memory demand during naturalistic language comprehension in humans of both sexes under rigorous surprisal controls. In addition, we address a related debate about whether the working memory mechanisms involved in language comprehension are language specialized or domain general. To do so, in each participant, we functionally localize (1) the language-selective network and (2) the "multiple-demand" network, which supports working memory across domains. Results show robust surprisal-independent effects of memory demand in the language network and no effect of memory demand in the multiple-demand network. Our findings thus support the view that language comprehension involves computationally demanding word-by-word structure building operations in working memory, in addition to any prediction-related mechanisms. Further, these memory operations appear to be primarily conducted by the same neural resources that store linguistic knowledge, with no evidence of involvement of brain regions known to support working memory across domains.SIGNIFICANCE STATEMENT This study uses fMRI to investigate signatures of working memory (WM) demand during naturalistic story listening, using a broad range of theoretically motivated estimates of WM demand. Results support a strong effect of WM demand in the brain that is distinct from effects of word predictability. Further, these WM demands register primarily in language-selective regions, rather than in "multiple-demand" regions that have previously been associated with WM in nonlinguistic domains. Our findings support a core role for WM in incremental language processing, using WM resources that are specialized for language.
Collapse
Affiliation(s)
- Cory Shain
- Massachusetts Institute of Technology, Cambridge, Massachusetts 02478
| | - Idan A Blank
- University of California, Los Angeles, Los Angeles, California 90095
| | - Evelina Fedorenko
- Massachusetts Institute of Technology, Cambridge, Massachusetts 02478
| | - Edward Gibson
- Massachusetts Institute of Technology, Cambridge, Massachusetts 02478
| | | |
Collapse
|
28
|
Lo CW, Tung TY, Ke AH, Brennan JR. Hierarchy, Not Lexical Regularity, Modulates Low-Frequency Neural Synchrony During Language Comprehension. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:538-555. [PMID: 37215342 PMCID: PMC10158645 DOI: 10.1162/nol_a_00077] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Accepted: 06/20/2022] [Indexed: 05/24/2023]
Abstract
Neural responses appear to synchronize with sentence structure. However, researchers have debated whether this response in the delta band (0.5-3 Hz) really reflects hierarchical information or simply lexical regularities. Computational simulations in which sentences are represented simply as sequences of high-dimensional numeric vectors that encode lexical information seem to give rise to power spectra similar to those observed for sentence synchronization, suggesting that sentence-level cortical tracking findings may reflect sequential lexical or part-of-speech information, and not necessarily hierarchical syntactic information. Using electroencephalography (EEG) data and the frequency-tagging paradigm, we develop a novel experimental condition to tease apart the predictions of the lexical and the hierarchical accounts of the attested low-frequency synchronization. Under a lexical model, synchronization should be observed even when words are reversed within their phrases (e.g., "sheep white grass eat" instead of "white sheep eat grass"), because the same lexical items are preserved at the same regular intervals. Critically, such stimuli are not syntactically well-formed; thus a hierarchical model does not predict synchronization of phrase- and sentence-level structure in the reversed phrase condition. Computational simulations confirm these diverging predictions. EEG data from N = 31 native speakers of Mandarin show robust delta synchronization to syntactically well-formed isochronous speech. Importantly, no such pattern is observed for reversed phrases, consistent with the hierarchical, but not the lexical, accounts.
Collapse
Affiliation(s)
- Chia-Wen Lo
- Research Group Language Cycles, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA
| | - Tzu-Yun Tung
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA
| | - Alan Hezao Ke
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA
- Department of Linguistics, Languages and Cultures, Michigan State University, East Lansing, MI, USA
| | | |
Collapse
|
29
|
Doricchi F, Lasaponara S, Pazzaglia M, Silvetti M. Left and right temporal-parietal junctions (TPJs) as "match/mismatch" hedonic machines: A unifying account of TPJ function. Phys Life Rev 2022; 42:56-92. [PMID: 35901654 DOI: 10.1016/j.plrev.2022.07.001] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 07/06/2022] [Indexed: 11/17/2022]
Abstract
Experimental and theoretical studies have tried to gain insights into the involvement of the Temporal Parietal Junction (TPJ) in a broad range of cognitive functions like memory, attention, language, self-agency and theory of mind. Recent investigations have demonstrated the partition of the TPJ in discrete subsectors. Nonetheless, whether these subsectors play different roles or implement an overarching function remains debated. Here, based on a review of available evidence, we propose that the left TPJ codes both matches and mismatches between expected and actual sensory, motor, or cognitive events while the right TPJ codes mismatches. These operations help keeping track of statistical contingencies in personal, environmental, and conceptual space. We show that this hypothesis can account for the participation of the TPJ in disparate cognitive functions, including "humour", and explain: a) the higher incidence of spatial neglect in right brain damage; b) the different emotional reactions that follow left and right brain damage; c) the hemispheric lateralisation of optimistic bias mechanisms; d) the lateralisation of mechanisms that regulate routine and novelty behaviours. We propose that match and mismatch operations are aimed at approximating "free energy", in terms of the free energy principle of decision-making. By approximating "free energy", the match/mismatch TPJ system supports both information seeking to update one's own beliefs and the pleasure of being right in one's own' current choices. This renewed view of the TPJ has relevant clinical implications because the misfunctioning of TPJ-related "match" and "mismatch" circuits in unilateral brain damage can produce low-dimensional deficits of active-inference and predictive coding that can be associated with different neuropsychological disorders.
Collapse
Affiliation(s)
- Fabrizio Doricchi
- Dipartimento di Psicologia 39, Università degli Studi di Roma 'La Sapienza', Roma, Italy; Fondazione Santa Lucia IRCCS, Roma, Italy.
| | - Stefano Lasaponara
- Dipartimento di Psicologia 39, Università degli Studi di Roma 'La Sapienza', Roma, Italy; Fondazione Santa Lucia IRCCS, Roma, Italy
| | - Mariella Pazzaglia
- Dipartimento di Psicologia 39, Università degli Studi di Roma 'La Sapienza', Roma, Italy; Fondazione Santa Lucia IRCCS, Roma, Italy
| | - Massimo Silvetti
- Computational and Translational Neuroscience Lab (CTNLab), Institute of Cognitive Sciences and Technologies, National Research Council (CNR), Rome, Italy
| |
Collapse
|
30
|
De Looze C, Dehsarvi A, Suleyman N, Crosby L, Hernández B, Coen RF, Lawlor BA, Reilly RB. Structural Correlates of Overt Sentence Reading in Mild Cognitive Impairment and Mild-to-Moderate Alzheimer's Disease. Curr Alzheimer Res 2022; 19:606-617. [PMID: 35929622 DOI: 10.2174/1567205019666220805110248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 06/15/2022] [Accepted: 06/22/2022] [Indexed: 01/27/2023]
Abstract
BACKGROUND Overt sentence reading in mild cognitive impairment (MCI) and mild-tomoderate Alzheimer's disease (AD) has been associated with slowness of speech, characterized by a higher number of pauses, shorter speech units and slower speech rate and attributed to reduced working memory/ attention and language capacity. OBJECTIVE This preliminary case-control study investigates whether the temporal organization of speech is associated with the volume of brain regions involved in overt sentence reading and explores the discriminative ability of temporal speech parameters and standard volumetric MRI measures for the classification of MCI and AD. METHODS Individuals with MCI, mild-to-moderate AD, and healthy controls (HC) had a structural MRI scan and read aloud sentences varying in cognitive-linguistic demand (length). The association between speech features and regional brain volumes was examined by linear mixed-effect modeling. Genetic programming was used to explore the discriminative ability of temporal and MRI features. RESULTS Longer sentences, slower speech rate, and a higher number of pauses and shorter interpausal units were associated with reduced volumes of the reading network. Speech-based classifiers performed similarly to the MRI-based classifiers for MCI-HC (67% vs. 68%) and slightly better for AD-HC (80% vs. 64%) and AD-MCI (82% vs. 59%). Adding the speech features to the MRI features slightly improved the performance of MRI-based classification for AD-HC and MCI-HC but not HC-MCI. CONCLUSION The temporal organization of speech in overt sentence reading reflects underlying volume reductions. It may represent a sensitive marker for early assessment of structural changes and cognitive- linguistic deficits associated with healthy aging, MCI, and AD.
Collapse
Affiliation(s)
- Céline De Looze
- Trinity Centre for Biomedical Engineering, School of Engineering, Trinity College Dublin, Dublin, Ireland.,Department of Gerontology, The Irish Longitudinal Study on Aging, Trinity College Dublin, Dublin, Ireland
| | - Amir Dehsarvi
- Trinity Centre for Biomedical Engineering, School of Engineering, Trinity College Dublin, Dublin, Ireland
| | - Narin Suleyman
- Trinity Centre for Biomedical Engineering, School of Engineering, Trinity College Dublin, Dublin, Ireland
| | - Lisa Crosby
- Mercer's Institute for Successful Aging, St James's Hospital, Dublin, Ireland
| | - Belinda Hernández
- Department of Gerontology, The Irish Longitudinal Study on Aging, Trinity College Dublin, Dublin, Ireland
| | - Robert F Coen
- Mercer's Institute for Successful Aging, St James's Hospital, Dublin, Ireland
| | - Brian A Lawlor
- Mercer's Institute for Successful Aging, St James's Hospital, Dublin, Ireland.,Institute of Neuroscience, School of Medicine, Trinity College Dublin, Dublin, Ireland
| | - Richard B Reilly
- Trinity Centre for Biomedical Engineering, School of Engineering, Trinity College Dublin, Dublin, Ireland.,Institute of Neuroscience, School of Medicine, Trinity College Dublin, Dublin, Ireland
| |
Collapse
|
31
|
Dunagan D, Zhang S, Li J, Bhattasali S, Pallier C, Whitman J, Yang Y, Hale J. Neural correlates of semantic number: A cross-linguistic investigation. BRAIN AND LANGUAGE 2022; 229:105110. [PMID: 35367813 DOI: 10.1016/j.bandl.2022.105110] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 03/22/2022] [Accepted: 03/24/2022] [Indexed: 06/14/2023]
Abstract
One aspect of natural language comprehension is understanding how many of what or whom a speaker is referring to. While previous work has documented the neural correlates of number comprehension and quantity comparison, this study investigates semantic number from a cross-linguistic perspective with the goal of identifying cortical regions involved in distinguishing plural from singular nouns. Three fMRI datasets are used in which Chinese, French, and English native speakers listen to an audiobook of a children's story in their native language. These languages are selected because they differ in their number semantics. Across these languages, several well-known language regions manifest a contrast between plural and singular, including the pars orbitalis, pars triangularis, posterior temporal lobe, and dorsomedial prefrontal cortex. This is consistent with a common brain network supporting comprehension across languages with overt as well as covert number-marking.
Collapse
Affiliation(s)
- Donald Dunagan
- Department of Linguistics, University of Georgia, GA, USA.
| | - Shulin Zhang
- Department of Linguistics, University of Georgia, GA, USA
| | - Jixing Li
- Neuroscience of Language Lab, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | | | | | - John Whitman
- Department of Linguistics, Cornell University, NY, USA
| | - Yiming Yang
- Jiangsu Normal University, Xuzhou, Jiangsu, China
| | - John Hale
- Department of Linguistics, University of Georgia, GA, USA
| |
Collapse
|
32
|
Passive Voice Comprehension during Thematic-Role Assignment in Russian-Speaking Children Aged 4-6 Is Reflected in the Sensitivity of ERP to Noun Inflections. Brain Sci 2022; 12:brainsci12060693. [PMID: 35741579 PMCID: PMC9220815 DOI: 10.3390/brainsci12060693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 05/21/2022] [Accepted: 05/24/2022] [Indexed: 01/25/2023] Open
Abstract
Children tend to rely on semantics rather than syntax during sentence comprehension. In transitive sentences, with no reliance on semantics, the syntax-based strategy becomes critical. We aimed to describe developmental changes of brain mechanisms for syntax processing in typically developing (TD) four to six year old’s. A specially designed sentence-picture matching task using active (AV) and passive (PV) voice enforced children to use grammar cues for sentence comprehension. Fifty children with above >60% level of accuracy in PV sentences comprehension demonstrated brain sensitivity to voice grammar markers-inflections of the second noun phrase (NP2), which was expressed in a greater event-related potentials (ERP) amplitude to PV vs. AV sentences in four-, five-, and six-year-old children. The biphasic positive-negative component at 200−400 ms was registered in the frontocentral and bilateral temporoparietal areas. Only in six-year-old children P600 was registered in the right temporoparietal area. LAN-like negativity seems to be a mechanism for distinguishing AV from PV in the early stages of mastering syntax processing of transitive sentences in four to five year old children. Both behavioral and ERP results distinguished six-year-olds from four-year-old’s and five-year-old’s, reflecting the possible transition to the “adult-like” syntax-based thematic role assignment.
Collapse
|
33
|
Riccardi N, Rorden C, Fridriksson J, Desai RH. Canonical Sentence Processing and the Inferior Frontal Cortex: Is There a Connection? NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:318-344. [PMID: 37215558 PMCID: PMC10158581 DOI: 10.1162/nol_a_00067] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 01/21/2022] [Indexed: 05/24/2023]
Abstract
The role of left inferior frontal cortex (LIFC) in canonical sentence comprehension is controversial. Many studies have found involvement of LIFC in sentence production or complex sentence comprehension, but negative or mixed results are often found in comprehension of simple or canonical sentences. We used voxel-, region-, and connectivity-based lesion symptom mapping (VLSM, RLSM, CLSM) in left-hemisphere chronic stroke survivors to investigate canonical sentence comprehension while controlling for lexical-semantic, executive, and phonological processes. We investigated how damage and disrupted white matter connectivity of LIFC and two other language-related regions, the left anterior temporal lobe (LATL) and posterior temporal-inferior parietal area (LpT-iP), affected sentence comprehension. VLSM and RLSM revealed that LIFC damage was not associated with canonical sentence comprehension measured by a sensibility judgment task. LIFC damage was associated instead with impairments in a lexical semantic similarity judgment task with high semantic/executive demands. Damage to the LpT-iP, specifically posterior middle temporal gyrus (pMTG), predicted worse sentence comprehension after controlling for visual lexical access, semantic knowledge, and auditory-verbal short-term memory (STM), but not auditory single-word comprehension, suggesting pMTG is vital for auditory language comprehension. CLSM revealed that disruption of left-lateralized white-matter connections from LIFC to LATL and LpT-iP was associated with worse sentence comprehension, controlling for performance in tasks related to lexical access, auditory word comprehension, and auditory-verbal STM. However, the LIFC connections were accounted for by the lexical semantic similarity judgment task, which had high semantic/executive demands. This suggests that LIFC connectivity is relevant to canonical sentence comprehension when task-related semantic/executive demands are high.
Collapse
Affiliation(s)
- Nicholas Riccardi
- Department of Psychology, University of South Carolina, Columbia, SC
| | - Chris Rorden
- Department of Psychology, University of South Carolina, Columbia, SC
- Institute for Mind and Brain, University of South Carolina, Columbia, SC
| | - Julius Fridriksson
- Institute for Mind and Brain, University of South Carolina, Columbia, SC
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC
| | - Rutvik H. Desai
- Department of Psychology, University of South Carolina, Columbia, SC
- Institute for Mind and Brain, University of South Carolina, Columbia, SC
| |
Collapse
|
34
|
Murphy E, Woolnough O, Rollo PS, Roccaforte ZJ, Segaert K, Hagoort P, Tandon N. Minimal Phrase Composition Revealed by Intracranial Recordings. J Neurosci 2022; 42:3216-3227. [PMID: 35232761 PMCID: PMC8994536 DOI: 10.1523/jneurosci.1575-21.2022] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 01/11/2022] [Accepted: 01/18/2022] [Indexed: 11/21/2022] Open
Abstract
The ability to comprehend phrases is an essential integrative property of the brain. Here, we evaluate the neural processes that enable the transition from single-word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 9 female) implanted with penetrating depth or surface subdural intracranial electrodes, heard auditory recordings of adjective-noun, pseudoword-noun, and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low-frequency power, and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality or phrase structure, but not both. Distinct timings were found for effects of phrase composition (210-300 ms) and pseudoword processing (∼300-700 ms), and these were localized to neighboring electrodes in pSTS. The pars triangularis and temporal pole encoded anticipation of composition in broadband low frequencies, and both regions exhibited greater functional connectivity with pSTS during phrase composition. Our results suggest that the pSTS is a highly specialized region composed of sparsely interwoven heterogeneous constituents that encodes both lower and higher level linguistic features. This hub in pSTS for minimal phrase processing may form the neural basis for the human-specific computational capacity for forming hierarchically organized linguistic structures.SIGNIFICANCE STATEMENT Linguists have claimed that the integration of multiple words into a phrase demands a computational procedure distinct from single-word processing. Here, we provide intracranial recordings from a large patient cohort, with high spatiotemporal resolution, to track the cortical dynamics of phrase composition. Epileptic patients volunteered to participate in a task in which they listened to phrases (red boat), word-pseudoword or pseudoword-word pairs (e.g., red fulg). At the onset of the second word in phrases, greater broadband high gamma activity was found in posterior superior temporal sulcus in electrodes that exclusively indexed phrasal meaning and not lexical meaning. These results provide direct, high-resolution signatures of minimal phrase composition in humans, a potentially species-specific computational capacity.
Collapse
Affiliation(s)
- Elliot Murphy
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Oscar Woolnough
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Patrick S Rollo
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Zachary J Roccaforte
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Katrien Segaert
- School of Psychology and Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, United Kingdom
- Max Planck Institute for Psycholinguistics, Nijmegen, 6525 XD Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, 6525 XD Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, 6525 HR Nijmegen, The Netherlands
| | - Nitin Tandon
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Memorial Hermann Hospital, Texas Medical Center, Houston, Texas 77030
| |
Collapse
|
35
|
Taylor C, Hall S, Manivannan S, Mundil N, Border S. The neuroanatomical consequences and pathological implications of bilingualism. J Anat 2022; 240:410-427. [PMID: 34486112 PMCID: PMC8742975 DOI: 10.1111/joa.13542] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 07/26/2021] [Accepted: 08/23/2021] [Indexed: 01/17/2023] Open
Abstract
In recent years, there has been a rise in the number of people who are able to speak two or more languages. This has been paralleled by an increase in research related to bilingualism. Despite this, much of the neuroanatomical consequences and pathological implications of bilingualism are still subject to discussion. This review aims to evaluate the neuroanatomical structures related to language and to the acquisition of a second language as well as exploring how learning a second language can alter one's susceptibility to and the progression of certain cerebral pathologies. A literature search was conducted on the Medline, Embase, and Web of Science databases. A total of 137 articles regarding the neuroanatomical or pathological implications of bilingualism were included for review. Following analysis of the included papers, this review finds that bilingualism induces significant gray and white matter cerebral changes, particularly in the frontal lobes, anterior cingulate cortex, left inferior parietal lobule and subcortical areas, and that native language and acquired language largely recruit the same neuroanatomical structures with however, subtle functional and anatomical differences dependent on proficiency and age of language acquisition. There is adequate evidence to suggest that bilingualism offsets the symptoms and diagnosis of dementia, and that it is protective against both pathological and age-related cognitive decline. While many of the neuroanatomical changes are known, more remains to be elucidated and the relationship between bilingualism and other neurological pathologies remains unclear.
Collapse
Affiliation(s)
- Charles Taylor
- Centre for Learning Anatomical SciencesFaculty of MedicineUniversity of SouthamptonSouthamptonUK
| | - Samuel Hall
- Centre for Learning Anatomical SciencesFaculty of MedicineUniversity of SouthamptonSouthamptonUK
- Department of NeurosurgeryUniversity Hospitals Southampton NHS Foundation TrustSouthamptonUK
| | - Susruta Manivannan
- Department of NeurosurgeryUniversity Hospitals Southampton NHS Foundation TrustSouthamptonUK
| | - Nilesh Mundil
- Department of NeurosurgeryUniversity Hospitals Southampton NHS Foundation TrustSouthamptonUK
| | - Scott Border
- Centre for Learning Anatomical SciencesFaculty of MedicineUniversity of SouthamptonSouthamptonUK
| |
Collapse
|
36
|
Li R, Mukadam N, Kiran S. Functional MRI evidence for reorganization of language networks after stroke. HANDBOOK OF CLINICAL NEUROLOGY 2022; 185:131-150. [PMID: 35078595 DOI: 10.1016/b978-0-12-823384-9.00007-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
In this chapter, we review fMRI evidence for language reorganization in individuals with poststroke aphasia. Several studies in the current literature have utilized fMRI as a tool to understand patterns of functional reorganization in poststroke aphasia. Consistent with previous models that have been proposed to explain the trajectory of language recovery, differential patterns of language processing and language recovery have been identified across individuals with poststroke aphasia in different stages of recovery. Overall, a global network breakdown typically occurs in the early stages of aphasia recovery, followed by normalization in "traditional" left hemisphere language networks. Depending on individual characteristics, right hemisphere regions and bilateral domain-general regions may be further recruited. The main takeaway of this chapter is that poststroke aphasia recovery does not depend on individual neural regions, but rather involves a complex interaction among regions in larger networks. Many of the unresolved issues and contrastive findings in the literature warrant further research with larger groups of participants and standard protocols of fMRI implementation.
Collapse
Affiliation(s)
- Ran Li
- Department of Speech, Language and Hearing Sciences, Boston University, Boston, MA, United States
| | - Nishaat Mukadam
- Department of Speech, Language and Hearing Sciences, Boston University, Boston, MA, United States
| | - Swathi Kiran
- Department of Speech, Language and Hearing Sciences, Boston University, Boston, MA, United States.
| |
Collapse
|
37
|
Abstract
In the human brain, the temporal-parietal junction (TPJ) is a histologically heterogenous area that includes the ventral portions of the parietal cortex and the caudal superior temporal gyrus sector adjacent to the posterior end of the Sylvian fissure. The anatomical heterogeneity of the TPJ is matched by its seemingly ubiquitous involvement in different cognitive functions that span from memory to language, attention, self-consciousness, and social behavior. In line with established clinical evidence, recent fMRI investigations have confirmed relevant hemispheric differences in the TPJ function. Most importantly, the same investigations have highlighted that, in each hemisphere, different subsectors of the TPJ are putatively involved in different cognitive functions. Here I review empirical evidence and theoretical proposals that were recently advanced to gain a unifying interpretation of TPJ function(s). In the final part of the review, a new overarching interpretation of the TPJ function is proposed. Current advances in cognitive neuroscience can provide important insights that help improve the clinical understanding of cognitive deficits experienced by patients with lesions centered in or involving the TPJ area.
Collapse
Affiliation(s)
- Fabrizio Doricchi
- Department of Psychology, "La Sapienza" University, Rome, Italy; Laboratory of Neuropsychology of Attention, I.R.C.C.S. Santa Lucia Foundation, Rome, Italy.
| |
Collapse
|
38
|
Functional differentiation in the language network revealed by lesion-symptom mapping. Neuroimage 2021; 247:118778. [PMID: 34896587 PMCID: PMC8830186 DOI: 10.1016/j.neuroimage.2021.118778] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2021] [Revised: 11/17/2021] [Accepted: 12/02/2021] [Indexed: 12/18/2022] Open
Abstract
Theories of language organization in the brain commonly posit that different regions underlie distinct linguistic mechanisms. However, such theories have been criticized on the grounds that many neuroimaging studies of language processing find similar effects across regions. Moreover, condition by region interaction effects, which provide the strongest evidence of functional differentiation between regions, have rarely been offered in support of these theories. Here we address this by using lesion-symptom mapping in three large, partially-overlapping groups of aphasia patients with left hemisphere brain damage due to stroke (N = 121, N = 92, N = 218). We identified multiple measure by region interaction effects, associating damage to the posterior middle temporal gyrus with syntactic comprehension deficits, damage to posterior inferior frontal gyrus with expressive agrammatism, and damage to inferior angular gyrus with semantic category word fluency deficits. Our results are inconsistent with recent hypotheses that regions of the language network are undifferentiated with respect to high-level linguistic processing.
Collapse
|
39
|
Nastase SA, Liu YF, Hillman H, Zadbood A, Hasenfratz L, Keshavarzian N, Chen J, Honey CJ, Yeshurun Y, Regev M, Nguyen M, Chang CHC, Baldassano C, Lositsky O, Simony E, Chow MA, Leong YC, Brooks PP, Micciche E, Choe G, Goldstein A, Vanderwal T, Halchenko YO, Norman KA, Hasson U. The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension. Sci Data 2021; 8:250. [PMID: 34584100 PMCID: PMC8479122 DOI: 10.1038/s41597-021-01033-3] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 08/18/2021] [Indexed: 02/08/2023] Open
Abstract
The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.
Collapse
Affiliation(s)
- Samuel A Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA.
| | - Yun-Fei Liu
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Hanna Hillman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Neggin Keshavarzian
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Janice Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Christopher J Honey
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Yaara Yeshurun
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
| | - Mor Regev
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Mai Nguyen
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Claire H C Chang
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | | | - Olga Lositsky
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, USA
| | - Erez Simony
- Faculty of Electrical Engineering, Holon Institute of Technology, Holon, Israel
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | | | - Yuan Chang Leong
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| | - Paula P Brooks
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Emily Micciche
- Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Gina Choe
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Tamara Vanderwal
- Department of Psychiatry, University of British Columbia, and BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Yaroslav O Halchenko
- Department of Psychological and Brain Sciences and Department of Computer Science, Dartmouth College, Hanover, NH, USA
| | - Kenneth A Norman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
40
|
|
41
|
Asyraff A, Lemarchand R, Tamm A, Hoffman P. Stimulus-independent neural coding of event semantics: Evidence from cross-sentence fMRI decoding. Neuroimage 2021; 236:118073. [PMID: 33878380 PMCID: PMC8270886 DOI: 10.1016/j.neuroimage.2021.118073] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Revised: 04/06/2021] [Accepted: 04/11/2021] [Indexed: 11/25/2022] Open
Abstract
Multivariate neuroimaging studies indicate that the brain represents word and object concepts in a format that readily generalises across stimuli. Here we investigated whether this was true for neural representations of simple events described using sentences. Participants viewed sentences describing four events in different ways. Multivariate classifiers were trained to discriminate the four events using a subset of sentences, allowing us to test generalisation to novel sentences. We found that neural patterns in a left-lateralised network of frontal, temporal and parietal regions discriminated events in a way that generalised successfully over changes in the syntactic and lexical properties of the sentences used to describe them. In contrast, decoding in visual areas was sentence-specific and failed to generalise to novel sentences. In the reverse analysis, we tested for decoding of syntactic and lexical structure, independent of the event being described. Regions displaying this coding were limited and largely fell outside the canonical semantic network. Our results indicate that a distributed neural network represents the meaning of event sentences in a way that is robust to changes in their structure and form. They suggest that the semantic system disregards the surface properties of stimuli in order to represent their underlying conceptual significance.
Collapse
Affiliation(s)
- Aliff Asyraff
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK
| | - Rafael Lemarchand
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK
| | - Andres Tamm
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK
| | - Paul Hoffman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh, EH8 9JZ, UK.
| |
Collapse
|
42
|
Wehbe L, Blank IA, Shain C, Futrell R, Levy R, von der Malsburg T, Smith N, Gibson E, Fedorenko E. Incremental Language Comprehension Difficulty Predicts Activity in the Language Network but Not the Multiple Demand Network. Cereb Cortex 2021. [PMID: 33895807 DOI: 10.1101/2020.04.15.043844] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/11/2023] Open
Abstract
What role do domain-general executive functions play in human language comprehension? To address this question, we examine the relationship between behavioral measures of comprehension and neural activity in the domain-general "multiple demand" (MD) network, which has been linked to constructs like attention, working memory, inhibitory control, and selection, and implicated in diverse goal-directed behaviors. Specifically, functional magnetic resonance imaging data collected during naturalistic story listening are compared with theory-neutral measures of online comprehension difficulty and incremental processing load (reading times and eye-fixation durations). Critically, to ensure that variance in these measures is driven by features of the linguistic stimulus rather than reflecting participant- or trial-level variability, the neuroimaging and behavioral datasets were collected in nonoverlapping samples. We find no behavioral-neural link in functionally localized MD regions; instead, this link is found in the domain-specific, fronto-temporal "core language network," in both left-hemispheric areas and their right hemispheric homotopic areas. These results argue against strong involvement of domain-general executive circuits in language comprehension.
Collapse
Affiliation(s)
- Leila Wehbe
- Carnegie Mellon University, Machine Learning Department PA 15213, USA
| | - Idan Asher Blank
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
- University of California Los Angeles, Department of Psychology CA 90095, USA
| | - Cory Shain
- Ohio State University, Department of Linguistics OH 43210, USA
| | - Richard Futrell
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
- University of California Irvine, Department of Linguistics CA 92697, USA
| | - Roger Levy
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
- University of California San Diego, Department of Linguistics CA 92161, USA
| | - Titus von der Malsburg
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
- University of Stuttgart, Institute of Linguistics, 70049 Stuttgart, Germany
| | - Nathaniel Smith
- University of California San Diego, Department of Linguistics CA 92161, USA
| | - Edward Gibson
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
| | - Evelina Fedorenko
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
- Massachusetts Institute of Technology, McGovern Institute for Brain ResearchMA 02139, USA
| |
Collapse
|
43
|
Wehbe L, Blank IA, Shain C, Futrell R, Levy R, von der Malsburg T, Smith N, Gibson E, Fedorenko E. Incremental Language Comprehension Difficulty Predicts Activity in the Language Network but Not the Multiple Demand Network. Cereb Cortex 2021; 31:4006-4023. [PMID: 33895807 DOI: 10.1093/cercor/bhab065] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 01/15/2021] [Accepted: 02/21/2021] [Indexed: 12/28/2022] Open
Abstract
What role do domain-general executive functions play in human language comprehension? To address this question, we examine the relationship between behavioral measures of comprehension and neural activity in the domain-general "multiple demand" (MD) network, which has been linked to constructs like attention, working memory, inhibitory control, and selection, and implicated in diverse goal-directed behaviors. Specifically, functional magnetic resonance imaging data collected during naturalistic story listening are compared with theory-neutral measures of online comprehension difficulty and incremental processing load (reading times and eye-fixation durations). Critically, to ensure that variance in these measures is driven by features of the linguistic stimulus rather than reflecting participant- or trial-level variability, the neuroimaging and behavioral datasets were collected in nonoverlapping samples. We find no behavioral-neural link in functionally localized MD regions; instead, this link is found in the domain-specific, fronto-temporal "core language network," in both left-hemispheric areas and their right hemispheric homotopic areas. These results argue against strong involvement of domain-general executive circuits in language comprehension.
Collapse
Affiliation(s)
- Leila Wehbe
- Carnegie Mellon University, Machine Learning Department PA 15213, USA
| | - Idan Asher Blank
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA.,University of California Los Angeles, Department of Psychology CA 90095, USA
| | - Cory Shain
- Ohio State University, Department of Linguistics OH 43210, USA
| | - Richard Futrell
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA.,University of California Irvine, Department of Linguistics CA 92697, USA
| | - Roger Levy
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA.,University of California San Diego, Department of Linguistics CA 92161, USA
| | - Titus von der Malsburg
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA.,University of Stuttgart, Institute of Linguistics, 70049 Stuttgart, Germany
| | - Nathaniel Smith
- University of California San Diego, Department of Linguistics CA 92161, USA
| | - Edward Gibson
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA
| | - Evelina Fedorenko
- Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences MA 02139, USA.,Massachusetts Institute of Technology, McGovern Institute for Brain ResearchMA 02139, USA
| |
Collapse
|
44
|
Zhang G, Xu Y, Zhang M, Wang S, Lin N. The brain network in support of social semantic accumulation. Soc Cogn Affect Neurosci 2021; 16:393-405. [PMID: 33433627 PMCID: PMC7990071 DOI: 10.1093/scan/nsab003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 12/07/2020] [Accepted: 01/11/2021] [Indexed: 11/14/2022] Open
Abstract
Some studies have indicated that a specific 'social semantic network' represents the social meanings of words. However, studies of the comprehension of complex materials, such as sentences and narratives, have indicated that the same network supports the online accumulation of connected semantic information. In this study, we examined the hypothesis that this network does not simply represent the social meanings of words but also accumulates connected social meanings from texts. We defined the social semantic network by conducting a meta-analysis of previous studies on social semantic processing and then examined the effects of social semantic accumulation using a functional Magnetic Resonance Imaging (fMRI) experiment. Two important findings were obtained. First, the social semantic network showed a stronger social semantic effect in sentence and narrative reading than in word list reading, indicating the amplitude of social semantic activation can be accumulated in the network. Second, the activation of the social semantic network in sentence and narrative reading can be better explained by the holistic social-semantic-richness rating scores of the stimuli than by those of the constitutive words, indicating the social semantic contents can be integrated in the network. These two findings convergently indicate that the social semantic network supports the accumulation of connected social meanings.
Collapse
Affiliation(s)
- Guangyao Zhang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing 100101, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yangwen Xu
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento 38123, Italy.,International School for Advanced Studies (SISSA), Trieste 34136, Italy
| | - Meimei Zhang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing 100101, China
| | - Shaonan Wang
- National Laboratory of Pattern Recognition, CASIA, Beijing 100190, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Nan Lin
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing 100101, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
45
|
Vansteensel MJ, Selten IS, Charbonnier L, Berezutskaya J, Raemaekers MAH, Ramsey NF, Wijnen F. Reduced brain activation during spoken language processing in children with developmental language disorder and children with 22q11.2 deletion syndrome. Neuropsychologia 2021; 158:107907. [PMID: 34058175 DOI: 10.1016/j.neuropsychologia.2021.107907] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 05/19/2021] [Accepted: 05/19/2021] [Indexed: 01/03/2023]
Abstract
Language difficulties of children with Developmental Language Disorder (DLD) have been associated with multiple underlying factors and are still poorly understood. One way of investigating the mechanisms of DLD language problems is to compare language-related brain activation patterns of children with DLD to those of a population with similar language difficulties and a uniform etiology. Children with 22q11.2 deletion syndrome (22q11DS) constitute such a population. Here, we conducted an fMRI study, in which children (6-10yo) with DLD and 22q11DS listened to speech alternated with reversed speech. We compared language laterality and language-related brain activation levels with those of typically developing (TD) children who performed the same task. The data revealed no significant differences between groups in language lateralization, but task-related activation levels were lower in children with language impairment than in TD children in several nodes of the language network. We conclude that language impairment in children with DLD and in children with 22q11DS may involve (partially) overlapping cortical areas.
Collapse
Affiliation(s)
- Mariska J Vansteensel
- UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands.
| | - Iris S Selten
- Utrecht Institute of Linguistics (UIL-OTS), Utrecht University, Utrecht, the Netherlands
| | - Lisette Charbonnier
- UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Julia Berezutskaya
- UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Mathijs A H Raemaekers
- UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Nick F Ramsey
- UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Frank Wijnen
- Utrecht Institute of Linguistics (UIL-OTS), Utrecht University, Utrecht, the Netherlands
| |
Collapse
|
46
|
Har-shai Yahav P, Zion Golumbic E. Linguistic processing of task-irrelevant speech at a cocktail party. eLife 2021; 10:e65096. [PMID: 33942722 PMCID: PMC8163500 DOI: 10.7554/elife.65096] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Accepted: 04/26/2021] [Indexed: 01/05/2023] Open
Abstract
Paying attention to one speaker in a noisy place can be extremely difficult, because to-be-attended and task-irrelevant speech compete for processing resources. We tested whether this competition is restricted to acoustic-phonetic interference or if it extends to competition for linguistic processing as well. Neural activity was recorded using Magnetoencephalography as human participants were instructed to attend to natural speech presented to one ear, and task-irrelevant stimuli were presented to the other. Task-irrelevant stimuli consisted either of random sequences of syllables, or syllables structured to form coherent sentences, using hierarchical frequency-tagging. We find that the phrasal structure of structured task-irrelevant stimuli was represented in the neural response in left inferior frontal and posterior parietal regions, indicating that selective attention does not fully eliminate linguistic processing of task-irrelevant speech. Additionally, neural tracking of to-be-attended speech in left inferior frontal regions was enhanced when competing with structured task-irrelevant stimuli, suggesting inherent competition between them for linguistic processing.
Collapse
Affiliation(s)
- Paz Har-shai Yahav
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan UniversityRamat GanIsrael
| | - Elana Zion Golumbic
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan UniversityRamat GanIsrael
| |
Collapse
|
47
|
Graessner A, Zaccarella E, Friederici AD, Obrig H, Hartwigsen G. Dissociable contributions of frontal and temporal brain regions to basic semantic composition. Brain Commun 2021; 3:fcab090. [PMID: 34159319 PMCID: PMC8212833 DOI: 10.1093/braincomms/fcab090] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Revised: 03/16/2021] [Accepted: 04/08/2021] [Indexed: 11/26/2022] Open
Abstract
Semantic composition is the ability to combine single words to form complex meanings and is an essential component for successful communication. Evidence from neuroimaging studies suggests that semantic composition engages a widely distributed left-hemispheric network, including the anterior temporal lobe, the inferior frontal gyrus and the angular gyrus. To date, the functional relevance of these regions remains unclear. Here, we investigate the impact of lesions to key regions in the semantic network on basic semantic composition. We conducted a multivariate lesion-behaviour mapping study in 36 native German speaking participants with chronic lesions to the language network after left-hemispheric stroke. During the experiment, participants performed a plausibility judgement task on auditorily presented adjective-noun phrases that were either meaningful (‘anxious horse’), anomalous (‘anxious salad’) or had the noun replaced by a pseudoword (‘anxious gufel’), as well as a single-word control condition (‘horse’). We observed that reduced accuracy for anomalous phrases is associated with lesions in left anterior inferior frontal gyrus, whereas increased reaction times for anomalous phrases correlates with lesions in anterior-to-mid temporal lobe. These results indicate that anterior inferior frontal gyrus is relevant for accurate semantic decisions, while anterior-to-mid temporal lobe lesions lead to slowing of the decision for anomalous two-word phrases. These differential effects of lesion location support the notion that anterior inferior frontal gyrus affords executive control for decisions on semantic composition while anterior-to-mid temporal lobe lesions slow the semantic processing of the individual constituents of the phrase.
Collapse
Affiliation(s)
- Astrid Graessner
- Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany.,Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Angela D Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Hellmuth Obrig
- Clinic for Cognitive Neurology, University Leipzig, 04103 Leipzig, Germany.,Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Gesa Hartwigsen
- Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany.,Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| |
Collapse
|
48
|
Burton H, Reeder RM, Holden T, Agato A, Firszt JB. Cortical Regions Activated by Spectrally Degraded Speech in Adults With Single Sided Deafness or Bilateral Normal Hearing. Front Neurosci 2021; 15:618326. [PMID: 33897343 PMCID: PMC8058229 DOI: 10.3389/fnins.2021.618326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Accepted: 03/04/2021] [Indexed: 11/13/2022] Open
Abstract
Those with profound sensorineural hearing loss from single sided deafness (SSD) generally experience greater cognitive effort and fatigue in adverse sound environments. We studied cases with right ear, SSD compared to normal hearing (NH) individuals. SSD cases were significantly less correct in naming last words in spectrally degraded 8- and 16-band vocoded sentences, despite high semantic predictability. Group differences were not significant for less intelligible 4-band sentences, irrespective of predictability. SSD also had diminished BOLD percent signal changes to these same sentences in left hemisphere (LH) cortical regions of early auditory, association auditory, inferior frontal, premotor, inferior parietal, dorsolateral prefrontal, posterior cingulate, temporal-parietal-occipital junction, and posterior opercular. Cortical regions with lower amplitude responses in SSD than NH were mostly components of a LH language network, previously noted as concerned with speech recognition. Recorded BOLD signal magnitudes were averages from all vertices within predefined parcels from these cortex regions. Parcels from different regions in SSD showed significantly larger signal magnitudes to sentences of greater intelligibility (e.g., 8- or 16- vs. 4-band) in all except early auditory and posterior cingulate cortex. Significantly lower response magnitudes occurred in SSD than NH in regions prior studies found responsible for phonetics and phonology of speech, cognitive extraction of meaning, controlled retrieval of word meaning, and semantics. The findings suggested reduced activation of a LH fronto-temporo-parietal network in SSD contributed to difficulty processing speech for word meaning and sentence semantics. Effortful listening experienced by SSD might reflect diminished activation to degraded speech in the affected LH language network parcels. SSD showed no compensatory activity in matched right hemisphere parcels.
Collapse
Affiliation(s)
- Harold Burton
- Department of Neuroscience, Washington University School of Medicine, Saint Louis, MO, United States
| | - Ruth M Reeder
- Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine, Saint Louis, MO, United States
| | - Tim Holden
- Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine, Saint Louis, MO, United States
| | - Alvin Agato
- Department of Neuroscience, Washington University School of Medicine, Saint Louis, MO, United States
| | - Jill B Firszt
- Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine, Saint Louis, MO, United States
| |
Collapse
|
49
|
Matar S, Dirani J, Marantz A, Pylkkänen L. Left posterior temporal cortex is sensitive to syntax within conceptually matched Arabic expressions. Sci Rep 2021; 11:7181. [PMID: 33785801 PMCID: PMC8010046 DOI: 10.1038/s41598-021-86474-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Accepted: 03/08/2021] [Indexed: 11/17/2022] Open
Abstract
During language comprehension, the brain processes not only word meanings, but also the grammatical structure-the "syntax"-that strings words into phrases and sentences. Yet the neural basis of syntax remains contentious, partly due to the elusiveness of experimental designs that vary structure independently of meaning-related variables. Here, we exploit Arabic's grammatical properties, which enable such a design. We collected magnetoencephalography (MEG) data while participants read the same noun-adjective expressions with zero, one, or two contiguously-written definite articles (e.g., 'chair purple'; 'the-chair purple'; 'the-chair the-purple'), representing equivalent concepts, but with different levels of syntactic complexity (respectively, indefinite phrases: 'a purple chair'; sentences: 'The chair is purple.'; definite phrases: 'the purple chair'). We expected regions processing syntax to respond differently to simple versus complex structures. Single-word controls ('chair'/'purple') addressed definiteness-based accounts. In noun-adjective expressions, syntactic complexity only modulated activity in the left posterior temporal lobe (LPTL), ~ 300 ms after each word's onset: indefinite phrases induced more MEG-measured positive activity. The effects disappeared in single-word tokens, ruling out non-syntactic interpretations. In contrast, left anterior temporal lobe (LATL) activation was driven by meaning. Overall, the results support models implicating the LPTL in structure building and the LATL in early stages of conceptual combination.
Collapse
Affiliation(s)
- Suhail Matar
- Department of Psychology, New York University, New York, NY, USA.
| | - Julien Dirani
- Department of Psychology, New York University, New York, NY, USA
- NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, UAE
| | - Alec Marantz
- Department of Psychology, New York University, New York, NY, USA
- Department of Linguistics, New York University, New York, NY, USA
- NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, UAE
| | - Liina Pylkkänen
- Department of Psychology, New York University, New York, NY, USA
- Department of Linguistics, New York University, New York, NY, USA
- NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, UAE
| |
Collapse
|
50
|
Law R, Pylkkänen L. Lists with and without Syntax: A New Approach to Measuring the Neural Processing of Syntax. J Neurosci 2021; 41:2186-2196. [PMID: 33500276 PMCID: PMC8018759 DOI: 10.1523/jneurosci.1179-20.2021] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 01/11/2021] [Accepted: 01/13/2021] [Indexed: 01/06/2023] Open
Abstract
In the neurobiology of syntax, a methodological challenge is to vary syntax while holding semantics constant. Changes in syntactic structure usually correlate with changes in meaning. We approached this challenge from a new angle. We deployed word lists-typically, the unstructured control in studies of syntax-as both test and control stimuli. Three-noun lists ("lamps, dolls, guitars") were embedded in sentences ("The eccentric man hoarded lamps, dolls, guitars…") and in longer lists ("forks, pen, toilet, rodeo, lamps, dolls, guitars…"). This allowed us to minimize contributions from lexical semantics and local phrasal combinatorics: the same words occurred in both conditions, and in neither case did the list items locally compose into phrases (e.g., "lamps" and "dolls" do not form a phrase). Crucially, the list partakes in a syntactic tree in one case but not the other. Lists-in-sentences increased source-localized MEG activity at ∼250-300 ms from each of the list item onsets in the left inferior frontal cortex, at ∼300-350 ms in the left anterior temporal lobe and, most reliably, at ∼330-400 ms in left posterior temporal cortex. In contrast, the main effects of semantic association strength, which we also varied, localized in the left temporoparietal cortex, with high associations increasing activity at ∼400 ms. This dissociation offers a novel characterization of the structure versus word meaning contrast in the brain: the frontotemporal network that is familiar from studies of sentence processing can be driven by the sheer presence of global sentence structure, while associative semantics has a more posterior neural signature.SIGNIFICANCE STATEMENT Human languages all have a syntax, which both enables the infinitude of linguistic creativity and determines what is grammatical in a language. The neurobiology of syntactic processing has, however, been challenging to characterize despite decades of study. One reason is pure manipulations of syntax are difficult to design. The approach here offers a novel control of two variables that are notoriously hard to keep constant when syntax is manipulated: word meaning and phrasal combinatorics. The same noun lists occurred inside longer lists and sentences, while semantic associations also varied. Our MEG results show that classic frontotemporal language regions can be driven by sentence structure even when local semantic contributions are absent. In contrast, the left temporoparietal junction tracks associative relationships.
Collapse
Affiliation(s)
- Ryan Law
- NYUAD Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Liina Pylkkänen
- NYUAD Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- Department of Psychology, New York University, New York, New York 10003
- Department of Linguistics, New York University, New York, New York 10003
| |
Collapse
|