1
|
Čeko M, Hirshfield L, Doherty E, Southwell R, D'Mello SK. Cortical cognitive processing during reading captured using functional-near infrared spectroscopy. Sci Rep 2024; 14:19483. [PMID: 39174562 PMCID: PMC11341567 DOI: 10.1038/s41598-024-69630-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 08/07/2024] [Indexed: 08/24/2024] Open
Abstract
Neuroimaging studies using functional magnetic resonance imaging (fMRI) have provided unparalleled insights into the fundamental neural mechanisms underlying human cognitive processing, such as high-level linguistic processes during reading. Here, we build upon this prior work to capture sentence reading comprehension outside the MRI scanner using functional near infra-red spectroscopy (fNIRS) in a large sample of participants (n = 82). We observed increased task-related hemodynamic responses in prefrontal and temporal cortical regions during sentence-level reading relative to the control condition (a list of non-words), replicating prior fMRI work on cortical recruitment associated with high-level linguistic processing during reading comprehension. These results lay the groundwork towards developing adaptive systems to support novice readers and language learners by targeting the underlying cognitive processes. This work also contributes to bridging the gap between laboratory findings and more real-world applications in the realm of cognitive neuroscience.
Collapse
Affiliation(s)
- Marta Čeko
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA.
| | - Leanne Hirshfield
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA.
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA.
| | - Emily Doherty
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| | - Rosy Southwell
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA
| | - Sidney K D'Mello
- Institute of Cognitive Science, University of Colorado Boulder, 1777 Exposition Drive, Boulder, CO, 80305, USA
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| |
Collapse
|
2
|
Fernandino L, Binder JR. How does the "default mode" network contribute to semantic cognition? BRAIN AND LANGUAGE 2024; 252:105405. [PMID: 38579461 PMCID: PMC11135161 DOI: 10.1016/j.bandl.2024.105405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Revised: 02/26/2024] [Accepted: 03/23/2024] [Indexed: 04/07/2024]
Abstract
This review examines whether and how the "default mode" network (DMN) contributes to semantic processing. We review evidence implicating the DMN in the processing of individual word meanings and in sentence- and discourse-level semantics. Next, we argue that the areas comprising the DMN contribute to semantic processing by coordinating and integrating the simultaneous activity of local neuronal ensembles across multiple unimodal and multimodal cortical regions, creating a transient, global neuronal ensemble. The resulting ensemble implements an integrated simulation of phenomenological experience - that is, an embodied situation model - constructed from various modalities of experiential memory traces. These situation models, we argue, are necessary not only for semantic processing but also for aspects of cognition that are not traditionally considered semantic. Although many aspects of this proposal remain provisional, we believe it provides new insights into the relationships between semantic and non-semantic cognition and into the functions of the DMN.
Collapse
Affiliation(s)
- Leonardo Fernandino
- Department of Neurology, Medical College of Wisconsin, USA; Department of Biomedical Engineering, Medical College of Wisconsin, USA.
| | - Jeffrey R Binder
- Department of Neurology, Medical College of Wisconsin, USA; Department of Biophysics, Medical College of Wisconsin, USA
| |
Collapse
|
3
|
Keller TA, Mason RA, Legg AE, Just MA. The neural and cognitive basis of expository text comprehension. NPJ SCIENCE OF LEARNING 2024; 9:21. [PMID: 38514702 PMCID: PMC10957871 DOI: 10.1038/s41539-024-00232-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 02/26/2024] [Indexed: 03/23/2024]
Abstract
As science and technology rapidly progress, it becomes increasingly important to understand how individuals comprehend expository technical texts that explain these advances. This study examined differences in individual readers' technical comprehension performance and differences among texts, using functional brain imaging to measure regional brain activity while students read passages on technical topics and then took a comprehension test. Better comprehension of the technical passages was related to higher activation in regions of the left inferior frontal gyrus, left superior parietal lobe, bilateral dorsolateral prefrontal cortex, and bilateral hippocampus. These areas are associated with the construction of a mental model of the passage and with the integration of new and prior knowledge in memory. Poorer comprehension of the passages was related to greater activation of the ventromedial prefrontal cortex and the precuneus, areas involved in autobiographical and episodic memory retrieval. More comprehensible passages elicited more brain activation associated with establishing links among different types of information in the text and activation associated with establishing conceptual coherence within the text representation. These findings converge with previous behavioral research in their implications for teaching technical learners to become better comprehenders and for improving the structure of instructional texts, to facilitate scientific and technological comprehension.
Collapse
Affiliation(s)
- Timothy A Keller
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA.
| | - Robert A Mason
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Aliza E Legg
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Marcel Adam Just
- Center for Cognitive Brain Imaging, Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| |
Collapse
|
4
|
Wat EK, Jangraw DC, Finn ES, Bandettini PA, Preston JL, Landi N, Hoeft F, Frost SJ, Lau A, Chen G, Pugh KR, Molfese PJ. Will you read how I will read? Naturalistic fMRI predictors of emergent reading. Neuropsychologia 2024; 193:108763. [PMID: 38141965 PMCID: PMC11370251 DOI: 10.1016/j.neuropsychologia.2023.108763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 10/07/2023] [Accepted: 12/16/2023] [Indexed: 12/25/2023]
Abstract
Despite reading being an essential and almost universal skill in the developed world, reading proficiency varies substantially from person to person. To study why, the fMRI field is beginning to turn from single-word or nonword reading tasks to naturalistic stimuli like connected text and listening to stories. To study reading development in children just beginning to read, listening to stories is an appropriate paradigm because speech perception and phonological processing are important for, and are predictors of, reading proficiency. Our study examined the relationship between behavioral reading-related skills and the neural response to listening to stories in the fMRI environment. Functional MRI were gathered in a 3T TIM-Trio scanner. During the fMRI scan, children aged approximately 7 years listened to professionally narrated common short stories and answered comprehension questions following the narration. Analyses of the data used inter-subject correlation (ISC), and representational similarity analysis (RSA). Our primary finding is that ISC reveals areas of increased synchrony in both high- and low-performing emergent readers previously implicated in reading ability/disability. Of particular interest are that several previously identified brain regions (medial temporal gyrus (MTG), inferior frontal gyrus (IFG), inferior temporal gyrus (ITG)) were found to "synchronize" across higher reading ability participants, while lower reading ability participants had idiosyncratic activation patterns in these regions. Additionally, two regions (superior frontal gyrus (SFG) and another portion of ITG) were recruited by all participants, but their specific timecourse of activation depended on reading performance. These analyses support the idea that different brain regions involved in reading follow different developmental trajectories that correlate with reading proficiency on a spectrum rather than the usual dichotomy of poor readers versus strong readers.
Collapse
Affiliation(s)
| | - David C Jangraw
- Department of Electrical and Biomedical Engineering, University of Vermont, Burlington, VT, USA
| | - Emily S Finn
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Peter A Bandettini
- Section on Functional Imaging Methods, NIMH, Bethesda, MD, USA; Center for Multimodal Neuroimaging, NIMH, Bethesda, MD, USA
| | - Jonathan L Preston
- Haskins Laboratories, New Haven, CT, USA; Syracuse University, Syracuse, NY, USA
| | - Nicole Landi
- Haskins Laboratories, New Haven, CT, USA; Department of Psychological Sciences, University of Connecticut, USA
| | - Fumiko Hoeft
- Haskins Laboratories, New Haven, CT, USA; Department of Psychological Sciences, University of Connecticut, USA
| | | | - Airey Lau
- Haskins Laboratories, New Haven, CT, USA
| | - Gang Chen
- Statistical Computing Core, NIMH, Bethesda, MD, USA
| | - Kenneth R Pugh
- Haskins Laboratories, New Haven, CT, USA; Department of Psychological Sciences, University of Connecticut, USA; Department of Linguistics, Yale University School of Medicine, New Haven, CT, USA
| | - Peter J Molfese
- Center for Multimodal Neuroimaging, NIMH, Bethesda, MD, USA; Haskins Laboratories, New Haven, CT, USA.
| |
Collapse
|
5
|
Thye M, Hoffman P, Mirman D. The words that little by little revealed everything: Neural response to lexical-semantic content during narrative comprehension. Neuroimage 2023; 276:120204. [PMID: 37257674 DOI: 10.1016/j.neuroimage.2023.120204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 04/19/2023] [Accepted: 05/27/2023] [Indexed: 06/02/2023] Open
Abstract
The ease with which narratives are understood belies the complexity of the information being conveyed and the cognitive processes that support comprehension. The meanings of the words must be rapidly accessed and integrated with the reader's mental representation of the overarching, unfolding scenario. A broad, bilateral brain network is engaged by this process, but it is not clear how words that vary on specific semantic dimensions, such as ambiguity, emotion, or socialness, engage the semantic, semantic control, or social cognition systems. In the present study, data from 48 participants who listened to The Little Prince audiobook during MRI scanning were selected from the Le Petit Prince dataset. The lexical and semantic content within the narrative was quantified from the transcript words with factor scores capturing Word Length, Semantic Flexibility, Emotional Strength, and Social Impact. These scores, along with word quantity variables, were used to investigate where these predictors co-vary with activation across the brain. In contrast to studies of isolated word processing, large networks were found to co-vary with the lexical and semantic content within the narrative. An increase in semantic content engaged the ventral portion of ventrolateral ATL, consistent with its role as a semantic hub. Decreased semantic content engaged temporal pole and inferior parietal lobule, which may reflect semantic integration. The semantic control network was engaged by words with low Semantic Flexibility, perhaps due to the demand required to process infrequent, less semantically diverse language. Activation in ATL co-varied with an increase in Social Impact, which is consistent with the claim that social knowledge is housed within the neural architecture of the semantic system. These results suggest that current models of language processing may present an impoverished estimate of the neural systems that coordinate to support narrative comprehension, and, by extension, real-world language processing.
Collapse
Affiliation(s)
- Melissa Thye
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom.
| | - Paul Hoffman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| | - Daniel Mirman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| |
Collapse
|
6
|
Hauptman M, Blank I, Fedorenko E. Non-literal language processing is jointly supported by the language and theory of mind networks: Evidence from a novel meta-analytic fMRI approach. Cortex 2023; 162:96-114. [PMID: 37023480 PMCID: PMC10210011 DOI: 10.1016/j.cortex.2023.01.013] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 11/08/2022] [Accepted: 01/11/2023] [Indexed: 03/12/2023]
Abstract
Going beyond the literal meaning of language is key to communicative success. However, the mechanisms that support non-literal inferences remain debated. Using a novel meta-analytic approach, we evaluate the contribution of linguistic, social-cognitive, and executive mechanisms to non-literal interpretation. We identified 74 fMRI experiments (n = 1,430 participants) from 2001 to 2021 that contrasted non-literal language comprehension with a literal control condition, spanning ten phenomena (e.g., metaphor, irony, indirect speech). Applying the activation likelihood estimation approach to the 825 activation peaks yielded six left-lateralized clusters. We then evaluated the locations of both the individual-study peaks and the clusters against probabilistic functional atlases (cf. anatomical locations, as is typically done) for three candidate brain networks-the language-selective network (Fedorenko, Behr, & Kanwisher, 2011), which supports language processing, the Theory of Mind (ToM) network (Saxe & Kanwisher, 2003), which supports social inferences, and the domain-general Multiple-Demand (MD) network (Duncan, 2010), which supports executive control. These atlases were created by overlaying individual activation maps of participants who performed robust and extensively validated 'localizer' tasks that selectively target each network in question (n = 806 for language; n = 198 for ToM; n = 691 for MD). We found that both the individual-study peaks and the ALE clusters fell primarily within the language network and the ToM network. These results suggest that non-literal processing is supported by both i) mechanisms that process literal linguistic meaning, and ii) mechanisms that support general social inference. They thus undermine a strong divide between literal and non-literal aspects of language and challenge the claim that non-literal processing requires additional executive resources.
Collapse
Affiliation(s)
- Miriam Hauptman
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Department of Psychological & Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA.
| | - Idan Blank
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Department of Psychology, UCLA, Los Angeles, CA 90095, USA; Department of Linguistics, UCLA, Los Angeles, CA 90095, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Program in Speech and Hearing in Bioscience and Technology, Harvard University, Boston, MA 02114, USA.
| |
Collapse
|
7
|
Assouline A, Mendelsohn A. Weaving a story: Narrative formation over prolonged time scales engages social cognition and frontoparietal networks. Eur J Neurosci 2023; 57:809-823. [PMID: 36617430 DOI: 10.1111/ejn.15909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2022] [Revised: 12/10/2022] [Accepted: 01/06/2023] [Indexed: 01/10/2023]
Abstract
Forming narratives is of key importance to human experience, enabling one to render large amounts of information into relatively compacted stories for future retrieval, giving meaning to otherwise fragmented occurrences. The neural mechanisms that underlie coherent narrative construction of causally connected information over prolonged temporal periods are yet unclear. Participants in this fMRI study observed consecutive scenes from a full-length movie either in their original order, enabling causal inferences over time, or in reverse order, impeding a key component of coherent narratives-causal inference. In between scenes, we presented short periods of blank screens for examining post-encoding processing effects. Using multivariate pattern analysis (MVPA) followed by seed-base correlation analysis, we hypothesized that networks involved in online monitoring of incoming information on the one hand, and offline processing of previous occurrences on the other would differ between the groups. We found that despite the exposure to the same scenes, the chronological-order condition exhibited enhanced functional connectivity in frontoparietal regions associated with information integration and working memory. The reverse-order condition yielded offline, post-scene coactivation of neural networks involved in social cognition and particularly theory of mind and action comprehension. These findings shed light on offline processes of narrative construction efforts, highlighting the role of social cognition networks in seeking for narrative coherence.
Collapse
Affiliation(s)
- Amir Assouline
- Sagol Department of Neurobiology, University of Haifa, Haifa, Israel.,The Institute of Information Processing and Decision Making (IIPDM), University of Haifa, Haifa, Israel
| | - Avi Mendelsohn
- Sagol Department of Neurobiology, University of Haifa, Haifa, Israel.,The Institute of Information Processing and Decision Making (IIPDM), University of Haifa, Haifa, Israel
| |
Collapse
|
8
|
Barbieri E, Thompson CK, Higgins J, Caplan D, Kiran S, Rapp B, Parrish T. Treatment-induced neural reorganization in aphasia is language-domain specific: Evidence from a large-scale fMRI study. Cortex 2023; 159:75-100. [PMID: 36610109 PMCID: PMC9931666 DOI: 10.1016/j.cortex.2022.11.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 08/14/2022] [Accepted: 11/29/2022] [Indexed: 12/23/2022]
Abstract
Studies investigating the effects of language intervention on the re-organization of language networks in chronic aphasia have resulted in mixed findings, likely related to-among other factors-the language function targeted during treatment. The present study investigated the effects of the type of treatment provided on neural reorganization. Seventy individuals with chronic stroke-induced aphasia, recruited from three research laboratories and meeting criteria for agrammatism, anomia or dysgraphia were assigned to either treatment (N = 51) or control (N = 19) groups. Participants in the treatment group received 12-weeks of language intervention targeting sentence comprehension/production, naming, or spelling. At baseline and post-testing, all participants performed an fMRI story comprehension task, with blocks of auditorily-presented stories alternated with blocks of reversed speech. Participants in the treatment, but not control, group significantly improved in the treated language domain. FMRI region-of-interest (ROI) analyses, conducted within regions that were either active (or homologous to active) regions in a group of 22 healthy participants on the story comprehension task, revealed a significant increase in activation from pre-to post-treatment in right-hemisphere homologues of these regions for participants in the sentence and spelling, but not naming, treatment groups, not predicted by left-hemisphere lesion size. For the sentence (but not the spelling) treatment group, activation changes within right-hemisphere homologues of language regions were positively associated with changes in measures of verb and sentence comprehension. These findings support previous research pointing to recruitment of right hemisphere tissue as a viable route for language recovery and suggest that sentence-level treatment may promote greater neuroplasticity on naturalistic, language comprehension tasks, compared to word-level treatment.
Collapse
Affiliation(s)
- Elena Barbieri
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Communication Sciences and Disorders, School of Communication, Northwestern University, 70 Arts Circle Drive, Evanston, IL 60208, USA.
| | - Cynthia K Thompson
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Communication Sciences and Disorders, School of Communication, Northwestern University, 70 Arts Circle Drive, Evanston, IL 60208, USA; Department of Neurology, Feinberg School of Medicine, Northwestern University, 303 East Chicago Avenue, Chicago, IL 60611, USA
| | - James Higgins
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N Michigan Avenue, Chicago, IL 60611, USA
| | - David Caplan
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Neurology, Massachusetts General Hospital, Harvard Medical School, 15 Parkman Street, Boston, MA 02114, USA
| | - Swathi Kiran
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Speech, Language, And Hearing, College of Health & Rehabilitation, Boston University, 635 Commonwealth Avenue, Boston, MA 02215, USA
| | - Brenda Rapp
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Cognitive Science, Krieger School of Arts & Sciences, Johns Hopkins Univeristy, 3400 N Charles Street, Baltimore, MD 21218, USA
| | - Todd Parrish
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N Michigan Avenue, Chicago, IL 60611, USA
| |
Collapse
|
9
|
Information flow across the cortical timescale hierarchy during narrative construction. Proc Natl Acad Sci U S A 2022; 119:e2209307119. [PMID: 36508677 PMCID: PMC9907070 DOI: 10.1073/pnas.2209307119] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
When listening to spoken narratives, we must integrate information over multiple, concurrent timescales, building up from words to sentences to paragraphs to a coherent narrative. Recent evidence suggests that the brain relies on a chain of hierarchically organized areas with increasing temporal receptive windows to process naturalistic narratives. We hypothesized that the structure of this cortical processing hierarchy should result in an observable sequence of response lags between networks comprising the hierarchy during narrative comprehension. This study uses functional MRI to estimate the response lags between functional networks during narrative comprehension. We use intersubject cross-correlation analysis to capture network connectivity driven by the shared stimulus. We found a fixed temporal sequence of response lags-on the scale of several seconds-starting in early auditory areas, followed by language areas, the attention network, and lastly the default mode network. This gradient is consistent across eight distinct stories but absent in data acquired during rest or using a scrambled story stimulus, supporting our hypothesis that narrative construction gives rise to internetwork lags. Finally, we build a simple computational model for the neural dynamics underlying the construction of nested narrative features. Our simulations illustrate how the gradual accumulation of information within the boundaries of nested linguistic events, accompanied by increased activity at each level of the processing hierarchy, can give rise to the observed lag gradient.
Collapse
|
10
|
Youssofzadeh V, Conant L, Stout J, Ustine C, Humphries C, Gross WL, Shah-Basak P, Mathis J, Awe E, Allen L, DeYoe EA, Carlson C, Anderson CT, Maganti R, Hermann B, Nair VA, Prabhakaran V, Meyerand B, Binder JR, Raghavan M. Late dominance of the right hemisphere during narrative comprehension. Neuroimage 2022; 264:119749. [PMID: 36379420 PMCID: PMC9772156 DOI: 10.1016/j.neuroimage.2022.119749] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Revised: 10/12/2022] [Accepted: 11/11/2022] [Indexed: 11/15/2022] Open
Abstract
PET and fMRI studies suggest that auditory narrative comprehension is supported by a bilateral multilobar cortical network. The superior temporal resolution of magnetoencephalography (MEG) makes it an attractive tool to investigate the dynamics of how different neuroanatomic substrates engage during narrative comprehension. Using beta-band power changes as a marker of cortical engagement, we studied MEG responses during an auditory story comprehension task in 31 healthy adults. The protocol consisted of two runs, each interleaving 7 blocks of the story comprehension task with 15 blocks of an auditorily presented math task as a control for phonological processing, working memory, and attention processes. Sources at the cortical surface were estimated with a frequency-resolved beamformer. Beta-band power was estimated in the frequency range of 16-24 Hz over 1-sec epochs starting from 400 msec after stimulus onset until the end of a story or math problem presentation. These power estimates were compared to 1-second epochs of data before the stimulus block onset. The task-related cortical engagement was inferred from beta-band power decrements. Group-level source activations were statistically compared using non-parametric permutation testing. A story-math contrast of beta-band power changes showed greater bilateral cortical engagement within the fusiform gyrus, inferior and middle temporal gyri, parahippocampal gyrus, and left inferior frontal gyrus (IFG) during story comprehension. A math-story contrast of beta power decrements showed greater bilateral but left-lateralized engagement of the middle frontal gyrus and superior parietal lobule. The evolution of cortical engagement during five temporal windows across the presentation of stories showed significant involvement during the first interval of the narrative of bilateral opercular and insular regions as well as the ventral and lateral temporal cortex, extending more posteriorly on the left and medially on the right. Over time, there continued to be sustained right anterior ventral temporal engagement, with increasing involvement of the right anterior parahippocampal gyrus, STG, MTG, posterior superior temporal sulcus, inferior parietal lobule, frontal operculum, and insula, while left hemisphere engagement decreased. Our findings are consistent with prior imaging studies of narrative comprehension, but in addition, they demonstrate increasing right-lateralized engagement over the course of narratives, suggesting an important role for these right-hemispheric regions in semantic integration as well as social and pragmatic inference processing.
Collapse
Affiliation(s)
- Vahab Youssofzadeh
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA,Corresponding author. (V. Youssofzadeh)
| | - Lisa Conant
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Jeffrey Stout
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Candida Ustine
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - William L. Gross
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA,Anesthesiology, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - Jed Mathis
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA,Radiology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Elizabeth Awe
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Linda Allen
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Edgar A. DeYoe
- Radiology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Chad Carlson
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - Rama Maganti
- Neurology, University of Wisconsin-Madison, Madison, WI, USA
| | - Bruce Hermann
- Neurology, University of Wisconsin-Madison, Madison, WI, USA
| | - Veena A. Nair
- Radiology, University of Wisconsin-Madison, Madison, WI, USA
| | - Vivek Prabhakaran
- Radiology, University of Wisconsin-Madison, Madison, WI, USA,Medical Physics, University of Wisconsin-Madison, Madison, WI, USA,Psychiatry, University of Wisconsin-Madison, Madison, WI, USA
| | - Beth Meyerand
- Radiology, University of Wisconsin-Madison, Madison, WI, USA,Medical Physics, University of Wisconsin-Madison, Madison, WI, USA,Biomedical Engineering, University of Wisconsin-Madison, Madison, WI, USA
| | | | - Manoj Raghavan
- Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| |
Collapse
|
11
|
Hernández Expósito S, Acosta Rodríguez V, Ramírez-Santana GM. Overlapping in memory profiles in Spanish children with autism spectrum disorders, developmental language disorders, and attention deficit hyperactivity disorder. APPLIED NEUROPSYCHOLOGY. CHILD 2022; 11:863-872. [PMID: 34806920 DOI: 10.1080/21622965.2021.2002694] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Neurodevelopmental disorders do not have biological markers that allow for their identification. This means that in most cases, diagnosis is based on behavior. This approach implies that difficulties will exist in establishing the diagnostic boundaries of the different nosological entities, and it argues that neurodevelopmental disorders probably share neuropsychological deficits. Our main objective was to study whether neurodevelopmental disorders share a common endophenotype. We carried out a study of memory in children with Autism Spectrum Disorders (ASD), Developmental Language Disorders (DLD), and Attention Deficit Hyperactivity Disorder (ADHD). For this purpose, we administered an extensive neuropsychological battery to evaluate memory to 24(ASD), 25(DLD), and 25(ADHD) children. The results obtained by these three clinical groups were contrasted with those obtained by a group of 25 children of typical development (TD). TD group performed better in all memory tasks, except the recognition task than the clinical groups, and the clinical groups showed slight differences among themselves in their performance in memory tasks. These results show that memory deficits could represent a common endophenotype at least in these three neurodevelopmental disorders and emphasize the need to intervene in memory disorders in this population.
Collapse
Affiliation(s)
- Sergio Hernández Expósito
- Department of Clinical Psychology, Psychobiology and Methodology, School of Psychology & Speech Therapy, University of La Laguna, Tenerife, Spain
| | - Víctor Acosta Rodríguez
- Department of Didactic and Educational Research, School of Psychology & Speech Therapy, University of La Laguna, Tenerife, Spain
| | - Gustavo M Ramírez-Santana
- Department of Clinical Psychology, Psychobiology and Methodology, School of Psychology & Speech Therapy, University of La Laguna, Tenerife, Spain
| |
Collapse
|
12
|
Falque A, Jordanis M, Landré L, Loureiro de Sousa P, Mondino M, Furcieri E, Blanc F. Neural basis of impaired narrative discourse comprehension in prodromal and mild dementia with lewy bodies. Front Aging Neurosci 2022; 14:939973. [PMID: 36185488 PMCID: PMC9520572 DOI: 10.3389/fnagi.2022.939973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Accepted: 08/15/2022] [Indexed: 11/13/2022] Open
Abstract
Narrative discourse (ND) comprehension is a complex task that implies not only linguistic abilities but also other cognitive abilities, including efficient executive functioning. An executive dysfunction has been described in dementia with Lewy bodies (DLB) from the early stage. Here, we question the link between executive dysfunction in DLB and narrative comprehension. The aim of our study was to evaluate ND comprehension and to investigate the neuroanatomical basis for its impairment in the early stage of DLB. DLB patients (N = 26) and controls (N = 19) underwent the ND comprehension test of the Montreal Protocol for Evaluation of Communication (MEC). An additional, qualitative analysis was conducted on their verbal productions. Cognitive tests assessing verbal episodic memory, executive functions, naming and oral syntactic comprehension were also performed. Brain gray matter correlates of the ND comprehension test were examined using voxel-based morphometry (VBM). An ND comprehension impairment was found for prodromal and mild DLB patients as compared to controls. These difficulties were correlated with the Frontal Assessment Battery (FAB) score. ND comprehension impairment in DLB was further characterized by a deficit in the organization and the logic of the discourse. Moreover, VBM analysis revealed a correlation between striatal gray matter volumes and DLB patients’ ability to extract and organize relevant information (p < 0.05, FDR correction, cluster level). The ND comprehension impairment in DLB patients could be related to their executive dysfunction through a deficit of information selection and organization that correlates with the volumetric reduction of striatal gray matter.
Collapse
Affiliation(s)
- Anaïs Falque
- ICube Laboratory and FMTS (Fédération de Médecine Translationnelle de Strasbourg), Team IMIS, Université de Strasbourg, Strasbourg, France
- Geriatrics Department, CM2R (Memory Resource and Research Centre), University Hospitals of Strasbourg, Strasbourg, France
| | - Mélanie Jordanis
- ICube Laboratory and FMTS (Fédération de Médecine Translationnelle de Strasbourg), Team IMIS, Université de Strasbourg, Strasbourg, France
- Geriatrics Department, CM2R (Memory Resource and Research Centre), University Hospitals of Strasbourg, Strasbourg, France
- *Correspondence: Mélanie Jordanis,
| | - Lionel Landré
- ICube Laboratory and FMTS (Fédération de Médecine Translationnelle de Strasbourg), Team IMIS, Université de Strasbourg, Strasbourg, France
- Lionel Landré,
| | - Paulo Loureiro de Sousa
- ICube Laboratory and FMTS (Fédération de Médecine Translationnelle de Strasbourg), Team IMIS, Université de Strasbourg, Strasbourg, France
| | - Mary Mondino
- ICube Laboratory and FMTS (Fédération de Médecine Translationnelle de Strasbourg), Team IMIS, Université de Strasbourg, Strasbourg, France
| | - Emmanuelle Furcieri
- Geriatrics Department, CM2R (Memory Resource and Research Centre), University Hospitals of Strasbourg, Strasbourg, France
| | - Frédéric Blanc
- ICube Laboratory and FMTS (Fédération de Médecine Translationnelle de Strasbourg), Team IMIS, Université de Strasbourg, Strasbourg, France
- Geriatrics Department, CM2R (Memory Resource and Research Centre), University Hospitals of Strasbourg, Strasbourg, France
| |
Collapse
|
13
|
de la Vega A, Rocca R, Blair RW, Markiewicz CJ, Mentch J, Kent JD, Herholz P, Ghosh SS, Poldrack RA, Yarkoni T. Neuroscout, a unified platform for generalizable and reproducible fMRI research. eLife 2022; 11:e79277. [PMID: 36040302 PMCID: PMC9489206 DOI: 10.7554/elife.79277] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 08/27/2022] [Indexed: 11/28/2022] Open
Abstract
Functional magnetic resonance imaging (fMRI) has revolutionized cognitive neuroscience, but methodological barriers limit the generalizability of findings from the lab to the real world. Here, we present Neuroscout, an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout leverages state-of-the-art machine learning models to automatically annotate stimuli from dozens of fMRI studies using naturalistic stimuli-such as movies and narratives-allowing researchers to easily test neuroscientific hypotheses across multiple ecologically-valid datasets. In addition, Neuroscout builds on a robust ecosystem of open tools and standards to provide an easy-to-use analysis builder and a fully automated execution engine that reduce the burden of reproducible research. Through a series of meta-analytic case studies, we validate the automatic feature extraction approach and demonstrate its potential to support more robust fMRI research. Owing to its ease of use and a high degree of automation, Neuroscout makes it possible to overcome modeling challenges commonly arising in naturalistic analysis and to easily scale analyses within and across datasets, democratizing generalizable fMRI research.
Collapse
Affiliation(s)
| | - Roberta Rocca
- Department of Psychology, The University of Texas at AustinAustinUnited States
- Interacting Minds Centre, Aarhus UniversityAarhusDenmark
| | - Ross W Blair
- Department of Psychology, Stanford UniversityStanfordUnited States
| | | | - Jeff Mentch
- Program in Speech and Hearing Bioscience and Technology, Harvard UniversityCambridgeUnited States
- McGovern Institute for Brain Research, Massachusetts Institute of TechnologyCambridgeUnited States
| | - James D Kent
- Department of Psychology, The University of Texas at AustinAustinUnited States
| | - Peer Herholz
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill UniversityMontrealCanada
| | - Satrajit S Ghosh
- McGovern Institute for Brain Research, Massachusetts Institute of TechnologyCambridgeUnited States
- Department of Otolaryngology, Harvard Medical SchoolBostonUnited States
| | | | - Tal Yarkoni
- Department of Psychology, The University of Texas at AustinAustinUnited States
| |
Collapse
|
14
|
Hakonen M, Ikäheimonen A, Hultèn A, Kauttonen J, Koskinen M, Lin FH, Lowe A, Sams M, Jääskeläinen IP. Processing of an Audiobook in the Human Brain Is Shaped by Cultural Family Background. Brain Sci 2022; 12:brainsci12050649. [PMID: 35625035 PMCID: PMC9139798 DOI: 10.3390/brainsci12050649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 05/10/2022] [Accepted: 05/13/2022] [Indexed: 11/16/2022] Open
Abstract
Perception of the same narrative can vary between individuals depending on a listener’s previous experiences. We studied whether and how cultural family background may shape the processing of an audiobook in the human brain. During functional magnetic resonance imaging (fMRI), 48 healthy volunteers from two different cultural family backgrounds listened to an audiobook depicting the intercultural social life of young adults with the respective cultural backgrounds. Shared cultural family background increased inter-subject correlation of hemodynamic activity in the left-hemispheric Heschl’s gyrus, insula, superior temporal gyrus, lingual gyrus and middle temporal gyrus, in the right-hemispheric lateral occipital and posterior cingulate cortices as well as in the bilateral middle temporal gyrus, middle occipital gyrus and precuneus. Thus, cultural family background is reflected in multiple areas of speech processing in the brain and may also modulate visual imagery. After neuroimaging, the participants listened to the narrative again and, after each passage, produced a list of words that had been on their minds when they heard the audiobook during neuroimaging. Cultural family background was reflected as semantic differences in these word lists as quantified by a word2vec-generated semantic model. Our findings may depict enhanced mutual understanding between persons who share similar cultural family backgrounds.
Collapse
Affiliation(s)
- Maria Hakonen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
- Faculty of Sport and Health Sciences, University of Jyväskylä, 40014 Jyväskylä, Finland
- Advanced Magnetic Imaging Centre, School of Science, Aalto University, 00076 Espoo, Finland
- Correspondence:
| | - Arsi Ikäheimonen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
| | - Annika Hultèn
- Imaging Language, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland;
| | - Janne Kauttonen
- Digital Business, Haaga-Helia University of Applied Sciences, 00520 Helsinki, Finland;
| | - Miika Koskinen
- Faculty of Medicine, University of Helsinki, 00014 Helsinki, Finland;
| | - Fa-Hsuan Lin
- Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada;
- Department of Medical Biophysics, University of Toronto, Toronto, ON M5G 1L7, Canada
| | - Anastasia Lowe
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
| | - Mikko Sams
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
- MAGICS Infrastructure, Aalto Studios, Aalto University, 02150 Espoo, Finland
| | - Iiro P. Jääskeläinen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
- International Social Neuroscience Laboratory, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia
| |
Collapse
|
15
|
Acunzo DJ, Low DM, Fairhall SL. Deep neural networks reveal topic-level representations of sentences in medial prefrontal cortex, lateral anterior temporal lobe, precuneus, and angular gyrus. Neuroimage 2022; 251:119005. [PMID: 35176493 PMCID: PMC10184870 DOI: 10.1016/j.neuroimage.2022.119005] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 02/11/2022] [Accepted: 02/13/2022] [Indexed: 11/17/2022] Open
Abstract
When reading a sentence, individual words can be combined to create more complex meaning. In this study, we sought to uncover brain regions that reflect the representation of the meaning of sentences at the topic level, as opposed to the meaning of their individual constituent words when considered irrespective of their context. Using fMRI, we recorded the neural activity of participants while reading sentences. We constructed a topic-level sentence representations using the final layer of a convolutional neural network (CNN) trained to classify Wikipedia sentences into broad semantic categories. This model was contrasted with word-level sentence representations constructed using the average of the word embeddings constituting the sentence. Using representational similarity analysis, we found that the medial prefrontal cortex, lateral anterior temporal lobe, precuneus, and angular gyrus more strongly represent sentence topic-level, compared to word-level, meaning, uncovering the important role of these semantic system regions in the representation of topic-level meaning. Results were comparable when sentence meaning was modelled with a multilayer perceptron that was not sensitive to word order within a sentence, suggesting that the learning objective, in the terms of the topic being modelled, is the critical factor in capturing these neural representational spaces.
Collapse
Affiliation(s)
- David J Acunzo
- CIMeC/University of Trento, Corso Bettini 31, Rovereto 38068, Italy
| | - Daniel M Low
- Program in Speech and Hearing Bioscience and Technology, Harvard Medical School, United States; Brain and Cognitive Sciences Department, MIT, United States
| | - Scott L Fairhall
- CIMeC/University of Trento, Corso Bettini 31, Rovereto 38068, Italy.
| |
Collapse
|
16
|
Morales M, Patel T, Tamm A, Pickering MJ, Hoffman P. Similar Neural Networks Respond to Coherence during Comprehension and Production of Discourse. Cereb Cortex 2022; 32:4317-4330. [PMID: 35059718 PMCID: PMC9528896 DOI: 10.1093/cercor/bhab485] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Revised: 11/22/2021] [Accepted: 11/23/2021] [Indexed: 12/03/2022] Open
Abstract
When comprehending discourse, listeners engage default-mode regions associated with integrative semantic processing to construct a situation model of its content. We investigated how similar networks are engaged when we produce, as well as comprehend, discourse. During functional magnetic resonance imaging, participants spoke about a series of specific topics and listened to discourse on other topics. We tested how activation was predicted by natural fluctuations in the global coherence of the discourse, that is, the degree to which utterances conformed to the expected topic. The neural correlates of coherence were similar across speaking and listening, particularly in default-mode regions. This network showed greater activation when less coherent speech was heard or produced, reflecting updating of mental representations when discourse did not conform to the expected topic. In contrast, regions that exert control over semantic activation showed task-specific effects, correlating negatively with coherence during listening but not during production. Participants who showed greater activation in left inferior prefrontal cortex also produced more coherent discourse, suggesting a specific role for this region in goal-directed regulation of speech content. Results suggest strong correspondence of discourse representations during speaking and listening. However, they indicate that the semantic control network plays different roles in comprehension and production.
Collapse
Affiliation(s)
- Matías Morales
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Tanvi Patel
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Andres Tamm
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Martin J Pickering
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Paul Hoffman
- Address correspondence to Dr Paul Hoffman, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK.
| |
Collapse
|
17
|
OUP accepted manuscript. Cereb Cortex 2022; 32:4869-4884. [DOI: 10.1093/cercor/bhab521] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Revised: 12/02/2021] [Accepted: 12/17/2021] [Indexed: 11/14/2022] Open
|
18
|
Augello A, Città G, Gentile M, Lieto A. A Storytelling Robot Managing Persuasive and Ethical Stances via ACT-R: An Exploratory Study. Int J Soc Robot 2021; 15:1-17. [PMID: 34956417 PMCID: PMC8693144 DOI: 10.1007/s12369-021-00847-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/19/2021] [Indexed: 11/06/2022]
Abstract
We present a storytelling robot, controlled via the ACT-R cognitive architecture, able to adopt different persuasive techniques and ethical stances while conversing about some topics concerning COVID-19. The main contribution of the paper consists in the proposal of a needs-driven model that guides and evaluates, during the dialogue, the use (if any) of persuasive techniques available in the agent procedural memory. The portfolio of persuasive techniques tested in such a model ranges from the use of storytelling to framing techniques and rhetorical-based arguments. To the best of our knowledge, this represents the first attempt of building a persuasive agent able to integrate a mix of explicitly grounded cognitive assumptions about dialogue management, storytelling and persuasive techniques as well as ethical attitudes. The paper presents the results of an exploratory evaluation of the system on 63 participants.
Collapse
Affiliation(s)
- Agnese Augello
- Institute for High Performance Computing and Networking of the National Research Council of Italy (ICAR-CNR), Palermo, Italy
| | - Giuseppe Città
- Institute for Educational Technology of the National Research Council of Italy (ITD-CNR), Palermo, Italy
| | - Manuel Gentile
- Institute for Educational Technology of the National Research Council of Italy (ITD-CNR), Palermo, Italy
- Department of Computer Science of University of Turin, Turin, Italy
| | - Antonio Lieto
- Institute for High Performance Computing and Networking of the National Research Council of Italy (ICAR-CNR), Palermo, Italy
- Department of Computer Science of University of Turin, Turin, Italy
| |
Collapse
|
19
|
Vigliecca NS. Story reading with incidental comprehension and memory: left hemisphere dominance. ARQUIVOS DE NEURO-PSIQUIATRIA 2021; 79:963-973. [PMID: 34816990 DOI: 10.1590/0004-282x-anp-2020-0489] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Accepted: 01/26/2021] [Indexed: 01/10/2023]
Abstract
BACKGROUND There are no studies on adults with unilateral brain lesions regarding story reading with incidental/implicit comprehension and memory, in which memory is only assessed through delayed recall. There is a need for validation of cerebral laterality in this type of verbal recall, which includes spontaneous performance (free or uncued condition (UC)), and induced-through-question performance regarding the forgotten units (cued condition (CC)). OBJECTIVES To explore the effects of unilateral brain lesions, of oral reading with expression (RE) and comprehension (RC) on delayed recall of a story, as either UC or CC; and to validate the ability of UC and CC to discriminate the side of brain injury. METHODS Data were obtained from 200 right-handed volunteers, among whom 42 had left-hemisphere injury (LHI), 49 had right-hemisphere injury (RHI) and 109 were demographically-matched healthy participants (HP). Patients who were unable to read, understand or speak were excluded. RESULTS LHI individuals presented impairment of both UC and CC, in relation to the other two groups (non-LHI) with sensitivity and specificity above 70%. LHI and RHI individuals were not significantly different in RE and RC, but they were both different from HP in all the assessments except CC, in which RHI individuals resembled HP. Despite this lack of abnormality in RHI individuals during CC, about half of this group showed impairment in UC. Additionally, whereas RE had a significant effect on UC, the moral of the story (RC) had a significant effect on both UC and CC. CONCLUSIONS The left hemisphere was dominant for this memory task involving implicit processing.
Collapse
Affiliation(s)
- Nora Silvana Vigliecca
- Consejo Nacional de Investigaciones Científicas y Técnicas de la Argentina (CONICET), Universidad Nacional de Córdoba, Instituto de Humanidades, Córdoba, Argentina.,Hospital Córdoba, Servicio de Neurología y Neurocirugía, Córdoba, Argentina
| |
Collapse
|
20
|
Nastase SA, Liu YF, Hillman H, Zadbood A, Hasenfratz L, Keshavarzian N, Chen J, Honey CJ, Yeshurun Y, Regev M, Nguyen M, Chang CHC, Baldassano C, Lositsky O, Simony E, Chow MA, Leong YC, Brooks PP, Micciche E, Choe G, Goldstein A, Vanderwal T, Halchenko YO, Norman KA, Hasson U. The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension. Sci Data 2021; 8:250. [PMID: 34584100 PMCID: PMC8479122 DOI: 10.1038/s41597-021-01033-3] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 08/18/2021] [Indexed: 02/08/2023] Open
Abstract
The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.
Collapse
Affiliation(s)
- Samuel A Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA.
| | - Yun-Fei Liu
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Hanna Hillman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Neggin Keshavarzian
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Janice Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Christopher J Honey
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Yaara Yeshurun
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
| | - Mor Regev
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Mai Nguyen
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Claire H C Chang
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | | | - Olga Lositsky
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, USA
| | - Erez Simony
- Faculty of Electrical Engineering, Holon Institute of Technology, Holon, Israel
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | | | - Yuan Chang Leong
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| | - Paula P Brooks
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Emily Micciche
- Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Gina Choe
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Tamara Vanderwal
- Department of Psychiatry, University of British Columbia, and BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Yaroslav O Halchenko
- Department of Psychological and Brain Sciences and Department of Computer Science, Dartmouth College, Hanover, NH, USA
| | - Kenneth A Norman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
21
|
Feng W, Wang W, Liu J, Wang Z, Tian L, Fan L. Neural Correlates of Causal Inferences in Discourse Understanding and Logical Problem-Solving: A Meta-Analysis Study. Front Hum Neurosci 2021; 15:666179. [PMID: 34248525 PMCID: PMC8261065 DOI: 10.3389/fnhum.2021.666179] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 05/21/2021] [Indexed: 11/13/2022] Open
Abstract
In discourse comprehension, we need to draw inferences to make sense of discourse. Previous neuroimaging studies have investigated the neural correlates of causal inferences in discourse understanding. However, these findings have been divergent, and how these types of inferences are related to causal inferences in logical problem-solving remains unclear. Using the activation likelihood estimation (ALE) approach, the current meta-analysis analyzed 19 experiments on causal inferences in discourse understanding and 20 experiments on those in logical problem-solving to identify the neural correlates of these two cognitive processes and their shared and distinct neural correlates. We found that causal inferences in discourse comprehension recruited a left-lateralized frontotemporal brain system, including the left inferior frontal gyrus, the left middle temporal gyrus (MTG), and the bilateral medial prefrontal cortex (MPFC), while causal inferences in logical problem-solving engaged a nonoverlapping brain system in the frontal and parietal cortex, including the left inferior frontal gyrus, the bilateral middle frontal gyri, the dorsal MPFC, and the left inferior parietal lobule (IPL). Furthermore, the pattern similarity analyses showed that causal inferences in discourse understanding were primarily related to the terms about language processing and theory-of-mind processing. Both types of inferences were found to be related to the terms about memory and executive function. These findings suggest that causal inferences in discourse understanding recruit distinct neural bases from those in logical problem-solving and rely more on semantic knowledge and social interaction experiences.
Collapse
Affiliation(s)
- Wangshu Feng
- Research Institute of Foreign Languages, Beijing Foreign Studies University, Beijing, China
| | - Weijuan Wang
- Research Institute of Foreign Languages, Beijing Foreign Studies University, Beijing, China
| | - Jia Liu
- Research Institute of Foreign Languages, Beijing Foreign Studies University, Beijing, China
| | - Zhen Wang
- Research Institute of Foreign Languages, Beijing Foreign Studies University, Beijing, China
| | - Lingyun Tian
- National Research Centre for Foreign Language Education, Beijing Foreign Studies University, Beijing, China
| | - Lin Fan
- Artificial Intelligence and Human Languages Lab, Beijing Foreign Studies University, Beijing, China
| |
Collapse
|
22
|
Singleton O, Newlon M, Fossas A, Sharma B, Cook-Greuter SR, Lazar SW. Brain Structure and Functional Connectivity Correlate with Psychosocial Development in Contemplative Practitioners and Controls. Brain Sci 2021; 11:brainsci11060728. [PMID: 34070890 PMCID: PMC8228853 DOI: 10.3390/brainsci11060728] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 05/24/2021] [Accepted: 05/25/2021] [Indexed: 11/23/2022] Open
Abstract
Jane Loevinger’s theory of adult development, termed ego development (1966) and more recently maturity development, provides a useful framework for understanding the development of the self throughout the lifespan. However, few studies have investigated its neural correlates. In the present study, we use structural and functional magnetic resonance imaging (MRI) to investigate the neural correlates of maturity development in contemplative practitioners and controls. Since traits possessed by individuals with higher levels of maturity development are similar to those attributed to individuals at advanced stages of contemplative practice, we chose to investigate levels of maturity development in meditation practitioners as well as matched controls. We used the Maturity Assessment Profile (MAP) to measure maturity development in a mixed sample of participants composed of 14 long-term meditators, 16 long-term yoga practitioners, and 16 demographically matched controls. We investigated the relationship between contemplative practice and maturity development with behavioral, seed-based resting state functional connectivity, and cortical thickness analyses. The results of this study indicate that contemplative practitioners possess higher maturity development compared to a matched control group, and in addition, maturity development correlates with cortical thickness in the posterior cingulate. Furthermore, we identify a brain network implicated in theory of mind, narrative, and self-referential processing, comprising the posterior cingulate cortex, dorsomedial prefrontal cortex, temporoparietal junction, and inferior frontal cortex, as a primary neural correlate.
Collapse
Affiliation(s)
- Omar Singleton
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02114, USA; (O.S.); (M.N.); (A.F.)
| | - Max Newlon
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02114, USA; (O.S.); (M.N.); (A.F.)
| | - Andres Fossas
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02114, USA; (O.S.); (M.N.); (A.F.)
| | - Beena Sharma
- Vertical Development Academy, Woodside, CA 94062, USA;
| | - Susanne R. Cook-Greuter
- Vertical Development Academy, Woodside, CA 94062, USA;
- Cook-Greuter and Associates, Wayland, MA 01778, USA;
| | - Sara W. Lazar
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02114, USA; (O.S.); (M.N.); (A.F.)
- Correspondence: ; Tel.: +1-617-724-7108; Fax: +1-617-643-7340
| |
Collapse
|
23
|
Zhou W, Cui X, Shi B, Su M, Cao M. The development of brain functional connectome during text reading. Dev Cogn Neurosci 2021; 48:100927. [PMID: 33556881 PMCID: PMC7868633 DOI: 10.1016/j.dcn.2021.100927] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Revised: 12/15/2020] [Accepted: 01/22/2021] [Indexed: 11/30/2022] Open
Abstract
Reading is an important skill for human beings to obtain information, whose acquisition is a major learning task for children. Especially, compared with single word reading, text reading requires an integration of multiple cognitive processes, which makes its underlying neural developmental mechanism not only extremely complicated but also remained poorly understood. Employing the graph theory analysis method, the present study explored the development of brain in the context of story reading from the perspective of connectomics. Forty-two primary school students and thirty-two adults read the stories in the functional magnetic resonance imaging (fMRI) experiment. We found that compared with children, adults had increased connectivity strength, nodal degree, and modular interactions for vision-related and semantics-related brain regions while decreased connectivity strength, nodal degree, and modular interactions for phonology-related brain regions. Brain-behavior association analysis suggested that the transmission to vision-related brain circuits would enhance the reading performance in adults, whereas phonology-related brain circuits played important roles in children’s reading before they develop into fluent readers. Collectivity, we highlight a shift from reliance on phonology-related networks to semantics-related and vision-related networks with age for text reading, which provides insights into the underlying neural signature of developmental cognitive mechanisms.
Collapse
Affiliation(s)
- Wei Zhou
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 100037, China
| | - Xiaohui Cui
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 100037, China
| | - Baoguo Shi
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 100037, China
| | - Mengmeng Su
- College of Elementary Education, Capital Normal University, Beijing, 100037, China.
| | - Miao Cao
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education, China.
| |
Collapse
|
24
|
Neural Correlates of Modal Displacement and Discourse-Updating under (Un)Certainty. eNeuro 2021; 8:ENEURO.0290-20.2020. [PMID: 33288644 PMCID: PMC7810261 DOI: 10.1523/eneuro.0290-20.2020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 10/27/2020] [Accepted: 10/29/2020] [Indexed: 11/21/2022] Open
Abstract
A hallmark of human thought is the ability to think about not just the actual world but also about alternative ways the world could be. One way to study this contrast is through language. Language has grammatical devices for expressing possibilities and necessities, such as the words might or must With these devices, called "modal expressions," we can study the actual versus possible contrast in a highly controlled way. While factual utterances such as "There is a monster under my bed" update the here-and-now of a discourse model, a modal version of this sentence, "There might be a monster under my bed," displaces from the here-and-now and merely postulates a possibility. We used magnetoencephalography (MEG) to test whether the processes of discourse updating and modal displacement dissociate in the brain. Factual and modal utterances were embedded in short narratives, and across two experiments, factual expressions increased the measured activity over modal expressions. However, the localization of the increase appeared to depend on perspective: signal localizing in right temporoparietal areas increased when updating the representation of someone else's beliefs, while frontal medial areas seem sensitive to updating one's own beliefs. The presence of modal displacement did not elevate MEG signal strength in any of our analyses. In sum, this study identifies potential neural signatures of the process by which facts get added to our mental representation of the world.
Collapse
|
25
|
The hippocampal region is necessary for text comprehension and memorization: a combined VBM/DTI study in neuropsychological patients. Brain Imaging Behav 2021; 15:2367-2376. [PMID: 33415514 DOI: 10.1007/s11682-020-00432-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/17/2020] [Indexed: 10/22/2022]
Abstract
According to the Construction-Integration model (Kintsch 1988; Kintsch 1998), two forms of representation are activated during the reading and the comprehension of a text: 1) the text base, which includes semantic propositions and 2) the situation model, corresponding to the integration of the information contained in the text to the memories and knowledge of the reader. Functional neuroimaging studies in healthy subjects have shown that the text base is underpinned by frontal regions and lateral temporal regions whereas the situation model would rather depend on the posterior cingulate cortex, the precuneus and other regions depending on the dimension studied. However, the brain regions highlighted so far were only involved in comprehension and not necessary for this cognitive ability. For the first time, we explored the brain structures necessary to understand texts using a combined VBM/DTI approach in neuropsychological patients with whom we obtained comprehension scores (text base and situation model) after the reading of narrative texts. To our great surprise and contrary to our hypotheses, which were based on the results of functional neuroimaging studies, our own results show that it is the hippocampal region that is necessary to activate and memorize/remember the text base and the situation model. The highlighting of a link between the integrity of a portion of the uncinate fasciculus which is well known to play a role in semantic processing and the performance scores of the text base suggests that the hippocampal region is necessary not only for the retrieval of the text base and of the situation model thanks to episodic memory, but also for the activation of the text base during the reading and the comprehension of a text.
Collapse
|
26
|
Distinct neural substrates of individual differences in components of reading comprehension in adults with or without dyslexia. Neuroimage 2020; 226:117570. [PMID: 33221445 DOI: 10.1016/j.neuroimage.2020.117570] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 11/11/2020] [Accepted: 11/14/2020] [Indexed: 12/26/2022] Open
Abstract
Reading comprehension is a complex task that depends on multiple cognitive and linguistic processes. According to the updated Simple View of Reading framework, in adults, individual variation in reading comprehension can be largely explained by combined variance in three component abilities: (1) decoding accuracy, (2) fluency, and (3) language comprehension. Here we asked whether the neural correlates of the three components are different in adults with dyslexia as compared to typically-reading adults and whether the relative contribution of these correlates to reading comprehension is similar in the two groups. We employed a novel naturalistic fMRI reading task to identify the neural correlates of individual differences in the three components using whole-brain and literature-driven regions-of-interest approaches. Across all participants, as predicted by the Simple View framework, we found distinct patterns of associations with linguistic and domain-general regions for the three components, and that the left-hemispheric neural correlates of language comprehension in the angular and posterior temporal gyri made the largest contributions to explaining out-of-scanner reading comprehension performance. These patterns differed between the two groups. In typical adult readers, better fluency was associated with greater activation of left occipitotemporal regions, better comprehension with lesser activation in prefrontal and posterior parietal regions, and there were no significant associations with decoding. In adults with dyslexia, better fluency was associated with greater activation of bilateral inferior parietal regions, better comprehension was associated with greater activation in some prefrontal clusters and lower in others, and better decoding skills were associated with lesser activation of bilateral prefrontal and posterior parietal regions. Extending the behavioral findings of skill-level differences in the relative contribution of the three components to reading comprehension, the relative contributions of the neural correlates to reading comprehension differed based on dyslexia status. These findings reveal some of the neural correlates of individual differences in the three components and the underlying mechanisms of reading comprehension deficits in adults with dyslexia.
Collapse
|
27
|
Bagarinao E, Watanabe H, Maesawa S, Mori D, Hara K, Kawabata K, Ohdake R, Masuda M, Ogura A, Kato T, Koyama S, Katsuno M, Wakabayashi T, Kuzuya M, Hoshiyama M, Isoda H, Naganawa S, Ozaki N, Sobue G. Identifying the brain's connector hubs at the voxel level using functional connectivity overlap ratio. Neuroimage 2020; 222:117241. [DOI: 10.1016/j.neuroimage.2020.117241] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2020] [Accepted: 08/07/2020] [Indexed: 01/06/2023] Open
|
28
|
Conservative and liberal attitudes drive polarized neural responses to political content. Proc Natl Acad Sci U S A 2020; 117:27731-27739. [PMID: 33082227 DOI: 10.1073/pnas.2008530117] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
People tend to interpret political information in a manner that confirms their prior beliefs, a cognitive bias that contributes to rising political polarization. In this study, we combined functional magnetic resonance imaging with semantic content analyses to investigate the neural mechanisms that underlie the biased processing of real-world political content. We scanned American participants with conservative-leaning or liberal-leaning immigration attitudes while they watched news clips, campaign ads, and public speeches related to immigration policy. We searched for evidence of "neural polarization": activity in the brain that diverges between people who hold liberal versus conservative political attitudes. Neural polarization was observed in the dorsomedial prefrontal cortex (DMPFC), a brain region associated with the interpretation of narrative content. Neural polarization in the DMPFC intensified during moments in the videos that included risk-related and moral-emotional language, highlighting content features most likely to drive divergent interpretations between conservatives and liberals. Finally, participants whose DMPFC activity closely matched that of the average conservative or the average liberal participant were more likely to change their attitudes in the direction of that group's position. Our work introduces a multimethod approach to study the neural basis of political cognition in naturalistic settings. Using this approach, we characterize how political attitudes biased information processing in the brain, the language most likely to drive polarized neural responses, and the consequences of biased processing for attitude change. Together, these results shed light on the psychological and neural underpinnings of how identical information is interpreted differently by conservatives and liberals.
Collapse
|
29
|
Movies and narratives as naturalistic stimuli in neuroimaging. Neuroimage 2020; 224:117445. [PMID: 33059053 PMCID: PMC7805386 DOI: 10.1016/j.neuroimage.2020.117445] [Citation(s) in RCA: 54] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2020] [Revised: 10/06/2020] [Accepted: 10/09/2020] [Indexed: 01/06/2023] Open
Abstract
Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.
Collapse
|
30
|
Blank IA, Fedorenko E. No evidence for differences among language regions in their temporal receptive windows. Neuroimage 2020; 219:116925. [PMID: 32407994 PMCID: PMC9392830 DOI: 10.1016/j.neuroimage.2020.116925] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Revised: 03/20/2020] [Accepted: 05/06/2020] [Indexed: 10/24/2022] Open
Abstract
The "core language network" consists of left frontal and temporal regions that are selectively engaged in linguistic processing. Whereas functional differences among these regions have long been debated, many accounts propose distinctions in terms of representational grain-size-e.g., words vs. phrases/sentences-or processing time-scale, i.e., operating on local linguistic features vs. larger spans of input. Indeed, the topography of language regions appears to overlap with a cortical hierarchy reported by Lerner et al. (2011) wherein mid-posterior temporal regions are sensitive to low-level features of speech, surrounding areas-to word-level information, and inferior frontal areas-to sentence-level information and beyond. However, the correspondence between the language network and this hierarchy of "temporal receptive windows" (TRWs) is difficult to establish because the precise anatomical locations of language regions vary across individuals. To directly test this correspondence, we first identified language regions in each participant with a well-validated task-based localizer, which confers high functional resolution to the study of TRWs (traditionally based on stereotactic coordinates); then, we characterized regional TRWs with the naturalistic story listening paradigm of Lerner et al. (2011), which augments task-based characterizations of the language network by more closely resembling comprehension "in the wild". We find no region-by-TRW interactions across temporal and inferior frontal regions, which are all sensitive to both word-level and sentence-level information. Therefore, the language network as a whole constitutes a unique stage of information integration within a broader cortical hierarchy.
Collapse
Affiliation(s)
- Idan A Blank
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| |
Collapse
|
31
|
Common and distinct neural systems support the generation retrieval phase of autobiographical memory and personal problem solving. Behav Brain Res 2020; 397:112911. [PMID: 32950609 DOI: 10.1016/j.bbr.2020.112911] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 08/19/2020] [Accepted: 09/12/2020] [Indexed: 11/20/2022]
Abstract
Prior research has documented engagement of a common 'core' retrieval network during autobiographical memory retrieval and higher-order prospective tasks, such as personal problem solving. This neural overlap has overwhelmingly been documented in the context of the 'elaboration phase' of retrieval, when a single mental event is simulated in detail . However, recollective and prospective tasks are often associated with generic cues, which require the retrieval and consideration of multiple conceptually-related events. This initial 'generation phase' of retrieval has received comparably little attention in the literature, leaving open questions as to how and when autobiographical memory and prospective tasks overlap within the brain. Here, we compare and contrast neural activity between autobiographical memory retrieval and personal problem solving with a focus on the initial generation phase of retrieval. In the MRI scanner, young adults completed both an autobiographical memory and a personal problem solving task. Each task consisted of a generation phase, which required participants to generate multiple past personal events or problem solutions to a given cue and a subsequent elaboration phase, where a single memory or solution was simulated in detail. A multivariate Partial Least Squares analysis revealed patterns of neural overlap between memory and problem solving during the generation phase that were distinct from the elaboration phase. Among regions commonly recruited during the generation phase was the anterior hippocampus, a structure involved in initiating mental construction and integrating concepts. Subsequent analyses demonstrated that the anterior hippocampus interacted with distinct cortical regions as a function of task, in particular the ventromedial prefrontal cortex. Together, these data provide novel evidence that neural overlap between autobiographical memory and personal problem solving does not occur solely in the context of detailed simulation but, instead, is driven by common retrieval demands.
Collapse
|
32
|
Single-word, sentence, and discourse comprehension in individuals with temporal lobe epilepsy. Epilepsy Behav 2020; 110:107140. [PMID: 32454295 DOI: 10.1016/j.yebeh.2020.107140] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Revised: 04/21/2020] [Accepted: 04/24/2020] [Indexed: 11/23/2022]
Abstract
The purpose of this study was to systematically investigate language comprehension in individuals with left and right temporal lobe epilepsy (TLE) at different language levels - single word (noun and verb), sentence, and discourse. Neither of the groups with TLE showed difficulties with noun comprehension, whereas verb comprehension performance was significantly lower in individuals with left, but not right TLE as compared to healthy controls. In contrast, sentence and discourse comprehension was overall impaired, irrespective of the lateralization of the epileptogenic focus. Education level and age at seizure onset were also found correlating with language comprehension in our tested cohort. The results, firstly, confirm that the verb comprehension task is more sensitive for assessment of single-word comprehension in individuals with TLE. Secondly, they indicate that language comprehension in left and right TLE is mostly impaired at the sentence and discourse levels, which may be associated with low working memory capacities.
Collapse
|
33
|
Heidlmayr K, Weber K, Takashima A, Hagoort P. No title, no theme: The joined neural space between speakers and listeners during production and comprehension of multi-sentence discourse. Cortex 2020; 130:111-126. [PMID: 32652339 DOI: 10.1016/j.cortex.2020.04.035] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2020] [Revised: 03/19/2020] [Accepted: 04/22/2020] [Indexed: 01/06/2023]
Abstract
Speakers and listeners usually interact in larger discourses than single words or even single sentences. The goal of the present study was to identify the neural bases reflecting how the mental representation of the situation denoted in a multi-sentence discourse (situation model) is constructed and shared between speakers and listeners. An fMRI study using a variant of the ambiguous text paradigm was designed. Speakers (n = 15) produced ambiguous texts in the scanner and listeners (n = 27) subsequently listened to these texts in different states of ambiguity: preceded by a highly informative, intermediately informative or no title at all. Conventional BOLD activation analyses in listeners, as well as inter-subject correlation analyses between the speakers' and the listeners' hemodynamic time courses were performed. Critically, only the processing of disambiguated, coherent discourse with an intelligible situation model representation involved (shared) activation in bilateral lateral parietal and medial prefrontal regions. This shared spatiotemporal pattern of brain activation between the speaker and the listener suggests that the process of memory retrieval in medial prefrontal regions and the binding of retrieved information in the lateral parietal cortex constitutes a core mechanism underlying the communication of complex conceptual representations.
Collapse
Affiliation(s)
- Karin Heidlmayr
- Max-Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands.
| | - Kirsten Weber
- Max-Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Atsuko Takashima
- Max-Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Peter Hagoort
- Max-Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
34
|
Chang CHC, Dehaene S, Wu DH, Kuo WJ, Pallier C. Cortical encoding of linguistic constituent with and without morphosyntactic cues. Cortex 2020; 129:281-295. [PMID: 32535379 DOI: 10.1016/j.cortex.2020.04.024] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2019] [Revised: 07/30/2019] [Accepted: 04/21/2020] [Indexed: 12/31/2022]
Abstract
This study examined the brain areas involved in combining words into larger units when there are few or no morphosyntactic cues. We manipulated constituent length in word strings of the same length under two conditions: Mandarin sentence, which had sparse morphosyntactic cues, and nominal phrase that had no morphosyntactic cues [e.g., ((honey mustard) (chicken burger))]. Contrasting sentences to word lists revealed a network that largely overlapped with the one reported in languages with rich morphosyntactic cues, including left IFGorb/IFGtri and areas along left STG/STS. Both conditions showed increased activation in left IFGtri/IFGorb in functional ROIs defined based on previous study in sentence processing, while the nominal phrases additionally revealed a constituent length effect in bilateral dorsal IFGtri, left IFGoper, left pMTG/pSTG, left IPL, and several subcortical areas, which might reflect an increased reliance on semantic and pragmatic information. Moreover, in upper left IFGtri/IFGoper and left thalamus/caudate, this effect increased with the participants' tendency to combine nouns into phrases. The absence of syntactic constraints on linguistic composition might highlight individual differences in cognitive control, which helps to integrate non-syntactic information.
Collapse
Affiliation(s)
- Claire H C Chang
- Institute of Neuroscience, National Yang-Ming University, Taipei, Taiwan.
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, France; Collège de France, Paris, France.
| | - Denise H Wu
- Institute of Cognitive Neuroscience, National Central University, Zhongli, Taiwan.
| | - Wen-Jui Kuo
- Institute of Neuroscience, National Yang-Ming University, Taipei, Taiwan; Brain Research Center, National Yang-Ming University, Taipei, Taiwan.
| | - Christophe Pallier
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, France.
| |
Collapse
|
35
|
Shain C, Blank IA, van Schijndel M, Schuler W, Fedorenko E. fMRI reveals language-specific predictive coding during naturalistic sentence comprehension. Neuropsychologia 2020; 138:107307. [PMID: 31874149 PMCID: PMC7140726 DOI: 10.1016/j.neuropsychologia.2019.107307] [Citation(s) in RCA: 87] [Impact Index Per Article: 21.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Revised: 12/02/2019] [Accepted: 12/13/2019] [Indexed: 11/19/2022]
Abstract
Much research in cognitive neuroscience supports prediction as a canonical computation of cognition across domains. Is such predictive coding implemented by feedback from higher-order domain-general circuits, or is it locally implemented in domain-specific circuits? What information sources are used to generate these predictions? This study addresses these two questions in the context of language processing. We present fMRI evidence from a naturalistic comprehension paradigm (1) that predictive coding in the brain's response to language is domain-specific, and (2) that these predictions are sensitive both to local word co-occurrence patterns and to hierarchical structure. Using a recently developed continuous-time deconvolutional regression technique that supports data-driven hemodynamic response function discovery from continuous BOLD signal fluctuations in response to naturalistic stimuli, we found effects of prediction measures in the language network but not in the domain-general multiple-demand network, which supports executive control processes and has been previously implicated in language comprehension. Moreover, within the language network, surface-level and structural prediction effects were separable. The predictability effects in the language network were substantial, with the model capturing over 37% of explainable variance on held-out data. These findings indicate that human sentence processing mechanisms generate predictions about upcoming words using cognitive processes that are sensitive to hierarchical structure and specialized for language processing, rather than via feedback from high-level executive control mechanisms.
Collapse
Affiliation(s)
| | - Idan Asher Blank
- University of California Los Angeles, 90024, USA; Massachusetts Institute of Technology, 02139, USA.
| | | | - William Schuler
- The Ohio State University, 43210, USA; Massachusetts General Hospital, Program in Speech and Hearing Bioscience and Technology, 02115, USA.
| | - Evelina Fedorenko
- Massachusetts General Hospital, Program in Speech and Hearing Bioscience and Technology, 02115, USA.
| |
Collapse
|
36
|
Jacoby N, Fedorenko E. Discourse-level comprehension engages medial frontal Theory of Mind brain regions even for expository texts. LANGUAGE, COGNITION AND NEUROSCIENCE 2020; 35:780-796. [PMID: 32984430 PMCID: PMC7518647 DOI: 10.1080/23273798.2018.1525494] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
In addition to understanding individual word meanings and processing the syntactic and semantic dependencies among those words within a sentence, language comprehension often requires constructing a higher-order discourse structure based on the relationships among clauses and sentences in the extended context. Prior fMRI studies of discourse-level comprehension have reported greater activation for texts than unconnected sentences in what-appear-to-be regions of the Theory of Mind (ToM) network. However, those studies have generally used narratives rich in mental state content, thus confounding coherence and content. We report an fMRI experiment where ToM regions were defined functionally in each participant, and their responses were examined to texts vs. sentence lists. Critically, we used expository texts to minimize mental state content. Medial frontal but not posterior ToM regions exhibited small but reliable increases in their responses to texts relative to unconnected sentences, suggesting a role for these regions in discourse comprehension independent of content.
Collapse
Affiliation(s)
- Nir Jacoby
- Department of Psychology, Columbia University, New York, NY, USA
| | - Evelina Fedorenko
- Harvard Medical School, Boston, MA, USA
- Department of Psychiatry, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
37
|
Aboud KS, Bailey SK, Del Tufo SN, Barquero LA, Cutting LE. Fairy Tales versus Facts: Genre Matters to the Developing Brain. Cereb Cortex 2019; 29:4877-4888. [PMID: 30806463 PMCID: PMC6917516 DOI: 10.1093/cercor/bhz025] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2018] [Revised: 01/21/2019] [Accepted: 02/04/2019] [Indexed: 11/12/2022] Open
Abstract
Neurobiological studies of discourse comprehension have almost exclusively focused on narrative comprehension. However, successful engagement in modern society, particularly in educational settings, also requires comprehension with an aim to learn new information (i.e., "expository comprehension"). Despite its prevalence, no studies to date have neurobiologically characterized expository comprehension as compared with narrative. In the current study, we used functional magnetic resonance imaging in typically developing children to test whether different genres require specialized brain networks. In addition to expected activations in language and comprehension areas in the default mode network (DMN), expository comprehension required significantly greater activation in the frontoparietal control network (FPN) than narrative comprehension, and relied significantly less on posterior regions in the DMN. Functional connectivity analysis revealed that, compared with narrative, the FPN robustly correlated with the DMN, and this inter-network communication was higher with increased reading expertise. These findings suggest that, relative to narrative comprehension, expository comprehension shows (1) a unique configuration of the DMN, potentially to support non-social comprehension processes, and (2) increased utilization of top-down regions to help support goal-directed comprehension processes in the DMN. More generally, our findings reveal that different types of discourse-level comprehension place diverse neural demands on the developing brain.
Collapse
Affiliation(s)
- Katherine S Aboud
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
- Peabody College of Education, Vanderbilt University, Nashville, TN, USA
| | - Stephen K Bailey
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
- Peabody College of Education, Vanderbilt University, Nashville, TN, USA
| | - Stephanie N Del Tufo
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
- Peabody College of Education, Vanderbilt University, Nashville, TN, USA
| | - Laura A Barquero
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Laurie E Cutting
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
- Peabody College of Education, Vanderbilt University, Nashville, TN, USA
- Vanderbilt University Institute of Imaging Science, Vanderbilt University, Nashville, TN, USA
- Vanderbilt Kennedy Center, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
38
|
Carson N, Rosenbaum RS, Moscovitch M, Murphy KJ. Self-referential processing improves memory for narrative information in healthy aging and amnestic Mild Cognitive Impairment. Neuropsychologia 2019; 134:107179. [DOI: 10.1016/j.neuropsychologia.2019.107179] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Revised: 08/16/2019] [Accepted: 08/28/2019] [Indexed: 12/15/2022]
|
39
|
Brain activation patterns associated with paragraph learning in persons with multiple sclerosis: The MEMREHAB trial. Int J Psychophysiol 2019; 154:37-45. [PMID: 31644933 DOI: 10.1016/j.ijpsycho.2019.09.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2018] [Revised: 09/18/2019] [Accepted: 09/19/2019] [Indexed: 10/25/2022]
Abstract
The modified Story Memory Technique (mSMT) is a memory rehabilitation program that combines training in visualization and context formation to improve learning and memory. Previous studies have shown improvement in learning and memory in individuals with multiple sclerosis (MS) after undergoing the mSMT, including changes in brain activity related to working memory and word encoding. The current study examined changes in brain activity in 16 individuals diagnosed with MS (n treatment = 6; n placebo control = 10) when they were presented with to-be-remembered information within a meaningful context (i.e. a paragraph) from before to after mSMT treatment. We expected treatment-related changes in brain activation in the language network (LAN), default mode network (DMN), and executive control network (ECN). Consistent with this prediction, fMRI results revealed reduced brain activation in the LAN, DMN and ECN after completing the mSMT treatment in the context of paragraph learning. While no significant behavioral changes were observed, a marginally significant improvement with a large effect size was noted between baseline and follow-up performance on the Rivermead Behavioral Memory Test in persons who completed treatment. Results are discussed in terms of the impact of imagery training on patterns of cerebral activation when learning words presented within a context.
Collapse
|
40
|
Yang X, Li H, Lin N, Zhang X, Wang Y, Zhang Y, Zhang Q, Zuo X, Yang Y. Uncovering cortical activations of discourse comprehension and their overlaps with common large-scale neural networks. Neuroimage 2019; 203:116200. [PMID: 31536803 DOI: 10.1016/j.neuroimage.2019.116200] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2019] [Revised: 09/11/2019] [Accepted: 09/15/2019] [Indexed: 02/04/2023] Open
Abstract
We conducted a meta-analysis of 78 task-based functional magnetic resonance imaging (fMRI) studies (1976 total participants) to reveal underlying brain activations and their overlap with large-scale neural networks in the brain during general discourse comprehension and its sub-processes. We found that discourse comprehension involved a neural system consisting of widely distributed brain regions that comprised not only the bilateral perisylvian language zones, but also regions in the superior and medial frontal cortex and the medial temporal lobe. Moreover, this neural system can be categorized into several sub-systems representing various sub-processes of discourse comprehension, with the left inferior frontal gyrus and middle temporal gyrus serving as core regions across all sub-processes. At a large-scale network level, we found that discourse comprehension relied most heavily on the default network, particularly on its dorsal medial subsystem. The pattern associated with large-scale network cooperation varied according to the respective sub-processes required. Our results reveal the functional dissociation within the discourse comprehension neural system and highlight the flexible involvements of large-scale networks.
Collapse
Affiliation(s)
- XiaoHong Yang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - HuiJie Li
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Nan Lin
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - XiuPing Zhang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - YinShan Wang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Ying Zhang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Qian Zhang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - XiNian Zuo
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China.
| | - YuFang Yang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100049, China.
| |
Collapse
|
41
|
Stawarczyk D, Bezdek MA, Zacks JM. Event Representations and Predictive Processing: The Role of the Midline Default Network Core. Top Cogn Sci 2019; 13:164-186. [PMID: 31486286 PMCID: PMC7984453 DOI: 10.1111/tops.12450] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
The human brain is tightly coupled to the world through its sensory‐motor systems—but it also spends a lot of its metabolism talking to itself. One important function of this intrinsic activity is the establishment and updating of event models—representations of the current situation that can predictively guide perception, learning, and action control. Here, we propose that event models largely depend on the default network (DN) midline core that includes the posterior cingulate and anterior medial prefrontal cortex. An increasing body of data indeed suggests that this subnetwork can facilitate stimuli processing during both naturalistic event comprehension and cognitive tasks in which mental representations of prior situations, trials, and task rules can predictively guide attention and performance. This midline core involvement in supporting predictions through event models can make sense of an otherwise complex and conflicting pattern of results regarding the possible cognitive functions subserved by the DN. Stawarczyk, Bezdek, and Zacks offer neuroscience evidence for a midline default network core, which appears to coordinate internal, top‐down mentation with externally‐triggered, bottom‐up attention in a push‐pull relationship. The network may enable the flexible pursuance of thoughts tuned into or detached from the current environment.
Collapse
Affiliation(s)
- David Stawarczyk
- Department of Psychological & Brain Sciences, Washington University.,Department of Psychology, Psychology and Neuroscience of Cognition Research Unit, University of Liège
| | - Matthew A Bezdek
- Department of Psychological & Brain Sciences, Washington University
| | - Jeffrey M Zacks
- Department of Psychological & Brain Sciences, Washington University
| |
Collapse
|
42
|
Neurocognitive Signatures of Naturalistic Reading of Scientific Texts: A Fixation-Related fMRI Study. Sci Rep 2019; 9:10678. [PMID: 31337859 PMCID: PMC6681173 DOI: 10.1038/s41598-019-47176-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2019] [Accepted: 07/10/2019] [Indexed: 11/25/2022] Open
Abstract
How do students gain scientific knowledge while reading expository text? This study examines the underlying neurocognitive basis of textual knowledge structure and individual readers’ cognitive differences and reading habits, including the influence of text and reader characteristics, on outcomes of scientific text comprehension. By combining fixation-related fMRI and multiband data acquisition, the study is among the first to consider self-paced naturalistic reading inside the MRI scanner. Our results revealed the underlying neurocognitive patterns associated with information integration of different time scales during text reading, and significant individual differences due to the interaction between text characteristics (e.g., optimality of the textual knowledge structure) and reader characteristics (e.g., electronic device use habits). Individual differences impacted the amount of neural resources deployed for multitasking and information integration for constructing the underlying scientific mental models based on the text being read. Our findings have significant implications for understanding science reading in a population that is increasingly dependent on electronic devices.
Collapse
|
43
|
Idiomatic expressions evoke stronger emotional responses in the brain than literal sentences. Neuropsychologia 2019; 131:233-248. [PMID: 31152753 DOI: 10.1016/j.neuropsychologia.2019.05.020] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Revised: 05/22/2019] [Accepted: 05/22/2019] [Indexed: 12/31/2022]
Abstract
Recent neuroscientific research shows that metaphors engage readers at the emotional level more strongly than literal expressions. What still remains unclear is what makes metaphors more engaging, and whether this generalises to all figurative expressions, no matter how conventionalised they are. This fMRI study aimed to investigate whether idiomatic expressions - the least creative part of figurative language - indeed trigger a higher affective resonance than literal expressions, and to explore possible interactions between activation in emotion-relevant neural structures and regions associated with figurative language processing. Participants silently read for comprehension a set of emotionally positive, negative and neutral idioms embedded in short sentences, and similarly valenced literal sentences. As in studies on metaphors, we found enhanced activation of the left inferior frontal gyrus and left amygdala in response to idioms, indexing stronger recruitment of executive control functions and enhanced emotional engagement, respectively. This suggests that the comprehension of even highly conventionalised and familiar figurative expressions, namely idioms, recruits regions involved in emotional processing. Furthermore, increased activation of the IFG interacted positively with activation in the amygdala, suggesting that the stronger cognitive engagement driven by idioms may in turn be coupled with stronger involvement at the emotional level.
Collapse
|
44
|
Linguistic networks associated with lexical, semantic and syntactic predictability in reading: A fixation-related fMRI study. Neuroimage 2019; 189:224-240. [DOI: 10.1016/j.neuroimage.2019.01.018] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2018] [Revised: 12/11/2018] [Accepted: 01/08/2019] [Indexed: 12/30/2022] Open
|
45
|
Sheldon S, Fenerci C, Gurguryan L. A Neurocognitive Perspective on the Forms and Functions of Autobiographical Memory Retrieval. Front Syst Neurosci 2019; 13:4. [PMID: 30760984 PMCID: PMC6361758 DOI: 10.3389/fnsys.2019.00004] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2018] [Accepted: 01/10/2019] [Indexed: 11/13/2022] Open
Abstract
Autobiographical memory retrieval involves constructing mental representations of personal past episodes by associating together an array of details related to the retrieved event. This construction process occurs flexibly so that the event details can be associated together in different ways during retrieval. Here, we propose that differences in how this association occurs support a division in autobiographical remembering. We first review theories of autobiographical memory organization that suggest that episodic details of an experience are processed along a gradient of abstraction. This organization allows for the same autobiographical event to be recalled as either a conceptualized or perceptually-based episodic memory. We then use neuroimaging evidence to show how this division within episodic autobiographical memory is also present in the brain, both at a network level and within the hippocampus. Specifically, we suggest that the anterior and posterior hippocampus are obligatorily tuned towards constructing conceptual vs. perceptual episodic representations of autobiographical memories. Finally, we discuss the directive purpose of this proposed division of episodic remembering by reviewing decision scenarios that benefit from recalling the past as a conceptual vs. a perceptual episode. Conceptual remembering is useful to guide ambiguous decisions that have yet to be encountered whereas perceptual remembering is useful to guide decisions for well-structured tasks that have been previously experienced. We emphasize that the ability to shift between conceptual and perceptual forms of remembering, by virtue of hippocampal specialization, during decision-making and other memory-guided actions is the key to adaptive behavior.
Collapse
Affiliation(s)
- Signy Sheldon
- Department of Psychology, McGill University, Montreal, QC, Canada
| | - Can Fenerci
- Department of Psychology, McGill University, Montreal, QC, Canada
| | - Lauri Gurguryan
- Department of Psychology, McGill University, Montreal, QC, Canada
| |
Collapse
|
46
|
Successful Encoding during Natural Reading Is Associated with Fixation-Related Potentials and Large-Scale Network Deactivation. eNeuro 2018; 5:eN-NWR-0122-18. [PMID: 30417083 PMCID: PMC6223116 DOI: 10.1523/eneuro.0122-18.2018] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2018] [Revised: 09/21/2018] [Accepted: 09/23/2018] [Indexed: 12/27/2022] Open
Abstract
Reading literature (e.g., an entire book) is an enriching experience that qualitatively differs from reading a single sentence; however, the brain dynamics of such context-dependent memory remains unclear. This study aimed to elucidate mnemonic neural dynamics during natural reading of literature by performing electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI). Brain activities of human participants recruited on campus were correlated with their subsequent memory, which was quantified by semantic correlation between the read text and reports subsequently written by them based on state of the art natural language processing procedures. The results of the EEG data analysis showed a significant positive relationship between subsequent memory and fixation-related EEG. Sentence-length and paragraph-length mnemonic processes were associated with N1-P2 and P3 fixation-related potential (FRP) components and fixation-related θ-band (4-8 Hz) EEG power, respectively. In contrast, the results of fMRI analysis showed a significant negative relationship between subsequent memory and blood oxygenation level-dependent (BOLD) activation. Sentence-length and paragraph-length mnemonic processes were associated with networks of regions forming part of the salience network and the default mode network (DMN), respectively. Taken together with the EEG results, these memory-related deactivations in the salience network and the DMN were thought to reflect the reading of sentences characterized by low mnemonic load and the suppression of task-irreverent thoughts, respectively. It was suggested that the context-dependent mnemonic process during literature reading requires large-scale network deactivation, which might reflect coordination of a range of voluntary processes during reading.
Collapse
|
47
|
Ryherd K, Jasinska K, Van Dyke JA, Hung YH, Baron E, Mencl WE, Zevin J, Landi N. Cortical regions supporting reading comprehension skill for single words and discourse. BRAIN AND LANGUAGE 2018; 186:32-43. [PMID: 30212746 PMCID: PMC6447036 DOI: 10.1016/j.bandl.2018.08.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Revised: 07/16/2018] [Accepted: 08/02/2018] [Indexed: 06/08/2023]
Abstract
A substantial amount of variation in reading comprehension skill is explained by listening comprehension skill, suggesting tight links between printed and spoken discourse processing. In addition, both word level (e.g., vocabulary) and discourse-level sub-skills (e.g., inference-making) support overall comprehension. However, while these contributions to variation in comprehension skill have been well-studied behaviorally, the underlying neurobiological basis of these relationships is less well understood. In order to examine the neural bases of individual differences in reading comprehension as a function of input modality and processing level, we examined functional neural activation to both spoken and printed single words and passages in adolescents with a range of comprehension skill. Data driven Partial Least Squares Correlation (PLSC) analyses revealed that comprehension skill was positively related to activation in a number of regions associated with discourse comprehension and negatively related to activation in regions associated with executive function and memory across processing levels and input modalities.
Collapse
Affiliation(s)
- K Ryherd
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, United States; Haskins Laboratories, New Haven, CT, United States; CT Institute for the Brain and Cognitive Sciences, Storrs, CT, United States
| | - K Jasinska
- Department of Linguistics and Cognitive Science, University of Delaware, United States; Haskins Laboratories, New Haven, CT, United States
| | - J A Van Dyke
- Haskins Laboratories, New Haven, CT, United States; CT Institute for the Brain and Cognitive Sciences, Storrs, CT, United States
| | - Y-H Hung
- Haskins Laboratories, New Haven, CT, United States
| | - E Baron
- Haskins Laboratories, New Haven, CT, United States
| | - W E Mencl
- Haskins Laboratories, New Haven, CT, United States; Department of Linguistics, Yale University, New Haven, CT, United States
| | - J Zevin
- Haskins Laboratories, New Haven, CT, United States; Departments of Psychology and Linguistics, University of Southern California, Los Angeles, CA, United States
| | - N Landi
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, United States; Haskins Laboratories, New Haven, CT, United States; Yale Child Study Center, Yale University, New Haven, CT, United States; CT Institute for the Brain and Cognitive Sciences, Storrs, CT, United States.
| |
Collapse
|
48
|
Coderre EL, Cohn N, Slipher SK, Chernenok M, Ledoux K, Gordon B. Visual and linguistic narrative comprehension in autism spectrum disorders: Neural evidence for modality-independent impairments. BRAIN AND LANGUAGE 2018; 186:44-59. [PMID: 30216902 DOI: 10.1016/j.bandl.2018.09.001] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2017] [Revised: 06/15/2018] [Accepted: 09/02/2018] [Indexed: 06/08/2023]
Abstract
Individuals with autism spectrum disorders (ASD) have notable language difficulties, including with understanding narratives. However, most narrative comprehension studies have used written or spoken narratives, making it unclear whether narrative difficulties stem from language impairments or more global impairments in the kinds of general cognitive processes (such as understanding meaning and structural sequencing) that are involved in narrative comprehension. Using event-related potentials (ERPs), we directly compared semantic comprehension of linguistic narratives (short sentences) and visual narratives (comic panels) in adults with ASD and typically-developing (TD) adults. Compared to the TD group, the ASD group showed reduced N400 effects for both linguistic and visual narratives, suggesting comprehension impairments for both types of narratives and thereby implicating a more domain-general impairment. Based on these results, we propose that individuals with ASD use a more bottom-up style of processing during narrative comprehension.
Collapse
Affiliation(s)
- Emily L Coderre
- Department of Communication Sciences and Disorders, University of Vermont, Burlington, VT, United States; Cognitive Neurology/Neuropsychology, Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, United States.
| | - Neil Cohn
- Tilburg Center for Cognition and Communication (TiCC), Tilburg University, Tilburg, The Netherlands
| | - Sally K Slipher
- Cognitive Neurology/Neuropsychology, Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, United States; Department of Health Professions, Montana State University, Bozeman, MT, United States
| | - Mariya Chernenok
- Cognitive Neurology/Neuropsychology, Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, United States; Department of Human Ecology, University of California at Davis, Davis, CA, United States
| | - Kerry Ledoux
- Cognitive Neurology/Neuropsychology, Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Barry Gordon
- Cognitive Neurology/Neuropsychology, Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, United States; Department of Cognitive Science, The Johns Hopkins University, Baltimore, MD, United States
| |
Collapse
|
49
|
Twait E, Farah R, Horowitz-Kraus T. Decreased functional connectivity of the salience network during narrative comprehension in children with reading difficulties: An fMRI study. NEUROIMAGE-CLINICAL 2018; 20:987-992. [PMID: 30316176 PMCID: PMC6190597 DOI: 10.1016/j.nicl.2018.10.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 09/10/2018] [Accepted: 10/06/2018] [Indexed: 12/19/2022]
Abstract
Dyslexia is a neurobiological learning disability, reflected through deficits in written (i.e. reading) but not in spoken language. Since written and spoken language rely on cognitive control abilities, we aimed to compare functional connectivity of the understudied salience network which is related to cognitive control in children with dyslexia vs. typical readers during a functional MRI narrative comprehension task. Although children with dyslexia showed similar comprehension levels as typical readers, neuroimaging data revealed children with dyslexia showed significantly decreased functional connectivity values of an independent component (IC) related to the salience network. The functional connectivity values in the salience network IC were negatively correlated with behavioral data of working memory in those with dyslexia. These findings further express that dyslexia is manifested through atypical involvement of neural circuits related to EF, specifically the salience network even when attending narratives. Since the salience network is related to switching abilities and error detection, future research should focus on strengthening these abilities early in life for better future reading outcomes. Behavioral data supports executive functioning and reading deficiencies in dyslexia Significant greater functional connectivity in the salience network IC in typical readers vs children with dyslexia Negative correlation between functional connectivity of the salience network, working memory abilities and processing speed
Collapse
Affiliation(s)
- Emma Twait
- Educational Neuroimaging Center, Faculty of Education in Science and Technology, Technion, Israel
| | - Rola Farah
- Educational Neuroimaging Center, Faculty of Education in Science and Technology, Technion, Israel
| | - Tzipi Horowitz-Kraus
- Educational Neuroimaging Center, Faculty of Education in Science and Technology, Technion, Israel; Faculty of Biomedical Engineering, Technion, Israel; Reading and Literacy Discovery Center, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, United States.
| |
Collapse
|
50
|
Trait paranoia shapes inter-subject synchrony in brain activity during an ambiguous social narrative. Nat Commun 2018; 9:2043. [PMID: 29795116 PMCID: PMC5966466 DOI: 10.1038/s41467-018-04387-2] [Citation(s) in RCA: 84] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2017] [Accepted: 04/26/2018] [Indexed: 01/21/2023] Open
Abstract
Individuals often interpret the same event in different ways. How do personality traits modulate brain activity evoked by a complex stimulus? Here we report results from a naturalistic paradigm designed to draw out both neural and behavioral variation along a specific dimension of interest, namely paranoia. Participants listen to a narrative during functional MRI describing an ambiguous social scenario, written such that some individuals would find it highly suspicious, while others less so. Using inter-subject correlation analysis, we identify several brain areas that are differentially synchronized during listening between participants with high and low trait-level paranoia, including theory-of-mind regions. Follow-up analyses indicate that these regions are more active to mentalizing events in high-paranoia individuals. Analyzing participants’ speech as they freely recall the narrative reveals semantic and syntactic features that also scale with paranoia. Results indicate that a personality trait can act as an intrinsic “prime,” yielding different neural and behavioral responses to the same stimulus across individuals. Reactions to the same event can vary vastly based on multiple factors. Here the authors show that people with high trait-level paranoia process ambiguous information in a narrative differently and this can be attributed to greater activity in mentalizing brain regions during the moments of ambiguity.
Collapse
|