1
|
Bacha-Trams M, Yorulmaz GE, Glerean E, Ryyppö E, Tapani K, Virmavirta E, Saaristo J, Jääskeläinen IP, Sams M. Sisterhood predicts similar neural processing of a film. Neuroimage 2024; 297:120712. [PMID: 38945181 DOI: 10.1016/j.neuroimage.2024.120712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 06/10/2024] [Accepted: 06/25/2024] [Indexed: 07/02/2024] Open
Abstract
Relationships between humans are essential for how we see the world. Using fMRI, we explored the neural basis of homophily, a sociological concept that describes the tendency to bond with similar others. Our comparison of brain activity between sisters, friends and acquaintances while they watched a movie, indicate that sisters' brain activity is more similar than that of friends and friends' activity is more similar than that of acquaintances. The increased similarity in brain activity measured as inter-subject correlation (ISC) was found both in higher-order brain areas including the default-mode network (DMN) and sensory areas. Increased ISC could not be explained by genetic relation between sisters neither by similarities in eye-movements, emotional experiences, and physiological activity. Our findings shed light on the neural basis of homophily by revealing that similarity in brain activity in the DMN and sensory areas is the stronger the closer is the relationship between the people.
Collapse
Affiliation(s)
- Mareike Bacha-Trams
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; Institute of Research Methods in Psychology - Media-based Knowledge Construction, Computer Science and Applied Cognitive Science, University of Duisburg-Essen, Germany.
| | - Gökce Ertas Yorulmaz
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Enrico Glerean
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Elisa Ryyppö
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Karoliina Tapani
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Eero Virmavirta
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Jenni Saaristo
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Iiro P Jääskeläinen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; Advanced Magnetic Imaging (AMI) Centre, Aalto NeuroImaging, Aalto University, Espoo, Finland.
| | - Mikko Sams
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; Aalto Studios - MAGICS, Aalto University, Espoo, Finland
| |
Collapse
|
2
|
Pooja R, Ghosh P, Sreekumar V. Towards an ecologically valid naturalistic cognitive neuroscience of memory and event cognition. Neuropsychologia 2024:108970. [PMID: 39147361 DOI: 10.1016/j.neuropsychologia.2024.108970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 07/31/2024] [Accepted: 08/08/2024] [Indexed: 08/17/2024]
Abstract
The landscape of human memory and event cognition research has witnessed a transformative journey toward the use of naturalistic contexts and tasks. In this review, we track this progression from abrupt, artificial stimuli used in extensively controlled laboratory experiments to more naturalistic tasks and stimuli that present a more faithful representation of the real world. We argue that in order to improve ecological validity, naturalistic study designs must consider the complexity of the cognitive phenomenon being studied. Then, we review the current state of "naturalistic" event segmentation studies and critically assess frequently employed movie stimuli. We evaluate recently developed tools like lifelogging and other extended reality technologies to help address the challenges we identified with existing naturalistic approaches. We conclude by offering some guidelines that can be used to design ecologically valid cognitive neuroscience studies of memory and event cognition. Keywords: naturalistic stimuli, episodic memory, event cognition, ecological validity, extended reality, neural recordings.
Collapse
Affiliation(s)
- Raju Pooja
- Cognitive Science Lab, International Institute of Information Technology, Hyderabad, India
| | - Pritha Ghosh
- Cognitive Science Lab, International Institute of Information Technology, Hyderabad, India
| | - Vishnu Sreekumar
- Cognitive Science Lab, International Institute of Information Technology, Hyderabad, India.
| |
Collapse
|
3
|
Patel KK, Sheridan MA, Bonar AS, Giletta M, Hastings PD, Nock MK, Rudolph KD, Slavich GM, Prinstein MJ, Miller AB. A preliminary investigation into cortical structural alterations in adolescents with nonsuicidal self-injury. Psychiatry Res Neuroimaging 2023; 336:111725. [PMID: 38456014 PMCID: PMC10917139 DOI: 10.1016/j.pscychresns.2023.111725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/09/2024]
Abstract
The structural neural correlates underlying youth nonsuicidal self-injury (NSSI) warrant further exploration. Few studies have explored the association between NSSI and brain structure in adolescence, and no studies have investigated differences in the relation between age and brain structure in youth with NSSI. This preliminary investigation examined associations between NSSI history, age, and cortical structure using magnetic resonance imaging in adolescent girls (N=100, Mage=13.4 years) at increased risk for psychopathology. We conducted whole-brain analyses to investigate the associations between age and cortical structure, NSSI history and cortical structure, and NSSI history as a moderator of the association between age and cortical structure. Results suggested that age was associated with less cortical thickness and surface area in the left and right prefrontal, temporal, and parietal cortex. NSSI history was associated with less left insula and left inferior parietal cortex cortical surface area. Among adolescents with NSSI history, older age predicted greater left inferior parietal cortex surface area and was not associated with left precentral cortex surface area. Among adolescents without NSSI history, older age predicted smaller surface areas as expected with the typical trajectory of neurodevelopment. Overall, our results suggest differences in cortical surface area development in adolescents with NSSI history.
Collapse
Affiliation(s)
- Kinjal K Patel
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Margaret A Sheridan
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Adrienne S Bonar
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Matteo Giletta
- Department of Developmental, Personality, and Social Psychology, Ghent University, Ghent, Belgium
- Department of Developmental Psychology, Tilburg University, Tilburg, Netherlands
| | - Paul D Hastings
- Department of Psychology, University of California, Davis, Davis, CA, USA
| | - Matthew K Nock
- Department of Psychology, Harvard University, Cambridge, MA, USA
| | - Karen D Rudolph
- Department of Psychology, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - George M Slavich
- Cousins Center for Psychoneuroimmunology and Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, USA
| | - Mitchell J Prinstein
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Adam Bryant Miller
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- RTI International, Research Triangle Park, NC, USA
| |
Collapse
|
4
|
Deng K, Jin W, Jiang K, Li Z, Im H, Chen S, Du H, Guan S, Ge W, Wei C, Zhang B, Wang P, Zhao G, Chen C, Liu L, Wang Q. Reactivity of the ventromedial prefrontal cortex, but not the amygdala, to negative emotion faces predicts greed personality trait. BEHAVIORAL AND BRAIN FUNCTIONS : BBF 2023; 19:21. [PMID: 38041182 PMCID: PMC10690991 DOI: 10.1186/s12993-023-00223-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 11/27/2023] [Indexed: 12/03/2023]
Abstract
This study explored whether amygdala reactivity predicted the greed personality trait (GPT) using both task-based and resting-state functional connectivity analyses (ntotal = 452). In Cohort 1 (n = 83), task-based functional magnetic resonance imaging (t-fMRI) results from a region-of-interest (ROI) analysis revealed no direct correlation between amygdala reactivity to fearful and angry faces and GPT. Instead, whole-brain analyses revealed GPT to robustly negatively vary with activations in the right ventromedial prefrontal cortex (vmPFC), supramarginal gyrus, and angular gyrus in the contrast of fearful + angry faces > shapes. Moreover, task-based psychophysiological interaction (PPI) analyses showed that the high GPT group showed weaker functional connectivity of the vmPFC seed with a top-down control network and visual pathways when processing fearful or angry faces compared to their lower GPT counterparts. In Cohort 2, resting-state functional connectivity (rs-FC) analyses indicated stronger connectivity between the vmPFC seed and the top-down control network and visual pathways in individuals with higher GPT. Comparing the two cohorts, bilateral amygdala seeds showed weaker associations with the top-down control network in the high group via PPI analyses in Cohort 1. Yet, they exhibited distinct rs-FC patterns in Cohort 2 (e.g., positive associations of GPT with the left amygdala-top-down network FC but negative associations with the right amygdala-visual pathway FC). The study underscores the role of the vmPFC and its functional connectivity in understanding GPT, rather than amygdala reactivity.
Collapse
Affiliation(s)
- Kun Deng
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Weipeng Jin
- Department of Neurosurgery, Tianjin Huanhu Hospital, Tianjin, 300060, China
| | - Keying Jiang
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Zixi Li
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Hohjin Im
- Department of Psychological Science, University of California, Irvine, CA, 92697-7085, USA
| | - Shuning Chen
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Hanxiao Du
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Shunping Guan
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Wei Ge
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Chuqiao Wei
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Bin Zhang
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Pinchun Wang
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
| | - Guang Zhao
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China
- Key Research Base of Humanities and Social Sciences of the Ministry of Education, Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, 300387, China
- Tianjin Social Science Laboratory of Students' Mental Development and Learning, Tianjin, 300387, China
| | - Chunhui Chen
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China.
| | - Liqing Liu
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China.
- Key Research Base of Humanities and Social Sciences of the Ministry of Education, Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, 300387, China.
- Tianjin Social Science Laboratory of Students' Mental Development and Learning, Tianjin, 300387, China.
| | - Qiang Wang
- Faculty of Psychology, Tianjin Normal University, Tianjin, 300387, China.
- Key Research Base of Humanities and Social Sciences of the Ministry of Education, Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, 300387, China.
- Tianjin Social Science Laboratory of Students' Mental Development and Learning, Tianjin, 300387, China.
| |
Collapse
|
5
|
Eqlimi E, Bockstael A, Schönwiesner M, Talsma D, Botteldooren D. Time course of EEG complexity reflects attentional engagement during listening to speech in noise. Eur J Neurosci 2023; 58:4043-4069. [PMID: 37814423 DOI: 10.1111/ejn.16159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 08/31/2023] [Accepted: 09/13/2023] [Indexed: 10/11/2023]
Abstract
Auditory distractions are recognized to considerably challenge the quality of information encoding during speech comprehension. This study explores electroencephalography (EEG) microstate dynamics in ecologically valid, noisy settings, aiming to uncover how these auditory distractions influence the process of information encoding during speech comprehension. We examined three listening scenarios: (1) speech perception with background noise (LA), (2) focused attention on the background noise (BA), and (3) intentional disregard of the background noise (BUA). Our findings showed that microstate complexity and unpredictability increased when attention was directed towards speech compared with tasks without speech (LA > BA & BUA). Notably, the time elapsed between the recurrence of microstates increased significantly in LA compared with both BA and BUA. This suggests that coping with background noise during speech comprehension demands more sustained cognitive effort. Additionally, a two-stage time course for both microstate complexity and alpha-to-theta power ratio was observed. Specifically, in the early epochs, a lower level was observed, which gradually increased and eventually reached a steady level in the later epochs. The findings suggest that the initial stage is primarily driven by sensory processes and information gathering, while the second stage involves higher level cognitive engagement, including mnemonic binding and memory encoding.
Collapse
Affiliation(s)
- Ehsan Eqlimi
- WAVES Research Group, Department of Information Technology, Ghent University, Ghent, Belgium
| | - Annelies Bockstael
- WAVES Research Group, Department of Information Technology, Ghent University, Ghent, Belgium
| | | | - Durk Talsma
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Dick Botteldooren
- WAVES Research Group, Department of Information Technology, Ghent University, Ghent, Belgium
| |
Collapse
|
6
|
Shimon-Raz O, Yeshurun Y, Ulmer-Yaniv A, Levinkron A, Salomon R, Feldman R. Attachment Reminders Trigger Widespread Synchrony across Multiple Brains. J Neurosci 2023; 43:7213-7225. [PMID: 37813569 PMCID: PMC10601370 DOI: 10.1523/jneurosci.0026-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Revised: 08/15/2023] [Accepted: 09/04/2023] [Indexed: 10/17/2023] Open
Abstract
Infant stimuli elicit widespread neural and behavioral response in human adults, and such massive allocation of resources attests to the evolutionary significance of the primary attachment. Here, we examined whether attachment reminders also trigger cross-brain concordance and generate greater neural uniformity, as indicated by intersubject correlation. Human mothers were imaged twice in oxytocin/placebo administration design, and stimuli included four ecological videos of a standard unfamiliar mother and infant: two infant/mother alone (Alone) and two mother-infant dyadic contexts (Social). Theory-driven analysis measured cross-brain synchrony in preregistered nodes of the parental caregiving network (PCN), which integrates subcortical structures underpinning mammalian mothering with cortical areas implicated in simulation, mentalization, and emotion regulation, and data-driven analysis assessed brain-wide concordance using whole-brain parcellation. Results demonstrated widespread cross-brain synchrony in both the PCN and across the neuroaxis, from primary sensory/somatosensory areas, through insular-cingulate regions, to temporal and prefrontal cortices. The Social context yielded significantly more cross-brain concordance, with PCNs striatum, parahippocampal gyrus, superior temporal sulcus, ACC, and PFC displaying cross-brain synchrony only to mother-infant social cues. Moment-by-moment fluctuations in mother-infant social synchrony, ranging from episodes of low synchrony to tightly coordinated positive bouts, were tracked online by cross-brain concordance in the preregistered ACC. Findings indicate that social attachment stimuli, representing evolutionary-salient universal cues that require no verbal narrative, trigger substantial interbrain concordance and suggest that the mother-infant bond, an icon standing at the heart of human civilization, may function to glue brains into a unified experience and bind humans into social groups.SIGNIFICANCE STATEMENT Infant stimuli elicit widespread neural response in human adults, attesting to their evolutionary significance, but do they also trigger cross-brain concordance and induce neural uniformity among perceivers? We measured cross-brain synchrony to ecological mother-infant videos. We used theory-driven analysis, measuring cross-brain concordance in the parenting network, and data-driven analysis, assessing brain-wide concordance using whole-brain parcellation. Attachment cues triggered widespread cross-brain concordance in both the parenting network and across the neuroaxis. Moment-by-moment fluctuations in behavioral synchrony were tracked online by cross-brain variability in ACC. Attachment reminders bind humans' brains into a unitary experience and stimuli characterized by social synchrony enhance neural similarity among participants, describing one mechanism by which attachment bonds provide the neural template for the consolidation of social groups.
Collapse
Affiliation(s)
| | - Yaara Yeshurun
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, 69978, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, 69978, Israel
| | | | - Ayelet Levinkron
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, 69978, Israel
| | - Roy Salomon
- Department of Cognitive Sciences, University of Haifa, Haifa, 3498838, Israel
| | | |
Collapse
|
7
|
Sheng J, Wang S, Zhang L, Liu C, Shi L, Zhou Y, Hu H, Chen C, Xue G. Intersubject similarity in neural representations underlies shared episodic memory content. Proc Natl Acad Sci U S A 2023; 120:e2308951120. [PMID: 37603733 PMCID: PMC10466090 DOI: 10.1073/pnas.2308951120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Accepted: 07/05/2023] [Indexed: 08/23/2023] Open
Abstract
Individuals generally form their unique memories from shared experiences, yet the neural representational mechanisms underlying this subjectiveness of memory are poorly understood. The current study addressed this important question from the cross-subject neural representational perspective, leveraging a large functional magnetic resonance imaging dataset (n = 415) of a face-name associative memory task. We found that individuals' memory abilities were predicted by their synchronization to the group-averaged, canonical trial-by-trial activation level and, to a lesser degree, by their similarity to the group-averaged representational patterns during encoding. More importantly, the memory content shared between pairs of participants could be predicted by their shared local neural activation pattern, particularly in the angular gyrus and ventromedial prefrontal cortex, even after controlling for differences in memory abilities. These results uncover neural representational mechanisms for individualized memory and underscore the constructive nature of episodic memory.
Collapse
Affiliation(s)
- Jintao Sheng
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Sisi Wang
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Liang Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Chuqi Liu
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Liang Shi
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Yu Zhou
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Huinan Hu
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
| | - Chuansheng Chen
- Department of Psychological Science, University of California, Irvine, CA92697
| | - Gui Xue
- State Key Laboratory of Cognitive Neuroscience and Learning and International Data Group/McGovern Institute for Brain Research, Beijing Normal University, Beijing100875, China
- Chinese Institute for Brain Research, Beijing102206, China
| |
Collapse
|
8
|
Thye M, Hoffman P, Mirman D. The words that little by little revealed everything: Neural response to lexical-semantic content during narrative comprehension. Neuroimage 2023; 276:120204. [PMID: 37257674 DOI: 10.1016/j.neuroimage.2023.120204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 04/19/2023] [Accepted: 05/27/2023] [Indexed: 06/02/2023] Open
Abstract
The ease with which narratives are understood belies the complexity of the information being conveyed and the cognitive processes that support comprehension. The meanings of the words must be rapidly accessed and integrated with the reader's mental representation of the overarching, unfolding scenario. A broad, bilateral brain network is engaged by this process, but it is not clear how words that vary on specific semantic dimensions, such as ambiguity, emotion, or socialness, engage the semantic, semantic control, or social cognition systems. In the present study, data from 48 participants who listened to The Little Prince audiobook during MRI scanning were selected from the Le Petit Prince dataset. The lexical and semantic content within the narrative was quantified from the transcript words with factor scores capturing Word Length, Semantic Flexibility, Emotional Strength, and Social Impact. These scores, along with word quantity variables, were used to investigate where these predictors co-vary with activation across the brain. In contrast to studies of isolated word processing, large networks were found to co-vary with the lexical and semantic content within the narrative. An increase in semantic content engaged the ventral portion of ventrolateral ATL, consistent with its role as a semantic hub. Decreased semantic content engaged temporal pole and inferior parietal lobule, which may reflect semantic integration. The semantic control network was engaged by words with low Semantic Flexibility, perhaps due to the demand required to process infrequent, less semantically diverse language. Activation in ATL co-varied with an increase in Social Impact, which is consistent with the claim that social knowledge is housed within the neural architecture of the semantic system. These results suggest that current models of language processing may present an impoverished estimate of the neural systems that coordinate to support narrative comprehension, and, by extension, real-world language processing.
Collapse
Affiliation(s)
- Melissa Thye
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom.
| | - Paul Hoffman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| | - Daniel Mirman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| |
Collapse
|
9
|
Yang E, Milisav F, Kopal J, Holmes AJ, Mitsis GD, Misic B, Finn ES, Bzdok D. The default network dominates neural responses to evolving movie stories. Nat Commun 2023; 14:4197. [PMID: 37452058 PMCID: PMC10349102 DOI: 10.1038/s41467-023-39862-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 06/27/2023] [Indexed: 07/18/2023] Open
Abstract
Neuroscientific studies exploring real-world dynamic perception often overlook the influence of continuous changes in narrative content. In our research, we utilize machine learning tools for natural language processing to examine the relationship between movie narratives and neural responses. By analyzing over 50,000 brain images of participants watching Forrest Gump from the studyforrest dataset, we find distinct brain states that capture unique semantic aspects of the unfolding story. The default network, associated with semantic information integration, is the most engaged during movie watching. Furthermore, we identify two mechanisms that underlie how the default network liaises with the amygdala and hippocampus. Our findings demonstrate effective approaches to understanding neural processes in everyday situations and their relation to conscious awareness.
Collapse
Affiliation(s)
- Enning Yang
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
- Mila-Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Filip Milisav
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
| | - Jakub Kopal
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
- Mila-Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Avram J Holmes
- Department of Psychology and Psychiatry, Yale University, New Haven, CT, USA
| | - Georgios D Mitsis
- Department of Bioengineering, McGill University, Montreal, QC, Canada
| | - Bratislav Misic
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
| | - Emily S Finn
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Danilo Bzdok
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada.
- Mila-Quebec Artificial Intelligence Institute, Montreal, QC, Canada.
| |
Collapse
|
10
|
The connectivity-based parcellation of the angular gyrus: fiber dissection and MR tractography study. Brain Struct Funct 2023; 228:121-130. [PMID: 36056938 DOI: 10.1007/s00429-022-02555-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 08/14/2022] [Indexed: 01/07/2023]
Abstract
The angular gyrus (AG) wraps the posterior end of the superior temporal sulcus (STS), so it is considered a continuation of the superior temporal gyrus (STG)/ middle temporal gyrus (MTG) and forms the inferior parietal lobule (IPL) with the supramarginal gyrus (SMG). The AG was functionally divided in the literature, but there is no fiber dissection study in this context. This study divided AG into superior (sAG) and inferior (iAG) parts by focusing on STS. Red, blue silicone-injected eight and four non-silicone-injected human cadaveric cerebrums were dissected via the Klingler method focusing on the AG. White matter (WM) tracts identified during dissection were then reconstructed on the Human Connectome Project 1065 individual template for validation. According to this study, superior longitudinal fasciculus (SLF) II and middle longitudinal fasciculus (MdLF) are associated with sAG; the anterior commissure (AC), optic radiation (OR) with iAG; the arcuate fasciculus (AF), inferior frontooccipital fasciculus (IFOF), and tapetum (Tp) with both parts. In cortical parcellation of AG based on STS, sAG and iAG were associated with different fiber tracts. Although it has been shown in previous studies that there are functionally different subunits with AG parcellation, here, for the first time, other functions of the subunits have been revealed with cadaveric dissection and tractography images.
Collapse
|
11
|
Seghier ML. Multiple functions of the angular gyrus at high temporal resolution. Brain Struct Funct 2023; 228:7-46. [PMID: 35674917 DOI: 10.1007/s00429-022-02512-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 05/22/2022] [Indexed: 02/07/2023]
Abstract
Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.
Collapse
Affiliation(s)
- Mohamed L Seghier
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, UAE. .,Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, UAE.
| |
Collapse
|
12
|
Russo AG, De Martino M, Elia A, Di Salle F, Esposito F. Negative correlation between word-level surprisal and intersubject neural synchronization during narrative listening. Cortex 2022; 155:132-149. [DOI: 10.1016/j.cortex.2022.07.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 02/10/2022] [Accepted: 07/06/2022] [Indexed: 11/30/2022]
|
13
|
Anurova I, Vetchinnikova S, Dobrego A, Williams N, Mikusova N, Suni A, Mauranen A, Palva S. Event-related responses reflect chunk boundaries in natural speech. Neuroimage 2022; 255:119203. [PMID: 35413442 DOI: 10.1016/j.neuroimage.2022.119203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 03/22/2022] [Accepted: 04/08/2022] [Indexed: 10/18/2022] Open
Abstract
Chunking language has been proposed to be vital for comprehension enabling the extraction of meaning from a continuous stream of speech. However, neurocognitive mechanisms of chunking are poorly understood. The present study investigated neural correlates of chunk boundaries intuitively identified by listeners in natural speech drawn from linguistic corpora using magneto- and electroencephalography (MEEG). In a behavioral experiment, subjects marked chunk boundaries in the excerpts intuitively, which revealed highly consistent chunk boundary markings across the subjects. We next recorded brain activity to investigate whether chunk boundaries with high and medium agreement rates elicit distinct evoked responses compared to non-boundaries. Pauses placed at chunk boundaries elicited a closure positive shift with the sources over bilateral auditory cortices. In contrast, pauses placed within a chunk were perceived as interruptions and elicited a biphasic emitted potential with sources located in the bilateral primary and non-primary auditory areas with right-hemispheric dominance, and in the right inferior frontal cortex. Furthermore, pauses placed at stronger boundaries elicited earlier and more prominent activation over the left hemisphere suggesting that brain responses to chunk boundaries of natural speech can be modulated by the relative strength of different linguistic cues, such as syntactic structure and prosody.
Collapse
Affiliation(s)
- Irina Anurova
- Helsinki Institute of Life Sciences, Neuroscience Center, University of Helsinki, Finland; BioMag Laboratory, HUS Medical Imaging Center, Helsinki, Finland.
| | | | | | - Nitin Williams
- Helsinki Institute of Life Sciences, Neuroscience Center, University of Helsinki, Finland; Department of Languages, University of Helsinki, Finland
| | - Nina Mikusova
- Department of Languages, University of Helsinki, Finland
| | - Antti Suni
- Department of Languages, University of Helsinki, Finland
| | - Anna Mauranen
- Department of Languages, University of Helsinki, Finland
| | - Satu Palva
- Helsinki Institute of Life Sciences, Neuroscience Center, University of Helsinki, Finland; Centre for Cognitive Neuroscience, Institute of Neuroscience and Psychology, University of Glasgow, United Kingdom.
| |
Collapse
|
14
|
Musz E, Chen J. Neural signatures associated with temporal compression in the verbal retelling of past events. Commun Biol 2022; 5:489. [PMID: 35606497 PMCID: PMC9126919 DOI: 10.1038/s42003-022-03418-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Accepted: 04/26/2022] [Indexed: 11/17/2022] Open
Abstract
When we retell our past experiences, we aim to reproduce some version of the original events; this reproduced version is often temporally compressed relative to the original. However, it is currently unclear how this compression manifests in brain activity. One possibility is that a compressed retrieved memory manifests as a neural pattern which is more dissimilar to the original, relative to a more detailed or vivid memory. However, we argue that measuring raw dissimilarity alone is insufficient, as it confuses a variety of interesting and uninteresting changes. To address this problem, we examine brain pattern changes that are consistent across people. We show that temporal compression in individuals’ retelling of past events predicts systematic encoding-to-recall transformations in several higher associative regions. These findings elucidate how neural representations are not simply reactivated, but can also be transformed due to temporal compression during a universal form of human memory expression: verbal retelling. Brain patterns measured while participants first watched a movie in the fMRI scanner, then recalled the movie’s key narrative features, demonstrate that temporal compression in individuals’ retelling of past events predicts encoding-to-recall transformations.
Collapse
Affiliation(s)
- Elizabeth Musz
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, 21218, USA.
| | - Janice Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, 21218, USA
| |
Collapse
|
15
|
Hakonen M, Ikäheimonen A, Hultèn A, Kauttonen J, Koskinen M, Lin FH, Lowe A, Sams M, Jääskeläinen IP. Processing of an Audiobook in the Human Brain Is Shaped by Cultural Family Background. Brain Sci 2022; 12:brainsci12050649. [PMID: 35625035 PMCID: PMC9139798 DOI: 10.3390/brainsci12050649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 05/10/2022] [Accepted: 05/13/2022] [Indexed: 11/16/2022] Open
Abstract
Perception of the same narrative can vary between individuals depending on a listener’s previous experiences. We studied whether and how cultural family background may shape the processing of an audiobook in the human brain. During functional magnetic resonance imaging (fMRI), 48 healthy volunteers from two different cultural family backgrounds listened to an audiobook depicting the intercultural social life of young adults with the respective cultural backgrounds. Shared cultural family background increased inter-subject correlation of hemodynamic activity in the left-hemispheric Heschl’s gyrus, insula, superior temporal gyrus, lingual gyrus and middle temporal gyrus, in the right-hemispheric lateral occipital and posterior cingulate cortices as well as in the bilateral middle temporal gyrus, middle occipital gyrus and precuneus. Thus, cultural family background is reflected in multiple areas of speech processing in the brain and may also modulate visual imagery. After neuroimaging, the participants listened to the narrative again and, after each passage, produced a list of words that had been on their minds when they heard the audiobook during neuroimaging. Cultural family background was reflected as semantic differences in these word lists as quantified by a word2vec-generated semantic model. Our findings may depict enhanced mutual understanding between persons who share similar cultural family backgrounds.
Collapse
Affiliation(s)
- Maria Hakonen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
- Faculty of Sport and Health Sciences, University of Jyväskylä, 40014 Jyväskylä, Finland
- Advanced Magnetic Imaging Centre, School of Science, Aalto University, 00076 Espoo, Finland
- Correspondence:
| | - Arsi Ikäheimonen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
| | - Annika Hultèn
- Imaging Language, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland;
| | - Janne Kauttonen
- Digital Business, Haaga-Helia University of Applied Sciences, 00520 Helsinki, Finland;
| | - Miika Koskinen
- Faculty of Medicine, University of Helsinki, 00014 Helsinki, Finland;
| | - Fa-Hsuan Lin
- Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada;
- Department of Medical Biophysics, University of Toronto, Toronto, ON M5G 1L7, Canada
| | - Anastasia Lowe
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
| | - Mikko Sams
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
- MAGICS Infrastructure, Aalto Studios, Aalto University, 02150 Espoo, Finland
| | - Iiro P. Jääskeläinen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 00076 Espoo, Finland; (A.I.); (A.L.); (M.S.); (I.P.J.)
- International Social Neuroscience Laboratory, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia
| |
Collapse
|
16
|
Jääskeläinen IP, Ahveninen J, Klucharev V, Shestakova AN, Levy J. Behavioral Experience-Sampling Methods in Neuroimaging Studies With Movie and Narrative Stimuli. Front Hum Neurosci 2022; 16:813684. [PMID: 35153706 PMCID: PMC8828971 DOI: 10.3389/fnhum.2022.813684] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Accepted: 01/06/2022] [Indexed: 01/22/2023] Open
Abstract
Movies and narratives are increasingly utilized as stimuli in functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and electroencephalography (EEG) studies. Emotional reactions of subjects, what they pay attention to, what they memorize, and their cognitive interpretations are all examples of inner experiences that can differ between subjects during watching of movies and listening to narratives inside the scanner. Here, we review literature indicating that behavioral measures of inner experiences play an integral role in this new research paradigm via guiding neuroimaging analysis. We review behavioral methods that have been developed to sample inner experiences during watching of movies and listening to narratives. We also review approaches that allow for joint analyses of the behaviorally sampled inner experiences and neuroimaging data. We suggest that building neurophenomenological frameworks holds potential for solving the interrelationships between inner experiences and their neural underpinnings. Finally, we tentatively suggest that recent developments in machine learning approaches may pave way for inferring different classes of inner experiences directly from the neuroimaging data, thus potentially complementing the behavioral self-reports.
Collapse
Affiliation(s)
- Iiro P. Jääskeläinen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- International Laboratory of Social Neurobiology, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia
- *Correspondence: Iiro P. Jääskeläinen,
| | - Jyrki Ahveninen
- Massachusetts General Hospital, Massachusetts Institute of Technology and Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, United States
| | - Vasily Klucharev
- International Laboratory of Social Neurobiology, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia
| | - Anna N. Shestakova
- International Laboratory of Social Neurobiology, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia
| | - Jonathan Levy
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- Baruch Ivcher School of Psychology, Interdisciplinary Center Herzliya, Reichman University, Herzliya, Israel
| |
Collapse
|
17
|
Hu X, Wang F, Zhang D. Similar brains blend emotion in similar ways: Neural representations of individual difference in emotion profiles. Neuroimage 2021; 247:118819. [PMID: 34920085 DOI: 10.1016/j.neuroimage.2021.118819] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Revised: 11/01/2021] [Accepted: 12/13/2021] [Indexed: 01/17/2023] Open
Abstract
Our daily emotional experience is a complex construct that usually involves multiple emotions blended in a context-dependent manner. However, the co-occurring and context-dependent nature of human emotions was understated in previous studies when addressing the individual difference in emotional experiences. The present study proposed a situated and blended 'profile' perspective to characterize individualized emotional experiences. Eighty participants watched a series of emotional videos with their EEG recorded, and the individual differences in their emotion profiles were measured as the vector distances between their multidimensional emotion ratings for these video stimuli. This measure was found to be a reliable descriptor of individualized emotional experiences and could efficiently predict classical emotional complexity indices. More importantly, inter-subject representational analyses revealed that similar emotion profiles were associated with similar delta-band activities over the prefrontal and temporo-parietal regions and similar theta-band activities over the frontal regions. Furthermore, left- and right-lateralized temporo-parietal representations were observed for positive and negative emotion profiles, respectively. Our findings demonstrate the potential of taking a 'profile' perspective for understanding individual differences in human emotions.
Collapse
Affiliation(s)
- Xin Hu
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China; Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China
| | - Fei Wang
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China; Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China
| | - Dan Zhang
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China; Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China.
| |
Collapse
|
18
|
Russ BE, Petkov CI, Kwok SC, Zhu Q, Belin P, Vanduffel W, Hamed SB. Common functional localizers to enhance NHP & cross-species neuroscience imaging research. Neuroimage 2021; 237:118203. [PMID: 34048898 PMCID: PMC8529529 DOI: 10.1016/j.neuroimage.2021.118203] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 05/15/2021] [Accepted: 05/24/2021] [Indexed: 11/25/2022] Open
Abstract
Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.
Collapse
Affiliation(s)
- Brian E Russ
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, United States; Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York City, NY, United States; Department of Psychiatry, New York University at Langone, New York City, NY, United States.
| | - Christopher I Petkov
- Biosciences Institute, Newcastle University Medical School, Newcastle upon Tyne, United Kingdom
| | - Sze Chai Kwok
- Shanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, Shanghai Key Laboratory of Magnetic Resonance, Affiliated Mental Health Center (ECNU), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China; Division of Natural and Applied Sciences, Duke Kunshan University, Kunshan, Jiangsu, China; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Qi Zhu
- Cognitive Neuroimaging Unit, INSERM, CEA, Université Paris-Saclay, NeuroSpin Center, 91191 Gif/Yvette, France; Laboratory for Neuro-and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, 3000, Belgium
| | - Pascal Belin
- Institut de Neurosciences de La Timone, Aix-Marseille Université et CNRS, Marseille, 13005, France
| | - Wim Vanduffel
- Laboratory for Neuro-and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, 3000, Belgium; Leuven Brain Institute, KU Leuven, Leuven, 3000, Belgium; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02129, United States; Department of Radiology, Harvard Medical School, Boston, MA 02144, United States.
| | - Suliann Ben Hamed
- Institut des Sciences Cognitives Marc Jeannerod, UMR 5229, Université de Lyon - CNRS, France.
| |
Collapse
|
19
|
Yeshurun Y, Nguyen M, Hasson U. The default mode network: where the idiosyncratic self meets the shared social world. Nat Rev Neurosci 2021; 22:181-192. [PMID: 33483717 PMCID: PMC7959111 DOI: 10.1038/s41583-020-00420-w] [Citation(s) in RCA: 228] [Impact Index Per Article: 76.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/10/2020] [Indexed: 01/29/2023]
Abstract
The default mode network (DMN) is classically considered an 'intrinsic' system, specializing in internally oriented cognitive processes such as daydreaming, reminiscing and future planning. In this Perspective, we suggest that the DMN is an active and dynamic 'sense-making' network that integrates incoming extrinsic information with prior intrinsic information to form rich, context-dependent models of situations as they unfold over time. We review studies that relied on naturalistic stimuli, such as stories and movies, to demonstrate how an individual's DMN neural responses are influenced both by external information accumulated as events unfold over time and by the individual's idiosyncratic past memories and knowledge. The integration of extrinsic and intrinsic information over long timescales provides a space for negotiating a shared neural code, which is necessary for establishing shared meaning, shared communication tools, shared narratives and, above all, shared communities and social networks.
Collapse
Affiliation(s)
- Yaara Yeshurun
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel.
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel.
| | - Mai Nguyen
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
- Department of Psychology, Princeton University, Princeton, NJ, USA
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Uri Hasson
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel.
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel.
- Department of Psychology, Princeton University, Princeton, NJ, USA.
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
| |
Collapse
|
20
|
Dieffenbach MC, Gillespie GSR, Burns SM, McCulloh IA, Ames DL, Dagher MM, Falk EB, Lieberman MD. Neural reference groups: a synchrony-based classification approach for predicting attitudes using fNIRS. Soc Cogn Affect Neurosci 2021; 16:117-128. [PMID: 33025001 PMCID: PMC7812626 DOI: 10.1093/scan/nsaa115] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Revised: 06/19/2020] [Accepted: 09/29/2020] [Indexed: 12/13/2022] Open
Abstract
Social neuroscience research has demonstrated that those who are like-minded are also 'like-brained.' Studies have shown that people who share similar viewpoints have greater neural synchrony with one another, and less synchrony with people who 'see things differently.' Although these effects have been demonstrated at the 'group level,' little work has been done to predict the viewpoints of specific 'individuals' using neural synchrony measures. Furthermore, the studies that have made predictions using synchrony-based classification at the individual level used expensive and immobile neuroimaging equipment (e.g. functional magnetic resonance imaging) in highly controlled laboratory settings, which may not generalize to real-world contexts. Thus, this study uses a simple synchrony-based classification method, which we refer to as the 'neural reference groups' approach, to predict individuals' dispositional attitudes from data collected in a mobile 'pop-up neuroscience' lab. Using functional near-infrared spectroscopy data, we predicted individuals' partisan stances on a sociopolitical issue by comparing their neural timecourses to data from two partisan neural reference groups. We found that partisan stance could be identified at above-chance levels using data from dorsomedial prefrontal cortex. These results indicate that the neural reference groups approach can be used to investigate naturally occurring, dispositional differences anywhere in the world.
Collapse
Affiliation(s)
- Macrina C Dieffenbach
- Annenberg School of Communication, University of Pennsylvania, Philadelphia, Philadelphia, PA 19104, USA
| | - Grace S R Gillespie
- Annenberg School of Communication, University of Pennsylvania, Philadelphia, Philadelphia, PA 19104, USA
| | - Shannon M Burns
- Annenberg School of Communication, University of Pennsylvania, Philadelphia, Philadelphia, PA 19104, USA
| | - Ian A McCulloh
- Accenture Federal Services, 800 N Glebe Rd, Arlington, VA 22203
| | - Daniel L Ames
- Annenberg School of Communication, University of Pennsylvania, Philadelphia, Philadelphia, PA 19104, USA
| | - Munqith M Dagher
- Independent Institute & Administration Civil Society Studies (IIACSS) Research Group, Al Hussam Center 2 270 Arar Mustafa Wahbii Al Tal, Amman, Jordan
| | - Emily B Falk
- Annenberg School of Communication, University of Pennsylvania, Philadelphia, PA 19104, USA, Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA, Wharton Marketing Department, University of Pennsylvania, Philadelphia, PA 19104, USA, University of Pennsylvania
| | - Matthew D Lieberman
- Annenberg School of Communication, University of Pennsylvania, Philadelphia, Philadelphia, PA 19104, USA
| |
Collapse
|
21
|
Movies and narratives as naturalistic stimuli in neuroimaging. Neuroimage 2020; 224:117445. [PMID: 33059053 PMCID: PMC7805386 DOI: 10.1016/j.neuroimage.2020.117445] [Citation(s) in RCA: 54] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2020] [Revised: 10/06/2020] [Accepted: 10/09/2020] [Indexed: 01/06/2023] Open
Abstract
Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.
Collapse
|
22
|
Thiede A, Glerean E, Kujala T, Parkkonen L. Atypical MEG inter-subject correlation during listening to continuous natural speech in dyslexia. Neuroimage 2020; 216:116799. [DOI: 10.1016/j.neuroimage.2020.116799] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Revised: 02/21/2020] [Accepted: 03/30/2020] [Indexed: 10/24/2022] Open
|
23
|
Finn ES, Glerean E, Khojandi AY, Nielson D, Molfese PJ, Handwerker DA, Bandettini PA. Idiosynchrony: From shared responses to individual differences during naturalistic neuroimaging. Neuroimage 2020; 215:116828. [PMID: 32276065 PMCID: PMC7298885 DOI: 10.1016/j.neuroimage.2020.116828] [Citation(s) in RCA: 122] [Impact Index Per Article: 30.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2019] [Revised: 04/02/2020] [Accepted: 04/02/2020] [Indexed: 01/07/2023] Open
Abstract
Two ongoing movements in human cognitive neuroscience have researchers shifting focus from group-level inferences to characterizing single subjects, and complementing tightly controlled tasks with rich, dynamic paradigms such as movies and stories. Yet relatively little work combines these two, perhaps because traditional analysis approaches for naturalistic imaging data are geared toward detecting shared responses rather than between-subject variability. Here, we review recent work using naturalistic stimuli to study individual differences, and advance a framework for detecting structure in idiosyncratic patterns of brain activity, or "idiosynchrony". Specifically, we outline the emerging technique of inter-subject representational similarity analysis (IS-RSA), including its theoretical motivation and an empirical demonstration of how it recovers brain-behavior relationships during movie watching using data from the Human Connectome Project. We also consider how stimulus choice may affect the individual signal and discuss areas for future research. We argue that naturalistic neuroimaging paradigms have the potential to reveal meaningful individual differences above and beyond those observed during traditional tasks or at rest.
Collapse
Affiliation(s)
- Emily S Finn
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA.
| | - Enrico Glerean
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Arman Y Khojandi
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Dylan Nielson
- Mood Brain & Development Unit, National Institute of Mental Health, Bethesda, MD, USA
| | - Peter J Molfese
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Daniel A Handwerker
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| | - Peter A Bandettini
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA
| |
Collapse
|
24
|
Nunes AS, Kozhemiako N, Moiseev A, Seymour RA, Cheung TPL, Ribary U, Doesburg SM. Neuromagnetic activation and oscillatory dynamics of stimulus-locked processing during naturalistic viewing. Neuroimage 2019; 216:116414. [PMID: 31794854 DOI: 10.1016/j.neuroimage.2019.116414] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2019] [Revised: 10/21/2019] [Accepted: 11/27/2019] [Indexed: 10/25/2022] Open
Abstract
Naturalistic stimuli such as watching a movie while in the scanner provide an ecologically valid paradigm that has the potential of extracting valuable information on how the brain processes complex stimuli in realistic visual and auditory contexts. Naturalistic viewing is also easier to conduct with challenging participant groups including patients and children. Given the high temporal resolution of MEG, in the present study, we demonstrate how a short movie clip can be used to map distinguishable activation and connectivity dynamics underlying the processing of specific classes of visual stimuli such as face and hand manipulations, as well as contrasting activation dynamics for auditory words and non-words. MEG data were collected from 22 healthy volunteers (6 females, 3 left handed, mean age - 27.7 ± 5.28 years) during the presentation of naturalistic audiovisual stimuli. The MEG data were split into trials with the onset of the stimuli belonging to classes of interest (words, non-words, faces, hand manipulations). Based on the components of the averaged sensor ERFs time-locked to the visual and auditory stimulus onset, four and three time-windows, respectively, were defined to explore brain activation dynamics. Pseudo-Z, defined as the ratio of the source-projected time-locked power to the projected noise power for each vertex, was computed and used as a proxy of time-locked brain activation. Statistical testing using the mean-centered Partial Least Squares analysis indicated periods where a given visual or auditory stimuli had higher activation. Based on peak pseudo-Z differences between the visual conditions, time-frequency resolved analyses were performed to assess beta band desynchronization in motor-related areas, and inter-trial phase synchronization between face processing areas. Our results provide the first evidence that activation and connectivity dynamics in canonical brain regions associated with the processing of particular classes of visual and auditory stimuli can be reliably mapped using MEG during presentation of naturalistic stimuli. Given the strength of MEG for brain mapping in temporal and frequency domains, the use of naturalistic stimuli may open new techniques in analyzing brain dynamics during ecologically valid sensation and perception.
Collapse
Affiliation(s)
- Adonay S Nunes
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada.
| | - Nataliia Kozhemiako
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada
| | - Alexander Moiseev
- Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada
| | - Robert A Seymour
- Aston Brain Centre, School of Life and Health Sciences, Aston University, Birmingham, UK; Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Teresa P L Cheung
- School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Urs Ribary
- Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada; Department Pediatrics and Psychiatry, University of British Columbia, Vancouver, BC, Canada; B.C. Children's Hospital Research Institute, Vancouver, BC, Canada; Department of Psychology, Simon Fraser University, Burnaby, BC, Canada
| | - Sam M Doesburg
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada; Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada
| |
Collapse
|
25
|
Saalasti S, Alho J, Bar M, Glerean E, Honkela T, Kauppila M, Sams M, Jääskeläinen IP. Inferior parietal lobule and early visual areas support elicitation of individualized meanings during narrative listening. Brain Behav 2019; 9:e01288. [PMID: 30977309 PMCID: PMC6520291 DOI: 10.1002/brb3.1288] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/13/2018] [Revised: 03/11/2019] [Accepted: 03/14/2019] [Indexed: 12/31/2022] Open
Abstract
INTRODUCTION When listening to a narrative, the verbal expressions translate into meanings and flow of mental imagery. However, the same narrative can be heard quite differently based on differences in listeners' previous experiences and knowledge. We capitalized on such differences to disclose brain regions that support transformation of narrative into individualized propositional meanings and associated mental imagery by analyzing brain activity associated with behaviorally assessed individual meanings elicited by a narrative. METHODS Sixteen right-handed female subjects were instructed to list words that best described what had come to their minds while listening to an eight-minute narrative during functional magnetic resonance imaging (fMRI). The fMRI data were analyzed by calculating voxel-wise intersubject correlation (ISC) values. We used latent semantic analysis (LSA) enhanced with Wordnet knowledge to measure semantic similarity of the produced words between subjects. Finally, we predicted the ISC with the semantic similarity using representational similarity analysis. RESULTS We found that semantic similarity in these word listings between subjects, estimated using LSA combined with WordNet knowledge, predicting similarities in brain hemodynamic activity. Subject pairs whose individual semantics were similar also exhibited similar brain activity in the bilateral supramarginal and angular gyrus of the inferior parietal lobe, and in the occipital pole. CONCLUSIONS Our results demonstrate, using a novel method to measure interindividual differences in semantics, brain mechanisms giving rise to semantics and associated imagery during narrative listening. During listening to a captivating narrative, the inferior parietal lobe and early visual cortical areas seem, thus, to support elicitation of individual meanings and flow of mental imagery.
Collapse
Affiliation(s)
- Satu Saalasti
- Department of Psychology and Logopedics, Medical Faculty, University of Helsinki, Helsinki, Finland.,Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland.,Advanced Magnetic Imaging (AMI) Centre, Aalto NeuroImaging, School of Science, Aalto University, Espoo, Finland
| | - Jussi Alho
- Department of Psychology and Logopedics, Medical Faculty, University of Helsinki, Helsinki, Finland.,Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Moshe Bar
- Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
| | - Enrico Glerean
- Department of Psychology and Logopedics, Medical Faculty, University of Helsinki, Helsinki, Finland.,Helsinki Institute of Information Technology, Aalto University, Espoo, Finland.,Department of Digital Humanities, University of Helsinki, Helsinki, Finland
| | - Timo Honkela
- Department of Computer Science, Aalto University School of Science, Espoo, Finland
| | - Minna Kauppila
- Department of Psychology and Logopedics, Medical Faculty, University of Helsinki, Helsinki, Finland
| | - Mikko Sams
- Department of Psychology and Logopedics, Medical Faculty, University of Helsinki, Helsinki, Finland.,Department of Digital Humanities, University of Helsinki, Helsinki, Finland
| | - Iiro P Jääskeläinen
- Department of Psychology and Logopedics, Medical Faculty, University of Helsinki, Helsinki, Finland
| |
Collapse
|