1
|
Cacciamani L, Tomer D, Mylod-Vargas MG, Selcov A, Peterson GA, Oseguera CI, Barbieux A. HD-tDCS to the lateral occipital complex improves haptic object recognition. Exp Brain Res 2024; 242:2113-2124. [PMID: 38970654 DOI: 10.1007/s00221-024-06888-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Accepted: 06/26/2024] [Indexed: 07/08/2024]
Abstract
High-definition transcranial direct current stimulation (HD-tDCS) is a non-invasive brain stimulation technique that has been shown to be safe and effective in modulating neuronal activity. The present study investigates the effect of anodal HD-tDCS on haptic object perception and memory through stimulation of the lateral occipital complex (LOC), a structure that has been shown to be involved in both visual and haptic object recognition. In this single-blind, sham-controlled, between-subjects study, blindfolded healthy, sighted participants used their right (dominant) hand to perform haptic discrimination and recognition tasks with 3D-printed, novel objects called "Greebles" while receiving 20 min of 2 milliamp (mA) anodal stimulation (or sham) to the left or right LOC. Compared to sham, those who received left LOC stimulation (contralateral to the hand used) showed an improvement in haptic object recognition but not discrimination-a finding that was evident from the start of the behavioral tasks. A second experiment showed that this effect was not observed with right LOC stimulation (ipsilateral to the hand used). These results suggest that HD-tDCS to the left LOC can improve recognition of objects perceived via touch. Overall, this work sheds light on the LOC as a multimodal structure that plays a key role in object recognition in both the visual and haptic modalities.
Collapse
Affiliation(s)
- Laura Cacciamani
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA.
| | - Daniel Tomer
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA
| | - Mary Grace Mylod-Vargas
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA
| | - Aaron Selcov
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA
| | - Grace A Peterson
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA
| | - Christopher I Oseguera
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA
| | - Aidan Barbieux
- Department of Psychology and Child Development, California Polytechnic State University, 1 Grand Ave., San Luis Obispo, CA, 93407, USA
| |
Collapse
|
2
|
Lahner B, Dwivedi K, Iamshchinina P, Graumann M, Lascelles A, Roig G, Gifford AT, Pan B, Jin S, Ratan Murty NA, Kay K, Oliva A, Cichy R. Modeling short visual events through the BOLD moments video fMRI dataset and metadata. Nat Commun 2024; 15:6241. [PMID: 39048577 PMCID: PMC11269733 DOI: 10.1038/s41467-024-50310-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 07/04/2024] [Indexed: 07/27/2024] Open
Abstract
Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos' extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.
Collapse
Affiliation(s)
- Benjamin Lahner
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA.
| | - Kshitij Dwivedi
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
- Department of Computer Science, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Polina Iamshchinina
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| | - Monika Graumann
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| | - Alex Lascelles
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA
| | - Gemma Roig
- Department of Computer Science, Goethe University Frankfurt, Frankfurt am Main, Germany
- The Hessian Center for AI (hessian.AI), Darmstadt, Germany
| | | | - Bowen Pan
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA
| | - SouYoung Jin
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA
| | - N Apurva Ratan Murty
- Department of Brain and Cognitive Science, MIT, Cambridge, MA, USA
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Kendrick Kay
- Center for Magnetic Resonance Research (CMRR), Department of Radiology, University of Minnesota, Minneapolis, MN, USA
| | - Aude Oliva
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA
| | - Radoslaw Cichy
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| |
Collapse
|
3
|
Carricarte T, Iamshchinina P, Trampel R, Chaimow D, Weiskopf N, Cichy RM. Laminar dissociation of feedforward and feedback in high-level ventral visual cortex during imagery and perception. iScience 2024; 27:110229. [PMID: 39006482 PMCID: PMC11246059 DOI: 10.1016/j.isci.2024.110229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 01/26/2024] [Accepted: 06/06/2024] [Indexed: 07/16/2024] Open
Abstract
Visual imagery and perception share neural machinery but rely on different information flow. While perception is driven by the integration of sensory feedforward and internally generated feedback information, imagery relies on feedback only. This suggests that although imagery and perception may activate overlapping brain regions, they do so in informationally distinctive ways. Using lamina-resolved MRI at 7 T, we measured the neural activity during imagery and perception of faces and scenes in high-level ventral visual cortex at the mesoscale of laminar organization that distinguishes feedforward from feedback signals. We found distinctive laminar profiles for imagery and perception of scenes and faces in the parahippocampal place area and the fusiform face area, respectively. Our findings provide insight into the neural basis of the phenomenology of visual imagery versus perception and shed new light into the mesoscale organization of feedforward and feedback information flow in high-level ventral visual cortex.
Collapse
Affiliation(s)
- Tony Carricarte
- Department of Education and Psychology, Freie Universität Berlin, 14195 Berlin, Germany
- Einstein Center for Neurosciences Berlin, Charité - Universitätsmedizin Berlin, 10117 Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität zu Berlin, 10117 Berlin, Germany
| | - Polina Iamshchinina
- Princeton Neuroscience Institute, Princeton University, New Jersey 08544, USA
| | - Robert Trampel
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Denis Chaimow
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Nikolaus Weiskopf
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
- Felix Bloch Institute for Solid State Physics, Faculty of Physics and Earth Sciences, Universität Leipzig, 04103 Leipzig, Germany
| | - Radoslaw M. Cichy
- Department of Education and Psychology, Freie Universität Berlin, 14195 Berlin, Germany
- Einstein Center for Neurosciences Berlin, Charité - Universitätsmedizin Berlin, 10117 Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität zu Berlin, 10117 Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, 10117 Berlin, Germany
| |
Collapse
|
4
|
Sütçübaşı B, Bayram A, Metin B, Demiralp T. Neural correlates of approach-avoidance behavior in healthy subjects: Effects of low-frequency repetitive transcranial magnetic stimulation (rTMS) over the right dorsolateral prefrontal cortex. Int J Psychophysiol 2024; 203:112392. [PMID: 39002638 DOI: 10.1016/j.ijpsycho.2024.112392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 07/01/2024] [Accepted: 07/10/2024] [Indexed: 07/15/2024]
Abstract
The dorsolateral prefrontal cortex (dlPFC) is implicated in top-down regulation of emotion, but the detailed network mechanisms require further elucidation. To investigate network-level functions of the dlPFC in emotion regulation, this study measured changes in task-based activation, resting-state and task-based functional connectivity (FC) patterns following suppression of dlPFC excitability by 1-Hz repetitive transcranial magnetic stimulation (rTMS). In a sham-controlled within-subject design, 1-Hz active or sham rTMS was applied to the right dlPFC of 19 healthy volunteers during two separate counterbalanced sessions. Following active and sham rTMS, functional magnetic resonance imaging (fMRI) was conducted in the resting state (rs-fMRI) and during approach-avoidance task responses to pictures with positive and negative emotional content (task-based fMRI). Activation and generalized psychophysiological interaction analyses were performed on task-based fMRI, and seed-based FC analysis was applied to rs-fMRI data. Task-based fMRI revealed greater and more lateralized activation in the right hemisphere during negative picture responses compared to positive picture responses. After active rTMS, greater activation was observed in the left middle prefrontal cortex compared to sham rTMS. Further, rTMS reduced response times and error rates in approach to positive pictures compared to negative pictures. Significant FC changes due to rTMS were observed predominantly in the frontoparietal network (FPN) and visual network (VN) during the task, and in the default mode network (DMN) and VN at rest. Suppression of right dlPFC activity by 1-Hz rTMS alters large-scale neural networks and modulates emotion, supporting potential applications for the treatment of mood disorders.
Collapse
Affiliation(s)
- Bernis Sütçübaşı
- Acibadem University, Faculty of Humanities and Social Sciences, Department of Psychology, Istanbul, Turkey
| | - Ali Bayram
- Istanbul University, Aziz Sancar Institute of Experimental Medicine, Department of Neuroscience, Istanbul, Turkey.
| | - Barış Metin
- Uskudar University, Faculty of Medicine, Department of Neurology, Istanbul, Turkey.
| | - Tamer Demiralp
- Istanbul University, Istanbul Faculty of Medicine, Department of Physiology, Istanbul, Turkey.
| |
Collapse
|
5
|
Kamath RS, Weldon KB, Moser HR, Montoya S, Abdullahi KS, Burton PC, Sponheim SR, Olman CA, Schallmo MP. Impaired contour object perception in psychosis. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.07.02.24309795. [PMID: 39006442 PMCID: PMC11245054 DOI: 10.1101/2024.07.02.24309795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/16/2024]
Abstract
Contour integration, the process of joining spatially separated elements into a single unified line, has consistently been found to be impaired in schizophrenia. Recent work suggests that this deficit could be associated with psychotic symptomatology, rather than a specific diagnosis such as schizophrenia. Examining a transdiagnostic sample of participants with psychotic psychopathology, we obtained quantitative indices of contour perception in a psychophysical behavioral task. We found impaired contour discrimination performance among people with psychotic psychopathology (PwPP, n = 62) compared to healthy controls (n = 34) and biological relatives of PwPP (n = 44). Participants with schizophrenia (n = 31) showed impaired task performance compared to participants with bipolar disorder (n = 18). We also measured responses during an analogous task using ultra-high field (7T) functional MRI and found higher responses in the lateral occipital cortex of PwPP compared to controls. Using task-based functional connectivity analyses, we observed abnormal connectivity between visual brain areas during contour perception among PwPP. These connectivity differences only emerged when participants had to distinguish the contour object from background distractors, suggesting that a failure to suppress noise elements relative to contour elements may underlie impaired contour processing in PwPP. Our results are consistent with impaired contour integration in psychotic psychopathology, and especially schizophrenia, that is related to cognitive dysfunction, and may be linked to impaired functional connectivity across visual regions.
Collapse
Affiliation(s)
- Rohit S. Kamath
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Kimberly B. Weldon
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Hannah R. Moser
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Samantha Montoya
- Graduate Program in Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - Kamar S. Abdullahi
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Philip C. Burton
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Office of the Associate Dean for Research, University of Minnesota, Minneapolis, MN, USA
| | - Scott R. Sponheim
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
- Veterans Affairs Health Care System, Minneapolis, MN, USA
| | - Cheryl A. Olman
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
- Department of Psychology, University of Minnesota, Minneapolis, MN, USA
| | - Michael-Paul Schallmo
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
6
|
Bencze D, Marián M, Szőllősi Á, Pajkossy P, Nemecz Z, Keresztes A, Hermann P, Vidnyánszky Z, Racsmány M. Contribution of the lateral occipital and parahippocampal cortices to pattern separation of objects and contexts. Cereb Cortex 2024; 34:bhae295. [PMID: 39077920 DOI: 10.1093/cercor/bhae295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 06/23/2024] [Indexed: 07/31/2024] Open
Abstract
Contextual features are integral to episodic memories; yet, we know little about context effects on pattern separation, a hippocampal function promoting orthogonalization of overlapping memory representations. Recent studies suggested that various extrahippocampal brain regions support pattern separation; however, the specific role of the parahippocampal cortex-a region involved in context representation-in pattern separation has not yet been studied. Here, we investigated the contribution of the parahippocampal cortex (specifically, the parahippocampal place area) to context reinstatement effects on mnemonic discrimination, using functional magnetic resonance imaging. During scanning, participants saw object images on unique context scenes, followed by a recognition task involving the repetitions of encoded objects or visually similar lures on either their original context or a lure context. Context reinstatement at retrieval improved item recognition but hindered mnemonic discrimination. Crucially, our region of interest analyses of the parahippocampal place area and an object-selective visual area, the lateral occipital cortex indicated that while during successful mnemonic decisions parahippocampal place area activity decreased for old contexts compared to lure contexts irrespective of object novelty, lateral occipital cortex activity differentiated between old and lure objects exclusively. These results imply that pattern separation of contextual and item-specific memory features may be differentially aided by scene and object-selective cortical areas.
Collapse
Affiliation(s)
- Dorottya Bencze
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
| | - Miklós Marián
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
- Institute of Psychology, University of Szeged, Egyetem utca 2., Szeged 6722, Hungary
| | - Ágnes Szőllősi
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
- Cognitive Medicine Research Group, Competence Centre for Neurocybernetics of the Life Sciences Cluster of the Centre of Excellence for Interdisciplinary Research, Development and Innovation of the University of Szeged, University of Szeged, Dugonics tér 13., Szeged 6720, Hungary
| | - Péter Pajkossy
- Cognitive Medicine Research Group, Competence Centre for Neurocybernetics of the Life Sciences Cluster of the Centre of Excellence for Interdisciplinary Research, Development and Innovation of the University of Szeged, University of Szeged, Dugonics tér 13., Szeged 6720, Hungary
- Department of Cognitive Science, Budapest University of Technology and Economics, Egry József utca 1., Budapest 1111, Hungary
| | - Zsuzsanna Nemecz
- Doctoral School of Psychology, ELTE Eötvös Loránd University, Izabella utca 46., Budapest 1064, Hungary
- Brain Imaging Centre, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
- Institute of Psychology, ELTE Eötvös Loránd University, Izabella utca. 46., Budapest 1064, Hungary
| | - Attila Keresztes
- Brain Imaging Centre, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
- Institute of Psychology, ELTE Eötvös Loránd University, Izabella utca. 46., Budapest 1064, Hungary
| | - Petra Hermann
- Brain Imaging Centre, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
| | - Zoltán Vidnyánszky
- Brain Imaging Centre, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
| | - Mihály Racsmány
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Magyar Tudósok Körútja 2, Budapest 1117, Hungary
- Institute of Psychology, University of Szeged, Egyetem utca 2., Szeged 6722, Hungary
- Cognitive Medicine Research Group, Competence Centre for Neurocybernetics of the Life Sciences Cluster of the Centre of Excellence for Interdisciplinary Research, Development and Innovation of the University of Szeged, University of Szeged, Dugonics tér 13., Szeged 6720, Hungary
| |
Collapse
|
7
|
Wang YM, Zhang YY, Wang Y, Cao Q, Zhang M. Task-related brain activation associated with violence in patients with schizophrenia: A meta-analysis. Asian J Psychiatr 2024; 97:104080. [PMID: 38788320 DOI: 10.1016/j.ajp.2024.104080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Revised: 04/20/2024] [Accepted: 04/30/2024] [Indexed: 05/26/2024]
Abstract
This study investigates specific changes in brain function during cognitive and emotional tasks in patients with schizophrenia and a history of violence (VSCZ) compared with non-violent patients with schizophrenia and healthy controls. A comprehensive literature search was conducted at the Web of Science, Medline, and PubMed. Ten studies met the inclusion criteria. In which, eight studies compared brain activation between patients with VSCZ and non-violent patients with schizophrenia, and the former exhibited increased activation at the middle occipital gyrus and rectus compared with the latter. Seven studies compared brain activation between patients with VSCZ and controls, and the former exhibited increased activation at the anterior cingulate cortex, cerebellum VI region, lingual gyrus and fusiform. Subgroup analysis in five studies performing emotional tasks revealed that patients with VSCZ showed increased activation at the middle occipital gyrus compared with non-violent patients with schizophrenia. Our findings suggest that abnormal emotion perception and regulation significantly contribute to the increased risk of violence in patients with schizophrenia. Notably, the middle occipital gyrus and rectus emerge as key neurophysiological correlates associated with this phenomenon.
Collapse
Affiliation(s)
- Yong-Ming Wang
- School of Biology & Basic Medical Sciences, Medical College of Soochow University, Suzhou 215123, China
| | - Yi-Yang Zhang
- The Second Clinical Medical School, Shaanxi University of Chinese Medicine, Xianyang 712046, China
| | - Ying Wang
- School of Biology & Basic Medical Sciences, Medical College of Soochow University, Suzhou 215123, China
| | - Qun Cao
- Koch Institute for Integrative Cancer Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Meng Zhang
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing 100096, China.
| |
Collapse
|
8
|
Lin Y, Hsu YY, Cheng T, Hsiung PC, Wu CW, Hsieh PJ. Neural representations of perspectival shapes and attentional effects: Evidence from fMRI and MEG. Cortex 2024; 176:129-143. [PMID: 38781910 DOI: 10.1016/j.cortex.2024.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 02/14/2024] [Accepted: 04/05/2024] [Indexed: 05/25/2024]
Abstract
Does the human brain represent perspectival shapes, i.e., viewpoint-dependent object shapes, especially in relatively higher-level visual areas such as the lateral occipital cortex? What is the temporal profile of the appearance and disappearance of neural representations of perspectival shapes? And how does attention influence these neural representations? To answer these questions, we employed functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and multivariate decoding techniques to investigate spatiotemporal neural representations of perspectival shapes. Participants viewed rotated objects along with the corresponding objective shapes and perspectival shapes (i.e., rotated round, round, and oval) while we measured their brain activities. Our results revealed that shape classifiers trained on the basic shapes (i.e., round and oval) consistently identified neural representations in the lateral occipital cortex corresponding to the perspectival shapes of the viewed objects regardless of attentional manipulations. Additionally, this classification tendency toward the perspectival shapes emerged approximately 200 ms after stimulus presentation. Moreover, attention influenced the spatial dimension as the regions showing the perspectival shape classification tendency propagated from the occipital lobe to the temporal lobe. As for the temporal dimension, attention led to a more robust and enduring classification tendency towards perspectival shapes. In summary, our study outlines a spatiotemporal neural profile for perspectival shapes that suggests a greater degree of perspectival representation than is often acknowledged.
Collapse
Affiliation(s)
- Yi Lin
- Taiwan International Graduate Program in Interdisciplinary Neuroscience, National Cheng Kung University and Academia Sinica, Nankan, Taipei, Taiwan; Research Unit Brain and Cognition, KU Leuven, Leuven, Belgium.
| | - Yung-Yi Hsu
- Department of Psychology, National Taiwan University, Da'an, Taipei, Taiwan
| | - Tony Cheng
- Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan
| | - Pin-Cheng Hsiung
- Department of Psychology, National Taiwan University, Da'an, Taipei, Taiwan
| | - Chen-Wei Wu
- Department of Philosophy, Georgia State University, Atlanta, GA, USA
| | - Po-Jang Hsieh
- Department of Psychology, National Taiwan University, Da'an, Taipei, Taiwan.
| |
Collapse
|
9
|
Stiles NRB, Choupan J, Ameri H, Patel VR, Shi Y. Visual Cortical Thickness Increases with Prolonged Artificial Vision Restoration. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.06.26.24309493. [PMID: 38978654 PMCID: PMC11230327 DOI: 10.1101/2024.06.26.24309493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/10/2024]
Abstract
The Argus II retinal prosthesis restores visual perception to late blind patients. It has been shown that structural changes occur in the brain due to late-onset blindness, including cortical thinning in visual regions of the brain. Following vision restoration, it is not yet known whether these visual regions are reinvigorated and regain a normal cortical thickness or retain the diminished thickness from blindness. We evaluated the cortical thicknesses of ten Argus II Retinal Prostheses patients, ten blind patients, and thirteen sighted participants. The Argus II patients on average had a thicker left Cuneus Cortex and Lateral Occipital Cortex relative to the blind patients. The duration of the Argus II use (time since implant in active users) significantly partially correlated with thicker visual cortical regions in the left hemisphere. Furthermore, in the two case studies (scanned before and after implantation), the patient with longer device use (44.5 months) had an increase in the cortical thickness of visual regions, whereas the shorter-using patient did not (6.5 months). Finally, a third case, scanned at three time points post-implantation, showed an increase in cortical thickness in the Lateral Occipital Cortex between 43.5 and 57 months, which was maintained even after 3 years of disuse (106 months). Overall, the Argus II patients' cortical thickness was on average significantly rejuvenated in two higher visual regions and, patients using the implant for a longer duration had thicker visual regions. This research raises the possibility of structural plasticity reversing visual cortical atrophy in late-blind patients with prolonged vision restoration.
Collapse
|
10
|
Carretié L, Fernández-Folgueiras U, Kessel D, Alba G, Veiga-Zarza E, Tapia M, Álvarez F. An extremely fast neural mechanism to detect emotional visual stimuli: A two-experiment study. PLoS One 2024; 19:e0299677. [PMID: 38905211 PMCID: PMC11192326 DOI: 10.1371/journal.pone.0299677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Accepted: 05/03/2024] [Indexed: 06/23/2024] Open
Abstract
Defining the brain mechanisms underlying initial emotional evaluation is a key but unexplored clue to understanding affective processing. Event-related potentials (ERPs), especially suited for investigating this issue, were recorded in two experiments (n = 36 and n = 35). We presented emotionally negative (spiders) and neutral (wheels) silhouettes homogenized regarding their visual parameters. In Experiment 1, stimuli appeared at fixation or in the periphery (200 trials per condition and location), the former eliciting a N40 (39 milliseconds) and a P80 (or C1: 80 milliseconds) component, and the latter only a P80. In Experiment 2, stimuli were presented only at fixation (500 trials per condition). Again, an N40 (45 milliseconds) was observed, followed by a P100 (or P1: 105 milliseconds). Analyses revealed significantly greater N40-C1P1 peak-to-peak amplitudes for spiders in both experiments, and ANCOVAs showed that these effects were not explained by C1P1 alone, but that processes underlying N40 significantly contributed. Source analyses pointed to V1 as an N40 focus (more clearly in Experiment 2). Sources for C1P1 included V1 (P80) and V2/LOC (P80 and P100). These results and their timing point to low-order structures (such as visual thalamic nuclei or superior colliculi) or the visual cortex itself, as candidates for initial evaluation structures.
Collapse
Affiliation(s)
- Luis Carretié
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | | | - Dominique Kessel
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - Guzmán Alba
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | | | - Manuel Tapia
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - Fátima Álvarez
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| |
Collapse
|
11
|
Goldstein-Marcusohn Y, Asaad R, Asaad L, Freud E. The large-scale organization of shape processing in the ventral and dorsal pathways is dissociable from attention. Cereb Cortex 2024; 34:bhae221. [PMID: 38832533 PMCID: PMC11148664 DOI: 10.1093/cercor/bhae221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Revised: 05/02/2024] [Accepted: 05/09/2024] [Indexed: 06/05/2024] Open
Abstract
The two visual pathways model posits that visual information is processed through two distinct cortical systems: The ventral pathway promotes visual recognition, while the dorsal pathway supports visuomotor control. Recent evidence suggests the dorsal pathway is also involved in shape processing and may contribute to object perception, but it remains unclear whether this sensitivity is independent of attentional mechanisms that were localized to overlapping cortical regions. To address this question, we conducted two fMRI experiments that utilized different parametric scrambling manipulations in which human participants viewed novel objects in different levels of scrambling and were instructed to attend to either the object or to another aspect of the image (e.g. color of the background). Univariate and multivariate analyses revealed that the large-scale organization of shape selectivity along the dorsal and ventral pathways was preserved regardless of the focus of attention. Attention did modulate shape sensitivity, but these effects were similar across the two pathways. These findings support the idea that shape processing is at least partially dissociable from attentional processes and relies on a distributed set of cortical regions across the visual pathways.
Collapse
Affiliation(s)
- Yael Goldstein-Marcusohn
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| | - Rahaf Asaad
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| | - Leen Asaad
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| | - Erez Freud
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| |
Collapse
|
12
|
Bougou V, Vanhoyland M, Bertrand A, Van Paesschen W, Op De Beeck H, Janssen P, Theys T. Neuronal tuning and population representations of shape and category in human visual cortex. Nat Commun 2024; 15:4608. [PMID: 38816391 PMCID: PMC11139926 DOI: 10.1038/s41467-024-49078-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 05/22/2024] [Indexed: 06/01/2024] Open
Abstract
Object recognition and categorization are essential cognitive processes which engage considerable neural resources in the human ventral visual stream. However, the tuning properties of human ventral stream neurons for object shape and category are virtually unknown. We performed large-scale recordings of spiking activity in human Lateral Occipital Complex in response to stimuli in which the shape dimension was dissociated from the category dimension. Consistent with studies in nonhuman primates, the neuronal representations were primarily shape-based, although we also observed category-like encoding for images of animals. Surprisingly, linear decoders could reliably classify stimulus category even in data sets that were entirely shape-based. In addition, many recording sites showed an interaction between shape and category tuning. These results represent a detailed study on shape and category coding at the neuronal level in the human ventral visual stream, furnishing essential evidence that reconciles human imaging and macaque single-cell studies.
Collapse
Affiliation(s)
- Vasiliki Bougou
- Research Group of Experimental Neurosurgery and Neuroanatomy, Department of Neurosciences, KU Leuven and the Leuven Brain Institute, Leuven, Belgium
- Laboratory for Neuro-and Psychophysiology, Research Group Neurophysiology, Department of Neurosciences, KU Leuven and the Leuven Brain Institute, Leuven, Belgium
| | - Michaël Vanhoyland
- Research Group of Experimental Neurosurgery and Neuroanatomy, Department of Neurosciences, KU Leuven and the Leuven Brain Institute, Leuven, Belgium
- Laboratory for Neuro-and Psychophysiology, Research Group Neurophysiology, Department of Neurosciences, KU Leuven and the Leuven Brain Institute, Leuven, Belgium
- Department of Neurosurgery, University Hospitals Leuven, Leuven, Belgium
| | | | - Wim Van Paesschen
- Department of Neurology, University Hospitals Leuven, Leuven, Belgium
- Laboratory for Epilepsy Research, KU Leuven, Leuven, Belgium
| | - Hans Op De Beeck
- Laboratory Biological Psychology, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Peter Janssen
- Laboratory for Neuro-and Psychophysiology, Research Group Neurophysiology, Department of Neurosciences, KU Leuven and the Leuven Brain Institute, Leuven, Belgium.
| | - Tom Theys
- Research Group of Experimental Neurosurgery and Neuroanatomy, Department of Neurosciences, KU Leuven and the Leuven Brain Institute, Leuven, Belgium
- Department of Neurosurgery, University Hospitals Leuven, Leuven, Belgium
| |
Collapse
|
13
|
Marcar VL, Wolf M. Modulation of the neuronal response in human primary visual cortex by re-entrant projections during retinal input processing as manifest in the visual evoked potential. Heliyon 2024; 10:e30752. [PMID: 38770287 PMCID: PMC11103468 DOI: 10.1016/j.heliyon.2024.e30752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 05/01/2024] [Accepted: 05/03/2024] [Indexed: 05/22/2024] Open
Abstract
Initial deflections in the visual evoked potential (VEP) reflect the neuronal process of extracting features from the retinal input; a process not modulated by re-entrant projections. Later deflections in the VEP reflect the neuronal process of combining features into an object, a process referred to as 'object closure' and modulated by re-entrant projections. Our earlier work indicated that the VEP reflects independent neuronal responses processing temporal - and spatial luminance contrast and that these responses arise from an interaction between forward and re-entrant input. In this earlier work, changing the temporal luminance contrast property of a stimulus altered its spatial luminance contrast property. We recorded the VEP in 12 volunteers viewing image pairs of a windmill, regular dartboard or an RMS dartboard rotated by either Π/4, Π/2, 3Π/4 or Π radians with respect to each other. The windmill and regular dartboard had identical white to black ratio, while the two dartboards identical contrast edges per unit area. Rotation varied temporal luminance contrast of a stimulus without affecting its spatial luminance contrast. N75, P100, N135 and P240 amplitude and latency were compared and a source localisation and temporal frequency analysis performed. P100 amplitude signals a neuronal response processing temporal luminance contrast that is modulated by re-entrant projections with fast axonal conduction velocities. N135 and P240 signal the neuronal response processing spatial luminance contrast and is modulated by re-entrant projections with slow axonal conduction velocities. The dorsal stream is interconnected by fast axonal conduction velocities, the ventral stream by slow axonal conduction velocities.
Collapse
Affiliation(s)
- Valentine L. Marcar
- University Hospital Zürich, Biomedical Optics Research Laboratory (BORL), Frauenklinikstrasse 10, CH-8091, Zürich, Switzerland
- University Hospital Zürich, Comprehensive Cancer Center Zürich (CCCZ), Rämistrasse 100, CH-8091, Zürich, Switzerland
| | - Martin Wolf
- University Hospital Zürich, Biomedical Optics Research Laboratory (BORL), Frauenklinikstrasse 10, CH-8091, Zürich, Switzerland
| |
Collapse
|
14
|
Ficco L, Li C, Kaufmann JM, Schweinberger SR, Kovács GZ. Investigating the neural effects of typicality and predictability for face and object stimuli. PLoS One 2024; 19:e0293781. [PMID: 38776350 PMCID: PMC11111078 DOI: 10.1371/journal.pone.0293781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 02/08/2024] [Indexed: 05/24/2024] Open
Abstract
The brain calibrates itself based on the past stimulus diet, which makes frequently observed stimuli appear as typical (as opposed to uncommon stimuli, which appear as distinctive). Based on predictive processing theory, the brain should be more "prepared" for typical exemplars, because these contain information that has been encountered frequently, allowing it to economically represent items of that category. Thus, one could ask whether predictability and typicality of visual stimuli interact, or rather act in an additive manner. We adapted the design by Egner and colleagues (2010), who used cues to induce expectations about stimulus category (face vs. chair) occurrence during an orthogonal inversion detection task. We measured BOLD responses with fMRI in 35 participants. First, distinctive stimuli always elicited stronger responses than typical ones in all ROIs, and our whole-brain directional contrasts for the effects of typicality and distinctiveness converge with previous findings. Second and importantly, we could not replicate the interaction between category and predictability reported by Egner et al. (2010), which casts doubt on whether cueing designs are ideal to elicit reliable predictability effects. Third, likely as a consequence of the lack of predictability effects, we found no interaction between predictability and typicality in any of the four tested regions (bilateral fusiform face areas, lateral occipital complexes) when considering both categories, nor in the whole brain. We discuss the issue of replicability in neuroscience and sketch an agenda for how future studies might address the same question.
Collapse
Affiliation(s)
- Linda Ficco
- Department of General Psychology and Cognitive Neuroscience, Friedrich Schiller University, Jena, Germany
- Department of Biological Psychology and Cognitive Neurosciences, Friedrich Schiller University, Jena, Germany
- International Max-Planck Research School for the Science of Human History, Jena, Germany
| | - Chenglin Li
- Department of Biological Psychology and Cognitive Neurosciences, Friedrich Schiller University, Jena, Germany
- School of Psychology, Zhejiang Normal University, Jinhua, China
| | - Jürgen M. Kaufmann
- Department of General Psychology and Cognitive Neuroscience, Friedrich Schiller University, Jena, Germany
| | - Stefan R. Schweinberger
- Department of General Psychology and Cognitive Neuroscience, Friedrich Schiller University, Jena, Germany
- International Max-Planck Research School for the Science of Human History, Jena, Germany
| | - Gyula Z. Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Friedrich Schiller University, Jena, Germany
| |
Collapse
|
15
|
Koenig-Robert R, Quek GL, Grootswagers T, Varlet M. Movement trajectories as a window into the dynamics of emerging neural representations. Sci Rep 2024; 14:11499. [PMID: 38769313 PMCID: PMC11106280 DOI: 10.1038/s41598-024-62135-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 05/14/2024] [Indexed: 05/22/2024] Open
Abstract
The rapid transformation of sensory inputs into meaningful neural representations is critical to adaptive human behaviour. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive. Here we show that movement trajectories can be used to measure emerging neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging data via representational similarity analysis (RSA), we show that movement trajectories track the unfolding of stimulus- and category-wise neural representations along key dimensions of the human visual system. We demonstrate that time-resolved representational structures derived from movement trajectories overlap with those derived from M/EEG (albeit delayed) and those derived from fMRI in functionally-relevant brain areas. Our findings highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.
Collapse
Affiliation(s)
- Roger Koenig-Robert
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
| | - Genevieve L Quek
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
| | - Tijl Grootswagers
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, NSW, 2751, Australia
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia.
- School of Psychology, Western Sydney University, Sydney, NSW, 2751, Australia.
| |
Collapse
|
16
|
Holland CM, Alleyne K, Pierre-Louis A, Bansal R, Pollatou A, Barbato K, Cheng B, Hao X, Rosen TS, Peterson BS, Spann MN. Utilizing maternal prenatal cognition as a predictor of newborn brain measures of intellectual development. Child Neuropsychol 2024; 30:582-601. [PMID: 37489806 PMCID: PMC10808270 DOI: 10.1080/09297049.2023.2233155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 06/28/2023] [Indexed: 07/26/2023]
Abstract
Identifying reliable indicators of cognitive functioning prior to age five has been challenging. Prior studies have shown that maternal cognition, as indexed by intellectual quotient (IQ) and years of education, predict child intelligence at school age. We examined whether maternal full scale IQ, education, and inhibitory control (index of executive function) are associated with newborn brain measures and toddler language outcomes to assess potential indicators of early cognition. We hypothesized that maternal indices of cognition would be associated with brain areas implicated in intelligence in school-age children and adults in the newborn period. Thirty-seven pregnant women and their newborns underwent an MRI scan. T2-weighted images and surface-based morphometric analysis were used to compute local brain volumes in newborn infants. Maternal cognition indices were associated with local brain volumes for infants in the anterior and posterior cingulate, occipital lobe, and pre/postcentral gyrus - regions associated with IQ, executive function, or sensori-motor functions in children and adults. Maternal education and executive function, but not maternal intelligence, were associated with toddler language scores at 12 and 24 months. Newborn brain volumes did not predict language scores. Overall, the pre/postcentral gyrus and occipital lobe may be unique indicators of early intellectual development in the newborn period. Given that maternal executive function as measured by inhibitory control has robust associations with the newborn brain and is objective, brief, and easy to administer, it may be a useful predictor of early developmental and cognitive capacity for young children.
Collapse
Affiliation(s)
- Cristin M. Holland
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY
| | - Kiarra Alleyne
- Department of Sociomedical Sciences, Columbia University Mailman School of Public Health, New York, NY
| | - Arline Pierre-Louis
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY
| | - Ravi Bansal
- Institute for the Developing Mind, Children’s Hospital Los Angeles, Los Angeles, CA
- Department of Psychiatry, Keck School of Medicine, University of Southern California, Los Angeles, CA
| | - Angeliki Pollatou
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY
| | - Kristiana Barbato
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY
| | - Bin Cheng
- Columbia University Mailman School of Public Health, New York, NY
| | - Xuejun Hao
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY
| | - Tove S Rosen
- Columbia University Mailman School of Public Health, New York, NY
| | - Bradley S. Peterson
- Institute for the Developing Mind, Children’s Hospital Los Angeles, Los Angeles, CA
- Department of Psychiatry, Keck School of Medicine, University of Southern California, Los Angeles, CA
| | - Marisa N. Spann
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY
- New York State Psychiatric Institute, New York, NY
| |
Collapse
|
17
|
Ferris CS, Inman CS, Hamann S. FMRI correlates of autobiographical memory: Comparing silent retrieval with narrated retrieval. Neuropsychologia 2024; 196:108842. [PMID: 38428520 PMCID: PMC11299904 DOI: 10.1016/j.neuropsychologia.2024.108842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 12/31/2023] [Accepted: 02/25/2024] [Indexed: 03/03/2024]
Abstract
FMRI studies of autobiographical memory (AM) retrieval typically ask subjects to retrieve memories silently to avoid speech-related motion artifacts. Recently, some fMRI studies have started to use overt (spoken) retrieval to probe moment-to-moment retrieved content. However, the extent to which the overt retrieval method alters fMRI activations during retrieval is unknown. Here we examined this question by eliciting unrehearsed AMs during fMRI scanning either overtly or silently, in the same subjects, in different runs. Differences between retrieval modality (silent vs. narrated) included greater activation for silent retrieval in the anterior hippocampus, left angular gyrus, PCC, and superior PFC, and greater activation for narrated retrieval in speech production regions, posterior hippocampus, and the DLPFC. To probe temporal dynamics, we divided each retrieval period into an initial search phase and a later elaboration phase. The activations during the search and elaboration phases were broadly similar regardless of modality, and these activations were in line with previous fMRI studies of AM temporal dynamics employing silent retrieval. For both retrieval modalities, search activated the hippocampus, mPFC, ACC, and PCC, and elaboration activated the left DLPFC and middle temporal gyri. To examine content-specific reactivation during retrieval, the timecourse of narrated memory content was transcribed and modeled. We observed dynamic activation associated with object content in the lateral occipital complex, and activation associated with scene content in the retrosplenial cortex. The current findings show that both silent and narrated AMs activate a broadly similar memory network, with some key differences, and add to current knowledge regarding the content-specific dynamics of AM retrieval. However, these observed differences between retrieval modality suggest that studies using overt retrieval should carefully consider this method's possible effects on cognitive and neural processing.
Collapse
Affiliation(s)
- Charles S Ferris
- Emory University, Department of Psychology, 36 Eagle Row, Atlanta, GA, 30322, USA.
| | - Cory S Inman
- University of Utah, Department of Psychology, 380 S 1530 E Beh S 502, Salt Lake City, UT, 84112, USA.
| | - Stephan Hamann
- Emory University, Department of Psychology, 36 Eagle Row, Atlanta, GA, 30322, USA.
| |
Collapse
|
18
|
Bollo L, Arrambide G, Cobo-Calvo A, Alvarez JV, Alberich M, Cabello S, Castilló J, Galan I, Midaglia LS, Acevedo BR, Zabalza A, Pappolla A, Mongay Ochoa N, Tintore M, Rio J, Comabella M, Tur C, Auger C, Sastre-Garriga J, Rovira A, Montalban X, Pareto D, Vidal-Jordana A. Trans-Synaptic Degeneration in the Visual Pathway in Patients With Myelin Oligodendrocyte Glycoprotein Antibody-Associated Disease. Neurology 2024; 102:e209156. [PMID: 38447105 DOI: 10.1212/wnl.0000000000209156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 11/27/2023] [Indexed: 03/08/2024] Open
Abstract
BACKGROUND AND OBJECTIVES We aimed to assess the presence of retinal neurodegeneration independent of optic neuritis (ON) in myelin oligodendrocyte glycoprotein antibody-associated disease (MOGAD) and to investigate the development of trans-synaptic anterograde degeneration in these patients after ON. METHODS Cross-sectional, retrospective study of 34 adult patients with MOGAD and 23 healthy controls (HC). Clinical, optical coherence tomography (OCT), and MRI data were collected. Peripapillary retinal nerve fiber layer (pRNFL) and ganglion cell inner plexiform layer (GCIPL) were obtained using Heidelberg Spectralis. FreeSurfer7 was used to obtain the lateral geniculate nucleus (LGN), occipital volume fractions (to total estimated intracranial volume), and occipital cortical thickness. For the anterior visual pathway, the analysis was conducted using eyes, classified based on the history of ON (Eye-ON and Eye-NON) and compared with Eye-HC. The analysis of OCT and brain volumetric measures was conducted comparing MOGAD-ON, MOGAD-NON, and HC groups. The analysis of covariance with a Bonferroni-adjusted post hoc test was used to test differences between groups and linear regression analysis to evaluate OCT/MRI associations; age and sex were considered as covariates. RESULTS 24 (70.5%) patients had a prior ON. Median pRNFL and GCIPL thickness (um) was significantly reduced in Eye-ON vs EyeNON and HC (pRNFL: 69.4 (17.3), 89.6 (13.7), 98.2 (11.7), p < 0.001; GCIPL: 55.8 (8.7), 67.39 (8.7), 72.6 (4.5), p < 0.001). pRNFL and GCIPL thickness had a negative correlation with the number of ON episodes (p = 0.025 and p = 0.031, respectively). LGN volume fraction was significantly lower in patients with MOGAD-ON than in HC (0.33 (0.05) vs 0.39 (0.04), p = 0.002). The occipital cortical thickness was lower in MOGAD-ON compared with MOGAD-NON and HC (p = 0.010). In patients with MOGAD-ON, pRNFL correlated with LGN volume (p = 0.006), occipital thickness (p = 0.002), and the medial occipital cortex (p = 0.002), but not the lateral occipital lobe. DISCUSSION Compared with HC, MOGAD-ON exhibits reduced retinal thickness, primarily influenced by the presence and the number of prior ON episodes. Moreover, MOGAD-ON demonstrates significant atrophy in the retinal, subcortical, and cortical regions of the visual pathway, distinguishing them from MOGAD-NON and HC. These findings suggest that in patients with MOGAD neurodegeneration is tightly correlated with damage to the involved pathway.
Collapse
Affiliation(s)
- Luca Bollo
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Georgina Arrambide
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Alvaro Cobo-Calvo
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Javier V Alvarez
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Manel Alberich
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Sergio Cabello
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Joaquín Castilló
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Ingrid Galan
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Luciana S Midaglia
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Breogan Rodriguez Acevedo
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Ana Zabalza
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Agustin Pappolla
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Neus Mongay Ochoa
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Mar Tintore
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Jordi Rio
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Manuel Comabella
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Carmen Tur
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Cristina Auger
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Jaume Sastre-Garriga
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Alex Rovira
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Xavier Montalban
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Deborah Pareto
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| | - Angela Vidal-Jordana
- From the Neurology Department (L.B., G.A., A.C.-C., J.V.A., S.C., J.C., I.G., L.S.M., B.R.A., A.Z., A.P., N.M.O., M.T., J.R., M.C., C.T., J.S.-G., X.M., A.V.-J.), Centro d'Esclerosi Múltiple de Catalunya (Cemcat); and Secció de Neuroradiologia (M.A., C.A., A.R., D.P.), Servei de Radiologia (IDI), Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Spain
| |
Collapse
|
19
|
Lahner B, Mohsenzadeh Y, Mullin C, Oliva A. Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response. PLoS Biol 2024; 22:e3002564. [PMID: 38557761 PMCID: PMC10984539 DOI: 10.1371/journal.pbio.3002564] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 02/26/2024] [Indexed: 04/04/2024] Open
Abstract
Behavioral and neuroscience studies in humans and primates have shown that memorability is an intrinsic property of an image that predicts its strength of encoding into and retrieval from memory. While previous work has independently probed when or where this memorability effect may occur in the human brain, a description of its spatiotemporal dynamics is missing. Here, we used representational similarity analysis (RSA) to combine functional magnetic resonance imaging (fMRI) with source-estimated magnetoencephalography (MEG) to simultaneously measure when and where the human cortex is sensitive to differences in image memorability. Results reveal that visual perception of High Memorable images, compared to Low Memorable images, recruits a set of regions of interest (ROIs) distributed throughout the ventral visual cortex: a late memorability response (from around 300 ms) in early visual cortex (EVC), inferior temporal cortex, lateral occipital cortex, fusiform gyrus, and banks of the superior temporal sulcus. Image memorability magnitude results are represented after high-level feature processing in visual regions and reflected in classical memory regions in the medial temporal lobe (MTL). Our results present, to our knowledge, the first unified spatiotemporal account of visual memorability effect across the human cortex, further supporting the levels-of-processing theory of perception and memory.
Collapse
Affiliation(s)
- Benjamin Lahner
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| | - Yalda Mohsenzadeh
- The Brain and Mind Institute, The University of Western Ontario, London, Canada
- Department of Computer Science, The University of Western Ontario, London, Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada
| | - Caitlin Mullin
- Vision: Science to Application (VISTA), York University, Toronto, Ontario, Canada
| | - Aude Oliva
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| |
Collapse
|
20
|
Marques dos Santos JP, Marques dos Santos JD. Explainable artificial intelligence (xAI) in neuromarketing/consumer neuroscience: an fMRI study on brand perception. Front Hum Neurosci 2024; 18:1305164. [PMID: 38584851 PMCID: PMC10995351 DOI: 10.3389/fnhum.2024.1305164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Accepted: 03/04/2024] [Indexed: 04/09/2024] Open
Abstract
Introduction The research in consumer neuroscience has identified computational methods, particularly artificial intelligence (AI) and machine learning, as a significant frontier for advancement. Previously, we utilized functional magnetic resonance imaging (fMRI) and artificial neural networks (ANNs) to model brain processes related to brand preferences in a paradigm exempted from motor actions. In the current study, we revisit this data, introducing recent advancements in explainable artificial intelligence (xAI) to gain insights into this domain. By integrating fMRI data analysis, machine learning, and xAI, our study aims to search for functional brain networks that support brand perception and, ultimately, search for brain networks that disentangle between preferred and indifferent brands, focusing on the early processing stages. Methods We applied independent component analysis (ICA) to overcome the expected fMRI data's high dimensionality, which raises hurdles in AI applications. We extracted pertinent features from the returned ICs. An ANN is then trained on this data, followed by pruning and retraining processes. We then apply explanation techniques, based on path-weights and Shapley values, to make the network more transparent, explainable, and interpretable, and to obtain insights into the underlying brain processes. Results The fully connected ANN model obtained an accuracy of 54.6%, which dropped to 50.4% after pruning. However, the retraining process allowed it to surpass the fully connected network, achieving an accuracy of 55.9%. The path-weights and Shapley-based analysis concludes that, regarding brand perception, the expected initial participation of the primary visual system is followed. Other brain areas participate in early processing and discriminate between preferred and indifferent brands, such as the cuneal and the lateral occipital cortices. Discussion The most important finding is that a split between processing brands|preferred from brands|indifferent may occur during early processing stages, still in the visual system. However, we found no evidence of a "decision pipeline" that would yield if a brand is preferred or indifferent. The results suggest the existence of a "tagging"-like process in parallel flows in the extrastriate. Network training dynamics aggregate specific processes within the hidden nodes by analyzing the model's hidden layer. This yielded that some nodes contribute to both global brand appraisal and specific brand category classification, shedding light on the neural substrates of decision-making in response to brand stimuli.
Collapse
Affiliation(s)
- José Paulo Marques dos Santos
- Department of Business Administration, University of Maia, Maia, Portugal
- Unit of Experimental Biology, Faculty of Medicine, University of Porto, Porto, Portugal
- LIACC – Artificial Intelligence and Computer Science Laboratory, University of Porto, Porto, Portugal
- NECE-UBI, Research Centre for Business Sciences, University of Beira Interior, Covilhã, Portugal
| | - José Diogo Marques dos Santos
- Faculty of Engineering, University of Porto, Porto, Portugal
- Abel Salazar Biomedical Sciences Institute, University of Porto, Porto, Portugal
| |
Collapse
|
21
|
Thye M, Hoffman P, Mirman D. The neural basis of naturalistic semantic and social cognition. Sci Rep 2024; 14:6796. [PMID: 38514738 PMCID: PMC10957894 DOI: 10.1038/s41598-024-56897-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Accepted: 03/11/2024] [Indexed: 03/23/2024] Open
Abstract
Decoding social environments and engaging meaningfully with other people are critical aspects of human cognition. Multiple cognitive systems, including social and semantic cognition, work alongside each other to support these processes. This study investigated shared processing between social and semantic systems using neuroimaging data collected during movie-viewing, which captures the multimodal environment in which social knowledge is exchanged. Semantic and social content from movie events (event-level) and movie transcripts (word-level) were used in parametric modulation analyses to test (1) the degree to which semantic and social information is processed within each respective network and (2) engagement of the same cross-network regions or the same domain-general hub located within the semantic network during semantic and social processing. Semantic word and event-level content engaged the same fronto-temporo-parietal network and a portion of the semantic hub in the anterior temporal lobe (ATL). Social word and event-level content engaged the supplementary motor area and right angular gyrus within the social network, but only social words engaged the domain-general semantic hub in left ATL. There was evidence of shared processing between the social and semantic systems in the dorsolateral portion of right ATL which was engaged by word and event-level semantic and social content. Overlap between the semantic and social word and event results was highly variable within and across participants, with the most consistent loci of overlap occurring in left inferior frontal, bilateral precentral and supramarginal gyri for social and semantic words and in bilateral superior temporal gyrus extending from ATL posteriorly into supramarginal gyri for social and semantic events. These results indicate a complex pattern of shared and distinct regions for social and semantic cognition during naturalistic processing. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on October 11, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/ACWQY .
Collapse
Affiliation(s)
- Melissa Thye
- Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, UK.
| | - Paul Hoffman
- Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, UK
| | - Daniel Mirman
- Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, UK
| |
Collapse
|
22
|
Fairchild GT, Holler DE, Fabbri S, Gomez MA, Walsh-Snow JC. Naturalistic Object Representations Depend on Distance and Size Cues. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.16.585308. [PMID: 38559105 PMCID: PMC10980039 DOI: 10.1101/2024.03.16.585308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Egocentric distance and real-world size are important cues for object perception and action. Nevertheless, most studies of human vision rely on two-dimensional pictorial stimuli that convey ambiguous distance and size information. Here, we use fMRI to test whether pictures are represented differently in the human brain from real, tangible objects that convey unambiguous distance and size cues. Participants directly viewed stimuli in two display formats (real objects and matched printed pictures of those objects) presented at different egocentric distances (near and far). We measured the effects of format and distance on fMRI response amplitudes and response patterns. We found that fMRI response amplitudes in the lateral occipital and posterior parietal cortices were stronger overall for real objects than for pictures. In these areas and many others, including regions involved in action guidance, responses to real objects were stronger for near vs. far stimuli, whereas distance had little effect on responses to pictures-suggesting that distance determines relevance to action for real objects, but not for pictures. Although stimulus distance especially influenced response patterns in dorsal areas that operate in the service of visually guided action, distance also modulated representations in ventral cortex, where object responses are thought to remain invariant across contextual changes. We observed object size representations for both stimulus formats in ventral cortex but predominantly only for real objects in dorsal cortex. Together, these results demonstrate that whether brain responses reflect physical object characteristics depends on whether the experimental stimuli convey unambiguous information about those characteristics. Significance Statement Classic frameworks of vision attribute perception of inherent object characteristics, such as size, to the ventral visual pathway, and processing of spatial characteristics relevant to action, such as distance, to the dorsal visual pathway. However, these frameworks are based on studies that used projected images of objects whose actual size and distance from the observer were ambiguous. Here, we find that when object size and distance information in the stimulus is less ambiguous, these characteristics are widely represented in both visual pathways. Our results provide valuable new insights into the brain representations of objects and their various physical attributes in the context of naturalistic vision.
Collapse
|
23
|
Morgenstern Y, Storrs KR, Schmidt F, Hartmann F, Tiedemann H, Wagemans J, Fleming RW. High-level aftereffects reveal the role of statistical features in visual shape encoding. Curr Biol 2024; 34:1098-1106.e5. [PMID: 38218184 PMCID: PMC10931819 DOI: 10.1016/j.cub.2023.12.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 11/13/2023] [Accepted: 12/13/2023] [Indexed: 01/15/2024]
Abstract
Visual shape perception is central to many everyday tasks, from object recognition to grasping and handling tools.1,2,3,4,5,6,7,8,9,10 Yet how shape is encoded in the visual system remains poorly understood. Here, we probed shape representations using visual aftereffects-perceptual distortions that occur following extended exposure to a stimulus.11,12,13,14,15,16,17 Such effects are thought to be caused by adaptation in neural populations that encode both simple, low-level stimulus characteristics17,18,19,20 and more abstract, high-level object features.21,22,23 To tease these two contributions apart, we used machine-learning methods to synthesize novel shapes in a multidimensional shape space, derived from a large database of natural shapes.24 Stimuli were carefully selected such that low-level and high-level adaptation models made distinct predictions about the shapes that observers would perceive following adaptation. We found that adaptation along vector trajectories in the high-level shape space predicted shape aftereffects better than simple low-level processes. Our findings reveal the central role of high-level statistical features in the visual representation of shape. The findings also hint that human vision is attuned to the distribution of shapes experienced in the natural environment.
Collapse
Affiliation(s)
- Yaniv Morgenstern
- Erasmus University Rotterdam, Department of Psychology, Burgemeester Oudlaan 50, 3062PA Rotterdam, the Netherlands; University of Leuven (KU Leuven), Brain and Cognition, Tiensestraat 102, 3000 Leuven, Belgium.
| | - Katherine R Storrs
- Justus Liebig University Giessen, Department of Psychology, Otto-Behaghel-Str. 10, 3000 Giessen, Germany; University of Auckland, School of Psychology, 23 Symonds Street, Auckland 1010, New Zealand
| | - Filipp Schmidt
- Justus Liebig University Giessen, Department of Psychology, Otto-Behaghel-Str. 10, 3000 Giessen, Germany; University of Marburg and Justus Liebig University Giessen, Center for Mind, Brain and Behavior (CMBB), Hans-Meerwein-Str. 6, 35032 Marburg, Germany
| | - Frieder Hartmann
- Justus Liebig University Giessen, Department of Psychology, Otto-Behaghel-Str. 10, 3000 Giessen, Germany
| | - Henning Tiedemann
- Justus Liebig University Giessen, Department of Psychology, Otto-Behaghel-Str. 10, 3000 Giessen, Germany
| | - Johan Wagemans
- University of Leuven (KU Leuven), Brain and Cognition, Tiensestraat 102, 3000 Leuven, Belgium
| | - Roland W Fleming
- Justus Liebig University Giessen, Department of Psychology, Otto-Behaghel-Str. 10, 3000 Giessen, Germany; University of Marburg and Justus Liebig University Giessen, Center for Mind, Brain and Behavior (CMBB), Hans-Meerwein-Str. 6, 35032 Marburg, Germany
| |
Collapse
|
24
|
Lyu W, Wu Y, Huynh KM, Ahmad S, Yap PT. A multimodal submillimeter MRI atlas of the human cerebellum. Sci Rep 2024; 14:5622. [PMID: 38453991 PMCID: PMC10920891 DOI: 10.1038/s41598-024-55412-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 02/23/2024] [Indexed: 03/09/2024] Open
Abstract
The human cerebellum is engaged in a broad array of tasks related to motor coordination, cognition, language, attention, memory, and emotional regulation. A detailed cerebellar atlas can facilitate the investigation of the structural and functional organization of the cerebellum. However, existing cerebellar atlases are typically limited to a single imaging modality with insufficient characterization of tissue properties. Here, we introduce a multifaceted cerebellar atlas based on high-resolution multimodal MRI, facilitating the understanding of the neurodevelopment and neurodegeneration of the cerebellum based on cortical morphology, tissue microstructure, and intra-cerebellar and cerebello-cerebral connectivity.
Collapse
Affiliation(s)
- Wenjiao Lyu
- Department of Radiology, University of North Carolina, Chapel Hill, NC, USA
- Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, NC, USA
| | - Ye Wu
- Department of Radiology, University of North Carolina, Chapel Hill, NC, USA
- Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, NC, USA
| | - Khoi Minh Huynh
- Department of Radiology, University of North Carolina, Chapel Hill, NC, USA
- Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, NC, USA
| | - Sahar Ahmad
- Department of Radiology, University of North Carolina, Chapel Hill, NC, USA
- Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, NC, USA
| | - Pew-Thian Yap
- Department of Radiology, University of North Carolina, Chapel Hill, NC, USA.
- Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, NC, USA.
| |
Collapse
|
25
|
Jang H, Tong F. Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks. Nat Commun 2024; 15:1989. [PMID: 38443349 PMCID: PMC10915141 DOI: 10.1038/s41467-024-45679-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 01/30/2024] [Indexed: 03/07/2024] Open
Abstract
Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide multi-faceted neurocomputational evidence that blurry visual experiences may be critical for conferring robustness to biological visual systems.
Collapse
Affiliation(s)
- Hojin Jang
- Department of Psychology, Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA.
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea.
| | - Frank Tong
- Department of Psychology, Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, USA.
| |
Collapse
|
26
|
Ross D, Wagshul ME, Izzetoglu M, Holtzer R. Cortical thickness moderates intraindividual variability in prefrontal cortex activation patterns of older adults during walking. J Int Neuropsychol Soc 2024; 30:117-127. [PMID: 37366047 PMCID: PMC10751394 DOI: 10.1017/s1355617723000371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
OBJECTIVE Increased intraindividual variability (IIV) in behavioral and cognitive performance is a risk factor for adverse outcomes but research concerning hemodynamic signal IIV is limited. Cortical thinning occurs during aging and is associated with cognitive decline. Dual-task walking (DTW) performance in older adults has been related to cognition and neural integrity. We examined the hypothesis that reduced cortical thickness would be associated with greater increases in IIV in prefrontal cortex oxygenated hemoglobin (HbO2) from single tasks to DTW in healthy older adults while adjusting for behavioral performance. METHOD Participants were 55 healthy community-dwelling older adults (mean age = 74.84, standard deviation (SD) = 4.97). Structural MRI was used to quantify cortical thickness. Functional near-infrared spectroscopy (fNIRS) was used to assess changes in prefrontal cortex HbO2 during walking. HbO2 IIV was operationalized as the SD of HbO2 observations assessed during the first 30 seconds of each task. Linear mixed models were used to examine the moderation effect of cortical thickness throughout the cortex on HbO2 IIV across task conditions. RESULTS Analyses revealed that thinner cortex in several regions was associated with greater increases in HbO2 IIV from the single tasks to DTW (ps < .02). CONCLUSIONS Consistent with neural inefficiency, reduced cortical thickness in the PFC and throughout the cerebral cortex was associated with increases in HbO2 IIV from the single tasks to DTW without behavioral benefit. Reduced cortical thickness and greater IIV of prefrontal cortex HbO2 during DTW may be further investigated as risk factors for developing mobility impairments in aging.
Collapse
Affiliation(s)
- Daliah Ross
- Ferkauf Graduate School of Psychology, Yeshiva University, Bronx, NY, USA
| | - Mark E. Wagshul
- Department of Radiology, Gruss Magnetic Resonance Research Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Meltem Izzetoglu
- Department of Electrical and Computer Engineering, Villanova University, Villanova, PA, USA
| | - Roee Holtzer
- Ferkauf Graduate School of Psychology, Yeshiva University, Bronx, NY, USA
- Department of Neurology, Albert Einstein College of Medicine, Bronx, NY, USA
| |
Collapse
|
27
|
Deperrois N, Petrovici MA, Senn W, Jordan J. Learning beyond sensations: How dreams organize neuronal representations. Neurosci Biobehav Rev 2024; 157:105508. [PMID: 38097096 DOI: 10.1016/j.neubiorev.2023.105508] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 12/05/2023] [Accepted: 12/09/2023] [Indexed: 12/25/2023]
Abstract
Semantic representations in higher sensory cortices form the basis for robust, yet flexible behavior. These representations are acquired over the course of development in an unsupervised fashion and continuously maintained over an organism's lifespan. Predictive processing theories propose that these representations emerge from predicting or reconstructing sensory inputs. However, brains are known to generate virtual experiences, such as during imagination and dreaming, that go beyond previously experienced inputs. Here, we suggest that virtual experiences may be just as relevant as actual sensory inputs in shaping cortical representations. In particular, we discuss two complementary learning principles that organize representations through the generation of virtual experiences. First, "adversarial dreaming" proposes that creative dreams support a cortical implementation of adversarial learning in which feedback and feedforward pathways engage in a productive game of trying to fool each other. Second, "contrastive dreaming" proposes that the invariance of neuronal representations to irrelevant factors of variation is acquired by trying to map similar virtual experiences together via a contrastive learning process. These principles are compatible with known cortical structure and dynamics and the phenomenology of sleep thus providing promising directions to explain cortical learning beyond the classical predictive processing paradigm.
Collapse
Affiliation(s)
| | | | - Walter Senn
- Department of Physiology, University of Bern, Bern, Switzerland
| | - Jakob Jordan
- Department of Physiology, University of Bern, Bern, Switzerland; Electrical Engineering, Yale University, New Haven, CT, United States
| |
Collapse
|
28
|
Balducci T, Garza-Villarreal EA, Valencia A, Aleman A, van Tol MJ. Abnormal functional neurocircuitry underpinning emotional processing in fibromyalgia. Eur Arch Psychiatry Clin Neurosci 2024; 274:151-164. [PMID: 36961564 PMCID: PMC10786973 DOI: 10.1007/s00406-023-01578-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 02/20/2023] [Indexed: 03/25/2023]
Abstract
Fibromyalgia, a condition characterized by chronic pain, is frequently accompanied by emotional disturbances. Here we aimed to study brain activation and functional connectivity (FC) during processing of emotional stimuli in fibromyalgia. Thirty female patients with fibromyalgia and 31 female healthy controls (HC) were included. Psychometric tests were administered to measure alexithymia, affective state, and severity of depressive and anxiety symptoms. Next, participants performed an emotion processing and regulation task during functional magnetic resonance imaging (fMRI). We performed a 2 × 2 ANCOVA to analyze main effects and interactions of the stimuli valence (positive or negative) and group (fibromyalgia or HC) on brain activation. Generalized psychophysiological interaction analysis was used to assess task-dependent FC of brain regions previously associated with emotion processing and fibromyalgia (i.e., hippocampus, amygdala, anterior insula, and pregenual anterior cingulate cortex [pACC]). The left superior lateral occipital cortex showed more activation in fibromyalgia during emotion processing than in HC, irrespective of valence. Moreover, we found an interaction effect (valence x group) in the FC between the left pACC and the precentral and postcentral cortex, and central operculum, and premotor cortex. These results suggest abnormal brain activation and connectivity underlying emotion processing in fibromyalgia, which could help explain the high prevalence of psychopathological symptoms in this condition.
Collapse
Affiliation(s)
- Thania Balducci
- Postgraduate Studies Division of the School of Medicine, Medical, Dental and Health Sciences Program, National Autonomous University of Mexico, Mexico city, Mexico
| | - Eduardo A Garza-Villarreal
- Instituto de Neurobiología, Universidad Nacional Autónoma de México Campus Juriquilla, Boulevard Juriquilla 3001, C.P. 76230, Querétaro, QRO, Mexico.
| | - Alely Valencia
- Instituto Nacional de Salud Pública, Cuernavaca, MOR, Mexico
| | - André Aleman
- Department of Biomedical Sciences of Cells and Systems, Cognitive Neuroscience Center, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
- Shenzhen Key Laboratory of Affective and Social Neuroscience, Center for Brain Disorders and Cognitive Sciences, Shenzhen University, Shenzhen, China
| | - Marie-José van Tol
- Department of Biomedical Sciences of Cells and Systems, Cognitive Neuroscience Center, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
29
|
Lurie LA, Rosen ML, Weissman DG, Machlin L, Lengua L, Sheridan MA, McLaughlin KA. Cognitive stimulation as a mechanism linking socioeconomic status and neural function supporting working memory: a longitudinal fMRI study. Cereb Cortex 2024; 34:bhad545. [PMID: 38236725 DOI: 10.1093/cercor/bhad545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 12/12/2023] [Accepted: 12/14/2023] [Indexed: 02/06/2024] Open
Abstract
Childhood experiences of low socioeconomic status are associated with alterations in neural function in the frontoparietal network and ventral visual stream, which may drive differences in working memory. However, the specific features of low socioeconomic status environments that contribute to these disparities remain poorly understood. Here, we examined experiences of cognitive deprivation (i.e. decreased variety and complexity of experience), as opposed to experiences of threat (i.e. violence exposure), as a potential mechanism through which family income contributes to alterations in neural activation during working memory. As part of a longitudinal study, 148 youth between aged 10 and 13 years completed a visuospatial working memory fMRI task. Early childhood low income, chronicity of low income in early childhood, and current income-to-needs were associated with task-related activation in the ventral visual stream and frontoparietal network. The association of family income with decreased activation in the lateral occipital cortex and intraparietal sulcus during working memory was mediated by experiences of cognitive deprivation. Surprisingly, however, family income and deprivation were not significantly related to working memory performance, and only deprivation was associated with academic achievement in this sample. Taken together, these findings suggest that early life low income and associated cognitive deprivation are important factors in neural function supporting working memory.
Collapse
Affiliation(s)
- Lucy A Lurie
- Department of Psychology and Neuroscience, University of North Carolina, 235 E. Cameron Avenue, Chapel Hill, NC 27514, United States
| | - Maya L Rosen
- Program in Neuroscience, Smith College, 44 College Lane, Northampton, MA 01073, United States
- Department of Psychology, Harvard University, 33 Kirkland Street, Cambridge, MA 02138, United States
| | - David G Weissman
- Department of Psychology, Harvard University, 33 Kirkland Street, Cambridge, MA 02138, United States
| | - Laura Machlin
- Department of Psychology, Harvard University, 33 Kirkland Street, Cambridge, MA 02138, United States
| | - Lilliana Lengua
- Department of Psychology, University of Washington, 3921 W. Stevens Way, Seattle, WA 98195, United States
| | - Margaret A Sheridan
- Department of Psychology and Neuroscience, University of North Carolina, 235 E. Cameron Avenue, Chapel Hill, NC 27514, United States
| | - Katie A McLaughlin
- Department of Psychology, Harvard University, 33 Kirkland Street, Cambridge, MA 02138, United States
- The Ballmer Institute for Children's Behavioral Health, University of Oregon, 2800 NE Liberty Street, Portland, OR 97211, United States
| |
Collapse
|
30
|
Sohn W, Di X, Liang Z, Zhang Z, Biswal BB. Explorations of using a convolutional neural network to understand brain activations during movie watching. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.20.576341. [PMID: 38328194 PMCID: PMC10849516 DOI: 10.1101/2024.01.20.576341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
Neuroimaging studies increasingly use naturalistic stimuli like video clips to trigger complex brain activations, but the complexity of such stimuli makes it difficult to assign specific functions to the resulting brain activations, particularly for higher-level content like social interactions. To address this challenge, researchers have turned to deep neural networks, e.g., convolutional neural networks (CNNs). CNNs have shown success in image recognition due to their different levels of features enabling high performance. In this study, we used pre-trained VGG-16, a popular CNN model, to analyze video data and extract hierarchical features from low-level shallow layers to high-level deeper layers, linking these activations to different levels of activation of the human brain. We hypothesized that activations in different layers of VGG-16 would be associated with different levels of brain activation and visual processing hierarchy in the brain. We were also curious about which brain regions would be associated with deeper convolutional layers in VGG-16. The study analyzed a functional MRI (fMRI) dataset where participants watched the cartoon movie Partly Cloudy. Frames of the videos were fed into VGG-16, and activation maps from different kernels and layers were extracted. Time series of the average activation patterns for each kernel were created and fed into a voxel-wise model to study brain activations. Results showed that lower convolutional layers (1st convolutional layer) were mostly associated with lower visual regions, but some kernels (6, 19, 24, 42, 55, and 58) surprisingly showed associations with activations in the posterior cingulate cortex, part of the default mode network. Deeper convolutional layers were associated with more anterior and lateral portions of the visual cortex (e.g., the lateral occipital complex) and the supramarginal gyrus. Analyzing activation features associated with different brain regions showed the promise and limitations of using CNNs to link video content to brain functions.
Collapse
Affiliation(s)
- Wonbum Sohn
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, 07029, USA
- Rutgers Biomedical and Health Sciences, Rutgers School of Graduate Studies, Newark, NJ, 07039, USA
| | - Xin Di
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, 07029, USA
| | - Zhen Liang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China, 518060
| | - Zhiguo Zhang
- School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, 518060, China
| | - Bharat B. Biswal
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, 07029, USA
| |
Collapse
|
31
|
Knight EJ, Altschuler TS, Molholm S, Murphy JW, Freedman EG, Foxe JJ. It's all in the timing: Delayed feedback in autism may weaken predictive mechanisms during contour integration. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.16.575908. [PMID: 38293016 PMCID: PMC10827178 DOI: 10.1101/2024.01.16.575908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2024]
Abstract
Humans rely on predictive mechanisms during visual processing to efficiently resolve incomplete or ambiguous sensory signals. While initial low-level sensory data are conveyed by feedforward connections, feedback connections are believed to shape sensory processing through conveyance of statistical predictions based on prior exposure to stimulus configurations. Individuals with autism spectrum disorder (ASD) show biases in stimulus processing toward parts rather than wholes, suggesting their sensory processing may be less shaped by statistical predictions acquired through prior exposure to global stimulus properties. Investigations of illusory contour (IC) processing in neurotypical (NT) adults have established a well-tested marker of contour integration characterized by a robust modulation of the visually evoked potential (VEP) - the IC-effect - that occurs over lateral occipital scalp during the timeframe of the N1 component. Converging evidence strongly supports the notion that this IC-effect indexes a signal with significant feedback contributions. Using high-density VEPs, we compared the IC-effect in 6-17-year-old children with ASD (n=32) or NT development (n=53). Both groups of children generated an IC-effect that was equivalent in amplitude. However, the IC-effect notably onset 21ms later in ASD, even though timing of initial VEP afference was identical across groups. This suggests that feedforward information predominated during perceptual processing for 15% longer in ASD compared to NT children. This delay in the feedback dependent IC-effect, in the context of known developmental differences between feedforward and feedback fibers, suggests a potential pathophysiological mechanism of visual processing in ASD, whereby ongoing stimulus processing is less shaped by statistical prediction mechanisms.
Collapse
Affiliation(s)
- Emily J. Knight
- The Frederick J. and Marion A. Schindler Cognitive Neurophysiology Laboratory, The Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- Development and Behavioral Pediatrics, Golisano Children’s Hospital, University of Rochester, Rochester, New York, USA
| | - Ted S. Altschuler
- The Cognitive Neurophysiology Laboratory, Department of Pediatrics and Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
- Program in Cognitive Neuroscience, Departments of Psychology & Biology, City College of the City University of New York, New York, USA
| | - Sophie Molholm
- The Cognitive Neurophysiology Laboratory, Department of Pediatrics and Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
- Program in Cognitive Neuroscience, Departments of Psychology & Biology, City College of the City University of New York, New York, USA
| | - Jeremy W. Murphy
- The Cognitive Neurophysiology Laboratory, Department of Pediatrics and Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
- Program in Cognitive Neuroscience, Departments of Psychology & Biology, City College of the City University of New York, New York, USA
- Department of Neuroscience, Brown University, Providence, Rhode Island, USA
| | - Edward G. Freedman
- The Frederick J. and Marion A. Schindler Cognitive Neurophysiology Laboratory, The Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
| | - John J. Foxe
- The Frederick J. and Marion A. Schindler Cognitive Neurophysiology Laboratory, The Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, New York, USA
- The Cognitive Neurophysiology Laboratory, Department of Pediatrics and Neuroscience, Albert Einstein College of Medicine, Bronx, New York, USA
- Program in Cognitive Neuroscience, Departments of Psychology & Biology, City College of the City University of New York, New York, USA
| |
Collapse
|
32
|
Simon SS, Varangis E, Lee S, Gu Y, Gazes Y, Razlighi QR, Habeck C, Stern Y. In vivo tau is associated with change in memory and processing speed, but not reasoning, in cognitively unimpaired older adults. Neurobiol Aging 2024; 133:28-38. [PMID: 38376885 PMCID: PMC10879688 DOI: 10.1016/j.neurobiolaging.2023.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 08/30/2023] [Accepted: 10/01/2023] [Indexed: 02/21/2024]
Abstract
The relationship between tau deposition and cognitive decline in cognitively healthy older adults is still unclear. The tau PET tracer 18F-MK-6240 has shown favorable imaging characteristics to identify early tau deposition in aging. We evaluated the relationship between in vivo tau levels (18F-MK-6240) and retrospective cognitive change over 5 years in episodic memory, processing speed, and reasoning. For tau quantification, a set of regions of interest (ROIs) was selected a priori based on previous literature: (1) total-ROI comprising selected areas, (2) medial temporal lobe-ROI, and (3) lateral temporal lobe-ROI and cingulate/parietal lobe-ROI. Higher tau burden in most ROIs was associated with a steeper decline in memory and speed. There were no associations between tau and reasoning change. The novelty of this finding is that tau burden may affect not only episodic memory, a well-established finding but also processing speed. Our finding reinforces the notion that early tau deposition in areas related to Alzheimer's disease is associated with cognitive decline in cognitively unimpaired individuals, even in a sample with low amyloid-β pathology.
Collapse
Affiliation(s)
- Sharon Sanz Simon
- Cognitive Neuroscience Division, Department of Neurology, Columbia University, Vagelos College of Physicians and Surgeons, New York, NY, USA
| | - Eleanna Varangis
- School of Kinesiology, University of Michigan, Ann Arbor, MI, USA; Concussion Center, University of Michigan, Ann Arbor, MI, USA
| | - Seonjoo Lee
- Department of Biostatistics, Mailman School of Public Health, Columbia University, New York, NY, USA
| | - Yian Gu
- Cognitive Neuroscience Division, Department of Neurology, Columbia University, Vagelos College of Physicians and Surgeons, New York, NY, USA; Department of Epidemiology, Joseph P. Mailman School of Public Health, Columbia University, New York, NY, USA
| | - Yunglin Gazes
- Cognitive Neuroscience Division, Department of Neurology, Columbia University, Vagelos College of Physicians and Surgeons, New York, NY, USA
| | | | - Christian Habeck
- Cognitive Neuroscience Division, Department of Neurology, Columbia University, Vagelos College of Physicians and Surgeons, New York, NY, USA
| | - Yaakov Stern
- Cognitive Neuroscience Division, Department of Neurology, Columbia University, Vagelos College of Physicians and Surgeons, New York, NY, USA.
| |
Collapse
|
33
|
Chai W, Zhang P, Zhang X, Wu J, Chen C, Li F, Xie X, Shi G, Liang J, Zhu C, Dong M. Feasibility study of functional near-infrared spectroscopy in the ventral visual pathway for real-life applications. NEUROPHOTONICS 2024; 11:015002. [PMID: 38192584 PMCID: PMC10773254 DOI: 10.1117/1.nph.11.1.015002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 11/07/2023] [Accepted: 12/14/2023] [Indexed: 01/10/2024]
Abstract
Significance fNIRS-based neuroenhancement depends on the feasible detection of hemodynamic responses in target brain regions. Using the lateral occipital complex (LOC) and the fusiform face area (FFA) in the ventral visual pathway as neurofeedback targets boosts performance in visual recognition. However, the feasibility of utilizing fNIRS to detect LOC and FFA activity in adults remains to be validated as the depth of these regions may exceed the detection limit of fNIRS. Aim This study aims to investigate the feasibility of using fNIRS to measure hemodynamic responses in the ventral visual pathway, specifically in the LOC and FFA, in adults. Approach We recorded the hemodynamic activities of the LOC and FFA regions in 35 subjects using a portable eight-channel fNIRS instrument. A standard one-back object and face recognition task was employed to elicit selective brain responses in the LOC and FFA regions. The placement of fNIRS optodes for LOC and FFA detection was guided by our group's transcranial brain atlas (TBA). Results Our findings revealed selective activation of the LOC target channel (CH2) in response to objects, whereas the FFA target channel (CH7) did not exhibit selective activation in response to faces. Conclusions Our findings indicate that, although fNIRS detection has limitations in capturing FFA activity, the LOC region emerges as a viable target for fNIRS-based detection. Furthermore, our results advocate for the adoption of the TBA-based method for setting the LOC target channel, offering a promising solution for optrode placement. This feasibility study stands as the inaugural validation of fNIRS for detecting cortical activity in the ventral visual pathway, underscoring its ecological validity. We suggest that our findings establish a pivotal technical groundwork for prospective real-life applications of fNIRS-based research.
Collapse
Affiliation(s)
- Weilu Chai
- Xidian University, School of Life Science and Technology, Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
- Xidian University, School of Life Science and Technology, Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, Xi'an, China
- Xidian University, School of Artificial Intelligence, Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xi'an, China
| | - Peiming Zhang
- Xidian University, School of Life Science and Technology, Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
- Xidian University, School of Life Science and Technology, Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, Xi'an, China
| | - Xiaoyan Zhang
- Xidian University, School of Life Science and Technology, Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
- Xidian University, School of Life Science and Technology, Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, Xi'an, China
| | - Jia Wu
- Northwestern Polytechnical University, School of Foreign Languages, Xi'an, China
| | - Chao Chen
- PLA Funding Payment Center, Beijing, China
| | - Fu Li
- Xidian University, School of Artificial Intelligence, Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xi'an, China
| | - Xuemei Xie
- Xidian University, School of Artificial Intelligence, Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xi'an, China
| | - Guangming Shi
- Xidian University, School of Artificial Intelligence, Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xi'an, China
| | - Jimin Liang
- Xidian University, School of Electronics and Engineering, Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xi'an, China
| | - Chaozhe Zhu
- Beijing Normal University, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing, China
| | - Minghao Dong
- Xidian University, School of Life Science and Technology, Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi'an, China
- Xidian University, School of Life Science and Technology, Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, Xi'an, China
- Xidian University, School of Artificial Intelligence, Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xi'an, China
| |
Collapse
|
34
|
Wiese H, Schipper M, Popova T, Burton AM, Young AW. Personal familiarity of faces, animals, objects, and scenes: Distinct perceptual and overlapping conceptual representations. Cognition 2023; 241:105625. [PMID: 37769520 DOI: 10.1016/j.cognition.2023.105625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 06/05/2023] [Accepted: 09/14/2023] [Indexed: 10/03/2023]
Abstract
While face, object, and scene recognition are often studied at a basic categorization level (e.g. "a face", "a car", "a kitchen"), we frequently recognise individual items of these categories as unique entities (e.g. "my mother", "my car", "my kitchen"). This recognition of individual identity is essential to appropriate behaviour in our world. However, relatively little is known about how we recognise individually familiar visual stimuli. Using event-related brain potentials, the present study examined whether and to what extent the underlying neural representations of personally familiar items are similar or different across different categories. In three experiments, we examined the recognition of personally highly familiar faces, animals, indoor scenes, and objects. We observed relatively distinct familiarity effects in an early time window (200-400 ms), with a clearly right-lateralized occipito-temporal scalp distribution for human faces and more bilateral and posterior distributions for other stimulus categories, presumably reflecting access to at least partly discrete visual long-term representations. In contrast, we found clearly overlapping familiarity effects in a later time window (starting 400 to 500 ms after stimulus onset), again with a mainly right occipito-temporal scalp distribution, for all stimulus categories. These later effects appear to reflect the sustained activation of conceptual properties relevant to any potential interaction. We conclude that familiarity for items from the various visual stimulus categories tested here is represented differently at the perceptual level, while relatively overlapping conceptual mechanisms allow for the preparation of impending potential interaction with the environment.
Collapse
|
35
|
Abdelhack M, Zhukovsky P, Milic M, Harita S, Wainberg M, Tripathy SJ, Griffiths JD, Hill SL, Felsky D. Opposing brain signatures of sleep in task-based and resting-state conditions. Nat Commun 2023; 14:7927. [PMID: 38040769 PMCID: PMC10692207 DOI: 10.1038/s41467-023-43737-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 11/17/2023] [Indexed: 12/03/2023] Open
Abstract
Sleep and depression have a complex, bidirectional relationship, with sleep-associated alterations in brain dynamics and structure impacting a range of symptoms and cognitive abilities. Previous work describing these relationships has provided an incomplete picture by investigating only one or two types of sleep measures, depression, or neuroimaging modalities in parallel. We analyze the correlations between brainwide neural signatures of sleep, cognition, and depression in task and resting-state data from over 30,000 individuals from the UK Biobank and Human Connectome Project. Neural signatures of insomnia and depression are negatively correlated with those of sleep duration measured by accelerometer in the task condition but positively correlated in the resting-state condition. Our results show that resting-state neural signatures of insomnia and depression resemble that of rested wakefulness. This is further supported by our finding of hypoconnectivity in task but hyperconnectivity in resting-state data in association with insomnia and depression. These observations dispute conventional assumptions about the neurofunctional manifestations of hyper- and hypo-somnia, and may explain inconsistent findings in the literature.
Collapse
Affiliation(s)
- Mohamed Abdelhack
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | - Peter Zhukovsky
- Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Center for Depression, Anxiety and Stress Research, McLean Hospital, Boston, MA, USA
| | - Milos Milic
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | - Shreyas Harita
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Physiology, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Michael Wainberg
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Prosserman Centre for Population Health Research, Lunenfeld-Tanenbaum Research Institute, Sinai Health, Toronto, ON, Canada
| | - Shreejoy J Tripathy
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Physiology, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
| | - John D Griffiths
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Physiology, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
| | - Sean L Hill
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Physiology, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Vector Institute for Artificial Intelligence, Toronto, ON, Canada
| | - Daniel Felsky
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, ON, Canada.
- Department of Physiology, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada.
- Department of Biostatistics, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.
- Rotman Research Institute, Baycrest Hospital, Toronto, ON, Canada.
| |
Collapse
|
36
|
Schnittjer AJ, Kim H, Lepley AS, Onate JA, Criss CR, Simon JE, Grooms DR. Organization of sensorimotor activity in anterior cruciate ligament reconstructed individuals: an fMRI conjunction analysis. Front Hum Neurosci 2023; 17:1263292. [PMID: 38077185 PMCID: PMC10704895 DOI: 10.3389/fnhum.2023.1263292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Accepted: 10/17/2023] [Indexed: 01/25/2024] Open
Abstract
Introduction Anterior cruciate ligament reconstruction (ACLR) is characterized by persistent involved limb functional deficits that persist for years despite rehabilitation. Previous research provides evidence of both peripheral and central nervous system adaptations following ACLR. However, no study has compared functional organization of the brain for involved limb motor control relative to the uninvolved limb and healthy controls. The purpose of this study was to examine sensorimotor cortex and cerebellar functional activity overlap and non-overlap during a knee motor control task between groups (ACLR and control), and to determine cortical organization of involved and uninvolved limb movement between groups. Methods Eighteen participants with left knee ACLR and 18 control participants performed a knee flexion/extension motor control task during functional magnetic resonance imaging (fMRI). A conjunction analysis was conducted to determine the degree of overlap in brain activity for involved and uninvolved limb knee motor control between groups. Results The ACLR group had a statistically higher mean percent signal change in the sensorimotor cortex for the involved > uninvolved contrast compared to the control group. Brain activity between groups statistically overlapped in sensorimotor regions of the cortex and cerebellum for both group contrasts: involved > uninvolved and uninvolved > involved. Relative to the control group, the ACLR group uniquely activated superior parietal regions (precuneus, lateral occipital cortex) for involved limb motor control. Additionally, for involved limb motor control, the ACLR group displayed a medial and superior shift in peak voxel location in frontal regions; for parietal regions, the ACLR group had a more posterior and superior peak voxel location relative to the control group. Conclusion ACLR may result in unique activation of the sensorimotor cortex via a cortically driven sensory integration strategy to maintain involved limb motor control. The ACLR group's unique brain activity was independent of strength, self-reported knee function, and time from surgery.
Collapse
Affiliation(s)
- Amber J. Schnittjer
- Translational Biomedical Sciences, Graduate College, Ohio University, Athens, OH, United States
- Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, United States
| | - HoWon Kim
- Translational Biomedical Sciences, Graduate College, Ohio University, Athens, OH, United States
- Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, United States
| | - Adam S. Lepley
- School of Kinesiology, Exercise and Sports Science Initiative, University of Michigan, Ann Arbor, MI, United States
| | - James A. Onate
- School of Health and Rehabilitation Sciences, The Ohio State University, Columbus, OH, United States
| | - Cody R. Criss
- OhioHealth Riverside Methodist Hospital, Columbus, OH, United States
| | - Janet E. Simon
- Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, United States
- Division of Athletic Training, School of Applied Health Sciences and Wellness, College of Health Sciences and Professions, Ohio University, Athens, OH, United States
| | - Dustin R. Grooms
- Ohio Musculoskeletal and Neurological Institute (OMNI), Ohio University, Athens, OH, United States
- Division of Physical Therapy, School of Rehabilitation and Communication Sciences, College of Health Sciences and Professions, Ohio University, Athens, OH, United States
| |
Collapse
|
37
|
Popovich C, Grau AS, Shih CH, Chidiac NT, Zhou A, Wang X, Xie H. Changes in fear-associated learning task brain activation over the COVID-19 pandemic period: a preliminary longitudinal analysis. Front Psychiatry 2023; 14:1239697. [PMID: 38076693 PMCID: PMC10699136 DOI: 10.3389/fpsyt.2023.1239697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 10/24/2023] [Indexed: 02/12/2024] Open
Abstract
Background The COVID-19 pandemic has had profound impacts on people worldwide. Previous studies have shown that fear learning, extinction, recall, and contextual information processing involve the activation of emotion and sensory brain systems, which can be modified. However, it remains unclear whether brain functions associated with these processes have been altered over the pandemic period. Methods We compared pre- and peri-pandemic brain activation during a fear-associated learning task (FALT) using previously collected data. The participants were divided into two groups: the pandemic group (n = 16), who completed a baseline FALT before the pandemic and repeated the task during the pandemic, and the non-pandemic group (n = 77), who completed both sessions before the pandemic began. Results Compared with the non-pandemic group, the pandemic group exhibited significant decreases in brain activation from baseline to follow-up assessments, including activation in the brainstem during early fear learning, the posterior thalamus/hippocampus during late extinction, and the occipital pole during late recall phases for contextual processing. Furthermore, activations associated with retrieving safety cues were reduced in the posterior cingulate, premotor, and calcarine cortices during the early recall phase, and activations associated with retrieving dangerous cues decreased in the occipital pole during the late recall phase. Additionally, correlations between decreased activation and elevated posttraumatic stress symptoms were observed. Conclusion These findings suggest that activations associated with processing low arousal contextual information, safety cues, and extinguished fear cues decreased during the pandemic. These changes in brain activation may have contributed to the increase in mental health disturbances observed during this time.
Collapse
Affiliation(s)
- Claire Popovich
- Department of Psychiatry, The University of Toledo, Toledo, OH, United States
| | - Aaron S. Grau
- Department of Psychiatry, The University of Toledo, Toledo, OH, United States
| | - Chia-Hao Shih
- Department of Emergency Medicine, The University of Toledo, Toledo, OH, United States
| | - Neejad T. Chidiac
- Department of Psychiatry, The University of Toledo, Toledo, OH, United States
| | - Adrian Zhou
- Department of Psychiatry, The University of Toledo, Toledo, OH, United States
| | - Xin Wang
- Department of Psychiatry, The University of Toledo, Toledo, OH, United States
| | - Hong Xie
- Department of Neurosciences, The University of Toledo, Toledo, OH, United States
| |
Collapse
|
38
|
Siestrup S, Schubotz RI. Minor Changes Change Memories: Functional Magnetic Resonance Imaging and Behavioral Reflections of Episodic Prediction Errors. J Cogn Neurosci 2023; 35:1823-1845. [PMID: 37677059 DOI: 10.1162/jocn_a_02047] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Episodic memories can be modified, a process that is potentially driven by mnemonic prediction errors. In the present study, we used modified cues to induce prediction errors of different episodic relevance. Participants encoded episodes in the form of short toy stories and then returned for an fMRI session on the subsequent day. Here, participants were presented either original episodes or slightly modified versions thereof. Modifications consisted of replacing a single object within the episode and either challenged the gist of an episode (gist modifications) or left it intact (surface modifications). On the next day, participants completed a post-fMRI memory test that probed memories for originally encoded episodes. Both types of modifications triggered brain activation in regions we previously found to be involved in the processing of content-based mnemonic prediction errors (i.e., the exchange of an object). Specifically, these were ventrolateral pFC, intraparietal cortex, and lateral occipitotemporal cortex. In addition, gist modifications triggered pronounced brain responses, whereas those for surface modification were only significant in the right inferior frontal sulcus. Processing of gist modifications also involved the posterior temporal cortex and the precuneus. Interestingly, our findings confirmed the posterior hippocampal role of detail processing in episodic memory, as evidenced by increased posterior hippocampal activity for surface modifications compared with gist modifications. In the post-fMRI memory test, previous experience with surface modified, but not gist-modified episodes, increased erroneous acceptance of the same modified versions as originally encoded. Whereas surface-level prediction errors might increase uncertainty and facilitate confusion of alternative episode representations, gist-level prediction errors seem to trigger the clear distinction of independent episodes.
Collapse
Affiliation(s)
- Sophie Siestrup
- University of Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany
| | - Ricarda I Schubotz
- University of Münster, Germany
- Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany
| |
Collapse
|
39
|
Han S, Rezanejad M, Walther DB. Memorability of line drawings of scenes: the role of contour properties. Mem Cognit 2023:10.3758/s13421-023-01478-4. [PMID: 37903987 DOI: 10.3758/s13421-023-01478-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/04/2023] [Indexed: 11/01/2023]
Abstract
Why are some images more likely to be remembered than others? Previous work focused on the influence of global, low-level visual features as well as image content on memorability. To better understand the role of local, shape-based contours, we here investigate the memorability of photographs and line drawings of scenes. We find that the memorability of photographs and line drawings of the same scenes is correlated. We quantitatively measure the role of contour properties and their spatial relationships for scene memorability using a Random Forest analysis. To determine whether this relationship is merely correlational or if manipulating these contour properties causes images to be remembered better or worse, we split each line drawing into two half-images, one with high and the other with low predicted memorability according to the trained Random Forest model. In a new memorability experiment, we find that the half-images predicted to be more memorable were indeed remembered better, confirming a causal role of shape-based contour features, and, in particular, T junctions in scene memorability. We performed a categorization experiment on half-images to test for differential access to scene content. We found that half-images predicted to be more memorable were categorized more accurately. However, categorization accuracy for individual images was not correlated with their memorability. These results demonstrate that we can measure the contributions of individual contour properties to scene memorability and verify their causal involvement with targeted image manipulations, thereby bridging the gap between low-level features and scene semantics in our understanding of memorability.
Collapse
Affiliation(s)
- Seohee Han
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, Canada.
| | - Morteza Rezanejad
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, Canada
| | - Dirk B Walther
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, Canada
| |
Collapse
|
40
|
Grégoire L, Robinson TD, Choi JM, Greening SG. Conscious expectancy rather than associative strength elicits brain activity during single-cue fear conditioning. Soc Cogn Affect Neurosci 2023; 18:nsad054. [PMID: 37756616 PMCID: PMC10597625 DOI: 10.1093/scan/nsad054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 07/14/2023] [Accepted: 09/21/2023] [Indexed: 09/29/2023] Open
Abstract
The neurocognitive processes underlying Pavlovian conditioning in humans are still largely debated. The conventional view is that conditioned responses (CRs) emerge automatically as a function of the contingencies between a conditioned stimulus (CS) and an unconditioned stimulus (US). As such, the associative strength model asserts that the frequency or amplitude of CRs reflects the strength of the CS-US associations. Alternatively, the expectation model asserts that the presentation of the CS triggers conscious expectancy of the US, which is responsible for the production of CRs. The present study tested the hypothesis that there are dissociable brain networks related to the expectancy and associative strength theories using a single-cue fear conditioning paradigm with a pseudo-random intermittent reinforcement schedule during functional magnetic resonance imaging. Participants' (n = 21) trial-by-trial expectations of receiving shock displayed a significant linear effect consistent with the expectation model. We also found a positive linear relationship between the expectancy model and activity in frontoparietal brain areas including the dorsolateral prefrontal cortex (PFC) and dorsomedial PFC. While an exploratory analysis found a linear relationship consistent with the associated strength model in the insula and early visual cortex, our primary results are consistent with the view that conscious expectancy contributes to CRs.
Collapse
Affiliation(s)
- Laurent Grégoire
- Department of Psychology, Louisiana State University, Baton Rouge, LA 70803, USA
- Department of Psychology and Brain Sciences, Texas A&M, College Station, TX 77843-4235, USA
| | - Tyler D Robinson
- Department of Psychology, Louisiana State University, Baton Rouge, LA 70803, USA
| | - Jong Moon Choi
- Department of Psychology, Louisiana State University, Baton Rouge, LA 70803, USA
- Statistical Methodology Division, Statistics Research Institute, Daejeon 35208, South Korea
| | - Steven G Greening
- Department of Psychology, Louisiana State University, Baton Rouge, LA 70803, USA
- Department of Psychology, University of Manitoba, Winnipeg R3T 2N2, Canada
| |
Collapse
|
41
|
Gu Z, Jamison K, Sabuncu MR, Kuceyeski A. Human brain responses are modulated when exposed to optimized natural images or synthetically generated images. Commun Biol 2023; 6:1076. [PMID: 37872319 PMCID: PMC10593916 DOI: 10.1038/s42003-023-05440-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 10/10/2023] [Indexed: 10/25/2023] Open
Abstract
Understanding how human brains interpret and process information is important. Here, we investigated the selectivity and inter-individual differences in human brain responses to images via functional MRI. In our first experiment, we found that images predicted to achieve maximal activations using a group level encoding model evoke higher responses than images predicted to achieve average activations, and the activation gain is positively associated with the encoding model accuracy. Furthermore, anterior temporal lobe face area (aTLfaces) and fusiform body area 1 had higher activation in response to maximal synthetic images compared to maximal natural images. In our second experiment, we found that synthetic images derived using a personalized encoding model elicited higher responses compared to synthetic images from group-level or other subjects' encoding models. The finding of aTLfaces favoring synthetic images than natural images was also replicated. Our results indicate the possibility of using data-driven and generative approaches to modulate macro-scale brain region responses and probe inter-individual differences in and functional specialization of the human visual system.
Collapse
Affiliation(s)
- Zijin Gu
- School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY, USA
| | - Keith Jamison
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA
| | - Mert R Sabuncu
- School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY, USA
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA
| | - Amy Kuceyeski
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA.
| |
Collapse
|
42
|
Ganesan S, A Moffat B, Van Dam NT, Lorenzetti V, Zalesky A. Meditation attenuates default-mode activity: A pilot study using ultra-high field 7 Tesla MRI. Brain Res Bull 2023; 203:110766. [PMID: 37734622 DOI: 10.1016/j.brainresbull.2023.110766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 08/10/2023] [Accepted: 09/18/2023] [Indexed: 09/23/2023]
Abstract
OBJECTIVES Mapping the neurobiology of meditation has been bolstered by functional MRI (fMRI) research, with advancements in ultra-high field 7 Tesla fMRI further enhancing signal quality and neuroanatomical resolution. Here, we utilize 7 Tesla fMRI to examine the neural substrates of meditation and replicate existing widespread findings, after accounting for relevant physiological confounds. METHODS In this feasibility study, we scanned 10 beginner meditators (N = 10) while they either attended to breathing (focused attention meditation) or engaged in restful thinking (non-focused rest). We also measured and adjusted the fMRI signal for key physiological differences between meditation and rest. Finally, we explored changes in state mindfulness, state anxiety and focused attention attributes for up to 2 weeks following the single fMRI meditation session. RESULTS Group-level task fMRI analyses revealed significant reductions in activity during meditation relative to rest in default-mode network hubs, i.e., antero-medial prefrontal and posterior cingulate cortices, precuneus, as well as visual and thalamic regions. These findings survived stringent statistical corrections for fluctuations in physiological responses which demonstrated significant differences (p < 0.05/n, Bonferroni controlled) between meditation and rest. Compared to baseline, State Mindfulness Scale (SMS) scores were significantly elevated (F(3,9) = 8.16, p < 0.05/n, Bonferroni controlled) following the fMRI meditation session, and were closely maintained at 2-week follow up. CONCLUSIONS This pilot study establishes the feasibility and utility of investigating focused attention meditation using ultra-high field (7 Tesla) fMRI, by supporting widespread evidence that focused attention meditation attenuates default-mode activity responsible for self-referential processing. Future functional neuroimaging studies of meditation should control for physiological confounds and include behavioural assessments.
Collapse
Affiliation(s)
- Saampras Ganesan
- Melbourne Neuropsychiatry Centre, Carlton, Victoria 3053, Australia; Department of Biomedical Engineering, The University of Melbourne, Carlton, Victoria 3053, Australia; Contemplative Studies Centre, Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Victoria 3010, Australia.
| | - Bradford A Moffat
- Melbourne Brain Centre Imaging Unit, Department of Radiology, The University of Melbourne, Parkville, Victoria 3052, Australia
| | - Nicholas T Van Dam
- Contemplative Studies Centre, Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Victoria 3010, Australia
| | - Valentina Lorenzetti
- Neuroscience of Addiction and Mental Health Program, Healthy Brain and Mind Research Centre, School of Behavioral and Health Sciences, Faculty of Health, Australian Catholic University, Fitzroy, Victoria 3065, Australia
| | - Andrew Zalesky
- Melbourne Neuropsychiatry Centre, Carlton, Victoria 3053, Australia; Department of Biomedical Engineering, The University of Melbourne, Carlton, Victoria 3053, Australia
| |
Collapse
|
43
|
von Gal A, Boccia M, Nori R, Verde P, Giannini AM, Piccardi L. Neural networks underlying visual illusions: An activation likelihood estimation meta-analysis. Neuroimage 2023; 279:120335. [PMID: 37591478 DOI: 10.1016/j.neuroimage.2023.120335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 07/05/2023] [Accepted: 08/14/2023] [Indexed: 08/19/2023] Open
Abstract
Visual illusions have long been used to study visual perception and contextual integration. Neuroimaging studies employ illusions to identify the brain regions involved in visual perception and how they interact. We conducted an Activation Likelihood Estimation (ALE) meta-analysis and meta-analytic connectivity modeling on fMRI studies using static and motion illusions to reveal the neural signatures of illusory processing and to investigate the degree to which different areas are commonly recruited in perceptual inference. The resulting networks encompass ventral and dorsal regions, including the inferior and middle occipital cortices bilaterally in both types of illusions. The static and motion illusion networks selectively included the right posterior parietal cortex and the ventral premotor cortex respectively. Overall, these results describe a network of areas crucially involved in perceptual inference relying on feed-back and feed-forward interactions between areas of the ventral and dorsal visual pathways. The same network is proposed to be involved in hallucinogenic symptoms characteristic of schizophrenia and other disorders, with crucial implications in the use of illusions as biomarkers.
Collapse
Affiliation(s)
| | - Maddalena Boccia
- Department of Psychology, Sapienza University of Rome, Rome, Italy; Cognitive and Motor Rehabilitation and Neuroimaging Unit, IRCCS Fondazione Santa Lucia, Rome, Italy
| | - Raffaella Nori
- Department of Psychology, University of Bologna, Bologna, Italy
| | - Paola Verde
- Italian Air Force Experimental Flight Center, Aerospace Medicine Department, Pratica di Mare, Rome, Italy
| | | | - Laura Piccardi
- Department of Psychology, Sapienza University of Rome, Rome, Italy; San Raffaele Cassino Hospital, Cassino, FR, Italy
| |
Collapse
|
44
|
Malik G, Crowder D, Mingolla E. Extreme image transformations affect humans and machines differently. BIOLOGICAL CYBERNETICS 2023; 117:331-343. [PMID: 37310489 PMCID: PMC10600046 DOI: 10.1007/s00422-023-00968-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 05/26/2023] [Indexed: 06/14/2023]
Abstract
Some recent artificial neural networks (ANNs) claim to model aspects of primate neural and human performance data. Their success in object recognition is, however, dependent on exploiting low-level features for solving visual tasks in a way that humans do not. As a result, out-of-distribution or adversarial input is often challenging for ANNs. Humans instead learn abstract patterns and are mostly unaffected by many extreme image distortions. We introduce a set of novel image transforms inspired by neurophysiological findings and evaluate humans and ANNs on an object recognition task. We show that machines perform better than humans for certain transforms and struggle to perform at par with humans on others that are easy for humans. We quantify the differences in accuracy for humans and machines and find a ranking of difficulty for our transforms for human data. We also suggest how certain characteristics of human visual processing can be adapted to improve the performance of ANNs for our difficult-for-machines transforms.
Collapse
Affiliation(s)
- Girik Malik
- Northeastern University, Boston, MA 02115 USA
| | | | | |
Collapse
|
45
|
Layer N, Abdel-Latif KHA, Radecke JO, Müller V, Weglage A, Lang-Roth R, Walger M, Sandmann P. Effects of noise and noise reduction on audiovisual speech perception in cochlear implant users: An ERP study. Clin Neurophysiol 2023; 154:141-156. [PMID: 37611325 DOI: 10.1016/j.clinph.2023.07.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 06/19/2023] [Accepted: 07/14/2023] [Indexed: 08/25/2023]
Abstract
OBJECTIVE Hearing with a cochlear implant (CI) is difficult in noisy environments, but the use of noise reduction algorithms, specifically ForwardFocus, can improve speech intelligibility. The current event-related potentials (ERP) study examined the electrophysiological correlates of this perceptual improvement. METHODS Ten bimodal CI users performed a syllable-identification task in auditory and audiovisual conditions, with syllables presented from the front and stationary noise presented from the sides. Brainstorm was used for spatio-temporal evaluation of ERPs. RESULTS CI users revealed an audiovisual benefit as reflected by shorter response times and greater activation in temporal and occipital regions at P2 latency. However, in auditory and audiovisual conditions, background noise hampered speech processing, leading to longer response times and delayed auditory-cortex-activation at N1 latency. Nevertheless, activating ForwardFocus resulted in shorter response times, reduced listening effort and enhanced superior-frontal-cortex-activation at P2 latency, particularly in audiovisual conditions. CONCLUSIONS ForwardFocus enhances speech intelligibility in audiovisual speech conditions by potentially allowing the reallocation of attentional resources to relevant auditory speech cues. SIGNIFICANCE This study shows for CI users that background noise and ForwardFocus differentially affect spatio-temporal cortical response patterns, both in auditory and audiovisual speech conditions.
Collapse
Affiliation(s)
- Natalie Layer
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, Audiology and Pediatric Audiology, Cochlear Implant Center, Germany.
| | | | - Jan-Ole Radecke
- Dept. of Psychiatry and Psychotherapy, University of Lübeck, Germany; Center for Brain, Behaviour and Metabolism (CBBM), University of Lübeck, Germany
| | - Verena Müller
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, Audiology and Pediatric Audiology, Cochlear Implant Center, Germany
| | - Anna Weglage
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, Audiology and Pediatric Audiology, Cochlear Implant Center, Germany
| | - Ruth Lang-Roth
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, Audiology and Pediatric Audiology, Cochlear Implant Center, Germany
| | - Martin Walger
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, Audiology and Pediatric Audiology, Cochlear Implant Center, Germany; Jean-Uhrmacher-Institute for Clinical ENT Research, University of Cologne, Germany
| | - Pascale Sandmann
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Otorhinolaryngology, Head and Neck Surgery, Audiology and Pediatric Audiology, Cochlear Implant Center, Germany; Department of Otolaryngology, Head and Neck Surgery, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
46
|
Kim HB, Kim SH, Um YH, Wang SM, Kim REY, Choe YS, Lee J, Kim D, Lim HK, Lee CU, Kang DW. Modulation of associations between education years and cortical volume in Alzheimer's disease vulnerable brain regions by Aβ deposition and APOE ε4 carrier status in cognitively normal older adults. Front Aging Neurosci 2023; 15:1248531. [PMID: 37829142 PMCID: PMC10565031 DOI: 10.3389/fnagi.2023.1248531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 09/05/2023] [Indexed: 10/14/2023] Open
Abstract
Background Education years, as a measure of cognitive reserve, have been shown to affect the progression of Alzheimer's disease (AD), both pathologically and clinically. However, inconsistent results have been reported regarding the association between years of education and intermediate structural changes in AD-vulnerable brain regions, particularly when AD risk factors were not considered during the preclinical phase. Objective This study aimed to examine how Aβ deposition and APOE ε4 carrier status moderate the relationship between years of education and cortical volume in AD-vulnerable regions among cognitively normal older adults. Methods A total of 121 participants underwent structural MRI, [18F] flutemetamol PET-CT imaging, and neuropsychological battery assessment. Multiple regression analysis was conducted to examine the interaction between years of education and the effects of potential modifiers on cortical volume. The associations between cortical volume and neuropsychological performance were further explored in subgroups categorized based on AD risk factors. Results The cortical volume of the left lateral occipital cortex and bilateral fusiform gyrus demonstrated a significant differential association with years of education, depending on the presence of Aβ deposition and APOE ε4 carrier status. Furthermore, a significant relationship between the cortical volume of the bilateral fusiform gyrus and AD-nonspecific cognitive function was predominantly observed in individuals without AD risk factors. Conclusion AD risk factors exerted varying influences on the association between years of education and cortical volume during the preclinical phase. Further investigations into the long-term implications of these findings would enhance our understanding of cognitive reserves in the preclinical stages of AD.
Collapse
Affiliation(s)
- Hak-Bin Kim
- Department of Psychiatry, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Sung-Hwan Kim
- Department of Psychiatry, Yeouido St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Yoo Hyun Um
- Department of Psychiatry, St. Vincent’s Hospital, College of Medicine, The Catholic University of Korea, Suwon, Republic of Korea
| | - Sheng-Min Wang
- Department of Psychiatry, Yeouido St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | | | - Yeong Sim Choe
- Research Institute, NEUROPHET Inc., Seoul, Republic of Korea
| | - Jiyeon Lee
- Research Institute, NEUROPHET Inc., Seoul, Republic of Korea
| | - Donghyeon Kim
- Research Institute, NEUROPHET Inc., Seoul, Republic of Korea
| | - Hyun Kook Lim
- Department of Psychiatry, Yeouido St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
- Research Institute, NEUROPHET Inc., Seoul, Republic of Korea
| | - Chang Uk Lee
- Department of Psychiatry, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Dong Woo Kang
- Department of Psychiatry, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| |
Collapse
|
47
|
Abstract
Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.
Collapse
Affiliation(s)
- Chris B Martin
- Department of Psychology, Florida State University, Tallahassee, Florida, USA;
| | - Morgan D Barense
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada;
- Rotman Research Institute, Baycrest Hospital, Toronto, Ontario, Canada
| |
Collapse
|
48
|
Li C, Ficco L, Trapp S, Rostalski SM, Korn L, Kovács G. The effect of context congruency on fMRI repetition suppression for objects. Neuropsychologia 2023; 188:108603. [PMID: 37270029 DOI: 10.1016/j.neuropsychologia.2023.108603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 05/31/2023] [Accepted: 05/31/2023] [Indexed: 06/05/2023]
Abstract
The recognition of objects is strongly facilitated when they are presented in the context of other objects (Biederman, 1972). Such contexts facilitate perception and induce expectations of context-congruent objects (Trapp and Bar, 2015). The neural mechanisms underlying these facilitatory effects of context on object processing, however, are not yet fully understood. In the present study, we investigate how context-induced expectations affect subsequent object processing. We used functional magnetic resonance imaging and measured repetition suppression as a proxy for prediction error processing. Participants viewed pairs of alternating or repeated object images which were preceded by context-congruent, context-incongruent or neutral cues. We found a stronger repetition suppression in congruent as compared to incongruent or neutral cues in the object sensitive lateral occipital cortex. Interestingly, this stronger effect was driven by enhanced responses to alternating stimulus pairs in the congruent contexts, rather than by suppressed responses to repeated stimulus pairs, which emphasizes the contribution of surprise-related response enhancement for the context modulation on RS when expectations are violated. In addition, in the congruent condition, we discovered significant functional connectivity between object-responsive and frontal cortical regions, as well as between object-responsive regions and the fusiform gyrus. Our findings indicate that prediction errors, reflected in enhanced brain responses to violated contextual expectations, underlie the facilitating effect of context during object perception.
Collapse
Affiliation(s)
- Chenglin Li
- School of Psychology, Zhejiang Normal University, China; Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Linda Ficco
- Department of General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany; Department of Linguistics and Cultural Evolution, International Max Planck Research School for the Science of Human History, Jena, Germany
| | - Sabrina Trapp
- Macromedia University of Applied Sciences, Munich, Germany
| | - Sophie-Marie Rostalski
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Lukas Korn
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany.
| |
Collapse
|
49
|
Chaudhari A, Wang X, Wu A, Liu H. Repeated Transcranial Photobiomodulation with Light-Emitting Diodes Improves Psychomotor Vigilance and EEG Networks of the Human Brain. Bioengineering (Basel) 2023; 10:1043. [PMID: 37760145 PMCID: PMC10525861 DOI: 10.3390/bioengineering10091043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 08/16/2023] [Accepted: 08/29/2023] [Indexed: 09/29/2023] Open
Abstract
Transcranial photobiomodulation (tPBM) has been suggested as a non-invasive neuromodulation tool. The repetitive administration of light-emitting diode (LED)-based tPBM for several weeks significantly improves human cognition. To understand the electrophysiological effects of LED-tPBM on the human brain, we investigated alterations by repeated tPBM in vigilance performance and brain networks using electroencephalography (EEG) in healthy participants. Active and sham LED-based tPBM were administered to the right forehead of young participants twice a week for four weeks. The participants performed a psychomotor vigilance task (PVT) during each tPBM/sham experiment. A 64-electrode EEG system recorded electrophysiological signals from each participant during the first and last visits in a 4-week study. Topographical maps of the EEG power enhanced by tPBM were statistically compared for the repeated tPBM effect. A new data processing framework combining the group's singular value decomposition (gSVD) with eLORETA was implemented to identify EEG brain networks. The reaction time of the PVT in the tPBM-treated group was significantly improved over four weeks compared to that in the sham group. We observed acute increases in EEG delta and alpha powers during a 10 min LED-tPBM while the participants performed the PVT task. We also found that the theta, beta, and gamma EEG powers significantly increased overall after four weeks of LED-tPBM. Combining gSVD with eLORETA enabled us to identify EEG brain networks and the corresponding network power changes by repeated 4-week tPBM. This study clearly demonstrated that a 4-week prefrontal LED-tPBM can neuromodulate several key EEG networks, implying a possible causal effect between modulated brain networks and improved psychomotor vigilance outcomes.
Collapse
Affiliation(s)
| | | | | | - Hanli Liu
- Department of Bioengineering, University of Texas at Arlington, 500 UTA Blvd, Arlington, TX 76019, USA; (A.C.); (X.W.); (A.W.)
| |
Collapse
|
50
|
Sanders DMW, Cowell RA. The locus of recognition memory signals in human cortex depends on the complexity of the memory representations. Cereb Cortex 2023; 33:9835-9849. [PMID: 37401000 DOI: 10.1093/cercor/bhad248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 06/12/2023] [Accepted: 06/14/2023] [Indexed: 07/05/2023] Open
Abstract
According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.
Collapse
Affiliation(s)
- D Merika W Sanders
- Department of Psychology, Harvard University, Cambridge, MA 02138, United States
| | - Rosemary A Cowell
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO 80309, United States
- Department of Psychology & Neuroscience, University of Colorado Boulder, Boulder, CO 80309, United States
| |
Collapse
|