1
|
Masuda Y, Ishikawa H, Ishikawa H, Kezuka T, Miyazaki A, Matsumoto K, Gomi F, Mimura O, Shikishima K, Nakano T, Terao M. Assessment of objective visual function following idebenone administration in patients with leber hereditary optic neuropathy. Jpn J Ophthalmol 2024:10.1007/s10384-024-01077-z. [PMID: 38967874 DOI: 10.1007/s10384-024-01077-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 05/29/2024] [Indexed: 07/06/2024]
Abstract
PURPOSE To objectively assess visual function in Leber's Hereditary Optic Neuropathy (LHON) patients; this study evaluated pre- and post-idebenone treatment changes in primary visual cortical (V1) responses using functional magnetic resonance imaging (fMRI), given the challenges in subjective testing due to central retinal ganglion cell damage. STUDY DESIGN A descriptive study involving four confirmed LHON patients. METHODS Four patients received 900 mg/day of oral idebenone for 24 weeks. Baseline and post-treatment visual acuity, visual fields, and BOLD fMRI responses while passively viewed drifting contrast pattern visual stimuli were compared with self-reported symptoms. RESULTS Post-idebenone, one patient showed positive trends across subjective tests, reported symptoms, and fMRI. Two patients had stable symptoms and fMRI responses; one improved on subjective tests, and another worsened slightly. Another patient improved in visual field tests despite worsening symptoms and fMRI trends. CONCLUSION fMRI may offer a valuable objective measure of visual functions in LHON and appears to be more relevant in assessing symptoms. Further research with more participants is needed to ascertain fMRI's role in developing objective visual assessments and treatment evaluation.
Collapse
Affiliation(s)
- Yoichiro Masuda
- Department of Ophthalmology, The Jikei University School of Medicine, 3-25-8 Nishi-Shinbashi Minato-ku, Tokyo, 105-8461, Japan.
| | - Hiroto Ishikawa
- Department of Ophthalmology, Hyogo Medical University, Nishinomiya, Hyogo, Japan
- Department of Ophthalmology, Mirai Eye and Skin Clinic, Joto-ku, Osaka, Japan
| | - Hitoshi Ishikawa
- Department of Ophthalmology, Kitasato University School of Medicine, Sagamihara, Kanagawa, Japan
| | - Takeshi Kezuka
- Department of Ophthalmology, Tokyo Medical University, Nishi‑Shinjuku, Shinjuku‑ku, Tokyo, Japan
| | | | | | - Fumi Gomi
- Department of Ophthalmology, Hyogo Medical University, Nishinomiya, Hyogo, Japan
| | - Osamu Mimura
- Department of Ophthalmology, Hyogo Medical University, Nishinomiya, Hyogo, Japan
| | - Keigo Shikishima
- Department of Ophthalmology, The Jikei University School of Medicine, 3-25-8 Nishi-Shinbashi Minato-ku, Tokyo, 105-8461, Japan
| | - Tadashi Nakano
- Department of Ophthalmology, The Jikei University School of Medicine, 3-25-8 Nishi-Shinbashi Minato-ku, Tokyo, 105-8461, Japan
| | - Masahiko Terao
- Research Institute for Time Studies, Yamaguchi University, Yamaguchi, Japan
| |
Collapse
|
2
|
Lee Y, Chen J. The relationship between event boundary strength and pattern shifts across the cortical hierarchy during naturalistic movie-viewing. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.10.588931. [PMID: 38645089 PMCID: PMC11030401 DOI: 10.1101/2024.04.10.588931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/23/2024]
Abstract
Our continuous experience is spontaneously segmented by the brain into discrete events. However, the beginning of a new event (an event boundary) is not always sharply identifiable: phenomenologically, event boundaries vary in salience. How are the response profiles of cortical areas at event boundaries modulated by boundary strength during complex, naturalistic movie-viewing? Do cortical responses scale in a graded manner with boundary strength, or do they merely detect boundaries in a binary fashion? We measured "cortical boundary shifts" as transient changes in multi-voxel patterns at event boundaries with different strengths (weak, moderate, and strong), determined by across-subject agreement. Cortical regions with different processing timescales were examined. In auditory areas, which have short timescales, cortical boundary shifts exhibited a clearly graded profile both in group-level and individual-level analyses. In cortical areas with long timescales, including the default mode network, boundary strength modulated pattern shift magnitude at the individual subject level. We also observed a positive relationship between boundary strength and the extent of temporal alignment of boundary shifts across different levels of the cortical hierarchy. Additionally, hippocampal activity was highest at event boundaries for which cortical boundary shifts were most aligned across hierarchical levels. Overall, we found that event boundary strength modulated cortical pattern shifts strongly in sensory areas and more weakly in higher-level areas, and that stronger boundaries were associated with greater alignment of these shifts across the cortical hierarchy.
Collapse
Affiliation(s)
- Yoonjung Lee
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Janice Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA
| |
Collapse
|
3
|
Goldstein-Marcusohn Y, Asaad R, Asaad L, Freud E. The large-scale organization of shape processing in the ventral and dorsal pathways is dissociable from attention. Cereb Cortex 2024; 34:bhae221. [PMID: 38832533 PMCID: PMC11148664 DOI: 10.1093/cercor/bhae221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Revised: 05/02/2024] [Accepted: 05/09/2024] [Indexed: 06/05/2024] Open
Abstract
The two visual pathways model posits that visual information is processed through two distinct cortical systems: The ventral pathway promotes visual recognition, while the dorsal pathway supports visuomotor control. Recent evidence suggests the dorsal pathway is also involved in shape processing and may contribute to object perception, but it remains unclear whether this sensitivity is independent of attentional mechanisms that were localized to overlapping cortical regions. To address this question, we conducted two fMRI experiments that utilized different parametric scrambling manipulations in which human participants viewed novel objects in different levels of scrambling and were instructed to attend to either the object or to another aspect of the image (e.g. color of the background). Univariate and multivariate analyses revealed that the large-scale organization of shape selectivity along the dorsal and ventral pathways was preserved regardless of the focus of attention. Attention did modulate shape sensitivity, but these effects were similar across the two pathways. These findings support the idea that shape processing is at least partially dissociable from attentional processes and relies on a distributed set of cortical regions across the visual pathways.
Collapse
Affiliation(s)
- Yael Goldstein-Marcusohn
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| | - Rahaf Asaad
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| | - Leen Asaad
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| | - Erez Freud
- Department of Psychology and the Centre for Vision Research, York University, 4700 Keele St, Toronto, ON M3J 1P3, Canada
| |
Collapse
|
4
|
Wan Q, Ardalan A, Fulvio JM, Postle BR. Representing Context and Priority in Working Memory. J Cogn Neurosci 2024; 36:1374-1394. [PMID: 38683726 DOI: 10.1162/jocn_a_02166] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
The ability to prioritize among contents in working memory (WM) is critical for successful control of thought and behavior. Recent work has demonstrated that prioritization in WM can be implemented by representing different states of priority in different representational formats. Here, we explored the mechanisms underlying WM prioritization by simulating the double serial retrocuing task with recurrent neural networks. Visualization of stimulus representational dynamics using principal component analysis revealed that the network represented trial context (order of presentation) and priority via different mechanisms. Ordinal context, a stable property lasting the duration of the trial, was accomplished by segregating representations into orthogonal subspaces. Priority, which changed multiple times during a trial, was accomplished by separating representations into different strata within each subspace. We assessed the generality of these mechanisms by applying dimensionality reduction and multiclass decoding to fMRI and EEG data sets and found that priority and context are represented differently along the dorsal visual stream and that behavioral performance is sensitive to trial-by-trial variability of priority coding, but not context coding.
Collapse
|
5
|
Christophel T, Weber S, Yan C, Stopak L, Hetzer S, Haynes JD. Nonfrontal Control of Working Memory. J Cogn Neurosci 2024; 36:1037-1047. [PMID: 38319895 DOI: 10.1162/jocn_a_02127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
Items held in visual working memory can be quickly updated, replaced, removed, and even manipulated in accordance with current behavioral goals. Here, we use multivariate pattern analyses to identify the patterns of neuronal activity that realize the executive control processes supervising these flexible stores. We find that portions of the middle temporal gyrus and the intraparietal sulcus represent what item is cued for continued memorization independently of representations of the item itself. Importantly, this selection-specific activity could not be explained by sensory representations of the cue and is only present when control is exerted. Our results suggest that the selection of memorized items might be controlled in a distributed and decentralized fashion. This evidence provides an alternative perspective to the notion of "domain general" central executive control over memory function.
Collapse
Affiliation(s)
- Thomas Christophel
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
- Humboldt Universität zu Berlin, Department of Psychology, Berlin, Germany
- Humboldt Universität, Berlin School of Mind and Brain, Berlin, Germany
| | - Simon Weber
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
- Humboldt Universität zu Berlin, Department of Psychology, Berlin, Germany
| | - Chang Yan
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Lee Stopak
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Stefan Hetzer
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - John-Dylan Haynes
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
- Humboldt Universität zu Berlin, Department of Psychology, Berlin, Germany
- Humboldt Universität, Berlin School of Mind and Brain, Berlin, Germany
- Cluster of Excellence NeuroCure, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
- SFB 940 Volition and Cognitive Control, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
6
|
Tsantani M, Yon D, Cook R. Neural Representations of Observed Interpersonal Synchrony/Asynchrony in the Social Perception Network. J Neurosci 2024; 44:e2009222024. [PMID: 38527811 PMCID: PMC11097257 DOI: 10.1523/jneurosci.2009-22.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 12/19/2023] [Accepted: 01/10/2024] [Indexed: 03/27/2024] Open
Abstract
The visual perception of individuals is thought to be mediated by a network of regions in the occipitotemporal cortex that supports specialized processing of faces, bodies, and actions. In comparison, we know relatively little about the neural mechanisms that support the perception of multiple individuals and the interactions between them. The present study sought to elucidate the visual processing of social interactions by identifying which regions of the social perception network represent interpersonal synchrony. In an fMRI study with 32 human participants (26 female, 6 male), we used multivoxel pattern analysis to investigate whether activity in face-selective, body-selective, and interaction-sensitive regions across the social perception network supports the decoding of synchronous versus asynchronous head-nodding and head-shaking. Several regions were found to support significant decoding of synchrony/asynchrony, including extrastriate body area (EBA), face-selective and interaction-sensitive mid/posterior right superior temporal sulcus, and occipital face area. We also saw robust cross-classification across actions in the EBA, suggestive of movement-invariant representations of synchrony/asynchrony. Exploratory whole-brain analyses also identified a region of the right fusiform cortex that responded more strongly to synchronous than to asynchronous motion. Critically, perceiving interpersonal synchrony/asynchrony requires the simultaneous extraction and integration of dynamic information from more than one person. Hence, the representation of synchrony/asynchrony cannot be attributed to augmented or additive processing of individual actors. Our findings therefore provide important new evidence that social interactions recruit dedicated visual processing within the social perception network that extends beyond that engaged by the faces and bodies of the constituent individuals.
Collapse
Affiliation(s)
- Maria Tsantani
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, United Kingdom
| | - Daniel Yon
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, United Kingdom
| | - Richard Cook
- School of Psychology, University of Leeds, Leeds LS2 9JU, United Kingdom
- Department of Psychology, University of York, York YO10 5DD, United Kingdom
| |
Collapse
|
7
|
Willbrand EH, Tsai YH, Gagnant T, Weiner KS. Updating the sulcal landscape of the human lateral parieto-occipital junction provides anatomical, functional, and cognitive insights. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.06.08.544284. [PMID: 38798426 PMCID: PMC11118496 DOI: 10.1101/2023.06.08.544284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
Recent work has uncovered relationships between evolutionarily new small and shallow cerebral indentations, or sulci, and human behavior. Yet, this relationship remains unexplored in the lateral parietal cortex (LPC) and the lateral parieto-occipital junction (LPOJ). After defining thousands of sulci in a young adult cohort, we revised the previous LPC/LPOJ sulcal landscape to include four previously overlooked, small, shallow, and variable sulci. One of these sulci (ventral supralateral occipital sulcus, slocs-v) is present in nearly every hemisphere and is morphologically, architecturally, and functionally dissociable from neighboring sulci. A data-driven, model-based approach, relating sulcal depth to behavior further revealed that the morphology of only a subset of LPC/LPOJ sulci, including the slocs-v, is related to performance on a spatial orientation task. Our findings build on classic neuroanatomical theories and identify new neuroanatomical targets for future "precision imaging" studies exploring the relationship among brain structure, brain function, and cognitive abilities in individual participants.
Collapse
Affiliation(s)
- Ethan H. Willbrand
- Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI USA
| | - Yi-Heng Tsai
- Department of Psychology, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Thomas Gagnant
- Medical Science Faculty, University of Bordeaux, Bordeaux, France
| | - Kevin S. Weiner
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
- Department of Neuroscience, University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|
8
|
Li HH, Sprague TC, Yoo AH, Ma WJ, Curtis CE. Neural mechanisms of resource allocation in working memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.11.593695. [PMID: 38766258 PMCID: PMC11100829 DOI: 10.1101/2024.05.11.593695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
To mitigate capacity limits of working memory, people allocate resources according to an item's relevance. However, the neural mechanisms supporting such a critical operation remain unknown. Here, we developed computational neuroimaging methods to decode and demix neural responses associated with multiple items in working memory with different priorities. In striate and extrastriate cortex, the gain of neural responses tracked the priority of memoranda. Higher-priority memoranda were decoded with smaller error and lower uncertainty. Moreover, these neural differences predicted behavioral differences in memory prioritization. Remarkably, trialwise variability in the magnitude of delay activity in frontal cortex predicted differences in decoded precision between low and high-priority items in visual cortex. These results suggest a model in which feedback signals broadcast from frontal cortex sculpt the gain of memory representations in visual cortex according to behavioral relevance, thus, identifying a neural mechanism for resource allocation.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, NY 10003, USA
- Department of Psychology, The Ohio State University, Columbus, OH 43201, USA
- These authors contributed equally
| | - Thomas C Sprague
- Department of Psychology, New York University, New York, NY 10003, USA
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106, USA
- These authors contributed equally
| | - Aspen H Yoo
- Department of Psychology, New York University, New York, NY 10003, USA
| | - Wei Ji Ma
- Department of Psychology, New York University, New York, NY 10003, USA
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Clayton E Curtis
- Department of Psychology, New York University, New York, NY 10003, USA
- Center for Neural Science, New York University, New York, NY 10003, USA
| |
Collapse
|
9
|
Ruiz T, Brown S, Farivar R. Graph Analysis of the Visual Cortical Network during Naturalistic Movie Viewing Reveals Increased Integration and Decreased Segregation Following Mild TBI. Vision (Basel) 2024; 8:33. [PMID: 38804354 PMCID: PMC11130927 DOI: 10.3390/vision8020033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 04/03/2024] [Accepted: 04/18/2024] [Indexed: 05/29/2024] Open
Abstract
Traditional neuroimaging methods have identified alterations in brain activity patterns following mild traumatic brain injury (mTBI), particularly during rest, complex tasks, and normal vision. However, studies using graph theory to examine brain network changes in mTBI have produced varied results, influenced by the specific networks and task demands analyzed. In our study, we employed functional MRI to observe 17 mTBI patients and 54 healthy individuals as they viewed a simple, non-narrative underwater film, simulating everyday visual tasks. This approach revealed significant mTBI-related changes in network connectivity, efficiency, and organization. Specifically, the mTBI group exhibited higher overall connectivity and local network specialization, suggesting enhanced information integration without overwhelming the brain's processing capabilities. Conversely, these patients showed reduced network segregation, indicating a less compartmentalized brain function compared to healthy controls. These patterns were consistent across various visual cortex subnetworks, except in primary visual areas. Our findings highlight the potential of using naturalistic stimuli in graph-based neuroimaging to understand brain network alterations in mTBI and possibly other conditions affecting brain integration.
Collapse
Affiliation(s)
- Tatiana Ruiz
- Department of Ophthalmology & Visual Sciences, McGill University, Montreal, QC H4A 0A4, Canada (S.B.)
- Research Institute of the McGill University Health Center, Montreal, QC H3G 1A4, Canada
| | - Shael Brown
- Department of Ophthalmology & Visual Sciences, McGill University, Montreal, QC H4A 0A4, Canada (S.B.)
- Research Institute of the McGill University Health Center, Montreal, QC H3G 1A4, Canada
| | - Reza Farivar
- Department of Ophthalmology & Visual Sciences, McGill University, Montreal, QC H4A 0A4, Canada (S.B.)
- Research Institute of the McGill University Health Center, Montreal, QC H3G 1A4, Canada
| |
Collapse
|
10
|
Pamir Z, Manley CE, Bauer CM, Bex PJ, Dilks DD, Merabet LB. Visuospatial processing in early brain-based visual impairment is associated with differential recruitment of dorsal and ventral visual streams. Cereb Cortex 2024; 34:bhae203. [PMID: 38795357 DOI: 10.1093/cercor/bhae203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 04/25/2024] [Indexed: 05/27/2024] Open
Abstract
Visuospatial processing impairments are prevalent in individuals with cerebral visual impairment (CVI) and are typically ascribed to "dorsal stream dysfunction" (DSD). However, the contribution of other cortical regions, including early visual cortex (EVC), frontal cortex, or the ventral visual stream, to such impairments remains unknown. Thus, here, we examined fMRI activity in these regions, while individuals with CVI (and neurotypicals) performed a visual search task within a dynamic naturalistic scene. First, behavioral performance was measured with eye tracking. Participants were instructed to search and follow a walking human target. CVI participants took significantly longer to find the target, and their eye gaze patterns were less accurate and less precise. Second, we used the same task in the MRI scanner. Along the dorsal stream, activation was reduced in CVI participants, consistent with the proposed DSD in CVI. Intriguingly, however, visual areas along the ventral stream showed the complete opposite pattern, with greater activation in CVI participants. In contrast, we found no differences in either EVC or frontal cortex between groups. These results suggest that the impaired visuospatial processing abilities in CVI are associated with differential recruitment of the dorsal and ventral visual streams, likely resulting from impaired selective attention.
Collapse
Affiliation(s)
- Zahide Pamir
- Department of Psychology & Department of Neuroscience, Bilkent University, Üniversiteler, Çankaya/Ankara 06800, Turkey
- Aysel Sabuncu Brain Research Center, Bilkent University, Üniversiteler, Çankaya/Ankara 06800, Turkey
| | - Claire E Manley
- The Laboratory for Visual Neuroplasticity, Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, 20 Staniford Street, Boston, MA 02114, USA
| | - Corinna M Bauer
- Lab for Neuroimaging and Vision Science, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, 125 Nashua St. Suite 660, Boston, MA 02114, USA
| | - Peter J Bex
- The Translational Vision Laboratory, Department of Psychology, Northeastern University, 105-107 Forsyth St #125, Boston, MA 02115, USA
| | - Daniel D Dilks
- Department of Psychology, Emory University, 36 Eagle Row, Atlanta, GA 30322, USA
| | - Lotfi B Merabet
- The Laboratory for Visual Neuroplasticity, Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, 20 Staniford Street, Boston, MA 02114, USA
| |
Collapse
|
11
|
Brands AM, Devore S, Devinsky O, Doyle W, Flinker A, Friedman D, Dugan P, Winawer J, Groen IIA. Temporal dynamics of short-term neural adaptation across human visual cortex. PLoS Comput Biol 2024; 20:e1012161. [PMID: 38815000 PMCID: PMC11166327 DOI: 10.1371/journal.pcbi.1012161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 06/11/2024] [Accepted: 05/12/2024] [Indexed: 06/01/2024] Open
Abstract
Neural responses in visual cortex adapt to prolonged and repeated stimuli. While adaptation occurs across the visual cortex, it is unclear how adaptation patterns and computational mechanisms differ across the visual hierarchy. Here we characterize two signatures of short-term neural adaptation in time-varying intracranial electroencephalography (iEEG) data collected while participants viewed naturalistic image categories varying in duration and repetition interval. Ventral- and lateral-occipitotemporal cortex exhibit slower and prolonged adaptation to single stimuli and slower recovery from adaptation to repeated stimuli compared to V1-V3. For category-selective electrodes, recovery from adaptation is slower for preferred than non-preferred stimuli. To model neural adaptation we augment our delayed divisive normalization (DN) model by scaling the input strength as a function of stimulus category, enabling the model to accurately predict neural responses across multiple image categories. The model fits suggest that differences in adaptation patterns arise from slower normalization dynamics in higher visual areas interacting with differences in input strength resulting from category selectivity. Our results reveal systematic differences in temporal adaptation of neural population responses between lower and higher visual brain areas and show that a single computational model of history-dependent normalization dynamics, fit with area-specific parameters, accounts for these differences.
Collapse
Affiliation(s)
| | - Sasha Devore
- New York University Grossman School of Medicine, New York, New York, United States of America
| | - Orrin Devinsky
- New York University Grossman School of Medicine, New York, New York, United States of America
| | - Werner Doyle
- New York University Grossman School of Medicine, New York, New York, United States of America
| | - Adeen Flinker
- New York University Grossman School of Medicine, New York, New York, United States of America
| | - Daniel Friedman
- New York University Grossman School of Medicine, New York, New York, United States of America
| | - Patricia Dugan
- New York University Grossman School of Medicine, New York, New York, United States of America
| | - Jonathan Winawer
- Department of Psychology, New York University, New York, New York, United States of America
| | | |
Collapse
|
12
|
Kamps FS, Chen EM, Kanwisher N, Saxe R. Representation of navigational affordances and ego-motion in the occipital place area. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.30.591964. [PMID: 38746251 PMCID: PMC11092631 DOI: 10.1101/2024.04.30.591964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
Humans effortlessly use vision to plan and guide navigation through the local environment, or "scene". A network of three cortical regions responds selectively to visual scene information, including the occipital (OPA), parahippocampal (PPA), and medial place areas (MPA) - but how this network supports visually-guided navigation is unclear. Recent evidence suggests that one region in particular, the OPA, supports visual representations for navigation, while PPA and MPA support other aspects of scene processing. However, most previous studies tested only static scene images, which lack the dynamic experience of navigating through scenes. We used dynamic movie stimuli to test whether OPA, PPA, and MPA represent two critical kinds of navigationally-relevant information: navigational affordances (e.g., can I walk to the left, right, or both?) and ego-motion (e.g., am I walking forward or backward? turning left or right?). We found that OPA is sensitive to both affordances and ego-motion, as well as the conflict between these cues - e.g., turning toward versus away from an open doorway. These effects were significantly weaker or absent in PPA and MPA. Responses in OPA were also dissociable from those in early visual cortex, consistent with the idea that OPA responses are not merely explained by lower-level visual features. OPA responses to affordances and ego-motion were stronger in the contralateral than ipsilateral visual field, suggesting that OPA encodes navigationally relevant information within an egocentric reference frame. Taken together, these results support the hypothesis that OPA contains visual representations that are useful for planning and guiding navigation through scenes.
Collapse
|
13
|
Bo K, Kraynak TE, Kwon M, Sun M, Gianaros PJ, Wager TD. A systems identification approach using Bayes factors to deconstruct the brain bases of emotion regulation. Nat Neurosci 2024; 27:975-987. [PMID: 38519748 DOI: 10.1038/s41593-024-01605-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 02/15/2024] [Indexed: 03/25/2024]
Abstract
Cognitive reappraisal is fundamental to cognitive therapies and everyday emotion regulation. Analyses using Bayes factors and an axiomatic systems identification approach identified four reappraisal-related components encompassing distributed neural activity patterns across two independent functional magnetic resonance imaging (fMRI) studies (n = 182 and n = 176): (1) an anterior prefrontal system selectively involved in cognitive reappraisal; (2) a fronto-parietal-insular system engaged by both reappraisal and emotion generation, demonstrating a general role in appraisal; (3) a largely subcortical system activated during negative emotion generation but unaffected by reappraisal, including amygdala, hypothalamus and periaqueductal gray; and (4) a posterior cortical system of negative emotion-related regions downregulated by reappraisal. These systems covaried with individual differences in reappraisal success and were differentially related to neurotransmitter binding maps, implicating cannabinoid and serotonin systems in reappraisal. These findings challenge 'limbic'-centric models of reappraisal and provide new systems-level targets for assessing and enhancing emotion regulation.
Collapse
Affiliation(s)
- Ke Bo
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Thomas E Kraynak
- Department of Epidemiology, University of Pittsburgh, Pittsburgh, PA, USA
| | - Mijin Kwon
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Michael Sun
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Peter J Gianaros
- Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Tor D Wager
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
14
|
Li H, Hu D, Tanigawa H, Takahata T. Topographic organization across foveal visual areas in macaques. Front Neuroanat 2024; 18:1389067. [PMID: 38741760 PMCID: PMC11089224 DOI: 10.3389/fnana.2024.1389067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Accepted: 04/08/2024] [Indexed: 05/16/2024] Open
Abstract
Introduction While the fovea on the retina covers only a small region of the visual field, a significant portion of the visual cortex is dedicated to processing information from the fovea being a critical center for object recognition, motion control, and visually guided attention. Despite its importance, prior functional imaging studies in awake monkeys often focused on the parafoveal visual field, potentially leading to inaccuracies in understanding the brain structure underlying function. Methods In this study, our aim is to unveil the neuronal connectivity and topography in the foveal visual cortex in comparison to the parafoveal visual cortex. Using four different types of retrograde tracers, we selectively injected them into the striate cortex (V1) or V4, encompassing the regions between the fovea and parafovea. Results V1 and V4 exhibited intense mutual connectivity in the foveal visual field, in contrast to the parafoveal visual field, possibly due to the absence of V3 in the foveal visual field. While previous live brain imaging studies failed to reveal retinotopy in the foveal visual fields, our results indicate that the foveal visual fields have continuous topographic connectivity across V1 through V4, as well as the parafoveal visual fields. Although a simple extension of the retinotopic isoeccentricity maps from V1 to V4 has been suggested from previous fMRI studies, our study demonstrated that V3 and V4 possess gradually smaller topographic maps compared to V1 and V2. Feedback projections to foveal V1 primarily originate from the infragranular layers of foveal V2 and V4, while feedforward projections to foveal V4 arise from both supragranular and infragranular layers of foveal V1 and V2, consistent with previous findings in the parafoveal visual fields. Discussion This study provides valuable insights into the connectivity of the foveal visual cortex, which was ambiguous in previous imaging studies.
Collapse
Affiliation(s)
- Hangqi Li
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China
- Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China
| | - Danling Hu
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China
- Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China
| | - Hisashi Tanigawa
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China
- Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China
| | - Toru Takahata
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China
- Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China
- Department of Neurology of the Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
| |
Collapse
|
15
|
Tu Y, Li X, Lu ZL, Wang Y. Adaptive smoothing of retinotopic maps based on Teichmüller parametrization. Med Image Anal 2024; 93:103074. [PMID: 38160658 DOI: 10.1016/j.media.2023.103074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Revised: 12/20/2023] [Accepted: 12/21/2023] [Indexed: 01/03/2024]
Abstract
Retinotopic mapping, the mapping between visual inputs on the retina and neural responses on the cortical surface, is one of the fundamental topics in visual neuroscience. In human studies, retinotopic maps are conventionally constructed and processed by decoding blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to designed visual stimuli on the cortical surface. However, these methods frequently generate retinotopic maps that do not preserve topology, contradicting a fundamental property of retinotopic maps observed in neurophysiology. To address this problem, we propose an integrated approach to simultaneously refine the flattening from the 3D cortical surface to the 2D parametric space and adaptively smooth retinotopic perception centers in the visual space to make the retinotopic maps topological. One key element of the approach is the enhanced error tolerant Teichmüller mapping, which refines the parametrization by minimizing angle distortions and maximizing alignment to noisy landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets and applied it to compute cortical magnification factor (CMF). The results showed that the proposed approach was superior to other conventional retinotopic mapping methods in predicting BOLD fMRI time series and preserving topology.
Collapse
Affiliation(s)
- Yanshuai Tu
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA
| | - Xin Li
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA
| | - Zhong-Lin Lu
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China; Center for Neural Science and Department of Psychology, New York University, New York, NY, USA; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China.
| | - Yalin Wang
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA.
| |
Collapse
|
16
|
Jung Y, Hsu D, Dilks DD. "Walking selectivity" in the occipital place area in 8-year-olds, not 5-year-olds. Cereb Cortex 2024; 34:bhae101. [PMID: 38494889 PMCID: PMC10945045 DOI: 10.1093/cercor/bhae101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 02/20/2024] [Accepted: 02/21/2024] [Indexed: 03/19/2024] Open
Abstract
A recent neuroimaging study in adults found that the occipital place area (OPA)-a cortical region involved in "visually guided navigation" (i.e. moving about the immediately visible environment, avoiding boundaries, and obstacles)-represents visual information about walking, not crawling, suggesting that OPA is late developing, emerging only when children are walking, not beforehand. But when precisely does this "walking selectivity" in OPA emerge-when children first begin to walk in early childhood, or perhaps counterintuitively, much later in childhood, around 8 years of age, when children are adult-like walking? To directly test these two hypotheses, using functional magnetic resonance imaging (fMRI) in two groups of children, 5- and 8-year-olds, we measured the responses in OPA to first-person perspective videos through scenes from a "walking" perspective, as well as three control perspectives ("crawling," "flying," and "scrambled"). We found that the OPA in 8-year-olds-like adults-exhibited walking selectivity (i.e. responding significantly more to the walking videos than to any of the others, and no significant differences across the crawling, flying, and scrambled videos), while the OPA in 5-year-olds exhibited no walking selectively. These findings reveal that OPA undergoes protracted development, with walking selectivity only emerging around 8 years of age.
Collapse
Affiliation(s)
- Yaelan Jung
- Department of Psychology, Emory University, Atlanta, GA 30322, USA
| | - Debbie Hsu
- Department of Psychology, Emory University, Atlanta, GA 30322, USA
| | - Daniel D Dilks
- Department of Psychology, Emory University, Atlanta, GA 30322, USA
| |
Collapse
|
17
|
Nara S, Kaiser D. Integrative processing in artificial and biological vision predicts the perceived beauty of natural images. SCIENCE ADVANCES 2024; 10:eadi9294. [PMID: 38427730 PMCID: PMC10906925 DOI: 10.1126/sciadv.adi9294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 01/29/2024] [Indexed: 03/03/2024]
Abstract
Previous research shows that the beauty of natural images is already determined during perceptual analysis. However, it is unclear which perceptual computations give rise to the perception of beauty. Here, we tested whether perceived beauty is predicted by spatial integration across an image, a perceptual computation that reduces processing demands by aggregating image parts into more efficient representations of the whole. We quantified integrative processing in an artificial deep neural network model, where the degree of integration was determined by the amount of deviation between activations for the whole image and its constituent parts. This quantification of integration predicted beauty ratings for natural images across four studies with different stimuli and designs. In a complementary functional magnetic resonance imaging study, we show that integrative processing in human visual cortex similarly predicts perceived beauty. Together, our results establish integration as a computational principle that facilitates perceptual analysis and thereby mediates the perception of beauty.
Collapse
Affiliation(s)
- Sanjeev Nara
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus Liebig University Gießen, Gießen Germany
| | - Daniel Kaiser
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus Liebig University Gießen, Gießen Germany
- Center for Mind, Brain and Behavior (CMBB), Philipps-University Marburg and Justus Liebig University Gießen, Marburg, Germany
| |
Collapse
|
18
|
Zang Z, Chi X, Luan M, Hu S, Zhou K, Liu J. Inter-individual, hemispheric and sex variability of brain activations during numerosity processing. Brain Struct Funct 2024; 229:459-475. [PMID: 38197958 PMCID: PMC10917853 DOI: 10.1007/s00429-023-02747-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Accepted: 12/04/2023] [Indexed: 01/11/2024]
Abstract
Numerosity perception is a fundamental and innate cognitive function shared by both humans and many animal species. Previous research has primarily focused on exploring the spatial and functional consistency of neural activations that were associated with the processing of numerosity information. However, the inter-individual variability of brain activations of numerosity perception remains unclear. In the present study, with a large-sample functional magnetic resonance imaging (fMRI) dataset (n = 460), we aimed to localize the functional regions related to numerosity perceptions and explore the inter-individual, hemispheric, and sex differences within these brain regions. Fifteen subject-specific activated regions, including the anterior intraparietal sulcus (aIPS), posterior intraparietal sulcus (pIPS), insula, inferior frontal gyrus (IFG), inferior temporal gyrus (ITG), premotor area (PM), middle occipital gyrus (MOG) and anterior cingulate cortex (ACC), were delineated in each individual and then used to create a functional probabilistic atlas to quantify individual variability in brain activations of numerosity processing. Though the activation percentages of most regions were higher than 60%, the intersections of most regions across individuals were considerably lower, falling below 50%, indicating substantial variations in brain activations related to numerosity processing among individuals. Furthermore, significant hemispheric and sex differences in activation location, extent, and magnitude were also found in these regions. Most activated regions in the right hemisphere had larger activation volumes and activation magnitudes, and were located more lateral and anterior than their counterparts in the left hemisphere. In addition, in most of these regions, males displayed stronger activations than females. Our findings demonstrate large inter-individual, hemispheric, and sex differences in brain activations related to numerosity processing, and our probabilistic atlas can serve as a robust functional and spatial reference for mapping the numerosity-related neural networks.
Collapse
Affiliation(s)
- Zhongyao Zang
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, 100875, China
| | - Xiaoyue Chi
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, 100875, China
| | - Mengkai Luan
- Department of Psychology, Shanghai University of Sport, 650 Qing Yuan Huan Road, Shanghai, 200438, People's Republic of China
| | - Siyuan Hu
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, 100875, China.
| | - Ke Zhou
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, 100875, China.
| | - Jia Liu
- Tsinghua Laboratory of Brain and Intelligence, Department of Psychology, Tsinghua University, Beijing, 100084, China
| |
Collapse
|
19
|
Yablonski M, Karipidis II, Kubota E, Yeatman JD. The transition from vision to language: Distinct patterns of functional connectivity for subregions of the visual word form area. Hum Brain Mapp 2024; 45:e26655. [PMID: 38488471 PMCID: PMC10941549 DOI: 10.1002/hbm.26655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 12/22/2023] [Accepted: 02/26/2024] [Indexed: 03/18/2024] Open
Abstract
Reading entails transforming visual symbols to sound and meaning. This process depends on specialized circuitry in the visual cortex, the visual word form area (VWFA). Recent findings suggest that this text-selective cortex comprises at least two distinct subregions: the more posterior VWFA-1 is sensitive to visual features, while the more anterior VWFA-2 processes higher level language information. Here, we explore whether these two subregions also exhibit different patterns of functional connectivity. To this end, we capitalize on two complementary datasets: Using the Natural Scenes Dataset (NSD), we identify text-selective responses in high-quality 7T adult data (N = 8), and investigate functional connectivity patterns of VWFA-1 and VWFA-2 at the individual level. We then turn to the Healthy Brain Network (HBN) database to assess whether these patterns replicate in a large developmental sample (N = 224; age 6-20 years), and whether they relate to reading development. In both datasets, we find that VWFA-1 is primarily correlated with bilateral visual regions. In contrast, VWFA-2 is more strongly correlated with language regions in the frontal and lateral parietal lobes, particularly the bilateral inferior frontal gyrus. Critically, these patterns do not generalize to adjacent face-selective regions, suggesting a specific relationship between VWFA-2 and the frontal language network. No correlations were observed between functional connectivity and reading ability. Together, our findings support the distinction between subregions of the VWFA, and suggest that functional connectivity patterns in the ventral temporal cortex are consistent over a wide range of reading skills.
Collapse
Affiliation(s)
- Maya Yablonski
- Division of Developmental‐Behavioral Pediatrics, Department of PediatricsStanford University School of MedicineStanfordCaliforniaUSA
- Stanford University Graduate School of EducationStanfordCaliforniaUSA
| | - Iliana I. Karipidis
- Department of Psychiatry and Behavioral SciencesStanford School of MedicineStanfordCaliforniaUSA
- Department of Child and Adolescent Psychiatry and PsychotherapyUniversity Hospital of Psychiatry Zurich, University of ZurichZürichSwitzerland
- Neuroscience Center ZurichUniversity of Zurich and ETHZurichSwitzerland
| | - Emily Kubota
- Psychology DepartmentStanford UniversityStanfordCaliforniaUSA
| | - Jason D. Yeatman
- Division of Developmental‐Behavioral Pediatrics, Department of PediatricsStanford University School of MedicineStanfordCaliforniaUSA
- Stanford University Graduate School of EducationStanfordCaliforniaUSA
- Psychology DepartmentStanford UniversityStanfordCaliforniaUSA
| |
Collapse
|
20
|
Brands AM, Devore S, Devinsky O, Doyle W, Flinker A, Friedman D, Dugan P, Winawer J, Groen IIA. Temporal dynamics of short-term neural adaptation across human visual cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.09.13.557378. [PMID: 37745548 PMCID: PMC10515883 DOI: 10.1101/2023.09.13.557378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
Neural responses in visual cortex adapt to prolonged and repeated stimuli. While adaptation occurs across the visual cortex, it is unclear how adaptation patterns and computational mechanisms differ across the visual hierarchy. Here we characterize two signatures of short-term neural adaptation in time-varying intracranial electroencephalography (iEEG) data collected while participants viewed naturalistic image categories varying in duration and repetition interval. Ventral- and lateral-occipitotemporal cortex exhibit slower and prolonged adaptation to single stimuli and slower recovery from adaptation to repeated stimuli compared to V1-V3. For category-selective electrodes, recovery from adaptation is slower for preferred than non-preferred stimuli. To model neural adaptation we augment our delayed divisive normalization (DN) model by scaling the input strength as a function of stimulus category, enabling the model to accurately predict neural responses across multiple image categories. The model fits suggest that differences in adaptation patterns arise from slower normalization dynamics in higher visual areas interacting with differences in input strength resulting from category selectivity. Our results reveal systematic differences in temporal adaptation of neural population responses across the human visual hierarchy and show that a single computational model of history-dependent normalization dynamics, fit with area-specific parameters, accounts for these differences.
Collapse
|
21
|
Monaco S, Menghi N, Crawford JD. Action-specific feature processing in the human cortex: An fMRI study. Neuropsychologia 2024; 194:108773. [PMID: 38142960 DOI: 10.1016/j.neuropsychologia.2023.108773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 11/29/2023] [Accepted: 12/18/2023] [Indexed: 12/26/2023]
Abstract
Sensorimotor integration involves feedforward and reentrant processing of sensory input. Grasp-related motor activity precedes and is thought to influence visual object processing. Yet, while the importance of reentrant feedback is well established in perception, the top-down modulations for action and the neural circuits involved in this process have received less attention. Do action-specific intentions influence the processing of visual information in the human cortex? Using a cue-separation fMRI paradigm, we found that action-specific instruction processing (manual alignment vs. grasp) became apparent only after the visual presentation of oriented stimuli, and occurred as early as in the primary visual cortex and extended to the dorsal visual stream, motor and premotor areas. Further, dorsal stream area aIPS, known to be involved in object manipulation, and the primary visual cortex showed task-related functional connectivity with frontal, parietal and temporal areas, consistent with the idea that reentrant feedback from dorsal and ventral visual stream areas modifies visual inputs to prepare for action. Importantly, both the task-dependent modulations and connections were linked specifically to the object presentation phase of the task, suggesting a role in processing the action goal. Our results show that intended manual actions have an early, pervasive, and differential influence on the cortical processing of vision.
Collapse
Affiliation(s)
- Simona Monaco
- CIMeC - Center for Mind/Brain Sciences, University of Trento, Rovereto (TN), Italy.
| | - Nicholas Menghi
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - J Douglas Crawford
- Center for Vision Research, York University, Toronto, Ontario M3J 1P3, Canada; Vision: Science to Applications (VISTA) Program, Neuroscience Graduate Diploma Program and Departments of Psychology, Biology, and Kinesiology and Health Science, York University, Toronto, Ontario M3J 1P3, Canada
| |
Collapse
|
22
|
Weber S, Christophel T, Görgen K, Soch J, Haynes J. Working memory signals in early visual cortex are present in weak and strong imagers. Hum Brain Mapp 2024; 45:e26590. [PMID: 38401134 PMCID: PMC10893972 DOI: 10.1002/hbm.26590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 12/06/2023] [Accepted: 12/29/2023] [Indexed: 02/26/2024] Open
Abstract
It has been suggested that visual images are memorized across brief periods of time by vividly imagining them as if they were still there. In line with this, the contents of both working memory and visual imagery are known to be encoded already in early visual cortex. If these signals in early visual areas were indeed to reflect a combined imagery and memory code, one would predict them to be weaker for individuals with reduced visual imagery vividness. Here, we systematically investigated this question in two groups of participants. Strong and weak imagers were asked to remember images across brief delay periods. We were able to reliably reconstruct the memorized stimuli from early visual cortex during the delay. Importantly, in contrast to the prediction, the quality of reconstruction was equally accurate for both strong and weak imagers. The decodable information also closely reflected behavioral precision in both groups, suggesting it could contribute to behavioral performance, even in the extreme case of completely aphantasic individuals. Our data thus suggest that working memory signals in early visual cortex can be present even in the (near) absence of phenomenal imagery.
Collapse
Affiliation(s)
- Simon Weber
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Training Group “Extrospection” and Berlin School of Mind and Brain, Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
| | - Thomas Christophel
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Department of PsychologyHumboldt‐Universität zu BerlinBerlinGermany
| | - Kai Görgen
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
| | - Joram Soch
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Institute of Psychology, Otto von Guericke University MagdeburgMagdeburgGermany
| | - John‐Dylan Haynes
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Training Group “Extrospection” and Berlin School of Mind and Brain, Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
- Department of PsychologyHumboldt‐Universität zu BerlinBerlinGermany
- Collaborative Research Center “Volition and Cognitive Control”Technische Universität DresdenDresdenGermany
| |
Collapse
|
23
|
Teng C, Postle BR. Investigating the Roles of the Visual and Parietal Cortex in Representing Content versus Context in Visual Working Memory. eNeuro 2024; 11:ENEURO.0270-20.2024. [PMID: 38336475 PMCID: PMC10860598 DOI: 10.1523/eneuro.0270-20.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 12/05/2023] [Accepted: 01/04/2024] [Indexed: 02/12/2024] Open
Abstract
Content-to-context binding is crucial for working memory performance. Using a dual-serial retrocueing (DSR) task on oriented gratings, Yu et al. (2020) found that content (orientation) of both prioritized and unprioritized memory items (PMI; UMI) was represented simultaneously in visual cortex, while their context (location) was represented in intraparietal sulcus (IPS), with a priority-based remapping of the representation of content and context of the UMI in each region, respectively. This registered report acquired fMRI of 24 healthy adults while they performed a DSR task with location as the to-be-reported content and orientation as the task-relevant context. We contrasted three accounts: domain-dependent, the engagement of visual and parietal regions depends on the feature domain (orientation vs location); functional, the engagement of these regions depends on their function (content vs context); and hybrid-a combination of the domain-dependent account and the additional stipulation that IPS encodes context regardless of domain. Delay-period activity in early visual cortex conformed most closely with functional predictions: robust priority-sensitive representation of stimulus location (content), but no evidence for the active representation of stimulus orientation (context). Delay-period activity in IPS, in contrast, conformed most closely to predictions of the hybrid account: active representation of content (location) and of prioritized context (orientation). Exploratory analyses further supported the hybrid account of IPS, revealing univariate sensitivity to variation in both content and context load, the latter in a manner that predicted individual differences in behavior. The representation of visual information in working memory is highly dependent on behavioral context.
Collapse
Affiliation(s)
- Chunyue Teng
- University of Wisconsin-Madison, Madison 53719, Wisconsin
- Lawrence University, Appleton 54911, Wisconsin
| | | |
Collapse
|
24
|
Steel A, Silson EH, Garcia BD, Robertson CE. A retinotopic code structures the interaction between perception and memory systems. Nat Neurosci 2024; 27:339-347. [PMID: 38168931 PMCID: PMC10923171 DOI: 10.1038/s41593-023-01512-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 10/31/2023] [Indexed: 01/05/2024]
Abstract
Conventional views of brain organization suggest that regions at the top of the cortical hierarchy processes internally oriented information using an abstract amodal neural code. Despite this, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here we report that retinotopic coding structures interactions between internally oriented (mnemonic) and externally oriented (perceptual) brain areas. Using functional magnetic resonance imaging, we observed robust inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. These functionally linked retinotopic populations in mnemonic and perceptual areas exhibit spatially specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually inhibitory dynamic. These results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, providing a scaffold for their dynamic interaction.
Collapse
Affiliation(s)
- Adam Steel
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| | - Edward H Silson
- Psychosophy, Psychology, and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Brenda D Garcia
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Caroline E Robertson
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
25
|
Jones SA, Noppeney U. Older adults preserve audiovisual integration through enhanced cortical activations, not by recruiting new regions. PLoS Biol 2024; 22:e3002494. [PMID: 38319934 PMCID: PMC10871488 DOI: 10.1371/journal.pbio.3002494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 02/16/2024] [Accepted: 01/09/2024] [Indexed: 02/08/2024] Open
Abstract
Effective interactions with the environment rely on the integration of multisensory signals: Our brains must efficiently combine signals that share a common source, and segregate those that do not. Healthy ageing can change or impair this process. This functional magnetic resonance imaging study assessed the neural mechanisms underlying age differences in the integration of auditory and visual spatial cues. Participants were presented with synchronous audiovisual signals at various degrees of spatial disparity and indicated their perceived sound location. Behaviourally, older adults were able to maintain localisation accuracy. At the neural level, they integrated auditory and visual cues into spatial representations along dorsal auditory and visual processing pathways similarly to their younger counterparts but showed greater activations in a widespread system of frontal, temporal, and parietal areas. According to multivariate Bayesian decoding, these areas encoded critical stimulus information beyond that which was encoded in the brain areas commonly activated by both groups. Surprisingly, however, the boost in information provided by these areas with age-related activation increases was comparable across the 2 age groups. This dissociation-between comparable information encoded in brain activation patterns across the 2 age groups, but age-related increases in regional blood-oxygen-level-dependent responses-contradicts the widespread notion that older adults recruit new regions as a compensatory mechanism to encode task-relevant information. Instead, our findings suggest that activation increases in older adults reflect nonspecific or modulatory mechanisms related to less efficient or slower processing, or greater demands on attentional resources.
Collapse
Affiliation(s)
- Samuel A. Jones
- Computational Neuroscience and Cognitive Robotics Centre, University of Birmingham, Birmingham, United Kingdom
- Department of Psychology, Nottingham Trent University, Nottingham, United Kingdom
| | - Uta Noppeney
- Computational Neuroscience and Cognitive Robotics Centre, University of Birmingham, Birmingham, United Kingdom
- Donders Institute for Brain, Cognition & Behaviour, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
26
|
Barnett B, Andersen LM, Fleming SM, Dijkstra N. Identifying content-invariant neural signatures of perceptual vividness. PNAS NEXUS 2024; 3:pgae061. [PMID: 38415219 PMCID: PMC10898512 DOI: 10.1093/pnasnexus/pgae061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 01/31/2024] [Indexed: 02/29/2024]
Abstract
Some conscious experiences are more vivid than others. Although perceptual vividness is a key component of human consciousness, how variation in this magnitude property is registered by the human brain is unknown. A striking feature of neural codes for magnitude in other psychological domains, such as number or reward, is that the magnitude property is represented independently of its sensory features. To test whether perceptual vividness also covaries with neural codes that are invariant to sensory content, we reanalyzed existing magnetoencephalography and functional MRI data from two distinct studies which quantified perceptual vividness via subjective ratings of awareness and visibility. Using representational similarity and decoding analyses, we find evidence for content-invariant neural signatures of perceptual vividness distributed across visual, parietal, and frontal cortices. Our findings indicate that the neural correlates of subjective vividness may share similar properties to magnitude codes in other cognitive domains.
Collapse
Affiliation(s)
- Benjy Barnett
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
| | - Lau M Andersen
- Aarhus Institute of Advanced Studies, 8000 Aarhus C, Denmark
- Center of Functionally Integrative Neuroscience, 8000 Aarhus C, Denmark
- Department for Linguistics, Cognitive Science and Semiotics, Aarhus University, 8000 Aarhus C, Denmark
| | - Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London WC1B 5EH, UK
| | - Nadine Dijkstra
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
| |
Collapse
|
27
|
Lee J, Park S. Multi-modal Representation of the Size of Space in the Human Brain. J Cogn Neurosci 2024; 36:340-361. [PMID: 38010320 DOI: 10.1162/jocn_a_02092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
To estimate the size of an indoor space, we must analyze the visual boundaries that limit the spatial extent and acoustic cues from reflected interior surfaces. We used fMRI to examine how the brain processes the geometric size of indoor scenes when various types of sensory cues are presented individually or together. Specifically, we asked whether the size of space is represented in a modality-specific way or in an integrative way that combines multimodal cues. In a block-design study, images or sounds that depict small- and large-sized indoor spaces were presented. Visual stimuli were real-world pictures of empty spaces that were small or large. Auditory stimuli were sounds convolved with different reverberations. By using a multivoxel pattern classifier, we asked whether the two sizes of space can be classified in visual, auditory, and visual-auditory combined conditions. We identified both sensory-specific and multimodal representations of the size of space. To further investigate the nature of the multimodal region, we specifically examined whether it contained multimodal information in a coexistent or integrated form. We found that angular gyrus and the right medial frontal gyrus had modality-integrated representation, displaying sensitivity to the match in the spatial size information conveyed through image and sound. Background functional connectivity analysis further demonstrated that the connection between sensory-specific regions and modality-integrated regions increases in the multimodal condition compared with single modality conditions. Our results suggest that spatial size perception relies on both sensory-specific and multimodal representations, as well as their interplay during multimodal perception.
Collapse
|
28
|
Marshall TR, Ruesseler M, Hunt LT, O’Reilly JX. The representation of priors and decisions in the human parietal cortex. PLoS Biol 2024; 22:e3002383. [PMID: 38285671 PMCID: PMC10824454 DOI: 10.1371/journal.pbio.3002383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 12/11/2023] [Indexed: 01/31/2024] Open
Abstract
Animals actively sample their environment through orienting actions such as saccadic eye movements. Saccadic targets are selected based both on sensory evidence immediately preceding the saccade, and a "salience map" or prior built-up over multiple saccades. In the primate cortex, the selection of each individual saccade depends on competition between target-selective cells that ramp up their firing rate to saccade release. However, it is less clear how a cross-saccade prior might be implemented, either in neural firing or through an activity-silent mechanism such as modification of synaptic weights on sensory inputs. Here, we present evidence from magnetoencephalography for 2 distinct processes underlying the selection of the current saccade, and the representation of the prior, in human parietal cortex. While the classic ramping decision process for each saccade was reflected in neural firing rates (measured in the event-related field), a prior built-up over multiple saccades was implemented via modulation of the gain on sensory inputs from the preferred target, as evidenced by rapid frequency tagging. A cascade of computations over time (initial representation of the prior, followed by evidence accumulation and then an integration of prior and evidence) provides a mechanism by which a salience map may be built up across saccades in parietal cortex. It also provides insight into the apparent contradiction that inactivation of parietal cortex has been shown not to affect performance on single-trials, despite the presence of clear evidence accumulation signals in this region.
Collapse
Affiliation(s)
- Tom R. Marshall
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, Oxford University, Oxford, United Kingdom
| | - Maria Ruesseler
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, Oxford University, Oxford, United Kingdom
| | - Laurence T. Hunt
- Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, Oxford University, Oxford, United Kingdom
| | - Jill X. O’Reilly
- Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, Oxford University, Oxford, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, Nuffield Department for Clinical Neurosciences, Oxford University, Oxford, United Kingdom
| |
Collapse
|
29
|
Liang Y, Bo K, Meyyappan S, Ding M. Decoding fMRI data with support vector machines and deep neural networks. J Neurosci Methods 2024; 401:110004. [PMID: 37914001 DOI: 10.1016/j.jneumeth.2023.110004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 10/21/2023] [Accepted: 10/27/2023] [Indexed: 11/03/2023]
Abstract
BACKGROUND Multivoxel pattern analysis (MVPA) examines fMRI activation patterns associated with different cognitive conditions. Support vector machines (SVMs) are the predominant method in MVPA. While SVM is intuitive and easy to apply, it is mainly suitable for analyzing data that are linearly separable. Convolutional neural networks (CNNs) are known to have the ability to approximate nonlinear relationships. Applications of CNN to fMRI data are beginning to appear with increasing frequency, but our understanding of the similarities and differences between CNN models and SVM models is limited. NEW METHOD We compared the two methods when they are applied to the same datasets. Two datasets were considered: (1) fMRI data collected from participants during a cued visual spatial attention task and (2) fMRI data collected from participants viewing natural images containing varying degrees of affective content. RESULTS We found that (1) both SVM and CNN are able to achieve above-chance decoding accuracies for attention control and emotion processing in both the primary visual cortex and the whole brain, (2) the CNN decoding accuracies are consistently higher than that of the SVM, (3) the SVM and CNN decoding accuracies are generally not correlated, and (4) the heatmaps derived from SVM and CNN are not significantly overlapping. COMPARISON WITH EXISTING METHODS By comparing SVM and CNN we pointed out the similarities and differences between the two methods. CONCLUSIONS SVM and CNN rely on different neural features for classification. Applying both to the same data may yield a more comprehensive understanding of neuroimaging data.
Collapse
Affiliation(s)
- Yun Liang
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, USA
| | - Ke Bo
- The Cognitive and Affective Neuroscience Lab, Dartmouth College, Hanover, NH, USA
| | | | - Mingzhou Ding
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, USA.
| |
Collapse
|
30
|
Beffara B, Hadj‐Bouziane F, Hamed SB, Boehler CN, Chelazzi L, Santandrea E, Macaluso E. Separate and overlapping mechanisms of statistical regularities and salience processing in the occipital cortex and dorsal attention network. Hum Brain Mapp 2023; 44:6439-6458. [PMID: 37877138 PMCID: PMC10681649 DOI: 10.1002/hbm.26520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 09/15/2023] [Accepted: 10/05/2023] [Indexed: 10/26/2023] Open
Abstract
Attention selects behaviorally relevant inputs for in-depth processing. Beside the role of traditional signals related to goal-directed and stimulus-driven control, a debate exists regarding the mechanisms governing the effect of statistical regularities on attentional selection, and how these are integrated with other control signals. Using a visuo-spatial search task under fMRI, we tested the joint effects of statistical regularities and stimulus-driven salience. We found that both types of signals modulated occipital activity in a spatially specific manner. Salience acted primarily by reducing the attention bias towards the target location when associated with irrelevant distractors, while statistical regularities reduced this attention bias when the target was presented at a low probability location, particularly at the lower levels of the visual hierarchy. In addition, we found that both statistical regularities and salience activated the dorsal frontoparietal network. Additional exploratory analyses of functional connectivity revealed that only statistical regularities modulated the inter-regional coupling between the posterior parietal cortex and the occipital cortex. These results show that statistical regularities and salience signals are both spatially represented at the occipital level, but that their integration into attentional processing priorities relies on dissociable brain mechanisms.
Collapse
Affiliation(s)
- Bertrand Beffara
- Centre de Recherche en Neurosciences de Lyon (CRNL)Université Claude Bernard Lyon 1, CNRS, INSERMBronFrance
| | - Fadila Hadj‐Bouziane
- Centre de Recherche en Neurosciences de Lyon (CRNL)Université Claude Bernard Lyon 1, CNRS, INSERMBronFrance
| | - Suliann Ben Hamed
- Institut des Sciences Cognitives Marc Jeannerod, Lyon, UMR5229, CNRSUniversité de LyonLyonFrance
| | - C. Nico Boehler
- Department of Experimental PsychologyGhent UniversityGhentBelgium
| | - Leonardo Chelazzi
- Department of Neuroscience, Biomedicine, and Movement SciencesUniversity of VeronaVeronaItaly
| | - Elisa Santandrea
- Department of Neuroscience, Biomedicine, and Movement SciencesUniversity of VeronaVeronaItaly
| | - Emiliano Macaluso
- Centre de Recherche en Neurosciences de Lyon (CRNL)Université Claude Bernard Lyon 1, CNRS, INSERMBronFrance
| |
Collapse
|
31
|
Witkowski PP, Geng JJ. Prefrontal Cortex Codes Representations of Target Identity and Feature Uncertainty. J Neurosci 2023; 43:8769-8776. [PMID: 37875376 PMCID: PMC10727173 DOI: 10.1523/jneurosci.1117-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 09/04/2023] [Accepted: 10/07/2023] [Indexed: 10/26/2023] Open
Abstract
Many objects in the real world have features that vary over time, creating uncertainty in how they will look in the future. This uncertainty makes statistical knowledge about the likelihood of features critical to attention demanding processes such as visual search. However, little is known about how the uncertainty of visual features is integrated into predictions about search targets in the brain. In the current study, we test the idea that regions prefrontal cortex code statistical knowledge about search targets before the onset of search. Across 20 human participants (13 female; 7 male), we observe target identity in the multivariate pattern and uncertainty in the overall activation of dorsolateral prefrontal cortex (DLPFC) and inferior frontal junction (IFJ) in advance of the search display. This indicates that the target identity (mean) and uncertainty (variance) of the target distribution are coded independently within the same regions. Furthermore, once the search display appears the univariate IFJ signal scaled with the distance of the actual target from the expected mean, but more so when expected variability was low. These results inform neural theories of attention by showing how the prefrontal cortex represents both the identity and expected variability of features in service of top-down attentional control.SIGNIFICANCE STATEMENT Theories of attention and working memory posit that when we engage in complex cognitive tasks our performance is determined by how precisely we remember task-relevant information. However, in the real world the properties of objects change over time, creating uncertainty about many aspects of the task. There is currently a gap in our understanding of how neural systems represent this uncertainty and combine it with target identity information in anticipation of attention demanding cognitive tasks. In this study, we show that the prefrontal cortex represents identity and uncertainty as unique codes before task onset. These results advance theories of attention by showing that the prefrontal cortex codes both target identity and uncertainty to implement top-down attentional control.
Collapse
Affiliation(s)
- Phillip P Witkowski
- Center for Mind and Brain, University of California, Davis, Davis, California 95618
- Department of Psychology, University of California, Davis, Davis, California 95618
| | - Joy J Geng
- Center for Mind and Brain, University of California, Davis, Davis, California 95618
- Department of Psychology, University of California, Davis, Davis, California 95618
| |
Collapse
|
32
|
Braun A, Donner TH. Adaptive biasing of action-selective cortical build-up activity by stimulus history. eLife 2023; 12:RP86740. [PMID: 38054952 DOI: 10.7554/elife.86740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2023] Open
Abstract
Decisions under uncertainty are often biased by the history of preceding sensory input, behavioral choices, or received outcomes. Behavioral studies of perceptual decisions suggest that such history-dependent biases affect the accumulation of evidence and can be adapted to the correlation structure of the sensory environment. Here, we systematically varied this correlation structure while human participants performed a canonical perceptual choice task. We tracked the trial-by-trial variations of history biases via behavioral modeling and of a neural signature of decision formation via magnetoencephalography (MEG). The history bias was flexibly adapted to the environment and exerted a selective effect on the build-up (not baseline level) of action-selective motor cortical activity during decision formation. This effect added to the impact of the current stimulus. We conclude that the build-up of action plans in human motor cortical circuits is shaped by dynamic prior expectations that result from an adaptive interaction with the environment.
Collapse
Affiliation(s)
- Anke Braun
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Psychiatry and Neurosciences, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Child and Adolescent Psychiatry, Berlin, Germany
| | - Tobias H Donner
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Bernstein Center for Computational Neuroscience, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
33
|
Klein LK, Maiello G, Stubbs K, Proklova D, Chen J, Paulun VC, Culham JC, Fleming RW. Distinct Neural Components of Visually Guided Grasping during Planning and Execution. J Neurosci 2023; 43:8504-8514. [PMID: 37848285 PMCID: PMC10711727 DOI: 10.1523/jneurosci.0335-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 07/18/2023] [Accepted: 09/06/2023] [Indexed: 10/19/2023] Open
Abstract
Selecting suitable grasps on three-dimensional objects is a challenging visuomotor computation, which involves combining information about an object (e.g., its shape, size, and mass) with information about the actor's body (e.g., the optimal grasp aperture and hand posture for comfortable manipulation). Here, we used functional magnetic resonance imaging to investigate brain networks associated with these distinct aspects during grasp planning and execution. Human participants of either sex viewed and then executed preselected grasps on L-shaped objects made of wood and/or brass. By leveraging a computational approach that accurately predicts human grasp locations, we selected grasp points that disentangled the role of multiple grasp-relevant factors, that is, grasp axis, grasp size, and object mass. Representational Similarity Analysis revealed that grasp axis was encoded along dorsal-stream regions during grasp planning. Grasp size was first encoded in ventral stream areas during grasp planning then in premotor regions during grasp execution. Object mass was encoded in ventral stream and (pre)motor regions only during grasp execution. Premotor regions further encoded visual predictions of grasp comfort, whereas the ventral stream encoded grasp comfort during execution, suggesting its involvement in haptic evaluation. These shifts in neural representations thus capture the sensorimotor transformations that allow humans to grasp objects.SIGNIFICANCE STATEMENT Grasping requires integrating object properties with constraints on hand and arm postures. Using a computational approach that accurately predicts human grasp locations by combining such constraints, we selected grasps on objects that disentangled the relative contributions of object mass, grasp size, and grasp axis during grasp planning and execution in a neuroimaging study. Our findings reveal a greater role of dorsal-stream visuomotor areas during grasp planning, and, surprisingly, increasing ventral stream engagement during execution. We propose that during planning, visuomotor representations initially encode grasp axis and size. Perceptual representations of object material properties become more relevant instead as the hand approaches the object and motor programs are refined with estimates of the grip forces required to successfully lift the object.
Collapse
Affiliation(s)
- Lina K Klein
- Department of Experimental Psychology, Justus Liebig University Giessen, 35390 Giessen, Germany
| | - Guido Maiello
- School of Psychology, University of Southampton, Southampton SO17 1PS, United Kingdom
| | - Kevin Stubbs
- Department of Psychology, University of Western Ontario, London, Ontario N6A 5C2, Canada
| | - Daria Proklova
- Department of Psychology, University of Western Ontario, London, Ontario N6A 5C2, Canada
| | - Juan Chen
- Center for the Study of Applied Psychology, Guangdong Key Laboratory of Mental Health and Cognitive Science, and the School of Psychology, South China Normal University, Guangzhou, 510631, China
- Key Laboratory of Brain, Cognition and Education Sciences, South China Normal University, Guangzhou 510631, China
| | - Vivian C Paulun
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
| | - Jody C Culham
- Department of Psychology, University of Western Ontario, London, Ontario N6A 5C2, Canada
| | - Roland W Fleming
- Department of Experimental Psychology, Justus Liebig University Giessen, 35390 Giessen, Germany
- Center for Mind, Brain and Behavior, University of Marburg and Justus Liebig University Giessen, Giessen, Germany, 35390
| |
Collapse
|
34
|
McMahon E, Bonner MF, Isik L. Hierarchical organization of social action features along the lateral visual pathway. Curr Biol 2023; 33:5035-5047.e8. [PMID: 37918399 PMCID: PMC10841461 DOI: 10.1016/j.cub.2023.10.015] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 09/01/2023] [Accepted: 10/10/2023] [Indexed: 11/04/2023]
Abstract
Recent theoretical work has argued that in addition to the classical ventral (what) and dorsal (where/how) visual streams, there is a third visual stream on the lateral surface of the brain specialized for processing social information. Like visual representations in the ventral and dorsal streams, representations in the lateral stream are thought to be hierarchically organized. However, no prior studies have comprehensively investigated the organization of naturalistic, social visual content in the lateral stream. To address this question, we curated a naturalistic stimulus set of 250 3-s videos of two people engaged in everyday actions. Each clip was richly annotated for its low-level visual features, mid-level scene and object properties, visual social primitives (including the distance between people and the extent to which they were facing), and high-level information about social interactions and affective content. Using a condition-rich fMRI experiment and a within-subject encoding model approach, we found that low-level visual features are represented in early visual cortex (EVC) and middle temporal (MT) area, mid-level visual social features in extrastriate body area (EBA) and lateral occipital complex (LOC), and high-level social interaction information along the superior temporal sulcus (STS). Communicative interactions, in particular, explained unique variance in regions of the STS after accounting for variance explained by all other labeled features. Taken together, these results provide support for representation of increasingly abstract social visual content-consistent with hierarchical organization-along the lateral visual stream and suggest that recognizing communicative actions may be a key computational goal of the lateral visual pathway.
Collapse
Affiliation(s)
- Emalie McMahon
- Department of Cognitive Science, Zanvyl Krieger School of Arts & Sciences, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA.
| | - Michael F Bonner
- Department of Cognitive Science, Zanvyl Krieger School of Arts & Sciences, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA
| | - Leyla Isik
- Department of Cognitive Science, Zanvyl Krieger School of Arts & Sciences, Johns Hopkins University, 237 Krieger Hall, 3400 N. Charles Street, Baltimore, MD 21218, USA; Department of Biomedical Engineering, Whiting School of Engineering, Johns Hopkins University, Suite 400 West, Wyman Park Building, 3400 N. Charles Street, Baltimore, MD 21218, USA
| |
Collapse
|
35
|
Ayzenberg V, Granovetter MC, Robert S, Patterson C, Behrmann M. Differential functional reorganization of ventral and dorsal visual pathways following childhood hemispherectomy. Dev Cogn Neurosci 2023; 64:101323. [PMID: 37976921 PMCID: PMC10682827 DOI: 10.1016/j.dcn.2023.101323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 09/28/2023] [Accepted: 11/09/2023] [Indexed: 11/19/2023] Open
Abstract
Hemispherectomy is a surgical procedure in which an entire hemisphere of a patient's brain is resected or functionally disconnected to manage seizures in individuals with drug-resistant epilepsy. Despite the extensive loss of both ventral and dorsal visual pathways in one hemisphere, pediatric patients who have undergone hemispherectomy show a remarkably high degree of perceptual function across many domains. In the current study, we sought to understand the extent to which functions of the ventral and dorsal visual pathways reorganize to the contralateral hemisphere following childhood hemispherectomy. To this end, we collected fMRI data from an equal number of left and right hemispherectomy patients who completed tasks that typically elicit lateralized responses from the ventral or the dorsal pathway, namely, word (left ventral), face (right ventral), tool (left dorsal), and global form (right dorsal) perception. Overall, there was greater evidence of functional reorganization in the ventral pathway than in the dorsal pathway. Importantly, because ventral and dorsal reorganization was tested within the very same patients, these results cannot be explained by idiosyncratic factors such as disease etiology, age at the time of surgery, or age at testing. These findings suggest that because the dorsal pathway may mature earlier, it may have a shorter developmental window of plasticity than the ventral pathway and, hence, be less malleable after perturbation.
Collapse
Affiliation(s)
- Vladislav Ayzenberg
- Department of Psychology, University of Pennsylvania, PA, USA; Department of Psychology and Neuroscience Institute, Carnegie Mellon University, PA, USA.
| | - Michael C Granovetter
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, PA, USA; School of Medicine, University of Pittsburgh, PA, USA
| | - Sophia Robert
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, PA, USA
| | - Christina Patterson
- School of Medicine, University of Pittsburgh, PA, USA; Department of Pediatrics, University of Pittsburgh, PA, USA
| | - Marlene Behrmann
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, PA, USA; Department of Pediatrics, University of Pittsburgh, PA, USA; Department of Ophthalmology, University of Pittsburgh, PA, USA.
| |
Collapse
|
36
|
Bick A, McKyton A, Glick-Shames H, Rein N, Levin N. Abnormal network connections to early visual cortex in posterior cortical atrophy. J Neurol Sci 2023; 454:120826. [PMID: 37832379 DOI: 10.1016/j.jns.2023.120826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Revised: 10/02/2023] [Accepted: 10/04/2023] [Indexed: 10/15/2023]
Abstract
INTRODUCTION Posterior Cortical Atrophy (PCA), a visual variant of Alzheimer's disease, initially manifests with higher-order visual disorders and parieto/temporo-occipital atrophy. Recent studies have shown remote functional impairment in both distant brain networks and along the calcarine sulcus (V1). Functional alteration in the calcarine differs along its length, reflecting center to periphery visual space differences. Herein, we aim to connect between these two sets of findings by looking at the retinotopic patterns of functional connectivity between large-scale brain networks and V1, comparing patients with normally sighted subjects. METHODS Resting state functional magnetic resonance imaging (fMRI) and T1 anatomical scans were obtained from 11 PCA patients and 17 age-matched healthy volunteers. Default mode network (DMN) and fronto parietal network (FPN) were defined and differences between the networks in patients and healthy controls were evaluated at the whole brain level, specifically their connectivity to V1. RESULTS Connectivity patterns within the DMN and the FPN were similar between the groups, although differences were found in regions within and beyond the networks. Focusing on V1, in the control group we identified the expected pattern of a distributed connectivity along eccentricity, with foveal regions showing stronger connectivity to the FPN and peripheral regions showing stronger connectivity to the DMN. However, in PCA patients we could not identify a clear difference in connectivity along the eccentricities. CONCLUSION Lost specialization of function along the calcarine in PCA patients may have further implications on large-scale networks or vice versa. This impairment, distant from the core pathology, might explain patients' visual disabilities.
Collapse
Affiliation(s)
- Atira Bick
- fMRI unit, Neurology department, Hadassah Medical Center and Faculty of Medicine, Hebrew University of Jerusalem, Israel
| | - Ayelet McKyton
- fMRI unit, Neurology department, Hadassah Medical Center and Faculty of Medicine, Hebrew University of Jerusalem, Israel
| | - Haya Glick-Shames
- fMRI unit, Neurology department, Hadassah Medical Center and Faculty of Medicine, Hebrew University of Jerusalem, Israel
| | - Netaniel Rein
- fMRI unit, Neurology department, Hadassah Medical Center and Faculty of Medicine, Hebrew University of Jerusalem, Israel
| | - Netta Levin
- fMRI unit, Neurology department, Hadassah Medical Center and Faculty of Medicine, Hebrew University of Jerusalem, Israel.
| |
Collapse
|
37
|
Steel A, Silson EH, Garcia BD, Robertson CE. A retinotopic code structures the interaction between perception and memory systems. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.15.540807. [PMID: 37292758 PMCID: PMC10245578 DOI: 10.1101/2023.05.15.540807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Conventional views of brain organization suggest that the cortical apex processes internally-oriented information using an abstract, amodal neural code. Yet, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here, we report that retinotopic coding structures interactions between internally-oriented (mnemonic) and externally-oriented (perceptual) brain areas. Using fMRI, we observed robust, inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. Specifically, these functionally-linked retinotopic populations in mnemonic and perceptual areas exhibit spatially-specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually-inhibitory dynamic. Together, these results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, thereby scaffolding their dynamic interaction.
Collapse
Affiliation(s)
- Adam Steel
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, 03755
| | - Edward H. Silson
- Psychology, School of Philosophy, Psychology, and Language Sciences, University of Edinburgh, Edinburgh, UK EH8 9JZ
| | - Brenda D. Garcia
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, 03755
| | | |
Collapse
|
38
|
Baker DH, Marinova D, Aveyard R, Hargreaves LJ, Renton A, Castellani R, Hall P, Harmens M, Holroyd G, Nicholson B, Williams EL, Hobson HM, Wade AR. Temporal dynamics of normalization reweighting. J Vis 2023; 23:6. [PMID: 37862008 PMCID: PMC10615141 DOI: 10.1167/jov.23.12.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2023] [Accepted: 09/08/2023] [Indexed: 10/21/2023] Open
Abstract
For decades, neural suppression in early visual cortex has been thought to be fixed. But recent work has challenged this assumption by showing that suppression can be reweighted based on recent history; when pairs of stimuli are repeatedly presented together, suppression between them strengthens. Here we investigate the temporal dynamics of this process using a steady-state visual evoked potential (SSVEP) paradigm that provides a time-resolved, direct index of suppression between pairs of stimuli flickering at different frequencies (5 and 7 Hz). Our initial analysis of an existing electroencephalography (EEG) dataset (N = 100) indicated that suppression increases substantially during the first 2-5 seconds of stimulus presentation (with some variation across stimulation frequency). We then collected new EEG data (N = 100) replicating this finding for both monocular and dichoptic mask arrangements in a preregistered study designed to measure reweighting. A third experiment (N = 20) used source-localized magnetoencephalography and found that these effects are apparent in primary visual cortex (V1), consistent with results from neurophysiological work. Because long-standing theories propose inhibition/excitation differences in autism, we also compared reweighting between individuals with high versus low autistic traits, and with and without an autism diagnosis, across our three datasets (total N = 220). We find no compelling differences in reweighting that are associated with autism. Our results support the normalization reweighting model and indicate that for prolonged stimulation, increases in suppression occur on the order of 2-5 seconds after stimulus onset.
Collapse
Affiliation(s)
- Daniel H Baker
- Department of Psychology and York Biomedical Research Institute, University of York, York, UK
| | | | | | | | - Alice Renton
- Department of Psychology, University of York, York, UK
| | | | - Phoebe Hall
- Department of Psychology, University of York, York, UK
| | | | | | | | | | - Hannah M Hobson
- Department of Psychology and York Biomedical Research Institute, University of York, York, UK
| | - Alex R Wade
- Department of Psychology and York Biomedical Research Institute, University of York, York, UK
| |
Collapse
|
39
|
Yu X, Yu J, Li Y, Cong J, Wang C, Fan R, Wang W, Zhou L, Xu C, Li Y, Liu Y. Altered intrinsic functional brain architecture in patients with functional constipation: a surface-based network study. Front Neurosci 2023; 17:1241993. [PMID: 37811328 PMCID: PMC10551127 DOI: 10.3389/fnins.2023.1241993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Accepted: 09/06/2023] [Indexed: 10/10/2023] Open
Abstract
Background Functional constipation (FCon) is a common functional gastrointestinal disorder (FGID). Studies have indicated a higher likelihood of psychiatric disorders, such as anxiety, depression, sleep disturbances, and impaired concentration, among patients with FCon. However, the underlying pathophysiological mechanisms responsible for these symptoms in FCon patients remain to be fully elucidated. The human brain is a complex network architecture with several fundamental organizational properties. Neurological interactions between gut symptoms and psychiatric issues may be closely associated with these complex networks. Methods In the present study, a total of 35 patients with FCon and 40 healthy controls (HC) were recruited for a series of clinical examinations and resting-state functional magnetic imaging (RS-fMRI). We employed the surface-based analysis (SBA) approach, utilizing the Schaefer cortical parcellation template and Tikhonov regularization. Graph theoretical analysis (GTA) and functional connectivity (FC) analysis of RS-fMRI were conducted to investigate the aberrant network alterations between the two groups. Additionally, correlation analyses were performed between the network indices and clinical variables in patients with FCon. Results At the global level, we found altered topological properties and networks in patients with FCon, mainly including the significantly increased clustering coefficient (CP), local efficiency (Eloc), and shortest path length (LP), whereas the decreased global efficiency (Eglob) compared to HC. At the regional level, patients with FCon exhibited increased nodal efficiency in the frontoparietal network (FPN). Furthermore, FC analysis demonstrated several functional alterations within and between the Yeo 7 networks, particularly including visual network (VN), limbic network (LN), default mode network (DMN), and somatosensory-motor network (SMN) in sub-network and large-scale network analysis. Correlation analysis revealed that there were no significant associations between the network metrics and clinical variables in the present study. Conclusion These results highlight the altered topological architecture of functional brain networks associated with visual perception abilities, emotion regulation, sensorimotor processing, and attentional control, which may contribute to effectively targeted treatment modalities for patients with FCon.
Collapse
Affiliation(s)
- Xiang Yu
- Department of Radiology, Tianjin Union Medical Center, Tianjin, China
| | - Jingjie Yu
- Department of Psychiatry and Psychology, Tianjin Union Medical Center, Tianjin, China
| | - Yuwei Li
- Department of Colorectal Surgery, Tianjin Union Medical Center, Tianjin, China
| | - Jiying Cong
- Department of Colorectal Surgery, Tianjin Union Medical Center, Tianjin, China
| | - Chao Wang
- Department of Radiology, Tianjin Union Medical Center, Tianjin, China
| | - Ran Fan
- Department of Radiology, Tianjin Union Medical Center, Tianjin, China
| | - Wanbing Wang
- Graduate School of Tianjin Nankai University, Tianjin, China
| | - Lige Zhou
- Graduate School of Tianjin Medical University, Tianjin, China
| | - Chen Xu
- Department of Colorectal Surgery, Tianjin Union Medical Center, Tianjin, China
| | - Yiming Li
- Department of Radiology, Tianjin Union Medical Center, Tianjin, China
| | - Yawu Liu
- Department of Neurology, University of Eastern Finland, Kuopio, Finland
- Department of Clinical Radiology, Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
40
|
Li S, Zeng X, Shao Z, Yu Q. Neural Representations in Visual and Parietal Cortex Differentiate between Imagined, Perceived, and Illusory Experiences. J Neurosci 2023; 43:6508-6524. [PMID: 37582626 PMCID: PMC10513072 DOI: 10.1523/jneurosci.0592-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/09/2023] [Accepted: 08/04/2023] [Indexed: 08/17/2023] Open
Abstract
Humans constantly receive massive amounts of information, both perceived from the external environment and imagined from the internal world. To function properly, the brain needs to correctly identify the origin of information being processed. Recent work has suggested common neural substrates for perception and imagery. However, it has remained unclear how the brain differentiates between external and internal experiences with shared neural codes. Here we tested this question in human participants (male and female) by systematically investigating the neural processes underlying the generation and maintenance of visual information from voluntary imagery, veridical perception, and illusion. The inclusion of illusion allowed us to differentiate between objective and subjective internality: while illusion has an objectively internal origin and can be viewed as involuntary imagery, it is also subjectively perceived as having an external origin like perception. Combining fMRI, eye-tracking, multivariate decoding, and encoding approaches, we observed superior orientation representations in parietal cortex during imagery compared with perception, and conversely in early visual cortex. This imagery dominance gradually developed along a posterior-to-anterior cortical hierarchy from early visual to parietal cortex, emerged in the early epoch of imagery and sustained into the delay epoch, and persisted across varied imagined contents. Moreover, representational strength of illusion was more comparable to imagery in early visual cortex, but more comparable to perception in parietal cortex, suggesting content-specific representations in parietal cortex differentiate between subjectively internal and external experiences, as opposed to early visual cortex. These findings together support a domain-general engagement of parietal cortex in internally generated experience.SIGNIFICANCE STATEMENT How does the brain differentiate between imagined and perceived experiences? Combining fMRI, eye-tracking, multivariate decoding, and encoding approaches, the current study revealed enhanced stimulus-specific representations in visual imagery originating from parietal cortex, supporting the subjective experience of imagery. This neural principle was further validated by evidence from visual illusion, wherein illusion resembled perception and imagery at different levels of cortical hierarchy. Our findings provide direct evidence for the critical role of parietal cortex as a domain-general region for content-specific imagery, and offer new insights into the neural mechanisms underlying the differentiation between subjectively internal and external experiences.
Collapse
Affiliation(s)
- Siyi Li
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Xuemei Zeng
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Zhujun Shao
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Qing Yu
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| |
Collapse
|
41
|
Ai H, Cui Y, Chen N. A "Bandwidth" in cortical representations of multiple faces. Cereb Cortex 2023; 33:10028-10035. [PMID: 37522262 DOI: 10.1093/cercor/bhad262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 06/29/2023] [Accepted: 06/30/2023] [Indexed: 08/01/2023] Open
Abstract
The human ability to process multiple items simultaneously can be constrained by the extent to which those items are represented by distinct neural populations. In the current study, we used fMRI to investigate the cortical representation of multiple faces. We found that the addition of a second face to occupy both visual hemifields led to an increased response, whereas a further addition of faces within the same visual hemifield resulted in a decreased response. This pattern was widely observed in the occipital visual cortex, the intraparietal sulcus, and extended to the posterior inferotemporal cortex. A parallel trend was found in a behavioral change-detection task, revealing a perceptual "bandwidth" of multiface processing. The sensitivity to face clutter gradually decreased along the ventral pathway, supporting the notion of a buildup of clutter-tolerance representation. These cortical response patterns to face clutters suggest that adding signals with nonoverlapping cortical representation enhanced perception, while adding signals that competed for representation resources impaired perception.
Collapse
Affiliation(s)
- Hailin Ai
- Department of Psychology, School of Social Sciences, Tsinghua University, Haidian District, Beijing, 100084, P. R. China
| | - Yuwei Cui
- Department of Psychology, School of Social Sciences, Tsinghua University, Haidian District, Beijing, 100084, P. R. China
| | - Nihong Chen
- Department of Psychology, School of Social Sciences, Tsinghua University, Haidian District, Beijing, 100084, P. R. China
- THU-IDG/McGovern Institute for Brain Research, Tsinghua University, Haidian District, Beijing, 100084, P. R. China
| |
Collapse
|
42
|
Hanning NM, Fernández A, Carrasco M. Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention. Nat Commun 2023; 14:5381. [PMID: 37666805 PMCID: PMC10477327 DOI: 10.1038/s41467-023-40678-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 08/03/2023] [Indexed: 09/06/2023] Open
Abstract
Shortly before saccadic eye movements, visual sensitivity at the saccade target is enhanced, at the expense of sensitivity elsewhere. Some behavioral and neural correlates of this presaccadic shift of attention resemble those of covert attention, deployed during fixation. Microstimulation in non-human primates has shown that presaccadic attention modulates perception via feedback from oculomotor to visual areas. This mechanism also seems plausible in humans, as both oculomotor and visual areas are active during saccade planning. We investigated this hypothesis by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show their causal and differential roles in contralateral presaccadic attention effects: Whereas rFEF+ stimulation enhanced sensitivity opposite the saccade target throughout saccade preparation, V1/V2 stimulation reduced sensitivity at the saccade target only shortly before saccade onset. These findings are consistent with presaccadic attention modulating perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.
Collapse
Affiliation(s)
- Nina M Hanning
- Department of Psychology & Center for Neural Sciences, New York University, New York, NY, USA.
- Institut für Psychologie, Humboldt Universität zu Berlin, Berlin, Germany.
| | - Antonio Fernández
- Department of Psychology & Center for Neural Sciences, New York University, New York, NY, USA
- Department of Psychology, University of Texas at Austin, Austin, TX, USA
| | - Marisa Carrasco
- Department of Psychology & Center for Neural Sciences, New York University, New York, NY, USA
| |
Collapse
|
43
|
Brown JA, Clancy KJ, Chen C, Zeng Y, Qin S, Ding M, Li W. Transcranial stimulation of alpha oscillations modulates brain state dynamics in sustained attention. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.27.542583. [PMID: 37398325 PMCID: PMC10312462 DOI: 10.1101/2023.05.27.542583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Abstract
The brain operates an advanced complex system to support mental activities. Cognition is thought to emerge from dynamic states of the complex brain system, which are organized spatially through large-scale neural networks and temporally via neural synchrony. However, specific mechanisms underlying these processes remain obscure. Applying high-definition alpha-frequency transcranial alternating-current stimulation (HD α-tACS) in a continuous performance task (CPT) during functional resonance imaging (fMRI), we causally elucidate these major organizational architectures in a key cognitive operation-sustained attention. We demonstrated that α-tACS enhanced both electroencephalogram (EEG) alpha power and sustained attention, in a correlated fashion. Akin to temporal fluctuations inherent in sustained attention, our hidden Markov modeling (HMM) of fMRI timeseries uncovered several recurrent, dynamic brain states, which were organized through a few major neural networks and regulated by the alpha oscillation. Specifically, during sustain attention, α-tACS regulated the temporal dynamics of the brain states by suppressing a Task-Negative state (characterized by activation of the default mode network/DMN) and Distraction state (with activation of the ventral attention and visual networks). These findings thus linked dynamic states of major neural networks and alpha oscillations, providing important insights into systems-level mechanisms of attention. They also highlight the efficacy of non-invasive oscillatory neuromodulation in probing the functioning of the complex brain system and encourage future clinical applications to improve neural systems health and cognitive performance.
Collapse
Affiliation(s)
- Joshua A. Brown
- Department of Psychology, Florida State University, Tallahassee, FL
| | - Kevin J. Clancy
- Department of Psychology, Florida State University, Tallahassee, FL
| | - Chaowen Chen
- Department of Psychology, Florida State University, Tallahassee, FL
- Tallahassee Memorial Healthcare, Tallahassee, FL
| | - Yimeng Zeng
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Shaozheng Qin
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Mingzhou Ding
- J Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL
| | - Wen Li
- Department of Psychology, Florida State University, Tallahassee, FL
| |
Collapse
|
44
|
Sanders DMW, Cowell RA. The locus of recognition memory signals in human cortex depends on the complexity of the memory representations. Cereb Cortex 2023; 33:9835-9849. [PMID: 37401000 DOI: 10.1093/cercor/bhad248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 06/12/2023] [Accepted: 06/14/2023] [Indexed: 07/05/2023] Open
Abstract
According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.
Collapse
Affiliation(s)
- D Merika W Sanders
- Department of Psychology, Harvard University, Cambridge, MA 02138, United States
| | - Rosemary A Cowell
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO 80309, United States
- Department of Psychology & Neuroscience, University of Colorado Boulder, Boulder, CO 80309, United States
| |
Collapse
|
45
|
Ribeiro FL, York A, Zavitz E, Bollmann S, Rosa MGP, Puckett A. Variability of visual field maps in human early extrastriate cortex challenges the canonical model of organization of V2 and V3. eLife 2023; 12:e86439. [PMID: 37580963 PMCID: PMC10427147 DOI: 10.7554/elife.86439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Accepted: 08/02/2023] [Indexed: 08/16/2023] Open
Abstract
Visual field maps in human early extrastriate areas (V2 and V3) are traditionally thought to form mirror-image representations which surround the primary visual cortex (V1). According to this scheme, V2 and V3 form nearly symmetrical halves with respect to the calcarine sulcus, with the dorsal halves representing lower contralateral quadrants, and the ventral halves representing upper contralateral quadrants. This arrangement is considered to be consistent across individuals, and thus predictable with reasonable accuracy using templates. However, data that deviate from this expected pattern have been observed, but mainly treated as artifactual. Here, we systematically investigate individual variability in the visual field maps of human early visual cortex using the 7T Human Connectome Project (HCP) retinotopy dataset. Our results demonstrate substantial and principled inter-individual variability. Visual field representation in the dorsal portions of V2 and V3 was more variable than in their ventral counterparts, including substantial departures from the expected mirror-symmetrical patterns. In addition, left hemisphere retinotopic maps were more variable than those in the right hemisphere. Surprisingly, only one-third of individuals had maps that conformed to the expected pattern in the left hemisphere. Visual field sign analysis further revealed that in many individuals the area conventionally identified as dorsal V3 shows a discontinuity in the mirror-image representation of the retina, associated with a Y-shaped lower vertical representation. Our findings challenge the current view that inter-individual variability in early extrastriate cortex is negligible, and that the dorsal portions of V2 and V3 are roughly mirror images of their ventral counterparts.
Collapse
Affiliation(s)
- Fernanda Lenita Ribeiro
- School of Psychology, The University of QueenslandBrisbaneAustralia
- Queensland Brain Institute, The University of QueenslandBrisbaneAustralia
- School of Electrical Engineering and Computer Science, The University of QueenslandBrisbaneAustralia
| | - Ashley York
- School of Psychology, The University of QueenslandBrisbaneAustralia
- Queensland Brain Institute, The University of QueenslandBrisbaneAustralia
| | - Elizabeth Zavitz
- Department of Physiology, Monash UniversityMelbourneAustralia
- Neuroscience Program, Biomedicine Discovery Institute; Monash UniversityMelbourneAustralia
- Department of Electrical and Computer Systems Engineering, Monash UniversityClaytonAustralia
| | - Steffen Bollmann
- School of Electrical Engineering and Computer Science, The University of QueenslandBrisbaneAustralia
- Queensland Digital Health Centre, The University of QueenslandBrisbaneAustralia
| | - Marcello GP Rosa
- Department of Physiology, Monash UniversityMelbourneAustralia
- Neuroscience Program, Biomedicine Discovery Institute; Monash UniversityMelbourneAustralia
| | - Alexander Puckett
- School of Psychology, The University of QueenslandBrisbaneAustralia
- Queensland Brain Institute, The University of QueenslandBrisbaneAustralia
| |
Collapse
|
46
|
Wang HZ, Wong YT. A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision. J Neural Eng 2023; 20:046027. [PMID: 37531948 PMCID: PMC10594539 DOI: 10.1088/1741-2552/aceca2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 07/13/2023] [Accepted: 08/01/2023] [Indexed: 08/04/2023]
Abstract
Objective.We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm.Approach.Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task.Main results.Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task.Significance.The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses.
Collapse
Affiliation(s)
- Haozhe Zac Wang
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, Australia
| | - Yan Tat Wong
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, Australia
- Department of Physiology, Monash University, Melbourne, Australia
| |
Collapse
|
47
|
Meyyappan S, Rajan A, Yang Q, Mangun GR, Ding M. Top-Down Biasing of Visual Cortical Activity Encodes Attended Information and Facilitates Behavioral Performance in Visual Spatial Attention. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.05.552084. [PMID: 37609147 PMCID: PMC10441319 DOI: 10.1101/2023.08.05.552084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/24/2023]
Abstract
Top-down attention plays a vital role in selecting relevant stimuli and suppressing distracting information. During top-down visual-spatial attention, control signals from the dorsal attention network modulate the baseline neuronal activity in the visual cortex in favor of task-relevant stimuli. While several studies have demonstrated that baseline shift during anticipatory attention occurs in multiple visual areas, such effects have not been systematically investigated across the visual hierarchy, especially when different attention conditions are matched for stimulus and task factors. In this fMRI study, we investigated anticipatory attention signals using univariate and multivariate (MVPA) analysis in multiple visual cortical areas. First, the univariate analysis yielded significant activation differences in higher-order visual areas, with the effect weaker in early visual areas. Second, however, in contrast, MVPA decoding was significant in predicting attention conditions in all visual areas and IPS, with lower-order visual areas (e.g., V1) having greater decoding accuracy than higher-order visual areas (e.g., LO1). Third, the strength of decoding accuracy predicted the behavioral performance in the discrimination task. All the results were highly replicable and consistent across two datasets with same experimental paradigms but recorded at two research sites, and two experimental conditions where the direction of spatial attention was driven either by external instructions (cue-instructed attention) or from internal decisions (free-choice attention). Our results provide clear evidence, not available in past univariate investigations, that top-down attentional control signals selectively bias neuronal processing throughout the visual hierarchy, and that this biasing is correlated with the task performance.
Collapse
|
48
|
Ayzenberg V, Granovetter MC, Robert S, Patterson C, Behrmann M. Differential functional reorganization of ventral and dorsal visual pathways following childhood hemispherectomy. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.03.551494. [PMID: 37577633 PMCID: PMC10418255 DOI: 10.1101/2023.08.03.551494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/15/2023]
Abstract
Hemispherectomy is a surgical procedure in which an entire hemisphere of a patient's brain is resected or functionally disconnected to manage seizures in individuals with drug-resistant epilepsy. Despite the extensive loss of input from both ventral and dorsal visual pathways of one hemisphere, pediatric patients who have undergone hemispherectomy show a remarkably high degree of perceptual function across many domains. In the current study, we sought to understand the extent to which functions of the ventral and dorsal visual pathways reorganize to the contralateral hemisphere following childhood hemispherectomy. To this end, we collected fMRI data from an equal number of left and right hemispherectomy patients who completed tasks that typically elicit lateralized responses from the ventral or the dorsal pathway, namely, word (left ventral), face (right ventral), tool (left dorsal), and global form (right dorsal) perception. Overall, there was greater evidence of functional reorganization in the ventral pathway than in the dorsal pathway. Importantly, because ventral and dorsal reorganization was tested in the very same patients, these results cannot be explained by idiosyncratic factors such as disease etiology, age at the time of surgery, or age at testing. These findings suggest that because the dorsal pathway may mature earlier, it may have a shorter developmental window of plasticity than the ventral pathway and, hence, be less malleable.
Collapse
Affiliation(s)
- Vladislav Ayzenberg
- Department of Psychology, University of Pennsylvania
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University
| | - Michael C Granovetter
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University
- School of Medicine, University of Pittsburgh
| | - Sophia Robert
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University
| | - Christina Patterson
- School of Medicine, University of Pittsburgh
- Department of Pediatrics, University of Pittsburgh
| | - Marlene Behrmann
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University
- Department of Pediatrics, University of Pittsburgh
| |
Collapse
|
49
|
Tarder-Stoll H, Baldassano C, Aly M. The brain hierarchically represents the past and future during multistep anticipation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.24.550399. [PMID: 37546761 PMCID: PMC10402095 DOI: 10.1101/2023.07.24.550399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
Memory for temporal structure enables both planning of future events and retrospection of past events. We investigated how the brain flexibly represents extended temporal sequences into the past and future during anticipation. Participants learned sequences of environments in immersive virtual reality. Pairs of sequences had the same environments in a different order, enabling context-specific learning. During fMRI, participants anticipated upcoming environments multiple steps into the future in a given sequence. Temporal structure was represented in the hippocampus and across visual regions (1) bidirectionally, with graded representations into the past and future and (2) hierarchically, with further events into the past and future represented in successively more anterior brain regions. Further, context-specific predictions were prioritized in the forward but not backward direction. Together, this work sheds light on how we flexibly represent sequential structure to enable planning over multiple timescales.
Collapse
|
50
|
Vishne G, Gerber EM, Knight RT, Deouell LY. Distinct ventral stream and prefrontal cortex representational dynamics during sustained conscious visual perception. Cell Rep 2023; 42:112752. [PMID: 37422763 PMCID: PMC10530642 DOI: 10.1016/j.celrep.2023.112752] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 05/12/2023] [Accepted: 06/20/2023] [Indexed: 07/11/2023] Open
Abstract
Instances of sustained stationary sensory input are ubiquitous. However, previous work focused almost exclusively on transient onset responses. This presents a critical challenge for neural theories of consciousness, which should account for the full temporal extent of experience. To address this question, we use intracranial recordings from ten human patients with epilepsy to view diverse images of multiple durations. We reveal that, in sensory regions, despite dramatic changes in activation magnitude, the distributed representation of categories and exemplars remains sustained and stable. In contrast, in frontoparietal regions, we find transient content representation at stimulus onset. Our results highlight the connection between the anatomical and temporal correlates of experience. To the extent perception is sustained, it may rely on sensory representations and to the extent perception is discrete, centered on perceptual updating, it may rely on frontoparietal representations.
Collapse
Affiliation(s)
- Gal Vishne
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel.
| | - Edden M Gerber
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Leon Y Deouell
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel; Department of Psychology, The Hebrew University of Jerusalem, Jerusalem 9190501, Israel.
| |
Collapse
|