1
|
Anderson EJ, Dekker TM, Farahbakhsh M, Hirji N, Schwarzkopf DS, Michaelides M, Rees G. fMRI and gene therapy in adults with CNGB3 mutation. Brain Res Bull 2024; 215:111026. [PMID: 38971478 DOI: 10.1016/j.brainresbull.2024.111026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Revised: 05/29/2024] [Accepted: 07/03/2024] [Indexed: 07/08/2024]
Abstract
Achromatopsia is an inherited retinal disease that affects 1 in 30,000-50,000 individuals and is characterised by an absence of functioning cone photoreceptors from birth. This results in severely reduced visual acuity, no colour vision, marked sensitivity to light and involuntary oscillations of the eyes (nystagmus). In most cases, a single gene mutation prevents normal development of cone photoreceptors, with mutations in the CNGB3 or CNGA3 gene being responsible for ∼80 % of all patients with achromatopsia. There are a growing number of studies investigating recovery of cone function after targeted gene therapy. These studies have provided some promise for patients with the CNGA3 mutation, but thus far have found limited or no recovery for patients with the CNGB3 mutation. Here, we developed colour-calibrated visual stimuli designed to isolate cone photoreceptor responses. We combined these with adapted fMRI techniques and pRF mapping to identify if cortical responses to cone-driven signals could be detected in 9 adult patients with the CNGB3 mutation after receiving gene therapy. We did not detect any change in brain activity after gene therapy when the 9 patients were analysed as a group. However, on an individual basis, one patient self-reported a change in colour perception, corroborated by improved performance on a psychophysical task designed to selectively identify cone function. This suggests a level of cone sensitivity that was lacking pre-treatment, further supported by a subtle but reliable change in cortical activity within their primary visual cortex.
Collapse
Affiliation(s)
- Elaine J Anderson
- UCL Institute of Ophthalmology, University College London, UK; UCL Institute of Cognitive Neuroscience, University College London, UK; The Wellcome Centre for Human Neuroimaging, University College London, UK.
| | - Tessa M Dekker
- UCL Institute of Ophthalmology, University College London, UK; Experimental Psychology, University College London, UK
| | - Mahtab Farahbakhsh
- UCL Institute of Ophthalmology, University College London, UK; Experimental Psychology, University College London, UK
| | - Nashila Hirji
- UCL Institute of Ophthalmology, University College London, UK; Moorfields Eye Hospital, London, UK
| | - D Samuel Schwarzkopf
- Experimental Psychology, University College London, UK; School of Optometry & Vision Science, University of Auckland, New Zealand
| | - Michel Michaelides
- UCL Institute of Ophthalmology, University College London, UK; Moorfields Eye Hospital, London, UK
| | - Geraint Rees
- UCL Institute of Cognitive Neuroscience, University College London, UK; The Wellcome Centre for Human Neuroimaging, University College London, UK
| |
Collapse
|
2
|
Kandemir G, Olivers C. Comparing Neural Correlates of Memory Encoding and Maintenance for Foveal and Peripheral Stimuli. J Cogn Neurosci 2024; 36:1807-1826. [PMID: 38940724 PMCID: PMC11324249 DOI: 10.1162/jocn_a_02203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/29/2024]
Abstract
Visual working memory is believed to rely on top-down attentional mechanisms that sustain active sensory representations in early visual cortex, a mechanism referred to as sensory recruitment. However, both bottom-up sensory input and top-down attentional modulations thereof appear to prioritize the fovea over the periphery, such that initially peripheral percepts may even be assimilated by foveal processes. This raises the question whether and how visual working memory differs for central and peripheral input. To address this, we conducted a delayed orientation recall task in which an orientation was presented either at the center of the screen or at 15° eccentricity to the left or right. Response accuracy, EEG activity, and gaze position were recorded from 30 participants. Accuracy was slightly but significantly higher for foveal versus peripheral memories. Decoding of EEG recordings revealed a clear dissociation between early sensory and later maintenance signals. Although sensory signals were clearly decodable for foveal stimuli, they were not for peripheral input. In contrast, maintenance signals were equally decodable for both foveal and peripheral memories, suggesting comparable top-down components regardless of eccentricity. Moreover, although memory representations were initially spatially specific and reflected in voltage fluctuations, later during the maintenance period, they generalized across locations, as emerged in alpha oscillations, thus revealing a dynamic transformation within memory from separate sensory traces to what we propose are common output-related codes. Furthermore, the combined absence of reliable decoding of sensory signals and robust presence of maintenance decoding indicates that storage activity patterns as measured by EEG reflect signals beyond primary visual cortex. We discuss the implications for the sensory recruitment hypothesis.
Collapse
|
3
|
Pais ML, Teixeira M, Soares C, Lima G, Rijo P, Cabral C, Castelo-Branco M. Rapid effects of tryptamine psychedelics on perceptual distortions and early visual cortical population receptive fields. Neuroimage 2024; 297:120718. [PMID: 38964563 DOI: 10.1016/j.neuroimage.2024.120718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2024] [Revised: 06/28/2024] [Accepted: 07/01/2024] [Indexed: 07/06/2024] Open
Abstract
N, N-dimethyltryptamine (DMT) is a psychedelic tryptamine acting on 5-HT2A serotonin receptors, which is associated with intense visual hallucinatory phenomena and perceptual changes such as distortions in visual space. The neural underpinnings of these effects remain unknown. We hypothesised that changes in population receptive field (pRF) properties in the primary visual cortex (V1) might underlie visual perceptual experience. We tested this hypothesis using magnetic resonance imaging (MRI) in a within-subject design. We used a technique called pRF mapping, which measures neural population visual response properties and retinotopic maps in early visual areas. We show that in the presence of visual effects, as documented by the Hallucinogen Rating Scale (HRS), the mean pRF sizes in V1 significantly increase in the peripheral visual field for active condition (inhaled DMT) compared to the control. Eye and head movement differences were absent across conditions. This evidence for short-term effects of DMT in pRF may explain perceptual distortions induced by psychedelics such as field blurring, tunnel vision (peripheral vision becoming blurred while central vision remains sharp) and the enlargement of nearby visual space, particularly at the visual locations surrounding the fovea. Our findings are also consistent with a mechanistic framework whereby gain control of ongoing and evoked activity in the visual cortex is controlled by activation of 5-HT2A receptors.
Collapse
Affiliation(s)
- Marta Lapo Pais
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), Portugal
| | - Marta Teixeira
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), Portugal
| | - Carla Soares
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), Portugal
| | - Gisela Lima
- Institute of Nuclear Sciences Applied to Health (ICNAS), Portugal; University of Maastricht, the Netherlands; Faculty of Medicine (FMUC), University of Coimbra, Portugal
| | - Patrícia Rijo
- CBIOS-Universidade Lusófona's Research Center for Biosciences & Health Technologies, Portugal; iMed.ULisboa, Faculty of Pharmacy, University of Lisbon, Portugal
| | - Célia Cabral
- Coimbra Institute for Clinical and Biomedical Research (iCBR), Clinic Academic Center of Coimbra (CACC), University of Coimbra, FMUC, Portugal; Center for Innovative Biomedicine and Biotechnology (CIBB), University of Coimbra, Portugal; Centre for Functional Ecology, Department of Life Sciences, University of Coimbra, Portugal
| | - Miguel Castelo-Branco
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, Portugal; Institute of Nuclear Sciences Applied to Health (ICNAS), Portugal; University of Maastricht, the Netherlands; Faculty of Medicine (FMUC), University of Coimbra, Portugal.
| |
Collapse
|
4
|
Waz S, Wang Y, Lu ZL. qPRF: A system to accelerate population receptive field decoding. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.08.13.607805. [PMID: 39185219 PMCID: PMC11343136 DOI: 10.1101/2024.08.13.607805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/27/2024]
Abstract
Patterns of BOLD response can be decoded using the population receptive field (PRF) model to reveal how visual input is represented on the cortex (Dumoulin and Wandell, 2008). The time cost of evaluating the PRF model is high, often requiring days to decode BOLD signals for a small cohort of subjects. We introduce the qPRF, an efficient method for decoding that reduced the computation time by a factor of 1436 when compared to another widely available PRF decoder (Kay, Winawer, Mezer and Wandell, 2013) on a benchmark of data from the Human Connectome Project (HCP; Van Essen, Smith, Barch, Behrens, Yacoub and Ugurbil, 2013). With a specially designed data structure and an efficient search algorithm, the qPRF optimizes the five PRF model parameters according to a least-squares criterion. To verify the accuracy of the qPRF solutions, we compared them to those provided by Benson, Jamison, Arcaro, Vu, Glasser, Coalson, Van Essen, Yacoub, Ugurbil, Winawer and Kay (2018). Both hemispheres of the 181 subjects in the HCP data set (a total of 10,753,572 vertices, each with a unique BOLD time series of 1800 frames) were decoded by qPRF in 15.2 hours on an ordinary CPU. The absolute difference inR 2 reported by Benson et al. and achieved by the qPRF was negligible, with a median of 0.39% (R 2 units being between 0% and 100%). In general, the qPRF yielded a slightly better fitting solution, achieving a greaterR 2 on 99.7% of vertices. The qPRF may facilitate the development and computation of more elaborate models based on the PRF framework, as well as the exploration of novel clinical applications.
Collapse
Affiliation(s)
- Sebastian Waz
- Center for Neural Science, New York University, 4 Washington Place, New York, 10003, NY, USA
| | - Yalin Wang
- School of Computing and Augmented Intelligence, Arizona State University, 699 S. Mill Avenue, Tempe, 85281, AZ, USA
| | - Zhong-Lin Lu
- Center for Neural Science, New York University, 4 Washington Place, New York, 10003, NY, USA
- Division of Arts and Sciences, NYU Shanghai, 567 West Yangsi Road, Pudong New District, 200124, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science, 3663 Zhongshan Road North, Putuo District, 200062, Shanghai, China
| |
Collapse
|
5
|
Kupers ER, Kim I, Grill-Spector K. Rethinking simultaneous suppression in visual cortex via compressive spatiotemporal population receptive fields. Nat Commun 2024; 15:6885. [PMID: 39128923 PMCID: PMC11317513 DOI: 10.1038/s41467-024-51243-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Accepted: 07/24/2024] [Indexed: 08/13/2024] Open
Abstract
When multiple visual stimuli are presented simultaneously in the receptive field, the neural response is suppressed compared to presenting the same stimuli sequentially. The prevailing hypothesis suggests that this suppression is due to competition among multiple stimuli for limited resources within receptive fields, governed by task demands. However, it is unknown how stimulus-driven computations may give rise to simultaneous suppression. Using fMRI, we find simultaneous suppression in single voxels, which varies with both stimulus size and timing, and progressively increases up the visual hierarchy. Using population receptive field (pRF) models, we find that compressive spatiotemporal summation rather than compressive spatial summation predicts simultaneous suppression, and that increased simultaneous suppression is linked to larger pRF sizes and stronger compressive nonlinearities. These results necessitate a rethinking of simultaneous suppression as the outcome of stimulus-driven compressive spatiotemporal computations within pRFs, and open new opportunities to study visual processing capacity across space and time.
Collapse
Affiliation(s)
- Eline R Kupers
- Department of Psychology, Stanford University, Stanford, CA, USA.
| | - Insub Kim
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| |
Collapse
|
6
|
Lu ZL, Yang S, Dosher B. Hierarchical Bayesian Augmented Hebbian Reweighting Model of Perceptual Learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.08.08.606902. [PMID: 39149245 PMCID: PMC11326272 DOI: 10.1101/2024.08.08.606902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
The Augmented Hebbian Reweighting Model (AHRM) has been effectively utilized to model the collective performance of observers in various perceptual learning studies. In this work, we have introduced a novel hierarchical Bayesian Augmented Hebbian Reweighting Model (HB-AHRM) to simultaneously model the learning curves of individual participants and the entire population within a single framework. We have compared its performance to that of a Bayesian Inference Procedure (BIP), which independently estimates the posterior distributions of model parameters for each individual subject without employing a hierarchical structure. To cope with the substantial computational demands, we developed an approach to approximate the likelihood function in the AHRM with feature engineering and linear regression, increasing the speed of the estimation procedure by 20,000 times. The HB-AHRM has enabled us to compute the joint posterior distribution of hyperparameters and parameters at the population, observer, and test levels, facilitating statistical inferences across these levels. While we have developed this methodology within the context of a single experiment, the HB-AHRM and the associated modeling techniques can be readily applied to analyze data from various perceptual learning experiments and provide predictions of human performance at both the population and individual levels. The likelihood approximation concept introduced in this study may have broader utility in fitting other stochastic models lacking analytic forms.
Collapse
Affiliation(s)
- Zhong-Lin Lu
- Division of Arts and Sciences, NYU Shanghai, Shanghai, China; Center for Neural Science and Department of Psychology, New York University, New York, USA; NYU-ECNU Institute of Brain and Cognitive Science, Shanghai, China
| | - Shanglin Yang
- Division of Arts and Sciences, NYU Shanghai, Shanghai, China
| | - Barbara Dosher
- Cognitive Sciences Department, University of California, Irvine, CA 92697-5100, USA
| |
Collapse
|
7
|
Jang G, Kragel PA. Understanding human amygdala function with artificial neural networks. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.29.605621. [PMID: 39131372 PMCID: PMC11312467 DOI: 10.1101/2024.07.29.605621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
The amygdala is a cluster of subcortical nuclei that receives diverse sensory inputs and projects to the cortex, midbrain and other subcortical structures. Numerous accounts of amygdalar contributions to social and emotional behavior have been offered, yet an overarching description of amygdala function remains elusive. Here we adopt a computationally explicit framework that aims to develop a model of amygdala function based on the types of sensory inputs it receives, rather than individual constructs such as threat, arousal, or valence. Characterizing human fMRI signal acquired as participants viewed a full-length film, we developed encoding models that predict both patterns of amygdala activity and self-reported valence evoked by naturalistic images. We use deep image synthesis to generate artificial stimuli that distinctly engage encoding models of amygdala subregions that systematically differ from one another in terms of their low-level visual properties. These findings characterize how the amygdala compresses high-dimensional sensory inputs into low-dimensional representations relevant for behavior.
Collapse
|
8
|
Kurzawski JW, Qiu BS, Majaj NJ, Benson NC, Pelli D, Winawer J. Human V4 size predicts crowding distance. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.03.587977. [PMID: 38617271 PMCID: PMC11014589 DOI: 10.1101/2024.04.03.587977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/16/2024]
Abstract
Visual recognition is limited by both object size (acuity) and spacing. The spacing limit, called "crowding", is the failure to recognize an object in the presence of other objects. Here, we take advantage of individual differences in crowding behavior to investigate its biological basis. Crowding distance, the minimum object spacing needed for recognition, varies 2-fold among healthy adults. We test the conjecture that this variation in psychophysical crowding distance is due to variation in cortical map size. To test this, we made paired measurements of brain and behavior in 50 observers. We used psychophysics to measure crowding distance and calculate λ, the number of letters that fit into each observer's visual field without crowding. In the same observers, we used fMRI to measure the surface area A (mm^2) of retinotopic maps V1, V2, V3, and V4. Across observers, λ is proportional to the surface area of V4 but is uncorrelated with the surface area of V1 to V3. The proportional relationship of λ to area of V4 indicates conservation of cortical crowding distance across individuals: letters can be recognized if they are spaced by at least 1.4 mm on the V4 map, irrespective of map size and psychophysical crowding distance. We conclude that the size of V4 predicts the spacing limit of visual perception.
Collapse
|
9
|
Master SL, Li S, Curtis CE. Trying Harder: How Cognitive Effort Sculpts Neural Representations during Working Memory. J Neurosci 2024; 44:e0060242024. [PMID: 38769009 PMCID: PMC11236589 DOI: 10.1523/jneurosci.0060-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 03/26/2024] [Accepted: 03/28/2024] [Indexed: 05/22/2024] Open
Abstract
While the exertion of mental effort improves performance on cognitive tasks, the neural mechanisms by which motivational factors impact cognition remain unknown. Here, we used fMRI to test how changes in cognitive effort, induced by changes in task difficulty, impact neural representations of working memory (WM). Participants (both sexes) were precued whether WM difficulty would be hard or easy. We hypothesized that hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard compared with easy trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity during delay periods in the prefrontal cortex (PFC), especially during hard trials. Yet, details of the memoranda could not be decoded from patterns in prefrontal activity. In the patterns of activity in the visual cortex, however, we found strong decoding of memorized targets, where accuracy was higher on hard trials. To potentially link these across-region effects, we hypothesized that effort, carried by persistent activity in the PFC, impacts the quality of WM representations encoded in the visual cortex. Indeed, we found that the amplitude of delay period activity in the frontal cortex predicted decoded accuracy in the visual cortex on a trial-wise basis. These results indicate that effort-related feedback signals sculpt population activity in the visual cortex, improving mnemonic fidelity.
Collapse
Affiliation(s)
- Sarah L Master
- Department of Psychology, New York University, New York, New York 10003
| | - Shanshan Li
- Department of Psychology, New York University, New York, New York 10003
- Program in Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Clayton E Curtis
- Department of Psychology, New York University, New York, New York 10003
- Center for Neural Science, New York University, New York, New York 10003
| |
Collapse
|
10
|
Ma S, Wang L, Hou S, Zhang C, Yan B. Large-scale parameters framework with large convolutional kernel for encoding visual fMRI activity information. Cereb Cortex 2024; 34:bhae257. [PMID: 38997209 DOI: 10.1093/cercor/bhae257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Revised: 06/01/2024] [Accepted: 06/02/2024] [Indexed: 07/14/2024] Open
Abstract
Visual encoding models often use deep neural networks to describe the brain's visual cortex response to external stimuli. Inspired by biological findings, researchers found that large receptive fields built with large convolutional kernels improve convolutional encoding model performance. Inspired by scaling laws in recent years, this article investigates the performance of large convolutional kernel encoding models on larger parameter scales. This paper proposes a large-scale parameters framework with a sizeable convolutional kernel for encoding visual functional magnetic resonance imaging activity information. The proposed framework consists of three parts: First, the stimulus image feature extraction module is constructed using a large-kernel convolutional network while increasing channel numbers to expand the parameter size of the framework. Second, enlarging the input data during the training stage through the multi-subject fusion module to accommodate the increase in parameters. Third, the voxel mapping module maps from stimulus image features to functional magnetic resonance imaging signals. Compared to sizeable convolutional kernel visual encoding networks with base parameter scale, our visual encoding framework improves by approximately 7% on the Natural Scenes Dataset, the dedicated dataset for the Algonauts 2023 Challenge. We further analyze that our encoding framework made a trade-off between encoding performance and trainability. This paper confirms that expanding parameters in visual coding can bring performance improvements.
Collapse
Affiliation(s)
- Shuxiao Ma
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, 450000, China
| | - Linyuan Wang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, 450000, China
| | - Senbao Hou
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, 450000, China
| | - Chi Zhang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, 450000, China
| | - Bin Yan
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, 450000, China
| |
Collapse
|
11
|
Cicero NG, Klimova M, Lewis LD, Ling S. Differential cortical and subcortical visual processing with eyes shut. J Neurophysiol 2024; 132:54-60. [PMID: 38810261 DOI: 10.1152/jn.00073.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 05/06/2024] [Accepted: 05/29/2024] [Indexed: 05/31/2024] Open
Abstract
Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar blood oxygenation level-dependent (BOLD) responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitatively distinct pattern of visual processing when the eyes are closed-one that is not simply an overall attenuation but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserve information about stimuli but are then gated off downstream in visual cortex.NEW & NOTEWORTHY When we close our eyes coarse luminance information is still accessible by the visual system. Using functional magnetic resonance imaging, we examined whether eyelid closure plays a unique role in visual processing. We discovered that while the LGN and V1 show equivalent responses when the eyes are open or closed, extrastriate cortex exhibited attenuated responses with eye closure. This suggests that when the eyes are closed, downstream visual processing is blind to this information.
Collapse
Affiliation(s)
- Nicholas G Cicero
- Graduate Program in Neuroscience, Boston University, Boston, Massachusetts, United States
- Department of Biomedical Engineering, Boston University, Boston, Massachusetts, United States
- Institute for Medical Engineering and Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
| | - Michaela Klimova
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, United States
| | - Laura D Lewis
- Department of Biomedical Engineering, Boston University, Boston, Massachusetts, United States
- Institute for Medical Engineering and Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts, United States
| | - Sam Ling
- Graduate Program in Neuroscience, Boston University, Boston, Massachusetts, United States
- Department of Psychological and Brain Sciences, Boston University, Boston, Massachusetts, United States
| |
Collapse
|
12
|
Mascheretti S, Arrigoni F, Toraldo A, Giubergia A, Andreola C, Villa M, Lampis V, Giorda R, Villa M, Peruzzo D. Alterations in neural activation in the ventral frontoparietal network during complex magnocellular stimuli in developmental dyslexia associated with READ1 deletion. BEHAVIORAL AND BRAIN FUNCTIONS : BBF 2024; 20:16. [PMID: 38926731 PMCID: PMC11210179 DOI: 10.1186/s12993-024-00241-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 06/11/2024] [Indexed: 06/28/2024]
Abstract
BACKGROUND An intronic deletion within intron 2 of the DCDC2 gene encompassing the entire READ1 (hereafter, READ1d) has been associated in both children with developmental dyslexia (DD) and typical readers (TRs), with interindividual variation in reading performance and motion perception as well as with structural and functional brain alterations. Visual motion perception -- specifically processed by the magnocellular (M) stream -- has been reported to be a solid and reliable endophenotype of DD. Hence, we predicted that READ1d should affect neural activations in brain regions sensitive to M stream demands as reading proficiency changes. METHODS We investigated neural activations during two M-eliciting fMRI visual tasks (full-field sinusoidal gratings controlled for spatial and temporal frequencies and luminance contrast, and sensitivity to motion coherence at 6%, 15% and 40% dot coherence levels) in four subject groups: children with DD with/without READ1d, and TRs with/without READ1d. RESULTS At the Bonferroni-corrected level of significance, reading skills showed a significant effect in the right polar frontal cortex during the full-field sinusoidal gratings-M task. Regardless of the presence/absence of the READ1d, subjects with poor reading proficiency showed hyperactivation in this region of interest (ROI) compared to subjects with better reading scores. Moreover, a significant interaction was found between READ1d and reading performance in the left frontal opercular area 4 during the 15% coherent motion sensitivity task. Among subjects with poor reading performance, neural activation in this ROI during this specific task was higher for subjects without READ1d than for READ1d carriers. The difference vanished as reading skills increased. CONCLUSIONS Our findings showed a READ1d-moderated genetic vulnerability to alterations in neural activation in the ventral attentive and salient networks during the processing of relevant stimuli in subjects with poor reading proficiency.
Collapse
Affiliation(s)
- Sara Mascheretti
- Department of Brain and Behavioral Sciences, University of Pavia, Piazza Botta, 6, Pavia (PV), 27100, PV, Italy.
- Child Psychopathology Unit, Scientific Institute IRCCS Eugenio Medea, Bosisio Parini (LC), Italy.
| | - Filippo Arrigoni
- Radiology and Neuroradiology Department, Children's Hospital V. Buzzi, Milan, Italy
| | - Alessio Toraldo
- Department of Brain and Behavioral Sciences, University of Pavia, Piazza Botta, 6, Pavia (PV), 27100, PV, Italy
- Milan Centre for Neuroscience (NeuroMI), Milan, Italy
| | - Alice Giubergia
- Neuroimaging Unit, Scientific Institute IRCCS Eugenio Medea, Bosisio Parini (LC), Italy
| | | | - Martina Villa
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA
- The Connecticut Institute for Brain and Cognitive Sciences, University of Connecticut, Storrs, CT, USA
- Yale Child Study Center Language Sciences Consortium, New Haven, CT, USA
| | - Valentina Lampis
- Department of Brain and Behavioral Sciences, University of Pavia, Piazza Botta, 6, Pavia (PV), 27100, PV, Italy
- Child Psychopathology Unit, Scientific Institute IRCCS Eugenio Medea, Bosisio Parini (LC), Italy
| | - Roberto Giorda
- Molecular Biology Laboratory, Scientific Institute IRCCS Eugenio Medea, Bosisio Parini (LC), Italy
| | - Marco Villa
- Molecular Biology Laboratory, Scientific Institute IRCCS Eugenio Medea, Bosisio Parini (LC), Italy
| | - Denis Peruzzo
- Neuroimaging Unit, Scientific Institute IRCCS Eugenio Medea, Bosisio Parini (LC), Italy
| |
Collapse
|
13
|
Li Y, Yang H, Gu S. Enhancing neural encoding models for naturalistic perception with a multi-level integration of deep neural networks and cortical networks. Sci Bull (Beijing) 2024; 69:1738-1747. [PMID: 38490889 DOI: 10.1016/j.scib.2024.02.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Revised: 06/27/2023] [Accepted: 02/23/2024] [Indexed: 03/17/2024]
Abstract
Cognitive neuroscience aims to develop computational models that can accurately predict and explain neural responses to sensory inputs in the cortex. Recent studies attempt to leverage the representation power of deep neural networks (DNNs) to predict the brain response and suggest a correspondence between artificial and biological neural networks in their feature representations. However, typical voxel-wise encoding models tend to rely on specific networks designed for computer vision tasks, leading to suboptimal brain-wide correspondence during cognitive tasks. To address this challenge, this work proposes a novel approach that upgrades voxel-wise encoding models through multi-level integration of features from DNNs and information from brain networks. Our approach combines DNN feature-level ensemble learning and brain atlas-level model integration, resulting in significant improvements in predicting whole-brain neural activity during naturalistic video perception. Furthermore, this multi-level integration framework enables a deeper understanding of the brain's neural representation mechanism, accurately predicting the neural response to complex visual concepts. We demonstrate that neural encoding models can be optimized by leveraging a framework that integrates both data-driven approaches and theoretical insights into the functional structure of the cortical networks.
Collapse
Affiliation(s)
- Yuanning Li
- School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai 201210, China.
| | - Huzheng Yang
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Shi Gu
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Shenzhen 518110, China.
| |
Collapse
|
14
|
Chang K, Fine I, Boynton GM. Improving the Reliability and Accuracy of Population Receptive Field Measures Using a Logarithmically Warped Stimulus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.11.598529. [PMID: 38915587 PMCID: PMC11195291 DOI: 10.1101/2024.06.11.598529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/26/2024]
Abstract
The population receptive field method, which measures the region in visual space that elicits a BOLD signal in a voxel in retinotopic cortex, is a powerful tool for investigating the functional organization of human visual cortex with fMRI (Dumoulin & Wandell, 2008). However, recent work has shown that population receptive field (pRF) estimates for early retinotopic visual areas can be biased and unreliable, especially for voxels representing the fovea. Here, we show that a 'log-bar' stimulus that is logarithmically warped along the eccentricity dimension produces more reliable estimates of pRF size and location than the traditional moving bar stimulus. The log-bar stimulus was better able to identify pRFs near the foveal representation, and pRFs were smaller in size, consistent with simulation estimates of receptive field sizes in the fovea.
Collapse
Affiliation(s)
- Kelly Chang
- Department of Psychology, University of Washington Seattle, Washington
| | - Ione Fine
- Department of Psychology, University of Washington Seattle, Washington
| | | |
Collapse
|
15
|
Chakravarthula PN, Eckstein MP. A preference to look closer to the eyes is associated with a position-invariant face neural code. Psychon Bull Rev 2024; 31:1268-1279. [PMID: 37930609 PMCID: PMC11192658 DOI: 10.3758/s13423-023-02412-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/17/2023] [Indexed: 11/07/2023]
Abstract
When looking at faces, humans invariably move their eyes to a consistent preferred first fixation location on the face. While most people have the preferred fixation location just below the eyes, a minority have it between the nose-tip and mouth. Not much is known about whether these long-term differences in the preferred fixation location are associated with distinct neural representations of faces. To study this, we used a gaze-contingent face adaptation aftereffect paradigm to test in two groups of observers, one with their mean preferred fixation location closer to the eyes (upper lookers) and the other closer to the mouth (lower lookers). In this task, participants were required to maintain their gaze at either their own group's mean preferred fixation location or that of the other group during adaptation and testing. The two possible fixation locations were 3.6° apart on the face. We measured the face adaptation aftereffects when the adaptation and testing happened while participants maintained fixation at either the same or different locations on the face. Both groups showed equally strong adaptation effects when the adaptation and testing happened at the same fixation location. Crucially, only the upper lookers showed a partial transfer of the FAE across the two fixation locations, when adaptation occurred at the eyes. Lower lookers showed no spatial transfer of the FAE irrespective of the adaptation position. Given the classic finding that neural tuning is increasingly position invariant as one moves higher in the visual hierarchy, this result suggests that differences in the preferred fixation location are associated with distinct neural representations of faces.
Collapse
Affiliation(s)
- Puneeth N Chakravarthula
- Psychological and Brain Science, University of California, Santa Barbara, CA, USA.
- Department of Radiology, Washington University in St. Louis, 4525 Scott Ave, St. Louis, MO, 2126 B63110, USA.
| | - Miguel P Eckstein
- Psychological and Brain Science, University of California, Santa Barbara, CA, USA
| |
Collapse
|
16
|
Ritter M, Hummer A, Pawloff M, Ledolter AA, Linhardt D, Woletz M, Deak GG, Sacu S, Ristl R, Ramazanova D, Holder GE, Windischberger C, Schmidt-Erfurth UM. Retinotopic cortical mapping in objective functional monitoring of macular therapy. Br J Ophthalmol 2024:bjophthalmol-2021-320723. [PMID: 38811051 DOI: 10.1136/bjo-2021-320723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 05/15/2024] [Indexed: 05/31/2024]
Abstract
BACKGROUND/AIMS To determine the suitability of functional MRI (fMRI) as an objective measure of macular function following therapeutic intervention; conventional psychophysical measures rely heavily on patient compliance. METHODS Twenty patients with neovascular age-related macular degeneration (nAMD) were studied with high-resolution fMRI, visual acuity, reading accuracy and speed, contrast sensitivity (CS) and microperimetry (MP) before and after 3 monthly intravitreal injections of ranibizumab. Population-receptive field retinotopic maps calculated from fMRI data were compared with psychophysical measures and optical coherence tomography. RESULTS Best-corrected visual acuity (BCVA) responders (≥5 letters) showed an increase of 29.5% in activated brain area, while non-responders showed a decrease of 0.8%. Radial histograms over eccentricity allowed quantification of the absolute number of significant voxels and thus differences before and after treatment. Responders showed increases in foveal (α<0.5°) activation, while non-responders did not. Absence of intraretinal fluid and preservation of outer retinal layers was associated with higher numbers of active V1 voxels and better BCVA. Higher voxel numbers were associated with improved reading performance and, less marked, with BCVA, CS and MP. CONCLUSION The data show that retinotopic mapping using fMRI can successfully be applied objectively to evaluate the therapeutic response in nAMD patients treated with anti-vascular endothelial growth factor therapy. This demonstrates the ability of retinotopic mapping to provide an objective assessment of functional recovery at a cortical level; the technique can therefore be applied, in other degenerative macular diseases, to the assessment of potential therapeutic interventions such as gene therapy or cell replacement therapy.
Collapse
Affiliation(s)
- Markus Ritter
- Department of Ophthalmology, Medical University of Vienna, Vienna, Austria
| | - Allan Hummer
- MR Center of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Maximilian Pawloff
- Department of Ophthalmology, Medical University of Vienna, Vienna, Austria
| | - Anna A Ledolter
- Department of Ophthalmology, Medical University of Vienna, Vienna, Austria
| | - David Linhardt
- MR Center of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Michael Woletz
- MR Center of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Gabor Gyoergy Deak
- Department of Ophthalmology, Medical University of Vienna, Vienna, Austria
| | - Stefan Sacu
- Department of Ophthalmology, Medical University of Vienna, Vienna, Austria
| | - Robin Ristl
- Section for Medical Statistics, Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, Austria
| | - Dariga Ramazanova
- Section for Medical Statistics, Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, Austria
| | - Graham E Holder
- Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- UCL Institute of Ophthalmology, London, UK
| | - Christian Windischberger
- MR Center of Excellence, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | | |
Collapse
|
17
|
Phangwiwat T, Phunchongharn P, Wongsawat Y, Chatnuntawech I, Wang S, Chunharas C, Sprague TC, Woodman GF, Itthipuripat S. Sustained attention operates via dissociable neural mechanisms across different eccentric locations. Sci Rep 2024; 14:11188. [PMID: 38755251 PMCID: PMC11099062 DOI: 10.1038/s41598-024-61171-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Accepted: 05/02/2024] [Indexed: 05/18/2024] Open
Abstract
In primates, foveal and peripheral vision have distinct neural architectures and functions. However, it has been debated if selective attention operates via the same or different neural mechanisms across eccentricities. We tested these alternative accounts by examining the effects of selective attention on the steady-state visually evoked potential (SSVEP) and the fronto-parietal signal measured via EEG from human subjects performing a sustained visuospatial attention task. With a negligible level of eye movements, both SSVEP and SND exhibited the heterogeneous patterns of attentional modulations across eccentricities. Specifically, the attentional modulations of these signals peaked at the parafoveal locations and such modulations wore off as visual stimuli appeared closer to the fovea or further away towards the periphery. However, with a relatively higher level of eye movements, the heterogeneous patterns of attentional modulations of these neural signals were less robust. These data demonstrate that the top-down influence of covert visuospatial attention on early sensory processing in human cortex depends on eccentricity and the level of saccadic responses. Taken together, the results suggest that sustained visuospatial attention operates differently across different eccentric locations, providing new understanding of how attention augments sensory representations regardless of where the attended stimulus appears.
Collapse
Affiliation(s)
- Tanagrit Phangwiwat
- Neuroscience Center for Research and Innovation (NX), Learning Institute, King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10140, Thailand
- Big Data Experience Center (BX), King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10600, Thailand
- Department of Computer Engineering, King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10140, Thailand
| | - Phond Phunchongharn
- Big Data Experience Center (BX), King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10600, Thailand
- Department of Computer Engineering, King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10140, Thailand
| | - Yodchanan Wongsawat
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, Nakhon Pathom, 73170, Thailand
| | - Itthi Chatnuntawech
- National Nanotechnology Center, National Science and Technology Development Agency, Pathum Thani, 12120, Thailand
| | - Sisi Wang
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Department of Psychology, Vanderbilt University, Nashville, TN, 37235, USA
| | - Chaipat Chunharas
- Cognitive Clinical and Computational Neuroscience Center of Excellence, Department of Internal Medicine, Faculty of Medicine, Chulalongkorn University, Bangkok, 10330, Thailand
- Chula Neuroscience Center, King Chulalongkorn Memorial Hospital, Thai Red Cross Society, Bangkok, 10330, Thailand
| | - Thomas C Sprague
- Department of Psychological and Brain Sciences, University of California Santa Barbara, Santa Barbara, CA, 93106, USA
| | - Geoffrey F Woodman
- Department of Psychology, Vanderbilt University, Nashville, TN, 37235, USA
| | - Sirawaj Itthipuripat
- Neuroscience Center for Research and Innovation (NX), Learning Institute, King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10140, Thailand.
- Big Data Experience Center (BX), King Mongkut's University of Technology Thonburi (KMUTT), Bangkok, 10600, Thailand.
- Department of Psychology, Vanderbilt University, Nashville, TN, 37235, USA.
| |
Collapse
|
18
|
Li HH, Sprague TC, Yoo AH, Ma WJ, Curtis CE. Neural mechanisms of resource allocation in working memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.11.593695. [PMID: 38766258 PMCID: PMC11100829 DOI: 10.1101/2024.05.11.593695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
To mitigate capacity limits of working memory, people allocate resources according to an item's relevance. However, the neural mechanisms supporting such a critical operation remain unknown. Here, we developed computational neuroimaging methods to decode and demix neural responses associated with multiple items in working memory with different priorities. In striate and extrastriate cortex, the gain of neural responses tracked the priority of memoranda. Higher-priority memoranda were decoded with smaller error and lower uncertainty. Moreover, these neural differences predicted behavioral differences in memory prioritization. Remarkably, trialwise variability in the magnitude of delay activity in frontal cortex predicted differences in decoded precision between low and high-priority items in visual cortex. These results suggest a model in which feedback signals broadcast from frontal cortex sculpt the gain of memory representations in visual cortex according to behavioral relevance, thus, identifying a neural mechanism for resource allocation.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, NY 10003, USA
- Department of Psychology, The Ohio State University, Columbus, OH 43201, USA
- These authors contributed equally
| | - Thomas C Sprague
- Department of Psychology, New York University, New York, NY 10003, USA
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA 93106, USA
- These authors contributed equally
| | - Aspen H Yoo
- Department of Psychology, New York University, New York, NY 10003, USA
| | - Wei Ji Ma
- Department of Psychology, New York University, New York, NY 10003, USA
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Clayton E Curtis
- Department of Psychology, New York University, New York, NY 10003, USA
- Center for Neural Science, New York University, New York, NY 10003, USA
| |
Collapse
|
19
|
Tünçok E, Carrasco M, Winawer J. Spatial attention alters visual cortical representation during target anticipation. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.02.583127. [PMID: 38496524 PMCID: PMC10942396 DOI: 10.1101/2024.03.02.583127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features in preparation for responding to a stimulus. Using a concurrent psychophysics- fMRI experiment, we investigated how covert spatial attention affects responses in human visual cortex prior to target onset, and how it affects subsequent behavioral performance. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention, demonstrating a selective tradeoff in processing. Pre-target BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere, paralleling the behavioral results. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties throughout and across multiple visual field maps.
Collapse
|
20
|
Malania M, Lin YS, Hörmandinger C, Werner JS, Greenlee MW, Plank T. Training-induced changes in population receptive field properties in visual cortex: Impact of eccentric vision training on population receptive field properties and the crowding effect. J Vis 2024; 24:7. [PMID: 38771584 PMCID: PMC11114612 DOI: 10.1167/jov.24.5.7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 02/15/2024] [Indexed: 05/22/2024] Open
Abstract
This study aimed to investigate the impact of eccentric-vision training on population receptive field (pRF) estimates to provide insights into brain plasticity processes driven by practice. Fifteen participants underwent functional magnetic resonance imaging (fMRI) measurements before and after behavioral training on a visual crowding task, where the relative orientation of the opening (gap position: up/down, left/right) in a Landolt C optotype had to be discriminated in the presence of flanking ring stimuli. Drifting checkerboard bar stimuli were used for pRF size estimation in multiple regions of interest (ROIs): dorsal-V1 (dV1), dorsal-V2 (dV2), ventral-V1 (vV1), and ventral-V2 (vV2), including the visual cortex region corresponding to the trained retinal location. pRF estimates in V1 and V2 were obtained along eccentricities from 0.5° to 9°. Statistical analyses revealed a significant decrease of the crowding anisotropy index (p = 0.009) after training, indicating improvement on crowding task performance following training. Notably, pRF sizes at and near the trained location decreased significantly (p = 0.005). Dorsal and ventral V2 exhibited significant pRF size reductions, especially at eccentricities where the training stimuli were presented (p < 0.001). In contrast, no significant changes in pRF estimates were found in either vV1 (p = 0.181) or dV1 (p = 0.055) voxels. These findings suggest that practice on a crowding task can lead to a reduction of pRF sizes in trained visual cortex, particularly in V2, highlighting the plasticity and adaptability of the adult visual system induced by prolonged training.
Collapse
Affiliation(s)
- Maka Malania
- Institute of Psychology, University of Regensburg, Regensburg, Germany
| | - Yih-Shiuan Lin
- Institute of Psychology, University of Regensburg, Regensburg, Germany
| | | | - John S Werner
- Department of Ophthalmology and Vision Science, University of California, Davis, Sacramento, CA, USA
| | - Mark W Greenlee
- Institute of Psychology, University of Regensburg, Regensburg, Germany
| | - Tina Plank
- Institute of Psychology, University of Regensburg, Regensburg, Germany
| |
Collapse
|
21
|
Lowndes R, Aveyard R, Welbourne LE, Wade A, Morland AB. In primary visual cortex fMRI responses to chromatic and achromatic stimuli are interdependent and predict contrast detection thresholds. Vision Res 2024; 218:108398. [PMID: 38552557 DOI: 10.1016/j.visres.2024.108398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 03/24/2024] [Accepted: 03/24/2024] [Indexed: 04/13/2024]
Abstract
Chromatic and achromatic signals in primary visual cortex have historically been considered independent of each other but have since shown evidence of interdependence. Here, we investigated the combination of two components of a stimulus; an achromatic dynamically changing check background and a chromatic (L-M or S cone) target grating. We found that combinations of chromatic and achromatic signals in primary visual cortex were interdependent, with the dynamic range of responses to chromatic contrast decreasing as achromatic contrast increased. A contrast detection threshold study also revealed interdependence of background and target, with increasing chromatic contrast detection thresholds as achromatic background contrast increased. A model that incorporated a normalising effect of achromatic contrast on chromatic responses, but not vice versa, best predicted our V1 data as well as behavioural thresholds. Further along the visual hierarchy, the dynamic range of chromatic responses was maintained when compared to achromatic responses, which became increasingly compressive.
Collapse
Affiliation(s)
- Rebecca Lowndes
- Department of Psychology, University of York, United Kingdom; York Neuroimaging Centre, University of York, United Kingdom.
| | - Richard Aveyard
- York Neuroimaging Centre, University of York, United Kingdom
| | - Lauren E Welbourne
- Department of Psychology, University of York, United Kingdom; York Neuroimaging Centre, University of York, United Kingdom
| | - Alex Wade
- Department of Psychology, University of York, United Kingdom; York Neuroimaging Centre, University of York, United Kingdom; York Biomedical Research Institute, University of York, United Kingdom
| | - Antony B Morland
- Department of Psychology, University of York, United Kingdom; York Neuroimaging Centre, University of York, United Kingdom; York Biomedical Research Institute, University of York, United Kingdom
| |
Collapse
|
22
|
Revsine C, Gonzalez-Castillo J, Merriam EP, Bandettini PA, Ramírez FM. A Unifying Model for Discordant and Concordant Results in Human Neuroimaging Studies of Facial Viewpoint Selectivity. J Neurosci 2024; 44:e0296232024. [PMID: 38438256 PMCID: PMC11044116 DOI: 10.1523/jneurosci.0296-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 02/06/2024] [Accepted: 02/15/2024] [Indexed: 03/06/2024] Open
Abstract
Recognizing faces regardless of their viewpoint is critical for social interactions. Traditional theories hold that view-selective early visual representations gradually become tolerant to viewpoint changes along the ventral visual hierarchy. Newer theories, based on single-neuron monkey electrophysiological recordings, suggest a three-stage architecture including an intermediate face-selective patch abruptly achieving invariance to mirror-symmetric face views. Human studies combining neuroimaging and multivariate pattern analysis (MVPA) have provided convergent evidence of view selectivity in early visual areas. However, contradictory conclusions have been reached concerning the existence in humans of a mirror-symmetric representation like that observed in macaques. We believe these contradictions arise from low-level stimulus confounds and data analysis choices. To probe for low-level confounds, we analyzed images from two face databases. Analyses of image luminance and contrast revealed biases across face views described by even polynomials-i.e., mirror-symmetric. To explain major trends across neuroimaging studies, we constructed a network model incorporating three constraints: cortical magnification, convergent feedforward projections, and interhemispheric connections. Given the identified low-level biases, we show that a gradual increase of interhemispheric connections across network-layers is sufficient to replicate view-tuning in early processing stages and mirror-symmetry in later stages. Data analysis decisions-pattern dissimilarity measure and data recentering-accounted for the inconsistent observation of mirror-symmetry across prior studies. Pattern analyses of human fMRI data (of either sex) revealed biases compatible with our model. The model provides a unifying explanation of MVPA studies of viewpoint selectivity and suggests observations of mirror-symmetry originate from ineffectively normalized signal imbalances across different face views.
Collapse
Affiliation(s)
- Cambria Revsine
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
- Department of Psychology, University of Chicago, Chicago, Illinois 60637
| | - Javier Gonzalez-Castillo
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
| | - Elisha P Merriam
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
| | - Peter A Bandettini
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
- Functional MRI Core Facility, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
| | - Fernando M Ramírez
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892
| |
Collapse
|
23
|
da Costa D, Kornemann L, Goebel R, Senden M. Convolutional neural networks develop major organizational principles of early visual cortex when enhanced with retinal sampling. Sci Rep 2024; 14:8980. [PMID: 38637554 PMCID: PMC11026486 DOI: 10.1038/s41598-024-59376-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 04/09/2024] [Indexed: 04/20/2024] Open
Abstract
Primate visual cortex exhibits key organizational principles: cortical magnification, eccentricity-dependent receptive field size and spatial frequency tuning as well as radial bias. We provide compelling evidence that these principles arise from the interplay of the non-uniform distribution of retinal ganglion cells, and a quasi-uniform convergence rate from the retina to the cortex. We show that convolutional neural networks outfitted with a retinal sampling layer, which resamples images according to retinal ganglion cell density, develop these organizational principles. Surprisingly, our results indicate that radial bias is spatial-frequency dependent and only manifests for high spatial frequencies. For low spatial frequencies, the bias shifts towards orthogonal orientations. These findings introduce a novel hypothesis about the origin of radial bias. Quasi-uniform convergence limits the range of spatial frequencies (in retinal space) that can be resolved, while retinal sampling determines the spatial frequency content throughout the retina.
Collapse
Affiliation(s)
- Danny da Costa
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands.
- Maastricht Brain Imaging Centre, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands.
| | - Lukas Kornemann
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands
- University of Bonn, Regina-Pacis-Weg 3, 53113, Bonn, Germany
| | - Rainer Goebel
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands
- Maastricht Brain Imaging Centre, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands
| | - Mario Senden
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands.
- Maastricht Brain Imaging Centre, Maastricht University, Oxfordlaan 55, 6229 EV, Maastricht, The Netherlands.
| |
Collapse
|
24
|
Woodry R, Curtis CE, Winawer J. Feedback scales the spatial tuning of cortical responses during visual memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.11.589111. [PMID: 38659957 PMCID: PMC11042180 DOI: 10.1101/2024.04.11.589111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Abstract
Perception, working memory, and long-term memory each evoke neural responses in visual cortex, suggesting that memory uses encoding mechanisms shared with perception. While previous research has largely focused on how perception and memory are similar, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each of these conditions, BOLD responses were spatially tuned and were aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width systematically up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the widths of tuned responses were broad across the visual hierarchy during working memory and long-term memory, matched to the widths in perception in later visual field maps but much broader in V1. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources. Moreover, these tuned responses when biased (clockwise or counterclockwise of target) predicted matched biases in memory, suggesting that the readout of maintained and reinstated mnemonic responses influences memory guided behavior. We conclude that feedback constrains spatial tuning during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.
Collapse
Affiliation(s)
- Robert Woodry
- Department of Psychology, New York University, New York City, NY 10003
| | - Clayton E. Curtis
- Department of Psychology, New York University, New York City, NY 10003
- Center for Neural Science, New York University, New York City, NY 10003
| | - Jonathan Winawer
- Department of Psychology, New York University, New York City, NY 10003
- Center for Neural Science, New York University, New York City, NY 10003
| |
Collapse
|
25
|
DeYoe EA, Huddleston W, Greenberg AS. Are neuronal mechanisms of attention universal across human sensory and motor brain maps? Psychon Bull Rev 2024:10.3758/s13423-024-02495-3. [PMID: 38587756 DOI: 10.3758/s13423-024-02495-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2024] [Indexed: 04/09/2024]
Abstract
One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.
Collapse
Affiliation(s)
- Edgar A DeYoe
- Department of Radiology, Medical College of Wisconsin, 8701 Watertown Plank Rd, Milwaukee, WI, 53226, USA.
- , Signal Mountain, USA.
| | - Wendy Huddleston
- School of Rehabilitation Sciences and Technology, College of Health Professions and Sciences, University of Wisconsin - Milwaukee, 3409 N. Downer Ave, Milwaukee, WI, 53211, USA
| | - Adam S Greenberg
- Department of Biomedical Engineering, Medical College of Wisconsin and Marquette University, Milwaukee, WI, 53226, USA
| |
Collapse
|
26
|
Tu Y, Li X, Lu ZL, Wang Y. Adaptive smoothing of retinotopic maps based on Teichmüller parametrization. Med Image Anal 2024; 93:103074. [PMID: 38160658 DOI: 10.1016/j.media.2023.103074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Revised: 12/20/2023] [Accepted: 12/21/2023] [Indexed: 01/03/2024]
Abstract
Retinotopic mapping, the mapping between visual inputs on the retina and neural responses on the cortical surface, is one of the fundamental topics in visual neuroscience. In human studies, retinotopic maps are conventionally constructed and processed by decoding blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to designed visual stimuli on the cortical surface. However, these methods frequently generate retinotopic maps that do not preserve topology, contradicting a fundamental property of retinotopic maps observed in neurophysiology. To address this problem, we propose an integrated approach to simultaneously refine the flattening from the 3D cortical surface to the 2D parametric space and adaptively smooth retinotopic perception centers in the visual space to make the retinotopic maps topological. One key element of the approach is the enhanced error tolerant Teichmüller mapping, which refines the parametrization by minimizing angle distortions and maximizing alignment to noisy landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets and applied it to compute cortical magnification factor (CMF). The results showed that the proposed approach was superior to other conventional retinotopic mapping methods in predicting BOLD fMRI time series and preserving topology.
Collapse
Affiliation(s)
- Yanshuai Tu
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA
| | - Xin Li
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA
| | - Zhong-Lin Lu
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China; Center for Neural Science and Department of Psychology, New York University, New York, NY, USA; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China.
| | - Yalin Wang
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA.
| |
Collapse
|
27
|
Li R, Li J, Wang C, Liu H, Liu T, Wang X, Zou T, Huang W, Yan H, Chen H. Multi-Semantic Decoding of Visual Perception with Graph Neural Networks. Int J Neural Syst 2024; 34:2450016. [PMID: 38372016 DOI: 10.1142/s0129065724500163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Constructing computational decoding models to account for the cortical representation of semantic information plays a crucial role in understanding visual perception. The human visual system processes interactive relationships among different objects when perceiving the semantic contents of natural visions. However, the existing semantic decoding models commonly regard categories as completely separate and independent visually and semantically and rarely consider the relationships from prior information. In this work, a novel semantic graph learning model was proposed to decode multiple semantic categories of perceived natural images from brain activity. The proposed model was validated on the functional magnetic resonance imaging data collected from five normal subjects while viewing 2750 natural images comprising 52 semantic categories. The results showed that the Graph Neural Network-based decoding model achieved higher accuracies than other deep neural network models. Moreover, the co-occurrence probability among semantic categories showed a significant correlation with the decoding accuracy. Additionally, the results suggested that semantic content organized in a hierarchical way with higher visual areas was more closely related to the internal visual experience. Together, this study provides a superior computational framework for multi-semantic decoding that supports the visual integration mechanism of semantic processing.
Collapse
Affiliation(s)
- Rong Li
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Jiyi Li
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Chong Wang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Haoxiang Liu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Tao Liu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Xuyang Wang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Ting Zou
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Wei Huang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Hongmei Yan
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| | - Huafu Chen
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
- MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China
| |
Collapse
|
28
|
Kupers ER, Kim I, Grill-Spector K. Rethinking simultaneous suppression in visual cortex via compressive spatiotemporal population receptive fields. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.06.24.546388. [PMID: 37461470 PMCID: PMC10350247 DOI: 10.1101/2023.06.24.546388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/20/2023]
Abstract
When multiple visual stimuli are presented simultaneously in the receptive field, the neural response is suppressed compared to presenting the same stimuli sequentially. The prevailing hypothesis suggests that this suppression is due to competition among multiple stimuli for limited resources within receptive fields, governed by task demands. However, it is unknown how stimulus-driven computations may give rise to simultaneous suppression. Using fMRI, we find simultaneous suppression in single voxels, which varies with both stimulus size and timing, and progressively increases up the visual hierarchy. Using population receptive field (pRF) models, we find that compressive spatiotemporal summation rather than compressive spatial summation predicts simultaneous suppression, and that increased simultaneous suppression is linked to larger pRF sizes and stronger compressive nonlinearities. These results necessitate a rethinking of simultaneous suppression as the outcome of stimulus-driven compressive spatiotemporal computations within pRFs, and open new opportunities to study visual processing capacity across space and time.
Collapse
Affiliation(s)
| | - Insub Kim
- Department of Psychology, Stanford University, CA, USA
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, CA, USA
| |
Collapse
|
29
|
Jiang C, Chen Z, Wolfe JM. Toward viewing behavior for aerial scene categorization. Cogn Res Princ Implic 2024; 9:17. [PMID: 38530617 PMCID: PMC10965882 DOI: 10.1186/s41235-024-00541-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 03/07/2024] [Indexed: 03/28/2024] Open
Abstract
Previous work has demonstrated similarities and differences between aerial and terrestrial image viewing. Aerial scene categorization, a pivotal visual processing task for gathering geoinformation, heavily depends on rotation-invariant information. Aerial image-centered research has revealed effects of low-level features on performance of various aerial image interpretation tasks. However, there are fewer studies of viewing behavior for aerial scene categorization and of higher-level factors that might influence that categorization. In this paper, experienced subjects' eye movements were recorded while they were asked to categorize aerial scenes. A typical viewing center bias was observed. Eye movement patterns varied among categories. We explored the relationship of nine image statistics to observers' eye movements. Results showed that if the images were less homogeneous, and/or if they contained fewer or no salient diagnostic objects, viewing behavior became more exploratory. Higher- and object-level image statistics were predictive at both the image and scene category levels. Scanpaths were generally organized and small differences in scanpath randomness could be roughly captured by critical object saliency. Participants tended to fixate on critical objects. Image statistics included in this study showed rotational invariance. The results supported our hypothesis that the availability of diagnostic objects strongly influences eye movements in this task. In addition, this study provides supporting evidence for Loschky et al.'s (Journal of Vision, 15(6), 11, 2015) speculation that aerial scenes are categorized on the basis of image parts and individual objects. The findings were discussed in relation to theories of scene perception and their implications for automation development.
Collapse
Affiliation(s)
- Chenxi Jiang
- School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, Hubei, China
| | - Zhenzhong Chen
- School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, Hubei, China.
- Hubei Luojia Laboratory, Wuhan, Hubei, China.
| | - Jeremy M Wolfe
- Harvard Medical School, Boston, MA, USA
- Brigham & Women's Hospital, Boston, MA, USA
| |
Collapse
|
30
|
Luo L, Wang X, Lu J, Chen G, Luan G, Li W, Wang Q, Fang F. Local field potentials, spiking activity, and receptive fields in human visual cortex. SCIENCE CHINA. LIFE SCIENCES 2024; 67:543-554. [PMID: 37957484 DOI: 10.1007/s11427-023-2436-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 08/21/2023] [Indexed: 11/15/2023]
Abstract
The concept of receptive field (RF) is central to sensory neuroscience. Neuronal RF properties have been substantially studied in animals, while those in humans remain nearly unexplored. Here, we measured neuronal RFs with intracranial local field potentials (LFPs) and spiking activity in human visual cortex (V1/V2/V3). We recorded LFPs via macro-contacts and discovered that RF sizes estimated from low-frequency activity (LFA, 0.5-30 Hz) were larger than those estimated from low-gamma activity (LGA, 30-60 Hz) and high-gamma activity (HGA, 60-150 Hz). We then took a rare opportunity to record LFPs and spiking activity via microwires in V1 simultaneously. We found that RF sizes and temporal profiles measured from LGA and HGA closely matched those from spiking activity. In sum, this study reveals that spiking activity of neurons in human visual cortex could be well approximated by LGA and HGA in RF estimation and temporal profile measurement, implying the pivotal functions of LGA and HGA in early visual information processing.
Collapse
Affiliation(s)
- Lu Luo
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- School of Psychology, Beijing Sport University, Beijing, 100084, China
| | - Xiongfei Wang
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
- Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
| | - Junshi Lu
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
| | - Guanpeng Chen
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, 100871, China
| | - Guoming Luan
- Department of Neurosurgery, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
- Beijing Key Laboratory of Epilepsy, Epilepsy Center, Sanbo Brain Hospital, Capital Medical University, Beijing, 100093, China
- Beijing Institute for Brain Disorders, Beijing, 100069, China
| | - Wu Li
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Qian Wang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
| | - Fang Fang
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, 100871, China.
| |
Collapse
|
31
|
Karami B, Schwiedrzik CM. Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity. NPJ SCIENCE OF LEARNING 2024; 9:13. [PMID: 38429339 PMCID: PMC10907723 DOI: 10.1038/s41539-024-00226-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 02/16/2024] [Indexed: 03/03/2024]
Abstract
Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning feature conjunctions. Visual cortex is organized into distinct anatomical compartments, each of which is devoted to processing a single feature. A prime example are neurons purely selective to color and orientation, respectively. However, neurons that jointly encode multiple features (mixed selectivity) also exist across the brain and play critical roles in a multitude of tasks. Here, we sought to uncover the optimal policy that our brain adapts to achieve conjunction learning using these available resources. 59 human subjects practiced orientation-color conjunction learning in four psychophysical experiments designed to nudge the visual system towards using one or the other resource. We find that conjunction learning is possible by linear mixing of pure color and orientation information, but that more and faster learning takes place when both pure and mixed selectivity representations are involved. We also find that learning with mixed selectivity confers advantages in performing an untrained "exclusive or" (XOR) task several months after learning the original conjunction task. This study sheds light on possible mechanisms underlying conjunction learning and highlights the importance of learning by mixed selectivity.
Collapse
Affiliation(s)
- Behnam Karami
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany
| | - Caspar M Schwiedrzik
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany.
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany.
| |
Collapse
|
32
|
Kreichman O, Gilaie‐Dotan S. Parafoveal vision reveals qualitative differences between fusiform face area and parahippocampal place area. Hum Brain Mapp 2024; 45:e26616. [PMID: 38379465 PMCID: PMC10879909 DOI: 10.1002/hbm.26616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Revised: 01/02/2024] [Accepted: 01/22/2024] [Indexed: 02/22/2024] Open
Abstract
The center-periphery visual field axis guides early visual system organization with enhanced resources devoted to central vision leading to reduced peripheral performance relative to that of central vision (i.e., behavioral eccentricity effect) for many visual functions. The center-periphery organization extends to high-order visual cortex where, for example, the well-studied face-sensitive fusiform face area (FFA) shows sensitivity to central vision and the place-sensitive parahippocampal place area (PPA) shows sensitivity to peripheral vision. As we have recently found that face perception is more sensitive to eccentricity than place perception, here we examined whether these behavioral findings reflect differences in FFA's and PPA's sensitivities to eccentricity. We assumed FFA would show higher sensitivity to eccentricity than PPA would, but that both regions' modulation by eccentricity would be invariant to the viewed category. We parametrically investigated (fMRI, n = 32) how FFA's and PPA's activations are modulated by eccentricity (≤8°) and category (upright/inverted faces/houses) while keeping stimulus size constant. As expected, FFA showed an overall higher sensitivity to eccentricity than PPA. However, both regions' activation modulations by eccentricity were dependent on the viewed category. In FFA, a reduction of activation with growing eccentricity ("BOLD eccentricity effect") was found (with different amplitudes) for all categories. In PPA however, qualitatively different BOLD eccentricity effect modulations were found (e.g., at 8° mild BOLD eccentricity effect for houses but a reverse BOLD eccentricity effect for faces and no modulation for inverted faces). Our results emphasize that peripheral vision investigations are critical to further our understanding of visual processing.
Collapse
Affiliation(s)
- Olga Kreichman
- School of Optometry and Vision Science, Faculty of Life ScienceBar Ilan UniversityRamat GanIsrael
- The Gonda Multidisciplinary Brain Research CenterBar Ilan UniversityRamat GanIsrael
| | - Sharon Gilaie‐Dotan
- School of Optometry and Vision Science, Faculty of Life ScienceBar Ilan UniversityRamat GanIsrael
- The Gonda Multidisciplinary Brain Research CenterBar Ilan UniversityRamat GanIsrael
- UCL Institute of Cognitive NeuroscienceLondonUK
| |
Collapse
|
33
|
Ryu J, Lee SH. Bounded contribution of human early visual cortex to the topographic anisotropy in spatial extent perception. Commun Biol 2024; 7:178. [PMID: 38351283 PMCID: PMC10864322 DOI: 10.1038/s42003-024-05846-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 01/23/2024] [Indexed: 02/16/2024] Open
Abstract
To interact successfully with objects, it is crucial to accurately perceive their spatial extent, an enclosed region they occupy in space. Although the topographic representation of space in the early visual cortex (EVC) has been favored as a neural correlate of spatial extent perception, its exact nature and contribution to perception remain unclear. Here, we inspect the topographic representations of human individuals' EVC and perception in terms of how much their anisotropy is influenced by the orientation (co-axiality) and radial position (radiality) of stimuli. We report that while the anisotropy is influenced by both factors, its direction is primarily determined by radiality in EVC but by co-axiality in perception. Despite this mismatch, the individual differences in both radial and co-axial anisotropy are substantially shared between EVC and perception. Our findings suggest that spatial extent perception builds on EVC's spatial representation but requires an additional mechanism to transform its topographic bias.
Collapse
Affiliation(s)
- Juhyoung Ryu
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul, 08826, Republic of Korea
| | - Sang-Hun Lee
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul, 08826, Republic of Korea.
| |
Collapse
|
34
|
Bergmann J, Petro LS, Abbatecola C, Li MS, Morgan AT, Muckli L. Cortical depth profiles in primary visual cortex for illusory and imaginary experiences. Nat Commun 2024; 15:1002. [PMID: 38307834 PMCID: PMC10837448 DOI: 10.1038/s41467-024-45065-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 01/12/2024] [Indexed: 02/04/2024] Open
Abstract
Visual illusions and mental imagery are non-physical sensory experiences that involve cortical feedback processing in the primary visual cortex. Using laminar functional magnetic resonance imaging (fMRI) in two studies, we investigate if information about these internal experiences is visible in the activation patterns of different layers of primary visual cortex (V1). We find that imagery content is decodable mainly from deep layers of V1, whereas seemingly 'real' illusory content is decodable mainly from superficial layers. Furthermore, illusory content shares information with perceptual content, whilst imagery content does not generalise to illusory or perceptual information. Together, our results suggest that illusions and imagery, which differ immensely in their subjective experiences, also involve partially distinct early visual microcircuits. However, overlapping microcircuit recruitment might emerge based on the nuanced nature of subjective conscious experience.
Collapse
Affiliation(s)
- Johanna Bergmann
- Imaging Centre of Excellence (ICE), Queen Elizabeth University Hospital, University of Glasgow, Glasgow, UK.
- Centre for Cognitive Neuroimaging (CCNi), School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK.
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Lucy S Petro
- Imaging Centre of Excellence (ICE), Queen Elizabeth University Hospital, University of Glasgow, Glasgow, UK
- Centre for Cognitive Neuroimaging (CCNi), School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK
| | - Clement Abbatecola
- Imaging Centre of Excellence (ICE), Queen Elizabeth University Hospital, University of Glasgow, Glasgow, UK
- Centre for Cognitive Neuroimaging (CCNi), School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK
| | - Min S Li
- Centre for Cognitive Neuroimaging (CCNi), School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK
- Centre for Computational Neuroscience and Cognitive Robotics, School of Psychology, University of Birmingham, Birmingham, UK
| | - A Tyler Morgan
- Imaging Centre of Excellence (ICE), Queen Elizabeth University Hospital, University of Glasgow, Glasgow, UK
- Centre for Cognitive Neuroimaging (CCNi), School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK
- Functional MRI Core Facility, National Institute of Mental Health, NIH, Bethesda, MD, 20817, USA
| | - Lars Muckli
- Imaging Centre of Excellence (ICE), Queen Elizabeth University Hospital, University of Glasgow, Glasgow, UK.
- Centre for Cognitive Neuroimaging (CCNi), School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK.
| |
Collapse
|
35
|
Hendrikx E, Paul JM, van Ackooij M, van der Stoep N, Harvey BM. Cortical quantity representations of visual numerosity and timing overlap increasingly into superior cortices but remain distinct. Neuroimage 2024; 286:120515. [PMID: 38216105 DOI: 10.1016/j.neuroimage.2024.120515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 12/18/2023] [Accepted: 01/09/2024] [Indexed: 01/14/2024] Open
Abstract
Many sensory brain areas are organized as topographic maps where neural response preferences change gradually across the cortical surface. Within association cortices, 7-Tesla fMRI and neural model-based analyses have also revealed many topographic maps for quantities like numerosity and event timing, often in similar locations. Numerical and temporal quantity estimations also show behavioral similarities and even interactions. For example, the duration of high-numerosity displays is perceived as longer than that of low-numerosity displays. Such interactions are often ascribed to a generalized magnitude system with shared neural responses across quantities. Anterior quantity responses are more closely linked to behavior. Here, we investigate whether common quantity representations hierarchically emerge by asking whether numerosity and timing maps become increasingly closely related in their overlap, response preferences, and topography. While the earliest quantity maps do not overlap, more superior maps overlap increasingly. In these overlapping areas, some intraparietal maps have consistently correlated numerosity and timing preferences, and some maps have consistent angles between the topographic progressions of numerosity and timing preferences. However, neither of these relationships increases hierarchically like the amount of overlap does. Therefore, responses to different quantities are initially derived separately, then progressively brought together, without generally becoming a common representation. Bringing together distinct responses to different quantities may underlie behavioral interactions and allow shared access to comparison and action planning systems.
Collapse
Affiliation(s)
- Evi Hendrikx
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, Utrecht 3584 CS, the Netherlands.
| | - Jacob M Paul
- Melbourne School of Psychological Sciences, University of Melbourne, Redmond Barry Building, Parkville 3010, Victoria, Australia
| | - Martijn van Ackooij
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, Utrecht 3584 CS, the Netherlands
| | - Nathan van der Stoep
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, Utrecht 3584 CS, the Netherlands
| | - Ben M Harvey
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, Utrecht 3584 CS, the Netherlands
| |
Collapse
|
36
|
Steel A, Silson EH, Garcia BD, Robertson CE. A retinotopic code structures the interaction between perception and memory systems. Nat Neurosci 2024; 27:339-347. [PMID: 38168931 PMCID: PMC10923171 DOI: 10.1038/s41593-023-01512-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 10/31/2023] [Indexed: 01/05/2024]
Abstract
Conventional views of brain organization suggest that regions at the top of the cortical hierarchy processes internally oriented information using an abstract amodal neural code. Despite this, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here we report that retinotopic coding structures interactions between internally oriented (mnemonic) and externally oriented (perceptual) brain areas. Using functional magnetic resonance imaging, we observed robust inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. These functionally linked retinotopic populations in mnemonic and perceptual areas exhibit spatially specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually inhibitory dynamic. These results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, providing a scaffold for their dynamic interaction.
Collapse
Affiliation(s)
- Adam Steel
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| | - Edward H Silson
- Psychosophy, Psychology, and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Brenda D Garcia
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Caroline E Robertson
- Department of Psychology and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
37
|
Lee M, Chong SC. Outlier rejection in the process of pooling. Atten Percept Psychophys 2024; 86:666-679. [PMID: 38191757 DOI: 10.3758/s13414-023-02842-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/25/2023] [Indexed: 01/10/2024]
Abstract
Ensemble perception allows our visual system to process large amounts of information efficiently by summarizing its statistical properties. A key aspect of ensemble perception is the devaluation of outlying elements, which leads to more informative summary statistics with reduced variance and a more representative mean. However, the mechanisms underlying this outlier rejection process are not well understood. One possibility is that outliers are selectively excluded before summarization. To test this, we investigated whether only weaker items were excluded from averaging. We manipulated the encoding strength of items in a display by changing the emotional intensities of faces, the spatial location of emotional outliers, and the spatial distribution of emotional faces. We found that the response to outliers varied depending on their location. Specifically, outliers were more likely to be excluded from averaging when presented in more peripheral regions, while their exclusion was partial in parafoveal regions. In other words, outlier rejection in ensemble processing is more flexible than the supposed rigid designation of weighting against outliers. Alternatively, the results fit well with hierarchically structured pooling, during which outliers are discounted more dynamically without positing any separate selective mechanism before summarization. We propose an explanation for outlier rejection in light of a recently proposed population response model of ensemble processing.
Collapse
Affiliation(s)
- Mincheol Lee
- Department of Philosophy, Yonsei University, Seoul, South Korea
| | - Sang Chul Chong
- Graduate Program in Cognitive Science, Yonsei University, Seoul, South Korea.
- Department of Psychology, Yonsei University, Seoul, South Korea.
| |
Collapse
|
38
|
Kim I, Kupers ER, Lerma-Usabiaga G, Grill-Spector K. Characterizing Spatiotemporal Population Receptive Fields in Human Visual Cortex with fMRI. J Neurosci 2024; 44:e0803232023. [PMID: 37963768 PMCID: PMC10866195 DOI: 10.1523/jneurosci.0803-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 10/20/2023] [Accepted: 10/24/2023] [Indexed: 11/16/2023] Open
Abstract
The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time-varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants (both females and males). We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (1) from early to later areas within a visual stream, spatial and temporal windows of pRFs progressively increase in size and show greater compressive nonlinearities, (2) later visual areas show diverging spatial and temporal windows across streams, and (3) within early visual areas (V1-V3), both spatial and temporal windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses using fMRI.
Collapse
Affiliation(s)
- Insub Kim
- Department of Psychology, Stanford University, Stanford, CA, 94305
| | - Eline R Kupers
- Department of Psychology, Stanford University, Stanford, CA, 94305
| | - Garikoitz Lerma-Usabiaga
- BCBL. Basque Center on Cognition, Brain and Language, 20009 San Sebastian, Spain
- IKERBASQUE. Basque Foundation for Science, 48009 Bilbao, Spain
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA, 94305
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, 94305
| |
Collapse
|
39
|
Aqil M, Knapen T, Dumoulin SO. Computational model links normalization to chemoarchitecture in the human visual system. SCIENCE ADVANCES 2024; 10:eadj6102. [PMID: 38170784 PMCID: PMC10776006 DOI: 10.1126/sciadv.adj6102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 12/01/2023] [Indexed: 01/05/2024]
Abstract
A goal of cognitive neuroscience is to provide computational accounts of brain function. Canonical computations-mathematical operations used by the brain in many contexts-fulfill broad information-processing needs by varying their algorithmic parameters. A key question concerns the identification of biological substrates for these computations and their algorithms. Chemoarchitecture-the spatial distribution of neurotransmitter receptor densities-shapes brain function. Here, we propose that local variations in specific receptor densities implement algorithmic modulations of canonical computations. To test this hypothesis, we combine mathematical modeling of brain responses with chemoarchitecture data. We compare parameters of divisive normalization obtained from 7-tesla functional magnetic resonance imaging with receptor density maps obtained from positron emission tomography. We find evidence that serotonin and γ-aminobutyric acid receptor densities are the biological substrate for algorithmic modulations of divisive normalization in the human visual system. Our model links computational and biological levels of vision, explaining how canonical computations allow the brain to fulfill broad information-processing needs.
Collapse
Affiliation(s)
- Marco Aqil
- Spinoza Centre for Neuroimaging, Amsterdam, Netherlands
- Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Tomas Knapen
- Spinoza Centre for Neuroimaging, Amsterdam, Netherlands
- Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Serge O. Dumoulin
- Spinoza Centre for Neuroimaging, Amsterdam, Netherlands
- Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, Netherlands
- Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- Experimental Psychology, Utrecht University, Utrecht, Netherlands
| |
Collapse
|
40
|
Brewer AA, Barton B. Cortical field maps across human sensory cortex. Front Comput Neurosci 2023; 17:1232005. [PMID: 38164408 PMCID: PMC10758003 DOI: 10.3389/fncom.2023.1232005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2023] [Accepted: 11/07/2023] [Indexed: 01/03/2024] Open
Abstract
Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.
Collapse
Affiliation(s)
- Alyssa A. Brewer
- mindSPACE Laboratory, Departments of Cognitive Sciences and Language Science (by Courtesy), Center for Hearing Research, University of California, Irvine, Irvine, CA, United States
| | - Brian Barton
- mindSPACE Laboratory, Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, United States
| |
Collapse
|
41
|
Thayer DD, Sprague TC. Feature-Specific Salience Maps in Human Cortex. J Neurosci 2023; 43:8785-8800. [PMID: 37907257 PMCID: PMC10727177 DOI: 10.1523/jneurosci.1104-23.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 09/29/2023] [Accepted: 10/24/2023] [Indexed: 11/02/2023] Open
Abstract
Priority map theory is a leading framework for understanding how various aspects of stimulus displays and task demands guide visual attention. Per this theory, the visual system computes a priority map, which is a representation of visual space indexing the relative importance, or priority, of locations in the environment. Priority is computed based on both salience, defined based on image-computable properties; and relevance, defined by an individual's current goals, and is used to direct attention to the highest-priority locations for further processing. Computational theories suggest that priority maps identify salient locations based on individual feature dimensions (e.g., color, motion), which are integrated into an aggregate priority map. While widely accepted, a core assumption of this framework, the existence of independent feature dimension maps in visual cortex, remains untested. Here, we tested the hypothesis that retinotopic regions selective for specific feature dimensions (color or motion) in human cortex act as neural feature dimension maps, indexing salient locations based on their preferred feature. We used fMRI activation patterns to reconstruct spatial maps while male and female human participants viewed stimuli with salient regions defined by relative color or motion direction. Activation in reconstructed spatial maps was localized to the salient stimulus position in the display. Moreover, the strength of the stimulus representation was strongest in the ROI selective for the salience-defining feature. Together, these results suggest that feature-selective extrastriate visual regions highlight salient locations based on local feature contrast within their preferred feature dimensions, supporting their role as neural feature dimension maps.SIGNIFICANCE STATEMENT Identifying salient information is important for navigating the world. For example, it is critical to detect a quickly approaching car when crossing the street. Leading models of computer vision and visual search rely on compartmentalized salience computations based on individual features; however, there has been no direct empirical demonstration identifying neural regions as responsible for performing these dissociable operations. Here, we provide evidence of a critical double dissociation that neural activation patterns from color-selective regions prioritize the location of color-defined salience while minimally representing motion-defined salience, whereas motion-selective regions show the complementary result. These findings reveal that specialized cortical regions act as neural "feature dimension maps" that are used to index salient locations based on specific features to guide attention.
Collapse
Affiliation(s)
- Daniel D Thayer
- Department of Psychological and Brain Sciences, University of California-Santa Barbara, Santa Barbara, California 93106
| | - Thomas C Sprague
- Department of Psychological and Brain Sciences, University of California-Santa Barbara, Santa Barbara, California 93106
| |
Collapse
|
42
|
Master SL, Li S, Curtis CE. Trying harder: how cognitive effort sculpts neural representations during working memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.07.570686. [PMID: 38106094 PMCID: PMC10723420 DOI: 10.1101/2023.12.07.570686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
The neural mechanisms by which motivational factors influence cognition remain unknown. Using fMRI, we tested how cognitive effort impacts working memory (WM). Participants were precued whether WM difficulty would be hard or easy. Hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity in prefrontal cortex, especially during hard trials. We found strong decoding of location in visual cortex, where accuracy was higher on hard trials. Connecting these across-region effects, we found that the amplitude of delay period activity in frontal cortex predicted decoded accuracy in visual cortex on a trial-wise basis. We conclude that the gain of persistent activity in frontal cortex may be the source of effort-related feedback signals that improve the quality of WM representations stored in visual cortex.
Collapse
Affiliation(s)
| | - Shanshan Li
- Department of Psychology, New York University
- Program in Psychology, New York University Abu Dhabi
| | - Clayton E. Curtis
- Department of Psychology, New York University
- Center for Neural Science, New York University
| |
Collapse
|
43
|
Heitmann C, Zhan M, Linke M, Hölig C, Kekunnaya R, van Hoof R, Goebel R, Röder B. Early visual experience refines the retinotopic organization within and across visual cortical regions. Curr Biol 2023; 33:4950-4959.e4. [PMID: 37918397 DOI: 10.1016/j.cub.2023.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 09/29/2023] [Accepted: 10/06/2023] [Indexed: 11/04/2023]
Abstract
Early visual areas are retinotopically organized in human and non-human primates. Population receptive field (pRF) size increases with eccentricity and from lower- to higher-level visual areas. Furthermore, the cortical magnification factor (CMF), a measure of how much cortical space is devoted to each degree of visual angle, is typically larger for foveal as opposed to peripheral regions of the visual field. Whether this fine-scale organization within and across visual areas depends on early visual experience has yet been unknown. Here, we employed 7T functional magnetic resonance imaging pRF mapping to assess the retinotopic organization of early visual regions (i.e., V1, V2, and V3) in eight sight recovery individuals with a history of congenital blindness until a maximum of 4 years of age. Compared with sighted controls, foveal pRF sizes in these individuals were larger, and pRF sizes did not show the typical increase with eccentricity and down the visual cortical processing stream (V1-V2-V3). Cortical magnification was overall diminished and decreased less from foveal to parafoveal visual field locations. Furthermore, cortical magnification correlated with visual acuity in sight recovery individuals. The results of this study suggest that early visual experience is essential for refining a presumably innate prototypical retinotopic organization in humans within and across visual areas, which seems to be crucial for acquiring full visual capabilities.
Collapse
Affiliation(s)
- Carolin Heitmann
- Biological Psychology and Neuropsychology Lab, Faculty of Psychology and Movement Sciences, Universität Hamburg, Von-Melle-Park 11, 20146 Hamburg, Germany.
| | - Minye Zhan
- U992 (Cognitive neuroimaging unit), NeuroSpin, INSERM-CEA, 91191 Gif sur Yvette, France
| | - Madita Linke
- Biological Psychology and Neuropsychology Lab, Faculty of Psychology and Movement Sciences, Universität Hamburg, Von-Melle-Park 11, 20146 Hamburg, Germany
| | - Cordula Hölig
- Biological Psychology and Neuropsychology Lab, Faculty of Psychology and Movement Sciences, Universität Hamburg, Von-Melle-Park 11, 20146 Hamburg, Germany
| | - Ramesh Kekunnaya
- U992 (Cognitive neuroimaging unit), NeuroSpin, INSERM-CEA, 91191 Gif sur Yvette, France
| | - Rick van Hoof
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands
| | - Rainer Goebel
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Universiteitssingel 40, 6229 ER Maastricht, the Netherlands; Department of Development and Research, Brain Innovation B.V., Oxfordlaan 55, 6229 EV Maastricht, the Netherlands
| | - Brigitte Röder
- Biological Psychology and Neuropsychology Lab, Faculty of Psychology and Movement Sciences, Universität Hamburg, Von-Melle-Park 11, 20146 Hamburg, Germany; Child Sight Institute, Jasti V. Ramanamma Children's Eye Care Center, LV Prasad Eye Institute, Hyderabad, Telangana 500034, India.
| |
Collapse
|
44
|
Barbieri R, Töpfer FM, Soch J, Bogler C, Sprekeler H, Haynes JD. Encoding of continuous perceptual choices in human early visual cortex. Front Hum Neurosci 2023; 17:1277539. [PMID: 38021249 PMCID: PMC10679739 DOI: 10.3389/fnhum.2023.1277539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 10/25/2023] [Indexed: 12/01/2023] Open
Abstract
Introduction Research on the neural mechanisms of perceptual decision-making has typically focused on simple categorical choices, say between two alternative motion directions. Studies on such discrete alternatives have often suggested that choices are encoded either in a motor-based or in an abstract, categorical format in regions beyond sensory cortex. Methods In this study, we used motion stimuli that could vary anywhere between 0° and 360° to assess how the brain encodes choices for features that span the full sensory continuum. We employed a combination of neuroimaging and encoding models based on Gaussian process regression to assess how either stimuli or choices were encoded in brain responses. Results We found that single-voxel tuning patterns could be used to reconstruct the trial-by-trial physical direction of motion as well as the participants' continuous choices. Importantly, these continuous choice signals were primarily observed in early visual areas. The tuning properties in this region generalized between choice encoding and stimulus encoding, even for reports that reflected pure guessing. Discussion We found only little information related to the decision outcome in regions beyond visual cortex, such as parietal cortex, possibly because our task did not involve differential motor preparation. This could suggest that decisions for continuous stimuli take can place already in sensory brain regions, potentially using similar mechanisms to the sensory recruitment in visual working memory.
Collapse
Affiliation(s)
- Riccardo Barbieri
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging, Department of Neurology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin and Berlin Institute of Health (BIH), Berlin, Germany
| | - Felix M. Töpfer
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging, Department of Neurology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin and Berlin Institute of Health (BIH), Berlin, Germany
| | - Joram Soch
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging, Department of Neurology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin and Berlin Institute of Health (BIH), Berlin, Germany
- German Center for Neurodegenerative Diseases, Göttingen, Germany
| | - Carsten Bogler
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging, Department of Neurology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin and Berlin Institute of Health (BIH), Berlin, Germany
| | - Henning Sprekeler
- Department for Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, Germany
| | - John-Dylan Haynes
- Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging, Department of Neurology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin and Berlin Institute of Health (BIH), Berlin, Germany
- Berlin School of Mind and Brain and Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
45
|
Phangwiwat T, Punchongham P, Wongsawat Y, Chatnuntawech I, Wang S, Chunharas C, Sprague T, Woodman GF, Itthipuripat S. Sustained attention operates via dissociable neural mechanisms across different eccentric locations. RESEARCH SQUARE 2023:rs.3.rs-3562186. [PMID: 37986807 PMCID: PMC10659535 DOI: 10.21203/rs.3.rs-3562186/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
In primates, foveal and peripheral vision have distinct neural architectures and functions. However, it has been debated if selective attention operates via the same or different neural mechanisms across eccentricities. We tested these alternative accounts by examining the effects of selective attention on the steady-state visually evoked potential (SSVEP) and the fronto-parietal signal measured via EEG from human subjects performing a sustained visuospatial attention task. With a negligible level of eye movements, both SSVEP and SND exhibited the heterogeneous patterns of attentional modulations across eccentricities. Specifically, the attentional modulations of these signals peaked at the parafoveal locations and such modulations wore off as visual stimuli appeared closer to the fovea or further away towards the periphery. However, with a relatively higher level of eye movements, the heterogeneous patterns of attentional modulations of these neural signals were less robust. These data demonstrate that the top-down influence of covert visuospatial attention on early sensory processing in human cortex depends on eccentricity and the level of saccadic responses. Taken together, the results suggest that sustained visuospatial attention operates differently across different eccentric locations, providing new understanding of how attention augments sensory representations regardless of where the attended stimulus appears.
Collapse
Affiliation(s)
- Tanagrit Phangwiwat
- Department of Computer Engineering, King Mongkut's University of Technology Thonburi
| | - Phond Punchongham
- Department of Computer Engineering, King Mongkut's University of Technology Thonburi
| | - Yodchanan Wongsawat
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University
| | - Itthi Chatnuntawech
- National Nanotechnology Center, National Science and Technology Development Agency
| | - Sisi Wang
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam
| | - Chaipat Chunharas
- Chula Neuroscience Center, King Chulalongkorn Memorial Hospital, Thai Red Cross Society
| | - Thomas Sprague
- Psychological and Brain Science, 251, University of California Santa Barbara
| | | | - Sirawaj Itthipuripat
- Neuroscience Center for Research and Innovation (NX), Learning Institute, King Mongkut's University of Technology Thonburi
| |
Collapse
|
46
|
Favila SE, Aly M. Hippocampal mechanisms resolve competition in memory and perception. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.09.561548. [PMID: 37873400 PMCID: PMC10592663 DOI: 10.1101/2023.10.09.561548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Behaving adaptively requires selection of relevant memories and sensations and suppression of competing ones. We hypothesized that these mechanisms are linked, such that hippocampal computations that resolve competition in memory also shape the precision of sensory representations to guide selective attention. We leveraged f MRI-based pattern similarity, receptive field modeling, and eye tracking to test this hypothesis in humans performing a memory-dependent visual search task. In the hippocampus, differentiation of competing memories predicted the precision of memory-guided eye movements. In visual cortex, preparatory coding of remembered target locations predicted search successes, whereas preparatory coding of competing locations predicted search failures due to interference. These effects were linked: stronger hippocampal memory differentiation was associated with lower competitor activation in visual cortex, yielding more precise preparatory representations. These results demonstrate a role for memory differentiation in shaping the precision of sensory representations, highlighting links between mechanisms that overcome competition in memory and perception.
Collapse
Affiliation(s)
- Serra E Favila
- Department of Psychology, Columbia University, New York, NY, 10027
| | - Mariam Aly
- Department of Psychology, Columbia University, New York, NY, 10027
| |
Collapse
|
47
|
Tangtartharakul G, Morgan CA, Rushton SK, Schwarzkopf DS. Retinotopic connectivity maps of human visual cortex with unconstrained eye movements. Hum Brain Mapp 2023; 44:5221-5237. [PMID: 37555758 PMCID: PMC10543111 DOI: 10.1002/hbm.26446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 06/27/2023] [Accepted: 07/26/2023] [Indexed: 08/10/2023] Open
Abstract
Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods.
Collapse
Affiliation(s)
- Gene Tangtartharakul
- School of Optometry and Vision ScienceUniversity of AucklandAucklandNew Zealand
- School of Psychology and Centre for Brain ResearchUniversity of AucklandAucklandNew Zealand
| | - Catherine A. Morgan
- School of Psychology and Centre for Brain ResearchUniversity of AucklandAucklandNew Zealand
- Centre for Advanced MRIUniServices LimitedAucklandNew Zealand
| | | | - D. Samuel Schwarzkopf
- School of Optometry and Vision ScienceUniversity of AucklandAucklandNew Zealand
- Experimental PsychologyUniversity College LondonLondonUK
| |
Collapse
|
48
|
Heij J, Raimondo L, Siero JCW, Dumoulin SO, van der Zwaag W, Knapen T. A selection and targeting framework of cortical locations for line-scanning fMRI. Hum Brain Mapp 2023; 44:5471-5484. [PMID: 37608563 PMCID: PMC10543358 DOI: 10.1002/hbm.26459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 07/15/2023] [Accepted: 08/02/2023] [Indexed: 08/24/2023] Open
Abstract
Depth-resolved functional magnetic resonance imaging (fMRI) is an emerging field growing in popularity given the potential of separating signals from different computational processes in cerebral cortex. Conventional acquisition schemes suffer from low spatial and temporal resolutions. Line-scanning methods allow depth-resolved fMRI by sacrificing spatial coverage to sample blood oxygenated level-dependent (BOLD) responses at ultra-high temporal and spatial resolution. For neuroscience applications, it is critical to be able to place the line accurately to (1) sample the right neural population and (2) target that neural population with tailored stimuli or tasks. To this end, we devised a multi-session framework where a target cortical location is selected based on anatomical and functional properties. The line is then positioned according to this information in a separate second session, and we tailor the experiment to focus on the target location. Anatomically, the precision of the line placement was confirmed by projecting a nominal representation of the acquired line back onto the surface. Functional estimates of neural selectivities in the line, as quantified by a visual population-receptive field model, resembled the target selectivities well for most subjects. This functional precision was quantified in detail by estimating the distance between the visual field location of the targeted vertex and the location in visual cortex (V1) that most closely resembled the line-scanning estimates; this distance was on average ~5.5 mm. Given the dimensions of the line, differences in acquisition, session, and stimulus design, this validates that line-scanning can be used to probe local neural sensitivities across sessions. In summary, we present an accurate framework for line-scanning MRI; we believe such a framework is required to harness the full potential of line-scanning and maximize its utility. Furthermore, this approach bridges canonical fMRI experiments with electrophysiological experiments, which in turn allows novel avenues for studying human physiology non-invasively.
Collapse
Affiliation(s)
- Jurjen Heij
- Spinoza Centre for NeuroimagingAmsterdamNetherlands
- Department of Computational Cognitive Neuroscience and NeuroimagingNetherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Experimental and Applied PsychologyVU UniversityAmsterdamNetherlands
| | - Luisa Raimondo
- Spinoza Centre for NeuroimagingAmsterdamNetherlands
- Department of Computational Cognitive Neuroscience and NeuroimagingNetherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Experimental and Applied PsychologyVU UniversityAmsterdamNetherlands
| | - Jeroen C. W. Siero
- Spinoza Centre for NeuroimagingAmsterdamNetherlands
- Department of Computational Cognitive Neuroscience and NeuroimagingNetherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of RadiologyUniversity Medical Center UtrechtUtrechtthe Netherlands
| | - Serge O. Dumoulin
- Spinoza Centre for NeuroimagingAmsterdamNetherlands
- Department of Computational Cognitive Neuroscience and NeuroimagingNetherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Experimental and Applied PsychologyVU UniversityAmsterdamNetherlands
- Department of Experimental PsychologyUtrecht UniversityUtrechtNetherlands
| | - Wietske van der Zwaag
- Spinoza Centre for NeuroimagingAmsterdamNetherlands
- Department of Computational Cognitive Neuroscience and NeuroimagingNetherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Tomas Knapen
- Spinoza Centre for NeuroimagingAmsterdamNetherlands
- Department of Computational Cognitive Neuroscience and NeuroimagingNetherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Experimental and Applied PsychologyVU UniversityAmsterdamNetherlands
| |
Collapse
|
49
|
Wu H, Zuo Z, Yuan Z, Zhou T, Zhuo Y, Zheng N, Chen B. Neural representation of gestalt grouping and attention effect in human visual cortex. J Neurosci Methods 2023; 399:109980. [PMID: 37783351 DOI: 10.1016/j.jneumeth.2023.109980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 08/29/2023] [Accepted: 09/29/2023] [Indexed: 10/04/2023]
Abstract
BACKGROUND The brain aggregates meaningless local sensory elements to form meaningful global patterns in a process called perceptual grouping. Current brain imaging studies have found that neural activities in V1 are modulated during visual grouping. However, how grouping is represented in each of the early visual areas, and how attention alters these representations, is still unknown. NEW METHOD We adopted MVPA to decode the specific content of perceptual grouping by comparing neural activity patterns between gratings and dot lattice stimuli which can be grouped with proximity law. Furthermore, we quantified the grouping effect by defining the strength of grouping, and assessed the effect of attention on grouping. RESULTS We found that activity patterns to proximity grouped stimuli in early visual areas resemble these to grating stimuli with the same orientations. This similarity exists even when there is no attention focused on the stimuli. The results also showed a progressive increase of representational strength of grouping from V1 to V3, and attention modulation to grouping is only significant in V3 among all the visual areas. COMPARISON WITH EXISTING METHODS Most of the previous work on perceptual grouping has focused on how activity amplitudes are modulated by grouping. Using MVPA, the present work successfully decoded the contents of neural activity patterns corresponding to proximity grouping stimuli, thus shed light on the availability of content-decoding approach in the research on perceptual grouping. CONCLUSIONS Our work found that the content of the neural activity patterns during perceptual grouping can be decoded in the early visual areas under both attended and unattended task, and provide novel evidence that there is a cascade processing for proximity grouping through V1 to V3. The strength of grouping was larger in V3 than in any other visual areas, and the attention modulation to the strength of grouping was only significant in V3 among all the visual areas, implying that V3 plays an important role in proximity grouping.
Collapse
Affiliation(s)
- Hao Wu
- School of Electrical Engineering, Xi'an University of Technology, Xi'an, Shaanxi 710048, China
| | - Zhentao Zuo
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of the Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing, China.
| | - Zejian Yuan
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi'an, Shaanxi 710049, China; Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, China
| | - Tiangang Zhou
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of the Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing, China
| | - Yan Zhuo
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of the Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing, China
| | - Nanning Zheng
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi'an, Shaanxi 710049, China; Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, China
| | - Badong Chen
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Xi'an, Shaanxi 710049, China; Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, China.
| |
Collapse
|
50
|
Asghar M, Sanchez-Panchuelo R, Schluppeck D, Francis S. Two-Dimensional Population Receptive Field Mapping of Human Primary Somatosensory Cortex. Brain Topogr 2023; 36:816-834. [PMID: 37634160 PMCID: PMC10522535 DOI: 10.1007/s10548-023-01000-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 08/09/2023] [Indexed: 08/29/2023]
Abstract
Functional magnetic resonance imaging can provide detailed maps of how sensory space is mapped in the human brain. Here, we use a novel 16 stimulator setup (a 4 × 4 grid) to measure two-dimensional sensory maps of between and within-digit (D2-D4) space using high spatial-resolution (1.25 mm isotropic) imaging at 7 Tesla together with population receptive field (pRF) mapping in 10 participants. Using a 2D Gaussian pRF model, we capture maps of the coverage of digits D2-D5 across Brodmann areas and estimate pRF size and shape. In addition, we compare results to previous studies that used fewer stimulators by constraining pRF models to a 1D Gaussian Between Digit or 1D Gaussian Within Digit model. We show that pRFs across somatosensory areas tend to have a strong preference to cover the within-digit axis. We show an increase in pRF size moving from D2-D5. We quantify pRF shapes in Brodmann area (BA) 3b, 3a, 1, 2 and show differences in pRF size in Brodmann areas 3a-2, with larger estimates for BA2. Generally, the 2D Gaussian pRF model better represents pRF coverage maps generated by our data, which itself is produced from a 2D stimulation grid.
Collapse
Affiliation(s)
- Michael Asghar
- Sir Peter Mansfield Imaging Centre, School of Physics and Astronomy, University of Nottingham, Nottingham, UK.
| | - Rosa Sanchez-Panchuelo
- Sir Peter Mansfield Imaging Centre, School of Physics and Astronomy, University of Nottingham, Nottingham, UK
- University Hospitals Birmingham NHS Foundation Trust, Nottingham, UK
| | | | - Susan Francis
- Sir Peter Mansfield Imaging Centre, School of Physics and Astronomy, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Nottingham University Hospitals NHS Trust and the University of Nottingham, Nottingham, UK
| |
Collapse
|