1
|
Xiao W, Sharma S, Kreiman G, Livingstone MS. Feature-selective responses in macaque visual cortex follow eye movements during natural vision. Nat Neurosci 2024; 27:1157-1166. [PMID: 38684892 PMCID: PMC11156562 DOI: 10.1038/s41593-024-01631-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 03/26/2024] [Indexed: 05/02/2024]
Abstract
In natural vision, primates actively move their eyes several times per second via saccades. It remains unclear whether, during this active looking, visual neurons exhibit classical retinotopic properties, anticipate gaze shifts or mirror the stable quality of perception, especially in complex natural scenes. Here, we let 13 monkeys freely view thousands of natural images across 4.6 million fixations, recorded 883 h of neuronal responses in six areas spanning primary visual to anterior inferior temporal cortex and analyzed spatial, temporal and featural selectivity in these responses. Face neurons tracked their receptive field contents, indicated by category-selective responses. Self-consistency analysis showed that general feature-selective responses also followed eye movements and remained gaze-dependent over seconds of viewing the same image. Computational models of feature-selective responses located retinotopic receptive fields during free viewing. We found limited evidence for feature-selective predictive remapping and no viewing-history integration. Thus, ventral visual neurons represent the world in a predominantly eye-centered reference frame during natural vision.
Collapse
Affiliation(s)
- Will Xiao
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA.
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA.
| | - Saloni Sharma
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Gabriel Kreiman
- Department of Ophthalmology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | | |
Collapse
|
2
|
Mancini V, Damaser MS, Chermansky C, Ochoa CD, Hashim H, Przydacz M, Hervé F, Martino L, Abrams P. Can we improve techniques and patients' selection for nerve stimulation suitable for lower urinary tract dysfunctions? ICI-RS 2023. Neurourol Urodyn 2023. [PMID: 38048061 DOI: 10.1002/nau.25346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 11/18/2023] [Indexed: 12/05/2023]
Abstract
AIMS Lower urinary tract dysfunctions (LUTD) are very common and, importantly, affect patients' quality of life (QoL). LUTD can range from urinary retention to urgency incontinence and includes a variety of symptoms. Nerve stimulation (NS) is an accepted widespread treatment with documented success for LUTD and is used widely. The aim of this review is to report the results of the discussion about how to improve the outcomes of NS for LUTD treatment. METHODS During its 2023 meeting in Bristol, the International Consultation on Incontinence Research Society discussed a literature review, and there was an expert consensus discussion focused on the emerging awareness of NS suitable for LUTD. RESULTS The consensus discussed how to improve techniques and patients' selection in NS, and high-priority research questions were identified. CONCLUSIONS Technique improvement, device programming, and patient selection are the goals of the current approach to NS. The conditional nerve stimulation with minimally invasive wireless systems and tailored algorithms hold promise for improving NS for LUTD, particularly for patients with neurogenic bladder who represent the new extended population to be treated.
Collapse
Affiliation(s)
- Vito Mancini
- Department of Urology and Renal Transplantation, University of Foggia, Foggia, Italy
| | - Margot S Damaser
- Department of Biomedical Engineering, Lerner Research Institute and Glickman Urological and Kidney Institute, Cleveland Clinic, Cleveland, and Advanced Platform Technology Center, Louis Stokes Cleveland Department of Veterans Affairs Medical Center, Cleveland, Ohio, USA
| | | | - Carolina D Ochoa
- Bristol Urological Institute, North Bristol Trust, University of Bristol, Bristol, UK
| | - Hashim Hashim
- Bristol Urological Institute, North Bristol Trust, University of Bristol, Bristol, UK
| | - Mikolaj Przydacz
- Department of Urology, Jagiellonian University Medical College, Krakow, Poland
| | - François Hervé
- Department of Urology, ERN Accredited Centrum, Ghent University Hospital, Ghent, Belgium
| | - Leonardo Martino
- Department of Urology and Renal Transplantation, University of Foggia, Foggia, Italy
| | - Paul Abrams
- Bristol Urological Institute, University of Bristol, Bristol, UK
| |
Collapse
|
3
|
Vinken K, Prince JS, Konkle T, Livingstone MS. The neural code for "face cells" is not face-specific. SCIENCE ADVANCES 2023; 9:eadg1736. [PMID: 37647400 PMCID: PMC10468123 DOI: 10.1126/sciadv.adg1736] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 07/27/2023] [Indexed: 09/01/2023]
Abstract
Face cells are neurons that respond more to faces than to non-face objects. They are found in clusters in the inferotemporal cortex, thought to process faces specifically, and, hence, studied using faces almost exclusively. Analyzing neural responses in and around macaque face patches to hundreds of objects, we found graded response profiles for non-face objects that predicted the degree of face selectivity and provided information on face-cell tuning beyond that from actual faces. This relationship between non-face and face responses was not predicted by color and simple shape properties but by information encoded in deep neural networks trained on general objects rather than face classification. These findings contradict the long-standing assumption that face versus non-face selectivity emerges from face-specific features and challenge the practice of focusing on only the most effective stimulus. They provide evidence instead that category-selective neurons are best understood by their tuning directions in a domain-general object space.
Collapse
Affiliation(s)
- Kasper Vinken
- Department of Neurobiology, Harvard Medical School, Boston, MA 02115, USA
| | - Jacob S. Prince
- Department of Psychology, Harvard University, Cambridge, MA 02478, USA
| | - Talia Konkle
- Department of Psychology, Harvard University, Cambridge, MA 02478, USA
| | | |
Collapse
|
4
|
Tesileanu T, Piasini E, Balasubramanian V. Efficient processing of natural scenes in visual cortex. Front Cell Neurosci 2022; 16:1006703. [PMID: 36545653 PMCID: PMC9760692 DOI: 10.3389/fncel.2022.1006703] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 11/17/2022] [Indexed: 12/12/2022] Open
Abstract
Neural circuits in the periphery of the visual, auditory, and olfactory systems are believed to use limited resources efficiently to represent sensory information by adapting to the statistical structure of the natural environment. This "efficient coding" principle has been used to explain many aspects of early visual circuits including the distribution of photoreceptors, the mosaic geometry and center-surround structure of retinal receptive fields, the excess OFF pathways relative to ON pathways, saccade statistics, and the structure of simple cell receptive fields in V1. We know less about the extent to which such adaptations may occur in deeper areas of cortex beyond V1. We thus review recent developments showing that the perception of visual textures, which depends on processing in V2 and beyond in mammals, is adapted in rats and humans to the multi-point statistics of luminance in natural scenes. These results suggest that central circuits in the visual brain are adapted for seeing key aspects of natural scenes. We conclude by discussing how adaptation to natural temporal statistics may aid in learning and representing visual objects, and propose two challenges for the future: (1) explaining the distribution of shape sensitivity in the ventral visual stream from the statistics of object shape in natural images, and (2) explaining cell types of the vertebrate retina in terms of feature detectors that are adapted to the spatio-temporal structures of natural stimuli. We also discuss how new methods based on machine learning may complement the normative, principles-based approach to theoretical neuroscience.
Collapse
Affiliation(s)
- Tiberiu Tesileanu
- Center for Computational Neuroscience, Flatiron Institute, New York, NY, United States,*Correspondence: Tiberiu Tesileanu
| | - Eugenio Piasini
- Scuola Internazionale Superiore di Studi Avanzati (SISSA), Trieste, Italy,Eugenio Piasini
| | - Vijay Balasubramanian
- Department of Physics and Astronomy, David Rittenhouse Laboratory, University of Pennsylvania, Philadelphia, PA, United States,Santa Fe Institute, Santa Fe, NM, United States
| |
Collapse
|
5
|
Flachot A, Akbarinia A, Schütt HH, Fleming RW, Wichmann FA, Gegenfurtner KR. Deep neural models for color classification and color constancy. J Vis 2022; 22:17. [PMID: 35353153 PMCID: PMC8976922 DOI: 10.1167/jov.22.4.17] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Color constancy is our ability to perceive constant colors across varying illuminations. Here, we trained deep neural networks to be color constant and evaluated their performance with varying cues. Inputs to the networks consisted of two-dimensional images of simulated cone excitations derived from three-dimensional (3D) rendered scenes of 2,115 different 3D shapes, with spectral reflectances of 1,600 different Munsell chips, illuminated under 278 different natural illuminations. The models were trained to classify the reflectance of the objects. Testing was done with four new illuminations with equally spaced CIEL*a*b* chromaticities, two along the daylight locus and two orthogonal to it. High levels of color constancy were achieved with different deep neural networks, and constancy was higher along the daylight locus. When gradually removing cues from the scene, constancy decreased. Both ResNets and classical ConvNets of varying degrees of complexity performed well. However, DeepCC, our simplest sequential convolutional network, represented colors along the three color dimensions of human color vision, while ResNets showed a more complex representation.
Collapse
Affiliation(s)
- Alban Flachot
- Abteilung Allgemeine Psychologie, Justus Liebig University, Giessen, Germany.,
| | - Arash Akbarinia
- Abteilung Allgemeine Psychologie, Justus Liebig University, Giessen, Germany.,
| | - Heiko H Schütt
- Center for Neural Science, New York University, New York, NY, USA.,
| | - Roland W Fleming
- Experimental Psychology, Justus Liebig University, Giessen, Germany.,
| | - Felix A Wichmann
- Neural Information Processing Group, University of Tübingen, Germany.,
| | - Karl R Gegenfurtner
- Abteilung Allgemeine Psychologie, Justus Liebig University, Giessen, Germany.,
| |
Collapse
|
6
|
|
7
|
Piasini E, Soltuzu L, Muratore P, Caramellino R, Vinken K, Op de Beeck H, Balasubramanian V, Zoccolan D. Temporal stability of stimulus representation increases along rodent visual cortical hierarchies. Nat Commun 2021; 12:4448. [PMID: 34290247 PMCID: PMC8295255 DOI: 10.1038/s41467-021-24456-3] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Accepted: 06/14/2021] [Indexed: 11/09/2022] Open
Abstract
Cortical representations of brief, static stimuli become more invariant to identity-preserving transformations along the ventral stream. Likewise, increased invariance along the visual hierarchy should imply greater temporal persistence of temporally structured dynamic stimuli, possibly complemented by temporal broadening of neuronal receptive fields. However, such stimuli could engage adaptive and predictive processes, whose impact on neural coding dynamics is unknown. By probing the rat analog of the ventral stream with movies, we uncovered a hierarchy of temporal scales, with deeper areas encoding visual information more persistently. Furthermore, the impact of intrinsic dynamics on the stability of stimulus representations grew gradually along the hierarchy. A database of recordings from mouse showed similar trends, additionally revealing dependencies on the behavioral state. Overall, these findings show that visual representations become progressively more stable along rodent visual processing hierarchies, with an important contribution provided by intrinsic processing.
Collapse
Affiliation(s)
- Eugenio Piasini
- Computational Neuroscience Initiative, University of Pennsylvania, Philadelphia, PA, United States
| | - Liviu Soltuzu
- Visual Neuroscience Lab, International School for Advanced Studies (SISSA), Trieste, Italy
- Blue Brain Project, École polytechnique fédérale de Lausanne (EPFL), Campus Biotech, Geneva, Switzerland
| | - Paolo Muratore
- Visual Neuroscience Lab, International School for Advanced Studies (SISSA), Trieste, Italy
| | - Riccardo Caramellino
- Visual Neuroscience Lab, International School for Advanced Studies (SISSA), Trieste, Italy
| | - Kasper Vinken
- Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
- Laboratory for Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Hans Op de Beeck
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Vijay Balasubramanian
- Computational Neuroscience Initiative, University of Pennsylvania, Philadelphia, PA, United States
| | - Davide Zoccolan
- Visual Neuroscience Lab, International School for Advanced Studies (SISSA), Trieste, Italy.
| |
Collapse
|