1
|
Dai W, Wang T, Li Y, Yang Y, Zhang Y, Kang J, Wu Y, Yu H, Xing D. Dynamic Recruitment of the Feedforward and Recurrent Mechanism for Black-White Asymmetry in the Primary Visual Cortex. J Neurosci 2023; 43:5668-5684. [PMID: 37487737 PMCID: PMC10401654 DOI: 10.1523/jneurosci.0168-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 07/11/2023] [Accepted: 07/14/2023] [Indexed: 07/26/2023] Open
Abstract
Black and white information is asymmetrically distributed in natural scenes, evokes asymmetric neuronal responses, and causes asymmetric perceptions. Recognizing the universality and essentiality of black-white asymmetry in visual information processing, the neural substrates for black-white asymmetry remain unclear. To disentangle the role of the feedforward and recurrent mechanisms in the generation of cortical black-white asymmetry, we recorded the V1 laminar responses and LGN responses of anesthetized cats of both sexes. In a cortical column, we found that black-white asymmetry starts at the input layer and becomes more pronounced in the output layer. We also found distinct dynamics of black-white asymmetry between the output layer and the input layer. Specifically, black responses dominate in all layers after stimulus onset. After stimulus offset, black and white responses are balanced in the input layer, but black responses still dominate in the output layer. Compared with that in the input layer, the rebound response in the output layer is significantly suppressed. The relative suppression strength evoked by white stimuli is notably stronger and depends on the location within the ON-OFF cortical map. A model with delayed and polarity-selective cortical suppression explains black-white asymmetry in the output layer, within which prominent recurrent connections are identified by Granger causality analysis. In addition to black-white asymmetry in response strength, the interlaminar differences in spatial receptive field varied dynamically. Our findings suggest that the feedforward and recurrent mechanisms are dynamically recruited for the generation of black-white asymmetry in V1.SIGNIFICANCE STATEMENT Black-white asymmetry is universal and essential in visual information processing, yet the neural substrates for cortical black-white asymmetry remain unknown. Leveraging V1 laminar recordings, we provided the first laminar pattern of black-white asymmetry in cat V1 and found distinct dynamics of black-white asymmetry between the output layer and the input layer. Comparing black-white asymmetry across three visual hierarchies, the LGN, V1 input layer, and V1 output layer, we demonstrated that the feedforward and recurrent mechanisms are dynamically recruited for the generation of cortical black-white asymmetry. Our findings not only enhance our understanding of laminar processing within a cortical column but also elucidate how feedforward connections and recurrent connections interact to shape neuronal response properties.
Collapse
Affiliation(s)
- Weifeng Dai
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Tian Wang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
- College of Life Sciences, Beijing Normal University, Beijing, 100875, China
| | - Yang Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Yi Yang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Yange Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Jian Kang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Yujie Wu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Hongbo Yu
- School of Life Sciences, State Key Laboratory of Medical Neurobiology, Collaborative Innovation Center for Brain Science, Fudan University, Shanghai, 200438, China
| | - Dajun Xing
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| |
Collapse
|
2
|
Wang C, Fang C, Zou Y, Yang J, Sawan M. Artificial intelligence techniques for retinal prostheses: a comprehensive review and future direction. J Neural Eng 2023; 20. [PMID: 36634357 DOI: 10.1088/1741-2552/acb295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 01/12/2023] [Indexed: 01/14/2023]
Abstract
Objective. Retinal prostheses are promising devices to restore vision for patients with severe age-related macular degeneration or retinitis pigmentosa disease. The visual processing mechanism embodied in retinal prostheses play an important role in the restoration effect. Its performance depends on our understanding of the retina's working mechanism and the evolvement of computer vision models. Recently, remarkable progress has been made in the field of processing algorithm for retinal prostheses where the new discovery of the retina's working principle and state-of-the-arts computer vision models are combined together.Approach. We investigated the related research on artificial intelligence techniques for retinal prostheses. The processing algorithm in these studies could be attributed to three types: computer vision-related methods, biophysical models, and deep learning models.Main results. In this review, we first illustrate the structure and function of the normal and degenerated retina, then demonstrate the vision rehabilitation mechanism of three representative retinal prostheses. It is necessary to summarize the computational frameworks abstracted from the normal retina. In addition, the development and feature of three types of different processing algorithms are summarized. Finally, we analyze the bottleneck in existing algorithms and propose our prospect about the future directions to improve the restoration effect.Significance. This review systematically summarizes existing processing models for predicting the response of the retina to external stimuli. What's more, the suggestions for future direction may inspire researchers in this field to design better algorithms for retinal prostheses.
Collapse
Affiliation(s)
- Chuanqing Wang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| | - Chaoming Fang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| | - Yong Zou
- Beijing Institute of Radiation Medicine, Beijing, People's Republic of China
| | - Jie Yang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| | - Mohamad Sawan
- Center of Excellence in Biomedical Research on Advanced Integrated-on-chips Neurotechnologies, School of Engineering, Westlake University, Hangzhou 310030, People's Republic of China
| |
Collapse
|
3
|
Norcia AM, Yakovleva A, Jehangir N, Goldberg JL. Preferential Loss of Contrast Decrement Responses in Human Glaucoma. Invest Ophthalmol Vis Sci 2022; 63:16. [PMID: 36264656 PMCID: PMC9587510 DOI: 10.1167/iovs.63.11.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose The purpose of this study was to determine whether glaucoma in human patients produces preferential damage to OFF visual pathways, as suggested by animal experimental models, patient electroretinogram (ERG), and retinal imaging data. Methods Steady-state visual evoked potentials (SSVEPs) were recorded monocularly from 50 patients with glaucoma and 28 age-similar controls in response to equal Weber contrast increments and decrements presented using 2.73 hertz (Hz) sawtooth temporal waveforms. Results The eyes of patients with glaucoma were separated into mild (better than -6 decibel [dB] mean deviation; n = 28) and moderate to severe (worse than -6 dB mean deviation, n = 22) groups based on their Humphrey 24-2 visual field measurements. Response amplitudes and phases from the two glaucoma-severity groups were compared to controls at the group level. SSVEP amplitudes were depressed in both glaucoma groups, more so in the moderate to severe glaucoma group. The differences between controls and the moderate-severe glaucoma groups were more statistically reliable for decrements than for increments. Mean responses to decremental sawtooth stimuli were larger than those to increments in controls and in the mild glaucoma but not in the moderate to severe glaucoma group at the first harmonic. OFF/decrement responses at the first harmonic were faster in controls, but not in patients. Conclusions The observed pattern of preferential loss of decremental responses in human glaucoma is consistent with prior reports of selective damage to OFF retinal ganglion cells in murine models and in data from human ERG and retinal imaging. These data motivate pursuit of SSVEP as a biomarker for glaucoma progression.
Collapse
Affiliation(s)
- Anthony M. Norcia
- Department of Psychology, Wu Tsai Neurosciences Institute, Stanford University, Stanford, California, United States
| | - Alexandra Yakovleva
- Spencer Center for Vision Research, Byers Eye Institute, Department of Ophthalmology, Stanford University, Stanford, California, United States
| | - Naz Jehangir
- Spencer Center for Vision Research, Byers Eye Institute, Department of Ophthalmology, Stanford University, Stanford, California, United States
| | - Jeffrey L. Goldberg
- Spencer Center for Vision Research, Byers Eye Institute, Department of Ophthalmology, Stanford University, Stanford, California, United States
| |
Collapse
|
4
|
Abstract
The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger. Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.
Collapse
|
5
|
Yu Z, Turner MH, Baudin J, Rieke F. Adaptation in cone photoreceptors contributes to an unexpected insensitivity of primate On parasol retinal ganglion cells to spatial structure in natural images. eLife 2022; 11:70611. [PMID: 35285798 PMCID: PMC8956286 DOI: 10.7554/elife.70611] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Accepted: 03/13/2022] [Indexed: 02/06/2023] Open
Abstract
Neural circuits are constructed from nonlinear building blocks, and not surprisingly overall circuit behavior is often strongly nonlinear. But neural circuits can also behave near linearly, and some circuits shift from linear to nonlinear behavior depending on stimulus conditions. Such control of nonlinear circuit behavior is fundamental to neural computation. Here, we study a surprising stimulus dependence of the responses of macaque On (but not Off) parasol retinal ganglion cells: these cells respond nonlinearly to spatial structure in some stimuli but near linearly to spatial structure in others, including natural inputs. We show that these differences in the linearity of the integration of spatial inputs can be explained by a shift in the balance of excitatory and inhibitory synaptic inputs that originates at least partially from adaptation in the cone photoreceptors. More generally, this highlights how subtle asymmetries in signaling - here in the cone signals - can qualitatively alter circuit computation.
Collapse
Affiliation(s)
- Zhou Yu
- Department of Physiology and Biophysics, University of Washington, Seattle, United States
| | - Maxwell H Turner
- Department of Physiology and Biophysics, University of Washington, Seattle, United States
| | - Jacob Baudin
- Department of Physiology and Biophysics, University of Washington, Seattle, United States
| | - Fred Rieke
- Department of Physiology and Biophysics, University of Washington, Seattle, United States
| |
Collapse
|
6
|
Ichinose T, Habib S. ON and OFF Signaling Pathways in the Retina and the Visual System. FRONTIERS IN OPHTHALMOLOGY 2022; 2:989002. [PMID: 36926308 PMCID: PMC10016624 DOI: 10.3389/fopht.2022.989002] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Visual processing starts at the retina of the eye, and signals are then transferred primarily to the visual cortex and the tectum. In the retina, multiple neural networks encode different aspects of visual input, such as color and motion. Subsequently, multiple neural streams in parallel convey unique aspects of visual information to cortical and subcortical regions. Bipolar cells, which are the second order neurons of the retina, separate visual signals evoked by light and dark contrasts and encode them to ON and OFF pathways, respectively. The interplay between ON and OFF neural signals is the foundation for visual processing for object contrast which underlies higher order stimulus processing. ON and OFF pathways have been classically thought to signal in a mirror-symmetric manner. However, while these two pathways contribute synergistically to visual perception in some instances, they have pronounced asymmetries suggesting independent operation in other cases. In this review, we summarize the role of the ON-OFF dichotomy in visual signaling, aiming to contribute to the understanding of visual recognition.
Collapse
Affiliation(s)
- Tomomi Ichinose
- Department of Ophthalmology, Visual and Anatomical Sciences, Wayne State University School of Medicine, Detroit, Michigan, USA
- Correspondence: Tomomi Ichinose, MD, PhD,
| | - Samar Habib
- Department of Ophthalmology, Visual and Anatomical Sciences, Wayne State University School of Medicine, Detroit, Michigan, USA
- Department of Medical Parasitology, Mansoura Faculty of Medicine, Mansoura University, Mansoura, Egypt
| |
Collapse
|
7
|
Norcia AM, Yakovleva A, Hung B, Goldberg JL. Dynamics of Contrast Decrement and Increment Responses in Human Visual Cortex. Transl Vis Sci Technol 2020; 9:6. [PMID: 32953246 PMCID: PMC7476656 DOI: 10.1167/tvst.9.10.6] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2020] [Accepted: 08/10/2020] [Indexed: 12/11/2022] Open
Abstract
Purpose The goal of the present experiments was to determine whether electrophysiologic response properties of the ON and OFF visual pathways observed in animal experimental models can be observed in humans. Methods Steady-state visual evoked potentials (SSVEPs) were recorded in response to equivalent magnitude contrast increments and decrements presented within a probe-on-pedestal Westheimer sensitization paradigm. The probes were modulated with sawtooth temporal waveforms at a temporal frequency of 3 or 2.73 Hz. SSVEP response waveforms and response spectra for incremental and decremental stimuli were analyzed as a function of stimulus size and visual field location in 67 healthy adult participants. Results SSVEPs recorded at the scalp differ between contrast decrements and increments of equal Weber contrast: SSVEP responses were larger in amplitude and shorter in latency for contrast decrements than for contrast increments. Both increment and decrement responses were larger for displays that were scaled for cortical magnification. Conclusions In a fashion that parallels results from the early visual system of cats and monkeys, two key properties of ON versus OFF pathways found in single-unit recordings are recapitulated at the population level of activity that can be observed with scalp electrodes, allowing differential assessment of ON and OFF pathway activity in human. Translational Relevance As data from preclinical models of visual pathway dysfunction point to differential damage to subtypes of retinal ganglion cells, this approach may be useful in future work on disease detection and treatment monitoring.
Collapse
Affiliation(s)
- Anthony M Norcia
- Department of Psychology, Stanford University, Stanford, CA, USA
| | | | - Bethany Hung
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | | |
Collapse
|
8
|
Mazade R, Jin J, Pons C, Alonso JM. Functional Specialization of ON and OFF Cortical Pathways for Global-Slow and Local-Fast Vision. Cell Rep 2020; 27:2881-2894.e5. [PMID: 31167135 DOI: 10.1016/j.celrep.2019.05.007] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2018] [Revised: 03/07/2019] [Accepted: 04/30/2019] [Indexed: 12/20/2022] Open
Abstract
Visual information is processed in the cortex by ON and OFF pathways that respond to light and dark stimuli. Responses to darks are stronger, faster, and driven by a larger number of cortical neurons than responses to lights. Here, we demonstrate that these light-dark cortical asymmetries reflect a functional specialization of ON and OFF pathways for different stimulus properties. We show that large long-lasting stimuli drive stronger cortical responses when they are light, whereas small fast stimuli drive stronger cortical responses when they are dark. Moreover, we show that these light-dark asymmetries are preserved under a wide variety of luminance conditions that range from photopic to low mesopic light. Our results suggest that ON and OFF pathways extract different spatiotemporal information from visual scenes, making OFF local-fast signals better suited to maximize visual acuity and ON global-slow signals better suited to guide the eye movements needed for retinal image stabilization.
Collapse
Affiliation(s)
- Reece Mazade
- Department of Biological and Visual Sciences, SUNY College of Optometry, New York, NY 10036, USA
| | - Jianzhong Jin
- Department of Biological and Visual Sciences, SUNY College of Optometry, New York, NY 10036, USA
| | - Carmen Pons
- Department of Biological and Visual Sciences, SUNY College of Optometry, New York, NY 10036, USA
| | - Jose-Manuel Alonso
- Department of Biological and Visual Sciences, SUNY College of Optometry, New York, NY 10036, USA.
| |
Collapse
|
9
|
Khani A, Mustafar F, Rainer G. Distinct Frequency Specialization for Detecting Dark Transients in Humans and Tree Shrews. Cell Rep 2019; 23:2405-2415. [PMID: 29791851 DOI: 10.1016/j.celrep.2018.04.076] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2017] [Revised: 02/23/2018] [Accepted: 04/13/2018] [Indexed: 10/16/2022] Open
Abstract
Despite well-known privileged perception of dark over light stimuli, it is unknown to what extent this dark dominance is maintained when visual transients occur in rapid succession, for example, during perception of moving stimuli. Here, we address this question using dark and light transients presented at different flicker frequencies. Although both human participants and tree shrews exhibited dark dominance for temporally modulated transients, these occurred at different flicker frequencies, namely, at 11 Hz in humans and 40 Hz and higher in tree shrews. Tree shrew V1 neuronal activity confirmed that differences between light and dark flicker were maximal at 40 Hz, corresponding closely to behavioral findings. These findings suggest large differences in flicker perception between humans and tree shrews, which may be related to the lifestyle of these species. A specialization for detecting dark transients at high temporal frequencies may thus be adaptive for tree shrews, which are particularly fast-moving small mammals.
Collapse
Affiliation(s)
- Abbas Khani
- Visual Cognition Laboratory, Department of Medicine, University of Fribourg, 1700 Fribourg, Switzerland; Functional Brain Mapping Laboratory, Department of Basic Neurosciences, University of Geneva, 1211 Geneva, Switzerland.
| | - Faiz Mustafar
- Visual Cognition Laboratory, Department of Medicine, University of Fribourg, 1700 Fribourg, Switzerland; Department of Neurosciences, Universiti Sains Malaysia, 16150 Kelantan, Malaysia
| | - Gregor Rainer
- Visual Cognition Laboratory, Department of Medicine, University of Fribourg, 1700 Fribourg, Switzerland.
| |
Collapse
|
10
|
Gao SB, Zhang M, Zhao Q, Zhang XS, Li YJ. Underwater Image Enhancement Using Adaptive Retinal Mechanisms. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:5580-5595. [PMID: 31180853 DOI: 10.1109/tip.2019.2919947] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
We propose an underwater image enhancement model inspired by the morphology and function of the teleost fish retina. We aim to solve the problems of underwater image degradation raised by the blurring and nonuniform color biasing. In particular, the feedback from color-sensitive horizontal cells to cones and a red channel compensation are used to correct the nonuniform color bias. The center-surround opponent mechanism of the bipolar cells and the feedback from amacrine cells to interplexiform cells then to horizontal cells serve to enhance the edges and contrasts of the output image. The ganglion cells with color-opponent mechanism are used for color enhancement and color correction. Finally, we adopt a luminance-based fusion strategy to reconstruct the enhanced image from the outputs of ON and OFF pathways of fish retina. Our model utilizes the global statistics (i.e., image contrast) to automatically guide the design of each low-level filter, which realizes the self-adaption of the main parameters. Extensive qualitative and quantitative evaluations on various underwater scenes validate the competitive performance of our technique. Our model also significantly improves the accuracy of transmission map estimation and local feature point matching using the underwater image. Our method is a single image approach that does not require the specialized prior about the underwater condition or scene structure.
Collapse
|
11
|
Escobar MJ, Reyes C, Herzog R, Araya J, Otero M, Ibaceta C, Palacios AG. Characterization of Retinal Functionality at Different Eccentricities in a Diurnal Rodent. Front Cell Neurosci 2018; 12:444. [PMID: 30559649 PMCID: PMC6287453 DOI: 10.3389/fncel.2018.00444] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2018] [Accepted: 11/05/2018] [Indexed: 11/18/2022] Open
Abstract
Although the properties of the neurons of the visual system that process central and peripheral regions of the visual field have been widely researched in the visual cortex and the LGN, they have scarcely been documented for the retina. The retina is the first step in integrating optical signals, and despite considerable efforts to functionally characterize the different types of retinal ganglion cells (RGCs), a clear account of the particular functionality of cells with central vs. peripheral fields is still wanting. Here, we use electrophysiological recordings, gathered from retinas of the diurnal rodent Octodon degus, to show that RGCs with peripheral receptive fields (RF) are larger, faster, and have shorter transient responses. This translates into higher sensitivity at high temporal frequencies and a full frequency bandwidth when compared to RGCs with more central RF. We also observed that imbalances between ON and OFF cell populations are preserved with eccentricity. Finally, the high diversity of functional types of RGCs highlights the complexity of the computational strategies implemented in the early stages of visual processing, which could inspire the development of bio-inspired artificial systems.
Collapse
Affiliation(s)
- María-José Escobar
- Departamento de Electrónica, Universidad Técnica Federico Santa María, Valparaíso, Chile
| | - César Reyes
- Departamento de Electrónica, Universidad Técnica Federico Santa María, Valparaíso, Chile
| | - Rubén Herzog
- Centro Interdisciplinario de Neurociencia de Valparaíso, Universidad de Valparaíso, Valparaíso, Chile
| | - Joaquin Araya
- Centro Interdisciplinario de Neurociencia de Valparaíso, Universidad de Valparaíso, Valparaíso, Chile
- Programa de Doctorado en NeurocienciaUniversidad de Santiago de Chile, Santiago, Chile
| | - Mónica Otero
- Departamento de Electrónica, Universidad Técnica Federico Santa María, Valparaíso, Chile
| | - Cristóbal Ibaceta
- Centro Interdisciplinario de Neurociencia de Valparaíso, Universidad de Valparaíso, Valparaíso, Chile
| | - Adrián G. Palacios
- Centro Interdisciplinario de Neurociencia de Valparaíso, Universidad de Valparaíso, Valparaíso, Chile
| |
Collapse
|
12
|
Abstract
Visual motion on the retina activates a cohort of retinal ganglion cells (RGCs). This population activity encodes multiple streams of information extracted by parallel retinal circuits. Motion processing in the retina is best studied in the direction-selective circuit. The main focus of this review is the neural basis of direction selectivity, which has been investigated in unprecedented detail using state-of-the-art functional, connectomic, and modeling methods. Mechanisms underlying the encoding of other motion features by broader RGC populations are also discussed. Recent discoveries at both single-cell and population levels highlight the dynamic and stimulus-dependent engagement of multiple mechanisms that collectively implement robust motion detection under diverse visual conditions.
Collapse
Affiliation(s)
- Wei Wei
- Department of Neurobiology, The University of Chicago, Chicago, Illinois 60637, USA
| |
Collapse
|
13
|
Botella-Soler V, Deny S, Martius G, Marre O, Tkačik G. Nonlinear decoding of a complex movie from the mammalian retina. PLoS Comput Biol 2018; 14:e1006057. [PMID: 29746463 PMCID: PMC5944913 DOI: 10.1371/journal.pcbi.1006057] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2016] [Accepted: 02/27/2018] [Indexed: 11/19/2022] Open
Abstract
Retina is a paradigmatic system for studying sensory encoding: the transformation of light into spiking activity of ganglion cells. The inverse problem, where stimulus is reconstructed from spikes, has received less attention, especially for complex stimuli that should be reconstructed "pixel-by-pixel". We recorded around a hundred neurons from a dense patch in a rat retina and decoded movies of multiple small randomly-moving discs. We constructed nonlinear (kernelized and neural network) decoders that improved significantly over linear results. An important contribution to this was the ability of nonlinear decoders to reliably separate between neural responses driven by locally fluctuating light signals, and responses at locally constant light driven by spontaneous-like activity. This improvement crucially depended on the precise, non-Poisson temporal structure of individual spike trains, which originated in the spike-history dependence of neural responses. We propose a general principle by which downstream circuitry could discriminate between spontaneous and stimulus-driven activity based solely on higher-order statistical structure in the incoming spike trains.
Collapse
Affiliation(s)
| | - Stéphane Deny
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, F-75012 Paris, France
| | - Georg Martius
- Max Planck Institute for Intelligent Systems, Tübingen, Germany
| | - Olivier Marre
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, F-75012 Paris, France
| | - Gašper Tkačik
- Institute of Science and Technology Austria, Klosterneuburg, Austria
| |
Collapse
|
14
|
Deny S, Ferrari U, Macé E, Yger P, Caplette R, Picaud S, Tkačik G, Marre O. Multiplexed computations in retinal ganglion cells of a single type. Nat Commun 2017; 8:1964. [PMID: 29213097 PMCID: PMC5719075 DOI: 10.1038/s41467-017-02159-y] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2016] [Accepted: 11/09/2017] [Indexed: 11/09/2022] Open
Abstract
In the early visual system, cells of the same type perform the same computation in different places of the visual field. How these cells code together a complex visual scene is unclear. A common assumption is that cells of a single-type extract a single-stimulus feature to form a feature map, but this has rarely been observed directly. Using large-scale recordings in the rat retina, we show that a homogeneous population of fast OFF ganglion cells simultaneously encodes two radically different features of a visual scene. Cells close to a moving object code quasilinearly for its position, while distant cells remain largely invariant to the object's position and, instead, respond nonlinearly to changes in the object's speed. We develop a quantitative model that accounts for this effect and identify a disinhibitory circuit that mediates it. Ganglion cells of a single type thus do not code for one, but two features simultaneously. This richer, flexible neural map might also be present in other sensory systems.
Collapse
Affiliation(s)
- Stéphane Deny
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France.,Neural Dynamics and Computation Lab, Stanford University, CA, 94305, USA
| | - Ulisse Ferrari
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France
| | - Emilie Macé
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France.,Neural Circuit Laboratories, Friedrich Miescher Institute for Biomedical Research, Maulbeerstrasse 66, 4058, Basel, Switzerland
| | - Pierre Yger
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France
| | - Romain Caplette
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France
| | - Serge Picaud
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France
| | - Gašper Tkačik
- Institute of Science and Technology Austria, 3400, Klosterneuburg, Austria
| | - Olivier Marre
- Institut de la Vision, INSERM UMRS 968, UPMC UM 80, CNRS UMR 7210, Paris, France.
| |
Collapse
|
15
|
Abstract
Visual textures are a class of stimuli with properties that make them well suited for addressing general questions about visual function at the levels of behavior and neural mechanism. They have structure across multiple spatial scales, they put the focus on the inferential nature of visual processing, and they help bridge the gap between stimuli that are analytically convenient and the complex, naturalistic stimuli that have the greatest biological relevance. Key questions that are well suited for analysis via visual textures include the nature and structure of perceptual spaces, modulation of early visual processing by task, and the transformation of sensory stimuli into patterns of population activity that are relevant to perception.
Collapse
Affiliation(s)
- Jonathan D Victor
- Feil Family Brain and Mind Research Institute, Weill Cornell Medical College, New York, NY 10065;
| | - Mary M Conte
- Feil Family Brain and Mind Research Institute, Weill Cornell Medical College, New York, NY 10065;
| | - Charles F Chubb
- Department of Cognitive Sciences, School of Social Sciences, University of California, Irvine, California 92697
| |
Collapse
|
16
|
Asymmetries of Dark and Bright Negative Afterimages Are Paralleled by Subcortical ON and OFF Poststimulus Responses. J Neurosci 2017; 37:1984-1996. [PMID: 28077727 DOI: 10.1523/jneurosci.2021-16.2017] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2016] [Revised: 12/21/2016] [Accepted: 01/02/2017] [Indexed: 01/01/2023] Open
Abstract
Humans are more sensitive to luminance decrements than increments, as evidenced by lower thresholds and shorter latencies for dark stimuli. This asymmetry is consistent with results of neurophysiological recordings in dorsal lateral geniculate nucleus (dLGN) and primary visual cortex (V1) of cat and monkey. Specifically, V1 population responses demonstrate that darks elicit higher levels of activation than brights, and the latency of OFF responses in dLGN and V1 is shorter than that of ON responses. The removal of a dark or bright disc often generates the perception of a negative afterimage, and here we ask whether there also exist asymmetries for negative afterimages elicited by dark and bright discs. If so, do the poststimulus responses of subcortical ON and OFF cells parallel such afterimage asymmetries? To test these hypotheses, we performed psychophysical experiments in humans and single-cell/S-potential recordings in cat dLGN. Psychophysically, we found that bright afterimages elicited by luminance decrements are stronger and last longer than dark afterimages elicited by luminance increments of equal sizes. Neurophysiologically, we found that ON cells responded to the removal of a dark disc with higher firing rates that were maintained for longer than OFF cells to the removal of a bright disc. The ON and OFF cell asymmetry was most pronounced at long stimulus durations in the dLGN. We conclude that subcortical response strength differences between ON and OFF channels parallel the asymmetries between bright and dark negative afterimages, further supporting a subcortical origin of bright and dark afterimage perception.SIGNIFICANCE STATEMENT Afterimages are physiological aftereffects following stimulation of the eye, the study of which helps us to understand how our visual brain generates visual perception in the absence of physical stimuli. We report, for the first time to our knowledge, asymmetries between bright and dark negative afterimages elicited by luminance decrements and increments, respectively. Bright afterimages are stronger and last longer than dark afterimages. Subcortical neuronal recordings of poststimulus responses of ON and OFF cells reveal similar asymmetries with respect to response strength and duration. Our results suggest that subcortical differences between ON and OFF channels help explain intensity and duration asymmetries between bright and dark afterimages, supporting the notion of a subcortical origin of bright and dark afterimages.
Collapse
|
17
|
Cooper EA. A normalized contrast-encoding model exhibits bright/dark asymmetries similar to early visual neurons. Physiol Rep 2016; 4:4/7/e12746. [PMID: 27044852 PMCID: PMC4831320 DOI: 10.14814/phy2.12746] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2016] [Accepted: 02/24/2016] [Indexed: 01/15/2023] Open
Abstract
Biological sensory systems share a number of organizing principles. One such principle is the formation of parallel streams. In the visual system, information about bright and dark features is largely conveyed via two separate streams: the ON and OFF pathways. While brightness and darkness can be considered symmetric and opposite forms of visual contrast, the response properties of cells in the ON and OFF pathways are decidedly asymmetric. Here, we ask whether a simple contrast‐encoding model predicts asymmetries for brights and darks that are similar to the asymmetries found in the ON and OFF pathways. Importantly, this model does not include any explicit differences in how the visual system represents brights and darks, but it does include a common normalization mechanism. The phenomena captured by the model include (1) nonlinear contrast response functions, (2) greater nonlinearities in the responses to darks, and (3) larger responses to dark contrasts. We report a direct, quantitative comparison between these model predictions and previously published electrophysiological measurements from the retina and thalamus (guinea pig and cat, respectively). This work suggests that the simple computation of visual contrast may account for a range of early visual processing nonlinearities. Assessing explicit models of sensory representations is essential for understanding which features of neuronal activity these models can and cannot predict, and for investigating how early computations may reverberate through the sensory pathways.
Collapse
Affiliation(s)
- Emily A Cooper
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, New Hampshire
| |
Collapse
|
18
|
Zhao L, Sendek C, Davoodnia V, Lashgari R, Dul MW, Zaidi Q, Alonso JM. Effect of Age and Glaucoma on the Detection of Darks and Lights. Invest Ophthalmol Vis Sci 2015; 56:7000-6. [PMID: 26513506 DOI: 10.1167/iovs.15-16753] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
PURPOSE We have shown previously that normal observers detect dark targets faster and more accurately than light targets, when presented in noisy backgrounds. We investigated how these differences in detection time and accuracy are affected by age and ganglion cell pathology associated with glaucoma. METHODS We asked 21 glaucoma patients, 21 age-similar controls, and 5 young control observers to report as fast as possible the number of 1 to 3 light or dark targets. The targets were positioned at random in a binary noise background, within the central 30° of the visual field. RESULTS We replicate previous findings that darks are detected faster and more accurately than lights. We extend these findings by demonstrating that differences in detection of darks and lights are found reliably across different ages and in observers with glaucoma. We show that differences in detection time increase at a rate of approximately 55 msec/dB at early stages of glaucoma and then remain constant at later stages at approximately 800 msec. In normal subjects, differences in detection time increase with age at a rate of approximately 8 msec/y. We also demonstrate that the accuracy to detect lights and darks is significantly correlated with the severity of glaucoma and that the mean detection time is significantly longer for subjects with glaucoma than age-similar controls. CONCLUSIONS We conclude that differences in detection of darks and lights can be demonstrated over a wide range of ages, and asymmetries in dark/light detection increase with age and early stages of glaucoma.
Collapse
Affiliation(s)
- Linxi Zhao
- Department of Biological and Visual Sciences State University of New York, College of Optometry, New York, New York, United States
| | - Caroline Sendek
- Department of Biological and Visual Sciences State University of New York, College of Optometry, New York, New York, United States
| | - Vandad Davoodnia
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Tehran, Iran
| | - Reza Lashgari
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Tehran, Iran
| | - Mitchell W Dul
- Department of Biological and Visual Sciences State University of New York, College of Optometry, New York, New York, United States
| | - Qasim Zaidi
- Department of Biological and Visual Sciences State University of New York, College of Optometry, New York, New York, United States
| | - Jose-Manuel Alonso
- Department of Biological and Visual Sciences State University of New York, College of Optometry, New York, New York, United States
| |
Collapse
|
19
|
Jiang Y, Purushothaman G, Casagrande VA. The functional asymmetry of ON and OFF channels in the perception of contrast. J Neurophysiol 2015; 114:2816-29. [PMID: 26334011 DOI: 10.1152/jn.00560.2015] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2015] [Accepted: 09/02/2015] [Indexed: 12/25/2022] Open
Abstract
To fully understand the relationship between perception and single neural responses, one should take into consideration the early stages of sensory processing. Few studies, however, have directly examined the neural underpinning of visual perception in the lateral geniculate nucleus (LGN), only one synapse away from the retina. In this study we recorded from LGN parvocellular (P) ON-center and OFF-center neurons while monkeys either passively viewed or actively detected a full range of contrasts. We found that OFF neurons were more sensitive in detecting negative contrasts than ON neurons were in detecting positive contrasts. Also, OFF neurons had higher spontaneous activities, higher peak response amplitudes, and were more sustained than ON neurons in their contrast responses. Puzzlingly, OFF neurons failed to show any significant correlations with the monkeys' perceptual choices, despite their greater contrast sensitivities. If, however, choice probabilities were calculated from interspike intervals instead of spike counts (thus taking into account the higher firing rates of OFF neurons), OFF neurons but not ON neurons were significantly correlated with behavioral choices. Taken together, these results demonstrate in awake, behaving animals that: 1) the ON and OFF pathways do not simply mirror each other in their functionality but instead carry qualitatively different types of information, and 2) the responses of ON and OFF neurons can be correlated with perceptual choices even in the absence of physical stimuli and interneuronal correlations.
Collapse
Affiliation(s)
- Yaoguang Jiang
- Department of Psychology, Vanderbilt University, Nashville, Tennessee
| | - Gopathy Purushothaman
- Department of Cell and Developmental Biology, Vanderbilt University, Nashville, Tennessee; and
| | - Vivien A Casagrande
- Department of Psychology, Vanderbilt University, Nashville, Tennessee; Department of Cell and Developmental Biology, Vanderbilt University, Nashville, Tennessee; and Department of Ophthalmology and Visual Sciences, Vanderbilt University, Nashville, Tennessee
| |
Collapse
|
20
|
Predicting cortical dark/bright asymmetries from natural image statistics and early visual transforms. PLoS Comput Biol 2015; 11:e1004268. [PMID: 26020624 PMCID: PMC4447361 DOI: 10.1371/journal.pcbi.1004268] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2014] [Accepted: 03/28/2015] [Indexed: 11/19/2022] Open
Abstract
The nervous system has evolved in an environment with structure and predictability. One of the ubiquitous principles of sensory systems is the creation of circuits that capitalize on this predictability. Previous work has identified predictable non-uniformities in the distributions of basic visual features in natural images that are relevant to the encoding tasks of the visual system. Here, we report that the well-established statistical distributions of visual features -- such as visual contrast, spatial scale, and depth -- differ between bright and dark image components. Following this analysis, we go on to trace how these differences in natural images translate into different patterns of cortical input that arise from the separate bright (ON) and dark (OFF) pathways originating in the retina. We use models of these early visual pathways to transform natural images into statistical patterns of cortical input. The models include the receptive fields and non-linear response properties of the magnocellular (M) and parvocellular (P) pathways, with their ON and OFF pathway divisions. The results indicate that there are regularities in visual cortical input beyond those that have previously been appreciated from the direct analysis of natural images. In particular, several dark/bright asymmetries provide a potential account for recently discovered asymmetries in how the brain processes visual features, such as violations of classic energy-type models. On the basis of our analysis, we expect that the dark/bright dichotomy in natural images plays a key role in the generation of both cortical and perceptual asymmetries. Sensory systems must contend with a tremendous amount of diversity in the natural world. Gaining a detailed description of the natural world’s statistical regularities is a critical part of understanding how the nervous system is adapted to its environment. Here, we report that the well-established statistical distributions of basic visual features—such as visual contrast and spatial scale—diverge when separated into bright and dark components. Operations such as dark/bright segregation are key features of early visual pathways. By modeling these pathways, we demonstrate that the dark and bright visual patterns driving cortical networks are asymmetric across a number of visual features, producing previously unappreciated second-order regularities. The results provide a parsimonious account for recently discovered asymmetries in cortical activity.
Collapse
|
21
|
Abstract
In many sensory systems, the neural signal splits into multiple parallel pathways. For example, in the mammalian retina, ~20 types of retinal ganglion cells transmit information about the visual scene to the brain. The purpose of this profuse and early pathway splitting remains unknown. We examine a common instance of splitting into ON and OFF neurons excited by increments and decrements of light intensity in the visual scene, respectively. We test the hypothesis that pathway splitting enables more efficient encoding of sensory stimuli. Specifically, we compare a model system with an ON and an OFF neuron to one with two ON neurons. Surprisingly, the optimal ON-OFF system transmits the same information as the optimal ON-ON system, if one constrains the maximal firing rate of the neurons. However, the ON-OFF system uses fewer spikes on average to transmit this information. This superiority of the ON-OFF system is also observed when the two systems are optimized while constraining their mean firing rate. The efficiency gain for the ON-OFF split is comparable with that derived from decorrelation, a well known processing strategy of early sensory systems. The gain can be orders of magnitude larger when the ecologically important stimuli are rare but large events of either polarity. The ON-OFF system also provides a better code for extracting information by a linear downstream decoder. The results suggest that the evolution of ON-OFF diversification in sensory systems may be driven by the benefits of lowering average metabolic cost, especially in a world in which the relevant stimuli are sparse.
Collapse
|
22
|
Komban SJ, Kremkow J, Jin J, Wang Y, Lashgari R, Li X, Zaidi Q, Alonso JM. Neuronal and perceptual differences in the temporal processing of darks and lights. Neuron 2014; 82:224-34. [PMID: 24698277 PMCID: PMC3980847 DOI: 10.1016/j.neuron.2014.02.020] [Citation(s) in RCA: 65] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/06/2014] [Indexed: 11/20/2022]
Abstract
Visual information is mediated by two major thalamic pathways that signal light decrements (OFF) and increments (ON) in visual scenes, the OFF pathway being faster than the ON. Here, we demonstrate that this OFF temporal advantage is transferred to visual cortex and has a correlate in human perception. OFF-dominated cortical neurons in cats responded ∼3 ms faster to visual stimuli than ON-dominated cortical neurons, and dark-mediated suppression in ON-dominated neurons peaked ∼14 ms faster than light-mediated suppression in OFF-dominated neurons. Consistent with the neuronal differences, human observers were 6-14 ms faster at detecting darks than lights and better at discriminating dark than light flickers. Neuronal and perceptual differences both vanished if backgrounds were biased toward darks. Our results suggest that the cortical OFF pathway is faster than the ON pathway at increasing and suppressing visual responses, and these differences have parallels in the human visual perception of lights and darks.
Collapse
Affiliation(s)
- Stanley Jose Komban
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA
| | - Jens Kremkow
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA
| | - Jianzhong Jin
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA
| | - Yushi Wang
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA
| | - Reza Lashgari
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA; School of Electrical Engineering, Iran University of Science and Technology, Narmak, Tehran, Iran
| | - Xiaobing Li
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA
| | - Qasim Zaidi
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA
| | - Jose-Manuel Alonso
- Graduate Center for Vision Research, SUNY College of Optometry, New York, NY, 10036, USA.
| |
Collapse
|