Pathway-Specific Asymmetries between ON and OFF Visual Signals

Visual evoked potentials in patients with congenital color vision deficiency

BACKGROUND/AIM

Congenital color vision deficiency (CCVD) is an eye disease characterized by abnormalities in the cone cells in the photoreceptor layer. Visual evoked potentials (VEPs) are electrophysiological tests that physiologically examine the optic nerve, other visual pathways, and the visual cortex. The aim of this research was to determine whether there are VEP abnormalities in CCVD patients.

METHODS

Patients with CCVD and healthy individuals were included in this prospective case-control study. Participants with eye disease or neurodegenerative disease were excluded from the study. Pattern reversal VEP (PVEP), flash VEP (FVEP), and optical coherence tomography were performed on all participants.

RESULTS

Twenty healthy individuals (15 male) and 21 patients with CCVD (18 male) were included in the study. The mean ages of healthy individuals and patients with CCVD were 29.8 ± 9.6 and 31.1 ± 10.9 years (p = 0.804). Retinal nerve fiber layer thickness and central macular thickness values did not differ between the two groups. In PVEP, Right P100, Left N75, P100, N135 values were delayed in CCVD patients compared to healthy individuals (p = 0.001, p = 0.032, p = 0.003, p = 0.032). At least one PVEP and FVEP abnormality was present in nine (42.9%) and six (28.6%) of the patients, respectively. PVEP or FVEP abnormalities were found in 13 (61.9%) of the patients.

CONCLUSION

This study indicated that there may be PVEP and FVEP abnormalities in patients with CCVD.

Asymmetries between achromatic increments and decrements: Perceptual scales and discrimination thresholds

The perceptual response to achromatic incremental (A+) and decremental (A-) visual stimuli is known to be asymmetrical, due most likely to differences between ON and OFF channels. In the current study, we further investigated this asymmetry psychophysically. In Experiment 1, maximum likelihood difference scaling (MLDS) was used to estimate separately observers' perceptual scales for A+ and A-. In Experiment 2, observers performed two spatial alternative forced choice (2SAFC) pedestal discrimination on multiple pedestal contrast levels, using all combinations of A+ and A- pedestals and tests. Both experiments showed the well-known asymmetry. The perceptual scale curves of A+ follow a modified Naka-Rushton equation, whereas those of A- follow a cubic function. Correspondingly, the discrimination thresholds for the A+ pedestal increased monotonically with pedestal contrast, whereas the thresholds of the A- pedestal first increased as the pedestal contrast increased, then decreased as the contrast became higher. We propose a model that links the results of the two experiments, in which the pedestal discrimination threshold is inversely related to the derivative of the perceptual scale curve. Our findings generally agree with Whittle's previous findings (Whittle, 1986, 1992), which also included strong asymmetry between A+ and A-. We suggest that the perception of achromatic balanced incremental and decremental (bipolar) stimuli, such as gratings or flicker, might be dominated by one polarity due to this asymmetry under some conditions.

GABAergic Inhibition Controls Receptive Field Size, Sensitivity, and Contrast Preference of Direction Selective Retinal Ganglion Cells Near the Threshold of Vision

Information about motion is encoded by direction-selective retinal ganglion cells (DSGCs). These cells reliably transmit this information across a broad range of light levels, spanning moonlight to sunlight. Previous work indicates that adaptation to low light levels causes heterogeneous changes to the direction tuning of ON-OFF (oo)DSGCs and suggests that superior-preferring ON-OFF DSGCs (s-DSGCs) are biased toward detecting stimuli rather than precisely signaling direction. Using a large-scale multielectrode array, we measured the absolute sensitivity of ooDSGCs and found that s-DSGCs are 10-fold more sensitive to dim flashes of light than other ooDSGCs. We measured their receptive field (RF) sizes and found that s-DSGCs also have larger receptive fields than other ooDSGCs; however, the size difference does not fully explain the sensitivity difference. Using a conditional knock-out of gap junctions and pharmacological manipulations, we demonstrate that GABA-mediated inhibition contributes to the difference in absolute sensitivity and receptive field size at low light levels, while the connexin36-mediated gap junction coupling plays a minor role. We further show that under scotopic conditions, ooDSGCs exhibit only an ON response, but pharmacologically removing GABA-mediated inhibition unmasks an OFF response. These results reveal that GABAergic inhibition controls and differentially modulates the responses of ooDSGCs under scotopic conditions.

Population encoding of stimulus features along the visual hierarchy

The retina and primary visual cortex (V1) both exhibit diverse neural populations sensitive to diverse visual features. Yet it remains unclear how neural populations in each area partition stimulus space to span these features. One possibility is that neural populations are organized into discrete groups of neurons, with each group signaling a particular constellation of features. Alternatively, neurons could be continuously distributed across feature-encoding space. To distinguish these possibilities, we presented a battery of visual stimuli to the mouse retina and V1 while measuring neural responses with multi-electrode arrays. Using machine learning approaches, we developed a manifold embedding technique that captures how neural populations partition feature space and how visual responses correlate with physiological and anatomical properties of individual neurons. We show that retinal populations discretely encode features, while V1 populations provide a more continuous representation. Applying the same analysis approach to convolutional neural networks that model visual processing, we demonstrate that they partition features much more similarly to the retina, indicating they are more like big retinas than little brains.

Contrast Sensitivity of ON and OFF Human Retinal Pathways in Myopia

The human visual cortex processes light and dark stimuli with ON and OFF pathways that are differently modulated by luminance contrast. We have previously demonstrated that ON cortical pathways have higher contrast sensitivity than OFF cortical pathways and the difference increases with luminance range (defined as the maximum minus minimum luminance in the scene). Here, we demonstrate that these ON-OFF cortical differences are already present in the human retina and that retinal responses measured with electroretinography are more affected by reductions in luminance range than cortical responses measured with electroencephalography. Moreover, we show that ON-OFF pathway differences measured with electroretinography become more pronounced in myopia, a visual disorder that elongates the eye and blurs vision at far distance. We find that, as the eye axial length increases across subjects, ON retinal pathways become less responsive, slower in response latency, less sensitive, and less effective and slower at driving pupil constriction. Based on these results, we conclude that myopia is associated with a deficit in ON pathway function that decreases the ability of the retina to process low contrast and regulate retinal illuminance in bright environments.

Awake responses suggest inefficient dense coding in the mouse retina

The structure and function of the vertebrate retina have been extensively studied across species with an isolated, ex vivo preparation. Retinal function in vivo, however, remains elusive, especially in awake animals. Here, we performed single-unit extracellular recordings in the optic tract of head-fixed mice to compare the output of awake, anesthetized, and ex vivo retinas. While the visual response properties were overall similar across conditions, we found that awake retinal output had in general (1) faster kinetics with less variability in the response latencies; (2) a larger dynamic range; and (3) higher firing activity, by ~20 Hz on average, for both baseline and visually evoked responses. Our modeling analyses further showed that such awake response patterns convey comparable total information but less efficiently, and allow for a linear population decoder to perform significantly better than the anesthetized or ex vivo responses. These results highlight distinct retinal behavior in awake states, in particular suggesting that the retina employs dense coding in vivo, rather than sparse efficient coding as has been often assumed from ex vivo studies.

Differences in nonlinearities determine retinal cell types

Classifying neurons in different types is still an open challenge. In the retina, recent works have taken advantage of the ability to record from a large number of cells to classify ganglion cells into different types based on functional information. Although the first attempts in this direction used the receptive field properties of each cell to classify them, more recent approaches have proposed to cluster ganglion cells directly based on their response to stimuli. These two approaches have not been compared directly. Here, we recorded the responses of a large number of ganglion cells and compared two methods for classifying them into functional groups, one based on the receptive field properties, and the other one using directly their responses to stimuli with various temporal frequencies. We show that the response-based approach allows separation of more types than the receptive field-based method, leading to a better classification. This better granularity is due to the fact that the response-based method takes into account not only the linear part of ganglion cell function but also some of the nonlinearities. A careful characterization of nonlinear processing is thus key to allowing functional classification of sensory neurons.NEW & NOTEWORTHY In the retina, ganglion cells can be classified based on their response to visual stimuli. Although some methods are based on the modeling of receptive fields, others rely on responses to characteristic stimuli. We compared these two classes of methods and show that the latter provides a higher discrimination performance. We also show that this gain arises from the ability to account for the nonlinear behavior of neurons.

Population encoding of stimulus features along the visual hierarchy

The retina and primary visual cortex (V1) both exhibit diverse neural populations sensitive to diverse visual features. Yet it remains unclear how neural populations in each area partition stimulus space to span these features. One possibility is that neural populations are organized into discrete groups of neurons, with each group signaling a particular constellation of features. Alternatively, neurons could be continuously distributed across feature-encoding space. To distinguish these possibilities, we presented a battery of visual stimuli to mouse retina and V1 while measuring neural responses with multi-electrode arrays. Using machine learning approaches, we developed a manifold embedding technique that captures how neural populations partition feature space and how visual responses correlate with physiological and anatomical properties of individual neurons. We show that retinal populations discretely encode features, while V1 populations provide a more continuous representation. Applying the same analysis approach to convolutional neural networks that model visual processing, we demonstrate that they partition features much more similarly to the retina, indicating they are more like big retinas than little brains.

ON and OFF receptive field processing in the presence of optical scattering

The balance of ON/OFF pathway activation in the retina plays a role in emmetropization. A new myopia control lens design uses contrast reduction to down-regulate a hypothesized enhanced ON contrast sensitivity in myopes. The study thus examined ON/OFF receptive field processing in myopes and non-myopes and the impact of contrast reduction. A psychophysical approach was used to measure the combined retinal-cortical output in the form of low-level ON and OFF contrast sensitivity with and without contrast reduction in 22 participants. ON responses were lower than OFF responses (ON 1.25 ± 0.03 vs. OFF 1.39 ± 0.03 log(CS); p < 0.0001) and myopes showed generally reduced sensitivities (myopes 1.25 ± 0.05 vs. non-myopes 1.39 ± 0.05 log(CS); p = 0.05). These findings remained unaffected by contrast reduction (p > 0.05). The study suggests that perceptual differences in ON and OFF signal processing between myopes and non-myopes exist but cannot explain how contrast reduction can inhibit myopia development.

Large-scale interrogation of retinal cell functions by 1-photon light-sheet microscopy

Visual processing in the retina depends on the collective activity of large ensembles of neurons organized in different layers. Current techniques for measuring activity of layer-specific neural ensembles rely on expensive pulsed infrared lasers to drive 2-photon activation of calcium-dependent fluorescent reporters. We present a 1-photon light-sheet imaging system that can measure the activity in hundreds of neurons in the ex vivo retina over a large field of view while presenting visual stimuli. This allows for a reliable functional classification of different retinal cell types. We also demonstrate that the system has sufficient resolution to image calcium entry at individual synaptic release sites across the axon terminals of dozens of simultaneously imaged bipolar cells. The simple design, large field of view, and fast image acquisition make this a powerful system for high-throughput and high-resolution measurements of retinal processing at a fraction of the cost of alternative approaches.

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

Systematic reduction of the dimensionality of natural scenes allows accurate predictions of retinal ganglion cell spike outputs

The mammalian retina engages a broad array of linear and nonlinear circuit mechanisms to convert natural scenes into retinal ganglion cell (RGC) spike outputs. Although many individual integration mechanisms are well understood, we know less about how multiple mechanisms interact to encode the complex spatial features present in natural inputs. Here, we identified key spatial features in natural scenes that shape encoding by primate parasol RGCs. Our approach identified simplifications in the spatial structure of natural scenes that minimally altered RGC spike responses. We observed that reducing natural movies into 16 linearly integrated regions described ∼80% of the structure of parasol RGC spike responses; this performance depended on the number of regions but not their precise spatial locations. We used simplified stimuli to design high-dimensional metamers that recapitulated responses to naturalistic movies. Finally, we modeled the retinal computations that convert flashed natural images into one-dimensional spike counts.

Cortical mechanisms of visual brightness

The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger.

Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.

Robust cone-mediated signaling persists late into rod photoreceptor degeneration

Rod photoreceptor degeneration causes deterioration in the morphology and physiology of cone photoreceptors along with changes in retinal circuits. These changes could diminish visual signaling at cone-mediated light levels, thereby limiting the efficacy of treatments such as gene therapy for rescuing normal, cone-mediated vision. However, the impact of progressive rod death on cone-mediated signaling remains unclear. To investigate the fidelity of retinal ganglion cell (RGC) signaling throughout disease progression, we used a mouse model of rod degeneration (Cngb1neo/neo). Despite clear deterioration of cone morphology with rod death, cone-mediated signaling among RGCs remained surprisingly robust: spatiotemporal receptive fields changed little and the mutual information between stimuli and spiking responses was relatively constant. This relative stability held until nearly all rods had died and cones had completely lost well-formed outer segments. Interestingly, RGC information rates were higher and more stable for natural movies than checkerboard noise as degeneration progressed. The main change in RGC responses with photoreceptor degeneration was a decrease in response gain. These results suggest that gene therapies for rod degenerative diseases are likely to prolong cone-mediated vision even if there are changes to cone morphology and density.

Retinal Encoding of Natural Scenes

An ultimate goal in retina science is to understand how the neural circuit of the retina processes natural visual scenes. Yet most studies in laboratories have long been performed with simple, artificial visual stimuli such as full-field illumination, spots of light, or gratings. The underlying assumption is that the features of the retina thus identified carry over to the more complex scenario of natural scenes. As the application of corresponding natural settings is becoming more commonplace in experimental investigations, this assumption is being put to the test and opportunities arise to discover processing features that are triggered by specific aspects of natural scenes. Here, we review how natural stimuli have been used to probe, refine, and complement knowledge accumulated under simplified stimuli, and we discuss challenges and opportunities along the way toward a comprehensive understanding of the encoding of natural scenes. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Retinal Glutamate Neurotransmission: From Physiology to Pathophysiological Mechanisms of Retinal Ganglion Cell Degeneration

Glutamate neurotransmission and metabolism are finely modulated by the retinal network, where the efficient processing of visual information is shaped by the differential distribution and composition of glutamate receptors and transporters. However, disturbances in glutamate homeostasis can result in glutamate excitotoxicity, a major initiating factor of common neurodegenerative diseases. Within the retina, glutamate excitotoxicity can impair visual transmission by initiating degeneration of neuronal populations, including retinal ganglion cells (RGCs). The vulnerability of RGCs is observed not just as a result of retinal diseases but has also been ascribed to other common neurodegenerative and peripheral diseases. In this review, we describe the vulnerability of RGCs to glutamate excitotoxicity and the contribution of different glutamate receptors and transporters to this. In particular, we focus on the N-methyl-d-aspartate (NMDA) receptor as the major effector of glutamate-induced mechanisms of neurodegeneration, including impairment of calcium homeostasis, changes in gene expression and signalling, and mitochondrial dysfunction, as well as the role of endoplasmic reticular stress. Due to recent developments in the search for modulators of NMDA receptor signalling, novel neuroprotective strategies may be on the horizon.

Adaptation in cone photoreceptors contributes to an unexpected insensitivity of primate On parasol retinal ganglion cells to spatial structure in natural images

Neural circuits are constructed from nonlinear building blocks, and not surprisingly overall circuit behavior is often strongly nonlinear. But neural circuits can also behave near linearly, and some circuits shift from linear to nonlinear behavior depending on stimulus conditions. Such control of nonlinear circuit behavior is fundamental to neural computation. Here, we study a surprising stimulus dependence of the responses of macaque On (but not Off) parasol retinal ganglion cells: these cells respond nonlinearly to spatial structure in some stimuli but near linearly to spatial structure in others, including natural inputs. We show that these differences in the linearity of the integration of spatial inputs can be explained by a shift in the balance of excitatory and inhibitory synaptic inputs that originates at least partially from adaptation in the cone photoreceptors. More generally, this highlights how subtle asymmetries in signaling - here in the cone signals - can qualitatively alter circuit computation.

Transience of the Retinal Output Is Determined by a Great Variety of Circuit Elements

Retinal ganglion cells (RGCs) encrypt stimulus features of the visual scene in action potentials and convey them toward higher visual centers in the brain. Although there are many visual features to encode, our recent understanding is that the ~46 different functional subtypes of RGCs in the retina share this task. In this scheme, each RGC subtype establishes a separate, parallel signaling route for a specific visual feature (e.g., contrast, the direction of motion, luminosity), through which information is conveyed. The efficiency of encoding depends on several factors, including signal strength, adaptational levels, and the actual efficacy of the underlying retinal microcircuits. Upon collecting inputs across their respective receptive field, RGCs perform further analysis (e.g., summation, subtraction, weighting) before they generate the final output spike train, which itself is characterized by multiple different features, such as the number of spikes, the inter-spike intervals, response delay, and the rundown time (transience) of the response. These specific kinetic features are essential for target postsynaptic neurons in the brain in order to effectively decode and interpret signals, thereby forming visual perception. We review recent knowledge regarding circuit elements of the mammalian retina that participate in shaping RGC response transience for optimal visual signaling.

Brain-wide ongoing activity is responsible for significant cross-trial BOLD variability

A notorious issue of task-based functional magnetic resonance imaging (fMRI) is its large cross-trial variability. To quantitatively characterize this variability, the blood oxygenation level-dependent (BOLD) signal can be modeled as a linear summation of a stimulation-relevant and an ongoing (i.e. stimulation-irrelevant) component. However, systematic investigation on the spatiotemporal features of the ongoing BOLD component and how these features affect the BOLD response is still lacking. Here we measured fMRI responses to light onsets and light offsets in awake rats. The neuronal response was simultaneously recorded with calcium-based fiber photometry. We established that between-region BOLD signals were highly correlated brain-wide at zero time lag, including regions that did not respond to visual stimulation, suggesting that the ongoing activity co-fluctuates across the brain. Removing this ongoing activity reduced cross-trial variability of the BOLD response by ~30% and increased its coherence with the Ca2+ signal. Additionally, the negative ongoing BOLD activity sometimes dominated over the stimulation-driven response and contributed to the post-stimulation BOLD undershoot. These results suggest that brain-wide ongoing activity is responsible for significant cross-trial BOLD variability, and this component can be reliably quantified and removed to improve the reliability of fMRI response. Importantly, this method can be generalized to virtually all fMRI experiments without changing stimulation paradigms.

ON and OFF Signaling Pathways in the Retina and the Visual System

Visual processing starts at the retina of the eye, and signals are then transferred primarily to the visual cortex and the tectum. In the retina, multiple neural networks encode different aspects of visual input, such as color and motion. Subsequently, multiple neural streams in parallel convey unique aspects of visual information to cortical and subcortical regions. Bipolar cells, which are the second order neurons of the retina, separate visual signals evoked by light and dark contrasts and encode them to ON and OFF pathways, respectively. The interplay between ON and OFF neural signals is the foundation for visual processing for object contrast which underlies higher order stimulus processing. ON and OFF pathways have been classically thought to signal in a mirror-symmetric manner. However, while these two pathways contribute synergistically to visual perception in some instances, they have pronounced asymmetries suggesting independent operation in other cases. In this review, we summarize the role of the ON-OFF dichotomy in visual signaling, aiming to contribute to the understanding of visual recognition.

From Receptive to Perceptive Fields: Size-Dependent Asymmetries in Both Negative Afterimages and Subcortical On and Off Post-Stimulus Responses

Negative afterimages are perceptual phenomena that occur after physical stimuli disappear from sight. Their origin is linked to transient post-stimulus responses of visual neurons. The receptive fields (RFs) of these subcortical ON- and OFF-center neurons exhibit antagonistic interactions between central and surrounding visual space, resulting in selectivity for stimulus polarity and size. These two features are closely intertwined, yet their relationship to negative afterimage perception remains unknown. Here we tested whether size differentially affects the perception of bright and dark negative afterimages in humans of both sexes, and how this correlates with neural mechanisms in subcortical ON and OFF cells. Psychophysically, we found a size-dependent asymmetry whereby dark disks produce stronger and longer-lasting negative afterimages than bright disks of equal contrast at sizes >0.8°. Neurophysiological recordings from retinal and relay cells in female cat dorsal lateral geniculate nucleus showed that subcortical ON cells exhibited stronger sustained post-stimulus responses to dark disks, than OFF cells to bright disks, at sizes >1°. These sizes agree with the emergence of center-surround antagonism, revealing stronger suppression to opposite-polarity stimuli for OFF versus ON cells, particularly in dorsal lateral geniculate nucleus. Using a network-based retino-geniculate model, we confirmed stronger antagonism and temporal transience for OFF-cell post-stimulus rebound responses. A V1 population model demonstrated that both strength and duration asymmetries can be propagated to downstream cortical areas. Our results demonstrate how size-dependent antagonism impacts both the neuronal post-stimulus response and the resulting afterimage percepts, thereby supporting the idea of perceptual RFs reflecting the underlying neuronal RF organization of single cells.SIGNIFICANCE STATEMENT Visual illusions occur when sensory inputs and perceptual outcomes do not match, and provide a valuable tool to understand transformations from neural to perceptual responses. A classic example are negative afterimages that remain visible after a stimulus is removed from view. Such perceptions are linked to responses in early visual neurons, yet the details remain poorly understood. Combining human psychophysics, neurophysiological recordings in cats and retino-thalamo-cortical computational modeling, our study reveals how stimulus size and the receptive-field structure of subcortical ON and OFF cells contributes to the parallel asymmetries between neural and perceptual responses to bright versus dark afterimages. Thus, this work provides a deeper link from the underlying neural mechanisms to the resultant perceptual outcomes.

Regional Variation of Gap Junctional Connections in the Mammalian Inner Retina

The retinas of many species show regional specialisations that are evident in the differences in the processing of visual input from different parts of the visual field. Regional specialisation is thought to reflect an adaptation to the natural visual environment, optical constraints, and lifestyle of the species. Yet, little is known about regional differences in synaptic circuitry. Here, we were interested in the topographical distribution of connexin-36 (Cx36), the major constituent of electrical synapses in the retina. We compared the retinas of mice, rats, and cats to include species with different patterns of regional specialisations in the analysis. First, we used the density of Prox1-immunoreactive amacrine cells as a marker of any regional specialisation, with higher cell density signifying more central regions. Double-labelling experiments showed that Prox1 is expressed in AII amacrine cells in all three species. Interestingly, large Cx36 plaques were attached to about 8-10% of Prox1-positive amacrine cell somata, suggesting the strong electrical coupling of pairs or small clusters of cell bodies. When analysing the regional changes in the volumetric density of Cx36-immunoreactive plaques, we found a tight correlation with the density of Prox1-expressing amacrine cells in the ON, but not in the OFF sublamina in all three species. The results suggest that the relative contribution of electrical synapses to the ON- and OFF-pathways of the retina changes with retinal location, which may contribute to functional ON/OFF asymmetries across the visual field.

Stimulus Contrast Affects Spatial Integration in the Lateral Geniculate Nucleus of Macaque Monkeys

Gain-control mechanisms adjust neuronal responses to accommodate the wide range of stimulus conditions in the natural environment. Contrast gain control and extraclassical surround suppression are two manifestations of gain control that govern the responses of neurons in the early visual system. Understanding how these two forms of gain control interact has important implications for the detection and discrimination of stimuli across a range of contrast conditions. Here, we report that stimulus contrast affects spatial integration in the lateral geniculate nucleus of alert macaque monkeys (male and female), whereby neurons exhibit a reduction in the strength of extraclassical surround suppression and an expansion in the preferred stimulus size with low-contrast stimuli compared with high-contrast stimuli. Effects were greater for magnocellular neurons than for parvocellular neurons, indicating stream-specific interactions between stimulus contrast and stimulus size. Within the magnocellular pathway, contrast-dependent effects were comparable for ON-center and OFF-center neurons, despite ON neurons having larger receptive fields, less pronounced surround suppression, and more pronounced contrast gain control than OFF neurons. Together, these findings suggest that the parallel streams delivering visual information from retina to primary visual cortex, serve not only to broaden the range of signals delivered to cortex, but also to provide a substrate for differential interactions between stimulus contrast and stimulus size that may serve to improve stimulus detection and stimulus discrimination under pathway-specific lower and higher contrast conditions, respectively.SIGNIFICANCE STATEMENT Stimulus contrast is a salient feature of visual scenes. Here we examine the influence of stimulus contrast on spatial integration in the lateral geniculate nucleus (LGN). Our results demonstrate that increases in contrast generally increase extraclassical suppression and decrease the size of optimal stimuli, indicating a reduction in the extent of visual space from which LGN neurons integrate signals. Differences between magnocellular and parvocellular neurons are noteworthy and further demonstrate that the feedforward parallel pathways to cortex increase the range of information conveyed for downstream cortical processing, a range broadened by diversity in the ON and OFF pathways. These results have important implications for more complex visual processing that underly the detection and discrimination of stimuli under varying natural conditions.

Intraocular Pressure Elevation Compromises Retinal Ganglion Cell Light Adaptation

Purpose

Functional adaptation to ambient light is a key characteristic of retinal ganglion cells (RGCs), but little is known about how adaptation is affected by factors that are harmful to RGC health. We explored adaptation-induced changes to RGC physiology when exposed to increased intraocular pressure (IOP), a major risk factor for glaucoma.

Methods

Wild-type mice of both sexes were subjected to 2 weeks of IOP elevation using the bead model. Retinas were assessed using a multielectrode array to record RGC responses to checkerboard white noise stimulation under both scotopic and photopic light levels. This information was used to calculate a spike-triggered average (STA) for each RGC with which to compare between lighting levels.

Results

Low but not high IOP elevation resulted in several distinct RGC functional changes: (1) diminished adaptation-dependent receptive field (RF) center-surround interactions; (2) increased likelihood of a scotopic STA; and (3) increased spontaneous firing rate. Center RF size change with lighting level varied among RGCs, and both the center and surround STA peak times were consistently increased under scotopic illumination, although none of these properties were impacted by IOP level.

Conclusions

These findings provide novel evidence that RGCs exhibit reduced light-dependent adaptation and increased excitability when IOP is elevated to low but not high levels. These results may reveal functional changes that occur early in glaucoma, which can potentially be used to identify patients with glaucoma at earlier stages when intervention is most beneficial.

OFF-transient alpha RGCs mediate looming triggered innate defensive response

Animals respond to visual threats, such as a looming object, with innate defensive behaviors. Here, we report that a specific type of retinal ganglion cell (RGC), the OFF-transient alpha RGC, is critical for the detection of looming objects. We identified Kcnip2 as its molecular marker. The activity of the Kcnip2-expressing RGCs encodes the size of the looming object. Ablation or suppression of these RGCs abolished or severely impaired the escape and freezing behaviors of mice in response to a looming object, while activation of their somas in the retina, or their axon terminals in the superior colliculus, triggered immediate escape behavior. Our results link the activity of a single type of RGC to visually triggered innate defensive behaviors and underscore that ethologically significant visual information is encoded by a labeled line strategy as early as in the retina.

Inter-mosaic coordination of retinal receptive fields

The output of the retina is organized into many detector grids, called ‘mosaics’ that signal different features of visual scenes to the brain^1–4. Each mosaic comprises a single retinal ganglion cell (RGC) type, whose receptive fields (RFs) tile space. Many mosaics arise as pairs, signaling increments (ON) and decrements (OFF), respectively, of a particular visual feature⁵. Using a model of efficient coding⁶, we determine how such mosaic pairs should be arranged to optimize the encoding of natural scenes. We find that information is maximized when these mosaic pairs are anti-aligned, meaning the RF centers between mosaics are more distant than expected by chance. We test this prediction across multiple RF mosaics acquired with large-scale measurements of RGC light responses from rat and primate. We find that ON and OFF RGC pairs with similar feature selectivity exhibit anti-aligned RF mosaics, consistent with theory. ON and OFF types that encode distinct features exhibit independent mosaics. These results extend efficient coding theory (ECT) beyond individual cells to predict how populations of diverse RGC types are spatially arranged.

Nonlinear Spatial Integration Underlies the Diversity of Retinal Ganglion Cell Responses to Natural Images

How neurons encode natural stimuli is a fundamental question for sensory neuroscience. In the early visual system, standard encoding models assume that neurons linearly filter incoming stimuli through their receptive fields, but artificial stimuli, such as contrast-reversing gratings, often reveal nonlinear spatial processing. We investigated to what extent such nonlinear processing is relevant for the encoding of natural images in retinal ganglion cells in mice of either sex.

How neurons encode natural stimuli is a fundamental question for sensory neuroscience. In the early visual system, standard encoding models assume that neurons linearly filter incoming stimuli through their receptive fields, but artificial stimuli, such as contrast-reversing gratings, often reveal nonlinear spatial processing. We investigated to what extent such nonlinear processing is relevant for the encoding of natural images in retinal ganglion cells in mice of either sex. We found that standard linear receptive field models yielded good predictions of responses to flashed natural images for a subset of cells but failed to capture the spiking activity for many others. Cells with poor model performance displayed pronounced sensitivity to fine spatial contrast and local signal rectification as the dominant nonlinearity. By contrast, sensitivity to high-frequency contrast-reversing gratings, a classical test for nonlinear spatial integration, was not a good predictor of model performance and thus did not capture the variability of nonlinear spatial integration under natural images. In addition, we also observed a class of nonlinear ganglion cells with inverse tuning for spatial contrast, responding more strongly to spatially homogeneous than to spatially structured stimuli. These findings highlight the diversity of receptive field nonlinearities as a crucial component for understanding early sensory encoding in the context of natural stimuli.

SIGNIFICANCE STATEMENT Experiments with artificial visual stimuli have revealed that many types of retinal ganglion cells pool spatial input signals nonlinearly. However, it is still unclear how relevant this nonlinear spatial integration is when the input signals are natural images. Here we analyze retinal responses to natural scenes in large populations of mouse ganglion cells. We show that nonlinear spatial integration strongly influences responses to natural images for some ganglion cells, but not for others. Cells with nonlinear spatial integration were sensitive to spatial structure inside their receptive fields, and a small group of cells displayed a surprising sensitivity to spatially homogeneous stimuli. Traditional analyses with contrast-reversing gratings did not predict this variability of nonlinear spatial integration under natural images.

Ignoring correlated activity causes a failure of retinal population codes

From starlight to sunlight, adaptation alters retinal output, changing both the signal and noise among populations of retinal ganglion cells (RGCs). Here we determine how these light level-dependent changes impact decoding of retinal output, testing the importance of accounting for RGC noise correlations to optimally read out retinal activity. We find that at moonlight conditions, correlated noise is greater and assuming independent noise severely diminishes decoding performance. In fact, assuming independence among a local population of RGCs produces worse decoding than using a single RGC, demonstrating a failure of population codes when correlated noise is substantial and ignored. We generalize these results with a simple model to determine what conditions dictate this failure of population processing. This work elucidates the circumstances in which accounting for noise correlations is necessary to take advantage of population-level codes and shows that sensory adaptation can strongly impact decoding requirements on downstream brain areas.

To see during day and night, the retina adapts to a trillion-fold change in light intensity. The authors show that an accurate read-out of retinal signals over this intensity range requires that brain circuits account for changing noise correlations across populations of retinal neurons.

Functional Specialization of ON and OFF Cortical Pathways for Global-Slow and Local-Fast Vision

Visual information is processed in the cortex by ON and OFF pathways that respond to light and dark stimuli. Responses to darks are stronger, faster, and driven by a larger number of cortical neurons than responses to lights. Here, we demonstrate that these light-dark cortical asymmetries reflect a functional specialization of ON and OFF pathways for different stimulus properties. We show that large long-lasting stimuli drive stronger cortical responses when they are light, whereas small fast stimuli drive stronger cortical responses when they are dark. Moreover, we show that these light-dark asymmetries are preserved under a wide variety of luminance conditions that range from photopic to low mesopic light. Our results suggest that ON and OFF pathways extract different spatiotemporal information from visual scenes, making OFF local-fast signals better suited to maximize visual acuity and ON global-slow signals better suited to guide the eye movements needed for retinal image stabilization.

Global Motion Processing by Populations of Direction-Selective Retinal Ganglion Cells

Simple stimuli have been critical to understanding neural population codes in sensory systems. Yet it remains necessary to determine the extent to which this understanding generalizes to more complex conditions. To examine this problem, we measured how populations of direction-selective ganglion cells (DSGCs) from the retinas of male and female mice respond to a global motion stimulus with its direction and speed changing dynamically. We then examined the encoding and decoding of motion direction in both individual and populations of DSGCs. Individual cells integrated global motion over ∼200 ms, and responses were tuned to direction. However, responses were sparse and broadly tuned, which severely limited decoding performance from small DSGC populations. In contrast, larger populations compensated for response sparsity, enabling decoding with high temporal precision (<100 ms). At these timescales, correlated spiking was minimal and had little impact on decoding performance, unlike results obtained using simpler local motion stimuli decoded over longer timescales. We use these data to define different DSGC population decoding regimes that use or mitigate correlated spiking to achieve high-spatial versus high-temporal resolution.SIGNIFICANCE STATEMENT ON-OFF direction-selective ganglion cells (ooDSGCs) in the mammalian retina are typically thought to signal local motion to the brain. However, several recent studies suggest they may signal global motion. Here we analyze the fidelity of encoding and decoding global motion in a natural scene across large populations of ooDSGCs. We show that large populations of DSGCs are capable of signaling rapid changes in global motion.

Efficient Coding by Midget and Parasol Ganglion Cells in the Human Retina

In humans, midget and parasol ganglion cells account for most of the input from the eyes to the brain. Yet, how they encode visual information is unknown. Here, we perform large-scale multi-electrode array recordings from retinas of treatment-naive patients who underwent enucleation surgery for choroidal malignant melanomas. We identify robust differences in the function of midget and parasol ganglion cells, consistent asymmetries between their ON and OFF types (that signal light increments and decrements, respectively) and divergence in the function of human versus non-human primate retinas. Our computational analyses reveal that the receptive fields of human midget and parasol ganglion cells divide naturalistic movies into adjacent spatiotemporal frequency domains with equal stimulus power, while the asymmetric response functions of their ON and OFF types simultaneously maximize stimulus coverage and information transmission and minimize metabolic cost. Thus, midget and parasol ganglion cells in the human retina efficiently encode our visual environment.

Inhibitory components of retinal bipolar cell receptive fields are differentially modulated by dopamine D1 receptors

During adaptation to an increase in environmental luminance, retinal signaling adjustments are mediated by the neuromodulator dopamine. Retinal dopamine is released with light and can affect center-surround receptive fields, the coupling state between neurons, and inhibitory pathways through inhibitory receptors and neurotransmitter release. While the inhibitory receptive field surround of bipolar cells becomes narrower and weaker during light adaptation, it is unknown how dopamine affects bipolar cell surrounds. If dopamine and light have similar effects, it would suggest that dopamine could be a mechanism for light-adapted changes. We tested the hypothesis that dopamine D1 receptor activation is sufficient to elicit the magnitude of light-adapted reductions in inhibitory bipolar cell surrounds. Surrounds were measured from OFF bipolar cells in dark-adapted mouse retinas while stimulating D1 receptors, which are located on bipolar, horizontal, and inhibitory amacrine cells. The D1 agonist SKF-38393 narrowed and weakened OFF bipolar cell inhibitory receptive fields but not to the same extent as with light adaptation. However, the receptive field surround reductions differed between the glycinergic and GABAergic components of the receptive field. GABAergic inhibitory strength was reduced only at the edges of the surround, while glycinergic inhibitory strength was reduced across the whole receptive field. These results expand the role of retinal dopamine to include modulation of bipolar cell receptive field surrounds. Additionally, our results suggest that D1 receptor pathways may be a mechanism for the light-adapted weakening of glycinergic surround inputs and the furthest wide-field GABAergic inputs to bipolar cells. However, remaining differences between light-adapted and D1 receptor-activated inhibition demonstrate that non-D1 receptor mechanisms are necessary to elicit the full effect of light adaptation on inhibitory surrounds.

Differential sensitivity of the On and Off visual responses to retinal ischemia

Retinal ischemia is a common condition that may lead into vision impairment and blindness. In this study, we evaluated changes separately in On and Off visual responses induced by retinal ischemia. To do this, reversible retinal ischemia was induced in anaesthetized rats by increasing the intraocular pressure until the eye fundus became whitish for either 30 or 60 min. Both electroretinogram (ERG) and multiunit neuronal activity in the superior colliculus (SC) were recorded simultaneously for at least 20 min before, during, and after ischemia. In addition, in normal eyes, intravitreal glycine (Gly) injections were performed to further investigate the mechanisms involved in this process. We found that collicular Off responses were more sensitive to ischemia than On responses. The Off response was the first one to decay at the time ischemia was induced and the last to recover after blood reperfusion. The duration of ischemia also differentially affected both responses. After 30 min of ischemia, 14% of SC recordings failed to recover Off responses. After 1 h of ischemia, the percentage of recordings that failed to recover Off responses increased to 50%. Post-ischemic ERGs remained unaltered in all cases. Intravitreal Gly injections caused suppression of Off responses in the SC. Higher doses caused suppression of both On and Off responses in the SC but with no effect on the ERG at the doses tested. In summary, Off responses were more sensitive than On responses to ischemia suggesting that different mechanisms drive the two types of responses. The recovery of transitory ischemia was not complete in the SC responses whereas the ERG remained unaltered, suggesting that retinal damage produced by ischemia is more prominent in ganglion cells. Our results provide critical information for understanding ischemia repercussions and visual processing in the early visual system.

Asymmetric ON-OFF processing of visual motion cancels variability induced by the structure of natural scenes

Animals detect motion using a variety of visual cues that reflect regularities in the natural world. Experiments in animals across phyla have shown that motion percepts incorporate both pairwise and triplet spatiotemporal correlations that could theoretically benefit motion computation. However, it remains unclear how visual systems assemble these cues to build accurate motion estimates. Here, we used systematic behavioral measurements of fruit fly motion perception to show how flies combine local pairwise and triplet correlations to reduce variability in motion estimates across natural scenes. By generating synthetic images with statistics controlled by maximum entropy distributions, we show that the triplet correlations are useful only when images have light-dark asymmetries that mimic natural ones. This suggests that asymmetric ON-OFF processing is tuned to the particular statistics of natural scenes. Since all animals encounter the world's light-dark asymmetries, many visual systems are likely to use asymmetric ON-OFF processing to improve motion estimation.

Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina

The functions of the diverse retinal ganglion cell types in primates and the parallel visual pathways they initiate remain poorly understood. Here, unusual physiological and computational properties of the ON and OFF smooth monostratified ganglion cells are explored. Large-scale multi-electrode recordings from 48 macaque retinas revealed that these cells exhibit irregular receptive field structure composed of spatially segregated hotspots, quite different from the classic center-surround model of retinal receptive fields. Surprisingly, visual stimulation of different hotspots in the same cell produced spikes with subtly different spatiotemporal voltage signatures, consistent with a dendritic contribution to hotspot structure. Targeted visual stimulation and computational inference demonstrated strong nonlinear subunit properties associated with each hotspot, supporting a model in which the hotspots apply nonlinearities at a larger spatial scale than bipolar cells. These findings reveal a previously unreported nonlinear mechanism in the output of the primate retina that contributes to signaling spatial information.

Non-parametric Physiological Classification of Retinal Ganglion Cells in the Mouse Retina

Retinal ganglion cells, the sole output neurons of the retina, exhibit surprising diversity. A recent study reported over 30 distinct types in the mouse retina, indicating that the processing of visual information is highly parallelised in the brain. The advent of high density multi-electrode arrays now enables recording from many hundreds to thousands of neurons from a single retina. Here we describe a method for the automatic classification of large-scale retinal recordings using a simple stimulus paradigm and a spike train distance measure as a clustering metric. We evaluate our approach using synthetic spike trains, and demonstrate that major known cell types are identified in high-density recording sessions from the mouse retina with around 1,000 retinal ganglion cells. A comparison across different retinas reveals substantial variability between preparations, suggesting pooling data across retinas should be approached with caution. As a parameter-free method, our approach is broadly applicable for cellular physiological classification in all sensory modalities.