Retinal processing near absolute threshold: from behavior to mechanism

Ancient origin of the rod bipolar cell pathway in the vertebrate retina

Vertebrates rely on rod photoreceptors for vision in low-light conditions. The specialized downstream circuit for rod signalling, called the primary rod pathway, is well characterized in mammals, but circuitry for rod signalling in non-mammals is largely unknown. Here we demonstrate that the mammalian primary rod pathway is conserved in zebrafish, which diverged from extant mammals ~400 million years ago. Using single-cell RNA sequencing, we identified two bipolar cell types in zebrafish that are related to mammalian rod bipolar cell (RBCs), the only bipolar type that directly carries rod signals from the outer to the inner retina in the primary rod pathway. By combining electrophysiology, histology and ultrastructural reconstruction of the zebrafish RBCs, we found that, similar to mammalian RBCs, both zebrafish RBC types connect with all rods in their dendritic territory and provide output largely onto amacrine cells. The wiring pattern of the amacrine cells postsynaptic to one RBC type is strikingly similar to that of mammalian RBCs and their amacrine partners, suggesting that the cell types and circuit design of the primary rod pathway emerged before the divergence of teleost fish and mammals. The second RBC type, which forms separate pathways, was either lost in mammals or emerged in fish.

Primate retina trades single-photon detection for high-fidelity contrast encoding

How the spike output of the retina enables human visual perception is not fully understood. Here, we address this at the sensitivity limit of vision by correlating human visual perception with the spike outputs of primate ON and OFF parasol (magnocellular) retinal ganglion cells in tightly matching stimulus conditions. We show that human vision at its ultimate sensitivity limit depends on the spike output of the ON but not the OFF retinal pathway. Consequently, nonlinear signal processing in the retinal ON pathway precludes perceptual detection of single photons in darkness but enables quantal-resolution discrimination of differences in light intensity.

Genetic manipulation of rod-cone differences in mouse retina

Though rod and cone photoreceptors use similar phototransduction mechanisms, previous model calculations have indicated that the most important differences in their light responses are likely to be differences in amplification of the G-protein cascade, different decay rates of phosphodiesterase (PDE) and pigment phosphorylation, and different rates of turnover of cGMP in darkness. To test this hypothesis, we constructed TrUx;GapOx rods by crossing mice with decreased transduction gain from decreased transducin expression, with mice displaying an increased rate of PDE decay from increased expression of GTPase-activating proteins (GAPs). These two manipulations brought the sensitivity of TrUx;GapOx rods to within a factor of 2 of WT cone sensitivity, after correcting for outer-segment dimensions. These alterations did not, however, change photoreceptor adaptation: rods continued to show increment saturation though at a higher background intensity. These experiments confirm model calculations that rod responses can mimic some (though not all) of the features of cone responses after only a few changes in the properties of transduction proteins.

Convergent mechanism underlying the acquisition of vertebrate scotopic vision

High sensitivity of scotopic vision (vision in dim light conditions) is achieved by the rods' low background noise, which is attributed to a much lower thermal activation rate (kth) of rhodopsin compared with cone pigments. Frogs and nocturnal geckos uniquely possess atypical rods containing noncanonical cone pigments that exhibit low kth, mimicking rhodopsin. Here, we investigated the convergent mechanism underlying the low kth of rhodopsins and noncanonical cone pigments. Our biochemical analysis revealed that the kth of canonical cone pigments depends on their absorption maximum (λmax). However, rhodopsin and noncanonical cone pigments showed a substantially lower kth than predicted from the λmax dependency. Given that the λmax is inversely proportional to the activation energy of the pigments in the Hinshelwood distribution-based model, our findings suggest that rhodopsin and noncanonical cone pigments have convergently acquired low frequency of spontaneous-activation attempts, including thermal fluctuations of the protein moiety, in the molecular evolutionary processes from canonical cone pigments, which contributes to highly sensitive scotopic vision.

Origin of Discrete and Continuous Dark Noise in Rod Photoreceptors

The detection of a single photon by a rod photoreceptor is limited by two sources of physiological noise, called discrete and continuous noise. Discrete noise occurs as intermittent current deflections with a waveform very similar to that of the single-photon response to real light and is thought to be produced by spontaneous activation of rhodopsin. Continuous noise occurs as random and continuous fluctuations in outer-segment current and is usually attributed to some intermediate in the phototransduction cascade. To confirm the origin of these noise sources, we have recorded from retinas of mouse lines with rods having reduced levels of rhodopsin, transducin, or phosphodiesterase. We show that the rate of discrete noise is diminished in proportion to the decrease in rhodopsin concentration, and that continuous noise is independent of transducin concentration but clearly elevated when the level of phosphodiesterase is reduced. Our experiments provide new molecular evidence that discrete noise is indeed produced by rhodopsin itself, and that continuous noise is generated by spontaneous activation of phosphodiesterase resulting in random fluctuations in outer-segment current.

Ancient origin of the rod bipolar cell pathway in the vertebrate retina

Vertebrates rely on rod photoreceptors for vision in low-light conditions1. Mammals have a specialized downstream circuit for rod signaling called the primary rod pathway, which comprises specific cell types and wiring patterns that are thought to be unique to this lineage2-6. Thus, it has been long assumed that the primary rod pathway evolved in mammals3,5-7. Here, we challenge this view by demonstrating that the mammalian primary rod pathway is conserved in zebrafish, which diverged from extant mammals ~400 million years ago. Using single-cell RNA-sequencing, we identified two bipolar cell (BC) types in zebrafish that are related to mammalian rod BCs (RBCs) of the primary rod pathway. By combining electrophysiology, histology, and ultrastructural reconstruction of the zebrafish RBCs, we found that, like mammalian RBCs8, both zebrafish RBC types connect with all rods and red-cones in their dendritic territory, and provide output largely onto amacrine cells. The wiring pattern of the amacrine cells post-synaptic to one RBC type is strikingly similar to that of mammalian RBCs. This suggests that the cell types and circuit design of the primary rod pathway may have emerged before the divergence of teleost fish and amniotes (mammals, bird, reptiles). The second RBC type in zebrafish, which forms separate pathways from the first RBC type, is either lost in mammals or emerged in fish to serve yet unknown roles.

Rabconnectin-3α/DMXL2 Is Locally Enriched at the Synaptic Ribbon of Rod Photoreceptor Synapses

Ribbon synapses reliably transmit synaptic signals over a broad signalling range. Rod photoreceptor ribbon synapses are capable of transmitting signals generated by the absorption of single photons. The high precision of ribbon synapses emphasizes the need for particularly efficient signalling mechanisms. Synaptic ribbons are presynaptic specializations of ribbon synapses and are anchored to the active zone. Synaptic ribbons bind many synaptic vesicles that are delivered to the active zone for continuous and faithful signalling. In the present study we demonstrate with independent antibodies at the light- and electron microscopic level that rabconnectin-3α (RC3α)-alternative name Dmx-like 2 (DMXL2)-is localized to the synaptic ribbons of rod photoreceptor synapses in the mouse retina. In the brain, RC3α-containing complexes are known to interact with important components of synaptic vesicles, including Rab3-activating/inactivating enzymes, priming proteins and the vesicular H⁺-ATPase that acidifies the synaptic vesicle lumen to promote full neurotransmitter loading. The association of RC3α/DMXL2 with rod synaptic ribbons of the mouse retina could enable these structures to deliver only fully signalling-competent synaptic vesicles to the active zone thus contributing to reliable synaptic communication.

Functional integrity of visual coding following advanced photoreceptor degeneration

Photoreceptor degeneration sufficient to produce severe visual loss often spares the inner retina. This raises hope for vision restoration treatments using optogenetics or electrical stimulation, which generate a replacement light input signal in surviving neurons. The success of these approaches is dependent on the capacity of surviving circuits of the visual system to generate and propagate an appropriate visual code in the face of neuroanatomical remodeling. To determine whether retinally degenerate animals possess this capacity, we generated a transgenic mouse model expressing the optogenetic actuator ReaChR in ON bipolar cells (second-order neurons in the visual projection). After crossing this with the rd1 model of photoreceptor degeneration, we compared ReaChR-derived responses with photoreceptor-driven responses in wild-type (WT) mice at the level of retinal ganglion cells and the visual thalamus. The ReaChR-driven responses in rd1 animals showed low photosensitivity, but in other respects generated a visual code that was very similar to the WT. ReaChR rd1 responses had high trial-to-trial reproducibility and showed sensitivity normalization to code contrast across background intensities. At the single unit level, ReaChR-derived responses exhibited broadly similar variations in response polarity, contrast sensitivity, and temporal frequency tuning as the WT. Units from the WT and ReaChR rd1 mice clustered together when subjected to unsupervised community detection based on stimulus-response properties. Our data reveal an impressive ability for surviving circuitry to recreate a rich visual code following advanced retinal degeneration and are promising for regenerative medicine in the central nervous system.

Homeostatic plasticity in the retina

Vision begins in the retina, whose intricate neural circuits extract salient features of the environment from the light entering our eyes. Neurodegenerative diseases of the retina (e.g., inherited retinal degenerations, age-related macular degeneration, and glaucoma) impair vision and cause blindness in a growing number of people worldwide. Increasing evidence indicates that homeostatic plasticity (i.e., the drive of a neural system to stabilize its function) can, in principle, preserve retinal function in the face of major perturbations, including neurodegeneration. Here, we review the circumstances and events that trigger homeostatic plasticity in the retina during development, sensory experience, and disease. We discuss the diverse mechanisms that cooperate to compensate and the set points and outcomes that homeostatic retinal plasticity stabilizes. Finally, we summarize the opportunities and challenges for unlocking the therapeutic potential of homeostatic plasticity. Homeostatic plasticity is fundamental to understanding retinal development and function and could be an important tool in the fight to preserve and restore vision.

Vision: Life on the dark side

Mice detect decreases in illumination in dim light near the visual threshold with OFF retinal ganglion cells.

Retinal OFF ganglion cells allow detection of quantal shadows at starlight

Perception of light in darkness requires no more than a handful of photons, and this remarkable behavioral performance can be directly linked to a particular retinal circuit-the retinal ON pathway. However, the neural limits of shadow detection in very dim light have remained unresolved. Here, we unravel the neural mechanisms that determine the sensitivity of mice (CBA/CaJ) to light decrements at the lowest light levels by measuring signals from the most sensitive ON and OFF retinal ganglion cell types and by correlating their signals with visually guided behavior. We show that mice can detect shadows when only a few photon absorptions are missing among thousands of rods. Behavioral detection of such "quantal" shadows relies on the retinal OFF pathway and is limited by noise and loss of single-photon signals in retinal processing. Thus, in the dim-light regime, light increments and decrements are encoded separately via the ON and OFF retinal pathways, respectively.

Genetic elimination of rod/cone coupling reveals the contribution of the secondary rod pathway to the retinal output

In the retina, signals originating from rod and cone photoreceptors can reach retinal ganglion cells (RGCs)-the output neurons-through different pathways. However, little is known about the exact sensitivities and operating ranges of these pathways. Previously, we created rod- or cone-specific Cx36 knockout (KO) mouse lines. Both lines are deficient in rod/cone electrical coupling and therefore provide a way to selectively remove the secondary rod pathway. We measured the threshold of the primary rod pathway in RGCs of wild-type mice. Under pharmacological blockade of the primary rod pathway, the threshold was elevated. This secondary component was removed in the Cx36 KOs to unmask the threshold of the third rod pathway, still below cone threshold. In turn, the cone threshold was estimated by several independent methods. Our work defines the functionality of the secondary rod pathway and describes an additive contribution of the different pathways to the retinal output.

Fiddler crab electroretinograms reveal vast circadian shifts in visual sensitivity and temporal summation in dim light

Many animals with compound eyes undergo major optical changes to adjust visual sensitivity from day to night, often under control of a circadian clock. In fiddler crabs, this presents most conspicuously in the huge volume increase of photopigment-packed rhabdoms and the widening of crystalline cone apertures at night. These changes are hypothesised to adjust the light flux to the photoreceptors and to alter optical sensitivity as the eye moves between light- and dark-adapted states. Here, we compare optical sensitivity in fiddler crab eyes (Gelasimus dampieri) during daytime and night via three electroretinogram (ERG) experiments performed on light- and dark-adapted crabs.

1) Light intensity required to elicit a threshold ERG response varied over six orders of magnitude, allowing more sensitive vision for discriminating small contrasts in dim light after dusk. During daytime, the eyes remained relatively insensitive, which would allow effective vision on bright mudflats, even after prolonged dark adaptation.

2) Flicker fusion frequency (FFF) experiments indicated that temporal summation is employed in dim light to increase light-gathering integration times and enhance visual sensitivity during both night and day.

3) ERG responses to flickering lights during 60 mins of dark adaptation increased at a faster rate and greater extent after sunset compared to daytime. However, even brief, dim and intermittent light exposure strongly disrupted dark-adaptation processes.

Together, these findings demonstrate effective light adaptation to optimise vision over the large range of light intensities that these animals experience.

Real models: The limits of behavioural evidence for understanding the ANS

Clarke and Beck use behavioural evidence to argue that (1) approximate ratio computations are sufficient for claiming that the approximate number system (ANS) represents the rationals, and (2) the ANS does not represent the reals. We argue that pure behaviour is a poor litmus test for this problem, and that we should trust the psychophysical models that place ANS representations within the reals.

Evolutionary adaptation of visual pigments in geckos for their photic environment

Vertebrates generally have a single type of rod for scotopic vision and multiple types of cones for photopic vision. Noteworthily, nocturnal geckos transmuted ancestral photoreceptor cells into rods containing not rhodopsin but cone pigments, and, subsequently, diurnal geckos retransmuted these rods into cones containing cone pigments. High sensitivity of scotopic vision is underlain by the rod’s low background noise, which originated from a much lower spontaneous activation rate of rhodopsin than of cone pigments. Here, we revealed that nocturnal gecko cone pigments decreased their spontaneous activation rates to mimic rhodopsin, whereas diurnal gecko cone pigments recovered high rates similar to those of typical cone pigments. We also identified amino acid residues responsible for the alterations of the spontaneous activation rates. Therefore, we concluded that the switch between diurnality and nocturnality in geckos required not only morphological transmutation of photoreceptors but also adjustment of the spontaneous activation rates of visual pigments.

Temporal vision: measures, mechanisms and meaning

Time is largely a hidden variable in vision. It is the condition for seeing interesting things such as spatial forms and patterns, colours and movements in the external world, and yet is not meant to be noticed in itself. Temporal aspects of visual processing have received comparatively little attention in research. Temporal properties have been made explicit mainly in measurements of resolution and integration in simple tasks such as detection of spatially homogeneous flicker or light pulses of varying duration. Only through a mechanistic understanding of their basis in retinal photoreceptors and circuits can such measures guide modelling of natural vision in different species and illuminate functional and evolutionary trade-offs. Temporal vision research would benefit from bridging traditions that speak different languages. Towards that goal, I here review studies from the fields of human psychophysics, retinal physiology and neuroethology, with a focus on fundamental constraints set by early vision.

Summary: Simple measures of temporal vision such as the critical flicker frequency can be useful for modelling natural vision only if their relationship to photoreceptor responses and retinal processing is understood.

Rod and Cone Connections With Bipolar Cells in the Rabbit Retina

Rod and cone pathways are segregated in the first stage of the retina: cones synapse with both ON- and OFF-cone bipolar cells while rods contact only rod bipolar cells. However, there is an exception to this specific wiring in that rods also contact certain OFF cone bipolar cells, providing a tertiary rod pathway. Recently, it has been proposed that there is even more crossover between rod and cone pathways. Physiological recordings suggested that rod bipolar cells receive input from cones, and ON cone bipolar cells can receive input from rods, in addition to the established pathways. To image their rod and cone contacts, we have dye-filled individual rod bipolar cells in the rabbit retina. We report that approximately half the rod bipolar cells receive one or two cone contacts. Dye-filling AII amacrine cells, combined with subtractive labeling, revealed most of the ON cone bipolar cells to which they were coupled, including the occasional blue cone bipolar cell, identified by its contacts with blue cones. Imaging the AII-coupled ON cone bipolar dendrites in this way showed that they contact cones exclusively. We conclude that there is some limited cone input to rod bipolar cells, but we could find no evidence for rod contacts with ON cone bipolar cells. The tertiary rod OFF pathway operates via direct contacts between rods and OFF cone bipolar cells. In contrast, our results do not support the presence of a tertiary rod ON pathway in the rabbit retina.

GABAA presynaptic inhibition regulates the gain and kinetics of retinal output neurons

Output signals of neural circuits, including the retina, are shaped by a combination of excitatory and inhibitory signals. Inhibitory signals can act presynaptically on axon terminals to control neurotransmitter release and regulate circuit function. However, it has been difficult to study the role of presynaptic inhibition in most neural circuits due to lack of cell type-specific and receptor type-specific perturbations. In this study, we used a transgenic approach to selectively eliminate GABA_A inhibitory receptors from select types of second-order neurons - bipolar cells - in mouse retina and examined how this affects the light response properties of the well-characterized ON alpha ganglion cell retinal circuit. Selective loss of GABA_A receptor-mediated presynaptic inhibition causes an enhanced sensitivity and slower kinetics of light-evoked responses from ON alpha ganglion cells thus highlighting the role of presynaptic inhibition in gain control and temporal filtering of sensory signals in a key neural circuit in the mammalian retina.

Threshold vision under full-field stimulation: Revisiting the minimum number of quanta necessary to evoke a visual sensation

At the absolute threshold of vision, Hecht, Shlaer and Pirenne estimate that 5-14 photons are absorbed within a retinal area containing ~500 rods. Other estimates of scotopic threshold vision based on stimuli with different durations and focal areas range up to ~100,000 photons. Given that rod density varies with retinal eccentricity and the magnitude of the intrinsic noise increases with increasing stimulus area and duration, here we determine whether the scotopic threshold estimates with focal stimuli can be extended to full-field stimulation and whether summation explains inter-study differences. We show that full-field threshold vision (~1018 mm², 10 ms duration) is more sensitive than at absolute threshold, requiring the absorption of ~1000 photons across ~91.96 million rods. A summation model is presented integrating our and published data and using a nominal exposure duration, criterion frequency of seeing, rod density, and retinal area that largely explains the inter-study differences and allows estimation of rods per photon ratio for any stimulus size and duration. The highest signal to noise ratio is defined by a peak rod convergence estimated at 53:4:1:2 (rods:rod bipolar cells:AII amacrine cells:retinal ganglion cells), in line with macaque anatomical estimates that show AII amacrine cells form the bottleneck in the rod pathway to set the scotopic visual limit. Our model estimations that the rods per photon ratio under full-field stimulation is ~3000X higher than at absolute threshold are in accordance with visual summation effects and provide an alternative approach for understanding the limits of scotopic vision.

Fovea-like Photoreceptor Specializations Underlie Single UV Cone Driven Prey-Capture Behavior in Zebrafish

In the eye, the function of same-type photoreceptors must be regionally adjusted to process a highly asymmetrical natural visual world. Here, we show that UV cones in the larval zebrafish area temporalis are specifically tuned for UV-bright prey capture in their upper frontal visual field, which may use the signal from a single cone at a time. For this, UV-photon detection probability is regionally boosted more than 10-fold. Next, in vivo two-photon imaging, transcriptomics, and computational modeling reveal that these cones use an elevated baseline of synaptic calcium to facilitate the encoding of bright objects, which in turn results from expressional tuning of phototransduction genes. Moreover, the light-driven synaptic calcium signal is regionally slowed by interactions with horizontal cells and later accentuated at the level of glutamate release driving retinal networks. These regional differences tally with variations between peripheral and foveal cones in primates and hint at a common mechanistic origin.

Molecular and functional architecture of the mouse photoreceptor network

Mouse photoreceptors are electrically coupled via gap junctions, but the relative importance of rod/rod, cone/cone, or rod/cone coupling is unknown. Furthermore, while connexin36 (Cx36) is expressed by cones, the identity of the rod connexin has been controversial. We report that FACS-sorted rods and cones both express Cx36 but no other connexins. We created rod- and cone-specific Cx36 knockout mice to dissect the photoreceptor network. In the wild type, Cx36 plaques at rod/cone contacts accounted for more than 95% of photoreceptor labeling and paired recordings showed the transjunctional conductance between rods and cones was ~300 pS. When Cx36 was eliminated on one side of the gap junction, in either conditional knockout, Cx36 labeling and rod/cone coupling were almost abolished. We could not detect direct rod/rod coupling, and cone/cone coupling was minor. Rod/cone coupling is so prevalent that indirect rod/cone/rod coupling via the network may account for previous reports of rod coupling.

Connectomic analysis reveals an interneuron with an integral role in the retinal circuit for night vision

Night vision in mammals depends fundamentally on rod photoreceptors and the well-studied rod bipolar (RB) cell pathway. The central neuron in this pathway, the AII amacrine cell (AC), exhibits a spatially tuned receptive field, composed of an excitatory center and an inhibitory surround, that propagates to ganglion cells, the retina's projection neurons. The circuitry underlying the surround of the AII, however, remains unresolved. Here, we combined structural, functional and optogenetic analyses of the mouse retina to discover that surround inhibition of the AII depends primarily on a single interneuron type, the NOS-1 AC: a multistratified, axon-bearing GABAergic cell, with dendrites in both ON and OFF synaptic layers, but with a pure ON (depolarizing) response to light. Our study demonstrates generally that novel neural circuits can be identified from targeted connectomic analyses and specifically that the NOS-1 AC mediates long-range inhibition during night vision and is a major element of the RB pathway.

Retinal Circuits for Seeing in the Dark

How can we relate processing in the retina to an animal's behavior? In this issue of Neuron, Smeds et al. (2019) report that when "every photon counts," mice trade sensitivity for reliability to master visual tasks.

Sensory Processing at Ribbon Synapses in the Retina and the Cochlea

In recent years, sensory neuroscientists have made major efforts to dissect the structure and function of ribbon synapses which process sensory information in the eye and ear. This review aims to summarize our current understanding of two key aspects of ribbon synapses: 1) their mechanisms of exocytosis and endocytosis and 2) their molecular anatomy and physiology. Our comparison of ribbon synapses in the cochlea and the retina reveals convergent signaling mechanisms, as well as divergent strategies in different sensory systems.

Local, nonlinear effects of cGMP and Ca2+ reduce single photon response variability in retinal rods

The single photon response (SPR) in vertebrate photoreceptors is inherently variable due to several stochastic events in the phototransduction cascade, the main one being the shutoff of photoactivated rhodopsin. Deactivation is driven by a random number of steps, each of random duration with final quenching occurring after a random delay. Nevertheless, variability of the SPR is relatively low, making the signal highly reliable. Several biophysical and mathematical mechanisms contributing to variability suppression have been examined by the authors. Here we investigate the contribution of local depletion of cGMP by PDE*, the non linear dependence of the photocurrent on cGMP, Ca²⁺ feedback by making use of a fully space resolved (FSR) mathematical model, applied to two species (mouse and salamander), by varying the cGMP diffusion rate severalfold and rod outer segment diameter by an order of magnitude, and by introducing new, more refined, and time dependent variability functionals. Globally well stirred (GWS) models, and to a lesser extent transversally well stirred models (TWS), underestimate the role of nonlinearities and local cGMP depletion in quenching the variability of the circulating current with respect to fully space resolved models (FSR). These distortions minimize the true extent to which SPR is stabilized by locality in cGMP depletion, nonlinear effects linking cGMP to current, and Ca²⁺ feedback arising from the physical separation of E* from the ion channels located on the outer shell, and the diffusion of these second messengers in the cytoplasm.

AMIGO2 Scales Dendrite Arbors in the Retina

The size of dendrite arbors shapes their function and differs vastly between neuron types. The signals that control dendritic arbor size remain obscure. Here, we find that in the retina, starburst amacrine cells (SACs) and rod bipolar cells (RBCs) express the homophilic cell-surface protein AMIGO2. In Amigo2 knockout (KO) mice, SAC and RBC dendrites expand while arbors of other retinal neurons remain stable. SAC dendrites are divided into a central input region and a peripheral output region that provides asymmetric inhibition to direction-selective ganglion cells (DSGCs). Input and output compartments scale precisely with increased arbor size in Amigo2 KO mice, and SAC dendrites maintain asymmetric connectivity with DSGCs. Increased coverage of SAC dendrites is accompanied by increased direction selectivity of DSGCs without changes to other ganglion cells. Our results identify AMIGO2 as a cell-type-specific dendritic scaling factor and link dendrite size and coverage to visual feature detection.

Paradoxical Rules of Spike Train Decoding Revealed at the Sensitivity Limit of Vision

All sensory information is encoded in neural spike trains. It is unknown how the brain utilizes this neural code to drive behavior. Here, we unravel the decoding rules of the brain at the most elementary level by linking behavioral decisions to retinal output signals in a single-photon detection task. A transgenic mouse line allowed us to separate the two primary retinal outputs, ON and OFF pathways, carrying information about photon absorptions as increases and decreases in spiking, respectively. We measured the sensitivity limit of rods and the most sensitive ON and OFF ganglion cells and correlated these results with visually guided behavior using markerless head and eye tracking. We show that behavior relies only on the ON pathway even when the OFF pathway would allow higher sensitivity. Paradoxically, behavior does not rely on the spike code with maximal information but instead relies on a decoding strategy based on increases in spiking.

Diverse Cell Types, Circuits, and Mechanisms for Color Vision in the Vertebrate Retina

Synaptic interactions to extract information about wavelength, and thus color, begin in the vertebrate retina with three classes of light-sensitive cells: rod photoreceptors at low light levels, multiple types of cone photoreceptors that vary in spectral sensitivity, and intrinsically photosensitive ganglion cells that contain the photopigment melanopsin. When isolated from its neighbors, a photoreceptor confounds photon flux with wavelength and so by itself provides no information about color. The retina has evolved elaborate color opponent circuitry for extracting wavelength information by comparing the activities of different photoreceptor types broadly tuned to different parts of the visible spectrum. We review studies concerning the circuit mechanisms mediating opponent interactions in a range of species, from tetrachromatic fish with diverse color opponent cell types to common dichromatic mammals where cone opponency is restricted to a subset of specialized circuits. Distinct among mammals, primates have reinvented trichromatic color vision using novel strategies to incorporate evolution of an additional photopigment gene into the foveal structure and circuitry that supports high-resolution vision. Color vision is absent at scotopic light levels when only rods are active, but rods interact with cone signals to influence color perception at mesopic light levels. Recent evidence suggests melanopsin-mediated signals, which have been identified as a substrate for setting circadian rhythms, may also influence color perception. We consider circuits that may mediate these interactions. While cone opponency is a relatively simple neural computation, it has been implemented in vertebrates by diverse neural mechanisms that are not yet fully understood.

Dopaminergic modulation of retinal processing from starlight to sunlight

Neuromodulators such as dopamine, enable context-dependent plasticity of neural circuit function throughout the central nervous system. For example, in the retina, dopamine tunes visual processing for daylight and nightlight conditions. Specifically, high levels of dopamine release in the retina tune vision for daylight (photopic) conditions, while low levels tune it for nightlight (scotopic) conditions. This review covers the cellular and circuit-level mechanisms within the retina that are altered by dopamine. These mechanisms include changes in gap junction coupling and ionic conductances, both of which are altered by the activation of diverse types of dopamine receptors across diverse types of retinal neurons. We contextualize the modulatory actions of dopamine in terms of alterations and optimizations to visual processing under photopic and scotopic conditions, with particular attention to how they differentially impact distinct cell types. Finally, we discuss how transgenic mice and disease models have shaped our understanding of dopaminergic signaling and its role in visual processing. Cumulatively, this review illustrates some of the diverse and potent mechanisms through which neuromodulation can shape brain function.

Probing Computation in the Primate Visual System at Single-Cone Resolution

Daylight vision begins when light activates cone photoreceptors in the retina, creating spatial patterns of neural activity. These cone signals are then combined and processed in downstream neural circuits, ultimately producing visual perception. Recent technical advances have made it possible to deliver visual stimuli to the retina that probe this processing by the visual system at its elementary resolution of individual cones. Physiological recordings from nonhuman primate retinas reveal the spatial organization of cone signals in retinal ganglion cells, including how signals from cones of different types are combined to support both spatial and color vision. Psychophysical experiments with human subjects characterize the visual sensations evoked by stimulating a single cone, including the perception of color. Future combined physiological and psychophysical experiments focusing on probing the elementary visual inputs are likely to clarify how neural processing generates our perception of the visual world.

Temporal resolution of single-photon responses in primate rod photoreceptors and limits imposed by cellular noise

Sensory receptor noise corrupts sensory signals, contributing to imperfect perception and dictating central processing strategies. For example, noise in rod phototransduction limits our ability to detect light, and minimizing the impact of this noise requires precisely tuned nonlinear processing by the retina. But detection sensitivity is only one aspect of night vision: prompt and accurate behavior also requires that rods reliably encode the timing of photon arrivals. We show here that the temporal resolution of responses of primate rods is much finer than the duration of the light response and identify the key limiting sources of transduction noise. We also find that the thermal activation rate of rhodopsin is lower than previous estimates, implying that other noise sources are more important than previously appreciated. A model of rod single-photon responses reveals that the limiting noise relevant for behavior depends critically on how rod signals are pooled by downstream neurons. NEW & NOTEWORTHY Many studies have focused on the visual system's ability to detect photons, but not on its ability to encode the relative timing of detected photons. Timing is essential for computations such as determining the velocity of moving objects. Here we examine the timing precision of primate rod photoreceptor responses and show that it is more precise than previously appreciated. This motivates an evaluation of whether scotopic vision approaches limits imposed by rod temporal resolution.

Range, routing and kinetics of rod signaling in primate retina

Stimulus- or context-dependent routing of neural signals through parallel pathways can permit flexible processing of diverse inputs. For example, work in mouse shows that rod photoreceptor signals are routed through several retinal pathways, each specialized for different light levels. This light-level-dependent routing of rod signals has been invoked to explain several human perceptual results, but it has not been tested in primate retina. Here, we show, surprisingly, that rod signals traverse the primate retina almost exclusively through a single pathway – the dedicated rod bipolar pathway. Identical experiments in mouse and primate reveal substantial differences in how rod signals traverse the retina. These results require reevaluating human perceptual results in terms of flexible computation within this single pathway. This includes a prominent speeding of rod signals with light level – which we show is inherited directly from the rod photoreceptors themselves rather than from different pathways with distinct kinetics.

Parallel Processing of Rod and Cone Signals: Retinal Function and Human Perception

We know a good deal about the operation of the retina when either rod or cone photoreceptors provide the dominant input (i.e., under very dim or very bright conditions). However, we know much less about how the retina operates when rods and cones are coactive (i.e., under intermediate lighting conditions, such as dusk). Such mesopic conditions span 20-30% of the light levels over which vision operates and encompass many situations in which vision is essential (e.g., driving at night). These lighting conditions are challenging because rod and cone signals differ substantially: Rod responses are nearing saturation, while cone responses are weak and noisy. A rich history of perceptual studies guides our investigation of how the retina operates under mesopic conditions and in doing so provides a powerful opportunity to link general issues about parallel processing in neural circuits with computation and perception. We review some of the successes and challenges in understanding the retinal basis of perceptual rod-cone interactions.

The discovery of the ability of rod photoreceptors to signal single photons

A retrospective on the scientific importance and impact of Hecht, Shlaer, and Pirenne’s classic 1942 paper, “Energy, Quanta, and Vision.”

Vertebrate rod photoreceptors evolved the astonishing ability to respond reliably to single photons. In parallel, the proximate neurons of the visual system evolved the ability to reliably encode information from a few single-photon responses (SPRs) as arising from the presence of an object of interest in the visual environment. These amazing capabilities were first inferred from measurements of human visual threshold by Hecht et al. (1942), whose paper has since been cited over 1,000 times. Subsequent research, in part inspired by Hecht et al.’s discovery, has directly measured rod SPRs, characterized the molecular mechanism responsible for their generation, and uncovered much about the specializations in the retina that enable the reliable transmission of SPRs in the teeth of intrinsic neuronal noise.

Electrical coupling between A17 cells enhances reciprocal inhibitory feedback to rod bipolar cells

A17 amacrine cells are an important part of the scotopic pathway. Their synaptic varicosities receive glutamatergic inputs from rod bipolar cells (RBC) and release GABA onto the same RBC terminal, forming a reciprocal feedback that shapes RBC depolarization. Here, using patch-clamp recordings, we characterized electrical coupling between A17 cells of the rat retina and report the presence of strongly interconnected and non-coupled A17 cells. In coupled A17 cells, evoked currents preferentially flow out of the cell through GJs and cross-synchronization of presynaptic signals in a pair of A17 cells is correlated to their coupling degree. Moreover, we demonstrate that stimulation of one A17 cell can induce electrical and calcium transients in neighboring A17 cells, thus confirming a functional flow of information through electrical synapses in the A17 coupled network. Finally, blocking GJs caused a strong decrease in the amplitude of the inhibitory feedback onto RBCs. We therefore propose that electrical coupling between A17 cells enhances feedback onto RBCs by synchronizing and facilitating GABA release from inhibitory varicosities surrounding each RBC axon terminal. GJs between A17 cells are therefore critical in shaping the visual flow through the scotopic pathway.

Endogenous spontaneous ultraweak photon emission in the formation of eye-specific retinogeniculate projections before birth

In 1963, it was suggested [Sperry, R.W. (1963). Chemoaffinity in the orderly growth of nerve fiber patterns and connections. Proc. Natl. Acad. Sci. USA 50, 703-710.] that molecular cues can direct the development of orderly connections between the eye and the brain (the "chemoaffinity hypothesis"). In the same year, the amazing degree of functional accuracy of the visual pathway in the absence of any external light/photon perception prior to birth [Wiesel, T.N and Hubel, D.H. (1963). Single-cell responses in striate cortex of kittens deprived of vision in one eye. J. Neurophysiol. 26, 1003-1017.] was discovered. These recognitions revealed that the wiring of the visual system relies on innate cues. However, how the eye-specific retinogeniculate pathway can be developed before birth without any visual experience is still an unresolved issue. In the present paper, we suggest that Müller cells (functioning as optical fibers), Müller cell cone (i.e. the inner half of the foveola that is created of an inverted cone-shaped zone of Müller cells), discrete retinal noise of rods, and intrinsically photosensitive retinal ganglion cells might have key functions by means of retinal spontaneous ultraweak photon emission in the development of eye-specific retinogeniculate pathways prior to birth.

A neurociência computacional no estudo dos processos cognitivos

Resumo Nas últimas décadas o estudo de processos cognitivos vem sendo influenciado por duas tendências: a legitimação de diversas formas e níveis de estudo e a tentativa de integração multidisciplinar. A primeira teve grande importância na segunda metade do século XX, quando linhas de pesquisa na psicologia cognitiva e nas neurociências fortaleceram-se. Nesse sentido, destacam-se os três níveis de Marr (computacional, algorítmico e implementacional) como forma de estruturar o estudo dos processos cognitivos. A segunda tendência é mais recente e busca, apoiada na primeira, aprofundar o entendimento dos processos cognitivos em suas diversas escalas e integrar diversos paradigmas de estudos, buscando consiliência teórica. O intento deste artigo é apresentar a neurociência computacional e suas possíveis contribuições para a psicologia cognitiva, articulando, por meio dos três níveis de Marr, uma base teórica que explicite o papel de cada uma das disciplinas e as suas possíveis interações.

Behavioural and physiological limits to vision in mammals

Human vision is exquisitely sensitive-a dark-adapted observer is capable of reliably detecting the absorption of a few quanta of light. Such sensitivity requires that the sensory receptors of the retina, rod photoreceptors, generate a reliable signal when single photons are absorbed. In addition, the retina must be able to extract this information and relay it to higher visual centres under conditions where very few rods signal single-photon responses while the majority generate only noise. Critical to signal transmission are mechanistic optimizations within rods and their dedicated retinal circuits that enhance the discriminability of single-photon responses by mitigating photoreceptor and synaptic noise. We describe behavioural experiments over the past century that have led to the appreciation of high sensitivity near absolute visual threshold. We further consider mechanisms within rod photoreceptors and dedicated rod circuits that act to extract single-photon responses from cellular noise. We highlight how these studies have shaped our understanding of brain function and point out several unresolved questions in the processing of light near the visual threshold.This article is part of the themed issue 'Vision in dim light'.

Processing of single-photon responses in the mammalian On and Off retinal pathways at the sensitivity limit of vision

Visually guided behaviour at its sensitivity limit relies on single-photon responses originating in a small number of rod photoreceptors. For decades, researchers have debated the neural mechanisms and noise sources that underlie this striking sensitivity. To address this question, we need to understand the constraints arising from the retinal output signals provided by distinct retinal ganglion cell types. It has recently been shown in the primate retina that On and Off parasol ganglion cells, the cell types likely to underlie light detection at the absolute visual threshold, differ fundamentally not only in response polarity, but also in the way they handle single-photon responses originating in rods. The On pathway provides the brain with a thresholded, low-noise readout and the Off pathway with a noisy, linear readout. We outline the mechanistic basis of these different coding strategies and analyse their implications for detecting the weakest light signals. We show that high-fidelity, nonlinear signal processing in the On pathway comes with costs: more single-photon responses are lost and their propagation is delayed compared with the Off pathway. On the other hand, the responses of On ganglion cells allow better intensity discrimination compared with the Off ganglion cell responses near visual threshold.

This article is part of the themed issue ‘Vision in dim light’.

Resolving the Trade-off Between Visual Sensitivity and Spatial Acuity-Lessons from Hawkmoths

The visual systems of many animals, particularly those active during the day, are optimized for high spatial acuity. However, at night, when photons are sparse and the visual signal competes with increased noise levels, fine spatial resolution cannot be sustained and is traded-off for the greater sensitivity required to see in dim light. High spatial acuity demands detectors and successive visual processing units whose receptive fields each cover only a small area of visual space, in order to reassemble a finely sampled and well resolved image. However, the smaller the sampled area, the fewer the photons that can be collected, and thus the worse the visual sensitivity becomes-leading to the classical trade-off between sensitivity and resolution. Nocturnal animals usually resolve this trade-off in favour of sensitivity, and thus have lower spatial acuity than their diurnal counterparts. Here we review results highlighting how hawkmoths, a highly visual group of insects with species active at different light intensities, resolve the trade-off between sensitivity and spatial resolution. We compare adaptations both in the optics and retina, as well as at higher levels of neural processing in a nocturnal and a diurnal hawkmoth species, and also give a perspective on the behavioral consequences. We broaden the scope of our review by drawing comparisons with the adaptive strategies used by other nocturnal and diurnal insects.

Homeostatic plasticity shapes the visual system's first synapse

Vision in dim light depends on synapses between rods and rod bipolar cells (RBCs). Here, we find that these synapses exist in multiple configurations, in which single release sites of rods are apposed by one to three postsynaptic densities (PSDs). Single RBCs often form multiple PSDs with one rod; and neighboring RBCs share ~13% of their inputs. Rod-RBC synapses develop while ~7% of RBCs undergo programmed cell death (PCD). Although PCD is common throughout the nervous system, its influences on circuit development and function are not well understood. We generate mice in which ~53 and ~93% of RBCs, respectively, are removed during development. In these mice, dendrites of the remaining RBCs expand in graded fashion independent of light-evoked input. As RBC dendrites expand, they form fewer multi-PSD contacts with rods. Electrophysiological recordings indicate that this homeostatic co-regulation of neurite and synapse development preserves retinal function in dim light.

Retinal rod bipolar cells (RBCs) partially undergo programmed cell death triggering cell density-dependent plasticity. This study shows that increased removal of RBCs using genetic approaches causes dendrites of the remaining RBCs to expand and contact more rod photoreceptors while reducing connectivity with each.

Point process analysis of noise in early invertebrate vision

Noise is a prevalent and sometimes even dominant aspect of many biological processes. While many natural systems have adapted to attenuate or even usefully integrate noise, the variability it introduces often still delimits the achievable precision across biological functions. This is particularly so for visual phototransduction, the process responsible for converting photons of light into usable electrical signals (quantum bumps). Here, randomness of both the photon inputs (regarded as extrinsic noise) and the conversion process (intrinsic noise) are seen as two distinct, independent and significant limitations on visual reliability. Past research has attempted to quantify the relative effects of these noise sources by using approximate methods that do not fully account for the discrete, point process and time ordered nature of the problem. As a result the conclusions drawn from these different approaches have led to inconsistent expositions of phototransduction noise performance.

This paper provides a fresh and complete analysis of the relative impact of intrinsic and extrinsic noise in invertebrate phototransduction using minimum mean squared error reconstruction techniques based on Bayesian point process (Snyder) filters. An integrate-fire based algorithm is developed to reliably estimate photon times from quantum bumps and Snyder filters are then used to causally estimate random light intensities both at the front and back end of the phototransduction cascade. Comparison of these estimates reveals that the dominant noise source transitions from extrinsic to intrinsic as light intensity increases. By extending the filtering techniques to account for delays, it is further found that among the intrinsic noise components, which include bump latency (mean delay and jitter) and shape (amplitude and width) variance, it is the mean delay that is critical to noise performance. As the timeliness of visual information is important for real-time action, this delay could potentially limit the speed at which invertebrates can respond to stimuli. Consequently, if one wants to increase visual fidelity, reducing the photoconversion lag is much more important than improving the regularity of the electrical signal.

The invertebrate phototransduction system captures and converts environmental light inputs into electrical signals for use in later visual processing. Consequently, one would expect it to be optimised in some way to ensure that only a minimal amount of environmental information is lost during conversion. Confirming this requires an understanding and quantification of the performance limiting noise sources. Photons, which are inherently random and discrete, introduce extrinsic noise. The phototransduction cascade, which converts photons into electrical bumps possessing non-deterministic shapes and latencies, contributes intrinsic noise. Previous work on characterising the relative impact of all these sources did not account for the discrete, causal, point process nature of the problem and thus results were often inconclusive. Here we use non-linear Poisson process filtering to show that photon noise is dominant at low light intensity and cascade noise limiting at high intensity. Further, our analysis reveals that mean bump delay is the most deleterious aspect of the intrinsic noise. Our work emphasises a new approach to assessing sensory noise and provides the first complete description and evaluation of the relative impact of noise in phototransduction that does not rely on continuity, linearity or Gaussian approximations.

Mechanisms of Persistent Activity in Cortical Circuits: Possible Neural Substrates for Working Memory

A commonly observed neural correlate of working memory is firing that persists after the triggering stimulus disappears. Substantial effort has been devoted to understanding the many potential mechanisms that may underlie memory-associated persistent activity. These rely either on the intrinsic properties of individual neurons or on the connectivity within neural circuits to maintain the persistent activity. Nevertheless, it remains unclear which mechanisms are at play in the many brain areas involved in working memory. Herein, we first summarize the palette of different mechanisms that can generate persistent activity. We then discuss recent work that asks which mechanisms underlie persistent activity in different brain areas. Finally, we discuss future studies that might tackle this question further. Our goal is to bridge between the communities of researchers who study either single-neuron biophysical, or neural circuit, mechanisms that can generate the persistent activity that underlies working memory.

The Transduction Cascade in Retinal ON-Bipolar Cells: Signal Processing and Disease

Our robust visual experience is based on the reliable transfer of information from our photoreceptor cells, the rods and cones, to higher brain centers. At the very first synapse of the visual system, information is split into two separate pathways, ON and OFF, which encode increments and decrements in light intensity, respectively. The importance of this segregation is borne out in the fact that receptive fields in higher visual centers maintain a separation between ON and OFF regions. In the past decade, the molecular mechanisms underlying the generation of ON signals have been identified, which are unique in their use of a G-protein signaling cascade. In this review, we consider advances in our understanding of G-protein signaling in ON-bipolar cell (BC) dendrites and how insights about signaling have emerged from visual deficits, mostly night blindness. Studies of G-protein signaling in ON-BCs reveal an intricate mechanism that permits the regulation of visual sensitivity over a wide dynamic range.

Measurement of Slow Spontaneous Release of 11-cis-Retinal from Rhodopsin

The vertebrate visual photoreceptor rhodopsin (Rho) is a unique G protein-coupled receptor as it utilizes a covalently tethered inverse agonist (11-cis-retinal) as the native ligand. Previously, electrophysiological studies showed that ligand binding of 11-cis-retinal in dark-adapted Rho was essentially irreversible with a half-life estimated to be 420 years, until after thermal isomerization to all-trans-retinal, which then slowly dissociates. This long lifetime of 11-cis-retinal binding was considered to be physiologically important for minimizing background signal (dark noise) of the visual system. However, in vitro biochemical studies on the thermal stability of Rho showed that Rho decays with a half-life on the order of days. In this study, we resolve the discrepancy by measuring the chromophore exchange rate of the bound 11-cis-retinal chromophore with free 9-cis-retinal from Rho in an in vitro phospholipid/detergent bicelle system. We conclude that the thermal decay of Rho primarily proceeds through spontaneous breaking of the covalent linkage between opsin and 11-cis-retinal, which was overlooked in the electrophysiological recording. We estimate that this slow spontaneous release of 11-cis-retinal from Rho should result in 10⁴ to 10⁵ free opsin molecules in a dark-adapted rod cell-a number that is three orders of magnitude higher than previously expected. We also discuss the physiological implications of these findings on the basal activity of opsins and the associated dark noise in the visual system.

Elevated cAMP improves signal-to-noise ratio in amphibian rod photoreceptors

Vertebrate photoreceptors need to distinguish light signals from background noise to convey visual information to downstream bipolar cells. By affecting both signal and noise, Astakhova et al. find that increases in intracellular cAMP can improve the signal-to-noise ratio by twofold.

The absolute sensitivity of vertebrate retinas is set by a background noise, called dark noise, which originates from several different cell types and is generated by different molecular mechanisms. The major share of dark noise is produced by photoreceptors and consists of two components, discrete and continuous. Discrete noise is generated by spontaneous thermal activations of visual pigment. These events are undistinguishable from real single-photon responses (SPRs) and might be considered an equivalent of the signal. Continuous noise is produced by spontaneous fluctuations of the catalytic activity of the cGMP phosphodiesterase. This masks both SPR and spontaneous SPR-like responses. Circadian rhythms affect photoreceptors, among other systems by periodically increasing intracellular cAMP levels ([cAMP]_in), which increases the size and changes the shape of SPRs. Here, we show that forskolin, a tool that increases [cAMP]_in, affects the magnitude and frequency spectrum of the continuous and discrete components of dark noise in photoreceptors. By changing both components of rod signaling, the signal and the noise, cAMP is able to increase the photoreceptor signal-to-noise ratio by twofold. We propose that this results in a substantial improvement of signal detection, without compromising noise rejection, at the rod bipolar cell synapse.

Adaptation of cone pigments found in green rods for scotopic vision through a single amino acid mutation

Most vertebrate retinas contain a single type of rod for scotopic vision and multiple types of cones for photopic and color vision. The retinas of certain amphibian species uniquely contain two types of rods: red rods, which express rhodopsin, and green rods, which express a blue-sensitive cone pigment (M1/SWS2 group). Spontaneous activation of rhodopsin induced by thermal isomerization of the retinal chromophore has been suggested to contribute to the rod's background noise, which limits the visual threshold for scotopic vision. Therefore, rhodopsin must exhibit low thermal isomerization rate compared with cone visual pigments to adapt to scotopic condition. In this study, we determined whether amphibian blue-sensitive cone pigments in green rods exhibit low thermal isomerization rates to act as rhodopsin-like pigments for scotopic vision. Anura blue-sensitive cone pigments exhibit low thermal isomerization rates similar to rhodopsin, whereas Urodela pigments exhibit high rates like other vertebrate cone pigments present in cones. Furthermore, by mutational analysis, we identified a key amino acid residue, Thr47, that is responsible for the low thermal isomerization rates of Anura blue-sensitive cone pigments. These results strongly suggest that, through this mutation, anurans acquired special blue-sensitive cone pigments in their green rods, which could form the molecular basis for scotopic color vision with normal red rods containing green-sensitive rhodopsin.

How Do Efficient Coding Strategies Depend on Origins of Noise in Neural Circuits?

Neural circuits reliably encode and transmit signals despite the presence of noise at multiple stages of processing. The efficient coding hypothesis, a guiding principle in computational neuroscience, suggests that a neuron or population of neurons allocates its limited range of responses as efficiently as possible to best encode inputs while mitigating the effects of noise. Previous work on this question relies on specific assumptions about where noise enters a circuit, limiting the generality of the resulting conclusions. Here we systematically investigate how noise introduced at different stages of neural processing impacts optimal coding strategies. Using simulations and a flexible analytical approach, we show how these strategies depend on the strength of each noise source, revealing under what conditions the different noise sources have competing or complementary effects. We draw two primary conclusions: (1) differences in encoding strategies between sensory systems-or even adaptational changes in encoding properties within a given system-may be produced by changes in the structure or location of neural noise, and (2) characterization of both circuit nonlinearities as well as noise are necessary to evaluate whether a circuit is performing efficiently.