Receptive fields in primate retina are coordinated to sample visual space more uniformly

Modeling responses of macaque and human retinal ganglion cells to natural images using a convolutional neural network

Linear-nonlinear (LN) cascade models provide a simple way to capture retinal ganglion cell (RGC) responses to artificial stimuli such as white noise, but their ability to model responses to natural images is limited. Recently, convolutional neural network (CNN) models have been shown to produce light response predictions that were substantially more accurate than those of a LN model. However, this modeling approach has not yet been applied to responses of macaque or human RGCs to natural images. Here, we train and test a CNN model on responses to natural images of the four numerically dominant RGC types in the macaque and human retina - ON parasol, OFF parasol, ON midget and OFF midget cells. Compared with the LN model, the CNN model provided substantially more accurate response predictions. Linear reconstructions of the visual stimulus were more accurate for CNN compared to LN model-generated responses, relative to reconstructions obtained from the recorded data. These findings demonstrate the effectiveness of a CNN model in capturing light responses of major RGC types in the macaque and human retinas in natural conditions.

GABAergic Inhibition Controls Receptive Field Size, Sensitivity, and Contrast Preference of Direction Selective Retinal Ganglion Cells Near the Threshold of Vision

Information about motion is encoded by direction-selective retinal ganglion cells (DSGCs). These cells reliably transmit this information across a broad range of light levels, spanning moonlight to sunlight. Previous work indicates that adaptation to low light levels causes heterogeneous changes to the direction tuning of ON-OFF (oo)DSGCs and suggests that superior-preferring ON-OFF DSGCs (s-DSGCs) are biased toward detecting stimuli rather than precisely signaling direction. Using a large-scale multielectrode array, we measured the absolute sensitivity of ooDSGCs and found that s-DSGCs are 10-fold more sensitive to dim flashes of light than other ooDSGCs. We measured their receptive field (RF) sizes and found that s-DSGCs also have larger receptive fields than other ooDSGCs; however, the size difference does not fully explain the sensitivity difference. Using a conditional knock-out of gap junctions and pharmacological manipulations, we demonstrate that GABA-mediated inhibition contributes to the difference in absolute sensitivity and receptive field size at low light levels, while the connexin36-mediated gap junction coupling plays a minor role. We further show that under scotopic conditions, ooDSGCs exhibit only an ON response, but pharmacologically removing GABA-mediated inhibition unmasks an OFF response. These results reveal that GABAergic inhibition controls and differentially modulates the responses of ooDSGCs under scotopic conditions.

Decomposition of retinal ganglion cell electrical images for cell type and functional inference

Identifying neuronal cell types and their biophysical properties based on their extracellular electrical features is a major challenge for experimental neuroscience and the development of high-resolution brain-machine interfaces. One example is identification of retinal ganglion cell (RGC) types and their visual response properties, which is fundamental for developing future electronic implants that can restore vision. The electrical image (EI) of a RGC, or the mean spatio-temporal voltage footprint of its recorded spikes on a high-density electrode array, contains substantial information about its anatomical, morphological, and functional properties. However, the analysis of these properties is complex because of the high-dimensional nature of the EI. We present a novel optimization-based algorithm to decompose electrical image into a low-dimensional, biophysically-based representation: the temporally-shifted superposition of three learned basis waveforms corresponding to spike waveforms produced in the somatic, dendritic and axonal cellular compartments. Large-scale multi-electrode recordings from the macaque retina were used to test the effectiveness of the decomposition. The decomposition accurately localized the somatic and dendritic compartments of the cell. The imputed dendritic fields of RGCs correctly predicted the location and shape of their visual receptive fields. The inferred waveform amplitudes and shapes accurately identified the four major primate RGC types (ON and OFF midget and parasol cells), a substantial advance. Together, these findings may contribute to more accurate inference of RGC types and their original light responses in the degenerated retina, with possible implications for other electrical imaging applications.

High-Fidelity Reproduction of Visual Signals by Electrical Stimulation in the Central Primate Retina

Electrical stimulation of retinal ganglion cells (RGCs) with electronic implants provides rudimentary artificial vision to people blinded by retinal degeneration. However, current devices stimulate indiscriminately and therefore cannot reproduce the intricate neural code of the retina. Recent work has demonstrated more precise activation of RGCs using focal electrical stimulation with multielectrode arrays in the peripheral macaque retina, but it is unclear how effective this can be in the central retina, which is required for high-resolution vision. This work probes the neural code and effectiveness of focal epiretinal stimulation in the central macaque retina, using large-scale electrical recording and stimulation ex vivo The functional organization, light response properties, and electrical properties of the major RGC types in the central retina were mostly similar to the peripheral retina, with some notable differences in density, kinetics, linearity, spiking statistics, and correlations. The major RGC types could be distinguished by their intrinsic electrical properties. Electrical stimulation targeting parasol cells revealed similar activation thresholds and reduced axon bundle activation in the central retina, but lower stimulation selectivity. Quantitative evaluation of the potential for image reconstruction from electrically evoked parasol cell signals revealed higher overall expected image quality in the central retina. An exploration of inadvertent midget cell activation suggested that it could contribute high spatial frequency noise to the visual signal carried by parasol cells. These results support the possibility of reproducing high-acuity visual signals in the central retina with an epiretinal implant.SIGNIFICANCE STATEMENT Artificial restoration of vision with retinal implants is a major treatment for blindness. However, present-day implants do not provide high-resolution visual perception, in part because they do not reproduce the natural neural code of the retina. Here, we demonstrate the level of visual signal reproduction that is possible with a future implant by examining how accurately responses to electrical stimulation of parasol retinal ganglion cells can convey visual signals. Although the precision of electrical stimulation in the central retina was diminished relative to the peripheral retina, the quality of expected visual signal reconstruction in parasol cells was greater. These findings suggest that visual signals could be restored with high fidelity in the central retina using a future retinal implant.

Retinal self-organization: a model of retinal ganglion cells and starburst amacrine cells mosaic formation

Individual retinal cell types exhibit semi-regular spatial patterns called retinal mosaics. Retinal ganglion cells (RGCs) and starburst amacrine cells (SACs) are known to exhibit such layouts. Mechanisms responsible for the formation of mosaics are not well understood but follow three main principles: (i) homotypic cells prevent nearby cells from adopting the same type, (ii) cell tangential migration and (iii) cell death. Alongside experiments in mouse, we use BioDynaMo, an agent-based simulation framework, to build a detailed and mechanistic model of mosaic formation. We investigate the implications of the three theories for RGC's mosaic formation. We report that the cell migration mechanism yields the most regular mosaics. In addition, we propose that low-density RGC type mosaics exhibit on average low regularities, and thus we question the relevance of regular spacing as a criterion for a group of RGCs to form a RGC type. We investigate SAC mosaics formation and interactions between the ganglion cell layer (GCL) and inner nuclear layer (INL) populations. We propose that homotypic interactions between the GCL and INL populations during mosaics creation are required to reproduce the observed SAC mosaics' characteristics. This suggests that the GCL and INL populations of SACs might not be independent during retinal development.

Neural System Identification With Spike-Triggered Non-Negative Matrix Factorization

Neuronal circuits formed in the brain are complex with intricate connection patterns. Such complexity is also observed in the retina with a relatively simple neuronal circuit. A retinal ganglion cell (GC) receives excitatory inputs from neurons in previous layers as driving forces to fire spikes. Analytical methods are required to decipher these components in a systematic manner. Recently a method called spike-triggered non-negative matrix factorization (STNMF) has been proposed for this purpose. In this study, we extend the scope of the STNMF method. By using retinal GCs as a model system, we show that STNMF can detect various computational properties of upstream bipolar cells (BCs), including spatial receptive field, temporal filter, and transfer nonlinearity. In addition, we recover synaptic connection strengths from the weight matrix of STNMF. Furthermore, we show that STNMF can separate spikes of a GC into a few subsets of spikes, where each subset is contributed by one presynaptic BC. Taken together, these results corroborate that STNMF is a useful method for deciphering the structure of neuronal circuits.

Improving the spatial resolution of artificial vision using midget retinal ganglion cell populations modelled at the human fovea

OBJECTIVE

Retinal prostheses seek to create artificial vision by stimulating surviving retinal neurons of patients with profound vision impairment. Notwithstanding tremendous research efforts, the performance of all implants tested to date has remained rudimentary, incapable of overcoming the threshold for legal blindness. To maximize the perceptual efficacy of retinal prostheses, a device must be capable of controlling retinal neurons with greater spatiotemporal precision. Most studies of retinal stimulation were derived from either non-primate species or the peripheral primate retina. We investigated if artificial stimulation could leverage the high spatial resolution afforded by the neural substrates at the primate fovea and surrounding regions to achieve improved percept qualities.

APPROACH

We began by developing a new computational model capable of generating anatomically accurate retinal ganglion cell (RGC) populations within the human central retina. Next, multiple RGC populations across the central retina were stimulated in-silico to compare clinical and recently proposed neurostimulation configurations based on their ability to improve perceptual efficacy and reduce activation thresholds.

MAIN RESULTS

Our model uniquely upholds eccentricity-dependent characteristics such as RGC density and dendritic field diameter, whilst incorporating anatomically accurate features such as axon projection and three-dimensional RGC layering, features often forgone in favor of reduced computational complexity. Following epiretinal stimulation, the RGCs in our model produced response patterns in shapes akin to the complex percepts reported in clinical trials. Our results also demonstrated that even within the neuron-dense central retina, epiretinal stimulation using a multi-return hexapolar electrode arrangement could reliably achieve spatially focused RGC activation and could achieve single-cell excitation in 74% of all tested locations.

SIGNIFICANCE

This study establishes an anatomically accurate three-dimensional model of the human central retina and demonstrates the potential for an epiretinal hexapolar configuration to achieve consistent, spatially confined retinal responses, even within the neuron-dense foveal region. Our results promote the prospect and optimization of higher spatial resolution in future epiretinal implants.

Simple model for encoding natural images by retinal ganglion cells with nonlinear spatial integration

A central goal in sensory neuroscience is to understand the neuronal signal processing involved in the encoding of natural stimuli. A critical step towards this goal is the development of successful computational encoding models. For ganglion cells in the vertebrate retina, the development of satisfactory models for responses to natural visual scenes is an ongoing challenge. Standard models typically apply linear integration of visual stimuli over space, yet many ganglion cells are known to show nonlinear spatial integration, in particular when stimulated with contrast-reversing gratings. We here study the influence of spatial nonlinearities in the encoding of natural images by ganglion cells, using multielectrode-array recordings from isolated salamander and mouse retinas. We assess how responses to natural images depend on first- and second-order statistics of spatial patterns inside the receptive field. This leads us to a simple extension of current standard ganglion cell models. We show that taking not only the weighted average of light intensity inside the receptive field into account but also its variance over space can partly account for nonlinear integration and substantially improve response predictions of responses to novel images. For salamander ganglion cells, we find that response predictions for cell classes with large receptive fields profit most from including spatial contrast information. Finally, we demonstrate how this model framework can be used to assess the spatial scale of nonlinear integration. Our results underscore that nonlinear spatial stimulus integration translates to stimulation with natural images. Furthermore, the introduced model framework provides a simple, yet powerful extension of standard models and may serve as a benchmark for the development of more detailed models of the nonlinear structure of receptive fields.

For understanding how sensory systems operate in the natural environment, an important goal is to develop models that capture neuronal responses to natural stimuli. For retinal ganglion cells, which connect the eye to the brain, current standard models often fail to capture responses to natural visual scenes. This shortcoming is at least partly rooted in the fact that ganglion cells may combine visual signals over space in a nonlinear fashion. We here show that a simple model, which not only considers the average light intensity inside a cell’s receptive field but also the variance of light intensity over space, can partly account for these nonlinearities and thereby improve current standard models. This provides an easy-to-obtain benchmark for modeling ganglion cell responses to natural images.

An in-silico analysis of electrically-evoked responses of midget and parasol retinal ganglion cells in different retinal regions

BACKGROUND

Visual outcomes provided by present retinal prostheses that primarily target retinal ganglion cells (RGCs) through epiretinal stimulation remain rudimentary, partly due to the limited knowledge of retinal responses under electrical stimulation. Better understanding of how different retinal regions can be quantitatively controlled with high spatial accuracy, will be beneficial to the design of micro-electrode arrays (MEAs) and stimulation strategies for next-generation wide-view, high-resolution epiretinal implants.

METHODS

A computational model was developed to assess neural activity at different eccentricities (2 mm and 5 mm) within the human retina. This model included midget and parasol RGCs with anatomically accurate cell distribution and cell-specific morphological information. We then performed in silico investigations of region-specific RGC responses to epiretinal electrical stimulation using varied electrode sizes (5 µm - 210 µm diameter), emulating both commercialized retinal implants and recently-developed prototype devices.

RESULTS

Our model of epiretinal stimulation predicted RGC population excitation analogous to the complex percepts reported in human subjects. Following this, our simulations suggest that midget and parasol RGCs have characteristic regional differences in excitation under preferred electrode sizes. Relatively central (2 mm) regions demonstrated higher number of excited RGCs but lower overall activated receptive field (RF) areas under the same stimulus amplitudes (two-way ANOVA, p < 0.05). Furthermore, the activated RGC numbers per unit active RF area (number-RF ratio) were significantly higher in central than in peripheral regions, and higher in the midget than in the parasol population under all tested electrode sizes (two-way ANOVA, p < 0.05). Our simulations also suggested that smaller electrodes exhibit a higher range of controllable stimulation parameters to achieve pre-defined performance of RGC excitation. ..

Revealing Fine Structures of the Retinal Receptive Field by Deep-Learning Networks

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on many visual tasks. Recently, they became useful models for the visual system in neuroscience. However, it is still not clear what is learned by CNNs in terms of neuronal circuits. When a deep CNN with many layers is used for the visual system, it is not easy to compare the structure components of CNNs with possible neuroscience underpinnings due to highly complex circuits from the retina to the higher visual cortex. Here, we address this issue by focusing on single retinal ganglion cells with biophysical models and recording data from animals. By training CNNs with white noise images to predict neuronal responses, we found that fine structures of the retinal receptive field can be revealed. Specifically, convolutional filters learned are resembling biological components of the retinal circuit. This suggests that a CNN learning from one single retinal cell reveals a minimal neural network carried out in this cell. Furthermore, when CNNs learned from different cells are transferred between cells, there is a diversity of transfer learning performance, which indicates that CNNs are cell specific. Moreover, when CNNs are transferred between different types of input images, here white noise versus natural images, transfer learning shows a good performance, which implies that CNNs indeed capture the full computational ability of a single retinal cell for different inputs. Taken together, these results suggest that CNNs could be used to reveal structure components of neuronal circuits, and provide a powerful model for neural system identification.

Dissecting cascade computational components in spiking neural networks

Finding out the physical structure of neuronal circuits that governs neuronal responses is an important goal for brain research. With fast advances for large-scale recording techniques, identification of a neuronal circuit with multiple neurons and stages or layers becomes possible and highly demanding. Although methods for mapping the connection structure of circuits have been greatly developed in recent years, they are mostly limited to simple scenarios of a few neurons in a pairwise fashion; and dissecting dynamical circuits, particularly mapping out a complete functional circuit that converges to a single neuron, is still a challenging question. Here, we show that a recent method, termed spike-triggered non-negative matrix factorization (STNMF), can address these issues. By simulating different scenarios of spiking neural networks with various connections between neurons and stages, we demonstrate that STNMF is a persuasive method to dissect functional connections within a circuit. Using spiking activities recorded at neurons of the output layer, STNMF can obtain a complete circuit consisting of all cascade computational components of presynaptic neurons, as well as their spiking activities. For simulated simple and complex cells of the primary visual cortex, STNMF allows us to dissect the pathway of visual computation. Taken together, these results suggest that STNMF could provide a useful approach for investigating neuronal systems leveraging recorded functional neuronal activity.

It is well known that the computation of neuronal circuits is carried out through the staged and cascade structure of different types of neurons. Nevertheless, the information, particularly sensory information, is processed in a network primarily with feedforward connections through different pathways. A peculiar example is the early visual system, where light is transcoded by the retinal cells, routed by the lateral geniculate nucleus, and reached the primary visual cortex. One meticulous interest in recent years is to map out these physical structures of neuronal pathways. However, most methods so far are limited to taking snapshots of a static view of connections between neurons. It remains unclear how to obtain a functional and dynamical neuronal circuit beyond the simple scenarios of a few randomly sampled neurons. Using simulated spiking neural networks of visual pathways with different scenarios of multiple stages, mixed cell types, and natural image stimuli, we demonstrate that a recent computational tool, named spike-triggered non-negative matrix factorization, can resolve these issues. It enables us to recover the entire structural components of neural networks underlying the computation, together with the functional components of each individual neuron. Utilizing it for complex cells of the primary visual cortex allows us to reveal every underpinning of the nonlinear computation. Our results, together with other recent experimental and computational efforts, show that it is possible to systematically dissect neural circuitry with detailed structural and functional components.

Scene statistics and noise determine the relative arrangement of receptive field mosaics

Across a wide variety of species, cells in the retina specialized for signaling either increases (ON) or decreases (OFF) in light represent one of the most basic building blocks of visual computation. These cells coordinate to form mosaics, with each cell responsible for a small, minimally overlapping portion of visual space, but the ways in which these mosaics could be spatially coordinated with each other are relatively unknown. Here, we show how efficient coding theory, which hypothesizes that the nervous system minimizes the amount of redundant information it encodes, can predict the relative spatial arrangement of ON and OFF mosaics. The most information-efficient arrangements are determined both by levels of noise in the system and the statistics of natural images.

Many sensory systems utilize parallel ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways consist of ensembles or grids of ON and OFF detectors spanning sensory space. Yet, encoding by opponent pathways raises a question: How should grids of ON and OFF detectors be arranged to optimally encode natural stimuli? We investigated this question using a model of the retina guided by efficient coding theory. Specifically, we optimized spatial receptive fields and contrast response functions to encode natural images given noise and constrained firing rates. We find that the optimal arrangement of ON and OFF receptive fields exhibits a transition between aligned and antialigned grids. The preferred phase depends on detector noise and the statistical structure of the natural stimuli. These results reveal that noise and stimulus statistics produce qualitative shifts in neural coding strategies and provide theoretical predictions for the configuration of opponent pathways in the nervous system.

Impact of Photoreceptor Loss on Retinal Circuitry

Our sense of sight relies on photoreceptors, which transduce photons into the nervous system's electrochemical interpretation of the visual world. These precious photoreceptors can be disrupted by disease, injury, and aging. Once photoreceptors start to die, but before blindness occurs, the remaining retinal circuitry can withstand, mask, or exacerbate the photoreceptor deficit and potentially be receptive to newfound therapies for vision restoration. To maximize the retina's receptivity to therapy, one must understand the conditions that influence the state of the remaining retina. In this review, we provide an overview of the retina's structure and function in health and disease. We analyze a collection of observations on photoreceptor disruption and generate a predictive model to identify parameters that influence the retina's response. Finally, we speculate on whether the retina, with its remarkable capacity to function over light levels spanning nine orders of magnitude, uses these same adaptational mechanisms to withstand and perhaps mask photoreceptor loss.

Signals Related to Color in the Early Visual Cortex

Visual images can be described in terms of the illuminants and objects that are causal to the light reaching the eye, the retinal image, its neural representation, or how the image is perceived. Respecting the differences among these distinct levels of description can be challenging but is crucial for a clear understanding of color vision. This article approaches color by reviewing what is known about its neural representation in the early visual cortex, with a brief description of signals in the eye and the thalamus for context. The review focuses on the properties of single neurons and advances the general theme that experimental approaches based on knowledge of feedforward signals have promoted greater understanding of the neural code for color than approaches based on correlating single-unit responses with color perception. New data from area V1 illustrate the strength of the feedforward approach. Future directions for progress in color neurophysiology are discussed: techniques for improved single-neuron characterization, for investigations of neural populations and small circuits, and for the analysis of natural image statistics.

Periodic clustering of simple and complex cells in visual cortex

Neurons in the primary visual cortex (V1) are often classified as simple or complex cells, but it is debated whether they are discrete hierarchical classes of neurons or if they represent a continuum of variation within a single class of cells. Herein, we show that simple and complex cells may arise commonly from the feedforward projections from the retina. From analysis of the cortical receptive fields in cats, we show evidence that simple and complex cells originate from the periodic variation of ON-OFF segregation in the feedforward projection of retinal mosaics, by which they organize into periodic clusters in V1. From data in cats, we observed that clusters of simple and complex receptive fields correlate topographically with orientation maps, which supports our model prediction. Our results suggest that simple and complex cells are not two distinct neural populations but arise from common retinal afferents, simultaneous with orientation tuning.

Nonlinear spatial integration in retinal bipolar cells shapes the encoding of artificial and natural stimuli

The retina dissects the visual scene into parallel information channels, which extract specific visual features through nonlinear processing. The first nonlinear stage is typically considered to occur at the output of bipolar cells, resulting from nonlinear transmitter release from synaptic terminals. In contrast, we show here that bipolar cells themselves can act as nonlinear processing elements at the level of their somatic membrane potential. Intracellular recordings from bipolar cells in the salamander retina revealed frequent nonlinear integration of visual signals within bipolar cell receptive field centers, affecting the encoding of artificial and natural stimuli. These nonlinearities provide sensitivity to spatial structure below the scale of bipolar cell receptive fields in both bipolar and downstream ganglion cells and appear to arise at the excitatory input into bipolar cells. Thus, our data suggest that nonlinear signal pooling starts earlier than previously thought: that is, at the input stage of bipolar cells.

•

Some retinal bipolar cells represent visual contrast in a nonlinear fashion

•

These bipolar cells also nonlinearly integrate visual signals over space

•

The spatial nonlinearity affects the encoding of natural stimuli by bipolar cells

•

The nonlinearity results from feedforward input, not from feedback inhibition

Linear and nonlinear chromatic integration in the mouse retina

The computations performed by a neural circuit depend on how it integrates its input signals into an output of its own. In the retina, ganglion cells integrate visual information over time, space, and chromatic channels. Unlike the former two, chromatic integration is largely unexplored. Analogous to classical studies of spatial integration, we here study chromatic integration in mouse retina by identifying chromatic stimuli for which activation from the green or UV color channel is maximally balanced by deactivation through the other color channel. This reveals nonlinear chromatic integration in subsets of On, Off, and On-Off ganglion cells. Unlike the latter two, nonlinear On cells display response suppression rather than activation under balanced chromatic stimulation. Furthermore, nonlinear chromatic integration occurs independently of nonlinear spatial integration, depends on contributions from the rod pathway and on surround inhibition, and may provide information about chromatic boundaries, such as the skyline in natural scenes.

Inter-mosaic coordination of retinal receptive fields

The output of the retina is organized into many detector grids, called ‘mosaics’ that signal different features of visual scenes to the brain^1–4. Each mosaic comprises a single retinal ganglion cell (RGC) type, whose receptive fields (RFs) tile space. Many mosaics arise as pairs, signaling increments (ON) and decrements (OFF), respectively, of a particular visual feature⁵. Using a model of efficient coding⁶, we determine how such mosaic pairs should be arranged to optimize the encoding of natural scenes. We find that information is maximized when these mosaic pairs are anti-aligned, meaning the RF centers between mosaics are more distant than expected by chance. We test this prediction across multiple RF mosaics acquired with large-scale measurements of RGC light responses from rat and primate. We find that ON and OFF RGC pairs with similar feature selectivity exhibit anti-aligned RF mosaics, consistent with theory. ON and OFF types that encode distinct features exhibit independent mosaics. These results extend efficient coding theory (ECT) beyond individual cells to predict how populations of diverse RGC types are spatially arranged.

Projection of Orthogonal Tiling from the Retina to the Visual Cortex

In higher mammals, the primary visual cortex (V1) is organized into diverse tuning maps of visual features. The topography of these maps intersects orthogonally, but it remains unclear how such a systematic relationship can develop. Here, we show that the orthogonal organization already exists in retinal ganglion cell (RGC) mosaics, providing a blueprint of the organization in V1. From analysis of the RGC mosaics data in monkeys and cats, we find that the ON-OFF RGC distance and ON-OFF angle of neighboring RGCs are organized into a topographic tiling across mosaics, analogous to the orthogonal intersection of cortical tuning maps. Our model simulation shows that the ON-OFF distance and angle in RGC mosaics correspondingly initiate ocular dominance/spatial frequency tuning and orientation tuning, resulting in the orthogonal intersection of cortical tuning maps. These findings suggest that the regularly structured ON-OFF patterns mirrored from the retina initiate the uniform representation of combinations of map features over the visual space.

Threshold vision under full-field stimulation: Revisiting the minimum number of quanta necessary to evoke a visual sensation

At the absolute threshold of vision, Hecht, Shlaer and Pirenne estimate that 5-14 photons are absorbed within a retinal area containing ~500 rods. Other estimates of scotopic threshold vision based on stimuli with different durations and focal areas range up to ~100,000 photons. Given that rod density varies with retinal eccentricity and the magnitude of the intrinsic noise increases with increasing stimulus area and duration, here we determine whether the scotopic threshold estimates with focal stimuli can be extended to full-field stimulation and whether summation explains inter-study differences. We show that full-field threshold vision (~1018 mm², 10 ms duration) is more sensitive than at absolute threshold, requiring the absorption of ~1000 photons across ~91.96 million rods. A summation model is presented integrating our and published data and using a nominal exposure duration, criterion frequency of seeing, rod density, and retinal area that largely explains the inter-study differences and allows estimation of rods per photon ratio for any stimulus size and duration. The highest signal to noise ratio is defined by a peak rod convergence estimated at 53:4:1:2 (rods:rod bipolar cells:AII amacrine cells:retinal ganglion cells), in line with macaque anatomical estimates that show AII amacrine cells form the bottleneck in the rod pathway to set the scotopic visual limit. Our model estimations that the rods per photon ratio under full-field stimulation is ~3000X higher than at absolute threshold are in accordance with visual summation effects and provide an alternative approach for understanding the limits of scotopic vision.

Physiological constraints of visual pathway lead to more efficient coding of information in retina

Nowadays, numerous studies have investigated the modeling of efficient neural encoding processes in the retina of the eye to encode the sensory data. Retina, as the innermost coat of the eye, is the first and the most important area of the visual neural system of mammalians, which is responsible for neural processes. Retina encodes the information of light intensity into a sequence of spikes, and sends them to retinal ganglion cells (RGCs) for further processing. An appropriate retinal encoding model should be adapted to the real retina as much as possible by considering the physiological constraints of the visual pathway to transfer most of the information of the input signal to the brain without too much redundancy of the channel. In this paper, inspired from the existing linear models of retinal encoding process, which have employed input noise and the spatial locality of the RGCs receptive fields (RFs) in the calculation of the encoding matrix, two extra physiological constraints, adapted from the real retina are taken into account so as to achieve a more realistic model for themammalian retina. These new constraints that are the correlation between RGCs and the spatial locality of the photoreceptors' projective fields (PFs), are modeled in a mathematical form and analyzed in detail. To quantify fidelity of the proposed encoding matrix and prove its superiority over existing models, various parameters of the models are calculated and presented in this paper: mean square error between the original and reconstructed image (MSE), the redundancy of the channel, the amount of information transferred through the channel, and the amount of wasted capacity for carrying input noise, to name a few. The results of these calculations show that the proposed model transfers input information with less redundancy of the channel. In other words, it reduces a portion of channel capacity which is wasted for carrying the input noise in comparison to the existing models. Also, due to considering extra physiological constraints in the proposed model, it is acceptable to have a slightly higher amount of MSE value in order to become similar to the real retina.

An offset ON-OFF receptive field is created by gap junctions between distinct types of retinal ganglion cells

In the vertebrate retina, the location of a neuron's receptive field in visual space closely corresponds to the physical location of synaptic input onto its dendrites, a relationship called the retinotopic map. We report the discovery of a systematic spatial offset between the ON and OFF receptive subfields in F-mini-ON retinal ganglion cells (RGCs). Surprisingly, this property does not come from spatially offset ON and OFF layer dendrites, but instead arises from a network of electrical synapses via gap junctions to RGCs of a different type, the F-mini-OFF. We show that the asymmetric morphology and connectivity of these RGCs can explain their receptive field offset, and we use a multicell model to explore the effects of receptive field offset on the precision of edge-location representation in a population. This RGC network forms a new electrical channel combining the ON and OFF feedforward pathways within the output layer of the retina.

Computational challenges and opportunities for a bi-directional artificial retina

A future artificial retina that can restore high acuity vision in blind people will rely on the capability to both read (observe) and write (control) the spiking activity of neurons using an adaptive, bi-directional and high-resolution device. Although current research is focused on overcoming the technical challenges of building and implanting such a device, exploiting its capabilities to achieve more acute visual perception will also require substantial computational advances. Using high-density large-scale recording and stimulation in the primate retina with an ex vivo multi-electrode array lab prototype, we frame several of the major computational problems, and describe current progress and future opportunities in solving them. First, we identify cell types and locations from spontaneous activity in the blind retina, and then efficiently estimate their visual response properties by using a low-dimensional manifold of inter-retina variability learned from a large experimental dataset. Second, we estimate retinal responses to a large collection of relevant electrical stimuli by passing current patterns through an electrode array, spike sorting the resulting recordings and using the results to develop a model of evoked responses. Third, we reproduce the desired responses for a given visual target by temporally dithering a diverse collection of electrical stimuli within the integration time of the visual system. Together, these novel approaches may substantially enhance artificial vision in a next-generation device.

Spontaneous Retinal Waves Can Generate Long-Range Horizontal Connectivity in Visual Cortex

In the primary visual cortex (V1) of higher mammals, long-range horizontal connections (LHCs) are observed to develop, linking iso-orientation domains of cortical tuning. It is unknown how this feature-specific wiring of circuitry develops before eye-opening. Here, we suggest that LHCs in V1 may originate from spatiotemporally structured feedforward activities generated from spontaneous retinal waves. Using model simulations based on the anatomy and observed activity patterns of the retina, we show that waves propagating in retinal mosaics can initialize the wiring of LHCs by coactivating neurons of similar tuning, whereas equivalent random activities cannot induce such organizations. Simulations showed that emerged LHCs can produce the patterned activities observed in V1, matching the topography of the underlying orientation map. The model can also reproduce feature-specific microcircuits in the salt-and-pepper organizations found in rodents. Our results imply that early peripheral activities contribute significantly to cortical development of functional circuits.SIGNIFICANCE STATEMENT Long-range horizontal connections (LHCs) in the primary visual cortex (V1) are observed to emerge before the onset of visual experience, thereby selectively connecting iso-domains of orientation map. However, it is unknown how such feature-specific wirings develop before eye-opening. Here, we show that LHCs in V1 may originate from the feature-specific activation of cortical neurons by spontaneous retinal waves during early developmental stages. Our simulations of a visual cortex model show that feedforward activities from the retina initialize the spatial organization of activity patterns in V1, which induces visual feature-specific wirings in the V1 neurons. Our model also explains the origin of cortical microcircuits observed in rodents, suggesting that the proposed developmental mechanism is universally applicable to circuits of various mammalian species.

Inference of nonlinear receptive field subunits with spike-triggered clustering

Responses of sensory neurons are often modeled using a weighted combination of rectified linear subunits. Since these subunits often cannot be measured directly, a flexible method is needed to infer their properties from the responses of downstream neurons. We present a method for maximum likelihood estimation of subunits by soft-clustering spike-triggered stimuli, and demonstrate its effectiveness in visual neurons. For parasol retinal ganglion cells in macaque retina, estimated subunits partitioned the receptive field into compact regions, likely representing aggregated bipolar cell inputs. Joint clustering revealed shared subunits between neighboring cells, producing a parsimonious population model. Closed-loop validation, using stimuli lying in the null space of the linear receptive field, revealed stronger nonlinearities in OFF cells than ON cells. Responses to natural images, jittered to emulate fixational eye movements, were accurately predicted by the subunit model. Finally, the generality of the approach was demonstrated in macaque V1 neurons.

New Features of Receptive Fields in Mouse Retina through Spike-triggered Covariance

Retinal ganglion cells (RGCs) encode various spatiotemporal features of visual information into spiking patterns. The receptive field (RF) of each RGC is usually calculated by spike-triggered average (STA), which is fast and easy to understand, but limited to simple and unimodal RFs. As an alternative, spike-triggered covariance (STC) has been proposed to characterize more complex patterns in RFs. This study compares STA and STC for the characterization of RFs and demonstrates that STC has an advantage over STA for identifying novel spatiotemporal features of RFs in mouse RGCs. We first classified mouse RGCs into ON, OFF, and ON/OFF cells according to their response to full-field light stimulus, and then investigated the spatiotemporal patterns of RFs with random checkerboard stimulation, using both STA and STC analysis. We propose five sub-types (T1–T5) in the STC of mouse RGCs together with their physiological implications. In particular, the relatively slow biphasic pattern (T1) could be related to excitatory inputs from bipolar cells. The transient biphasic pattern (T2) allows one to characterize complex patterns in RFs of ON/OFF cells. The other patterns (T3–T5), which are contrasting, alternating, and monophasic patterns, could be related to inhibitory inputs from amacrine cells. Thus, combining STA and STC and considering the proposed sub-types unveil novel characteristics of RFs in the mouse retina and offer a more holistic understanding of the neural coding mechanisms of mouse RGCs.

Temporal information loss in the macaque early visual system

Stimuli that modulate neuronal activity are not always detectable, indicating a loss of information between the modulated neurons and perception. To identify where in the macaque visual system information about periodic light modulations is lost, signal-to-noise ratios were compared across simulated cone photoreceptors, lateral geniculate nucleus (LGN) neurons, and perceptual judgements. Stimuli were drifting, threshold-contrast Gabor patterns on a photopic background. The sensitivity of LGN neurons, extrapolated to populations, was similar to the monkeys' at low temporal frequencies. At high temporal frequencies, LGN sensitivity exceeded the monkeys' and approached the upper bound set by cone photocurrents. These results confirm a loss of high-frequency information downstream of the LGN. However, this loss accounted for only about 5% of the total. Phototransduction accounted for essentially all of the rest. Together, these results show that low temporal frequency information is lost primarily between the cones and the LGN, whereas high-frequency information is lost primarily within the cones, with a small additional loss downstream of the LGN.

Ganglion Cells in Primate Retina Use Fuzzy Logic to Encode Complex Visual Receptive Fields

In most neurons, all spikes look alike. However, in this issue of Neuron, Rhoades et al. (2019) describe a ganglion cell in primate retina that reports visual input to different regions of its receptive field with distinct action potential waveforms.

Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina

The functions of the diverse retinal ganglion cell types in primates and the parallel visual pathways they initiate remain poorly understood. Here, unusual physiological and computational properties of the ON and OFF smooth monostratified ganglion cells are explored. Large-scale multi-electrode recordings from 48 macaque retinas revealed that these cells exhibit irregular receptive field structure composed of spatially segregated hotspots, quite different from the classic center-surround model of retinal receptive fields. Surprisingly, visual stimulation of different hotspots in the same cell produced spikes with subtly different spatiotemporal voltage signatures, consistent with a dendritic contribution to hotspot structure. Targeted visual stimulation and computational inference demonstrated strong nonlinear subunit properties associated with each hotspot, supporting a model in which the hotspots apply nonlinearities at a larger spatial scale than bipolar cells. These findings reveal a previously unreported nonlinear mechanism in the output of the primate retina that contributes to signaling spatial information.

Probing Computation in the Primate Visual System at Single-Cone Resolution

Daylight vision begins when light activates cone photoreceptors in the retina, creating spatial patterns of neural activity. These cone signals are then combined and processed in downstream neural circuits, ultimately producing visual perception. Recent technical advances have made it possible to deliver visual stimuli to the retina that probe this processing by the visual system at its elementary resolution of individual cones. Physiological recordings from nonhuman primate retinas reveal the spatial organization of cone signals in retinal ganglion cells, including how signals from cones of different types are combined to support both spatial and color vision. Psychophysical experiments with human subjects characterize the visual sensations evoked by stimulating a single cone, including the perception of color. Future combined physiological and psychophysical experiments focusing on probing the elementary visual inputs are likely to clarify how neural processing generates our perception of the visual world.

The dynamic receptive fields of retinal ganglion cells

Retinal ganglion cells (RGCs) were one of the first classes of sensory neurons to be described in terms of a receptive field (RF). Over the last six decades, our understanding of the diversity of RGC types and the nuances of their response properties has grown exponentially. We will review the current understanding of RGC RFs mostly from studies in mammals, but including work from other vertebrates as well. We will argue for a new paradigm that embraces the fluidity of RGC RFs with an eye toward the neuroethology of vision. Specifically, we will focus on (1) different methods for measuring RGC RFs, (2) RF models, (3) feature selectivity and the distinction between fluid and stable RF properties, and (4) ideas about the future of understanding RGC RFs.

Bioinspired Approach to Modeling Retinal Ganglion Cells Using System Identification Techniques

The processing capabilities of biological vision systems are still vastly superior to artificial vision, even though this has been an active area of research for over half a century. Current artificial vision techniques integrate many insights from biology yet they remain far-off the capabilities of animals and humans in terms of speed, power, and performance. A key aspect to modeling the human visual system is the ability to accurately model the behavior and computation within the retina. In particular, we focus on modeling the retinal ganglion cells (RGCs) as they convey the accumulated data of real world images as action potentials onto the visual cortex via the optic nerve. Computational models that approximate the processing that occurs within RGCs can be derived by quantitatively fitting the sets of physiological data using an input-output analysis where the input is a known stimulus and the output is neuronal recordings. Currently, these input-output responses are modeled using computational combinations of linear and nonlinear models that are generally complex and lack any relevance to the underlying biophysics. In this paper, we illustrate how system identification techniques, which take inspiration from biological systems, can accurately model retinal ganglion cell behavior, and are a viable alternative to traditional linear-nonlinear approaches.

Convis: A Toolbox to Fit and Simulate Filter-Based Models of Early Visual Processing

We developed Convis, a Python simulation toolbox for large scale neural populations which offers arbitrary receptive fields by 3D convolutions executed on a graphics card. The resulting software proves to be flexible and easily extensible in Python, while building on the PyTorch library (The Pytorch Project, 2017), which was previously used successfully in deep learning applications, for just-in-time optimization and compilation of the model onto CPU or GPU architectures. An alternative implementation based on Theano (Theano Development Team, 2016) is also available, although not fully supported. Through automatic differentiation, any parameter of a specified model can be optimized to approach a desired output which is a significant improvement over e.g., Monte Carlo or particle optimizations without gradients. We show that a number of models including even complex non-linearities such as contrast gain control and spiking mechanisms can be implemented easily. We show in this paper that we can in particular recreate the simulation results of a popular retina simulation software VirtualRetina (Wohrer and Kornprobst, 2009), with the added benefit of providing (1) arbitrary linear filters instead of the product of Gaussian and exponential filters and (2) optimization routines utilizing the gradients of the model. We demonstrate the utility of 3d convolution filters with a simple direction selective filter. Also we show that it is possible to optimize the input for a certain goal, rather than the parameters, which can aid the design of experiments as well as closed-loop online stimulus generation. Yet, Convis is more than a retina simulator. For instance it can also predict the response of V1 orientation selective cells. Convis is open source under the GPL-3.0 license and available from https://github.com/jahuth/convis/ with documentation at https://jahuth.github.io/convis/.

Distribution and diversity of intrinsically photosensitive retinal ganglion cells in tree shrew

Intrinsically photosensitive retinal ganglion cells (ipRGCs) mediate the pupillary light reflex, circadian entrainment, and may contribute to luminance and color perception. The diversity of ipRGCs varies from rodents to primates, suggesting differences in their contributions to retinal output. To further understand the variability in their organization and diversity across species, we used immunohistochemical methods to examine ipRGCs in tree shrew (Tupaia belangeri). Tree shrews share membership in the same clade, or evolutionary branch, as rodents and primates. They are highly visual, diurnal animals with a cone-dominated retina and a geniculo-cortical organization resembling that of primates. We identified cells with morphological similarities to M1 and M2 cells described previously in rodents and primates. M1-like cells typically had somas in the ganglion cell layer, with 23% displaced to the inner nuclear layer (INL). However, unlike M1 cells, they had bistratified dendritic fields ramifying in S1 and S5 that collectively tiled space. M2-like cells had dendritic fields restricted to S5 that were smaller and more densely branching. A novel third type of melanopsin immunopositive cell was identified. These cells had somata exclusively in the INL and monostratified dendritic fields restricted to S1 that tiled space. Surprisingly, these cells immunolabeled for tyrosine hydroxylase, a key component in dopamine synthesis. These cells immunolabeled for an RGC marker, not amacrine cell markers, suggesting that they are dopaminergic ipRGCs. We found no evidence for M4 or M5 ipRGCs, described previously in rodents. These results identify some organizational features of the ipRGC system that are canonical versus species-specific.

Interlayer Repulsion of Retinal Ganglion Cell Mosaics Regulates Spatial Organization of Functional Maps in the Visual Cortex

In higher mammals, orientation tuning of neurons is organized into a quasi-periodic pattern in the primary visual cortex. Our previous model studies suggested that the topography of cortical orientation maps may originate from moiré interference of ON and OFF retinal ganglion cell (RGC) mosaics, but did not account for how the consistent spatial period of maps could be achieved. Here we address this issue with two crucial findings on the development of RGC mosaics: first, homotypic local repulsion between RGCs can develop a long-range hexagonal periodicity. Second, heterotypic interaction restrains the alignment of ON and OFF mosaics, and generates a periodic interference pattern map with consistent spatial frequency. To validate our model, we quantitatively analyzed the RGC mosaics in cat data, and confirmed that the observed retinal mosaics showed evidence of heterotypic interactions, contrary to the previous view that ON and OFF mosaics are developed independently.SIGNIFICANCE STATEMENT Orientation map is one of the most studied functional maps in the brain, but it has remained unanswered how the consistent spatial periodicity of maps could be developed. In the current study, we address this issue with our developmental model for the retinal origin of orientation map. We showed that local repulsive interactions between retinal ganglion cells (RGCs) can develop a hexagonal periodicity in the RGC mosaics and restrict the alignment between ON and OFF mosaics, so that they generate a periodic pattern with consistent spatial frequency for both the RGC mosaics and the cortical orientation maps. Our results demonstrate that the organization of functional maps in visual cortex, including its structural consistency, may be constrained by a retinal blueprint.

Space-time codependence of retinal ganglion cells can be explained by novel and separable components of their receptive fields

Reverse correlation methods such as spike‐triggered averaging consistently identify the spatial center in the linear receptive fields (RFs) of retinal ganglion cells (GCs). However, the spatial antagonistic surround observed in classical experiments has proven more elusive. Tests for the antagonistic surround have heretofore relied on models that make questionable simplifying assumptions such as space–time separability and radial homogeneity/symmetry. We circumvented these, along with other common assumptions, and observed a linear antagonistic surround in 754 of 805 mouse GCs. By characterizing the RF's space–time structure, we found the overall linear RF's inseparability could be accounted for both by tuning differences between the center and surround and differences within the surround. Finally, we applied this approach to characterize spatial asymmetry in the RF surround. These results shed new light on the spatiotemporal organization of GC linear RFs and highlight a major contributor to its inseparability.

Image Sharpness and Contrast Tuning in the Early Visual Pathway

The center-surround organization of the receptive fields (RFs) of retinal ganglion cells highlights the presence of local contrast in visual stimuli. As RF of thalamic relay cells follow the same basic functional organization, it is often assumed that they contribute very little to alter the retinal output. However, in many species, thalamic relay cells largely outnumber their retinal inputs, which diverge to contact simultaneously several units at thalamic level. This gain in cell population as well as retinothalamic convergence opens the door to question how information about contrast is transformed at the thalamic stage. Here, we address this question using a realistic dynamic model of the retinothalamic circuit. Our results show that different components of the thalamic RF might implement filters that are analogous to two types of well-known image processing techniques to preserve the quality of a higher resolution version of the image on its way to the primary visual cortex.

Diversity in spatial scope of contrast adaptation among mouse retinal ganglion cells

Retinal ganglion cells adapt to changes in visual contrast by adjusting their response kinetics and sensitivity. While much work has focused on the time scales of these adaptation processes, less is known about the spatial scale of contrast adaptation. For example, do small, localized contrast changes affect a cell's signal processing across its entire receptive field? Previous investigations have provided conflicting evidence, suggesting that contrast adaptation occurs either locally within subregions of a ganglion cell's receptive field or globally over the receptive field in its entirety. Here, we investigated the spatial extent of contrast adaptation in ganglion cells of the isolated mouse retina through multielectrode-array recordings. We applied visual stimuli so that ganglion cell receptive fields contained regions where the average contrast level changed periodically as well as regions with constant average contrast level. This allowed us to analyze temporal stimulus integration and sensitivity separately for stimulus regions with and without contrast changes. We found that the spatial scope of contrast adaptation depends strongly on cell identity, with some ganglion cells displaying clear local adaptation, whereas others, in particular large transient ganglion cells, adapted globally to contrast changes. Thus, the spatial scope of contrast adaptation in mouse retinal ganglion cells appears to be cell-type specific. This could reflect differences in mechanisms of contrast adaptation and may contribute to the functional diversity of different ganglion cell types.NEW & NOTEWORTHY Understanding whether adaptation of a neuron in a sensory system can occur locally inside the receptive field or whether it always globally affects the entire receptive field is important for understanding how the neuron processes complex sensory stimuli. For mouse retinal ganglion cells, we here show that both local and global contrast adaptation exist and that this diversity in spatial scope can contribute to the functional diversity of retinal ganglion cell types.

Inference of neuronal functional circuitry with spike-triggered non-negative matrix factorization

Neurons in sensory systems often pool inputs over arrays of presynaptic cells, giving rise to functional subunits inside a neuron’s receptive field. The organization of these subunits provides a signature of the neuron’s presynaptic functional connectivity and determines how the neuron integrates sensory stimuli. Here we introduce the method of spike-triggered non-negative matrix factorization for detecting the layout of subunits within a neuron’s receptive field. The method only requires the neuron’s spiking responses under finely structured sensory stimulation and is therefore applicable to large populations of simultaneously recorded neurons. Applied to recordings from ganglion cells in the salamander retina, the method retrieves the receptive fields of presynaptic bipolar cells, as verified by simultaneous bipolar and ganglion cell recordings. The identified subunit layouts allow improved predictions of ganglion cell responses to natural stimuli and reveal shared bipolar cell input into distinct types of ganglion cells.

How a neuron integrates sensory information requires knowledge about its functional presynaptic connections. Here the authors report a new method using non-negative matrix factorization to identify the layout of presynaptic bipolar cell inputs onto retinal ganglion cells and predict their responses to natural stimuli.

Cell type-specific changes in retinal ganglion cell function induced by rod death and cone reorganization in rats

We have determined the impact of rod death and cone reorganization on the spatiotemporal receptive fields (RFs) and spontaneous activity of distinct retinal ganglion cell (RGC) types. We compared RGC function between healthy and retinitis pigmentosa (RP) model rats (S334ter-3) at a time when nearly all rods were lost but cones remained. This allowed us to determine the impact of rod death on cone-mediated visual signaling, a relevant time point because the diagnosis of RP frequently occurs when patients are nightblind but daytime vision persists. Following rod death, functionally distinct RGC types persisted; this indicates that parallel processing of visual input remained largely intact. However, some properties of cone-mediated responses were altered ubiquitously across RGC types, such as prolonged temporal integration and reduced spatial RF area. Other properties changed in a cell type-specific manner, such as temporal RF shape (dynamics), spontaneous activity, and direction selectivity. These observations identify the extent of functional remodeling in the retina following rod death but before cone loss. They also indicate new potential challenges to restoring normal vision by replacing lost rod photoreceptors.NEW & NOTEWORTHY This study provides novel and therapeutically relevant insights to retinal function following rod death but before cone death. To determine changes in retinal output, we used a large-scale multielectrode array to simultaneously record from hundreds of retinal ganglion cells (RGCs). These recordings of large-scale neural activity revealed that following the death of all rods, functionally distinct RGCs remain. However, the receptive field properties and spontaneous activity of these RGCs are altered in a cell type-specific manner.

Using Matrix and Tensor Factorizations for the Single-Trial Analysis of Population Spike Trains

Advances in neuronal recording techniques are leading to ever larger numbers of simultaneously monitored neurons. This poses the important analytical challenge of how to capture compactly all sensory information that neural population codes carry in their spatial dimension (differences in stimulus tuning across neurons at different locations), in their temporal dimension (temporal neural response variations), or in their combination (temporally coordinated neural population firing). Here we investigate the utility of tensor factorizations of population spike trains along space and time. These factorizations decompose a dataset of single-trial population spike trains into spatial firing patterns (combinations of neurons firing together), temporal firing patterns (temporal activation of these groups of neurons) and trial-dependent activation coefficients (strength of recruitment of such neural patterns on each trial). We validated various factorization methods on simulated data and on populations of ganglion cells simultaneously recorded in the salamander retina. We found that single-trial tensor space-by-time decompositions provided low-dimensional data-robust representations of spike trains that capture efficiently both their spatial and temporal information about sensory stimuli. Tensor decompositions with orthogonality constraints were the most efficient in extracting sensory information, whereas non-negative tensor decompositions worked well even on non-independent and overlapping spike patterns, and retrieved informative firing patterns expressed by the same population in response to novel stimuli. Our method showed that populations of retinal ganglion cells carried information in their spike timing on the ten-milliseconds-scale about spatial details of natural images. This information could not be recovered from the spike counts of these cells. First-spike latencies carried the majority of information provided by the whole spike train about fine-scale image features, and supplied almost as much information about coarse natural image features as firing rates. Together, these results highlight the importance of spike timing, and particularly of first-spike latencies, in retinal coding.

Subretinal electrical stimulation reveals intact network activity in the blind mouse retina

Retinal degeneration (rd) leads to progressive photoreceptor cell death, resulting in vision loss. Stimulation of the inner-retinal neurons by neuroprosthetic implants is one of the clinically approved vision-restoration strategies, providing basic visual percepts to blind patients. However, little is understood as to what degree the degenerating retinal circuitry and the resulting aberrant hyperactivity may prevent the stimulation of physiological electrical activity. Therefore, we electrically stimulated ex vivo retinas from wild-type (wt; C57BL/6J) and blind (rd10 and rd1) mice using an implantable subretinal microchip and simultaneously recorded and analyzed the retinal ganglion cell (RGC) output with a flexible microelectrode array. We found that subretinal anodal stimulation of the rd10 retina and wt retina evoked similar spatiotemporal RGC-spiking patterns. In both retinas, electrically stimulated ON and a small percentage of OFF RGC responses were detected. The spatial selectivity of the retinal network to electrical stimuli reveals an intact underlying network with a median receptive-field center of 350 μm in both retinas. An antagonistic surround is activated by stimulation with large electrode fields. However, in rd10 and to a higher percentage, in rd1 retinas, rhythmic and spatially unconfined RGC patterns were evoked by anodal or by cathodal electrical stimuli. Our findings demonstrate that the surviving retinal circuitry in photoreceptor-degenerated retinas is preserved in a way allowing for the stimulation of temporally diverse and spatially confined RGC activity. Future vision restoration strategies can build on these results but need to avoid evoking the easily inducible rhythmic activity in some retinal circuits.

The Thalamus as a Low Pass Filter: Filtering at the Cellular Level does Not Equate with Filtering at the Network Level

In the mammalian central nervous system, most sensory information passes through primary sensory thalamic nuclei, however the consequence of this remains unclear. Various propositions exist, likening the thalamus to a gate, or a high pass filter. Here, using a simple leaky integrate and fire model based on physiological parameters, we show that the thalamus behaves akin to a low pass filter. Specifically, as individual cells in the thalamus rely on consistent drive to spike, stimuli that is rapidly and continuously changing over time such that it activates sensory cells with different receptive fields are unable to drive thalamic spiking. This means that thalamic encoding is robust to sensory noise, however it induces a lag in sensory representation. Thus, the thalamus stabilizes encoding of sensory information, at the cost of response rate.

Spatio-temporal dynamics of impulse responses to figure motion in optic flow neurons

White noise techniques have been used widely to investigate sensory systems in both vertebrates and invertebrates. White noise stimuli are powerful in their ability to rapidly generate data that help the experimenter decipher the spatio-temporal dynamics of neural and behavioral responses. One type of white noise stimuli, maximal length shift register sequences (m-sequences), have recently become particularly popular for extracting response kernels in insect motion vision. We here use such m-sequences to extract the impulse responses to figure motion in hoverfly lobula plate tangential cells (LPTCs). Figure motion is behaviorally important and many visually guided animals orient towards salient features in the surround. We show that LPTCs respond robustly to figure motion in the receptive field. The impulse response is scaled down in amplitude when the figure size is reduced, but its time course remains unaltered. However, a low contrast stimulus generates a slower response with a significantly longer time-to-peak and half-width. Impulse responses in females have a slower time-to-peak than males, but are otherwise similar. Finally we show that the shapes of the impulse response to a figure and a widefield stimulus are very similar, suggesting that the figure response could be coded by the same input as the widefield response.

Simultaneous recording of mouse retinal ganglion cells during epiretinal or subretinal stimulation

We compared response patterns and electrical receptive fields (ERF) of retinal ganglion cells (RGCs) during epiretinal and subretinal electrical stimulation of isolated mouse retina. Retinas were stimulated with an array of 3200 independently controllable electrodes. Four response patterns were observed: a burst of activity immediately after stimulation (Type I cells, Vision Research (2008), 48, 1562-1568), delayed bursts beginning >25ms after stimulation (Type II), a combination of both (Type III), and inhibition of ongoing spike activity. Type I responses were produced more often by epiretinal than subretinal stimulation whereas delayed and inhibitory responses were evoked more frequently by subretinal stimulation. Response latencies were significantly shorter with epiretinal than subretinal stimulation. These data suggest that subretinal stimulation is more effective at activating intraretinal circuits than epiretinal stimulation. There was no significant difference in charge threshold between subretinal and epiretinal configurations. ERFs were defined by the stimulating array surface area that successfully stimulated spikes in an RGC. ERFs were complex in shape, similar to receptive fields mapped with light. ERF areas were significantly smaller with subretinal than epiretinal stimulation. This may reflect the greater distance between stimulating electrodes and RGCs in the subretinal configuration. ERFs for immediate and delayed responses mapped within the same Type III cells differed in shape and size, consistent with different sites and mechanisms for generating these two response types.

Functional architecture of the retina: development and disease

Structure and function are highly correlated in the vertebrate retina, a sensory tissue that is organized into cell layers with microcircuits working in parallel and together to encode visual information. All vertebrate retinas share a fundamental plan, comprising five major neuronal cell classes with cell body distributions and connectivity arranged in stereotypic patterns. Conserved features in retinal design have enabled detailed analysis and comparisons of structure, connectivity and function across species. Each species, however, can adopt structural and/or functional retinal specializations, implementing variations to the basic design in order to satisfy unique requirements in visual function. Recent advances in molecular tools, imaging and electrophysiological approaches have greatly facilitated identification of the cellular and molecular mechanisms that establish the fundamental organization of the retina and the specializations of its microcircuits during development. Here, we review advances in our understanding of how these mechanisms act to shape structure and function at the single cell level, to coordinate the assembly of cell populations, and to define their specific circuitry. We also highlight how structure is rearranged and function is disrupted in disease, and discuss current approaches to re-establish the intricate functional architecture of the retina.

A polyaxonal amacrine cell population in the primate retina

Amacrine cells are the most diverse and least understood cell class in the retina. Polyaxonal amacrine cells (PACs) are a unique subset identified by multiple long axonal processes. To explore their functional properties, populations of PACs were identified by their distinctive radially propagating spikes in large-scale high-density multielectrode recordings of isolated macaque retina. One group of PACs exhibited stereotyped functional properties and receptive field mosaic organization similar to that of parasol ganglion cells. These PACs had receptive fields coincident with their dendritic fields, but much larger axonal fields, and slow radial spike propagation. They also exhibited ON-OFF light responses, transient response kinetics, sparse and coordinated firing during image transitions, receptive fields with antagonistic surrounds and fine spatial structure, nonlinear spatial summation, and strong homotypic neighbor electrical coupling. These findings reveal the functional organization and collective visual signaling by a distinctive, high-density amacrine cell population.

Statistical wiring of thalamic receptive fields optimizes spatial sampling of the retinal image

It is widely assumed that mosaics of retinal ganglion cells establish the optimal representation of visual space. However, relay cells in the visual thalamus often receive convergent input from several retinal afferents and, in cat, outnumber ganglion cells. To explore how the thalamus transforms the retinal image, we built a model of the retinothalamic circuit using experimental data and simple wiring rules. The model shows how the thalamus might form a resampled map of visual space with the potential to facilitate detection of stimulus position in the presence of sensor noise. Bayesian decoding conducted with the model provides support for this scenario. Despite its benefits, however, resampling introduces image blur, thus impairing edge perception. Whole-cell recordings obtained in vivo suggest that this problem is mitigated by arrangements of excitation and inhibition within the receptive field that effectively boost contrast borders, much like strategies used in digital image processing.

Retinal representation of the elementary visual signal

The propagation of visual signals from individual cone photoreceptors through parallel neural circuits was examined in the primate retina. Targeted stimulation of individual cones was combined with simultaneous recording from multiple retinal ganglion cells of identified types. The visual signal initiated by an individual cone produced strong responses with different kinetics in three of the four numerically dominant ganglion cell types. The magnitude and kinetics of light responses in each ganglion cell varied nonlinearly with stimulus strength but in a manner that was independent of the cone of origin after accounting for the overall input strength of each cone. Based on this property of independence, the receptive field profile of an individual ganglion cell could be well estimated from responses to stimulation of each cone individually. Together, these findings provide a quantitative account of how elementary visual inputs form the ganglion cell receptive field.