Information processing in the primate retina: circuitry and coding

Neural activity of retinal ganglion cells under continuous, dynamically-modulated high frequency electrical stimulation

Objective.Current retinal prosthetics are limited in their ability to precisely control firing patterns of functionally distinct retinal ganglion cell (RGC) types. The aim of this study was to characterise RGC responses to continuous, kilohertz-frequency-varying stimulation to assess its utility in controlling RGC activity.Approach.We usedin vitropatch-clamp experiments to assess electrically-evoked ON and OFF RGC responses to frequency-varying pulse train sequences. In each sequence, the stimulation amplitude was kept constant while the stimulation frequency (0.5-10 kHz) was changed every 40 ms, in either a linearly increasing, linearly decreasing or randomised manner. The stimulation amplitude across sequences was increased from 10 to 300µA.Main results.We found that continuous stimulation without rest periods caused complex and irreproducible stimulus-response relationships, primarily due to strong stimulus-induced response adaptation and influence of the preceding stimulus frequency on the response to a subsequent stimulus. In addition, ON and OFF populations showed different sensitivities to continuous, frequency-varying pulse trains, with OFF cells generally exhibiting more dependency on frequency changes within a sequence. Finally, the ability to maintain spiking behaviour to continuous stimulation in RGCs significantly reduced over longer stimulation durations irrespective of the frequency order.Significance.This study represents an important step in advancing and understanding the utility of continuous frequency modulation in controlling functionally distinct RGCs. Our results indicate that continuous, kHz-frequency-varying stimulation sequences provide very limited control of RGC firing patterns due to inter-dependency between adjacent frequencies and generally, different RGC types do not display different frequency preferences under such stimulation conditions. For future stimulation strategies using kHz frequencies, careful consideration must be given to design appropriate pauses in stimulation, stimulation frequency order and the length of continuous stimulation duration.

Applications of information geometry to spiking neural network activity

The space of possible behaviors that complex biological systems may exhibit is unimaginably vast, and these systems often appear to be stochastic, whether due to variable noisy environmental inputs or intrinsically generated chaos. The brain is a prominent example of a biological system with complex behaviors. The number of possible patterns of spikes emitted by a local brain circuit is combinatorially large, although the brain may not make use of all of them. Understanding which of these possible patterns are actually used by the brain, and how those sets of patterns change as properties of neural circuitry change is a major goal in neuroscience. Recently, tools from information geometry have been used to study embeddings of probabilistic models onto a hierarchy of model manifolds that encode how model outputs change as a function of their parameters, giving a quantitative notion of "distances" between outputs. We apply this method to a network model of excitatory and inhibitory neural populations to understand how the competition between membrane and synaptic response timescales shapes the network's information geometry. The hyperbolic embedding allows us to identify the statistical parameters to which the model behavior is most sensitive, and demonstrate how the ranking of these coordinates changes with the balance of excitation and inhibition in the network.

An actor-model framework for visual sensory encoding

A fundamental challenge in neuroengineering is determining a proper artificial input to a sensory system that yields the desired perception. In neuroprosthetics, this process is known as artificial sensory encoding, and it holds a crucial role in prosthetic devices restoring sensory perception in individuals with disabilities. For example, in visual prostheses, one key aspect of artificial image encoding is to downsample images captured by a camera to a size matching the number of inputs and resolution of the prosthesis. Here, we show that downsampling an image using the inherent computation of the retinal network yields better performance compared to learning-free downsampling methods. We have validated a learning-based approach (actor-model framework) that exploits the signal transformation from photoreceptors to retinal ganglion cells measured in explanted mouse retinas. The actor-model framework generates downsampled images eliciting a neuronal response in-silico and ex-vivo with higher neuronal reliability than the one produced by a learning-free approach. During the learning process, the actor network learns to optimize contrast and the kernel's weights. This methodological approach might guide future artificial image encoding strategies for visual prostheses. Ultimately, this framework could be applicable for encoding strategies in other sensory prostheses such as cochlear or limb.

Population encoding of stimulus features along the visual hierarchy

The retina and primary visual cortex (V1) both exhibit diverse neural populations sensitive to diverse visual features. Yet it remains unclear how neural populations in each area partition stimulus space to span these features. One possibility is that neural populations are organized into discrete groups of neurons, with each group signaling a particular constellation of features. Alternatively, neurons could be continuously distributed across feature-encoding space. To distinguish these possibilities, we presented a battery of visual stimuli to the mouse retina and V1 while measuring neural responses with multi-electrode arrays. Using machine learning approaches, we developed a manifold embedding technique that captures how neural populations partition feature space and how visual responses correlate with physiological and anatomical properties of individual neurons. We show that retinal populations discretely encode features, while V1 populations provide a more continuous representation. Applying the same analysis approach to convolutional neural networks that model visual processing, we demonstrate that they partition features much more similarly to the retina, indicating they are more like big retinas than little brains.

Synaptic Origins of the Complex Receptive Field Structure in Primate Smooth Monostratified Retinal Ganglion Cells

Considerable progress has been made in studying the receptive fields of the most common primate retinal ganglion cell (RGC) types, such as parasol RGCs. Much less is known about the rarer primate RGC types and the circuitry that gives rise to noncanonical receptive field structures. The goal of this study was to analyze synaptic inputs to smooth monostratified RGCs to determine the origins of their complex spatial receptive fields, which contain isolated regions of high sensitivity called "hotspots." Interestingly, smooth monostratified RGCs co-stratify with the well-studied parasol RGCs and are thus constrained to receiving input from bipolar and amacrine cells with processes sharing the same layer, raising the question of how their functional differences originate. Through 3D reconstructions of circuitry and synapses onto ON smooth monostratified and ON parasol RGCs from central macaque retina, we identified four distinct sampling strategies employed by smooth and parasol RGCs to extract diverse response properties from co-stratifying bipolar and amacrine cells. The two RGC types differed in the proportion of amacrine cell input, relative contributions of co-stratifying bipolar cell types, amount of synaptic input per bipolar cell, and spatial distribution of bipolar cell synapses. Our results indicate that the smooth RGC's complex receptive field structure arises through spatial asymmetries in excitatory bipolar cell input which formed several discrete clusters comparable with physiologically measured hotspots. Taken together, our results demonstrate how the striking differences between ON parasol and ON smooth monostratified RGCs arise from distinct strategies for sampling a common set of synaptic inputs.

A dynamical adaptation model of visual spatiotemporal processing in cones and horizontal cells

In this work, we introduce a phenomenological model for the cone-horizontal cell assembly, including spatial integration and formation of receptive field-like structures. The model extends our previous dynamical adaptation description with gain control accounting for processes in single cones, valid in severe nonlinear regimes. Here, a spatially extended feedback mechanism is introduced from horizontal cells to cones to account for experimental evidence, contributing thus to the development of a center-surround receptive field in cones and downstream bipolar cells. Feedback gain is defined on different spatial scales by weighting spatial filters: a short scale accounting for cone input to the feedback mechanism and a large scale driven by the syncytium characteristics of horizontal cells. A third spatial scale improves the description, mimicking neighboring cone-cone coupling. This overall spatial integration couples to temporal signal processing, thus obtaining a spatiotemporal model of outer retina responses capable of reproducing nonlinear features in both dimensions (space and time). The model was tested and validated using measurements on horizontal cells from different studies, with excellent performance. By its phenomenological nature, signal processing properties are inferred from model parameters. The model can be used in arrays of processing units with more complex incoming patterns of visual stimuli.

Decomposition of retinal ganglion cell electrical images for cell type and functional inference

Identifying neuronal cell types and their biophysical properties based on their extracellular electrical features is a major challenge for experimental neuroscience and the development of high-resolution brain-machine interfaces. One example is identification of retinal ganglion cell (RGC) types and their visual response properties, which is fundamental for developing future electronic implants that can restore vision. The electrical image (EI) of a RGC, or the mean spatio-temporal voltage footprint of its recorded spikes on a high-density electrode array, contains substantial information about its anatomical, morphological, and functional properties. However, the analysis of these properties is complex because of the high-dimensional nature of the EI. We present a novel optimization-based algorithm to decompose electrical image into a low-dimensional, biophysically-based representation: the temporally-shifted superposition of three learned basis waveforms corresponding to spike waveforms produced in the somatic, dendritic and axonal cellular compartments. Large-scale multi-electrode recordings from the macaque retina were used to test the effectiveness of the decomposition. The decomposition accurately localized the somatic and dendritic compartments of the cell. The imputed dendritic fields of RGCs correctly predicted the location and shape of their visual receptive fields. The inferred waveform amplitudes and shapes accurately identified the four major primate RGC types (ON and OFF midget and parasol cells), a substantial advance. Together, these findings may contribute to more accurate inference of RGC types and their original light responses in the degenerated retina, with possible implications for other electrical imaging applications.

Brain activity characteristics of RGB stimulus: an EEG study

The perception of color is a fundamental cognitive feature of our psychological experience, with an essential role in many aspects of human behavior. Several studies used magnetoencephalography, functional magnetic resonance imaging, and electroencephalography (EEG) approaches to investigate color perception. Their methods includes the event-related potential and spectral power activity of different color spaces, such as Derrington-Krauskopf-Lennie and red-green-blue (RGB), in addition to exploring the psychological and emotional effects of colors. However, we found insufficient studies in RGB space that considered combining all aspects of EEG signals. Thus, in the present study, focusing on RGB stimuli and using a data-driven approach, we investigated significant differences in the perception of colors. Our findings show that beta oscillation of green compared to red and blue colors occurs in early sensory periods with a latency shifting in the occipital region. Furthermore, in the occipital region, the theta power of the blue color decreases noticeably compared to the other colors. Concurrently, in the prefrontal area, we observed an increase in phase consistency in response to the green color, while the blue color showed a decrease. Therefore, our results can be used to interpret the brain activity mechanism of color perception in RGB color space and to choose suitable colors for more efficient performance in cognitive activities.

An ON-type direction-selective ganglion cell in primate retina

To maintain a stable and clear image of the world, our eyes reflexively follow the direction in which a visual scene is moving. Such gaze-stabilization mechanisms reduce image blur as we move in the environment. In non-primate mammals, this behaviour is initiated by retinal output neurons called ON-type direction-selective ganglion cells (ON-DSGCs), which detect the direction of image motion and transmit signals to brainstem nuclei that drive compensatory eye movements1. However, ON-DSGCs have not yet been identified in the retina of primates, raising the possibility that this reflex is mediated by cortical visual areas. Here we mined single-cell RNA transcriptomic data from primate retina to identify a candidate ON-DSGC. We then combined two-photon calcium imaging, molecular identification and morphological analysis to reveal a population of ON-DSGCs in the macaque retina. The morphology, molecular signature and GABA (γ-aminobutyric acid)-dependent mechanisms that underlie direction selectivity in primate ON-DSGCs are highly conserved with those in other mammals. We further identify a candidate ON-DSGC in human retina. The presence of ON-DSGCs in primates highlights the need to examine the contribution of subcortical retinal mechanisms to normal and aberrant gaze stabilization in the developing and mature visual system.

Fixational Eye Movements Enhance the Precision of Visual Information Transmitted by the Primate Retina

Fixational eye movements alter the number and timing of spikes transmitted from the retina to the brain, but whether these changes enhance or degrade the visual signal is unclear. To quantify this, we developed a Bayesian method for reconstructing natural images from the recorded spikes of hundreds of macaque retinal ganglion cells (RGCs) of the major cell types, combining a likelihood model for RGC light responses with the natural image prior implicitly embedded in an artificial neural network optimized for denoising. The method matched or surpassed the performance of previous reconstruction algorithms, and provided an interpretable framework for characterizing the retinal signal. Reconstructions were improved with artificial stimulus jitter that emulated fixational eye movements, even when the jitter trajectory was inferred from retinal spikes. Reconstructions were degraded by small artificial perturbations of spike times, revealing more precise temporal encoding than suggested by previous studies. Finally, reconstructions were substantially degraded when derived from a model that ignored cell-to-cell interactions, indicating the importance of stimulus-evoked correlations. Thus, fixational eye movements enhance the precision of the retinal representation.

Retinal ganglion cells encode differently in the myopic mouse retina?

The etiology of myopia remains unclear. This study investigated whether retinal ganglion cells (RGCs) in the myopic retina encode visual information differently from the normal retina and to determine the role of Connexin (Cx) 36 in this process. Generalized linear models (GLMs), which can capture stimulus-dependent changes in real neurons with spike timing precision and reliability, were used to predict RGCs responses to focused and defocused images in the retinas of wild-type (normal) and Lens-Induced Myopia (LIM) mice. As the predominant subunit of gap junctions in the mouse retina and a plausible modulator in myopia development, Cx36 knockout (KO) mice were used as a control for an intact retinal circuit. The kinetics of excitatory postsynaptic currents (EPSCs) of a single αRGC could reflect projection of both focused and defocused images in the retinas of normal and LIM, but not in the Cx36 knockout mice. Poisson GLMs revealed that RGC encoding of visual stimuli in the LIM retina was similar to that of the normal retina. In the LIM retinas, the linear-Gaussian GLM model with offset was a better fit for predicting the spike count under a focused image than the defocused image. Akaike information criterion (AIC) indicated that nonparametric GLM (np-GLM) model predicted focused/defocused images better in both LIM and normal retinas. However, the spike counts in 33% of αRGCs in LIM retinas were better fitted by exponential GLM (exp-GLM) under defocus, compared to only 13% αRGCs in normal retinas. The differences in encoding performance between LIM and normal retinas indicated the possible amendment and plasticity of the retinal circuit in myopic retinas. The absence of a similar response between Cx36 KO mice and normal/LIM mice might suggest that Cx36, which is associated with myopia development, plays a role in encoding focused and defocused images.

On the Functional Role of Gamma Synchronization in the Retinogeniculate System of the Cat

Fast gamma oscillations, generated within the retina, and transmitted to the cortex via the lateral geniculate nucleus (LGN), are thought to carry information about stimulus size and continuity. This hypothesis relies mainly on studies conducted under anesthesia and the extent to which it holds under more naturalistic conditions remains unclear. Using multielectrode recordings of spiking activity in the retina and the LGN of both male and female cats, we show that visually driven gamma oscillations are absent for awake states and are highly dependent on halothane (or isoflurane). Under ketamine, responses were nonoscillatory, as in the awake condition. Response entrainment to the monitor refresh was commonly observed up to 120 Hz and was superseded by the gamma oscillatory responses induced by halothane. Given that retinal gamma oscillations are contingent on halothane anesthesia and absent in the awake cat, such oscillations should be considered artifactual, thus playing no functional role in vision.SIGNIFICANCE STATEMENT Gamma rhythms have been proposed to be a robust encoding mechanism critical for visual processing. In the retinogeniculate system of the cat, many studies have shown gamma oscillations associated with responses to static stimuli. Here, we extend these observations to dynamic stimuli. An unexpected finding was that retinal gamma responses strongly depend on halothane concentration levels and are absent in the awake cat. These results weaken the notion that gamma in the retina is relevant for vision. Notably, retinal gamma shares many of the properties of cortical gamma. In this respect, oscillations induced by halothane in the retina may serve as a valuable preparation, although artificial, for studying oscillatory dynamics.

Population encoding of stimulus features along the visual hierarchy

The retina and primary visual cortex (V1) both exhibit diverse neural populations sensitive to diverse visual features. Yet it remains unclear how neural populations in each area partition stimulus space to span these features. One possibility is that neural populations are organized into discrete groups of neurons, with each group signaling a particular constellation of features. Alternatively, neurons could be continuously distributed across feature-encoding space. To distinguish these possibilities, we presented a battery of visual stimuli to mouse retina and V1 while measuring neural responses with multi-electrode arrays. Using machine learning approaches, we developed a manifold embedding technique that captures how neural populations partition feature space and how visual responses correlate with physiological and anatomical properties of individual neurons. We show that retinal populations discretely encode features, while V1 populations provide a more continuous representation. Applying the same analysis approach to convolutional neural networks that model visual processing, we demonstrate that they partition features much more similarly to the retina, indicating they are more like big retinas than little brains.

Large-scale interrogation of retinal cell functions by 1-photon light-sheet microscopy

Visual processing in the retina depends on the collective activity of large ensembles of neurons organized in different layers. Current techniques for measuring activity of layer-specific neural ensembles rely on expensive pulsed infrared lasers to drive 2-photon activation of calcium-dependent fluorescent reporters. We present a 1-photon light-sheet imaging system that can measure the activity in hundreds of neurons in the ex vivo retina over a large field of view while presenting visual stimuli. This allows for a reliable functional classification of different retinal cell types. We also demonstrate that the system has sufficient resolution to image calcium entry at individual synaptic release sites across the axon terminals of dozens of simultaneously imaged bipolar cells. The simple design, large field of view, and fast image acquisition make this a powerful system for high-throughput and high-resolution measurements of retinal processing at a fraction of the cost of alternative approaches.

Retinal self-organization: a model of retinal ganglion cells and starburst amacrine cells mosaic formation

Individual retinal cell types exhibit semi-regular spatial patterns called retinal mosaics. Retinal ganglion cells (RGCs) and starburst amacrine cells (SACs) are known to exhibit such layouts. Mechanisms responsible for the formation of mosaics are not well understood but follow three main principles: (i) homotypic cells prevent nearby cells from adopting the same type, (ii) cell tangential migration and (iii) cell death. Alongside experiments in mouse, we use BioDynaMo, an agent-based simulation framework, to build a detailed and mechanistic model of mosaic formation. We investigate the implications of the three theories for RGC's mosaic formation. We report that the cell migration mechanism yields the most regular mosaics. In addition, we propose that low-density RGC type mosaics exhibit on average low regularities, and thus we question the relevance of regular spacing as a criterion for a group of RGCs to form a RGC type. We investigate SAC mosaics formation and interactions between the ganglion cell layer (GCL) and inner nuclear layer (INL) populations. We propose that homotypic interactions between the GCL and INL populations during mosaics creation are required to reproduce the observed SAC mosaics' characteristics. This suggests that the GCL and INL populations of SACs might not be independent during retinal development.

A general pattern of non-spiking neuron dynamics under the effect of potassium and calcium channel modifications

Electrical activity of excitable cells results from ion exchanges through cell membranes, so that genetic or epigenetic changes in genes encoding ion channels are likely to affect neuronal electrical signaling throughout the brain. There is a large literature on the effect of variations in ion channels on the dynamics of spiking neurons that represent the main type of neurons found in the vertebrate nervous systems. Nevertheless, non-spiking neurons are also ubiquitous in many nervous tissues and play a critical role in the processing of some sensory systems. To our knowledge, however, how conductance variations affect the dynamics of non-spiking neurons has never been assessed. Based on experimental observations reported in the biological literature and on mathematical considerations, we first propose a phenotypic classification of non-spiking neurons. Then, we determine a general pattern of the phenotypic evolution of non-spiking neurons as a function of changes in calcium and potassium conductances. Furthermore, we study the homeostatic compensatory mechanisms of ion channels in a well-posed non-spiking retinal cone model. We show that there is a restricted range of ion conductance values for which the behavior and phenotype of the neuron are maintained. Finally, we discuss the implications of the phenotypic changes of individual cells at the level of neuronal network functioning of the C. elegans worm and the retina, which are two non-spiking nervous tissues composed of neurons with various phenotypes.

New insights into binocular rivalry from the reconstruction of evolving percepts using model network dynamics

When the two eyes are presented with highly distinct stimuli, the resulting visual percept generally switches every few seconds between the two monocular images in an irregular fashion, giving rise to a phenomenon known as binocular rivalry. While a host of theoretical studies have explored potential mechanisms for binocular rivalry in the context of evoked model dynamics in response to simple stimuli, here we investigate binocular rivalry directly through complex stimulus reconstructions based on the activity of a two-layer neuronal network model with competing downstream pools driven by disparate monocular stimuli composed of image pixels. To estimate the dynamic percept, we derive a linear input-output mapping rooted in the non-linear network dynamics and iteratively apply compressive sensing techniques for signal recovery. Utilizing a dominance metric, we are able to identify when percept alternations occur and use data collected during each dominance period to generate a sequence of percept reconstructions. We show that despite the approximate nature of the input-output mapping and the significant reduction in neurons downstream relative to stimulus pixels, the dominant monocular image is well-encoded in the network dynamics and improvements are garnered when realistic spatial receptive field structure is incorporated into the feedforward connectivity. Our model demonstrates gamma-distributed dominance durations and well obeys Levelt's four laws for how dominance durations change with stimulus strength, agreeing with key recurring experimental observations often used to benchmark rivalry models. In light of evidence that individuals with autism exhibit relatively slow percept switching in binocular rivalry, we corroborate the ubiquitous hypothesis that autism manifests from reduced inhibition in the brain by systematically probing our model alternation rate across choices of inhibition strength. We exhibit sufficient conditions for producing binocular rivalry in the context of natural scene stimuli, opening a clearer window into the dynamic brain computations that vary with the generated percept and a potential path toward further understanding neurological disorders.

High-throughput sequencing of single neuron projections reveals spatial organization in the olfactory cortex

In most sensory modalities, neuronal connectivity reflects behaviorally relevant stimulus features, such as spatial location, orientation, and sound frequency. By contrast, the prevailing view in the olfactory cortex, based on the reconstruction of dozens of neurons, is that connectivity is random. Here, we used high-throughput sequencing-based neuroanatomical techniques to analyze the projections of 5,309 mouse olfactory bulb and 30,433 piriform cortex output neurons at single-cell resolution. Surprisingly, statistical analysis of this much larger dataset revealed that the olfactory cortex connectivity is spatially structured. Single olfactory bulb neurons targeting a particular location along the anterior-posterior axis of piriform cortex also project to matched, functionally distinct, extra-piriform targets. Moreover, single neurons from the targeted piriform locus also project to the same matched extra-piriform targets, forming triadic circuit motifs. Thus, as in other sensory modalities, olfactory information is routed at early stages of processing to functionally diverse targets in a coordinated manner.

Single-cell RNA sequencing reveals a landscape and targeted treatment of ferroptosis in retinal ischemia/reperfusion injury

BACKGROUND

The aim of this study was to establish a complete retinal cell atlas of ischemia-reperfusion injury by single-cell RNA sequencing, and to explore the underlying mechanism of retinal ischemia-reperfusion injury in mice.

METHODS

Single-cell RNA sequencing was used to evaluate changes in the mouse retinal ischemia reperfusion model. In vivo and in vitro experiments were performed to verify the protective effect of inhibiting ferroptosis in retinal ischemia-reperfusion injury.

RESULTS

After ischemia-reperfusion injury, retinal cells were significantly reduced, accompanied by the activation of myeloid and a large amount of blood-derived immune cell infiltration. The IFNG, MAPK and NFKB signaling pathways in retinal neuronal cells, together with the TNF signaling pathway in myeloid give rise to a strong inflammatory response in the I/R state. Besides, the expression of genes implicating iron metabolism, oxidative stress and multiple programed cell death pathways have changed in cell subtypes described above. Especially the ferroptosis-related genes and blocking this process could apparently alleviate the inflammatory immune responses and enhance retinal ganglion cells survival.

CONCLUSIONS

We established a comprehensive landscape of mouse retinal ischemia-reperfusion injury at the single-cell level, revealing the important role of ferroptosis during this injury, and targeted inhibition of ferroptosis can effectively protect retinal structure and function.

Implications of Neural Plasticity in Retinal Prosthesis

Retinal degenerative diseases such as retinitis pigmentosa cause a progressive loss of photoreceptors that eventually prevents the affected person from perceiving visual sensations. The absence of a visual input produces a neural rewiring cascade that propagates along the visual system. This remodeling occurs first within the retina. Then, subsequent neuroplastic changes take place at higher visual centers in the brain, produced by either the abnormal neural encoding of the visual inputs delivered by the diseased retina or as the result of an adaptation to visual deprivation. While retinal implants can activate the surviving retinal neurons by delivering electric current, the unselective activation patterns of the different neural populations that exist in the retinal layers differ substantially from those in physiologic vision. Therefore, artificially induced neural patterns are being delivered to a brain that has already undergone important neural reconnections. Whether or not the modulation of this neural rewiring can improve the performance for retinal prostheses remains a critical question whose answer may be the enabler of improved functional artificial vision and more personalized neurorehabilitation strategies.

Fluorescent transgenic mouse models for whole-brain imaging in health and disease

A paradigm shift is occurring in neuroscience and in general in life sciences converting biomedical research from a descriptive discipline into a quantitative, predictive, actionable science. Living systems are becoming amenable to quantitative description, with profound consequences for our ability to predict biological phenomena. New experimental tools such as tissue clearing, whole-brain imaging, and genetic engineering technologies have opened the opportunity to embrace this new paradigm, allowing to extract anatomical features such as cell number, their full morphology, and even their structural connectivity. These tools will also allow the exploration of new features such as their geometrical arrangement, within and across brain regions. This would be especially important to better characterize brain function and pathological alterations in neurological, neurodevelopmental, and neurodegenerative disorders. New animal models for mapping fluorescent protein-expressing neurons and axon pathways in adult mice are key to this aim. As a result of both developments, relevant cell populations with endogenous fluorescence signals can be comprehensively and quantitatively mapped to whole-brain images acquired at submicron resolution. However, they present intrinsic limitations: weak fluorescent signals, unequal signal strength across the same cell type, lack of specificity of fluorescent labels, overlapping signals in cell types with dense labeling, or undetectable signal at distal parts of the neurons, among others. In this review, we discuss the recent advances in the development of fluorescent transgenic mouse models that overcome to some extent the technical and conceptual limitations and tradeoffs between different strategies. We also discuss the potential use of these strains for understanding disease.

High-density electrode recordings reveal strong and specific connections between retinal ganglion cells and midbrain neurons

The superior colliculus is a midbrain structure that plays important roles in visually guided behaviors in mammals. Neurons in the superior colliculus receive inputs from retinal ganglion cells but how these inputs are integrated in vivo is unknown. Here, we discovered that high-density electrodes simultaneously capture the activity of retinal axons and their postsynaptic target neurons in the superior colliculus, in vivo. We show that retinal ganglion cell axons in the mouse provide a single cell precise representation of the retina as input to superior colliculus. This isomorphic mapping builds the scaffold for precise retinotopic wiring and functionally specific connection strength. Our methods are broadly applicable, which we demonstrate by recording retinal inputs in the optic tectum in zebra finches. We find common wiring rules in mice and zebra finches that provide a precise representation of the visual world encoded in retinal ganglion cells connections to neurons in retinorecipient areas.

The superior colliculus receives visual information from retinal ganglion cells, but it remains unclear how this information is organized and integrated in vivo. Here the authors describe how high-density electrodes can simultaneously capture the activity of incoming axons and target neurons in the superior colliculus, and demonstrate isomorphic mapping and strong and specific connections in mice and zebrafinches.

Artificial Visual Information Produced by Retinal Prostheses

Numerous retinal prosthetic systems have demonstrated somewhat useful vision can be restored to individuals who had lost their sight due to outer retinal degenerative diseases. Earlier prosthetic studies have mostly focused on the confinement of electrical stimulation for improved spatial resolution and/or the biased stimulation of specific retinal ganglion cell (RGC) types for selective activation of retinal ON/OFF pathway for enhanced visual percepts. To better replicate normal vision, it would be also crucial to consider information transmission by spiking activities arising in the RGC population since an incredible amount of visual information is transferred from the eye to the brain. In previous studies, however, it has not been well explored how much artificial visual information is created in response to electrical stimuli delivered by microelectrodes. In the present work, we discuss the importance of the neural information for high-quality artificial vision. First, we summarize the previous literatures which have computed information transmission rates from spiking activities of RGCs in response to visual stimuli. Second, we exemplify a couple of studies which computed the neural information from electrically evoked responses. Third, we briefly introduce how information rates can be computed in the representative two ways – direct method and reconstruction method. Fourth, we introduce in silico approaches modeling artificial retinal neural networks to explore the relationship between amount of information and the spiking patterns. Lastly, we conclude our review with clinical implications to emphasize the necessity of considering visual information transmission for further improvement of retinal prosthetics.

Improving the spatial resolution of artificial vision using midget retinal ganglion cell populations modelled at the human fovea

OBJECTIVE

Retinal prostheses seek to create artificial vision by stimulating surviving retinal neurons of patients with profound vision impairment. Notwithstanding tremendous research efforts, the performance of all implants tested to date has remained rudimentary, incapable of overcoming the threshold for legal blindness. To maximize the perceptual efficacy of retinal prostheses, a device must be capable of controlling retinal neurons with greater spatiotemporal precision. Most studies of retinal stimulation were derived from either non-primate species or the peripheral primate retina. We investigated if artificial stimulation could leverage the high spatial resolution afforded by the neural substrates at the primate fovea and surrounding regions to achieve improved percept qualities.

APPROACH

We began by developing a new computational model capable of generating anatomically accurate retinal ganglion cell (RGC) populations within the human central retina. Next, multiple RGC populations across the central retina were stimulated in-silico to compare clinical and recently proposed neurostimulation configurations based on their ability to improve perceptual efficacy and reduce activation thresholds.

MAIN RESULTS

Our model uniquely upholds eccentricity-dependent characteristics such as RGC density and dendritic field diameter, whilst incorporating anatomically accurate features such as axon projection and three-dimensional RGC layering, features often forgone in favor of reduced computational complexity. Following epiretinal stimulation, the RGCs in our model produced response patterns in shapes akin to the complex percepts reported in clinical trials. Our results also demonstrated that even within the neuron-dense central retina, epiretinal stimulation using a multi-return hexapolar electrode arrangement could reliably achieve spatially focused RGC activation and could achieve single-cell excitation in 74% of all tested locations.

SIGNIFICANCE

This study establishes an anatomically accurate three-dimensional model of the human central retina and demonstrates the potential for an epiretinal hexapolar configuration to achieve consistent, spatially confined retinal responses, even within the neuron-dense foveal region. Our results promote the prospect and optimization of higher spatial resolution in future epiretinal implants.

Retinal OFF ganglion cells allow detection of quantal shadows at starlight

Perception of light in darkness requires no more than a handful of photons, and this remarkable behavioral performance can be directly linked to a particular retinal circuit-the retinal ON pathway. However, the neural limits of shadow detection in very dim light have remained unresolved. Here, we unravel the neural mechanisms that determine the sensitivity of mice (CBA/CaJ) to light decrements at the lowest light levels by measuring signals from the most sensitive ON and OFF retinal ganglion cell types and by correlating their signals with visually guided behavior. We show that mice can detect shadows when only a few photon absorptions are missing among thousands of rods. Behavioral detection of such "quantal" shadows relies on the retinal OFF pathway and is limited by noise and loss of single-photon signals in retinal processing. Thus, in the dim-light regime, light increments and decrements are encoded separately via the ON and OFF retinal pathways, respectively.

Conserved circuits for direction selectivity in the primate retina

The detection of motion direction is a fundamental visual function and a classic model for neural computation. In the non-primate retina, direction selectivity arises in starburst amacrine cell (SAC) dendrites, which provide selective inhibition to direction-selective retinal ganglion cells (dsRGCs). Although SACs are present in primates, their connectivity and the existence of dsRGCs remain open questions. Here, we present a connectomic reconstruction of the primate ON SAC circuit from a serial electron microscopy volume of the macaque central retina. We show that the structural basis for the SACs' ability to confer directional selectivity on postsynaptic neurons is conserved. SACs selectively target a candidate homolog to the mammalian ON-sustained dsRGCs that project to the accessory optic system (AOS) and contribute to gaze-stabilizing reflexes. These results indicate that the capacity to compute motion direction is present in the retina, which is earlier in the primate visual system than classically thought.

Tangential high-density electrode insertions allow to simultaneously measure neuronal activity across an extended region of the visual field in mouse superior colliculus

BACKGROUND

The superior colliculus (SC) is a midbrain structure that plays a central role in visual processing. Although we have learned a considerable amount about the function of single SC neurons, the way in which sensory information is represented and processed on the population level in awake behaving animals and across a large region of the retinotopic map is still largely unknown. Partially because the SC is anatomically located below the cortical sheet and the transverse sinus, which render the measure of neuronal activity from a large population of neurons in the SC technically difficult to perform.

NEW METHOD

To address this, we propose a tangential recording configuration using high-density electrode probes (Neuropixels) in mouse SC in vivo. This method permits a large number of recording sites (~200) inside the SC circuitry allowing to record from a large population of SC neurons along a vast area of retinotopic space.

RESULTS

This approach provides a unique opportunity to measure the activity of SC neuronal populations over up to ~2mm of SC tissue reporting for the first time the continuous receptive fields coverage of almost the entire SC retinotopy. Here we describe how to perform targeted tangential recordings along the anterior-posterior and the medio-lateral axis of the mouse SC in vivo in the upper visual layers. Furthermore, we describe how to combine this approach with optogenetic tools for cell-type identification on the population level.

COMPARISON WITH EXISTING METHODS

Vertical insertion has been a standard way to record visual responses in the SC. Inserting multi-shank probes vertically allows to cover a larger region of the SC but misses both the complete extent of the available retinotopy and the continuous measure allowed by the high density of recording sites on Neuropixels probes.

CONCLUSION

Altogether tangential insertions in the upper visual layers of the mouse SC using Neuropixels permit for the first time to access a majority of the retinotopically organized visual representation of the world at an unprecedented precision.

Use of extended protocols with nonstandard stimuli to characterize rod and cone contributions to the canine electroretinogram

PURPOSE

In this study, we assessed several extended electroretinographic protocols using nonstandard stimuli. Our aim was to separate and quantify the contributions of different populations of retinal cells to the overall response, both to assess normal function and characterize dogs with inherited retinal disease.

METHODS

We investigated three different protocols for measuring the full-field flash electroretinogram-(1) chromatic dark-adapted red and blue flashes, (2) increasing luminance blue-background, (3) flicker with fixed frequency and increasing luminance, and flicker with increasing frequency at a fixed luminance-to assess rod and cone contributions to electroretinograms recorded in phenotypically normal control dogs and dogs lacking rod function.

RESULTS

Temporal separation of the rod- and cone-driven responses is possible in the fully dark-adapted eye using dim red flashes. A- and b-wave amplitudes decrease at different rates with increasing background luminance in control dogs. Flicker responses elicited with extended flicker protocols are well fit with mathematical models in control dogs. Dogs lacking rod function demonstrated larger amplitude dark-adapted compared to light-adapted flicker responses.

CONCLUSIONS

Using extended protocols of the full-field electroretinogram provides additional characterization of the health and function of different populations of cells in the normal retina and enables quantifiable comparison between phenotypically normal dogs and those with retinal disease.

Adaptation in cone photoreceptors contributes to an unexpected insensitivity of primate On parasol retinal ganglion cells to spatial structure in natural images

Neural circuits are constructed from nonlinear building blocks, and not surprisingly overall circuit behavior is often strongly nonlinear. But neural circuits can also behave near linearly, and some circuits shift from linear to nonlinear behavior depending on stimulus conditions. Such control of nonlinear circuit behavior is fundamental to neural computation. Here, we study a surprising stimulus dependence of the responses of macaque On (but not Off) parasol retinal ganglion cells: these cells respond nonlinearly to spatial structure in some stimuli but near linearly to spatial structure in others, including natural inputs. We show that these differences in the linearity of the integration of spatial inputs can be explained by a shift in the balance of excitatory and inhibitory synaptic inputs that originates at least partially from adaptation in the cone photoreceptors. More generally, this highlights how subtle asymmetries in signaling - here in the cone signals - can qualitatively alter circuit computation.

Individual variability of neural computations in the primate retina

Variation in the neural code contributes to making each individual unique. We probed neural code variation using ∼100 population recordings from major ganglion cell types in the macaque retina, combined with an interpretable computational representation of individual variability. This representation captured variation and covariation in properties such as nonlinearity, temporal dynamics, and spatial receptive field size and preserved invariances such as asymmetries between On and Off cells. The covariation of response properties in different cell types was associated with the proximity of lamination of their synaptic input. Surprisingly, male retinas exhibited higher firing rates and faster temporal integration than female retinas. Exploiting data from previously recorded retinas enabled efficient characterization of a new macaque retina, and of a human retina. Simulations indicated that combining a large dataset of retinal recordings with behavioral feedback could reveal the neural code in a living human and thus improve vision restoration with retinal implants.

Three-Terminal Ovonic Threshold Switch (3T-OTS) with Tunable Threshold Voltage for Versatile Artificial Sensory Neurons

Inspired by information processing in biological systems, sensor-combined edge-computing systems attract attention requesting artificial sensory neurons as essential ingredients. Here, we introduce a simple and versatile structure of artificial sensory neurons based on a novel three-terminal Ovonic threshold switch (3T-OTS), which features an electrically controllable threshold voltage (V_th). Combined with a sensor driving an output voltage, this 3T-OTS generates spikes with a frequency depending on an external stimulus. As a proof of concept, we have built an artificial retinal ganglion cell (RGC) by combining a 3T-OTS and a photodiode. Furthermore, this artificial RGC is combined with the reservoir-computing technique to perform a classification of chest X-ray images for normal, viral pneumonia, and COVID-19 infections, releasing the recognition accuracy of about 86.5%. These results indicate that the 3T-OTS is highly promising for applications in neuromorphic sensory systems, providing a building block for energy-efficient in-sensor computing devices.

Cortical Representation of Touch in Silico

With its six layers and ~ 12,000 neurons, a cortical column is a complex network whose function is plausibly greater than the sum of its constituents'. Functional characterization of its network components will require going beyond the brute-force modulation of the neural activity of a small group of neurons. Here we introduce an open-source, biologically inspired, computationally efficient network model of the somatosensory cortex's granular and supragranular layers after reconstructing the barrel cortex in soma resolution. Comparisons of the network activity to empirical observations showed that the in silico network replicates the known properties of touch representations and whisker deprivation-induced changes in synaptic strength induced in vivo. Simulations show that the history of the membrane potential acts as a spatial filter that determines the presynaptic population of neurons contributing to a post-synaptic action potential; this spatial filtering might be critical for synaptic integration of top-down and bottom-up information.

Biologically Inspired Deep Learning Model for Efficient Foveal-Peripheral Vision

While abundant in biology, foveated vision is nearly absent from computational models and especially deep learning architectures. Despite considerable hardware improvements, training deep neural networks still presents a challenge and constraints complexity of models. Here we propose an end-to-end neural model for foveal-peripheral vision, inspired by retino-cortical mapping in primates and humans. Our model has an efficient sampling technique for compressing the visual signal such that a small portion of the scene is perceived in high resolution while a large field of view is maintained in low resolution. An attention mechanism for performing "eye-movements" assists the agent in collecting detailed information incrementally from the observed scene. Our model achieves comparable results to a similar neural architecture trained on full-resolution data for image classification and outperforms it at video classification tasks. At the same time, because of the smaller size of its input, it can reduce computational effort tenfold and uses several times less memory. Moreover, we present an easy to implement bottom-up and top-down attention mechanism which relies on task-relevant features and is therefore a convenient byproduct of the main architecture. Apart from its computational efficiency, the presented work provides means for exploring active vision for agent training in simulated environments and anthropomorphic robotics.

Spatial modulation of dark versus bright stimulus responses in the mouse visual system

A fundamental task of the visual system is to respond to both increases and decreases of luminance with action potentials (ON and OFF responses1-4). OFF responses are stronger, faster, and more salient than ON responses in primary visual cortex (V1) of both cats5,6 and primates,7,8 but in ferrets9 and mice,10 ON responses can be stronger, weaker,11 or balanced12 in comparison to OFF responses. These discrepancies could arise from differences in species, experimental techniques, or stimulus properties, particularly retinotopic location in the visual field, as has been speculated;9 however, the role of retinotopy for ON/OFF dominance has not been systematically tested across multiple scales of neural activity within species. Here, we measured OFF versus ON responses across large portions of visual space with silicon probe and whole-cell patch-clamp recordings in mouse V1 and lateral geniculate nucleus (LGN). We found that OFF responses dominated in the central visual field, whereas ON and OFF responses were more balanced in the periphery. These findings were consistent across local field potential (LFP), spikes, and subthreshold membrane potential in V1, and were aligned with spatial biases in ON and OFF responses in LGN. Our findings reveal that retinotopy may provide a common organizing principle for spatial modulation of OFF versus ON processing in mammalian visual systems.

Pluripotent stem cell therapy for retinal diseases

Pluripotent stem cells (PSCs), which include human embryonic stem cells (hESCs) and induced pluripotent stem cell (iPSC), have been used to study development of disease processes, and as potential therapies in multiple organ systems. In recent years, there has been increasing interest in the use of PSC-based transplantation to treat disorders of the retina in which retinal cells have been functionally damaged or lost through degeneration. The retina, which consists of neuronal tissue, provides an excellent system to test the therapeutic utility of PSC-based transplantation due to its accessibility and the availability of high-resolution imaging technology to evaluate effects. Preclinical trials in animal models of retinal diseases have shown improvement in visual outcomes following subretinal transplantation of PSC-derived photoreceptors or retinal pigment epithelium (RPE) cells. This review focuses on preclinical studies and clinical trials exploring the use of PSCs for retinal diseases. To date, several phase I/II clinical trials in patients with age-related macular degeneration (AMD) and Stargardt disease (STGD1) have demonstrated the safety and feasibility of PSC-derived RPE transplantation. Additional phase I/II clinical trials using PSC-derived RPE or photoreceptor cells for the treatment of AMD, STGD1, and also retinitis pigmentosa (RP) are currently in the pipeline. As this field continues to evolve, additional technologies may enhance PSC-derived cell transplantation through gene-editing of autologous cells, transplantation of more complex cellular structures such as organoids, and monitoring of transplanted cells through novel imaging technologies.

Impact of Photoreceptor Loss on Retinal Circuitry

Our sense of sight relies on photoreceptors, which transduce photons into the nervous system's electrochemical interpretation of the visual world. These precious photoreceptors can be disrupted by disease, injury, and aging. Once photoreceptors start to die, but before blindness occurs, the remaining retinal circuitry can withstand, mask, or exacerbate the photoreceptor deficit and potentially be receptive to newfound therapies for vision restoration. To maximize the retina's receptivity to therapy, one must understand the conditions that influence the state of the remaining retina. In this review, we provide an overview of the retina's structure and function in health and disease. We analyze a collection of observations on photoreceptor disruption and generate a predictive model to identify parameters that influence the retina's response. Finally, we speculate on whether the retina, with its remarkable capacity to function over light levels spanning nine orders of magnitude, uses these same adaptational mechanisms to withstand and perhaps mask photoreceptor loss.

Morphology, Molecular Characterization, and Connections of Ganglion Cells in Primate Retina

The eye sends information about the visual world to the brain on over 20 parallel signal pathways, each specialized to signal features such as spectral reflection (color), edges, and motion of objects in the environment. Each pathway is formed by the axons of a separate type of retinal output neuron (retinal ganglion cell). In this review, we summarize what is known about the excitatory retinal inputs, brain targets, and gene expression patterns of ganglion cells in humans and nonhuman primates. We describe how most ganglion cell types receive their input from only one or two of the 11 types of cone bipolar cell and project selectively to only one or two target regions in the brain. We also highlight how genetic methods are providing tools to characterize ganglion cells and establish cross-species homologies.

Nonlinear Decoding of Natural Images From Large-Scale Primate Retinal Ganglion Recordings

Decoding sensory stimuli from neural activity can provide insight into how the nervous system might interpret the physical environment, and facilitates the development of brain-machine interfaces. Nevertheless, the neural decoding problem remains a significant open challenge. Here, we present an efficient nonlinear decoding approach for inferring natural scene stimuli from the spiking activities of retinal ganglion cells (RGCs). Our approach uses neural networks to improve on existing decoders in both accuracy and scalability. Trained and validated on real retinal spike data from more than 1000 simultaneously recorded macaque RGC units, the decoder demonstrates the necessity of nonlinear computations for accurate decoding of the fine structures of visual stimuli. Specifically, high-pass spatial features of natural images can only be decoded using nonlinear techniques, while low-pass features can be extracted equally well by linear and nonlinear methods. Together, these results advance the state of the art in decoding natural stimuli from large populations of neurons.

Cell Types of the Human Retina and Its Organoids at Single-Cell Resolution

Human organoids recapitulating the cell-type diversity and function of their target organ are valuable for basic and translational research. We developed light-sensitive human retinal organoids with multiple nuclear and synaptic layers and functional synapses. We sequenced the RNA of 285,441 single cells from these organoids at seven developmental time points and from the periphery, fovea, pigment epithelium and choroid of light-responsive adult human retinas, and performed histochemistry. Cell types in organoids matured in vitro to a stable "developed" state at a rate similar to human retina development in vivo. Transcriptomes of organoid cell types converged toward the transcriptomes of adult peripheral retinal cell types. Expression of disease-associated genes was cell-type-specific in adult retina, and cell-type specificity was retained in organoids. We implicate unexpected cell types in diseases such as macular degeneration. This resource identifies cellular targets for studying disease mechanisms in organoids and for targeted repair in human retinas.

Single-Cell Transcriptomic Comparison of Human Fetal Retina, hPSC-Derived Retinal Organoids, and Long-Term Retinal Cultures

To study the development of the human retina, we use single-cell RNA sequencing (RNA-seq) at key fetal stages and follow the development of the major cell types as well as populations of transitional cells. We also analyze stem cell (hPSC)-derived retinal organoids; although organoids have a very similar cellular composition at equivalent ages as the fetal retina, there are some differences in gene expression of particular cell types. Moreover, the inner retinal lamination is disrupted at more advanced stages of organoids compared with fetal retina. To determine whether the disorganization in the inner retina is due to the culture conditions, we analyze retinal development in fetal retina maintained under similar conditions. These retinospheres develop for at least 6 months, displaying better inner retinal lamination than retinal organoids. Our single-cell RNA sequencing (scRNA-seq) comparisons of fetal retina, retinal organoids, and retinospheres provide a resource for developing better in vitro models for retinal disease.

Inter-mosaic coordination of retinal receptive fields

The output of the retina is organized into many detector grids, called ‘mosaics’ that signal different features of visual scenes to the brain^1–4. Each mosaic comprises a single retinal ganglion cell (RGC) type, whose receptive fields (RFs) tile space. Many mosaics arise as pairs, signaling increments (ON) and decrements (OFF), respectively, of a particular visual feature⁵. Using a model of efficient coding⁶, we determine how such mosaic pairs should be arranged to optimize the encoding of natural scenes. We find that information is maximized when these mosaic pairs are anti-aligned, meaning the RF centers between mosaics are more distant than expected by chance. We test this prediction across multiple RF mosaics acquired with large-scale measurements of RGC light responses from rat and primate. We find that ON and OFF RGC pairs with similar feature selectivity exhibit anti-aligned RF mosaics, consistent with theory. ON and OFF types that encode distinct features exhibit independent mosaics. These results extend efficient coding theory (ECT) beyond individual cells to predict how populations of diverse RGC types are spatially arranged.

Visual properties of human retinal ganglion cells

The retinal output is the sole source of visual information for the brain. Studies in non-primate mammals estimate that this information is carried by several dozens of retinal ganglion cell types, each informing the brain about different aspects of a visual scene. Even though morphological studies of primate retina suggest a similar diversity of ganglion cell types, research has focused on the function of only a few cell types. In human retina, recordings from individual cells are anecdotal or focus on a small subset of identified types. Here, we present the first systematic ex-vivo recording of light responses from 342 ganglion cells in human retinas obtained from donors. We find a great variety in the human retinal output in terms of preferences for positive or negative contrast, spatio-temporal frequency encoding, contrast sensitivity, and speed tuning. Some human ganglion cells showed similar response behavior as known cell types in other primate retinas, while we also recorded light responses that have not been described previously. This first extensive description of the human retinal output should facilitate interpretation of primate data and comparison to other mammalian species, and it lays the basis for the use of ex-vivo human retina for in-vitro analysis of novel treatment approaches.

Electric Stimulation Elicits Heterogeneous Responses in ON but Not OFF Retinal Ganglion Cells to Transmit Rich Neural Information

Retinal implants electrically stimulate surviving retinal neurons to restore vision in people blinded by outer retinal degeneration. Although the healthy retina is known to transmit a vast amount of visual information to the brain, it has not been studied whether prosthetic vision contains a similar amount of information. Here, we assessed the neural information transmitted by population responses arising in brisk transient (BT) and brisk sustained (BS) subtypes of ON and OFF retinal ganglion cells (RGCs) in the rabbit retina. To correlate the response heterogeneity and the information transmission, we first quantified the cell-to-cell heterogeneity by calculating the spike time tiling coefficient (STTC) across spiking patterns of RGCs in each type. Then, we computed the neural information encoded by the RGC population in a given type. In responses to light stimulation, spiking activities were more heterogeneous in OFF than ON RGCs (STTC_AVG = 0.36, 0.45, 0.77 and 0.55 for OFF BT, OFF BS, ON BT, and ON BS, respectively). Interestingly, however, in responses to electric stimulation, both BT and BS subtypes of OFF RGCs showed remarkably homogeneous spiking patterns across cells (STTC_AVG = 0.93 and 0.82 for BT and BS, respectively), whereas the two subtypes of ON RGCs showed slightly increased populational heterogeneity compared to light-evoked responses (STTC_AVG = 0.71 and 0.63 for BT and BS, respectively). Consequently, the neural information encoded by the electrically-evoked responses of a population of 15 RGCs was substantially lower in the OFF than the ON pathway: OFF BT and BS cells transmit only ~23% and ~53% of the neural information transmitted by their ON counterparts. Together with previously-reported natural spiking activities in ON RGCs, the higher neural information may make ON responses more recognizable, eliciting the biased percepts of bright phosphenes.

Spike-triggered Clustering for Retinal Ganglion Cell Classification

Retinal ganglion cells (RGCs), the retina's output neurons, encode visual information through spiking. The RGC receptive field (RF) represents the basic unit of visual information processing in the retina. RFs are commonly estimated using the spike-triggered average (STA), which is the average of the stimulus patterns to which a given RGC is sensitive. Whereas STA, based on the concept of the average, is simple and intuitive, it leaves more complex structures in the RFs undetected. Alternatively, spike-triggered covariance (STC) analysis provides information on second-order RF statistics. However, STC is computationally cumbersome and difficult to interpret. Thus, the objective of this study was to propose and validate a new computational method, called spike-triggered clustering (STCL), specific for multimodal RFs. Specifically, RFs were fit with a Gaussian mixture model, which provides the means and covariances of multiple RF clusters. The proposed method recovered bipolar stimulus patterns in the RFs of ON-OFF cells, while the STA identified only ON and OFF RGCs, and the remaining RGCs were labeled as unknown types. In contrast, our new STCL analysis distinguished ON-OFF RGCs from the ON, OFF, and unknown RGC types classified by STA. Thus, the proposed method enables us to include ON-OFF RGCs prior to retinal information analysis.

Detection of occluding targets in natural backgrounds

Detection of target objects in the surrounding environment is a common visual task. There is a vast psychophysical and modeling literature concerning the detection of targets in artificial and natural backgrounds. Most studies involve detection of additive targets or of some form of image distortion. Although much has been learned from these studies, the targets that most often occur under natural conditions are neither additive nor distorting; rather, they are opaque targets that occlude the backgrounds behind them. Here, we describe our efforts to measure and model detection of occluding targets in natural backgrounds. To systematically vary the properties of the backgrounds, we used the constrained sampling approach of Sebastian, Abrams, and Geisler (2017). Specifically, millions of calibrated gray-scale natural-image patches were sorted into a 3D histogram along the dimensions of luminance, contrast, and phase-invariant similarity to the target. Eccentricity psychometric functions (accuracy as a function of retinal eccentricity) were measured for four different occluding targets and 15 different combinations of background luminance, contrast, and similarity, with a different randomly sampled background on each trial. The complex pattern of results was consistent across the three subjects, and was largely explained by a principled model observer (with only a single efficiency parameter) that combines three image cues (pattern, silhouette, and edge) and four well-known properties of the human visual system (optical blur, blurring and downsampling by the ganglion cells, divisive normalization, intrinsic position uncertainty). The model also explains the thresholds for additive foveal targets in natural backgrounds reported in Sebastian et al. (2017).

Role of Feedback Connections in Central Visual Processing

The physiological response properties of neurons in the visual system are inherited mainly from feedforward inputs. Interestingly, feedback inputs often outnumber feedforward inputs. Although they are numerous, feedback connections are weaker, slower, and considered to be modulatory, in contrast to fast, high-efficacy feedforward connections. Accordingly, the functional role of feedback in visual processing has remained a fundamental mystery in vision science. At the core of this mystery are questions about whether feedback circuits regulate spatial receptive field properties versus temporal responses among target neurons, or whether feedback serves a more global role in arousal or attention. These proposed functions are not mutually exclusive, and there is compelling evidence to support multiple functional roles for feedback. In this review, the role of feedback in vision will be explored mainly from the perspective of corticothalamic feedback. Further generalized principles of feedback applicable to corticocortical connections will also be considered.

Physiological characterization of a rare subpopulation of doublet-spiking neurons in the ferret lateral geniculate nucleus

Interest in exploring homologies in the early visual pathways of rodents, carnivores, and primates has recently grown. Retinas of these species contain morphologically and physiologically heterogeneous retinal ganglion cells that form the basis for parallel visual information processing streams. Whether rare retinal ganglion cells with unusual visual response properties in carnivores and primates project to the visual thalamus and drive unusual visual responses among thalamic relay neurons is poorly understood. We surveyed neurophysiological responses among hundreds of lateral geniculate nucleus (LGN) neurons in ferrets and observed a novel subpopulation of LGN neurons displaying doublet-spiking waveforms. Some visual response properties of doublet-spiking LGN neurons, like contrast and temporal frequency tuning, were intermediate to those of X and Y LGN neurons. Interestingly, most doublet-spiking LGN neurons were tuned for orientation and displayed direction selectivity for horizontal motion. Spatiotemporal receptive fields of doublet-spiking neurons were diverse and included center/surround organization, On/Off responses, and elongated separate On and Off subregions. Optogenetic activation of corticogeniculate feedback did not alter the tuning or spatiotemporal receptive fields of doublet-spiking neurons, suggesting that their unusual tuning properties were inherited from retinal inputs. The doublet-spiking LGN neurons were found throughout the depth of LGN recording penetrations. Together these findings suggest that while extremely rare (<2% of recorded LGN neurons), unique subpopulations of LGN neurons in carnivores receive retinal inputs that confer them with nonstandard visual response properties like direction selectivity. These results suggest that neuronal circuits for nonstandard visual computations are common across a variety of species, even though their proportions vary.NEW & NOTEWORTHY Interest in visual system homologies across species has recently increased. Across species, retinas contain diverse retinal ganglion cells including cells with unusual visual response properties. It is unclear whether rare retinal ganglion cells in carnivores project to and drive similarly unique visual responses in the visual thalamus. We discovered a rare subpopulation of thalamic neurons defined by unique spike shape and visual response properties, suggesting that nonstandard visual computations are common to many species.