Neural sensitization improves encoding fidelity in the primate retina

Response Plasticity of Drosophila Olfactory Sensory Neurons

In insect olfaction, sensitization refers to the amplification of a weak olfactory signal when the stimulus is repeated within a specific time window. In the vinegar fly, Drosophila melanogaster, this occurs already at the periphery, at the level of olfactory sensory neurons (OSNs) located in the antenna. In our study, we investigate whether sensitization is a widespread property in a set of seven types of OSNs, as well as the mechanisms involved. First, we characterize and compare the differences in spontaneous activity, response velocity and response dynamics, among the selected OSN types. These express different receptors with distinct tuning properties and behavioral relevance. Second, we show that sensitization is not a general property. Among our selected OSN types, it occurs in those responding to more general food odors, while OSNs involved in very specific detection of highly specific ecological cues like pheromones and warning signals show no sensitization. Moreover, we show that mitochondria play an active role in sensitization by contributing to the increase in intracellular Ca2+ upon weak receptor activation. Thus, by using a combination of single sensillum recordings (SSRs), calcium imaging and pharmacology, we widen the understanding of how the olfactory signal is processed at the periphery.

GABA receptors mediate adaptation and sensitization processes in mouse retinal ganglion cells

Two coordinated dynamic properties (adaptation and sensitization) are observed in retinal ganglion cells (RGCs) under the contrast stimulation. During sustained high-contrast period, adaptation decreases RGCs' responses while sensitization increases RGCs' responses. In mouse retina, adaptation and sensitization respectively show OFF- and ON-pathway-dominance. However, the mechanisms which drive the differentiation between adaptation and sensitization remain unclear. In the present study, multi-electrode recordings were conducted on isolated mouse retina under full-field contrast stimulation. Dynamic property was quantified based on the trend of RGC's firing rate during high-contrast period, light sensitivity was estimated by linear-nonlinear analysis and coding ability was estimated through stimulus reconstruction algorism. γ-Aminobutyric acid (GABA) receptors were pharmacologically blocked to explore the relation between RGCs' dynamic property and the activity of GABA receptors. It was found that GABAA and GABAC receptors respectively mediated the adaptation and sensitization processes in RGCs' responses. RGCs' dynamic property changes occurred after the blockage of GABA receptors were related to the modulation of the cells' light sensitivity. Further, the blockage of GABAA (GABAC) receptor significantly decreased RGCs' overall coding ability and eliminated the functional benefits of adaptation (sensitization). Our work suggests that the dynamic property of individual RGC is related to the balance between its GABAA-receptor-mediated inputs and GABAC-receptor-mediated inputs. Blockage of GABA receptors breaks the balance of retinal circuitry for signal processing, and down-regulates the visual information coding ability.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-023-09950-2.

An artificial visual neuron with multiplexed rate and time-to-first-spike coding

Human visual neurons rely on event-driven, energy-efficient spikes for communication, while silicon image sensors do not. The energy-budget mismatch between biological systems and machine vision technology has inspired the development of artificial visual neurons for use in spiking neural network (SNN). However, the lack of multiplexed data coding schemes reduces the ability of artificial visual neurons in SNN to emulate the visual perception ability of biological systems. Here, we present an artificial visual spiking neuron that enables rate and temporal fusion (RTF) coding of external visual information. The artificial neuron can code visual information at different spiking frequencies (rate coding) and enables precise and energy-efficient time-to-first-spike (TTFS) coding. This multiplexed sensory coding scheme could improve the computing capability and efficacy of artificial visual neurons. A hardware-based SNN with the RTF coding scheme exhibits good consistency with real-world ground truth data and achieves highly accurate steering and speed predictions for self-driving vehicles in complex conditions. The multiplexed RTF coding scheme demonstrates the feasibility of developing highly efficient spike-based neuromorphic hardware.

Two Sides of the Same Coin: Efficient and Predictive Neural Coding

Some visual properties are consistent across a wide range of environments, while other properties are more labile. The efficient coding hypothesis states that many of these regularities in the environment can be discarded from neural representations, thus allocating more of the brain's dynamic range to properties that are likely to vary. This paradigm is less clear about how the visual system prioritizes different pieces of information that vary across visual environments. One solution is to prioritize information that can be used to predict future events, particularly those that guide behavior. The relationship between the efficient coding and future prediction paradigms is an area of active investigation. In this review, we argue that these paradigms are complementary and often act on distinct components of the visual input. We also discuss how normative approaches to efficient coding and future prediction can be integrated.

Diversity of Ganglion Cell Responses to Saccade-Like Image Shifts in the Primate Retina

Saccades are a fundamental part of natural vision. They interrupt fixations of the visual gaze and rapidly shift the image that falls onto the retina. These stimulus dynamics can cause activation or suppression of different retinal ganglion cells, but how they affect the encoding of visual information in different types of ganglion cells is largely unknown. Here, we recorded spiking responses to saccade-like shifts of luminance gratings from ganglion cells in isolated marmoset retinas and investigated how the activity depended on the combination of presaccadic and postsaccadic images. All identified cell types, On and Off parasol and midget cells, as well as a type of Large Off cells, displayed distinct response patterns, including particular sensitivity to either the presaccadic or the postsaccadic image or combinations thereof. In addition, Off parasol and Large Off cells, but not On cells, showed pronounced sensitivity to whether the image changed across the transition. Stimulus sensitivity of On cells could be explained based on their responses to step changes in light intensity, whereas Off cells, in particular, parasol and the Large Off cells, seem to be affected by additional interactions that are not triggered during simple light-intensity flashes. Together, our data show that ganglion cells in the primate retina are sensitive to different combinations of presaccadic and postsaccadic visual stimuli. This contributes to the functional diversity of the output signals of the retina and to asymmetries between On and Off pathways and provides evidence of signal processing beyond what is triggered by isolated steps in light intensity.SIGNIFICANCE STATEMENT Sudden eye movements (saccades) shift our direction of gaze, bringing new images in focus on our retinas. To study how retinal neurons deal with these rapid image transitions, we recorded spiking activity from ganglion cells, the output neurons of the retina, in isolated retinas of marmoset monkeys while shifting a projected image in a saccade-like fashion across the retina. We found that the cells do not just respond to the newly fixated image, but that different types of ganglion cells display different sensitivities to the presaccadic and postsaccadic stimulus patterns. Certain Off cells, for example, are sensitive to changes in the image across transitions, which contributes to differences between On and Off information channels and extends the range of encoded stimulus features.

Suppression without inhibition: how retinal computation contributes to saccadic suppression

Visual perception remains stable across saccadic eye movements, despite the concurrent strongly disruptive visual flow. This stability is partially associated with a reduction in visual sensitivity, known as saccadic suppression, which already starts in the retina with reduced ganglion cell sensitivity. However, the retinal circuit mechanisms giving rise to such suppression remain unknown. Here, we describe these mechanisms using electrophysiology in mouse, pig, and macaque retina, 2-photon calcium imaging, computational modeling, and human psychophysics. We find that sequential stimuli, like those that naturally occur during saccades, trigger three independent suppressive mechanisms in the retina. The main mechanism is triggered by contrast-reversing sequential stimuli and originates within the receptive field center of ganglion cells. It does not involve inhibition or other known suppressive mechanisms like saturation or adaptation. Instead, it relies on temporal filtering of the inherently slow response of cone photoreceptors coupled with downstream nonlinearities. Two further mechanisms of suppression are present predominantly in ON ganglion cells and originate in the receptive field surround, highlighting another disparity between ON and OFF ganglion cells. The mechanisms uncovered here likely play a role in shaping the retinal output following eye movements and other natural viewing conditions where sequential stimulation is ubiquitous.

Retinal Encoding of Natural Scenes

An ultimate goal in retina science is to understand how the neural circuit of the retina processes natural visual scenes. Yet most studies in laboratories have long been performed with simple, artificial visual stimuli such as full-field illumination, spots of light, or gratings. The underlying assumption is that the features of the retina thus identified carry over to the more complex scenario of natural scenes. As the application of corresponding natural settings is becoming more commonplace in experimental investigations, this assumption is being put to the test and opportunities arise to discover processing features that are triggered by specific aspects of natural scenes. Here, we review how natural stimuli have been used to probe, refine, and complement knowledge accumulated under simplified stimuli, and we discuss challenges and opportunities along the way toward a comprehensive understanding of the encoding of natural scenes. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Visual Stimulation Induces Distinct Forms of Sensitization of On-Off Direction-Selective Ganglion Cell Responses in the Dorsal and Ventral Retina

Experience-dependent modulation of neuronal responses is a key attribute in sensory processing. In the mammalian retina, the On-Off direction-selective ganglion cell (DSGC) is well known for its robust direction selectivity. However, how the On-Off DSGC light responsiveness dynamically adjusts to the changing visual environment is underexplored. Here, we report that On-Off DSGCs tuned to posterior motion direction [i.e. posterior DSGCs (pDSGCs)] in mice of both sexes can be transiently sensitized by prior stimuli. Notably, distinct sensitization patterns are found in dorsal and ventral pDSGCs. Although responses of both dorsal and ventral pDSGCs to dark stimuli (Off responses) are sensitized, only dorsal cells show the sensitization of responses to bright stimuli (On responses). Visual stimulation to the dorsal retina potentiates a sustained excitatory input from Off bipolar cells, leading to tonic depolarization of pDSGCs. Such tonic depolarization propagates from the Off to the On dendritic arbor of the pDSGC to sensitize its On response. We also identified a previously overlooked feature of DSGC dendritic architecture that can support dendritic integration between On and Off dendritic layers bypassing the soma. By contrast, ventral pDSGCs lack a sensitized tonic depolarization and thus do not exhibit sensitization of their On responses. Our results highlight a topographic difference in Off bipolar cell inputs underlying divergent sensitization patterns of dorsal and ventral pDSGCs. Moreover, substantial crossovers between dendritic layers of On-Off DSGCs suggest an interactive dendritic algorithm for processing On and Off signals before they reach the soma.SIGNIFICANCE STATEMENT Visual neuronal responses are dynamically influenced by the prior visual experience. This form of plasticity reflects the efficient coding of the naturalistic environment by the visual system. We found that a class of retinal output neurons, On-Off direction-selective ganglion cells, transiently increase their responsiveness after visual stimulation. Cells located in dorsal and ventral retinas exhibit distinct sensitization patterns because of different adaptive properties of Off bipolar cell signaling. A previously overlooked dendritic morphologic feature of the On-Off direction-selective ganglion cell is implicated in the cross talk between On and Off pathways during sensitization. Together, these findings uncover a topographic difference in the adaptive encoding of upper and lower visual fields and the underlying neural mechanism in the dorsal and ventral retinas.

Opposite forms of adaptation in mouse visual cortex are controlled by distinct inhibitory microcircuits

Sensory processing in the cortex adapts to the history of stimulation but the mechanisms are not understood. Imaging the primary visual cortex of mice we find here that an increase in stimulus contrast is not followed by a simple decrease in gain of pyramidal cells; as many cells increase gain to improve detection of a subsequent decrease in contrast. Depressing and sensitizing forms of adaptation also occur in different types of interneurons (PV, SST and VIP) and the net effect within individual pyramidal cells reflects the balance of PV inputs, driving depression, and a subset of SST interneurons driving sensitization. Changes in internal state associated with locomotion increase gain across the population of pyramidal cells while maintaining the balance between these opposite forms of plasticity, consistent with activation of both VIP->SST and SST->PV disinhibitory pathways. These results reveal how different inhibitory microcircuits adjust the gain of pyramidal cells signalling changes in stimulus strength.

The authors describe the role of inhibitory microcircuits in the visual cortex of mice in adaptation to contrast. They show how external stimuli and internal state interact to adjust processing in the visual cortex.

Inhibition, but not excitation, recovers from partial cone loss with greater spatiotemporal integration, synapse density, and frequency

Neural circuits function in the face of changing inputs, either caused by normal variation in stimuli or by cell death. To maintain their ability to perform essential computations with partial inputs, neural circuits make modifications. Here, we study the retinal circuit’s responses to changes in light stimuli or in photoreceptor inputs by inducing partial cone death in the mature mouse retina. Can the retina withstand or recover from input loss? We find that the excitatory pathways exhibit functional loss commensurate with cone death and with some aspects predicted by partial light stimulation. However, inhibitory pathways recover functionally from lost input by increasing spatiotemporal integration in a way that is not recapitulated by partially stimulating the control retina. Anatomically, inhibitory synapses are upregulated on secondary bipolar cells and output ganglion cells. These findings demonstrate the greater capacity for inhibition, compared with excitation, to modify spatiotemporal processing with fewer cone inputs.

Lee et al. find partial cone loss triggers inhibition, but not excitation, to increase spatiotemporal integration, recover contrast gain, and increase synaptic release onto retinal ganglion cells. Natural images filtered by cone-loss receptive fields perceptually match those of controls. Thus, inhibition compensates for fewer cones to potentially preserve perception.

Predictive encoding of motion begins in the primate retina

Predictive motion encoding is an important aspect of visually guided behavior that allows animals to estimate the trajectory of moving objects. Motion prediction is understood primarily in the context of translational motion, but the environment contains other types of behaviorally salient motion correlation such as those produced by approaching or receding objects. However, the neural mechanisms that detect and predictively encode these correlations remain unclear. We report here that four of the parallel output pathways in the primate retina encode predictive motion information, and this encoding occurs for several classes of spatiotemporal correlation that are found in natural vision. Such predictive coding can be explained by known nonlinear circuit mechanisms that produce a nearly optimal encoding, with transmitted information approaching the theoretical limit imposed by the stimulus itself. Thus, these neural circuit mechanisms efficiently separate predictive information from nonpredictive information during the encoding process.

Efficient and adaptive sensory codes

The ability to adapt to changes in stimulus statistics is a hallmark of sensory systems. Here, we developed a theoretical framework that can account for the dynamics of adaptation from an information processing perspective. We use this framework to optimize and analyze adaptive sensory codes, and we show that codes optimized for stationary environments can suffer from prolonged periods of poor performance when the environment changes. To mitigate the adversarial effects of these environmental changes, sensory systems must navigate tradeoffs between the ability to accurately encode incoming stimuli and the ability to rapidly detect and adapt to changes in the distribution of these stimuli. We derive families of codes that balance these objectives, and we demonstrate their close match to experimentally observed neural dynamics during mean and variance adaptation. Our results provide a unifying perspective on adaptation across a range of sensory systems, environments, and sensory tasks.

Synaptic inputs to broad thorny ganglion cells in macaque retina

In primates, broad thorny retinal ganglion cells are highly sensitive to small, moving stimuli. They have tortuous, fine dendrites with many short, spine-like branches that occupy three contiguous strata in the middle of the inner plexiform layer. The neural circuits that generate their responses to moving stimuli are not well-understood, and that was the goal of this study. A connectome from central macaque retina was generated by serial block-face scanning electron microscopy, a broad thorny cell was reconstructed, and its synaptic inputs were analyzed. It received fewer than 2% of its inputs from both ON and OFF types of bipolar cells; the vast majority of its inputs were from amacrine cells. The presynaptic amacrine cells were reconstructed, and seven types were identified based on their characteristic morphology. Two types of narrow-field cells, knotty bistratified Type 1 and wavy multistratified Type 2, were identified. Two types of medium-field amacrine cells, ON starburst and spiny, were also presynaptic to the broad thorny cell. Three types of wide-field amacrine cells, wiry Type 2, stellate wavy, and semilunar Type 2, also made synapses onto the broad thorny cell. Physiological experiments using a macaque retinal preparation in vitro confirmed that broad thorny cells received robust excitatory input from both the ON and the OFF pathways. Given the paucity of bipolar cell inputs, it is likely that amacrine cells provided much of the excitatory input, in addition to inhibitory input.

High Contrast Allows the Retina to Compute More Than Just Contrast

The goal of sensory processing is to represent the environment of an animal. All sensory systems share a similar constraint: they need to encode a wide range of stimulus magnitudes within their narrow neuronal response range. The most efficient way, exploited by even the simplest nervous systems, is to encode relative changes in stimulus magnitude rather than the absolute magnitudes. For instance, the retina encodes contrast, which are the variations of light intensity occurring in time and in space. From this perspective, it is easy to understand why the bright plumage of a moving bird gains a lot of attention, while an octopus remains motionless and mimics its surroundings for concealment. Stronger contrasts simply cause stronger visual signals. However, the gains in retinal performance associated with higher contrast are far more than what can be attributed to just a trivial linear increase in signal strength. Here we discuss how this improvement in performance is reflected throughout different parts of the neural circuitry, within its neural code and how high contrast activates many non-linear mechanisms to unlock several sophisticated retinal computations that are virtually impossible in low contrast conditions.

Retinal ganglion cells and the magnocellular, parvocellular, and koniocellular subcortical visual pathways from the eye to the brain

In primates including humans, most retinal ganglion cells send signals to the lateral geniculate nucleus (LGN) of the thalamus. The anatomical and functional properties of the two major pathways through the LGN, the parvocellular (P) and magnocellular (M) pathways, are now well understood. Neurones in these pathways appear to convey a filtered version of the retinal image to primary visual cortex for further analysis. The properties of the P-pathway suggest it is important for high spatial acuity and red-green color vision, while those of the M-pathway suggest it is important for achromatic visual sensitivity and motion vision. Recent work has sharpened our understanding of how these properties are built in the retina, and described subtle but important nonlinearities that shape the signals that cortex receives. In addition to the P- and M-pathways, other retinal ganglion cells also project to the LGN. These ganglion cells are larger than those in the P- and M-pathways, have different retinal connectivity, and project to distinct regions of the LGN, together forming heterogenous koniocellular (K) pathways. Recent work has started to reveal the properties of these K-pathways, in the retina and in the LGN. The functional properties of K-pathways are more complex than those in the P- and M-pathways, and the K-pathways are likely to have a distinct contribution to vision. They provide a complementary pathway to the primary visual cortex, but can also send signals directly to extrastriate visual cortex. At the level of the LGN, many neurones in the K-pathways seem to integrate retinal with non-retinal inputs, and some may provide an early site of binocular convergence.

Functional-pathway-dominant contrast adaptation and sensitization in mouse retinal ganglion cells

Retinal ganglion cells (RGCs) reduce their light sensitivity during persistent high-contrast stimulation to prevent saturation to strong inputs and improve coding efficiency. This process is known as contrast adaptation. However, contrast adaptation also reduces RGCs' light response to weak inputs. On the other hand, some RGCs undergo contrast sensitization, and these RGCs respond to weak inputs following high contrast stimulation. In the present study, multi-electrode recordings were conducted on isolated mouse retinas under full-field visual stimulation with different contrast levels. Adaptation and sensitization were mainly observed in OFF and ON pathways, respectively. The results of linear-nonlinear analysis and stimulus reconstruction revealed that both the light sensitivity and encoded information were changed in opposite directions in adaptation and sensitization processes. Our work suggests that contrast adaptation and sensitization are two opposite dynamic processes. In mouse retina, OFF RGCs utilize adaptation to increase the discrimination of strong OFF inputs. On the other hand, ON RGCs use sensitization to increase the sensitivity to weak ON inputs. This functional differentiation might be meaningful for the mouse's survival as it lives in environments in which strong OFF stimuli often indicate potential predators while weak ON stimuli are usually related to movement and might be important for predation.

Selectivity to approaching motion in retinal inputs to the dorsal visual pathway

To efficiently navigate through the environment and avoid potential threats, an animal must quickly detect the motion of approaching objects. Current models of primate vision place the origins of this complex computation in the visual cortex. Here, we report that detection of approaching motion begins in the retina. Several ganglion cell types, the retinal output neurons, show selectivity to approaching motion. Synaptic current recordings from these cells further reveal that this preference for approaching motion arises in the interplay between presynaptic excitatory and inhibitory circuit elements. These findings demonstrate how excitatory and inhibitory circuits interact to mediate an ethologically relevant neural function. Moreover, the elementary computations that detect approaching motion begin early in the visual stream of primates.