Retina is structured to process an excess of darkness in natural scenes

Dynamic integration of information about salience and value for smooth pursuit eye movements

Eye movement behavior can be determined by bottom-up factors like visual salience and by top-down factors like expected value. These different types of signals have to be combined for the control of eye movements. In this study we investigated how smooth pursuit eye movements integrate salience and value information. Observers were asked to track a random-dot kinematogram containing two coherent motion directions. To manipulate salience, the coherence or the density of one of the motion signals was varied. To manipulate value, observers won or lost money in a separate experiment if they were tracking one or the other motion direction. Our results show that pursuit direction was initially determined only by salience. 300-400 ms after target motion onset, pursuit steered towards the rewarded direction and the salience effects disappeared. The time course of this effect depended crucially on the difficulty to segment the two signal directions. These results indicate that salience determines early pursuit responses in the same way as saccades with short latencies. Value information is processed slower and dominates pursuit after several 100 ms.

Perceived depth in natural images reflects encoding of low-level luminance statistics

Sighted animals must survive in an environment that is diverse yet highly structured. Neural-coding models predict that the visual system should allocate its computational resources to exploit regularities in the environment, and that this allocation should facilitate perceptual judgments. Here we use three approaches (natural scenes statistical analysis, a reanalysis of single-unit data from alert behaving macaque, and a behavioral experiment in humans) to address the question of how the visual system maximizes behavioral success by taking advantage of low-level regularities in the environment. An analysis of natural scene statistics reveals that the probability distributions for light increments and decrements are biased in a way that could be exploited by the visual system to estimate depth from relative luminance. A reanalysis of neurophysiology data from Samonds et al. (2012) shows that the previously reported joint tuning of V1 cells for relative luminance and binocular disparity is well matched to a predicted distribution of binocular disparities produced by natural scenes. Finally, we show that a percept of added depth can be elicited in images by exaggerating the correlation between luminance and depth. Together, the results from these three approaches provide further evidence that the visual system allocates its processing resources in a way that is driven by the statistics of the natural environment.

Smaller pupil size and better proofreading performance with positive than with negative polarity displays

The 'positive polarity advantage' describes the fact that reading performance is better for dark text on light background (positive polarity) than for light text on dark background (negative polarity). We investigated the underlying mechanism by assessing pupil size and proofreading performance when reading positive and negative polarity texts. In particular, we tested the display luminance hypothesis which postulates that the typically greater brightness of positive compared to negative polarity displays leads to smaller pupil sizes and, hence, a sharper retinal image and better perception of detail. Indeed, pupil sizes were smaller and proofreading performance was better with positive than with negative polarity displays. The results are compatible with the hypothesis that the positive polarity advantage is an effect of display luminance. Limitations of the study are being discussed.

Refractory sampling links efficiency and costs of sensory encoding to stimulus statistics

Sensory neurons integrate information about the world, adapting their sampling to its changes. However, little is understood mechanistically how this primary encoding process, which ultimately limits perception, depends upon stimulus statistics. Here, we analyze this open question systematically by using intracellular recordings from fly (Drosophila melanogaster and Coenosia attenuata) photoreceptors and corresponding stochastic simulations from biophysically realistic photoreceptor models. Recordings show that photoreceptors can sample more information from naturalistic light intensity time series (NS) than from Gaussian white-noise (GWN), shuffled-NS or Gaussian-1/f stimuli; integrating larger responses with higher signal-to-noise ratio and encoding efficiency to large bursty contrast changes. Simulations reveal how a photoreceptor's information capture depends critically upon the stochastic refractoriness of its 30,000 sampling units (microvilli). In daylight, refractoriness sacrifices sensitivity to enhance intensity changes in neural image representations, with more and faster microvilli improving encoding. But for GWN and other stimuli, which lack longer dark contrasts of real-world intensity changes that reduce microvilli refractoriness, these performance gains are submaximal and energetically costly. These results provide mechanistic reasons why information sampling is more efficient for natural/naturalistic stimulation and novel insight into the operation, design, and evolution of signaling and code in sensory neurons.

Grid cells and cortical representation

One of the grand challenges in neuroscience is to comprehend neural computation in the association cortices, the parts of the cortex that have shown the largest expansion and differentiation during mammalian evolution and that are thought to contribute profoundly to the emergence of advanced cognition in humans. In this Review, we use grid cells in the medial entorhinal cortex as a gateway to understand network computation at a stage of cortical processing in which firing patterns are shaped not primarily by incoming sensory signals but to a large extent by the intrinsic properties of the local circuit.

Neuronal and perceptual differences in the temporal processing of darks and lights

Visual information is mediated by two major thalamic pathways that signal light decrements (OFF) and increments (ON) in visual scenes, the OFF pathway being faster than the ON. Here, we demonstrate that this OFF temporal advantage is transferred to visual cortex and has a correlate in human perception. OFF-dominated cortical neurons in cats responded ∼3 ms faster to visual stimuli than ON-dominated cortical neurons, and dark-mediated suppression in ON-dominated neurons peaked ∼14 ms faster than light-mediated suppression in OFF-dominated neurons. Consistent with the neuronal differences, human observers were 6-14 ms faster at detecting darks than lights and better at discriminating dark than light flickers. Neuronal and perceptual differences both vanished if backgrounds were biased toward darks. Our results suggest that the cortical OFF pathway is faster than the ON pathway at increasing and suppressing visual responses, and these differences have parallels in the human visual perception of lights and darks.

Neuronal nonlinearity explains greater visual spatial resolution for darks than lights

Astronomers and physicists noticed centuries ago that visual spatial resolution is higher for dark than light stimuli, but the neuronal mechanisms for this perceptual asymmetry remain unknown. Here we demonstrate that the asymmetry is caused by a neuronal nonlinearity in the early visual pathway. We show that neurons driven by darks (OFF neurons) increase their responses roughly linearly with luminance decrements, independent of the background luminance. However, neurons driven by lights (ON neurons) saturate their responses with small increases in luminance and need bright backgrounds to approach the linearity of OFF neurons. We show that, as a consequence of this difference in linearity, receptive fields are larger in ON than OFF thalamic neurons, and cortical neurons are more strongly driven by darks than lights at low spatial frequencies. This ON/OFF asymmetry in linearity could be demonstrated in the visual cortex of cats, monkeys, and humans and in the cat visual thalamus. Furthermore, in the cat visual thalamus, we show that the neuronal nonlinearity is present at the ON receptive field center of ON-center neurons and ON receptive field surround of OFF-center neurons, suggesting an origin at the level of the photoreceptor. These results demonstrate a fundamental difference in visual processing between ON and OFF channels and reveal a competitive advantage for OFF neurons over ON neurons at low spatial frequencies, which could be important during cortical development when retinal images are blurred by immature optics in infant eyes.

Flies and humans share a motion estimation strategy that exploits natural scene statistics

Sighted animals extract motion information from visual scenes by processing spatiotemporal patterns of light falling on the retina. The dominant models for motion estimation exploit intensity correlations only between pairs of points in space and time. Moving natural scenes, however, contain more complex correlations. We found that fly and human visual systems encode the combined direction and contrast polarity of moving edges using triple correlations that enhance motion estimation in natural environments. Both species extracted triple correlations with neural substrates tuned for light or dark edges, and sensitivity to specific triple correlations was retained even as light and dark edge motion signals were combined. Thus, both species separately process light and dark image contrasts to capture motion signatures that can improve estimation accuracy. This convergence argues that statistical structures in natural scenes have greatly affected visual processing, driving a common computational strategy over 500 million years of evolution.

Adaptation to changes in higher-order stimulus statistics in the salamander retina

Adaptation in the retina is thought to optimize the encoding of natural light signals into sequences of spikes sent to the brain. While adaptive changes in retinal processing to the variations of the mean luminance level and second-order stimulus statistics have been documented before, no such measurements have been performed when higher-order moments of the light distribution change. We therefore measured the ganglion cell responses in the tiger salamander retina to controlled changes in the second (contrast), third (skew) and fourth (kurtosis) moments of the light intensity distribution of spatially uniform temporally independent stimuli. The skew and kurtosis of the stimuli were chosen to cover the range observed in natural scenes. We quantified adaptation in ganglion cells by studying linear-nonlinear models that capture well the retinal encoding properties across all stimuli. We found that the encoding properties of retinal ganglion cells change only marginally when higher-order statistics change, compared to the changes observed in response to the variation in contrast. By analyzing optimal coding in LN-type models, we showed that neurons can maintain a high information rate without large dynamic adaptation to changes in skew or kurtosis. This is because, for uncorrelated stimuli, spatio-temporal summation within the receptive field averages away non-gaussian aspects of the light intensity distribution.

Cortical brightness adaptation when darkness and brightness produce different dynamical states in the visual cortex

Darkness and brightness are very different perceptually. To understand the neural basis for the visual difference, we studied the dynamical states of populations of neurons in macaque primary visual cortex when a spatially uniform area (8° × 8°) of the visual field alternated between black and white. Darkness evoked sustained nerve-impulse spiking in primary visual cortex neurons, but bright stimuli evoked only a transient response. A peak in the local field potential (LFP) γ band (30-80 Hz) occurred during darkness; white-induced LFP fluctuations were of lower amplitude, peaking at 25 Hz. However, the sustained response to white in the evoked LFP was larger than for black. Together with the results on spiking, the LFP results imply that, throughout the stimulus period, bright fields evoked strong net sustained inhibition. Such cortical brightness adaptation can explain many perceptual phenomena: interocular speeding up of dark adaptation, tonic interocular suppression, and interocular masking.

Information theory of adaptation in neurons, behavior, and mood

The ability to make accurate predictions of future stimuli and consequences of one's actions are crucial for the survival and appropriate decision-making. These predictions are constantly being made at different levels of the nervous system. This is evidenced by adaptation to stimulus parameters in sensory coding, and in learning of an up-to-date model of the environment at the behavioral level. This review will discuss recent findings that actions of neurons and animals are selected based on detailed stimulus history in such a way as to maximize information for achieving the task at hand. Information maximization dictates not only how sensory coding should adapt to various statistical aspects of stimuli, but also that reward function should adapt to match the predictive information from past to future.

Transformation of stimulus correlations by the retina

Redundancies and correlations in the responses of sensory neurons may seem to waste neural resources, but they can also carry cues about structured stimuli and may help the brain to correct for response errors. To investigate the effect of stimulus structure on redundancy in retina, we measured simultaneous responses from populations of retinal ganglion cells presented with natural and artificial stimuli that varied greatly in correlation structure; these stimuli and recordings are publicly available online. Responding to spatio-temporally structured stimuli such as natural movies, pairs of ganglion cells were modestly more correlated than in response to white noise checkerboards, but they were much less correlated than predicted by a non-adapting functional model of retinal response. Meanwhile, responding to stimuli with purely spatial correlations, pairs of ganglion cells showed increased correlations consistent with a static, non-adapting receptive field and nonlinearity. We found that in response to spatio-temporally correlated stimuli, ganglion cells had faster temporal kernels and tended to have stronger surrounds. These properties of individual cells, along with gain changes that opposed changes in effective contrast at the ganglion cell input, largely explained the pattern of pairwise correlations across stimuli where receptive field measurements were possible.

An influential theory of early sensory processing argues that sensory circuits should conserve scarce resources in their outputs by reducing correlations present in their inputs. Measuring simultaneous responses from large numbers of retinal ganglion cells responding to widely different classes of visual stimuli, we find that output correlations increase when we present stimuli with spatial, but not temporal, correlations. On the other hand, we find evidence that retina adjusts to spatio-temporal structure so that retinal output correlations change less than input correlations would predict. Changes in the receptive field properties of individual cells, along with gain changes, largely explain this relative constancy of correlations over the population.

Olfactory stimulation selectively modulates the OFF pathway in the retina of zebrafish

Cross-modal regulation of visual performance by olfactory stimuli begins in the retina, where dopaminergic interneurons receive projections from the olfactory bulb. However, we do not understand how olfactory stimuli alter the processing of visual signals within the retina. We investigated this question by in vivo imaging activity in transgenic zebrafish expressing SyGCaMP2 in bipolar cell terminals and GCaMP3.5 in ganglion cells. The food-related amino acid methionine reduced the gain and increased sensitivity of responses to luminance and contrast transmitted through OFF bipolar cells but not ON. The effects of olfactory stimulus were blocked by inhibiting dopamine uptake and release. Activation of dopamine receptors increased the gain of synaptic transmission in vivo and potentiated synaptic calcium currents in isolated bipolar cells. These results indicate that olfactory stimuli alter the sensitivity of the retina through the dopaminergic regulation of presynaptic calcium channels that control the gain of synaptic transmission through OFF bipolar cells.

•

Olfactory stimuli regulate transmission of signals through retinal bipolar cells

•

Modulation of synaptic gain and sensitivity occur in OFF bipolar cells but not ON

•

An inhibitor of dopamine uptake blocks odor-induced changes in synaptic gain

•

Dopamine potentiates presynaptic calcium channels in isolated bipolar cells

Novel flicker-sensitive visual circuit neurons inhibited by stationary patterns

Many animals use visual motion cues for navigating within their surroundings. Both flies and vertebrates compute local motion by temporal correlation of neighboring photoreceptors, via so-called elementary motion detectors (EMDs). In the fly lobula plate and the vertebrate visual cortex the output from many EMDs is pooled in neurons sensitive to wide-field optic flow. Although the EMD has been the preferred model for more than 50 years, recent work has highlighted its limitations in describing some visual behaviors, such as responses to higher-order motion stimuli. Non-EMD motion processing may therefore serve an important function in vision. Here, we describe a novel neuron class in the fly lobula plate that clearly does not derive its input from classic EMDs. The centrifugal stationary inhibited flicker excited (cSIFE) neuron is strongly excited by flicker, up to very high temporal frequencies. The non-EMD driven flicker sensitivity leads to strong, nondirectional responses to high-speed, wide-field motion. Furthermore, cSIFE is strongly inhibited by stationary patterns, within a narrow wavelength band. cSIFE's outputs overlap with the inputs of well described optic flow-sensitive lobula plate tangential cells (LPTCs). Driving cSIFE affects the active dendrites of LPTCs, and cSIFE may therefore play a large role in motion vision.

Synaptic mechanisms of adaptation and sensitization in the retina

Sensory systems continually adjust the way stimuli are processed. What are the circuit mechanisms underlying this plasticity? We investigated how synapses in the retina of zebrafish adjust to changes in the temporal contrast of a visual stimulus by imaging activity in vivo. Following an increase in contrast, bipolar cell synapses with strong initial responses depressed, whereas synapses with weak initial responses facilitated. Depression and facilitation predominated in different strata of the inner retina, where bipolar cell output was anticorrelated with the activity of amacrine cell synapses providing inhibitory feedback. Pharmacological block of GABAergic feedback converted facilitating bipolar cell synapses into depressing ones. These results indicate that depression intrinsic to bipolar cell synapses causes adaptation of the ganglion cell response to contrast, whereas depression in amacrine cell synapses causes sensitization. Distinct microcircuits segregating to different layers of the retina can cause simultaneous increases or decreases in the gain of neural responses.

Efficient coding of spatial information in the primate retina

Sensory neurons have been hypothesized to efficiently encode signals from the natural environment subject to resource constraints. The predictions of this efficient coding hypothesis regarding the spatial filtering properties of the visual system have been found consistent with human perception, but they have not been compared directly with neural responses. Here, we analyze the information that retinal ganglion cells transmit to the brain about the spatial information in natural images subject to three resource constraints: the number of retinal ganglion cells, their total response variances, and their total synaptic strengths. We derive a model that optimizes the transmitted information and compare it directly with measurements of complete functional connectivity between cone photoreceptors and the four major types of ganglion cells in the primate retina, obtained at single-cell resolution. We find that the ganglion cell population exhibited 80% efficiency in transmitting spatial information relative to the model. Both the retina and the model exhibited high redundancy (~30%) among ganglion cells of the same cell type. A novel and unique prediction of efficient coding, the relationships between projection patterns of individual cones to all ganglion cells, was consistent with the observed projection patterns in the retina. These results indicate a high level of efficiency with near-optimal redundancy in visual signaling by the retina.

The neuronal organization of the retina

The mammalian retina consists of neurons of >60 distinct types, each playing a specific role in processing visual images. They are arranged in three main stages. The first decomposes the outputs of the rod and cone photoreceptors into ∼12 parallel information streams. The second connects these streams to specific types of retinal ganglion cells. The third combines bipolar and amacrine cell activity to create the diverse encodings of the visual world--roughly 20 of them--that the retina transmits to the brain. New transformations of the visual input continue to be found: at least half of the encodings sent to the brain (ganglion cell response selectivities) remain to be discovered. This diversity of the retina's outputs has yet to be incorporated into our understanding of higher visual function.

Relative luminance and binocular disparity preferences are correlated in macaque primary visual cortex, matching natural scene statistics

Humans excel at inferring information about 3D scenes from their 2D images projected on the retinas, using a wide range of depth cues. One example of such inference is the tendency for observers to perceive lighter image regions as closer. This psychophysical behavior could have an ecological basis because nearer regions tend to be lighter in natural 3D scenes. Here, we show that an analogous association exists between the relative luminance and binocular disparity preferences of neurons in macaque primary visual cortex. The joint coding of relative luminance and binocular disparity at the neuronal population level may be an integral part of the neural mechanisms for perceptual inference of depth from images.

Faster thalamocortical processing for dark than light visual targets

ON and OFF visual pathways originate in the retina at the synapse between photoreceptor and bipolar cells. OFF bipolar cells are shorter in length and use receptors with faster kinetics than ON bipolar cells and, therefore, process information faster. Here, we demonstrate that this temporal advantage is maintained through thalamocortical processing, with OFF visual responses reaching cortex ~3-6 ms before ON visual responses. Faster OFF visual responses could be demonstrated in recordings from large populations of cat thalamic neurons representing the center of vision (both X and Y) and from subpopulations making connection with the same cortical orientation column. While the OFF temporal advantage diminished as visual responses reached their peak, the integral of the impulse response was greater in OFF than ON neurons. Given the stimulus preferences from OFF and ON channels, our results indicate that darks are processed faster than lights in the thalamocortical pathway.

Neural population densities shape network correlations

The way sensory microcircuits manage cellular response correlations is a crucial question in understanding how such systems integrate external stimuli and encode information. Most sensory systems exhibit heterogeneities in terms of population sizes and features, which all impact their dynamics. This work addresses how correlations between the dynamics of neural ensembles depend on the relative size or density of excitatory and inhibitory populations. To do so, we study an apparently symmetric system of coupled stochastic differential equations that model the evolution of the populations' activities. Excitatory and inhibitory populations are connected by reciprocal recurrent connections, and both receive different stimuli exhibiting a certain level of correlation with each other. A stability analysis is performed, which reveals an intrinsic asymmetry in the distribution of the fixed points with respect to the threshold of the nonlinearities. Based on this, we show how the cross correlation between the population responses depends on the density of the inhibitory population, and that a specific ratio between both population sizes leads to a state of zero correlation. We show that this so-called asynchronous state subsists, despite the presence of stimulus correlation, and most importantly, that it occurs only in asymmetrical systems where one population outnumbers the other. Using linear approximations, we derive analytical expressions for the root of the cross-correlation function and study how the asynchronous state is impacted by the model's parameters. This work suggests a possible explanation for why inhibitory cells outnumber excitatory cells in the visual system.

Darks are processed faster than lights

Recent physiological studies claim that dark stimuli have access to greater neuronal resources than light stimuli in early visual pathway. We used two sets of novel stimuli to examine the functional consequences of this dark dominance in human observers. We show that increment and decrement thresholds are equal when controlled for adaptation and eye movements. However, measurements for salience differences at high contrasts show that darks are detected pronouncedly faster and more accurately than lights when presented against uniform binary noise. In addition, the salience advantage for darks is abolished when the background distribution is adjusted to control for the irradiation illusion. The threshold equality suggests that the highest sensitivities of neurons in the ON and OFF channels are similar, whereas the salience difference is consistent with a population advantage for the OFF system.

Fast, scalable, Bayesian spike identification for multi-electrode arrays

We present an algorithm to identify individual neural spikes observed on high-density multi-electrode arrays (MEAs). Our method can distinguish large numbers of distinct neural units, even when spikes overlap, and accounts for intrinsic variability of spikes from each unit. As MEAs grow larger, it is important to find spike-identification methods that are scalable, that is, the computational cost of spike fitting should scale well with the number of units observed. Our algorithm accomplishes this goal, and is fast, because it exploits the spatial locality of each unit and the basic biophysics of extracellular signal propagation. Human interaction plays a key role in our method; but effort is minimized and streamlined via a graphical interface. We illustrate our method on data from guinea pig retinal ganglion cells and document its performance on simulated data consisting of spikes added to experimentally measured background noise. We present several tests demonstrating that the algorithm is highly accurate: it exhibits low error rates on fits to synthetic data, low refractory violation rates, good receptive field coverage, and consistency across users.

Natural images from the birthplace of the human eye

Here we introduce a database of calibrated natural images publicly available through an easy-to-use web interface. Using a Nikon D70 digital SLR camera, we acquired about six-megapixel images of Okavango Delta of Botswana, a tropical savanna habitat similar to where the human eye is thought to have evolved. Some sequences of images were captured unsystematically while following a baboon troop, while others were designed to vary a single parameter such as aperture, object distance, time of day or position on the horizon. Images are available in the raw RGB format and in grayscale. Images are also available in units relevant to the physiology of human cone photoreceptors, where pixel values represent the expected number of photoisomerizations per second for cones sensitive to long (L), medium (M) and short (S) wavelengths. This database is distributed under a Creative Commons Attribution-Noncommercial Unported license to facilitate research in computer vision, psychophysics of perception, and visual neuroscience.

Information transmission in genetic regulatory networks: a review

Genetic regulatory networks enable cells to respond to changes in internal and external conditions by dynamically coordinating their gene expression profiles. Our ability to make quantitative measurements in these biochemical circuits has deepened our understanding of what kinds of computations genetic regulatory networks can perform, and with what reliability. These advances have motivated researchers to look for connections between the architecture and function of genetic regulatory networks. Transmitting information between a network's inputs and outputs has been proposed as one such possible measure of function, relevant in certain biological contexts. Here we summarize recent developments in the application of information theory to gene regulatory networks. We first review basic concepts in information theory necessary for understanding recent work. We then discuss the functional complexity of gene regulation, which arises from the molecular nature of the regulatory interactions. We end by reviewing some experiments that support the view that genetic networks responsible for early development of multicellular organisms might be maximizing transmitted 'positional information'.

Illuminating synapses and circuitry in the retina

In the central nervous system, space is at a premium. This is especially true in the retina, where synapses, cells, and circuitry have evolved to maximize signal-processing capacity within a thin, optically transparent tissue. For example, at some retinal synapses, single presynaptic active zones contact multiple postsynaptic targets; some individual neurons perform completely different tasks depending on visual conditions, while others execute hundreds of circuit computations in parallel; and the retinal network adapts, at various levels, to the ever-changing visual world. Each of these features reflects efficient use of limited cellular resources to optimally encode visual information.