Two Sides of the Same Coin: Efficient and Predictive Neural Coding

Nonlinear receptive fields evoke redundant retinal coding of natural scenes

The role of the vertebrate retina in early vision is generally described by the efficient coding hypothesis1,2, which predicts that the retina reduces the redundancy inherent in natural scenes3 by discarding spatiotemporal correlations while preserving stimulus information4. It is unclear, however, whether the predicted decorrelation and redundancy reduction in the activity of ganglion cells, the retina's output neurons, hold under gaze shifts, which dominate the dynamics of the natural visual input5. We show here that species-specific gaze patterns in natural stimuli can drive correlated spiking responses both in and across distinct types of ganglion cells in marmoset as well as mouse retina. These concerted responses disrupt redundancy reduction to signal fixation periods with locally high spatial contrast. Model-based analyses of ganglion cell responses to natural stimuli show that the observed response correlations follow from nonlinear pooling of ganglion cell inputs. Our results indicate cell-type-specific deviations from efficient coding in retinal processing of natural gaze shifts.

Functional diversity in the output of the primate retina

The visual image transmitted by the retina to the brain has long been understood in terms of spatial filtering by the center-surround receptive fields of retinal ganglion cells (RGCs). Recently, this textbook view has been challenged by the stunning functional diversity and specificity observed in ∼40 distinct RGC types in the mouse retina. However, it is unclear whether the ∼20 morphologically and molecularly identified RGC types in primates exhibit similar functional diversity, or instead exhibit center-surround organization at different spatial scales. Here, we reveal striking and surprising functional diversity in macaque and human RGC types using large-scale multi-electrode recordings from isolated macaque and human retinas. In addition to the five well-known primate RGC types, 18-27 types were distinguished by their functional properties, likely revealing several previously unknown types. Surprisingly, many of these cell types exhibited striking non-classical receptive field structure, including irregular spatial and chromatic properties not previously reported in any species. Qualitatively similar results were observed in recordings from the human retina. The receptive fields of less-understood RGC types formed uniform mosaics covering visual space, confirming their classification, and the morphological counterparts of two types were established using single-cell recording. The striking receptive field diversity was paralleled by distinctive responses to natural movies and complexity of visual computation. These findings suggest that diverse RGC types, rather than merely filtering the scene at different spatial scales, instead play specialized roles in human vision.

Human perception of flicker-fused letters that are luminance balanced

The Talbot-Plateau law specifies what combinations of flash frequency, duration, and intensity will yield a flicker-fused stimulus that matches the brightness of a steady stimulus. It has proven to be remarkably robust in its predictions, and here we provide additional support though the use of a contrast discrimination task. However, we also find that the visual system can register flicker-fused letters when the combination of frequency and duration is relatively low. The letters are recognized even though they have the same physical luminance as background. We hypothesize that the letters elicit synchronous oscillations that encode for stimulus attributes, which prevents the letter from blending into the background.

Pupil constriction by contrast for contrast

The pupil is the eye's adjustable aperture. Fitzpatrick et al. find that visual contrast constricts the pupil, increasing contrast.1 This process improves behavioral performance. Its retinal origin has unorthodox elements, like interneurons that make connections in unusual locales and photoreceptive ganglion cells.

A mechanism for deviance detection and contextual routing in the thalamus: a review and theoretical proposal

Predictive processing theories conceptualize neocortical feedback as conveying expectations and contextual attention signals derived from internal cortical models, playing an essential role in the perception and interpretation of sensory information. However, few predictive processing frameworks outline concrete mechanistic roles for the corticothalamic (CT) feedback from layer 6 (L6), despite the fact that the number of CT axons is an order of magnitude greater than that of feedforward thalamocortical (TC) axons. Here we review the functional architecture of CT circuits and propose a mechanism through which L6 could regulate thalamic firing modes (burst, tonic) to detect unexpected inputs. Using simulations in a model of a TC cell, we show how the CT feedback could support prediction-based input discrimination in TC cells by promoting burst firing. This type of CT control can enable the thalamic circuit to implement spatial and context selective attention mechanisms. The proposed mechanism generates specific experimentally testable hypotheses. We suggest that the L6 CT feedback allows the thalamus to detect deviance from predictions of internal cortical models, thereby supporting contextual attention and routing operations, a far more powerful role than traditionally assumed.