Circuitry to explain how the relative number of L and M cones shapes color experience

Unique yellow shifts for small and brief stimuli in the central retina

The spectral locus of unique yellow was determined for flashes of different sizes (<11 arcmin) and durations (<500 ms) presented in and near the fovea. An adaptive optics scanning laser ophthalmoscope was used to minimize the effects of higher-order aberrations during simultaneous stimulus delivery and retinal imaging. In certain subjects, parafoveal cones were classified as L, M, or S, which permitted the comparison of unique yellow measurements with variations in local L/M ratios within and between observers. Unique yellow shifted to longer wavelengths as stimulus size or duration was reduced. This effect is most pronounced for changes in size and more apparent in the fovea than in the parafovea. The observed variations in unique yellow are not entirely predicted from variations in L/M ratio and therefore implicate neural processes beyond photoreception.

Cone-Opponent Ganglion Cells in the Primate Fovea Tuned to Noncardinal Color Directions

A long-standing question in vision science is how the three cone photoreceptor types-long (L), medium (M), and short (S) wavelength sensitive-combine to generate our perception of color. Hue perception can be described along two opponent axes: red-green and blue-yellow. Psychophysical measurements of color appearance indicate that the cone inputs to the red-green and blue-yellow opponent axes are M vs. L + S and L vs. M + S, respectively. However, the "cardinal directions of color space" revealed by psychophysical measurements of color detection thresholds following adaptation are L vs. M and S vs. L + M. These cardinal directions match the most common cone-opponent retinal ganglion cells (RGCs) in the primate retina. Accordingly, the cone opponency necessary for color appearance is thought to be established in the cortex. While neurons with the appropriate M vs. L + S and L vs. M + S opponency have been reported in the retina and lateral geniculate nucleus, their existence continues to be debated. Resolving this long-standing debate is necessary because a complete account of the cone opponency in the retinal output is critical for understanding how downstream neural circuits process color. Here, we performed adaptive optics calcium imaging to noninvasively measure foveal RGC light responses in the living Macaca fascicularis eye. We confirm the presence of L vs. M + S and M vs. L + S neurons with noncardinal cone opponency and demonstrate that cone-opponent signals in the retinal output are more diverse than classically thought.

From cones to color vision: a neurobiological model that explains the unique hues

The irreducible unique hues-red, green, blue, and yellow-remain one of the great mysteries of vision science. Attempts to create a physiologically parsimonious model that can predict the spectral locations of the unique hues all rely on at least one post hoc adjustment to produce appropriate loci for unique green and unique red, and struggle to explain the non-linearity of the Blue/Yellow system. We propose a neurobiological color vision model that overcomes these challenges by using physiological cone ratios, cone-opponent normalization to equal-energy white, and a simple adaptation mechanism to produce color-opponent mechanisms that accurately predict the spectral locations and variability of the unique hues.

Variation and heritability of retinal cone ratios in a free-ranging population of rhesus macaques

A defining feature of catarrhine primates is uniform trichromacy-the ability to distinguish red (long; L), green (medium; M), and blue (short; S) wavelengths of light. Although the tuning of photoreceptors is conserved, the ratio of L:M cones in the retina is variable within and between species, with human cone ratios differing from other catarrhines. Yet, the sources and structure of variation in cone ratios are poorly understood, precluding a broader understanding of color vision variability. Here, we report a large-scale study of a pedigreed population of rhesus macaques (Macaca mulatta). We collected foveal RNA and analyzed opsin gene expression using cDNA and estimated additive genetic variance of cone ratios. The average L:M ratio and standard error was 1.03:1 ± 0.02. There was no age effect, and genetic contribution to variation was negligible. We found marginal sex effects with females having larger ratios than males. S cone ratios (0.143:1 ± 0.002) had significant genetic variance with a heritability estimate of 43% but did not differ between sexes or age groups. Our results contextualize the derived human condition of L-cone dominance and provide new information about the heritability of cone ratios and variation in primate color vision.

How We See Black and White: The Role of Midget Ganglion Cells

According to classical opponent color theory, hue sensations are mediated by spectrally opponent neurons that are excited by some wavelengths of light and inhibited by others, while black-and-white sensations are mediated by spectrally non-opponent neurons that respond with the same sign to all wavelengths. However, careful consideration of the morphology and physiology of spectrally opponent L vs. M midget retinal ganglion cells (RGCs) in the primate retina indicates that they are ideally suited to mediate black-and-white sensations and poorly suited to mediate color. Here we present a computational model that demonstrates how the cortex could use unsupervised learning to efficiently separate the signals from L vs. M midget RGCs into distinct signals for black and white based only correlation of activity over time. The model also reveals why it is unlikely that these same ganglion cells could simultaneously mediate our perception of red and green, and shows how, in theory, a separate small population of midget RGCs with input from S, M, and L cones would be ideally suited to mediating hue perception.

Dissociation between red and white stimulus perception: A perimetric quantification of protanopic color vision deficiencies

Significance

Horizontal visual field extension was assessed for red and white stimuli in subjects with protanopia using semi-automated kinetic perimetry. In contrast to a conventional anomaloscope, the “red/white dissociation ratio” (RWR) allows to describe protanopia numerically. For the majority of subjects with protanopia a restriction for faint red stimuli was found.

Purpose

Comparing the horizontal visual field extensions for red and white stimuli in subjects with protanopia and those with normal trichromacy and assessing the related intra-subject intra-session repeatability.

Methods

The subjects were divided into groups with protanopia and with normal trichromacy, based on color vision testing (HMC anomaloscope, Oculus, Wetzlar/FRG). Two stimulus characteristics, III4e and III1e, according to the Goldmann-classification, were presented with semi-automated kinetic perimetry (Octopus 900 perimeter, Haag-Streit, Köniz/CH). They moved along the horizontal meridian, with an angular velocity of 3°/s towards the visual field center, starting from either the temporal or nasal periphery. If necessary, a 20° nasal fixation point offset was chosen to capture the temporal periphery of the visual field. For each condition the red/white dissociation ratio (RWR); Pat Appl. DPMA DRN 43200082D) between the extent of the isopter for red (RG610, Schott, Mainz/ FRG) and white stimuli along the horizontal meridian was determined.

Results

All data are listed as median/interquartile range: Five males with protanopia (age 22.1/4.5 years) and six males with normal trichromacy (control group, age 30.5/15.2 years) were enrolled. The RWR is listed for the right eye, as no clinically relevant difference between right and left eye occurred. Protanopes’ RWR for mark III4e (in brackets: control group) was 0.941/0.013 (0.977/0.019) and for mark III1e 0.496/0.062 (0.805/0.051), respectively.

Conclusions

In this exploratory “proof-of-concept study” red/white dissociation ratio perimetry is introduced as a novel technique aiming at assessing and quantifying the severity of protanopia. Further effort is needed to understand the magnitude of the observed red-/white dissociation and to extend this methodology to a wider age range of the sample and to anomalous trichromacies (protanomalia) with varying magnitude.

Reconciling Color Vision Models With Midget Ganglion Cell Receptive Fields

Midget retinal ganglion cells (RGCs) make up the majority of foveal RGCs in the primate retina. The receptive fields of midget RGCs exhibit both spectral and spatial opponency and are implicated in both color and achromatic form vision, yet the exact mechanisms linking their responses to visual perception remain unclear. Efforts to develop color vision models that accurately predict all the features of human color and form vision based on midget RGCs provide a case study connecting experimental and theoretical neuroscience, drawing on diverse research areas such as anatomy, physiology, psychophysics, and computer vision. Recent technological advances have allowed researchers to test some predictions of color vision models in new and precise ways, producing results that challenge traditional views. Here, we review the progress in developing models of color-coding receptive fields that are consistent with human psychophysics, the biology of the primate visual system and the response properties of midget RGCs.

Photopigment genes, cones, and color update: disrupting the splicing code causes a diverse array of vision disorders

The human long- and middle-wavelength sensitive cone opsin genes exhibit an extraordinary degree of haplotype diversity that results from recombination mechanisms that have intermixed the genes. As a first step in expression, genes-including the protein coding exons and intervening introns-are transcribed. Next, transcripts are spliced to remove the introns and join the exons to generate a mature message that codes for the protein. Important information necessary for splicing is contained within exons, and is overlaid by the protein code. Intermixing the long- and middle-wavelength sensitive cone opsin genes has disrupted the splicing code, leading to exclusion of some exons from the mature message and is associated with several vision disorders including nearsightedness, cone dystrophy, and color vision deficiencies.

The spectral identity of foveal cones is preserved in hue perception

Organisms are faced with the challenge of making inferences about the physical world from incomplete incoming sensory information. One strategy to combat ambiguity in this process is to combine new information with prior experiences. We investigated the strategy of combining these information sources in color vision. Single cones in human subjects were stimulated and the associated percepts were recorded. Subjects rated each flash for brightness, hue, and saturation. Brightness ratings were proportional to stimulus intensity. Saturation was independent of intensity, but varied between cones. Hue, in contrast, was assigned in a stereotyped manner that was predicted by cone type. These experiments revealed that, near the fovea, long and middle wavelength sensitive cones produce sensations that can be reliably distinguished on the basis of hue, but not saturation or brightness. Taken together, these observations implicate the high-resolution, color-opponent parvocellular pathway in this low-level visual task.

V1-based modeling of discrimination between natural scenes within the luminance and isoluminant color planes

We have been developing a computational visual difference predictor model that can predict how human observers rate the perceived magnitude of suprathreshold differences between pairs of full-color naturalistic scenes (To, Lovell, Troscianko, & Tolhurst, 2010). The model is based closely on V1 neurophysiology and has recently been updated to more realistically implement sequential application of nonlinear inhibitions (contrast normalization followed by surround suppression; To, Chirimuuta, & Tolhurst, 2017). The model is based originally on a reliable luminance model (Watson & Solomon, 1997) which we have extended to the red/green and blue/yellow opponent planes, assuming that the three planes (luminance, red/green, and blue/yellow) can be modeled similarly to each other with narrow-band oriented filters. This paper examines whether this may be a false assumption, by decomposing our original full-color stimulus images into monochromatic and isoluminant variants, which observers rate separately and which we model separately. The ratings for the original full-color scenes correlate better with the new ratings for the monochromatic variants than for the isoluminant ones, suggesting that luminance cues carry more weight in observers' ratings to full-color images. The ratings for the original full-color stimuli can be predicted from the new monochromatic and isoluminant rating data by combining them by Minkowski summation with power m = 2.71, consistent with other studies involving feature summation. The model performed well at predicting ratings for monochromatic stimuli, but was weaker for isoluminant stimuli, indicating that mirroring the monochromatic models is not sufficient to model the color planes. We discuss several alternative strategies to improve the color modeling.

Sensations from a single M-cone depend on the activity of surrounding S-cones

Color vision requires the activity of cone photoreceptors to be compared in post-receptoral circuitry. Decades of psychophysical measurements have quantified the nature of these comparative interactions on a coarse scale. How such findings generalize to a cellular scale remains unclear. To answer that question, we quantified the influence of surrounding light on the appearance of spots targeted to individual cones. The eye's aberrations were corrected with adaptive optics and retinal position was precisely tracked in real-time to compensate for natural movement. Subjects reported the color appearance of each spot. A majority of L-and M-cones consistently gave rise to the sensation of white, while a smaller group repeatedly elicited hue sensations. When blue sensations were reported they were more likely mediated by M- than L-cones. Blue sensations were elicited from M-cones against a short-wavelength light that preferentially elevated the quantal catch in surrounding S-cones, while stimulation of the same cones against a white background elicited green sensations. In one of two subjects, proximity to S-cones increased the probability of blue reports when M-cones were probed. We propose that M-cone increments excited both green and blue opponent pathways, but the relative activity of neighboring cones favored one pathway over the other.

Evolution of the circuitry for conscious color vision in primates

There are many ganglion cell types and subtypes in our retina that carry color information. These have appeared at different times over the history of the evolution of the vertebrate visual system. They project to several different places in the brain and serve a variety of purposes allowing wavelength information to contribute to diverse visual functions. These include circadian photoentrainment, regulation of sleep and mood, guidance of orienting movements, detection and segmentation of objects. Predecessors to some of the circuits serving these purposes presumably arose before mammals evolved and different functions are represented by distinct ganglion cell types. However, while other animals use color information to elicit motor movements and regulate activity rhythms, as do humans, using phylogenetically ancient circuitry, the ability to appreciate color appearance may have been refined in ancestors to primates, mediated by a special set of ganglion cells that serve only that purpose. Understanding the circuitry for color vision has implications for the possibility of treating color blindness using gene therapy by recapitulating evolution. In addition, understanding how color is encoded, including how chromatic and achromatic percepts are separated is a step toward developing a complete picture of the diversity of ganglion cell types and their functions. Such knowledge could be useful in developing therapeutic strategies for blinding eye disorders that rely on stimulating elements in the retina, where more than 50 different neuron types are organized into circuits that transform signals from photoreceptors into specialized detectors many of which are not directly involved in conscious vision.

The elementary representation of spatial and color vision in the human retina

The retina is the most accessible element of the central nervous system for linking behavior to the activity of isolated neurons. We unraveled behavior at the elementary level of single input units-the visual sensation generated by stimulating individual long (L), middle (M), and short (S) wavelength-sensitive cones with light. Spectrally identified cones near the fovea of human observers were targeted with small spots of light, and the type, proportion, and repeatability of the elicited sensations were recorded. Two distinct populations of cones were observed: a smaller group predominantly associated with signaling chromatic sensations and a second, more numerous population linked to achromatic percepts. Red and green sensations were mainly driven by L- and M-cones, respectively, although both cone types elicited achromatic percepts. Sensations generated by cones were rarely stochastic; rather, they were consistent over many months and were dominated by one specific perceptual category. Cones lying in the midst of a pure spectrally opponent neighborhood, an arrangement purported to be most efficient in producing chromatic signals in downstream neurons, were no more likely to signal chromatic percepts. Overall, the results are consistent with the idea that the nervous system encodes high-resolution achromatic information and lower-resolution color signals in separate pathways that emerge as early as the first synapse. The lower proportion of cones eliciting color sensations may reflect a lack of evolutionary pressure for the chromatic system to be as fine-grained as the high-acuity achromatic system.