Color and the Cone Mosaic

Diverse functions and pathogenetic role of Crumbs in retinopathy

The Crumbs protein (CRB) family plays a crucial role in maintaining the apical-basal polarity and integrity of embryonic epithelia. The family comprises different isoforms in different animals and possesses diverse structural, localization, and functional characteristics. Mutations in the human CRB1 or CRB2 gene may lead to a broad spectrum of retinal dystrophies. Various CRB-associated experimental models have recently provided mechanistic insights into human CRB-associated retinopathies. The knowledge obtained from these models corroborates the importance of CRB in retinal development and maintenance. Therefore, complete elucidation of these models can provide excellent therapeutic prospects for human CRB-associated retinopathies. In this review, we summarize the current animal models and human-derived models of different CRB family members and describe the main characteristics of their retinal phenotypes.

Brightness and hue judgment of dyed hair color

This study aims to investigate human hair color perception through two empirical studies in the context of colored hair. The preliminary study was intended to establish a numerical representation of perceptually meaningful brightness levels. It identified that the brightness level was proportional to the power of 0.766 of L*. In the visual assessment, participants (N = 47) categorized 246 hair color samples into eight color hue groups aligned with the Munsell system. Hue judgment was conducted by visually comparing dyed hair tresses with natural black hair. Based on the L*, a*, and b* values of hair tresses and visual assessments thereof, we observed the ranges of hue categories for hair color alongside the brightness levels. Additionally, the differences between the Munsell hue names and the assessment results were compared. Predominantly influenced by the dark brown hair color, the neutral orientation was shifted to the first quadrant of the a*-b* plane. The study contributes to an understanding of human hair color perception and provides insights into color categorization and labeling, especially when the context is confined.

Assessing perceptual chromatic equiluminance using a reflexive pupillary response

Equiluminant stimuli help assess the integrity of colour perception and the relationship of colour to other visual features. As a result of individual variation, it is necessary to calibrate experimental visual stimuli to suit each individual's unique equiluminant ratio. Most traditional methods rely on training observers to report their subjective equiluminance point. Such paradigms cannot easily be implemented on pre-verbal or non-verbal observers. Here, we present a novel Pupil Frequency-Tagging Method (PFTM) for detecting a participant's unique equiluminance point without verbal instruction and with minimal training. PFTM analyses reflexive pupil oscillations induced by slow (< 2 Hz) temporal alternations between coloured stimuli. Two equiluminant stimuli will induce a similar pupil dilation response regardless of colour; therefore, an observer's equiluminant point can be identified as the luminance ratio between two colours for which the oscillatory amplitude of the pupil at the tagged frequency is minimal. We compared pupillometry-based equiluminance ratios to those obtained with two established techniques in humans: minimum flicker and minimum motion. In addition, we estimated the equiluminance point in non-human primates, demonstrating that this new technique can be successfully employed in non-verbal subjects.

From water to land: Evolution of photoreceptor circuits for vision in air

When vertebrates first conquered the land, they encountered a visual world that was radically distinct from that of their aquatic ancestors. Fish exploit the strong wavelength-dependent interactions of light with water by differentially feeding the signals from up to 5 spectral photoreceptor types into distinct behavioural programmes. However, above the water the same spectral rules do not apply, and this called for an update to visual circuit strategies. Early tetrapods soon evolved the double cone, a still poorly understood pair of new photoreceptors that brought the "ancestral terrestrial" complement from 5 to 7. Subsequent nonmammalian lineages differentially adapted this highly parallelised retinal input strategy for their diverse visual ecologies. By contrast, mammals shed most ancestral photoreceptors and converged on an input strategy that is exceptionally general. In eutherian mammals including in humans, parallelisation emerges gradually as the visual signal traverses the layers of the retina and into the brain.

Color appearance and the end of Hering's Opponent-Colors Theory

Hering's Opponent-Colors Theory has been central to understanding color appearance for 150 years. It aims to explain the phenomenology of colors with two linked propositions. First, a psychological hypothesis stipulates that any color is described necessarily and sufficiently by the extent to which it appears reddish-versus-greenish, bluish-versus-yellowish, and blackish-versus-whitish. Second, a physiological hypothesis stipulates that these perceptual mechanisms are encoded by three innate brain mechanisms. We review the evidence and conclude that neither side of the linking proposition is accurate: the theory is wrong. We sketch out an alternative, Utility-Based Coding, by which the known retinal cone-opponent mechanisms represent optimal encoding of spectral information given competing selective pressure to extract high-acuity spatial information; and phenomenological color categories represent an adaptive, efficient, output of the brain governed by behavioral demands.

Characterizing cone spectral classification by optoretinography

Light propagation in photoreceptor outer segments is affected by photopigment absorption and the phototransduction amplification cascade. Photopigment absorption has been studied using retinal densitometry, while recently, optoretinography (ORG) has provided an avenue to probe changes in outer segment optical path length due to phototransduction. With adaptive optics (AO), both densitometry and ORG have been used for cone spectral classification based on the differential bleaching signatures of the three cone types. Here, we characterize cone classification by ORG, implemented in an AO line-scan optical coherence tomography (OCT), and compare it against densitometry. The cone mosaics of five color normal subjects were classified using ORG showing high probability (∼0.99), low error (<0.22%), high test-retest reliability (∼97%), and short imaging durations (< 1 hour). Of these, the cone spectral assignments in two subjects were compared against AO-scanning laser opthalmoscope densitometry. High agreement (mean: 91%) was observed between the two modalities in these two subjects, with measurements conducted 6-7 years apart. Overall, ORG benefits from higher sensitivity and dynamic range to probe cone photopigments compared to densitometry, and thus provides greater fidelity for cone spectral classification.

Variation and heritability of retinal cone ratios in a free-ranging population of rhesus macaques

A defining feature of catarrhine primates is uniform trichromacy-the ability to distinguish red (long; L), green (medium; M), and blue (short; S) wavelengths of light. Although the tuning of photoreceptors is conserved, the ratio of L:M cones in the retina is variable within and between species, with human cone ratios differing from other catarrhines. Yet, the sources and structure of variation in cone ratios are poorly understood, precluding a broader understanding of color vision variability. Here, we report a large-scale study of a pedigreed population of rhesus macaques (Macaca mulatta). We collected foveal RNA and analyzed opsin gene expression using cDNA and estimated additive genetic variance of cone ratios. The average L:M ratio and standard error was 1.03:1 ± 0.02. There was no age effect, and genetic contribution to variation was negligible. We found marginal sex effects with females having larger ratios than males. S cone ratios (0.143:1 ± 0.002) had significant genetic variance with a heritability estimate of 43% but did not differ between sexes or age groups. Our results contextualize the derived human condition of L-cone dominance and provide new information about the heritability of cone ratios and variation in primate color vision.

Equivalent noise characterization of human lightness constancy

A goal of visual perception is to provide stable representations of task-relevant scene properties (e.g. object reflectance) despite variation in task-irrelevant scene properties (e.g. illumination and reflectance of other nearby objects). To study such stability in the context of the perceptual representation of lightness, we introduce a threshold-based psychophysical paradigm. We measure how thresholds for discriminating the achromatic reflectance of a target object (task-relevant property) in rendered naturalistic scenes are impacted by variation in the reflectance functions of background objects (task-irrelevant property), using a two-alternative forced-choice paradigm in which the reflectance of the background objects is randomized across the two intervals of each trial. We control the amount of background reflectance variation by manipulating a statistical model of naturally occurring surface reflectances. For low background object reflectance variation, discrimination thresholds were nearly constant, indicating that observers’ internal noise determines threshold in this regime. As background object reflectance variation increases, its effects start to dominate performance. A model based on signal detection theory allows us to express the effects of task-irrelevant variation in terms of the equivalent noise, that is relative to the intrinsic precision of the task-relevant perceptual representation. The results indicate that although naturally occurring background object reflectance variation does intrude on the perceptual representation of target object lightness, the effect is modest – within a factor of two of the equivalent noise level set by internal noise.

An image reconstruction framework for characterizing initial visual encoding

We developed an image-computable observer model of the initial visual encoding that operates on natural image input, based on the framework of Bayesian image reconstruction from the excitations of the retinal cone mosaic. Our model extends previous work on ideal observer analysis and evaluation of performance beyond psychophysical discrimination, takes into account the statistical regularities of the visual environment, and provides a unifying framework for answering a wide range of questions regarding the visual front end. Using the error in the reconstructions as a metric, we analyzed variations of the number of different photoreceptor types on human retina as an optimal design problem. In addition, the reconstructions allow both visualization and quantification of information loss due to physiological optics and cone mosaic sampling, and how these vary with eccentricity. Furthermore, in simulations of color deficiencies and interferometric experiments, we found that the reconstructed images provide a reasonable proxy for modeling subjects' percepts. Lastly, we used the reconstruction-based observer for the analysis of psychophysical threshold, and found notable interactions between spatial frequency and chromatic direction in the resulting spatial contrast sensitivity function. Our method is widely applicable to experiments and applications in which the initial visual encoding plays an important role.

Colors

Bevil Conway introduces colors.

Circuit mechanisms for colour vision in zebrafish

The use of spectral information in natural light to inform behaviour is one of the oldest and most fundamental abilities of visual systems. It long-predates animals' venture onto the land, and even the appearance of image-forming eyes. Accordingly, circuits for colour vision evolved under the surface of ancient oceans for hundreds of millions of years. These aquatic beginnings fundamentally underpin, and likely constrain, the organisation of modern visual systems. In contrast to our detailed circuit level understanding from diverse terrestrial vertebrates, however, comparatively little is known about their aquatic counterparts. Here, I summarise some of what is known about neural circuits for colour vision in fish, the most species-diverse group of vertebrates. With a focus on zebrafish, I will explore how their computational strategies are linked to the statistics of natural light in the underwater world, and how their study might help us understand vision in general, including in our own eyes.

Human Eye Optics within a Non-Euclidian Geometrical Approach and Some Implications in Vision Prosthetics Design

An analogy with our previously published theory on the ionospheric auroral gyroscope provides a new perspective in human eye optics. Based on cone cells’ real distribution, we model the human eye macula as a pseudospherical surface. This allows the rigorous description of the photoreceptor cell densities in the parafoveal zones modeled further by an optimized paving method. The hexagonal photoreceptors’ distribution has been optimally projected on the elliptical pseudosphere, thus designing a prosthetic array counting almost 7000 pixel points. Thanks to the high morphological similarities to a normal human retina, the visual prosthesis performance in camera-free systems might be significantly improved.

Crumbs proteins stabilize the cone mosaics of photoreceptors and improve vision in zebrafish

Although the unique organization of vertebrate cone mosaics was first described long ago, both their underlying molecular basis and physiological significance are largely unknown. Here, we demonstrate that Crumbs proteins, the key regulators of epithelial apical polarity, establish the planar cellular polarity of photoreceptors in zebrafish. Via heterophilic Crb2a-Crb2b interactions, the apicobasal polarity protein Crb2b restricts the asymmetric planar distribution of Crb2a in photoreceptors. The planar polarized Crumbs proteins thus balance intercellular adhesions and tension between photoreceptors, thereby stabilizing the geometric organization of cone mosaics. Notably, loss of Crb2b in zebrafish induces a nearsightedness-like phenotype in zebrafish accompanied by an elongated eye axis and impairs zebrafish visual perception for predation. These data reveal a detailed mechanism for cone mosaic homeostasis via previously undiscovered apical-planar polarity coordination and propose a pathogenic mechanism for nearsightedness.

Color, Pattern, and the Retinal Cone Mosaic

Textbook trichromacy accounts for human color vision in terms of spectral sampling by three classes of cone photoreceptors. This account neglects entangling of color and pattern information created by wavelength-dependent optical blur (chromatic aberrations) and interleaved spatial sampling of the retinal image by the three classes of cones. Recent experimental, computational, and neurophysiological work is now considering color and pattern vision at the elementary scale of daylight vison, that is at the scale of individual cones. The results provide insight about rich interactions between color and pattern vision as well as the role of the statistical structure of natural scenes in shaping visual processing.

Diverse Cell Types, Circuits, and Mechanisms for Color Vision in the Vertebrate Retina

Synaptic interactions to extract information about wavelength, and thus color, begin in the vertebrate retina with three classes of light-sensitive cells: rod photoreceptors at low light levels, multiple types of cone photoreceptors that vary in spectral sensitivity, and intrinsically photosensitive ganglion cells that contain the photopigment melanopsin. When isolated from its neighbors, a photoreceptor confounds photon flux with wavelength and so by itself provides no information about color. The retina has evolved elaborate color opponent circuitry for extracting wavelength information by comparing the activities of different photoreceptor types broadly tuned to different parts of the visible spectrum. We review studies concerning the circuit mechanisms mediating opponent interactions in a range of species, from tetrachromatic fish with diverse color opponent cell types to common dichromatic mammals where cone opponency is restricted to a subset of specialized circuits. Distinct among mammals, primates have reinvented trichromatic color vision using novel strategies to incorporate evolution of an additional photopigment gene into the foveal structure and circuitry that supports high-resolution vision. Color vision is absent at scotopic light levels when only rods are active, but rods interact with cone signals to influence color perception at mesopic light levels. Recent evidence suggests melanopsin-mediated signals, which have been identified as a substrate for setting circadian rhythms, may also influence color perception. We consider circuits that may mediate these interactions. While cone opponency is a relatively simple neural computation, it has been implemented in vertebrates by diverse neural mechanisms that are not yet fully understood.

The Retinal Basis of Vertebrate Color Vision

The jawless fish that were ancestral to all living vertebrates had four spectral cone types that were probably served by chromatic-opponent retinal circuits. Subsequent evolution of photoreceptor spectral sensitivities is documented for many vertebrate lineages, giving insight into the ecological adaptation of color vision. Beyond the photoreceptors, retinal color processing is best understood in mammals, especially the blueON system, which opposes short- against long-wavelength receptor responses. For other vertebrates that often have three or four types of cone pigment, new findings from zebrafish are extending older work on teleost fish and reptiles to reveal rich color circuitry. Here, horizontal cells establish diverse and complex spectral responses even in photoreceptor outputs. Cone-selective connections to bipolar cells then set up color-opponent synaptic layers in the inner retina, which lead to a large variety of color-opponent channels for transmission to the brain via retinal ganglion cells.

Spatial summation of individual cones in human color vision

The human retina contains three classes of cone photoreceptors each sensitive to different portions of the visual spectrum: long (L), medium (M) and short (S) wavelengths. Color information is computed by downstream neurons that compare relative activity across the three cone types. How cone signals are combined at a cellular scale has been more difficult to resolve. This is especially true near the fovea, where spectrally-opponent neurons in the parvocellular pathway draw excitatory input from a single cone and thus even the smallest stimulus projected through natural optics will engage multiple color-signaling neurons. We used an adaptive optics microstimulator to target individual and pairs of cones with light. Consistent with prior work, we found that color percepts elicited from individual cones were predicted by their spectral sensitivity, although there was considerable variability even between cones within the same spectral class. The appearance of spots targeted at two cones were predicted by an average of their individual activations. However, two cones of the same subclass elicited percepts that were systematically more saturated than predicted by an average. Together, these observations suggest both spectral opponency and prior experience influence the appearance of small spots.

Computational-observer analysis of illumination discrimination

The spectral properties of the ambient illumination provide useful information about time of day and weather. We study the perceptual representation of illumination by analyzing measurements of how well people discriminate between illuminations across scene configurations. More specifically, we compare human performance to a computational-observer analysis that evaluates the information available in the isomerizations of cone photopigment in a model human photoreceptor mosaic. The performance of such an observer is limited by the Poisson variability of the number of isomerizations in each cone. The overall level of Poisson-limited computational-observer sensitivity exceeded that of human observers. This was modeled by increasing the amount of noise in the number of isomerizations of each cone. The additional noise brought the overall level of performance of the computational observer into the same range as that of human observers, allowing us to compare the pattern of sensitivity across stimulus manipulations. Key patterns of human performance were not accounted for by the computational observer. In particular, neither the elevation of illumination-discrimination thresholds for illuminant changes in a blue color direction (when thresholds are expressed in CIELUV ΔE units), nor the effects of varying the ensemble of surfaces in the scenes being viewed, could be accounted for by variation in the information available in the cone isomerizations.

Methods for Assessing Quantity and Quality of Illumination

Human vision provides useful information about the shape and color of the objects around us. It works well in many, but not all, lighting conditions. Since the advent of human-made light sources, it has been important to understand how illumination affects vision quality, but this has been surprisingly difficult. The widespread introduction of solid-state light emitters has increased the urgency of this problem. Experts still debate how lighting can best enable high-quality vision-a key issue since about one-fifth of global electrical power production is used to make light. Photometry, the measurement of the visual quantity of light, is well established, yet significant uncertainties remain. Colorimetry, the measurement of color, has achieved good reproducibility, but researchers still struggle to understand how illumination can best enable high-quality color vision. Fortunately, in recent years, considerable progress has been made. Here, we summarize the current understanding and discuss key areas for future study.

The spectral identity of foveal cones is preserved in hue perception

Organisms are faced with the challenge of making inferences about the physical world from incomplete incoming sensory information. One strategy to combat ambiguity in this process is to combine new information with prior experiences. We investigated the strategy of combining these information sources in color vision. Single cones in human subjects were stimulated and the associated percepts were recorded. Subjects rated each flash for brightness, hue, and saturation. Brightness ratings were proportional to stimulus intensity. Saturation was independent of intensity, but varied between cones. Hue, in contrast, was assigned in a stereotyped manner that was predicted by cone type. These experiments revealed that, near the fovea, long and middle wavelength sensitive cones produce sensations that can be reliably distinguished on the basis of hue, but not saturation or brightness. Taken together, these observations implicate the high-resolution, color-opponent parvocellular pathway in this low-level visual task.

Computational luminance constancy from naturalistic images

The human visual system supports stable percepts of object color even though the light that reflects from object surfaces varies significantly with the scene illumination. To understand the computations that support stable color perception, we study how estimating a target object's luminous reflectance factor (LRF; a measure of the light reflected from the object under a standard illuminant) depends on variation in key properties of naturalistic scenes. Specifically, we study how variation in target object reflectance, illumination spectra, and the reflectance of background objects in a scene impact estimation of a target object's LRF. To do this, we applied supervised statistical learning methods to the simulated excitations of human cone photoreceptors, obtained from labeled naturalistic images. The naturalistic images were rendered with computer graphics. The illumination spectra of the light sources and the reflectance spectra of the surfaces in the scene were generated using statistical models of natural spectral variation. Optimally decoding target object LRF from the responses of a small learned set of task-specific linear receptive fields that operate on a contrast representation of the cone excitations yields estimates that are within 13% of the correct LRF. Our work provides a framework for evaluating how different sources of scene variability limit performance on luminance constancy.

Color Perception: Objects, Constancy, and Categories

Color has been scientifically investigated by linking color appearance to colorimetric measurements of the light that enters the eye. However, the main purpose of color perception is not to determine the properties of incident light, but to aid the visual perception of objects and materials in our environment. We review the state of the art on object colors, color constancy, and color categories to gain insight into the functional aspects of color perception. The common ground between these areas of research is that color appearance is tightly linked to the identification of objects and materials and the communication across observers. In conclusion, we argue that research should focus on how color processing is adapted to the surface properties of objects in the natural environment in order to bridge the gap between the known early stages of color perception and the subjective appearance of color.

Local tuning biases in mouse primary visual cortex

Neurons in primary visual cortex are selective to the orientation and spatial frequency of sinusoidal gratings. In the classic model of cortical organization, a population of neurons responding to the same region of the visual field but tuned to all possible feature combinations provides a detailed representation of the local image. Such a functional module is assumed to be replicated across primary visual cortex to provide a uniform representation of the image across the entire visual field. In contrast, it has been hypothesized that the tiling properties of ON- and OFF-center receptive fields in the retina, largely mirrored in the geniculate, may constrain cortical tuning at each location in the visual field. This model predicts the existence of local biases in tuning that vary across the visual field and would prevent the cortex from developing a uniform, modular representation as postulated by the classic model. Here, we confirm the existence of local tuning biases in the primary visual cortex of the mouse, lending support to the notion that cortical tuning may be constrained by signals from the periphery. NEW & NOTEWORTHY Populations of cortical neurons responding to the same part of the visual field are shown to have similar tuning. Such local biases are consistent with the hypothesis that cortical tuning, in mouse primary visual cortex, is constrained by signals from the periphery.

The elementary representation of spatial and color vision in the human retina

The retina is the most accessible element of the central nervous system for linking behavior to the activity of isolated neurons. We unraveled behavior at the elementary level of single input units-the visual sensation generated by stimulating individual long (L), middle (M), and short (S) wavelength-sensitive cones with light. Spectrally identified cones near the fovea of human observers were targeted with small spots of light, and the type, proportion, and repeatability of the elicited sensations were recorded. Two distinct populations of cones were observed: a smaller group predominantly associated with signaling chromatic sensations and a second, more numerous population linked to achromatic percepts. Red and green sensations were mainly driven by L- and M-cones, respectively, although both cone types elicited achromatic percepts. Sensations generated by cones were rarely stochastic; rather, they were consistent over many months and were dominated by one specific perceptual category. Cones lying in the midst of a pure spectrally opponent neighborhood, an arrangement purported to be most efficient in producing chromatic signals in downstream neurons, were no more likely to signal chromatic percepts. Overall, the results are consistent with the idea that the nervous system encodes high-resolution achromatic information and lower-resolution color signals in separate pathways that emerge as early as the first synapse. The lower proportion of cones eliciting color sensations may reflect a lack of evolutionary pressure for the chromatic system to be as fine-grained as the high-acuity achromatic system.