Robust colour constancy in red-green dichromats

How the orientation of the color gamut of natural scenes influences color discrimination in red-green dichromacy

In natural scenes, visual discrimination of colored surfaces by individuals with X-linked dichromacy is known to be only a little poorer than in normal trichromacy. This surprising result may be related to the properties of the colors of these scenes, like the shape and orientation of the color gamut, uneven frequency, and a considerable variation in lightness. It is unclear, however, how much each of these factors contributes to the small impairment in discrimination, in particular, what is the contribution of the orientation of the gamut. We measured the discrimination of colors from natural scenes by six normal trichromats and six dichromats. Colors were drawn either from the original color gamut of the scenes or from gamut-rotated versions of the scenes. Pairs of colors were randomly drawn from hyperspectral images of one rural and one urban environment and presented on a screen. As expected, dichromats were only a little poorer than normal trichromats at discrimination but the disadvantage varied systematically with the orientation of the color gamut by a factor of about three with a minimum around a yellow-green axis. Dichromats also took longer to respond, and the response times were modulated with the orientation of the color gamut in a similar way as the loss in discrimination. For the scenes tested here, these results imply an important impact of the orientation of the gamut on discrimination. They also indicate that the predominantly yellow-blue orientation of the gamut of natural scene might not be optimal for discrimination in dichromacy.

Colour vision is aligned with natural scene statistics at 4 months of age

Visual perception in adult humans is thought to be tuned to represent the statistical regularities of natural scenes. For example, in adults, visual sensitivity to different hues shows an asymmetry which coincides with the statistical regularities of colour in the natural world. Infants are sensitive to statistical regularities in social and linguistic stimuli, but whether or not infants' visual systems are tuned to natural scene statistics is currently unclear. We measured colour discrimination in infants to investigate whether or not the visual system can represent chromatic scene statistics in very early life. Our results reveal the earliest association between vision and natural scene statistics that has yet been found: even as young as 4 months of age, colour vision is aligned with the distributions of colours in natural scenes. RESEARCH HIGHLIGHTS: We find infants' colour sensitivity is aligned with the distribution of colours in the natural world, as it is in adults. At just 4 months, infants' visual systems are tailored to extract and represent the statistical regularities of the natural world. This points to a drive for the human brain to represent statistical regularities even at a young age.

Influence of colour vision on attention to, and impression of, complex aesthetic images

Humans exhibit colour vision variations due to genetic polymorphisms, with trichromacy being the most common, while some people are classified as dichromats. Whether genetic differences in colour vision affect the way of viewing complex images remains unknown. Here, we investigated how people with different colour vision focused their gaze on aesthetic paintings by eye-tracking while freely viewing digital rendering of paintings and assessed individual impressions through a decomposition analysis of adjective ratings for the images. Gaze-concentrated areas among trichromats were more highly correlated than those among dichromats. However, compared with the brief dichromatic experience with the simulated images, there was little effect of innate colour vision differences on impressions. These results indicate that chromatic information is instructive as a cue for guiding attention, whereas the impression of each person is generated according to their own sensory experience and normalized through one's own colour space.

Little information loss with red-green color deficient vision in natural environments

Inherited color vision deficiency affects red-green discrimination in about one in twelve men from European populations. Its effects have been studied mainly in primitive foraging but also in detecting blushing and breaking camouflage. Yet there is no obvious relationship between these specific tasks and vision in the real world. The aim here was to quantify the impact of color vision deficiency by estimating computationally the information available to observers about colored surfaces in natural scenes. With representative independent sets of 50 and 100 hyperspectral images, estimated information was found to be only a little less in red-green color vision deficiency than in normal trichromacy. Colorimetric analyses revealed the importance of large lightness variations within scenes, small redness-greenness variations, and uneven frequencies of different colored surfaces. While red-green color vision deficiency poses challenges in some tasks, it has much less effect on gaining information from natural environments.

Color constancy for daylight illumination changes in anomalous trichromats and dichromats

Color constancy is the perceptual stability of surface colors under temporal changes in the illumination spectrum. The illumination discrimination task (IDT) reveals worse discrimination for "bluer" illumination changes in normal-trichromatic observers (changes towards cooler color temperatures on the daylight chromaticity locus), indicating greater stability of scene colors or better color constancy, compared with illumination changes in other chromatic directions. Here, we compare the performance of individuals with X-linked color-vision deficiencies (CVDs) to normal trichromats on the IDT performed in an immersive setting with a real scene illuminated by spectrally tunable LED lamps. We determine discrimination thresholds for illumination changes relative to a reference illumination (D65) in four chromatic directions, roughly parallel and orthogonal to the daylight locus. We find, using both a standard CIELUV metric and a cone-contrast metric tailored to distinct CVD types, that discrimination thresholds for daylight changes do not differ between normal trichromats and CVD types, including dichromats and anomalous trichromats, but thresholds for atypical illuminations do differ. This result extends a previous report of illumination discrimination ability in dichromats for simulated daylight changes in images. In addition, using the cone-contrast metric to compare thresholds for bluer and yellower daylight changes with those for unnatural redder and greener changes, we suggest that reduced sensitivity to daylight changes is weakly preserved in X-linked CVDs.

Robust categorical color constancy along daylight locus in red-green color deficiency

Categorical color constancy in normal trichromats has been found to be very robust in real scenes. In this study, we investigated categorical color constancy in red-green dichromats and anomalous trichromats. Eight dichromats (two protanopes and six deuteranopes), eight anomalous trichromats (four protanomalous and four deuteranomalous trichromats), and eight normal trichromats sorted 208 Munsell matte surfaces into Berlin and Kay's basic color categories under D65 illuminant, F illuminant with correlated color temperature 4200 K, and TL84 illuminant with correlated color temperature 2700 K. Color constancy was quantified by a color constancy index. The results showed that the constancy index of dichromats (0.79) was considerable and significantly lower than that of normal trichromats (0.87) while that of anomalous trichromats (0.84) was not. The impairment of color constancy performance in dichromats was expected to be caused by their large intra-subject variabilities in color naming. The results indicate robust categorical color constancy along daylight locus in red-green dichromats and anomalous trichromats, which might be contributed by cone adaptation mechanism and be independent of color discrimination mechanism. It suggests that the color categorization by color vision deficient subjects can be reasonable without any assistants of artificial equipment in daily life under sunlight and common illuminations.

Equivalent noise characterization of human lightness constancy

A goal of visual perception is to provide stable representations of task-relevant scene properties (e.g. object reflectance) despite variation in task-irrelevant scene properties (e.g. illumination and reflectance of other nearby objects). To study such stability in the context of the perceptual representation of lightness, we introduce a threshold-based psychophysical paradigm. We measure how thresholds for discriminating the achromatic reflectance of a target object (task-relevant property) in rendered naturalistic scenes are impacted by variation in the reflectance functions of background objects (task-irrelevant property), using a two-alternative forced-choice paradigm in which the reflectance of the background objects is randomized across the two intervals of each trial. We control the amount of background reflectance variation by manipulating a statistical model of naturally occurring surface reflectances. For low background object reflectance variation, discrimination thresholds were nearly constant, indicating that observers’ internal noise determines threshold in this regime. As background object reflectance variation increases, its effects start to dominate performance. A model based on signal detection theory allows us to express the effects of task-irrelevant variation in terms of the equivalent noise, that is relative to the intrinsic precision of the task-relevant perceptual representation. The results indicate that although naturally occurring background object reflectance variation does intrude on the perceptual representation of target object lightness, the effect is modest – within a factor of two of the equivalent noise level set by internal noise.

Colour-emotion associations in individuals with red-green colour blindness

Colours and emotions are associated in languages and traditions. Some of us may convey sadness by saying feeling blue or by wearing black clothes at funerals. The first example is a conceptual experience of colour and the second example is an immediate perceptual experience of colour. To investigate whether one or the other type of experience more strongly drives colour-emotion associations, we tested 64 congenitally red-green colour-blind men and 66 non-colour-blind men. All participants associated 12 colours, presented as terms or patches, with 20 emotion concepts, and rated intensities of the associated emotions. We found that colour-blind and non-colour-blind men associated similar emotions with colours, irrespective of whether colours were conveyed via terms (r = .82) or patches (r = .80). The colour-emotion associations and the emotion intensities were not modulated by participants’ severity of colour blindness. Hinting at some additional, although minor, role of actual colour perception, the consistencies in associations for colour terms and patches were higher in non-colour-blind than colour-blind men. Together, these results suggest that colour-emotion associations in adults do not require immediate perceptual colour experiences, as conceptual experiences are sufficient.

Computational-observer analysis of illumination discrimination

The spectral properties of the ambient illumination provide useful information about time of day and weather. We study the perceptual representation of illumination by analyzing measurements of how well people discriminate between illuminations across scene configurations. More specifically, we compare human performance to a computational-observer analysis that evaluates the information available in the isomerizations of cone photopigment in a model human photoreceptor mosaic. The performance of such an observer is limited by the Poisson variability of the number of isomerizations in each cone. The overall level of Poisson-limited computational-observer sensitivity exceeded that of human observers. This was modeled by increasing the amount of noise in the number of isomerizations of each cone. The additional noise brought the overall level of performance of the computational observer into the same range as that of human observers, allowing us to compare the pattern of sensitivity across stimulus manipulations. Key patterns of human performance were not accounted for by the computational observer. In particular, neither the elevation of illumination-discrimination thresholds for illuminant changes in a blue color direction (when thresholds are expressed in CIELUV ΔE units), nor the effects of varying the ensemble of surfaces in the scenes being viewed, could be accounted for by variation in the information available in the cone isomerizations.

Illumination discrimination for chromatically biased illuminations: Implications for color constancy

We measured discrimination thresholds for illumination changes along different chromatic directions starting from chromatically biased reference illuminations. Participants viewed a Mondrian-papered scene illuminated by LED lamps. The scene was first illuminated by a reference illumination, followed by two comparisons. One comparison matched the reference (the target); the other (the test) varied from the reference, nominally either bluer, yellower, redder, or greener. The participant's task was to correctly select the target. A staircase procedure found thresholds for discrimination of an illumination change along each axis of chromatic change. Nine participants completed the task for five different reference illumination conditions (neutral, blue, yellow, red, and green). We find that relative discrimination thresholds for different chromatic directions of illumination change vary with the reference illumination. For the neutral reference, there is a trend for thresholds to be highest in the bluer illumination-change direction, replicating our previous reports of a "blue bias" for neutral reference illuminations. For the four chromatic references (blue, yellow, red, and green), the change in illumination toward the neutral reference is less well discriminated than changes in the other directions: a "neutral bias." The results have implications for color constancy: In considering the stability of surface appearance under changes in illumination, both the starting chromaticity of the illumination and direction of change must be considered, as well as the chromatic characteristics of the surface reflectance ensemble. They also suggest it will be worthwhile to explore whether and how the human visual system has internalized the statistics of natural illumination changes.

Illumination discrimination in the absence of a fixed surface-reflectance layout

Previous studies have shown that humans can discriminate spectral changes in illumination and that this sensitivity depends both on the chromatic direction of the illumination change and on the ensemble of surfaces in the scene. These studies, however, always used stimulus scenes with a fixed surface-reflectance layout. Here we compared illumination discrimination for scenes in which the surface reflectance layout remains fixed (fixed-surfaces condition) to those in which surface reflectances were shuffled randomly across scenes, but with the mean scene reflectance held approximately constant (shuffled-surfaces condition). Illumination discrimination thresholds in the fixed-surfaces condition were commensurate with previous reports. Thresholds in the shuffled-surfaces condition, however, were considerably elevated. Nonetheless, performance in the shuffled-surfaces condition exceeded that attainable through random guessing. Analysis of eye fixations revealed that in the fixed-surfaces condition, low illumination discrimination thresholds (across observers) were predicted by low overall fixation spread and high consistency of fixation location and fixated surface reflectances across trial intervals. Performance in the shuffled-surfaces condition was not systematically related to any of the eye-fixation characteristics we examined for that condition, but was correlated with performance in the fixed-surfaces condition.