Color constancy by asymmetric color matching with real objects in three-dimensional scenes

Transparent layer constancy improves with increased naturalness of the scene

The extent to which hue, saturation, and transmittance of thin light-transmitting layers are perceived as constant when the illumination changes (transparent layer constancy, TLC) has previously been investigated with simple stimuli in asymmetric matching tasks. In this task, a target filter is presented under one illumination and a second filter is matched under a second illumination. Although two different illuminations are applied in the stimulus generation, there is no guarantee that the stimulus will be interpreted appropriately by the visual system. In previous work, we found a higher degree of TLC when both illuminations were presented alternately than when they were presented simultaneously, which could be explained, for example, by an increased plausibility of an illumination change. In this work, we test whether TLC can also be increased in simultaneous presentation when the filter's belonging to a particular illumination context is made more likely by additional cues. To this end, we presented filters in differently lit areas of complex, naturalistically rendered 3D scenes containing different types of cues to the prevailing illumination, such as scene geometry, object shading, and cast shadows. We found higher degrees of TLC in such complex scenes than in colorimetrically similar simple 2D color mosaics, which is consistent with the results of similar studies in the area of color constancy. To test which of the illumination cues available in the scenes are actually used, the different types of cues were successively removed from the naturalistically rendered complex scene. A total of eight levels of scene complexity were examined. As expected, TLC decreased the more cues were removed. Object shading and illumination gradients due to shadow cast were both found to have a positive effect on TLC. A second filter had a small positive effect on TLC when added in strongly reduced scenes, but not in the complex scenes that already provide many cues about the illumination context of the filter.

The effect of scene articulation on transparent layer constancy

In this article, we examine the influence of scene articulation on transparent layer constancy. We argue that the term articulation may be understood as an aspect of the more general concept naturalness of a stimulus that relates to the degree of enrichment compared with a minimal stimulus and to the extent to which a stimulus contains regularities that are typically found in natural scenes. We conducted two matching experiments, in which we used strongly reduced scenes and operationalized articulation by the number of background reflectances (numerosity). The results of the first experiment show that higher numerosity actually leads to an increase in transparent layer constancy when reflectances are randomly drawn from a fixed population. However, this advantage disappears if the spatial mean and the variation of the subset colors are controlled as in our second experiment. Furthermore, our results suggest that the mechanism underlying transparent layer constancy leads to a rather stable compromise between two matching criteria, namely, proximal identity and constant filter properties according to our perceptual model. For filters with an additive component, which appear more or less hazy, we observed improved recovered filter properties and correspondingly higher degrees of transparent layer constancy, suggesting an additional mechanism in this type of filter.

Computational color prediction versus least-dissimilar matching

The performance of color prediction methods CIECAM02, KSM², Waypoint, Best Linear, Metamer Mismatch Volume Center, and Relit color signal are compared in terms of how well they explain Logvinenko and Tokunaga's asymmetric color matching results [Seeing Perceiving24, 407 (2011)]. In their experiment, four observers were asked to determine (three repeats) for a given Munsell paper under a test illuminant which of 22 other Munsell papers was the least-dissimilar under a match illuminant. Their use of "least-dissimilar" as opposed to "matching" is an important aspect of their experiment. Their results raise several questions. Question 1: Are observers choosing the original Munsell paper under the match illuminant? If they are, then the average (over 12 matches) color signal (i.e., cone LMS or CIE XYZ) made under a given illuminant condition should correspond to that of the test paper's color signal under the match illuminant. Computation shows that the mean color signal of the matched papers is close to the color signal of the physically identical paper under the match illuminant. Question 2: Which color prediction method most closely predicts the observers' average least-dissimilar match? Question 3: Given the variability between observers, how do individual observers compare to the computational methods in predicting the average observer matches? A leave-one-observer-out comparison shows that individual observers, somewhat surprisingly, predict the average matches of the remaining observers better than any of the above color prediction methods.

Determinants of Colour Constancy and the Blue Bias

We investigated several sensory and cognitive determinants of colour constancy across 40 illumination hues. In the first experiment, we measured colour naming for the illumination and for the colour induced by the illumination on the colorimetric grey. Results confirmed that the induced colours are approximately complementary to the colour of the illumination. In the second experiment, we measured colour constancy using achromatic adjustments. Average colour constancy was perfect under the blue daylight illumination and decreased in colour directions away from the blue daylight illumination due to undershooting and a strong blue bias. Apart from this blue bias, colour constancy was not related to illumination discrimination and to chromatic detection measured previously with the same setup and stimuli. We also observed a strong negative relationship between the degree of colour constancy and the consensus of naming the illumination colour. Constancy coincided with a low naming consensus, in particular because bluish illumination colours were sometimes seen as achromatic. Blue bias and category consensus alone explained >68%, and all determinants together explained >94% of the variance of achromatic adjustments. These findings suggest that colour constancy is optimised for blue daylight.

Effects of memory colour on colour constancy for unknown coloured objects

The perception of an object's colour remains constant despite large variations in the chromaticity of the illumination-colour constancy. Hering suggested that memory colours, the typical colours of objects, could help in estimating the illuminant's colour and therefore be an important factor in establishing colour constancy. Here we test whether the presence of objects with diagnostical colours (fruits, vegetables, etc) within a scene influence colour constancy for unknown coloured objects in the scene. Subjects matched one of four Munsell papers placed in a scene illuminated under either a reddish or a greenish lamp with the Munsell book of colour illuminated by a neutral lamp. The Munsell papers were embedded in four different scenes-one scene containing diagnostically coloured objects, one scene containing incongruent coloured objects, a third scene with geometrical objects of the same colour as the diagnostically coloured objects, and one scene containing non-diagnostically coloured objects (eg, a yellow coffee mug). All objects were placed against a black background. Colour constancy was on average significantly higher for the scene containing the diagnostically coloured objects compared with the other scenes tested. We conclude that the colours of familiar objects help in obtaining colour constancy for unknown objects.

Color constancy

A quarter of a century ago, the first systematic behavioral experiments were performed to clarify the nature of color constancy-the effect whereby the perceived color of a surface remains constant despite changes in the spectrum of the illumination. At about the same time, new models of color constancy appeared, along with physiological data on cortical mechanisms and photographic colorimetric measurements of natural scenes. Since then, as this review shows, there have been many advances. The theoretical requirements for constancy have been better delineated and the range of experimental techniques has been greatly expanded; novel invariant properties of images and a variety of neural mechanisms have been identified; and increasing recognition has been given to the relevance of natural surfaces and scenes as laboratory stimuli. Even so, there remain many theoretical and experimental challenges, not least to develop an account of color constancy that goes beyond deterministic and relatively simple laboratory stimuli and instead deals with the intrinsically variable nature of surfaces and illuminations present in the natural world.

Effect of Scene Dimensionality on Colour Constancy with Real Three-Dimensional Scenes and Objects

The effect of scene dimensionality on colour constancy was tested with real scenes and objects. Observers viewed a three-dimensional (3-D) scene, or its two-dimensional (2-D) planar projection, through a large beam-splitter that projected the virtual image of a real test object (a cube or its 2-D projection) so that it appeared part of the scene. Test object and scene could be illuminated independently with high chromatic precision. In each trial, the illuminance of the scene changed abruptly from 25 000 K to 6700 K and the illuminant of the test object changed either consistently or inconsistently with it by a variable quantifiable amount. Observers had to decide whether the test object underwent a change in its materials. The extent of constancy obtained in the experiment was not influenced by scene dimensionality and varied significantly with the colour of the test object. These results suggest that color constancy in the conditions tested here may be determined by local spectral quantities.

Color constancy of red-green dichromats and anomalous trichromats

Purpose. Color-vision deficiency is associated with abnormalities in color matching and color discrimination, but its impact on the ability of people to judge the constancy of surface colors under different lights (color constancy) is less clear. This work had two aims: first, to quantify the degree of color constancy in subjects with congenital red-green color deficiency; second, to test whether the degree of color constancy in anomalous trichromats can be predicted from their Rayleigh anomaloscope matches. Methods. Color constancy of red-green color-deficient subjects was tested in a task requiring the discrimination of illuminant changes from surface-reflectance changes. Mondrian-like colored patterns, generated on the screen of a computer monitor, were used as stimuli to avoid the spatial cues provided by natural objects and scenes. Spectral reflectances were taken from the Munsell Book of Color and from natural scenes. Illuminants were taken from the daylight locus. Results. Protanopes and deuteranopes performed more poorly than normal trichromats with Munsell spectral reflectances but were less impaired with natural spectral reflectances. Protanomalous and deuteranomalous trichromats performed as well as, or almost as well as, normal trichromats, independent of the type of reflectance. Individual differences were not correlated with Rayleigh anomaloscope matches. Conclusions. Despite the evidence of clinical color-vision tests, red-green color-deficient persons are less disadvantaged than might be expected in their judgments of surface colors under different lights.

Do people match surface reflectance fundamentally differently than they match emitted light?

We compared matches between colours that were both presented on a computer monitor or both as pieces of paper, with matching the colour of a piece of paper with a colour presented on a computer monitor and vice versa. Performance was specifically poor when setting an image on a computer monitor to match the colour of a piece of paper. This cannot be due to any of the individual judgments because subjects readily selected a matching piece of paper to match another piece of paper and set the image on the monitor to match another image on a monitor. We propose that matching the light reaching the eye and matching surface reflectance are fundamentally different judgments and that subjects can sometimes but not always choose which to match.

Color constancy: phenomenal or projective?

Naive observers viewed a sequence of colored Mondrian patterns, simulated on a color monitor. Each pattern was presented twice in succession, first under one daylight illuminant with a correlated color temperature of either 16,000 or 4000 K and then under the other, to test for color constancy. The observers compared the central square of the pattern across illuminants, either rating it for sameness of material appearance or sameness of hue and saturation or judging an objective property-that is, whether its change of color originated from a change in material or only from a change in illumination. Average color constancy indices were high for material appearance ratings and binary judgments of origin and low for hue-saturation ratings. Individuals' performance varied, but judgments of material and of hue and saturation remained demarcated. Observers seem able to separate phenomenal percepts from their ontological projections of mental appearance onto physical phenomena; thus, even when a chromatic change alters perceived hue and saturation, observers can reliably infer the cause, the constancy of the underlying surface spectral reflectance.

Anomalous trichromats' judgments of surface color in natural scenes under different daylights

Deuteranomalous trichromacy, which affects medium-wavelength-sensitive cones, is more common than protanomalous trichromacy, which affects long-wavelength-sensitive cones. The aim of the present work was to test the extent to which these two kinds of anomalous trichromacy affect surface-color judgments in the natural world. Simulations of 18 natural scenes under different daylight illuminants were presented on a high-resolution color monitor to 7 deuteranomalous, 7 protanomalous, and 12 normal trichromatic observers, who had to discriminate between reflectance and illuminant changes in the images. Observers' ability to judge surface color was quantified by a standard color-constancy index. Deuteranomalous trichromats performed as well as normal trichromats, but protanomalous trichromats performed more poorly than both. The results are considered in relation to the spectral coverage of cones, rod intrusion, and the characterization of anomalous trichromacy by the Rayleigh match.

Color constancy in natural scenes with and without an explicit illuminant cue

Observers can generally make reliable judgments of surface color in natural scenes despite changes in an illuminant that is out of view. This ability has sometimes been attributed to observers' estimating the spectral properties of the illuminant in order to compensate for its effects. To test this hypothesis, two surface-color-matching experiments were performed with images of natural scenes obtained from high-resolution hyperspectral images. In the first experiment, the sky illuminating the scene was directly visible to the observer, and its color was manipulated. In the second experiment, a large gray sphere was introduced into the scene so that its illumination by the sun and sky was also directly visible to the observer, and the color of that illumination was manipulated. Although the degree of color constancy varied across this and other variations of the images, there was no reliable effect of illuminant color. Even when the sky was eliminated from view, color constancy did not worsen. Judging surface color in natural scenes seems to be independent of an explicit illuminant cue.

Minimum-variance cone-excitation ratios and the limits of relational color constancy

Relational color constancy refers to the constancy of the perceived relations between the colors of surfaces of a scene under changes in the spectral composition of the illuminant. Spatial ratios of cone excitations provide a natural physical basis for this constancy, as, on average, they are almost invariant under illuminant changes for large collections of natural surfaces and illuminants. The aim of the present work was to determine, computationally, for specific surfaces and illuminants, the constancy limits obtained by the application of a minimum-variance principle to cone-excitation ratios and to investigate its validity in predicting observers' surface-color judgments. Cone excitations and their changes due to variations in the color of the illuminant were estimated for colored surfaces in simulated two-dimensional scenes of colored papers and real three-dimensional scenes of solid colored objects. For various test surfaces, scenes, and illuminants, the estimated levels of relational color constancy mediated by cone-excitation ratios varied significantly with the test surface and only with certain desaturated surfaces corresponded to ideal matches. Observers' experimental matches were compared with predictions expressed in CIE 1976 (u′,v′) space and were found to be generally consistent with minimum-variance predictions.

Colour constancy under simultaneous changes in surface position and illuminant

Two kinds of constancy underlie the everyday perception of surface colour: constancy under changes in illuminant and constancy under changes in surface position. Classically, these two constancies seem to place conflicting demands on the visual system: to both take into account the region surrounding a surface and also discount it. It is shown here, however, that the ability of observers to make surface-colour matches across simultaneous changes in test-surface position and illuminant in computer-generated 'Mondrian' patterns is almost as good as across changes in illuminant alone. Performance was no poorer when the surfaces surrounding the test surface were permuted, or when information from a potential comparison surface, the one with the highest luminance, was suppressed. Computer simulations of cone-photoreceptor activity showed that a reliable cue for making surface-colour matches in all experimental conditions was provided by the ratios of cone excitations between the test surfaces and a spatial average over the whole pattern.