When is a background equivalent? Sparse chromatic context revisited

Color constancy

A quarter of a century ago, the first systematic behavioral experiments were performed to clarify the nature of color constancy-the effect whereby the perceived color of a surface remains constant despite changes in the spectrum of the illumination. At about the same time, new models of color constancy appeared, along with physiological data on cortical mechanisms and photographic colorimetric measurements of natural scenes. Since then, as this review shows, there have been many advances. The theoretical requirements for constancy have been better delineated and the range of experimental techniques has been greatly expanded; novel invariant properties of images and a variety of neural mechanisms have been identified; and increasing recognition has been given to the relevance of natural surfaces and scenes as laboratory stimuli. Even so, there remain many theoretical and experimental challenges, not least to develop an account of color constancy that goes beyond deterministic and relatively simple laboratory stimuli and instead deals with the intrinsically variable nature of surfaces and illuminations present in the natural world.

Combining local and global contributions to perceived colour: An analysis of the variability in symmetric and asymmetric colour matching

Are surfaces' colours judged from weighted averages of the light that they reflect to the eyes and the colour contrast at their borders? To find out we asked subjects to set the colour and luminance of test disks to match reference disks, on various backgrounds, and analysed the variability in their settings. Most of the variability between repeated settings was in luminance. The standard deviations in the set colour were smallest when the disk and background were the same colour, irrespective of the colour itself. Matches were equally precise for greenish or reddish disks on a grey background, as for grey disks on a greenish or reddish background. The precision was less dependent on the colour contrast at the disks' borders when the backgrounds were more complex and when there was a large luminance contrast at the disks' borders. Subjects were less precise when different colours surrounded the two disks. These findings are consistent with the perceived colour at any position being a weighted average of the local cone excitation ratio and the change in the cone excitation ratio at the borders of the surface in question. However, the involved weights must be variable and depend systematically on parameters such as the luminance contrast at the surface's borders and other chromatic contrasts within the scene.

Color constancy in natural scenes explained by global image statistics

To what extent do observers' judgments of surface color with natural scenes depend on global image statistics? To address this question, a psychophysical experiment was performed in which images of natural scenes under two successive daylights were presented on a computer-controlled high-resolution color monitor. Observers reported whether there was a change in reflectance of a test surface in the scene. The scenes were obtained with a hyperspectral imaging system and included variously trees, shrubs, grasses, ferns, flowers, rocks, and buildings. Discrimination performance, quantified on a scale of 0 to 1 with a color-constancy index, varied from 0.69 to 0.97 over 21 scenes and two illuminant changes, from a correlated color temperature of 25,000 K to 6700 K and from 4000 K to 6700 K. The best account of these effects was provided by receptor-based rather than colorimetric properties of the images. Thus, in a linear regression, 43% of the variance in constancy index was explained by the log of the mean relative deviation in spatial cone-excitation ratios evaluated globally across the two images of a scene. A further 20% was explained by including the mean chroma of the first image and its difference from that of the second image and a further 7% by the mean difference in hue. Together, all four global color properties accounted for 70% of the variance and provided a good fit to the effects of scene and of illuminant change on color constancy, and, additionally, of changing test-surface position. By contrast, a spatial-frequency analysis of the images showed that the gradient of the luminance amplitude spectrum accounted for only 5% of the variance.

Regulation of chromatic induction by neighboring images

We deal with the regulation of chromatic contrast when the induction of a second stimulus (one of five neighboring surrounds) opposes the induction from a first stimulus (one of two remote vivid peripheral fields). Using a hue cancellation judgment, we show that, although every neighboring surround that we used has the same average chromatic content, the resulting color appearance of the target differs between surrounds, and this may be ascribed to the spatiochromatic organization of the surround. So, rather than the chromatic contrast amplitude or the frequential structure of the surround, it is the structure of proximity that matters.

Minimalist surface-colour matching

Some theories of surface-colour perception assume that observers estimate the illuminant on a scene so that its effects can be discounted. A critical test of this interpretation of colour constancy is whether surface-colour matching is worse when the number of surfaces in a scene is so small that any illuminant estimate is unreliable. In the experiment reported here, observers made asymmetric colour matches between pairs of simultaneously presented Mondrian-like patterns under different daylights. The patterns had either 49 surfaces or a minimal 2 surfaces. No significant effect of number was found, suggesting that illuminant estimates are unnecessary for surface-colour matching.

Colour constancy under simultaneous changes in surface position and illuminant

Two kinds of constancy underlie the everyday perception of surface colour: constancy under changes in illuminant and constancy under changes in surface position. Classically, these two constancies seem to place conflicting demands on the visual system: to both take into account the region surrounding a surface and also discount it. It is shown here, however, that the ability of observers to make surface-colour matches across simultaneous changes in test-surface position and illuminant in computer-generated 'Mondrian' patterns is almost as good as across changes in illuminant alone. Performance was no poorer when the surfaces surrounding the test surface were permuted, or when information from a potential comparison surface, the one with the highest luminance, was suppressed. Computer simulations of cone-photoreceptor activity showed that a reliable cue for making surface-colour matches in all experimental conditions was provided by the ratios of cone excitations between the test surfaces and a spatial average over the whole pattern.

Chromatic induction and the layout of colours within a complex scene

A target's apparent colour is influenced by the colours in its surrounding. If the surrounding consists of a single coloured surface, the influence is a shift 'away' from the surface's colour. If the surface is more than 1 degrees from the target area the shift is very small. If there are many surfaces, then not only the average luminance and chromaticity of the surfaces matters, but also the chromatic variability. It is not yet clear whether it makes any difference where the chromatic variability is within the scene, so we constructed stimuli in which the chromatic variability was restricted to certain regions. We found that it made very little difference where the chromatic variability was located. The extent to which the average colour of nearby surfaces influences the apparent colour of the target seems to depend on the average chromatic variability of the whole scene.

The influence of chromatic and achromatic variability on chromatic induction and perceived colour

Judgments of the colour of a surface are influenced by the colour of the surrounding. To determine whether only the average colour of the surrounding matters, or also the chromatic variability, judgments in colourful scenes are often compared with ones in which a target is surrounded by a plain background that provides the same average physical illumination of the retina as the colourful scene. The variability sometimes makes a difference (eg Shevell and Wei, 1998 Vision Research 38 1561-1566), and sometimes it does not (eg Brenner and Cornelissen, 1998 Vision Research 38 1789-1793). Is this because of the nonlinearity in cone responses? We designed scenes that stimulated the cones in an equivalent manner, both on average and in terms of variability, and yet differed markedly in chromatic variability. The more colourful surroundings had considerably less influence on subjects' colour judgments. We conclude that early cone-specific regulation of sensitivity cannot be responsible for the change in perceived colour, and deduce that chromatic induction takes place after contrast gain control.

Illuminant cues in surface color perception: tests of three candidate cues

Many recent computational models of surface color perception presuppose information about illumination in scenes. The models differ primarily in the physical process each makes use of as a cue to the illuminant. We evaluated whether the human visual system makes use of any of three of the following candidate illuminant cues: (1) specular highlight, (2) full surface specularity [Lee, H. C. (1986). Method for computing the scene-illuminant chromaticity from specular highlights. Journal of the Optical Society of America A, 3(10), 1694-1699; D'Zmura, M., & Lennie, P. (1986). Mechanisms of color constancy. Journal of the Optical Society of America A, 3(10), 1662-1672], and (3) uniform background. Observers viewed simulated scenes binocularly in a computer-controlled Wheatstone stereoscope. All simulated scenes contained a uniform background plane perpendicular to the observer's line of sight and a small number of specular, colored spheres resting on the uniform background. Scenes were rendered under either standard illuminant D65 or standard illuminant A. Observers adjusted the color of a small, simulated test patch to appear achromatic. In a series of experiments we perturbed the illuminant color signaled by each candidate cue and looked for an influence of the changed cue on achromatic settings. We found that the specular highlight cue had a significant influence, but that the influence was asymmetric: greater when the base illuminant, CIE standard Illuminant A, was perturbed in the direction of Illuminant D65 than vice versa. Neither the full surface specularity cue nor the background cue had any observable influence. The lack of influence of the background cue is likely due to the placement of the test patch in front of the background rather than, as is typical, embedded in the background.