Lightness perception: seeing one color through another

A unified account of perceptual layering and surface appearance in terms of gamut relativity

When we look at the world--or a graphical depiction of the world--we perceive surface materials (e.g. a ceramic black and white checkerboard) independently of variations in illumination (e.g. shading or shadow) and atmospheric media (e.g. clouds or smoke). Such percepts are partly based on the way physical surfaces and media reflect and transmit light and partly on the way the human visual system processes the complex patterns of light reaching the eye. One way to understand how these percepts arise is to assume that the visual system parses patterns of light into layered perceptual representations of surfaces, illumination and atmospheric media, one seen through another. Despite a great deal of previous experimental and modelling work on layered representation, however, a unified computational model of key perceptual demonstrations is still lacking. Here we present the first general computational model of perceptual layering and surface appearance--based on a boarder theoretical framework called gamut relativity--that is consistent with these demonstrations. The model (a) qualitatively explains striking effects of perceptual transparency, figure-ground separation and lightness, (b) quantitatively accounts for the role of stimulus- and task-driven constraints on perceptual matching performance, and (c) unifies two prominent theoretical frameworks for understanding surface appearance. The model thereby provides novel insights into the remarkable capacity of the human visual system to represent and identify surface materials, illumination and atmospheric media, which can be exploited in computer graphics applications.

The luminance misattribution in lightness perception

The Simultaneous Lightness Contrast is the condition whereby a grey patch on a dark background appears lighter than a physically identical patch on a light background. This is probably the most studied phenomenon in lightness perception. Although this phenomenon has been explained in terms of low-level mechanisms, convincing evidences supporting a high-level interpretation have been presented over the last decades. Two are the main highlevel interpretations. On one side, the layer approach claims that the visual system splits the luminance into separate overlapping layers, corresponding to separate physical contributions; whilst on the other side, the framework approach maintains that the visual system groups the luminance within a set of contiguous frameworks. One of the biggest weaknesses of the layer approach is that it cannot account properly for errors in lightness perception (Gilchrist, 2005 Current Biology, 15(9), 330-332). To extend the multiple layers interpretation to errors in lightness perception, in this study we show that the perceptual lightness difference among equal patches on different backgrounds increases even when the luminance contrast with their backgrounds shrinks. Specifically, it is shown that the perceptual lightness difference among equal patches on different backgrounds intensifies when a small-sized semi-transparent surface is interposed between the patches and the backgrounds. This result indicates that in these conditions the visual system besides decomposing the luminance into separate layers also becomes liable for a luminance misattribution. It is proposed that the photometric and geometric relationships among the luminance edges in the image might account for this misattribution.

Global integration of local color differences in transparency perception: An fMRI study

In normal viewing, the visual system effortlessly assigns approximately constant attributes of color and shape to perceived objects. A fundamental component of this process is the compensation for illuminant variations and intervening media to recover reflectance properties of natural surfaces. We exploited the phenomenon of transparency perception to explore the cortical regions implicated in such processes, using fMRI. By manipulating the coherence of local color differences around a region in an image, we interfered with their global perceptual integration and thereby modified whether the region appeared transparent or not. We found the major cortical activation due to global integration of local color differences to be in the anterior part of the parahippocampal gyrus. Regions differentially activated by chromatic versus achromatic geometric patterns showed no significant differential response related to the coherence/incoherence of local color differences. The results link the integration of local color differences in the extraction of a transparent layer with sites activated by object-related properties of an image.