Depth effect on lightness revisited: The role of articulation, proximity and fields of illumination

Transparent layer constancy improves with increased naturalness of the scene

The extent to which hue, saturation, and transmittance of thin light-transmitting layers are perceived as constant when the illumination changes (transparent layer constancy, TLC) has previously been investigated with simple stimuli in asymmetric matching tasks. In this task, a target filter is presented under one illumination and a second filter is matched under a second illumination. Although two different illuminations are applied in the stimulus generation, there is no guarantee that the stimulus will be interpreted appropriately by the visual system. In previous work, we found a higher degree of TLC when both illuminations were presented alternately than when they were presented simultaneously, which could be explained, for example, by an increased plausibility of an illumination change. In this work, we test whether TLC can also be increased in simultaneous presentation when the filter's belonging to a particular illumination context is made more likely by additional cues. To this end, we presented filters in differently lit areas of complex, naturalistically rendered 3D scenes containing different types of cues to the prevailing illumination, such as scene geometry, object shading, and cast shadows. We found higher degrees of TLC in such complex scenes than in colorimetrically similar simple 2D color mosaics, which is consistent with the results of similar studies in the area of color constancy. To test which of the illumination cues available in the scenes are actually used, the different types of cues were successively removed from the naturalistically rendered complex scene. A total of eight levels of scene complexity were examined. As expected, TLC decreased the more cues were removed. Object shading and illumination gradients due to shadow cast were both found to have a positive effect on TLC. A second filter had a small positive effect on TLC when added in strongly reduced scenes, but not in the complex scenes that already provide many cues about the illumination context of the filter.

Equivalent noise characterization of human lightness constancy

A goal of visual perception is to provide stable representations of task-relevant scene properties (e.g. object reflectance) despite variation in task-irrelevant scene properties (e.g. illumination and reflectance of other nearby objects). To study such stability in the context of the perceptual representation of lightness, we introduce a threshold-based psychophysical paradigm. We measure how thresholds for discriminating the achromatic reflectance of a target object (task-relevant property) in rendered naturalistic scenes are impacted by variation in the reflectance functions of background objects (task-irrelevant property), using a two-alternative forced-choice paradigm in which the reflectance of the background objects is randomized across the two intervals of each trial. We control the amount of background reflectance variation by manipulating a statistical model of naturally occurring surface reflectances. For low background object reflectance variation, discrimination thresholds were nearly constant, indicating that observers’ internal noise determines threshold in this regime. As background object reflectance variation increases, its effects start to dominate performance. A model based on signal detection theory allows us to express the effects of task-irrelevant variation in terms of the equivalent noise, that is relative to the intrinsic precision of the task-relevant perceptual representation. The results indicate that although naturally occurring background object reflectance variation does intrude on the perceptual representation of target object lightness, the effect is modest – within a factor of two of the equivalent noise level set by internal noise.

The effect of scene articulation on transparent layer constancy

In this article, we examine the influence of scene articulation on transparent layer constancy. We argue that the term articulation may be understood as an aspect of the more general concept naturalness of a stimulus that relates to the degree of enrichment compared with a minimal stimulus and to the extent to which a stimulus contains regularities that are typically found in natural scenes. We conducted two matching experiments, in which we used strongly reduced scenes and operationalized articulation by the number of background reflectances (numerosity). The results of the first experiment show that higher numerosity actually leads to an increase in transparent layer constancy when reflectances are randomly drawn from a fixed population. However, this advantage disappears if the spatial mean and the variation of the subset colors are controlled as in our second experiment. Furthermore, our results suggest that the mechanism underlying transparent layer constancy leads to a rather stable compromise between two matching criteria, namely, proximal identity and constant filter properties according to our perceptual model. For filters with an additive component, which appear more or less hazy, we observed improved recovered filter properties and correspondingly higher degrees of transparent layer constancy, suggesting an additional mechanism in this type of filter.

Color for the perceptual organization of the pictorial plane: Victor Vasarely's legacy to Gestalt psychology

Victor Vasarely's (1906-1997) important legacy to the study of human perception is brought to the forefront and discussed. A large part of his impressive work conveys the appearance of striking three-dimensional shapes and structures in a large-scale pictorial plane. Current perception science explains such effects by invoking brain mechanisms for the processing of monocular (2D) depth cues. Here in this study, we illustrate and explain local effects of 2D color and contrast cues on the perceptual organization in terms of figure-ground assignments, i.e. which local surfaces are likely to be seen as "nearer" or "bigger" in the image plane. Paired configurations are embedded in a larger, structurally ambivalent pictorial context inspired by some of Vasarely's creations. The figure-ground effects these configurations produce reveal a significant correlation between perceptual solutions for "nearer" and "bigger" when other geometric depth cues are missing. In consistency with previous findings on similar, albeit simpler visual displays, a specific color may compete with luminance contrast to resolve the planar ambiguity of a complex pattern context at a critical point in the hierarchical resolution of figure-ground uncertainty. The potential role of color temperature in this process is brought forward here. Vasarely intuitively understood and successfully exploited the subtle context effects accounted for in this paper, well before empirical investigation had set out to study and explain them in terms of information processing by the visual brain.

Depth inversion with a 3D structure influences brightness perception

Whether or not depth perception influences brightness and/or lightness perception has been repeatedly discussed, and some studies have emphasized its importance. In addition, a small number of studies have empirically tested and shown the effect of depth inversion, such as seen in the Mach card illusion, on perceived lightness, and they interpreted such results in terms of lightness constancy. However, how perceived brightness changes contingent on depth inversion remains unexplained. Therefore, this study used the matching method to examine changes in brightness perception when depth inversion is observed. We created and used a three-dimensional (3D) concave object, composed of three sides made of card stock, which could be perceived as having two different shapes in 3D; it could be perceived as a horizontal concave object, corresponding to its actual physical structure, and as a convex standing object, similar in shape to a building. Participants observed this object as both a concave object and as a convex object, and judged the brightness of its surfaces during each observation. Our results show that the perception of the brightness of the object's surfaces clearly changed depending on the perception of depth. When the object was seen as convex, one part of the surface was perceived as darker than when the object was seen as concave, but the other part of the surface remained unchanged. Here we discuss the relationship between depth perception and brightness perception in terms of perceptual organization.

Neighboring chromaticity influences how white a surface looks

To identify surface properties independently of the illumination the visual system must make assumptions about the statistics of scenes and their illumination. Are assumptions about the intensity of the illumination independent of assumptions about its chromaticity? To find out, we asked participants to judge whether test patches within three different sets of surrounding surfaces were white or grey. Two sets were matched in terms of their maximal luminance, their mean luminance and chromaticity, and the variability in their luminance and chromaticity, but differed in how luminance and chromaticity were associated: the highest luminance was either associated with colorful surfaces or with achromatic ones. We found that test patches had to have a higher luminance to appear white when the highest luminance in the surrounding was associated with colorful surfaces. This makes sense if one considers that being colorful implies that a surface only reflects part of the light that falls on it, meaning that the illumination must have a higher luminance (a perfectly white surface reflects all of the light falling on it). In the third set, the colorful surfaces had the same luminance as in the set in which they were associated with the highest luminance, but the achromatic surfaces had a lower luminance so that the overall mean luminance was lower. Despite the constraints on the illumination being identical, test patches did not have to have as high luminance to appear white for the third set. Considering the layout of the surfaces in the surrounding revealed that test patches did have to have the same high luminance if the high luminance colorful surfaces were adjacent to the target patch. Thus, the assumptions about the possible illumination are applied locally. A possible mechanism is relying on the contrast within each type of cone: for a surface to appear white it must stimulate each of the three kinds of cones substantially more than do any neighboring surfaces.

The "face race lightness illusion": An effect of the eyes and pupils?

In an internet-based, forced-choice, test of the ‘face race lightness illusion’, the majority of respondents, regardless of their ethnicity, reported perceiving the African face as darker in skin tone than the European face, despite the mean luminance, contrast and numbers of pixels of the images were identical. In the laboratory, using eye tracking, it was found that eye fixations were distributed differently on the African face and European face, so that gaze dwelled relatively longer onto the locally brighter regions of the African face and, in turn, mean pupil diameters were smaller than for the European face. There was no relationship between pupils’ size and implicit social attitude (IAT) scores. In another experiment, the faces were presented either tachistoscopically (140 ms) or longer (2500 ms) so that, when gaze was prevented from looking directly at the faces in the former condition, the tendency to report the African face as “dark” disappeared, but it was present when gaze was free to move for just a few seconds. We conclude that the presence of the illusion depends on oculomotor behavior and we also propose a novel account based on a predictive strategy of sensory acquisition. Specifically, by differentially directing gaze towards to facial regions that are locally different in luminance, the resulting changes in retinal illuminance yield respectively darker or brighter percepts while attending to each face, hence minimizing the mismatch between visual input and the learned perceptual prototypes of ethnic categories.

To compute lightness, illumination is not estimated, it is held constant

The light reaching the eye from a surface does not indicate the black-gray-white shade of a surface (called lightness) because the effects of illumination level are confounded with the reflectance of the surface. Rotating a gray paper relative to a light source alters its luminance (intensity of light reaching the eye) but the lightness of the paper remains relatively constant. Recent publications have argued, as had Helmholtz (1866/1924), that the visual system unconsciously estimates the direction and intensity of the light source. We report experiments in which this theory was pitted against an alternative theory according to which illumination level and surface reflectance are disentangled by comparing only those surfaces that are equally illuminated, in other words, by holding illumination level constant. A 3-dimensional scene was created within which the rotation of a target surface would be expected to become darker gray according to the lighting estimation theory, but lighter gray according to the equi-illumination comparison theory, with results clearly favoring the latter. In a further experiment cues held to indicate light source direction (cast shadows, attached shadows, and glossy highlights) were completely eliminated and yet this had no effect on the results. (PsycINFO Database Record

The nature of instructional effects in color constancy

The instructions subjects receive can have a large effect on experimentally measured color constancy, but the nature of these effects and how their existence should inform our understanding of color perception remains unclear. We used a factorial design to measure how instructional effects on constancy vary with experimental task and stimulus set. In each of 2 experiments, we employed both a classic adjustment-based asymmetric matching task and a novel color selection task. Four groups of naive subjects were instructed to make adjustments/selections based on (a) color (neutral instructions); (b) the light reaching the eye (physical spectrum instructions); (c) the actual surface reflectance of an object (objective reflectance instructions); or (d) the apparent surface reflectance of an object (apparent reflectance instructions). Across the 2 experiments we varied the naturalness of the stimuli. We find clear interactions between instructions, task, and stimuli. With simplified stimuli (Experiment 1), instructional effects were large and the data revealed 2 instruction-dependent patterns. In 1 (neutral and physical spectrum instructions) constancy was low, intersubject variability was also low, and adjustment-based and selection-based constancy were in agreement. In the other (reflectance instructions) constancy was high, intersubject variability was large, adjustment-based constancy deviated from selection-based constancy and for some subjects selection-based constancy increased across sessions. Similar patterns held for naturalistic stimuli (Experiment 2), although instructional effects were smaller. We interpret these 2 patterns as signatures of distinct task strategies-1 is perceptual, with judgments based primarily on the perceptual representation of color; the other involves explicit instruction-driven reasoning. (PsycINFO Database Record

Grouping Factors and the Reverse Contrast Illusion

In simultaneous lightness contrast, two identical gray target squares lying on backgrounds of different intensities appear different in lightness. Traditionally, this illusion was explained by lateral inhibitory mechanisms operating retinotopically. More recently, spatial filtering models have been preferred. We report tests of an anchoring theory account in which the illusion is attributed to grouping rules used by the visual system to compute lightness. We parametrically varied the belongingness of two gray target bars to their respective backgrounds so that they either appeared to group with a set of bars flanking them, or they appeared to group with their respective backgrounds. In all variations, the retinal adjacency of the gray squares and their backgrounds was essentially unchanged. We report data from seven experiments showing that manipulation of the grouping rules governs the size and direction of the simultaneous lightness contrast illusion. These results support the idea that simultaneous lightness contrast is the product of anchoring within perceptual groups.

Illumination frame of reference in the object-reviewing paradigm: A case of luminance and lightness

The present study combines the object-reviewing paradigm (Kahneman, Treisman, & Gibbs, 1992) with the checkershadow illusion (Adelson, 1995) to contrast the effects of objects' luminance versus lightness on the object-specific preview benefit. To this end, we manipulated objects' luminance and the amount of illumination given by an informative background scene in experiments. In line with previous studies (Moore, Stephens, & Hein, 2010), there was no object-specific preview benefit when objects were presented on a uniformly colored background and luminance switched between objects. In contrast, when objects were presented on the checkershadow illusion background which provided an explanation for the luminance switch, a reliable object-specific preview benefit was observed. This suggests that object correspondence as measured by the object-reviewing paradigm can be influenced by scene-induced, perceived lightness of objects' surfaces. We replicated this finding and moreover showed that the scene context only influences the object-specific preview benefit if the objects are perceived as part of the background scene.

Color constancy supports cross-illumination color selection

We rely on color to select objects as the targets of our actions (e.g., the freshest fish, the ripest fruit). To be useful for selection, color must provide accurate guidance about object identity across changes in illumination. Although the visual system partially stabilizes object color appearance across illumination changes, how such color constancy supports object selection is not understood. To study how constancy operates in real-life tasks, we developed a novel paradigm in which subjects selected which of two test objects presented under a test illumination appeared closer in color to a target object presented under a standard illumination. From subjects' choices, we inferred a selection-based match for the target via a variant of maximum likelihood difference scaling, and used it to quantify constancy. Selection-based constancy was good when measured using naturalistic stimuli, but was dramatically reduced when the stimuli were simplified, indicating that a naturalistic stimulus context is critical for good constancy. Overall, our results suggest that color supports accurate object selection across illumination changes when both stimuli and task match how color is used in real life. We compared our selection-based constancy results with data obtained using a classic asymmetric matching task and found that the adjustment-based matches predicted selection well for our stimuli and instructions, indicating that the appearance literature provides useful guidance for the emerging study of constancy in natural tasks.

What visual illusions tell us about underlying neural mechanisms and observer strategies for tackling the inverse problem of achromatic perception

Research in lightness perception centers on understanding the prior assumptions and processing strategies the visual system uses to parse the retinal intensity distribution (the proximal stimulus) into the surface reflectance and illumination components of the scene (the distal stimulus—ground truth). It is agreed that the visual system must compare different regions of the visual image to solve this inverse problem; however, the nature of the comparisons and the mechanisms underlying them are topics of intense debate. Perceptual illusions are of value because they reveal important information about these visual processing mechanisms. We propose a framework for lightness research that resolves confusions and paradoxes in the literature, and provides insight into the mechanisms the visual system employs to tackle the inverse problem. The main idea is that much of the debate and confusion in the literature stems from the fact that lightness, defined as apparent reflectance, is underspecified and refers to three different types of judgments that are not comparable. Under stimulus conditions containing a visible illumination component, such as a shadow boundary, observers can distinguish and match three independent dimensions of achromatic experience: apparent intensity (brightness), apparent local intensity ratio (brightness-contrast), and apparent reflectance (lightness). In the absence of a visible illumination boundary, however, achromatic vision reduces to two dimensions and, depending on stimulus conditions and observer instructions, judgments of lightness are identical to judgments of brightness or brightness-contrast. Furthermore, because lightness judgments are based on different information under different conditions, they can differ greatly in their degree of difficulty and in their accuracy. This may, in part, explain the large variability in lightness constancy across studies.

Color constancy in a naturalistic, goal-directed task

In daily life, we use color information to select objects that will best serve a particular goal (e.g., pick the best-tasting fruit or avoid spoiled food). This is challenging when judgments must be made across changes in illumination as the spectrum reflected from an object to the eye varies with the illumination. Color constancy mechanisms serve to partially stabilize object color appearance across illumination changes, but whether and to what degree constancy supports accurate cross-illumination object selection is not well understood. To get closer to understanding how constancy operates in real-life tasks, we developed a paradigm in which subjects engage in a goal-directed task for which color is instrumental. Specifically, in each trial, subjects re-created an arrangement of colored blocks (the model) across a change in illumination. By analyzing the re-creations, we were able to infer and quantify the degree of color constancy that mediated subjects' performance. In Experiments 1 and 2, we used our paradigm to characterize constancy for two different sets of block reflectances, two different illuminant changes, and two different groups of subjects. On average, constancy was good in our naturalistic task, but it varied considerably across subjects. In Experiment 3, we tested whether varying scene complexity and the validity of local contrast as a cue to the illumination change modulated constancy. Increasing complexity did not lead to improved constancy; silencing local contrast significantly reduced constancy. Our results establish a novel goal-directed task that enables us to approach color constancy as it emerges in real life.

Lightness perception in simple images: testing the anchoring rules

One approach toward understanding how vision computes surface lightness is to first determine what principles govern lightness in simple stimuli and then test whether these hold for more complex stimuli. Gilchrist (2006) proposed that in the simplest images that produce the experience of a surface (two surfaces differing in luminance that fill the entire visual field) lightness can be predicted based on two anchoring rules: the highest luminance rule and the area rule, plus a scale normalization. To test whether these anchoring rules hold when critical features of the stimuli are varied, we probed lightness in simple stimuli, painted onto the inside of hemispheric domes viewed under diffuse lighting. We find that although the highest luminance surface appears nearly white across a large variation in illumination (as predicted by the highest luminance rule), its lightness tends to increase as its luminance increases. This effect is small relative to the size of the overall luminance change. Further, we find that when the darker region fills more than half of the visual field, it appears to lighten with further increases in area but only if it is a single surface. Splitting the dark region into smaller sectors that cover an equal cumulative area diminishes or eliminates the area effect.

A theory divided: current representations of the anchoring theory of lightness contradict the original's core claims

The anchoring theory of lightness perception (Gilchrist et al., Psychological Review 106 (1999) 795-834) has been described as one of the most successful approaches to lightness perception. Yet, not only does the original proposal contain serious gaps and inconsistencies, later expressions of the theory, which was never formally revised, seem to contradict the original claims while leaving the gaps unresolved. These problems call into question the theory's viability.

The effect of photometric and geometric context on photometric and geometric lightness effects

We measured the lightness of probe tabs embedded at different orientations in various contextual images presented on a computer-controlled stereo display. Two background context planes met along a horizontal roof-like ridge. Each plane was a graphic rendering of a set of achromatic surfaces with the simulated illumination for each plane controlled independently. Photometric context was varied by changing the difference in simulated illumination intensity between the two background planes. Geometric context was varied by changing the angle between them. We parsed the data into separate photometric effects and geometric effects. For fixed geometry, varying photometric context led to linear changes in both the photometric and geometric effects. Varying geometric context did not produce a statistically reliable change in either the photometric or geometric effects.

The effect of background and illumination on color identification of real, 3D objects

For the surface reflectance of an object to be a useful cue to object identity, judgments of its color should remain stable across changes in the object's environment. In 2D scenes, there is general consensus that color judgments are much more stable across illumination changes than background changes. Here we investigate whether these findings generalize to real 3D objects. Observers made color matches to cubes as we independently varied both the illumination impinging on the cube and the 3D background of the cube. As in 2D scenes, we found relatively high but imperfect stability of color judgments under an illuminant shift. In contrast to 2D scenes, we found that background had little effect on average color judgments. In addition, variability of color judgments was increased by an illuminant shift and decreased by embedding the cube within a background. Taken together, these results suggest that in real 3D scenes with ample cues to object segregation, the addition of a background may improve stability of color identification.