Brightness with and without perceived transparency: when does it make a difference?

Deformation-induced transparency resolves color scission

Dynamic image deformation produces the perception of a transparent material that appears to deform the background image by light refraction. Since past studies on this phenomenon have mainly used subjective judgment about the presence of a transparent layer, it remains unsolved whether this is a real perceptual transparency effect in the sense that it forms surface representations, as do conventional transparency effects. Visual computation for color and luminance transparency, induced mainly by surface-contour information, can be decomposed into two components: surface formation to determine foreground and background layers, and scission to assign color and luminance to each layer. Here we show that deformation-induced perceptual transparency aids surface formation by color transparency and consequently resolves color scission. We asked observers to report the color of the front layer in a spatial region with a neutral physical color. The layer color could be seen as either reddish or greenish depending on the spatial context producing the color transparency, which was, however, ambiguous about the order of layers. We found that adding to the display a deformation-induced transparency that could specify the front layer significantly biased color scission in the predicted way if and only if the deformation-induced transparency was spatially coincident with the interpretation of color transparency. The results indicate that deformation-induced transparency is indeed a novel type of perceptual transparency that plays a role in surface formation in cooperation with color transparency.

Test of Models of Achromatic Transparency

Consider an achromatic disk transparent on an achromatic background formed by two adjoining rectangles, with the common border of the rectangles dividing the disk in half. Current models of achromatic transparency contend that the perceived extent of transparency of the disk depends on the luminance contrast inside the disk and on the luminance contrast in the background outside the disk. Here, a model is proposed which contends that this perceived extent is determined only by the luminance contrasts inherent in the disk: inside the disk and between the disk and the background. Two experiments were designed to determine which luminance contrasts influence transparency. In the first experiment, subjects rated the perceived extent of transparency of the disk for different combinations of the luminances of the disk and of the background. The results strengthen the view that the perceived extent of transparency depends on the luminance contrasts inherent in the disk. In the second experiment, a test was made of the possibility that luminance contrasts between adjoining areas of the background outside the disk are nonessential for transparency. The results show that transparency occurred both when the areas of the background outside the transparent region adjoined one another and when they were separated, confirming that the perceived extent of transparency depended only on luminance contrasts between adjoining areas inherent in the disk.

Brightness/darkness induction and the genesis of a contour

Visual contours often result from the integration or interpolation of fragmented edges. The strength of the completion increases when the edges share the same contrast polarity (CP). Here we demonstrate that the appearance in the perceptual field of this integrated unit, or contour of invariant CP, is concomitant with a vivid brightness alteration of the surfaces at its opposite sides. To observe this effect requires some stratagems because the formation in the visual field of a contour of invariant CP normally engenders the formation of a second contour and then the rise of two streams of induction signals that interfere in different ways. Particular configurations have been introduced that allow us to observe the induction effects of one contour taken in isolation. I documented these effects by phenomenological observations and psychophysical measurement of the brightness alteration in relation to luminance contrast. When the edges of the same CP complete to form a contour, the background of homogeneous luminance appears to dim at one side and to brighten at the opposite side (in accord with the CP). The strength of the phenomenon is proportional to the local luminance contrast. This effect weakens or nulls when the contour of the invariant CP separates surfaces filled with different gray shades. These conflicting results stimulate a deeper exploration of the induction phenomena and their role in the computation of brightness contrast. An alternative perspective is offered to account for some brightness illusions and their relation to the phenomenal transparency. The main assumption asserts that, when in the same region induction signals of opposite CP overlap, the filling-in is blocked unless the image is stratified into different layers, one for each signal of the same polarity. Phenomenological observations document this “solution” by the visual system.

Paradoxical effect of spatially homogenous transparent fields on simultaneous contrast illusions

In simultaneous brightness contrast (SBC) demonstrations, identical mid-luminance disks appear different from each other when one is placed on a black background while the other is placed on a white background. The strength of SBC effects can be enhanced by placing a semi-transparent layer on top of the display (Meyer's effect). Here, we try to separate the causes of Meyer's effect by placing a spatially homogenous transparent layer over a standard SBC display, and systematically varying the transmission level (alpha=0, clear; alpha=1, opaque) and color (black, gray, white) of the semi-transparent layer. Spatially homogenous transparent layers, which lack spatial cues, cannot be unambiguously interpreted as transparent fields. We measure SBC strength with both matching and ranking procedures. Paradoxically, with black layers, increasing alpha level weakens SBC when measured with a ranking procedure (no Meyer's effect) and strengthens SBC when measured with a matching procedure (Meyer's effect). With white and gray layers, neither procedure produces Meyer's effect. We account for the differences between white and black layers by positing that the visual system separates luminance from contrast. The results suggest that observers attend to different information in the matching and ranking procedures.

Local computation of lightness on articulated surrounds

Lightness of a grey target on a uniform light (or dark) surround changes by articulating the surround (articulation effect). To elucidate the processing of lightness underlying the articulation effect, the present study introduced transparency over a dark surround and investigated its effects on lightness of the target. The transparency was produced by adding a contiguous external field to the dark surround while keeping local stimulus configuration constant. Results showed that the target lightness did not change on the articulated surround when a dark transparent filter was perceived over the target, although it did on the uniform surround. These results suggest that image decomposition into a transparent filter and an underlying surface does not necessarily change lightness of the surface if the surface is articulated. Moreover, the present study revealed that articulating the surround does not always enhance lightness contrast; it can reduce the contrast effect when the target luminance is not the highest within the surround. These findings are consistent with the theoretical view that lightness perception on articulated surfaces is determined locally within a spatially limited region, and they also place a constraint on how the luminance distribution within the limited region is scaled.

When is spatial filtering enough? Investigation of brightness and lightness perception in stimuli containing a visible illumination component

Brightness (perceived intensity) and lightness (perceived reflectance) matching were investigated in seven well-known visual stimuli that contain a visible shadow or transparent overlay. These stimuli are frequently upheld as evidence that low-level spatial filtering is inadequate to explain brightness/lightness illusions and that additional mid- or high-level mechanisms are required. The argument in favor of rejecting low-level spatial filtering explanations has been founded on the erroneous assumption that equating test patch and near surround luminance is sufficient to control for and rule out this type of mechanism. We tested this idea by comparing the matching behavior of four observers to the predictions of the ODOG multiscale filtering model (Blakeslee & McCourt, 1999). Lightness and brightness matching differed significantly only when test patches appeared in shadow or beneath a transparency. Lightness and brightness matches were both significantly larger under these conditions; however, the lightness matches greatly exceeded the brightness matches. Lightness matches were greater for test patches in shadow or beneath a transparency because lightness matches under these conditions were based on conscious inferential (not sensory-level) judgments where observers attempted to discount the difference in illumination. The ODOG model accounted for approximately 80% of the total variance in the brightness matches (as well as in the lightness matches for targets not in shadow or beneath a transparency), and successfully predicted the relative magnitude of these matches in five of the seven stimulus sets. These results indicate that multiscale spatial filtering provides a unified and parsimonious explanation for brightness perception in these stimuli and imply that higher-level mechanisms are not required to explain them. The model was not as successful for the argyle and wall of blocks illusions in that it incorrectly rank-ordered the relative magnitude of the effects across different versions of the stimuli. It is an important question whether such model failures are due to known but corrigible limitations of the ODOG model or whether they will require other (possibly higher-level) explanations.

Lightness, brightness and transparency: a quarter century of new ideas, captivating demonstrations and unrelenting controversy

The past quarter century has witnessed considerable advances in our understanding of Lightness (perceived reflectance), Brightness (perceived luminance) and perceived Transparency (LBT). This review poses eight major conceptual questions that have engaged researchers during this period, and considers to what extent they have been answered. The questions concern 1. the relationship between lightness, brightness and perceived non-uniform illumination, 2. the brain site for lightness and brightness perception, 3 the effects of context on lightness and brightness, 4. the relationship between brightness and contrast for simple patch-background stimuli, 5. brightness "filling-in", 6. lightness anchoring, 7. the conditions for perceptual transparency, and 8. the perceptual representation of transparency. The discussion of progress on major conceptual questions inevitably requires an evaluation of which approaches to LBT are likely and which are unlikely to bear fruit in the long term, and which issues remain unresolved. It is concluded that the most promising developments in LBT are (a) models of brightness coding based on multi-scale filtering combined with contrast normalization, (b) the idea that the visual system decomposes the image into "layers" of reflectance, illumination and transparency, (c) that an understanding of image statistics is important to an understanding of lightness errors, (d) Whittle's logW metric for contrast-brightness, (e) the idea that "filling-in" is mediated by low spatial frequencies rather than neural spreading, and (f) that there exist multiple cues for identifying non-uniform illumination and transparency. Unresolved issues include how relative lightness values are anchored to produce absolute lightness values, and the perceptual representation of transparency. Bridging the gap between multi-scale filtering and layer decomposition approaches to LBT is a major task for future research.

Organização espacial na percepção visual de luminosidade

Este estudo analisou a influência de variações físicas dos estímulos, com base na organização espacial de figura-fundo criada pela associação dos efeitos ilusórios de contraste simultâneo de luminosidade e de contornos subjetivos. A cada participante, no total de 64, foram apresentadas 160 matrizes de escolha, cada uma composta de um estímulo modelo e quatro estímulos de comparação, devendo ser identificado qual dos quatro estímulos de comparação correspondia ao estímulo modelo. A diferença significativa entre as médias de ajuste visual verificadas para a condição de contorno subjetivo médio e para a condição controle (sem contorno) mostrou que a formação clássica de contornos subjetivos de Kanizsa, quando associada ao efeito de contraste simultâneo de luminosidade, influenciou a percepção de luminosidade dos participantes.

Multiplicative and additive Adelson's snake illusions

Two different versions of Adelson's snake lightness illusion are quantitatively investigated. In one experiment an additive version of the illusion is investigated by varying the additive component of the atmosphere transfer function (ATF) introduced by Adelson [2000, in The New Cognitive Neuroscience Ed. M Gazzaniga (Cambridge, MA: MIT Press) pp 339-351]. In the other, a multiplicative version of the illusion is examined by varying the multiplicative component of the ATE In both experiments four observers matched the targets' lightness of the snake patterns with Munsell samples. Increasing the additive or the multiplicative component elicited an approximately equal increase in the magnitude of the lightness illusion. The results show that both components, in the absence of other kinds of information, can be used as heuristics by our visual system to anchor luminance of the object when converting it into lightness.

Coming to terms with lightness and brightness: effects of stimulus configuration and instructions on brightness and lightness judgments

To recover surface reflectance and illuminance from the raw luminance signal, the visual system must use prior assumptions and strategies that make use of additional sources of information. Indeed, it has been found that depending on experimental conditions, lightness (apparent reflectance) may refer to judgments that are similar to brightness judgments (apparent luminance), that are similar to local brightness-contrast judgments, or that represent an independent third dimension of achromatic experience which exists only when the illumination across regions of the display is visibly non-uniform (L. E. Arend & B. Spehar, 1993a, 1993b). This means that lightness data generated in one experimental condition may not be comparable to lightness data measured in other conditions. We investigate this problem with regard to a history of data on simultaneous brightness-contrast by measuring brightness, brightness-contrast, and lightness in stimuli similar to those used in Gilchrist's edge-substitution studies (A. Gilchrist, S. Delman, & A. Jacobsen, 1983) and in stimuli similar to those used to test Gilchrist's intrinsic-image model against his newer anchoring model (A. Gilchrist, 2006). Our results clarify confusions that appear to stem from comparing different types of lightness judgments and from inadvertently using brightness as an index of lightness under conditions where independent lightness judgments are possible.

Chromatic shadow compatibility and cone-excitation ratios

Logvinenko [Perception 31, 201 (2002)] asserts that Adelson's wall-of-blocks illusion [Science 262, 2042 (1993)], where identical gray-cube surface tops appear to differ in brightness, arises when the surfaces surrounding the cube tops are shadow compatible, creating a concomitant illusion of transparency. We replicated Logvinenko's main findings in the chromatic domain across three experiments in which observers match cube tops in hue, saturation, and brightness. A second set of stimuli adjusted cone-excitation ratios across the apparent transparency border [Proc. R. Soc. London 257, 115 (1994)], which enhanced lightness and brightness constancy but only when the stimuli varied in both chromaticity and intensity.

Mechanisms of contrast induction in heterogeneous displays

This study examines how judgments of a region's contrast are influenced by components of a heterogeneous surround. Each stimulus comprised a 5x5 grid of squares in a homogeneous background of fixed mean luminance, with the central square the target. On a given trial, the task was to judge (with feedback) whether the (Weber) contrast of the target was 0.04 or -0.04 (relative to the background); the contrasts assigned (in random order) to the 24 surrounding squares were drawn from the values -0.98, -0.33, 0.33, 0.98 in conformity to one of nine pre-chosen histograms. Presentations were brief (80 ms) in one condition and long (800 ms) in another. A novel psychophysical method was used to estimate the impact exerted on judged target contrast (JTC) by a given contrast in a given grid position. Results were similar for four observers. For both display durations, the four squares sharing an edge with the target influenced JTC 2.4-9 times more than any other surrounding squares. In long presentations, abutting squares of extreme contrast repelled target contrast: squares of contrast -0.98 (0.98) increased (decreased) JTC. However, lower contrast abutting squares attracted target contrast: squares of contrast -0.33 (0.33) decreased (increased) JTC. This central finding can be explained by supposing that: (a) JTC is strongly correlated with the average boundary contrast from surround to target, as registered by linear, edge-selective neurons, and, crucially, (b) the responses of these neurons are themselves subject to lateral inhibition from the rectified responses of other similarly tuned neurons. Finally, in brief presentations, a polarity-specific asymmetry was observed: the two positive abutting-square contrasts continued to influence JTC as they did in long presentations, but contrasts -0.33 and -0.98 ceased to exert much impact, suggesting that lateral influences on target appearance propagate more quickly from positive than from negative contrast abutting regions.

Brightening prospects for early cortical coding of perceived luminance: a high-density electrical mapping study

Establishing the computational rules and neural substrates of brightness coding is a topic of both historical and contemporary interest. Two major classes of explanations for brightness illusions, such as brightness contrast, can be traced to Hering and Helmholtz. Hering's legacy is a low-level account in which brightness contrast results from obligatory lateral inhibitory interactions occurring at some level(s) in the visual system. Helmholtz offered a high-level account, positing a causal role for factors such as perceptual grouping, inferred illumination, and the extraction of surface properties such as orientation and reflectance. The tension between these theoretical viewpoints persists unabated to date. Intracranial electrophysiological recordings have revealed that brightness is represented in the firing rates of striate neurons, a fact consistent with low-level explanations. However, since the time-course of brightness-related responses relative to the onset of striate activity is undisclosed, it remains possible that striate activation might be temporally and causally secondary to higher-level computational processes. Knowledge of the timing of brightness-related neural activity is thus crucial to both constrain and adjudicate between these competing theories. We utilize high-density electrophysiological recording and a tachistoscopic brightness discrimination task to measure the time-course and scalp topography of brightness-related electrical potentials in human observers. Brightness perception is correlated with electrical activity at the earliest stages of visual cortical processing. These findings are interpreted to support Hering's low-level account of brightness for White's effect, and the results are discussed in the context of current theories of brightness perception.

Brightness assimilation in bullseye displays

In simultaneous brightness contrast displays, a gray target square G(B) bordered by black appears brighter than an identical gray target square G(W) bordered by white. Here we demonstrate that this effect can be reversed if G(B) is surrounded by bands that alternate outward from black to white, while G(W) is surrounded by bands that alternate outward from white to black. With these simple "bullseye" displays assimilation generally occurs--G(B) appears darker than G(W). Experiments 1 and 2 used a 2AFC design with a 2.2 s display duration. The results of these experiments indicate that (i) substantial assimilation occurs for target Weber contrasts (relative to the gray background) of -0.25, 0, and 0.25, but assimilation was maximal when target contrast was -0.25 and decreased as target contrast increased, (ii) assimilation effects were the same whether the width of the four surround bands was 20% of the target or 40% of the target, and (iii) assimilation occurs with as few as 2 surround-bands and the magnitude of the effect increases slightly as the number of bands increase. When experiment 1 was re-run using the method of matching (experiment 3), however, the results changed dramatically: (moderate) assimilation effects were found only when target contrast was -0.25; when target contrast was 0.25, there was a brightness contrast effect; when target contrast was 0, there was no illusion. Assimilation effects in bullseye displays are not predicted by the CSF model described in DeValois and DeValois [Spatial Vision, Oxford University Press, New York, 1988], the anchoring model of Gilchrist et al. [Psychological Review, 106(4) (1999) 795], or Blakeslee and McCourt's [Vision Research 39 (1999) 4361] ODOG model. We propose that this assimilation effect is the result of a contrast inhibition mechanism similar to that proposed by Chubb et al. [Proceedings for the National Academy of Science, vol. 86, 1989, p. 9631] to underlie contrast effects.

Influences of motion and depth on brightness induction: an illusory transparency effect?

To experiments were performed to investigate whether motion and binocular disparity influence brightness induction, and whether the effects of motion and binocular disparity, if any, interact with each other. In order to introduce motion, textured backgrounds were used as the inducing field. The results showed that motion and/or crossed disparity reduce brightness induction, whereas uncrossed disparity increases it. The effect of motion and the effect of disparity are independent of each other and additive, which suggests that, to the extent that brightness induction reflects segmentation of objects, motion and binocular disparity serve independently to segment objects from their background. The difference between the effects of crossed and uncrossed disparity can be explained by what we call 'illusory transparency'.

Stereoscopic surface interpolation supports lightness constancy

The human visual system has a remarkable ability to construct surface representations from sparse stereoscopic, as well as texture and motion, information. In impoverished displays where few points are used to define regions in depth, the brain often interpolates depth estimates across intervening blank regions to create a compelling sense of a solid surface. The set of experiments described here examined stereoscopic interpolation using a novel technique based on lightness constancy. The effectiveness of this method is notable because it stands as the only technique to date that unequivocally examines the perception of interpolated surfaces, and not surfaces inferred subjectively from depth information in the stimulus. Further, these data support the growing evidence that a primary function of the stereoscopic system is to define three-dimensional surface structure.

Information regarding structure and lightness based on phenomenal transparency influences the efficiency of visual search

Phenomenal transparency reflects a process which makes it possible to recover the structure and lightness of overlapping objects from a fragmented image. This process was investigated by the visual-search paradigm. In three experiments, observers searched for a target that consisted of gray patches among a variable number of distractors and the search efficiency was assessed. Experiments 1 and 2 showed that the search efficiency was greatly improved when the target was distinctive with regard to structure, based on transparency. Experiment 3 showed that the search efficiency was impaired when a target was not distinctive with regard to lightness (ie perceived reflectance), based on transparency. These results suggest that the shape and reflectance of overlapping objects when accompanied by transparency can be calculated in parallel across the visual field, and can be used as a guide for visual attention.

Perception of brightness and brightness illusions in the macaque monkey

Recent physiological studies show that neural responses correlated with the perception of brightness are found in cortical area V1 but not earlier in the visual pathway (Kayama et al., 1979; Reid and Shapley, 1989; Squatrito et al., 1990; Komatsu et al., 1996; Rossi et al., 1996; MacEvoy et al., 1998; Rossi and Paradiso, 1999; Hung et al., 2001; Kinoshita and Komatsu, 2001; MacEvoy and Paradiso, 2001). However, these studies are based on comparisons of neural responses in animals with brightness perception in humans. Very little is known about the perception of brightness in animals typically used in physiological experiments. In this study, we quantify brightness discrimination, brightness induction, and White's effect in macaque monkeys. The results show that, qualitatively and quantitatively, the perception of brightness in macaques and humans is quite similar. This similarity may be an indication of common underlying neural computations in the two species.

An empirical study of the traditional Mach card effect

The traditional achromatic Mach card effect is an example of lightness inconstancy and a demonstration of how shape and lightness perception interact. We present a quantitative study of this phenomenon and explore the conditions under which it occurs. The results demonstrate that observers show lightness constancy only when sufficient information is available about the light-source position, and the perceptual task required of them is surface identification rather than direct colour-appearance matching. An analysis and comparison of these results with the chromatic Mach card effect (Bloj et al 1999 Nature 402 877-879) demonstrate that the luminance effects of mutual illumination do not account for the change in lightness perception in the traditional Mach card.

A multiscale spatial filtering account of the Wertheimer-Benary effect and the corrugated Mondrian

Blakeslee and McCourt [Blakeslee, B., & McCourt, M.E. (1997). Similar mechanisms underlie simultaneous brightness contrast and grating induction. Vision Research, 37, 2849-2869] demonstrated that a multiscale array of two-dimensional difference-of-Gaussian (DOG) filters provided a simple but powerful model for explaining a number of seemingly complex features of grating induction (GI), while simultaneously encompassing salient features of brightness induction in simultaneous brightness contrast (SBC), brightness assimilation and Hermann Grid stimuli. The DOG model (and isotropic contrast models in general) cannot, however, account for another important group of brightness effects including the White effect [White, M. (1997). A new effect of pattern on perceived lightness. Perception, 8, 413-416] and a variant of SBC [Todorovic, D. (1997). Lightness and junctions. Perception, 26, 379-395]. Blakeslee and McCourt [Blakeslee, B., McCourt, M.E. (1999). A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction. Vision Research, 39, 4361-4377] developed a modified version of the model, an oriented (ODOG) model, which differed from the DOG model in that the filters were anisotropic and their outputs were pooled nonlinearly. Using this model, they were able to account for both groups of induction effects. The present paper examines two additional sets of brightness illusions that cannot be explained by isotropic contrast models. Psychophysical brightness matching is employed to quantitatively measure the size of the brightness effect for two Wertheimer-Benary stimuli [Benary, W. (1924). Beobachtungen zu einem experiment uber helligkeitskontrast. Psychologische Forschung, 5, 131-142; Todorovic, D. (1997). Lightness and junctions. Perception, 26, 379-395] and for low- and high-contrast versions of corrugated Mondrian stimuli [Adelson, E.H. (1993). Perceptual organization and the jugdement of brightness. Science, 262, 2042-2044; Todorovic, D. (1997). Lightness and junctions. Perception, 26, 379-395]. Brightness matches are obtained on both homogeneous and checkerboard matching backgrounds. The ODOG model qualitatively predicts the appearance of the test patches in the Wertheimer-Benary stimuli and corrugated Mondrian stimuli. In addition, it quantitatively predicts the relative magnitudes of the corrugated Mondrian effects in the various conditions. In general, the psychophysical results and ODOG modeling argue strongly that like SBC, GI, the White effect and Todorovic's SBC demonstration, induced brightness in Wertheimer-Benary stimuli and in the corrugated Mondrian primarily reflects early-stage filtering operations in the visual system.

A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction

Blakeslee and McCourt ((1997) Vision Research, 37, 2849-2869) demonstrated that a multiscale array of two-dimensional difference-of-Gaussian (DOG) filters provided a simple but powerful model for explaining a number of seemingly complex features of grating induction (GI), while simultaneously encompassing salient features of brightness induction in simultaneous brightness contrast (SBC), brightness assimilation and Hermann Grid stimuli. The DOG model (and isotropic contrast models in general) cannot, however, account for another important group of brightness effects which includes the White effect (White (1979) Perception, 8, 413-416) and the demonstrations of Todorovic ((1997) Perception, 26, 379-395). This paper introduces an oriented DOG (ODOG) model which differs from the DOG model in that the filters are anisotropic and their outputs are pooled nonlinearly. The ODOG model qualitatively predicts the appearance of the test patches in the White effect, the Todorovic demonstration, GI and SBC, while quantitatively predicting the relative magnitudes of these brightness effects as measured psychophysically using brightness matching. The model also accounts for both the smooth transition in test patch brightness seen in the White effect (White & White (1985) Vision Research, 25, 1331-1335) when the relative phase of the test patch is varied relative to the inducing grating, and for the spatial variation of brightness across the test patch as measured using point-by-point brightness matching. Finally, the model predicts intensive aspects of brightness induction measured in a series of Todorovic stimuli as the arms of the test crosses are lengthened (Pessoa, Baratoff, Neumann & Todorokov (1998) Investigative Ophthalmology and Visual Science, Supplement, 39, S159), but fails in one condition. Although it is concluded that higher-level perceptual grouping factors may play a role in determining brightness in this instance, in general the psychophysical results and ODOG modeling argue strongly that the induced brightness phenomena of SBC, GI, the White effect and the Todorovic demonstration, primarily reflect early-stage cortical filtering operations in the visual system.