Adaptation to textured chromatic fields

Remote controls illusion: strange interactions across space cannot be explained by simple contrast filters

The visual system has separable visual encoding for luminance and for contrast modulation [J. Vis.8(1), B152 (2008)1534-736210.1167/8.6.1]; the two dimensions can be represented with a luminance contrast versus luminance plane. Here we use a contrast asynchrony paradigm to explore contextual effects on luminance contrast modulation: two identical rectangular bars (0.5°×2.5°) have luminance levels that modulate at 2 Hz; when one bar is placed on a bright field and the other bar on a dark field, observers perceive the bars modulating in antiphase with each other and yet becoming light and dark at the same time. The antiphase perception corresponds to the change in contrast between the bars and their surrounds (a change along the contrast axis of the plane); the in-phase perception corresponds to the luminance modulation (a change along the luminance axis of the plane). We examine spatial interaction by adding bright rectangular (0.5°×2.5°) flankers on both sides of the dark-field bar and dark flankers on both sides of the bright-field bar. Remarkably, flankers produce an in-phase appearance when separated from the bars by between 2^' and 4^' of visual angle, and produce antiphase appearance when they directly adjoin the bars or are separated by more than 8^'. To estimate the dimensions of the spatial interaction, we parametrically adjust the size of the gap between bars and flankers and the length of the flankers. We attempt to account for the results with models based on rectified difference of Gaussian filters and with rectified oriented difference of Gaussian filters. The models can account for the results when the flankers are the same height as bars, but are unable to account for the effects of increasing the flanker length. The models therefore suggest that the spatial interaction across distances requires more complex interactions of contrast filters.

Segregating animals in naturalistic surroundings: interaction of color distributions and mechanisms

Humans have been shown to rapidly detect animals in naturalistic scenes, but the role of color in this task is unclear. We first analyze the color information contained in a large number of images of salient and camouflaged animals in generic backgrounds. We found that color distributions of most animals and of their immediate backgrounds were oriented along other than the cardinal directions of color space. In addition, the maximum distances between animals and background distributions also tended to be along noncardinal directions, suggesting a role for higher-order cortical color mechanisms whose preferred axes are distributed widely in color space. We measured temporal thresholds for segmenting animal color distributions from background distributions in the absence of spatial cues. Combined over all observers and all images in our sample, thresholds for segmenting isoluminant projections of these distributions were lower than for segmenting the original distributions and considerably lower than for segmenting achromatic projections. Color information is thus likely to be useful in segregating animals in generic views, i.e., views not purposely chosen by the photographer to enhance the visibility of the animal. However, a comparison of thresholds with distances between distributions failed to reveal any advantage conferred by higher-order color mechanisms.

The separation of monocular and binocular contrast

The contrast asynchrony is a stimulus configuration that illustrates the visual system's separable responses to luminance and luminance contrast information (Shapiro, 2008; Shapiro et al., 2004). When two disks, whose luminances modulate in phase with each other, are each surrounded by a disk, one light and one dark, observers can see both the in-phase brightness signals and the antiphase contrast signals and can separate the two. Here we present the results of experiments in which observers viewed a similar stimulus dichoptically. We report that no asynchrony is perceived when one eye is presented with modulating disks and the other eye is presented with the black and white surround rings, nor is an asynchrony perceived in gradient versions of the contrast asynchrony. We also explore the "window shade illusion" (Shapiro, Charles, & Shear-Heyman, 2005) dichoptically and find that when a modulating disk is presented to one eye and a horizontally split black/white annulus is presented to the other, observers perceive a "shading" motion up and down the disk. This shading can be seen in either direction in the binocular condition, but it is almost always seen as moving towards low contrast in the monocular condition. These findings indicate the presence of separable retinal and cortical networks for contrast processing at different temporal and spatial scales.

Neural locus of color afterimages

After fixating on a colored pattern, observers see a similar pattern in complementary colors when the stimulus is removed [1-6]. Afterimages were important in disproving the theory that visual rays emanate from the eye, in demonstrating interocular interactions, and in revealing the independence of binocular vision from eye movements. Afterimages also prove invaluable in exploring selective attention, filling in, and consciousness. Proposed physiological mechanisms for color afterimages range from bleaching of cone photopigments to cortical adaptation [4-9], but direct neural measurements have not been reported. We introduce a time-varying method for evoking afterimages, which provides precise measurements of adaptation and a direct link between visual percepts and neural responses [10]. We then use in vivo electrophysiological recordings to show that all three classes of primate retinal ganglion cells exhibit subtractive adaptation to prolonged stimuli, with much slower time constants than those expected of photoreceptors. At the cessation of the stimulus, ganglion cells generate rebound responses that can provide afterimage signals for later neurons. Our results indicate that afterimage signals are generated in the retina but may be modified like other retinal signals by cortical processes, so that evidence presented for cortical generation of color afterimages is explainable by spatiotemporal factors that modify all signals.

Chromatic discrimination: differential contributions from two adapting fields

To test whether a retinal or cortical mechanism sums contributions from two adapting fields to chromatic discrimination, L/M discrimination was measured with a test annulus surrounded by an inner circular field and an outer rectangular field. A retinal summation mechanism predicted that the discrimination pattern would not change with a change in the fixation location. Therefore, the fixation was set either in the inner or the outer field in two experiments. When one of the adapting fields was "red" and the other was "green," the adapting field where the observer fixated always had a stronger influence on chromatic discrimination. However, when one adapting field was "white" and the other was red or green, the white field always weighted more heavily than the other adapting field in determining discrimination thresholds, whether the white field or the fixation was in the inner or outer adapting field. These results suggest that a cortical mechanism determines the relative contributions from different adapting fields.

Effect of spatial structure on colorfulness adaptation for natural images

We examined whether the perception of the colorfulness of an image is influenced by the adaptation of the visual system to natural and shuffled images with different degrees of saturation. In the experiment, observers first became adapted to several images with different levels of saturation and then their colorfulness perception of a test image was measured. The results show that their perception of colorfulness was influenced by their adaptation to the saturation of images. The effect was stronger following adaptation to natural images than to images consisting of a shuffled collage of randomized color blocks, which suggests that the naturalness of the spatial structure of an image affects the strength of the effect.

Do common mechanisms of adaptation mediate color discrimination and appearance? Contrast adaptation

Are effects of background contrast on color appearance and sensitivity controlled by the same mechanism of adaptation? We examined the effects of background color contrast on color appearance and on color-difference sensitivity under well-matched conditions. We linked the data using Fechner's hypothesis that the rate of apparent stimulus change is proportional to sensitivity and examined a family of parametric models of adaptation. Our results show that both appearance and discrimination are consistent with the same mechanism of adaptation.

Computational adaptation model and its predictions for color induction of first and second orders

The appearance of a patch of color or its contrast depends not only on the stimulus itself but also on the surrounding stimuli (induction effects-simultaneous contrast). A comprehensive computational physiological model is presented to describe chromatic adaptation of the first (retinal) and second (cortical) orders, and to predict the different chromatic induction effects. We propose that the chromatic induction of the first order that yields perceived complementary colors can be predicted by retinal adaptation mechanisms, contrary to previous suggestions. The second order of the proposed adaptation mechanism succeeds to predict the automatic perceived inhibition or facilitation of the central contrast of a texture stimulus, depending on the surrounding contrast. Furthermore, contrary to other models, this model is able to also predict the effect of variegated surrounding on the central perceived color.

The spatial tuning of chromatic adaptation

A key question in colour research is how the colour and spatial analysis of an image interact. Traditionally, colour and form analysis have been regarded as parallel and separate processes, and documented effects of image complexity on chromatic adaptation have been attributed to a temporal integration process during eye movements. Evidence is presented here for a spatial mechanism, which tunes chromatic adaptation to the luminance structure (spatial frequency and orientation) of an image. This in turn suggests a close cooperation between colour and form analysis during chromatic adaptation. The results are discussed in relation to the "segregated pathway hypothesis" and the role of spatial aspects for the computation of colour constancy and adaptation to natural scenes.

Time-course of S-cone system adaptation to simple and complex fields

We examine the temporal nature of adaptation at different stages of the S-cone color system. All lights were restricted to the S-cone-only (a constant L and M) cardinal axis in color space passing through mid-white (W). The observer initially adapted to a steady uniform field with a chromaticity on the -S end of the axis or on the +S end of the axis or a complex field composed of chromaticy -S and +S (+/-S adaptation). The observer then readapted to a steady uniform field of chromaticity W for a variable length of time (i.e., 0, 0.1, 0.25, 0.5, 1.0, or 2.0 s). A probe-flash technique was used to measure S-cone discrimination at various points along the S-cone-only cardinal axis. This allowed estimation of the response of the S-cone system over an extended response range. Following exposure to the -S and +S uniform fields, sensitivity was maximal at or near the chromaticity of the initial adaptation field and decreased linearly away from the adapting point. The shift from +S to W occurred more rapidly than the shift from -S to W; both of these shifts can be described by a multiplicative scaling of the S-cone signal. Following +/-S adaptation the threshold curve initially had a shape similar to that measured following -S adaptation, but returned rapidly to the W adaptation state. The shift following +/-S adaptation cannot be described by the multiplicative model, but can be explained by a change in the shape of the non-linearity. The results suggest the existence of fast post-receptoral processes.

Sensitivity to modulation of color distribution in multicolored textures

We evaluated the discriminability of color distributions in square-element textures. Each texture contained 225 colors, represented by a distribution of color vectors in color space defined by the L-M and S-(L+M) axes. Each color distribution was systematically manipulated by modulating the distribution of the vector lengths sinusoidally as a function of the direction in the color space. The results showed that it is difficult to resolve a color distribution modulated in more than three cycles per 360 degrees in the chromatic direction. The difference in components along the cardinal axes is not a critical factor in the discrimination of the color distribution. An analysis using a line-element model suggested that the discrimination of the color distribution is mediated by multiple chromatic channels that are tuned to a variety of directions in the color space with a half-height-half-bandwidth of about 40 degrees in the chromatic direction.

Time course of chromatic adaptation for color appearance and discrimination

Adaptation to a steady background has a profound effect on both color appearance and discrimination. We determined the temporal characteristics of chromatic adaptation for appearance and discrimination along different color directions. Subjects were adapted to a large uniform background made up of a CRT screen and a 45x64 degrees wall, illuminated by computer controlled lamps. After an instant change in background color along a red-green or blue-yellow color axis, we measured thresholds for the detection of increments along the same axes at fixed times between 25 ms and 121 s. Analogously, color appearance was determined using achromatic matching. Three components of adaptation could be identified by their temporal characteristics. A slow exponential time course of adaptation with a half-life of about 20 s was common to appearance and discrimination. A faster component with a half-life of 40-70 ms--probably due to photoreceptor adaptation--was also common to both. Exclusive for color appearance, there was a third, extremely rapid mechanism with a half-life faster than 10 ms. This instantaneous process explained more than 50% of total adaptation for color appearance and could be shown to act in a multiplicative manner. We conclude that this instantaneous adaptation mechanism for color appearance is situated at a later processing stage, after mechanisms common to appearance and discrimination, and is based on multiplicative spatial interactions rather than on local, temporal adaptational processes. Color appearance, and thus color constancy, seems to be determined in large part by cortical computations.

Identification of illuminant and object colors: heuristic-based algorithms

In everyday scenes, from perceived colors of objects and terrains, observers can simultaneously identify objects across illuminants and identify the nature of the light, e.g., as sunlight or cloudy. As a formal problem, identifying objects and illuminants from the color information provided by sensor responses is underdetermined. It is shown how the problem can be simplified considerably by the empirical result that chromaticities of sets of objects under one illuminant are approximately affine transformations of the chromaticities under spectrally different illuminants. Algorithms that use the affine nature of the correlation as a heuristic can identify objects of identical spectral reflectance across scenes lit simultaneously or successively by different illuminants. The relative chromaticities of the illuminants are estimated as part of the computation. Because information about objects and illuminants is useful in many different tasks, it would be more advantageous for the visual system to use such algorithms to extract both sorts of information from retinal signals than to discount either automatically at an early neural stage.