The Oriented Difference of Gaussians (ODOG) model of brightness perception: Overview and executable Mathematica notebooks

Psychophysics of neon color spreading: Chromatic and temporal factors are not limiting

Neon color spreading (NCS) is an illusory color phenomenon that provides a dramatic example of surface completion and filling-in. Numerous studies have varied both spatial and temporal aspects of the neon-generating stimulus to explore variations in the strength of the effect. Here, we take a novel, parametric, low-level psychophysical approach to studying NCS in two experiments. In Experiment 1, we test the ability of both cone-isolating and equiluminant stimuli to generate neon color spreading for both increments and decrements in cone modulations. As expected, sensitivity was low to S(hort-wavelength) cone stimuli due to their poor spatial resolution, but sensitivity was similar for the other color directions. We show that when these differences in detection sensitivity are accounted for, the particular cone type, and the polarity (increment or decrement), make little difference in generating neon color spreading, with NCS visible at about twice detection threshold level in all cases. In Experiment 2, we use L-cone flicker modulations (reddish and greenish excursions around grey) to study sensitivity to NCS as a function of temporal frequency from 0.5 to 8 Hz. After accounting for detectability, the temporal contrast sensitivity functions for NCS are approximately constant or even increase over the studied frequency range. Therefore there is no evidence in this study that the processes underlying NCS are slower than the low-level processes of simple flicker detection. These results point to relatively fast mechanisms, not slow diffusion processes, as the substrate for NCS.

The effects of distractors on brightness perception based on a spiking network

Visual perception can be modified by the surrounding context. Particularly, experimental observations have demonstrated that visual perception and primary visual cortical responses could be modified by properties of surrounding distractors. However, the underlying mechanism remains unclear. To simulate primary visual cortical activities in this paper, we design a k-winner-take-all (k-WTA) spiking network whose responses are generated through probabilistic inference. In simulations, images with the same target and various surrounding distractors perform as stimuli. Distractors are designed with multiple varying properties, including the luminance, the sizes and the distances to the target. Simulations for each varying property are performed with other properties fixed. Each property could modify second-layer neural responses and interactions in the network. To the same target in the designed images, the modified network responses could simulate distinguishing brightness perception consistent with experimental observations. Our model provides a possible explanation of how the surrounding distractors modify primary visual cortical responses to induce various brightness perception of the given target.

A discrete magno-parvo additive model in early vision for explaining brightness perception in varying contrastive contexts

A varying contrastive context filter (VCCF)-based model of brightness perception has been proposed. It is motivated first by a recently proposed difference of difference-of-Gaussian (DDOG) filter. Alongside, it is also inspired from the fact that the nature evolves various discrete systems and mechanisms to carry out many of its complex tasks. A weight factor, used for the linear combination of two filters representing the magnocellular and parvocellular channels in the central visual pathway, has been defined and termed as the factor of contrastive context (FOCC) in the present model. This is a binary variable that lends a property of discretization to the DDOG filter. By analyzing important brightness contrast as well as brightness assimilation illusions, we arrive at the minimal set of values (only two) for FOCC, using which one is able to successfully predict the direction of brightness shift in both situations of brightness contrast, claimed and categorized here as low contrastive context, and those of brightness assimilation, claimed and categorized here as high contrastive context perception, depending upon whether the initial M-channel-filtered stimulus is above or below a threshold of the contrastive context. As distinct from Michelson/Weber/RMS contrast, high or low, the contrastive context claimed is dependent on the edge information in the stimulus determined by the Laplacian operator, also used in the DDOG model. We compared the proposed model against the already well-established oriented difference-of-Gaussian (ODOG) model of brightness perception. Extensive simulations suggest that though for most illusions both ODOG and VCCF produce correct output, for certain intricate cases in which the ODOG filter fails to correctly predict the illusory effect, our proposed VCCF model continues to remain effective.

The perception threshold of the panda illusion, a particular form of 2D pulse-width-modulated halftone, correlates with visual acuity

To call attention to the danger of extinction of the panda bear, the Lithuanian artist Ilja Klemencov created the artwork “They can disappear”. The illustration is composed of black-and-white zigzagged lines, which form the famous panda logo of the World Wild Fund For Nature (WWF) when seen from a distance. If one is too close to the artwork, it is difficult to spot the bear, however, if one steps back or takes off one’s glasses the panda suddenly appears. This led us to ask if the ability to see the panda is related to the visual acuity of the observer and if therefore, the panda illusion can be used to assess the spatial resolution of the eye. Here we present the results of the comparison between visual acuity determined using the Landolt C and that predicted from the panda illusion in 23 healthy volunteers with artificially reduced visual acuity. Furthermore, we demonstrate that the panda illusion is based on a 2D pulse-width modulation, explain its technical history, and provide the equations required to create the illusion. Finally, we explain why the illusion indeed can be used to predict visual acuity and discuss the neural causes of its perception with best-corrected visual acuity.

A model of lightness perception guided by probabilistic assumptions about lighting and reflectance

Lightness perception is the ability to perceive black, white, and gray surface colors in a wide range of lighting conditions and contexts. This ability is fundamental for any biological or artificial visual system, but it poses a difficult computational problem, and how the human visual system computes lightness is not well understood. Here I show that several key phenomena in lightness perception can be explained by a probabilistic graphical model that makes a few simple assumptions about local patterns of lighting and reflectance, and infers globally optimal interpretations of stimulus images. Like human observers, the model exhibits partial lightness constancy, codetermination, contrast, glow, and articulation effects. It also arrives at human-like interpretations of strong lightness illusions that have challenged previous models. The model's assumptions are reasonable and generic, including, for example, that lighting intensity spans a much wider range than surface reflectance and that shadow boundaries tend to be straighter than reflectance edges. Thus, a probabilistic model based on simple assumptions about lighting and reflectance gives a good computational account of lightness perception over a wide range of conditions. This work also shows how graphical models can be extended to develop more powerful models of constancy that incorporate features such color and depth.

Mechanisms underlying simultaneous brightness contrast: Early and innate

In the phenomenon of simultaneous brightness contrast, two patches, one on a dark background and the other on a light one, appear to have different brightness despite being physically equi-luminant. Elucidating the phenomenon's underlying mechanisms is relevant for the larger question of how the visual system makes photometric judgments in images. Accounts over the past century have spanned low-, mid- and high-level visual processes, but a definitive resolution has not emerged. We present three studies that collectively demonstrate that the computations underlying this phenomenon are low-level, instantiated prior to binocular fusion, and available innately, without need for inferential learning via an individual's visual experience. In our first two studies, we find that strong brightness induction is obtained even when observers are unaware of any luminance differences in the neighborhoods of the probe patches. Results with dichoptic displays reveal that eye of origin, although not evident consciously, has a marked influence on the eventual brightness percept of the probe patches, thereby localizing brightness estimation to a site preceding binocular fusion. The third study uses conventional simultaneous brightness contrast displays, but an unusual group of participants: Congenitally blind children whom we were able to treat surgically. The results demonstrate an immediate susceptibility to the simultaneous brightness illusion after sight onset. Together, these data strongly constrain the search for mechanisms underlying a fundamental brightness phenomenon.

Lightness induction enhancements and limitations at low frequency modulations across a variety of stimulus contexts

Lightness illusions are often studied under static viewing conditions with figures varying in geometric design, containing different types of perceptual grouping and figure-ground cues. A few studies have explored the perception of lightness induction while modulating lightness illusions continuously in time, where changes in perceived lightness are often linked to the temporal modulation frequency, up to around 2–4 Hz. These findings support the concept of a cut-off frequency for lightness induction. However, another critical change (enhancement) in the magnitude of perceived lightness during slower temporal modulation conditions has not been addressed in previous temporal modulation studies. Moreover, it remains unclear whether this critical change applies to a variety of lightness illusion stimuli, and the degree to which different stimulus configurations can demonstrate enhanced lightness induction in low modulation frequencies. Therefore, we measured lightness induction strength by having participants cancel out any perceived modulation in lightness detected over time within a central target region, while the surrounding context, which ultimately drives the lightness illusion, was viewed in a static state or modulated continuously in time over a low frequency range (0.25–2 Hz). In general, lightness induction decreased as temporal modulation frequency was increased, with the strongest perceived lightness induction occurring at lower modulation frequencies for visual illusions with strong grouping and figure-ground cues. When compared to static viewing conditions, we found that slow continuous surround modulation induces a strong and significant increase in perceived lightness for multiple types of lightness induction stimuli. Stimuli with perceptually ambiguous grouping and figure-ground cues showed weaker effects of slow modulation lightness enhancement. Our results demonstrate that, in addition to the existence of a cut-off frequency, an additional critical temporal modulation frequency of lightness induction exists (0.25–0.5 Hz), which instead maximally enhances lightness induction and seems to be contingent upon the prevalence of figure-ground and grouping organization.

Visual illusions via neural dynamics: Wilson-Cowan-type models and the efficient representation principle

We reproduce suprathreshold perception phenomena, specifically visual illusions, by Wilson-Cowan (WC)-type models of neuronal dynamics. Our findings show that the ability to replicate the illusions considered is related to how well the neural activity equations comply with the efficient representation principle. Our first contribution consists in showing that the WC equations can reproduce a number of brightness and orientation-dependent illusions. Then we formally prove that there cannot be an energy functional that the WC dynamics are minimizing. This leads us to consider an alternative, variational modeling, which has been previously employed for local histogram equalization (LHE) tasks. To adapt our model to the architecture of V1, we perform an extension that has an explicit dependence on local image orientation. Finally, we report several numerical experiments showing that LHE provides a better reproduction of visual illusions than the original WC formulation, and that its cortical extension is capable also to reproduce complex orientation-dependent illusions.NEW & NOTEWORTHY We show that the Wilson-Cowan equations can reproduce a number of brightness and orientation-dependent illusions. Then we formally prove that there cannot be an energy functional that the Wilson-Cowan equations are minimizing, making them suboptimal with respect to the efficient representation principle. We thus propose a slight modification that is consistent with such principle and show that this provides a better reproduction of visual illusions than the original Wilson-Cowan formulation. We also consider the cortical extension of both models to deal with more complex orientation-dependent illusions.

Lateral effects in pattern vision

There is a large literature on lateral effects in pattern vision but no consensus about them or comprehensive model of them. This paper reviews the literature with a focus on the effects of parallel context in the central fovea. It describes seven experiments that measure detection and discrimination thresholds in annular and Gabor-pattern contexts at different separations. It presents a model of these effects, which is an elaboration of Foley's (1994) model. The model describes the results well, and it shows that lateral context affects the response to the target by both multiplicative excitation and additive inhibition. Both lateral effects extend for several wavelengths beyond the target. They vary in relative strength, producing near suppression and far enhancement of the response to the target. The model describes the detection and discrimination results well, and it also describes the results of experiments on lateral effects on perceived contrast. The model is consistent with the physiology of V1 cells.

What image features guide lightness perception?

Lightness constancy is the ability to perceive black and white surface colors under a wide range of lighting conditions. This fundamental visual ability is not well understood, and current theories differ greatly on what image features are important for lightness perception. Here we measured classification images for human observers and four models of lightness perception to determine which image regions influenced lightness judgments. The models were a high-pass-filter model, an oriented difference-of-Gaussians model, an anchoring model, and an atmospheric-link-function model. Human and model observers viewed three variants of the argyle illusion (Adelson, 1993) and judged which of two test patches appeared lighter. Classification images showed that human lightness judgments were based on local, anisotropic stimulus regions that were bounded by regions of uniform lighting. The atmospheric-link-function and anchoring models predicted the lightness illusion perceived by human observers, but the high-pass-filter and oriented-difference-of-Gaussians models did not. Furthermore, all four models produced classification images that were qualitatively different from those of human observers, meaning that the model lightness judgments were guided by different image regions than human lightness judgments. These experiments provide a new test of models of lightness perception, and show that human observers' lightness computations can be highly local, as in low-level models, and nevertheless depend strongly on lighting boundaries, as suggested by midlevel models.

Kitaoka's Tomato: Two Simple Explanations Based on Information in the Stimulus

Kitaoka’s Tomato is a color illusion in which a semitransparent blue-green field is placed on top of a red object (a tomato). The tomato appears red even though the pixels would appear green if viewed in isolation. We show that this phenomenon can be explained by a high-pass filter and by histogram equalization. The results suggest that this illusion does not require complex inferences about color constancy; rather, the tomato’s red is available in the physical stimulus at the appropriate spatial scale and dynamic range.

Grouping Factors and the Reverse Contrast Illusion

In simultaneous lightness contrast, two identical gray target squares lying on backgrounds of different intensities appear different in lightness. Traditionally, this illusion was explained by lateral inhibitory mechanisms operating retinotopically. More recently, spatial filtering models have been preferred. We report tests of an anchoring theory account in which the illusion is attributed to grouping rules used by the visual system to compute lightness. We parametrically varied the belongingness of two gray target bars to their respective backgrounds so that they either appeared to group with a set of bars flanking them, or they appeared to group with their respective backgrounds. In all variations, the retinal adjacency of the gray squares and their backgrounds was essentially unchanged. We report data from seven experiments showing that manipulation of the grouping rules governs the size and direction of the simultaneous lightness contrast illusion. These results support the idea that simultaneous lightness contrast is the product of anchoring within perceptual groups.

Brightness induction and suprathreshold vision: effects of age and visual field

A variety of visual capacities show significant age-related alterations. We assessed suprathreshold contrast and brightness perception across the lifespan in a large sample of healthy participants (N=155; 142) ranging in age from 16 to 80 years. Experiment 1 used a quadrature-phase motion cancelation technique (Blakeslee & McCourt, 2008) to measure canceling contrast (in central vision) for induced gratings at two temporal frequencies (1 Hz and 4 Hz) at two test field heights (0.5° or 2°×38.7°; 0.052 c/d). There was a significant age-related reduction in canceling contrast at 4 Hz, but not at 1 Hz. We find no age-related change in induction magnitude in the 1 Hz condition. We interpret the age-related decline in grating induction magnitude at 4 Hz to reflect a diminished capacity for inhibitory processing at higher temporal frequencies. In Experiment 2 participants adjusted the contrast of a matching grating (0.5° or 2°×38.7°; 0.052 c/d) to equal that of both real (30% contrast, 0.052 c/d) and induced (McCourt, 1982) standard gratings (100% inducing grating contrast; 0.052 c/d). Matching gratings appeared in the upper visual field (UVF) and test gratings appeared in the lower visual field (LVF), and vice versa, at eccentricities of ±7.5°. Average induction magnitude was invariant with age for both test field heights. There was a significant age-related reduction in perceived contrast of stimuli in the LVF versus UVF for both real and induced gratings.