The psychophysics of detecting binocular discrepancies of luminance

Empirical tests of the effectiveness of EnChroma multi-notch filters for enhancing color vision in deuteranomaly

Manufacturers of notch filter-based aids for color vision claim that their products can enhance color perception for people with anomalous trichromacy, a form of color vision deficiency (CVD). Anecdotal reports imply that people with CVD can have radically enhanced color vision when using the filters. However, existing empirical research largely focussed on the effect of notch filters on performance on diagnostic tests for CVD has not found that they have any substantial effect. Informed by a model of anomalous trichromatic color vision, we selected stimuli predicted to reveal the effects of EnChroma filters. Using these stimuli, we tested the ability of EnChroma filters to enhance color vision for 10 deuteranomalous trichromats in three experiments: 1. asymmetric color matching between test and control filter conditions, 2. color discrimination measured using four alternative forced-choice, and 3. color appearance measured using dissimilarity ratings to reconstruct subjective color spaces using multidimensional scaling. To investigate potential effects of long-term adaptation or perceptual learning, participants completed all three experiments at two time points, on first exposure to the filters, and after a week of regular use. We found a significant effect of the filters on color matches in the direction predicted by the model at both time points, implying that the filters can enhance the anomalous trichromatic color gamut. However, we found minimal effect of the filters on color discrimination at threshold. We found a significant effect of the filters in enhancing the appearance of colors along the red-green axis at the first time point, and a trend in the same direction at the second time point. Our results provide the first quantitative experimental evidence that notch filters can enhance color perception for anomalous trichromats.

Predicted effectiveness of EnChroma multi-notch filters for enhancing color perception in anomalous trichromats

EnChroma filters are aids designed to improve color vision for anomalous trichromats. Their use is controversial because the results of lab-based assessments of their effectiveness have so far largely failed to agree with positive anecdotal reports. However, the effectiveness of EnChroma filters will vary depending on the conditions of viewing, including whether the stimuli are broadband reflective surfaces or colors presented on RGB displays, whether illumination spectra are broadband or narrowband, the transmission spectra of particular filters, and the cone spectral sensitivity functions of the observer. We created a model of anomalous trichromatic color vision to predict the effects of EnChroma filters on the color signals impaired in anomalous trichromacy. Using the model we varied illumination, filter type and observer cone sensitivity functions, and tested the effect of presenting colors as broadband reflective surfaces or on RGB displays. We also used hyperspectral images to assess the impact of the filters on anomalous trichromats' color vision for natural scenes. Model results predicted that the filters should be broadly effective at enhancing anomalous trichromats' equivalent to L/(L + M) chromatic contrasts under a range of viewing conditions, but are substantially more effective for deuteranomals than for protanomals. The filters are predicted to be more effective for broadband reflective surfaces presented under broadband illuminants than for surfaces presented under narrowband illuminants or for colors presented on RGB displays. Since the potential impacts of contrast adaptation and perceptual learning are not considered in the model, it needs to be empirically validated. Results of empirical tests of the effects of EnChroma filters on deuteranomalous color vision in comparison with model predictions are presented in an accompanying paper (Somers et al., in prep.).

Binocular luster elicited by isoluminant chromatic stimuli relies on mechanisms similar to those in the achromatic case

The phenomenon of binocular luster can be evoked by simple dichoptic center-surround stimuli showing a luminance contrast difference between the eyes. Previous findings support the idea that this phenomenon is mediated by a low-level conflict mechanism that integrates the monocular signals from different types of contrast detector cells. Also, isoluminant stimuli with different chromatic contrasts between eyes can trigger sensations of luster. Here, we investigate whether the lustrous impression in such purely chromatic stimuli depends on interocular contrast differences and in particular on interocular contrast polarity pairings in a similar way as in the achromatic case. In our experiments, we measured the magnitude of the lustrous response using a series of isoluminant dichoptic center-ring-surround stimuli with varying ring width whose chromatic properties were varied along the red-green and blue-yellow cardinal directions. The trends in the data were very similar to those of our former study with achromatic stimuli, indicating similar mechanisms in both cases. The empirical luster data could also be predicted fairly well by a chromatic version of our interocular conflict model (with overall R2 values between 0.577 and 0.639), for which two different receptive field models were used, simulating the behavior of color-sensitive double-opponent cells in V1.

Detection of vertical interocular phase disparities using luster as cue

Interocular disparities in contrast generate an impression of binocular luster, providing a cue for their detection. Disparities in the carrier spatial phase of horizontally oriented Gabor patches also generate an impression of luster, so the question arises as to whether it is the disparities in local contrast that accompany the phase disparities that give rise to the luster. We examined this idea by comparing the detection of interocular spatial phase disparities with that of interocular contrast disparities in Gabor patches, in the latter case that differed in overall contrast rather than phase between the eyes. When bandwidth was held constant and Gabor spatial frequency was varied, the detection of phase and contrast disparities followed a similar pattern. However, when spatial frequency was fixed and Gabor envelope standard deviation (and hence number of modulation cycles) was varied, thresholds for detecting phase disparities followed a U-shaped function of Gabor standard deviation, whereas thresholds for contrast disparities, following an initial decline, were more-or-less constant as a function of Gabor standard deviation. After reviewing a number of possible explanations for the U-shape found with phase disparities, we suggest that the likely cause is binocular sensory fusion, the strength of which increases with the number of modulation cycles. Binocular sensory fusion would operate to reduce phase but not contrast disparities, thus selectively elevating phase disparity thresholds.

A simple model of binocular luster

The dichoptic combination of simple center–surround stimuli showing a contrast difference between eyes can trigger a lustrous impression in the fused percept, particularly when the contrast polarities in the two input images are of opposite sign. Recent developments suggest that the phenomenon of binocular luster results from a neural conflict between ON and OFF visual pathways at an early binocular level. Support for this idea was found in a previous study in which the empirical luster judgments strongly correlated with the predictions of an interocular conflict model which was based on such ON–OFF pairings. However, our original model could not account for the fact that weaker lustrous sensations can also be evoked by stimuli showing contrast polarities of same sign between eyes. In the present study we present an improved model that also includes ON–ON and OFF–OFF pairings. The predictive power of this model was tested in a series of four experiments, using a total of about 500 different center–ring–surround configurations as test stimuli. We found that, overall, our modified version accounts for more than 80% of the variance in the empirical luster judgments and that the former problems could be largely resolved. Our results further suggest a nonlinear transducer function for the binocular conflict signals.

Binocular luster - A review

Binocular luster is a visual phenomenon that can be elicited by dichoptic stimuli showing an interocular difference in color or luminance contrast. For instance, when the two eyes are presented with simple center-surround stimuli in which the center patch in one eye is brighter and in the other eye darker than the common surround, the center patch in the fused percept assumes a lustrous appearance reminiscent of metal or graphite. Soon after the discovery of this phenomenon in the mid-19th century, it was intensively studied and several explanations were proposed. After this initial phase, however, research interest waned significantly. Stimulated by new insights into related phenomena and the underlying physiological mechanisms, the last 20 years have seen an increase in research activity in this field, which has considerably expanded our understanding of binocular luster. In this paper, we provide a detailed review of research on binocular luster over the past 170 years. We present and discuss the existing findings in a number of separate sections, dealing with 1) the phenomenology of binocular luster, 2) different theories that have been proposed, 3) several factors influencing the lustrous impression, 4) the relationship between binocular luster and binocular rivalry, 5) the current understanding of its neural basis, and 6) potential applications based on binocular luster.

Binocular fusion enhances the efficiency of spot-the-difference gameplay

Spot-the-difference, the popular childhood game and a prototypical change blindness task, involves identification of differences in local features of two otherwise identical scenes using an eye scanning and matching strategy. Through binocular fusion of the companion scenes, the game becomes a visual search task, wherein players can simply scan the cyclopean percept for local features that may distinctly stand-out due to binocular rivalry/lustre. Here, we had a total of 100 visually normal adult (18-28 years of age) volunteers play this game in the traditional non-fusion mode and after cross-fusion of the companion images using a hand-held mirror stereoscope. The results demonstrate that the fusion mode significantly speeds up gameplay and reduces errors, relative to the non-fusion mode, for a range of target sizes, contrasts, and chromaticity tested (all, p<0.001). Amongst the three types of local feature differences available in these images (polarity difference, presence/absence of a local feature difference and shape difference in a local feature difference), features containing polarity difference was identified as first in ~60-70% of instances in both modes of gameplay (p<0.01), with this proportion being larger in the fusion than in the non-fusion mode. The binocular fusion advantage is lost when the lustre cue is purposefully weakened through alterations in target luminance polarity. The spot-the-difference game may thus be cheated using binocular fusion and the differences readily identified through a vivid experience of binocular rivalry/lustre.

A Re-examination of Dichoptic Tone Mapping

Dichoptic tone mapping methods aim to leverage stereoscopic displays to increase visual detail and contrast in images and videos. These methods, which have been called both binocular tone mapping and dichoptic contrast enhancement, selectively emphasize contrast differently in the two eyes' views. The visual system integrates these contrast differences into a unified percept, which is theorized to contain more contrast overall than each eye's view on its own. As stereoscopic displays become increasingly common for augmented and virtual reality (AR/VR), dichoptic tone mapping is an appealing technique for imaging pipelines. We sought to examine whether a standard photographic technique, exposure bracketing, could be modified to enhance contrast similarly to dichoptic tone mapping. While assessing the efficacy of this technique with user studies, we also re-evaluated existing dichoptic tone mapping methods. Across several user studies; however, we did not find evidence that either dichoptic tone mapping or dichoptic exposures consistently increased subjective image preferences. We also did not observe improvements in subjective or objective measures of detail visibility. We did find evidence that dichoptic methods enhanced subjective 3D impressions. Here, we present these results and evaluate the potential contributions and current limitations of dichoptic methods for applications in stereoscopic displays.

The role of contrast polarities in binocular luster: Low-level and high-level processes

The binocular fusion of two center-surround configurations, where one center is brighter, the other darker than the common surround, leads to a strong impression of luster in the central patch. Without reversed contrast polarities of the center patches, this impression is much weaker or even absent. However, we observed that in the latter case the perceived luster can be considerably enhanced by enclosing both centers with a thin ring of fixed luminance. Compared to the standard stimulus, this center-ring-surround configuration shows much less binocular rivalry and the luster has also a different, more glass-like material quality. In a psychophysical experiment, we examined how the magnitude of the lustrous response depends on the width of the ring, both in stimuli with reversed and consistent contrast polarities. It has been proposed that binocular luster results from a neuronal conflict between ON and OFF visual pathways. To test this hypothesis with respect to our data, we developed a simple model to estimate the amount of interocular conflict resulting from a given binocular stimulus pair and applied it to all stimuli used in the experiment. We found strong correlations between the interocular conflict measure and the strength of luster observed in the experiment, suggesting that a common low-level mechanism determines the magnitude of the lustrous response. Regarding the differences in the perceived material quality of the lustrous impressions, we discuss evidence indicating that high-level processes are involved that promote the visual system's interpretation of the ring-stimuli as a certain depth-segmented 3D scene.

Dichoptic Spatial Contrast Sensitivity Reflects Binocular Balance in Normal and Stereoanomalous Subjects

Purpose

To study binocular balance by comparing dichoptic and standard monocular contrast sensitivity function (CSF) in stereonormal and stereoanomalous/stereoblind amblyopic subjects.

Methods

Sixteen amblyopes and 17 controls participated. Using the capability of the passive three-dimensional display, we measured their CSF both monocularly and dichoptically at spatial frequencies 0.5, 1, 2, 4, and 8 cpds using achromatic Gabor patches on a luminance noise background. During monocular stimulation, the untested eye was covered, while for the dichoptic stimulation the untested eye viewed background noise. Dichoptic CSF of both eyes was acquired within one block.

Results

In patients with central fixation, dichoptic viewing had a large negative impact on the CSF of the amblyopic eye, although it hardly affected that of the dominant eye. In contrast, dichoptic viewing had a small but significant effect on both eyes for controls. In addition, all participants lay along a continuum in terms of how much their two eyes were affected by dichoptic stimulation: by using two predefined contrast sensitivity ratios, namely, amblyopic sensitivity decrement and dichoptic sensitivity decrement, not only did we find a significant correlation between these variables among all participants, but also the two groups were identified with minimum error using a cluster analysis.

Conclusions

Dichoptic CSF may be considered to measure visual performance in patients with altered binocular vision, because it better reflects the visual capacity of the amblyopic eye than the standard monocular examinations. It may also be a more reliable parameter to assess the efficacy of modern approaches to treat amblyopia.

Interocular difference thresholds are mediated by binocular differencing, not summing, channels

Patterns in the two eyes' views that are not identical in hue or contrast often elicit an impression of luster, providing a cue for discriminating them from perfectly matched patterns. Here we attempt to determine the mechanisms for detecting interocular differences in luminance contrast, in particular in relation to the possible contributions of binocular differencing and binocular summing channels. Test patterns were horizontally oriented multi-spatial-frequency luminance-grating patterns subject to variable amounts of interocular difference in grating phase, resulting in varying degrees of local interocular contrast difference. Two types of experiment were conducted. In the first, subjects discriminated between a pedestal with an interocular difference that ranged upward from zero (i.e., binocularly correlated) and a test pattern that contained a bigger interocular difference. In the second type of experiment, subjects discriminated between a pedestal with an interocular difference that ranged downward from a maximum (i.e., binocularly anticorrelated) and a test pattern that contained smaller interocular difference. The two types of task could be mediated by a binocular differencing and a binocular summing channel, respectively. However, we found that the results from both experiments were well described by a simpler model in which a single, linear binocular differencing channel is followed by a standard nonlinear transducer that is expansive for small signals but strongly compressive for large ones. Possible reasons for the lack of involvement of a binocular summing channel are discussed in the context of a model that incorporates the responses of both monocular and binocular channels.

The Effects of Length and Orientation on Numerical Representation in Flow Maps

Flow maps are a common type of geographic information visualization in which lines that symbolize flow are typically varied in width to represent differences in the magnitude of the flow. An accurate perception of thickness is critical to numerical representation in flow maps. Previous studies have identified some of the factors, such as horizontal–vertical visual illusions and color size effects, that affect the perceived size of objects. However, the question of whether multiple visual variables that encode flow lines, such as length, orientation, and shape, interfere with their perceived thicknesses, remains unanswered. In this study, we performed a user study to determine the effect of length and orientation on thickness perception. The result indicates that the horizontal orientation is perceived to be thicker than the vertical orientation, and a short length is perceived to be thicker than a long length. Furthermore, we report and discuss other results (e.g., on adjustment direction) that are consistent with previous work. Although this study constitutes basic research, accumulating evidence on thickness perception is essential to this field of science. This study may contribute to our understanding of the factors that influence the perception of the thickness of lines on a flow map. We provide some concrete guidelines for the design of flow maps that may be beneficial to map designers.

Deadeye Visualization Revisited: Investigation of Preattentiveness and Applicability in Virtual Environments

Visualizations rely on highlighting to attract and guide our attention. To make an object of interest stand out independently from a number of distractors, the underlying visual cue, e.g., color, has to be preattentive. In our prior work, we introduced Deadeye as an instantly recognizable highlighting technique that works by rendering the target object for one eye only. In contrast to prior approaches, Deadeye excels by not modifying any visual properties of the target. However, in the case of 2D visualizations, the method requires an additional setup to allow dichoptic presentation, which is a considerable drawback. As a follow-up to requests from the community, this paper explores Deadeye as a highlighting technique for 3D visualizations, because such stereoscopic scenarios support dichoptic presentation out of the box. Deadeye suppresses binocular disparities for the target object, so we cannot assume the applicability of our technique as a given fact. With this motivation, the paper presents quantitative evaluations of Deadeye in VR, including configurations with multiple heterogeneous distractors as an important robustness challenge. After confirming the preserved preattentiveness (all average accuracies above 90%) under such real-world conditions, we explore VR volume rendering as an example application scenario for Deadeye. We depict a possible workflow for integrating our technique, conduct an exploratory survey to demonstrate benefits and limitations, and finally provide related design implications.

Retinal image quality in near-eye pupil-steered systems

State-of-the-art near-eye displays often compromise on eye box size to maintain a wide field of view, necessitating a means for steering the eye box to maintain alignment with a moving eye. The design space of such pupil-steered systems is not well defined and the implications of imperfect steering on the perceived image are not well understood. To better characterize the pupil steering design space, we introduce a generalized taxonomy of pupil-steered architectures that considers both system and ocular factors that affect steering performance. We also develop an optical model of a generalized pupil-steered system with a wide-field schematic eye to simulate the retinal image. Using this framework, we systematically characterize retinal image quality for different combinations of design parameters. The results of these simulations provide an overview of the pupil steering design space and help determine relevant psychophysical experiments for further evaluation.

At least two distinct mechanisms control binocular luster, rivalry, and perceived rotation with contrast and average luminance disparities

When one views a square-wave grating and dichoptically changes the average luminance or contrast of the monocular images, at least three perceptual phenomena might occur. These are the Venetian blind effect, or a perceived rotation of the bars around individual vertical axes; binocular luster, or a perceived shimmering; and binocular rivalry, or an alternating perception between the views of the two eyes. Perception of luster and rivalry occur when the "light bars" in the grating dichoptically straddle the background luminance (one eye's image has a higher luminance than the background and the other eye's image has a lower luminance than the background), with little impact from the "dark bars." Perception of rotation, on the other hand, is related to average luminance or contrast disparity, independent of whether or not the "light bars" straddle the background luminance. The patterns for perceived rotation versus binocular luster and binocular rivalry suggest at least two separate mechanisms in the visual system for processing luminance and contrast information over and above their differing physiological states suggested by their different appearances. While luster and rivalry depend directly on the relation between stimuli and the background, perceived rotation depends on the magnitude of the luminance or contrast disparity, as described by the generalized difference model.

Differences in Stereoscopic Luster Evoked by Static and Dynamic Stimuli

We compared the classic static stereoscopic luster phenomenon with a recently described dynamic variant ("counter modulation") to investigate whether they are related to the same or different processes. In the experiments, we presented pairs of center-surround stimuli haploscopically and measured the effect of the contrast between center colors on perceived luster. The center colors were either static or temporally modulated. In addition, we examined five color conditions (one achromatic, two equiluminant, and two mixed conditions) and three background conditions that influence the channel-wise polarities of the contrast of the two centers to the common surround. The results for static and dynamic stimuli differed in several ways, suggesting that they depend on different mechanisms: Compared with the static version, in dynamic stimuli, luster was perceived at markedly lower contrasts, did not depend on the sign of the contrast polarities, and appeared more steady. However, both phenomena seem also similar in some respects: In both cases, equiluminant stimuli led to lustrous impressions that were considerably less strong than those evoked by stimuli containing luminance variation, and the strength of the perceived luster was generally boosted with reversed contrast polarities.

Binocular Summation for Reflexive Eye Movements: A Potential Diagnostic Tool for Stereodeficiencies

Purpose

Stereoscopic vision, by detecting interocular correlations, enhances depth perception. Stereodeficiencies often emerge during the first months of life, and left untreated can lead to severe loss of visual acuity in one eye and/or strabismus. Early treatment results in much better outcomes, yet diagnostic tests for infants are cumbersome and not widely available. We asked whether reflexive eye movements, which in principle can be recorded even in infants, can be used to identify stereodeficiencies.

Methods

Reflexive ocular following eye movements induced by fast drifting noise stimuli were recorded in 10 adult human participants (5 with normal stereoacuity, 5 stereodeficient). To manipulate interocular correlation, the stimuli shown to the two eyes were either identical, different, or had opposite contrast. Monocular presentations were also interleaved. The participants were asked to passively fixate the screen.

Results

In the participants with normal stereoacuity, the responses to binocular identical stimuli were significantly larger than those induced by binocular opposite stimuli. In the stereodeficient participants the responses were indistinguishable. Despite the small size of ocular following responses, 40 trials, corresponding to less than 2 minutes of testing, were sufficient to reliably differentiate normal from stereodeficient participants.

Conclusions

Ocular-following eye movements, because of their reliance on cortical neurons sensitive to interocular correlations, are affected by stereodeficiencies. Because these eye movements can be recorded noninvasively and with minimal participant cooperation, they can potentially be measured even in infants and might thus provide an useful screening tool for this currently underserved population.

Deadeye: A Novel Preattentive Visualization Technique Based on Dichoptic Presentation

Preattentive visual features such as hue or flickering can effectively draw attention to an object of interest - for instance, an important feature in a scientific visualization. These features appear to pop out and can be recognized by our visual system, independently from the number of distractors. Most cues do not take advantage of the fact that most humans have two eyes. In cases where binocular vision is applied, it is almost exclusively used to convey depth by exposing stereo pairs. We present Deadeye, a novel preattentive visualization technique based on presenting different stimuli to each eye. The target object is rendered for one eye only and is instantly detected by our visual system. In contrast to existing cues, Deadeye does not modify any visual properties of the target and, thus, is particularly suited for visualization applications. Our evaluation confirms that Deadeye is indeed perceived preattentively. We also explore a conjunction search based on our technique and show that, in contrast to 3D depth, the task cannot be processed in parallel.

Adaptation to interocular difference

Patterns in the two eyes' views that are not identical in hue or contrast often elicit an impression of luster, providing a cue for discriminating them from perfectly matched patterns. Here we ask whether the mechanism for detecting interocular differences (IDs) is adaptable. Our stimuli were horizontally oriented multispatial-frequency grating patterns that could be subject to varying degrees of ID through the introduction of interocular phase differences in the grating components. Subjects adapted to patterns that were either correlated, uncorrelated, monocular (one eye only), or anticorrelated. Following adaptation, thresholds for detecting IDs were measured using a staircase procedure. It was found that ID thresholds were elevated following adaptation to uncorrelated, monocular, and anticorrelated but not correlated patterns. Threshold elevation was found to be maximal when the orientations of the adaptor and test gratings were the same, and when their spatial frequencies were similar. The results support the existence of a specialized mechanism for detecting IDs, the most likely candidate being the binocular differencing channel proposed in previous studies.

Ocularity Feature Contrast Attracts Attention Exogenously

An eye-of-origin singleton, e.g., a bar shown to the left eye among many other bars shown to the right eye, can capture attention and gaze exogenously or reflexively, even when it appears identical to other visual input items in the scene and when the eye-of-origin feature is irrelevant to the observer’s task. Defining saliency as the strength of exogenous attraction to attention, we say that this eye-of-origin singleton, or its visual location, is salient. Defining the ocularity of a visual input item as the relative difference between its left-eye input and its right-eye input, this paper shows the general case that an ocularity singleton is also salient. For example, a binocular input item among monocular input items is salient, so is a left-eye-dominant input item (e.g., a bar with a higher input contrast to the left eye than to the right eye) among right-eye-dominant items. Saliency by unique input ocularity is analogous to saliency by unique input colour (e.g., a red item among green ones), as colour is determined by the relative difference(s) between visual inputs to different photoreceptor cones. Just as a smaller colour difference between a colour singleton and background items makes this singleton less salient, so does a smaller ocularity difference between an ocularity singleton and background items. While a salient colour difference is highly visible, a salient ocularity difference is often perceptually invisible in some cases and discouraging gaze shifts towards it in other cases, making its behavioural manifestation not as apparent. Saliency by ocularity contrast provides another support to the idea that the primary visual cortex creates a bottom-up saliency map to guide attention exogenously.

Binocularity and visual search-Revisited

Binocular rivalry is a phenomenon of visual competition in which perception alternates between two monocular images. When two eye's images only differ in luminance, observers may perceive shininess, a form of rivalry called binocular luster. Does dichoptic information guide attention in visual search? Wolfe and Franzel (Perception & Psychophysics, 44(1), 81-93, 1988) reported that rivalry could guide attention only weakly, but that luster (shininess) "popped out," producing very shallow Reaction Time (RT) × Set Size functions. In this study, we have revisited the topic with new and improved stimuli. By using a checkerboard pattern in rivalry experiments, we found that search for rivalry can be more efficient (16 ms/item) than standard, rivalrous grating (30 ms/item). The checkerboard may reduce distracting orientation signals that masked the salience of rivalry between simple orthogonal gratings. Lustrous stimuli did not pop out when potential contrast and luminance artifacts were reduced. However, search efficiency was substantially improved when luster was added to the search target. Both rivalry and luster tasks can produce search asymmetries, as is characteristic of guiding features in search. These results suggest that interocular differences that produce rivalry or luster can guide attention, but these effects are relatively weak and can be hidden by other features like luminance and orientation in visual search tasks.

Contrast and lustre: A model that accounts for eleven different forms of contrast discrimination in binocular vision

Our goal here is a more complete understanding of how information about luminance contrast is encoded and used by the binocular visual system. In two-interval forced-choice experiments we assessed observers' ability to discriminate changes in contrast that could be an increase or decrease of contrast in one or both eyes, or an increase in one eye coupled with a decrease in the other (termed IncDec). The base or pedestal contrasts were either in-phase or out-of-phase in the two eyes. The opposed changes in the IncDec condition did not cancel each other out, implying that along with binocular summation, information is also available from mechanisms that do not sum the two eyes' inputs. These might be monocular mechanisms. With a binocular pedestal, monocular increments of contrast were much easier to see than monocular decrements. These findings suggest that there are separate binocular (B) and monocular (L,R) channels, but only the largest of the three responses, max(L,B,R), is available to perception and decision. Results from contrast discrimination and contrast matching tasks were described very accurately by this model. Stimuli, data, and model responses can all be visualized in a common binocular contrast space, allowing a more direct comparison between models and data. Some results with out-of-phase pedestals were not accounted for by the max model of contrast coding, but were well explained by an extended model in which gratings of opposite polarity create the sensation of lustre. Observers can discriminate changes in lustre alongside changes in contrast.

3D Displays

Creating realistic three-dimensional (3D) experiences has been a very active area of research and development, and this article describes progress and what remains to be solved. A very active area of technical development has been to build displays that create the correct relationship between viewing parameters and triangulation depth cues: stereo, motion, and focus. Several disciplines are involved in the design, construction, evaluation, and use of 3D displays, but an understanding of human vision is crucial to this enterprise because in the end, the goal is to provide the desired perceptual experience for the viewer. In this article, we review research and development concerning displays that create 3D experiences. And we highlight areas in which further research and development is needed.

Glossiness representation using binocular color difference

We demonstrate that a binocular color difference can be used to express the surface glossiness of an object on 3D display devices without being accompanied by a specular reflection pattern. A simple image with a binocular color difference provides a similar surface appearance impression to a real object that has the same binocular color difference. It is found that human binocular perception is likely to interpret binocular color difference as spectral reflectance rather than as transparency. Binocular glossiness is caused not only by a binocular lightness difference but also by a chromatic or hue difference.

Attention, uncertainty, and free-energy

We suggested recently that attention can be understood as inferring the level of uncertainty or precision during hierarchical perception. In this paper, we try to substantiate this claim using neuronal simulations of directed spatial attention and biased competition. These simulations assume that neuronal activity encodes a probabilistic representation of the world that optimizes free-energy in a Bayesian fashion. Because free-energy bounds surprise or the (negative) log-evidence for internal models of the world, this optimization can be regarded as evidence accumulation or (generalized) predictive coding. Crucially, both predictions about the state of the world generating sensory data and the precision of those data have to be optimized. Here, we show that if the precision depends on the states, one can explain many aspects of attention. We illustrate this in the context of the Posner paradigm, using the simulations to generate both psychophysical and electrophysiological responses. These simulated responses are consistent with attentional bias or gating, competition for attentional resources, attentional capture and associated speed-accuracy trade-offs. Furthermore, if we present both attended and non-attended stimuli simultaneously, biased competition for neuronal representation emerges as a principled and straightforward property of Bayes-optimal perception.

Colour vision deficiency

Colour vision deficiency is one of the commonest disorders of vision and can be divided into congenital and acquired forms. Congenital colour vision deficiency affects as many as 8% of males and 0.5% of females--the difference in prevalence reflects the fact that the commonest forms of congenital colour vision deficiency are inherited in an X-linked recessive manner. Until relatively recently, our understanding of the pathophysiological basis of colour vision deficiency largely rested on behavioural data; however, modern molecular genetic techniques have helped to elucidate its mechanisms. The current management of congenital colour vision deficiency lies chiefly in appropriate counselling (including career counselling). Although visual aids may be of benefit to those with colour vision deficiency when performing certain tasks, the evidence suggests that they do not enable wearers to obtain normal colour discrimination. In the future, gene therapy remains a possibility, with animal models demonstrating amelioration following treatment.