Temporal integration of monocular images separated in time: stereopsis, stereoacuity, and binocular luster

How to construct liquid-crystal spectacles to control vision of real-world objects and environments

A major challenge in studying naturalistic vision lies in controlling stimulus and scene viewing time. This is especially the case for studies using real-world objects as stimuli (rather than computerized images) because real objects cannot be "onset" and "offset" in the same way that images can be. Since the late 1980s, one solution to this problem has been to have the observer wear electro-optic spectacles with computer-controlled liquid-crystal lenses that switch between transparent ("open") and translucent ("closed") states. Unfortunately, the commercially available glasses (PLATO Visual Occlusion Spectacles) command a high price tag, the hardware is fragile, and the glasses cannot be customized. This led us to explore how to manufacture liquid-crystal occlusion glasses in our own laboratory. Here, we share the products of our work by providing step-by-step instructions for researchers to design, build, operate, and test liquid-crystal glasses for use in experimental contexts. The glasses can be assembled with minimal technical knowledge using readily available components, and they can be customized for different populations and applications. The glasses are robust, and they can be produced at a fraction of the cost of commercial alternatives. Tests of reliability and temporal accuracy show that the performance of our laboratory prototype was comparable to that of the PLATO glasses. We discuss the results of our work with respect to implications for promoting rigor and reproducibility, potential use cases, comparisons with other liquid-crystal shutter glasses, and how users can find information regarding future updates and developments.

Binocular luster - A review

Binocular luster is a visual phenomenon that can be elicited by dichoptic stimuli showing an interocular difference in color or luminance contrast. For instance, when the two eyes are presented with simple center-surround stimuli in which the center patch in one eye is brighter and in the other eye darker than the common surround, the center patch in the fused percept assumes a lustrous appearance reminiscent of metal or graphite. Soon after the discovery of this phenomenon in the mid-19th century, it was intensively studied and several explanations were proposed. After this initial phase, however, research interest waned significantly. Stimulated by new insights into related phenomena and the underlying physiological mechanisms, the last 20 years have seen an increase in research activity in this field, which has considerably expanded our understanding of binocular luster. In this paper, we provide a detailed review of research on binocular luster over the past 170 years. We present and discuss the existing findings in a number of separate sections, dealing with 1) the phenomenology of binocular luster, 2) different theories that have been proposed, 3) several factors influencing the lustrous impression, 4) the relationship between binocular luster and binocular rivalry, 5) the current understanding of its neural basis, and 6) potential applications based on binocular luster.

At least two distinct mechanisms control binocular luster, rivalry, and perceived rotation with contrast and average luminance disparities

When one views a square-wave grating and dichoptically changes the average luminance or contrast of the monocular images, at least three perceptual phenomena might occur. These are the Venetian blind effect, or a perceived rotation of the bars around individual vertical axes; binocular luster, or a perceived shimmering; and binocular rivalry, or an alternating perception between the views of the two eyes. Perception of luster and rivalry occur when the "light bars" in the grating dichoptically straddle the background luminance (one eye's image has a higher luminance than the background and the other eye's image has a lower luminance than the background), with little impact from the "dark bars." Perception of rotation, on the other hand, is related to average luminance or contrast disparity, independent of whether or not the "light bars" straddle the background luminance. The patterns for perceived rotation versus binocular luster and binocular rivalry suggest at least two separate mechanisms in the visual system for processing luminance and contrast information over and above their differing physiological states suggested by their different appearances. While luster and rivalry depend directly on the relation between stimuli and the background, perceived rotation depends on the magnitude of the luminance or contrast disparity, as described by the generalized difference model.

Differences in Stereoscopic Luster Evoked by Static and Dynamic Stimuli

We compared the classic static stereoscopic luster phenomenon with a recently described dynamic variant ("counter modulation") to investigate whether they are related to the same or different processes. In the experiments, we presented pairs of center-surround stimuli haploscopically and measured the effect of the contrast between center colors on perceived luster. The center colors were either static or temporally modulated. In addition, we examined five color conditions (one achromatic, two equiluminant, and two mixed conditions) and three background conditions that influence the channel-wise polarities of the contrast of the two centers to the common surround. The results for static and dynamic stimuli differed in several ways, suggesting that they depend on different mechanisms: Compared with the static version, in dynamic stimuli, luster was perceived at markedly lower contrasts, did not depend on the sign of the contrast polarities, and appeared more steady. However, both phenomena seem also similar in some respects: In both cases, equiluminant stimuli led to lustrous impressions that were considerably less strong than those evoked by stimuli containing luminance variation, and the strength of the perceived luster was generally boosted with reversed contrast polarities.

Latent binocular function in amblyopia

Recently, psychophysical studies have shown that humans with amblyopia do have binocular function that is not normally revealed due to dominant suppressive interactions under normal viewing conditions. Here we use magnetoencephalography (MEG) combined with dichoptic visual stimulation to investigate the underlying binocular function in humans with amblyopia for stimuli that, because of their temporal properties, would be expected to bypass suppressive effects and to reveal any underlying binocular function. We recorded contrast response functions in visual cortical area V1 of amblyopes and normal observers using a steady state visually evoked responses (SSVER) protocol. We used stimuli that were frequency-tagged at 4Hz and 6Hz that allowed identification of the responses from each eye and were of a sufficiently high temporal frequency (>3Hz) to bypass suppression. To characterize binocular function, we compared dichoptic masking between the two eyes in normal and amblyopic participants as well as interocular phase differences in the two groups. We observed that the primary visual cortex responds less to the stimulation of the amblyopic eye compared to the fellow eye. The pattern of interaction in the amblyopic visual system however was not significantly different between the amblyopic and fellow eyes. However, the amblyopic suppressive interactions were lower than those observed in the binocular system of our normal observers. Furthermore, we identified an interocular processing delay of approximately 20ms in our amblyopic group. To conclude, when suppression is greatly reduced, such as the case with our stimulation above 3Hz, the amblyopic visual system exhibits a lack of binocular interactions.

'Proto-rivalry': how the binocular brain identifies gloss

Visually identifying glossy surfaces can be crucial for survival (e.g. ice patches on a road), yet estimating gloss is computationally challenging for both human and machine vision. Here, we demonstrate that human gloss perception exploits some surprisingly simple binocular fusion signals, which are likely available early in the visual cortex. In particular, we show that the unusual disparity gradients and vertical offsets produced by reflections create distinctive ‘proto-rivalrous’ (barely fusible) image regions that are a critical indicator of gloss. We find that manipulating the gradients and vertical components of binocular disparities yields predictable changes in material appearance. Removing or occluding proto-rivalrous signals makes surfaces look matte, while artificially adding such signals to images makes them appear glossy. This suggests that the human visual system has internalized the idiosyncratic binocular fusion characteristics of glossy surfaces, providing a straightforward means of estimating surface attributes using low-level image signals.

Lustrous material appearances: Internal and external constraints on triggering conditions for binocular lustre

Lustrous surface appearances can be elicited by simple image configurations with no texture or specular highlights, as most prominently illustrated by Helmholtz' demonstration of stereoscopic lustre. Three types of explanatory framework have been proposed for stereoscopic lustre, which attribute the phenomenon to a binocular luminance conflict, an internalised physical regularity (Helmholtz), or to a disentangling of "essential" and "accidental" attributes in surface representations (Hering). In order to investigate these frameworks, we used haploscopically fused half-images of centre-surround configurations in which the luminances of the test patch were dynamically modulated. Experiment 1 shows that stereoscopic lustre is not specifically tied to situations of a luminance conflict between the eyes. Experiment 2 identifies a novel aspect in the binocular temporal dynamics that provides a physical basis for lustrous appearances, namely the occurrence of a temporal luminance counter-modulation between the eyes. This feature sheds some light on the internal principles underlying a disentangling of "accidental" and "essential" surface attributes. Experiment 3 reveals an asymmetry between a light and a dark reference level for the counter-modulations. This finding again suggests an interpretation in terms of an internalised physical regularity with respect to the dynamics of perceiving illuminated surfaces.

Binocular and monocular depth cues in online feedback control of 3D pointing movement

Previous work has shown that humans continuously use visual feedback of the hand to control goal-directed movements online. In most studies, visual error signals were predominantly in the image plane and, thus, were available in an observer's retinal image. We investigate how humans use visual feedback about finger depth provided by binocular and monocular depth cues to control pointing movements. When binocularly viewing a scene in which the hand movement was made in free space, subjects were about 60 ms slower in responding to perturbations in depth than in the image plane. When monocularly viewing a scene designed to maximize the available monocular cues to finger depth (motion, changing size, and cast shadows), subjects showed no response to perturbations in depth. Thus, binocular cues from the finger are critical to effective online control of hand movements in depth. An optimal feedback controller that takes into account the low peripheral stereoacuity and inherent ambiguity in cast shadows can explain the difference in response time in the binocular conditions and lack of response in monocular conditions.

Alternation frequency thresholds for stereopsis as a technique for exploring stereoscopic difficulties

When stereoscopic images are presented alternately to the two eyes, stereopsis occurs at F ≥ 1 Hz full-cycle frequencies for very simple stimuli, and F ≥ 3 Hz full-cycle frequencies for random-dot stereograms (eg Ludwig I, Pieper W, Lachnit H, 2007 “Temporal integration of monocular images separated in time: stereopsis, stereoacuity, and binocular luster” Perception & Psychophysics69 92–102). Using twenty different stereograms presented through liquid crystal shutters, we studied the transition to stereopsis with fifteen subjects. The onset of stereopsis was observed during a stepwise increase of the alternation frequency, and its disappearance was observed during a stepwise decrease in frequency. The lowest F values (around 2.5 Hz) were observed with stimuli involving two to four simple disjoint elements (circles, arcs, rectangles). Higher F values were needed for stimuli containing slanted elements or curved surfaces (about 1 Hz increment), overlapping elements at two different depths (about 2.5 Hz increment), or camouflaged overlapping surfaces (> 7 Hz increment). A textured cylindrical surface with a horizontal axis appeared easier to interpret (5.7 Hz) than a pair of slanted segments separated in depth but forming a cross in projection (8 Hz). Training effects were minimal, and F usually increased as disparities were reduced. The hierarchy of difficulties revealed in the study may shed light on various problems that the brain needs to solve during stereoscopic interpretation. During the construction of the three-dimensional percept, the loss of information due to natural decay of the stimuli traces must be compensated by refreshes of visual input. In the discussion an attempt is made to link our results with recent advances in the comprehension of visual scene memory.

The psychophysics of detecting binocular discrepancies of luminance

In the natural world, a binocular discrepancy of luminance can signal a glossy surface. Using a spatial forced choice task, we have measured the ability of subjects to detect binocular luminance disparities. We show that the detection of binocular luminance disparity shares several basic psychophysical features with the detection of surface properties such as lightness and chromaticity: an approximation to Weber's Law, spatial summation, temporal summation, and a deterioration with increasing eccentricity. We also discuss whether color-deficient subjects could derive reliable information about chromaticity from the binocular disparities of luminance induced by a monocularly worn color filter.

Temporal integration limits of stereovision in reaching and grasping

Even though there have been extensive investigations of the temporal integration limits of binocular vision in perceptual tasks, relatively little is known about temporal integration limits during the completion of visuomotor tasks. To assess the temporal integration limits of binocular disparity within the action domain, accuracy of reach kinematics in a reaching and grasping task under continuous binocular and monocular viewing conditions were compared with those obtained under alternating monocular viewing conditions with interocular delays ranging from 14 to 58 ms. Even the shortest of the interocular delays resulted in larger grip apertures than those in the continuous monocular and binocular viewing conditions. The short temporal integration interval of stereovision obtained in this study cannot be accounted for by differential visual feedback in the binocular and interocular delay conditions, nor is it likely to be a consequence of visual disruption due to the interocular delays. Our findings suggest that the visuomotor system has little tolerance to interocular delay.