The absolute disparity anomaly and the mechanism of relative disparities

Depth constancy and the absolute vergence anomaly

Binocular disparity provides information about the depth structure of objects and surfaces in our environment. Since disparity depends on the distance to objects as well as the depth separation of points, information about distance is required to estimate depth from disparity. Our perception of size and shape is biased, such that far objects appear too small and flattened in depth, and near objects too big and stretched in depth. The current study assessed the extent to which the failure of depth constancy can be accounted for by the uncertainty of distance information provided by vergence. We measured individual differences in vergence noise using a nonius line task, and the degree of depth constancy using a task in which observers judged the magnitude of a depth interval relative to the vertical distance between two targets in the image plane. We found no correlation between the two measures, and show that depth constancy was much poorer than would be expected from vergence noise measured in this way. This limited ability to take account of vergence in the perception of depth is, however, consistent with our poor sensitivity to absolute disparity differences. This absolute disparity anomaly thus also applies to our poor ability to make use of vergence information for absolute distance judgements.

Factors Affecting Stimulus Duration Threshold for Depth Discrimination of Asynchronous Targets in the Intermediate Distance Range

Purpose

Binocular depth discrimination in the near distance range (< 2 m) improves with stimulus duration. However, whether the same response-pattern holds in the intermediate distance range (approximately 2-25 m) remains unknown because the spatial coding mechanisms are thought to be different.

Methods

We used the two-interval forced choice procedure to measure absolute depth discrimination of paired asynchronous targets (3, 6, or 16 arc min). The paired targets (0.2 degrees) were located over a distance and height range, respectively, of 4.5 to 7.0 m and 0.15 to 0.7 m. Experiment 1 estimated duration thresholds for binocular depth discrimination at varying target durations (40-1610 ms), in the presence of a 2 × 6 array of parallel texture-elements spanning 1.5 × 5.83 m on the floor. The texture-elements provided a visible background in the light-tight room (9 × 3 m). Experiment 2 used a similar setup to control for viewing conditions: binocular versus monocular and with versus without texture background. Experiment 3 compared binocular depth discrimination between brief (40, 80, and 125 ms) and continuous texture background presentation.

Results

Stimulus duration threshold for depth discrimination decreased with increasing disparity in experiment 1. Experiment 2 revealed depth discrimination performance with texture background was near chance level with monocular viewing. Performance with binocular viewing degraded without texture background. Experiment 3 showed continuous texture background presentation enhances binocular depth discrimination.

Conclusions

Absolute depth discrimination improves with target duration, binocular viewing, and texture background. Performance further improved with longer background duration underscoring the role of ground surface representation in spatial coding.

Absolute and relative disparity mechanisms revealed by an equivalent noise analysis

The precision of stereopsis and vergence are ultimately limited by internal binocular disparity noise. Here we propose an equivalent noise model with both global and local internal disparity noises to provide a unified explanation of both absolute and relative disparity thresholds. To test this model, we developed a psychophysical procedure to measure the equivalent internal disparity noise by adding external disparity noise to random-Gabor-patch stereograms. We used the method of constant stimuli to measure the minimum and maximum disparity thresholds (Dmin and Dmax) for both absolute and relative disparity. Consistent with previous studies, we found that Dmin thresholds are substantially worse for absolute disparity than for relative disparity. We tested three relative disparity mechanisms: (1) the difference between the monocular separations of targets projecting to the two eyes; (2) the direct measurement of relative disparity; and (3) the difference of absolute disparities of targets. Computing the difference of absolute disparities when detecting relative disparity, Mechanism 3 cancels global noise, resulting in a much lower relative Dmin threshold, and provides a reasonable fit to the experimental data. We also found that the presence of as much as 2400 arcsec of external disparity noise does not appear to affect the Dmax threshold. This observation suggests that Dmax is implicated in a mechanism that disregards the disparity variance of individual items, relying instead on the average disparity across all items, supporting the depth model proposed in our previous study (Ding & Levi, 2021), which posits distinct mechanisms governing Dmin and Dmax thresholds.

What's special about horizontal disparity

Horizontal disparity has been recognized as the primary signal driving stereoscopic depth since the invention of the stereoscope in the 1830s. It has a unique status in our understanding of binocular vision. The direction of offset of the eyes gives the disparities of corresponding image point locations across the two retinas a strong horizontal bias. Beyond the retina, other factors give shape to the effective disparity direction used by visual mechanisms. The influence of orientation is examined here. I argue that horizontal disparity is an inflection point along a continuum of effective directions, and its role in stereo vision can be reinterpreted. The pointwise geometric justification for its special status neglects the oriented structural elements of spatial vision, its physiological support is equivocal, and psychophysical support of its special status may partially reflect biased stimulus sampling. The literature shows that horizontal disparity plays no particular role in the processing of one-dimensional stimuli, a reflection of the stereo aperture problem. The resulting depth is non-veridical, even non-transitive. Although one-dimensional components contribute to the stereo depth of visual objects generally, two-dimensional stimuli appear not to inherit the aperture problem. However, a look at the two-dimensional stimuli that predominate in experimental studies shows regularities in orientation that give a new perspective on horizontal disparity.

Cognitive penetrability of scene representations based on horizontal image disparities

The structure of natural scenes is signaled by many visual cues. Principal amongst them are the binocular disparities created by the laterally separated viewpoints of the two eyes. Disparity cues are believed to be processed hierarchically, first in terms of local measurements of absolute disparity and second in terms of more global measurements of relative disparity that allow extraction of the depth structure of a scene. Psychophysical and oculomotor studies have suggested that relative disparities are particularly relevant to perception, whilst absolute disparities are not. Here, we compare neural responses to stimuli that isolate the absolute disparity cue with stimuli that contain additional relative disparity cues, using the high temporal resolution of EEG to determine the temporal order of absolute and relative disparity processing. By varying the observers' task, we assess the extent to which each cue is cognitively penetrable. We find that absolute disparity is extracted before relative disparity, and that task effects arise only at or after the extraction of relative disparity. Our results indicate a hierarchy of disparity processing stages leading to the formation of a proto-object representation upon which higher cognitive processes can act.

Transfer of Perceptual Learning From Local Stereopsis to Global Stereopsis in Adults With Amblyopia: A Preliminary Study

It has long been debated whether the analysis of global and local stereoscopic depth is performed by a single system or by separate systems. Global stereopsis requires the visual system to solve a complex binocular matching problem to obtain a coherent percept of depth. In contrast, local stereopsis requires only a simple matching of similar image features. In this preliminary study, we recruited five adults with amblyopia who lacked global stereopsis and trained them on a computerized local stereopsis depth task for an average of 12 h. Three out of five (60%) participants recovered fine global stereoscopic vision through training. Those who recovered global stereopsis reached a learning plateau more quickly on the local stereopsis task, and they tended to start the training with better initial local stereopsis performance, to improve more on local stereopsis with training, and to have less severe amblyopia. The transfer of learning from local stereopsis to global stereopsis is compatible with an interacting two-stage model.

Recent understanding of binocular vision in the natural environment with clinical implications

Technological advances in recent decades have allowed us to measure both the information available to the visual system in the natural environment and the rich array of behaviors that the visual system supports. This review highlights the tasks undertaken by the binocular visual system in particular and how, for much of human activity, these tasks differ from those considered when an observer fixates a static target on the midline. The everyday motor and perceptual challenges involved in generating a stable, useful binocular percept of the environment are discussed, together with how these challenges are but minimally addressed by much of current clinical interpretation of binocular function. The implications for new technology, such as virtual reality, are also highlighted in terms of clinical and basic research application.

Binocular non-stereoscopic cues can deceive clinical tests of stereopsis

Stereoscopic vision plays a critical role in visual perception; however, it is difficult to assess. In clinical settings, stereoacuity is assessed with clinical stereotests. Observers can use monocular cues to deceive some of the most common stereotests, such as the Titmus test. The Randot test has been found free of monocular cues, and here we confirm that result by testing observers under monocular viewing. However, there is a common misconception that only monocular cues can be used to deceive stereotests. Here we demonstrate that binocular non-stereoscopic cues can also be used to pass the Randot, by testing participants with the test rotated, a condition that abolishes stereopsis, and comparing the performance to a monocular viewing condition. We also assessed the Random Dot Butterfly test and discovered considerable amounts of non-stereoscopic cues, including binocular cues in the Circles that can be used to deceive the test. Participants with amblyopia had more difficulty using non-stereoscopic cues than neurotypical observers. We gathered normal-viewing Randot stereoacuities for 110 participants (90 neurotypical and 20 with amblyopia) and compared them to psychophysical stereoacuities (our gold standard). The Randot test showed low positive normalized predictive values for detecting stereoblindness. It could perfectly detect stereo-impairment but with a low sensitivity.

The prevalence and diagnosis of 'stereoblindness' in adults less than 60 years of age: a best evidence synthesis

PURPOSE

Stereoscopic vision (or stereopsis) is the ability to perceive depth from binocular disparity - the difference of viewpoints between the two eyes. Interestingly, there are large individual differences as to how well one can appreciate depth from such a cue. The total absence of stereoscopic vision, called 'stereoblindness', has been associated with negative behavioural outcomes such as poor distance estimation. Surprisingly, the prevalence of stereoblindness remains unclear, as it appears highly dependent on the way in which stereopsis is measured.

RECENT FINDINGS

This review highlights the fact that stereopsis is not a unitary construct, but rather implies different systems. The optimal conditions for measuring these varieties of stereoscopic information processing are discussed given the goal of detecting stereoblindness, using either psychophysical or clinical stereotests. In that light, we then discuss the estimates of stereoblindness prevalence of past studies.

SUMMARY

We identify four different approaches that all converge toward a prevalence of stereoblindness of 7% (median approach: 7%; unambiguous-stereoblindness-criteria approach: 7%; visual-defect-included approach: 7%; multiple-criteria approach: 7%). We note that these estimates were derived considering adults of age <60 years old. Older adults may have a higher prevalence. Finally, we make recommendations for a new ecological definition of stereoblindness and for efficient clinical methods for determining stereoblindness by adapting existing tools.

Attentional selection in judgments of stereo depth

Stereoscopic depth is most useful when it comes from relative rather than absolute disparities. However, the depth perceived from relative disparities can vary with stimulus parameters that have no connection with depth or are irrelevant to the task. We investigated observers' ability to judge the stereo depth of task-relevant stimuli while ignoring irrelevant stimuli. The calculation of depth from disparity differs for 1-D and 2-D stimuli and we investigated the role this difference plays in observers' ability to selectively process relevant information. We show that the presence of irrelevant disparities affects perceived depth differently depending on stimulus dimensionality. Observers could not ignore disparities of irrelevant stimuli when they judged the relative depth between a 1-D stimulus (a grating) and a 2-D stimulus (a plaid). Yet these irrelevant disparities did not affect judgments of the relative depth between 2-D stimuli. Two processes contributing to stereo depth were identified, only one of which computes depth from a horizontal disparity metric and permits attentional selection. The other uses all stimuli, relevant and irrelevant, to calculate an effective disparity direction for comparing disparity magnitudes. These processes produce inseparable effects in most data sets. Using multiple disparity directions and comparing 1-D and 2-D stimuli can distinguish them.

Enhancing Motion-In-Depth Perception of Random-Dot Stereograms

Random-dot stereograms have been widely used to explore the neural mechanisms underlying binocular vision. Although they are a powerful tool to stimulate motion-in-depth (MID) perception, published results report some difficulties in the capacity to perceive MID generated by random-dot stereograms. The purpose of this study was to investigate whether the performance of MID perception could be improved using an appropriate stimulus design. Sixteen inexperienced observers participated in the experiment. A training session was carried out to improve the accuracy of MID detection before the experiment. Four aspects of stimulus design were investigated: presence of a static reference, background texture, relative disparity, and stimulus contrast. Participants' performance in MID direction discrimination was recorded and compared to evaluate whether varying these factors helped MID perception. Results showed that only the presence of background texture had a significant effect on MID direction perception. This study provides suggestions for the design of 3D stimuli in order to facilitate MID perception.

Early dynamics of stereoscopic surface slant perception

Surface orientation is an important visual primitive that can be estimated from monocular or binocular (stereoscopic) signals. Changes in motor planning occur within about 200 ms after either type of signal is perturbed, but the time it takes for apparent (perceived) slant to develop from stereoscopic cues is not known. Apparent slant sometimes develops very slowly (Gillam, Chambers, & Russo, 1988; van Ee & Erkelens, 1996). However, these long durations could reflect the time it takes for the visual system to resolve conflicts between slant cues that inevitably specify different slants in laboratory displays (Allison & Howard, 2000). We used a speed–accuracy tradeoff analysis to measure the time it takes to discriminate slant, allowing us to report psychometric functions as a function of response time. Observers reported which side of a slanted surface was farther, with a temporal deadline for responding that varied block-to-block. Stereoscopic slant discrimination rose above chance starting at 200 ms after stimulus onset. Unexpectedly, observers discriminated slant from binocular disparity faster than texture, and for stereoscopic whole-field stimuli faster than stereoscopic slant contrast stimuli. However, performance after the initial deviation from chance increased more rapidly for slant-contrast stimuli than whole-field stimuli. Discrimination latencies were similar for slants about the horizontal and vertical axes, but performance increased faster for slants about the vertical axis. Finally, slant from vertical disparity was somewhat slower than slant from horizontal disparity, which may reflect cue conflict. These results demonstrate, in contradiction with the previous literature, that the perception of slant from disparity happens very quickly—in fact, more quickly than the perception of slant from texture—and in comparable time to the simple perception of brightness from luminance.

Thresholds for sine-wave corrugations defined by binocular disparity in random dot stereograms: Factor analysis of individual differences reveals two stereoscopic mechanisms tuned for spatial frequency

Threshold functions for sinusoidal depth corrugations typically reach their minimum (highest sensitivity) at spatial frequencies of 0.2-0.4 cycles/degree (cpd), with lower thresholds for horizontal than vertical corrugations at low spatial frequencies. To elucidate spatial frequency and orientation tuning of stereoscopic mechanisms, we measured the disparity sensitivity functions, and used factor analytic techniques to estimate the existence of independent underlying stereo channels. The data set (N = 30 individuals) was for horizontal and vertical corrugations of spatial frequencies ranging from 0.1 to 1.6 cpd. A principal component analysis of disparity sensitivities (log-arcsec) revealed that two significant factors accounted for 70% of the variability. Following Varimax rotation to approximate "simple structure", one factor clearly loaded onto low spatial frequencies (≤0.4 cpd), and a second was tuned to higher spatial frequencies (≥0.8 cpd). Each factor had nearly identical tuning (loadings) for horizontal and vertical patterns. The finding of separate factors for low and high spatial frequencies is consistent with previous studies. The failure to find separate factors for horizontal and vertical corrugations is somewhat surprising because the neuronal mechanisms are believed to be different. Following an oblique rotation (Direct Oblimin), the two factors correlated significantly, suggesting some interdependence rather than full independence between the two factors.

Dressmakers show enhanced stereoscopic vision

The ability to estimate the distance of objects from one’s self and from each other is fundamental to a variety of behaviours from grasping objects to navigating. The main cue to distance, stereopsis, relies on the slight offsets between the images derived from our left and right eyes, also termed disparities. Here we ask whether the precision of stereopsis varies with professional experience with precise manual tasks. We measured stereo-acuities of dressmakers and non-dressmakers for both absolute and relative disparities. We used a stereoscope and a computerized test removing monocular cues. We also measured vergence noise and bias using the Nonius line technique. We demonstrate that dressmakers’ stereoscopic acuities are better than those of non-dressmakers, for both absolute and relative disparities. In contrast, vergence noise and bias were comparable in the two groups. Two non-exclusive mechanisms may be at the source of the group difference we document: (i) self-selection or the fact that stereo-vision is functionally important to become a dressmaker, and (ii) plasticity, or the fact that training on demanding stereovision tasks improves stereo-acuity.

Fast and Forceful: Modulation of Response Activation Induced by Shifts of Perceived Depth in Virtual 3D Space

Reaction time (RT) can strongly be influenced by a number of stimulus properties. For instance, there was converging evidence that perceived size rather than physical (i.e., retinal) size constitutes a major determinant of RT. However, this view has recently been challenged since within a virtual three-dimensional (3D) environment retinal size modulation failed to influence RT. In order to further investigate this issue in the present experiments response force (RF) was recorded as a supplemental measure of response activation in simple reaction tasks. In two separate experiments participants' task was to react as fast as possible to the occurrence of a target located close to the observer or farther away while the offset between target locations was increased from Experiment 1 to Experiment 2. At the same time perceived target size (by varying the retinal size across depth planes) and target type (sphere vs. soccer ball) were modulated. Both experiments revealed faster and more forceful reactions when targets were presented closer to the observers. Perceived size and target type barely affected RT and RF in Experiment 1 but differentially affected both variables in Experiment 2. Thus, the present findings emphasize the usefulness of RF as a supplement to conventional RT measurement. On a behavioral level the results confirm that (at least) within virtual 3D space perceived object size neither strongly influences RT nor RF. Rather the relative position within egocentric (body-centered) space presumably indicates an object's behavioral relevance and consequently constitutes an important modulator of visual processing.