The Role of Vertical Disparity in Distance and Depth Perception as Revealed by Different Stereo-Camera Configurations

Minimal theory of 3D vision: new approach to visual scale and visual shape

Since Kepler and Descartes in the early-1600s, vision science has been committed to a triangulation model of stereo vision. But in the early-1800s, we realized that disparities are responsible for stereo vision. And we have spent the past 200 years trying to shoe-horn disparities back into the triangulation account. The first part of this article argues that this is a mistake, and that stereo vision is a solution to a different problem: the eradication of rivalry between the two retinal images, rather than the triangulation of objects in space. This leads to a 'minimal theory of 3D vision', where 3D vision is no longer tied to estimating the scale, shape, and direction of objects in the world. The second part of this article then asks whether the other aspects of 3D vision, which go beyond stereo vision, really operate at the same level of visual experience as stereo vision? I argue they do not. Whilst we want a theory of real-world 3D vision, the literature risks giving us a theory of picture perception instead. And I argue for a two-stage theory, where our purely internal 'minimal' 3D percept (from stereo vision) is linked to the world through cognition. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Does Vergence Affect Perceived Size?

Since Kepler (1604) and Descartes (1637), it has been suggested that 'vergence' (the angular rotation of the eyes) plays a key role in size constancy. However, this has never been tested divorced from confounding cues such as changes in the retinal image. In our experiment, participants viewed a target which grew or shrank in size over 5 s. At the same time, the fixation distance specified by vergence was reduced from 50 to 25 cm. The question was whether this change in vergence affected the participants' judgements of whether the target grew or shrank in size? We found no evidence of any effect, and therefore no evidence that eye movements affect perceived size. If this is correct, then our finding has three implications. First, perceived size is much more reliant on cognitive influences than previously thought. This is consistent with the argument that visual scale is purely cognitive in nature (Linton, 2017; 2018). Second, it leads us to question whether the vergence modulation of V1 contributes to size constancy. Third, given the interaction between vergence, proprioception, and the retinal image in the Taylor illusion, it leads us to ask whether this cognitive approach could also be applied to multisensory integration.

Optokinetic stimulation induces vertical vergence, possibly through a non-visual pathway

Vertical vergence is generally associated with one of three mechanisms: vestibular activation during a head tilt, induced by vertical visual disparity, or as a by-product of ocular torsion. However, vertical vergence can also be induced by seemingly unrelated visual conditions, such as optokinetic rotations. This study aims to investigate the effect of vision on this latter form of vertical vergence. Eight subjects (4m/4f) viewed a visual scene in head erect position in two different viewing conditions (monocular and binocular). The scene, containing white lines angled at 45° against a black background, was projected at an eye-screen distance of 2 m, and rotated 28° at an acceleration of 56°/s2. Eye movements were recorded using a Chronos Eye-Tracker, and eye occlusions were carried out by placing an infrared-translucent cover in front of the left eye during monocular viewing. Results revealed vergence amplitudes during binocular viewing to be significantly lower than those seen for monocular conditions (p = 0.003), while torsion remained unaffected. This indicates that vertical vergence to optokinetic stimulation, though visually induced, is visually suppressed during binocular viewing. Considering that vertical vergence is generally viewed as a vestibular signal, the findings may reflect a visually induced activation of a vestibular pathway.

(Disparity-Driven) Accommodation Response Contributes to Perceived Depth

When looking at objects at various distances in the physical space, the accommodation and vergence systems adjust their parameters to provide a single and clear vision of the world. Subtended muscle activity provides oculomotor cues that can contribute to the perception of depth and distance. While several studies have outlined the role of vergence in distance perception, little is known about the contribution of its concommitant accommodation component. It is possible to unravel the role of each of these physiological systems by placing observers in a situation where there is a conflict between accommodation and vergence distances. We thus sought to determine the contribution of each response system to perceived depth by simultaneously measuring vergence and accommodation while participants judged the depth of 3D stimuli. The distance conflict decreased depth constancy for stimulus displayed with negative disparity steps (divergence). Although vergence was unaffected by the stimulus distance, accommodation responses were significantly reduced when the stimulus was displayed with negative disparities. Our results show that biases in perceived depth follow undershoots in the disparity-driven accommodation response. These findings suggest that accommodation responses (i.e., from oculomotor information) can contribute to perceived depth.

Perspective Preserving Solution for Quasi-Orthoscopic Video See-Through HMDs

In non-orthoscopic video see-through (VST) head-mounted displays (HMDs), depth perception through stereopsis is adversely affected by sources of spatial perception errors. Solutions for parallax-free and orthoscopic VST HMDs were considered to ensure proper space perception but at expenses of an increased bulkiness and weight. In this work, we present a hybrid video-optical see-through HMD the geometry of which explicitly violates the rigorous conditions of orthostereoscopy. For properly recovering natural stereo fusion of the scene within the personal space in a region around a predefined distance from the observer, we partially resolve the eye-camera parallax by warping the camera images through a perspective preserving homography that accounts for the geometry of the VST HMD and refers to such distance. For validating our solution; we conducted objective and subjective tests. The goal of the tests was to assess the efficacy of our solution in recovering natural depth perception in the space around said reference distance. The results obtained showed that the quasi-orthoscopic setting of the HMD; together with the perspective preserving image warping; allow the recovering of a correct perception of the relative depths. The perceived distortion of space around the reference plane proved to be not as severe as predicted by the mathematical models.