Perspective based on stereopsis and occlusion

Audiovisual Delay as a Novel Cue to Visual Distance

For audiovisual sensory events, sound arrives with a delay relative to light that increases with event distance. It is unknown, however, whether humans can use these ubiquitous sound delays as an information source for distance computation. Here, we tested the hypothesis that audiovisual delays can both bias and improve human perceptual distance discrimination, such that visual stimuli paired with auditory delays are perceived as more distant and are thereby an ordinal distance cue. In two experiments, participants judged the relative distance of two repetitively displayed three-dimensional dot clusters, both presented with sounds of varying delays. In the first experiment, dot clusters presented with a sound delay were judged to be more distant than dot clusters paired with equivalent sound leads. In the second experiment, we confirmed that the presence of a sound delay was sufficient to cause stimuli to appear as more distant. Additionally, we found that ecologically congruent pairing of more distant events with a sound delay resulted in an increase in the precision of distance judgments. A control experiment determined that the sound delay duration influencing these distance judgments was not detectable, thereby eliminating decision-level influence. In sum, we present evidence that audiovisual delays can be an ordinal cue to visual distance.

Rapid Figure – Ground Responses to Stereograms Reveal an Advantage for a Convex Foreground

Convexity has long been recognised as a factor that affects figure – ground segmentation, even when pitted against other factors such as symmetry [Kanizsa and Gerbino, 1976 Art and Artefacts Ed.M Henle (New York: Springer) pp 25–32], It is accepted in the literature that the difference between concave and convex contours is important for the visual system, and that there is a prior expectation favouring convexities as figure. We used bipartite stimuli and a simple task in which observers had to report whether the foreground was on the left or the right. We report objective evidence that supports the idea that convexity affects figure – ground assignment, even though our stimuli were not pictorial in that depth order was specified unambiguously by binocular disparity.

Depth cues, rather than perceived depth, govern vergence

We studied the influence of perceived surface orientation on vergence accompanying a saccade while viewing an ambiguous stimulus. We used the slant rivalry stimulus, in which perspective foreshortening and disparity specified opposite surface orientations. This rivalrous configuration induces alternations of perceived surface orientation, while the slant cues remain constant. Subjects were able to voluntarily control their perceptual state while viewing the ambiguous stimulus. They were asked to make a saccade across the perceived slanted surface. Our data show that vergence responses closely approximated the vergence response predicted by the disparity cue, irrespective of voluntarily controlled perceived orientation. However, comparing the data obtained while viewing the ambiguous stimulus with data from an unambiguous stimulus condition (when disparity and perspective specified similar surface orientations) revealed an effect of perspective cues on vergence. Collectively our results show that depth cues rather than perceived depth govern vergence.

Amodal completion and visual holes (static and moving)

Occlusion is a frequent occurrence in a cluttered world of opaque objects. Often information about the shape of partly occluded objects can be gathered from the visible portion of the object and in particular its contours. Here we address the case where a region of a surface is visible exclusively through an aperture (visual hole). We make several observations about the grouping of surface regions visible through holes, and the appearance of moving objects and holes. These observations support the view that holes are shape properties of the object-with-hole.

Voluntarily controlled bi-stable slant perception of real and photographed surfaces

We have quantified voluntarily selected perceived slant of real trapezoidal surfaces (a 'reverse-perspective' scene) and their photographed counterparts (pictorial space). The surfaces were slanted about the vertical axis and observers estimated slant relative to the frontal plane. We were particularly interested in those cases in which binocular disparity and monocular perspective provided conflicting slant information. We varied the monocularly and binocularly specified surface slants independently across stimulus presentations. To eliminate texture and shading cues we used sand-blasted aluminium trapezoidal surfaces illuminated from all directions. When disparity-specified slant and perspective-specified slant were conflicting, observers were able to perceive the surfaces in two ways: they perceived either a trapezoid or a rectangle. Our main finding is twofold. First, when subjects chose to perceive the trapezoid, the slant estimates followed the disparity-predicted slant with only a slight underestimation, as if they selected a pure binocular representation of slant governed only by disparity. Second, when subjects chose to perceive the rectangle their estimates for real surfaces were similar to those for photographed surfaces, as if they selected a representation of slant governed by perspective foreshortening.

Toward an understanding of the neural processing for 3D shape perception

In this article we address the major issue of space vision, how the brain represents the 3D shape of objects in the real world, on the basis of psychophysics and neurophysiology. In psychophysics, Gibson found texture gradients and width gradients, as well as the gradient of binocular disparity, as the major cues for surface orientation in depth. Marr proposed that a surface-based representation is the main step towards 3D shape representation. In our neurophysiological studies of the monkey parietal cortex, we have found visual-dominant neurons in area AIP with selectivity in 3D shape of the objects, and also surface-orientation-selective (SOS) neurons in the caudal intraparietal (CIP) area. SOS neurons responded selectively to surface orientation in depth presented in random dot stereograms with a disparity gradient. Many of the SOS neurons responded selectively also to texture gradients and linear perspective, and their responses were enhanced by the combination of these cues. We also found axis-orientation-selective (AOS) neurons in area CIP, responding selectively to the orientation of the longitudinal axis of elongated objects in depth. We present preliminary data here to demonstrate that some of AOS neurons that prefer intermediate thickness are shape-selective, and they are likely to discriminate surface curvature. These data suggest that neurons in and around area CIP may have the capacity to represent 3D shape.

Bayesian modeling of cue interaction: bistability in stereoscopic slant perception

Our two eyes receive different views of a visual scene, and the resulting binocular disparities enable us to reconstruct its three-dimensional layout. However, the visual environment is also rich in monocular depth cues. We examined the resulting percept when observers view a scene in which there are large conflicts between the surface slant signaled by binocular disparities and the slant signaled by monocular perspective. For a range of disparity-perspective cue conflicts, many observers experience bistability: They are able to perceive two distinct slants and to flip between the two percepts in a controlled way. We present a Bayesian model that describes the quantitative aspects of perceived slant on the basis of the likelihoods of both perspective and disparity slant information combined with prior assumptions about the shape and orientation of objects in the scene. Our Bayesian approach can be regarded as an overarching framework that allows researchers to study all cue integration aspects-including perceptual decisions--in a unified manner.