1
|
Han S, Blake R, Aubuchon C, Tadin D. Binocular rivalry under naturalistic geometry: Evidence from worlds simulated in virtual reality. PNAS NEXUS 2024; 3:pgae054. [PMID: 38380058 PMCID: PMC10877069 DOI: 10.1093/pnasnexus/pgae054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 01/30/2024] [Indexed: 02/22/2024]
Abstract
Binocular rivalry is a fascinating, widely studied visual phenomenon in which perception alternates between two competing images. This experience, however, is generally restricted to laboratory settings where two irreconcilable images are presented separately to the two eyes, an implausible geometry where two objects occupy the same physical location. Such laboratory experiences are in stark contrast to everyday visual behavior, where rivalry is almost never encountered, casting doubt on whether rivalry is relevant to our understanding of everyday binocular vision. To investigate the external validity of binocular rivalry, we manipulated the geometric plausibility of rival images using a naturalistic, cue-rich, 3D-corridor model created in virtual reality. Rival stimuli were presented in geometrically implausible, semi-plausible, or plausible layouts. Participants tracked rivalry fluctuations in each of these three layouts and for both static and moving rival stimuli. Results revealed significant and canonical binocular rivalry alternations regardless of geometrical plausibility and stimulus type. Rivalry occurred for layouts that mirrored the unnatural geometry used in laboratory studies and for layouts that mimicked real-world occlusion geometry. In a complementary 3D modeling analysis, we show that interocular conflict caused by geometrically plausible occlusion is a common outcome in a visual scene containing multiple objects. Together, our findings demonstrate that binocular rivalry can reliably occur for both geometrically implausible interocular conflicts and conflicts caused by a common form of naturalistic occlusion. Thus, key features of binocular rivalry are not simply laboratory artifacts but generalize to conditions that match the geometry of everyday binocular vision.
Collapse
Affiliation(s)
- Shui'er Han
- Center for Visual Science, University of Rochester, Rochester, NY 14642, USA
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY 14642, USA
- Institute for Infocomm Research Agency for Science, Technology and Research, Singapore 138632, Singapore
- Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore 138632, Singapore
| | - Randolph Blake
- Department of Psychology, Vanderbilt University, Nashville, TN 37240, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN 37232, USA
| | - Celine Aubuchon
- Department of Cognitive Linguistic and Psychological Sciences, Brown University, Providence, RI 02912, USA
| | - Duje Tadin
- Center for Visual Science, University of Rochester, Rochester, NY 14642, USA
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY 14642, USA
- Department of Neuroscience, University of Rochester, Rochester, NY 14642, USA
- Department of Ophthalmology, University of Rochester, Rochester, NY 14642, USA
| |
Collapse
|
2
|
Adams H, Stefanucci J, Creem-Regehr S, Pointon G, Thompson W, Bodenheimer B. Shedding Light on Cast Shadows: An Investigation of Perceived Ground Contact in AR and VR. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:4624-4639. [PMID: 34280102 DOI: 10.1109/tvcg.2021.3097978] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Virtual objects in augmented reality (AR) often appear to float atop real world surfaces, which makes it difficult to determine where they are positioned in space. This is problematic as many applications for AR require accurate spatial perception. In the current study, we examine how the way we render cast shadows-which act as an important monocular depth cue for creating a sense of contact between an object and the surface beneath it-impacts spatial perception. Over two experiments, we evaluate people's sense of surface contact given both traditional and non-traditional shadow shading methods in optical see-through augmented reality (OST AR), video see-through augmented reality (VST AR), and virtual reality (VR) head-mounted displays. Our results provide evidence that nontraditional shading techniques for rendering shadows in AR displays may enhance the accuracy of one's perception of surface contact. This finding implies a possible tradeoff between photorealism and accuracy of depth perception, especially in OST AR displays. However, it also supports the use of more stylized graphics like non-traditional cast shadows to improve perception and interaction in AR applications.
Collapse
|
3
|
Song J, Bennett PJ, Sekuler AB, Sun HJ. The effect of apparent distance on peripheral target detection. J Vis 2021; 21:8. [PMID: 34495294 PMCID: PMC8431976 DOI: 10.1167/jov.21.10.8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Previous research suggests that peripheral target detection is modulated by viewing distance and distance simulated by pictorial cues and optic flow. In the latter case, it is unclear what cues contribute to the effect of distance. The current study evaluated the effect of distance on peripheral detection in a virtual three-dimensional environment. Experiments 1–3 used a continuous, dynamic central task that simulated observers traveling either actively or passively through a virtual environment following a car. Peripheral targets were flashed on checkerboard-covered walls to the left and right of the path of motion, at a near and a far distance from the observer. The retinal characteristics of the targets were identical across distances. Experiment 1 found more accurate and faster detection for near targets compared to far targets, especially for larger eccentricities. Experiment 2 equated the predictability of target onset across distances and found the near advantage for larger eccentricities in accuracy but a much smaller effect in reaction time (RT). Experiment 3 removed the checkerboard background implemented in Experiments 1 and 2, and Experiment 4 manipulated several static, monocular cues. Experiments 3 and 4 found that the variation in the density of the checkerboard backgrounds could explain the main effect of distance on accuracy but could not completely account for the interaction between target distance and eccentricity. These results suggest that attention is modulated by target distance, but the effect is small. Finally, there were consistent divided attention costs in the central car-following task but not the peripheral detection task.
Collapse
Affiliation(s)
- Jiali Song
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada.,
| | - Patrick J Bennett
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada.,
| | - Allison B Sekuler
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada.,Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada.,Department of Psychology, University of Toronto, Toronto, Ontario, Canada.,
| | - Hong-Jin Sun
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada.,
| |
Collapse
|
4
|
Nguyen ATT, Clifford CWG. Gazing into space: Systematic biases in determining another's fixation distance from gaze vergence in upright and inverted faces. J Vis 2020; 19:5. [PMID: 31509601 DOI: 10.1167/19.11.5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The eyes of others play a crucial role in social interactions, providing information such as the focus of another's attention and their current thoughts and emotions. Although much research has focused on understanding how we perceive gaze direction, little has been done on gaze vergence, which can potentially yield information about the distance of another's fixation. Here, we presented participants with synthetic faces in a stereoscopically simulated 3-D environment to determine the absolute fixation distance at which they perceived a face to be gazing. The results showed an underestimation in fixation distance for downward-averted gaze and a limit in discrimination of gaze vergence beyond 35 cm. For inverted faces, fixation distance for gaze vergence in the lower visual field (corresponding to the avatar's upwards gaze) was underestimated, suggesting that our bias to underestimate others' fixation distance may rely on a viewer-centered, egocentric representation of interpersonal space.
Collapse
Affiliation(s)
- Alysha T T Nguyen
- School of Psychology, University of New South Wales Sydney, Sydney, Australia
| | - Colin W G Clifford
- School of Psychology, University of New South Wales Sydney, Sydney, Australia
| |
Collapse
|
5
|
Weller M, Takahashi K, Watanabe K, Bülthoff HH, Meilinger T. The Object Orientation Effect in Exocentric Distances. Front Psychol 2018; 9:1374. [PMID: 30123172 PMCID: PMC6085577 DOI: 10.3389/fpsyg.2018.01374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2017] [Accepted: 07/16/2018] [Indexed: 11/13/2022] Open
Abstract
The object orientation effect describes shorter perceived distances to the front than to the back of oriented objects. The present work extends previous studies in showing that the object orientation effect occurs not only for egocentric distances between an observer and an object, but also for exocentric distances, that are between two oriented objects. Participants watched animated virtual humans (avatars) which were either facing each other or looking away, and afterward adjusted a bar to estimate the perceived length. In two experiments, participants judged avatars facing each other as closer than avatars facing away from each other. As the judged distance was between two objects and did not involve the observer, results rule out an explanation that observers perceive object fronts as closer to prepare for future interaction with them. The second experiment tested an explanation by predictive coding, this is the extrapolation of the current state of affairs to likely future states here that avatars move forward. We used avatars standing on bridges either connecting them or running orthogonal to the inter-avatar line thus preventing forward movement. This variation of walkability did not influence participants’ judgments. We conclude that if predictive coding was used by participants, they did not consider the whole scene layout for prediction, but concentrated on avatars. Another potential explanation of the effect assumes a general asymmetrical distribution of inter-person distances: people facing each other might typically be closer to each other than when facing away and that this asymmetry is reflected as a bias in perception.
Collapse
Affiliation(s)
- Marlene Weller
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | | | - Katsumi Watanabe
- Department of Intermedia Art and Science, Waseda University, Tokyo, Japan
| | | | - Tobias Meilinger
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- *Correspondence: Tobias Meilinger,
| |
Collapse
|
6
|
Abstract
The angular declination of a target with respect to eye level is known to be an important cue to egocentric distance when objects are viewed or can be assumed to be resting on the ground. When targets are fixated, angular declination and the direction of the gaze with respect to eye level have the same objective value. However, any situation that limits the time available to shift gaze could leave to-be-localized objects outside the fovea, and, in these cases, the objective values would differ. Nevertheless, angular declination and gaze declination are often conflated, and the role for retinal eccentricity in egocentric distance judgments is unknown. We report two experiments demonstrating that gaze declination is sufficient to support judgments of distance, even when extraretinal signals are all that are provided by the stimulus and task environment. Additional experiments showed no accuracy costs for extrafoveally viewed targets and no systematic impact of foveal or peripheral biases, although a drop in precision was observed for the most retinally eccentric targets. The results demonstrate the remarkable utility of target direction, relative to eye level, for judging distance (signaled by angular declination and/or gaze declination) and are consonant with the idea that detection of the target is sufficient to capitalize on the angular declination of floor-level targets (regardless of the direction of gaze).
Collapse
|
7
|
Wu J, Zhou L, Shi P, He ZJ, Ooi TL. The visible ground surface as a reference frame for scaling binocular depth of a target in midair. J Exp Psychol Hum Percept Perform 2014; 41:111-26. [PMID: 25384237 DOI: 10.1037/a0038287] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The natural ground surface carries texture information that extends continuously from one's feet to the horizon, providing a rich depth resource for accurately locating an object resting on it. Here, we showed that the ground surface's role as a reference frame also aids in locating a target suspended in midair based on relative binocular disparity. Using real world setup in our experiments, we first found that a suspended target is more accurately localized when the ground surface is visible and the observer views the scene binocularly. In addition, the increased accuracy occurs only when the scene is viewed for 5 s rather than 0.15 s, suggesting that the binocular depth process takes time. Second, we found that manipulation of the configurations of the texture-gradient and/or linear-perspective cues on the visible ground surface affects the perceived distance of the suspended target in midair. Third, we found that a suspended target is more accurately localized against a ground texture surface than a ceiling texture surface. This suggests that our visual system uses the ground surface as the preferred reference frame to scale the distance of a suspended target according to its relative binocular disparity.
Collapse
Affiliation(s)
- Jun Wu
- Department of Psychological and Brain Sciences
| | - Liu Zhou
- Institute of Cognitive Neuroscience, School of Psychology and Cognitive Science, East China Normal University
| | - Pan Shi
- Institute of Cognitive Neuroscience, School of Psychology and Cognitive Science, East China Normal University
| | | | | |
Collapse
|
8
|
Chen CF, Lin CC, Huang KC. Effects of spacing between items and view direction on errors in the perceived height of a rotated 3-D figure. Percept Mot Skills 2014; 119:215-27. [PMID: 25153751 DOI: 10.2466/24.27.pms.119c12z6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This study investigated the errors in the perceived height of virtual cones presented on the screen. 80 students (50 women, 30 men; M age = 18.8 yr., SD = 1.2 using a duodecimal system) participated in the study. They judged the height of virtual cones in several conditions: (a) different spaces between the items in the array (2, 4, and 6 cm); (b) different viewing directions - bottom-up or top-down; (c) cones presented in different forward-rotated angles (15, 30, and 45°). Results indicate that fewer errors in the perceived heights of virtual cones were made when: the space between items was 2 cm, judgment was made in a bottom-up view and at a 15° angle. These results may have implications for graphics-based interface design such as interior design, driver navigation systems, geological models, and flight-simulation systems.
Collapse
Affiliation(s)
- Chen-Fu Chen
- 1 Department of Product Design, Ming Chuan University, Taiwan
| | | | | |
Collapse
|
9
|
Herdtweck C, Wallraven C. Estimation of the horizon in photographed outdoor scenes by human and machine. PLoS One 2013; 8:e81462. [PMID: 24349073 PMCID: PMC3861256 DOI: 10.1371/journal.pone.0081462] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2013] [Accepted: 10/14/2013] [Indexed: 11/18/2022] Open
Abstract
We present three experiments on horizon estimation. In Experiment 1 we verify the human ability to estimate the horizon in static images from only visual input. Estimates are given without time constraints with emphasis on precision. The resulting estimates are used as baseline to evaluate horizon estimates from early visual processes. Stimuli are presented for only 153 ms and then masked to purge visual short-term memory and enforcing estimates to rely on early processes, only. The high agreement between estimates and the lack of a training effect shows that enough information about viewpoint is extracted in the first few hundred milliseconds to make accurate horizon estimation possible. In Experiment 3 we investigate several strategies to estimate the horizon in the computer and compare human with machine "behavior" for different image manipulations and image scene types.
Collapse
Affiliation(s)
- Christian Herdtweck
- Department of Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics,Tübingen, Germany
| | - Christian Wallraven
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| |
Collapse
|
10
|
Zhou L, He ZJ, Ooi TL. The visual system's intrinsic bias and knowledge of size mediate perceived size and location in the dark. J Exp Psychol Learn Mem Cogn 2013; 39:1930-42. [PMID: 23751007 DOI: 10.1037/a0033088] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Dimly lit targets in the dark are perceived as located about an implicit slanted surface that delineates the visual system's intrinsic bias (Ooi, Wu, & He, 2001). If the intrinsic bias reflects the internal model of visual space-as proposed here-its influence should extend beyond target localization. Our first 2 experiments demonstrated that the intrinsic bias also influences perceived target size. We employed a size-matching task and an action task to measure the perceived size of a dimly lit target at various locations in the dark. Then using the size distance invariance hypothesis along with the accurately perceived target angular declination, we converted the perceived sizes to locations. We found that the derived locations from the size judgment tasks can be fitted by slanted curves that resemble the intrinsic bias profile from judged target locations. Our third experiment revealed that armed with the explicit knowledge of target size, an observer perceives target locations in the dark following an intrinsic bias-like profile that is shifted slightly farther from the observer than the profile obtained without knowledge of target size (i.e., slightly more veridical). Altogether, we showed that the intrinsic bias serves as an internal model, or memory, of ground surface layouts when the visual system cannot rely on external depth information. This memory/model can also be weakly influenced by top-down knowledge.
Collapse
Affiliation(s)
- Liu Zhou
- Institute of Cognitive Neuroscience, The School of Psychology and Cognitive Science, East China Normal University
| | | | | |
Collapse
|
11
|
Rand KM, Tarampi MR, Creem-Regehr SH, Thompson WB. The influence of ground contact and visible horizon on perception of distance and size under severely degraded vision. ACTA ACUST UNITED AC 2012; 25:425-47. [PMID: 22370655 DOI: 10.1163/187847611x620946] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
For low vision navigation, misperceiving the locations of hazards can have serious consequences. Potential sources of such misperceptions are hazards that are not visually associated with the ground plane, thus, depriving the viewer of important perspective cues for egocentric distance. In Experiment 1, we assessed absolute distance and size judgments to targets on stands under degraded vision conditions. Normally sighted observers wore blur goggles that severely reduced acuity and contrast, and viewed targets placed on either detectable or undetectable stands. Participants in the detectable stand condition demonstrated accurate distance judgments, whereas participants in the undetectable stand condition overestimated target distances. Similarly, the perceived size of targets in the undetectable stand condition was judged to be significantly larger than in the detectable stand condition, suggesting a perceptual coupling of size and distance in conditions of degraded vision. In Experiment 2, we investigated size and implied distance perception of targets elevated above a visible horizon for individuals in an induced state of degraded vision. When participants' size judgments are inserted into the size-distance invariance hypothesis (SDIH) formula, distance to above-horizon objects increased compared to those below the horizon. Together, our results emphasize the importance of salient visible ground-contact information for accurate distance perception. The absence of this ground-contact information could be the source of perceptual errors leading to potential hazards for low vision individuals with severely degraded acuity and contrast sensitivity.
Collapse
Affiliation(s)
- Kristina M Rand
- University of Utah, 380 S. 1530 E., Room 502, Salt Lake City, UT 84112, USA.
| | | | | | | |
Collapse
|
12
|
Rand KM, Tarampi MR, Creem-Regehr SH, Thompson WB. The importance of a visual horizon for distance judgments under severely degraded vision. Perception 2011; 40:143-54. [PMID: 21650089 DOI: 10.1068/p6843] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
In two experiments we examined the role of visual horizon information on absolute egocentric distance judgments to on-ground targets. Sedgwick [1983, in Human and Machine Vision (New York: Academic Press) pp 425-458] suggested that the visual system may utilize the angle of declination from a horizontal line of sight to the target location (horizon distance relation) to determine absolute distances on infinite ground surfaces. While studies have supported this hypothesis, less is known about the specific cues (vestibular, visual) used to determine horizontal line of sight. We investigated this question by requiring observers to judge distances under degraded vision given an unaltered or raised visual horizon. The results suggest that visual horizon information does influence perception of absolute distances as evident through two different action-based measures: walking or throwing without vision to previously viewed targets. Distances were judged as shorter in the presence of a raised visual horizon. The results are discussed with respect to how the visual system accurately determines absolute distance to objects on a finite ground plane and for their implications for understanding space perception in low-vision individuals.
Collapse
Affiliation(s)
- Kristina M Rand
- Department of Psychology, University of Utah, Salt Lake City, UT 84112, USA.
| | | | | | | |
Collapse
|