Perceiving distance in virtual reality: theoretical insights from contemporary technologies

Validating virtual reality for time perception research: Virtual reality changes expectations about the duration of physical processes, but not the sense of time

Immersive virtual reality (VR) provides a versatile method for investigating human time perception, because it allows the manipulation and control of relevant variables (e.g., the speed of environmental changes) that cannot be modified in the real world. However, an important premise for interpreting the results of VR studies, namely that the method itself does not affect time perception, has received little attention. Here we tested this assumption by comparing timing performance in a real environment and a VR scenario. Participants performed two timing tasks, requiring the production of intervals defined either by numerical values ("eight seconds") or by a physical process ("the time it takes for a bottle to run out when turned over"). We found that the experience of immersive VR exclusively altered judgments about the duration of physical processes, whereas judgments about the duration of abstract time units were unaffected. These results demonstrate that effects of VR on timing performance are not driven by changes in time perception itself, but rather by altered expectations regarding the duration of physical processes. The present study validates the use of VR in time perception research and strengthens the interpretation of changed timing behaviour induced by manipulations within VR.

Changes in Navigation Controls and Field-of-View Modes Affect Cybersickness Severity and Spatiotemporal Gait Patterns After Exposure to Virtual Environments

OBJECTIVE

To examine the effects of navigation controls and field-of-view modes on cybersickness severity and gait dynamics after cessation of exposure to a virtual environment (VE).

BACKGROUND

The applications of virtual reality are increasing in various fields; however, whether changes in interaction techniques and visual contents could mitigate the potential gait disturbance following VE exposure remains unclear.

METHOD

Thirty healthy adults wore a head-mounted display to complete six sessions of 12-min run-and-gun tasks using different navigation controls (gamepad, head, natural) and field-of-view modes (full, restricted). Forward and backward walking tasks were performed before and after VE exposure. The degrees of cybersickness and presence were evaluated using questionnaires, along with the in-session task performance. Spatiotemporal gait measures and their variabilities were calculated for each walking task.

RESULTS

The participants experienced less cybersickness with the head and natural controls than with the gamepad. Natural control, based on matching body movements, was associated with the highest degree of presence and best performance. VE navigation using the gamepad showed reduced cadences and increased stride times during postexposure forward-walking tasks. When the VE was presented via the restricted field-of-view mode, increased gait variabilities were observed from backward-walking tasks after VE exposure.

CONCLUSION

Body movement-based navigation controls may alleviate cybersickness. We observed gait adaptation during both ambulation tasks, which was influenced by the navigation control method and field-of-view mode.

APPLICATION

This study provides the first evidence for gait adaptation during balance-demanding tasks after VE exposure, which is valuable for designing guidelines for virtual reality interactions.

Painful distortions: people with painful knee osteoarthritis have biased visuospatial perception of the environment

ABSTRACT

Visuospatial perception is thought to be adaptive-ie, hills are perceived as steeper when capacity is low, or threat is high-guiding appropriate interaction with the environment. Pain (bodily threat) may similarly modulate visuospatial perception, with the extent of modulation influenced by threat magnitude (pain intensity, fear) and associated with behaviour (physical activity). We compared visuospatial perception of the environment between 50 people with painful knee osteoarthritis and 50 age-/sex-matched pain-free control participants using 3 virtual reality tasks (uphill steepness estimation, downhill steepness estimation, and a distance-on-hill measure), exploring associations between visuospatial perception, clinical characteristics (pain intensity, state and trait fear), and behaviour (wrist-worn accelerometry) within a larger knee osteoarthritis group (n = 85). People with knee osteoarthritis overestimated uphill (F1,485 = 19.4, P < 0.001) and downhill (F1,480 = 32.3, P < 0.001) steepness more so than pain-free controls, but the groups did not differ for distance-on-hill measures (U = 1273, P = 0.61). There was also a significant group x steepness interaction for the downhill steepness task (F4,480 = 3.11, P = 0.02). Heightened overestimation in people with knee osteoarthritis relative to pain-free controls increased as downhill slopes became steeper. Results were unchanged in a replication analysis using all knee osteoarthritis participants (n = 85), except the downhill steepness interaction was no longer significant. In people with knee osteoarthritis, higher state fear was associated with greater over-estimation of downhill slope steepness (rho = 0.69, P < 0.001), and greater visuospatial overestimation (distance-on-hill) was associated with lower physical activity levels (rho = -0.22, P = 0.045). These findings suggest that chronic pain may shift perception of the environment in line with protection, with overestimation heightened when threat is greater (steeper hills, more fearful), although impact on real-world behaviour is uncertain.

Linear perspective cues have a greater effect on the perceptual rescaling of distant stimuli than textures in the virtual environment

The presence of pictorial depth cues in virtual environments is important for minimising distortions driven by unnatural viewing conditions (e.g., vergence-accommodation conflict). Our aim was to determine how different pictorial depth cues affect size constancy in virtual environments under binocular and monocular viewing conditions. We systematically removed linear perspective cues and textures of a hallway in a virtual environment. The experiment was performed using the method of constant stimuli. The task required participants to compare the size of 'far' (10 m) and 'near' (5 m) circles displayed inside a virtual environment with one or both or none of the pictorial depth cues. Participants performed the experiment under binocular and monocular viewing conditions while wearing a virtual reality headset. ANOVA revealed that size constancy was greater for both the far and the near circles in the virtual environment with pictorial depth cues compared to the one without cues. However, the effect of linear perspective cues was stronger than textures, especially for the far circle. We found no difference between the binocular and monocular viewing conditions across the different virtual environments. We conclude that linear perspective cues exert a stronger effect than textures on the perceptual rescaling of far stimuli placed in the virtual environment, and that this effect does not vary between binocular and monocular viewing conditions.

Investigating and acquiring motor expertise using virtual reality

After just months of simulated training, on January 19, 2019 a 23-year-old E-sports pro-gamer, Enzo Bonito, took to the racetrack and beat Lucas di Grassi, a Formula E and ex-Formula 1 driver with decades of real-world racing experience. This event raised the possibility that practicing in virtual reality can be surprisingly effective for acquiring motor expertise in real-world tasks. Here, we evaluate the potential of virtual reality to serve as a space for training to expert levels in highly complex real-world tasks in time windows much shorter than those required in the real world and at much lower financial cost without the hazards of the real world. We also discuss how VR can also serve as an experimental platform for exploring the science of expertise more generally.

New Approaches to 3D Vision

New approaches to 3D vision are enabling new advances in artificial intelligence and autonomous vehicles, a better understanding of how animals navigate the 3D world, and new insights into human perception in virtual and augmented reality. Whilst traditional approaches to 3D vision in computer vision (SLAM: simultaneous localization and mapping), animal navigation (cognitive maps), and human vision (optimal cue integration) start from the assumption that the aim of 3D vision is to provide an accurate 3D model of the world, the new approaches to 3D vision explored in this issue challenge this assumption. Instead, they investigate the possibility that computer vision, animal navigation, and human vision can rely on partial or distorted models or no model at all. This issue also highlights the implications for artificial intelligence, autonomous vehicles, human perception in virtual and augmented reality, and the treatment of visual disorders, all of which are explored by individual articles. This article is part of a discussion meeting issue 'New approaches to 3D vision'.