Dynamic affordances in embodied interactive systems: the role of display and mode of locomotion

LoCoMoTe - A Framework for Classification of Natural Locomotion in VR by Task, Technique and Modality

Virtual reality (VR) research has provided overviews of locomotion techniques, how they work, their strengths and overall user experience. Considerable research has investigated new methodologies, particularly machine learning to develop redirection algorithms. To best support the development of redirection algorithms through machine learning, we must understand how best to replicate human navigation and behaviour in VR, which can be supported by the accumulation of results produced through live-user experiments. However, it can be difficult to identify, select and compare relevant research without a pre-existing framework in an ever-growing research field. Therefore, this work aimed to facilitate the ongoing structuring and comparison of the VR-based natural walking literature by providing a standardised framework for researchers to utilise. We applied thematic analysis to study methodology descriptions from 140 VR-based papers that contained live-user experiments. From this analysis, we developed the LoCoMoTe framework with three themes: navigational decisions, technique implementation, and modalities. The LoCoMoTe framework provides a standardised approach to structuring and comparing experimental conditions. The framework should be continually updated to categorise and systematise knowledge and aid in identifying research gaps and discussions.

How Virtual Hand Representations Affect the Perceptions of Dynamic Affordances in Virtual Reality

User representations are critical to the virtual experience, and involve both the input device used to support interactions as well as how the user is virtually represented in the scene. Inspired by previous work that has shown effects of user representations on the perceptions of relatively static affordances, we attempt to investigate how end-effector representations affect the perceptions of affordances that dynamically change over time. Towards this end, we empirically evaluated how different virtual hand representations affect users' perceptions of dynamic affordances in an object retrieval task wherein users were tasked with retrieving a target from a box for a number of trials while avoiding collisions with its moving doors. We employed a 3 (virtual end-effector representation) X 13 (frequency of moving doors) X 2 (target object size) multi-factorial design, manipulating the input modality and its concomitant virtual end-effector representation as a between-subjects factor across three experimental conditions: (1) Controller (using a controller represented as a virtual controller); (2) Controller-hand (using a controller represented as a virtual hand); (3) Glove (using a hand tracked hi-fidelity glove represented as a virtual hand). Results indicated that the controller-hand condition produced lower levels of performance than both the other conditions. Furthermore, users in this condition exhibited a diminished ability to calibrate their performance over trials. Overall, we find that representing the end-effector as a hand tends to increase embodiment but can also come at the cost of performance, or an increased workload due to a discordant mapping between the virtual representation and the input modality used. It follows that VR system designers should carefully consider the priorities and target requirements of the application being developed when choosing the type of end-effector representation for users to embody in immersive virtual experiences.

Pedestrian Crossing Decisions in Virtual Environments: Behavioral Validity in CAVEs and Head-Mounted Displays

OBJECTIVE

To contribute to the validation of virtual reality (VR) as a tool for analyzing pedestrian behavior, we compared two types of high-fidelity pedestrian simulators to a test track.

BACKGROUND

While VR has become a popular tool in pedestrian research, it is uncertain to what extent simulator studies evoke the same behavior as nonvirtual environments.

METHOD

An identical experimental procedure was replicated in a CAVE automatic virtual environment (CAVE), a head-mounted display (HMD), and on a test track. In each group, 30 participants were instructed to step forward whenever they felt the gap between two approaching vehicles was adequate for crossing.

RESULTS

Our analyses revealed distinct effects for the three environments. Overall acceptance was highest on the test track. In both simulators, crossings were initiated later, but a relationship between gap size and crossing initiation was apparent only in the CAVE. In contrast to the test track, vehicle speed significantly affected acceptance rates and safety margins in both simulators.

CONCLUSION

For a common decision task, the results obtained in virtual environments deviate from those in a nonvirtual test bed. The consistency of differences indicates that restrictions apply when predicting real-world behavior based on VR studies. In particular, the higher susceptibility to speed effects warrants further investigation, since it implies that differences in perceptual processing alter experimental outcomes.

APPLICATION

Our observations should inform the conclusions drawn from future research in pedestrian simulators, for example by accounting for a higher sensitivity to speed variations and a greater uncertainty associated with crossing decisions.

A Review of the Potential of Virtual Walking Techniques for Gait Rehabilitation

Virtual reality (VR) technology has emerged as a promising tool for studying and rehabilitating gait disturbances in different cohorts of patients (such as Parkinson's disease, post-stroke, or other neurological disorders) as it allows patients to be engaged in an immersive and artificial environment, which can be designed to address the particular needs of each individual. This review demonstrates the state of the art in applications of virtual walking techniques and related technologies for gait therapy and rehabilitation of people with movement disorders makes recommendations for future research and discusses the use of VR in the clinic. However, the potential for using these techniques in gait rehabilitation is to provide a more personalized approach by simulate the experience of natural walking, while patients with neurological disorders are maintained localized in the real world. The goal of our work is to investigate how the human nervous system controls movement in health and neurodegenerative disease.

Comparison of Controller-Based Locomotion Techniques for Visual Observation in Virtual Reality

Many virtual reality (VR) applications use teleport for locomotion. The non-continuous locomotion of teleport is suited for VR controllers and can minimize simulator sickness, but it can also reduce spatial awareness compared to continuous locomotion. Our aim was to create continuous, controller-based locomotion techniques that would support spatial awareness. We compared the new techniques, slider and grab, with teleport in a task where participants counted small visual targets in a VR environment. Task performance was assessed by asking participants to report how many visual targets they found. The results showed that slider and grab were significantly faster to use than teleport, and they did not cause significantly more simulator sickness than teleport. Moreover, the continuous techniques provided better spatial awareness than teleport.

How Do Children Perceive and Act on Dynamic Affordances in Crossing Traffic-Filled Roads?

Successfully perceiving and acting on dynamic affordances is critical for children and adults to function. In our work, we look at how children cross roads as a model for understanding how they learn to perceive and act on dynamic affordances. Ten- to 14-year-old children and adults ride an interactive bicycling simulator through an immersive virtual environment where they cross intersections with continuous cross traffic. We consistently find developmental and individual differences in children's ability to tightly time their entry into the roadway relative to the lead car in the gap. Given that children do not adjust their gap choices to match their less precise timing abilities, children take more risks when crossing roads than adults. We conclude by discussing possible reasons for these developmental differences in movement timing.