How Foot Tracking Matters: The Impact of an Animated Self-Avatar on Interaction, Embodiment and Presence in Shared Virtual Environments

Walk the plank! Using mobile electroencephalography to investigate emotional lateralization of immersive fear in virtual reality

Most studies on emotion processing induce emotions through images or films. However, this method lacks ecological validity, limiting generalization to real-life emotion processing. More realistic paradigms using virtual reality (VR) may be better suited to investigate authentic emotional states and their neuronal correlates. This pre-registered study examines the neuronal underpinnings of naturalistic fear, measured using mobile electroencephalography (EEG). Seventy-five healthy participants walked across a virtual plank which extended from the side of a skyscraper-either 80 storeys up (the negative condition) or at street level (the neutral condition). Subjective ratings showed that the negative condition induced feelings of fear. Following the VR experience, participants passively viewed negative and neutral images from the international affective picture system (IAPS) outside of VR. We compared frontal alpha asymmetry between the plank and IAPS task and across valence of the conditions. Asymmetry indices in the plank task revealed greater right-hemispheric lateralization during the negative VR condition, relative to the neutral VR condition and to IAPS viewing. Within the IAPS task, no significant asymmetries were detected. In summary, our findings indicate that immersive technologies such as VR can advance emotion research by providing more ecologically valid ways to induce emotion.

vexptoolbox: A software toolbox for human behavior studies using the Vizard virtual reality platform

Virtual reality (VR) is a powerful tool for researchers due to its potential to study dynamic human behavior in highly naturalistic environments while retaining full control over the presented stimuli. Due to advancements in consumer hardware, VR devices are now very affordable and have also started to include technologies such as eye tracking, further extending potential research applications. Rendering engines such as Unity, Unreal, or Vizard now enable researchers to easily create complex VR environments. However, implementing the experimental design can still pose a challenge, and these packages do not provide out-of-the-box support for trial-based behavioral experiments. Here, we present a Python toolbox, designed to facilitate common tasks when developing experiments using the Vizard VR platform. It includes functionality for common tasks like creating, randomizing, and presenting trial-based experimental designs or saving results to standardized file formats. Moreover, the toolbox greatly simplifies continuous recording of eye and body movements using any hardware supported in Vizard. We further implement and describe a simple goal-directed reaching task in VR and show sample data recorded from five volunteers. The toolbox, example code, and data are all available on GitHub under an open-source license. We hope that our toolbox can simplify VR experiment development, reduce code duplication, and aid reproducibility and open-science efforts.

Immersive Virtual Reality Avatars for Embodiment Illusions in People With Mild to Borderline Intellectual Disability: User-Centered Development and Feasibility Study

BACKGROUND

Immersive virtual reality (IVR) has been investigated as a tool for treating psychiatric conditions. In particular, the practical nature of IVR, by offering a doing instead of talking approach, could support people who do not benefit from existing treatments. Hence, people with mild to borderline intellectual disability (MBID; IQ=50-85) might profit particularly from IVR therapies, for instance, to circumvent issues in understanding relevant concepts and interrelations. In this context, immersing the user into a virtual body (ie, avatar) appears promising for enhancing learning (eg, by changing perspectives) and usability (eg, natural interactions). However, design requirements, immersion procedures, and proof of concept of such embodiment illusion (ie, substituting the real body with a virtual one) have not been explored in this group.

OBJECTIVE

Our study aimed to establish design guidelines for IVR embodiment illusions in people with MBID. We explored 3 factors to induce the illusion, by testing the avatar's appearance, locomotion using IVR controllers, and virtual object manipulation. Furthermore, we report on the feasibility to induce the embodiment illusion and provide procedural guidance.

METHODS

We conducted a user-centered study with 29 end users in care facilities, to investigate the avatar's appearance, controller-based locomotion (ie, teleport, joystick, or hybrid), and object manipulation. Overall, 3 iterations were conducted using semistructured interviews to explore design factors to induce embodiment illusions in our group. To further understand the influence of interactions on the illusion, we measured the sense of embodiment (SoE) during 5 interaction tasks.

RESULTS

IVR embodiment illusions can be induced in adults with MBID. To induce the illusion, having a high degree of control over the body outweighed avatar customization, despite the participants' desire to replicate their own body image. Similarly, the highest SoE was measured during object manipulation tasks, which required a combination of (virtual) locomotion and object manipulation behavior. Notably, interactions that are implausible (eg, teleport and occlusions when grabbing) showed a negative influence on SoE. In contrast, implementing artificial interaction aids into the IVR avatar's hands (ie, for user interfaces) did not diminish the illusion, presuming that the control was unimpaired. Nonetheless, embodiment illusions showed a tedious and complex need for (control) habituation (eg, motion sickness), possibly hindering uptake in practice.

CONCLUSIONS

Balancing the embodiment immersion by focusing on interaction habituation (eg, controller-based locomotion) and lowering customization effort seems crucial to achieve both high SoE and usability for people with MBID. Hence, future studies should investigate the requirements for natural IVR avatar interactions by using multisensory integrations for the virtual body (eg, animations, physics-based collision, and touch) and other interaction techniques (eg, hand tracking and redirected walking). In addition, procedures and use for learning should be explored for tailored mental health therapies in people with MBID.

Can avatar homophily influence flow and exploratory behaviour of online users?

Virtual learning environments have been recognized as an area of particular importance by which educators can use to improve desirable learning behaviours. Investigating the impact of different virtual environments on learners' behaviours has become the centre of attention of researchers, especially during COVID-19. The homophily effect of avatar-identity on individuals' perceptions of an environment can be a key for understanding their learning behaviours. This study examined the relationship between key constructs related to avatar homophily (background and attitude) and learners' flow and exploratory behaviour. An online survey was distributed to 157 students (93 males and 64 females with age ranging from 19 to 21 years) who took part in an online learning activity using an avatar-mediated environment (Second Life). The results showed that users' flow experience can be influenced by the function of perceived background and attitude homophily in an avatar-mediated environment. Flow experience was found to mediate the relationship between avatar homophily and learners' exploratory behaviour. This study offers a conceptual understanding of the relationship between homophily and individual's flow state.

Augmenting Immersive Telepresence Experience with a Virtual Body

We propose augmenting immersive telepresence by adding a virtual body, representing the user's own arm motions, as realized through a head-mounted display and a 360-degree camera. Previous research has shown the effectiveness of having a virtual body in simulated environments; however, research on whether seeing one's own virtual arms increases presence or preference for the user in an immersive telepresence setup is limited. We conducted a study where a host introduced a research lab while participants wore a head-mounted display which allowed them to be telepresent at the host's physical location via a 360-degree camera, either with or without a virtual body. We first conducted a pilot study of 20 participants, followed by a pre-registered 62 participant confirmatory study. Whereas the pilot study showed greater presence and preference when the virtual body was present, the confirmatory study failed to replicate these results, with only behavioral measures suggesting an increase in presence. After analyzing the qualitative data and modeling interactions, we suspect that the quality and style of the virtual arms, and the contrast between animation and video, led to individual differences in reactions to the virtual body which subsequently moderated feelings of presence.

Perspective Taking and Avatar-Self Merging

Today, avatars often represent users in digital worlds such as in video games or workplace applications. Avatars embody the user and perform their actions in these artificial environments. As a result, users sometimes develop the feeling that their self merges with their avatar. The user realizes that they are the avatar, but the avatar is also the user-meaning that avatar's appearance, character, and actions also affect their self. In the present paper, we first introduce the event-coding approach of the self and then argue based on the reviewed literature on human-avatar interaction that a self-controlled avatar can lead to avatar-self merging: the user sets their own goals in the virtual environment, plans and executes the avatar's actions, and compares the predicted with the actual motion outcomes of the avatar. This makes the user feel body ownership and agency over the avatar's action. Following the event-coding account, avatar-self merging should not be seen as an all-or-nothing process, but rather as a continuous process to which various factors contribute, including successfully taking the perspective of the avatar. Against this background, we discuss affective, cognitive, and visuo-spatial perspective taking of the avatar. As evidence for avatar-self merging, we present findings showing that when users take the avatar's perspective, they can show spontaneous behavioral tendencies that run counter to their own.

Head-Mounted Display with Increased Downward Field of View Improves Presence and Sense of Self-Location

Common existing head-mounted displays (HMDs) for virtual reality (VR) provide users with a high presence and embodiment. However, the field of view (FoV) of a typical HMD for VR is about 90 to 110 [deg] in the diagonal direction and about 70 to 90 [deg] in the vertical direction, which is narrower than that of humans. Specifically, the downward FoV of conventional HMDs is too narrow to present the user avatar's body and feet. To address this problem, we have developed a novel HMD with a pair of additional display units to increase the downward FoV by approximately 60 ( 10+50) [deg]. We comprehensively investigated the effects of the increased downward FoV on the sense of immersion that includes presence, sense of self-location (SoSL), sense of agency (SoA), and sense of body ownership (SoBO) during VR experience and on patterns of head movements and cybersickness as its secondary effects. As a result, it was clarified that the HMD with an increased FoV improved presence and SoSL. Also, it was confirmed that the user could see the object below with a head movement pattern close to the real behavior, and did not suffer from cybersickness. Moreover, the effect of the increased downward FoV on SoBO and SoA was limited since it was easier to perceive the misalignment between the real and virtual bodies.

Extended Reality in Spatial Sciences: A Review of Research Challenges and Future Directions

This manuscript identifies and documents unsolved problems and research challenges in the extended reality (XR) domain (i.e., virtual (VR), augmented (AR), and mixed reality (MR)). The manuscript is structured to include technology, design, and human factor perspectives. The text is visualization/display-focused, that is, other modalities such as audio, haptic, smell, and touch, while important for XR, are beyond the scope of this paper. We further narrow our focus to mainly geospatial research, with necessary deviations to other domains where these technologies are widely researched. The main objective of the study is to provide an overview of broader research challenges and directions in XR, especially in spatial sciences. Aside from the research challenges identified based on a comprehensive literature review, we provide case studies with original results from our own studies in each section as examples to demonstrate the relevance of the challenges in the current research. We believe that this paper will be of relevance to anyone who has scientific interest in extended reality, and/or uses these systems in their research.