Effects of body visualization on performance in head-mounted display virtual reality

Balance performance of healthy young individuals in real versus matched virtual environments: a systematic scoping review

Background

Due to technological advancements and the development of consumer-oriented head mounted displays (HMDs), virtual reality (VR) is used in studies on balance performance and balance trainability more and more frequently. Yet, it may be assumed that balance performance is affected by the physical characteristics of the HMD (e.g., weight) as well as by the virtual visual environment. Moreover, it has been shown that balance is age-dependent with children and adolescents showing worse performances compared to young adults, which may also affect their balance performance in virtual environments.

Objectives

The present systematic scoping review aims to provide an overview on the current evidence regarding balance performance of healthy, young individuals (6–30 years) in real and matched virtual environments.

Methods

A systematic literature search in the electronic databases PubMed, Web of Science, and SPORTDiscus (from their inception date to February 2024) resulted in 9,554 studies potentially eligible for inclusion. Eligibility criteria were: (i) investigation of healthy, young individuals (6–30 years), (ii) balance assessment in the real and a matched virtual environment, (iii) use of a fully immersive HMD, (iv) reporting of at least one balance parameter. A total of 10 studies met the predefined inclusion criteria and were thus included in this review. All studies were conducted with healthy, young adults (19–30 years).

Results

Five studies assessed static balance, four studies quantified dynamic balance, and one study measured static as well as dynamic balance performance. In healthy young adults, static balance performance was similar with and without VR during simple standing tasks (e.g., two-legged stance), but worse in VR during more challenging tasks (e.g., one-legged stance). Concerning dynamic balance, four out of five studies reported worse performance in VR, while one study did not find differences between visual environments. Most importantly, none of the studies investigating healthy children (6–12 years) and/or adolescents (13–18 years) met the predefined inclusion criteria.

Conclusion

In healthy young adults, balance performance seems to be affected by VR only during challenging static (e.g., one-legged stance) as well as during dynamic balance tasks. The underlying causes remain unclear, but factors such as perceived presence in VR, a shift in sensory organization and/or perceptual distortion may play a role. Of particular importance is the finding that there is a void in the literature on the influence of VR on balance performance of healthy children and adolescents.

The use of virtual exhibition to promote exhibitors' pro-environmental behavior: The case study of Zhejiang Yiwu International Intelligent Manufacturing Equipment Expo

This study investigates the role of virtual exhibition attributes (navigation, ubiquity, vividness, interactivity, visualization) in creating positive perceived green performance and satisfaction of exhibitors, thus benefiting the exhibitors' sustainable behaviors of Eco-exhibition. Two studies were conducted to verify the proposed hypotheses. In Study 1, 417 samples were collected from 2021 ME-Expo of China to test the model. In Study 2, the follow-up interviews were conducted with 18 participants to validate the quantitative results and gain deeper insights. The results of Study 1 indicate that adopting virtual exhibitions is critical in predicting exhibitors' perceived performance and satisfaction, which in turn, influences their pro-environmental behavior. The results of Study 2 confirmed above mentioned relationship, and interviewees indicate that the emergence of virtual exhibitions should be a long-term strategy for sustainable development in the exhibition industry.

Movement kinematic and postural control differences when performing a visuomotor skill in real and virtual environments

Immersive technologies, like virtual and mixed reality, pose a novel challenge for our sensorimotor systems as they deliver simulated sensory inputs that may not match those of the natural environment. These include reduced fields of view, missing or inaccurate haptic information, and distortions of 3D space; differences that may impact the control of motor actions. For instance, reach-to-grasp movements without end-point haptic feedback are characterised by slower and more exaggerated movements. A general uncertainty about sensory input may also induce a more conscious form of movement control. We tested whether a more complex skill like golf putting was also characterized by more consciously controlled movement. In a repeated-measures design, kinematics of the putter swing and postural control were compared between (i) real-world putting, (ii) VR putting, and (iii) VR putting with haptic feedback from a real ball (i.e., mixed reality). Differences in putter swing were observed both between the real world and VR, and between VR conditions with and without haptic information. Further, clear differences in postural control emerged between real and virtual putting, with both VR conditions characterised by larger postural movements, which were more regular and less complex, suggesting a more conscious form of balance control. Conversely, participants actually reported less conscious awareness of their movements in VR. These findings highlight how fundamental movement differences may exist between virtual and natural environments, which may pose challenges for transfer of learning within applications to motor rehabilitation and sport.

Gymnastic skills on a balance beam with simulated height

Virtual reality (VR) is a valuable tool for simulating dangerous situations and training under these conditions with a reduced possibility of injury. This could be beneficial within different sports scenarios. In gymnastics, the height of the balance beam can be dangerous and frightening, especially for beginners. Here, a simulated height can reduce the participant's risk of injury and facilitate entry to balance beam gymnastics. However, the investigation of sports performance in a virtual environment is rare. Therefore, the current study aims to compare beginners' performance in balance beam tasks between the real world (RW) and VR. 34 sports students executed gymnastic balancing forward, backward and the extension of one leg to the front, the side and the back on a regular balance beam in the RW and on a balance beam with simulated height in VR (using a head-mounted display). We analyzed beginners' performance in both conditions (RW and VR) regarding different criteria for each balance beam task. Statistical analyses show significant differences in performance with better results in RW (p < .05). Especially the body tension and the upper body posture were superior in RW. One explanation can be the more difficult regulation of the balance in VR. For the tasks where the motion took part in a fixed position on the beam, the further performance aspects were similar for RW and VR. When the participants moved along the beam, further performance aspects, like the leg extension, were better in RW. In total, the participants executed the VR balance beam tasks with decreased danger of injury due to the simulated height of the balance beam, but their performance was slightly limited. We conclude that for the first contact with the height of a balance beam, VR is a suitable tool to reduce the danger of injury occurring from falling off the beam and facilitate entry to balance beam gymnastics.

Probing the deployment of peripheral visual attention during obstacle-crossing planning

Gaze is directed to one location at a time, making peripheral visual input important for planning how to negotiate different terrain during walking. Whether and how the brain attends to this input is unclear. We developed a novel paradigm to probe the deployment of sustained covert visual attention by testing orientation discrimination of a Gabor patch at stepping and non-stepping locations during obstacle-crossing planning. Compared to remaining stationary, obstacle-crossing planning decreased visual performance (percent correct) and sensitivity (d') at only the first of two stepping locations. Given the timing of the first and second steps before obstacle crossing relative to the Gabor patch presentation, the results suggest the brain uses peripheral vision to plan one step at a time during obstacle crossing, in contrast to how it uses central vision to plan two or more steps in advance. We propose that this protocol, along with multiple possible variations, presents a novel behavioral approach to identify the role of covert visual attention during obstacle-crossing planning and other goal-directed walking tasks.

Comparison of response behavior in karate kumite between real world and virtual reality

Virtual reality is increasingly applied to support physical training and improve athletes’ performance in sports. Nevertheless, there is a research deficit in that, especially in martial arts, it has not yet been shown to what extent the response behavior of athletes in virtual reality is the same as in the real world. If this can be confirmed, a transfer of VR-adapted skills to RW can be expected and sports training in a virtual environment can be applied to improve sports performance. Since the response behavior is essential for many sports, this study compares it in karate kumite to the competition-important attack (Kizami-Zuki) of a real and a virtual opponent. Experienced karate athletes wore a head-mounted display and were asked to respond quickly and efficiently to 22 karate attacks, of which eight were Kizami Zuki’s attacks. Using a video-based movement assessment, karate experts quantified the response behavior with the parameters ‘time for response’, ‘response quality’ and ‘kind of response’. Results show no significant differences in ‘time for response’ and ‘kind of response’ between both conditions (virtual reality vs. real world). Only the ‘response quality’ was rated better in real world than in virtual reality. It is concluded that the ‘time of response’ and ‘kind of response’ for karate kumite athletes in virtual reality are similar to that in the real world.

Simplified Virtual Reality System Can Be Used to Evaluate the Temporal Discrimination Ability in Softball Batting as in the Real Environment

Recently, virtual reality (VR) technology has developed rapidly and has increasingly come to be used in the sports field. VR technology ranges from large, highly immersive devices to simple devices such as smartphones, and the respective usefulness and shortcomings of different device types have been debated. Simple devices have advantages such as portability, but also provide only a weak sense of realism. It is important to understand the purpose and extent to which VR technologies can be used. Our purpose in this study was to briefly measure one of the cognitive-motor abilities used in softball batting: temporal discrimination ability in swing onset when a batter faces two types of balls thrown at different speeds. We investigated whether a simplified head-mounted display (HMD) system can evaluate such cognitive-motor ability to the same extent as in a real environment. Ten elite female softball batters swung at fastballs and slowballs randomly thrown by the same pitcher in both real and 3D VR environments, with the same range of trajectories. We then compared the temporal discrimination ability of swing onset analyzed by video analysis between environments. We found that the discrimination ability in VR is almost the same as in reality. In addition, questionnaire items on the VR system related to user experience and cybersickness showed overall promising responses. However, we also found that the system had some issues that need to be considered, such as leading to early swing onset and large variability in it. We discussed the usefulness and limitations of the VR system by combining the results for swing onset with the questionnaire responses. By understanding the characteristics of VR technology and using it as an efficient evaluation and training of players, the sports field can make significant progress.

Temporal Development of Sense of Presence and Cybersickness during an Immersive VR Experience

Following the advances in modern head-mounted displays, research exploring the human experience of virtual environments has seen a surge in interest. Researchers have examined how to promote individuals’ sense of presence, i.e., their experience of “being” in the VE, as well as to diminish the negative side effects of cybersickness. Studies investigating the relationship between sense of presence and cybersickness have reported heterogeneous results. Authors that found a positive relation have argued that the phenomena have shared cognitive underpinnings. However, recent literature has reported that positive associations can be explained by the confounding factor of immersion. The current study aims to investigate how cybersickness and sense of presence are associated and develop over time. During the experiment, participants were exposed to a virtual roller coaster and presented orally with questions aimed to quantify their perceived sense of presence and cybersickness. The results of the experiment indicate that cybersickness and sense of presence are both modulated by the time spent in the virtual setting. The utilized short measures for sense of presence and cybersickness were found to be reliable alternatives to multi-item questionnaires.

Perceptual distortion in virtual reality and its impact on dynamic postural control

BACKGROUND

Voluntary movement such as lifting a foot in preparation to stepping acts as a self-initiated perturbation that disturbs postural equilibrium. To maintain and restore equilibrium, humans utilize early, anticipatory, and compensatory postural adjustments. Despite technological progress in accessible virtual reality (VR) devices, little is known on the usage of VR in control and maintenance of balance while standing.

RESEARCH QUESTION

How does VR modulate early, anticipatory, and compensatory postural adjustments during a dynamic task of leg lifting while avoiding an obstacle?

METHODS

First, the postural adjustments in a single-leg obstacle avoidance were compared between real and VR settings, where a statistical reanalysis was performed with data subsets that minimize the difference of foot elevation speed. Second, the effect of simple foot elevation was examined to identify the fundamental nature of leg lifting motion as a self-initiated perturbation. Lastly, perceptual distortion in VR was assessed by evaluating how the spatial scale of the virtual scene used in the single-leg obstacle avoidance experiment was recognized by participants.

RESULTS

The VR setting reduced the activities of lower leg muscles on the supporting side not only in the compensatory phase but also in the preparatory early and anticipatory phases. On the other hand, simple foot elevation resulted in a significant increase of muscle activities with lifting height only found in the compensatory phase. Furthermore, it is suggested that the VR induced perceptual distortion in estimating the sizes of the virtual objects.

SIGNIFICANCE

The findings provide more definitive evidence that VR presentation modulates the components of postural adjustments for maintaining upright stance while being perturbed. One of the potential psychophysical factors is perceptual distortion in VR, and this provides critical information for further development of VR based training system.

Influence of body visualization in VR during the execution of motoric tasks in different age groups

Virtual reality (VR) has become a common tool and is often considered for sport-specific purposes. Despite the increased usage, the transfer of VR-adapted skills into the real-world (RW) has not yet been sufficiently studied, and it is still unknown how much of the own body must be visible to complete motoric tasks within VR. In addition, it should be clarified whether older adults also need to perceive their body within VR scenarios to the same extent as younger people extending the usability. Therefore, younger (18-30 years old) and elderly adults (55 years and older) were tested (n = 42) performing a balance-, grasping- and throwing task in VR (HMD based) accompanied with different body visualization types in VR and in the RW having the regular visual input of body's components. Comparing the performances between the age groups, the time for completion, the number of steps (balance task), the subjective estimation of difficulty, the number of errors, and a rating system revealing movements' quality were considered as examined parameters. A one-way ANOVA/Friedmann with repeated measurements with factor [body visualization] was conducted to test the influence of varying body visualizations during task completion. Comparisons between the conditions [RW, VR] were performed using the t-Tests/Wilcoxon tests, and to compare both age groups [young, old], t-Tests for independent samples/Mann-Whitney-U-Test were used. The analyses of the effect of body visualization on performances showed a significant loss in movement's quality when no body part was visualized (p < .05). This did not occur for the elderly adults, for which no influence of the body visualization on their performance could be proven. Comparing both age groups, the elderly adults performed significantly worse than the young age group in both conditions (p < .05). In VR, both groups showed longer times for completion, a higher rating of tasks' difficulty in the balance and throwing task, and less performance quality in the grasping task. Overall, the results suggest using VR for the elderly with caution to the task demands, and the visualization of the body seemed less crucial for generating task completion. In summary, the actual task demands in VR could be successfully performed by elderly adults, even once one has to reckon with losses within movement's quality. Although more different movements should be tested, basic elements are also realizable for elderly adults expanding possible areas of VR applications.