Assessing Visual Exploratory Activity of Athletes in Virtual Reality Using Head Motion Characteristics

Exploring the effects of 3D-360°VR and 2D viewing modes on gaze behavior, head excursion, and workload during a boxing specific anticipation task

Introduction

Recent evidence has started to demonstrate that 360°VR, a type of VR that immerses a user within a 360° video, has advantages over two-dimensional (2D) video displays in the context of perceptual-cognitive evaluation and training. However, there is currently a lack of empirical evidence to explain how perceptual-cognitive strategies differ between these two paradigms when performing sports-related tasks. Thus, the objective of this study was to examine and compare the impact of different viewing conditions (e.g., 3D-360°VR and 2D video displays), on gaze behavior and head excursions in a boxing-specific anticipatory task. A secondary objective was to assess the workload associated with each viewing mode, including the level of presence experienced. Thirdly, an exploratory analysis was conducted to evaluate any potential sex differences.

Methods

Thirty-two novice participants (16 females) were recruited for this study. A total of 24 single-punch sequences were randomly presented using a standalone VR headset (Pico Neo 3 Pro Eye), with two different viewing modes: 3D-360°VR and 2D. Participants were instructed to respond to the punches with appropriate motor actions, aiming to avoid punches. Gaze behavior was recorded using a Tobii eyetracker embedded in the VR headset. Workload and presence were measured with the SIM-TLX questionnaire. Fixation duration, number of fixations, saccades, search rate and head excursions (roll, pitch, yaw) were analyzed using linear mixed models.

Results

The results revealed significant shorter fixation durations and more head excursions (roll, pitch) in 3D-360°VR, compared to the 2D viewing mode (ps < 0.05). The sense of presence was found to be much higher in the 3D-360°VR viewing mode (p < 0.05). No sex differences were observed. These results demonstrate that 360°VR elicited shorter fixation durations but mostly greater head excursions and immersion compared to a 2D projection in the context of a boxing-specific task.

Discussion

These findings contribute to the understanding of previous evidence supporting the possible advantages of using 360°VR over 2D for perceptual-cognitive evaluation and training purposes. Further validation studies that compare behaviors and performance in 360°VR with those in the real-world will be needed.

Stereopsis Only: Validation of a Monocular Depth Cues Reduced Gamified Virtual Reality with Reaction Time Measurement

The visual depth perception is composed of monocular and binocular depth cues. Studies show that in absence of binocular depth cues the performance of visuomotor tasks like pointing to or grasping objects is limited. Thus, binocular depth cues are of great importance for motor control required in everyday life. However, binocular depth cues like retinal disparity (basis for stereopsis) might be influenced due to developmental disorders of the visual system. For example, amblyopia in which one eye's visual input is not processed leads to loss of stereopsis. The primary amblyopia treatment is occlusion of the healthy eye to force the amblyopic eye to train. However, improvements in stereopsis are poor. Therefore, binocular treatments arose that equilibrate both eyes' visual input to enable binocular vision. However, most approaches rely on divided stimuli which do not account for loss of stereopsis. We created a Virtual Reality (VR) with reduced monocular depth cues in which a stereoscopic task is shown to both eyes simultaneously, consisting of two balls jumping towards the user. One ball appears closer to the user which must be identified. To evaluate the task performance the reaction time is measured. We validated our approach with 18 participants with stereopsis under three contrast settings including one leading to monocular vision. The number of correct responses reduces from 90% under binocular vision to 52% under monocular vision corresponding to random guessing. Our results indicate that it is possible to disable monocular depth cues and create a dynamic stereoscopic task inside a VR.

Development and Evaluation of a Virtual Environment to Assess Cycling Hazard Perception Skills

Safe cycling requires situational awareness to identify and perceive hazards in the environment to react to and avoid dangerous situations. Concurrently, tending to external distractions leads to a failure to identify hazards or to respond appropriately in a time-constrained manner. Hazard perception training can enhance the ability to identify and react to potential dangers while cycling. Although cycling on the road in the presence of driving cars provides an excellent opportunity to develop and evaluate hazard perception skills, there are obvious ethical and practical risks, requiring extensive resources to facilitate safety, particularly when involving children. Therefore, we developed a Cycling and Hazard Perception virtual reality (VR) simulator (CHP-VR simulator) to create a safe environment where hazard perception can be evaluated and/or trained in a real-time setting. The player interacts in the virtual environment through a stationary bike, where sensors on the bike transfer the player's position and actions (speed and road positioning) into the virtual environment. A VR headset provides a real-world experience for the player, and a procedural content generation (PCG) algorithm enables the generation of playable artifacts. Pilot data using experienced adult cyclists was collected to develop and evaluate the VR simulator through measuring gaze behavior, both in VR and in situ. A comparable scene (cycling past a parked bus) in VR and in situ was used. In this scenario, cyclists fixated 20% longer at the bus in VR compared to in situ. However, limited agreement identified that the mean differences fell within 95% confidence intervals. The observed differences were likely attributed to a lower number of concurrently appearing elements (i.e., cars) in the VR environment compared with in situ. Future work will explore feasibility testing in young children by increasing assets and incorporating a game scoring system to direct attention to overt and covert hazards.

Analysis of the Learning Process through Eye Tracking Technology and Feature Selection Techniques

In recent decades, the use of technological resources such as the eye tracking methodology is providing cognitive researchers with important tools to better understand the learning process. However, the interpretation of the metrics requires the use of supervised and unsupervised learning techniques. The main goal of this study was to analyse the results obtained with the eye tracking methodology by applying statistical tests and supervised and unsupervised machine learning techniques, and to contrast the effectiveness of each one. The parameters of fixations, saccades, blinks and scan path, and the results in a puzzle task were found. The statistical study concluded that no significant differences were found between participants in solving the crossword puzzle task; significant differences were only detected in the parameters saccade amplitude minimum and saccade velocity minimum. On the other hand, this study, with supervised machine learning techniques, provided possible features for analysis, some of them different from those used in the statistical study. Regarding the clustering techniques, a good fit was found between the algorithms used (k-means ++, fuzzy k-means and DBSCAN). These algorithms provided the learning profile of the participants in three types (students over 50 years old; and students and teachers under 50 years of age). Therefore, the use of both types of data analysis is considered complementary.