Perception of Looming Motion in Virtual Reality Egocentric Interception Tasks

The role of arousal in the estimation of time-to-collision of threatening stimuli

The accurate estimation of time-to-collision (TTC) is essential for the survival of organisms. Previous studies have revealed that the emotional properties of approaching stimuli can influence the estimation of TTC, indicating that approaching threatening stimuli are perceived to collide with the observers earlier than they actually do, and earlier than non-threatening stimuli. However, not only are threatening stimuli more negative in valence, but they also have higher arousal compared to non-threatening stimuli. Up to now, the effect of arousal on TTC estimation remains unclear. In addition, inconsistent findings may result from the different experimental settings employed in previous studies. To investigate whether the underestimation of TTC is attributed to threat or high arousal, three experiments with the same settings were conducted. In Experiment 1, the underestimation of TTC estimation of threatening stimuli was replicated when arousal was not controlled, in comparison to non-threatening stimuli. In Experiments 2 and 3, the underestimation effect of threatening stimuli disappeared when compared to positive stimuli with similar arousal. These findings suggest that being threatening alone is not sufficient to explain the underestimation effect, and arousal also plays a significant role in the TTC estimation of approaching stimuli. Further studies are required to validate the effect of arousal on TTC estimation, as no difference was observed in Experiment 3 between the estimated TTC of high and low arousal stimuli.

Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments

Real-world actions require one to simultaneously perceive, think, and act on the surrounding world, requiring the integration of (bottom-up) sensory information and (top-down) cognitive and motor signals. Studying these processes involves the intellectual challenge of cutting across traditional neuroscience silos, and the technical challenge of recording data in uncontrolled natural environments. However, recent advances in techniques, such as neuroimaging, virtual reality, and motion tracking, allow one to address these issues in naturalistic environments for both healthy participants and clinical populations. In this review, we survey six topics in which naturalistic approaches have advanced both our fundamental understanding of brain function and how neurologic deficits influence goal-directed, coordinated action in naturalistic environments. The first part conveys fundamental neuroscience mechanisms related to visuospatial coding for action, adaptive eye-hand coordination, and visuomotor integration for manual interception. The second part discusses applications of such knowledge to neurologic deficits, specifically, steering in the presence of cortical blindness, impact of stroke on visual-proprioceptive integration, and impact of visual search and working memory deficits. This translational approach-extending knowledge from lab to rehab-provides new insights into the complex interplay between perceptual, motor, and cognitive control in naturalistic tasks that are relevant for both basic and clinical research.

Contribution of the stereoscopic representation of motion-in-depth during visually guided feedback control

Considerable studies have focused on the neural basis of visually guided tracking movement in the frontoparallel plane, whereas the neural process in real-world circumstances regarding the influence of binocular disparity and motion-in-depth (MID) perception is less understood. Although the role of stereoscopic versus monoscopic MID information has been extensively described for visual processing, its influence on top-down regulation for motor execution has not received much attention. Here, we orthogonally varied the visual representation (stereoscopic versus monoscopic) and motion direction (depth motion versus bias depth motion versus frontoparallel motion) during visually guided tracking movements, with simultaneous functional near-infrared spectroscopy recordings. Results show that the stereoscopic representation of MID could lead to more accurate movements, which was supported by specific neural activity pattern. More importantly, we extend prior evidence about the role of frontoparietal network in brain-behavior relationship, showing that occipital area, more specifically, visual area V2/V3 was also robustly involved in the association. Furthermore, by using the stereoscopic representation of MID, it is plausible to detect robust brain-behavior relationship even with small sample size at low executive task demand. Taken together, these findings highlight the importance of the stereoscopic representation of MID for investigating neural correlates of visually guided feedback control.

Virtual reality modulates the control of upper limb motion in one-handed ball catching

There remains a question about whether and to what extent perception-action coupled response in virtual reality are equal/unequal to those in the real world or physical reality. The purpose of this study was to identify the differences in the environmental effect of virtual presentation on the motor responses of a one-handed ball catching. Thirteen healthy participants were instructed to catch an approaching ball projected at three speeds in a real laboratory room and in a room-sized virtual reality system (CAVE) that simulated those real situations with two- or three-dimensional display settings. The results showed that the arm movement time, which denotes the duration of arm-raising motion (shoulder flexion), was significantly longer in the virtual reality than that in the physical reality at the fast ball speed condition. The shoulder flexion velocities, calculated as the average angular velocity of shoulder flexion over the arm movement time, were significantly lower in the virtual reality than in the physical reality at the medium and fast ball speed conditions. The electromyography onsets, derived from anterior deltoid, biceps brachii, and flexor carpi radialis muscles of the catching arm, appeared before and significantly closer to the initiation of arm raising in the two-dimensional virtual reality than both in the physical reality and in the three-dimensional virtual reality. The findings suggest that simulation of virtual reality may induce a modulation in the motor responses of the catching arm, which is different from natural motion that appeared in the real world. On the contrary, the effect of ball speed generally found in real setting was maintained in the current CAVE experiment.

Flexible viewing time when estimating time-to-contact in 3D parabolic trajectories

Obtaining reliable estimates of the time-to-contact (TTC) in a three-dimensional (3D) parabolic trajectory is still an open issue. A direct analysis of the optic flow cannot make accurate predictions for gravitationally accelerated objects. Alternatively, resorting to prior knowledge of gravity and size can provide accurate estimates of TTC in parabolic head-on trajectories, but its generalization depends on the specific geometry of the trajectory and particular moments. The aim of this work is to explore the preferred viewing windows to estimate TTC and how the available visual information affects these estimations. We designed a task in which participants, wearing an head-mounted display (HMD), had to time the moment a ball in a parabolic path returned at eye level. We used five trajectories for which accurate temporal predictions were available at different points of flight time. Our results show that our observers can predict both the trajectory of the ball and TTC based on the available visual information and previous experience with the task. However, the times at which our observers chose to gather the visual evidence did not match those in which visual information provided accurate TTC. Instead, they looked at the ball at relatively fixed temporal windows depending on the trajectory but not of TTC.

Perceptual judgments of duration of parabolic motions

In a 2-alternative forced-choice protocol, observers judged the duration of ball motions shown on an immersive virtual-reality display as approaching in the sagittal plane along parabolic trajectories compatible with Earth gravity effects. In different trials, the ball shifted along the parabolas with one of three different laws of motion: constant tangential velocity, constant vertical velocity, or gravitational acceleration. Only the latter motion was fully consistent with Newton’s laws in the Earth gravitational field, whereas the motions with constant velocity profiles obeyed the spatio-temporal constraint of parabolic paths dictated by gravity but violated the kinematic constraints. We found that the discrimination of duration was accurate and precise for all types of motions, but the discrimination for the trajectories at constant tangential velocity was slightly but significantly more precise than that for the trajectories at gravitational acceleration or constant vertical velocity. The results are compatible with a heuristic internal representation of gravity effects that can be engaged when viewing projectiles shifting along parabolic paths compatible with Earth gravity, irrespective of the specific kinematics. Opportunistic use of a moving frame attached to the target may favour visual tracking of targets with constant tangential velocity, accounting for the slightly superior duration discrimination.