Effects of texture and shape on perceived time to passage: knowing "what" influences judging "when"

Interception of vertically approaching objects: temporal recruitment of the internal model of gravity and contribution of optical information

Introduction: Recent views posit that precise control of the interceptive timing can be achieved by combining on-line processing of visual information with predictions based on prior experience. Indeed, for interception of free-falling objects under gravity's effects, experimental evidence shows that time-to-contact predictions can be derived from an internal gravity representation in the vestibular cortex. However, whether the internal gravity model is fully engaged at the target motion outset or reinforced by visual motion processing at later stages of motion is not yet clear. Moreover, there is no conclusive evidence about the relative contribution of internalized gravity and optical information in determining the time-to-contact estimates. Methods: We sought to gain insight on this issue by asking 32 participants to intercept free falling objects approaching directly from above in virtual reality. Object motion had durations comprised between 800 and 1100 ms and it could be either congruent with gravity (1 g accelerated motion) or not (constant velocity or -1 g decelerated motion). We analyzed accuracy and precision of the interceptive responses, and fitted them to Bayesian regression models, which included predictors related to the recruitment of a priori gravity information at different times during the target motion, as well as based on available optical information. Results: Consistent with the use of internalized gravity information, interception accuracy and precision were significantly higher with 1 g motion. Moreover, Bayesian regression indicated that interceptive responses were predicted very closely by assuming engagement of the gravity prior 450 ms after the motion onset, and that adding a predictor related to on-line processing of optical information improved only slightly the model predictive power. Discussion: Thus, engagement of a priori gravity information depended critically on the processing of the first 450 ms of visual motion information, exerting a predominant influence on the interceptive timing, compared to continuously available optical information. Finally, these results may support a parallel processing scheme for the control of interceptive timing.

Road crossing decisions in real and virtual environments: A comparative study on simulator validity

Virtual reality (VR) is a valuable tool for the assessment of human perception and behavior in a risk-free environment. Investigators should, however, ensure that the used virtual environment is validated in accordance with the experiment's intended research question since behavior in virtual environments has been shown to differ to behavior in real environments. This article presents the street crossing decisions of 30 participants who were facing an approaching vehicle and had to decide at what moment it was no longer safe to cross, applying the step-back method. The participants executed the task in a real environment and also within a highly immersive VR setup involving a head-mounted display (HMD). The results indicate significant differences between the two settings regarding the participants' behaviors. The time-to-contact of approaching vehicles was significantly lower for crossing decisions in the virtual environment than for crossing decisions in the real one. Additionally, it was demonstrated that participants based their crossing decisions in the real environment on the temporal distance of the approaching vehicle (i.e., time-to-contact), whereas the crossing decisions in the virtual environment seemed to depend on the vehicle's spatial distance, neglecting the vehicle's velocity. Furthermore, a deeper analysis suggests that crossing decisions were not affected by factors such as the participant's gender or the order in which they faced the real and the virtual environment.

Impending Collision Judgment from an Egocentric Perspective in Real and Virtual Environments: A Review

The human egocentric perception of approaching objects and the related perceptual processes have been of interest to researchers for several decades. This article gives a literature review on numerous studies that investigated the phenomenon when an object approaches an observer (or the other way around) with the goal to single out factors that influence the perceptual process. A taxonomy of metrics is followed by a breakdown of different experimental measurement methods. Thereinafter, potential factors affecting the judgment of approaching objects are compiled and debated while divided into human factors (e.g., gender, age, and driving experience), compositional factors (e.g., approaching velocity, spatial distance, and observation time), and technical factors (e.g., field of view, stereoscopy, and display contrast). Experimental findings are collated, juxtaposed, and critically discussed. With virtual-reality devices having taken a tremendous developmental leap forward in the past few years, they have been able to gain ground in experimental research. Therefore, special attention in this article is also given to the perception of approaching objects in virtual environments and put in contrast to the perception in reality.

Judging time-to-passage of looming sounds: Evidence for the use of distance-based information

Perceptual judgments are an essential mechanism for our everyday interaction with other moving agents or events. For instance, estimation of the time remaining before an object contacts or passes us is essential to act upon or to avoid that object. Previous studies have demonstrated that participants use different cues to estimate the time to contact or the time to passage of approaching visual stimuli. Despite the considerable number of studies on the judgment of approaching auditory stimuli, not much is known about the cues that guide listeners' performance in an auditory Time-to-Passage (TTP) task. The present study evaluates how accurately participants judge approaching white-noise stimuli in a TTP task that included variable occlusion periods (portion of the presentation time where the stimulus is not audible). Results showed that participants were able to accurately estimate TTP and their performance, in general, was weakly affected by occlusion periods. Moreover, we looked into the psychoacoustic variables provided by the stimuli and analysed how binaural cues related with the performance obtained in the psychophysical task. The binaural temporal difference seems to be the psychoacoustic cue guiding participants' performance for lower amounts of occlusion, while the binaural loudness difference seems to be the cue guiding performance for higher amounts of occlusion. These results allowed us to explain the perceptual strategies used by participants in a TTP task (maintaining accuracy by shifting the informative cue for TTP estimation), and to demonstrate that the psychoacoustic cue guiding listeners' performance changes according to the occlusion period.

Predicting where a ball will land: from thrower's body language to ball's motion

To predict where a thrown ball will land, an observer may use visual information about its trajectory. However, in addition, the thrower's body language (i.e., body movement and facial expression) may contain useful information that could be used by the observer to understand intention and emotional state. Here, we investigated how observers estimated a ball's landing point thrown by a virtual agent with different amounts of information from body language. In addition, occlusion time was varied to examine how it potentiates the use of body-language information. Results showed that body movement and facial expression carry information about thrower's effort. However, once the ball has left the thrower's hand, advance information on facial expression does contribute to judgments only if consistent with the amplitude of the throw. Moreover, as the occlusion time increases, a stronger influence of the body movement is observed for estimating the landing point. The overriding effect of ball's trajectory availability over body language is discussed.

The time course of estimating time-to-contact: switching between sources of information

The different sources of information that can be used to estimate time-to-contact may have different degrees of reliability across time. For example, after a given presentation or display time, an absolute change of angular size can be more reliable than the corresponding estimation of the rate of angular expansion (e.g. motion information). One could then expect systematic biases in the observer's responses for different times of stimulus exposure. In one experiment, observers judged whether approaching objects arrived at the point of observation before or after a reference beep (1.2s) under monocular, and binocular plus monocular vision. Five display times from 0.1 to 0.9s were used. Unlike monocular viewing, where accuracy increased monotonically with display time, an interesting non-linearity occurred for objects with small size when binocular information was available. Accuracy reached maximum values for small objects with only 0.3s of vision with stereopsis. This accuracy, however, dropped significantly after 0.4s of exposure and increased again linearly with time. This is consistent with subjects switching from using binocular information to using monocular motion information when it started to become more reliable. We also explored whether monocular cues were combined differently across time by fitting a model that relates visual angle to its rate of expansion. Results show that subjects relied more on angular motion information (i.e. rate of expansion) with presentation time but interrupting this motion integration process led to a loss of accuracy in time-to-contact judgments.

Synergies between optical and physical variables in intercepting parabolic targets

Interception requires precise estimation of time-to-contact (TTC) information. A long-standing view posits that all relevant information for extracting TTC is available in the angular variables, which result from the projection of distal objects onto the retina. The different timing models rooted in this tradition have consequently relied on combining visual angle and its rate of expansion in different ways with tau being the most well-known solution for TTC. The generalization of these models to timing parabolic trajectories is not straightforward. For example, these different combinations rely on isotropic expansion and usually assume first-order information only, neglecting acceleration. As a consequence no optical formulations have been put forward so far to specify TTC of parabolic targets with enough accuracy. It is only recently that context-dependent physical variables have been shown to play an important role in TTC estimation. Known physical size and gravity can adequately explain observed data of linear and free-falling trajectories, respectively. Yet, a full timing model for specifying parabolic TTC has remained elusive. We here derive two formulations that specify TTC for parabolic ball trajectories. The first specification extends previous models in which known size is combined with thresholding visual angle or its rate of expansion to the case of fly balls. To efficiently use this model, observers need to recover the 3D radial velocity component of the trajectory which conveys the isotropic expansion. The second one uses knowledge of size and gravity combined with ball visual angle and elevation angle. Taking into account the noise due to sensory measurements, we simulate the expected performance of these models in terms of accuracy and precision. While the model that combines expansion information and size knowledge is more efficient during the late trajectory, the second one is shown to be efficient along all the flight.

People favour imperfect catching by assuming a stable world

The visual angle that is projected by an object (e.g. a ball) on the retina depends on the object's size and distance. Without further information, however, the visual angle is ambiguous with respect to size and distance, because equal visual angles can be obtained from a big ball at a longer distance and a smaller one at a correspondingly shorter distance. Failure to recover the true 3D structure of the object (e.g. a ball's physical size) causing the ambiguous retinal image can lead to a timing error when catching the ball. Two opposing views are currently prevailing on how people resolve this ambiguity when estimating time to contact. One explanation challenges any inference about what causes the retinal image (i.e. the necessity to recover this 3D structure), and instead favors a direct analysis of optic flow. In contrast, the second view suggests that action timing could be rather based on obtaining an estimate of the 3D structure of the scene. With the latter, systematic errors will be predicted if our inference of the 3D structure fails to reveal the underlying cause of the retinal image. Here we show that hand closure in catching virtual balls is triggered by visual angle, using an assumption of a constant ball size. As a consequence of this assumption, hand closure starts when the ball is at similar distance across trials. From that distance on, the remaining arrival time, therefore, depends on ball's speed. In order to time the catch successfully, closing time was coupled with ball's speed during the motor phase. This strategy led to an increased precision in catching but at the cost of committing systematic errors.

Evaluating methods to measure time-to-contact

Many every-day activities necessitate an estimate of the time remaining until an object will hit us: the time-to-contact (TTC). Observers' skill in estimating TTC has been studied by considering the use and combination of key visual signals (e.g. looming and disparity). However, establishing observers' proficiency in estimating TTC can be complicated, as the variable of interest (time) is typically highly correlated with other signals (e.g. target velocity or displacement). As a result, observers' responses may be based on correlates of TTC rather than on TTC itself. Here we evaluate two widely-used TTC tasks: one absolute task in which observers pressed a button to indicate the estimated TTC, and a relative task in which TTC was judged relative to a reference. We test how a wide range of experimental variables that co-vary with TTC contribute to observers' judgments. We systematically vary the correlation between TTC and its covariates and test how psychophysical judgments are affected. We show that for both absolute and relative estimation tasks, observers' responses are best explained on the basis that they judge TTC rather than one (or more) of its covariates. Our results suggest that relative tasks are preferable when assessing TTC, and we suggest a number of analyses methods to ensure that participants' judgements correspond to the variable under investigation.

A new ball launching system with controlled flight parameters for catching experiments

Systematic investigations of sensorimotor control of interceptive actions in naturalistic conditions, such as catching or hitting a ball moving in three-dimensional space, requires precise control of the projectile flight parameters and of the associated visual stimuli. Such control is challenging when air drag cannot be neglected because the mapping of launch parameters into flight parameters cannot be computed analytically. We designed, calibrated, and experimentally validated an actuated launching apparatus that can control the average spatial position and flight duration of a ball at a given distance from a fixed launch location. The apparatus was constructed by mounting a ball launching machine with adjustable delivery speed on an actuated structure capable of changing the spatial orientation of the launch axis while projecting balls through a hole in a screen hiding the apparatus. The calibration procedure relied on tracking the balls with a motion capture system and on approximating the mapping of launch parameters into flight parameters by means of polynomials functions. Polynomials were also used to estimate the variability of the flight parameters. The coefficients of these polynomials were obtained using the launch and flight parameters of 660 launches with 65 different initial conditions. The relative accuracy and precision of the apparatus were larger than 98% for flight times and larger than 96% for ball heights at a distance of 6m from the screen. Such novel apparatus, by reliably and automatically controlling desired ball flight characteristics without neglecting air drag, allows for a systematic investigation of naturalistic interceptive tasks.

Judgements of time to contact are affected by rate of appearance of visible texture

More fine-grained texture becomes visible if the distance between an observer and an object or surface is reduced. This article illustrates with a schematic example that the inverse rate of the relative appearance of visible texture provides information about time to contact if the observer has a constant visual acuity and the texture has a certain scale-independent structure. An experiment is reported in which texture appearance was manipulated. Participants were asked to make forced-choice time-to-contact judgements. A small but significant effect indicates that the judgements were affected by the rate of appearance of the texture. It is concluded that observers use this type of information.