Visual processing of the impending collision of a looming object: Time to collision revisited

Emotion-gaze interaction affects time-to-collision estimates, but not preferred interpersonal distance towards looming faces

Estimating the time until impending collision (time-to-collision, TTC) of approaching or looming individuals and maintaining a comfortable distance from others (interpersonal distance, IPD) are commonly required in daily life and contribute to survival and social goals. Despite accumulating evidence that facial expressions and gaze direction interactively influence face processing, it remains unclear how these facial features affect the spatiotemporal processing of looming faces. We examined whether facial expressions (fearful vs. neutral) and gaze direction (direct vs. averted) interact on the judgments of TTC and IPD for looming faces, based on the shared signal hypothesis that fear signals the existence of threats in the environment when coupled with averted gaze. Experiment 1 demonstrated that TTC estimates were reduced for fearful faces compared to neutral ones only when the concomitant gaze was averted. In Experiment 2, the emotion-gaze interaction was not observed in the IPD regulation, which is arguably sensitive to affective responses to faces. The results suggest that fearful-averted faces modulate the cognitive extrapolation process of looming motion by communicating environmental threats rather than by altering subjective fear or perceived emotional intensity of faces. The TTC-specific effect may reflect an enhanced defensive response to unseen threats implied by looming fearful-averted faces. Our findings provide insight into how the visual system processes facial features to ensure bodily safety and comfortable interpersonal communication in dynamic environments.

The effect of background information and motion speed on the performance of TTC estimation

BACKGROUND

In previous studies, most research on motion perception have been conducted under background-free condition when the stimulus moved in a plane parallel to the observer. In real-life situations, people's perception of the motion state of objects is usually done under different visual noise. Based on the occlusion paradigm, this study aimed to investigate whether different background information and motion speed affect the trend and accuracy of time-to-collision (TTC) estimation when stimuli move in a plane parallel to the observer.

METHODS

Thirty five college students (mean age = 20.94, SD = 2.95, range = 18-28 years) participated in experiment 1, and used a 2 (background orientation: horizontal, vertical) × 3 (motion speed: slow, medium, fast) design to explore the effect of different line segment orientations and motion speed on TTC estimation performance; 36 college students (mean age = 20.81, SD = 2.82, range = 18-28 years) participated in experiment 2, and used a 2 (background dimension: two-dimensional background, three-dimensional background) × 3 (motion speed: slow, medium, fast) design to explore the effect of different background dimensions and motion speed on the performance of TTC estimation. The data were analyzed using SPSS 25.0.

RESULTS

The results revealed that: (1) The TTC was underestimated for the slow speed condition and overestimated for the medium and fast speed conditions. (2) The highest accuracy of TTC estimation was obtained for the fast condition. (3) The TTC were overestimated for the vertical background condition and underestimated for the horizontal background condition. (4) Compared to the two-dimensional background, the TTC was overestimated in the three-dimensional background.

CONCLUSIONS

Object motion speed affected the TTC estimation performance, and different background information affected the TTC estimation performance when the object moved in a plane parallel to the observer. Meanwhile, the impact of background orientation and motion speed showed significant interactions.

Should I stay or should I go? The cerebral bases of street-crossing decision

An observer willing to cross a street must first estimate if the approaching cars offer enough time to safely complete the task. The brain areas supporting this perception, known as Time-To-Contact (TTC) perception, have been mainly studied through noninvasive correlational approaches. We carried out an experiment in which patients were tested during an awake brain surgery electrostimulation mapping to examine the causal implication of various brain areas in the street-crossing decision process. Forty patients were tested in a gap acceptance task before their surgery to establish a baseline performance. The task was individually adapted upon this baseline level and carried out during their surgery. We acquired and normalized to MNI space the coordinates of the functional areas that influenced task performance. A total of 103 stimulation sites were tested, allowing to establish a large map of the areas involved in the street-crossing decision. Multiple sites were found to impact the gap acceptance decision. A direct implication was however found mostly for sites within the right parietal lobe, while indirect implication was found for sites within the language, motor, or attentional networks. The right parietal lobe can be considered as causally influencing the gap acceptance decision. Other positive sites were all accompanied with dysfunction in other cognitive functions, and therefore should probably not be considered as the site of TTC estimation.

Age-Related Changes in the Utilization of Visual Information for Collision Prediction: A Study Using an Affordance-Based Model

The ability to predict collisions with moving objects deteriorates with aging. We followed the affordance-based model to identify optical variables that older adults had difficulty using for collision prediction. We reproduced a modified version of the interception task used in Steinmetz (Steinmetz, Layton, Powell, & Fajen, 2020, "Affordance-based versus current - future accounts of choosing whether to pursue or abandon the chase of a moving target," Journal of Vision, 20(3), 8) in a virtual reality (VR) environment and newly introduced perturbation for each of three optical variables (vertical and horizontal expansions of a moving object and the bearing angle produced between participants and a moving object). We expected that perturbation would negatively affect the performance only for those who rely on the optical variable to perform the interception task effectively. We tested 18 older and 15 younger adults and showed that older participants were not negatively affected by the perturbation for the vertical and horizontal expansion of a moving object, while they showed decreased performance when the perturbation was introduced with a bearing angle. These findings suggest that predicting collisions with moving objects deteriorates with aging because the perception of object expansion is impaired with aging.

A Case for Raising the Camera: A Driving Simulator Test of Camera-Monitor Systems

OBJECTIVE

This experiment provides a first-of-its-kind driving-simulator study to investigate the feasibility of camera-monitor systems (CMS) with displaced side-mounted cameras in sedans.

BACKGROUND

Among the increasing number of studies investigating the replacement of side-mounted rearview mirrors with CMS, the placement of side-mounted cameras has been largely neglected. Moreover, user preferences with respect to camera placement have not been validated in a driving simulator. Past research merely has shown that the vertical camera position can affect distance perception.

METHOD

In a driving simulator experiment, we investigated the effects of rearward camera placement on driver acceptance and performance. Thirty-six participants performed multiple lane changes in a last safe-gap paradigm. The camera position, ego-velocity, and velocity of the approaching vehicle varied across the experiment.

RESULTS

The results suggest a clear preference for a high rearward perspective, whereas participants disliked the lower viewpoint. However, these stark differences were only marginally mirrored in lane change performance. Average safety margins tended to decrease and their variation tended to increase for the low camera position.

CONCLUSION

Even if the impact of the camera position on driving behavior seems to be small in sedans, driver expectations show clear-cut preferences. When designing CMS, this should be taken into account, as these preferences could promote the use of CMS and thus their positive impact on safety.

APPLICATION

Designers should place side-mounted cameras as high as possible to increase acceptance of CMS. Low camera positions are not recommended, as they might decrease safety margins and are not appreciated by drivers.

Overestimated time-to-collision for quiet vehicles: Evidence from a study using a novel audiovisual virtual-reality system for traffic scenarios

To avoid collision, pedestrians intending to cross a road need to estimate the time-to-collision (TTC) of an approaching vehicle. Here, we present a novel interactive audiovisual virtual-reality system for investigating how the acoustic characteristics (loudness and engine type) of vehicles influence the TTC estimation. Using acoustic recordings of real vehicles as source signals, the dynamic spatial sound fields corresponding to a vehicle approaching in an urban setting are generated based on physical modeling of the sound propagation between vehicle and pedestrian and are presented via sound field synthesis. We studied TTC estimation for vehicles with internal combustion engine and for loudness-matched electric vehicles. The vehicle sound levels were varied by 10 dB, independently of the speed, presented TTC, and vehicle type. In an auditory-only condition, the cars were not visible, and lower loudness of the cars resulted in considerably longer TTC estimates. Importantly, the loudness of the cars also had a significant effect in the same direction on the TTC estimates in an audiovisual condition, where the cars were additionally visually presented via interactive virtual-reality simulations. Thus, pedestrians use auditory information when estimating TTC, even when full visual information is available. At equal loudness, the TTC judgments for electric and conventional vehicles were virtually identical, indicating that loudness has a stronger effect than spectral differences. Because TTC overestimations can result in risky road crossing decisions, the results imply that vehicle loudness should be considered as an important factor in pedestrian safety.

Wider is better but sharper is not: optimizing the image of camera-monitor systems

The replacement of rear-view mirrors with camera-monitor systems introduces new opportunities for design, such as altering the image quality and the rearward field-of-view. We investigated how the image quality and field-of-view might affect the distance and time-to-contact estimation of other vehicles. Eighty-six subjects estimated either their egocentric distance to a stationary vehicle (Experiment I) or the time-to-contact to an approaching vehicle (Experiment II). Throughout the experiments, the pixel density and either the field-of-view or the viewing condition varied. A larger field-of-view increased distance estimation accuracy and confidence. Reduced pixel density led to larger estimates. In contrast, reduced pixel density and simulated dirt shortened time-to-contact estimates. This is compatible with a safety strategy applied under conditions of impaired vision. Moreover, a limited benefit was observed for higher pixel densities. Therefore, camera-monitor systems with large field-of-view and a pixel density of around 300 ppi could ensure accurate TTC and distance estimation. Practitioner summary: A camera's field-of-view and image quality are important parameters for camera-monitor systems. In two experiments, we investigated the effects of these two parameters on rearward distance and time-to-contact estimation. Whereas a larger field-of-view improved distance estimation accuracy, increasing the pixel density had a limited effect in the estimation of time-to-contact.

Bumblebees display characteristics of active vision during robust obstacle avoidance flight

Insects are remarkable flyers and capable of navigating through highly cluttered environments. We tracked the head and thorax of bumblebees freely flying in a tunnel containing vertically oriented obstacles to uncover the sensorimotor strategies used for obstacle detection and collision avoidance. Bumblebees presented all the characteristics of active vision during flight by stabilizing their head relative to the external environment and maintained close alignment between their gaze and flightpath. Head stabilization increased motion contrast of nearby features against the background to enable obstacle detection. As bees approached obstacles, they appeared to modulate avoidance responses based on the relative retinal expansion velocity (RREV) of obstacles and their maximum evasion acceleration was linearly related to RREVmax. Finally, bees prevented collisions through rapid roll manoeuvres implemented by their thorax. Overall, the combination of visuo-motor strategies of bumblebees highlights elegant solutions developed by insects for visually guided flight through cluttered environments.

Estimating time-to-contact when vision is impaired

Often, we have to rely on limited information when judging time-to-contact (TTC), as for example, when driving in foul weather, or in situations where we would need reading glasses but do not have them handy. However, most existing studies on the ability to judge TTC have worked with optimal visual stimuli. In a prediction motion task, we explored to what extent TTC estimation is affected by visual stimulus degradation. A simple computer-simulated object approached the observer at constant speed either with clear or impaired vision. It was occluded after 1 or 1.5 s. The observers extrapolated the object's motion and pressed a button when they thought the object would have collided with them. We found that dioptric blur and simulated snowfall shortened TTC-estimates. Contrast reduction produced by a virtual semi-transparent mask lengthened TTC estimates, which could be the result of distance overestimation or speed underestimation induced by the lower contrast or the increased luminance of the mask. We additionally explored the potential influence of arousal and valence, although they played a minor role for basic TTC estimation. Our findings suggest that vision impairments have adverse effects on TTC estimation, depending on the specific type of degradation and the changes of the visual environmental cues which they cause.

The Ups and Downs of Camera-Monitor Systems: The Effect of Camera Position on Rearward Distance Perception

OBJECTIVE

This study investigates the effects of different positions of side-mounted rear-view cameras on distance estimation of drivers.

BACKGROUND

Camera-monitor systems bring advantages as compared to conventional rear-view mirrors, such as improved aerodynamics and enlarged field-of-view. Applied research has mainly focused on the comparison between cameras and mirrors or on positioning of in-vehicle monitors. However, the positioning of the exterior camera awaits investigation given that the perspective of the observer at does affect depth perception at large.

METHOD

In two experiments, a total of 50 students estimated metric distances to static vehicles presented in realistic or 3D-rendered pictures. The pictures depicted the rearward scene of a car following the driver as viewed through a camera at varying vertical and horizontal positions. The following vehicle's size and environmental information varied among conditions and experiments.

RESULTS

Lower camera positions led to distance overestimation and higher positions to underestimation. The effect increased as the distance to the following vehicle decreased. Moreover, larger vehicles led to stronger distance underestimation, especially in low camera positions. Interestingly, the main effect of camera position disappeared when the ego-vehicles' back was visible.

CONCLUSION

Different rearward viewpoints affect distance estimation of drivers, especially in close distances. However, a visible reference of one's own vehicle seems to mostly compensate this effect.

APPLICATION

In general, the rear-view camera should be mounted rather higher and to the front of the vehicle. Also, the vehicle's back should always be visible. Low camera positions are not recommended.

Integration of predictions and afferent signals in body ownership

We aimed at investigating the contribution of sensory predictions triggered by the sight of an object moving towards the body for the sense of body ownership. We used a recently developed psychophysical discrimination task to assess body ownership in the rubber hand illusion. In this task, the participants had to choose which of the two right rubber hands in view felt most like their own, and the ownership discriminations were fitted to psychometric curves. In the current study, we occluded the visual impressions of the object moving towards one of the rubber hands (during the first two-thirds of the path) and only revealed the final third of the object's movement trajectory when it touched the rubber hand (approach-occluded condition). Alternatively, we occluded only the final part so that the main part of the movement towards the model hand was visible (touch-occluded). We compared these two conditions to an illusion baseline condition where the object was visible during the entire trajectory and contact (no-occlusion). The touch-occluded condition produced equally strong hand ownership as the baseline condition with no occlusion, while ownership perception was significantly reduced when vision of the object approaching the rubber hand was occluded (approach-occluded). Our results show that tactile predictions generated from seeing an object moving towards the body are temporally exact, and they contribute to the rubber hand illusion by integrating with temporally congruent afferent sensory signals. This finding highlights the importance of multisensory predictions in peripersonal space, object permanence, and the interplay between bottom-up sensory signals and top-down predictions in body ownership.

Time-to-contact perception in the brain

Time-to-contact (TTC) perception refers to the ability of an observer to estimate the remaining time before an object reaches a point in the environment, and is of crucial importance in daily life. Noninvasive correlational approaches have identified several brain areas sensitive to TTC information. Here we report the results of two studies, including one during an awake brain surgery, that aimed to identify the specific areas causally engaged in the TTC estimation process. In Study 1, we tested 40 patients with brain tumor in a TTC estimation task. The results showed that four of the six patients with impaired performance had tumors in right upper parietal cortex, although this tumoral location represented only six over 40 patients. In Study 2, 15 patients underwent awake brain surgery electrostimulation mapping to examine the implication of various brain areas in the TTC estimation process. We acquired and normalized to MNI space the coordinates of the functional areas that influenced task performance. Our results seem to demonstrate that the early stage of the TTC estimation process involved specific cortical territories in the ventral region of the right intraparietal sulcus. Downstream processing of TTC could also involve the frontal eye field (middle frontal gyrus) related to ocular search. We also found that deactivating language areas in the left hemisphere interfered with the TTC estimation process. These findings demonstrate a fine grained, cortical representation of TTC processing close to the ventral right intraparietal sulcus and complement those described in other human studies.

Brain activity during time to contact estimation: an EEG study

Understanding the neural mechanisms associated with time to contact (TTC) estimation is an intriguing but challenging task. Despite the importance of TTC estimation in our everyday life, few studies have been conducted on it, and there are still a lot of unanswered questions and unknown aspects of this issue. In this study, we intended to address one of these unknown aspects. We used independent component analysis to systematically assess EEG substrates associated with TTC estimation using two experiments: (1) transversal motion experiment (when a moving object passes transversally in the frontoparallel plane from side to side in front of the observer), and (2) head-on motion experiment (when the observer is on the motion path of the moving object). We also studied the energy of all EEG sources in these two experiments. The results showed that brain regions involved in the transversal and head-on motion experiments were the same. However, the energy used by some brain regions in the head-on motion experiment, including some regions in left parietotemporal and left frontal lobes, was significantly higher than the energy used by those regions in the transversal motion experiment. These brain regions are dominantly associated with different kinds of visual attention, integration of visual information, and responding to visual motion.

Impending Collision Judgment from an Egocentric Perspective in Real and Virtual Environments: A Review

The human egocentric perception of approaching objects and the related perceptual processes have been of interest to researchers for several decades. This article gives a literature review on numerous studies that investigated the phenomenon when an object approaches an observer (or the other way around) with the goal to single out factors that influence the perceptual process. A taxonomy of metrics is followed by a breakdown of different experimental measurement methods. Thereinafter, potential factors affecting the judgment of approaching objects are compiled and debated while divided into human factors (e.g., gender, age, and driving experience), compositional factors (e.g., approaching velocity, spatial distance, and observation time), and technical factors (e.g., field of view, stereoscopy, and display contrast). Experimental findings are collated, juxtaposed, and critically discussed. With virtual-reality devices having taken a tremendous developmental leap forward in the past few years, they have been able to gain ground in experimental research. Therefore, special attention in this article is also given to the perception of approaching objects in virtual environments and put in contrast to the perception in reality.

Measuring Pedestrian Collision Detection With Peripheral Field Loss and the Impact of Peripheral Prisms

Purpose

Peripheral field loss (PFL) due to retinitis pigmentosa, choroideremia, or glaucoma often results in a highly constricted residual central field, which makes it difficult for patients to avoid collision with approaching pedestrians. We developed a virtual environment to evaluate the ability of patients to detect pedestrians and judge potential collisions. We validated the system with both PFL patients and normally sighted subjects with simulated PFL. We also tested whether properly placed high-power prisms may improve pedestrian detection.

Methods

A virtual park-like open space was rendered using a driving simulator (configured for walking speeds), and pedestrians in testing scenarios appeared within and outside the residual central field. Nine normally sighted subjects and eight PFL patients performed the pedestrian detection and collision judgment tasks. The performance of the subjects with simulated PFL was further evaluated with field of view expanding prisms.

Results

The virtual system for testing pedestrian detection and collision judgment was validated. The performance of PFL patients and normally sighted subjects with simulated PFL were similar. The prisms for simulated PFL improved detection rates, reduced detection response times, and supported reasonable collision judgments in the prism-expanded field; detections and collision judgments in the residual central field were not influenced negatively by the prisms.

Conclusions

The scenarios in a virtual environment are suitable for evaluating PFL and the impact of field of view expanding devices.

Translational Relevance

This study validated an objective means to evaluate field expansion devices in reproducible near-real-life settings.

Judging time-to-passage of looming sounds: Evidence for the use of distance-based information

Perceptual judgments are an essential mechanism for our everyday interaction with other moving agents or events. For instance, estimation of the time remaining before an object contacts or passes us is essential to act upon or to avoid that object. Previous studies have demonstrated that participants use different cues to estimate the time to contact or the time to passage of approaching visual stimuli. Despite the considerable number of studies on the judgment of approaching auditory stimuli, not much is known about the cues that guide listeners' performance in an auditory Time-to-Passage (TTP) task. The present study evaluates how accurately participants judge approaching white-noise stimuli in a TTP task that included variable occlusion periods (portion of the presentation time where the stimulus is not audible). Results showed that participants were able to accurately estimate TTP and their performance, in general, was weakly affected by occlusion periods. Moreover, we looked into the psychoacoustic variables provided by the stimuli and analysed how binaural cues related with the performance obtained in the psychophysical task. The binaural temporal difference seems to be the psychoacoustic cue guiding participants' performance for lower amounts of occlusion, while the binaural loudness difference seems to be the cue guiding performance for higher amounts of occlusion. These results allowed us to explain the perceptual strategies used by participants in a TTP task (maintaining accuracy by shifting the informative cue for TTP estimation), and to demonstrate that the psychoacoustic cue guiding listeners' performance changes according to the occlusion period.

Audiovisual Integration of Time-to-Contact Information for Approaching Objects

Previous studies of time-to-collision (TTC) judgments of approaching objects focused on effectiveness of visual TTC information in the optical expansion pattern (e.g., visual tau, disparity). Fewer studies examined effectiveness of auditory TTC information in the pattern of increasing intensity (auditory tau), or measured integration of auditory and visual TTC information. Here, participants judged TTC of an approaching object presented in the visual or auditory modality, or both concurrently. TTC information provided by the modalities was jittered slightly against each other, so that auditory and visual TTC were not perfectly correlated. A psychophysical reverse correlation approach was used to estimate the influence of auditory and visual cues on TTC estimates. TTC estimates were shorter in the auditory than the visual condition. On average, TTC judgments in the audiovisual condition were not significantly different from judgments in the visual condition. However, multiple regression analyses showed that TTC estimates were based on both auditory and visual information. Although heuristic cues (final sound pressure level, final optical size) and more reliable information (relative rate of change in acoustic intensity, optical expansion) contributed to auditory and visual judgments, the effect of heuristics was greater in the auditory condition. Although auditory and visual information influenced judgments, concurrent presentation of both did not result in lower response variability compared to presentation of either one alone; there was no multimodal advantage. The relative weightings of heuristics and more reliable information differed between auditory and visual TTC judgments, and when both were available, visual information was weighted more heavily.

Errors in motion processing amongst older drivers may increase accident risk

Accident statistics highlight that older drivers are more frequently involved in right-of-way collisions than younger drivers. Accurately gauging vehicle speed is critical for judgement of when to pull out from a junction safely in front of oncoming traffic. We used psychophysical methods to measure drivers' ability to discriminate between different rates of looming presented by vehicles approaching at different speeds. We demonstrate that sensitivity to approach speed reduces by between 2.8 and 3.4 mph, dependent upon vehicle type, for every decade that age increases. We show that perceptual limitations for drivers over the age of 75 years can lead to a 50% reduction in time available to perform traffic manoeuvres, which may contribute in part to their overrepresentation in casualty statistics at junction. Results are discussed in terms of implications for road safety policy.