Long range interactions between object-motion and self-motion in the perception of movement in depth

The impact of visually simulated self-motion on predicting object motion

To interact successfully with moving objects in our environment we need to be able to predict their behavior. Predicting the position of a moving object requires an estimate of its velocity. When flow parsing during self-motion is incomplete-that is, when some of the retinal motion created by self-motion is incorrectly attributed to object motion-object velocity estimates become biased. Further, the process of flow parsing should add noise and lead to object velocity judgements being more variable during self-motion. Biases and lowered precision in velocity estimation should then translate to biases and lowered precision in motion extrapolation. We investigated this relationship between self-motion, velocity estimation and motion extrapolation with two tasks performed in a realistic virtual reality (VR) environment: first, participants were shown a ball moving laterally which disappeared after a certain time. They then indicated by button press when they thought the ball would have hit a target rectangle positioned in the environment. While the ball was visible, participants sometimes experienced simultaneous visual lateral self-motion in either the same or in the opposite direction of the ball. The second task was a two-interval forced choice task in which participants judged which of two motions was faster: in one interval they saw the same ball they observed in the first task while in the other they saw a ball cloud whose speed was controlled by a PEST staircase. While observing the single ball, they were again moved visually either in the same or opposite direction as the ball or they remained static. We found the expected biases in estimated time-to-contact, while for the speed estimation task, this was only the case when the ball and observer were moving in opposite directions. Our hypotheses regarding precision were largely unsupported by the data. Overall, we draw several conclusions from this experiment: first, incomplete flow parsing can affect motion prediction. Further, it suggests that time-to-contact estimation and speed judgements are determined by partially different mechanisms. Finally, and perhaps most strikingly, there appear to be certain compensatory mechanisms at play that allow for much higher-than-expected precision when observers are experiencing self-motion-even when self-motion is simulated only visually.

The impact of visually simulated self-motion on predicting object motion-A registered report protocol

To interact successfully with moving objects in our environment we need to be able to predict their behavior. Predicting the position of a moving object requires an estimate of its velocity. When flow parsing during self-motion is incomplete-that is, when some of the retinal motion created by self-motion is incorrectly attributed to object motion-object velocity estimates become biased. Further, the process of flow parsing should add noise and lead to object velocity judgements being more variable during self-motion. Biases and lowered precision in velocity estimation should then translate to biases and lowered precision in motion extrapolation. We investigate this relationship between self-motion, velocity estimation and motion extrapolation with two tasks performed in a realistic virtual reality (VR) environment: first, participants are shown a ball moving laterally which disappears after a certain time. They then indicate by button press when they think the ball would have hit a target rectangle positioned in the environment. While the ball is visible, participants sometimes experience simultaneous visual lateral self-motion in either the same or in the opposite direction of the ball. The second task is a two-interval forced choice task in which participants judge which of two motions is faster: in one interval they see the same ball they observed in the first task while in the other they see a ball cloud whose speed is controlled by a PEST staircase. While observing the single ball, they are again moved visually either in the same or opposite direction as the ball or they remain static. We expect participants to overestimate the speed of a ball that moves opposite to their simulated self-motion (speed estimation task), which should then lead them to underestimate the time it takes the ball to reach the target rectangle (prediction task). Seeing the ball during visually simulated self-motion should increase variability in both tasks. We expect to find performance in both tasks to be correlated, both in accuracy and precision.

Object speed perception during lateral visual self-motion

Judging object speed during observer self-motion requires disambiguating retinal stimulation from two sources: self-motion and object motion. According to the Flow Parsing hypothesis, observers estimate their own motion, then subtract the retinal corresponding motion from the total retinal stimulation and interpret the remaining stimulation as pertaining to object motion. Subtracting noisier self-motion information from retinal input should lead to a decrease in precision. Furthermore, when self-motion is only simulated visually, self-motion is likely to be underestimated, yielding an overestimation of target speed when target and observer move in opposite directions and an underestimation when they move in the same direction. We tested this hypothesis with a two-alternative forced-choice task in which participants judged which of two motions, presented in an immersive 3D environment, was faster. One motion interval contained a ball cloud whose speed was selected dynamically according to a PEST staircase, while the other contained one big target travelling laterally at a fixed speed. While viewing the big target, participants were either static or experienced visually simulated lateral self-motion in the same or opposite direction of the target. Participants were not significantly biased in either motion profile, and precision was only significantly lower when participants moved visually in the direction opposite to the target. We conclude that, when immersed in an ecologically valid 3D environment with rich self-motion cues, participants perceive an object's speed accurately at a small precision cost, even when self-motion is simulated only visually.

Accuracy and Tuning of Flow Parsing for Visual Perception of Object Motion During Self-Motion

How do we perceive object motion during self-motion using visual information alone? Previous studies have reported that the visual system can use optic flow to identify and globally subtract the retinal motion component resulting from self-motion to recover scene-relative object motion, a process called flow parsing. In this article, we developed a retinal motion nulling method to directly measure and quantify the magnitude of flow parsing (i.e., flow parsing gain) in various scenarios to examine the accuracy and tuning of flow parsing for the visual perception of object motion during self-motion. We found that flow parsing gains were below unity for all displays in all experiments; and that increasing self-motion and object motion speed did not alter flow parsing gain. We conclude that visual information alone is not sufficient for the accurate perception of scene-relative motion during self-motion. Although flow parsing performs global subtraction, its accuracy also depends on local motion information in the retinal vicinity of the moving object. Furthermore, the flow parsing gain was constant across common self-motion or object motion speeds. These results can be used to inform and validate computational models of flow parsing.

Effects of Adjacent Vehicles on Judgments of a Lead Car During Car Following

OBJECTIVE

Two experiments were conducted to determine whether detection of the onset of a lead car's deceleration and judgments of its time to contact (TTC) were affected by the presence of vehicles in lanes adjacent to the lead car.

BACKGROUND

In a previous study, TTC judgments of an approaching object by a stationary observer were influenced by an adjacent task-irrelevant approaching object. The implication is that vehicles in lanes adjacent to a lead car could influence a driver's ability to detect the lead car's deceleration and to make judgments of its TTC.

METHOD

Displays simulated car-following scenes in which two vehicles in adjacent lanes were either present or absent. Participants were instructed to respond as soon as the lead car decelerated (Experiment 1) or when they thought their car would hit the decelerating lead car (Experiment 2).

RESULTS

The presence of adjacent vehicles did not affect response time to detect deceleration of a lead car but did affect the signal detection theory measure of sensitivity d' and the number of missed deceleration events. Judgments of the lead car's TTC were shorter when adjacent vehicles were present and decelerated early than when adjacent vehicles were absent.

CONCLUSION

The presence of vehicles in nearby lanes can affect a driver's ability to detect a lead car's deceleration and to make subsequent judgments of its TTC.

APPLICATION

Results suggest that nearby traffic can affect a driver's ability to accurately judge a lead car's motion in situations that pose risk for rear-end collisions.

The effect of monocular depth cues on the detection of moving objects by moving observers

An observer moving through the world must be able to identify and locate moving objects in the scene. In principle, one could accomplish this task by detecting object images moving at a different angle or speed than the images of other items in the optic flow field. While angle of motion provides an unambiguous cue that an object is moving relative to other items in the scene, a difference in speed could be due to a difference in the depth of the objects and thus is an ambiguous cue. We tested whether the addition of information about the distance of objects from the observer, in the form of monocular depth cues, aided detection of moving objects. We found that thresholds for detection of object motion decreased as we increased the number of depth cues available to the observer.

Multisensory self-motion compensation during object trajectory judgments

Judging object trajectory during self-motion is a fundamental ability for mobile organisms interacting with their environment. This fundamental ability requires the nervous system to compensate for the visual consequences of self-motion in order to make accurate judgments, but the mechanisms of this compensation are poorly understood. We comprehensively examined both the accuracy and precision of observers' ability to judge object trajectory in the world when self-motion was defined by vestibular, visual, or combined visual-vestibular cues. Without decision feedback, subjects demonstrated no compensation for self-motion that was defined solely by vestibular cues, partial compensation (47%) for visually defined self-motion, and significantly greater compensation (58%) during combined visual-vestibular self-motion. With decision feedback, subjects learned to accurately judge object trajectory in the world, and this generalized to novel self-motion speeds. Across conditions, greater compensation for self-motion was associated with decreased precision of object trajectory judgments, indicating that self-motion compensation comes at the cost of reduced discriminability. Our findings suggest that the brain can flexibly represent object trajectory relative to either the observer or the world, but a world-centered representation comes at the cost of decreased precision due to the inclusion of noisy self-motion signals.

Vestibular facilitation of optic flow parsing

Simultaneous object motion and self-motion give rise to complex patterns of retinal image motion. In order to estimate object motion accurately, the brain must parse this complex retinal motion into self-motion and object motion components. Although this computational problem can be solved, in principle, through purely visual mechanisms, extra-retinal information that arises from the vestibular system during self-motion may also play an important role. Here we investigate whether combining vestibular and visual self-motion information improves the precision of object motion estimates. Subjects were asked to discriminate the direction of object motion in the presence of simultaneous self-motion, depicted either by visual cues alone (i.e. optic flow) or by combined visual/vestibular stimuli. We report a small but significant improvement in object motion discrimination thresholds with the addition of vestibular cues. This improvement was greatest for eccentric heading directions and negligible for forward movement, a finding that could reflect increased relative reliability of vestibular versus visual cues for eccentric heading directions. Overall, these results are consistent with the hypothesis that vestibular inputs can help parse retinal image motion into self-motion and object motion components.

Use of speed cues in the detection of moving objects by moving observers

When an observer moves through an environment containing stationary and moving objects, he or she must be able to determine which objects are moving relative to the others in order to navigate successfully and avoid collisions. We investigated whether image speed can be used as a cue to detect a moving object in the scene. Our results show that image speed can be used to detect moving objects as long as the object is moving sufficiently faster or slower than it would if it were part of the stationary scene.

Global flow impacts time-to-passage judgments based on local motion cues

We assessed the effect of the coherence of optic flow on time-to-passage judgments in order to investigate the strategies that observers use when local expansion information is reduced or lacking. In the standard display, we presented a cloud of dots whose image expanded consistent with constant observer motion. The dots themselves, however, did not expand and were thus devoid of object expansion cues. Only the separations between the dots expanded. Subjects had to judge which of two colored target dots, presented at different simulated depths and lateral displacements would pass them first. Image velocities of the target dots were chosen so as to correlate with time-to-passage only some of the time. When optic flow was mainly incoherent, subjects' responses were biased and relied on image velocities rather than on global flow analysis. However, the bias induced by misleading image velocity cues diminished as a function of the coherence of the optic flow. We discuss the results in the context of a global tau mechanism and settle a debate whether local expansion cues or optic flow analysis are the basis for time-to-passage estimation.

Aging and the detection of observer and moving object collisions

The authors examined age-related differences in the detection of collision events. Older and younger observers were presented with displays simulating approaching objects that would either collide or pass by the observer. In 4 experiments, the authors found that older observers, as compared with younger observers, had less sensitivity in detecting collisions with an increase in speed, at shorter display durations, and with longer time-to-contact conditions. Older observers also had greater difficulty when the scenario simulated observer motion, suggesting that older observers have difficulty discriminating object motion expansion from background expansion from observer motion. The results of these studies support the expansion sensitivity hypothesis-that age-related decrements in detecting collision events involving moving objects are the result of a decreased sensitivity to recover expansion information.

Unconfounding the direction of motion in depth, time to passage and rotation rate of an approaching object

Observers were presented with a set of 216 simulated approaching textured baseballs in random order. In Experiment 1 each had a different combination of time to passage (TTP), direction of motion in depth (dMID) in the vertical plane and total change in angular size (Deltatheta). In Experiments 2 and 3 each had a different combination of TTP, dMID and rate of ball rotation (RR). When required to discriminate TTP and dMID in separate experimental blocks for a non-rotating baseball (Experiment 1), observers could not discriminate dMID independently of variations in TTP but instead showed a bias towards perceiving objects approaching on a trajectory close to the nose as having a shorter TTP than objects approaching on a trajectory that would miss the face. When required to discriminate TTP, dMID and RR in separate experimental blocks (Experiment 2), TTP judgments were again influenced by dMID but could be made independently of RR. Judgments of the relative dMID were affected by variations in RR and rotation direction: for simulated overspin the (i.e., the top of the ball spins towards the observer) perceived ball trajectory was biased towards the ground whereas for simulated underspin the perceived ball trajectory was biased towards the sky. RR could be discriminated independently of both TTP and dMID. When required to make all three of these judgments simultaneously on each trial (Experiment 3) discrimination thresholds were not appreciably different from those found in Experiment 2. We conclude that TTP, dMID and RR can be estimated in parallel but not completely independently within the human visual system.