Exploring the link between time to collision and representational momentum

Representational horizon and visual space orientation: An investigation into the role of visual contextual cues on spatial mislocalisations

The perceived offset position of a moving target has been found to be displaced forward, in the direction of motion (Representational Momentum; RM), downward, in the direction of gravity (Representational Gravity; RG), and, recently, further displaced along the horizon implied by the visual context (Representational Horizon; RH). The latter, while still underexplored, offers the prospect to clarify the role of visual contextual cues in spatial orientation and in the perception of dynamic events. As such, the present work sets forth to ascertain the robustness of Representational Horizon across varying types of visual contexts, particularly between interior and exterior scenes, and to clarify to what degree it reflects a perceptual or response phenomenon. To that end, participants were shown targets, moving along one out of several possible trajectories, overlaid on a randomly chosen background depicting either an interior or exterior scene rotated -22.5º, 0º, or 22.5º in relation to the actual vertical. Upon the vanishing of the target, participants were required to indicate its last seen location with a computer mouse. For half the participants, the background vanished with the target while for the remaining it was kept visible until a response was provided. Spatial localisations were subjected to a discrete Fourier decomposition procedure to obtain independent estimates of RM, RG, and RH. Outcomes showed that RH's direction was biased towards the horizon implied by the visual context, but solely for exterior scenes, and irrespective of its presence or absence during the spatial localisation response, supporting its perceptual/representational nature.

Human estimates of descending objects' motion are more accurate than those of ascending objects regardless of gravity information

Humans can accurately estimate and track object motion, even if it accelerates. Research shows that humans exhibit superior estimation and tracking performance for descending (falling) than ascending (rising) objects. Previous studies presented ascending and descending targets along the gravitational and body axes in an upright posture. Thus, it is unclear whether humans rely on congruent information between the direction of the target motion and gravity or the direction of the target motion and longitudinal body axes. Two experiments were conducted to explore these possibilities. In Experiment 1, participants estimated the arrival time at a goal for both upward and downward motion of targets along the longitudinal body axis in the upright (both axes of target motion and gravity congruent) and supine (both axes incongruent) postures. In Experiment 2, smooth pursuit eye movements were assessed while tracking both targets in the same postures. Arrival time estimation and smooth pursuit eye movement performance were consistently more accurate for downward target motion than for upward motion, irrespective of posture. These findings suggest that the visual experience of seeing an object moving along an observer's leg side in everyday life may influence the ability to accurately estimate and track the descending object's motion.

Relationships between the magnitude of representational momentum and the spatial and temporal anticipatory judgments of opponent's kicks in taekwondo

For successful actions in a fast, dynamic environment such as sports, a quick successful anticipation of a forthcoming environmental state is essential. However, the perceptual mechanisms involved in successful anticipation are not fully understood. This study examined the relationships between the magnitude of representational momentum (RM) as a forward displacement of the memory representation of the final position of a moving object (which implies that observers perceptually "see" a near future forthcoming dynamic environmental state) and the temporal and spatial anticipatory judgments of the opponent's high or middle kicks in taekwondo. Twenty-seven participants (university taekwondo club members and non-members) observed video clips of taekwondo kicks that vanished at one of 10 frame positions prior to the kick impact and performed three tasks consecutively: anticipatory coincidence timing (CT) with the arrival of kick impact, judgment of the kick type (high and middle kicks) by forced choice, and judgment of the vanishing frame position (measuring RM). Our results showed significant group effects for the number of correct kick-type judgments and the judgment threshold for kick-type choice (kick-typeJT), which was estimated in terms of individual psychometric function curves. A significant correlation was found between the magnitude of RM (estimated at kick-typeJT) and kick-typeJT, but not between the CT errors (estimated at kick-typeJT) and kick-typeJT. This indicates that the magnitude of RM may play an influential role in quick kick-type judgments, but not in coincidence timing while observing an opponent's kick motion. These findings suggest that subjective anticipatory perception or judgment of the future spatial state is vital to anticipatory actions under severe time constraints.

Time-to-Collision Estimations in Young Drivers with Autism Spectrum Disorder and Attention-Deficit/Hyperactivity Disorder

Individuals with attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) may exhibit driving difficulties due to cognitive impairments such as time perception difficulties, a construct related to the perception of time-to-collision (TTC). This study examined the timing abilities of drivers with ASD and ADHD. Sixty participants (n_ADHD = 20, n_ASD = 20, n_TD = 20) completed a time reproduction task and a TTC estimation task in a driving simulator. Results indicated drivers with ASD were less precise in time reproduction across all time intervals and over-reproduced time at shorter intervals. Drivers with ASD produced larger TTC estimates when driving at a faster speed compared to typically developing drivers. Drivers with ASD, but not ADHD, appear to present difficulties in time estimation abilities.

Representational momentum and anisotropies in nearby visual space

The possibility of anisotropies in visual space in and near the final location of a moving target was examined. Experiments 1 and 2 presented a moving target, and after the target vanished, participants indicated the final location of the leading or trailing edge of the target. Memory for both edges was displaced forward from the actual final locations, and the magnitude of displacement was smaller for the leading edge. Experiments 3 and 4 also presented stationary objects in front of and behind the final location of the target, and participants indicated the location of the nearest or farthest edge of one of the stationary objects. Memory for the near or far edge of an object in front of the target was displaced backward, and memory for the near or far edge of an object behind the target was displaced forward; the magnitude of displacement was larger for objects in front of the target and when the edge was farther away. The findings (a) suggest representational momentum is associated with an anisotropy of visual space that extends across and outward from the moving target and (b) are consistent with previous findings regarding estimation of time-to-contact, anorthoscopic perception, and memory psychophysics.

An Effect of Context on Whether Memory for Initial Position Exhibits a FröHlich Effect or an Onset Repulsion Effect

Memory for the initial and final positions of moving targets was examined. When targets appeared adjacent to the boundary of a larger enclosing window, memory for initial position exhibited a Fröhlich effect (i.e., a displacement forward), and when distance of initial position from the boundary increased, memory for initial position exhibited a smaller Fröhlich effect or an onset repulsion effect (i.e., a displacement backward). When targets vanished adjacent to the boundary of a larger enclosing window, memory for final position was displaced backward, and when distance of final position from the boundary increased, memory for final position did not exhibit significant displacement. These patterns differed from previously reported displacements of initial and final positions of targets presented on a blank background. Possible influences of attention and extrapolation of trajectory on whether memory for initial position exhibits a Fröhlich effect or an onset repulsion effect and on backward displacement in memory for final position are discussed.

Manipulating time and space: Collision prediction in peripersonal and extrapersonal space

Being able to predict potential collisions is a necessary survival prerequisite for all moving species. Temporal and spatial information is fundamental for this purpose. However, it is not clear yet if the peripersonal (i.e. near) and extrapersonal (i.e. far) distance between our body and the moving objects affects the way in which we can predict possible collisions. In order to assess this, we manipulated independently velocity and path of two balls moving one towards the other in such a way as to collide or not in peripersonal and extrapersonal space. In two experiments, participants had to judge if these balls were to collide or not. The results consistently showed a lower discrimination capacity and a more liberal tendency to predict collisions when the moving balls were in peripersonal space and their velocity was different rather than equal. This did not happen in extrapersonal space. Therefore, peripersonal space was particularly affected by temporal information. The possible link between the motor and anticipatory adaptive function of peripersonal space and collision prediction mechanisms is discussed.

Judging time-to-passage of looming sounds: Evidence for the use of distance-based information

Perceptual judgments are an essential mechanism for our everyday interaction with other moving agents or events. For instance, estimation of the time remaining before an object contacts or passes us is essential to act upon or to avoid that object. Previous studies have demonstrated that participants use different cues to estimate the time to contact or the time to passage of approaching visual stimuli. Despite the considerable number of studies on the judgment of approaching auditory stimuli, not much is known about the cues that guide listeners' performance in an auditory Time-to-Passage (TTP) task. The present study evaluates how accurately participants judge approaching white-noise stimuli in a TTP task that included variable occlusion periods (portion of the presentation time where the stimulus is not audible). Results showed that participants were able to accurately estimate TTP and their performance, in general, was weakly affected by occlusion periods. Moreover, we looked into the psychoacoustic variables provided by the stimuli and analysed how binaural cues related with the performance obtained in the psychophysical task. The binaural temporal difference seems to be the psychoacoustic cue guiding participants' performance for lower amounts of occlusion, while the binaural loudness difference seems to be the cue guiding performance for higher amounts of occlusion. These results allowed us to explain the perceptual strategies used by participants in a TTP task (maintaining accuracy by shifting the informative cue for TTP estimation), and to demonstrate that the psychoacoustic cue guiding listeners' performance changes according to the occlusion period.

Time-to-contact estimation modulated by implied friction

The present study demonstrated that friction cues for target motion affect time-to-contact (TTC) estimation. A circular target moved in a linear path with a constant velocity and was gradually occluded by a static rectangle. The target moved with forward and backward spins or without spin. Observers were asked to respond at the time when the moving target appeared to pass the occluder. The results showed that TTC was significantly longer in the backward spin condition than in the forward and without-spin conditions. Moreover, similar results were obtained when a sound was used to imply friction. Our findings indicate that the observer's experiential knowledge of motion coupled with friction intuitively modulated their TTC estimation.

Cross-modal influences on representational momentum and representational gravity

Effects of cross-modal information on representational momentum and on representational gravity (ie on displacement of remembered location in the direction of target motion or in the direction of gravitational attraction, respectively) were examined. In experiment 1, ascending or descending visual motion (in the picture plane) was paired with ascending or descending auditory motion (in frequency space); motion was congruent (both ascending, both descending) or incongruent (one ascending, one descending). Memory for visual location or auditory pitch was probed. Congruence resulted in larger forward displacement for auditory pitch, but did not influence forward displacement for visual location. In experiment 2, horizontal visual motion was paired with ascending, descending, or no auditory motion. Memory for visual location was displaced downward with descending or no auditory motion, and downward displacement was larger for visual motion paired with descending auditory motion than for visual motion paired with ascending auditory motion. Effects of cross-modal information on displacement suggest representational momentum and representational gravity reflect high-level processing.

Extrapolation of vertical target motion through a brief visual occlusion

It is known that arbitrary target accelerations along the horizontal generally are extrapolated much less accurately than target speed through a visual occlusion. The extent to which vertical accelerations can be extrapolated through an occlusion is much less understood. Here, we presented a virtual target rapidly descending on a blank screen with different motion laws. The target accelerated under gravity (1g), decelerated under reversed gravity (-1g), or moved at constant speed (0g). Probability of each type of acceleration differed across experiments: one acceleration at a time, or two to three different accelerations randomly intermingled could be presented. After a given viewing period, the target disappeared for a brief, variable period until arrival (occluded trials) or it remained visible throughout (visible trials). Subjects were asked to press a button when the target arrived at destination. We found that, in visible trials, the average performance with 1g targets could be better or worse than that with 0g targets depending on the acceleration probability, and both were always superior to the performance with -1g targets. By contrast, the average performance with 1g targets was always superior to that with 0g and -1g targets in occluded trials. Moreover, the response times of 1g trials tended to approach the ideal value with practice in occluded protocols. To gain insight into the mechanisms of extrapolation, we modeled the response timing based on different types of threshold models. We found that occlusion was accompanied by an adaptation of model parameters (threshold time and central processing time) in a direction that suggests a strategy oriented to the interception of 1g targets at the expense of the interception of the other types of tested targets. We argue that the prediction of occluded vertical motion may incorporate an expectation of gravity effects.

The onset-repulsion effect and motion-induced mislocalization of a stationary object

The influence of a moving target on memory for the location of a briefly presented stationary object aligned with the initial location of that moving target was examined. Memory for the location of the stationary object was displaced backward (ie in the direction opposite to target motion), and memory for the initial location of the moving target was also displaced backward (consistent with an onset-repulsion effect); displacement of the stationary object did not differ from displacement of the moving target. Displacement in memory for the initial location of a moving target was not influenced by whether or not a stationary object aligned with that initial location was also presented. The results demonstrate that motion-induced mislocalization can occur in a direction other than the direction of motion, and are consistent with the hypothesis that dynamics of a moving target can influence memory for a nearby stationary object.

Optical flow and viewpoint change modulate the perception and memorization of complex motion

Participants observed a point-light character (PLC) performing a gymnastic movement. They either memorized the final PLC orientation from the initial viewpoint, to match it to a test posture (memory task), or judged whether the biological motion appeared continuous (perceptual task), despite a viewpoint change. The observer could be either static or virtually in motion (pan or track) while looking at the movement from the initial viewpoint. The presence of a spatial layout during virtual self-motion induced a global optical flow specifying the translational component of the PLC movement, rendering the event more predictable for the participants. A representational momentum effect was observed in the memory task, suggesting that when a visual stimulation, such as a PLC motion, is abruptly stopped, its dynamics survive. In contrast, structural and transformational invariants specifying the PLC motion were sufficient to solve the perceptual task accurately. Finally, both the remembering of the final posture and the perception of continuity degraded with an increase in viewpoint change due to tilt/slant posture orientation matching, indicating that orientation processes interfered with event perception.

Estimating Time-to-Collision with Retinitis Pigmentosa

This article reports on the ability of observers who are sighted and those with low vision to make time-to-collision (TTC) estimations using video. The TTC estimations made by the observers with low vision were comparable to those made by the sighted observers, and both groups made underestimation errors that were similar to those that were previously reported in the literature.

Representational momentum and related displacements in spatial memory: A review of the findings

Memory for the final location of a moving target is often displaced in the direction of target motion, and this has been referred to as representational momentum. Characteristics of the target (e.g., velocity, size, direction, and identity), display (e.g., target format, retention interval, and response method), context (landmarks, expectations, and attribution of motion source), and observer (e.g., allocation of attention, eye movements, and psychopathology) that influence the direction and magnitude of displacement are reviewed. Specific conclusions regarding numerous variables that influence displacement (e.g., presence of landmarks or surrounding context), as well as broad-based conclusions regarding displacement in general (e.g., displacement does not reflect objective physical principles, may reflect aspects of naive physics, does not solely reflect eye movements, may involve some modular processing, and reflects high-level processes) are drawn. A possible computational theory of displacement is suggested in which displacement (1) helps bridge the gap between perception and action and (2) plays a critical part in localizing stimuli in the environment.

A Clockwork Orange: Compensation opposing momentum in memory for location

Libet, Gleason, Wright, and Pearl's (1983; Libet, 1985) influential work using a clock-watching task suggests that voluntary actions are initiated in motor cortex prior to the point where the participant claims to have initiated that action. Joordens, van Duijn, and Spalek (2002) showed that a bias exists in this task with respect to the participants' reports of initiation times. Joordens et al. assumed that this bias was primarily due to motion cues that are very much like those used to elicit phenomena such as representational momentum. In the present Experiment 1, it is demonstrated that this bias disappears when a mouse-click response is used in place of a temporal-order judgment. This finding, however, is actually more confusing than clarifying given that the procedural parallels with representational momentum are still present and should be supporting a bias. In the three subsequent experiments the view that a bias is indeed present, but that it is opposed by an opposite-acting compensation process, is proposed and tested. Implications for both representational momentum and for the general use of clock-watching tasks (e.g., Libet et al., 1983) are highlighted.

Long range interactions between object-motion and self-motion in the perception of movement in depth

Self-motion through a three-dimensional array of objects creates a radial flow pattern on the retina. We superimposed a simulated object moving in depth on such a flow pattern to investigate the effect of the flow pattern on judgments of both the time to collision (TTC) with an approaching object and the trajectory of that object. Our procedure allowed us to decouple the direction and speed of simulated self motion-in-depth (MID) from the direction and speed of simulated object MID. In Experiment 1 we found that objects with the same closing speed were perceived to have a higher closing speed when self-motion and object-motion were in the same direction and a lower closing speed when they were in the opposite direction. This effect saturated rapidly as the ratio between the speeds of self-motion and object-motion was increased. In Experiment 2 we found that the perceived direction of object-MID was shifted towards the focus of expansion of the flow pattern. In Experiments 3 and 4 we found that the erroneous biases in perceived speed and direction produced by simulated self-motion were significantly reduced when binocular information about MID was added. These findings suggest that the large body of research that has studied motion perception using stationary observers has limited applicability to situations in which both the observer and the object are moving.