Eye movements and visible persistence explain the mislocalization of the final position of a moving target

Motion extrapolation in sport expertise: Representational momentum and representational gravity in volleyball athletes

When people indicate the vanishing location of a moving target that suddenly disappears, systematic errors forward (in the direction of motion) and downward (in the direction of gravity) emerge. These spatial displacements were coined, respectively, Representational Momentum and Representational Gravity, and are believed to reflect internalized ecologically relevant physical invariants useful for the anticipation of future states of an event. Previous research has shown that sports athletes exhibit increased Representational Momentum, indicating enhanced motion extrapolation and anticipation, albeit it is still not clear up to what degree this effect is specific for the expertise context or if it generalizes to other dynamic events. Furthermore, the influence of expertise on Representational Gravity, particularly in contexts where anticipation of vertically moving objects is crucial, remains understudied. This study aimed to address these gaps by focusing on Volleyball as a context of expertise due to the prevalence of fast vertically moving balls. Volleyball athletes and non-athletes indicated the perceived offset location of a smoothly moving target, which moved at a constant speed or was subjected to acceleration/deceleration, embedded either in a Volleyball or neutral context. Outcomes revealed that for the Volleyball context, athletes, but not non-athletes, revealed a significant trend to misperceive targets moving along the left diagonal to be further displaced forward beyond what would be expected due to Representational Momentum alone. This finding is discussed in relation to the natural statistics of Volleyball games, where crossed ball trajectories, particularly by the outside hitter, are more prevalent, fast, and offensive, requiring better anticipation to be efficiently dealt with.

Prediction of time to contact under perceptual and contextual uncertainties

Accurately estimating time to contact (TTC) is crucial for successful interactions with moving objects, yet it is challenging under conditions of sensory and contextual uncertainty, such as occlusion. In this study, participants engaged in a prediction motion task, monitoring a target that moved rightward and an occluder. The participants' task was to press a key when they predicted the target would be aligned with the occluder's right edge. We manipulated sensory uncertainty by varying the visible and occluded periods of the target, thereby modulating the time available to integrate sensory information and the duration over which motion must be extrapolated. Additionally, contextual uncertainty was manipulated by having a predictable and unpredictable condition, meaning the occluder either reliably indicated where the moving target would disappear or provided no such indication. Results showed differences in accuracy between the predictable and unpredictable occluder conditions, with different eye movement patterns in each case. Importantly, the ratio of the time the target was visible, which allows for the integration of sensory information, to the occlusion time, which determines perceptual uncertainty, was a key factor in determining performance. This ratio is central to our proposed model, which provides a robust framework for understanding and predicting human performance in dynamic environments with varying degrees of uncertainty.

Representational horizon and visual space orientation: An investigation into the role of visual contextual cues on spatial mislocalisations

The perceived offset position of a moving target has been found to be displaced forward, in the direction of motion (Representational Momentum; RM), downward, in the direction of gravity (Representational Gravity; RG), and, recently, further displaced along the horizon implied by the visual context (Representational Horizon; RH). The latter, while still underexplored, offers the prospect to clarify the role of visual contextual cues in spatial orientation and in the perception of dynamic events. As such, the present work sets forth to ascertain the robustness of Representational Horizon across varying types of visual contexts, particularly between interior and exterior scenes, and to clarify to what degree it reflects a perceptual or response phenomenon. To that end, participants were shown targets, moving along one out of several possible trajectories, overlaid on a randomly chosen background depicting either an interior or exterior scene rotated -22.5º, 0º, or 22.5º in relation to the actual vertical. Upon the vanishing of the target, participants were required to indicate its last seen location with a computer mouse. For half the participants, the background vanished with the target while for the remaining it was kept visible until a response was provided. Spatial localisations were subjected to a discrete Fourier decomposition procedure to obtain independent estimates of RM, RG, and RH. Outcomes showed that RH's direction was biased towards the horizon implied by the visual context, but solely for exterior scenes, and irrespective of its presence or absence during the spatial localisation response, supporting its perceptual/representational nature.

Relationships between the magnitude of representational momentum and the spatial and temporal anticipatory judgments of opponent's kicks in taekwondo

For successful actions in a fast, dynamic environment such as sports, a quick successful anticipation of a forthcoming environmental state is essential. However, the perceptual mechanisms involved in successful anticipation are not fully understood. This study examined the relationships between the magnitude of representational momentum (RM) as a forward displacement of the memory representation of the final position of a moving object (which implies that observers perceptually "see" a near future forthcoming dynamic environmental state) and the temporal and spatial anticipatory judgments of the opponent's high or middle kicks in taekwondo. Twenty-seven participants (university taekwondo club members and non-members) observed video clips of taekwondo kicks that vanished at one of 10 frame positions prior to the kick impact and performed three tasks consecutively: anticipatory coincidence timing (CT) with the arrival of kick impact, judgment of the kick type (high and middle kicks) by forced choice, and judgment of the vanishing frame position (measuring RM). Our results showed significant group effects for the number of correct kick-type judgments and the judgment threshold for kick-type choice (kick-typeJT), which was estimated in terms of individual psychometric function curves. A significant correlation was found between the magnitude of RM (estimated at kick-typeJT) and kick-typeJT, but not between the CT errors (estimated at kick-typeJT) and kick-typeJT. This indicates that the magnitude of RM may play an influential role in quick kick-type judgments, but not in coincidence timing while observing an opponent's kick motion. These findings suggest that subjective anticipatory perception or judgment of the future spatial state is vital to anticipatory actions under severe time constraints.

Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow

The growing intelligence and prevalence of drones have led to an increase in their disorderly and illicit usage, posing substantial risks to aviation and public safety. This paper focuses on addressing the issue of drone detection through surveillance cameras. Drone targets in images possess distinctive characteristics, including small size, weak energy, low contrast, and limited and varying features, rendering precise detection a challenging task. To overcome these challenges, we propose a novel detection method that extends the input of YOLOv5s to a continuous sequence of images and inter-frame optical flow, emulating the visual mechanisms employed by humans. By incorporating the image sequence as input, our model can leverage both temporal and spatial information, extracting more features of small and weak targets through the integration of spatiotemporal data. This integration augments the accuracy and robustness of drone detection. Furthermore, the inclusion of optical flow enables the model to directly perceive the motion information of drone targets across consecutive frames, enhancing its ability to extract and utilize features from dynamic objects. Comparative experiments demonstrate that our proposed method of extended input significantly enhances the network's capability to detect small moving targets, showcasing competitive performance in terms of accuracy and speed. Specifically, our method achieves a final average precision of 86.87%, representing a noteworthy 11.49% improvement over the baseline, and the speed remains above 30 frames per second. Additionally, our approach is adaptable to other detection models with different backbones, providing valuable insights for domains such as Urban Air Mobility and autonomous driving.

Spatiotemporal jump detection during continuous film viewing

Prior research on film viewing has demonstrated that participants frequently fail to notice spatiotemporal disruptions, such as scene edits in the movies. Whether such insensitivity to spatiotemporal disruptions extends beyond scene edits in film viewing is not well understood. Across three experiments, we created spatiotemporal disruptions by presenting participants with minute long movie clips, and occasionally jumping the movie clips ahead or backward in time. Participants were instructed to press a button when they noticed any disruptions while watching the clips. The results from experiments 1 and 2 indicate that participants failed to notice the disruptions in continuity about 10% to 30% of the time depending on the magnitude of the jump. In addition, detection rates were lower by approximately 10% when the videos jumped ahead in time compared to the backward jumps across all jump magnitudes, suggesting a role of knowledge about the future affects jump detection. An additional analysis used optic flow similarity during these disruptions. Our findings suggest that insensitivity to spatiotemporal disruptions during film viewing is influenced by knowledge about future states.

A dynamic noise background reveals perceptual motion extrapolation: The twinkle-goes illusion

We find that on a dynamic noise background, the perceived disappearance location of a moving object is shifted in the direction of motion. This “twinkle-goes” illusion does not require luminance- or chromaticity-based confusability of the object with the background, or on the amount of background motion energy in the same direction as the object motion. This suggests that the illusion is enabled by the dynamic noise masking the offset transients that otherwise accompany an object's disappearance. While these results are consistent with an anticipatory process that pre-activates positions ahead of the object's current position, additional findings suggest an alternative account: a continuation of attentional tracking after the object disappears. First, the shift increased with speed until over 1.2 revolutions per second (rps), nearing the attentional tracking limit. Second, the shift was greatly reduced when attention was divided between two moving objects. Finally, the illusion was associated with a delay in simple reaction time to the disappearance of the object. We propose that in the absence of offset transients, attentional tracking keeps moving for several tens of milliseconds after the target disappearance, and this causes one to hallucinate a moving object at the position of attention.

Resolving visual motion through perceptual gaps

Perceptual gaps can be caused by objects in the foreground temporarily occluding objects in the background or by eyeblinks, which briefly but frequently interrupt visual information. Resolving visual motion across perceptual gaps is particularly challenging, as object position changes during the gap. We examine how visual motion is maintained and updated through externally driven (occlusion) and internally driven (eyeblinks) perceptual gaps. Focusing on both phenomenology and potential mechanisms such as suppression, extrapolation, and integration, we present a framework for how perceptual gaps are resolved over space and time. We finish by highlighting critical questions and directions for future work.

Effects of Audiovisual Presentations on Visual Localization Errors: One or Several Multisensory Mechanisms?

The present study examines the extent to which temporal and spatial properties of sound modulate visual motion processing in spatial localization tasks. Participants were asked to locate the place at which a moving visual target unexpectedly vanished. Across different tasks, accompanying sounds were factorially varied within subjects as to their onset and offset times and/or positions relative to visual motion. Sound onset had no effect on the localization error. Sound offset was shown to modulate the perceived visual offset location, both for temporal and spatial disparities. This modulation did not conform to attraction toward the timing or location of the sounds but, demonstrably in the case of temporal disparities, to bimodal enhancement instead. Favorable indications to a contextual effect of audiovisual presentations on interspersed visual-only trials were also found. The short sound-leading offset asynchrony had equivalent benefits to audiovisual offset synchrony, suggestive of the involvement of early-level mechanisms, constrained by a temporal window, at these conditions. Yet, we tentatively hypothesize that the whole of the results and how they compare with previous studies requires the contribution of additional mechanisms, including learning-detection of auditory-visual associations and cross-sensory spread of endogenous attention.

Motion Extrapolation in Visual Processing: Lessons from 25 Years of Flash-Lag Debate

Because of the delays inherent in neural transmission, the brain needs time to process incoming visual information. If these delays were not somehow compensated, we would consistently mislocalize moving objects behind their physical positions. Twenty-five years ago, Nijhawan used a perceptual illusion he called the flash-lag effect (FLE) to argue that the brain's visual system solves this computational challenge by extrapolating the position of moving objects (Nijhawan, 1994). Although motion extrapolation had been proposed a decade earlier (e.g., Finke et al., 1986), the proposal that it caused the FLE and functioned to compensate for computational delays was hotly debated in the years that followed, with several alternative interpretations put forth to explain the effect. Here, I argue, 25 years later, that evidence from behavioral, computational, and particularly recent functional neuroimaging studies converges to support the existence of motion extrapolation mechanisms in the visual system, as well as their causal involvement in the FLE. First, findings that were initially argued to challenge the motion extrapolation model of the FLE have since been explained, and those explanations have been tested and corroborated by more recent findings. Second, motion extrapolation explains the spatial shifts observed in several FLE conditions that cannot be explained by alternative (temporal) models of the FLE. Finally, neural mechanisms that actually perform motion extrapolation have been identified at multiple levels of the visual system, in multiple species, and with multiple different methods. I outline key questions that remain, and discuss possible directions for future research.

Predictions from masked motion with and without obstacles

Predicting the future is essential for organisms like Homo sapiens, who live in a dynamic and ever-changing world. Previous research has established that conscious stimuli can lead to non-conscious predictions. Here we examine whether masked stimuli can also induce such predictions. We use masked movement-with and without obstacles-to examine predictions from masked stimuli. In six experiments a moving object was masked using continuous flash suppression (CFS). A few hundred milliseconds after the object had disappeared, a conscious probe appeared in a location that was either consistent with the masked stimulus or not. In Experiments 1-3 the movement was linear, and reaction times (RTs) indicated predictions that were based on direction and speed of movement. In Experiment 4, the masked moving object collided with an obstacle and then disappeared. Predictions in this case should reflect deflection, and indeed reaction times revealed predictions on the deflection route. In Experiments 5 and 6 we introduce an innovative way of using eye-tracking during continuous flash suppression (CFS) and report physiological evidence-in the forms of eye-movements-for masked stimuli induced predictions. We thus conclude that humans can use dynamic masked stimuli to generate active predictions about the future, and use these predictions to guide behavior. We also discuss the possible interpretations of these findings in light of the current scientific discussion regarding the relation between masked presentation, subliminal perception and awareness measurement methods.

Perceiving Locations of Moving Objects Across Eyeblinks

Eyeblinks cause disruption of visual input that generally goes unnoticed. It is thought that the brain uses active suppression to prevent awareness of the gaps, but it is unclear how suppression would affect the perception of dynamic events when visual input changes across the blink. Here, we addressed this question by studying the perception of moving objects around eyeblinks. In Experiment 1 (N = 16), we observed that when motion terminates during a blink, the last perceived position is shifted forward from its actual last position. In Experiment 2 (N = 8), we found that motion trajectories were perceived as more continuous when the object jumped backward during the blink, canceling a fraction of the space that it traveled. This suggests subjective underestimation of blink duration. These results reveal the strategies used by the visual system to compensate for disruptions and maintain perceptual continuity: Time elapsed during eyeblinks is perceptually compressed and filled with extrapolated information.

Direction of Apparent Motion During Smooth Pursuit Is Determined Using a Mixture of Retinal and Objective Proximities

Many studies have investigated various effects of smooth pursuit on visual motion processing, especially the effects related to the additional retinal shifts produced by eye movement. In this article, we show that the perception of apparent motion during smooth pursuit is determined by the interelement proximity in retinal coordinates and also by the proximity in objective world coordinates. In Experiment 1, we investigated the perceived direction of the two-frame apparent motion of a square-wave grating with various displacement sizes under fixation and pursuit viewing conditions. The retinal and objective displacements between the two frames agreed with each other under the fixation condition. However, the displacements differed by 180 degrees in terms of phase shift, under the pursuit condition. The proportions of the reported motion direction between the two viewing conditions did not coincide when they were plotted as a function of either the retinal displacement or of the objective displacement; however, they did coincide when plotted as a function of a mixture of the two. The result from Experiment 2 showed that the perceived jump size of the apparent motion was also dependent on both retinal and objective displacements. Our findings suggest that the detection of the apparent motion during smooth pursuit considers the retinal proximity and also the objective proximity. This mechanism may assist with the selection of a motion path that is more likely to occur in the real world and, therefore, be useful for ensuring perceptual stability during smooth pursuit.

The role of cortical areas hMT/V5+ and TPJ on the magnitude of representational momentum and representational gravity: a transcranial magnetic stimulation study

The perceived vanishing location of a moving target is systematically displaced forward, in the direction of motion-representational momentum-, and downward, in the direction of gravity-representational gravity. Despite a wealth of research on the factors that modulate these phenomena, little is known regarding their neurophysiological substrates. The present experiment aims to explore which role is played by cortical areas hMT/V5+, linked to the processing of visual motion, and TPJ, thought to support the functioning of an internal model of gravity, in modulating both effects. Participants were required to perform a standard spatial localization task while the activity of the right hMT/V5+ or TPJ sites was selectively disrupted with an offline continuous theta-burst stimulation (cTBS) protocol, interspersed with control blocks with no stimulation. Eye movements were recorded during all spatial localizations. Results revealed an increase in representational gravity contingent on the disruption of the activity of hMT/V5+ and, conversely, some evidence suggested a bigger representational momentum when TPJ was stimulated. Furthermore, stimulation of hMT/V5+ led to a decreased ocular overshoot and to a time-dependent downward drift of gaze location. These outcomes suggest that a reciprocal balance between perceived kinematics and anticipated dynamics might modulate these spatial localization responses, compatible with a push-pull mechanism.

Serial dependence in position occurs at the time of perception

Observers perceive objects in the world as stable over space and time, even though the visual experience of those objects is often discontinuous and distorted due to masking, occlusion, camouflage, or noise. How are we able to easily and quickly achieve stable perception in spite of this constantly changing visual input? It was previously shown that observers experience serial dependence in the perception of features and objects, an effect that extends up to 15 seconds back in time. Here, we asked whether the visual system utilizes an object's prior physical location to inform future position assignments in order to maximize location stability of an object over time. To test this, we presented subjects with small targets at random angular locations relative to central fixation in the peripheral visual field. Subjects reported the perceived location of the target on each trial by adjusting a cursor's position to match its location. Subjects made consistent errors when reporting the perceived position of the target on the current trial, mislocalizing it toward the position of the target in the preceding two trials (Experiment 1). This pull in position perception occurred even when a response was not required on the previous trial (Experiment 2). In addition, we show that serial dependence in perceived position occurs immediately after stimulus presentation, and it is a fast stabilization mechanism that does not require a delay (Experiment 3). This indicates that serial dependence occurs for position representations and facilitates the stable perception of objects in space. Taken together with previous work, our results show that serial dependence occurs at many stages of visual processing, from initial position assignment to object categorization.

Implied tactile motion: Localizing dynamic stimulations on the skin

We report two experiments designed to investigate how the implied motion of tactile stimuli influences perceived location. Predicting the location of sensory input is especially important as far as the perception of, and interaction with, the external world is concerned. Using two different experimental approaches, an overall pattern of localization shifts analogous to what has been described previously in the visual and auditory modalities is reported. That is, participants perceive the last location of a dynamic stimulus further along its trajectory than is objectively the case. In Experiment 1, participants judged whether the last vibration in a sequence of three was located closer to the wrist or to the elbow. In Experiment 2, they indicated the last location on a ruler attached to their forearm. We further pinpoint the effects of implied motion on tactile localization by investigating the independent influences of motion direction and perceptual uncertainty. Taken together, these findings underline the importance of dynamic information in localizing tactile stimuli on the skin.

The faster you decide, the more accurate localization is possible: Position representation of "curveball illusion" in perception and eye movements

When the inside texture of a moving object moves, the perceived motion of the object is often distorted toward the direction of the texture's motion (motion-induced position shift), and such perceptual distortion accumulates while the object is watched, causing what is known as the curveball illusion. In a recent study, however, the accumulation of the position error was not observed in saccadic eye movements. Here, we examined whether the position of the illusory object is represented independently in the perceptual and saccadic systems. In the experiments, the stimulus of the curveball illusion was adopted to examine the temporal change in the position representation for saccadic eye movements and for perception by varying the elapsed time from the input of visual information to saccade onset and perceptual judgment, respectively. The results showed that the temporal accumulation of the motion-induced position shift is observed not only in perception but also in saccadic eye movements. In the saccade tasks, the landing positions of saccades gradually shifted to the illusory perceived position as the elapsed time from the target offset to the saccade "go" signal increased. Furthermore, in the perception task, shortening the time between the target offset and the perceptual judgment reduced the size of the illusion effect. Therefore, these results argue against the idea of dissociation between saccadic and perceptual localization of a moving object suggested in the previous study, in which saccades were measured in a rushed way while perceptual responses were measured without time constraint. Instead, the similar temporal trends of these effects imply a common or similar target representation for perception and eye movements which dynamically changes over the course of evidence accumulation.

Representational momentum and anisotropies in nearby visual space

The possibility of anisotropies in visual space in and near the final location of a moving target was examined. Experiments 1 and 2 presented a moving target, and after the target vanished, participants indicated the final location of the leading or trailing edge of the target. Memory for both edges was displaced forward from the actual final locations, and the magnitude of displacement was smaller for the leading edge. Experiments 3 and 4 also presented stationary objects in front of and behind the final location of the target, and participants indicated the location of the nearest or farthest edge of one of the stationary objects. Memory for the near or far edge of an object in front of the target was displaced backward, and memory for the near or far edge of an object behind the target was displaced forward; the magnitude of displacement was larger for objects in front of the target and when the edge was farther away. The findings (a) suggest representational momentum is associated with an anisotropy of visual space that extends across and outward from the moving target and (b) are consistent with previous findings regarding estimation of time-to-contact, anorthoscopic perception, and memory psychophysics.

Effects of Auditory Patterns on Judged Displacements of an Occluded Moving Object

Using displays in which a moving disk disappeared behind an occluder, we examined whether an accompanying auditory rhythm influenced the perceived displacement of the disk during occlusion. We manipulated a baseline rhythm, comprising a relatively fast alternation of equal sound and pause durations. We had two different manipulations to create auditory sequences with a slower rhythm: either the pause durations or the sound durations were increased. In the trial, a disk moved at a constant speed, and at a certain point moved behind an occluder during which an auditory rhythm was played. Participants were instructed to track the occluded disk, and judge the expected position of the disk at the moment that the auditory rhythm ended by touching the judged position on a touch screen. We investigated the influence of the auditory rhythm, i.e., ratio of sound to pause duration, and the influence of auditory density, i.e., the number of sound onsets per time unit, on the judged distance. The results showed that the temporal characteristics affected the spatial judgments. Overall, we found that in the current paradigm relatively slow rhythms led to shorter judged distance as compared to relatively fast rhythms for both pause and sound variations. There was no main effect of auditory density on the judged distance of an expected visual event. That is, whereas the speed of the auditory rhythm appears crucial, the number of sound onsets per time unit as such, i.e., the auditory density, appears a much weaker factor.

An Effect of Context on Whether Memory for Initial Position Exhibits a FröHlich Effect or an Onset Repulsion Effect

Memory for the initial and final positions of moving targets was examined. When targets appeared adjacent to the boundary of a larger enclosing window, memory for initial position exhibited a Fröhlich effect (i.e., a displacement forward), and when distance of initial position from the boundary increased, memory for initial position exhibited a smaller Fröhlich effect or an onset repulsion effect (i.e., a displacement backward). When targets vanished adjacent to the boundary of a larger enclosing window, memory for final position was displaced backward, and when distance of final position from the boundary increased, memory for final position did not exhibit significant displacement. These patterns differed from previously reported displacements of initial and final positions of targets presented on a blank background. Possible influences of attention and extrapolation of trajectory on whether memory for initial position exhibits a Fröhlich effect or an onset repulsion effect and on backward displacement in memory for final position are discussed.

The ball vanishes in the air: can we blame representational momentum?

In the vanishing ball illusion (VBI), the magician throws a ball up into the air twice and then pretends to do a third throw. On the third (fake) throw, the audience sees the ball go up and then disappear. In this article, we study the psychological mechanisms at play in this magic trick. We test the hypothesis that the illusion is based on representational momentum (RM), a psychological phenomenon in which the observer perceives the stopping point of a moving scene as being located farther ahead in the direction of motion than it really is. To determine whether the mechanisms involved in VBI are similar to those underlying RM, we compared the results of a standard VBI task to those obtained on an RM task designed to be very close to the VBI task. The results showed that VBI sensitivity was not associated with a higher anticipation score on the RM task. Unexpectedly, we found that participants who were sensitive to the illusion even obtained a weaker RM effect. We discuss several hypotheses that might account for these results.

A novel dissociation between representational momentum and representational gravity through response modality

When people are required to indicate the vanishing location of a moving object, systematic biases forward, in the direction of motion, and downward, in the direction of gravity, are usually found. Both these displacements, called representational momentum and representational gravity, respectively, are thought to reflect anticipatory internal mechanisms aiming to overcome neural delays in the perception of motion. We challenge this view. There may not be such a single mechanism. Although both representational momentum and representational gravity follow a specific time-course, compatible with an anticipation of the object's dynamics, they do not seem to be commensurable with each other, as they are differentially modulated by relevant variables, such as eye movements and strength of motion signals. We found separate response components, one related to overt motor localization behaviour and one limited to purely perceptual judgement. Representational momentum emerged only for the motor localization task, revealing a motor overshoot. In contrast, representational gravity was mostly evident for spatial perceptual judgements. We interpret the results in support of a partial dissociation in the mechanisms that give rise to representational momentum and representational gravity, with the former but not the latter strongly modulated by the enrolment of the motor system.

Tactile motion lacks momentum

The displacement of the final position of a moving object in the direction of the observed motion path, i.e. an overestimation, is known as representational momentum. It has been described both in the visual and the auditory domain, and is suggested to be modality-independent. Here, we tested whether a representational momentum can also be demonstrated in the somatosensory domain. While the cognitive literature on representational momentum suggests that it can, previous work on the psychophysics of tactile motion perception would rather predict an underestimation of the perceived endpoint of a tactile stimulus. Tactile motion stimuli were applied on the left and the right dorsal forearms of 32 healthy participants, who were asked to indicate the subjectively perceived endpoint of the stimulation. Velocity, length and direction of the trajectory were varied. Contrary to the prediction based on the representational momentum literature, participants in our experiment significantly displaced the endpoint against the direction of movement (underestimation). The results are thus compatible with previous psychophysical findings on the perception of tactile motion. Further studies combining paradigms from classical psychophysics and cognitive psychology will be needed to resolve the apparently paradoxical predictions by the two literatures.

Implied motion language can influence visual spatial memory

How do language and vision interact? Specifically, what impact can language have on visual processing, especially related to spatial memory? What are typically considered errors in visual processing, such as remembering the location of an object to be farther along its motion trajectory than it actually is, can be explained as perceptual achievements that are driven by our ability to anticipate future events. In two experiments, we tested whether the prior presentation of motion language influences visual spatial memory in ways that afford greater perceptual prediction. Experiment 1 showed that motion language influenced judgments for the spatial memory of an object beyond the known effects of implied motion present in the image itself. Experiment 2 replicated this finding. Our findings support a theory of perception as prediction.

Toward a general theory of momentum-like effects

The future actions, behaviors, and outcomes of objects, individuals, and processes can often be anticipated, and some of these anticipations have been hypothesized to result from momentum-like effects. Five types of momentum-like effects (representational momentum, operational momentum, attentional momentum, behavioral momentum, psychological momentum) are briefly described. Potential similarities involving properties of momentum-like effects (continuation, coherence, role of chance or guessing, role of sensory processing, imperviousness to practice or error feedback, shifts in memory for position, effects of changes in velocity, rapid occurrence, effects of retention interval, attachment to an object rather than an abstract frame of reference, nonrigid transformation) are described, and potential constraints on a future theory of momentum-like effects (dynamic representation, nature of extrapolation, sensitivity to environmental contingencies, bridging gaps between stimulus and response, increasing adaptiveness to the environment, serving as a heuristic for perception and action, insensitivity to stimulus format, importance of subjective consequences, role of knowledge and belief, automaticity of occurrence, properties of functional architecture) are discussed. The similarity and ubiquity of momentum-like effects suggests such effects might result from a single or small number of mechanisms that operate over different dimensions, modalities, and time-scales and provide a fundamental adaptation for perception and action.

Crossmodal Modulation of Spatial Localization by Mimetic Words

The present study investigated whether aurally presented mimetic words affect the judgment of the final position of a moving object. In Experiment 1, horizontal apparent motion of a visual target was presented, and an auditory mimetic word of “byun” (representing rapid forward motion), “pitari” (representing stop of motion), or “nisahi” (nonsense syllable) was presented via headphones. Observers were asked to judge which of two test stimuli was horizontally aligned with the target. The results showed that forward displacement in the “pitari” condition was significantly smaller than in the “byun” and “nisahi” conditions. However, when non-mimetic but meaningful words were presented (Experiment 2), this effect did not occur. Our findings suggest that the mimetic words, especially that meaning stop of motion, affect spatial localization by means of mental imagery regarding “stop” established by the phonological information of the word.

Vestibular stimulation interferes with the dynamics of an internal representation of gravity

The remembered vanishing location of a moving target has been found to be displaced downward in the direction of gravity (representational gravity) and more so with increasing retention intervals, suggesting that the visual spatial updating recruits an internal model of gravity. Despite being consistently linked with gravity, few inquiries have been made about the role of vestibular information in these trends. Previous experiments with static tilting of observers' bodies suggest that under conflicting cues between the idiotropic vector and vestibular signals, the dynamic drift in memory is reduced to a constant displacement along the body's main axis. The present experiment aims to replicate and extend these outcomes while keeping the observers' bodies unchanged in relation to physical gravity by varying the gravito-inertial acceleration using a short-radius centrifuge. Observers were shown, while accelerated to varying degrees, targets moving along several directions and were required to indicate the perceived vanishing location after a variable interval. Increases of the gravito-inertial force (up to 1.4G), orthogonal to the idiotropic vector, did not affect the direction of representational gravity, but significantly disrupted its time course. The role and functioning of an internal model of gravity for spatial perception and orientation are discussed in light of the results.

Perceptual shrinkage of a one-way motion path with high-speed motion

Back-and-forth motion induces perceptual shrinkage of the motion path, but such shrinkage is hardly perceived for one-way motion. If the shrinkage is caused by temporal averaging of stimulus position around the endpoints, it should also be induced for one-way motion at higher motion speeds. In psychophysical experiments with a high-speed projector, we tested this conjecture for a one-way motion stimulus at various speeds (4–100 deg/s) along a straight path. Results showed that perceptual shrinkage of the motion path was robustly observed in higher-speed motion (faster than 66.7 deg/s). In addition, the amount of the forwards shift at the onset position was larger than that of the backwards shift at the offset position. These results demonstrate that high-speed motion can induce shrinkage, even for a one-way motion path. This can be explained by the view that perceptual position is represented by the integration of the temporal average of instantaneous position and the motion representation.

Representational Momentum in Spatial Hearing

The final position of a moving visual object usually appears to be displaced in the direction of motion. We investigated this phenomenon, termed representational momentum, in the auditory modality. In a dark anechoic environment, an acoustic target (continuous noise or noise pulses) moved from left to right or from right to left along the frontal horizontal plane. Listeners judged the final position of the target using a hand pointer. Target velocity was 8° s−1 or 16° s−1. Generally, the final target positions were localised as displaced in the direction of motion. With presentation of continuous noise, target velocity had a strong influence on mean displacement: displacements were stronger with lower velocity. No influence of sound velocity on displacement was found with motion of pulsed noise. Although these findings suggest that the underlying mechanisms may be different in the auditory and visual modality, the occurrence of displacements indicates that representational-momentum-like effects are not restricted to the visual modality, but may reflect a general phenomenon with judgments of dynamic events.

Representational Momentum Beyond Internalized Physics

Prediction of future motion is necessary in order to successfully deal with moving objects. Implicit measures have been used to evaluate the sources of information used in this task. For instance, observers may be asked to localize the final position of a moving target. Judgments have been found to be displaced in the direction of motion (forward displacement), suggesting that observers have internalized a mental analogue of physical momentum. However, more recent studies have shown that forward displacement may not be caused by cognitive mechanisms alone. Rather, predictive mechanisms at the perceptual and motor levels may contribute to the forward error. Supporting the notion that mechanisms of anticipation may be embodied, the forward error was found to depend on the execution of eye and pointing movements. Also, forward displacement depended on the motion type that was presented (smooth vs. jerky or implied), which suggests that attention moves to the next expected target position to facilitate responses to this position.

The visual representations of motion and of gravity are functionally independent: Evidence of a differential effect of smooth pursuit eye movements

The memory for the final position of a moving object which suddenly disappears has been found to be displaced forward, in the direction of motion, and downwards, in the direction of gravity. These phenomena were coined, respectively, Representational Momentum and Representational Gravity. Although both these and similar effects have been systematically linked with the functioning of internal representations of physical variables (e.g. momentum and gravity), serious doubts have been raised for a cognitively based interpretation, favouring instead a major role of oculomotor and perceptual factors which, more often than not, were left uncontrolled and even ignored. The present work aims to determine the degree to which Representational Momentum and Representational Gravity are epiphenomenal to smooth pursuit eye movements. Observers were required to indicate the offset locations of targets moving along systematically varied directions after a variable imposed retention interval. Each participant completed the task twice, varying the eye movements' instructions: gaze was either constrained or left free to track the targets. A Fourier decomposition analysis of the localization responses was used to disentangle both phenomena. The results show unambiguously that constraining eye movements significantly eliminates the harmonic components which index Representational Momentum, but have no effect on Representational Gravity or its time course. The found outcomes offer promising prospects for the study of the visual representation of gravity and its neurological substrates.

How Fast Do Objects Fall in Visual Memory? Uncovering the Temporal and Spatial Features of Representational Gravity

Visual memory for the spatial location where a moving target vanishes has been found to be systematically displaced downward in the direction of gravity. Moreover, it was recently reported that the magnitude of the downward error increases steadily with increasing retention intervals imposed after object’s offset and before observers are allowed to perform the spatial localization task, in a pattern where the remembered vanishing location drifts downward as if following a falling trajectory. This outcome was taken to reflect the dynamics of a representational model of earth’s gravity. The present study aims to establish the spatial and temporal features of this downward drift by taking into account the dynamics of the motor response. The obtained results show that the memory for the last location of the target drifts downward with time, thus replicating previous results. Moreover, the time taken for completion of the behavioural localization movements seems to add to the imposed retention intervals in determining the temporal frame during which the visual memory is updated. Overall, it is reported that the representation of spatial location drifts downward by about 3 pixels for each two-fold increase of time until response. The outcomes are discussed in relation to a predictive internal model of gravity which outputs an on-line spatial update of remembered objects’ location.

ARM MOVEMENT AS A CUE FOR THE ESTIMATION OF VISUAL LOCATION

Two experiments including 24 (M age=29 yr., SD=9; 6 men) and 25 participants (M age=27 yr., SD=9; 8 men), respectively, examined how arm movement extent affects the perception of visual locations. Linear arm movements were performed on a horizontal plane from a start position until an auditory signal occurred. Subsequently, the position of a visual target located along the movement path was judged. The target was judged as further away with an increase in movement extent. The results indicated that motor-related signals are taken into account in visual perception of locations. There were no indications, though, that changes of location perception prompted subsequent changes of action planning, which demonstrates the short-term nature of action-induced plasticity of space perception under the present conditions.

An effect of contrast and luminance on visual representational momentum for location

Effects of the contrast of target luminance and background luminance, and of the absolute level of target luminance, on representational momentum for the remembered final location of a previously viewed moving target were examined. Targets were high in contrast or luminance, decreasing in contrast or luminance, increasing in contrast or luminance, or low in contrast or luminance; the background was black or white. Representational momentum for target location was larger if targets were high or increasing in contrast or luminance and smaller if targets were low or decreasing in contrast or luminance. Representational momentum for target location was larger if targets were presented on a white background than on a black background. Implications for theories of localization and for theories of representational momentum are discussed.

Fourier decomposition of spatial localization errors reveals an idiotropic dominance of an internal model of gravity

Given its conspicuous nature, gravity has been acknowledged by several research lines as a prime factor in structuring the spatial perception of one's environment. One such line of enquiry has focused on errors in spatial localization aimed at the vanishing location of moving objects - it has been systematically reported that humans mislocalize spatial positions forward, in the direction of motion (representational momentum) and downward in the direction of gravity (representational gravity). Moreover, spatial localization errors were found to evolve dynamically with time in a pattern congruent with an anticipated trajectory (representational trajectory). The present study attempts to ascertain the degree to which vestibular information plays a role in these phenomena. Human observers performed a spatial localization task while tilted to varying degrees and referring to the vanishing locations of targets moving along several directions. A Fourier decomposition of the obtained spatial localization errors revealed that although spatial errors were increased "downward" mainly along the body's longitudinal axis (idiotropic dominance), the degree of misalignment between the latter and physical gravity modulated the time course of the localization responses. This pattern is surmised to reflect increased uncertainty about the internal model when faced with conflicting cues regarding the perceived "downward" direction.

High-level context effects on spatial displacement: the effects of body orientation and language on memory

Three decades of research suggests that cognitive simulation of motion is involved in the comprehension of object location, bodily configuration, and linguistic meaning. For example, the remembered location of an object associated with actual or implied motion is typically displaced in the direction of motion. In this paper, two experiments explore context effects in spatial displacement. They provide a novel approach to estimating the remembered location of an implied motion image by employing a cursor-positioning task. Both experiments examine how the remembered spatial location of a person is influenced by subtle differences in implied motion, specifically, by shifting the orientation of the person's body to face upward or downward, and by pairing the image with motion language that differed on intentionality, fell versus jumped. The results of Experiment 1, a survey-based experiment, suggest that language and body orientation influenced vertical spatial displacement. Results of Experiment 2, a task that used Adobe Flash and Amazon Mechanical Turk, showed consistent effects of body orientation on vertical spatial displacement but no effect of language. Our findings are in line with previous work on spatial displacement that uses a cursor-positioning task with implied motion stimuli. We discuss how different ways of simulating motion can influence spatial memory.

Can representational trajectory reveal the nature of an internal model of gravity?

The memory for the vanishing location of a horizontally moving target is usually displaced forward in the direction of motion (representational momentum) and downward in the direction of gravity (representational gravity). Moreover, this downward displacement has been shown to increase with time (representational trajectory). However, the degree to which different kinematic events change the temporal profile of these displacements remains to be determined. The present article attempts to fill this gap. In the first experiment, we replicate the finding that representational momentum for downward-moving targets is bigger than for upward motions, showing, moreover, that it increases rapidly during the first 300 ms, stabilizing afterward. This temporal profile, but not the increased error for descending targets, is shown to be disrupted when eye movements are not allowed. In the second experiment, we show that the downward drift with time emerges even for static targets. Finally, in the third experiment, we report an increased error for upward-moving targets, as compared with downward movements, when the display is compatible with a downward ego-motion by including vection cues. Thus, the errors in the direction of gravity are compatible with the perceived event and do not merely reflect a retinotopic bias. Overall, these results provide further evidence for an internal model of gravity in the visual representational system.

Do the flash-lag effect and representational momentum involve similar extrapolations?

In the flash-lag effect (FLE) and in representational momentum (RM), the represented position of a moving target is displaced in the direction of motion. Effects of numerous variables on the FLE and on RM are briefly considered. In many cases, variables appear to have the same effect on the FLE and on RM, and this is consistent with a hypothesis that displacements in the FLE and in RM result from overlapping or similar mechanisms. In other cases, variables initially appear to have different effects on the FLE and on RM, but accounts reconciling those apparent differences with a hypothesis of overlapping or similar mechanisms are suggested. Given that RM is simpler and accounts for a wider range of findings (i.e., RM involves a single stimulus rather than the relationship between two stimuli, RM accounts for displacement in absolute position of a single stimulus and for differences in relative position of two stimuli), it is suggested that (at least some cases of) the FLE might be a special case of RM in which the position of the target is assessed relative to the position of another stimulus (i.e., the flashed object) rather than relative to the actual position of the target.

Beyond face value: does involuntary emotional anticipation shape the perception of dynamic facial expressions?

Emotional facial expressions are immediate indicators of the affective dispositions of others. Recently it has been shown that early stages of social perception can already be influenced by (implicit) attributions made by the observer about the agent's mental state and intentions. In the current study possible mechanisms underpinning distortions in the perception of dynamic, ecologically-valid, facial expressions were explored. In four experiments we examined to what extent basic perceptual processes such as contrast/context effects, adaptation and representational momentum underpinned the perceptual distortions, and to what extent 'emotional anticipation', i.e. the involuntary anticipation of the other's emotional state of mind on the basis of the immediate perceptual history, might have played a role. Neutral facial expressions displayed at the end of short video-clips, in which an initial facial expression of joy or anger gradually morphed into a neutral expression, were misjudged as being slightly angry or slightly happy, respectively (Experiment 1). This response bias disappeared when the actor's identity changed in the final neutral expression (Experiment 2). Videos depicting neutral-to-joy-to-neutral and neutral-to-anger-to-neutral sequences again produced biases but in opposite direction (Experiment 3). The bias survived insertion of a 400 ms blank (Experiment 4). These results suggested that the perceptual distortions were not caused by any of the low-level perceptual mechanisms (adaptation, representational momentum and contrast effects). We speculate that especially when presented with dynamic, facial expressions, perceptual distortions occur that reflect 'emotional anticipation' (a low-level mindreading mechanism), which overrules low-level visual mechanisms. Underpinning neural mechanisms are discussed in relation to the current debate on action and emotion understanding.

Effect of automatic image realignment on visuomotor coordination in simulated laparoscopic surgery

During laparoscopic surgery, the surgeon's hand-eye coordination is often disrupted by the incongruent mapping between the orientation of the endoscopic view and the actual operative field. Two experiments were conducted to examine the effect of automatic image realignment on the performance of laparoscopic surgery. The first experiment investigated how visual-motor misalignment impacted laparoscopic surgery performance. Novice subjects were randomly assigned to one of the two paired viewing conditions in a simulated laparoscopic surgery environment: 1) the endoscope was either at the center of the modeled workspace with an optical axis of 90°, or at -45° from the midline of the subjects with an optical axis 45°; 2) the endoscope was either at 0°, or at 180° from the midline of the subjects, both with an optical axis of 45°. Each group of twelve subjects performed a dynamic point-and-touch task under the assigned pair of viewing conditions, each with eight image orientations, in a repeated-measures mixed design. The second experiment examined whether the automatic realigning mechanism that was activated mid-task (such that a congruent mapping between display and control was re-established if the mapping at the beginning of the task had been misaligned) was helpful to improve performance. Twelve novice subjects performed the same task as in the first experiment in a repeated-measures design. Performance was examined under three misaligned visuomotor mappings, each followed by the realigned mapping activated by the automatic realigning mechanism. Results showed that performance was best when the endoscopic image was perfectly aligned with the actual task space (0° image orientation), but degraded progressively as a function of deviation from perfect alignment. Subjects' performance maintained a consistent pattern across 8 image orientations regardless of optical axis orientation and endoscope location. Performance was improved with the automatic realigning mechanism. It is recommended that any solution to restore the visuomotor congruency in laparoscopic surgery should first align the image with the task space. This work has implications for the design of visualization systems in laparoscopic surgery.

Motion extrapolation in the central fovea

Neural transmission latency would introduce a spatial lag when an object moves across the visual field, if the latency was not compensated. A visual predictive mechanism has been proposed, which overcomes such spatial lag by extrapolating the position of the moving object forward. However, a forward position shift is often absent if the object abruptly stops moving (motion-termination). A recent "correction-for-extrapolation" hypothesis suggests that the absence of forward shifts is caused by sensory signals representing 'failed' predictions. Thus far, this hypothesis has been tested only for extra-foveal retinal locations. We tested this hypothesis using two foveal scotomas: scotoma to dim light and scotoma to blue light. We found that the perceived position of a dim dot is extrapolated into the fovea during motion-termination. Next, we compared the perceived position shifts of a blue versus a green moving dot. As predicted the extrapolation at motion-termination was only found with the blue moving dot. The results provide new evidence for the correction-for-extrapolation hypothesis for the region with highest spatial acuity, the fovea.

Investigating the anticipatory nature of pattern perception in sport

The aim of the present study was to examine the anticipatory nature of pattern perception in sport by using static and moving basketball patterns across three different display types. Participants of differing skill levels were included in order to determine whether the effects would be moderated by the knowledge and experience of the observer in the same manner reported previously for simple images. The results from a pattern recognition task showed that both expert and recreational participants were more likely to anticipate the next likely state of a pattern when it was presented as a moving video, but only the experts appeared to have the depth of understanding required to elicit the same anticipatory encoding for patterns presented as schematic images. The results extend those reported in previous research and provide further evidence of an anticipatory encoding in pattern perception for images containing complex, interrelated patterns.

Paradoxical extension into the contralesional hemispace in spatial neglect

To explore the idea of a perceptual distortion of space in spatial neglect, neglect patients, age-matched healthy controls and right hemisphere control patients judged the vanishing point of horizontally and vertically-moving stimuli. Hemifield of presentation and movement direction of the stimulus presentation was manipulated. The results suggest that neglect patients show a stronger response bias in the direction of the moving stimuli ("representational momentum") than healthy and right hemisphere controls. Furthermore, neglect patients, but not the control groups, showed a direction-specific response whereby the presence of neglect was associated with a larger representational momentum for leftward-moving stimuli. The one left-hemisphere patient with right-sided neglect showed the opposite effect. Thus, neglect patients showed a relative overextension into their neglected side of space. While these findings are in line with the idea of an extension in the representation of contralesional space, other explanations such as deficient spatial remapping, impairments in smooth pursuit and distortions in memorized visuo-motor movements are considered.

Effects of spatial cuing on the onset repulsion effect

Effects of cuing the onset (initial) location of a moving target on memory for the onset location of that target were examined. If a cue presented prior to target onset indicated the location where that target would appear, the onset repulsion effect (in which the judged initial location of the target was displaced in the direction opposite to target motion) was decreased, and the onset repulsion effect was smaller if the cue was valid than if the cue was invalid. If a cue presented during target motion or after the target vanished indicated the location where that target had appeared, the onset repulsion effect was eliminated. The data (1) suggest that positional uncertainty might contribute to the onset repulsion effect, (2) provide the first evidence of an effect of expectancy regarding target trajectory on the onset repulsion effect, and (3) are partially consistent with previous data involving effects of attention and spatial cuing on the Fröhlich effect and on representational momentum.

Representational momentum in older adults

Humans have a tendency to perceive motion even in static images that simply "imply" movement. This tendency is so strong that our memory for actions depicted in static images is distorted in the direction of implied motion - a phenomenon known as representational momentum (RM). In the present study, we created an RM display depicting a pattern of implied (clockwise) rotation of a rectangle. Young adults viewers' memory of the final position of the test rectangle was biased in the direction of continuing rotation, but older adults did not show a similar memory bias. We discuss several possible explanations for this group difference, but argue that the failure of older adults to shown an RM effect most likely reflects age-related changes in areas of the brain involved in processing real and implied motion.