Motion-Induced Position Shifts Activate Early Visual Cortex

Sustained attention and the flash grab effect

When a stationary target is briefly presented on top of a moving background as it reverses direction, the target is displaced perceptually in the direction of the upcoming motion (the flash grab effect). To determine the role of attention in this effect, we investigated whether the predictability of the location of the flash grab target modulates the illusion. First, we established that effect was weaker for spatially predictable targets. Next, we showed that the flash grab effect decreased for a narrower spatial spread of attention before the onset of the target and that it was smaller for left hemifield presentations than right. Finally, we demonstrated that diverting attention away from the target and the background motion decreases the flash grab effect. In the first two experiments, the decrease in the illusion could be attributed to either increased attention to the target or decreased attention to the motion; we assume that increasing attention to the target necessarily decreases attention to the motion. However, in the final experiment, the central task decreases attention to both the target and the motion. The results show a decrease in the illusion and that reveals that attention to the motion is the primary causal factor.

Unveiling the time course of visual stabilization through human electrophysiology

Object positions are coded relative to their surroundings, presumably providing visual stability during eye movements. But when does this perceived stability arise? Here we used a visual illusion, the frame-induced position shift, and measured electrophysiological activity elicited by an object whose perceived position was either shifted because of a surrounding frame or not, thus dissociating perceived and physical locations. We found that visually evoked responses were sensitive to only physical location earlier in time (∼70 ms), but both physical and illusory location information was present at a later time point (∼140 ms). Furthermore, location information could be reliably decoded across physical and illusory locations during the later time interval but not during the earlier time interval, demonstrating that neural activity patterns are shared between the two processes at a later stage. These results suggest that visual stability of objects emerges relatively late and is thus dependent on recurrent feedback from higher processing stages.

A motion-induced position shift that depends on motion both before and after the test probe

Two versions of the flash grab illusion were used to examine the relative contributions of motion before and motion after the test flash to the illusory position shift. The stimulus in the first two experiments was a square pattern that expanded and contracted with an outline square flashed each time the motion reversed producing a dramatic difference in perceived size between the two reversals. Experiment 1 showed a strong illusion when motion was present before and after the flashed tests or just after the flashes, but no significant effect when only the pre-flash motion was present. In Experiment 2, motion always followed the flash, and the duration of the pre-flash motion was varied. The results showed a significant increase in illusion strength with the duration of pre-flash motion and the effect of the pre-flash motion was almost 50% that of the post-flash motion. Finally, Experiment 3 tested the position shifts when the linear motion of a disk before the flash was orthogonal to its motion after the flash. Here, the results again showed that the pre-flash motion made a significant contribution, about 32% that of the post-flash motion. Several models are considered and even though all fail to some degree, they do offer insights into the nature of the illusion. Finally, we show that the empirical measure of the relative contribution of motion before and after the flash can be used to distinguish the mechanisms underlying different illusions.

Facilitation and inhibition effects of anodal and cathodal tDCS over areas MT+ on the flash-lag effect

The perceived position of a moving object in vision entails an accumulation of neural signals over space and time. Due to neural signal transmission delays, the visual system can not acquire immediate information about the moving object's position. Although physiological and psychophysical studies on the flash-lag effect (FLE), a moving object is perceived ahead of a flash even they are aligned at the same location, have shown that the visual system develops the mechanisms of predicting the object's location to compensate for the neural delays, the neural mechanisms of motion-induced location prediction are not still understood well. Here, we investigated the role of neural activity changes in areas MT+ (specialized for motion processing) and the potential contralateral processing preference of MT+ in modulating the FLE. Using transcranial direct current stimulations (tDCS) over the left and right MT+ between pre-and post-tests of the FLE in different motion directions, we measured the effects of tDCS on the FLE. The results found that anodal and cathodal tDCS enhanced and reduced the FLE with the moving object heading to but not deviating from the side of the brain stimulated, respectively, compared to sham tDCS. These findings suggest a causal role of area MT+ in motion-induced location prediction, which may involve the integration of position information.

A position anchor sinks the double-drift illusion

When the internal texture of a Gabor patch moves orthogonally to its envelope's motion, the perceived path, viewed in the periphery, shifts dramatically in position, and direction relative to the true path (the double-drift illusion). Here, we examine positional uncertainty as a critical factor underlying this illusory shift. We presented participants with an anchoring line at different distances from the drifting Gabor's physical path. Our results indicate that placing an anchor (a fixed line) close to the Gabor's path halved the magnitude of the illusion. This suppression was symmetrical for anchors placed on either side of the Gabor. In a second experiment, we used crowding to degrade the anchoring line's position information by embedding it in a set of parallel lines. In this case, despite the presence of the same lines that reduced the illusion when presented in isolation, the illusory shift was now largely restored. We suggest that the adjacent lines crowded each other, reducing their positional certainty, and thus their ability to anchor the location of the moving Gabor. These findings indicate that the positional uncertainty of the equiluminant Gabor patch is critical for the illusory position offset.

Investigating the Interaction Between Form and Motion Processing: A Review of Basic Research and Clinical Evidence

A widely held view of the visual system supported the perspective that the primate brain is organized in two main specialized streams, called the ventral and dorsal streams. The ventral stream is known to be involved in object recognition (e.g., form and orientation). In contrast, the dorsal stream is thought to be more involved in spatial recognition (e.g., the spatial relationship between objects and motion direction). Recent evidence suggests that these two streams are not segregated but interact with each other. A class of visual stimuli known as Glass patterns has been developed to shed light on this process. Glass patterns are visual stimuli made of pairs of dots, called dipoles, that give the percept of a specific form or apparent motion, depending on the spatial and temporal arrangement of the dipoles. In this review, we show an update of the neurophysiological, brain imaging, psychophysical, clinical, and brain stimulation studies which have assessed form and motion integration mechanisms, and the level at which this occurs in the human and non-human primate brain. We also discuss several studies based on non-invasive brain stimulation techniques that used different types of visual stimuli to assess the cortico-cortical interactions in the visual cortex for the processing of form and motion information. Additionally, we discuss the timing of specific visual processing in the ventral and dorsal streams. Finally, we report some parallels between healthy participants and neurologically impaired patients in the conscious processing of form and motion.

Adaptation to feedback representation of illusory orientation produced from flash grab effect

Adaptation is a ubiquitous property of sensory systems. It is typically considered that neurons adapt to dominant energy in the ambient environment to function optimally. However, perceptual representation of the stimulus, often modulated by feedback signals, sometimes do not correspond to the input state of the stimulus, which tends to be more linked with feedforward signals. Here we investigated the relative contributions to cortical adaptation from feedforward and feedback signals, taking advantage of a visual illusion, the Flash-Grab Effect, to disassociate the feedforward and feedback representation of an adaptor. Results reveal that orientation adaptation is exclusively dependent on the perceived rather than the retinal orientation of the adaptor. Combined fMRI and EEG measurements demonstrate that the perceived orientation of the Flash-Grab Effect is indeed supported by feedback signals in the cortex. These findings highlight the important contribution of feedback signals for cortical neurons to recalibrate their sensitivity.

Feedforward-feedback signal interactions are common in the brain during sensory information processing. Here, the authors show that feedback-driven representation of perceived orientation dominates visual adaptation, despite the discrepant feedforward representation of input orientation.

Neural Correlates of the Conscious Perception of Visual Location Lie Outside Visual Cortex

When perception differs from the physical stimulus, as it does for visual illusions and binocular rivalry, the opportunity arises to localize where perception emerges in the visual processing hierarchy. Representations prior to that stage differ from the eventual conscious percept even though they provide input to it. Here, we investigate where and how a remarkable misperception of position emerges in the brain. This "double-drift" illusion causes a dramatic mismatch between retinal and perceived location, producing a perceived motion path that can differ from its physical path by 45° or more. The deviations in the perceived trajectory can accumulate over at least a second, whereas other motion-induced position shifts accumulate over 80-100 ms before saturating. Using fMRI and multivariate pattern analysis, we find that the illusory path does not share activity patterns with a matched physical path in any early visual areas. In contrast, a whole-brain searchlight analysis reveals a shared representation in anterior regions of the brain. These higher-order areas would have the longer time constants required to accumulate the small moment-to-moment position offsets that presumably originate in early visual cortical areas and then transform these sensory inputs into a final conscious percept. The dissociation between perception and the activity in early sensory cortex suggests that consciously perceived position does not emerge in what is traditionally regarded as the visual system but instead emerges at a higher level.

Ocular torsion is related to perceived motion-induced position shifts

Ocular torsion (i.e., rotations of the eye about the line of sight) can be induced by visual rotational motion. It remains unclear whether and how such visually induced torsion is related to perception. By using the flash-grab effect, an illusory position shift of a briefly flashed stationary target superimposed on a rotating pattern, we examined the relationship between torsion and perception. In two experiments, 25 observers reported the perceived location of a flash while their three-dimensional eye movements were recorded. In Experiment 1, the flash coincided with a direction reversal of a large, centrally displayed, rotating grating. The grating triggered visually induced torsion in the direction of stimulus rotation. The magnitude of torsional eye rotation correlated with the illusory perceptual position shift. To test whether torsion caused the illusion, in Experiment 2, the flash was superimposed on two peripheral gratings rotating in opposite directions. Even though torsion was eliminated, the illusory position shift persisted. Despite the lack of a causal relationship, the torsion-perception correlations indicate a close link between both systems, either through similar visual-input processing or a boost of visual rotational signal strength via oculomotor feedback.

Motion-induced position mis-localization predicts the severity of Alzheimer's disease

Patients with Alzheimer's disease (AD) often exhibit motion processing deficits. It is unclear whether the localization of moving objects - a perceptual process tightly linked to motion - is impaired or intact in AD. In this study, we used the phenomenon of illusory shift of position induced by motion as a behavioural paradigm to probe how the spatial representation differs between AD patients and healthy elderly controls. We measured the magnitudes of motion-induced position shift in a group of AD participants (N = 24) and age-matched elderly observers (N = 24). We found that AD patients showed weakened position mis-localization, but only for motion stimuli of slow speeds. For fast motion, the position mis-localization did not differ significantly between groups. Furthermore, we showed that the magnitudes of position mis-localization can predict the severity of AD; that is, patients with more severe symptoms had less preserved position mis-localization. Our results suggest that AD pathology impacts not only motion processing per se, but also the perceptual process related to motion such as the localization of moving objects.

Perceived shift of the centres of contracting and expanding optic flow fields: Different biases in the lower-right and upper-right visual quadrants

We studied differences in localizing the centres of flow in radially expanding and contracting patterns in different regions of the visual field. Our results suggest that the perceived centre of a peripherally viewed expanding pattern is shifted towards the fovea relative to that of a contracting pattern, but only in the lower right and upper right visual quadrants and when a single speed gradient with appropriate overall speeds of the trajectories of the moving dots was used. The biases were not systematically related to differences of sensitivity to optic flow in different quadrants. Further experiments demonstrated that the biases were likely due to a combination of two effects: an advantage of global processing in favor of the lower visual hemifield and a hemispheric asymmetry in attentional allocation in favor of motion-induced spatial displacement in the right visual hemifield. The bias in the lower right visual quadrant was speed gradient-sensitive and could be reduced to a non-significant level with the usage of multiple speed gradients, possibly due to a special role of the lower visual hemifield in extracting global information from the multiple speed gradients. A holistic processing on multiple speed gradients, rather than a predominant processing on a single speed gradient, was likely adopted. In contrast, the perceived bias in the upper right visual quadrant was overall speed-sensitive and could be reduced to a non-significant level with the reduction of the overall speeds of the trajectories. The implications of these results for understanding motion-induced spatial illusions are discussed.

Motion-induced position shift in early Alzheimer's disease

The localization of object position in space is one of the most important visual abilities in humans. Motion-induced position shift is a perceptual illusion in which the position of a moving object is perceived to be shifted in the direction of motion. In this study, we wanted to explore whether and how Alzheimer’s disease (AD) affects this illusion. We recruited a group of patients with early AD and a group of age-matched healthy controls. In our experiments, two drifting Gabor patches moving in opposite directions were presented and participants were asked to report whether the upper Gabor appeared rightwards or leftwards of the lower one. We measured the psychometric functions, of which the point of subjective alignment was taken as the magnitude of motion-induced position shift. We compared the position shift across the two groups at three different retinal eccentricities. We found that position shifts were systematically smaller in the AD group as comparing to the elderly control group. Our data demonstrated that AD patients were less prone to motion-induced position shift. The results add to the existing knowledge of perceptual deficits in AD patients. We suggest that motion induced position shift may be effective as a new behavioral indicator for AD identification.

Meridian interference reveals neural locus of motion-induced position shifts

When a Gabor patch moves along a path in one direction while its internal texture drifts orthogonally to this path, it can appear to deviate from its physical path by 45° or more. This double-drift illusion is different from other motion-induced position shift effects in several ways: it has an integration period of over a second; the illusory displacement that accumulates over a second or more is orthogonal to rather than along the motion path; the perceptual deviations are much larger; and they have little or no effect on eye movements to the target. In this study we investigated the underlying neural mechanisms of the motion integration and position processing for this double-drift stimulus by testing possible anatomical constraints on its magnitude. We found that the illusion was reduced at the vertical and horizontal meridians when the perceptual path would cross or be driven toward the meridian, but not at other locations or other motion directions. The disruption of the accumulation of the position error at both the horizontal and vertical meridians suggests a central role of quadrantic areas in the generation of this type of motion-induced position shift. NEW & NOTEWORTHY The remarkably strong double-drift illusion is disrupted at both the vertical and horizontal meridians. We propose that this finding is the behavioral consequence of the anatomical gaps at both meridians, suggesting that neural areas with quadrantic representations (e.g., V2, V3) are the initial locus of this motion-induced position shift. This result rules out V1 as the source of the illusion because it has an anatomical break only at the vertical meridian.