Asymmetry in visual motion processing

Tracking and perceiving diverse motion signals: Directional biases in human smooth pursuit and perception

Human smooth pursuit eye movements and motion perception behave similarly when observers track and judge the motion of simple objects, such as dots. But moving objects in our natural environment are complex and contain internal motion. We ask how pursuit and perception integrate the motion of objects with motion that is internal to the object. Observers (n = 20) tracked a moving random-dot kinematogram with their eyes and reported the object’s perceived direction. Objects moved horizontally with vertical shifts of 0, ±3, ±6, or ±9° and contained internal dots that were static or moved ±90° up/down. Results show that whereas pursuit direction was consistently biased in the direction of the internal dot motion, perceptual biases differed between observers. Interestingly, the perceptual bias was related to the magnitude of the pursuit bias (r = 0.75): perceptual and pursuit biases were directionally aligned in observers that showed a large pursuit bias, but went in opposite directions in observers with a smaller pursuit bias. Dissociations between perception and pursuit might reflect different functional demands of the two systems. Pursuit integrates all available motion signals in order to maximize the ability to monitor and collect information from the whole scene. Perception needs to recognize and classify visual information, thus segregating the target from its context. Ambiguity in whether internal motion is part of the scene or contributes to object motion might have resulted in individual differences in perception. The perception-pursuit correlation suggests shared early-stage motion processing or perception-pursuit interactions.

Elements of exogenous attentional cueing preserved during optokinetic motion of the visual scene

Navigating through our environment raises challenges for perception by generating salient background visual motion, and eliciting prominent eye movements to stabilise the retinal image. It remains unclear if exogenous spatial attentional orienting is possible during background motion and the eye movements it causes, and whether this compromises the underlying neural processing. To test this, we combined exogenous orienting, visual scene motion, and EEG. 26 participants viewed a background of moving black and grey bars (optokinetic stimulation). We tested for effects of non-spatially predictive peripheral cueing on visual motion discrimination of a target dot, presented either at the same (valid) or opposite (invalid) location as the preceding cue. Valid cueing decreased reaction times not only when participants kept their gaze fixed on a central point (fixation blocks), but even when there was no fixation point, so that participants performed intensive, repetitive tracking eye movements (eye movements blocks). Overall, manual response reaction times were slower during eye movements. Cueing also produced reliable effects on neural activity on either block, including within the first 120 milliseconds of neural processing of the target. The key pattern with larger ERP amplitudes on invalid versus valid trials showed that the neural substrate of exogenous cueing was highly similar during eye movements or fixation. Exogenous peripheral cueing and its neural correlates are robust against distraction from the moving visual scene, important for perceptual cognition during navigation.

Achieving visual stability during smooth pursuit eye movements: Directional and confidence judgements favor a recalibration model

During smooth pursuit eye movements, the visual system is faced with the task of telling apart reafferent retinal motion from motion in the world. While an efference copy signal can be used to predict the amount of reafference to subtract from the image, an image-based adaptive mechanism can ensure the continued accuracy of this computation. Indeed, repeatedly exposing observers to background motion with a fixed direction relative to that of the target that is pursued leads to a shift in their point of subjective stationarity (PSS). We asked whether the effect of exposure reflects adaptation to motion contingent on pursuit direction, recalibration of a reference signal or both. A recalibration account predicts a shift in reference signal (i.e. predicted reafference), resulting in a shift of PSS, but no change in sensitivity. Results show that both directional judgements and confidence judgements about them favor a recalibration account, whereby there is an adaptive shift in the reference signal caused by the prevailing retinal motion during pursuit. We also found that the recalibration effect is specific to the exposed visual hemifield.

Motion integration is anisotropic during smooth pursuit eye movements

Smooth pursuit eye movements (pursuit) are used to minimize the retinal motion of moving objects. During pursuit, the pattern of motion on the retina carries not only information about the object movement but also reafferent information about the eye movement itself. The latter arises from the retinal flow of the stationary world in the direction opposite to the eye movement. To extract the global direction of motion of the tracked object and stationary world, the visual system needs to integrate ambiguous local motion measurements (i.e., the aperture problem). Unlike the tracked object, the stationary world's global motion is entirely determined by the eye movement and thus can be approximately derived from motor commands sent to the eye (i.e., from an efference copy). Because retinal motion opposite to the eye movement is dominant during pursuit, different motion integration mechanisms might be used for retinal motion in the same direction and opposite to pursuit. To investigate motion integration during pursuit, we tested direction discrimination of a brief change in global object motion. The global motion stimulus was a circular array of small static apertures within which one-dimensional gratings moved. We found increased coherence thresholds and a qualitatively different reflexive ocular tracking for global motion opposite to pursuit. Both effects suggest reduced sampling of motion opposite to pursuit, which results in an impaired ability to extract coherence in motion signals in the reafferent direction. We suggest that anisotropic motion integration is an adaptation to asymmetric retinal motion patterns experienced during pursuit eye movements. NEW & NOTEWORTHY This study provides a new understanding of how the visual system achieves coherent perception of an object's motion while the eyes themselves are moving. The visual system integrates local motion measurements to create a coherent percept of object motion. An analysis of perceptual judgments and reflexive eye movements to a brief change in an object's global motion confirms that the visual and oculomotor systems pick fewer samples to extract global motion opposite to the eye movement.

Kinematic property of target motion conditions gaze behavior and eye-hand synergy during manual tracking

This study investigated how frequency demand and motion feedback influenced composite ocular movements and eye-hand synergy during manual tracking. Fourteen volunteers conducted slow and fast force-tracking in which targets were displayed in either line-mode or wave-mode to guide manual tracking with target movement of direct position or velocity nature. The results showed that eye-hand synergy was a selective response of spatiotemporal coupling conditional on target rate and feedback mode. Slow and line-mode tracking exhibited stronger eye-hand coupling than fast and wave-mode tracking. Both eye movement and manual action led the target signal during fast-tracking, while the latency of ocular navigation during slow-tracking depended on the feedback mode. Slow-tracking resulted in more saccadic responses and larger pursuit gains than fast-tracking. Line-mode tracking led to larger pursuit gains but fewer and shorter gaze fixations than wave-mode tracking. During slow-tracking, incidences of saccade and gaze fixation fluctuated across a target cycle, peaking at velocity maximum and the maximal curvature of target displacement, respectively. For line-mode tracking, the incidence of smooth pursuit was phase-dependent, peaking at velocity maximum as well. Manual behavior of slow or line-mode tracking was better predicted by composite eye movements than that of fast or wave-mode tracking. In conclusion, manual tracking relied on versatile visual strategies to perceive target movements of different kinematic properties, which suggested a flexible coordinative control for the ocular and manual sensorimotor systems.

Inhibition of Steady-State Smooth Pursuit and Catch-Up Saccades by Abrupt Visual and Auditory Onsets

It is known that visual transients prolong saccadic latency and reduce saccadic frequency. The latter effect was attributed to subcortical structures because it occurred only 60–70 ms after stimulus onset. We examined the effects of large task-irrelevant transients on steady-state pursuit and the generation of catch-up saccades. Two screen-wide stripes of equal contrast (4, 20, or 100%) were briefly flashed at equal eccentricities (3, 6, or 12°) from the pursuit target. About 100 ms after flash onset, we observed that pursuit gain dropped by 6–12% and catch-up saccades were entirely suppressed. The relatively long latency of the inhibition suggests that it results from cortical mechanisms that may act by promoting fixation or the deployment of attention over the visual field. In addition, we show that a loud irrelevant sound is able to generate the same inhibition of saccades as visual transients, whereas it only induces a weak modulation of pursuit gain, indicating a privileged access of acoustic information to the saccadic system. Finally, irrelevant changes in motion direction orthogonal to pursuit had a smaller and later inhibitory effect.

Ocular Responses to Brief Motion of Textured Backgrounds During Smooth Pursuit in Humans

We studied the effects of horizontal smooth pursuit on the ocular responses to brief vertical perturbations of textured backgrounds in humans. When the subject was fixating on a stationary target, a brief vertical perturbation of the background elicited a small tracking response. When the subject was pursuing a target moving horizontally, the same background perturbation elicited a larger response: that is, the response to vertical background perturbations was enhanced during pursuit (pursuit-related enhancement). On the other hand, the dependencies of the ocular responses on spatial frequency, temporal frequency, and stimulus contrast were similar regardless of the ongoing behavior of the subject. We also found that a low-level energy-based mechanism underlies the ocular responses to vertical perturbations of the background during fixation and smooth pursuit. We conclude that the pursuit-related enhancement is independent of the properties of visual processing for cross-axis motion of backgrounds, which suggests that this enhancement results from uniform facilitation of the visual system and/or from facilitation of visuomotor transmission downstream of the visual processing.

Trial-by-trial updating of the gain in preparation for smooth pursuit eye movement based on past experience in humans

To understand how the CNS uses past experiences to generate movements that accommodate minute-by-minute environmental changes, we studied the trial-by-trial updating of the gain for initiating smooth pursuit eye movements and how this relates to the history of previous trials. Ocular responses in humans elicited by a small perturbing motion presented 300 ms after appearance of a target were used as a measure of the gain of visuomotor transmission. After the perturbation, the target was either moved horizontally (pursuit trial) or remained in a stationary position (fixation trial). The trial sequence randomly included pursuit and fixation. The amplitude of the response to the perturbation was modulated in a trial-by-trial manner based on the immediately preceding trial, with preceding fixation and pursuit trials decreasing and increasing the gain, respectively. The effect of the previous trial was larger with shorter intertrial intervals, but did not diminish for at least 2,000 ms. A time-series analysis showed that the response amplitude was significantly correlated with the past few trials, with dynamics that could be approximated by a first-order linear system. The results suggest that the CNS integrates recent experiences to set the gain in preparation for upcoming tracking movements in a changing environment.

Contrast and Assimilation in Motion Perception and Smooth Pursuit Eye Movements

The analysis of visual motion serves many different functions ranging from object motion perception to the control of self-motion. The perception of visual motion and the oculomotor tracking of a moving object are known to be closely related and are assumed to be controlled by shared brain areas. We compared perceived velocity and the velocity of smooth pursuit eye movements in human observers in a paradigm that required the segmentation of target object motion from context motion. In each trial, a pursuit target and a visual context were independently perturbed simultaneously to briefly increase or decrease in speed. Observers had to accurately track the target and estimate target speed during the perturbation interval. Here we show that the same motion signals are processed in fundamentally different ways for perception and steady-state smooth pursuit eye movements. For the computation of perceived velocity, motion of the context was subtracted from target motion (motion contrast), whereas pursuit velocity was determined by the motion average (motion assimilation). We conclude that the human motion system uses these computations to optimally accomplish different functions: image segmentation for object motion perception and velocity estimation for the control of smooth pursuit eye movements.

Visually guided reaching depends on motion area MT+

Visual information is crucial for goal-directed reaching. A number of studies have recently shown that motion in particular is an important source of information for the visuomotor system. For example, when reaching a stationary object, movement of the background can influence the trajectory of the hand, even when the background motion is irrelevant to the object and task. This manual following response may be a compensatory response to changes in body position, but the underlying mechanism remains unclear. Here we tested whether visual motion area MT+ is necessary to generate the manual following response. We found that stimulation of MT+ with transcranial magnetic stimulation significantly reduced a strong manual following response. MT+ is therefore necessary for generating the manual following response, indicating that it plays a crucial role in guiding goal-directed reaching movements by taking into account background motion in scenes.

Contextual Effects on Smooth-Pursuit Eye Movements

Segregating a moving object from its visual context is particularly relevant for the control of smooth-pursuit eye movements. We examined the interaction between a moving object and a stationary or moving visual context to determine the role of the context motion signal in driving pursuit. Eye movements were recorded from human observers to a medium-contrast Gaussian dot that moved horizontally at constant velocity. A peripheral context consisted of two vertically oriented sinusoidal gratings, one above and one below the stimulus trajectory, that were either stationary or drifted into the same or opposite direction as that of the target at different velocities. We found that a stationary context impaired pursuit acceleration and velocity and prolonged pursuit latency. A drifting context enhanced pursuit performance, irrespective of its motion direction. This effect was modulated by context contrast and orientation. When a context was briefly perturbed to move faster or slower eye velocity changed accordingly, but only when the context was drifting along with the target. Perturbing a context into the direction orthogonal to target motion evoked a deviation of the eye opposite to the perturbation direction. We therefore provide evidence for the use of absolute and relative motion cues, or motion assimilation and motion contrast, for the control of smooth-pursuit eye movements.

Pursuit responses to target steps during ongoing tracking

Brief smooth eye-velocity responses to target position steps have been reported during smooth pursuit. We investigated position-error responses in eight healthy human subjects, comparing the effects of a step-ramp change in target position when imposed on steady-state smooth pursuit, vestibuloocular reflex (VOR) slow phases, or fixation. During steady-state pursuit or VOR, the target performed a step-ramp movement in the same or in the opposite direction relative to ongoing eye movements. When the step was directed backward relative to steady-state smooth pursuit, eye velocity transiently decreased (1.3 +/- 0.4 degrees /s; average peak change in amplitude +/- SD), beginning about 100 ms after the step. The amplitude of position-error responses varied inversely with the step size. In contrast, there was little or no response in trials with forward steps during steady-state smooth pursuit, when step-ramps were imposed on VOR or when smooth pursuit began from fixation. We hypothesize that during ongoing smooth tracking when a sudden shift in target position is detected the pursuit system compares the direction of ongoing eye velocity with the relative positional error on the retina. In the case of different relative directions between ongoing tracking and a new target eccentricity, a position-error response toward the new target is initiated. Such a mechanism might help the smooth pursuit system to respond better to changes in target direction. These experimental findings were simulated by a mathematical model of smooth pursuit by implementing direction-dependent behavior with a position-error gating mechanism.

Suppression of optokinesis during smooth pursuit eye movements revisited: The role of extra-retinal information

When our eyes track objects that are moving in a richly structured environment, the retinal image of the stationary visual scene inevitably moves over the retina in a direction opposite to the eye movement. Such self-motion-induced global retinal slip usually provides an ideal stimulus for the optokinetic reflex. This reflex operates to compensate for global image flow. However, during smooth pursuit eye movements it must be shut down so that the reflex does not counteract the voluntary pursuit of moving targets. Here, we asked if retinal information is sufficient for this cancellation of the optokinetic reflex during smooth pursuit eye movements. In a series of experiments, we show that neither the eye movement-induced retinal image motion per se nor the relative motion between the pursuit target and the background are sufficient for suppression of optokinesis. We, therefore, conclude that extra-retinal information about smooth pursuit eye movements is required for the cancellation of the optokinetic reflex.

Spatial deployment of attention influences both saccadic and pursuit tracking

We examined the effects of changing spatial aspects of attention during oculomotor tracking. Human subjects were instructed to make a discrimination on either the small (0.8 degrees ) central or the large (8 degrees ) peripheral part of a compound stimulus (two counter-rotating concentric rings) while the stimulus either translated across the screen or was stationary. During this period, a transient perturbation with either step or ramp movement profile occurred. For perturbations leading to a change in position larger than the small ring, saccades occurred more frequently and had much shorter latencies (by 135 ms) when attention was directed to the small ring than when attention was directed to the large ring. These latency differences were sufficiently great that from a single saccade one can identify the attentional instruction with 94% accuracy. However, with target steps as small as the small ring, saccade latencies differed less. For pursuit, ramp perturbations caused larger changes in eye velocity with little change in latency when attention was directed to the small ring. Finally, when only the motion of the non-attended ring was perturbed, most subjects showed stronger saccadic responses to perturbations of the small than the large ring, and stronger pursuit responses to perturbations of the large than the small ring. By fitting the saccade latency distributions with the Reddi and Carpenter LATER model, we found that our subjects apparently employed at least two distinct strategies for changing latency when attending large vs. small. We propose that the timing of the saccade decision process depends on both the size of the attended object and the magnitude of the perturbation.

Visual motion due to eye movements helps guide the hand

Movement of the body, head, or eyes with respect to the world creates one of the most common yet complex situations in which the visuomotor system must localize objects. In this situation, vestibular, proprioceptive, and extra-retinal information contribute to accurate visuomotor control. The utility of retinal motion information, on the other hand, is questionable, since a single pattern of retinal motion can be produced by any number of head or eye movements. Here we investigated whether retinal motion during a smooth pursuit eye movement contributes to visuomotor control. When subjects pursued a moving object with their eyes and reached to the remembered location of a separate stationary target, the presence of a moving background significantly altered the endpoints of their reaching movements. A background that moved with the pursuit, creating a retinally stationary image (no retinal slip), caused the endpoints of the reaching movements to deviate in the direction of pursuit, overshooting the target. A physically stationary background pattern, however, producing retinal image motion opposite to the direction of pursuit, caused reaching movements to become more accurate. The results indicate that background retinal motion is used by the visuomotor system in the control of visually guided action.

Neuroophthalmology: a brief Vademecum

The stunning, intricate interaction between the visual, vestibular and optomotor systems--each a miracle on its own--ensures maintenance of orientation in space as well as visual recognition and target selection despite a host of sensory conflicts and adversary disturbances. Their main goals are to keep a target of interest on the fovea by either maintaining or shifting the direction of gaze in order to produce an accurate internal representation of the visual surroundings, in particular the selected target, and to continuously mirror the spatial relationship between these various visual elements and the self. Not surprising, the implementation of this host of elaborate neural networks encompasses almost every part of the brain, including the brainstem, cerebellum, extrapyramidal system and many areas of the cerebral cortex. Thus far, these systems are among the best investigated in brain research; and enormous knowledge was amassed over the last century employing a variety of techniques, including single cell recordings, eye movement studies, functional imaging and neuropsychological observations. In addition, this prolific line of research has enlightened many fundamental principles of neural and neuronal processing, which have subsequently enriched other fields of brain research as well as computational neuroscience, e.g. the discovery of receptive fields, which have now become a ubiquitous concept in many other areas of neurophysiology. This (improperly) brief, fractional and undoubtedly biased Vademecum is meant to accompany the reader into this marvellous field of neurophysiology and neurology. In particular, it stresses the clinical application of its functional neuroanatomy at the bedside, which, in many respects, is superior to other means of investigating a patient.

Ocular Tracking of Moving Targets: Effects of Perturbing the Background

Primates are able to track a moving target with their eyes, even when the target is seen against a stationary textured background. In this situation, the tracking eye movement induces motion of the background images on the retina (reafference) that competes with the motion of the target's retinal image, potentially disrupting the tracking of the target. Previous work on humans reported that brief perturbations of the background in the opposite direction to pursuit were much less disruptive than perturbations in the same direction as pursuit. Furthermore, if the background moved together with the pursuit target—so as to effectively eliminate the reafference—then the effects of a subsequent background perturbation showed less dependence on direction. This suggested that the direction selectivity to background perturbations during pursuit against a stationary background was due, at least in part, to the prior motion of the background secondary to the pursuit. We now report similar findings in monkeys, and in addition, have investigated the effect of moving the background while the animal was fixating a stationary target. In this situation, the ocular tracking responses to subsequent brief perturbations of the moving background were weaker when the perturbations were in the same direction as the prior background motion than when in the opposite direction. This suggests that the selective insensitivity to the reafferent visual input associated with pursuit across a stationary background is, at least in part, independent of pursuit per se and attributable to a progressive reduction in the sensitivity to sustained background motion.

Recasting the Smooth Pursuit Eye Movement System

Primates use a combination of smooth pursuit and saccadic eye movements to stabilize the retinal image of selected objects within the high-acuity region near the fovea. Pursuit has traditionally been viewed as a relatively automatic behavior, driven by visual motion signals and mediated by pathways that connect visual areas in the cerebral cortex to motor regions in the cerebellum. However, recent findings indicate that this view needs to be reconsidered. Rather than being controlled primarily by areas in extrastriate cortex specialized for processing visual motion, pursuit involves an extended network of cortical areas, and, of these, the pursuit-related region in the frontal eye fields appears to exert the most direct influence. The traditional pathways through the cerebellum are important, but there are also newly identified routes involving structures previously associated with the control of saccades, including the basal ganglia, the superior colliculus, and nuclei in the brain stem reticular formation. These recent findings suggest that the pursuit system has a functional architecture very similar to that of the saccadic system. This viewpoint provides a new perspective on the processing steps that occur as descending control signals interact with circuits in the brain stem and cerebellum responsible for gating and executing voluntary eye movements. Although the traditional view describes pursuit and saccades as two distinct neural systems, it may be more accurate to consider the two movements as different outcomes from a shared cascade of sensory–motor functions.

Commentary: smooth pursuit eye movements: from low-level to high-level vision

If an object of great interest moves in our environment, we are able to elicit smooth pursuit eye movements that keep the image of the moving object stationary on our fovea. The processing of visual motion underlying the execution of smooth pursuit eye movements is very similar to the processing underlying the perception of visual motion. During initiation of smooth pursuit, an averaging across all available motion information occurs. Cognitive factors including attention, prediction and learning are able to influence the execution of smooth pursuit. The pursuit target trajectory in space is represented in the discharge rates of neurons in the posterior parietal cortex of rhesus monkeys.

Cancellation of self-induced retinal image motion during smooth pursuit eye movements

When our eyes are tracking a target that is moving in front of a structured background, global motion of equal speed is induced in the opposite direction. This effect has been termed reafference, which, astonishingly, does not significantly affect the execution of such pursuit eye movements. Employing brief and unexpected injections of full-field motion during ongoing human smooth pursuit, we demonstrate that the sensitivity for full-field motion is reduced strongly in the direction opposite to the eye movement, i.e. the direction of reafferent background motion. Our experiments further characterize this asymmetry in visual motion processing and provide a preliminary explanation for the accuracy of the pursuit system despite self-induced motion.

Segregation of object and background motion in visual area MT: effects of microstimulation on eye movements

To track a moving object, its motion must first be distinguished from that of the background. The center-surround properties of neurons in the middle temporal visual area (MT) may be important for signaling the relative motion between object and background. To test this, we microstimulated within MT and measured the effects on monkeys' eye movements to moving targets. We found that stimulation at "local motion" sites, where receptive fields possessed antagonistic surrounds, shifted pursuit in the preferred direction of the neurons, whereas stimulation at "wide-field motion" sites shifted pursuit in the opposite, or null, direction. We propose that activating wide-field sites simulated background motion, thus inducing a target motion signal in the opposite direction. Our results support the hypothesis that neuronal center-surround mechanisms contribute to the behavioral segregation of objects from the background.