Combined smooth and saccadic ocular pursuit during the transient occlusion of a moving visual object

Prediction of time to contact under perceptual and contextual uncertainties

Accurately estimating time to contact (TTC) is crucial for successful interactions with moving objects, yet it is challenging under conditions of sensory and contextual uncertainty, such as occlusion. In this study, participants engaged in a prediction motion task, monitoring a target that moved rightward and an occluder. The participants' task was to press a key when they predicted the target would be aligned with the occluder's right edge. We manipulated sensory uncertainty by varying the visible and occluded periods of the target, thereby modulating the time available to integrate sensory information and the duration over which motion must be extrapolated. Additionally, contextual uncertainty was manipulated by having a predictable and unpredictable condition, meaning the occluder either reliably indicated where the moving target would disappear or provided no such indication. Results showed differences in accuracy between the predictable and unpredictable occluder conditions, with different eye movement patterns in each case. Importantly, the ratio of the time the target was visible, which allows for the integration of sensory information, to the occlusion time, which determines perceptual uncertainty, was a key factor in determining performance. This ratio is central to our proposed model, which provides a robust framework for understanding and predicting human performance in dynamic environments with varying degrees of uncertainty.

Characterizing motion prediction in small autonomous swarms

The use of robotic swarms has become increasingly common in research, industrial, and military domains for tasks such as collective exploration, coordinated movement, and collective localization. Despite the expanded use of robotic swarms, little is known about how swarms are perceived by human operators. To characterize human-swarm interactions, we evaluate how operators perceive swarm characteristics, including movement patterns, control schemes, and occlusion. In a series of experiments manipulating movement patterns and control schemes, participants tracked swarms on a computer screen until they were occluded from view, at which point participants were instructed to estimate the spatiotemporal dynamics of the occluded swarm by mouse click. In addition to capturing mouse click responses, eye tracking was used to capture participants eye movements while visually tracking swarms. We observed that manipulating control schemes had minimal impact on the perception of swarms, and that swarms are easier to track when they are visible compared to when they were occluded. Regarding swarm movements, a complex pattern of data emerged. For example, eye tracking indicates that participants more closely track a swarm in an arc pattern compared to sinusoid and linear movement patterns. When evaluating behavioral click-responses, data show that time is underestimated, and that spatial accuracy is reduced in complex patterns. Results suggest that measures of performance may capture different patterns of behavior, underscoring the need for multiple measures to accurately characterize performance. In addition, the lack of generalizable data across different movement patterns highlights the complexity involved in the perception of swarms of objects.

Tracking an occluded visual target with sequences of saccades

Gaze behavior during visual tracking consists of a combination of pursuit and saccadic movements. When the tracked object is intermittently occluded, the role of smooth pursuit is reduced, with a corresponding increase in the role of saccades. However, studies of visual tracking during occlusion have focused only on the first few saccades, usually with occlusion periods of less than 1 second in duration. We investigated tracking on a circular trajectory with random occlusions and found that an occluded object can be tracked reliably for up to several seconds with mainly anticipatory saccades and very little smooth pursuit. Furthermore, we investigated the accumulation of uncertainty in prediction and found that prediction errors seem to accumulate faster when an absolute reference frame is not available during tracking. We suggest that the observed saccadic tracking reflects the use of a time-based internal estimate of object position that is anchored to the environment via fixations.

The influence of time structure on prediction motion in visual and auditory modalities

Usually people can estimate the correct position of a moving object even when it temporarily moves behind an occlusion. Studies have been performed on this type of occluded motion with prediction motion (PM) tasks in the laboratory. Previous publications have emphasized that people could use mental imagery or apply an oculomotor system to estimate the arrival of a moving stimulus at the target place. Nevertheless, these two ways cannot account for the performance difference under a different set of conditions. Our study tested the role of time structure in a time-to-collision (TTC) task using visual and auditory modalities. In the visual condition, the moving red bar travelled from left to right and was invisible during the entire course but flashed at the initial and the occluded points. The auditory condition and visual condition were alike, except that the flashes in the visual condition were changed to clicks at the initial and the occluded points. The results illustrated that participants' performance was better in the equal time structure condition. The comparison between the two sense modalities demonstrated a similar tendency, which suggested there could be common cognitive processes between visual and auditory modalities when participants took advantage of temporal cues to judge TTC.

The visual control of interceptive steering: How do people steer a car to intercept a moving target?

The visually guided interception of a moving target is a fundamental visuomotor task that humans can do with ease. But how humans carry out this task is still unclear despite numerous empirical investigations. Measurements of angular variables during human interception have suggested three possible strategies: the pursuit strategy, the constant bearing angle strategy, and the constant target-heading strategy. Here, we review previous experimental paradigms and show that some of them do not allow one to distinguish among the three strategies. Based on this analysis, we devised a virtual driving task that allows investigating which of the three strategies best describes human interception. Crucially, we measured participants' steering, head, and gaze directions over time for three different target velocities. Subjects initially aligned head and gaze in the direction of the car's heading. When the target appeared, subjects centered their gaze on the target, pointed their head slightly off the heading direction toward the target, and maintained an approximately constant target-heading angle, whose magnitude varied across participants, while the target's bearing angle continuously changed. With a second condition, in which the target was partially occluded, we investigated several alternative hypotheses about participants' visual strategies. Overall, the results suggest that interceptive steering is best described by the constant target-heading strategy and that gaze and head are coordinated to continuously acquire visual information to achieve successful interception.

Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion

In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.

Reinforcement effects in anticipatory smooth eye movements

When predictive information about target motion is available, anticipatory smooth pursuit eye movements (aSPEM) are consistently generated before target appearance, thereby reducing the typical sensorimotor delay between target motion onset and foveation. By manipulating the probability for target motion direction, we were able to bias the direction and mean velocity of aSPEM. This suggests that motion-direction expectancy has a strong effect on the initiation of anticipatory movements. To further understand the nature of anticipatory smooth eye movements, we investigated different effects of reinforcement on aSPEM. In a first experiment, the reinforcement was contingent to a particular anticipatory behavior. A monetary reward was associated to a criterion-matching anticipatory velocity as estimated online during the gap before target motion onset. Our results showed a small but significant effect of behavior-contingent monetary reward on aSPEM. In a second experiment, the proportion of rewarded trials was manipulated across motion directions (right vs. left) independently from participants' behavior. Our results indicate that a bias in expected reward does not systematically affect anticipatory eye movements. Overall, these findings strengthen the notion that anticipatory eye movements can be considered as an operant behavior (similar to visually guided ones), whereas the expectancy for a noncontingent reward cannot efficiently bias them.

Synaptic mechanisms of interference in working memory

Information from preceding trials of cognitive tasks can bias performance in the current trial, a phenomenon referred to as interference. Subjects performing visual working memory tasks exhibit interference in their responses: the recalled target location is biased in the direction of the target presented on the previous trial. We present modeling work that develops a probabilistic inference model of this history-dependent bias, and links our probabilistic model to computations of a recurrent network wherein short-term facilitation accounts for the observed bias. Network connectivity is reshaped dynamically during each trial, generating predictions from prior trial observations. Applying timescale separation methods, we obtain a low-dimensional description of the trial-to-trial bias based on the history of target locations. Furthermore, we demonstrate task protocols for which our model with facilitation performs better than a model with static connectivity: repetitively presented targets are better retained in working memory than targets drawn from uncorrelated sequences.

Contribution of Visuospatial and Motion-Tracking to Invisible Motion

People experience an object's motion even when it is occluded. We investigate the processing of invisible motion in three experiments. Observers saw a moving circle passing behind an invisible, irregular hendecagonal polygon and had to respond as quickly as possible when the target had “just reappeared” from behind the occluder. Without explicit cues allowing the end of each of the eight hidden trajectories to be predicted (length ranging between 4.7 and 5 deg), we found as expected, if visuospatial attention was involved, anticipation errors, providing that information on pre-occluder motion was available. This indicates that the observers, rather than simply responding when they saw the target, tended to anticipate its reappearance (Experiment 1). The new finding is that, with a fixation mark indicating the center of the invisible trajectory, a linear relationship between the physical and judged occlusion duration is found, but not without it (Experiment 2) or with a fixation mark varying in position from trial to trial (Experiment 3). We interpret the role of central fixation in the differences in distinguishing trajectories smaller than 0.3 deg, by suggesting that it reflects spatiotemporal computation and motion-tracking. These two mechanisms allow visual imagery to form of the point symmetrical to that of the disappearance, with respect to fixation, and then for the occluded moving target to be tracked up to this point.

Learning the trajectory of a moving visual target and evolution of its tracking in the monkey

An object moving in the visual field triggers a saccade that brings its image onto the fovea. It is followed by a combination of slow eye movements and catch-up saccades that try to keep the target image on the fovea as long as possible. The accuracy of this ability to track the "here-and-now" location of a visual target contrasts with the spatiotemporally distributed nature of its encoding in the brain. We show in six experimentally naive monkeys how this performance is acquired and gradually evolves during successive daily sessions. During the early exposure, the tracking is mostly saltatory, made of relatively large saccades separated by low eye velocity episodes, demonstrating that accurate (here and now) pursuit is not spontaneous and that gaze direction lags behind its location most of the time. Over the sessions, while the pursuit velocity is enhanced, the gaze is more frequently directed toward the current target location as a consequence of a 25% reduction in the number of catch-up saccades and a 37% reduction in size (for the first saccade). This smoothing is observed at several scales: during the course of single trials, across the set of trials within a session, and over successive sessions. We explain the neurophysiological processes responsible for this combined evolution of saccades and pursuit in the absence of stringent training constraints. More generally, our study shows that the oculomotor system can be used to discover the neural mechanisms underlying the ability to synchronize a motor effector with a dynamic external event.

Eye movements in the wild: Oculomotor control, gaze behavior & frames of reference

Understanding the brain's capacity to encode complex visual information from a scene and to transform it into a coherent perception of 3D space and into well-coordinated motor commands are among the outstanding questions in the study of integrative brain function. Eye movement methodologies have allowed us to begin addressing these questions in increasingly naturalistic tasks, where eye and body movements are ubiquitous and, therefore, the applicability of most traditional neuroscience methods restricted. This review explores foundational issues in (1) how oculomotor and motor control in lab experiments extrapolates into more complex settings and (2) how real-world gaze behavior in turn decomposes into more elementary eye movement patterns. We review the received typology of oculomotor patterns in laboratory tasks, and how they map onto naturalistic gaze behavior (or not). We discuss the multiple coordinate systems needed to represent visual gaze strategies, how the choice of reference frame affects the description of eye movements, and the related but conceptually distinct issue of coordinate transformations between internal representations within the brain.

Development of internal models and predictive abilities for visual tracking during childhood

The prediction of the consequences of our own actions through internal models is an essential component of motor control. Previous studies showed improvement of anticipatory behaviors with age for grasping, drawing, and postural control. Since these actions require visual and proprioceptive feedback, these improvements might reflect both the development of internal models and the feedback control. In contrast, visual tracking of a temporarily invisible target gives specific markers of prediction and internal models for eye movements. Therefore, we recorded eye movements in 50 children (aged 5-19 yr) and in 10 adults, who were asked to pursue a visual target that is temporarily blanked. Results show that the youngest children (5-7 yr) have a general oculomotor behavior in this task, qualitatively similar to the one observed in adults. However, the overall performance of older subjects in terms of accuracy at target reappearance and variability in their behavior was much better than the youngest children. This late maturation of predictive mechanisms with age was reflected into the development of the accuracy of the internal models governing the synergy between the saccadic and pursuit systems with age. Altogether, we hypothesize that the maturation of the interaction between smooth pursuit and saccades that relies on internal models of the eye and target displacement is related to the continuous maturation of the cerebellum.

Filling gaps in visual motion for target capture

A remarkable challenge our brain must face constantly when interacting with the environment is represented by ambiguous and, at times, even missing sensory information. This is particularly compelling for visual information, being the main sensory system we rely upon to gather cues about the external world. It is not uncommon, for example, that objects catching our attention may disappear temporarily from view, occluded by visual obstacles in the foreground. Nevertheless, we are often able to keep our gaze on them throughout the occlusion or even catch them on the fly in the face of the transient lack of visual motion information. This implies that the brain can fill the gaps of missing sensory information by extrapolating the object motion through the occlusion. In recent years, much experimental evidence has been accumulated that both perceptual and motor processes exploit visual motion extrapolation mechanisms. Moreover, neurophysiological and neuroimaging studies have identified brain regions potentially involved in the predictive representation of the occluded target motion. Within this framework, ocular pursuit and manual interceptive behavior have proven to be useful experimental models for investigating visual extrapolation mechanisms. Studies in these fields have pointed out that visual motion extrapolation processes depend on manifold information related to short-term memory representations of the target motion before the occlusion, as well as to longer term representations derived from previous experience with the environment. We will review recent oculomotor and manual interception literature to provide up-to-date views on the neurophysiological underpinnings of visual motion extrapolation.

Memory and prediction in natural gaze control

In addition to stimulus properties and task factors, memory is an important determinant of the allocation of attention and gaze in the natural world. One way that the role of memory is revealed is by predictive eye movements. Both smooth pursuit and saccadic eye movements demonstrate predictive effects based on previous experience. We have previously shown that unskilled subjects make highly accurate predictive saccades to the anticipated location of a ball prior to a bounce in a virtual racquetball setting. In this experiment, we examined this predictive behaviour. We asked whether the period after the bounce provides subjects with visual information about the ball trajectory that is used to programme the pursuit movement initiated when the ball passes through the fixation point. We occluded a 100 ms period of the ball's trajectory immediately after the bounce, and found very little effect on the subsequent pursuit movement. Subjects did not appear to modify their strategy to prolong the fixation. Neither were we able to find an effect on interception performance. Thus, it is possible that the occluded trajectory information is not critical for subsequent pursuit, and subjects may use an estimate of the ball's trajectory to programme pursuit. These results provide further support for the role of memory in eye movements.

Is acceleration used for ocular pursuit and spatial estimation during prediction motion?

Here we examined ocular pursuit and spatial estimation in a linear prediction motion task that emphasized extrapolation of occluded accelerative object motion. Results from the ocular response up to occlusion showed that there was evidence in the eye position, velocity and acceleration data that participants were attempting to pursue the moving object in accord with the veridical motion properties. They then attempted to maintain ocular pursuit of the randomly-ordered accelerative object motion during occlusion but this was not ideal, and resulted in undershoot of eye position and velocity at the moment of object reappearance. In spatial estimation there was a general bias, with participants less likely to report object reappearance being behind than ahead of the expected position. In addition, participants’ spatial estimation did not take into account the effects of object acceleration. Logistic regression indicated that spatial estimation was best predicted for the majority of participants by the difference between actual object reappearance position and an extrapolation based on pre-occlusion velocity. In combination, and in light of previous work, we interpret these findings as showing that eye movements are scaled in accord with the effects of object acceleration but do not directly specify information for accurate spatial estimation in prediction motion.

Enhanced top-down control during pursuit eye tracking in schizophrenia

Alterations in sensorimotor processing and predictive mechanisms have both been proposed as the primary cause of eye tracking deficits in schizophrenia. 20 schizophrenia patients and 20 healthy controls were assessed on blocks of predictably moving visual targets at constant speeds of 10, 15 or 30°/s. To assess internal drive to the eye movement system based on predictions about the ongoing target movement, targets were blanked off for either 666 or 1,000 ms during the ongoing pursuit movement in additional conditions. Main parameters of interest were eye deceleration after extinction of the visual target and residual eye velocity during blanking intervals. Eye deceleration after target extinction, reflecting persistence of predictive signals, was slower in patients than in controls, implying greater rather than diminished utilization of predictive mechanisms for pursuit in schizophrenia. Further, residual gain was not impaired in patients indicating a basic integrity of internal predictive models. Pursuit velocity gain in patients was reduced in all conditions with visible targets replicating previous findings about a sensorimotor transformation deficit in schizophrenia. A pattern of slower eye deceleration and unimpaired residual gain during blanking intervals implies greater adherence to top-down predictive models for pursuit tracking in schizophrenia. This suggests that predictive modeling is relatively intact in schizophrenia and that the primary cause of abnormal visual pursuit is impaired sensorimotor transformation of the retinal error signal needed for the maintenance of accurate visually driven pursuit. This implies that disruption in extrastriate and sensorimotor systems rather than frontostriatal predictive mechanisms may underlie this widely reported endophenotypes for schizophrenia.

Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task

Despite general agreement that prediction is a central aspect of perception, there is relatively little evidence concerning the basis on which visual predictions are made. Although both saccadic and pursuit eye-movements reveal knowledge of the future position of a moving visual target, in many of these studies targets move along simple trajectories through a fronto-parallel plane. Here, using a naturalistic and racquet-based interception task in a virtual environment, we demonstrate that subjects make accurate predictions of visual target motion, even when targets follow trajectories determined by the complex dynamics of physical interactions and the head and body are unrestrained. Furthermore, we found that, following a change in ball elasticity, subjects were able to accurately adjust their prebounce predictions of the ball's post-bounce trajectory. This suggests that prediction is guided by experience-based models of how information in the visual image will change over time.

Covert tracking: a combined ERP and fixational eye movement study

Attention can be directed to particular spatial locations, or to objects that appear at anticipated points in time. While most work has focused on spatial or temporal attention in isolation, we investigated covert tracking of smoothly moving objects, which requires continuous coordination of both. We tested two propositions about the neural and cognitive basis of this operation: first that covert tracking is a right hemisphere function, and second that pre-motor components of the oculomotor system are responsible for driving covert spatial attention during tracking. We simultaneously recorded event related potentials (ERPs) and eye position while participants covertly tracked dots that moved leftward or rightward at 12 or 20°/s. ERPs were sensitive to the direction of target motion. Topographic development in the leftward motion was a mirror image of the rightward motion, suggesting that both hemispheres contribute equally to covert tracking. Small shifts in eye position were also lateralized according to the direction of target motion, implying covert activation of the oculomotor system. The data addresses two outstanding questions about the nature of visuospatial tracking. First, covert tracking is reliant upon a symmetrical frontoparietal attentional system, rather than being right lateralized. Second, this same system controls both pursuit eye movements and covert tracking.

Do common systems control eye movements and motion extrapolation?

People are able to judge the current position of occluded moving objects. This operation is known as motion extrapolation. It has previously been suggested that motion extrapolation is independent of the oculomotor system. Here we revisited this question by measuring eye position while participants completed two types of motion extrapolation task. In one task, a moving visual target travelled rightwards, disappeared, then reappeared further along its trajectory. Participants discriminated correct reappearance times from incorrect (too early or too late) with a two-alternative forced-choice button press. In the second task, the target travelled rightwards behind a visible, rectangular occluder, and participants pressed a button at the time when they judged it should reappear. In both tasks, performance was significantly different under fixation as compared to free eye movement conditions. When eye movements were permitted, eye movements during occlusion were related to participants' judgements. Finally, even when participants were required to fixate, small changes in eye position around fixation (<2°) were influenced by occluded target motion. These results all indicate that overlapping systems control eye movements and judgements on motion extrapolation tasks. This has implications for understanding the mechanism underlying motion extrapolation.

Internally generated error signals in monkey frontal eye field during an inferred motion task

An internal model for predictive saccades in frontal cortex was investigated by recording neurons in monkey frontal eye field (FEF) during an inferred motion task. Monkeys were trained to make saccades to the extrapolated position of a small moving target that was rendered temporarily invisible and whose trajectory was altered. On approximately two-thirds of the trials, monkeys made multiple saccades while the target was invisible. Primary saccades were correlated with extrapolated target position. Secondary saccades significantly reduced residual errors resulting from imperfect accuracy of the first saccade. These observations suggest that the second saccade was corrective. Because there was no visual feedback, corrective saccades could only be driven by an internally generated error signal. Neuronal activity in the frontal eye field was directionally tuned before both primary and secondary saccades. Separate subpopulations of cells encoded either saccade direction or direction error before the second saccade. These results suggest that FEF neurons encode the error after the first saccade, as well as the direction of the second saccade. Hence, FEF appears to contribute to detecting and correcting movement errors based on internally generated signals.

Where Did they Go? Recovering Dynamic Objects after Interruptions

The aim of the current study was to identify strategies used in recovering dynamic objects after long interruptions. The primary task in this study required participants to track a set of six target dots amongst eight distracter dots and locate them after a 30 second interruption. In one condition the dots reappeared in their displaced locations (moving condition) while in the other condition they reappeared in their original pre-interruption locations (not-moving condition). Consistent with previous research we found that the not-moving condition had significantly better accuracy than the moving condition. Above chance accuracy was found in both conditions. Reaction time data provided further insight into the strategies used to recover displaced objects. In the end, it was concluded that pre-interruption location is the most salient and easily remembered characteristic. Reaction time data did provide preliminary support for the use of on-line tracking during interruptions, although such abilities seem to be limited in capacity to approximately three targets. The results of this research have wide spread implications to domains requiring constant tracking of objects such as air traffic control.

Oculomotor prediction of accelerative target motion during occlusion: long-term and short-term effects

The present study examined the influence of long-term (i.e., between-trial) and short-term (i.e., within-trial) predictive mechanisms on ocular pursuit during transient occlusion. To this end, we compared ocular pursuit of accelerative and decelerative target motion in trials that were presented in random or blocked-order. Catch trials in which target acceleration was unexpectedly modified were randomly interleaved in blocked-order trials. Irrespective of trial order, eye velocity decayed following target occlusion and then recovered towards the different levels of target velocity at reappearance. However, the recovery was better scaled in blocked-order trials than random-order trials. In blocked-order trials only, the reduced gain of smooth pursuit during occlusion was compensated by a change in saccade amplitude and resulted in total eye displacement (TED) that was well matched to target displacement. Subsidiary analysis indicated that three repeats of blocked-order trials was sufficient for participants to modify eye displacement compared to that exhibited in random-order trials, although more trials were required before end-occlusion eye velocity was better scaled. Finally, we found that participants exhibited evidence of a scaled response to an unexpected change in target acceleration (i.e., catch trials), although there were also transfer effects from the preceding blocked-order trials. These findings are consistent with the suggestion that on-the-fly prediction (short-term effect) is combined with memorized information from previous trials (long-term effect) to generate a persistent and veridical prediction of occluded target motion.

Extrapolation of vertical target motion through a brief visual occlusion

It is known that arbitrary target accelerations along the horizontal generally are extrapolated much less accurately than target speed through a visual occlusion. The extent to which vertical accelerations can be extrapolated through an occlusion is much less understood. Here, we presented a virtual target rapidly descending on a blank screen with different motion laws. The target accelerated under gravity (1g), decelerated under reversed gravity (-1g), or moved at constant speed (0g). Probability of each type of acceleration differed across experiments: one acceleration at a time, or two to three different accelerations randomly intermingled could be presented. After a given viewing period, the target disappeared for a brief, variable period until arrival (occluded trials) or it remained visible throughout (visible trials). Subjects were asked to press a button when the target arrived at destination. We found that, in visible trials, the average performance with 1g targets could be better or worse than that with 0g targets depending on the acceleration probability, and both were always superior to the performance with -1g targets. By contrast, the average performance with 1g targets was always superior to that with 0g and -1g targets in occluded trials. Moreover, the response times of 1g trials tended to approach the ideal value with practice in occluded protocols. To gain insight into the mechanisms of extrapolation, we modeled the response timing based on different types of threshold models. We found that occlusion was accompanied by an adaptation of model parameters (threshold time and central processing time) in a direction that suggests a strategy oriented to the interception of 1g targets at the expense of the interception of the other types of tested targets. We argue that the prediction of occluded vertical motion may incorporate an expectation of gravity effects.

Target Acceleration Can Be Extracted and Represented Within the Predictive Drive to Ocular Pursuit

Given sufficient exposure to stimulus presentation, the oculomotor system generates a representation of the stimulus characteristics, which is then used to predict the upcoming target motion. In addition to compensating for the perceptual-motor delay, these predictive processes perpetuate eye motion during a transient occlusion and compensate for the loss of visual input. At present, however, it is not well understood whether and how the oculomotor system extracts and represents target acceleration for subsequent predictive control. To this end, we used a target occlusion paradigm where both position and velocity of the target during the occlusion and at reappearance could not be predicted without extracting target acceleration before target disappearance. We found that the oculomotor response during the blanking period was not influenced by target acceleration when the initial exposure was 200 ms. However, smooth and saccadic eye movements did discriminate between the different levels of acceleration after an initial 500- or 800-ms exposure. In the event that the smooth response during the occlusion did not match well the target trajectory and thus eliminate a developing displacement error, there was an increased saccadic displacement. Still, the combined response during the blanking period did not eliminate retinal slip and position error at target reappearance. These results indicate that information on target acceleration can be extracted on-line, during pursuit of a visible ramp, and then used to drive a predictive oculomotor response in the absence of visual input.

Neural activation associated with corrective saccades during tasks with fixation, pursuit and saccades

Corrective saccades are small eye movements that redirect gaze whenever the actual eye position differs from the desired eye position. In contrast to various forms of saccades including pro-saccades, recentering-saccades or memory guided saccades, corrective saccades have been widely neglected so far. The fMRI correlates of corrective saccades were studied that spontaneously occurred during fixation, pursuit or saccadic tasks. Eyetracking was performed during the fMRI data acquisition with a fiber-optic device. Using a combined block and event-related design, we isolated the cortical activations associated with visually guided fixation, pursuit or saccadic tasks and compared these to the activation associated with the occurrence of corrective saccades. Neuronal activations in anterior inferior cingulate, bilateral middle and inferior frontal gyri, bilateral insula and cerebellum are most likely specifically associated with corrective saccades. Additionally, overlapping activations with the established pro-saccade and, to a lesser extent, pursuit network were present. The presented results imply that corrective saccades represent a potential systematic confound in eye-movement studies, in particular because the frequency of spontaneously occurring corrective saccades significantly differed between fixation, pursuit and pro-saccades.

Phenomenal permanence and the development of predictive tracking in infancy

The perceived spatiotemporal continuity of objects depends on the way they appear and disappear as they move in the spatial layout. This study investigated whether infants' predictive tracking of a briefly occluded object is sensitive to the manner by which the object disappears and reappears. Five-, 7-, and 9-month-old infants were shown a ball rolling across a visual scene and briefly disappearing via kinetic occlusion, instantaneous disappearance, implosion, or virtual occlusion. Three different measures converged to show that predictive tracking increased with age and that infants were most likely to anticipate the reappearance of the ball following kinetic occlusion. These results suggest that infants' knowledge of the permanence and nonpermanence of objects is embodied in their predictive tracking.

A quantitative synchronization model for smooth pursuit target tracking

We propose a quantitative model for human smooth pursuit tracking of a continuously moving visual target which is based on synchronization of an internal expectancy model of the target position coupled to the retinal target signal. The model predictions are tested in a smooth circular pursuit eye tracking experiment with transient target blanking of variable duration. In subjects with a high tracking accuracy, the model accounts for smooth pursuit and repeatedly reproduces quantitatively characteristic patterns of the eye dynamics during target blanking. In its simplest form, the model has only one free parameter, a coupling constant. An extended model with a second parameter, a time delay or memory term, accounts for predictive smooth pursuit eye movements which advance the target. The model constitutes an example of synchronization of a complex biological system with perceived sensory signals.

Different extraretinal neuronal mechanisms of smooth pursuit eye movements in schizophrenia: An fMRI study

Smooth pursuit eye movements (SPEM) are necessary to follow slowly moving targets while maintaining foveal fixation. In about 50% of schizophrenic patients SPEM velocity is reduced. In this study we were interested in identifying the cortical mechanisms associated with extraretinal processing of SPEM in schizophrenic patients. During condition A, patients and healthy subjects had to pursue a constantly visible target (10 degrees /s). During condition B the target was blanked out for 1000 ms while subjects were instructed to continue SPEM. Eye movement data were assessed during scanning sessions by a limbus tracker. During condition A, reduced SPEM velocity in patients was associated with reduced activation of the right ventral premotor cortex and increased activation of the left dorsolateral prefrontal cortex, the right thalamus and the Crus II of the left cerebellar hemisphere. During condition B, SPEM velocity was reduced to a similar extent in both groups. While in patients a decrease in activation was observed in the right cerebellar area VIIIA, the activation of the right anterior cingulate, the right superior temporal cortex, and the bilateral frontal eye fields was increased. The results implicate that schizophrenic patients employ different strategies during SPEM both with and without target blanking than healthy subjects. These strategies predominantly involve extraretinal mechanisms.

Predicting curvilinear target motion through an occlusion

When a tracked target is occluded transiently, extraretinal signals are known to maintain smooth pursuit, albeit with a reduced gain. The extent to which extraretinal signals incorporate predictions of time-varying behavior, such as gradual changes in target direction, is not known. Three experiments were conducted to examine this question. In the experiments, subjects tracked a target that initially moved along a straight path, then (briefly) followed the arc of a circle, before it disappeared behind a visible occlusion. In the first experiment, the target did not emerge from the occlusion and subjects were asked to point to the location where they thought the target would have emerged. Gaze and pointing behaviors demonstrated that most of the subjects predicted that the target would follow a linear path through the occlusion. The direction of this extrapolated path was the same as the final visible target direction. In the second set of experiments, the target did emerge after following a curvilinear path through the occlusion, and subjects were asked to track the target with their eyes. Gaze behaviors indicated that, in this experimental condition, the subjects predicted curvilinear target motion while the target was occluded. Saccades were directed to the unseen curvilinear path and pursuit continued to follow this same path at a reduced speed in the occlusion. Importantly, the direction of smooth pursuit continued to change throughout the occlusion. Smooth pursuit angular velocity was maintained for approximately 200 ms following target disappearance. The results of the experiments indicate that extraretinal signals indeed incorporate cognitive expectations about the time-varying behavior of target motion.

Evidence for Synergy Between Saccades and Smooth Pursuit During Transient Target Disappearance

Visual tracking of moving objects requires prediction to compensate for visual delays and minimize mismatches between eye and target position and velocity. In everyday life, objects often disappear behind an occluder, and prediction is required to align eye and target at reappearance. Earlier studies investigating eye motion during target blanking showed that eye velocity first decayed after disappearance but was sustained or often recovered in a predictive way. Furthermore, saccades were directed toward the unseen target trajectory and therefore appeared to correct for position errors resulting from eye velocity decay. To investigate the synergy between smooth and saccadic eye movements, this study used a target blanking paradigm where both position and velocity of the target at reappearance could vary independently but were presented repeatedly to facilitate prediction. We found that eye velocity at target reappearance was only influenced by expected target velocity, whereas saccades responded to the expected change of target position at reappearance. Moreover, subjects exhibited on-line adaptation, on a trial-by-trial basis, between smooth and saccadic components; i.e., saccades compensated for variability of smooth eye displacement during the blanking period such that gaze at target reappearance was independent of the level of smooth eye displacement. We suggest these results indicate that information arising from efference copies of saccadic and smooth pursuit systems are combined with the goal of adjusting eye position at target reappearance. Based on prior experimental evidence, we hypothesize that this spatial remapping is carried out through interactions between a number of identified neurophysiological structures.