Predictive Smooth Pursuit Eye Movements

Classification of short and long term mild traumatic brain injury using computerized eye tracking

Accurate, and objective diagnosis of brain injury remains challenging. This study evaluated useability and reliability of computerized eye-tracker assessments (CEAs) designed to assess oculomotor function, visual attention/processing, and selective attention in recent mild traumatic brain injury (mTBI), persistent post-concussion syndrome (PPCS), and controls. Tests included egocentric localisation, fixation-stability, smooth-pursuit, saccades, Stroop, and the vestibulo-ocular reflex (VOR). Thirty-five healthy adults performed the CEA battery twice to assess useability and test-retest reliability. In separate experiments, CEA data from 55 healthy, 20 mTBI, and 40 PPCS adults were used to train a machine learning model to categorize participants into control, mTBI, or PPCS classes. Intraclass correlation coefficients demonstrated moderate (ICC > .50) to excellent (ICC > .98) reliability (p < .05) and satisfactory CEA compliance. Machine learning modelling categorizing participants into groups of control, mTBI, and PPCS performed reasonably (balanced accuracy control: 0.83, mTBI: 0.66, and PPCS: 0.76, AUC-ROC: 0.82). Key outcomes were the VOR (gaze stability), fixation (vertical error), and pursuit (total error, vertical gain, and number of saccades). The CEA battery was reliable and able to differentiate healthy, mTBI, and PPCS patients reasonably well. While promising, the diagnostic model accuracy should be improved with a larger training dataset before use in clinical environments.

Age effects on predictive eye movements for action

When interacting with the environment, humans typically shift their gaze to where information is to be found that is useful for the upcoming action. With increasing age, people become slower both in processing sensory information and in performing their movements. One way to compensate for this slowing down could be to rely more on predictive strategies. To examine whether we could find evidence for this, we asked younger (19-29 years) and older (55-72 years) healthy adults to perform a reaching task wherein they hit a visual target that appeared at one of two possible locations. In separate blocks of trials, the target could appear always at the same location (predictable), mainly at one of the locations (biased), or at either location randomly (unpredictable). As one might expect, saccades toward predictable targets had shorter latencies than those toward less predictable targets, irrespective of age. Older adults took longer to initiate saccades toward the target location than younger adults, even when the likely target location could be deduced. Thus we found no evidence of them relying more on predictive gaze. Moreover, both younger and older participants performed more saccades when the target location was less predictable, but again no age-related differences were found. Thus we found no tendency for older adults to rely more on prediction.

A Study on the Effects of a Self-Administered Eye Exercise Program on the Balance and Gait Ability of Chronic Stroke Patients: A Randomized Controlled Trial

This study investigates the effects of a self-administered eye exercise (SEE) program on the balance and gait ability of chronic stroke patients hospitalized due to hemiplegia. This study includes 42 patients diagnosed with stroke-related hemiplegia and hospitalized at D Rehabilitation Hospital. The researcher randomly allocated 42 patients into two groups: the experimental group (EG, n = 21, mean age = 58.14 ± 7.69 years, mean BMI = 22.83 ± 2.19 kg/m2) and the control group (CG, n = 21, mean age = 58.57 ± 6.53 years, mean BMI = 22.81 ± 2.36 kg/m2). The SEE program was applied to the EG and the general self-administered exercise (SE) program was applied to the CG. After 4 weeks of intervention, weight distribution of the affected side, the Timed Up and Go test (TUG), step length of the affected side, step length of the unaffected side, gait speed, and cadence were analyzed and compared. In the within-group comparison, both groups showed significant differences in weight distribution (p < 0.05), TUG (p < 0.05), step length of the affected side (p < 0.05), step length of the unaffected side (p < 0.05), gait speed (p < 0.05), and cadence (p < 0.05). In the between-group comparison, a significant difference in the TUG (p < 0.05) was observed. The SEE program had an overall similar effect to the SE program in improving the balance and gait ability of chronic stroke patients, and had a greater effect on dynamic balance ability. Therefore, the SEE program can be proposed as a self-administered exercise program to improve balance and gait ability in stroke patients who are too weak to perform the SE program in a clinical environment or have a high risk of falling.

Representational horizon and visual space orientation: An investigation into the role of visual contextual cues on spatial mislocalisations

The perceived offset position of a moving target has been found to be displaced forward, in the direction of motion (Representational Momentum; RM), downward, in the direction of gravity (Representational Gravity; RG), and, recently, further displaced along the horizon implied by the visual context (Representational Horizon; RH). The latter, while still underexplored, offers the prospect to clarify the role of visual contextual cues in spatial orientation and in the perception of dynamic events. As such, the present work sets forth to ascertain the robustness of Representational Horizon across varying types of visual contexts, particularly between interior and exterior scenes, and to clarify to what degree it reflects a perceptual or response phenomenon. To that end, participants were shown targets, moving along one out of several possible trajectories, overlaid on a randomly chosen background depicting either an interior or exterior scene rotated -22.5º, 0º, or 22.5º in relation to the actual vertical. Upon the vanishing of the target, participants were required to indicate its last seen location with a computer mouse. For half the participants, the background vanished with the target while for the remaining it was kept visible until a response was provided. Spatial localisations were subjected to a discrete Fourier decomposition procedure to obtain independent estimates of RM, RG, and RH. Outcomes showed that RH's direction was biased towards the horizon implied by the visual context, but solely for exterior scenes, and irrespective of its presence or absence during the spatial localisation response, supporting its perceptual/representational nature.

Interactions between circuit architecture and plasticity in a closed-loop cerebellar system

Determining the sites and directions of plasticity underlying changes in neural activity and behavior is critical for understanding mechanisms of learning. Identifying such plasticity from neural recording data can be challenging due to feedback pathways that impede reasoning about cause and effect. We studied interactions between feedback, neural activity, and plasticity in the context of a closed-loop motor learning task for which there is disagreement about the loci and directions of plasticity: vestibulo-ocular reflex learning. We constructed a set of circuit models that differed in the strength of their recurrent feedback, from no feedback to very strong feedback. Despite these differences, each model successfully fit a large set of neural and behavioral data. However, the patterns of plasticity predicted by the models fundamentally differed, with the direction of plasticity at a key site changing from depression to potentiation as feedback strength increased. Guided by our analysis, we suggest how such models can be experimentally disambiguated. Our results address a long-standing debate regarding cerebellum-dependent motor learning, suggesting a reconciliation in which learning-related changes in the strength of synaptic inputs to Purkinje cells are compatible with seemingly oppositely directed changes in Purkinje cell spiking activity. More broadly, these results demonstrate how changes in neural activity over learning can appear to contradict the sign of the underlying plasticity when either internal feedback or feedback through the environment is present.

Bayesian approaches to smooth pursuit of random dot kinematograms: effects of varying RDK noise and the predictability of RDK direction

Smooth pursuit eye movements respond on the basis of both immediate and anticipated target motion, where anticipations may be derived from either memory or perceptual cues. To study the combined influence of both immediate sensory motion and anticipation, subjects pursued clear or noisy random dot kinematograms (RDKs) whose mean directions were chosen from Gaussian distributions with SDs = 10° (narrow prior) or 45° (wide prior). Pursuit directions were consistent with Bayesian theory in that transitions over time from dependence on the prior to near total dependence on immediate sensory motion (likelihood) took longer with the noisier RDKs and with the narrower, more reliable, prior. Results were fit to Bayesian models in which parameters representing the variability of the likelihood either were or were not constrained to be the same for both priors. The unconstrained model provided a statistically better fit, with the influence of the prior in the constrained model smaller than predicted from strict reliability-based weighting of prior and likelihood. Factors that may have contributed to this outcome include prior variability different from nominal values, low-level sensorimotor learning with the narrow prior, or departures of pursuit from strict adherence to reliability-based weighting. Although modifications of, or alternatives to, the normative Bayesian model will be required, these results, along with previous studies, suggest that Bayesian approaches are a promising framework to understand how pursuit combines immediate sensory motion, past history, and informative perceptual cues to accurately track the target motion that is most likely to occur in the immediate future.NEW & NOTEWORTHY Smooth pursuit eye movements respond on the basis of anticipated, as well as immediate, target motions. Bayesian models using reliability-based weighting of previous (prior) and immediate target motions (likelihood) accounted for many, but not all, aspects of pursuit of clear and noisy random dot kinematograms with different levels of predictability. Bayesian approaches may solve the long-standing problem of how pursuit combines immediate sensory motion and anticipation of future motion to configure an effective response.

Cognitive-perceptual traits associated with autism and schizotypy influence use of physics during predictive visual tracking

Schizophrenia and autism spectrum disorder (ASD) can disrupt cognition and consequently behaviour. Traits of ASD and the subclinical manifestation of schizophrenia called schizotypy have been studied in healthy populations with overlap found in trait profiles linking ASD social deficits to negative schizotypy and ASD attention to detail to positive schizotypy. Here, we probed the relationship between subtrait profiles, cognition and behaviour, using a predictive tracking task to measure individuals' eye movements under three gravity conditions. A total of 48 healthy participants tracked an on-screen projected ball under familiar gravity, inverted upward acceleration (against gravity) and horizontal gravity control conditions while eye movements were recorded and dynamic performance quantified. Participants completed ASD and schizotypy inventories generating highly correlated scores, r = 0.73. All tracked best under the gravity condition, producing anticipatory downward responses from stimulus onset which were delayed under upward inverted gravity. Tracking performance was not associated with overall ASD or schizotypy trait levels. Combining measures using principal components analysis (PCA), we decomposed the inventories into subtraits unveiling interesting patterns. Positive schizotypy was associated with ASD dimensions of rigidity, odd behaviour and face processing, which all linked to anticipatory tracking responses under inverted gravity. In contrast, negative schizotypy was associated with ASD dimensions of social interactions and rigidity and to early stimulus-driven tracking under gravity. There was also substantial nonspecific overlap between ASD and schizotypy dissociated from tracking. Our work links positive-odd traits with anticipatory tracking when physics rules are violated and negative-social traits with exploitation of physics laws of motion.

Precision Concussion Management: Approaches to Quantifying Head Injury Severity and Recovery

Mitigating the substantial public health impact of concussion is a particularly difficult challenge. This is partly because concussion is a highly prevalent condition, and diagnosis is predominantly symptom-based. Much of contemporary concussion management relies on symptom interpretation and accurate reporting by patients. These types of reports may be influenced by a variety of factors for each individual, such as preexisting mental health conditions, headache disorders, and sleep conditions, among other factors. This can all be contributory to non-specific and potentially misleading clinical manifestations in the aftermath of a concussion. This review aimed to conduct an examination of the existing literature on emerging approaches for objectively evaluating potential concussion, as well as to highlight current gaps in understanding where further research is necessary. Objective assessments of visual and ocular motor concussion symptoms, specialized imaging techniques, and tissue-based concentrations of specific biomarkers have all shown promise for specifically characterizing diffuse brain injuries, and will be important to the future of concussion diagnosis and management. The consolidation of these approaches into a comprehensive examination progression will be the next horizon for increased precision in concussion diagnosis and treatment.

The eyes anticipate where objects will move based on their shape

Imagine staring into a clear river, starving, desperately searching for a fish to spear and cook. You see a dark shape lurking beneath the surface. It doesn't resemble any sort of fish you've encountered before - but you're hungry. To catch it, you need to anticipate which way it will move when you lunge for it, to compensate for your own sensory and motor processing delays1,2,3. Yet you know nothing about the behaviour of this creature, and do not know in which direction it will try to escape. What cues do you then use to drive such anticipatory responses? Fortunately, many species4, including humans, have the remarkable ability to predict the directionality of objects based on their shape - even if they are unfamiliar and so we cannot rely on semantic knowledge about their movements5. While it is known that such directional inferences can guide attention5, we do not yet fully understand how such causal inferences are made, or the extent to which they enable anticipatory behaviours. Does the oculomotor system, which moves our eyes to optimise visual input, use directional inferences from shape to anticipate upcoming motion direction? Such anticipation is necessary to stabilise the moving object on the high-resolution fovea of the retina while tracking the shape, a primary goal of the oculomotor system6, and to guide any future interactions7,8. Here, we leveraged a well-known behaviour of the oculomotor system: anticipatory smooth eye movements (ASEM), where an increase in eye velocity is observed in the direction of a stimulus' expected motion, before the stimulus actually moves3, to show that the oculomotor system extracts directional information from shape, and uses this inference to predict and anticipate upcoming motion.

Cues for predictive eye movements in naturalistic scenes

We previously compared following of the same trajectories with eye movements, but either as an isolated targets or embedded in a naturalistic scene-in this case, the movement of a puck in an ice hockey game. We observed that the oculomotor system was able to leverage the contextual cues available in the naturalistic scene to produce predictive eye movements. In this study, we wanted to assess which factors are critical for achieving this predictive advantage by manipulating four factors: the expertise of the viewers, the amount of available peripheral information, and positional and kinematic cues. The more peripheral information became available (by manipulating the area of the video that was visible), the better the predictions of all observers. However, expert ice hockey fans were consistently better at predicting than novices and used peripheral information more effectively for predictive saccades. Artificial cues about player positions did not lead to a predictive advantage, whereas impairing the causal structure of kinematic cues by playing the video in reverse led to a severe impairment. When videos were flipped vertically to introduce more difficult kinematic cues, predictive behavior was comparable to watching the original videos. Together, these results demonstrate that, when contextual information is available in naturalistic scenes, the oculomotor system is successfully integrating them and is not relying only on low-level information about the target trajectory. Critical factors for successful prediction seem to be the amount of available information, experience with the stimuli, and the availability of intact kinematic cues for player movements.

Inferential eye movement control while following dynamic gaze

Attending to other people's gaze is evolutionary important to make inferences about intentions and actions. Gaze influences covert attention and triggers eye movements. However, we know little about how the brain controls the fine-grain dynamics of eye movements during gaze following. Observers followed people's gaze shifts in videos during search and we related the observer eye movement dynamics to the time course of gazer head movements extracted by a deep neural network. We show that the observers' brains use information in the visual periphery to execute predictive saccades that anticipate the information in the gazer's head direction by 190-350ms. The brain simultaneously monitors moment-to-moment changes in the gazer's head velocity to dynamically alter eye movements and re-fixate the gazer (reverse saccades) when the head accelerates before the initiation of the first forward gaze-following saccade. Using saccade-contingent manipulations of the videos, we experimentally show that the reverse saccades are planned concurrently with the first forward gaze-following saccade and have a functional role in reducing subsequent errors fixating on the gaze goal. Together, our findings characterize the inferential and functional nature of social attention's fine-grain eye movement dynamics.

Eye movements in patients with post-COVID condition

Eye movement control is impaired in some neurological conditions, but the impact of COVID-19 on eye movements remains unknown. This study aims to investigate differences in oculomotor function and pupil response in individuals who suffer post-COVID-19 condition (PCC) with cognitive deficits. Saccades, smooth pursuit, fixation, vergence and pupillary response were recorded using an eye tracker. Eye movements and pupil response parameters were computed. Data from 16 controls, 38 COVID mild (home recovery) and 19 COVID severe (hospital admission) participants were analyzed. Saccadic latencies were shorter in controls (183 ± 54 ms) than in COVID mild (236 ± 83 ms) and COVID severe (227 ± 42 ms) participants (p = 0.017). Fixation stability was poorer in COVID mild participants (Bivariate Contour Ellipse Area of 0.80 ± 1.61°2 vs 0.36 ± 0.65 °2 for controls, p = 0.019), while percentage of pupil area reduction/enlargement was reduced in COVID severe participants (39.7 ± 12.7%/31.6 ± 12.7% compared to 51.7 ± 22.0%/49.1 ± 20.7% in controls, p < 0.015). The characteristics of oculomotor alterations found in PCC may be useful to understand different pathophysiologic mechanisms.

Age-related decline of online visuomotor adaptation: a combined effect of deteriorations of motor anticipation and execution

The literature has established that the capability of visuomotor adaptation decreases with aging. However, the underlying mechanisms of this decline are yet to be fully understood. The current study addressed this issue by examining how aging affected visuomotor adaptation in a continuous manual tracking task with delayed visual feedback. To distinguish separate contributions of the declined capability of motor anticipation and deterioration of motor execution to this age-related decline, we recorded and analyzed participants' manual tracking performances and their eye movements during tracking. Twenty-nine older people and twenty-three young adults (control group) participated in this experiment. The results showed that the age-related decline of visuomotor adaptation was strongly linked to degraded performance in predictive pursuit eye movement, indicating that declined capability motor anticipation with aging had critical influences on the age-related decline of visuomotor adaptation. Additionally, deterioration of motor execution, measured by random error after controlling for the lag between target and cursor, was found to have an independent contribution to the decline of visuomotor adaptation. Taking these findings together, we see a picture that the age-related decline of visuomotor adaptation is a joint effect of the declined capability of motor anticipation and the deterioration of motor execution with aging.

Frontal-to-visual information flow explains predictive motion tracking

Predictive tracking demonstrates our ability to maintain a line of vision on moving objects even when they temporarily disappear. Models of smooth pursuit eye movements posit that our brain achieves this ability by directly streamlining motor programming from continuously updated sensory motion information. To test this hypothesis, we obtained sensory motion representation from multivariate electroencephalogram activity while human participants covertly tracked a temporarily occluded moving stimulus with their eyes remaining stationary at the fixation point. The sensory motion representation of the occluded target evolves to its maximum strength at the expected timing of reappearance, suggesting a timely modulation of the internal model of the visual target. We further characterize the spatiotemporal dynamics of the task-relevant motion information by computing the phase gradients of slow oscillations. We discovered a predominant posterior-to-anterior phase gradient immediately after stimulus occlusion; however, at the expected timing of reappearance, the axis reverses the gradient, becoming anterior-to-posterior. The behavioral bias of smooth pursuit eye movements, which is a signature of the predictive process of the pursuit, was correlated with the posterior division of the gradient. These results suggest that the sensory motion area modulated by the prediction signal is involved in updating motor programming.

Inferring visual space from ultra-fine extra-retinal knowledge of gaze position

It has long been debated how humans resolve fine details and perceive a stable visual world despite the incessant fixational motion of their eyes. Current theories assume these processes to rely solely on the visual input to the retina, without contributions from motor and/or proprioceptive sources. Here we show that contrary to this widespread assumption, the visual system has access to high-resolution extra-retinal knowledge of fixational eye motion and uses it to deduce spatial relations. Building on recent advances in gaze-contingent display control, we created a spatial discrimination task in which the stimulus configuration was entirely determined by oculomotor activity. Our results show that humans correctly infer geometrical relations in the absence of spatial information on the retina and accurately combine high-resolution extraretinal monitoring of gaze displacement with retinal signals. These findings reveal a sensory-motor strategy for encoding space, in which fine oculomotor knowledge is used to interpret the fixational input to the retina.

Changes in visual speed perception induced by anticipatory smooth eye movements

Expectations about forthcoming visual motion shaped by observers' experiences are known to induce anticipatory smooth eye movements (ASEM) and changes in visual perception. Previous studies have demonstrated discrete effects of expectations on the control of ASEM and perception. However, the tasks designed in these studies were not able to segregate the effects of expectations and execution of ASEM itself on perception. In the current study, we attempted to directly examine the effect of ASEM itself on visual speed perception using a two-alternative forced-choice task (2AFC task), in which observers were asked to track a pair of sequentially presented visual motion stimuli with their eyes and to judge whether the second stimulus (test stimulus) was faster or slower than the first (reference stimulus). Our results showed that observers' visual speed perception, quantified by a psychometric function, shifted according to ASEM velocity. This was the case, even though there was no difference in the steady-state eye velocity. Further analyses revealed that the observers' perceptual decisions could be explained by a difference in the magnitude of retinal slip velocity in the initial phase of ocular tracking when the reference and test stimuli were presented, rather than in the steady-state phase. Our results provide psychophysical evidence of the importance of initial ocular tracking in visual speed perception and the strong impact of ASEM.

Using Artificial Intelligence for Assistance Systems to Bring Motor Learning Principles into Real World Motor Tasks

Humans learn movements naturally, but it takes a lot of time and training to achieve expert performance in motor skills. In this review, we show how modern technologies can support people in learning new motor skills. First, we introduce important concepts in motor control, motor learning and motor skill learning. We also give an overview about the rapid expansion of machine learning algorithms and sensor technologies for human motion analysis. The integration between motor learning principles, machine learning algorithms and recent sensor technologies has the potential to develop AI-guided assistance systems for motor skill training. We give our perspective on this integration of different fields to transition from motor learning research in laboratory settings to real world environments and real world motor tasks and propose a stepwise approach to facilitate this transition.

The oculomotor signature of expected surprise

Expected surprise, defined as the anticipation of uncertainty associated with the occurrence of a future event, plays a major role in gaze shifting and spatial attention. In the present study, we analyzed its impact on oculomotor behavior. We hypothesized that the occurrence of anticipatory saccades could decrease with increasing expected surprise and that its influence on visually-guided responses could be different given the presence of sensory information and perhaps competitive attentional effects. This hypothesis was tested in humans using a saccadic reaction time task in which a cue indicated the future stimulus position. In the ‘no expected surprise’ condition, the visual target could appear only at one previously cued location. In other conditions, more likely future positions were cued with increasing expected surprise. Anticipation was more frequent and pupil size was larger in the ‘no expected surprise’ condition compared with all other conditions, probably due to increased arousal. The latency of visually-guided saccades increased linearly with the logarithm of surprise (following Hick’s law) but their maximum velocity repeated the arousal-related pattern. Therefore, expected surprise affects anticipatory and visually-guided responses differently. Moreover, these observations suggest a causal chain linking surprise, attention and saccades that could be disrupted in attentional or impulse control disorders.

Differential saccade-pursuit coordination under sleep loss and low-dose alcohol

Introduction

Ocular tracking of a moving object requires tight coordination between smooth pursuit and saccadic eye movements. Normally, pursuit drives gaze velocity to closely match target velocity, with residual position offsets corrected by catch-up saccades. However, how/if common stressors affect this coordination is largely unknown. This study seeks to elucidate the effects of acute and chronic sleep loss, and low-dose alcohol, on saccade-pursuit coordination, as well as that of caffeine.

Methods

We used an ocular tracking paradigm to assess three metrics of tracking (pursuit gain, saccade rate, saccade amplitude) and to compute "ground lost" (from reductions in steady-state pursuit gain) and "ground recouped" (from increases in steady-state saccade rate and/or amplitude). We emphasize that these are measures of relative changes in positional offsets, and not absolute offset from the fovea.

Results

Under low-dose alcohol and acute sleep loss, ground lost was similarly large. However, under the former, it was nearly completely recouped by saccades, whereas under the latter, compensation was at best partial. Under chronic sleep restriction and acute sleep loss with a caffeine countermeasure, the pursuit deficit was dramatically smaller, yet saccadic behavior remained altered from baseline. In particular, saccadic rate remained significantly elevated, despite the fact that ground lost was minimal.

Discussion

This constellation of findings demonstrates differential impacts on saccade-pursuit coordination with low-dose alcohol impacting only pursuit, likely through extrastriate cortical pathways, while acute sleep loss not only disrupts pursuit but also undermines saccadic compensation, likely through midbrain/brainstem pathways. Furthermore, while chronic sleep loss and caffeine-mitigated acute sleep loss show little residual pursuit deficit, consistent with uncompromised cortical visual processing, they nonetheless show an elevated saccade rate, suggesting residual midbrain and/or brainstem impacts.

The influence of stimulus and behavioral histories on predictive control of smooth pursuit eye movements

The smooth pursuit system has the ability to perform predictive feedforward control of eye movements. This study attempted to examine how stimulus and behavioral histories of past trials affect the control of predictive pursuit of target motion with randomized velocities. We used sequential ramp stimuli where the rightward velocity was fixed at 16 deg/s while the leftward velocity was either fixed (predictable) at one of seven velocities (4, 8, 12, 16, 20, 24, or 28 deg/s) or randomized (unpredictable). As a result, predictive pursuit responses were observed not only in the predictable condition but also in the unpredictable condition. Linear mixed-effects (LME) models showed that both stimulus and behavioral histories of the previous two or three trials influenced the predictive pursuit responses in the unpredictable condition. Intriguingly, the goodness of fit of the LME model was improved when both historical effects were fitted simultaneously rather than when each type of historical data was fitted alone. Our results suggest that predictive pursuit systems allow us to track randomized target motion using weighted averaging of the information of target velocity (stimulus) and motor output (behavior) in past time sequences.

Recent understanding of binocular vision in the natural environment with clinical implications

Technological advances in recent decades have allowed us to measure both the information available to the visual system in the natural environment and the rich array of behaviors that the visual system supports. This review highlights the tasks undertaken by the binocular visual system in particular and how, for much of human activity, these tasks differ from those considered when an observer fixates a static target on the midline. The everyday motor and perceptual challenges involved in generating a stable, useful binocular percept of the environment are discussed, together with how these challenges are but minimally addressed by much of current clinical interpretation of binocular function. The implications for new technology, such as virtual reality, are also highlighted in terms of clinical and basic research application.

Flexible prediction of opponent motion with internal representation in interception behavior

Skilled interception behavior often relies on accurate predictions of external objects because of a large delay in our sensorimotor systems. To deal with the sensorimotor delay, the brain predicts future states of the target based on the current state available, but it is still debated whether internal representations acquired from prior experience are used as well. Here we estimated the predictive manner by analyzing the response behavior of a pursuer to a sudden directional change of the evasive target, providing strong evidence that prediction of target motion by the pursuer was incompatible with a linear extrapolation based solely on the current state of the target. Moreover, using neural network models, we validated that nonlinear extrapolation as estimated was computationally feasible and useful even against unknown opponents. These results support the use of internal representations in predicting target motion, suggesting the usefulness and versatility of predicting external object motion through internal representations.

The effect of explicit cues on smooth pursuit termination

Predictive deceleration of eye motion during smooth pursuit is induced by explicit cues indicating the timing of the visual target offset. The first aim of this study (experiment 1) was to determine whether the timing of the onset of cue-based predictive pursuit termination depends on spatial or temporal information using three target velocities. The second aim (experiment 2) was to examine whether an unexpected offset of the target affects the pursuit termination. We conducted a pursuit termination task where participants tracked a moving target and then stopped tracking after the target disappeared. The results of experiment 1 showed that the onset times of predictive eye deceleration were consistent regardless of target velocity, indicating that its timing is controlled by the temporal estimation, rather than the spatial distance between the target and cue positions. In experiment 2, we compared pursuit termination between the following two conditions. One condition did not present any cues (unknown condition), whereas a second condition included a same cue as experiment 1 but the target disappeared 500 ms before the timing indicated by the cue unpredictably (unexpected condition). As a result, the unexpected condition showed significant delays in the onset of eye deceleration, but no difference in the total time for completion of pursuit termination. Therefore, our findings suggest that the cue-based pursuit termination is controlled by the predictive pursuit system, and an unexpected offset of the target yields delays in the onset of eye deceleration, while does not affect the duration of pursuit termination.

A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception

Due to the close relationship between oculomotor behavior and visual processing, eye movements have been studied in many different areas of research over the last few decades. While these studies have brought interesting insights, specialization within each research area comes at the potential cost of a narrow and isolated view of the oculomotor system. In this review, we want to expand this perspective by looking at the interactions between the two most important types of voluntary eye movements: saccades and pursuit. Recent evidence indicates multiple interactions and shared signals at the behavioral and neurophysiological level for oculomotor control and for visual perception during pursuit and saccades. Oculomotor control seems to be based on shared position- and velocity-related information, which leads to multiple behavioral interactions and synergies. The distinction between position- and velocity-related information seems to be also present at the neurophysiological level. In addition, visual perception seems to be based on shared efferent signals about upcoming eye positions and velocities, which are to some degree independent of the actual oculomotor response. This review suggests an interactive perspective on the oculomotor system, based mainly on different types of sensory input, and less so on separate subsystems for saccadic or pursuit eye movements.

Ice hockey spectators use contextual cues to guide predictive eye movements

Eye movements are an integral part of human visual perception. They allow us to have a small foveal region with exquisite acuity and at the same time a large visual field. For a long time, eye movements were regarded as machine-like behaviors in response to visual stimulation¹, but over the past few decades it has been convincingly shown that expectations, intended actions, rewards and many other cognitive factors can have profound effects on the way we move our eyes^2-4. In order to be useful, our oculomotor system must minimize delay with respect to the dynamic events in the visual scene. The ability to do so has been demonstrated in situations where we are in control of these events, for example when we are making a sandwich or tea⁵, and when we are active participants, for example when hitting a cricket ball⁶. But what about scenes with complex dynamics that we do not control or directly take part in, like a hockey game we are watching as a spectator? A semantic influence on gaze fixation location during viewing of tennis videos has been suggested before⁷. Here we use carefully annotated hockey videos to show that the brain is indeed able to exploit the semantic context of the game to anticipate the continuous motion of the puck, leading to eye movements that are fundamentally different than when following exactly the same motion without any context.

Micropursuit and the control of attention and eye movements in dynamic environments

It is more challenging to plan eye movements during perceptual tasks performed in dynamic displays than in static displays. Decisions about the timing of saccades become more critical, and decisions must also involve smooth eye movements, as well as saccades. The present study examined eye movements when judging which of two moving discs would arrive first, or collide, at a common meeting point. Perceptual discrimination after training was precise (Weber fractions < 6%). Strategies reflected a combined contribution of saccades and smooth eye movements. The preferred strategy was to look near the meeting point when strategies were freely chosen. When strategies were assigned, looking near the meeting point produced better performance than switching between the discs. Smooth eye movements were engaged in two ways: (a) low-velocity smooth eye movements correlated with the motion of each disc (micropursuit) were found while the line of sight remained between the discs; and (b) spontaneous smooth pursuit of the pair of discs occurred after the perceptual report, when the discs moved as a pair along a common path. The results show clear preferences and advantages for those eye movement strategies during dynamic perceptual tasks that require minimal management or effort. In addition, smooth eye movements, whose involvement during perceptual tasks within dynamic displays may have previously escaped notice, provide useful indictors of the strategies used to select information and distribute attention during the performance of dynamic perceptual tasks.

Action-dependent processing of self-motion in parietal cortex of macaque monkeys

Successful interaction with the environment requires the dissociation of self-induced from externally induced sensory stimulation. Temporal proximity of action and effect is hereby often used as an indicator of whether an observed event should be interpreted as a result of own actions or not. We tested how the delay between an action (press of a touch bar) and an effect (onset of simulated self-motion) influences the processing of visually simulated self-motion in the ventral intraparietal area (VIP) of macaque monkeys. We found that a delay between the action and the start of the self-motion stimulus led to a rise of activity above the baseline activity before motion onset in a subpopulation of 21% of the investigated neurons. In the responses to the stimulus, we found a significantly lower sustained activity when the press of a touch bar and the motion onset were contiguous compared to the condition when the motion onset was delayed. We speculate that this weak inhibitory effect might be part of a mechanism that sharpens the tuning of VIP neurons during self-induced motion and thus has the potential to increase the precision of heading information that is required to adjust the orientation of self-motion in everyday navigational tasks.NEW & NOTEWORTHY Neurons in macaque ventral intraparietal area (VIP) are responding to sensory stimulation related to self-motion, e.g. visual optic flow. Here, we found that self-motion induced activation depends on the sense of agency, i.e., it differed when optic flow was perceived as self- or externally induced. This demonstrates that area VIP is well suited for study of the interplay between active behavior and sensory processing during self-motion.

Retinal error signals and fluctuations in eye velocity influence oculomotor behavior in subsequent trials

The oculomotor system makes use of an integration of previous stimulus velocities (the prior) and current sensory inputs to adjust initial eye speeds. The present study extended this research by investigating the roles of different retinal or extra-retinal signals for this process. To test for this, participants viewed movement sequences that all ended with the same test trial. Earlier in the sequence, the prior was manipulated by presenting targets that either had different velocities, different starting positions, or target movements designed to elicit differential oculomotor behavior (tracked with or without additional corrective saccades). Additionally, these prior targets could vary in terms of contrast to manipulate reliability. When the velocity of prior trials differed from test trials, the reliability-weighted integration of prior information was replicated. When the prior trials differed in starting position, significant effects on subsequent oculomotor behavior were only observed for the reliable target. Although there were also differences in eye velocity across the different manipulations, they could not explain the observed reliability-weighted integration. When comparing the same physical prior trials but tracked with additional corrective saccades, the eye velocity in the test trial also differed systematically (slower for forward saccades, and faster for backward saccades). The direction of the observed effect contradicts the expectations based on perceived speed and eye velocity, but can be predicted by a combination of retinal velocity and position error signals. Together, these results suggest that general fluctuations in eye velocity as well as retinal error signals are related to oculomotor behavior in subsequent trials.

Expectations about motion direction affect perception and anticipatory smooth pursuit differently

Smooth pursuit eye movements and visual motion perception rely on the integration of current sensory signals with past experience. Experience shapes our expectation of current visual events and can drive eye movement responses made in anticipation of a target, such as anticipatory pursuit. Previous research revealed consistent effects of expectation on anticipatory pursuit-eye movements follow the expected target direction or speed-and contrasting effects on motion perception, but most studies considered either eye movement or perceptual responses. The current study directly compared effects of direction expectation on perception and anticipatory pursuit within the same direction discrimination task to investigate whether both types of responses are affected similarly or differently. Observers (n = 10) viewed high-coherence random-dot kinematograms (RDKs) moving rightward and leftward with a probability of 50%, 70%, or 90% in a given block of trials to build up an expectation of motion direction. They were asked to judge motion direction of interleaved low-coherence RDKs (0%-15%). Perceptual judgements were compared with changes in anticipatory pursuit eye movements as a function of probability. Results show that anticipatory pursuit velocity scaled with probability and followed direction expectation (attraction bias), whereas perceptual judgments were biased opposite to direction expectation (repulsion bias). Control experiments suggest that the repulsion bias in perception was not caused by retinal slip induced by anticipatory pursuit, or by motion adaptation. We conclude that direction expectation can be processed differently for perception and anticipatory pursuit.NEW & NOTEWORTHY We show that expectations about motion direction that are based on long-term trial history affect perception and anticipatory pursuit differently. Whereas anticipatory pursuit direction was coherent with the expected motion direction (attraction bias), perception was biased opposite to the expected direction (repulsion bias). These opposite biases potentially reveal different ways in which perception and action utilize prior information and support the idea of different information processing for perception and pursuit.

Humans adapt their anticipatory eye movements to the volatility of visual motion properties

Animal behavior constantly adapts to changes, for example when the statistical properties of the environment change unexpectedly. For an agent that interacts with this volatile setting, it is important to react accurately and as quickly as possible. It has already been shown that when a random sequence of motion ramps of a visual target is biased to one direction (e.g. right or left), human observers adapt their eye movements to accurately anticipate the target's expected direction. Here, we prove that this ability extends to a volatile environment where the probability bias could change at random switching times. In addition, we also recorded the explicit prediction of the next outcome as reported by observers using a rating scale. Both results were compared to the estimates of a probabilistic agent that is optimal in relation to the assumed generative model. Compared to the classical leaky integrator model, we found a better match between our probabilistic agent and the behavioral responses, both for the anticipatory eye movements and the explicit task. Furthermore, by controlling the level of preference between exploitation and exploration in the model, we were able to fit for each individual's experimental dataset the most likely level of volatility and analyze inter-individual variability across participants. These results prove that in such an unstable environment, human observers can still represent an internal belief about the environmental contingencies, and use this representation both for sensory-motor control and for explicit judgments. This work offers an innovative approach to more generically test the diversity of human cognitive abilities in uncertain and dynamic environments.

Mechanisms that allow cortical preparatory activity without inappropriate movement

We reveal a novel mechanism that explains how preparatory activity can evolve in motor-related cortical areas without prematurely inducing movement. The smooth eye movement region of the frontal eye fields (FEF_SEM) is a critical node in the neural circuit controlling smooth pursuit eye movement. Preparatory activity evolves in the monkey FEF_SEM during fixation in parallel with an objective measure of visual-motor gain. We propose that the use of FEF_SEM output as a gain signal rather than a movement command allows for preparation to progress in pursuit without causing movement. We also show that preparatory modulation of firing rate in FEF_SEM predicts movement, providing evidence against the ‘movement-null’ space hypothesis as an explanation of how preparatory activity can progress without movement. Finally, there is a partial reorganization of FEF_SEM population activity between preparation and movement that would allow for a directionally non-specific component of preparatory visual-motor gain enhancement in pursuit.