Beyond the point of no return: effects of visual distractors on saccade amplitude and velocity

Saccadic "inhibition" unveils the late influence of image content on oculomotor programming

Image content is prioritized in the visual system. Faces are a paradigmatic example, receiving preferential processing along the visual pathway compared to other visual stimuli. Moreover, face prioritization manifests also in behavior. People tend to look at faces more frequently and for longer periods, and saccadic reaction times can be faster when targeting a face as opposed to a phase-scrambled control. However, it is currently not clear at which stage image content affects oculomotor planning and execution. It can be hypothesized that image content directly influences oculomotor signal generation. Alternatively, the image content could exert its influence on oculomotor planning and execution at a later stage, after the image has been processed. Here we aim to disentangle these two alternative hypotheses by measuring the frequency of saccades toward a visual target when the latter is followed by a visual transient in the central visual field. Behaviorally, this paradigm leads to a reduction in saccade frequency that happens about 90 ms after any visual transient event, also known as saccadic "inhibition". In two experiments, we measured occurrence of saccades in visually guided saccades as well as microsaccades during fixation, using face and noise-matched visual stimuli. We observed that while the reduction in saccade occurrence was similar for both stimulus types, face stimuli lead to a prolonged reduction in eye movements. Moreover, saccade kinematics were altered by both stimulus types, showing an amplitude reduction without change in peak velocity for the earliest saccades. Taken together, our experiments imply that face stimuli primarily affect the later stages of the behavioral phenomenon of saccadic "inhibition". We propose that while some stimulus features are processed at an early stage and can quickly influence eye movements, a delayed signal conveying image content information is necessary to further inhibit/delay activity in the oculomotor system to trigger eye movements.

Presaccadic attention does not facilitate the detection of changes in the visual field

Planning a rapid eye movement (saccade) changes how we perceive our visual world. Even before we move the eyes visual discrimination sensitivity improves at the impending target of eye movements, a phenomenon termed "presaccadic attention." Yet, it is unknown if such presaccadic selection merely affects perceptual sensitivity, or also affects downstream decisional processes, such as choice bias. We report a surprising lack of presaccadic perceptual benefits in a common, everyday setting-detection of changes in the visual field. Despite the lack of sensitivity benefits, choice bias for reporting changes increased reliably for the saccade target. With independent follow-up experiments, we show that presaccadic change detection is rendered more challenging because percepts at the saccade target location are biased toward, and more precise for, only the most recent of two successive stimuli. With a Bayesian model, we show how such perceptual and choice biases are crucial to explain the effects of saccade plans on change detection performance. In sum, visual change detection sensitivity does not improve presaccadically, a result that is readily explained by teasing apart distinct components of presaccadic selection. The findings may have critical implications for real-world scenarios, like driving, that require rapid gaze shifts in dynamically changing environments.

Bright-light distractions and visual performance

Visual distractions pose a significant risk to transportation safety, with laser attacks against aircraft pilots being a common example. This study used a research-grade High Dynamic Range (HDR) display to produce bright-light distractions for 12 volunteer participants performing a combined visual task across central and peripheral visual fields. The visual scene had an average luminance of 10 cd∙m-2 with targets of approximately 0.5° angular size, while the distractions had a maximum luminance of 9,000 cd∙m-2 and were 3.6° in size. The dependent variables were the mean fixation duration during task execution (representative of information processing time), and the critical stimulus duration required to support a target level of performance (representative of task efficiency). The experiment found a statistically significant increase in mean fixation duration, rising from 192 ms without distractions to 205 ms with bright-light distractions (p = 0.023). This indicates a decrease in visibility of the low contrast targets or an increase in cognitive workload that required greater processing time for each fixation in the presence of the bright-light distractions. Mean critical stimulus duration was not significantly affected by the distraction conditions used in this study. Future experiments are suggested to replicate driving and/or piloting tasks and employ bright-light distractions based on real-world data, and we advocate the use of eye-tracking metrics as sensitive measures of changes in performance.

Saccadic inhibition during free viewing in macaque monkeys

Through the process of saccadic inhibition, visual events briefly suppress eye movements including microsaccades. In humans, saccadic inhibition has been shown to occur in response to the presentation of parafoveal or peripheral visual distractors during fixation and target-directed saccades and to physical changes of behaviorally relevant visual objects. In monkeys performing tasks that controlled eye movements, saccadic inhibition of microsaccades and target-directed saccades has been shown. Using eye data from three previously published studies, we investigated how saccade rate changed while monkeys were presented with visual stimuli under conditions with loose or no viewing demands. In two conditions, animals passively sat while an LED lamp flashed or screen-wide images appeared in front of them. In the third condition, images were repeated semiperiodically while animals had to maintain their gaze within a wide rectangular area and detect oddballs. Despite animals not being required to maintain fixation or make saccades to particular targets, the onset of visual events led to a temporary reduction of saccade rate across all conditions. Interestingly, saccadic inhibition was found at image offsets as well. These results show that saccadic inhibition occurs in monkeys during free viewing.NEW & NOTEWORTHY We investigated the time courses of saccade rate following visual stimuli during three conditions of free viewing in macaque monkeys. Under all conditions, saccade rate decreased transiently after the onset of visual stimuli. These results suggest that saccadic inhibition occurs during free viewing.

Superior colliculus saccade motor bursts do not dictate movement kinematics

The primate superior colliculus (SC) contains a topographic map of space, such that the anatomical location of active neurons defines a desired eye movement vector. Complementing such a spatial code, SC neurons also exhibit saccade-related bursts that are tightly synchronized with movement onset. Current models suggest that such bursts constitute a rate code dictating movement kinematics. Here, using two complementary approaches, we demonstrate a dissociation between the SC rate code and saccade kinematics. First, we show that SC burst strength systematically varies depending on whether saccades of the same amplitude are directed towards the upper or lower visual fields, but the movements themselves have similar kinematics. Second, we show that for the same saccade vector, when saccades are significantly slowed down by the absence of a visible saccade target, SC saccade-related burst strengths can be elevated rather than diminished. Thus, SC saccade-related motor bursts do not necessarily dictate movement kinematics.

Eye Movement and Pupil Measures: A Review

Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first describe the main oculomotor events studied in the literature, and their characteristics exploited by different measures. Next, we review various eye movement and pupil measures from prior literature. Finally, we discuss our observations based on applications of these measures, the benefits and practical challenges involving these measures, and our recommendations on future eye-tracking research directions.

Time-dependent inhibition of covert shifts of attention

Visual transients can interrupt overt orienting by abolishing the execution of a planned eye movement due about 90 ms later, a phenomenon known as saccadic inhibition (SI). It is not known if the same inhibitory process might influence covert orienting in the absence of saccades, and consequently alter visual perception. In Experiment 1 (n = 14), we measured orientation discrimination during a covert orienting task in which an uninformative exogenous visual cue preceded the onset of an oriented probe by 140-290 ms. In half of the trials, the onset of the probe was accompanied by a brief irrelevant flash, a visual transient that would normally induce SI. We report a time-dependent inhibition of covert orienting in which the irrelevant flash impaired orientation discrimination accuracy when the probe followed the cue by 190 and 240 ms. The interference was more pronounced when the cue was incongruent with the probe location, suggesting an impact on the reorienting component of the attentional shift. In Experiment 2 (n = 12), we tested whether the inhibitory effect of the flash could occur within an earlier time range, or only within the later, reorienting range. We presented probes at congruent cue locations in a time window between 50 and 200 ms. Similar to Experiment 1, discrimination performance was altered at 200 ms after the cue. We suggest that covert attention may be susceptible to similar inhibitory mechanisms that generate SI, especially in later stages of attentional shifting (> 200 ms after a cue), typically associated with reorienting.

Instantaneous movement-unrelated midbrain activity modifies ongoing eye movements

At any moment in time, new information is sampled from the environment and interacts with ongoing brain state. Often, such interaction takes place within individual circuits that are capable of both mediating the internally ongoing plan as well as representing exogenous sensory events. Here, we investigated how sensory-driven neural activity can be integrated, very often in the same neuron types, into ongoing saccade motor commands. Despite the ballistic nature of saccades, visually induced action potentials in the rhesus macaque superior colliculus (SC), a structure known to drive eye movements, not only occurred intra-saccadically, but they were also associated with highly predictable modifications of ongoing eye movements. Such predictable modifications reflected a simultaneity of movement-related discharge at one SC site and visually induced activity at another. Our results suggest instantaneous readout of the SC during movement generation, irrespective of activity source, and they explain a significant component of kinematic variability of motor outputs.

Dependence of the stimulus-driven microsaccade rate signature in rhesus macaque monkeys on visual stimulus size and polarity

Microsaccades have a steady rate of occurrence during maintained gaze fixation, which gets transiently modulated by abrupt sensory stimuli. Such modulation, characterized by a rapid reduction in microsaccade frequency followed by a stronger rebound phase of high microsaccade rate, is often described as the microsaccadic rate signature, owing to its stereotyped nature. Here, we investigated the impacts of stimulus polarity (luminance increments or luminance decrements relative to background luminance) and size on the microsaccadic rate signature. We presented brief, behaviorally irrelevant visual flashes consisting of large or small, white or black stimuli over an otherwise gray image background. Both large and small stimuli caused robust early microsaccadic inhibition, but postinhibition microsaccade rate rebound was significantly delayed and weakened for large stimuli when compared with small ones. Critically, small black stimuli were associated with stronger modulations in the microsaccade rate signature than small white stimuli, particularly in the postinhibition rebound phase, and black stimuli also amplified the incidence of early stimulus-directed microsaccades. Our results demonstrate that the microsaccadic rate signature is sensitive to stimulus size and polarity, and they point to dissociable neural mechanisms underlying early microsaccadic inhibition after stimulus onset and later microsaccadic rate rebound at longer times thereafter. These results also demonstrate early access of oculomotor control circuitry to diverse sensory representations, particularly for momentarily inhibiting saccade generation with short latencies.NEW & NOTEWORTHY Microsaccade rate is transiently reduced after sudden stimulus onsets, and then strongly rebounds before returning to baseline. We explored the influence of stimulus polarity (black vs. white) and size on this "rate signature." Large stimuli caused more muted microsaccadic rebound than small ones, and microsaccadic rebound was also differentially affected by black versus white stimuli, particularly with small stimuli. These results suggest dissociated neural mechanisms for microsaccadic inhibition and rebound in the microsaccadic rate signature.

Eye Position Error Influence over "Open-Loop" Smooth Pursuit Initiation

The oculomotor system integrates a variety of visual signals into appropriate motor plans, but such integration can have widely varying time scales. For example, smooth pursuit eye movements to follow a moving target are slower and longer lasting than saccadic eye movements and it has been suggested that initiating a smooth pursuit eye movement involves an obligatory "open-loop" interval in which new visual motion signals presumably cannot influence the ensuing motor plan for up to 100 ms after movement initiation. However, this view is contrary to the idea that the oculomotor periphery has privileged access to short-latency visual signals. Here, we show that smooth pursuit initiation is sensitive to visual inputs, even in open-loop intervals. We instructed male rhesus macaque monkeys to initiate saccade-free smooth pursuit eye movements and injected a transient, instantaneous eye position error signal at different times relative to movement initiation. We found robust short-latency modulations in eye velocity and acceleration, starting only ∼50 ms after transient signal occurrence and even during open-loop pursuit initiation. Critically, the spatial direction of the injected position error signal had predictable effects on smooth pursuit initiation, with forward errors increasing eye acceleration and backward errors reducing it. Catch-up saccade frequencies and amplitudes were also similarly altered ∼50 ms after transient signals, much like the well known effects on microsaccades during fixation. Our results demonstrate that smooth pursuit initiation is highly sensitive to visual signals and that catch-up saccade generation is reset after a visual transient.SIGNIFICANCE STATEMENT Smooth pursuit eye movements allow us to track moving objects. The first ∼100 ms of smooth pursuit initiation are characterized by smooth eye acceleration and are overwhelmingly described as being "open-loop"; that is, unmodifiable by new visual motion signals. We found that all phases of smooth pursuit, including the so-called open-loop intervals, are reliably modifiable by visual signals. We injected transient flashes resulting in very brief, spatially specific position error signals to smooth pursuit and observed very short-latency changes in smooth eye movements to minimize such errors. Our results highlight the flexibility of the oculomotor system in reacting to environmental events and suggest a functional role for the pervasiveness of visual sensitivity in oculomotor control brain regions.

Face perception influences the programming of eye movements

Previous studies have shown that face stimuli elicit extremely fast and involuntary saccadic responses toward them, relative to other categories of visual stimuli. In the present study, we further investigated to what extent face stimuli influence the programming and execution of saccades examining their amplitude. We performed two experiments using a saccadic choice task: two images (one with a face, one with a vehicle) were simultaneously displayed in the left and right visual fields of participants who had to initiate a saccade toward the image (Experiment 1) or toward a cross in the image (Experiment 2) containing a target stimulus (a face or a vehicle). Results revealed shorter saccades toward vehicle than face targets, even if participants were explicitly asked to perform their saccades toward a specific location (Experiment 2). Furthermore, error saccades had smaller amplitude than correct saccades. Further analyses showed that error saccades were interrupted in mid-flight to initiate a concurrently-programmed corrective saccade. Overall, these data suggest that the content of visual stimuli can influence the programming of saccade amplitude, and that efficient online correction of saccades can be performed during the saccadic choice task.

Saccadic inhibition in a guided saccade task

The eye movement system reacts very systematically to visual transients that are presented during the planning phase of a saccade. About 50 to 70 ms after the onset of a transient, the number of saccades that are started decreases, a phenomenon that has been termed saccadic inhibition. Saccades started just before this time window are hypometric compared to regular saccades, presumably because the presentation of the transient stops them in mid-flight. Recent research investigating the properties of repeated saccades to fixed locations found that these early saccades were additionally faster than expected from the main sequence relation, suggesting that a saccadic dead time during which saccades can no longer be modified does not exist. The present study investigated the properties of saccades to random locations in a guided saccade task. As expected, early saccades starting just before the saccadic inhibition dip in frequency were hypometric. Their velocity profiles implied that these saccades were actively stopped after reaching peak velocity. However, the peak velocities of these saccades did not generally deviate from the main sequence relation. The question whether an active stop of early saccades is incompatible with the idea of a saccadic dead time is open to debate.

Saccade Reorienting Is Facilitated by Pausing the Oculomotor Program

As we look around the world, selecting our targets, competing events may occur at other locations. Depending on current goals, the viewer must decide whether to look at new events or to ignore them. Two experimental paradigms formalize these response options: double-step saccades and saccadic inhibition. In the first, the viewer must reorient to a newly appearing target; in the second, they must ignore it. Until now, the relationship between reorienting and inhibition has been unexplored. In three experiments, we found saccadic inhibition ∼100 msec after a new target onset, regardless of the task instruction. Moreover, if this automatic inhibition is boosted by an irrelevant flash, reorienting is facilitated, suggesting that saccadic inhibition plays a crucial role in visual behavior, as a bottom-up brake that buys the time needed for decisional processes to act. Saccadic inhibition may be a ubiquitous pause signal that provides the flexibility for voluntary behavior to emerge.

Rapid accumulation of inhibition accounts for saccades curved away from distractors

Saccades curved toward a distractor are accompanied by a burst of neuronal activation at the distractor locus in the intermediate layers of the superior colliculus (SCi) ~30 ms before the initiation of a saccade. Although saccades curve away from inactivated SCi loci, whether inhibition is restricted to a similar critical epoch for saccades curved away from a distractor remains unclear. We examined this possibility by modeling human saccade curvature as a function of the time between onset of a task irrelevant luminance- or color-modulated distractor and initiation of an impending saccade, referred to as saccade distractor onset asynchrony (SDOA). Our results demonstrated that 70 ms of luminance-modulated distractor processing or 90 ms of color-modulated distractor processing was required to modulate saccade trajectories. As these behavioral, feature-based differences were temporally consistent with the cortically mediated neurophysiological differences in visual onset latencies between luminance and color stimuli observed in the oculomotor and visual system, this method provides a noninvasive means to estimate the timing of peak activation in the oculomotor system. As such, we modeled SDOA functions separately for saccades curved toward and away from distractors and observed that a similar temporal process determined the magnitude of saccade curvatures in both contexts, suggesting that saccades deviate away from a distractor due to a rapid accumulation of inhibition in the critical epoch before saccade initiation.NEW & NOTEWORTHY In this research article, we propose a novel, noninvasive approach to behaviorally model the time course of competitive oculomotor processing. Our results highly resembled those from previously published neurophysiological experiments utilizing similar oculomotor processing contexts, thus validating our approach. Furthermore, this methodology provided new insights into the underlying neural mechanism subserving oculomotor processing given that we applied it to a context with which the neural mechanism is more contentious, and the results clearly favored one view.

Alteration of the microsaccadic velocity-amplitude main sequence relationship after visual transients: implications for models of saccade control

Microsaccades occur during gaze fixation to correct for miniscule foveal motor errors. The mechanisms governing such fine oculomotor control are still not fully understood. In this study, we explored microsaccade control by analyzing the impacts of transient visual stimuli on these movements' kinematics. We found that such kinematics can be altered in systematic ways depending on the timing and spatial geometry of visual transients relative to the movement goals. In two male rhesus macaques, we presented peripheral or foveal visual transients during an otherwise stable period of fixation. Such transients resulted in well-known reductions in microsaccade frequency, and our goal was to investigate whether microsaccade kinematics would additionally be altered. We found that both microsaccade timing and amplitude were modulated by the visual transients, and in predictable manners by these transients' timing and geometry. Interestingly, modulations in the peak velocity of the same movements were not proportional to the observed amplitude modulations, suggesting a violation of the well-known "main sequence" relationship between microsaccade amplitude and peak velocity. We hypothesize that visual stimulation during movement preparation affects not only the saccadic "Go" system driving eye movements but also a "Pause" system inhibiting them. If the Pause system happens to be already turned off despite the new visual input, movement kinematics can be altered by the readout of additional visually evoked spikes in the Go system coding for the flash location. Our results demonstrate precise control over individual microscopic saccades and provide testable hypotheses for mechanisms of saccade control in general.NEW & NOTEWORTHY Microsaccadic eye movements play an important role in several aspects of visual perception and cognition. However, the mechanisms for microsaccade control are still not fully understood. We found that microsaccade kinematics can be altered in a systematic manner by visual transients, revealing a previously unappreciated and exquisite level of control by the oculomotor system of even the smallest saccades. Our results suggest precise temporal interaction between visual, motor, and inhibitory signals in microsaccade control.

The pupil is faster than the corneal reflection (CR): Are video based pupil-CR eye trackers suitable for studying detailed dynamics of eye movements?

Most modern video eye trackers use the p-CR (pupil minus CR) technique to deal with small relative movements between the eye tracker camera and the eye. We question whether the p-CR technique is appropriate to investigate saccade dynamics. In two experiments we investigated the dynamics of pupil, CR and gaze signals obtained from a standard SMI Hi-Speed eye tracker. We found many differences between the pupil and the CR signals. Differences concern timing of the saccade onset, saccade peak velocity and post-saccadic oscillation (PSO). We also obtained that pupil peak velocities were higher than CR peak velocities. Saccades in the eye trackers' gaze signal (that is constructed from p-CR) appear to be excessive versions of saccades in the pupil signal. We conclude that the pupil-CR technique is not suitable for studying detailed dynamics of eye movements.