Vision, Perception, and Attention through the Lens of Microsaccades: Mechanisms and Implications

Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory

Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.

Pathways for Naturalistic Looking Behavior in Primate I: Behavioral Characteristics and Brainstem Circuits

Organisms control their visual worlds by moving their eyes, heads, and bodies. This control of "gaze" or "looking" is key to survival and intelligence, but our investigation of the underlying neural mechanisms in natural conditions is hindered by technical limitations. Recent advances have enabled measurement of both brain and behavior in freely moving animals in complex environments, expanding on historical head-fixed laboratory investigations. We juxtapose looking behavior as traditionally measured in the laboratory against looking behavior in naturalistic conditions, finding that behavior changes when animals are free to move or when stimuli have depth or sound. We specifically focus on the brainstem circuits driving gaze shifts and gaze stabilization. The overarching goal of this review is to reconcile historical understanding of the differential neural circuits for different "classes" of gaze shift with two inconvenient truths. (1) "classes" of gaze behavior are artificial. (2) The neural circuits historically identified to control each "class" of behavior do not operate in isolation during natural behavior. Instead, multiple pathways combine adaptively and non-linearly depending on individual experience. While the neural circuits for reflexive and voluntary gaze behaviors traverse somewhat independent brainstem and spinal cord circuits, both can be modulated by feedback, meaning that most gaze behaviors are learned rather than hardcoded. Despite this flexibility, there are broadly enumerable neural pathways commonly adopted among primate gaze systems. Parallel pathways which carry simultaneous evolutionary and homeostatic drives converge in superior colliculus, a layered midbrain structure which integrates and relays these volitional signals to brainstem gaze-control circuits.

Activity in the human superior colliculus associated with reaching for tactile targets

The superior colliculus (SC) plays a major role in orienting movements of eyes and the head and in the allocation of attention. Functions of the SC have been mostly investigated in animal models, including non-human primates. Differences in the SC's anatomy and function between different species question extrapolations of these studies to humans without further validation. Few electrophysiological and neuroimaging studies in animal models and humans have reported a role of the SC in visually guided reaching movements. Using BOLD fMRI imaging, we sought to decipher if the SC is also active during reaching movements guided by tactile stimulation. Participants executed reaching movements to visual and tactile target positions. When contrasted against visual and tactile stimulation without reaching, we found increased SC activity with reaching not only for visual but also for tactile targets. We conclude that the SC's involvement in reaching does not rely on visual inputs. It is also independent from a specific sensory modality. Our results indicate a general involvement of the human SC in upper limb reaching movements.

Microsaccade rate activity during the preparation of pro- and antisaccades

Microsaccades belong to the category of fixational micromovements and may be crucial for image stability on the retina. Eye movement paradigms typically require fixational control, but this does not eliminate all oculomotor activity. The antisaccade task requires a planned eye movement in the direction opposite of an onset, allowing separation of planning and execution. We build on previous studies of microsaccades in the antisaccade task using a combination of fixed and mixed pro- and antisaccade blocks. We hypothesized that microsaccade rates may be reduced prior to the execution of antisaccades as compared with regular saccades (prosaccades). In two experiments, we measured microsaccades in four conditions across three trial blocks: one block each of fixed prosaccade and antisaccade trials, and a mixed block where both saccade types were randomized. We anticipated that microsaccade rates would be higher prior to antisaccades than prosaccades due to the need to preemptively suppress reflexive saccades during antisaccade generation. In Experiment 1, with monocular eye tracking, there was an interaction between the effects of saccade and block type on microsaccade rates, suggesting lower rates on antisaccade trials, but only within mixed blocks. In Experiment 2, eye tracking was binocular, revealing suppressed microsaccade rates on antisaccade trials. A cluster permutation analysis of the microsaccade rate over the course of a trial did not reveal any particular critical time for this difference in microsaccade rates. Our findings suggest that microsaccade rates reflect the degree of suppression of the oculomotor system during the antisaccade task.

Visual Functions of the Primate Superior Colliculus

The superior colliculus (SC) is a subcortical brain structure that is relevant for sensation, cognition, and action. In nonhuman primates, a rich history of studies has provided unprecedented detail about this structure's role in controlling orienting behaviors; as a result, the primate SC has become primarily regarded as a motor control structure. However, as in other species, the primate SC is also a highly visual structure: A fraction of its inputs is retinal and complemented by inputs from visual cortical areas, including the primary visual cortex. Motivated by this, recent investigations are revealing the rich visual pattern analysis capabilities of the primate SC, placing this structure in an ideal position to guide orienting movements. The anatomical proximity of the primate SC to both early visual inputs and final motor control apparatuses, as well as its ascending feedback projections to the cortex, affirms an important role for this structure in active perception.

Microsaccades and temporal attention at different locations of the visual field

Temporal attention, the prioritization of information at specific points in time, improves performance in behavioral tasks but cannot ameliorate the perceptual asymmetries that exist across the visual field. That is, even after attentional deployment, performance is better along the horizontal than vertical meridian and worse at the upper than lower vertical meridian. Here we asked whether and how microsaccades-tiny fixational eye-movements-could mirror or alternatively attempt to compensate for these performance asymmetries by assessing temporal profiles and direction of microsaccades as a function of visual field location. Observers were asked to report the orientation of one of two targets presented at different time points, in one of three blocked locations (fovea, right horizontal meridian, upper vertical meridian). We found the following: (1) Microsaccade occurrence did not affect either task performance or the magnitude of the temporal attention effect. (2) Temporal attention modulated the microsaccade temporal profiles, and this modulation varied with polar angle location. At all locations, microsaccade rates were significantly more suppressed in anticipation of the target when temporally cued than in the neutral condition. Moreover, microsaccade rates were more suppressed during target presentation in the fovea than in the right horizontal meridian. (3) Across locations and attention conditions, there was a pronounced bias toward the upper hemifield. Overall, these results reveal that temporal attention benefits performance similarly around the visual field, microsaccade suppression is more pronounced for attention than expectation (neutral trials) across locations, and the directional bias toward the upper hemifield could reflect an attempt to compensate for typical poor performance at the upper vertical meridian.

Stimulus representations in visual cortex shaped by spatial attention and microsaccades

Microsaccades (MSs) are commonly associated with spatially directed attention, but how they affect visual processing is still not clear. We studied MSs in a task in which the animal was randomly cued to attend to a target stimulus and ignore distractors, and it was rewarded for detecting a color change in the target. We found that the enhancement of firing rates normally found with attention to a cued stimulus was delayed until the first MS directed towards that stimulus. Once that MS occurred, attention to the target was engaged and there were persistent effects of attention on firing rates for the remainder of the trial. These effects were found in the superficial and deep layers of V4 as well as the lateral pulvinar and IT cortex. Although the tuning curves of V4 cells do not change depending on the locus of spatial attention, we found pronounced effects of MS direction on stimulus representations that persisted for the length of the trial in V4. In intervals following a MS towards the target in the RF, stimulus decoding from population activity was substantially better than in intervals following a MS away from the target. Likewise, turning curves of cells were substantially sharper following a MS towards the target in the RF. This sharpening appeared to result from both a "refreshing" of the initial transient sensory response to stimulus onset, and a magnification of the effects of attention in this condition. MSs to the target also enhanced the neuronal response to the behaviorally relevant target color change and led to faster reaction times. These results thus reveal a major link between spatial attention, object processing and its coordination with eye movements.

Role of Rostral Superior Colliculus in Gaze Stabilization during Visual Fixation

Visual fixation (i.e., holding gaze on a specific visual object or location of interest) has been shown to be influenced by activity in the rostral pole of the intermediate layers of the superior colliculus (SCi)-a sensory-motor integration nucleus in the midbrain involved in visual fixation and saccadic eye movement generation. Neurons in the rostral SCi discharge tonically during visual fixation and pause during saccades to locations beyond their foveal visual-sensory or saccadic-motor response fields. Injection of muscimol to deactivate rostral SCi neurons also leads to an increase in fixation instability. However, the precise role of rostral SCi activity for controlling visual fixation has not been established and is actively debated. Here, we address whether this activity reflects signals related to task demands (i.e., maintaining visual fixation) or foveal visual stimulus properties. Two non-human primates performed an oculomotor task that required fixation of a central fixation point (FP) of varying luminance at the start of each trial. During this fixation period, we measured fixational saccades (≤ 2° of the FP, including microsaccades) and fixation-error saccades (> 2° from the FP) in combination with activity from the rostral SCi. Fixation of the lowest FP luminance increased the latency (onset time relative to initial FP foveation) for both fixational and fixation-error saccades. Fifty percent of the rostral SCi neurons exhibited activity that opposed the change in FP luminance and correlated with delayed fixational saccades and increased fixation-error saccades. Twenty-two percent of rostral SCi neurons exhibited activity that followed the change in FP luminance and correlated with earlier fixational saccades and decreased fixation-error saccades. This suggests the rostral SCi contains both sensory-driven and task-related motor signals related to foveal sensory stimuli and visual fixation. This evidence supports a role for the rostral SCi in gaze stabilization and can help inform artificial computational models of vision.

Targeting displacement as an indicator of binocular fixation in normal Chinese adults

Purpose

The stability of fixation is crucial for the development of visual function. In this study, we quantify the deviation of visual target during fixational and saccadic tasks using eye-tracking technology, reflecting the control ability and characteristics of fixational displacement among healthy adults in a convenient method.

Methods

One hundred healthy participants aged between 18 and 55 years were recruited in the study. All participants underwent a complete ophthalmic assessment. The eye positions in the fixational and saccadic tasks were documented and analyzed by the Tobii eye-tracking system. Participants were grouped by age and gender. Targeting displacement (TD), defined as the average displacement between visual target and the mean of fixation points corresponding to that stimuli, was used to quantitatively observe fixational displacement in the horizontal and vertical directions.

Result

There was a strong reproducibility of TD as an indicator of fixation (ICC 0.812 to 0.891, p < 0.001). The TD in fixational task was significantly smaller than that of the saccadic task (3.884 ± 0.525 vs. 4.484 ± 0.509, p < 0.001) among normal people. Moreover, the difference of TD in the horizontal and vertical meridians was related to the nature of the task: In the fixational task, the TD in horizontal was smaller than that in the vertical (p < 0.001), whereas the TD in horizontal was larger than that in vertical in the saccadic task (p = 0.003). In the different age and gender groups: There was no significant difference between different gender and age groups in fixational task. However, during the saccadic task, males had smaller TD in the vertical direction than females (4.061 ± 0.495 vs. 4.404 ± 0.484, p = 0.002), and the average TD increased with age, mainly in the vertical direction (all p < 0.05). The fixation stability decreased significantly in the group over 50-years-old.

Conclusion

By reporting the fixational displacement of different genders and ages in fixational and saccadic tasks, as well as different longitude lines among normal people, our study might provide an objective, quantitative and convenient reference index for the evaluation of fixation stability in visual impairment diseases and aging phenomenon of visual function.

Functional but not obligatory link between microsaccades and neural modulation by covert spatial attention

Covert spatial attention is associated with spatial modulation of neural activity as well as with directional biases in fixational eye movements known as microsaccades. We studied how these two ‘fingerprints’ of attention are interrelated in humans. We investigated spatial modulation of 8-12 Hz EEG alpha activity and microsaccades when attention is directed internally within the spatial layout of visual working memory. Consistent with a common origin, spatial modulations of alpha activity and microsaccades co-vary: alpha lateralisation is stronger in trials with microsaccades toward versus away from the memorised location of the to-be-attended item and occurs earlier in trials with earlier microsaccades toward this item. Critically, however, trials without attention-driven microsaccades nevertheless show clear spatial modulation of alpha activity – comparable to trials with attention-driven microsaccades. Thus, directional biases in microsaccades correlate with neural signatures of spatial attention, but they are not necessary for neural modulation by spatial attention to be manifest.

Covert visual spatial attention modulates neural activity and biases the direction of small eye movements, known as microsaccades. Here, the authors show that these two markers co-vary, but that microsaccades are not necessary for neural modulation by attention to occur.

Optic Flow Speed and Retinal Stimulation Influence Microsaccades

Microsaccades are linked with extraretinal mechanisms that significantly alter spatial perception before the onset of eye movements. We sought to investigate whether microsaccadic activity is modulated by the speed of radial optic flow stimuli. Experiments were performed in the dark on 19 subjects who stood in front of a screen covering 135 × 107° of the visual field. Subjects were instructed to fixate on a central fixation point while optic flow stimuli were presented in full field, in the foveal, and in the peripheral visual field at different dot speeds (8, 11, 14, 17, and 20°/s). Fixation in the dark was used as a control stimulus. For almost all tested speeds, the stimulation of the peripheral retina evoked the highest microsaccade rate. We also found combined effects of optic flow speed and the stimulated retinal region (foveal, peripheral, and full field) for microsaccade latency. These results show that optic flow speed modulates microsaccadic activity when presented in specific retinal portions, suggesting that eye movement generation is strictly dependent on the stimulated retinal regions.

The dynamics of microsaccade amplitude reflect shifting of covert attention

Attention flexibly shifts between spatial locations to accommodate task demands. The present study examined if the dynamics of attentional shifting are seen in microsaccades whose direction has been shown to accompany the shifts of covert attention. In a spatial cueing task, the cue predicted the target location on 100%, 75%, or 50% of the trials. The results revealed that microsaccade rate and amplitude were both reduced following cue onset and then rebounded. Both microsaccade rate and amplitude were biased towards the opposite direction of the cue and then returned to the cued direction. Importantly, the cue validity modulated the temporal profile of microsaccade amplitude but had little impact on the temporal profile of microsaccade rate. In line with this, the cueing effect measured with target response accuracy was correlated with the microsaccade amplitude only. These results indicate that the temporal dynamics of microsaccade amplitude reflect shifting of covert attention.

Eye Movement and Pupil Measures: A Review

Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first describe the main oculomotor events studied in the literature, and their characteristics exploited by different measures. Next, we review various eye movement and pupil measures from prior literature. Finally, we discuss our observations based on applications of these measures, the benefits and practical challenges involving these measures, and our recommendations on future eye-tracking research directions.

Distinct Sensory and Goal Related Signals Underlie the Gap Effect in the Superior Colliculus

The removal of a fixation point (FP) prior to the appearance of a saccade target (gap effect) influences pre-motor circuits and reduces saccadic reaction time (SRT). Saccade preparation signals underlying the gap effect have been observed within the intermediate layers of the superior colliculus (SCi). Neurons in the caudal SCi, coding a target location, increase their activity during the gap, while neurons in the rostral SCi, with tonic activity related to visual fixation, decrease activity. However, the gap effect confounds two factors: 1) a goal-driven temporal warning component (upcoming saccade target appearance); and 2) a stimulus-driven sensory component (FP disappearance). These factors combine to reduce SRT and elicit pre-target responses in the SCi. To dissociate warning and sensory effects, we altered the luminance of the FP during the gap period (renamed warning period) such that it could increase, decrease, or stay the same. Faster SRTs resulted with larger decrements in FP luminance. Different categories of SCi warning period activity were evaluated: 1) always increasing or decreasing; or 2) sensory-linked responses to changes in FP luminance. In the caudal SCi (at the location coding the target), all activity correlated negatively with SRT (i.e. saccade facilitation) and two categories of activity were observed (always increasing or opposing FP luminance changes). In the rostral SCi, four categories of activity were observed: Activity that increased or followed the change in FP luminance correlated positively with SRT (i.e. saccade inhibition), while activity that decreased or opposed FP luminance changes correlated negatively with SRT. Such SCi activity reflected both goal-driven saccade preparation signals and FP sensory properties.

The role of fixation disengagement and oculomotor preparation in gap saccade task is gap-duration dependent

The influence of internal brain state on behavioral performance is well illustrated by the gap-saccade task, in which saccades might be initiated with short latency (express saccade) or with long latency (regular saccade) even though the external visual condition is identical. Accumulated evidence has demonstrated that the internal brain state is different before the initiation of an express saccade than of a regular saccade. However, the reported origin of the fluctuation of internal brain state is disputed among previous studies, e.g., the fixation disengagement theory versus the oculomotor preparation theory. In the present study, we examined these two theories by analyzing the rate and direction of fixational saccades, i.e., small amplitude saccades during fixation period, because they could be modulated by internal brain state. Since fixation disengagement is not spatially tuned, it might affect the rate but not direction of fixational saccade. In contrast, oculomotor preparation can contain the spatial information for upcoming saccade, thus, it might have a distinct effect on fixational saccade direction. We found that the different spatiotemporal characteristics of fixational saccades among tasks with different gap durations reveals different driven force to change the internal brain state. Under short gap duration (100 ms), fixation disengagement plays a primary role in switching internal brain state. Conversely, under medium (200 ms) and long (400 ms) gap durations, oculomotor preparation plays a primary role. These results suggest that both fixation disengagement and oculomotor preparation can change the internal brain state, but their relative contributions are gap-duration dependent.

Role of the frontal eye field in human microsaccade responses: A TMS study

Microsaccade is a type of fixational eye movements that is modulated by various sensory and cognitive processes, and impact our visual perception. Although studies in monkeys have demonstrated a functional role for the superior colliculus and frontal eye field (FEF) in controlling microsaccades, our understanding of the neural mechanisms underlying the generation of microsaccades is still limited. By applying continuous theta-burst stimulation (cTBS) over the right FEF and the vertex, we investigated the role of the FEF in generating human microsaccade responses evoked by salient stimuli or by changes in background luminance. We observed higher microsaccade rates prior to target appearance, and larger rebound in microsaccade occurrence following salient stimuli, when disruptive cTBS was applied over FEF compared to vertex stimulation. Moreover, the microsaccade direction modulation after changes in background luminance was disrupted with FEF stimulation. Together, our results constitute the first evidence of FEF modulation in human microsaccade responses.

Microsaccades and attention in a high-acuity visual alignment task

While aiming and shooting, we make tiny eye movements called microsaccades that shift gaze between task-relevant objects within a small region of the visual field. However, in the brief period before pressing the trigger, microsaccades are suppressed. This might be due to the lack of a requirement to shift gaze as the retinal images of the two objects begin to overlap on the fovea. Alternatively, we might actively suppress microsaccades to prevent any disturbances in visual perception caused by microsaccades around the time of their occurrence and their subsequent effect on shooting performance. In this study we looked at microsaccade rates while participants performed a simulated shooting task under two conditions: a normal condition in which they moved their eyes freely, and an eccentric condition in which they maintained gaze on a fixed target while performing the shooting task at 5° eccentricity. As expected, microsaccade rate dropped near the end of the task in the normal viewing condition. However, we also found the same decrease for the eccentric condition in which microsaccades did not shift gaze between the task objects. Microsaccades are also produced in response to shifts in covert attention. To test whether disengagement of covert attention from the eccentric shooting location caused the drop in microsaccade rate, we monitored the location of participants' spatial attention by using a Rapid Serial Visual Presentation (RSVP) task simultaneously at a location opposite to the shooting task. Target letter detection at the RSVP location did not improve during the drop in microsaccade rate, suggesting that covert attention was maintained at the shooting task location. We conclude that in addition to their usual gaze-shifting function, microsaccades during fine-acuity tasks might be modulated by cognitive processes other than spatial attention.

Dependence of perceptual saccadic suppression on peri-saccadic image flow properties and luminance contrast polarity

Across saccades, perceptual detectability of brief visual stimuli is strongly diminished. We recently observed that this perceptual suppression phenomenon is jumpstarted in the retina, suggesting that the phenomenon might be significantly more visual in nature than normally acknowledged. Here, we explicitly compared saccadic suppression strength when saccades were made across a uniform image of constant luminance versus when saccades were made across image patches of different luminance, width, and trans-saccadic luminance polarity. We measured perceptual contrast thresholds of human subjects for brief peri-saccadic flashes of positive (luminance increments) or negative (luminance decrements) polarity. Thresholds were >6–7 times higher when saccades translated a luminance stripe or edge across the retina than when saccades were made over a completely uniform image patch. Critically, both background luminance and flash luminance polarity strongly modulated peri-saccadic contrast thresholds. In addition, all of these very same visual dependencies also occurred in the absence of any saccades, but with qualitatively similar rapid translations of image patches across the retina. This similarity of visual dependencies with and without saccades supports the notion that perceptual saccadic suppression may be fundamentally a visual phenomenon, which strongly motivates neurophysiological and theoretical investigations on the role of saccadic eye movement commands in modulating its properties.

Instantaneous movement-unrelated midbrain activity modifies ongoing eye movements

At any moment in time, new information is sampled from the environment and interacts with ongoing brain state. Often, such interaction takes place within individual circuits that are capable of both mediating the internally ongoing plan as well as representing exogenous sensory events. Here, we investigated how sensory-driven neural activity can be integrated, very often in the same neuron types, into ongoing saccade motor commands. Despite the ballistic nature of saccades, visually induced action potentials in the rhesus macaque superior colliculus (SC), a structure known to drive eye movements, not only occurred intra-saccadically, but they were also associated with highly predictable modifications of ongoing eye movements. Such predictable modifications reflected a simultaneity of movement-related discharge at one SC site and visually induced activity at another. Our results suggest instantaneous readout of the SC during movement generation, irrespective of activity source, and they explain a significant component of kinematic variability of motor outputs.

A low-cost, high-performance video-based binocular eye tracker for psychophysical research

We describe a high-performance, pupil-based binocular eye tracker that approaches the performance of a well-established commercial system, but at a fraction of the cost. The eye tracker is built from standard hardware components, and its software (written in Visual C++) can be easily implemented. Because of its fast and simple linear calibration scheme, the eye tracker performs best in the central 10 degrees of the visual field. The eye tracker possesses a number of useful features: (1) automated calibration simultaneously in both eyes while subjects fixate four fixation points sequentially on a computer screen, (2) automated realtime continuous analysis of measurement noise, (3) automated blink detection, (4) and realtime analysis of pupil centration artifacts. This last feature is critical because it is known that pupil diameter changes can be erroneously registered by pupil-based trackers as a change in eye position. We evaluated the performance of our system against that of a wellestablished commercial system using simultaneous measurements in 10 participants. We propose our low-cost eye tracker as a promising resource for studies of binocular eye movements.

Sensory Input Modulates Microsaccades during Heading Perception

Microsaccades are small eye movements produced during attempted fixation. During locomotion, the eyes scan the environment; the gaze is not always directed to the focus of expansion of the optic flow field. We sought to investigate whether the microsaccadic activity was modulated by eye position during the view of radial optic flow stimuli, and if the presence or lack of a proprioceptive input signal may influence the microsaccade characteristics during self-motion perception. We recorded the oculomotor activity when subjects were either standing or sitting in front of a screen during the view of optic flow stimuli that simulated specific heading directions with different gaze positions. We recorded five trials of each stimulus. Results showed that microsaccade duration, peak velocity, and rate were significantly modulated by optic flow stimuli and trial sequence. We found that the microsaccade rate increased in each condition from trial 1 to trial 5. Microsaccade peak velocity and duration were significantly different across trials. The analysis of the microsaccade directions showed that the different combinations of optic flow and eye position evoked non-uniform directions of microsaccades in standing condition with mean vectors in the upper-left quadrant of the visual field, uncorrelated with optic flow directions and eye positions. In sitting conditions, all stimuli evoked uniform directions of microsaccades. Present results indicate that the proprioceptive signals when the subjects stand up creates a different input that could alter the eye-movement characteristics during heading perceptions.

Dissociable Cortical and Subcortical Mechanisms for Mediating the Influences of Visual Cues on Microsaccadic Eye Movements

Visual selection in primates is intricately linked to eye movements, which are generated by a network of cortical and subcortical neural circuits. When visual selection is performed covertly, without foveating eye movements toward the selected targets, a class of fixational eye movements, called microsaccades, is still involved. Microsaccades are small saccades that occur when maintaining precise gaze fixation on a stationary point, and they exhibit robust modulations in peripheral cueing paradigms used to investigate covert visual selection mechanisms. These modulations consist of changes in both microsaccade directions and frequencies after cue onsets. Over the past two decades, the properties and functional implications of these modulations have been heavily studied, revealing a potentially important role for microsaccades in mediating covert visual selection effects. However, the neural mechanisms underlying cueing effects on microsaccades are only beginning to be investigated. Here we review the available causal manipulation evidence for these effects' cortical and subcortical substrates. In the superior colliculus (SC), activity representing peripheral visual cues strongly influences microsaccade direction, but not frequency, modulations. In the cortical frontal eye fields (FEF), activity only compensates for early reflexive effects of cues on microsaccades. Using evidence from behavior, theoretical modeling, and preliminary lesion data from the primary visual cortex and microstimulation data from the lower brainstem, we argue that the early reflexive microsaccade effects arise subcortically, downstream of the SC. Overall, studying cueing effects on microsaccades in primates represents an important opportunity to link perception, cognition, and action through unaddressed cortical-subcortical neural interactions. These interactions are also likely relevant in other sensory and motor modalities during other active behaviors.

Learning to silence saccadic suppression

Sensory systems often suppress self-generated sensations in order to discriminate them from those arising in the environment. The suppression of visual sensitivity during rapid eye movements is well established, and although functionally beneficial most of the time, it can limit the performance of certain tasks. Here, we show that with repeated practice, mechanisms that suppress visual signals during eye movements can be modified. People trained to detect brief visual patterns learn to turn off suppression around the expected time of the target. These findings demonstrate an elegant form of plasticity, capable of improving the visibility of behaviorally relevant stimuli without compromising the wider functional benefits of suppression.

Perceptual stability is facilitated by a decrease in visual sensitivity during rapid eye movements, called saccadic suppression. While a large body of evidence demonstrates that saccadic programming is plastic, little is known about whether the perceptual consequences of saccades can be modified. Here, we demonstrate that saccadic suppression is attenuated during learning on a standard visual detection-in-noise task, to the point that it is effectively silenced. Across a period of 7 days, 44 participants were trained to detect brief, low-contrast stimuli embedded within dynamic noise, while eye position was tracked. Although instructed to fixate, participants regularly made small fixational saccades. Data were accumulated over a large number of trials, allowing us to assess changes in performance as a function of the temporal proximity of stimuli and saccades. This analysis revealed that improvements in sensitivity over the training period were accompanied by a systematic change in the impact of saccades on performance—robust saccadic suppression on day 1 declined gradually over subsequent days until its magnitude became indistinguishable from zero. This silencing of suppression was not explained by learning-related changes in saccade characteristics and generalized to an untrained retinal location and stimulus orientation. Suppression was restored when learned stimulus timing was perturbed, consistent with the operation of a mechanism that temporarily reduces or eliminates saccadic suppression, but only when it is behaviorally advantageous to do so. Our results indicate that learning can circumvent saccadic suppression to improve performance, without compromising its functional benefits in other viewing contexts.

Active vision at the foveal scale in the primate superior colliculus

The primate superior colliculus (SC) has recently been shown to possess both a large foveal representation as well as a varied visual processing repertoire. This structure is also known to contribute to eye movement generation. Here, we describe our current understanding of how SC visual and movement-related signals interact within the realm of small eye movements associated with the foveal scale of visuomotor behavior. Within the SC's foveal representation, there is a full spectrum of visual, visual-motor, and motor-related discharge for fixational eye movements. Moreover, a substantial number of neurons only emit movement-related discharge when microsaccades are visually guided, but not when similar movements are generated toward a blank. This represents a particularly striking example of integrating vision and action at the foveal scale. Beyond that, SC visual responses themselves are strongly modulated, and in multiple ways, by the occurrence of small eye movements. Intriguingly, this impact can extend to eccentricities well beyond the fovea, causing both sensitivity enhancement and suppression in the periphery. Because of large foveal magnification of neural tissue, such long-range eccentricity effects are neurally warped into smaller differences in anatomical space, providing a structural means for linking peripheral and foveal visual modulations around fixational eye movements. Finally, even the retinal-image visual flows associated with tiny fixational eye movements are signaled fairly faithfully by peripheral SC neurons with relatively large receptive fields. These results demonstrate how studying active vision at the foveal scale represents an opportunity for understanding primate vision during natural behaviors involving ever-present foveating eye movements.NEW & NOTEWORTHY The primate superior colliculus (SC) is ideally suited for active vision at the foveal scale: it enables detailed foveal visual analysis by accurately driving small eye movements, and it also possesses a visual processing machinery that is sensitive to active eye movement behavior. Studying active vision at the foveal scale in the primate SC is informative for broader aspects of active perception, including the overt and covert processing of peripheral extra-foveal visual scene locations.

Dependence of the stimulus-driven microsaccade rate signature in rhesus macaque monkeys on visual stimulus size and polarity

Microsaccades have a steady rate of occurrence during maintained gaze fixation, which gets transiently modulated by abrupt sensory stimuli. Such modulation, characterized by a rapid reduction in microsaccade frequency followed by a stronger rebound phase of high microsaccade rate, is often described as the microsaccadic rate signature, owing to its stereotyped nature. Here, we investigated the impacts of stimulus polarity (luminance increments or luminance decrements relative to background luminance) and size on the microsaccadic rate signature. We presented brief, behaviorally irrelevant visual flashes consisting of large or small, white or black stimuli over an otherwise gray image background. Both large and small stimuli caused robust early microsaccadic inhibition, but postinhibition microsaccade rate rebound was significantly delayed and weakened for large stimuli when compared with small ones. Critically, small black stimuli were associated with stronger modulations in the microsaccade rate signature than small white stimuli, particularly in the postinhibition rebound phase, and black stimuli also amplified the incidence of early stimulus-directed microsaccades. Our results demonstrate that the microsaccadic rate signature is sensitive to stimulus size and polarity, and they point to dissociable neural mechanisms underlying early microsaccadic inhibition after stimulus onset and later microsaccadic rate rebound at longer times thereafter. These results also demonstrate early access of oculomotor control circuitry to diverse sensory representations, particularly for momentarily inhibiting saccade generation with short latencies.NEW & NOTEWORTHY Microsaccade rate is transiently reduced after sudden stimulus onsets, and then strongly rebounds before returning to baseline. We explored the influence of stimulus polarity (black vs. white) and size on this "rate signature." Large stimuli caused more muted microsaccadic rebound than small ones, and microsaccadic rebound was also differentially affected by black versus white stimuli, particularly with small stimuli. These results suggest dissociated neural mechanisms for microsaccadic inhibition and rebound in the microsaccadic rate signature.

Sustained spatial attention accounts for the direction bias of human microsaccades

Small ballistic eye movements, so called microsaccades, occur even while foveating an object. Previous studies using covert attention tasks have shown that shortly after a symbolic spatial cue, specifying a behaviorally relevant location, microsaccades tend to be directed toward the cued location. This suggests that microsaccades can serve as an index for the covert orientation of spatial attention. However, this hypothesis faces two major challenges: First, effects associated with visual spatial attention are hard to distinguish from those that associated with the contemplation of foveating a peripheral stimulus. Second, it is less clear whether endogenously sustained attention alone can bias microsaccade directions without a spatial cue on each trial. To address the first issue, we investigated the direction of microsaccades in human subjects while they attended to a behaviorally relevant location and prepared a response eye movement either toward or away from this location. We find that directions of microsaccades are biased toward the attended location rather than towards the saccade target. To tackle the second issue, we verbally indicated the location to attend before the start of each block of trials, to exclude potential visual cue-specific effects on microsaccades. Our results indicate that sustained spatial attention alone reliably produces the microsaccade direction effect. Overall, our findings demonstrate that sustained spatial attention alone, even in the absence of saccade planning or a spatial cue, is sufficient to explain the direction bias observed in microsaccades.

Exploring the temporal dynamics of inhibition of return using steady-state visual evoked potentials

Inhibition of return is characterized by delayed responses to previously attended locations when the interval between stimuli is long enough. The present study employed steady-state visual evoked potentials (SSVEPs) as a measure of attentional modulation to explore the nature and time course of input- and output-based inhibitory cueing mechanisms that each slow response times at previously stimulated locations under different experimental conditions. The neural effects of behavioral inhibition were examined by comparing post-cue SSVEPs between cued and uncued locations measured across two tasks that differed only in the response modality (saccadic or manual response to targets). Grand averages of SSVEP amplitudes for each condition showed a reduction in amplitude at cued locations in the window of 100-500 ms post-cue, revealing an early, short-term decrease in the responses of neurons that can be attributed to sensory adaptation, regardless of response modality. Because primary visual cortex has been found to be one of the major sources of SSVEP signals, the results suggest that the SSVEP modulations observed were caused by input-based inhibition that occurred in V1, or visual areas earlier than V1, as a consequence of reduced visual input activity at previously cued locations. No SSVEP modulations were observed in either response condition late in the cue-target interval, suggesting that neither late input- nor output-based IOR modulates SSVEPs. These findings provide further electrophysiological support for the theory of multiple mechanisms contributing to behavioral cueing effects.

Microsaccadic modulation evoked by emotional events

Saccadic eye movements can allude to emotional states and visual attention. Recent studies have shown that microsaccadic responses (i.e., small fixational eye movements) reflect advanced brain activity during attentional and cognitive tasks. Moreover, the microsaccadic activity related to emotional attention provides new insights into this field. For example, emotional pictures attenuate the microsaccadic rate, and microsaccadic responses to covert attention occur in the direction opposite to a negative emotional target. However, the effects of various emotional events on microsaccadic activity remain debatable. This review introduces visual attention and eye movement studies that support findings on the modulation of microsaccadic responses to emotional events, comparing them with typical microsaccadic responses. This review also discusses the brain neuronal mechanisms governing microsaccadic responses to the attentional shifts triggered by emotion-related stimuli. It is hard to reveal the direct brain pathway of the microsaccadic modulation, especially in advanced (e.g., sustained anger, envy, distrust, guilt, frustration, delight, attraction, trust, and love), but also in basic human emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). However, non-human primates and human studies can uncover the possible brain pathways of emotional attention and microsaccades, thus providing future research directions. In particular, the facilitated (or reduced) attention is common evidence that microsaccadic activities change under a variety of social modalities (e.g., cognition, music, mental illness, and working memory) that elicit emotions and feelings.

Rapid stimulus-driven modulation of slow ocular position drifts

The eyes are never still during maintained gaze fixation. When microsaccades are not occurring, ocular position exhibits continuous slow changes, often referred to as drifts. Unlike microsaccades, drifts remain to be viewed as largely random eye movements. Here we found that ocular position drifts can, instead, be very systematically stimulus-driven, and with very short latencies. We used highly precise eye tracking in three well trained macaque monkeys and found that even fleeting (~8 ms duration) stimulus presentations can robustly trigger transient and stimulus-specific modulations of ocular position drifts, and with only approximately 60 ms latency. Such drift responses are binocular, and they are most effectively elicited with large stimuli of low spatial frequency. Intriguingly, the drift responses exhibit some image pattern selectivity, and they are not explained by convergence responses, pupil constrictions, head movements, or starting eye positions. Ocular position drifts have very rapid access to exogenous visual information.

Visual working memory and action: Functional links and bi-directional influences

Working memory bridges perception to action over extended delays, enabling flexible goal-directed behaviour. To date, studies of visual working memory – concerned with detailed visual representations such as shape and colour – have considered visual memory predominantly in the context of visual task demands, such as visual identification and search. Another key purpose of visual working memory is to directly inform and guide upcoming actions. Taking this as a starting point, I review emerging evidence for the pervasive bi-directional links between visual working memory and (planned) action, and discuss these links from the perspective of their common goal of enabling flexible and precise behaviour.

Modulations of foveal vision associated with microsaccade preparation

It is known that attention shifts prior to a saccade to start processing the saccade target before it lands in the foveola, the high-resolution region of the retina. Yet, once the target is foveated, microsaccades, tiny saccades maintaining the fixated object within the fovea, continue to occur. What is the link between these eye movements and attention? There is growing evidence that these eye movements are associated with covert shifts of attention in the visual periphery, when the attended stimuli are presented far from the center of gaze. Yet, microsaccades are primarily used to explore complex foveal stimuli and to optimize fine spatial vision in the foveola, suggesting that the influences of microsaccades on attention may predominantly impact vision at this scale. To address this question we tracked gaze position with high precision and briefly presented high-acuity stimuli at predefined foveal locations right before microsaccade execution. Our results show that visual discrimination changes prior to microsaccade onset. An enhancement occurs at the microsaccade target location. This modulation is highly selective and it is coupled with a drastic impairment at the opposite foveal location, just a few arcminutes away. This effect is strongest when stimuli are presented closer to the eye movement onset time. These findings reveal that the link between attention and microsaccades is deeper than previously thought, exerting its strongest effects within the foveola. As a result, during fixation, foveal vision is constantly being reshaped both in space and in time with the occurrence of microsaccades.

Visual feature tuning of superior colliculus neural reafferent responses after fixational microsaccades

The primate superior colliculus (SC) is causally involved in microsaccade generation. Moreover, visually responsive SC neurons across this structure's topographic map, even at peripheral eccentricities much larger than the tiny microsaccade amplitudes, exhibit significant modulations of evoked response sensitivity when stimuli appear perimicrosaccadically. However, during natural viewing, visual stimuli are normally stably present in the environment and are only shifted on the retina by eye movements. Here we investigated this scenario for the case of microsaccades, asking whether and how SC neurons respond to microsaccade-induced image jitter. We recorded neural activity from two male rhesus macaque monkeys. Within the response field (RF) of a neuron, there was a stable stimulus consisting of a grating of one of three possible spatial frequencies. The grating was stable on the display, but microsaccades periodically jittered the retinotopic RF location over it. We observed clear short-latency visual reafferent responses after microsaccades. These responses were weaker, but earlier (relative to new fixation onset after microsaccade end), than responses to sudden stimulus onsets without microsaccades. The reafferent responses clearly depended on microsaccade amplitude as well as microsaccade direction relative to grating orientation. Our results indicate that one way for microsaccades to influence vision is through modulating how the spatio-temporal landscape of SC visual neural activity represents stable stimuli in the environment. Such representation depends on the specific pattern of temporal luminance modulations expected from the relative relationship between eye movement vector (size and direction) on one hand and spatial visual pattern layout on the other.NEW & NOTEWORTHY Despite being diminutive, microsaccades still jitter retinal images. We investigated how such jitter affects superior colliculus (SC) activity. We found that SC neurons exhibit short-latency visual reafferent bursts after microsaccades. These bursts reflect not only the spatial luminance profiles of visual patterns but also how such profiles are shifted by eye movement size and direction. These results indicate that the SC continuously represents visual patterns, even as they are jittered by the smallest possible saccades.

Microsaccade dynamics in the attentional repulsion effect

A briefly flashed peripheral cue has been shown to repulse the perceived position of a subsequently presented foveal probe - a bias called the Attentional Repulsion Effect (ARE). While this bias has originally been assumed to reflect attentional capturing by the cue, its attentional nature has recently been questioned. To investigate the ARE's attentional properties, we recorded microsaccades as an attentional marker in the ARE paradigm. Microsaccades, small fixational eye movements performed during fixation, have previously been described to reflect the dynamics of spatial attention deployment. Our results favor an attentional explanation for the ARE: In trials in which an ARE was found, microsaccades were directed more often toward the cue, presumably reflecting the covert shift of attention. In contrast, more cue-incongruent microsaccades were observed in trials in which no ARE was found. Therefore, both repulsion as well as measured microsaccade modulations, are most likely an outcome of the preceding shifts of covert attention.

The Attentional Blink is Related to the Microsaccade Rate Signature

The reduced detectability of a target T2 following discrimination of a preceding target T1 in the attentional blink (AB) paradigm is classically interpreted as a consequence of reduced attention to T2 due to attentional allocation to T1. Here, we investigated whether AB was related to changes in microsaccade rate (MSR). We found a pronounced MSR signature following T1 onset, characterized by MSR suppression from 200 to 328 ms and enhancement from 380 to 568 ms. Across participants, the magnitude of the MSR suppression correlated with the AB effect such that low T2 detectability corresponded to reduced MSR. However, in the same task, T1 error trials coincided with the presence of microsaccades. We discuss this apparent paradox in terms of known neurophysiological correlates of MS whereby cortical excitability is suppressed both during the microsaccade and MSR suppression, in accordance to poor T1 performance with microsaccade occurrence and poor T2 performance with microsaccade absence. Our data suggest a novel low-level mechanism contributing to AB characterized by reduced MSR, thought to cause suppressed visual cortex excitability. This opens the question of whether attention mediates T2 performance suppression independently from MSR, and if not, how attention interacts with MSR to produce the T2 performance suppression.

Memory-guided microsaccades

Despite strong evidence to the contrary in the literature, microsaccades are overwhelmingly described as involuntary eye movements. Here we show in both human subjects and monkeys that individual microsaccades of any direction can easily be triggered: (1) on demand, based on an arbitrary instruction, (2) without any special training, (3) without visual guidance by a stimulus, and (4) in a spatially and temporally accurate manner. Subjects voluntarily generated instructed "memory-guided" microsaccades readily, and similarly to how they made normal visually-guided ones. In two monkeys, we also observed midbrain superior colliculus neurons that exhibit movement-related activity bursts exclusively for memory-guided microsaccades, but not for similarly-sized visually-guided movements. Our results demonstrate behavioral and neural evidence for voluntary control over individual microsaccades, supporting recently discovered functional contributions of individual microsaccade generation to visual performance alterations and covert visual selection, as well as observations that microsaccades optimize eye position during high acuity visually-guided behavior.

Rapid Ocular Responses Are Modulated by Bottom-up-Driven Auditory Salience

Despite the prevalent use of alerting sounds in alarms and human-machine interface systems and the long-hypothesized role of the auditory system as the brain's "early warning system," we have only a rudimentary understanding of what determines auditory salience-the automatic attraction of attention by sound-and which brain mechanisms underlie this process. A major roadblock has been the lack of a robust, objective means of quantifying sound-driven attentional capture. Here we demonstrate that: (1) a reliable salience scale can be obtained from crowd-sourcing (N = 911), (2) acoustic roughness appears to be a driving feature behind this scaling, consistent with previous reports implicating roughness in the perceptual distinctiveness of sounds, and (3) crowd-sourced auditory salience correlates with objective autonomic measures. Specifically, we show that a salience ranking obtained from online raters correlated robustly with the superior colliculus-mediated ocular freezing response, microsaccadic inhibition (MSI), measured in naive, passively listening human participants (of either sex). More salient sounds evoked earlier and larger MSI, consistent with a faster orienting response. These results are consistent with the hypothesis that MSI reflects a general reorienting response that is evoked by potentially behaviorally important events regardless of their modality.SIGNIFICANCE STATEMENT Microsaccades are small, rapid, fixational eye movements that are measurable with sensitive eye-tracking equipment. We reveal a novel, robust link between microsaccade dynamics and the subjective salience of brief sounds (salience rankings obtained from a large number of participants in an online experiment): Within 300 ms of sound onset, the eyes of naive, passively listening participants demonstrate different microsaccade patterns as a function of the sound's crowd-sourced salience. These results position the superior colliculus (hypothesized to underlie microsaccade generation) as an important brain area to investigate in the context of a putative multimodal salience hub. They also demonstrate an objective means for quantifying auditory salience.

The Foveal Visual Representation of the Primate Superior Colliculus

A defining feature of the primate visual system is its foveated nature. Processing of foveal retinal input is important not only for high-quality visual scene analysis but also for ensuring precise, albeit tiny, gaze shifts during high-acuity visual tasks. The representations of foveal retinal input in the primate lateral geniculate nucleus and early visual cortices have been characterized. However, how such representations translate into precise eye movements remains unclear. Here, we document functional and structural properties of the foveal visual representation of the midbrain superior colliculus. We show that the superior colliculus, classically associated with extra-foveal spatial representations needed for gaze shifts, is highly sensitive to visual input impinging on the fovea. The superior colliculus also represents such input in an orderly and very specific manner, and it magnifies the representation of foveal images in neural tissue as much as the primary visual cortex does. The primate superior colliculus contains a high-fidelity visual representation, with large foveal magnification, perfectly suited for active visuomotor control and perception.

Kinematics and the neurophysiological study of visually-guided eye movements

How do we relate observations and measurements made at the behavioral and neuronal levels? Notions of kinematics have been used to "decode" the firing rate of neurons and to explain the neurophysiology underlying the generation of visually-guided eye movements. The appropriateness of their fitting to events occurring within a medium (the brain) radically different from the physical world is questioned in this chapter. Instead of embedding the eye kinematics in the firing rate of central neurons, we propose that the saccadic and pursuit eye movements in fact reflect the dynamics of transitions of brain activity, from unbalanced states to equilibrium (symmetry) between opposing directional tendencies carried by the recruited visuomotor channels, with distinct transitions characterizing each movement category. While the eyeballs conform to the physical laws of motion, the neural processes leading to their movements follow principles dictated by the intrinsic properties of the brain network and of its diverse neurons.

Eye Position Error Influence over "Open-Loop" Smooth Pursuit Initiation

The oculomotor system integrates a variety of visual signals into appropriate motor plans, but such integration can have widely varying time scales. For example, smooth pursuit eye movements to follow a moving target are slower and longer lasting than saccadic eye movements and it has been suggested that initiating a smooth pursuit eye movement involves an obligatory "open-loop" interval in which new visual motion signals presumably cannot influence the ensuing motor plan for up to 100 ms after movement initiation. However, this view is contrary to the idea that the oculomotor periphery has privileged access to short-latency visual signals. Here, we show that smooth pursuit initiation is sensitive to visual inputs, even in open-loop intervals. We instructed male rhesus macaque monkeys to initiate saccade-free smooth pursuit eye movements and injected a transient, instantaneous eye position error signal at different times relative to movement initiation. We found robust short-latency modulations in eye velocity and acceleration, starting only ∼50 ms after transient signal occurrence and even during open-loop pursuit initiation. Critically, the spatial direction of the injected position error signal had predictable effects on smooth pursuit initiation, with forward errors increasing eye acceleration and backward errors reducing it. Catch-up saccade frequencies and amplitudes were also similarly altered ∼50 ms after transient signals, much like the well known effects on microsaccades during fixation. Our results demonstrate that smooth pursuit initiation is highly sensitive to visual signals and that catch-up saccade generation is reset after a visual transient.SIGNIFICANCE STATEMENT Smooth pursuit eye movements allow us to track moving objects. The first ∼100 ms of smooth pursuit initiation are characterized by smooth eye acceleration and are overwhelmingly described as being "open-loop"; that is, unmodifiable by new visual motion signals. We found that all phases of smooth pursuit, including the so-called open-loop intervals, are reliably modifiable by visual signals. We injected transient flashes resulting in very brief, spatially specific position error signals to smooth pursuit and observed very short-latency changes in smooth eye movements to minimize such errors. Our results highlight the flexibility of the oculomotor system in reacting to environmental events and suggest a functional role for the pervasiveness of visual sensitivity in oculomotor control brain regions.

Transfer function of the rhesus macaque oculomotor system for small-amplitude slow motion trajectories

Two main types of small eye movements occur during gaze fixation: microsaccades and slow ocular drifts. While microsaccade generation has been relatively well studied, ocular drift control mechanisms are unknown. Here we explored the degree to which monkey smooth eye movements, on the velocity scale of slow ocular drifts, can be generated systematically. Two male rhesus macaque monkeys tracked a spot moving sinusoidally, but slowly, along the horizontal or vertical direction. Maximum target displacement in the motion trajectory was 30 min arc (0.5°), and we varied the temporal frequency of target motion from 0.2 to 5 Hz. We obtained an oculomotor “transfer function” by measuring smooth eye velocity gain (relative to target velocity) as a function of frequency, similar to past work with large-amplitude pursuit. Monkey eye velocities as slow as those observed during slow ocular drifts were clearly target motion driven. Moreover, as with large-amplitude smooth pursuit, eye velocity gain varied with temporal frequency. However, unlike with large-amplitude pursuit, exhibiting low-pass behavior, small-amplitude motion tracking was band pass, with the best ocular movement gain occurring at ~0.8–1 Hz. When oblique directions were tested, we found that the horizontal component of pursuit gain was larger than the vertical component. Our results provide a catalog of the control abilities of the monkey oculomotor system for slow target motions, and they also support the notion that smooth fixational ocular drifts are controllable. This has implications for neural investigations of drift control and the image-motion consequences of drifts on visual coding in early visual areas.

NEW & NOTEWORTHY We studied the efficacy of monkey smooth pursuit eye movements for very slow target velocities. Pursuit was impaired for sinusoidal motions of frequency less than ~0.8–1 Hz. Nonetheless, eye trajectory was still sinusoidally modulated, even at velocities lower than those observed during gaze fixation with slow ocular drifts. Our results characterize the slow control capabilities of the monkey oculomotor system and provide a basis for future understanding of the neural mechanisms for slow ocular drifts.

Directing Voluntary Temporal Attention Increases Fixational Stability

Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

Microsaccadic rate and pupil size dynamics in pro-/anti-saccade preparation: the impact of intermixed vs. blocked trial administration

Prolonged fixation can lead to the generation of tiny and fast eye movements called microsaccades, whose dynamics can be associated with higher cognitive mechanisms. Saccade preparation is also reflected in microsaccadic activity, but the few studies on this topic provided mixed results. For instance, fewer microsaccades have been observed when participants were asked to prepare for an anti-saccade (i.e., a saccade in the opposite direction to the target) as compared to a pro-saccade (i.e., a saccade executed towards a target), but null results have also been reported. In the attempt to shed new light on this topic, two experiments were carried out in which the context of presentation of pro- and anti-saccade trials was manipulated. Pupil size was also recorded, as a further index of cognitive load. In Experiment 1, participants were asked to prepare and perform pro- and anti-saccades in response to a peripheral target, according to a central instruction cue provided at the beginning of each trial (intermixed condition). In Experiment 2, the same task was employed, but pro- and anti-saccade trials were delivered in two distinct blocks (blocked condition). In both experiments, greater saccadic latencies and lower accuracy emerged for anti- than for pro-saccades. However, in the intermixed condition, a lower microsaccadic rate and a greater pupil size emerged when participants prepared for anti- rather than pro-saccades, whereas these differences disappeared in the blocked condition. These results suggest that contextual factors may play a key role in shaping oculomotor dynamics linked to saccade preparation.

Neural entrainment and network resonance in support of top-down guided attention

Which neural mechanisms provide the functional basis of top-down guided cognitive control? Here, we review recent evidence that suggest that the neural basis of attention is inherently rhythmic. In particular, we discuss two physical properties of self-sustained networks, namely entrainment and resonance, and how these shape the timescale of attentional control. Several recent findings revealed theta-band (3-8 Hz) dynamics in top-down guided behavior. These reports were paralleled by intracranial recordings, which implicated theta oscillations in the organization of functional attention networks. We discuss how the intrinsic network architecture shapes covert attentional sampling as well as overt behavior. Taken together, we posit that theta rhythmicity is an inherent feature of the attention network in support of top-down guided goal-directed behavior.

Human-level saccade detection performance using deep neural networks

Saccades are ballistic eye movements that rapidly shift gaze from one location of visual space to another. Detecting saccades in eye movement recordings is important not only for studying the neural mechanisms underlying sensory, motor, and cognitive processes, but also as a clinical and diagnostic tool. However, automatically detecting saccades can be difficult, particularly when such saccades are generated in coordination with other tracking eye movements, like smooth pursuits, or when the saccade amplitude is close to eye tracker noise levels, like with microsaccades. In such cases, labeling by human experts is required, but this is a tedious task prone to variability and error. We developed a convolutional neural network to automatically detect saccades at human-level accuracy and with minimal training examples. Our algorithm surpasses state of the art according to common performance metrics and could facilitate studies of neurophysiological processes underlying saccade generation and visual processing. NEW & NOTEWORTHY Detecting saccades in eye movement recordings can be a difficult task, but it is a necessary first step in many applications. We present a convolutional neural network that can automatically identify saccades with human-level accuracy and with minimal training examples. We show that our algorithm performs better than other available algorithms, by comparing performance on a wide range of data sets. We offer an open-source implementation of the algorithm as well as a web service.

The attentional repulsion effect and relative size judgments

Rapid shifts of involuntary attention have been shown to induce mislocalizations of nearby objects. One pattern of mislocalization, termed the Attentional Repulsion Effect (ARE), occurs when the onset of peripheral pre-cues lead to perceived shifts of subsequently presented stimuli away from the cued location. While the standard ARE configuration utilizes vernier lines, to date, all previous ARE studies have only assessed distortions along one direction and tested one spatial dimension (i.e., position or shape). The present study assessed the magnitude of the ARE using a novel stimulus configuration. Across three experiments participants judged which of two rectangles on the left or right side of the display appeared wider or taller. Pre-cues were used in Experiments 1 and 2. Results show equivalent perceived expansions in the width and height of the pre-cued rectangle in addition to baseline asymmetries in left/right relative size under no-cue conditions. Altering cue locations led to shifts in the perceived location of the same rectangles, demonstrating distortions in perceived shape and location using the same stimuli and cues. Experiment 3 demonstrates that rectangles are perceived as larger in the periphery compared to fixation, suggesting that eye movements cannot account for results from Experiments 1 and 2. The results support the hypothesis that the ARE reflects a localized, symmetrical warping of visual space that impacts multiple aspects of spatial and object perception.

Perisaccadic perceptual mislocalization is different for upward saccades

Saccadic eye movements, which dramatically alter retinal images, are associated with robust perimovement perceptual alterations. Such alterations, thought to reflect brain mechanisms for maintaining perceptual stability in the face of saccade-induced retinal image disruptions, are often studied by asking subjects to localize brief stimuli presented around the time of horizontal saccades. However, other saccade directions are not usually explored. Motivated by recently discovered asymmetries in upper and lower visual field representations in the superior colliculus, a structure important for both saccade generation and visual analysis, we observed significant differences in perisaccadic perceptual alterations for upward saccades relative to other saccade directions. We also found that, even for purely horizontal saccades, perceptual alterations differ for upper vs. lower retinotopic stimulus locations. Our results, coupled with conceptual modeling, suggest that perisaccadic perceptual alterations might critically depend on neural circuits, such as superior colliculus, that asymmetrically represent the upper and lower visual fields. NEW & NOTEWORTHY Brief visual stimuli are robustly mislocalized around the time of saccades. Such mislocalization is thought to arise because oculomotor and visual neural maps distort space through foveal magnification. However, other neural asymmetries, such as upper visual field magnification in the superior colliculus, may also exist, raising the possibility that interactions between saccades and visual stimuli would depend on saccade direction. We confirmed this behaviorally by exploring and characterizing perisaccadic perception for upward saccades.

No supplementary evidence of attention to a spatial cue when saccadic facilitation is absent

Attending a location in space facilitates responses to targets at that location when the time between cue and target is short. Certain types of exogenous cues – such as sudden peripheral onsets – have been described as reflexive and automatic. Recent studies however, have been showing many cases where exogenous cues are less automatic than previously believed and do not always result in facilitation. A lack of the behavioral facilitation, however, does not automatically necessitate a lack of underlying attention to that location. We test exogenous cueing in two experiments where facilitation is and is not likely to be observed with saccadic responses. We also test alternate measures linked to the allocation of attention such as saccadic curvature, microsaccades and pupil size. As expected, we find early facilitation as measured by saccadic reaction time when CTOAs are predictable but not when they are randomized within a block. We find no impact of the cue on microsaccade direction for either experiment, and only a slight dip in the frequency of microsaccades after the cue. We do find that change in pupil size to the cue predicts the magnitude of the validity effect, but only in the experiment where facilitation was observed. In both experiments, we observed a tendency for saccadic curvature to deviate away from the cued location and this was stronger for early CTOAs and toward vertical targets. Overall, we find that only change in pupil size is consistent with observed facilitation. Saccadic curvature is influenced by the onset of the cue, buts its direction is indicative of oculomotor inhibition whether we see RT facilitation or not. Microsaccades were not diagnostic in either experiment. Finally, we see little to no evidence of attention at the cued location in any additional measures when facilitation of saccadic responses is absent.

Orientation and Contrast Tuning Properties and Temporal Flicker Fusion Characteristics of Primate Superior Colliculus Neurons

The primate superior colliculus is traditionally studied from the perspectives of gaze control, target selection, and selective attention. However, this structure is also visually responsive, and it is the primary visual structure in several species. Thus, understanding the visual tuning properties of the primate superior colliculus is important, especially given that the superior colliculus is part of an alternative visual pathway running in parallel to the predominant geniculo-cortical pathway. In recent previous studies, we have characterized receptive field organization and spatial frequency tuning properties in the primate (rhesus macaque) superior colliculus. Here, we explored additional aspects like orientation tuning, putative center-surround interactions, and temporal frequency tuning characteristics of visually-responsive superior colliculus neurons. We found that orientation tuning exists in the primate superior colliculus, but that such tuning is relatively moderate in strength. We also used stimuli of different sizes to explore contrast sensitivity and center-surround interactions. We found that stimulus size within a visual receptive field primarily affects the slope of contrast sensitivity curves without altering maximal firing rate. Additionally, sustained firing rates, long after stimulus onset, strongly depend on stimulus size, and this is also reflected in local field potentials. This suggests the presence of inhibitory interactions within and around classical receptive fields. Finally, primate superior colliculus neurons exhibit temporal frequency tuning for frequencies lower than 30 Hz, with critical flicker fusion frequencies of <20 Hz. These results support the hypothesis that the primate superior colliculus might contribute to visual performance, likely by mediating coarse, but rapid, object detection and identification capabilities for the purpose of facilitating or inhibiting orienting responses. Such mediation may be particularly amplified in blindsight subjects who lose portions of their primary visual cortex and therefore rely on alternative visual pathways including the pathway through the superior colliculus.

Spatial frequency sensitivity in macaque midbrain

Visual brain areas exhibit tuning characteristics well suited for image statistics present in our natural environment. However, visual sensation is an active process, and if there are any brain areas that ought to be particularly in tune with natural scene statistics, it would be sensory-motor areas critical for guiding behavior. Here we found that the rhesus macaque superior colliculus, a structure instrumental for rapid visual exploration with saccades, detects low spatial frequencies, which are the most prevalent in natural scenes, much more rapidly than high spatial frequencies. Importantly, this accelerated detection happens independently of whether a neuron is more or less sensitive to low spatial frequencies to begin with. At the population level, the superior colliculus additionally over-represents low spatial frequencies in neural response sensitivity, even at near-foveal eccentricities. Thus, the superior colliculus possesses both temporal and response gain mechanisms for efficient gaze realignment in low-spatial-frequency-dominated natural environments.