Goal representations dominate superior colliculus activity during extrafoveal tracking

The superior colliculus projection upon the macaque inferior olive

Saccade accommodation is a productive model for exploring the role of the cerebellum in behavioral plasticity. In this model, the target is moved during the saccade, gradually inducing a change in the saccade vector as the animal adapts. The climbing fiber pathway from the inferior olive provides a visual error signal generated by the superior colliculus that is believed to be crucial for cerebellar adaptation. However, the primate tecto-olivary pathway has only been explored using large injections of the central portion of the superior colliculus. To provide a more detailed picture, we have made injections of anterograde tracers into various regions of the macaque superior colliculus. As shown previously, large central injections primarily label a dense terminal field within the C subdivision at caudal end of the contralateral medial inferior olive. Several, previously unobserved, sites of sparse terminal labeling were noted: bilaterally in the dorsal cap of Kooy and ipsilaterally in the C subdivision of the medial inferior olive. Small, physiologically directed, injections into the rostral, small saccade portion of the superior colliculus produced terminal fields in the same regions of the medial inferior olive, but with decreased density. Small injections of the caudal superior colliculus, where large amplitude gaze changes are encoded, again labeled a terminal field located in the same areas. The lack of a topographic pattern within the main tecto-olivary projection suggests that either the precise vector of the visual error is not transmitted to the vermis, or that encoding of this error is via non-topographic means.

Express detection of visual objects by primate superior colliculus neurons

Primate superior colliculus (SC) neurons exhibit visual feature tuning properties and are implicated in a subcortical network hypothesized to mediate fast threat and/or conspecific detection. However, the mechanisms through which SC neurons contribute to peripheral object detection, for supporting rapid orienting responses, remain unclear. Here we explored whether, and how quickly, SC neurons detect real-life object stimuli. We presented experimentally-controlled gray-scale images of seven different object categories, and their corresponding luminance- and spectral-matched image controls, within the extrafoveal response fields of SC neurons. We found that all of our functionally-identified SC neuron types preferentially detected real-life objects even in their very first stimulus-evoked visual bursts. Intriguingly, even visually-responsive motor-related neurons exhibited such robust early object detection. We further identified spatial frequency information in visual images as an important, but not exhaustive, source for the earliest (within 100 ms) but not for the late (after 100 ms) component of object detection by SC neurons. Our results demonstrate rapid and robust detection of extrafoveal visual objects by the SC. Besides supporting recent evidence that even SC saccade-related motor bursts can preferentially represent visual objects, these results reveal a plausible mechanism through which rapid orienting responses to extrafoveal visual objects can be mediated.

Visual Functions of the Primate Superior Colliculus

The superior colliculus (SC) is a subcortical brain structure that is relevant for sensation, cognition, and action. In nonhuman primates, a rich history of studies has provided unprecedented detail about this structure's role in controlling orienting behaviors; as a result, the primate SC has become primarily regarded as a motor control structure. However, as in other species, the primate SC is also a highly visual structure: A fraction of its inputs is retinal and complemented by inputs from visual cortical areas, including the primary visual cortex. Motivated by this, recent investigations are revealing the rich visual pattern analysis capabilities of the primate SC, placing this structure in an ideal position to guide orienting movements. The anatomical proximity of the primate SC to both early visual inputs and final motor control apparatuses, as well as its ascending feedback projections to the cortex, affirms an important role for this structure in active perception.

A Midbrain Inspired Recurrent Neural Network Model for Robust Change Detection

We present a biologically inspired recurrent neural network (RNN) that efficiently detects changes in natural images. The model features sparse, topographic connectivity (st-RNN), closely modeled on the circuit architecture of a "midbrain attention network." We deployed the st-RNN in a challenging change blindness task, in which changes must be detected in a discontinuous sequence of images. Compared with a conventional RNN, the st-RNN learned 9x faster and achieved state-of-the-art performance with 15x fewer connections. An analysis of low-dimensional dynamics revealed putative circuit mechanisms, including a critical role for a global inhibitory (GI) motif, for successful change detection. The model reproduced key experimental phenomena, including midbrain neurons' sensitivity to dynamic stimuli, neural signatures of stimulus competition, as well as hallmark behavioral effects of midbrain microstimulation. Finally, the model accurately predicted human gaze fixations in a change blindness experiment, surpassing state-of-the-art saliency-based methods. The st-RNN provides a novel deep learning model for linking neural computations underlying change detection with psychophysical mechanisms.SIGNIFICANCE STATEMENT For adaptive survival, our brains must be able to accurately and rapidly detect changing aspects of our visual world. We present a novel deep learning model, a sparse, topographic recurrent neural network (st-RNN), that mimics the neuroanatomy of an evolutionarily conserved "midbrain attention network." The st-RNN achieved robust change detection in challenging change blindness tasks, outperforming conventional RNN architectures. The model also reproduced hallmark experimental phenomena, both neural and behavioral, reported in seminal midbrain studies. Lastly, the st-RNN outperformed state-of-the-art models at predicting human gaze fixations in a laboratory change blindness experiment. Our deep learning model may provide important clues about key mechanisms by which the brain efficiently detects changes.

Intra-Areal Visual Topography in Primate Brains Mapped with Probabilistic Tractography of Diffusion-Weighted Imaging

Noninvasive diffusion-weighted magnetic resonance imaging (dMRI) can be used to map the neural connectivity between distinct areas in the intact brain, but the standard resolution achieved fundamentally limits the sensitivity of such maps. We investigated the sensitivity and specificity of high-resolution postmortem dMRI and probabilistic tractography in rhesus macaque brains to produce retinotopic maps of the lateral geniculate nucleus (LGN) and extrastriate cortical visual area V5/MT based on their topographic connections with the previously established functional retinotopic map of primary visual cortex (V1). We also replicated the differential connectivity of magnocellular and parvocellular LGN compartments with V1 across visual field positions. Predicted topographic maps based on dMRI data largely matched the established retinotopy of both LGN and V5/MT. Furthermore, tractography based on in vivo dMRI data from the same macaque brains acquired at standard field strength (3T) yielded comparable topographic maps in many cases. We conclude that tractography based on dMRI is sensitive enough to reveal the intrinsic organization of ordered connections between topographically organized neural structures and their resultant functional organization.

Involuntary oculomotor inhibition markers of saliency and deviance in response to auditory sequences

Our eyes move constantly but are often inhibited momentarily in response to external stimuli (oculomotor inhibition [OMI]), depending on the stimulus saliency, anticipation, and attention. Previous studies have shown prolonged OMI for auditory oddballs; however, they required counting the oddballs, possibly reflecting voluntary attention. Here, we investigated whether the “passive” OMI response to auditory deviants can provide a quantitative measure of deviance strength (pitch difference) and studied its dependence on the inter-trial interval (ITI). Participants fixated centrally and passively listened to repeated short sequences of pure tones that contained a deviant tone either regularly or with 20% probability (oddballs). In an “active” control experiment, participants counted the deviant or the standard. As in previous studies, the results showed prolonged microsaccade inhibition and increased pupil dilation following the rare deviant tone. Earlier inhibition onset was found in proportion to the pitch deviance (the saliency effect), and a later release was found for oddballs, but only for ITI <2.5 seconds. The active control experiment showed similar results when counting the deviant but longer OMI for the standard when counting it. Taken together, these results suggest that OMI provides involuntary markers of saliency and deviance, which can be obtained without the participant's response.

Fixational drift is driven by diffusive dynamics in central neural circuitry

During fixation and between saccades, our eyes undergo diffusive random motion called fixational drift. The role of fixational drift in visual coding and inference has been debated in the past few decades, but the mechanisms that underlie this motion remained unknown. In particular, it has been unclear whether fixational drift arises from peripheral sources, or from central sources within the brain. Here we show that fixational drift is correlated with neural activity, and identify its origin in central neural circuitry within the oculomotor system, upstream to the ocular motoneurons (OMNs). We analyzed a large data set of OMN recordings in the rhesus monkey, alongside precise measurements of eye position, and found that most of the variance of fixational eye drifts must arise upstream of the OMNs. The diffusive statistics of the motion points to the oculomotor integrator, a memory circuit responsible for holding the eyes still between saccades, as a likely source of the motion. Theoretical modeling, constrained by the parameters of the primate oculomotor system, supports this hypothesis by accounting for the amplitude as well as the statistics of the motion. Thus, we propose that fixational ocular drift provides a direct observation of diffusive dynamics in a neural circuit responsible for storage of continuous parameter memory in persistent neural activity. The identification of a mechanistic origin for fixational drift is likely to advance the understanding of its role in visual processing and inference.

Microsaccades as a marker not a cause for attention-related modulation

Recent evidence suggests that microsaccades are causally linked to the attention-related modulation of neurons—specifically, that microsaccades toward the attended location are required for the subsequent changes in firing rate. These findings have raised questions about whether attention-related modulation is due to different states of attention as traditionally assumed or might instead be a secondary effect of microsaccades. Here, in two rhesus macaques, we tested the relationship between microsaccades and attention-related modulation in the superior colliculus (SC), a brain structure crucial for allocating attention. We found that attention-related modulation emerged even in the absence of microsaccades, was already present prior to microsaccades toward the cued stimulus, and persisted through the suppression of activity that accompanied all microsaccades. Nonetheless, consistent with previous findings, we also found significant attention-related modulation when microsaccades were directed toward, rather than away from, the cued location. Thus, despite the clear links between microsaccades and attention, microsaccades are not necessary for attention-related modulation, at least not in the SC. They do, however, provide an additional marker for the state of attention, especially at times when attention is shifting from one location to another.

Differential saccade-pursuit coordination under sleep loss and low-dose alcohol

Introduction

Ocular tracking of a moving object requires tight coordination between smooth pursuit and saccadic eye movements. Normally, pursuit drives gaze velocity to closely match target velocity, with residual position offsets corrected by catch-up saccades. However, how/if common stressors affect this coordination is largely unknown. This study seeks to elucidate the effects of acute and chronic sleep loss, and low-dose alcohol, on saccade-pursuit coordination, as well as that of caffeine.

Methods

We used an ocular tracking paradigm to assess three metrics of tracking (pursuit gain, saccade rate, saccade amplitude) and to compute "ground lost" (from reductions in steady-state pursuit gain) and "ground recouped" (from increases in steady-state saccade rate and/or amplitude). We emphasize that these are measures of relative changes in positional offsets, and not absolute offset from the fovea.

Results

Under low-dose alcohol and acute sleep loss, ground lost was similarly large. However, under the former, it was nearly completely recouped by saccades, whereas under the latter, compensation was at best partial. Under chronic sleep restriction and acute sleep loss with a caffeine countermeasure, the pursuit deficit was dramatically smaller, yet saccadic behavior remained altered from baseline. In particular, saccadic rate remained significantly elevated, despite the fact that ground lost was minimal.

Discussion

This constellation of findings demonstrates differential impacts on saccade-pursuit coordination with low-dose alcohol impacting only pursuit, likely through extrastriate cortical pathways, while acute sleep loss not only disrupts pursuit but also undermines saccadic compensation, likely through midbrain/brainstem pathways. Furthermore, while chronic sleep loss and caffeine-mitigated acute sleep loss show little residual pursuit deficit, consistent with uncompromised cortical visual processing, they nonetheless show an elevated saccade rate, suggesting residual midbrain and/or brainstem impacts.

Smooth pursuit operates over perceived not physical positions of the double-drift stimulus

The double-drift illusion produces a large deviation in perceived direction that strongly dissociates physical position from perceived position. Surprisingly, saccades do not seem to be affected by the illusion (Lisi & Cavanagh, 2015). When targeting a double-drift stimulus, the saccade system is driven by retinal rather than perceived position. Here, using paired double-drift targets, we test whether the smooth pursuit system is driven by perceived or physical position. Participants (n = 7) smoothly pursued the inferred midpoint (Steinbach, 1976) between two horizontally aligned Gabor patches that were separated by 20° and moving on parallel, oblique paths. On the first half of each trial, the Gabors’ internal textures were static while both drifted obliquely downward. On the second half of each trial, while the envelope moved obliquely upward, the internal texture drifted orthogonally to the envelope's motion, producing a large perceived deviation from the downward path even though the upward and downward trajectories always followed the same physical path but in opposite directions. We find that smooth pursuit eye movements accurately followed the nonillusory downward path of the midpoint between the two Gabors, but then followed the illusory rather than the physical trajectory on the upward return. Thus, virtual targets for smooth pursuit are derived from perceived rather than retinal coordinates.

Instantaneous movement-unrelated midbrain activity modifies ongoing eye movements

At any moment in time, new information is sampled from the environment and interacts with ongoing brain state. Often, such interaction takes place within individual circuits that are capable of both mediating the internally ongoing plan as well as representing exogenous sensory events. Here, we investigated how sensory-driven neural activity can be integrated, very often in the same neuron types, into ongoing saccade motor commands. Despite the ballistic nature of saccades, visually induced action potentials in the rhesus macaque superior colliculus (SC), a structure known to drive eye movements, not only occurred intra-saccadically, but they were also associated with highly predictable modifications of ongoing eye movements. Such predictable modifications reflected a simultaneity of movement-related discharge at one SC site and visually induced activity at another. Our results suggest instantaneous readout of the SC during movement generation, irrespective of activity source, and they explain a significant component of kinematic variability of motor outputs.

Dissociable Cortical and Subcortical Mechanisms for Mediating the Influences of Visual Cues on Microsaccadic Eye Movements

Visual selection in primates is intricately linked to eye movements, which are generated by a network of cortical and subcortical neural circuits. When visual selection is performed covertly, without foveating eye movements toward the selected targets, a class of fixational eye movements, called microsaccades, is still involved. Microsaccades are small saccades that occur when maintaining precise gaze fixation on a stationary point, and they exhibit robust modulations in peripheral cueing paradigms used to investigate covert visual selection mechanisms. These modulations consist of changes in both microsaccade directions and frequencies after cue onsets. Over the past two decades, the properties and functional implications of these modulations have been heavily studied, revealing a potentially important role for microsaccades in mediating covert visual selection effects. However, the neural mechanisms underlying cueing effects on microsaccades are only beginning to be investigated. Here we review the available causal manipulation evidence for these effects' cortical and subcortical substrates. In the superior colliculus (SC), activity representing peripheral visual cues strongly influences microsaccade direction, but not frequency, modulations. In the cortical frontal eye fields (FEF), activity only compensates for early reflexive effects of cues on microsaccades. Using evidence from behavior, theoretical modeling, and preliminary lesion data from the primary visual cortex and microstimulation data from the lower brainstem, we argue that the early reflexive microsaccade effects arise subcortically, downstream of the SC. Overall, studying cueing effects on microsaccades in primates represents an important opportunity to link perception, cognition, and action through unaddressed cortical-subcortical neural interactions. These interactions are also likely relevant in other sensory and motor modalities during other active behaviors.

Active vision at the foveal scale in the primate superior colliculus

The primate superior colliculus (SC) has recently been shown to possess both a large foveal representation as well as a varied visual processing repertoire. This structure is also known to contribute to eye movement generation. Here, we describe our current understanding of how SC visual and movement-related signals interact within the realm of small eye movements associated with the foveal scale of visuomotor behavior. Within the SC's foveal representation, there is a full spectrum of visual, visual-motor, and motor-related discharge for fixational eye movements. Moreover, a substantial number of neurons only emit movement-related discharge when microsaccades are visually guided, but not when similar movements are generated toward a blank. This represents a particularly striking example of integrating vision and action at the foveal scale. Beyond that, SC visual responses themselves are strongly modulated, and in multiple ways, by the occurrence of small eye movements. Intriguingly, this impact can extend to eccentricities well beyond the fovea, causing both sensitivity enhancement and suppression in the periphery. Because of large foveal magnification of neural tissue, such long-range eccentricity effects are neurally warped into smaller differences in anatomical space, providing a structural means for linking peripheral and foveal visual modulations around fixational eye movements. Finally, even the retinal-image visual flows associated with tiny fixational eye movements are signaled fairly faithfully by peripheral SC neurons with relatively large receptive fields. These results demonstrate how studying active vision at the foveal scale represents an opportunity for understanding primate vision during natural behaviors involving ever-present foveating eye movements.NEW & NOTEWORTHY The primate superior colliculus (SC) is ideally suited for active vision at the foveal scale: it enables detailed foveal visual analysis by accurately driving small eye movements, and it also possesses a visual processing machinery that is sensitive to active eye movement behavior. Studying active vision at the foveal scale in the primate SC is informative for broader aspects of active perception, including the overt and covert processing of peripheral extra-foveal visual scene locations.

Exploration of the functional consequences of fixational eye movements in the absence of a fovea

A recent theory posits that ocular drifts of fixational eye movements serve to reformat the visual input of natural images, so that the power of the input image is equalized across a range of spatial frequencies. This “spectral whitening” effect is postulated to improve the processing of high-spatial-frequency information and requires normal fixational eye movements. Given that people with macular disease exhibit abnormal fixational eye movements, do they also exhibit spectral whitening? To answer this question, we computed the power spectral density of movies of natural images translated in space and time according to the fixational eye movements (thus simulating the retinal input) of a group of observers with long-standing bilateral macular disease. Just as for people with normal vision, the power of the retinal input at low spatial frequencies was lower than that based on the 1/f² relationship, demonstrating spectral whitening. However, the amount of whitening was much less for observers with macular disease when compared with age-matched controls with normal vision. A mediation analysis showed that the eccentricity of the preferred retinal locus adopted by these observers and the characteristics of ocular drifts are important factors limiting the amount of whitening. Finally, we did not find a normal aging effect on spectral whitening. Although these findings alone cannot form a causal link between macular disease and spectral properties of eye movements, they suggest novel potential means of modifying the characteristics of fixational eye movements, which may in turn improve functional vision for people with macular disease.

Rapid stimulus-driven modulation of slow ocular position drifts

The eyes are never still during maintained gaze fixation. When microsaccades are not occurring, ocular position exhibits continuous slow changes, often referred to as drifts. Unlike microsaccades, drifts remain to be viewed as largely random eye movements. Here we found that ocular position drifts can, instead, be very systematically stimulus-driven, and with very short latencies. We used highly precise eye tracking in three well trained macaque monkeys and found that even fleeting (~8 ms duration) stimulus presentations can robustly trigger transient and stimulus-specific modulations of ocular position drifts, and with only approximately 60 ms latency. Such drift responses are binocular, and they are most effectively elicited with large stimuli of low spatial frequency. Intriguingly, the drift responses exhibit some image pattern selectivity, and they are not explained by convergence responses, pupil constrictions, head movements, or starting eye positions. Ocular position drifts have very rapid access to exogenous visual information.

What Can Computational Models Learn From Human Selective Attention? A Review From an Audiovisual Unimodal and Crossmodal Perspective

Selective attention plays an essential role in information acquisition and utilization from the environment. In the past 50 years, research on selective attention has been a central topic in cognitive science. Compared with unimodal studies, crossmodal studies are more complex but necessary to solve real-world challenges in both human experiments and computational modeling. Although an increasing number of findings on crossmodal selective attention have shed light on humans' behavioral patterns and neural underpinnings, a much better understanding is still necessary to yield the same benefit for intelligent computational agents. This article reviews studies of selective attention in unimodal visual and auditory and crossmodal audiovisual setups from the multidisciplinary perspectives of psychology and cognitive neuroscience, and evaluates different ways to simulate analogous mechanisms in computational models and robotics. We discuss the gaps between these fields in this interdisciplinary review and provide insights about how to use psychological findings and theories in artificial intelligence from different perspectives.

Gaze direction as equilibrium: more evidence from spatial and temporal aspects of small-saccade triggering in the rhesus macaque monkey

Rigorous behavioral studies made in human subjects have shown that small-eccentricity target displacements are associated with increased saccadic reaction times, but the reasons for this remain unclear. Before characterizing the neurophysiological foundations underlying this relationship between the spatial and temporal aspects of saccades, we tested the triggering of small saccades in the male rhesus macaque monkey. We also compared our results to those obtained in human subjects, both from the existing literature and through our own additional measurements. Using a variety of behavioral tasks exercising visual and nonvisual guidance of small saccades, we found that small saccades consistently require more time than larger saccades to be triggered in the nonhuman primate, even in the absence of any visual guidance and when valid advance information about the saccade landing position is available. We also found a strong asymmetry in the reaction times of small upper versus lower visual field visually guided saccades, a phenomenon that has not been described before for small saccades, even in humans. Following the suggestion that an eye movement is not initiated as long as the visuo-oculomotor system is within a state of balance, in which opposing commands counterbalance each other, we propose that the longer reaction times are a signature of enhanced times needed to create the symmetry-breaking condition that puts downstream premotor neurons into a push-pull regime necessary for rotating the eyeballs. Our results provide an important catalog of nonhuman primate oculomotor capabilities on the miniature scale, allowing concrete predictions on underlying neurophysiological mechanisms.NEW & NOTEWORTHY Leveraging a multitude of neurophysiological investigations in the rhesus macaque monkey, we generated and tested hypotheses about small-saccade latencies in this animal model. We found that small saccades always take longer, on average, than larger saccades to trigger, regardless of visual and cognitive context. Moreover, small downward saccades have the longest latencies overall. Our results provide an important documentation of oculomotor capabilities of an indispensable animal model for neuroscientific research in vision, cognition, and action.

Superior colliculus encodes visual saliency during smooth pursuit eye movements

The saliency map has played a long-standing role in models and theories of visual attention, and it is now supported by neurobiological evidence from several cortical and subcortical brain areas. While visual saliency is computed during moments of active fixation, it is not known whether the same is true while engaged in smooth pursuit of a moving stimulus, which is very common in real-world vision. Here, we examined extrafoveal saliency coding in the superior colliculus, a midbrain area associated with attention and gaze, during smooth pursuit eye movements. We found that SC neurons from the superficial visual layers showed a robust representation of peripheral saliency evoked by a conspicuous stimulus embedded in a wide-field array of goal-irrelevant stimuli. In contrast, visuomotor neurons from the intermediate saccade-related layers showed a poor saliency representation, even though most of these neurons were visually responsive during smooth pursuit. These results confirm and extend previous findings that place the SCs in a unique role as a saliency map that monitors peripheral vision during foveation of stationary and now moving objects.

Transfer function of the rhesus macaque oculomotor system for small-amplitude slow motion trajectories

Two main types of small eye movements occur during gaze fixation: microsaccades and slow ocular drifts. While microsaccade generation has been relatively well studied, ocular drift control mechanisms are unknown. Here we explored the degree to which monkey smooth eye movements, on the velocity scale of slow ocular drifts, can be generated systematically. Two male rhesus macaque monkeys tracked a spot moving sinusoidally, but slowly, along the horizontal or vertical direction. Maximum target displacement in the motion trajectory was 30 min arc (0.5°), and we varied the temporal frequency of target motion from 0.2 to 5 Hz. We obtained an oculomotor “transfer function” by measuring smooth eye velocity gain (relative to target velocity) as a function of frequency, similar to past work with large-amplitude pursuit. Monkey eye velocities as slow as those observed during slow ocular drifts were clearly target motion driven. Moreover, as with large-amplitude smooth pursuit, eye velocity gain varied with temporal frequency. However, unlike with large-amplitude pursuit, exhibiting low-pass behavior, small-amplitude motion tracking was band pass, with the best ocular movement gain occurring at ~0.8–1 Hz. When oblique directions were tested, we found that the horizontal component of pursuit gain was larger than the vertical component. Our results provide a catalog of the control abilities of the monkey oculomotor system for slow target motions, and they also support the notion that smooth fixational ocular drifts are controllable. This has implications for neural investigations of drift control and the image-motion consequences of drifts on visual coding in early visual areas.

NEW & NOTEWORTHY We studied the efficacy of monkey smooth pursuit eye movements for very slow target velocities. Pursuit was impaired for sinusoidal motions of frequency less than ~0.8–1 Hz. Nonetheless, eye trajectory was still sinusoidally modulated, even at velocities lower than those observed during gaze fixation with slow ocular drifts. Our results characterize the slow control capabilities of the monkey oculomotor system and provide a basis for future understanding of the neural mechanisms for slow ocular drifts.

Human-level saccade detection performance using deep neural networks

Saccades are ballistic eye movements that rapidly shift gaze from one location of visual space to another. Detecting saccades in eye movement recordings is important not only for studying the neural mechanisms underlying sensory, motor, and cognitive processes, but also as a clinical and diagnostic tool. However, automatically detecting saccades can be difficult, particularly when such saccades are generated in coordination with other tracking eye movements, like smooth pursuits, or when the saccade amplitude is close to eye tracker noise levels, like with microsaccades. In such cases, labeling by human experts is required, but this is a tedious task prone to variability and error. We developed a convolutional neural network to automatically detect saccades at human-level accuracy and with minimal training examples. Our algorithm surpasses state of the art according to common performance metrics and could facilitate studies of neurophysiological processes underlying saccade generation and visual processing. NEW & NOTEWORTHY Detecting saccades in eye movement recordings can be a difficult task, but it is a necessary first step in many applications. We present a convolutional neural network that can automatically identify saccades with human-level accuracy and with minimal training examples. We show that our algorithm performs better than other available algorithms, by comparing performance on a wide range of data sets. We offer an open-source implementation of the algorithm as well as a web service.

Neurophysiology of visually guided eye movements: critical review and alternative viewpoint

In this article, we perform a critical examination of assumptions that led to the assimilation of measurements of the movement of a rigid body in the physical world to parameters encoded within brain activity. In many neurophysiological studies of goal-directed eye movements, equivalence has indeed been made between the kinematics of the eyes or of a targeted object and the associated neuronal processes. Such a way of proceeding brings up the reduction encountered in projective geometry when a multidimensional object is being projected onto a one-dimensional segment. The measurement of a movement indeed consists of generation of a series of numerical values from which magnitudes such as amplitude, duration, and their ratio (speed) are calculated. By contrast, movement generation consists of activation of multiple parallel channels in the brain. Yet, for many years, kinematic parameters were supposed to be encoded in brain activity, even though the neuronal image of most physical events is distributed both spatially and temporally. After explaining why the "neuronalization" of such parameters is questionable for elucidating the neural processes underlying the execution of saccadic and pursuit eye movements, we propose an alternative to the framework that has dominated the last five decades. A viewpoint is presented in which these processes follow principles that are defined by intrinsic properties of the brain (population coding, multiplicity of transmission delays, synchrony of firing, connectivity). We propose reconsideration of the time course of saccadic and pursuit eye movements as the restoration of equilibria between neural populations that exert opposing motor tendencies.

Signals driving the adaptation of saccades that require spatial updating

Saccades adapt to persistent natural or artificially imposed dysmetrias. The characteristics and circuitry of saccade adaptation have been revealed using a visually guided task (VGT) where the vectors of the target step and the intended saccade command are the same. However, in real life, another saccade occasionally intervenes before the saccade to the target occurs. This necessitates an updating of the intended saccade to account for the intervening saccadic displacement, which dissociates the visual target signal and the intended saccade command. We determined whether the adaptation process is similar for VGT and updated saccades by studying the transfer of adaptation between them. The ultimate visual target was dissociated from the intended saccade command with double-step saccade tasks (DSTs) in which two targets are flashed sequentially at different locations while the monkey maintains fixation. The resulting saccades toward the first and second targets occur in the dark. The transfer of visually guided saccade adaptation to the second saccades of a DST and vice versa depended on the eccentricity of the second visual target, and not the second saccade command. If a target with the same eccentricity as the adapted target appears briefly during the intersaccadic interval of a DST, more adaptation transfers. Because a brief appearance of the visual target either before the first saccade or during the intersaccadic interval influences how much adaptation transfer the second saccade will express, the processing of adaptation and DST updating may overlap. NEW & NOTEWORTHY Adaptation and the spatial updating of saccades are thought to be independent processes. When we dissociate the visual target and the intended saccade command, the transfer of visually guided saccade adaptation to the saccades of the double-step saccade tasks (DST) and vice versa is driven by a visual not motor error. The visual target has an effect until the second saccade of a DST occurs. Therefore, the processing of adaptation and the spatial updating of saccades may overlap.

Orientation and Contrast Tuning Properties and Temporal Flicker Fusion Characteristics of Primate Superior Colliculus Neurons

The primate superior colliculus is traditionally studied from the perspectives of gaze control, target selection, and selective attention. However, this structure is also visually responsive, and it is the primary visual structure in several species. Thus, understanding the visual tuning properties of the primate superior colliculus is important, especially given that the superior colliculus is part of an alternative visual pathway running in parallel to the predominant geniculo-cortical pathway. In recent previous studies, we have characterized receptive field organization and spatial frequency tuning properties in the primate (rhesus macaque) superior colliculus. Here, we explored additional aspects like orientation tuning, putative center-surround interactions, and temporal frequency tuning characteristics of visually-responsive superior colliculus neurons. We found that orientation tuning exists in the primate superior colliculus, but that such tuning is relatively moderate in strength. We also used stimuli of different sizes to explore contrast sensitivity and center-surround interactions. We found that stimulus size within a visual receptive field primarily affects the slope of contrast sensitivity curves without altering maximal firing rate. Additionally, sustained firing rates, long after stimulus onset, strongly depend on stimulus size, and this is also reflected in local field potentials. This suggests the presence of inhibitory interactions within and around classical receptive fields. Finally, primate superior colliculus neurons exhibit temporal frequency tuning for frequencies lower than 30 Hz, with critical flicker fusion frequencies of <20 Hz. These results support the hypothesis that the primate superior colliculus might contribute to visual performance, likely by mediating coarse, but rapid, object detection and identification capabilities for the purpose of facilitating or inhibiting orienting responses. Such mediation may be particularly amplified in blindsight subjects who lose portions of their primary visual cortex and therefore rely on alternative visual pathways including the pathway through the superior colliculus.

Overt and covert attention to location-based reward

Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities.

Synchronizing the tracking eye movements with the motion of a visual target: Basic neural processes

In primates, the appearance of an object moving in the peripheral visual field elicits an interceptive saccade that brings the target image onto the foveae. This foveation is then maintained more or less efficiently by slow pursuit eye movements and subsequent catch-up saccades. Sometimes, the tracking is such that the gaze direction looks spatiotemporally locked onto the moving object. Such a spatial synchronism is quite spectacular when one considers that the target-related signals are transmitted to the motor neurons through multiple parallel channels connecting separate neural populations with different conduction speeds and delays. Because of the delays between the changes of retinal activity and the changes of extraocular muscle tension, the maintenance of the target image onto the fovea cannot be driven by the current retinal signals as they correspond to past positions of the target. Yet, the spatiotemporal coincidence observed during pursuit suggests that the oculomotor system is driven by a command estimating continuously the current location of the target, i.e., where it is here and now. This inference is also supported by experimental perturbation studies: when the trajectory of an interceptive saccade is experimentally perturbed, a correction saccade is produced in flight or after a short delay, and brings the gaze next to the location where unperturbed saccades would have landed at about the same time, in the absence of visual feedback. In this chapter, we explain how such correction can be supported by previous visual signals without assuming "predictive" signals encoding future target locations. We also describe the basic neural processes which gradually yield the synchronization of eye movements with the target motion. When the process fails, the gaze is driven by signals related to past locations of the target, not by estimates to its upcoming locations, and a catch-up is made to reinitiate the synchronization.

How is visual salience computed in the brain? Insights from behaviour, neurobiology and modelling

Inherent in visual scene analysis is a bottleneck associated with the need to sequentially sample locations with foveating eye movements. The concept of a 'saliency map' topographically encoding stimulus conspicuity over the visual scene has proven to be an efficient predictor of eye movements. Our work reviews insights into the neurobiological implementation of visual salience computation. We start by summarizing the role that different visual brain areas play in salience computation, whether at the level of feature analysis for bottom-up salience or at the level of goal-directed priority maps for output behaviour. We then delve into how a subcortical structure, the superior colliculus (SC), participates in salience computation. The SC represents a visual saliency map via a centre-surround inhibition mechanism in the superficial layers, which feeds into priority selection mechanisms in the deeper layers, thereby affecting saccadic and microsaccadic eye movements. Lateral interactions in the local SC circuit are particularly important for controlling active populations of neurons. This, in turn, might help explain long-range effects, such as those of peripheral cues on tiny microsaccades. Finally, we show how a combination of in vitro neurophysiology and large-scale computational modelling is able to clarify how salience computation is implemented in the local circuit of the SC.This article is part of the themed issue 'Auditory and visual scene analysis'.

Midbrain auditory selectivity to natural sounds

This study investigated auditory stimulus selectivity in the midbrain superior colliculus (SC) of the echolocating bat, an animal that relies on hearing to guide its orienting behaviors. Multichannel, single-unit recordings were taken across laminae of the midbrain SC of the awake, passively listening big brown bat, Eptesicus fuscus. Species-specific frequency-modulated (FM) echolocation sound sequences with dynamic spectrotemporal features served as acoustic stimuli along with artificial sound sequences matched in bandwidth, amplitude, and duration but differing in spectrotemporal structure. Neurons in dorsal sensory regions of the bat SC responded selectively to elements within the FM sound sequences, whereas neurons in ventral sensorimotor regions showed broad response profiles to natural and artificial stimuli. Moreover, a generalized linear model (GLM) constructed on responses in the dorsal SC to artificial linear FM stimuli failed to predict responses to natural sounds and vice versa, but the GLM produced accurate response predictions in ventral SC neurons. This result suggests that auditory selectivity in the dorsal extent of the bat SC arises through nonlinear mechanisms, which extract species-specific sensory information. Importantly, auditory selectivity appeared only in responses to stimuli containing the natural statistics of acoustic signals used by the bat for spatial orientation-sonar vocalizations-offering support for the hypothesis that sensory selectivity enables rapid species-specific orienting behaviors. The results of this study are the first, to our knowledge, to show auditory spectrotemporal selectivity to natural stimuli in SC neurons and serve to inform a more general understanding of mechanisms guiding sensory selectivity for natural, goal-directed orienting behaviors.

Vision, Perception, and Attention through the Lens of Microsaccades: Mechanisms and Implications

Microsaccades are small saccades. Neurophysiologically, microsaccades are generated using similar brainstem mechanisms as larger saccades. This suggests that peri-saccadic changes in vision that accompany large saccades might also be expected to accompany microsaccades. In this review, we highlight recent evidence demonstrating this. Microsaccades are not only associated with suppressed visual sensitivity and perception, as in the phenomenon of saccadic suppression, but they are also associated with distorted spatial representations, as in the phenomenon of saccadic compression, and pre-movement response gain enhancement, as in the phenomenon of pre-saccadic attention. Surprisingly, the impacts of peri-microsaccadic changes in vision are far reaching, both in time relative to movement onset as well as spatial extent relative to movement size. Periods of ~100 ms before and ~100 ms after microsaccades exhibit significant changes in neuronal activity and behavior, and this happens at eccentricities much larger than the eccentricities targeted by the microsaccades themselves. Because microsaccades occur during experiments enforcing fixation, these effects create a need to consider the impacts of microsaccades when interpreting a variety of experiments on vision, perception, and cognition using awake, behaving subjects. The clearest example of this idea to date has been on the links between microsaccades and covert visual attention. Recent results have demonstrated that peri-microsaccadic changes in vision play a significant role in both neuronal and behavioral signatures of covert visual attention, so much so that in at least some attentional cueing paradigms, there is very tight synchrony between microsaccades and the emergence of attentional effects. Just like large saccades, microsaccades are genuine motor outputs, and their impacts can be substantial even during perceptual and cognitive experiments not concerned with overt motor generation per se.

A parsimonious computational model of visual target position encoding in the superior colliculus

The superior colliculus (SC) is a brainstem structure at the crossroad of multiple functional pathways. Several neurophysiological studies suggest that the population of active neurons in the SC encodes the location of a visual target to foveate, pursue or attend to. Although extensive research has been carried out on computational modeling, most of the reported models are often based on complex mechanisms and explain a limited number of experimental results. This suggests that a key aspect may have been overlooked in the design of previous computational models. After a careful study of the literature, we hypothesized that the representation of the whole retinal stimulus (not only its center) might play an important role in the dynamics of SC activity. To test this hypothesis, we designed a model of the SC which is built upon three well-accepted principles: the log-polar representation of the visual field onto the SC, the interplay between a center excitation and a surround inhibition and a simple neuronal dynamics, like the one proposed by the dynamic neural field theory. Results show that the retinotopic organization of the collicular activity conveys an implicit computation that deeply impacts the target selection process.

Educating the blind brain: a panorama of neural bases of vision and of training programs in organic neurovisual deficits

Vision is a complex function, which is achieved by movements of the eyes to properly foveate targets at any location in 3D space and to continuously refresh neural information in the different visual pathways. The visual system involves five main routes originating in the retinas but varying in their destination within the brain: the occipital cortex, but also the superior colliculus (SC), the pretectum, the supra-chiasmatic nucleus, the nucleus of the optic tract and terminal dorsal, medial and lateral nuclei. Visual pathway architecture obeys systematization in sagittal and transversal planes so that visual information from left/right and upper/lower hemi-retinas, corresponding respectively to right/left and lower/upper visual fields, is processed ipsilaterally and ipsialtitudinally to hemi-retinas in left/right hemispheres and upper/lower fibers. Organic neurovisual deficits may occur at any level of this circuitry from the optic nerve to subcortical and cortical destinations, resulting in low or high-level visual deficits. In this didactic review article, we provide a panorama of the neural bases of eye movements and visual systems, and of related neurovisual deficits. Additionally, we briefly review the different schools of rehabilitation of organic neurovisual deficits, and show that whatever the emphasis is put on action or perception, benefits may be observed at both motor and perceptual levels. Given the extent of its neural bases in the brain, vision in its motor and perceptual aspects is also a useful tool to assess and modulate central nervous system (CNS) in general.

Subcortical connections of area V4 in the macaque

Area V4 has numerous, topographically organized connections with multiple cortical areas, some of which are important for spatially organized visual processing, and others which seem important for spatial attention. Although the topographic organization of V4's connections with other cortical areas has been established, the detailed topography of its connections with subcortical areas is unclear. We therefore injected retrograde and anterograde tracers in different topographical regions of V4 in nine macaques to determine the organization of its subcortical connections. The injection sites included representations ranging from the fovea to far peripheral eccentricities in both the upper and lower visual fields. The topographically organized connections of V4 included bidirectional connections with four subdivisions of the pulvinar, two subdivisions of the claustrum, and the interlaminar portions of the lateral geniculate nucleus, and efferent projections to the superficial and intermediate layers of the superior colliculus, the thalamic reticular nucleus, and the caudate nucleus. All of these structures have a possible role in spatial attention. The nontopographic, or converging, connections included bidirectional connections with the lateral nucleus of the amygdala, afferent inputs from the dorsal raphe, median raphe, locus coeruleus, ventral tegmentum and nucleus basalis of Meynert, and efferent projections to the putamen. Any role of these structures in attention may be less spatially specific.

Vergence neurons identified in the rostral superior colliculus code smooth eye movements in 3D space

The rostral superior colliculus (rSC) encodes position errors for multiple types of eye movements, including microsaccades, small saccades, smooth pursuit, and fixation. Here we address whether the rSC contributes to the development of neural signals that are suitable for controlling vergence eye movements. We use both single-unit recording and microstimulation techniques in monkey to answer this question. We found that vergence eye movements can be evoked using microstimulation in the rSC. Moreover, among the previously described neurons in rSC, we recorded a novel population of neurons that either increased (i.e., convergence neurons) or decreased (i.e., divergence neurons) their activity during vergence eye movements. In particular, these neurons dynamically encoded changes in vergence angle during vergence tracking, fixation in 3D space and the slow binocular realignment that occurs after disconjugate saccades, but were completely unresponsive during conjugate or the rapid component of disconjugate saccades (i.e., fast vergence) and conjugate smooth pursuit. Together, our microstimulation and single-neuron results suggest that the SC plays a role in the generation of signals required to precisely align the eyes toward targets in 3D space. We propose that accurate maintenance of 3D eye position, critical for the perception of stereopsis, may be mediated via the rSC.

Predictive encoding of moving target trajectory by neurons in the parabigeminal nucleus

Intercepting momentarily invisible moving objects requires internally generated estimations of target trajectory. We demonstrate here that the parabigeminal nucleus (PBN) encodes such estimations, combining sensory representations of target location, extrapolated positions of briefly obscured targets, and eye position information. Cui and Malpeli (Cui H, Malpeli JG. J Neurophysiol 89: 3128-3142, 2003) reported that PBN activity for continuously visible tracked targets is determined by retinotopic target position. Here we show that when cats tracked moving, blinking targets the relationship between activity and target position was similar for ON and OFF phases (400 ms for each phase). The dynamic range of activity evoked by virtual targets was 94% of that of real targets for the first 200 ms after target offset and 64% for the next 200 ms. Activity peaked at about the same best target position for both real and virtual targets. PBN encoding of target position takes into account changes in eye position resulting from saccades, even without visual feedback. Since PBN response fields are retinotopically organized, our results suggest that activity foci associated with real and virtual targets at a given target position lie in the same physical location in the PBN, i.e., a retinotopic as well as a rate encoding of virtual-target position. We also confirm that PBN activity is specific to the intended target of a saccade and is predictive of which target will be chosen if two are offered. A Bayesian predictor-corrector model is presented that conceptually explains the differences in the dynamic ranges of PBN neuronal activity evoked during tracking of real and virtual targets.

Superior colliculus inactivation alters the relationship between covert visual attention and microsaccades

Microsaccades are tiny saccades that occur during gaze fixation. Whereas these movements have traditionally been viewed as random, it was recently discovered that microsaccade directions can be significantly biased by covertly attended visual stimuli. The detailed mechanisms mediating such a bias are neither known nor immediately obvious, especially because the amplitudes of the movements influenced by attentional cueing could be up to two orders of magnitude smaller than the eccentricity of the attended location. Here, we tested whether activity in the peripheral superior colliculus (SC) is necessary for this correlation between attentional cueing and microsaccades. We reversibly and focally inactivated SC neurons representing peripheral regions of visual space while rhesus monkeys performed a demanding covert visual attention task. The normal bias of microsaccade directions observed in each monkey before SC inactivation was eliminated when a cue was placed in the visual region affected by the inactivation; microsaccades were, instead, biased away from the affected visual space. When the cue was placed at another location unaffected by SC inactivation, the baseline cue-induced bias of microsaccade directions remained mostly intact, because the cue was in unaffected visual space, and any remaining changes were again explained by a repulsion of microsaccades away from the inactivated region. Our results indicate that peripheral SC activity is required for the link between microsaccades and the cueing of covert visual attention, and that it could do so by altering the probability of triggering microsaccades without necessarily affecting the motor generation of these movements.

Visual fixation as equilibrium: evidence from superior colliculus inactivation

During visual fixation, the image of an object is maintained within the fovea. Previous studies have shown that such maintenance involves the deep superior colliculus (dSC). However, the mechanisms by which the dSC supports visual fixation remain controversial. According to one view, activity in the rostral dSC maintains gaze direction by preventing neurons in the caudal dSC from issuing saccade commands. An alternative hypothesis proposes that gaze direction is achieved through equilibrium of target position signals originating from the two dSCs. Here, we show in monkeys that artificially reducing activity in the rostral half of one dSC results in a biased estimate of target position during fixation, consistent with the second hypothesis, rather than an inability to maintain gaze fixation as predicted by the first hypothesis. After injection of muscimol at rostral sites in the dSC, fixation became more stable since microsaccade rate was reduced rather than increased. Moreover, the scatter of eye positions was offset relative to preinactivation baselines. The magnitude and the direction of the offsets depended on both the target size and the injected site in the collicular map. Other oculomotor parameters, such as the accuracy of saccades to peripheral targets and the amplitude and velocity of fixational saccades, were largely unaffected. These results suggest that the rostral half of the dSC supports visual fixation through a distributed representation of behaviorally relevant target position signals. The inactivation-induced fixation offset establishes the foveal visual stimulation that is required to restore the balance of activity between the two dSCs.

Is saccade averaging determined by visual processing or movement planning?

Saccadic averaging that causes subjects' gaze to land between the location of two targets when faced with simultaneously or sequentially presented stimuli has been often used as a probe to investigate the nature of computations that transform sensory representations into an oculomotor plan. Since saccadic movements involve at least two processing stages-a visual stage that selects a target and a movement stage that prepares the response-saccade averaging can either occur due to interference in visual processing or movement planning. By having human subjects perform two versions of a saccadic double-step task, in which the stimuli remained the same, but different instructions were provided (REDIRECT gaze to the later-appearing target vs. FOLLOW the sequence of targets in their order of appearance), we tested two alternative hypotheses. If saccade averaging were due to visual processing alone, the pattern of saccade averaging is expected to remain the same across task conditions. However, whereas subjects produced averaged saccades between two targets in the FOLLOW condition, they produced hypometric saccades in the direction of the initial target in the REDIRECT condition, suggesting that the interaction between competing movement plans produces saccade averaging.

Similarity of superior colliculus involvement in microsaccade and saccade generation

The characteristics of microsaccades, or small fixational saccades, and their influence on visual function have been studied extensively. However, the detailed mechanisms for generating these movements are less understood. We recently found that the superior colliculus (SC), a midbrain structure involved in saccade generation, also plays a role in microsaccade generation. Here we compared the dynamics of neuronal activity in the SC associated with microsaccades to those observed in this structure in association with larger voluntary saccades. We found that microsaccade-related activity in the SC is characterized by a gradual increase in firing rate starting ∼100 ms prior to microsaccade onset, a peak of neuronal discharge just after movement onset, and a subsequent gradual decrease in firing rate until ∼100 ms after movement onset. These properties were shared with saccade-related SC neurons, recorded from the same monkeys but preferring larger eye movements, suggesting that at the level of the SC the neuronal control of microsaccades is similar to that for larger voluntary saccades. We also found that neurons exhibiting microsaccade-related activity often also exhibited saccade-related activity for slightly larger movements of similar direction, suggesting a continuity of the spatial representation in the SC, in both amplitude and direction, down to the smallest movements. Our results indicate that the mechanisms controlling microsaccades may be fundamentally the same as those for larger saccades, and thus shed new light on the functional role of these eye movements and their possible influence on sensory and sensory-motor processes.

Superior colliculi involvement in poststroke unilateral spatial neglect: a pilot study

PURPOSE

The neural mechanisms underlying unilateral spatial neglect (USN) are unclear. The superior colliculi (SC) may be involved in USN expression, and the spatial summation effect (SSE), where reaction times to bilateral stimuli are faster than to unilateral, may be a behavioral index of SC function. We determined the feasibility of investigating SC contribution to poststroke USN using the SSE in 3 groups.

METHODS

Seven participants with left near-extrapersonal space USN (USN+) following right hemisphere stroke, 10 without (USN-), and 10 controls were tested under binocular/monocular (right eye patched) conditions while responding to unilateral/bilateral stimuli. Control and USN- groups completed the SSE paradigm.

RESULTS

Most USN+ participants were unable to initiate the SSE paradigm due to poor visual fi xation and demonstrated higher contrast sensitivity for left-sided stimuli. Controls showed an SSE (under both viewing conditions) while the USN- showed an abnormal SSE whereby reaction times to bilateral stimuli were faster than to unilateral-left but not to unilateral-right stimuli (under both binocular/monocular conditions).

CONCLUSION

This study is the fi rst to investigate SC contribution in poststroke USN using the SSE; we identifi ed higher contrast sensitivity to left-sided stimuli and poor fi xation in the USN+ group. These fi ndings suggest avenues for research that may lead to novel rehabilitation interventions.

Modulation of microsaccades in monkey during a covert visual attention task

The use of awake, fixating monkeys in neuroscience has allowed significant advances in understanding numerous brain functions. However, fixation is an active process, with the occurrence of incessant eye movements, including rapid ones called microsaccades. Even though microsaccades have been shown to be modulated by stimulus and cognitive processes in humans, it is not known to what extent these results are similar in monkeys or why they occur. Here, we analyzed the stimulus-, context-, and attention-related changes in microsaccades while monkeys performed a challenging visual attention task. The distributions of microsaccade times were highly stereotypical across thousands of trials in the task. Moreover, in epochs of the task in which animals anticipated the occurrence of brief stimulus probes, microsaccade frequency decreased to a rate of less than one movement per second even on long multisecond trials. These effects were explained by the observation that microsaccades occurring at the times of the brief probes were sometimes associated with reduced perceptual performance. Microsaccade directions also exhibited temporal modulations related to the attentional demands of the task, like earlier studies in humans, and were more likely to be directed toward an attended location on successfully performed trials than on unsuccessfully completed ones. Our results show that microsaccades in nonhuman primates are correlated with the allocation of stimulus-evoked and sustained covert attention. We hypothesize that involvement of the superior colliculus in microsaccade generation and attentional allocation contributes to these observations. More importantly, our results clarify the potential role of these eye movements in modifying behavior and neural activity.

Mechanisms for generating and compensating for the smallest possible saccades

Microsaccades are small eye movements that occur during gaze fixation. Although taking place only when we attempt to stabilize gaze position, microsaccades can be understood by relating them to the larger voluntary saccades, which abruptly shift gaze position. Starting from this approach to microsaccade analysis, I show how it can lead to significant insight about the generation and functional role of these eye movements. Like larger saccades, microsaccades are now known to be generated by brainstem structures involved not only in compiling motor commands for eye movements, but also in identifying and selecting salient target locations in the visual environment. In addition, these small eye movements both influence and are influenced by sensory and cognitive processes in various areas of the brain, and in a manner that is similar to the interactions between larger saccades and sensory or cognitive processes. By approaching the study of microsaccades from the perspective of what has been learned about their larger counterparts, we are now in a position to make greater strides in our understanding of the function of the smallest possible saccadic eye movements.

Flexibility of foveal attention during ocular pursuit

Smooth pursuit of natural objects requires flexible allocation of attention to inspect features. However, it has been reported that attention is focused at the fovea during pursuit. We ask here if foveal attention is obligatory during pursuit, or if it can be disengaged. Observers tracked a stimulus composed of a central dot surrounded by four others and identified one of the dots when it dimmed. Extinguishing the center dot before the dimming improved task performance, suggesting that attention was released from it. To determine if the center dot automatically usurped attention, we provided the pursuit system with an alternative sensory signal by adding peripheral motion that moved with the stimulus. This also improved identification performance, evidence that a central target does not necessarily require attention during pursuit. Identification performance at the central dot also improved, suggesting that the spatial extent of the background did not attract attention to the periphery; instead, peripheral motion freed pursuit attention from the central dot, affording better identification performance. The results show that attention can be flexibly allocated during pursuit and imply that attention resources for pursuit of small and large objects come from different sources.

Topographic organization of excitatory and inhibitory commissural connections in the superior colliculi and their functional roles in saccade generation

Our electrophysiological study showed that there are topographic connections between excitatory and inhibitory commissural neurons (CNs) in one superior colliculus (SC) and tectoreticular neurons (TRNs) in the opposite SC. To obtain morphological evidence for these topographic commissural connections between the SCs, tracers were injected into various parts of the SC, the inhibitory burst neuron (IBN) area and Forel's field H (FFH), in the cat. Retrogradely labeled CNs were classified into three types according to their somatic areas and identified as GABA-positive or -negative immunohistochemically. Caudal SC injections labeled small GABA-positive CNs (<200 μm(2)) in the deep layers of the opposite rostral SC. Rostral SC injections mainly labeled medium-sized GABA-negative CNs (200-700 μm(2)) in the upper intermediate layer of the opposite rostral SC and small GABA-positive CNs in its deeper layers. Lateral SC injections labeled small GABA-positive CNs in the opposite medial SC and mainly medium-sized GABA-negative CNs in its lateral part. Medial SC injections labeled small GABA-positive CNs in the lateral SC and medium-sized GABA-negative CNs in the medial SC. In comparison, TRNs projecting to the FFH or IBN region were large (>700 μm(2)) and medium-sized. Many of the medium-sized GABA-negative CNs were TRNs projecting to the FFH. These results indicate that mirror-symmetric excitatory pathways link medial to medial (upper field) and lateral to lateral (lower field) parts of the SCs, whereas upper and lower field representations are linked by reciprocal inhibitory pathways in the tectal commissure. These connections presumably play important roles in conjugate upward and downward vertical saccades.

Microsaccadic suppression of visual bursts in the primate superior colliculus

Saccadic suppression, a behavioral phenomenon in which perceptual thresholds are elevated before, during, and after saccadic eye movements, is an important mechanism for maintaining perceptual stability. However, even during fixation, the eyes never remain still, but undergo movements including microsaccades, drift, and tremor. The neural mechanisms for mediating perceptual stability in the face of these "fixational" movements are not fully understood. Here, we investigated one component of such mechanisms: a neural correlate of microsaccadic suppression. We measured the size of short-latency, stimulus-induced visual bursts in superior colliculus neurons of adult, male rhesus macaques. We found that microsaccades caused approximately 30% suppression of the bursts. Suppression started approximately 70 ms before microsaccade onset and ended approximately 70 ms after microsaccade end, a time course similar to behavioral measures of this phenomenon in humans. We also identified a new behavioral effect of microsaccadic suppression on saccadic reaction times, even for continuously presented, suprathreshold visual stimuli. These results provide evidence that the superior colliculus is part of the mechanism for suppressing self-generated visual signals during microsaccades that might otherwise disrupt perceptual stability.