The Evolution of Gaze Shifting Eye Movements

Natural visual behavior and active sensing in the mouse

In the natural world, animals use vision for a wide variety of behaviors not reflected in most laboratory paradigms. Although mice have low-acuity vision, they use their vision for many natural behaviors, including predator avoidance, prey capture, and navigation. They also perform active sensing, moving their head and eyes to achieve behavioral goals and acquire visual information. These aspects of natural vision result in visual inputs and corresponding behavioral outputs that are outside the range of conventional vision studies but are essential aspects of visual function. Here, we review recent studies in mice that have tapped into natural behavior and active sensing to reveal the computational logic of neural circuits for vision.

Hindbrain modules differentially transform activity of single collicular neurons to coordinate movements

Seemingly simple behaviors such as swatting a mosquito or glancing at a signpost involve the precise coordination of multiple body parts. Neural control of coordinated movements is widely thought to entail transforming a desired overall displacement into displacements for each body part. Here we reveal a different logic implemented in the mouse gaze system. Stimulating superior colliculus (SC) elicits head movements with stereotyped displacements but eye movements with stereotyped endpoints. This is achieved by individual SC neurons whose branched axons innervate modules in medulla and pons that drive head movements with stereotyped displacements and eye movements with stereotyped endpoints, respectively. Thus, single neurons specify a mixture of endpoints and displacements for different body parts, not overall displacement, with displacements for different body parts computed at distinct anatomical stages. Our study establishes an approach for unraveling motor hierarchies and identifies a logic for coordinating movements and the resulting pose.

Predictive saccades and decision making in the beetle-predating saffron robber fly

Internal predictions about the sensory consequences of self-motion, encoded by corollary discharge, are ubiquitous in the animal kingdom, including for fruit flies, dragonflies, and humans. In contrast, predicting the future location of an independently moving external target requires an internal model. With the use of internal models for predictive gaze control, vertebrate predatory species compensate for their sluggish visual systems and long sensorimotor latencies. This ability is crucial for the timely and accurate decisions that underpin a successful attack. Here, we directly demonstrate that the robber fly Laphria saffrana, a specialized beetle predator, also uses predictive gaze control when head tracking potential prey. Laphria uses this predictive ability to perform the difficult categorization and perceptual decision task of differentiating a beetle from other flying insects with a low spatial resolution retina. Specifically, we show that (1) this predictive behavior is part of a saccade-and-fixate strategy, (2) the relative target angular position and velocity, acquired during fixation, inform the subsequent predictive saccade, and (3) the predictive saccade provides Laphria with additional fixation time to sample the frequency of the prey's specular wing reflections. We also demonstrate that Laphria uses such wing reflections as a proxy for the wingbeat frequency of the potential prey and that consecutively flashing LEDs to produce apparent motion elicits attacks when the LED flicker frequency matches that of the beetle's wingbeat cycle.

Regularities in vertical saccadic metrics: new insights, and future perspectives

Introduction

Asymmetries in processing by the healthy brain demonstrate regularities that facilitate the modeling of brain operations. The goal of the present study was to determine asymmetries in saccadic metrics during visual exploration, devoid of confounding clutter in the visual field.

Methods

Twenty healthy adults searched for a small, low-contrast gaze-contingent target on a blank computer screen. The target was visible, only if eye fixation was within a 5 deg. by 5 deg. area of the target's location.

Results

Replicating previously-reported asymmetries, repeated measures contrast analyses indicated that up-directed saccades were executed earlier, were smaller in amplitude, and had greater probability than down-directed saccades. Given that saccade velocities are confounded by saccade amplitudes, it was also useful to investigate saccade kinematics of visual exploration, as a function of vertical saccade direction. Saccade kinematics were modeled for each participant, as a square root relationship between average saccade velocity (i.e., average velocity between launching and landing of a saccade) and corresponding saccade amplitude (Velocity = S*[Saccade Amplitude]^0.5). A comparison of the vertical scaling parameter (S) for up- and down-directed saccades showed that up-directed saccades tended to be slower than down-directed ones.

Discussion

To motivate future research, an ecological theory of asymmetric pre-saccadic inhibition was presented to explain the collection of vertical saccadic regularities. For example, given that the theory proposes strong inhibition for the releasing of reflexive down-directed prosaccades (cued by an attracting peripheral target below eye fixation), and weak inhibition for the releasing of up-directed prosaccades (cued by an attracting peripheral target above eye fixation), a prediction for future studies is longer reaction times for vertical anti-saccade cues above eye fixation. Finally, the present study with healthy individuals demonstrates a rationale for further study of vertical saccades in psychiatric disorders, as bio-markers for brain pathology.

Distinguishing externally from saccade-induced motion in visual cortex

Distinguishing sensory stimuli caused by changes in the environment from those caused by an animal’s own actions is a hallmark of sensory processing¹. Saccades are rapid eye movements that shift the image on the retina. How visual systems differentiate motion of the image induced by saccades from actual motion in the environment is not fully understood². Here we discovered that in mouse primary visual cortex (V1) the two types of motion evoke distinct activity patterns. This is because, during saccades, V1 combines the visual input with a strong non-visual input arriving from the thalamic pulvinar nucleus. The non-visual input triggers responses that are specific to the direction of the saccade and the visual input triggers responses that are specific to the direction of the shift of the stimulus on the retina, yet the preferred directions of these two responses are uncorrelated. Thus, the pulvinar input ensures differential V1 responses to external and self-generated motion. Integration of external sensory information with information about body movement may be a general mechanism for sensory cortices to distinguish between self-generated and external stimuli.

Distinct activity patterns in the primary visual cortex distinguish movement in the environment from motion caused by eye movements.

Evolution of visual system specialization in predatory arthropods

Under strong selective pressure for survival, image-forming vision set off an ongoing predatory arms race 500 million years ago. Since then, and particularly so in the arthropods, predatory behavior has driven a myriad of eye adaptations that increase visual performance. In this review, we provide examples of how different arthropod predators have achieved improvements in key visual features such as spatial and temporal resolution of their retina. We then describe morphological, neural and behavioral strategies used by animals in this group to gather crucial information about the prey, such as its distance, velocity and size. We also highlight the importance of head and body tracking movements to aid in categorizing the potential prey, and briefly mention the ongoing work on the sensorimotor transformations necessary for target interception.

The neuroecology of the water-to-land transition and the evolution of the vertebrate brain

The water-to-land transition in vertebrate evolution offers an unusual opportunity to consider computational affordances of a new ecology for the brain. All sensory modalities are changed, particularly a greatly enlarged visual sensorium owing to air versus water as a medium, and expanded by mobile eyes and neck. The multiplication of limbs, as evolved to exploit aspects of life on land, is a comparable computational challenge. As the total mass of living organisms on land is a hundredfold larger than the mass underwater, computational improvements promise great rewards. In water, the midbrain tectum coordinates approach/avoid decisions, contextualized by water flow and by the animal's body state and learning. On land, the relative motions of sensory surfaces and effectors must be resolved, adding on computational architectures from the dorsal pallium, such as the parietal cortex. For the large-brained and long-living denizens of land, making the right decision when the wrong one means death may be the basis of planning, which allows animals to learn from hypothetical experience before enactment. Integration of value-weighted, memorized panoramas in basal ganglia/frontal cortex circuitry, with allocentric cognitive maps of the hippocampus and its associated cortices becomes a cognitive habit-to-plan transition as substantial as the change in ecology. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

Retinal optic flow during natural locomotion

We examine the structure of the visual motion projected on the retina during natural locomotion in real world environments. Bipedal gait generates a complex, rhythmic pattern of head translation and rotation in space, so without gaze stabilization mechanisms such as the vestibular-ocular-reflex (VOR) a walker's visually specified heading would vary dramatically throughout the gait cycle. The act of fixation on stable points in the environment nulls image motion at the fovea, resulting in stable patterns of outflow on the retinae centered on the point of fixation. These outflowing patterns retain a higher order structure that is informative about the stabilized trajectory of the eye through space. We measure this structure by applying the curl and divergence operations on the retinal flow velocity vector fields and found features that may be valuable for the control of locomotion. In particular, the sign and magnitude of foveal curl in retinal flow specifies the body's trajectory relative to the gaze point, while the point of maximum divergence in the retinal flow field specifies the walker's instantaneous overground velocity/momentum vector in retinotopic coordinates. Assuming that walkers can determine the body position relative to gaze direction, these time-varying retinotopic cues for the body's momentum could provide a visual control signal for locomotion over complex terrain. In contrast, the temporal variation of the eye-movement-free, head-centered flow fields is large enough to be problematic for use in steering towards a goal. Consideration of optic flow in the context of real-world locomotion therefore suggests a re-evaluation of the role of optic flow in the control of action during natural behavior.

Superior colliculus drives stimulus-evoked directionally biased saccades and attempted head movements in head-fixed mice

Animals investigate their environments by directing their gaze towards salient stimuli. In the prevailing view, mouse gaze shifts entail head rotations followed by brainstem-mediated eye movements, including saccades to reset the eyes. These 'recentering' saccades are attributed to head movement-related vestibular cues. However, microstimulating mouse superior colliculus (SC) elicits directed head and eye movements resembling SC-dependent sensory-guided gaze shifts in other species, suggesting that mouse gaze shifts may be more flexible than has been recognized. We investigated this possibility by tracking eye and attempted head movements in a head-fixed preparation that eliminates head movement-related sensory cues. We found tactile stimuli evoke directionally biased saccades coincident with attempted head rotations. Differences in saccade endpoints across stimuli are associated with distinct stimulus-dependent relationships between initial eye position and saccade direction and amplitude. Optogenetic perturbations revealed SC drives these gaze shifts. Thus, head-fixed mice make sensory-guided, SC-dependent gaze shifts involving coincident, directionally biased saccades and attempted head movements. Our findings uncover flexibility in mouse gaze shifts and provide a foundation for studying head-eye coupling.

Dynamics of gaze control during prey capture in freely moving mice

Many studies of visual processing are conducted in constrained conditions such as head- and gaze-fixation, and therefore less is known about how animals actively acquire visual information in natural contexts. To determine how mice target their gaze during natural behavior, we measured head and bilateral eye movements in mice performing prey capture, an ethological behavior that engages vision. We found that the majority of eye movements are compensatory for head movements, thereby serving to stabilize the visual scene. During movement, however, periods of stabilization are interspersed with non-compensatory saccades that abruptly shift gaze position. Notably, these saccades do not preferentially target the prey location. Rather, orienting movements are driven by the head, with the eyes following in coordination to sequentially stabilize and recenter the gaze. These findings relate eye movements in the mouse to other species, and provide a foundation for studying active vision during ethological behaviors in the mouse.

Dog eye movements are slower than human eye movements

Eye movement of a species reflects the visual behavior strategy that it has adapted to during its evolution. What are eye movements of domestic dogs (Canis lupus familiaris) like? Investigations of dog eye movements per se have not been done, despite the increasing number of visuo-cognitive studies in dogs using eye-tracking systems. To fill this gap, we have recorded dog eye movements using a video-based eye-tracking system, and compared the dog data to that of humans. We found dog saccades follow the systematic relationships between saccade metrics previously shown in humans and other animal species. Yet, the details of the relationships, and the quantities of each metric of dog saccades and fixations differed from those of humans. Overall, dog saccades were slower and fixations were longer than those of humans. We hope our findings contribute to existing comparative analyses of eye movement across animal species, and also to improvement of algorithms used for classifying eye movement data of dogs.

Eye Movements in Neuropsychological Tasks

This chapter reviews how recording and analysis of eye movements have been applied to understanding cognitive functioning in patients with neurological disease. Measures derived from the performance of instructed eye movement tests such as the anti-saccade and memory-guided saccade tasks have been shown to be associated with cognitive test performance and the early stages of neurodegenerative disorders including Alzheimer's and Parkinson's disease. Other researchers have taken an ecological approach and recorded the uninstructed pattern of saccades made by patients during performance of established neuropsychological tasks. Studies that have analysed the eye movement strategies used in a number of widely used tests are reviewed, including the Corsi blocks, Tower of London, 'CANTAB' Spatial Working Memory and Brixton Spatial Anticipation test. The findings illustrate that eye movements are not purely in the service of vision, but support visuospatial working memory and forward action planning. Eye movement tests and measures also have potential for application in the assessment and diagnosis of neurological disease and cognitive impairment. Establishing large-scale normative data sets in healthy older adults and use of machine learning multivariate classifier algorithms may be key to further developing eye tracking applications in neuropsychological assessment.