Improved visual sensitivity during smooth pursuit eye movements

Form Properties of Moving Targets Bias Smooth Pursuit Target Selection in Monkeys

During natural viewing, we often recognize multiple objects, detect their motion, and select one object as the target to track. It remains to be determined how such behavior is guided by the integration of visual form and motion perception. To address this, we studied how monkeys made a choice to track moving targets with different forms by smooth pursuit eye movements in a two-target task. We found that pursuit responses were biased toward the motion direction of a target with a hole. By computing the relative weighting, we found that the target with a hole exhibited a larger weight for vector computation. The global hole feature dominated other form properties. This dominance failed to account for changes in pursuit responses to a target with different forms moving singly. These findings suggest that the integration of visual form and motion perception can reshape the competition in sensorimotor networks to guide behavioral selection.

Spatial localization during open-loop smooth pursuit

Introduction

Numerous previous studies have shown that eye movements induce errors in the localization of briefly flashed stimuli. Remarkably, the error pattern is indicative of the underlying eye movement and the exact experimental condition. For smooth pursuit eye movements (SPEM) and the slow phase of the optokinetic nystagmus (OKN), perceived stimulus locations are shifted in the direction of the ongoing eye movement, with a hemifield asymmetry observed only during SPEM. During the slow phases of the optokinetic afternystagmus (OKAN), however, the error pattern can be described as a perceptual expansion of space. Different from SPEM and OKN, the OKAN is an open-loop eye movement.

Methods

Visually guided smooth pursuit can be transformed into an open-loop eye movement by briefly blanking the pursuit target (gap). Here, we examined flash localization during open-loop pursuit and asked, whether localization is also prone to errors and whether these are similar to those found during SPEM or during OKAN. Human subjects tracked a pursuit target. In half of the trials, the target was extinguished for 300 ms (gap) during the steady-state, inducing open-loop pursuit. Flashes were presented during this gap or during steady-state (closed-loop) pursuit.

Results

In both conditions, perceived flash locations were shifted in the direction of the eye movement. The overall error pattern was very similar with error size being slightly smaller in the gap condition. The differences between errors in the open- and closed-loop conditions were largest in the central visual field and smallest in the periphery.

Discussion

We discuss the findings in light of the neural substrates driving the different forms of eye movements.

Visual rehabilitation indicating neuroplasticity in an esotropic adult patient with diplopia after sudden visual acuity loss in the non-amblyopic eye: A case report

BACKGROUND

The aim of this case report is to present the successful management of both diplopia and amblyopia in a specific clinical situation, demonstrating neuroplasticity of the visual system in an adult patient. Causes of diplopia include eye pathologies in monocular diplopia and ischemic ocular motor nerve palsies, sudden life-threatening and chronic conditions in central nervous system in binocular diplopia. Strabismic amblyopia and nonarteritic anterior ischemic optic neuropathy are quite often ophthalmic conditions, first one is caused by suppression during developmental period and the latter one by ischemia of the optic nerve in adults. Coexistence of aforementioned conditions may cause unusual clinical situation in which ability of nervous system to functional reorganization could be demonstrated.

CASE PRESENTATION

In our adult patient, diplopia was incited by the loss of suppression of the strabismic amblyopic eye, which was the consequence of a sudden decrease of the visual acuity in the previously better eye in the course of nonarteritic anterior ischemic optic neuropathy. This led to impairment in daily activities.

RESULTS

Visual training rehabilitation improved distance and near visual acuity in the amblyopic eye over three months, and prescribing two pairs of glasses with prisms enabled the patient to return to daily activities.

CONCLUSION

The discussed patient lost the suppression of the strabismic amblyopic eye. Management of amblyopia is usually undertaken in children, however considering neuroplasticity we successfully attempted to improve visual functioning of our patient, despite lower intensity of neuroplasticity functions in an adult brain.

Common and independent processing of visual motion perception and oculomotor response

Visual motion signals are used not only to drive motion perception but also to elicit oculomotor responses. A fundamental question is whether perceptual and oculomotor processing of motion signals shares a common mechanism. This study aimed to address this question using visual motion priming, in which the perceived direction of a directionally ambiguous stimulus is biased in the same (positive priming) or opposite (negative priming) direction as that of a priming stimulus. The priming effect depends on the duration of the priming stimulus. It is assumed that positive and negative priming are mediated by high- and low-level motion systems, respectively. Participants were asked to judge the perceived direction of a π-phase-shifted test grating after a smoothly drifting priming grating during varied durations. Their eye movements were measured while the test grating was presented. The perception and eye movements were discrepant under positive priming and correlated under negative priming on a trial-by-trial basis when an interstimulus interval was inserted between the priming and test stimuli, indicating that the eye movements were evoked by the test stimulus per se. These findings suggest that perceptual and oculomotor responses are induced by a common mechanism at a low level of motion processing but by independent mechanisms at a high level of motion processing.

Model Based or Model Free? Comparing Adaptive Methods for Estimating Thresholds in Neuroscience

The quantification of human perception through the study of psychometric functions Ψ is one of the pillars of experimental psychophysics. In particular, the evaluation of the threshold is at the heart of many neuroscience and cognitive psychology studies, and a wide range of adaptive procedures has been developed to improve its estimation. However, these procedures are often implicitly based on different mathematical assumptions on the psychometric function, and unfortunately, these assumptions cannot always be validated prior to data collection. This raises questions about the accuracy of the estimator produced using the different procedures. In the study we examine in this letter, we compare five adaptive procedures commonly used in psychophysics to estimate the threshold: Dichotomous Optimistic Search (DOS), Staircase, PsiMethod, Gaussian Processes, and QuestPlus. These procedures range from model-based methods, such as the PsiMethod, which relies on strong assumptions regarding the shape of Ψ, to model-free methods, such as DOS, for which assumptions are minimal. The comparisons are performed using simulations of multiple experiments, with psychometric functions of various complexity. The results show that while model-based methods perform well when Ψ is an ideal psychometric function, model-free methods rapidly outshine them when Ψ deviates from this model, as, for instance, when Ψ is a beta cumulative distribution function. Our results highlight the importance of carefully choosing the most appropriate method depending on the context.

Micropursuit and the control of attention and eye movements in dynamic environments

It is more challenging to plan eye movements during perceptual tasks performed in dynamic displays than in static displays. Decisions about the timing of saccades become more critical, and decisions must also involve smooth eye movements, as well as saccades. The present study examined eye movements when judging which of two moving discs would arrive first, or collide, at a common meeting point. Perceptual discrimination after training was precise (Weber fractions < 6%). Strategies reflected a combined contribution of saccades and smooth eye movements. The preferred strategy was to look near the meeting point when strategies were freely chosen. When strategies were assigned, looking near the meeting point produced better performance than switching between the discs. Smooth eye movements were engaged in two ways: (a) low-velocity smooth eye movements correlated with the motion of each disc (micropursuit) were found while the line of sight remained between the discs; and (b) spontaneous smooth pursuit of the pair of discs occurred after the perceptual report, when the discs moved as a pair along a common path. The results show clear preferences and advantages for those eye movement strategies during dynamic perceptual tasks that require minimal management or effort. In addition, smooth eye movements, whose involvement during perceptual tasks within dynamic displays may have previously escaped notice, provide useful indictors of the strategies used to select information and distribute attention during the performance of dynamic perceptual tasks.

Selective postsaccadic enhancement of motion perception

Saccadic eye movements can drastically affect motion perception: during saccades, the stationary surround is swept rapidly across the retina and contrast sensitivity is suppressed. However, after saccades, contrast sensitivity is enhanced for color and high-spatial frequency stimuli and reflexive tracking movements known as ocular following responses (OFR) are enhanced in response to large field motion. Additionally, OFR and postsaccadic enhancement of neural activity in primate motion processing areas are well correlated. It is not yet known how this postsaccadic enhancement arises. Therefore, we tested if the enhancement can be explained by changes in the balance of centre-surround antagonism in motion processing, where spatial summation is favoured at low contrasts and surround suppression is favoured at high contrasts. We found motion perception was selectively enhanced immediately after saccades for high spatial frequency stimuli, consistent with previously reported selective postsaccadic enhancement of contrast sensitivity for flashed high spatial frequency stimuli. The observed enhancement was also associated with changes in spatial summation and suppression, as well as contrast facilitation and inhibition, suggesting that motion processing is augmented to maximise visual perception immediately after saccades. The results highlight that spatial and contrast properties of underlying neural mechanisms for motion processing can be affected by an antecedent saccade for highly detailed stimuli and are in line with studies that show behavioural and neuronal enhancement of motion processing in non-human primates.

Age effects on saccadic suppression of luminance and color

Saccadic eye movements modulate visual perception: they initiate and terminate high acuity vision at a certain location in space, but before and during their execution visual contrast sensitivity is strongly attenuated for 100 to 200 ms. Transient perisaccadic perceptual distortions are assumed to be an important mechanism to maintain visual stability. Little is known about age effects on saccadic suppression, even though for healthy adults other major age-related changes are well documented, like a decrease of visual contrast sensitivity for intermediate and high spatial frequencies or an increase of saccade latencies. Here, we tested saccadic suppression of luminance and isoluminant chromatic flashes in 100 participants from eight to 78 years. To estimate the effect of saccadic suppression on contrast sensitivity, we used a two-alternative forced choice (2AFC) design and an adaptive staircase procedure to modulate the luminance or chromatic contrast of a flashed detection target during fixation and 15 ms after saccade onset. The target was a single horizontal luminance or chromatic line flashed 2° above or below the fixation or saccade target. Compared to fixation, average perisaccadic contrast sensitivity decreased significantly by 66% for luminance and by 36% for color. A significant correlation was found for the strength of saccadic suppression of luminance and color. However, a small age effect was found only for the strength of saccadic suppression of luminance, which increased from 64% to 70% from young to old age. We conclude that saccadic suppression for luminance and color is present in most participants independent of their age and that mechanisms of suppression stay relatively stable during healthy aging.

Visual selective attention and the control of tracking eye movements: a critical review

People’s eyes are directed at objects of interest with the aim of acquiring visual information. However, processing this information is constrained in capacity, requiring task-driven and salience-driven attentional mechanisms to select few among the many available objects. A wealth of behavioral and neurophysiological evidence has demonstrated that visual selection and the motor selection of saccade targets rely on shared mechanisms. This coupling supports the premotor theory of visual attention put forth more than 30 years ago, postulating visual selection as a necessary stage in motor selection. In this review, we examine to which extent the coupling of visual and motor selection observed with saccades is replicated during ocular tracking. Ocular tracking combines catch-up saccades and smooth pursuit to foveate a moving object. We find evidence that ocular tracking requires visual selection of the speed and direction of the moving target, but the position of the motion signal may not coincide with the position of the pursuit target. Further, visual and motor selection can be spatially decoupled when pursuit is initiated (open-loop pursuit). We propose that a main function of coupled visual and motor selection is to serve the coordination of catch-up saccades and pursuit eye movements. A simple race-to-threshold model is proposed to explain the variable coupling of visual selection during pursuit, catch-up and regular saccades, while generating testable predictions. We discuss pending issues, such as disentangling visual selection from preattentive visual processing and response selection, and the pinpointing of visual selection mechanisms, which have begun to be addressed in the neurophysiological literature.

Oculomotor inhibition during smooth pursuit and its dependence on contrast sensitivity

Our eyes are never still, but tend to "freeze" in response to stimulus onset. This effect is termed "oculomotor inhibition" (OMI); its magnitude and time course depend on the stimulus parameters, attention, and expectation. We previously showed that the time course and duration of microsaccade and spontaneous eye-blink inhibition provide an involuntary measure of low-level visual properties such as contrast sensitivity during fixation. We investigated whether this stimulus-dependent inhibition also occurs during smooth pursuit, for both the catch-up saccades and the pursuit itself. Observers followed a target with continuous back-and-forth horizontal motion while a Gabor patch was briefly flashed centrally with varied spatial frequency and contrast. Catch-up saccades of the size of microsaccades had a similar pattern of inhibition as microsaccades during fixation, with stronger inhibition onset and faster inhibition release for more salient stimuli. Moreover, a similar stimulus dependency of inhibition was shown for pursuit latencies and peak velocity. Additionally, microsaccade latencies at inhibition release, peak pursuit velocities, and latencies at minimum pursuit velocity were correlated with contrast sensitivity. We demonstrated the generality of OMI to smooth pursuit for both microsaccades and the pursuit itself and its close relation to the low-level processes that define saliency, such as contrast sensitivity.

Detecting motion changes with peripheral vision: On the superiority of fixating over smooth-pursuit tracking

Detecting motion changes is a fundamental prerequisite for solving tasks in sports and in everyday life. It is known that peripheral vision is used to detect these changes and that saccades impair detection performance. However, comparatively little is known about the role of smooth-pursuit eye-movements (SPEMs) during these tasks. Therefore, we compared peripheral motion-change detection during SPEM and fixation at eccentricities up to 18°, simulating the perceptual demands of real-life situations. Based on expert gaze behavior in sports, we predicted that motion detection should be better during fixation than SPEM. In a series of three experiments, we consistently found that detection rates and response times were impaired during SPEM compared to fixation, particularly at 18° eccentricity. With an invisible pursuit object and targets moving ahead rather than behind the pursued object, performance differences in response times declined, whereas differences in detection rates interestingly remained unmoved. We argue that retinal image motion and attentional demands are reasons for SPEM impairments.

Two-Dimensional Analysis of Smooth Pursuit Eye Movements Reveals Quantitative Deficits in Precision and Accuracy

Purpose

Small moving targets are followed by pursuit eye movements, with success ubiquitously defined by gain. Gain quantifies accuracy, rather than precision, and only for eye movements along the target trajectory. Analogous to previous studies of fixation, we analyzed pursuit performance in two dimensions as a function of target direction, velocity, and amplitude. As a subsidiary experiment, we compared pursuit performance against that of fixation.

Methods

Eye position was recorded from 15 observers during pursuit. The target was a 0.4° dot that moved across a large screen at 8°/s or 16°/s, either horizontally or vertically, through peak-to-peak amplitudes of 8°, 16°, or 32°. Two-dimensional eye velocity was expressed relative to the target, and a bivariate probability density function computed to obtain accuracy and precision. As a comparison, identical metrics were derived from fixation data.

Results

For all target directions, eye velocity was less precise along the target trajectory. Eye velocities orthogonal to the target trajectory were more accurate during vertical pursuit than horizontal. Pursuit accuracy and precision along and orthogonal to the target trajectory decreased at the higher target velocity. Accuracy along the target trajectory decreased with smaller target amplitudes.

Conclusions

Orthogonal to the target trajectory, pursuit was inaccurate and imprecise. Compared to fixation, pursuit was less precise and less accurate even when following the stimulus that gave the best performance.

Translational Relevance

This analytical approach may help the detection of subtle deficits in slow phase eye movements that could be used as biomarkers for disease progression and/or treatment.

Neural sensitization improves encoding fidelity in the primate retina

An animal’s motion through the environment can induce large and frequent fluctuations in light intensity on the retina. These fluctuations pose a major challenge to neural circuits tasked with encoding visual information, as they can cause cells to adapt and lose sensitivity. Here, we report that sensitization, a short-term plasticity mechanism, solves this difficult computational problem by maintaining neuronal sensitivity in the face of these fluctuations. The numerically dominant output pathway in the macaque monkey retina, the midget (parvocellular-projecting) pathway, undergoes sensitization under specific conditions, including simulated eye movements. Sensitization is present in the excitatory synaptic inputs from midget bipolar cells and is mediated by presynaptic disinhibition from a wide-field mechanism extending >0.5 mm along the retinal surface. Direct physiological recordings and a computational model indicate that sensitization in the midget pathway supports accurate sensory encoding and prevents a loss of responsiveness during dynamic visual processing.

Light intensity on the retina can fluctuate rapidly during natural vision, posing a challenge for encoding visual information. Here, the authors report that mechanisms of sensitization/facilitation maintain the sensitivity of the numerically dominant neural pathway in the primate retina during dynamic vision.

Superior colliculus encodes visual saliency during smooth pursuit eye movements

The saliency map has played a long-standing role in models and theories of visual attention, and it is now supported by neurobiological evidence from several cortical and subcortical brain areas. While visual saliency is computed during moments of active fixation, it is not known whether the same is true while engaged in smooth pursuit of a moving stimulus, which is very common in real-world vision. Here, we examined extrafoveal saliency coding in the superior colliculus, a midbrain area associated with attention and gaze, during smooth pursuit eye movements. We found that SC neurons from the superficial visual layers showed a robust representation of peripheral saliency evoked by a conspicuous stimulus embedded in a wide-field array of goal-irrelevant stimuli. In contrast, visuomotor neurons from the intermediate saccade-related layers showed a poor saliency representation, even though most of these neurons were visually responsive during smooth pursuit. These results confirm and extend previous findings that place the SCs in a unique role as a saliency map that monitors peripheral vision during foveation of stationary and now moving objects.

Perceived speed of motion in depth modulates misjudgements of approaching trajectories consistently with a slow prior

Previous studies have shown that the angle of approach is consistently overestimated for approaching (but passing-by) objects. An explanation based on a slow-motion prior has been proposed in the past to account for this bias. The mechanism relies on the (less reliable) in-depth component of the motion being more attracted towards the slow motion prior than the (more reliable) lateral component. This hypothesis predicts that faster speeds in depth will translate into a greater bias if the perception of velocity in depth follows Weber's law. Our approach is different than the one used in previous studies where perceived speed and direction were measured in different experiments. To test our hypothesis, we conducted an experiment in which participants estimated approaching angles via a pointing device, while at the same time comparing the speed of the approaching object with a lateral velocity reference. This way, we couple perceived speed with perceived trajectory for each approaching angle in the same trial. Our results show that the directional bias is larger for faster objects, which is consistent with motion in depth following Weber's law. The differential biases can be accounted for by a Bayesian model that includes a slow motion prior.

Eye Position Error Influence over "Open-Loop" Smooth Pursuit Initiation

The oculomotor system integrates a variety of visual signals into appropriate motor plans, but such integration can have widely varying time scales. For example, smooth pursuit eye movements to follow a moving target are slower and longer lasting than saccadic eye movements and it has been suggested that initiating a smooth pursuit eye movement involves an obligatory "open-loop" interval in which new visual motion signals presumably cannot influence the ensuing motor plan for up to 100 ms after movement initiation. However, this view is contrary to the idea that the oculomotor periphery has privileged access to short-latency visual signals. Here, we show that smooth pursuit initiation is sensitive to visual inputs, even in open-loop intervals. We instructed male rhesus macaque monkeys to initiate saccade-free smooth pursuit eye movements and injected a transient, instantaneous eye position error signal at different times relative to movement initiation. We found robust short-latency modulations in eye velocity and acceleration, starting only ∼50 ms after transient signal occurrence and even during open-loop pursuit initiation. Critically, the spatial direction of the injected position error signal had predictable effects on smooth pursuit initiation, with forward errors increasing eye acceleration and backward errors reducing it. Catch-up saccade frequencies and amplitudes were also similarly altered ∼50 ms after transient signals, much like the well known effects on microsaccades during fixation. Our results demonstrate that smooth pursuit initiation is highly sensitive to visual signals and that catch-up saccade generation is reset after a visual transient.SIGNIFICANCE STATEMENT Smooth pursuit eye movements allow us to track moving objects. The first ∼100 ms of smooth pursuit initiation are characterized by smooth eye acceleration and are overwhelmingly described as being "open-loop"; that is, unmodifiable by new visual motion signals. We found that all phases of smooth pursuit, including the so-called open-loop intervals, are reliably modifiable by visual signals. We injected transient flashes resulting in very brief, spatially specific position error signals to smooth pursuit and observed very short-latency changes in smooth eye movements to minimize such errors. Our results highlight the flexibility of the oculomotor system in reacting to environmental events and suggest a functional role for the pervasiveness of visual sensitivity in oculomotor control brain regions.

Selective modulation of visual sensitivity during fixation

During periods of steady fixation, we make small-amplitude ocular movements, termed microsaccades, at a rate of 1–2 every second. Early studies provided evidence that visual sensitivity is reduced during microsaccades—akin to the well-established suppression associated with larger saccades. However, the results of more recent work suggest that microsaccades may alter retinal input in a manner that enhances visual sensitivity to some stimuli. Here we parametrically varied the spatial frequency of a stimulus during a detection task and tracked contrast sensitivity as a function of time relative to microsaccades. Our data reveal two distinct modulations of sensitivity: suppression during the eye movement itself and facilitation after the eye has stopped moving. The magnitude of suppression and facilitation of visual sensitivity is related to the spatial content of the stimulus: suppression is greatest for low spatial frequencies, while sensitivity is enhanced most for stimuli of 1–2 cycles/°, spatial frequencies at which we are already most sensitive in the absence of eye movements. We present a model in which the tuning of suppression and facilitation is explained by delayed lateral inhibition between spatial frequency channels. Our data show that eye movements actively modulate visual sensitivity even during fixation: the detectability of images at different spatial scales can be increased or decreased depending on when the image occurs relative to a microsaccade.

NEW & NOTEWORTHY Given the frequency with which we make microsaccades during periods of fixation, it is vital that we understand how they affect visual processing. We demonstrate two selective modulations of contrast sensitivity that are time-locked to the occurrence of a microsaccade: suppression of low spatial frequencies during each eye movement and enhancement of higher spatial frequencies after the eye has stopped moving. These complementary changes may arise naturally because of sluggish gain control between spatial channels.

Execution of saccadic eye movements affects speed perception

Due to the foveal organization of our visual system we have to constantly move our eyes to gain precise information about our environment. Doing so massively alters the retinal input. This is problematic for the perception of moving objects, because physical motion and retinal motion become decoupled and the brain has to discount the eye movements to recover the speed of moving objects. Two different types of eye movements, pursuit and saccades, are combined for tracking. We investigated how the way we track moving targets can affect the perceived target speed. We found that the execution of corrective saccades during pursuit initiation modifies how fast the target is perceived compared with pure pursuit. When participants executed a forward (catch-up) saccade they perceived the target to be moving faster. When they executed a backward saccade they perceived the target to be moving more slowly. Variations in pursuit velocity without corrective saccades did not affect perceptual judgments. We present a model for these effects, assuming that the eye velocity signal for small corrective saccades gets integrated with the retinal velocity signal during pursuit. In our model, the execution of corrective saccades modulates the integration of these two signals by giving less weight to the retinal information around the time of corrective saccades.

Central Brain Circuitry for Color-Vision-Modulated Behaviors

Color is famous for not existing in the external world: our brains create the perception of color from the spatial and temporal patterns of the wavelength and intensity of light. For an intangible quality, we have detailed knowledge of its origins and consequences. Much is known about the organization and evolution of the first phases of color processing, the filtering of light in the eye and processing in the retina, and about the final phases, the roles of color in behavior and natural selection. To understand how color processing in the central brain has evolved, we need well-defined pathways or circuitry where we can gauge how color contributes to the computations involved in specific behaviors. Examples of such pathways or circuitry that are dedicated to processing color cues are rare, despite the separation of color and luminance pathways early in the visual system of many species, and despite the traditional definition of color as being independent of luminance. This minireview presents examples in which color vision contributes to behaviors dominated by other visual modalities, examples that are not part of the canon of color vision circuitry. The pathways and circuitry process a range of chromatic properties of objects and their illumination, and are taken from a variety of species. By considering how color processing complements luminance processing, rather than being independent of it, we gain an additional way to account for the diversity of color coding in the central brain, its consequences for specific behaviors and ultimately the evolution of color vision.

Enhanced brain responses to color during smooth-pursuit eye movements

Eye movements alter visual perceptions in a number of ways. During smooth-pursuit eye movements, previous studies reported decreased detection threshold for colored stimuli and for high-spatial-frequency luminance stimuli, suggesting a boost in the parvocellular system. The present study investigated the underlying neural mechanism using EEG in human participants. Participants followed a moving target with smooth-pursuit eye movements while steady-state visually evoked potentials (SSVEPs) were elicited by equiluminant red-green flickering gratings in the background. SSVEP responses to colored gratings were 18.9% higher during smooth pursuit than during fixation. There was no enhancement of SSVEPs by smooth pursuit when the flickering grating was defined by luminance instead of color. This result provides physiological evidence that the chromatic response in the visual system is boosted by the execution of smooth-pursuit eye movements in humans. Because the response improvement is thought to be the result of an improved response in the parvocellular system, SSVEPs to equiluminant stimuli could provide a direct test of parvocellular signaling, especially in populations where collecting an explicit behavioral response from the participant is not feasible.NEW & NOTEWORTHY We constantly move our eyes when we explore the world. Eye movements alter visual perception in various ways. The smooth-pursuit eye movements have been shown to boost color sensitivity. We recorded steady-state visually evoked potentials to equiluminant chromatic flickering stimuli and observed increased steady-state visually evoked potentials when participants smoothly pursued a moving target compared with when they maintained fixation. This work provides direct neurophysiological evidence for the parvocellular boost by smooth-pursuit eye movements in humans.

The Interaction Between Vision and Eye Movements

The existence of a central fovea, the small retinal region with high analytical performance, is arguably the most prominent design feature of the primate visual system. This centralization comes along with the corresponding capability to move the eyes to reposition the fovea continuously. Past research on visual perception was mainly concerned with foveal vision while the observers kept their eyes stationary. Research on the role of eye movements in visual perception emphasized their negative aspects, for example, the active suppression of vision before and during the execution of saccades. But is the only benefit of our precise eye movement system to provide high acuity of the small foveal region, at the cost of retinal blur during their execution? In this review, I will compare human visual perception with and without saccadic and smooth pursuit eye movements to emphasize different aspects and functions of eye movements. I will show that the interaction between eye movements and visual perception is optimized for the active sampling of information across the visual field and for the calibration of different parts of the visual field. The movements of our eyes and visual information uptake are intricately intertwined. The two processes interact to enable an optimal perception of the world, one that we cannot fully grasp by doing experiments where observers are fixating a small spot on a display.

The Roles of Non-retinotopic Motions in Visual Search

In visual search, a moving target among stationary distracters is detected more rapidly and more efficiently than a static target among moving distracters. Here we examined how this search asymmetry depends on motion signals from three distinct coordinate systems—retinal, relative, and spatiotopic (head/body-centered). Our search display consisted of a target element, distracters elements, and a fixation point tracked by observers. Each element was composed of a spatial carrier grating windowed by a Gaussian envelope, and the motions of carriers, windows, and fixation were manipulated independently and used in various combinations to decouple the respective effects of motion coordinate systems on visual search asymmetry. We found that retinal motion hardly contributes to reaction times and search slopes but that relative and spatiotopic motions contribute to them substantially. Results highlight the important roles of non-retinotopic motions for guiding observer attention in visual search.

Pursuit tracks chase: exploring the role of eye movements in the detection of chasing

We explore the role of eye movements in a chase detection task. Unlike the previous studies, which focused on overall performance as indicated by response speed and chase detection accuracy, we decompose the search process into gaze events such as smooth eye movements and use a data-driven approach to separately describe these gaze events. We measured eye movements of four human subjects engaged in a chase detection task displayed on a computer screen. The subjects were asked to detect two chasing rings among twelve other randomly moving rings. Using principal component analysis and support vector machines, we looked at the template and classification images that describe various stages of the detection process. We showed that the subjects mostly search for pairs of rings that move one after another in the same direction with a distance of 3.5-3.8 degrees. To find such pairs, the subjects first looked for regions with a high ring density and then pursued the rings in this region. Most of these groups consisted of two rings. Three subjects preferred to pursue the pair as a single object, while the remaining subject pursued the group by alternating the gaze between the two individual rings. In the discussion, we argue that subjects do not compare the movement of the pursued pair to a singular preformed template that describes a chasing motion. Rather, subjects bring certain hypotheses about what motion may qualify as chase and then, through feedback, they learn to look for a motion pattern that maximizes their performance.

Individual differences in oscillatory brain activity in response to varying attentional demands during a word recall and oculomotor dual task

Every day, we face situations that involve multi-tasking. How our brain utilizes cortical resources during multi-tasking is one of many interesting research topics. In this study, we tested whether a dual-task can be differentiated in the neural and behavioral responses of healthy subjects with varying degree of working memory capacity (WMC). We combined word recall and oculomotor tasks because they incorporate common neural networks including the fronto-parietal (FP) network. Three different types of oculomotor tasks (eye fixation, Fix-EM; predictive and random smooth pursuit eye movement, P-SPEM and R-SPEM) were combined with two memory load levels (low-load: five words, high-load: 10 words) for a word recall task. Each of those dual-task combinations was supposed to create varying cognitive loads on the FP network. We hypothesize that each dual-task requires different cognitive strategies for allocating the brain's limited cortical resources and affects brain oscillation of the FP network. In addition, we hypothesized that groups with different WMC will show differential neural and behavioral responses. We measured oscillatory brain activity with simultaneous MEG and EEG recordings and behavioral performance by word recall. Prominent frontal midline (FM) theta (4-6 Hz) synchronization emerged in the EEG of the high-WMC group experiencing R-SPEM with high-load conditions during the early phase of the word maintenance period. Conversely, significant parietal upper alpha (10-12 Hz) desynchronization was observed in the EEG and MEG of the low-WMC group experiencing P-SPEM under high-load conditions during the same period. Different brain oscillatory patterns seem to depend on each individual's WMC and varying attentional demands from different dual-task combinations. These findings suggest that specific brain oscillations may reflect different strategies for allocating cortical resources during combined word recall and oculomotor dual-tasks.

Paradoxical Interaction between Ocular Activity, Perception, and Decision Confidence at the Threshold of Vision

In humans and some other species perceptual decision-making is complemented by the ability to make confidence judgements about the certainty of sensory evidence. While both forms of decision process have been studied empirically, the precise relationship between them remains poorly understood. We performed an experiment that combined a perceptual decision-making task (identifying the category of a faint visual stimulus) with a confidence-judgement task (wagering on the accuracy of each perceptual decision). The visual stimulation paradigm required steady fixation, so we used eye-tracking to control for stray eye movements. Our data analyses revealed an unexpected and counterintuitive interaction between the steadiness of fixation (prior to and during stimulation), perceptual decision making, and post-decision wagering: greater variability in gaze direction during fixation was associated with significantly increased visual-perceptual sensitivity, but significantly decreased reliability of confidence judgements. The latter effect could not be explained by a simple change in overall confidence (i.e. a criterion artifact), but rather was tied to a change in the degree to which high wagers predicted correct decisions (i.e. the sensitivity of the confidence judgement). We found no evidence of a differential change in pupil diameter that could account for the effect and thus our results are consistent with fixational eye movements being the relevant covariate. However, we note that small changes in pupil diameter can sometimes cause artefactual fluctuations in measured gaze direction and this possibility could not be fully ruled out. In either case, our results suggest that perceptual decisions and confidence judgements can be processed independently and point toward a new avenue of research into the relationship between them.

Motion perception correlates with volitional but not reflexive eye movements

Visually-driven actions and perception are traditionally ascribed to the dorsal and ventral visual streams of the cortical processing hierarchy. However, motion perception and the control of tracking eye movements both depend on sensory motion analysis by neurons in the dorsal stream, suggesting that the same sensory circuits may underlie both action and perception. Previous studies have suggested that multiple sensory modules may be responsible for the perception of low- and high-level motion, or the detection versus identification of motion direction. However, it remains unclear whether the sensory processing systems that contribute to direction perception and the control of eye movements have the same neuronal constraints. To address this, we examined inter-individual variability across 36 observers, using two tasks that simultaneously assessed the precision of eye movements and direction perception: in the smooth pursuit task, observers volitionally tracked a small moving target and reported its direction; in the ocular following task, observers reflexively tracked a large moving stimulus and reported its direction. We determined perceptual-oculomotor correlations across observers, defined as the correlation between each observer's mean perceptual precision and mean oculomotor precision. Across observers, we found that: (i) mean perceptual precision was correlated between the two tasks; (ii) mean oculomotor precision was correlated between the tasks, and (iii) oculomotor and perceptual precision were correlated for volitional smooth pursuit, but not reflexive ocular following. Collectively, these results demonstrate that sensory circuits with common neuronal constraints subserve motion perception and volitional, but not reflexive eye movements.

Perceptual learning modifies untrained pursuit eye movements

Perceptual learning improves detection and discrimination of relevant visual information in mature humans, revealing sensory plasticity. Whether visual perceptual learning affects motor responses is unknown. Here we implemented a protocol that enabled us to address this question. We tested a perceptual response (motion direction estimation, in which observers overestimate motion direction away from a reference) and a motor response (voluntary smooth pursuit eye movements). Perceptual training led to greater overestimation and, remarkably, it modified untrained smooth pursuit. In contrast, pursuit training did not affect overestimation in either pursuit or perception, even though observers in both training groups were exposed to the same stimuli for the same time period. A second experiment revealed that estimation training also improved discrimination, indicating that overestimation may optimize perceptual sensitivity. Hence, active perceptual training is necessary to alter perceptual responses, and an acquired change in perception suffices to modify pursuit, a motor response.

Attention driven foveated video quality assessment

Contrast sensitivity of the human visual system to visual stimuli can be significantly affected by several mechanisms, e.g., vision foveation and attention. Existing studies on foveation based video quality assessment only take into account static foveation mechanism. This paper first proposes an advanced foveal imaging model to generate the perceived representation of video by integrating visual attention into the foveation mechanism. For accurately simulating the dynamic foveation mechanism, a novel approach to predict video fixations is proposed by mimicking the essential functionality of eye movement. Consequently, an advanced contrast sensitivity function, derived from the attention driven foveation mechanism, is modeled and then integrated into a wavelet-based distortion visibility measure to build a full reference attention driven foveated video quality (AFViQ) metric. AFViQ exploits adequately perceptual visual mechanisms in video quality assessment. Extensive evaluation results with respect to several publicly available eye-tracking and video quality databases demonstrate promising performance of the proposed video attention model, fixation prediction approach, and quality metric.

Motion deblurring during pursuit tracking improves spatial-interval acuity

The extent of perceived blur produced by a moving retinal image is less when the image motion occurs during pursuit eye movements compared to fixation. This study examined the effect of this reduced perception of motion blur during pursuit on spatial-interval acuity. Observers judged during pursuit at 4 or 8 deg/s whether the horizontal separation between two stationary lines was larger or smaller than a standard. Three different line separations were tested for each pursuit velocity. Each observer performed these judgments also during fixation, for spatial-interval stimuli that moved with the same mean and standard deviation of speeds as the distribution of eye velocities during pursuit. Spatial-interval acuity was better during pursuit than fixation for small or intermediate line separations. The results indicate that a reduction of perceived motion blur during pursuit eye movements can lead to improved visual performance.

Peri-saccadic natural vision

The fundamental role of the visual system is to guide behavior in natural environments. To optimize information transmission, many animals have evolved a non-homogeneous retina and serially sample visual scenes by saccadic eye movements. Such eye movements, however, introduce high-speed retinal motion and decouple external and internal reference frames. Until now, these processes have only been studied with unnatural stimuli, eye movement behavior, and tasks. These experiments confound retinotopic and geotopic coordinate systems and may probe a non-representative functional range. Here we develop a real-time, gaze-contingent display with precise spatiotemporal control over high-definition natural movies. In an active condition, human observers freely watched nature documentaries and indicated the location of periodic narrow-band contrast increments relative to their gaze position. In a passive condition under central fixation, the same retinal input was replayed to each observer by updating the video's screen position. Comparison of visual sensitivity between conditions revealed three mechanisms that the visual system has adapted to compensate for peri-saccadic vision changes. Under natural conditions we show that reduced visual sensitivity during eye movements can be explained simply by the high retinal speed during a saccade without recourse to an extra-retinal mechanism of active suppression; we give evidence for enhanced sensitivity immediately after an eye movement indicative of visual receptive fields remapping in anticipation of forthcoming spatial structure; and we demonstrate that perceptual decisions can be made in world rather than retinal coordinates.

Cortical oscillatory changes in human middle temporal cortex underlying smooth pursuit eye movements

Extra-striate regions are thought to receive non-retinal signals from the pursuit system to maintain perceptual stability during eye movements. Here, we used magnetoencephalography (MEG) to study changes in oscillatory power related to smooth pursuit in extra-striate visual areas under three conditions: 'pursuit' of a small target, 'retinal motion' of a large background and 'pursuit + retinal motion' combined. All stimuli moved sinusoidally. MEG source reconstruction was performed using synthetic aperture magnetometry. Broadband alpha-beta suppression (5-25 Hz) was observed over bilateral extra-striate cortex (consistent with middle temporal cortex (MT+)) during all conditions. A functional magnetic resonance imaging study using the same experimental protocols confirmed an MT+ localisation of this extra-striate response. The alpha-beta envelope power in the 'pursuit' condition showed a hemifield-dependent eye-position signal, such that the global minimum in the alpha-beta suppression recorded in extra-striate cortex was greatest when the eyes were at maximum contralateral eccentricity. The 'retinal motion' condition produced sustained alpha-beta power decreases for the duration of stimulus motion, while the 'pursuit + retinal motion' condition revealed a double-dip 'W' shaped alpha-beta envelope profile with the peak suppression contiguous with eye position when at opposing maximum eccentricity. These results suggest that MT+ receives retinal as well as extra-retinal signals from the pursuit system as part of the process that enables the visual system to compensate for retinal motion during eye movement. We speculate that the suppression of the alpha-beta rhythm reflects either the integration of an eye position-dependent signal or one that lags the peak velocity of the sinusoidally moving target.

Active control of acoustic field-of-view in a biosonar system

Active-sensing systems abound in nature, but little is known about systematic strategies that are used by these systems to scan the environment. Here, we addressed this question by studying echolocating bats, animals that have the ability to point their biosonar beam to a confined region of space. We trained Egyptian fruit bats to land on a target, under conditions of varying levels of environmental complexity, and measured their echolocation and flight behavior. The bats modulated the intensity of their biosonar emissions, and the spatial region they sampled, in a task-dependant manner. We report here that Egyptian fruit bats selectively change the emission intensity and the angle between the beam axes of sequentially emitted clicks, according to the distance to the target, and depending on the level of environmental complexity. In so doing, they effectively adjusted the spatial sector sampled by a pair of clicks-the "field-of-view." We suggest that the exact point within the beam that is directed towards an object (e.g., the beam's peak, maximal slope, etc.) is influenced by three competing task demands: detection, localization, and angular scanning-where the third factor is modulated by field-of-view. Our results suggest that lingual echolocation (based on tongue clicks) is in fact much more sophisticated than previously believed. They also reveal a new parameter under active control in animal sonar-the angle between consecutive beams. Our findings suggest that acoustic scanning of space by mammals is highly flexible and modulated much more selectively than previously recognized.

Influence of motion smear on visual acuity in simulated infantile nystagmus

PURPOSE

In persons with infantile nystagmus (IN), visual acuity correlates with the duration of the foveation period of the nystagmus waveform, i.e., when the retinal image is on or near the fovea and moves with low velocity. In this study, we asked how acuity is affected by the non-foveating phases of the nystagmus waveform, when the velocity of retinal image motion is substantially higher.

METHODS

Visual acuity was measured in three normal observers for high contrast, four-orientation single T-stimuli, presented during image motion that simulated either the whole jerk-IN waveform (whole-waveform) or only the foveation periods of the IN waveform (foveation-only). Simulated foveation durations ranged from 20 to 120 ms. For both motion waveforms, we displayed the acuity target for different number of cycles to examine whether acuity benefits from multiple presentations of the stimulus.

RESULTS

As expected, visual acuity improves with longer simulated foveation durations in both the whole-waveform and foveation-only conditions. Acuity is consistently better (by ∼0.1 logarithm of the minimum angle of resolution) in the foveation-only than the whole-waveform condition, indicating that the high-velocity image motion during the simulated IN waveform has a detrimental effect. This difference in acuity between the two waveform conditions increases with the number of cycles, apparently because summation occurs across cycles in the foveation-only condition but not in the whole-waveform condition.

CONCLUSIONS

In normal observers, visual acuity in the presence of a simulated nystagmus waveform is limited not only by the duration of the foveation periods, but also by the non-foveating phases of the waveform. However, because persons with IN report little or no motion smear in association with their nystagmus, it remains unclear whether the rapid retinal image motion during the non-foveating phases of the nystagmus waveform generates a similar degradation of visual acuity in IN.

The perception of motion smear during eye and head movements

Because the visual system integrates information across time, an image that moves on the retina would be expected to be perceived as smeared. In this article, we summarize the previous evidence that human observers perceive a smaller extent of smear when retinal image motion results from an eye or head movement, compared to when a physically moving target generates comparable image motion while the eyes and head are still. This evidence indicates that the reduction of perceived motion smear is asymmetrical, occurring only for targets that move against the direction of an eye or head movement. In addition, we present new data to show that no reduction of perceived motion smear occurs for targets that move in either direction during a visually-induced perception of self motion. We propose that low-level extra-retinal eye- and head-movement signals are responsible for the reduction of perceived motion smear, by decreasing the duration of the temporal impulse response. Although retinal as well as extra-retinal mechanisms can reduce the extent of perceived motion smear, available evidence suggests that improved visual functioning may occur only when an extra-retinal mechanism reduces the perception of smear.

Does the noise matter? Effects of different kinematogram types on smooth pursuit eye movements and perception

We investigated how the human visual system and the pursuit system react to visual motion noise. We presented three different types of random-dot kinematograms at five different coherence levels. For transparent motion, the signal and noise labels on each dot were preserved throughout each trial, and noise dots moved with the same speed as the signal dots but in fixed random directions. For white noise motion, every 20 ms the signal and noise labels were randomly assigned to each dot and noise dots appeared at random positions. For Brownian motion, signal and noise labels were also randomly assigned, but the noise dots moved at the signal speed in a direction that varied randomly from moment to moment. Neither pursuit latency nor early eye acceleration differed among the different types of kinematograms. Late acceleration, pursuit gain, and perceived speed all depended on kinematogram type, with good agreement between pursuit gain and perceived speed. For transparent motion, pursuit gain and perceived speed were independent of coherence level. For white and Brownian motions, pursuit gain and perceived speed increased with coherence but were higher for white than for Brownian motion. This suggests that under our conditions, the pursuit system integrates across all directions of motion but not across all speeds.

Spatial perception during pursuit initiation

Spatial perception is modulated by eye movements. During smooth pursuit, perceived locations are shifted in the direction of the eye movement. During active fixation, visual space is perceptually compressed towards the fovea. In our present study, we were interested to determine the time course of spatial localization during pursuit initiation, i.e. the transition period from fixation to steady-state pursuit. Human observers had to localize briefly flashed targets around the time of pursuit initiation. Our data clearly show that pursuit-like mislocalization starts well before the onset of the eye movement. Our results point towards corollary-discharge as neural source for the observed perceptual effect.

Compression of time during smooth pursuit eye movements

Humans have a clear sense for the passage of time, but while implicit motor timing is quite accurate, explicit timing is prone to distortions particularly during action (Wenke & Haggard, 2009) and saccadic eye movements (Morrone, Ross, & Burr, 2005). Here, we investigated whether perceived duration is also affected by the execution of smooth pursuit eye movements, showing a compression of apparent duration similar to that observed during saccades. To this end, we presented two brief bars that marked intervals between 100 and 300 ms and asked subjects to judge their duration during fixation and pursuit. We found a compression of perceived duration for bars modulated in luminance contrast of about 32% and for bars modulated in chromatic contrast of 14% during pursuit compared to fixation. Interestingly, Weber ratios were similar for fixation and pursuit, if they are expressed as ratio between JND and perceived duration. This compression was constant for pursuit speeds from 7 to 14 deg/s and did not occur for intervals marked by auditory events. These results argue for a modality-specific component in the processing of temporal information.

Smooth pursuit eye movements improve temporal resolution for color perception

Human observers see a single mixed color (yellow) when different colors (red and green) rapidly alternate. Accumulating evidence suggests that the critical temporal frequency beyond which chromatic fusion occurs does not simply reflect the temporal limit of peripheral encoding. However, it remains poorly understood how the central processing controls the fusion frequency. Here we show that the fusion frequency can be elevated by extra-retinal signals during smooth pursuit. This eye movement can keep the image of a moving target in the fovea, but it also introduces a backward retinal sweep of the stationary background pattern. We found that the fusion frequency was higher when retinal color changes were generated by pursuit-induced background motions than when the same retinal color changes were generated by object motions during eye fixation. This temporal improvement cannot be ascribed to a general increase in contrast gain of specific neural mechanisms during pursuit, since the improvement was not observed with a pattern flickering without changing position on the retina or with a pattern moving in the direction opposite to the background motion during pursuit. Our findings indicate that chromatic fusion is controlled by a cortical mechanism that suppresses motion blur. A plausible mechanism is that eye-movement signals change spatiotemporal trajectories along which color signals are integrated so as to reduce chromatic integration at the same locations (i.e., along stationary trajectories) on the retina that normally causes retinal blur during fixation.

The temporal impulse response function during smooth pursuit

Recent studies indicate that the extent of perceived motion smear is attenuated asymmetrically during smooth pursuit eye movements, based on the relative directions of the target and eye motion. We conducted two experiments to determine if the reduction of perceived smear during pursuit might be associated with an acceleration of the temporal impulse response function (TIRF). In Experiment 1, two-pulse increment sensitivity was determined during fixation and rightward pursuit for sequential flashes of a long horizontal line, presented with stimulus-onset asynchronies between 5.9 and 234 ms. In Experiment 2, temporal contrast sensitivity was measured during fixation and rightward pursuit for a vertical 1 cpd grating with retinal image velocities between 4 and 30 Hz. During pursuit, grating motion was either in the same or the opposite direction as the eye movement. TIRFs were modeled as the impulse responses of a second-order, low-pass linear system, fit to the two-pulse increment sensitivity data by an optimization procedure and to the temporal contrast sensitivity results by iterative Fourier synthesis. The results indicate that the natural temporal frequency of the fitted TIRFs was approximately 10% higher during pursuit than fixation. In Experiment 2, the increased natural frequency of the TIRF was restricted to the condition in which the grating moved spatially in the opposite direction of the pursuit eye movement. The results are consistent with the hypothesis that extra-retinal signals reduce the extent of perceived motion smear during pursuit, in part by increasing the speed of visual processing preferentially for one direction of image motion.

Precision and accuracy of ocular following: influence of age and type of eye movement

Previous work on ocular-following emphasises the accuracy of tracking eye movements. However, a more complete understanding of oculomotor control should account for variable error as well. We identify two forms of precision: 'shake', occurring over shorter timescales; 'drift', occurring over longer timescales. We show how these can be computed across a series of eye movements (e.g. a sequence of slow-phases or collection of pursuit trials) and then measure accuracy and precision for younger and older observers executing different types of eye movement. Overall, we found older observers were less accurate over a range of stimulus speeds and less precise at faster eye speeds. Accuracy declined more steeply for reflexive eye movements and shake was independent of speed. In all other instances, the two measures of precision expanded non-linearly with mean eye speed. We also found that shake during fixation was similar to shake for reflexive eye movement. The results suggest that deliberate and reflexive eye movement do not share a common non-linearity or a common noise source. The relationship of our data to previous studies is discussed, as are the consequences of imprecise eye movement for models of oculomotor control and perception during eye movement.

Segregation of short-wavelength-sensitive (S) cone signals in the macaque dorsal lateral geniculate nucleus

An important problem in the study of the mammalian visual system is whether functionally different retinal ganglion cell types are anatomically segregated further up along the central visual pathway. It was previously demonstrated that, in a New World diurnal monkey (marmoset), the neurones carrying signals from the short-wavelength-sensitive (S) cones [blue-yellow (B/Y)-opponent cells] are predominantly located in the koniocellular layers of the dorsal lateral geniculate nucleus (LGN), whereas the red-green (R/G)-opponent cells carrying signals from the medium- and long-wavelength-sensitive cones are segregated in the parvocellular layers. Here, we used extracellular single-unit recordings followed by histological reconstruction to investigate the distribution of color-selective cells in the LGN of the macaque, an Old World diurnal monkey. Cells were classified using cone-isolating stimuli to identify their cone inputs. Our results indicate that the majority of cells carrying signals from S-cones are located either in the koniocellular layers or in the 'koniocellular bridges' that fully or partially span the parvocellular layers. By contrast, the R/G-opponent cells are located in the parvocellular layers. We conclude that anatomical segregation of B/Y- and R/G-opponent afferent signals for color vision is common to the LGNs of New World and Old World diurnal monkeys.

Improved visual sensitivity during smooth pursuit eye movements: Temporal and spatial characteristics

Recently, we showed that contrast sensitivity for color and high–spatial frequency luminance stimuli is enhanced during smooth pursuit eye movements (Schütz et al., 2008). In this study, we investigated the enhancement over a wide range of temporal and spatial frequencies. In Experiment 1, we measured the temporal impulse response function (TIRF) for colored stimuli. The TIRF for pursuit and fixation differed mostly with respect to the gain but not with respect to the natural temporal frequency. Hence, the sensitivity enhancement seems to be rather independent of the temporal frequency of the stimuli. In Experiment 2, we measured the spatial contrast sensitivity function for luminance-defined Gabor patches with spatial frequencies ranging from 0.2 to 7 cpd. We found a sensitivity improvement during pursuit for spatial frequencies above 2–3 cpd. Between 0.5 and 3 cpd, sensitivity was impaired by smooth pursuit eye movements, but no consistent difference was observed below 0.5 cpd. The results of both experiments are consistent with an increased contrast gain of the parvocellular retinogeniculate pathway.

S-cone signals invisible to the motion system can improve motion extraction via grouping by color

The purpose of this study was to test whether color–motion correlations carried by a pure color difference (S-cone component only) can be used to improve global motion extraction. We also examined the neural markers of color–motion correlation processing in event-related potentials. Color and motion information was dissociated using a two-colored random dot kinematogram, wherein coherent motion and motion noise differed from each other only in their S-cone component, with spatial and temporal parameters set so that global motion processing relied solely on a constant L-M component. Hence, when color and the local motion direction are correlated, more efficient segregation of coherent motion can only be brought about by the S-cone difference, and crucially, this S-cone component does not provide any effective input to a global motion mechanism but only changes the color appearance of the moving dots. The color contrasts (vector length in the S vs. L-M plane) of both the dots carrying coherent motion and the dots moving randomly were fixed at motion discrimination threshold to ensure equal effectiveness for motion extraction. In the behavioral experiment, participants were asked to discriminate between coherent and random motion, and d′ was determined for three different conditions: uncorrelated, uncued correlated, and cued correlated. In the electroencephalographic experiment, participants discriminated direction of motion for uncued correlated and cued correlated conditions. Color–motion correlations were found to improve performance. Cueing a specific color also modulated the N1 component of the event-related potential, with sources in visual area middle temporal. We conclude that S-cone signals “invisible” to the motion system can influence the analysis by direction-selective motion mechanisms through grouping of local motion signals by color. This grouping mechanism must precede motion processing and is likely to be under attentional control.

Asymmetrical perception of motion smear in infantile nystagmus

Normal observers perceive less motion smear if a target moves in the opposite direction of a smooth eye movement than if the target moves to produce the same retinal image speed in the same direction as the eye movement. This study investigated whether a similar asymmetrical attenuation of perceived motion smear occurs in observers with infantile nystagmus (IN). Observers (N=3) viewed a laser spot that moved for 100 or 125ms to the right or left at a speed between 5 and 60 degrees /s during the slow phase of jerk IN. After each trial, the observer adjusted the length of a bright line to match the extent of the perceived smear. Across observers, the average duration of perceived smear was 39 and 106ms, respectively, for relative motion of the laser spot in the opposite vs. the same direction as the IN slow phase. In one observer with periodic alternating nystagmus, the direction of spot motion that produced less perceived smear reversed with an alternation in the direction of the IN slow phase. The reduction of perceived motion smear for relative target motion in the opposite direction of IN slow phases is attributed to extra-retinal signals that accompany IN. As during normal eye movements, the reduction of perceived smear for this direction of relative motion should foster the perception of clarity in the stationary visual world.