Pupil size dynamics during fixation impact the accuracy and precision of video-based gaze estimation

Microsaccades Tracking by Secondary Speckle Pattern Analysis

Here we propose a not pupil-dependent microsaccades tracking technique and a novel detection method. We present a proof of concept for detecting microsaccades using a non-contact laser-based photonic system recording and processing the temporal changes of speckle patterns scattered from an eye sclera. The data, simultaneously recorded by the speckle-based tracker (SBT) and the video-based eye tracker (Eyelink), was analyzed by the frequently used detection method of Engbert and Kliegl (E&K) and by advanced machine learning detection (MLD) techniques. We detected 93% of microsaccades in the SBT data out of microsaccades detected in the Eyelink data with the E&K method. By utilizing MLD, a precision of 86% was achieved. The findings of our study demonstrate a potential improvement in measuring tiny eye movements, such as microsaccades, using speckle-based eye tracking and, thus, an alternative to video-based eye tracking for detecting microsaccades.

Wearable Near-Eye Tracking Technologies for Health: A Review

With the rapid advancement of computer vision, machine learning, and consumer electronics, eye tracking has emerged as a topic of increasing interest in recent years. It plays a key role across diverse domains including human-computer interaction, virtual reality, and clinical and healthcare applications. Near-eye tracking (NET) has recently been developed to possess encouraging features such as wearability, affordability, and interactivity. These features have drawn considerable attention in the health domain, as NET provides accessible solutions for long-term and continuous health monitoring and a comfortable and interactive user interface. Herein, this work offers an inaugural concise review of NET for health, encompassing approximately 70 related articles published over the past two decades and supplemented by an in-depth examination of 30 literatures from the preceding five years. This paper provides a concise analysis of health-related NET technologies from aspects of technical specifications, data processing workflows, and the practical advantages and limitations. In addition, the specific applications of NET are introduced and compared, revealing that NET is fairly influencing our lives and providing significant convenience in daily routines. Lastly, we summarize the current outcomes of NET and highlight the limitations.

(The limits of) eye-tracking with iPads

Applications for eye-tracking-particularly in the clinic-are limited by a reliance on dedicated hardware. Here we compare eye-tracking implemented on an Apple iPad Pro 11" (third generation)-using the device's infrared head-tracking and front-facing camera-with a Tobii 4c infrared eye-tracker. We estimated gaze location using both systems while 28 observers performed a variety of tasks. For estimating fixation, gaze position estimates from the iPad were less accurate and precise than the Tobii (mean absolute error of 3.2° ± 2.0° compared with 0.75° ± 0.43°), but fixation stability estimates were correlated across devices (r = 0.44, p < 0.05). For tasks eliciting saccades >1.5°, estimated saccade counts (r = 0.4-0.73, all p < 0.05) were moderately correlated across devices. For tasks eliciting saccades >8° we observed moderate correlations in estimated saccade speed and amplitude (r = 0.4-0.53, all p < 0.05). We did, however, note considerable variation in the vertical component of estimated smooth pursuit speed from the iPad and a catastrophic failure of tracking on the iPad in 5% to 20% of observers (depending on the test). Our findings sound a note of caution to researchers seeking to use iPads for eye-tracking and emphasize the need to properly examine their eye-tracking data to remove artifacts and outliers.

Visual Feature Tuning Properties of Short-Latency Stimulus-Driven Ocular Position Drift Responses during Gaze Fixation

Ocular position drifts during gaze fixation are significantly less well understood than microsaccades. We recently identified a short-latency ocular position drift response, of ∼1 min arc amplitude, that is triggered within <100 ms by visual onsets. This systematic eye movement response is feature-tuned and seems to be coordinated with a simultaneous resetting of the saccadic system by visual stimuli. However, much remains to be learned about the drift response, especially for designing better-informed neurophysiological experiments unraveling its mechanistic substrates. Here we systematically tested multiple new feature tuning properties of drift responses. Using highly precise eye tracking in three male rhesus macaque monkeys, we found that drift responses still occur for tiny foveal visual stimuli. Moreover, the responses exhibit size tuning, scaling their amplitude (both up and down) as a function of stimulus size, and they also possess a monotonically increasing contrast sensitivity curve. Importantly, short-latency drift responses still occur for small peripheral visual targets, which additionally introduce spatially directed modulations in drift trajectories toward the appearing peripheral stimuli. Drift responses also remain predominantly upward even for stimuli exclusively located in the lower visual field and even when starting gaze position is upward. When we checked the timing of drift responses, we found it was better synchronized to stimulus-induced saccadic inhibition than to stimulus onset. These results, along with a suppression of drift response amplitudes by peristimulus saccades, suggest that drift responses reflect the rapid impacts of short-latency and feature-tuned visual neural activity on final oculomotor control circuitry in the brain.

Boundary updating as a source of history effect on decision uncertainty

When sorting a sequence of stimuli into binary classes, current choices are often negatively correlated with recent stimulus history. This phenomenon-dubbed the repulsive bias-can be explained by boundary updating, a process of shifting the class boundary to previous stimuli. This explanation implies that recent stimulus history can also influence "decision uncertainty," the probability of making incorrect decisions, because it depends on the location of the boundary. However, there have been no previous efforts to elucidate the impact of previous stimulus history on decision uncertainty. Here, from the boundary-updating process that accounts for the repulsive bias, we derived a prediction that decision uncertainty increases as current choices become more congruent with previous stimuli. We confirmed this prediction in behavioral, physiological, and neural correlates of decision uncertainty. Our work demonstrates that boundary updating offers a principled account of how previous stimulus history concurrently relates to choice bias and decision uncertainty.

An eye for detail: Eye movements and attention at the foveal scale

Human vision relies on a tiny region of the retina, the 1-deg foveola, to achieve high spatial resolution. Foveal vision is of paramount importance in daily activities, yet its study is challenging, as eye movements incessantly displace stimuli across this region. Here I will review work that, building on recent advances in eye-tracking and gaze-contingent display, examines how attention and eye movements operate at the foveal level. This research highlights how exploration of fine spatial detail unfolds following visuomotor strategies reminiscent of those occurring at larger scales. It shows that, together with highly precise control of attention, this motor activity is linked to non-homogenous processing within the foveola and selectively modulates sensitivity both in space and time. Overall, the picture emerges of a highly dynamic foveal perception in which fine spatial vision, rather than simply being the result of placing a stimulus at the center of gaze, is the result of a finely tuned and orchestrated synergy of motor, cognitive, and attentional processes.

How to improve data quality in dog eye tracking

Pupil-corneal reflection (P-CR) eye tracking has gained a prominent role in studying dog visual cognition, despite methodological challenges that often lead to lower-quality data than when recording from humans. In the current study, we investigated if and how the morphology of dogs might interfere with tracking of P-CR systems, and to what extent such interference, possibly in combination with dog-unique eye-movement characteristics, may undermine data quality and affect eye-movement classification when processed through algorithms. For this aim, we have conducted an eye-tracking experiment with dogs and humans, and investigated incidences of tracking interference, compared how they blinked, and examined how differential quality of dog and human data affected the detection and classification of eye-movement events. Our results show that the morphology of dogs' face and eye can interfere with tracking methods of the systems, and dogs blink less often but their blinks are longer. Importantly, the lower quality of dog data lead to larger differences in how two different event detection algorithms classified fixations, indicating that the results of key dependent variables are more susceptible to choice of algorithm in dog than human data. Further, two measures of the Nyström & Holmqvist (Behavior Research Methods, 42(4), 188-204, 2010) algorithm showed that dog fixations are less stable and dog data have more trials with extreme levels of noise. Our findings call for analyses better adjusted to the characteristics of dog eye-tracking data, and our recommendations help future dog eye-tracking studies acquire quality data to enable robust comparisons of visual cognition between dogs and humans.

Patterns of small involuntary fixation saccades (SIFSs) in different neurodegenerative diseases: the role of noise

During the attempt to steadily fixate at a single spot, sequences of small involuntary fixation saccades (SIFSs, known also as microsaccades οr intrusions) occur which form spatio-temporal patterns such as square wave jerks (SWJs), a pattern characterised by alternating centrifugal and centripetal movements of similar magnitude. In many neurodegenerative disorders, SIFSs exhibit elevated amplitudes and frequencies. Elevated SIFS amplitudes have been shown to favour the occurrence of SWJs ("SWJ coupling"). We analysed SIFSs in different subject groups comprising both healthy controls (CTR) and patients with amyotrophic lateral sclerosis (ALS) and progressive supranuclear palsy (PSP), i.e. two neurodegenerative diseases with completely different neuropathological basis and different clinical phenotypes. We show that, across these groups, the relations between SIFS amplitude and the relative frequency of SWJ-like patterns and other SIFS characteristics follow a common law. As an explanation, we propose that physiological and technical noise comprises a small, amplitude-independent component that has little effect on large SIFSs, but causes considerable deviations from the intended amplitude and direction of small ones. Therefore, in contrast to large SIFSs, successive small SIFSs have a lower chance to meet the SWJ similarity criteria. In principle, every measurement of SIFSs is affected by an amplitude-independent noise background. Therefore, the dependence of SWJ coupling on SIFS amplitude will probably be encountered in almost any group of subjects. In addition, we find a positive correlation between SIFS amplitude and frequency in ALS, but none in PSP, suggesting that the elevated amplitudes might arise at different sites in the two disorders.

Quotidian Profile of Vergence Angle in Ambulatory Subjects Monitored With Wearable Eye Tracking Glasses

Purpose

Wearable eye trackers record gaze position as ambulatory subjects navigate their environment. Tobii Pro Glasses 3 were tested to assess their accuracy and precision in the measurement of vergence angle.

Methods

Four subjects wore the eye tracking glasses, with their head stabilized, while fixating at a series of distances corresponding to vergence demands of: 0.25, 0.50, 1, 2, 4, 8, 16, and 32°. After these laboratory trials were completed, 10 subjects wore the glasses for a prolonged period while carrying out their customary daily pursuits. A vergence profile was compiled for each subject and compared with interpupillary distance.

Results

In the laboratory, the eye tracking glasses were comparable in accuracy to remote video eye trackers, outputting a mean vergence value within 1° of demand at all angles except 32°. In ambulatory subjects, the glasses were less accurate, due to tracking interruptions and measurement errors, partly mitigated by the application of data filters. Nonetheless, a useful record of vergence behavior was obtained in every subject. Vergence profiles often had a bimodal distribution, reflecting a preponderance of activities at near (mobile phone and computer) or far (driving and walking). As expected, vergence angle correlated with interpupillary distance.

Conclusions

Wearable eye tracking glasses make it possible to compile a nearly continuous record of vergence angle over hours, which can be correlated with the corresponding visual scene viewed by ambulatory subjects.

Translational Relevance

This technology provides new insight into the diversity of human ocular motor behavior and may become useful for the diagnosis of disorders that affect vergence function such as: convergence insufficiency, Parkinson disease, and strabismus.

The amplitude of small eye movements can be accurately estimated with video-based eye trackers

Estimating the gaze direction with a digital video-based pupil and corneal reflection (P-CR) eye tracker is challenging partly since a video camera is limited in terms of spatial and temporal resolution, and because the captured eye images contain noise. Through computer simulation, we evaluated the localization accuracy of pupil-, and CR centers in the eye image for small eye rotations (≪ 1 deg). Results highlight how inaccuracies in center localization are related to 1) how many pixels the pupil and CR span in the eye camera image, 2) the method to compute the center of the pupil and CRs, and 3) the level of image noise. Our results provide a possible explanation to why the amplitude of small saccades may not be accurately estimated by many currently used video-based eye trackers. We conclude that eye movements with arbitrarily small amplitudes can be accurately estimated using the P-CR eye-tracking principle given that the level of image noise is low and the pupil and CR span enough pixels in the eye camera, or if localization of the CR is based on the intensity values in the eye image instead of a binary representation.

Eye tracking: empirical foundations for a minimal reporting guideline

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").

More than a feeling: Scalp EEG and eye signals in conscious tactile perception

Understanding the neural basis of consciousness is a fundamental goal of neuroscience, and sensory perception is often used as a proxy for consciousness in empirical studies. However, most studies rely on reported perception of visual stimuli. Here we present behavior, high density scalp EEG and eye metric recordings collected simultaneously during a novel tactile threshold perception task. We found significant N80, N140 and P300 event related potentials in perceived trials and in perceived versus not perceived trials. Significance was limited to a P100 and P300 in not perceived trials. We also found an increase in pupil diameter and blink rate and a decrease in microsaccade rate following perceived relative to not perceived tactile stimuli. These findings support the use of eye metrics as a measure of physiological arousal associated with conscious perception. Eye metrics may also represent a novel path toward the creation of tactile no-report tasks in the future.

Estimating 3D spatiotemporal point of regard: a device evaluation

This paper presents and evaluates a system and method that record spatiotemporal scene information and location of the center of visual attention, i.e., spatiotemporal point of regard (PoR) in ecological environments. A primary research application of the proposed system and method is for enhancing current 2D visual attention models. Current eye-tracking approaches collapse a scene's depth structures to a 2D image, omitting visual cues that trigger important functions of the human visual system (e.g., accommodation and vergence). We combined head-mounted eye-tracking with a miniature time-of-flight camera to produce a system that could be used to estimate the spatiotemporal location of the PoR-the point of highest visual attention-within 3D scene layouts. Maintaining calibration accuracy is a primary challenge for gaze mapping; hence, we measured accuracy repeatedly by matching the PoR to fixated targets arranged within a range of working distances in depth. Accuracy was estimated as the deviation from estimated PoR relative to known locations of scene targets. We found that estimates of 3D PoR had an overall accuracy of approximately 2° omnidirectional mean average error (OMAE) with variation over a 1 h recording maintained within 3.6° OMAE. This method can be used to determine accommodation and vergence cues of the human visual system continuously within habitual environments, including everyday applications (e.g., use of hand-held devices).

Neural basis for anxiety and anxiety-related physiological responses during a driving situation: an fMRI study

Although the exteroceptive and interoceptive prediction of a negative event increases a person’s anxiety in daily life situations, the relationship between the brain mechanism of anxiety and the anxiety-related autonomic response has not been fully understood. In this functional magnetic resonance imaging (fMRI) study, we examined the neural basis of anxiety and anxiety-related autonomic responses in a daily driving situation. Participants viewed a driving video clip in the first-person perspective. During the video clip, participants were presented with a cue to indicate whether a subsequent crash could occur (attention condition) or not (safe condition). Enhanced activities in the anterior insula, bed nucleus of the stria terminalis, thalamus, and periaqueductal gray, and higher sympathetic nerve responses (pupil dilation and peripheral arterial stiffness) were triggered by the attention condition but not with the safe condition. Autonomic response-related functional connectivity was detected in the visual cortex, cerebellum, brainstem, and MCC/PCC with the right anterior insula and its adjacent regions as seed regions. Thus, the right anterior insula and adjacent regions, in collaboration with other regions play a role in eliciting anxiety based on the prediction of negative events, by mediating anxiety-related autonomic responses according to interoceptive information.

Scale invariance in fNIRS as a measurement of cognitive load

Scale invariant neural dynamics are a relatively new but effective means of measuring changes in brain states as a result of varied cognitive load and task difficulty. This study tests whether scale invariance (as measured by the Hurst exponent, H) can be used with functional near-infrared spectroscopy (fNIRS) to quantify cognitive load, paving the way for scale-invariance to be measured in a variety of real-world settings. We analyzed H extracted from the fNIRS time series while participants completed an N-back working memory task. Consistent with what has been demonstrated in fMRI, the current results showed that scale-invariance analysis significantly differentiated between task and rest periods as calculated from both oxy- (HbO) and deoxy-hemoglobin (HbR) concentration changes. Results from both channel-averaged H and a multivariate partial least squares approach (Task PLS) demonstrated higher H during the 1-back task than the 2-back task. These results were stronger for H derived from HbR than from HbO. This suggests that scale-free brain states are a robust signature of cognitive load and not limited by the specific neuroimaging modality employed. Further, as fNIRS is relatively portable and robust to motion-related artifacts, these preliminary results shed light on the promising future of measuring cognitive load in real life settings.

A unified model of the task-evoked pupil response

The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.

Alpha EEG Activity and Pupil Diameter Coupling during Inactive Wakefulness in Humans

Variations in human behavior correspond to the adaptation of the nervous system to different internal and environmental demands. Attention, a cognitive process for weighing environmental demands, changes over time. Pupillary activity, which is affected by fluctuating levels of cognitive processing, appears to identify neural dynamics that relate to different states of attention. In mice, for example, pupil dynamics directly correlate with brain state fluctuations. Although, in humans, alpha-band activity is associated with inhibitory processes in cortical networks during visual processing, and its amplitude is modulated by attention, conclusive evidence linking this narrowband activity to pupil changes in time remains sparse. We hypothesize that, as alpha activity and pupil diameter indicate attentional variations over time, these two measures should be comodulated. In this work, we recorded the electroencephalographic (EEG) and pupillary activity of 16 human subjects who had their eyes fixed on a gray screen for 1 min. Our study revealed that the alpha-band amplitude and the high-frequency component of the pupil diameter covariate spontaneously. Specifically, the maximum alpha-band amplitude was observed to occur ∼300 ms before the peak of the pupil diameter. In contrast, the minimum alpha-band amplitude was noted to occur ∼350 ms before the trough of the pupil diameter. The consistent temporal coincidence of these two measurements strongly suggests that the subject's state of attention, as indicated by the EEG alpha amplitude, is changing moment to moment and can be monitored by measuring EEG together with the diameter pupil.

The confounding effects of eye blinking on pupillometry, and their remedy

Pupillometry, thanks to its strong relationship with cognitive factors and recent advancements in measuring techniques, has become popular among cognitive or neural scientists as a tool for studying the physiological processes involved in mental or neural processes. Despite this growing popularity of pupillometry, the methodological understanding of pupillometry is limited, especially regarding potential factors that may threaten pupillary measurements' validity. Eye blinking can be a factor because it frequently occurs in a manner dependent on many cognitive components and induces a pulse-like pupillary change consisting of constriction and dilation with substantive magnitude and length. We set out to characterize the basic properties of this "blink-locked pupillary response (BPR)," including the shape and magnitude of BPR and their variability across subjects and blinks, as the first step of studying the confounding nature of eye blinking. Then, we demonstrated how the dependency of eye blinking on cognitive factors could confound, via BPR, the pupillary responses that are supposed to reflect the cognitive states of interest. By building a statistical model of how the confounding effects of eye blinking occur, we proposed a probabilistic-inference algorithm of de-confounding raw pupillary measurements and showed that the proposed algorithm selectively removed BPR and enhanced the statistical power of pupillometry experiments. Our findings call for attention to the presence and confounding nature of BPR in pupillometry. The algorithm we developed here can be used as an effective remedy for the confounding effects of BPR on pupillometry.

Fixational eye movements in passive versus active sustained fixation tasks

Human fixational eye movements are so small and precise that high-speed, accurate tools are needed to fully reveal their properties and functional roles. Where the fixated image lands on the retina and how it moves for different levels of visually demanding tasks is the subject of the current study. An Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO) was used to image, track and present a variety of fixation targets (Maltese cross, disk, concentric circles, Vernier and tumbling-E letter) to healthy subjects. During these different passive (static) or active (discriminating) tasks under natural eye motion, the landing position of the target on the retina was tracked in space and time over the retinal image directly with high spatial (<1 arcmin) and temporal (960 Hz) resolution. We computed both the eye motion and the exact trajectory of the fixated target's motion over the retina. We confirmed that compared to passive tasks, active tasks elicited a partial inhibition of microsaccades, leading to longer drift periods compensated by larger corrective saccades. Consequently, the overall fixation stability during active tasks was on average 57% larger than during passive tasks. The preferred retinal locus of fixation was the same for each task and did not coincide with the location of the peak cone density.

Visual exploration dynamics are low-dimensional and driven by intrinsic factors

When looking at visual images, the eyes move to the most salient and behaviourally relevant objects. Saliency and semantic information significantly explain where people look. Less is known about the spatiotemporal properties of eye movements (i.e., how people look). We show that three latent variables explain 60% of eye movement dynamics of more than a hundred observers looking at hundreds of different natural images. The first component explaining 30% of variability loads on fixation duration, and it does not relate to image saliency or semantics; it approximates a power-law distribution of gaze steps, an intrinsic dynamic measure, and identifies observers with two viewing styles: static and dynamic. Notably, these viewing styles were also identified when observers look at a blank screen. These results support the importance of endogenous processes such as intrinsic dynamics to explain eye movement spatiotemporal properties.

Spatiotemporal characteristics of postsaccadic dynamic overshoot in young and elderly subjects

Saccadic eye movements may not stop steadily but fluctuate briefly, known as saccadic dynamic overshoot (SDO). The reported relationships between SDO and saccadic parameters of main saccade and the effect of aging on SDO are controversial. In addition, it is not clear whether aging-related disease, such as mild cognitive impairment (MCI) and Parkinson disease (PD), causes the specific change of SDO. To address these questions, we analyzed the spatiotemporal features of SDO in young healthy subjects, elderly healthy subjects, and subjects with PD and MCI in three oculomotor tasks. We found two types of SDOs—simple and complex SDO. We confirmed that the frequency and amplitude of SDO were positively correlated with the peak velocity and deceleration of main saccades and increased in elderly subjects; however, they were not significantly different among the three elderly groups. Our results support the previous argument that the oculomotor structure in brainstem and cerebellum directly develop SDO.

•

We classify two types of saccadic dynamic overshoot (SDO): SDO_simple and SDO_complex

•

Saccades with SDO have higher peak velocity and deceleration than saccades without SDO

•

Elderly subjects show a higher frequency and amplitude of SDO than young subjects

•

Saccades with SDO_complex occur more frequently in reflexive than voluntary saccades

Interocular Suppression in Primary Visual Cortex in Strabismus

People with strabismus acquired during childhood do not experience diplopia (double vision). To investigate how perception of the duplicate image is suppressed, we raised two male monkeys with alternating exotropia by disinserting the medial rectus muscle in each eye at age four weeks. Once the animals were mature, they were brought to the laboratory and trained to fixate a small spot while recordings were made in primary visual cortex (V1). Drifting gratings were presented to the receptive fields of 500 single neurons for eight interleaved conditions: (1) right eye monocular; (2) left eye monocular; (3) right eye's field, right eye fixating; (4) right eye's field, left eye fixating; (5) left eye's field, right eye fixating; (6) left eye's field, left eye fixating; (7) both eyes' fields, right eye fixating; (8) both eyes' fields, left eye fixating. As expected, ocular dominance histograms showed a monocular bias compared with normal animals, but many cells could still be driven via both eyes. Overall, neuronal responses were not affected by switches in ocular fixation. Individual neurons exhibited binocular interactions, but mean population indices indicated no net interocular suppression or facilitation. Even neurons located in cortex with reduced cytochrome oxidase (CO) activity, representing portions of the nasal visual field where perception is suppressed during binocular viewing, showed no net inhibition. These data indicate that V1 neurons do not appear to reflect strabismic suppression and therefore the elimination of diplopia is likely to be mediated at a higher cortical level.SIGNIFICANCE STATEMENT In patients with strabismus, images fall on non-corresponding points in the two retinas. Only one image is perceived, because signals emanating from the other eye that convey the duplicate image are suppressed. The benefit is that diplopia is prevented, but the penalty is that the visual feedback required to adjust eye muscle tone to realign the globes is eliminated. Here, we report the first electrophysiological recordings from the primary visual cortex (V1) in awake monkeys raised with strabismus. The experiments were designed to reveal how perception of double images is avoided.

Does Vergence Affect Perceived Size?

Since Kepler (1604) and Descartes (1637), it has been suggested that 'vergence' (the angular rotation of the eyes) plays a key role in size constancy. However, this has never been tested divorced from confounding cues such as changes in the retinal image. In our experiment, participants viewed a target which grew or shrank in size over 5 s. At the same time, the fixation distance specified by vergence was reduced from 50 to 25 cm. The question was whether this change in vergence affected the participants' judgements of whether the target grew or shrank in size? We found no evidence of any effect, and therefore no evidence that eye movements affect perceived size. If this is correct, then our finding has three implications. First, perceived size is much more reliant on cognitive influences than previously thought. This is consistent with the argument that visual scale is purely cognitive in nature (Linton, 2017; 2018). Second, it leads us to question whether the vergence modulation of V1 contributes to size constancy. Third, given the interaction between vergence, proprioception, and the retinal image in the Taylor illusion, it leads us to ask whether this cognitive approach could also be applied to multisensory integration.

Micro-pursuit: A class of fixational eye movements correlating with smooth, predictable, small-scale target trajectories

Humans generate ocular pursuit movements when a moving target is tracked throughout the visual field. In this article, we show that pursuit can be generated and measured at small amplitudes, at the scale of fixational eye movements, and tag these eye movements as micro-pursuits. During micro-pursuits, gaze direction correlates with a target's smooth, predictable target trajectory. We measure similarity between gaze and target trajectories using a so-called maximally projected correlation and provide results in three experimental data sets. A first observation of micro-pursuit is provided in an implicit pursuit task, where observers were tasked to maintain their gaze fixed on a static cross at the center of screen, while reporting changes in perception of an ambiguous, moving (Necker) cube. We then provide two experimental paradigms and their corresponding data sets: a first replicating micro-pursuits in an explicit pursuit task, where observers had to follow a moving fixation cross (Cross), and a second with an unambiguous square (Square). Individual and group analyses provide evidence that micro-pursuits exist in both the Necker and Cross experiments but not in the Square experiment. The interexperiment analysis results suggest that the manipulation of stimulus target motion, task, and/or the nature of the stimulus may play a role in the generation of micro-pursuits.

Characteristics of saccades during the near point of convergence test

The near point of convergence test is widely used to evaluate binocular vision. It assesses the ability of the eyes to converge at short distances. Although the test consists of a pure symmetrical vergence task, small involuntary saccades occur concurrently. The main goal of this study was to analyze saccadic characteristics as a function of vergence demand when testing the near point of convergence. To this purpose, the eye movements of 11 participants were registered with an eye-tracker while they performed the near point of convergence test by following a target that traveled forward and backward on a motorized bench. Saccade amplitude increased and, on average, saccade rate decreased with vergence demand. In general, the direction of the concurrent vergence movement had no significant effect on saccade characteristics. However, each individual subject showed idiosyncratic behavior. Most saccades tended to be corrective in terms of both binocular disparity and individual fixation position errors. In particular, most participants tended to correct the fixation position error of the dominant eye.

Overt attentional correlates of memorability of scene images and their relationships to scene semantics

Computer vision-based research has shown that scene semantics (e.g., presence of meaningful objects in a scene) can predict memorability of scene images. Here, we investigated whether and to what extent overt attentional correlates, such as fixation map consistency (also called inter-observer congruency of fixation maps) and fixation counts, mediate the relationship between scene semantics and scene memorability. First, we confirmed that the higher the fixation map consistency of a scene, the higher its memorability. Moreover, both fixation map consistency and its correlation to scene memorability were the highest in the first 2 seconds of viewing, suggesting that meaningful scene features that contribute to producing more consistent fixation maps early in viewing, such as faces and humans, may also be important for scene encoding. Second, we found that the relationship between scene semantics and scene memorability was partially (but not fully) mediated by fixation map consistency and fixation counts, separately as well as together. Third, we found that fixation map consistency, fixation counts, and scene semantics significantly and additively contributed to scene memorability. Together, these results suggest that eye-tracking measurements can complement computer vision-based algorithms and improve overall scene memorability prediction.

Introducing Point-of-Interest as an alternative to Area-of-Interest for fixation duration analysis

Many eye-tracking data analyses rely on the Area-of-Interest (AOI) methodology, which utilizes AOIs to analyze metrics such as fixations. However, AOI-based methods have some inherent limitations including variability and subjectivity in shape, size, and location of AOIs. In this article, we propose an alternative approach to the traditional AOI dwell time analysis: Weighted Sum Durations (WSD). This approach decreases the subjectivity of AOI definitions by using Points-of-Interest (POI) while maintaining interpretability. In WSD, the durations of fixations toward each POI is weighted by the distance from the POI and summed together to generate a metric comparable to AOI dwell time. To validate WSD, we reanalyzed data from a previously published eye-tracking study (n = 90). The re-analysis replicated the original findings that people gaze less towards faces and more toward points of contact when viewing violent social interactions.

The Tobii Pro Spectrum: A useful tool for studying microsaccades?

Due to its reported high sampling frequency and precision, the Tobii Pro Spectrum is of potential interest to researchers who want to study small eye movements during fixation. We test how suitable the Tobii Pro Spectrum is for research on microsaccades by computing data-quality measures and common properties of microsaccades and comparing these to the currently most used system in this field: the EyeLink 1000 Plus. Results show that the EyeLink data provide higher RMS precision and microsaccade rates compared with data acquired with the Tobii Pro Spectrum. However, both systems provide microsaccades with similar directions and shapes, as well as rates consistent with previous literature. Data acquired at 1200 Hz with the Tobii Pro Spectrum provide results that are more similar to the EyeLink, compared to data acquired at 600 Hz. We conclude that the Tobii Pro Spectrum is a useful tool for researchers investigating microsaccades.

Is apparent fixational drift in eye-tracking data due to filters or eyeball rotation?

Eye trackers are sometimes used to study the miniature eye movements such as drift that occur while observers fixate a static location on a screen. Specifically, analysis of such eye-tracking data can be performed by examining the temporal spectrum composition of the recorded gaze position signal, allowing to assess its color. However, not only rotations of the eyeball but also filters in the eye tracker may affect the signal’s spectral color. Here, we therefore ask whether colored, as opposed to white, signal dynamics in eye-tracking recordings reflect fixational eye movements, or whether they are instead largely due to filters. We recorded gaze position data with five eye trackers from four pairs of human eyes performing fixation sequences, and also from artificial eyes. We examined the spectral color of the gaze position signals produced by the eye trackers, both with their filters switched on, and for unfiltered data. We found that while filtered data recorded from both human and artificial eyes were colored for all eye trackers, for most eye trackers the signal was white when examining both unfiltered human and unfiltered artificial eye data. These results suggest that color in the eye-movement recordings was due to filters for all eye trackers except the most precise eye tracker where it may partly reflect fixational eye movements. As such, researchers studying fixational eye movements should be careful to examine the properties of the filters in their eye tracker to ensure they are studying eyeball rotation and not filter properties.

Load-dependent relationships between frontal fNIRS activity and performance: A data-driven PLS approach

Neuroimaging research frequently demonstrates load-dependent activation in prefrontal and parietal cortex during working memory tasks such as the N-back. Most of this work has been conducted in fMRI, but functional near-infrared spectroscopy (fNIRS) is gaining traction as a less invasive and more flexible alternative to measuring cortical hemodynamics. Few fNIRS studies, however, have examined how working memory load-dependent changes in brain hemodynamics relate to performance. The current study employs a newly developed and robust statistical analysis of task-based fNIRS data in a large sample, and demonstrates the utility of data-driven, multivariate analyses to link brain activation and behavior in this modality. Seventy participants completed a standard N-back task with three N-back levels (N = 1, 2, 3) while fNIRS data were collected from frontal and parietal cortex. Overall, participants showed reliably greater fronto-parietal activation for the 2-back versus the 1-back task, suggesting fronto-parietal fNIRS measurements are sensitive to differences in cognitive load. The results for 3-back were much less consistent, potentially due to poor behavioral performance in the 3-back task. To address this, a multivariate analysis (behavioral partial least squares, PLS) was conducted to examine the interaction between fNIRS activation and performance at each N-back level. Results of the PLS analysis demonstrated differences in the relationship between accuracy and change in the deoxyhemoglobin fNIRS signal as a function of N-back level in eight mid-frontal channels. Specifically, greater reductions in deoxyhemoglobin (i.e., more activation) were positively related to performance on the 3-back task, unrelated to accuracy in the 2-back task, and negatively associated with accuracy in the 1-back task. This pattern of results suggests that the metabolic demands correlated with neural activity required for high levels of accuracy vary as a consequence of task difficulty/cognitive load, whereby more automaticity during the 1-back task (less mid-frontal activity) predicted superior performance on this relatively easy task, and successful engagement of this mid-frontal region was required for high accuracy on a more difficult and cognitively demanding 3-back task. In summary, we show that fNIRS activity can track working memory load and can uncover significant associations between brain activity and performance, thus opening the door for this modality to be used in more wide-spread applications.

The pupil-size artefact (PSA) across time, viewing direction, and different eye trackers

The pupil size artefact (PSA) is the gaze deviation reported by an eye tracker during pupil size changes if the eye does not rotate. In the present study, we ask three questions: 1) how stable is the PSA over time, 2) does the PSA depend on properties of the eye tracker set up, and 3) does the PSA depend on the participants’ viewing direction? We found that the PSA is very stable over time for periods as long as 1 year, but may differ between participants. When comparing the magnitude of the PSA between eye trackers, we found the magnitude of the obtained PSA to be related to the direction of the eye-tracker-camera axis, suggesting that the angle between the participants’ viewing direction and the camera axis affects the PSA. We then investigated the PSA as a function of the participants’ viewing direction. The PSA was non-zero for viewing direction 0^∘ and depended on the viewing direction. These findings corroborate the suggestion by Choe et al. (Vision Research 118(6755):48–59, 2016), that the PSA can be described by an idiosyncratic and a viewing direction-dependent component. Based on a simulation, we cannot claim that the viewing direction-dependent component of the PSA is caused by the optics of the cornea.

Visuomotor learning from postdictive motor error

Sensorimotor learning adapts motor output to maintain movement accuracy. For saccadic eye movements, learning also alters space perception, suggesting a dissociation between the performed saccade and its internal representation derived from corollary discharge (CD). This is critical since learning is commonly believed to be driven by CD-based visual prediction error. We estimate the internal saccade representation through pre- and trans-saccadic target localization, showing that it decouples from the actual saccade during learning. We present a model that explains motor and perceptual changes by collective plasticity of spatial target percept, motor command, and a forward dynamics model that transforms CD from motor into visuospatial coordinates. We show that learning does not follow visual prediction error but instead a postdictive update of space after saccade landing. We conclude that trans-saccadic space perception guides motor learning via CD-based postdiction of motor error under the assumption of a stable world.

Factors Influencing Saccadic Reaction Time: Effect of Task Modality, Stimulus Saliency, Spatial Congruency of Stimuli, and Pupil Size

It is often assumed that the reaction time of a saccade toward visual and/or auditory stimuli reflects the sensitivities of our oculomotor-orienting system to stimulus saliency. Endogenous factors, as well as stimulus-related factors, would also affect the saccadic reaction time (SRT). However, it was not clear how these factors interact and to what extent visual and auditory-targeting saccades are accounted for by common mechanisms. The present study examined the effect of, and the interaction between, stimulus saliency and audiovisual spatial congruency on the SRT for visual- and for auditory-target conditions. We also analyzed pre-target pupil size to examine the relationship between saccade preparation and pupil size. Pupil size is considered to reflect arousal states coupling with locus-coeruleus (LC) activity during a cognitive task. The main findings were that (1) the pattern of the examined effects on the SRT varied between visual- and auditory-auditory target conditions, (2) the effect of stimulus saliency was significant for the visual-target condition, but not significant for the auditory-target condition, (3) Pupil velocity, not absolute pupil size, was sensitive to task set (i.e., visual-targeting saccade vs. auditory-targeting saccade), and (4) there was a significant correlation between the pre-saccade absolute pupil size and the SRTs for the visual-target condition but not for the auditory-target condition. The discrepancy between target modalities for the effect of pupil velocity and between the absolute pupil size and pupil velocity for the correlation with SRT may imply that the pupil effect for the visual-target condition was caused by a modality-specific link between pupil size modulation and the SC rather than by the LC-NE (locus coeruleus-norepinephrine) system. These results support the idea that different threshold mechanisms in the SC may be involved in the initiation of saccades toward visual and auditory targets.

Accuracy and precision of small saccades

Despite recent advances on the mechanisms and purposes of fine oculomotor behavior, a rigorous assessment of the precision and accuracy of the smallest saccades is still lacking. Yet knowledge of how effectively these movements shift gaze is necessary for understanding their functions and is helpful in further elucidating their motor underpinnings. Using a combination of high-resolution eye-tracking and gaze-contingent control, here we examined the accuracy and precision of saccades aimed toward targets ranging from [Formula: see text] to [Formula: see text] eccentricity. We show that even small saccades of just 14-[Formula: see text] are very effective in centering the stimulus on the retina. Furthermore, we show that for a target at any given eccentricity, the probability of eliciting a saccade depends on its efficacy in reducing the foveal offset. The pattern of results reported here is consistent with current knowledge on the motor mechanisms of microsaccade production.

Rapid stimulus-driven modulation of slow ocular position drifts

The eyes are never still during maintained gaze fixation. When microsaccades are not occurring, ocular position exhibits continuous slow changes, often referred to as drifts. Unlike microsaccades, drifts remain to be viewed as largely random eye movements. Here we found that ocular position drifts can, instead, be very systematically stimulus-driven, and with very short latencies. We used highly precise eye tracking in three well trained macaque monkeys and found that even fleeting (~8 ms duration) stimulus presentations can robustly trigger transient and stimulus-specific modulations of ocular position drifts, and with only approximately 60 ms latency. Such drift responses are binocular, and they are most effectively elicited with large stimuli of low spatial frequency. Intriguingly, the drift responses exhibit some image pattern selectivity, and they are not explained by convergence responses, pupil constrictions, head movements, or starting eye positions. Ocular position drifts have very rapid access to exogenous visual information.

Does vision extract absolute distance from vergence?

Since Kepler (1604) and Descartes (1637), 'vergence' (the angular rotation of the eyes) has been thought of as one of our most important absolute distance cues. But vergence has never been tested as an absolute distance cue divorced from obvious confounding cues such as binocular disparity. In this article, we control for these confounding cues for the first time by gradually manipulating vergence and find that observers fail to accurately judge distance from vergence. We consider several different interpretations of these results and argue that the most principled response to these results is to question the general effectiveness of vergence as an absolute distance cue. Given that other absolute distance cues (such as motion parallax and vertical disparities) are limited in application, this poses a real challenge to our contemporary understanding of visual scale.

REMoDNaV: robust eye-movement classification for dynamic stimulation

Tracking of eye movements is an established measurement for many types of experimental paradigms. More complex and more prolonged visual stimuli have made algorithmic approaches to eye-movement event classification the most pragmatic option. A recent analysis revealed that many current algorithms are lackluster when it comes to data from viewing dynamic stimuli such as video sequences. Here we present an event classification algorithm—built on an existing velocity-based approach—that is suitable for both static and dynamic stimulation, and is capable of classifying saccades, post-saccadic oscillations, fixations, and smooth pursuit events. We validated classification performance and robustness on three public datasets: 1) manually annotated, trial-based gaze trajectories for viewing static images, moving dots, and short video sequences, 2) lab-quality gaze recordings for a feature-length movie, and 3) gaze recordings acquired under suboptimal lighting conditions inside the bore of a magnetic resonance imaging (MRI) scanner for the same full-length movie. We found that the proposed algorithm performs on par or better compared to state-of-the-art alternatives for static stimulation. Moreover, it yields eye-movement events with biologically plausible characteristics on prolonged dynamic recordings. Lastly, algorithm performance is robust on data acquired under suboptimal conditions that exhibit a temporally varying noise level. These results indicate that the proposed algorithm is a robust tool with improved classification accuracy across a range of use cases. The algorithm is cross-platform compatible, implemented using the Python programming language, and readily available as free and open-source software from public sources.

Fixational microsaccades: A quantitative and objective measure of disability in multiple sclerosis

BACKGROUND

Objective tools for prognosis and disease progression monitoring in multiple sclerosis (MS) are lacking. The visuomotor system could be used to track motor dysfunction at the micron scale through the monitoring of fixational microsaccades.

AIMS

The aim of this study was to evaluate whether microsaccades are correlated with standard MS disability metrics and to assess whether these methods play a predictive role in MS disability.

METHOD

We used a custom-built retinal eye tracker, the tracking scanning laser ophthalmoscope (TSLO), to record fixation in 111 participants with MS and 100 unaffected controls.

RESULTS

In MS participants, a greater number of microsaccades showed significant association with higher Expanded Disability Status Scale score (EDSS, p < 0.001), nine-hole peg test (non-dominant: p = 0.006), Symbol Digit Modalities Test (SMDT, p = 0.014), and Functional Systems Scores (FSS) including brainstem (p = 0.005), cerebellar (p = 0.011), and pyramidal (p = 0.009). Both brainstem FSS and patient-reported fatigue showed significant associations with microsaccade number, amplitude, and peak acceleration. Participants with MS showed a statistically different average number (p = 0.020), peak vertical acceleration (p = 0.003), and vertical amplitude (p < 0.001) versus controls. Logistic regression models for MS disability were created using TSLO microsaccade metrics and paraclinical tests with ⩾80% accuracy.

CONCLUSION

Microsaccades provide objective measurements of MS disability level and disease worsening.

Relationship of postsaccadic oscillation with the state of the pupil inside the iris and with cognitive processing

Recent studies using video-based eye tracking have presented accumulating evidence that postsaccadic oscillation defined in reference to the pupil center (PSOp) is larger than that to the iris center (PSOi). This indicates that the relative motion of the pupil reflects the viscoelasticity of the tissue of the iris. It is known that the pupil size controlled by the sphincter/dilator pupillae muscles reflects many aspects of cognition. A hypothesis derived from this fact is that cognitive tasks affect the properties of PSOp due to the change in the state of these muscles. To test this hypothesis, we conducted pro- and antisaccade tasks for human participants and adopted the recent physical model of PSO to evaluate the dynamic properties of PSOp/PSOi. The results showed the dependence of the elasticity coefficient of the PSOp on the antisaccade task, but this effect was not significant for the PSOi. This suggests that cognitive tasks such as antisaccade tasks affect elasticity of the muscle of the iris. We found that the trial-by-trial fluctuation in the presaccade absolute pupil size correlated with the elasticity coefficient of PSOp. We also found the task dependence of the viscosity coefficient and overshoot amount of PSOi, which probably reflects the dynamics of the entire eyeball movement. The difference in task dependence between PSOp and PSOi indicates that the separate measures of these two can be means to distinguish factors related to the oculomotor neural system from those related to the physiological states of the iris tissue.

NEW & NOTEWORTHY The state of the eyeball varies dynamically moment by moment depending on underlying neural/cognitive processing. Combining simultaneous measurements of pupil-centric and iris-centric movements and a recent physical model of postsaccadic oscillation (PSO), we show that the pupil-centric PSO is sensitive to the type of saccade task, suggesting that the physical state of the iris muscles reflects the underlying cognitive processes.

Use of information modelling techniques to understand research trends in eye gaze estimation methods: An automated review

Eye gaze tracking has been used to study the influence of visual stimuli on consumer behavior and attentional processes. Eye gaze tracking techniques have made substantial contributions in advertisement design, human computer interaction, virtual reality and disease diagnosis. Eye gaze estimation is considered critical for prediction of human attention, and hence indispensable for better understanding human activities. In this paper, Latent Semantic Analysis is used to develop an information model for identifying emerging research trends within eye gaze estimation techniques. An exhaustive collection of 423 titles and abstracts of research papers published during 2005-2018 were used. Five major research areas and ten research trends were classified based upon this study.

Violence reduces attention to faces and draws attention to points of contact

Although violence is a frequently researched topic, little is known about how different social features influence information gathering from violent interactions. Regions of an interaction that provide contextual information should receive more attention. We predicted the most informative features of a violent social interaction would be faces, points of contact, and objects being held. To test this, we tracked the eyes of 90 participants as they viewed images of social interactions that varied with respect to violence. When viewing violent interactions, participants attended significantly less to faces and significantly more to points of contact. Moreover, first-fixation analysis suggests that some of these biases are present from the beginning of scene-viewing. These findings are the first to demonstrate the visual relevance of faces and contact points in gathering information from violent social interactions. These results also question the attentional dominance of faces in active social scenes, highlighting the importance of using a variety of stimuli and contexts in social cognition research.

Aging and eye tracking: in the quest for objective biomarkers

Recent applications of eye tracking for diagnosis, prognosis and follow-up of therapy in age-related neurological or psychological deficits have been reviewed. The review is focused on active aging, neurodegeneration and cognitive impairments. The potential impacts and current limitations of using characterizing features of eye movements and pupillary responses (oculometrics) as objective biomarkers in the context of aging are discussed. A closer look into the findings, especially with respect to cognitive impairments, suggests that eye tracking is an invaluable technique to study hidden aspects of aging that have not been revealed using any other noninvasive tool. Future research should involve a wider variety of oculometrics, in addition to saccadic metrics and pupillary responses, including nonlinear and combinatorial features as well as blink- and fixation-related metrics to develop biomarkers to trace age-related irregularities associated with cognitive and neural deficits.

Microsaccade rate as a measure of drug response

In 22 human subjects we measured microsaccade count across 60 brief fixation trials both pre- and post- administration of 300mg of caffeine. There was a statistically significant reduction in average microsaccade count post-caffeine administration, with a moderate effect size (Cohen's d of 0.42). Microsaccade count was stable within individuals across time points (Pearson's r of 0.89). Sensitivity analysis suggests that the pre/post caffeine effect size is robust to choice of parameters used to identify microsaccades. Bootstrap resampling suggests that both the pre/post-caffeine difference and the across-time stability within individuals could be reliably assessed with far fewer trials. The results support the use of microsaccade count as both a trait measure of individual differences and a state measure of caffeine response. We discuss the results in the context of the theory that the superior colliculus is central to the generation of microsaccades and hence that microsaccade rate may be a useful assay for at least some drug-induced changes at the level of the colliculus: a potentially useful tool in the development of therapies for disorders that may involve collicular dysfunction such as ADHD.

The Effects of Calibration Target, Screen Location, and Movement Type on Infant Eye-Tracking Data Quality

During infant eye-tracking, fussiness caused by the repetition of calibration stimuli and body movements during testing are frequent constraints on measurement quality. Here, we systematically investigated these constraints with infants and adults using EyeLink 1000 Plus. We compared looking time and dispersion of gaze points elicited by stimuli resembling commonly used calibration animations. The adult group additionally performed body movements during gaze recording that were equivalent to movements infants spontaneously produce during testing. In our results, infants' preference for a particular calibration target did not predict data quality elicited by that stimulus, but targets exhibiting the strongest contrasts in their center or targets with globally distributed complexity resulted in the highest accuracy. Our gaze measures from the adult movement tasks were differentially affected by the type of movement as well as the location where the target appeared on the screen. These heterogeneous effects of movement on measures should be taken into account when planning infant eye-tracking experiments. Additionally, to improve data quality, infants' tolerance for repeated calibrations can be facilitated by alternating between precise calibration targets.

A behavioral face preference deficit in a monkey with an incomplete face patch system

Primates are experts in face perception and naturally show a preference for faces under free-viewing conditions. The primate ventral stream is characterized by a network of face patches that selectively responds to faces, but it remains uncertain how important such parcellation is for face perception. Here we investigated free-viewing behavior in a female monkey who naturally lacks fMRI-defined posterior and middle lateral face patches. We presented a series of content-rich images of scenes that included faces or other objects to that monkey during a free-viewing task and tested a group of 10 control monkeys on the same task for comparison. We found that, compared to controls, the monkey with missing face patches showed a marked reduction of face viewing preference that was most pronounced for the first few fixations. In addition, her gaze fixation patterns were substantially distinct from those of controls, especially for pictures with a face. These data demonstrate an association between the clustering of neurons in face selective patches and a behavioral bias for faces in natural images.

Behavioural evidence for parallel outcome-sensitive and outcome-insensitive Pavlovian learning systems in humans

There is a dichotomy in instrumental conditioning between goal-directed actions and habits that are distinguishable on the basis of their relative sensitivity to changes in outcome value. It is less clear whether a similar distinction applies in Pavlovian conditioning, where responses have been found to be predominantly outcome sensitive. To test for both devaluation insensitive and devaluation sensitive Pavlovian conditioning in humans, we conducted four experiments combining Pavlovian conditioning and outcome devaluation procedures while measuring multiple conditioned responses. Our results suggest that Pavlovian conditioning involves two distinct types of learning: one that learns the current value of the outcome which is sensitive to devaluation, and one that learns about the spatial localisation of the outcome which is insensitive to devaluation. Our findings have implications for the mechanistic understanding of Pavlovian conditioning and provide a more nuanced understanding of Pavlovian mechanisms that might contribute to a number of psychiatric disorders.

Ocular drift reflects volitional action preparation

Human cognitive behavior is predictive rather than reflexive because of volitional action preparation. Recent studies have shown that the covert process of volitional action preparation can be decoded from overt fixational eye movements of fixational/microsaccades and pupil dilation. Ocular drift, the slowest fixational eye movements, is also under the active neural control, but its relationship with cognitive behavior is unknown. Here, we examined whether ocular drift also reflects volitional action preparation. We analyzed ocular drift while adult humans maintained fixation on a central visual stimulus as they prepared to generate a volitional saccade. We adopted the antisaccade paradigm in which subjects generate a targeting saccade toward the opposite direction of a peripheral visual stimulus. Our findings are the following five points. First, ocular drift was slower when subjects prepared for targeting saccade initiation than when such preparation was unnecessary. Second, ocular drift was slowed down with elapsed time from fixation initiation, which was associated with the facilitation of targeting saccade initiation. Third, ocular drift was further slowed on correct antisaccade trials than when subjects failed to suppress targeting saccades toward peripheral stimuli. Fourth, such correlation with antisaccade performance was observed immediately after fixation initiation in ocular drift, but it emerged more slowly in the other fixational eye movements. Fifth, subjects with unstable fixation because of faster ocular drift had poorer antisaccade performance. We suggest that fixation stability measured by ocular drift can be used to decode the covert process of volitional action preparation along with the other fixational eye movements.

Transfer function of the rhesus macaque oculomotor system for small-amplitude slow motion trajectories

Two main types of small eye movements occur during gaze fixation: microsaccades and slow ocular drifts. While microsaccade generation has been relatively well studied, ocular drift control mechanisms are unknown. Here we explored the degree to which monkey smooth eye movements, on the velocity scale of slow ocular drifts, can be generated systematically. Two male rhesus macaque monkeys tracked a spot moving sinusoidally, but slowly, along the horizontal or vertical direction. Maximum target displacement in the motion trajectory was 30 min arc (0.5°), and we varied the temporal frequency of target motion from 0.2 to 5 Hz. We obtained an oculomotor “transfer function” by measuring smooth eye velocity gain (relative to target velocity) as a function of frequency, similar to past work with large-amplitude pursuit. Monkey eye velocities as slow as those observed during slow ocular drifts were clearly target motion driven. Moreover, as with large-amplitude smooth pursuit, eye velocity gain varied with temporal frequency. However, unlike with large-amplitude pursuit, exhibiting low-pass behavior, small-amplitude motion tracking was band pass, with the best ocular movement gain occurring at ~0.8–1 Hz. When oblique directions were tested, we found that the horizontal component of pursuit gain was larger than the vertical component. Our results provide a catalog of the control abilities of the monkey oculomotor system for slow target motions, and they also support the notion that smooth fixational ocular drifts are controllable. This has implications for neural investigations of drift control and the image-motion consequences of drifts on visual coding in early visual areas.

NEW & NOTEWORTHY We studied the efficacy of monkey smooth pursuit eye movements for very slow target velocities. Pursuit was impaired for sinusoidal motions of frequency less than ~0.8–1 Hz. Nonetheless, eye trajectory was still sinusoidally modulated, even at velocities lower than those observed during gaze fixation with slow ocular drifts. Our results characterize the slow control capabilities of the monkey oculomotor system and provide a basis for future understanding of the neural mechanisms for slow ocular drifts.

Do pupil-based binocular video eye trackers reliably measure vergence?

A binocular eye tracker needs to be accurate to enable the determination of vergence, distance to the binocular fixation point and fixation disparity. These measures are useful in e.g. the research fields of visual perception, binocular control in reading and attention in 3D. Are binocular pupil-based video eye trackers accurate enough to produce meaningful binocular measures? Recent research revealed potentially large idiosyncratic systematic errors due to pupil-size changes. With a top of the line eye tracker (SR Research EyeLink 1000 plus), we investigated whether the pupil-size artefact in the separate eyes may cause the eye tracker to report apparent vergence when the eyeballs do not rotate. Participants were asked to fixate a target at a distance of 77 cm for 160 s. We evoked pupil-size changes by varying the light intensity. With increasing pupil size, horizontal vergence reported by the eye tracker decreased in most subjects, up to two degrees. However, this was not due to a rotation of the eyeballs, as identified from the absence of systematic movement in the corneal reflection (CR) signals. From this, we conclude that binocular pupil-CR or pupil-only video eye trackers using the dark pupil technique are not accurate enough to be used to determine vergence, distance to the binocular fixation point and fixation disparity.

Microsaccadic rate and pupil size dynamics in pro-/anti-saccade preparation: the impact of intermixed vs. blocked trial administration

Prolonged fixation can lead to the generation of tiny and fast eye movements called microsaccades, whose dynamics can be associated with higher cognitive mechanisms. Saccade preparation is also reflected in microsaccadic activity, but the few studies on this topic provided mixed results. For instance, fewer microsaccades have been observed when participants were asked to prepare for an anti-saccade (i.e., a saccade in the opposite direction to the target) as compared to a pro-saccade (i.e., a saccade executed towards a target), but null results have also been reported. In the attempt to shed new light on this topic, two experiments were carried out in which the context of presentation of pro- and anti-saccade trials was manipulated. Pupil size was also recorded, as a further index of cognitive load. In Experiment 1, participants were asked to prepare and perform pro- and anti-saccades in response to a peripheral target, according to a central instruction cue provided at the beginning of each trial (intermixed condition). In Experiment 2, the same task was employed, but pro- and anti-saccade trials were delivered in two distinct blocks (blocked condition). In both experiments, greater saccadic latencies and lower accuracy emerged for anti- than for pro-saccades. However, in the intermixed condition, a lower microsaccadic rate and a greater pupil size emerged when participants prepared for anti- rather than pro-saccades, whereas these differences disappeared in the blocked condition. These results suggest that contextual factors may play a key role in shaping oculomotor dynamics linked to saccade preparation.