The influence of crystalline lens accommodation on post-saccadic oscillations in pupil-based eye trackers

Effects of post-saccadic oscillations on visual processing times

Saccadic eye movements enable us to search for the target of interest in a crowded scene or, in the case of goal-directed saccades, to simply bring the image of the peripheral target to the very centre of the fovea. This mechanism extends the use of the superior image processing performance of the fovea over a large visual field. We know that visual information is processed quickly at the end of each saccade but estimates of the times involved remain controversial. This study aims to investigate the processing of visual information during post fixation oscillations of the eyeball. A new psychophysical test measures the combined eye movement response latencies, including fixation duration and visual processing times. When the test is used in conjunction with an eye tracker, each component that makes up the 'integrated saccade latency' time, from the onset of the peripheral stimulus to the correct interpretation of the information carried by the stimulus, can be measured and the discrete components delineated. The results show that the time required to process and encode the stimulus attribute of interest at the end of a saccade is longer than the time needed to carry out the same task in the absence of an eye movement. We propose two principal hypotheses, each of which can account for this finding. 1. The known inhibition of afferent retinal signals during fast eye movements extends beyond the end point of the saccade. 2. The extended visual processing times measured when saccades are involved are caused by the transient loss of spatial resolution due to eyeball instability during post-saccadic oscillations. The latter can best be described as retinal image smear with greater loss of spatial resolution expected for stimuli of low luminance contrast.

Post-Saccadic Oscillations of the Pupil and Lens Reduce Fixation Stability in Retinitis Pigmentosa and Age-Related Macular Degeneration

Purpose

Post-saccadic oscillations (PSOs) reflect movements of gaze that result from motion of the pupil and lens relative to the eyeball rather than eyeball rotations. Here, we analyzed the characteristics of PSOs in subjects with age-related macular degeneration (AMD), retinitis pigmentosa (RP), and normal vision (NV). Our aim was to assess the differences in PSOs between people with vision loss and healthy controls because PSOs affect retinal image stability after each saccade.

Methods

Participants completed a horizontal saccade task and their gaze was measured using a pupil-based eye tracker. Oscillations occurring in the 80 to 200 ms post-saccadic period were described with a damped oscillation model. We compared the amplitude, decay time constant, and frequency of the PSOs for the three different groups. We also examined the correlation between these PSO parameters and the amplitude, peak velocity, and final deceleration of the preceding saccades.

Results

Subjects with vision loss (AMD, n = 6, and RP, n = 5) had larger oscillation amplitudes, longer decay constants, and lower frequencies than subjects with NV (n = 7). The oscillation amplitudes increased with increases in saccade deceleration in all three groups. The other PSO parameters, however, did not show consistent correlations with either saccade amplitude or peak velocity.

Conclusions

Post-saccadic fixation stability in AMD and RP is reduced due to abnormal PSOs. The differences with respect to NV are not due to differences in saccade kinematics, suggesting that anatomic and neuronal variations affect the suspension of the iris and the lens in the patients' eyes.

Fixational eye movements in passive versus active sustained fixation tasks

Human fixational eye movements are so small and precise that high-speed, accurate tools are needed to fully reveal their properties and functional roles. Where the fixated image lands on the retina and how it moves for different levels of visually demanding tasks is the subject of the current study. An Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO) was used to image, track and present a variety of fixation targets (Maltese cross, disk, concentric circles, Vernier and tumbling-E letter) to healthy subjects. During these different passive (static) or active (discriminating) tasks under natural eye motion, the landing position of the target on the retina was tracked in space and time over the retinal image directly with high spatial (<1 arcmin) and temporal (960 Hz) resolution. We computed both the eye motion and the exact trajectory of the fixated target's motion over the retina. We confirmed that compared to passive tasks, active tasks elicited a partial inhibition of microsaccades, leading to longer drift periods compensated by larger corrective saccades. Consequently, the overall fixation stability during active tasks was on average 57% larger than during passive tasks. The preferred retinal locus of fixation was the same for each task and did not coincide with the location of the peak cone density.

Relationship of postsaccadic oscillation with the state of the pupil inside the iris and with cognitive processing

Recent studies using video-based eye tracking have presented accumulating evidence that postsaccadic oscillation defined in reference to the pupil center (PSOp) is larger than that to the iris center (PSOi). This indicates that the relative motion of the pupil reflects the viscoelasticity of the tissue of the iris. It is known that the pupil size controlled by the sphincter/dilator pupillae muscles reflects many aspects of cognition. A hypothesis derived from this fact is that cognitive tasks affect the properties of PSOp due to the change in the state of these muscles. To test this hypothesis, we conducted pro- and antisaccade tasks for human participants and adopted the recent physical model of PSO to evaluate the dynamic properties of PSOp/PSOi. The results showed the dependence of the elasticity coefficient of the PSOp on the antisaccade task, but this effect was not significant for the PSOi. This suggests that cognitive tasks such as antisaccade tasks affect elasticity of the muscle of the iris. We found that the trial-by-trial fluctuation in the presaccade absolute pupil size correlated with the elasticity coefficient of PSOp. We also found the task dependence of the viscosity coefficient and overshoot amount of PSOi, which probably reflects the dynamics of the entire eyeball movement. The difference in task dependence between PSOp and PSOi indicates that the separate measures of these two can be means to distinguish factors related to the oculomotor neural system from those related to the physiological states of the iris tissue.

NEW & NOTEWORTHY The state of the eyeball varies dynamically moment by moment depending on underlying neural/cognitive processing. Combining simultaneous measurements of pupil-centric and iris-centric movements and a recent physical model of postsaccadic oscillation (PSO), we show that the pupil-centric PSO is sensitive to the type of saccade task, suggesting that the physical state of the iris muscles reflects the underlying cognitive processes.

Improving free-viewing fixation-related EEG potentials with continuous-time regression

BACKGROUND

In the analysis of combined ET-EEG data, there are several issues with estimating FRPs by averaging. Neural responses associated with fixations will likely overlap with one another in the EEG recording and neural responses change as a function of eye movement characteristics. Especially in tasks that do not constrain eye movements in any way, these issues can become confounds.

NEW METHOD

Here, we propose the use of regression based estimates as an alternative to averaging. Multiple regression can disentangle different influences on the EEG and correct for overlap. It thereby accounts for potential confounds in a way that averaging cannot. Specifically, we test the applicability of the rERP framework, as proposed by Smith and Kutas (2015b), (2017), or Sassenhagen (2018) to combined eye tracking and EEG data from a visual search and a scene memorization task.

RESULTS

Results show that the method successfully estimates eye movement related confounds in real experimental data, so that these potential confounds can be accounted for when estimating experimental effects.

COMPARISON WITH EXISTING METHODS

The rERP method successfully corrects for overlapping neural responses in instances where averaging does not. As a consequence, baselining can be applied without risking distortions. By estimating a known experimental effect, we show that rERPs provide an estimate with less variance and more accuracy than averaged FRPs. The method therefore provides a practically feasible and favorable alternative to averaging.

CONCLUSIONS

We conclude that regression based ERPs provide novel opportunities for estimating fixation related EEG in free-viewing experiments.

One algorithm to rule them all? An evaluation and discussion of ten eye movement event-detection algorithms

Almost all eye-movement researchers use algorithms to parse raw data and detect distinct types of eye movement events, such as fixations, saccades, and pursuit, and then base their results on these. Surprisingly, these algorithms are rarely evaluated. We evaluated the classifications of ten eye-movement event detection algorithms, on data from an SMI HiSpeed 1250 system, and compared them to manual ratings of two human experts. The evaluation focused on fixations, saccades, and post-saccadic oscillations. The evaluation used both event duration parameters, and sample-by-sample comparisons to rank the algorithms. The resulting event durations varied substantially as a function of what algorithm was used. This evaluation differed from previous evaluations by considering a relatively large set of algorithms, multiple events, and data from both static and dynamic stimuli. The main conclusion is that current detectors of only fixations and saccades work reasonably well for static stimuli, but barely better than chance for dynamic stimuli. Differing results across evaluation methods make it difficult to select one winner for fixation detection. For saccade detection, however, the algorithm by Larsson, Nyström and Stridh (IEEE Transaction on Biomedical Engineering, 60(9):2484-2493,2013) outperforms all algorithms in data from both static and dynamic stimuli. The data also show how improperly selected algorithms applied to dynamic data misestimate fixation and saccade properties.

Searching for monocular microsaccades - A red Hering of modern eye trackers?

Despite early reports and the contemporary consensus on microsaccades as purely binocular phenomena, recent work has proposed not only the existence of monocular microsaccades, but also that they serve functional purposes. We take a critical look at the detection of monocular microsaccades from a signal perspective, using raw data and a state-of-the-art, video-based eye tracker. In agreement with previous work, monocular detections were present in all participants using a standard microsaccade detection algorithm. However, a closer look at the raw data invalidates the vast majority of monocular detections. These results again raise the question of the existence of monocular microsaccades, as well as the need for improved methods to study small eye movements recorded with video-based eye trackers.

The pupil is faster than the corneal reflection (CR): Are video based pupil-CR eye trackers suitable for studying detailed dynamics of eye movements?

Most modern video eye trackers use the p-CR (pupil minus CR) technique to deal with small relative movements between the eye tracker camera and the eye. We question whether the p-CR technique is appropriate to investigate saccade dynamics. In two experiments we investigated the dynamics of pupil, CR and gaze signals obtained from a standard SMI Hi-Speed eye tracker. We found many differences between the pupil and the CR signals. Differences concern timing of the saccade onset, saccade peak velocity and post-saccadic oscillation (PSO). We also obtained that pupil peak velocities were higher than CR peak velocities. Saccades in the eye trackers' gaze signal (that is constructed from p-CR) appear to be excessive versions of saccades in the pupil signal. We conclude that the pupil-CR technique is not suitable for studying detailed dynamics of eye movements.

Pupil size influences the eye-tracker signal during saccades

While it is known that scleral search coils-measuring the rotation of the eye globe--and modern, video based eye trackers-tracking the center of the pupil and the corneal reflection (CR)--produce signals with different properties, the mechanisms behind the differences are less investigated. We measure how the size of the pupil affects the eye-tracker signal recorded during saccades with a common pupil-CR eye-tracker. Eye movements were collected from four healthy participants and one person with an aphakic eye while performing self-paced, horizontal saccades at different levels of screen luminance and hence pupil size. Results show that pupil-, and gaze-signals, but not the CR-signal, are affected by the size of the pupil; changes in saccade peak velocities in the gaze signal of more than 30% were found. It is important to be aware of this pupil size dependent change when comparing fine grained oculomotor behavior across participants and conditions.