Evaluating Eye Movement Event Detection: A Review of the State of the Art

Strategies for enhancing automatic fixation detection in head-mounted eye tracking

Moving through a dynamic world, humans need to intermittently stabilize gaze targets on their retina to process visual information. Overt attention being thus split into discrete intervals, the automatic detection of such fixation events is paramount to downstream analysis in many eye-tracking studies. Standard algorithms tackle this challenge in the limiting case of little to no head motion. In this static scenario, which is approximately realized for most remote eye-tracking systems, it amounts to detecting periods of relative eye stillness. In contrast, head-mounted eye trackers allow for experiments with subjects moving naturally in everyday environments. Detecting fixations in these dynamic scenarios is more challenging, since gaze-stabilizing eye movements need to be reliably distinguished from non-fixational gaze shifts. Here, we propose several strategies for enhancing existing algorithms developed for fixation detection in the static case to allow for robust fixation detection in dynamic real-world scenarios recorded with head-mounted eye trackers. Specifically, we consider (i) an optic-flow-based compensation stage explicitly accounting for stabilizing eye movements during head motion, (ii) an adaptive adjustment of algorithm sensitivity according to head-motion intensity, and (iii) a coherent tuning of all algorithm parameters. Introducing a new hand-labeled dataset, recorded with the Pupil Invisible glasses by Pupil Labs, we investigate their individual contributions. The dataset comprises both static and dynamic scenarios and is made publicly available. We show that a combination of all proposed strategies improves standard thresholding algorithms and outperforms previous approaches to fixation detection in head-mounted eye tracking.

A Multi-Modal Classification Method for Early Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease Using Three Paradigms With Various Task Difficulties

Alzheimer's Disease (AD) accounts for the majority of dementia, and Mild Cognitive Impairment (MCI) is the early stage of AD. Early and accurate diagnosis of dementia plays a vital role in more targeted treatments and effectively halting disease progression. However, the clinical diagnosis of dementia requires various examinations, which are expensive and require a high level of expertise from the doctor. In this paper, we proposed a classification method based on multi-modal data including Electroencephalogram (EEG), eye tracking and behavioral data for early diagnosis of AD and MCI. Paradigms with various task difficulties were used to identify different severity of dementia: eye movement task and resting-state EEG tasks were used to detect AD, while eye movement task and delayed match-to-sample task were used to detect MCI. Besides, the effects of different features were compared and suitable EEG channels were selected for the detection. Furthermore, we proposed a data augmentation method to enlarge the dataset, designed an extra ERPNet feature extract layer to extract multi-modal features and used domain-adversarial neural network to improve the performance of MCI diagnosis. We achieved an average accuracy of 88.81% for MCI diagnosis and 100% for AD diagnosis. The results of this paper suggest that our classification method can provide a feasible and affordable way to diagnose dementia.

ACE-DNV: Automatic classification of gaze events in dynamic natural viewing

Eye movements offer valuable insights for clinical interventions, diagnostics, and understanding visual perception. The process usually involves recording a participant's eye movements and analyzing them in terms of various gaze events. Manual identification of these events is extremely time-consuming. Although the field has seen the development of automatic event detection and classification methods, these methods have primarily focused on distinguishing events when participants remain stationary. With increasing interest in studying gaze behavior in freely moving participants, such as during daily activities like walking, new methods are required to automatically classify events in data collected under unrestricted conditions. Existing methods often rely on additional information from depth cameras or inertial measurement units (IMUs), which are not typically integrated into mobile eye trackers. To address this challenge, we present a framework for classifying gaze events based solely on eye-movement signals and scene video footage. Our approach, the Automatic Classification of gaze Events in Dynamic and Natural Viewing (ACE-DNV), analyzes eye movements in terms of velocity and direction and leverages visual odometry to capture head and body motion. Additionally, ACE-DNV assesses changes in image content surrounding the point of gaze. We evaluate the performance of ACE-DNV using a publicly available dataset and showcased its ability to discriminate between gaze fixation, gaze pursuit, gaze following, and gaze shifting (saccade) events. ACE-DNV exhibited comparable performance to previous methods, while eliminating the necessity for additional devices such as IMUs and depth cameras. In summary, ACE-DNV simplifies the automatic classification of gaze events in natural and dynamic environments. The source code is accessible at https://github.com/arnejad/ACE-DNV .

Eye-Tracking Technology in Dentistry: A Review of Literature

This narrative review explores the integration of eye-tracking technology in dentistry, aiming to provide a comprehensive overview of its current applications and potential benefits. The review begins by elucidating the fundamental principles of eye tracking, encompassing the various eye-tracking methods and devices commonly used in dental research. It then delves into the role of eye tracking in dental education, where the technology offers a unique perspective on students' visual attention during training and skill acquisition. Moreover, the review examines how eye tracking can aid in assessing and improving dental practitioners' clinical performance, shedding light on areas of improvement and expertise. In patient care, the application of eye-tracking technology offers significant potential. By analyzing patients' gaze patterns and visual focus during dental procedures, clinicians can gain valuable insights into their experiences, identifying sources of anxiety and discomfort. This newfound understanding can pave the way for more patient-centric care and optimized treatment plans. The review also explores the application of eye-tracking technology in designing and evaluating dental interfaces and equipment. By assessing visual ergonomics and usability, researchers can develop user-friendly instruments that enhance dental professionals' workflow and efficiency. However, despite its promise, integrating eye tracking in dentistry is not without challenges. Technical limitations, data analysis complexities, and ethical considerations require careful attention to ensure this technology's ethical and responsible use. In conclusion, this narrative review highlights the growing significance of eye-tracking technology in dentistry. Its applications span dental education, clinical practice, and patient care, holding immense potential to revolutionize how dental procedures are conducted, evaluated, and experienced. Nevertheless, further research and collaboration between dental professionals and eye-tracking experts are necessary to unlock the technology's benefits and ensure its seamless integration into dental practices.

What can entropy metrics tell us about the characteristics of ocular fixation trajectories?

In this study, we provide a detailed analysis of entropy measures calculated for fixation eye movement trajectories from the three different datasets. We employed six key metrics (Fuzzy, Increment, Sample, Gridded Distribution, Phase, and Spectral Entropies). We calculate these six metrics on three sets of fixations: (1) fixations from the GazeCom dataset, (2) fixations from what we refer to as the "Lund" dataset, and (3) fixations from our own research laboratory ("OK Lab" dataset). For each entropy measure, for each dataset, we closely examined the 36 fixations with the highest entropy and the 36 fixations with the lowest entropy. From this, it was clear that the nature of the information from our entropy metrics depended on which dataset was evaluated. These entropy metrics found various types of misclassified fixations in the GazeCom dataset. Two entropy metrics also detected fixation with substantial linear drift. For the Lund dataset, the only finding was that low spectral entropy was associated with what we call "bumpy" fixations. These are fixations with low-frequency oscillations. For the OK Lab dataset, three entropies found fixations with high-frequency noise which probably represent ocular microtremor. In this dataset, one entropy found fixations with linear drift. The between-dataset results are discussed in terms of the number of fixations in each dataset, the different eye movement stimuli employed, and the method of eye movement classification.

Characterizing Eye Gaze for Assistive Device Control

Eye gaze tracking is increasingly popular due to improved technology and availability. However, in assistive device control, eye gaze tracking is often limited to discrete control inputs. In this paper, we present a method for collecting both reactionary and control eye gaze signals to build an individualized characterization for eye gaze interface use. Results from a study conducted with motor-impaired participants are presented, offering insights into maximizing the potential of eye gaze for assistive device control. These findings can inform the development of continuous control paradigms using eye gaze.