1
|
Dai W, Selesnick I, Rizzo JR, Rucker J, Hudson T. Detection of normal and slow saccades using implicit piecewise polynomial approximation. J Vis 2021; 21:8. [PMID: 34125160 PMCID: PMC8212426 DOI: 10.1167/jov.21.6.8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The quantitative analysis of saccades in eye movement data unveils information associated with intention, cognition, and health status. Abnormally slow saccades are indicative of neurological disorders and often imply a specific pathological disturbance. However, conventional saccade detection algorithms are not designed to detect slow saccades, and are correspondingly unreliable when saccades are unusually slow. In this article, we propose an algorithm that is effective for the detection of both normal and slow saccades. The proposed algorithm is partly based on modeling saccadic waveforms as piecewise-quadratic signals. The algorithm first decreases noise in acquired eye-tracking data using optimization to minimize a prescribed objective function, then uses velocity thresholding to detect saccades. Using both simulated saccades and real saccades generated by healthy subjects and patients, we evaluate the performance of the proposed algorithm and 10 other detection algorithms. We show the proposed algorithm is more accurate in detecting both normal and slow saccades than other algorithms.
Collapse
Affiliation(s)
- Weiwei Dai
- Department of Electrical and Computer Engineering, Tandon School of Engineering, New York University, Brooklyn, NY, USA.,
| | - Ivan Selesnick
- Department of Electrical and Computer Engineering, Tandon School of Engineering, New York University, Brooklyn, NY, USA.,
| | - John-Ross Rizzo
- Department of Neurology, School of Medicine, New York University, New York, NY, USA.,
| | - Janet Rucker
- Department of Neurology, School of Medicine, New York University, New York, NY, USA.,
| | - Todd Hudson
- Department of Neurology, School of Medicine, New York University, New York, NY, USA.,
| |
Collapse
|
2
|
Voloh B, Watson MR, König S, Womelsdorf T. MAD saccade: statistically robust saccade threshold estimation via the median absolute deviation. J Eye Mov Res 2020; 12:10.16910/jemr.12.8.3. [PMID: 33828776 PMCID: PMC7881893 DOI: 10.16910/jemr.12.8.3] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Saccade detection is a critical step in the analysis of gaze data. A common method for saccade detection is to use a simple threshold for velocity or acceleration values, which can be estimated from the data using the mean and standard deviation. However, this method has the downside of being influenced by the very signal it is trying to detect, the outlying velocities or accelerations that occur during saccades. We propose instead to use the median absolute deviation (MAD), a robust estimator of dispersion that is not influenced by outliers. We modify an algorithm proposed by Nyström and colleagues, and quantify saccade detection performance in both simulated and human data. Our modified algorithm shows a significant and marked improvement in saccade detection - showing both more true positives and less false negatives - especially under higher noise levels. We conclude that robust estimators can be widely adopted in other common, automatic gaze classification algorithms due to their ease of implementation.
Collapse
|
3
|
Zhu H, Salcudean S, Rohling R. The Neyman Pearson detection of microsaccades with maximum likelihood estimation of parameters. J Vis 2019; 19:17. [DOI: 10.1167/19.13.17] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Hongzhi Zhu
- School of Biomedical Engineering, University of British Columbia, Vancouver, BC, Canada
| | - Septimiu Salcudean
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada
- ://www.ece.ubc.ca/faculty/tim-salcudean
| | - Robert Rohling
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada
- ://www.ece.ubc.ca/faculty/robert-rohling
| |
Collapse
|
4
|
Bellet ME, Bellet J, Nienborg H, Hafed ZM, Berens P. Human-level saccade detection performance using deep neural networks. J Neurophysiol 2018; 121:646-661. [PMID: 30565968 DOI: 10.1152/jn.00601.2018] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Saccades are ballistic eye movements that rapidly shift gaze from one location of visual space to another. Detecting saccades in eye movement recordings is important not only for studying the neural mechanisms underlying sensory, motor, and cognitive processes, but also as a clinical and diagnostic tool. However, automatically detecting saccades can be difficult, particularly when such saccades are generated in coordination with other tracking eye movements, like smooth pursuits, or when the saccade amplitude is close to eye tracker noise levels, like with microsaccades. In such cases, labeling by human experts is required, but this is a tedious task prone to variability and error. We developed a convolutional neural network to automatically detect saccades at human-level accuracy and with minimal training examples. Our algorithm surpasses state of the art according to common performance metrics and could facilitate studies of neurophysiological processes underlying saccade generation and visual processing. NEW & NOTEWORTHY Detecting saccades in eye movement recordings can be a difficult task, but it is a necessary first step in many applications. We present a convolutional neural network that can automatically identify saccades with human-level accuracy and with minimal training examples. We show that our algorithm performs better than other available algorithms, by comparing performance on a wide range of data sets. We offer an open-source implementation of the algorithm as well as a web service.
Collapse
Affiliation(s)
- Marie E Bellet
- Institute for Ophthalmic Research, University of Tübingen , Tübingen , Germany
| | - Joachim Bellet
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen , Tübingen , Germany.,International Max Planck Research School for Cognitive and Systems Neuroscience , Tübingen , Germany.,Hertie Institute for Clinical Brain Research, University of Tübingen , Tübingen , Germany
| | - Hendrikje Nienborg
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen , Tübingen , Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen , Tübingen , Germany.,Hertie Institute for Clinical Brain Research, University of Tübingen , Tübingen , Germany
| | - Philipp Berens
- Institute for Ophthalmic Research, University of Tübingen , Tübingen , Germany.,Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen , Tübingen , Germany.,Bernstein Center for Computational Neuroscience , Tübingen , Germany
| |
Collapse
|
5
|
Sheynikhovich D, Bécu M, Wu C, Arleo A. Unsupervised detection of microsaccades in a high-noise regime. J Vis 2018; 18:19. [PMID: 30029229 DOI: 10.1167/18.6.19] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Micromovements of the eye during visual fixations provide clues about how our visual system acquires information. The analysis of fixational eye movements can thus serve as a noninvasive means to detect age-related or pathological changes in visual processing, which can in turn reflect associated cognitive or neurological disorders. However, the utility of such diagnostic approaches relies on the quality and usability of detection methods applied for the eye movement analysis. Here, we propose a novel method for (micro)saccade detection that is resistant to high-frequency recording noise, a frequent problem in video-based eye tracking in either aged subjects or subjects suffering from a vision-related pathology. The method is fast, it does not require manual noise removal, and it can work with position, velocity, or acceleration features, or a combination thereof. The detection accuracy of the proposed method is assessed on a new dataset of manually labeled recordings acquired from 14 subjects of advanced age (69-81 years old), performing an ocular fixation task. It is demonstrated that the detection accuracy of the new method compares favorably to that of two frequently used reference methods and that it is comparable to the best of the two algorithms when tested on an existing low-noise eye-tracking dataset.
Collapse
Affiliation(s)
| | - Marcia Bécu
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
| | - Changmin Wu
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
| | - Angelo Arleo
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
| |
Collapse
|
6
|
Becerra-García R, García-Bermúdez R, Joya-Caparrós G, Fernández-Higuera A, Velázquez-Rodríguez C, Velázquez-Mariño M, Cuevas-Beltrán F, García-Lagos F, Rodráguez-Labrada R. Data mining process for identification of non-spontaneous saccadic movements in clinical electrooculography. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2016.10.077] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
7
|
Abstract
Microsaccades are high-velocity fixational eye movements, with special roles in perception and cognition. The default microsaccade detection method is to determine when the smoothed eye velocity exceeds a threshold. We have developed a new method, Bayesian microsaccade detection (BMD), which performs inference based on a simple statistical model of eye positions. In this model, a hidden state variable changes between drift and microsaccade states at random times. The eye position is a biased random walk with different velocity distributions for each state. BMD generates samples from the posterior probability distribution over the eye state time series given the eye position time series. Applied to simulated data, BMD recovers the “true” microsaccades with fewer errors than alternative algorithms, especially at high noise. Applied to EyeLink eye tracker data, BMD detects almost all the microsaccades detected by the default method, but also apparent microsaccades embedded in high noise—although these can also be interpreted as false positives. Next we apply the algorithms to data collected with a Dual Purkinje Image eye tracker, whose higher precision justifies defining the inferred microsaccades as ground truth. When we add artificial measurement noise, the inferences of all algorithms degrade; however, at noise levels comparable to EyeLink data, BMD recovers the “true” microsaccades with 54% fewer errors than the default algorithm. Though unsuitable for online detection, BMD has other advantages: It returns probabilities rather than binary judgments, and it can be straightforwardly adapted as the generative model is refined. We make our algorithm available as a software package.
Collapse
Affiliation(s)
- Andra Mihali
- Center for Neural Science, New York University, New York, NY,
| | | | - Wei Ji Ma
- Center for Neural Science, New York University, New York, NY, USADepartment of Psychology, New York University, New York, NY,
| |
Collapse
|
8
|
Abstract
Recent years have witnessed a remarkable growth in the way mathematics, informatics, and computer science can process data. In disciplines such as machine learning,
pattern recognition, computer vision, computational neurology, molecular biology,
information retrieval, etc., many new methods have been developed to cope with the
ever increasing amount and complexity of the data. These new methods offer interesting possibilities for processing, classifying and interpreting eye-tracking data. The
present paper exemplifies the application of topological arguments to improve the
evaluation of eye-tracking data. The task of classifying raw eye-tracking data into
saccades and fixations, with a single, simple as well as intuitive argument, described
as coherence of spacetime, is discussed, and the hierarchical ordering of the fixations
into dwells is shown. The method, namely identification by topological characteristics
(ITop), is parameter-free and needs no pre-processing and post-processing of the raw
data. The general and robust topological argument is easy to expand into complex
settings of higher visual tasks, making it possible to identify visual strategies.
Collapse
Affiliation(s)
- Oliver Hein
- Neurological University Clinic Hamburg UKE, Germany
| | | |
Collapse
|
9
|
Hainque E, Apartis E, Daye PM. Switching between two targets with non-constant velocity profiles reveals shared internal model of target motion. Eur J Neurosci 2016; 44:2622-2634. [PMID: 27529455 DOI: 10.1111/ejn.13370] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2015] [Revised: 07/24/2016] [Accepted: 08/03/2016] [Indexed: 11/27/2022]
Abstract
Several experiments have shown that smooth pursuit and saccades interact while tracking an object moving across the visual scene. It was proposed two decades ago that the amplitude of saccades triggered during smooth pursuit ('catch-up saccades') were corrected by a delayed sensory signal to account for the ongoing target displacement during catch-up saccades. However, recent studies used targets with non-constant velocity profiles and suggested that the correction of catch-up saccade amplitude must be done through an internal model of target motion. It is widely accepted that an internal model of target motion is also used by the central nervous system (CNS) to cancel inherent delays between visual input and smooth pursuit motor output, ensuring accurate tracking of moving targets. Our study proposes a new paradigm in which the target switches unexpectedly from one target with a non-constant periodic velocity profile to another with a non-constant aperiodic velocity profile. Our results confirm the hypothesis that the CNS uses an internal model of target motion to correct catch-up saccade amplitude. In addition, we reconcile the sensory delayed and the internal model of target motion hypotheses and show that a common internal model of target motion is shared within the CNS to control smooth pursuit and to correct catch-up saccade amplitude.
Collapse
Affiliation(s)
- E Hainque
- ICM, UMR 7225, UMRS 1127, CNRS-INSERM-UPMC, 47 Boulevard de l'Hopital, 75013, Paris, France.,Assistance Publique Hôpitaux de Paris (AP-HP), Department of Neurophysiology, Saint-Antoine Hospital, Paris, France
| | - E Apartis
- ICM, UMR 7225, UMRS 1127, CNRS-INSERM-UPMC, 47 Boulevard de l'Hopital, 75013, Paris, France.,Assistance Publique Hôpitaux de Paris (AP-HP), Department of Neurophysiology, Saint-Antoine Hospital, Paris, France
| | - P M Daye
- ICM, UMR 7225, UMRS 1127, CNRS-INSERM-UPMC, 47 Boulevard de l'Hopital, 75013, Paris, France.
| |
Collapse
|