1
|
Shteinberg O, Agdarov S, Beiderman Y, Bonneh YS, Ziv I, Zalevsky Z. Microsaccades Tracking by Secondary Speckle Pattern Analysis. JOURNAL OF BIOPHOTONICS 2024:e202400184. [PMID: 39246222 DOI: 10.1002/jbio.202400184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2024] [Revised: 08/13/2024] [Accepted: 08/14/2024] [Indexed: 09/10/2024]
Abstract
Here we propose a not pupil-dependent microsaccades tracking technique and a novel detection method. We present a proof of concept for detecting microsaccades using a non-contact laser-based photonic system recording and processing the temporal changes of speckle patterns scattered from an eye sclera. The data, simultaneously recorded by the speckle-based tracker (SBT) and the video-based eye tracker (Eyelink), was analyzed by the frequently used detection method of Engbert and Kliegl (E&K) and by advanced machine learning detection (MLD) techniques. We detected 93% of microsaccades in the SBT data out of microsaccades detected in the Eyelink data with the E&K method. By utilizing MLD, a precision of 86% was achieved. The findings of our study demonstrate a potential improvement in measuring tiny eye movements, such as microsaccades, using speckle-based eye tracking and, thus, an alternative to video-based eye tracking for detecting microsaccades.
Collapse
Affiliation(s)
- Ola Shteinberg
- Faculty of Engineering, Bar-Ilan University, Ramat Gan, Israel
| | - Sergey Agdarov
- Faculty of Engineering, Bar-Ilan University, Ramat Gan, Israel
| | - Yafim Beiderman
- Faculty of Engineering, Bar-Ilan University, Ramat Gan, Israel
| | - Yoram S Bonneh
- School of Optometry and Vision Science, Faculty of Life Science, Bar-Ilan University, Ramat Gan, Israel
- The Leslie and Susan Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
| | - Inbal Ziv
- School of Optometry and Vision Science, Faculty of Life Science, Bar-Ilan University, Ramat Gan, Israel
| | - Zeev Zalevsky
- Faculty of Engineering, Bar-Ilan University, Ramat Gan, Israel
| |
Collapse
|
2
|
Kreyenmeier P, Bhuiyan I, Gian M, Chow HM, Spering M. Smooth pursuit inhibition reveals audiovisual enhancement of fast movement control. J Vis 2024; 24:3. [PMID: 38558158 PMCID: PMC10996987 DOI: 10.1167/jov.24.4.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 02/03/2024] [Indexed: 04/04/2024] Open
Abstract
The sudden onset of a visual object or event elicits an inhibition of eye movements at latencies approaching the minimum delay of visuomotor conductance in the brain. Typically, information presented via multiple sensory modalities, such as sound and vision, evokes stronger and more robust responses than unisensory information. Whether and how multisensory information affects ultra-short latency oculomotor inhibition is unknown. In two experiments, we investigate smooth pursuit and saccadic inhibition in response to multisensory distractors. Observers tracked a horizontally moving dot and were interrupted by an unpredictable visual, auditory, or audiovisual distractor. Distractors elicited a transient inhibition of pursuit eye velocity and catch-up saccade rate within ∼100 ms of their onset. Audiovisual distractors evoked stronger oculomotor inhibition than visual- or auditory-only distractors, indicating multisensory response enhancement. Multisensory response enhancement magnitudes were equal to the linear sum of responses to component stimuli. These results demonstrate that multisensory information affects eye movements even at ultra-short latencies, establishing a lower time boundary for multisensory-guided behavior. We conclude that oculomotor circuits must have privileged access to sensory information from multiple modalities, presumably via a fast, subcortical pathway.
Collapse
Affiliation(s)
- Philipp Kreyenmeier
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, British Columbia, Canada
- Graduate Program in Neuroscience, University of British Columbia, Vancouver, British Columbia, Canada
| | - Ishmam Bhuiyan
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Mathew Gian
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Hiu Mei Chow
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, British Columbia, Canada
- Department of Psychology, St. Thomas University, Fredericton, New Brunswick, Canada
| | - Miriam Spering
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, British Columbia, Canada
- Graduate Program in Neuroscience, University of British Columbia, Vancouver, British Columbia, Canada
- Djavad Mowafaghian Center for Brain Health, University of British Columbia, BC, Vancouver, Canada
- Institute for Computing, Information, and Cognitive Systems, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
3
|
Kadosh O, Inbal K, Snir H, Bonneh YS. Oculomotor inhibition markers of working memory load. Sci Rep 2024; 14:1872. [PMID: 38253785 PMCID: PMC10803752 DOI: 10.1038/s41598-024-52518-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Accepted: 01/19/2024] [Indexed: 01/24/2024] Open
Abstract
Involuntary eye movements occur constantly even during fixation and were shown to convey information about cognitive processes. They are inhibited momentarily in response to external stimuli (oculomotor inhibition, OMI), with a time and magnitude that depend on stimulus saliency, attention, and expectations. It was recently shown that the working memory load for numbers modulates the microsaccade rate; however, the generality of the effect and its temporal properties remain unclear. Our goal was to investigate the relationship between OMI and the working memory load for simple colored shapes. Participants (N = 26) maintained their fixation while their eyes were tracked; they viewed briefly flashed colored shapes accompanied by small arrows indicating the shapes to be memorized (1/2/3). After a retention period, a probe shape appeared for matching. The microsaccade rate modulation and temporal properties were analyzed for the memory encoding, maintenance, and retrieval phases. Microsaccade inhibition was stronger when more shapes were memorized, and performance improved when microsaccades were suppressed during maintenance and retrieval. This occurred even though the physical stimuli were identical in number under all conditions. Thus, oculomotor inhibition may play a role in silencing the visual input while processing current stimuli and is generally related to processing time and load.
Collapse
Affiliation(s)
- Oren Kadosh
- School of Optometry and Vision Science, Faculty of Life Sciences, Bar-Ilan University, Ramat Gan, Israel
| | - Kfir Inbal
- School of Optometry and Vision Science, Faculty of Life Sciences, Bar-Ilan University, Ramat Gan, Israel
| | - Hadar Snir
- School of Optometry and Vision Science, Faculty of Life Sciences, Bar-Ilan University, Ramat Gan, Israel
| | - Yoram S Bonneh
- School of Optometry and Vision Science, Faculty of Life Sciences, Bar-Ilan University, Ramat Gan, Israel.
- The Leslie and Susan Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan, Israel.
| |
Collapse
|
4
|
Takahashi M, Veale R. Pathways for Naturalistic Looking Behavior in Primate I: Behavioral Characteristics and Brainstem Circuits. Neuroscience 2023; 532:133-163. [PMID: 37776945 DOI: 10.1016/j.neuroscience.2023.09.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 09/09/2023] [Accepted: 09/18/2023] [Indexed: 10/02/2023]
Abstract
Organisms control their visual worlds by moving their eyes, heads, and bodies. This control of "gaze" or "looking" is key to survival and intelligence, but our investigation of the underlying neural mechanisms in natural conditions is hindered by technical limitations. Recent advances have enabled measurement of both brain and behavior in freely moving animals in complex environments, expanding on historical head-fixed laboratory investigations. We juxtapose looking behavior as traditionally measured in the laboratory against looking behavior in naturalistic conditions, finding that behavior changes when animals are free to move or when stimuli have depth or sound. We specifically focus on the brainstem circuits driving gaze shifts and gaze stabilization. The overarching goal of this review is to reconcile historical understanding of the differential neural circuits for different "classes" of gaze shift with two inconvenient truths. (1) "classes" of gaze behavior are artificial. (2) The neural circuits historically identified to control each "class" of behavior do not operate in isolation during natural behavior. Instead, multiple pathways combine adaptively and non-linearly depending on individual experience. While the neural circuits for reflexive and voluntary gaze behaviors traverse somewhat independent brainstem and spinal cord circuits, both can be modulated by feedback, meaning that most gaze behaviors are learned rather than hardcoded. Despite this flexibility, there are broadly enumerable neural pathways commonly adopted among primate gaze systems. Parallel pathways which carry simultaneous evolutionary and homeostatic drives converge in superior colliculus, a layered midbrain structure which integrates and relays these volitional signals to brainstem gaze-control circuits.
Collapse
Affiliation(s)
- Mayu Takahashi
- Department of Systems Neurophysiology, Graduate School of Medical and Dental, Sciences, Tokyo Medical and Dental University, Japan.
| | - Richard Veale
- Department of Neurobiology, Graduate School of Medicine, Kyoto University, Japan
| |
Collapse
|
5
|
Khademi F, Zhang T, Baumann MP, Buonocore A, Malevich T, Yu Y, Hafed ZM. Visual feature tuning properties of stimulus-driven saccadic inhibition in macaque monkeys. J Neurophysiol 2023; 130:1282-1302. [PMID: 37818591 DOI: 10.1152/jn.00289.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 10/03/2023] [Accepted: 10/03/2023] [Indexed: 10/12/2023] Open
Abstract
Saccadic inhibition refers to a short-latency transient cessation of saccade generation after visual sensory transients. This oculomotor phenomenon occurs with a latency that is consistent with a rapid influence of sensory responses, such as stimulus-induced visual bursts, on oculomotor control circuitry. However, the neural mechanisms underlying saccadic inhibition are not well understood. Here, we exploited the fact that macaque monkeys experience robust saccadic inhibition to test the hypothesis that inhibition time and strength exhibit systematic visual feature tuning properties to a multitude of visual feature dimensions commonly used in vision science. We measured saccades in three monkeys actively controlling their gaze on a target, and we presented visual onset events at random times. Across seven experiments, the visual onsets tested size, spatial frequency, contrast, orientation, motion direction, and motion speed dependencies of saccadic inhibition. We also investigated how inhibition might depend on the behavioral relevance of the appearing stimuli. We found that saccadic inhibition starts earlier, and is stronger, for large stimuli of low spatial frequencies and high contrasts. Moreover, saccadic inhibition timing depends on motion direction and orientation, with earlier inhibition systematically occurring for horizontally drifting vertical gratings. On the other hand, saccadic inhibition is stronger for faster motions and when the appearing stimuli are subsequently foveated. Besides documenting a range of feature tuning dimensions of saccadic inhibition to the properties of exogenous visual stimuli, our results establish macaque monkeys as an ideal model system for unraveling the neural mechanisms underlying a ubiquitous oculomotor phenomenon in visual neuroscience.NEW & NOTEWORTHY Visual onsets dramatically reduce saccade generation likelihood with very short latencies. Such latencies suggest that stimulus-induced visual responses, normally jump-starting perceptual and scene analysis processes, can also directly impact the decision of whether to generate saccades or not, causing saccadic inhibition. Consistent with this, we found that changing the appearance of the visual onsets systematically alters the properties of saccadic inhibition. These results constrain neurally inspired models of coordination between saccade generation and exogenous sensory stimulation.
Collapse
Affiliation(s)
- Fatemeh Khademi
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Tong Zhang
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Antimo Buonocore
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
- Department of Educational, Psychological and Communication Sciences, Suor Orsola Benincasa University, Naples, Italy
| | - Tatiana Malevich
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Yue Yu
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| |
Collapse
|
6
|
Face familiarity revealed by fixational eye movements and fixation-related potentials in free viewing. Sci Rep 2022; 12:20178. [PMID: 36418497 PMCID: PMC9684544 DOI: 10.1038/s41598-022-24603-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Accepted: 11/17/2022] [Indexed: 11/25/2022] Open
Abstract
Event-related potentials (ERPs) and the oculomotor inhibition (OMI) in response to visual transients are known to be sensitive to stimulus properties, attention, and expectation. We have recently found that the OMI is also sensitive to face familiarity. In natural vision, stimulation of the visual cortex is generated primarily by saccades, and it has been recently suggested that fixation-related potentials (FRPs) share similar components with the ERPs. Here, we investigated whether FRPs and microsaccade inhibition (OMI) in free viewing are sensitive to face familiarity. Observers freely watched a slideshow of seven unfamiliar and one familiar facial images presented randomly for 4-s periods, with multiple images per identity. We measured the occipital fixation-related N1 relative to the P1 magnitude as well as the associated fixation-triggered OMI. We found that the average N1-P1 was significantly smaller and the OMI was shorter for the familiar face, compared with any of the seven unfamiliar faces. Moreover, the P1 was suppressed across saccades for the familiar but not for the unfamiliar faces. Our results highlight the sensitivity of the occipital FRPs to stimulus properties such as face familiarity and advance our understanding of the integration process across successive saccades in natural vision.
Collapse
|
7
|
Fixation-related saccadic inhibition in free viewing in response to stimulus saliency. Sci Rep 2022; 12:6619. [PMID: 35459790 PMCID: PMC9033846 DOI: 10.1038/s41598-022-10605-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Accepted: 04/11/2022] [Indexed: 01/04/2023] Open
Abstract
Microsaccades that occur during fixation were studied extensively in response to transient stimuli, showing a typical inhibition (Oculomotor Inhibition, OMI), and a later release with a latency that depends on stimulus saliency, attention, and expectations. Here, we investigated the hypothesis that in free viewing every saccade provides a new transient stimulation that should result in a stimulus-dependent OMI like a flashed presentation during fixation. Participants (N = 16) freely inspected static displays of randomly oriented Gabor texture images, with varied contrast and spatial frequency (SF) for periods of 10 s each. Eye tracking recordings were divided into epochs triggered by saccade landing (> 1 dva), and microsaccade latency relative to fixation onset was computed (msRT). We found that the msRT in free viewing was shorter for more salient stimuli (higher contrast or lower SF), as previously found for flashed stimuli. It increased with saccade size and decreased across successive saccades, but only for higher contrast, suggesting contrast-dependent repetition enhancement in free viewing. Our results indicate that visual stimulus-dependent inhibition of microsaccades also applies to free viewing. These findings are in agreement with the similarity found between event-related and fixation-related potentials and open the way for studies combining both approaches to study natural vision.
Collapse
|
8
|
Salinas E, Stanford TR. Under time pressure, the exogenous modulation of saccade plans is ubiquitous, intricate, and lawful. Curr Opin Neurobiol 2021; 70:154-162. [PMID: 34818614 PMCID: PMC8688226 DOI: 10.1016/j.conb.2021.10.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 09/29/2021] [Accepted: 10/27/2021] [Indexed: 11/21/2022]
Abstract
The choice of where to look next is determined by both exogenous (bottom-up) and endogenous (top-down) factors, but details of their interaction and distinct contributions to target selection have remained elusive. Recent experiments with urgent choice tasks, in which stimuli are evaluated while motor plans are already advancing, have greatly clarified these contributions. Specifically, exogenous modulations associated with stimulus detection act rapidly and briefly (∼25 ms) to automatically halt and/or boost ongoing motor plans as per spatial congruence rules. These stereotypical modulations explain, in quantitative detail, characteristic features of many saccadic tasks (e.g. antisaccade, countermanding, saccadic-inhibition, gap, and double-step). Thus, the same low-level visuomotor interactions contribute to diverse oculomotor phenomena traditionally attributed to different neural mechanisms.
Collapse
Affiliation(s)
- Emilio Salinas
- Department of Neurobiology & Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC, 27157-1010, USA.
| | - Terrence R Stanford
- Department of Neurobiology & Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC, 27157-1010, USA
| |
Collapse
|