1
|
Yang B, Intoy J, Rucci M. Eye blinks as a visual processing stage. Proc Natl Acad Sci U S A 2024; 121:e2310291121. [PMID: 38564641 PMCID: PMC11009678 DOI: 10.1073/pnas.2310291121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 02/12/2024] [Indexed: 04/04/2024] Open
Abstract
Humans blink their eyes frequently during normal viewing, more often than it seems necessary for keeping the cornea well lubricated. Since the closure of the eyelid disrupts the image on the retina, eye blinks are commonly assumed to be detrimental to visual processing. However, blinks also provide luminance transients rich in spatial information to neural pathways highly sensitive to temporal changes. Here, we report that the luminance modulations from blinks enhance visual sensitivity. By coupling high-resolution eye tracking in human observers with modeling of blink transients and spectral analysis of visual input signals, we show that blinking increases the power of retinal stimulation and that this effect significantly enhances visibility despite the time lost in exposure to the external scene. We further show that, as predicted from the spectral content of input signals, this enhancement is selective for stimuli at low spatial frequencies and occurs irrespective of whether the luminance transients are actively generated or passively experienced. These findings indicate that, like eye movements, blinking acts as a computational component of a visual processing strategy that uses motor behavior to reformat spatial information into the temporal domain.
Collapse
Affiliation(s)
- Bin Yang
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY14627
- Center for Visual Science, University of Rochester, Rochester, NY14627
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY14627
- Center for Visual Science, University of Rochester, Rochester, NY14627
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY14627
- Center for Visual Science, University of Rochester, Rochester, NY14627
| |
Collapse
|
2
|
Cox MA, Clark AM, Intoy J, Moon B, Wu RJ, Victor JD, Rucci M. Poster Session: Oculomotor influences on retinal input signals in myopia. J Vis 2023; 23:42. [PMID: 37733536 DOI: 10.1167/jov.23.11.42] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/23/2023] Open
Abstract
Studies of emmetropization have traditionally focused on the spatial characteristics of visual input signals. Yet the input to the retina is not a two-dimensional pattern but a temporally-varying luminance flow. The temporal structure of this flow is predominately determined by eye movements, as the human eyes move incessantly. Even when fixating on a single point, a persistent motion known as ocular drift reformats the luminance flow in a way that counterbalances the spectra of natural scenes. It is established that emmetropes are highly sensitive to these luminance modulations. However, their visual consequences in myopia and hyperopia are unknown. Here, we first review how the temporal-frequency distribution of retinal input signals varies with the amount of ocular drift. We then use a detailed optical/geometrical model of the eye to study how the eye movements jointly shape retinal input as a function of refraction. We show that, within the temporal range of sensitivity of the retina, the spatial frequency distribution of the input signals conveys signed information about defocus. Specifically, for a given degree of defocus, myopic retinas experience more power from low spatial frequency stimuli than hyperopic retinas. These redistribution of input power may have a consequence during eye growth supporting the proposal that eye movements should be taken into consideration in the process of emmetropization.
Collapse
Affiliation(s)
| | - Ashley M Clark
- Department of Brain and Cognitive Sciences & Center for Visual Science, University of Rochester
| | - Janis Intoy
- Center for Visual Science, University of Rochester
| | - Benjamin Moon
- The Institute of Optics & Center for Visual Science, University of Rochester
| | - Ruei-Jr Wu
- The Institute of Optics & Center for Visual Science, University of Rochester
| | | | - Michele Rucci
- Department of Brain and Cognitive Sciences & Center for Visual Sciences, University of Rochester
| |
Collapse
|
3
|
Li YH, Cox MA, Intoy J, Victor J, Yang B, Zhao Z, Rucci M. Poster Session: Spatial-frequency-selective enhancement of visual sensitivity from saccade dynamics. J Vis 2023; 23:58. [PMID: 37733520 DOI: 10.1167/jov.23.11.58] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/23/2023] Open
Abstract
Eye movements transform a spatial scene into luminance modulations on the retina. Recent work has shown that this transformation is highly structured: within human temporal sensitivity, saccades deliver power that increases in proportion to spatial frequency (SF) up to a critical frequency and remains constant beyond that. Importantly, the critical SF increases with decreasing amplitude. Therefore, at sufficiently low SFs, larger saccades effectively deliver stronger input signals to the retina. Here we tested whether this input reformatting has the predicted perceptual consequences, by examining how large and small saccades (6o & 1o) affect contrast sensitivity. We measured relative sensitivity at two SFs: a reference (0.5 cpd), equal to the critical SF for the small saccade, and a probe at either a lower or higher SF (0.1/2.5 cpd). We predicted that large saccades enhance visibility only when the probe has a lower SF than the reference. Subjects (N=7) made instructed saccades while presented with a plaid of overlapping orthogonal gratings at the two SFs and reported which grating was more visible. Results closely follow theoretical predictions: psychometric functions following small and large saccades only differed with the lower SF probe, in which case the larger saccade significantly enhanced visibility. In sum, saccades enable selectivity not only in the spatial domain, but also in the spatial-frequency domain.
Collapse
Affiliation(s)
| | | | | | - Jonathan Victor
- Feil Family Brain and Mind Research Institute, Weill Cornell Medical College
| | | | | | | |
Collapse
|
4
|
Clark AM, Cox MA, Wu RJ, Intoy J, Rucci M. Poster Session: Fixational Eye Movements in Myopia. J Vis 2023; 23:41. [PMID: 37733537 DOI: 10.1167/jov.23.11.41] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/23/2023] Open
Abstract
During fixation, an incessant drift of the eye keeps the image impinging on the retina always in motion. Previous work indicated that luminance modulations from ocular drift serve important visual functions in emmetropes (Intoy & Rucci, 2020; Clark et al 2022). However, it remains unknown how ocular drift varies under myopia, a visual impairment commonly caused by eye elongation. We measured eye movements in 19 individuals with varying degrees of myopia (-0.25D to -6.5D) using a digital Dual-Purkinje Image eye-tracker, a recently developed system with sub-arcminute resolution. Subjects observed stimuli monocularly with vision corrected via a Badal optometer. They engaged in two high-acuity tasks: (a) resolution of a 20/20 line of an eye chart (5 evenly spaced tumbling E optotypes); and (b) a more natural task where subjects were presented with images of distant faces (1⁰) and asked to report the image's gaze direction. We show ocular drift characteristics differ in myopes relative to emmetropes. Drift was faster and less curved in myopic observers. On the retina, these changes result in luminance modulations that amplify low spatial frequencies at the expense of high spatial frequencies, so that high-frequency signals are effectively weaker in myopes These results are consistent with the proposal that fine spatial vision strongly relies on oculomotor-induced luminance modulations and emphasize the importance of considering fine eye movements in myopia.
Collapse
|
5
|
Wu RJ, Clark AM, Cox MA, Intoy J, Jolly PC, Zhao Z, Rucci M. High-resolution eye-tracking via digital imaging of Purkinje reflections. J Vis 2023; 23:4. [PMID: 37140912 PMCID: PMC10166114 DOI: 10.1167/jov.23.5.4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2023] Open
Abstract
Reliably measuring eye movements and determining where the observer looks are fundamental needs in vision science. A classical approach to achieve high-resolution oculomotor measurements is the so-called dual Purkinje image (DPI) method, a technique that relies on the relative motion of the reflections generated by two distinct surfaces in the eye, the cornea and the back of the lens. This technique has been traditionally implemented in fragile and difficult to operate analog devices, which have remained exclusive use of specialized oculomotor laboratories. Here we describe progress on the development of a digital DPI, a system that builds on recent advances in digital imaging to enable fast, highly precise eye-tracking without the complications of previous analog devices. This system integrates an optical setup with no moving components with a digital imaging module and dedicated software on a fast processing unit. Data from both artificial and human eyes demonstrate subarcminute resolution at 1 kHz. Furthermore, when coupled with previously developed gaze-contingent calibration methods, this system enables localization of the line of sight within a few arcminutes.
Collapse
Affiliation(s)
- Ruei-Jr Wu
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Ashley M Clark
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Michele A Cox
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Janis Intoy
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Paul C Jolly
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Zhetuo Zhao
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Michele Rucci
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| |
Collapse
|
6
|
Lin YC, Intoy J, Clark AM, Rucci M, Victor JD. Cognitive influences on fixational eye movements. Curr Biol 2023; 33:1606-1612.e4. [PMID: 37015221 PMCID: PMC10133196 DOI: 10.1016/j.cub.2023.03.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 01/16/2023] [Accepted: 03/09/2023] [Indexed: 04/05/2023]
Abstract
We perceive the world based on visual information acquired via oculomotor control,1 an activity intertwined with ongoing cognitive processes.2,3,4 Cognitive influences have been primarily studied in the context of macroscopic movements, like saccades and smooth pursuits. However, our eyes are never still, even during periods of fixation. One of the fixational eye movements, ocular drifts, shifts the stimulus over hundreds of receptors on the retina, a motion that has been argued to enhance the processing of spatial detail by translating spatial into temporal information.5 Despite their apparent randomness, ocular drifts are under neural control.6,7,8 However little is known about the control of drift beyond the brainstem circuitry of the vestibulo-ocular reflex.9,10 Here, we investigated the cognitive control of ocular drifts with a letter discrimination task. The experiment was designed to reveal open-loop effects, i.e., cognitive oculomotor control driven by specific prior knowledge of the task, independent of incoming sensory information. Open-loop influences were isolated by randomly presenting pure noise fields (no letters) while subjects engaged in discriminating specific letter pairs. Our results show open-loop control of drift direction in human observers.
Collapse
|
7
|
Wu RJ, Jolly P, Mizobuchi S, Clark AM, Zhao Z, Yang B, Intoy J, Cox MA, Rucci M. High-resolution oculomotor measurements via a digital Dual Purkinje Image eye-tracker. J Vis 2022. [DOI: 10.1167/jov.22.14.4203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
- Ruei-Jr Wu
- Center for Vision Science, University of Rochester
- The Institute of Optics, University of Rochester
| | - Paul Jolly
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Soma Mizobuchi
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Ashley M. Clark
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Zhetuo Zhao
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Bin Yang
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Michele A. Cox
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester
- Center for Vision Science, University of Rochester
| |
Collapse
|
8
|
Li YH, Cox MA, Intoy J, Victor J, Yang B, Zhao Z, Rucci M. Saccade-amplitude dependent enhancement of visual sensitivity. J Vis 2022. [DOI: 10.1167/jov.22.14.4046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
9
|
Intoy J, Carpenter M, Rucci M. Visual and motor contributions to saccadic suppression in the fovea. J Vis 2022. [DOI: 10.1167/jov.22.14.3309] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
10
|
Zhao Z, Li YH, Lin R, Kapisthalam S, Clark AM, Yang B, Intoy J, Cox MA, Rucci M. Task-dependent head-eye coordination during natural fixation. J Vis 2022. [DOI: 10.1167/jov.22.14.4068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
- Zhetuo Zhao
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Yuanhao H. Li
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Ruitao Lin
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Sanjana Kapisthalam
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Ashley M. Clark
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Bin Yang
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Janis Intoy
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Michele A. Cox
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences
- Center for Visual Science, University of Rochester, USA
| |
Collapse
|
11
|
Lin R, Intoy J, Rucci M. Mapping temporal sensitivity across the central fovea. J Vis 2022. [DOI: 10.1167/jov.22.14.4188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
12
|
Lin YC, Intoy J, Clark AM, Rucci M, Victor JD. Cognitive Influences on Ocular Drifts during Visual Discrimination. J Vis 2022. [DOI: 10.1167/jov.22.14.3678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
13
|
Cox MA, Intoy J, Li YH, Murdison S, Yang B, Zhao Z, Rucci M. Oculomotor influences on the dynamics of visual sensitivity. J Vis 2022. [DOI: 10.1167/jov.22.14.4085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
- Michele A. Cox
- Department of Brain and Cognitive Sciences, University of Rochester, USA
- Center for Visual Science, University of Rochester, USA
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, USA
- Center for Visual Science, University of Rochester, USA
| | - Yuanhao H. Li
- Department of Brain and Cognitive Sciences, University of Rochester, USA
- Center for Visual Science, University of Rochester, USA
| | | | - Bin Yang
- Department of Brain and Cognitive Sciences, University of Rochester, USA
- Center for Visual Science, University of Rochester, USA
| | - Zhetuo Zhao
- Department of Brain and Cognitive Sciences, University of Rochester, USA
- Center for Visual Science, University of Rochester, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, USA
- Center for Visual Science, University of Rochester, USA
| |
Collapse
|
14
|
Li Y, Cox MA, Murdison TS, Yang B, Intoy J, Zhao Z, Rucci M. Post-saccadic dynamics of visual sensitivity across the visual field. J Vis 2021. [DOI: 10.1167/jov.21.9.1930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
15
|
Cox MA, Intoy J, Moon B, Wu RJ, Victor JD, Rucci M. Consequences of Eye’s Optics and Geometry for Retinal Image Motion. J Vis 2021. [DOI: 10.1167/jov.21.9.2046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
16
|
Yang B, Cox MA, Li Y, Murdison S, Zhao Z, Intoy J, Rucci M. A Model of the Post-saccadic Dynamics of Visual Sensitivity. J Vis 2021. [DOI: 10.1167/jov.21.9.2558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
17
|
|
18
|
Rucci M, Bowers NR, Victor JD, Poletti M, Intoy J. Luminance modulations from eye movements predict visual sensitivity. J Vis 2021. [DOI: 10.1167/jov.21.9.2204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
19
|
Clark A, Intoy J, Poletti M. Linking individual differences in fixational eye movements and visual acuity. J Vis 2021. [DOI: 10.1167/jov.21.9.2763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
20
|
Intoy J, Victor JD, Rucci M. Active task-dependent control of ocular drift during natural fixation. J Vis 2020. [DOI: 10.1167/jov.20.11.1335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Janis Intoy
- Graduate Program for Neuroscience, Boston University
- Brain & Cognitive Sciences, University of Rochester
- Center for Visual Science, University of Rochester
| | | | - Michele Rucci
- Brain & Cognitive Sciences, University of Rochester
- Center for Visual Science, University of Rochester
| |
Collapse
|
21
|
|
22
|
Yang B, Intoy J, Rucci M. Visual consequences of the luminance transients from eye blinks. J Vis 2020. [DOI: 10.1167/jov.20.11.1357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
23
|
Abstract
Despite recent advances on the mechanisms and purposes of fine oculomotor behavior, a rigorous assessment of the precision and accuracy of the smallest saccades is still lacking. Yet knowledge of how effectively these movements shift gaze is necessary for understanding their functions and is helpful in further elucidating their motor underpinnings. Using a combination of high-resolution eye-tracking and gaze-contingent control, here we examined the accuracy and precision of saccades aimed toward targets ranging from [Formula: see text] to [Formula: see text] eccentricity. We show that even small saccades of just 14-[Formula: see text] are very effective in centering the stimulus on the retina. Furthermore, we show that for a target at any given eccentricity, the probability of eliciting a saccade depends on its efficacy in reducing the foveal offset. The pattern of results reported here is consistent with current knowledge on the motor mechanisms of microsaccade production.
Collapse
Affiliation(s)
- Martina Poletti
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA.
- Department of Neuroscience, University of Rochester, Rochester, NY, 14627, USA.
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA.
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
- Graduate Program for Neuroscience, Boston University, Boston, MA, 02215, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
| |
Collapse
|
24
|
Mostofi N, Zhao Z, Intoy J, Boi M, Victor JD, Rucci M. Spatiotemporal Content of Saccade Transients. Curr Biol 2020; 30:3999-4008.e2. [PMID: 32916116 DOI: 10.1016/j.cub.2020.07.085] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Revised: 07/21/2020] [Accepted: 07/28/2020] [Indexed: 11/25/2022]
Abstract
Humans use rapid gaze shifts, known as saccades, to explore visual scenes. These movements yield abrupt luminance changes on the retina, which elicit robust neural discharges at fixation onsets. Yet little is known about the spatial content of saccade transients. Here, we show that saccades redistribute spatial information within the temporal range of retinal sensitivity following two distinct regimes: saccade modulations counterbalance (whiten) the spectral density of natural scenes at low spatial frequencies and follow the external power distribution at higher frequencies. This redistribution is a consequence of saccade dynamics, particularly the speed/amplitude/duration relation known as the main sequence. It resembles the redistribution resulting from inter-saccadic eye drifts, revealing a continuum in the modulations given by different eye movements, with oculomotor transitions primarily acting by regulating the bandwidth of whitening. Our findings suggest important computational roles for saccade transients in the establishment of spatial representations and lead to testable predictions about their consequences for visual functions and encoding mechanisms.
Collapse
Affiliation(s)
- Naghmeh Mostofi
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA 02215, USA
| | - Zhetuo Zhao
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Meliora Hall, Rochester, NY 14627, USA.
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Graduate Program for Neuroscience, Boston University, 24 Cummington Mall, Boston, MA 02215, USA
| | - Marco Boi
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA 02215, USA
| | - Jonathan D Victor
- Feil Family Brain and Mind Research Institute, Weill Cornell Medical College, 1300 York Avenue, New York, NY 10065, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Meliora Hall, Rochester, NY 14627, USA.
| |
Collapse
|
25
|
Abstract
High visual acuity is essential for many tasks, from recognizing distant friends to driving a car. While much is known about how the eye’s optics and anatomy contribute to spatial resolution, possible influences from eye movements are rarely considered. Yet humans incessantly move their eyes, and it has long been suggested that oculomotor activity enhances fine pattern vision. Here we examine the role of eye movements in the most common assessment of visual acuity, the Snellen eye chart. By precisely localizing gaze and actively controlling retinal stimulation, we show that fixational behavior improves acuity by more than 0.15 logMAR, at least 2 lines of the Snellen chart. This improvement is achieved by adapting both microsaccades and ocular drifts to precisely position the image on the retina and adjust its motion. These findings show that humans finely tune their fixational eye movements so that they greatly contribute to normal visual acuity. Humans are normally not aware that their eyes are always in motion, even when attempting to maintain steady gaze on a point. Here the authors show that these small eye movements are finely controlled and contribute more than two lines in a standard eye-chart test of visual acuity.
Collapse
Affiliation(s)
- Janis Intoy
- Graduate Program for Neuroscience, Boston University, Boston, MA, 02215, USA.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA.,Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA. .,Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA.
| |
Collapse
|
26
|
Cox MA, Bowers NR, Intoy J, Poletti M, Rucci M. Decoupling eye movements from retinal image motion reveals active fixation control. J Vis 2019. [DOI: 10.1167/19.10.148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
| | | | - Janis Intoy
- Center for Visual Science, University of Rochester
- Graduate Program for Neuroscience, Boston University
| | - Martina Poletti
- Center for Visual Science, University of Rochester
- Department of Neurosciences, University of Rochester Medical Center
| | - Michele Rucci
- Center for Visual Science, University of Rochester
- Brain and Cognitive Sciences, University of Rochester
| |
Collapse
|
27
|
Rucci M, Intoy J, Zhao Z, Victor JD. A continuum in the retinal modulations resulting from eye movements. J Vis 2019. [DOI: 10.1167/19.10.122b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Michele Rucci
- Center for Visual Science and Dept. of Brain & Cognitive Sciences, University of Rochester
| | - Janis Intoy
- Center for Visual Science and Dept. of Brain & Cognitive Sciences, University of Rochester
- Graduate Program in Neuroscience, Boston University
| | - Zhetuo Zhao
- Center for Visual Science and Dept. of Brain & Cognitive Sciences, University of Rochester
| | - Jonathan D Victor
- Feil Family Brain and Mind Research Institute and Dept. of Neurology, Weill Cornell Medical College, New York
| |
Collapse
|
28
|
Intoy J, Cox MA, Rucci M. Control and coordination of fixational eye movements in the Snellen acuity test. J Vis 2019. [DOI: 10.1167/19.10.145a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Janis Intoy
- Graduate Program for Neuroscience, Boston University
- Center for Visual Science, University of Rochester
| | | | - Michele Rucci
- Center for Visual Science, University of Rochester
- Department of Brain & Cognitive Sciences, University of Rochester
| |
Collapse
|
29
|
Intoy J, Bowers N, Victor J, Poletti M, Rucci M. The impact of retinal image motion on extrafoveal sensitivity. J Vis 2018. [DOI: 10.1167/18.10.372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Janis Intoy
- Graduate Program for Neuroscience, Boston University
| | | | - Jonathan Victor
- Brain and Mind Research Institute, Weill Cornell Medical College
| | - Martina Poletti
- Department of Neuroscience, University of RochesterThe Center for Visual Science, University of Rochester
| | - Michele Rucci
- Department of Brain & Cognitive Sciences, University of RochesterThe Center for Visual Science, University of Rochester
| |
Collapse
|
30
|
Intoy J, Rucci M. The Role of Microsaccades in the Snellen Acuity Test. J Vis 2017. [DOI: 10.1167/17.10.920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Janis Intoy
- Graduate Program for Neuroscience, Boston University
| | - Michele Rucci
- Graduate Program for Neuroscience, Boston UniversityDepartment of Psychological and Brain Sciences, Boston University
| |
Collapse
|
31
|
Rucci M, Intoy J, Poletti M. Microsaccades and high-acuity vision. J Vis 2017. [DOI: 10.1167/17.7.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
32
|
Saegusa C, Intoy J, Shimojo S. Visual attractiveness is leaky: the asymmetrical relationship between face and hair. Front Psychol 2015; 6:377. [PMID: 25914656 PMCID: PMC4390982 DOI: 10.3389/fpsyg.2015.00377] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2014] [Accepted: 03/16/2015] [Indexed: 11/13/2022] Open
Abstract
Predicting personality is crucial when communicating with people. It has been revealed that the perceived attractiveness or beauty of the face is a cue. As shown in the well-known "what is beautiful is good" stereotype, perceived attractiveness is often associated with desirable personality. Although such research on attractiveness used mainly the face isolated from other body parts, the face is not always seen in isolation in the real world. Rather, it is surrounded by one's hairstyle, and is perceived as a part of total presence. In human vision, perceptual organization/integration occurs mostly in a bottom up, task-irrelevant fashion. This raises an intriguing possibility that task-irrelevant stimulus that is perceptually integrated with a target may influence our affective evaluation. In such a case, there should be a mutual influence between attractiveness perception of the face and surrounding hair, since they are assumed to share strong and unique perceptual organization. In the current study, we examined the influence of a task-irrelevant stimulus on our attractiveness evaluation, using face and hair as stimuli. The results revealed asymmetrical influences in the evaluation of one while ignoring the other. When hair was task-irrelevant, it still affected attractiveness of the face, but only if the hair itself had never been evaluated by the same evaluator. On the other hand, the face affected the hair regardless of whether the face itself was evaluated before. This has intriguing implications on the asymmetry between face and hair, and perceptual integration between them in general. Together with data from a post hoc questionnaire, it is suggested that both implicit non-selective and explicit selective processes contribute to attractiveness evaluation. The findings provide an understanding of attractiveness perception in real-life situations, as well as a new paradigm to reveal unknown implicit aspects of information integration for emotional judgment.
Collapse
Affiliation(s)
- Chihiro Saegusa
- R & D-Kansei Science Research, Kao Corporation Tokyo, Japan ; Division of Biology and Biological Engineering, California Institute of Technology Pasadena, CA, USA ; Research Center for Advanced Science and Technology, The University of Tokyo Tokyo, Japan
| | - Janis Intoy
- Division of Engineering and Applied Sciences, California Institute of Technology Pasadena, CA, USA
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology Pasadena, CA, USA ; Computation and Neural Systems, California Institute of Technology Pasadena, CA, USA
| |
Collapse
|
33
|
Saegusa C, Intoy J, Shimojo S. Visual Attractiveness is Leaky (5): Perceptual organization matters. J Vis 2011. [DOI: 10.1167/11.11.633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|