1
|
Greilich J, Baumann MP, Hafed ZM. Microsaccadic suppression of peripheral perceptual detection performance as a function of foveated visual image appearance. J Vis 2024; 24:3. [PMID: 39365250 PMCID: PMC11457924 DOI: 10.1167/jov.24.11.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Accepted: 09/02/2024] [Indexed: 10/05/2024] Open
Abstract
Microsaccades are known to be associated with a deficit in perceptual detection performance for brief probe flashes presented in their temporal vicinity. However, it is still not clear how such a deficit might depend on the visual environment across which microsaccades are generated. Here, and motivated by studies demonstrating an interaction between visual background image appearance and perceptual suppression strength associated with large saccades, we probed peripheral perceptual detection performance of human subjects while they generated microsaccades over three different visual backgrounds. Subjects fixated near the center of a low spatial frequency grating, a high spatial frequency grating, or a small white fixation spot over an otherwise gray background. When a computer process detected a microsaccade, it presented a brief peripheral probe flash at one of four locations (over a uniform gray background) and at different times. After collecting full psychometric curves, we found that both perceptual detection thresholds and slopes of psychometric curves were impaired for peripheral flashes in the immediate temporal vicinity of microsaccades, and they recovered with later flash times. Importantly, the threshold elevations, but not the psychometric slope reductions, were stronger for the white fixation spot than for either of the two gratings. Thus, like with larger saccades, microsaccadic suppression strength can show a certain degree of image dependence. However, unlike with larger saccades, stronger microsaccadic suppression did not occur with low spatial frequency textures. This observation might reflect the different spatiotemporal retinal transients associated with the small microsaccades in our study versus larger saccades.
Collapse
Affiliation(s)
- Julia Greilich
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| |
Collapse
|
2
|
Gur M. Seeing on the fly: Physiological and behavioral evidence show that space-to-space representation and processing enable fast and efficient performance by the visual system. J Vis 2024; 24:11. [PMID: 39392446 PMCID: PMC11472890 DOI: 10.1167/jov.24.11.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Accepted: 08/16/2024] [Indexed: 10/12/2024] Open
Abstract
When we view the world, our eyes saccade quickly between points of interest. Even when fixating a target our eyes are not completely at rest but execute small fixational eye movements (FEMs). That vision is not blurred despite this ever-present jitter has seemingly motivated an increasingly popular theory denying the reliance of the visual system on pure spatial processing in favor of a space-to-time mechanism generated by the eye drifting across the image. Accordingly, FEMs are not detrimental but rather essential to good visibility. However, the space-to-time theory is incompatible with physiological data showing that all information is conveyed by the short neural volleys generated when the eyes land on a target, and with our faithful perception of briefly displayed objects, during which time FEMs have no effect. Another difficulty in rejecting the idea of image representation by the locations and nature of responding cells in favor of a timecode, is that somewhere, somehow, this code must be decoded into a parallel spatial one when reaching perception. Thus, in addition to the implausibility of generating meaningful responses during retinal drift, the space-to-time hypothesis calls for replacing efficient point-to-point parallel transmission with a cumbersome, delayed, space-to-time-to-space process. A novel physiological framework is presented here wherein the ability of the visual system to quickly process information is mediated by the short, powerful neural volleys generated by the landing saccades. These volleys are necessary and sufficient for normal perception without FEMs contribution. This mechanism enables our excellent perception of brief stimuli and explains that visibility is not blurred by FEMs because they do not generate useful information.
Collapse
Affiliation(s)
- Moshe Gur
- Department of Biomedical Engineering, Technion-Israel Institute of Technology Haifa, Israel
| |
Collapse
|
3
|
Wu EG, Brackbill N, Rhoades C, Kling A, Gogliettino AR, Shah NP, Sher A, Litke AM, Simoncelli EP, Chichilnisky EJ. Fixational eye movements enhance the precision of visual information transmitted by the primate retina. Nat Commun 2024; 15:7964. [PMID: 39261491 PMCID: PMC11390888 DOI: 10.1038/s41467-024-52304-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 08/29/2024] [Indexed: 09/13/2024] Open
Abstract
Fixational eye movements alter the number and timing of spikes transmitted from the retina to the brain, but whether these changes enhance or degrade the retinal signal is unclear. To quantify this, we developed a Bayesian method for reconstructing natural images from the recorded spikes of hundreds of retinal ganglion cells (RGCs) in the macaque retina (male), combining a likelihood model for RGC light responses with the natural image prior implicitly embedded in an artificial neural network optimized for denoising. The method matched or surpassed the performance of previous reconstruction algorithms, and provides an interpretable framework for characterizing the retinal signal. Reconstructions were improved with artificial stimulus jitter that emulated fixational eye movements, even when the eye movement trajectory was assumed to be unknown and had to be inferred from retinal spikes. Reconstructions were degraded by small artificial perturbations of spike times, revealing more precise temporal encoding than suggested by previous studies. Finally, reconstructions were substantially degraded when derived from a model that ignored cell-to-cell interactions, indicating the importance of stimulus-evoked correlations. Thus, fixational eye movements enhance the precision of the retinal representation.
Collapse
Affiliation(s)
- Eric G Wu
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
| | - Nora Brackbill
- Department of Physics, Stanford University, Stanford, CA, USA
| | - Colleen Rhoades
- Department of Bioengineering, Stanford University, Stanford, CA, USA
| | - Alexandra Kling
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
- Department of Ophthalmology, Stanford University, Stanford, CA, USA
- Hansen Experimental Physics Laboratory, Stanford University, 452 Lomita Mall, Stanford, 94305, CA, USA
| | - Alex R Gogliettino
- Hansen Experimental Physics Laboratory, Stanford University, 452 Lomita Mall, Stanford, 94305, CA, USA
- Neurosciences PhD Program, Stanford University, Stanford, CA, USA
| | - Nishal P Shah
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Alexander Sher
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, Santa Cruz, CA, USA
| | - Alan M Litke
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, Santa Cruz, CA, USA
| | - Eero P Simoncelli
- Flatiron Institute, Simons Foundation, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
- Courant Institute of Mathematical Sciences, New York University, New York, NY, USA
| | - E J Chichilnisky
- Department of Neurosurgery, Stanford University, Stanford, CA, USA.
- Department of Ophthalmology, Stanford University, Stanford, CA, USA.
- Hansen Experimental Physics Laboratory, Stanford University, 452 Lomita Mall, Stanford, 94305, CA, USA.
| |
Collapse
|
4
|
Intoy J, Li YH, Bowers NR, Victor JD, Poletti M, Rucci M. Consequences of eye movements for spatial selectivity. Curr Biol 2024; 34:3265-3272.e4. [PMID: 38981478 PMCID: PMC11348862 DOI: 10.1016/j.cub.2024.06.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 05/17/2024] [Accepted: 06/07/2024] [Indexed: 07/11/2024]
Abstract
What determines spatial tuning in the visual system? Standard views rely on the assumption that spatial information is directly inherited from the relative position of photoreceptors and shaped by neuronal connectivity.1,2 However, human eyes are always in motion during fixation,3,4,5,6 so retinal neurons receive temporal modulations that depend on the interaction of the spatial structure of the stimulus with eye movements. It has long been hypothesized that these modulations might contribute to spatial encoding,7,8,9,10,11,12 a proposal supported by several recent observations.13,14,15,16 A fundamental, yet untested, consequence of this encoding strategy is that spatial tuning is not hard-wired in the visual system but critically depends on how the fixational motion of the eye shapes the temporal structure of the signals impinging onto the retina. Here we used high-resolution techniques for eye-tracking17 and gaze-contingent display control18 to quantitatively test this distinctive prediction. We examined how contrast sensitivity, a hallmark of spatial vision, is influenced by fixational motion, both during normal active fixation and when the spatiotemporal stimulus on the retina is altered to mimic changes in fixational control. We showed that visual sensitivity closely follows the strength of the luminance modulations delivered within a narrow temporal bandwidth, so changes in fixational motion have opposite visual effects at low and high spatial frequencies. By identifying a key role for oculomotor activity in spatial selectivity, these findings have important implications for the perceptual consequences of abnormal eye movements, the sources of perceptual variability, and the function of oculomotor control.
Collapse
Affiliation(s)
- Janis Intoy
- Center for Visual Science, University of Rochester, Rochester, NY, USA; Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| | - Yuanhao H Li
- Center for Visual Science, University of Rochester, Rochester, NY, USA; Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| | - Norick R Bowers
- Department of Psychology, Justus-Liebig University, Giessen, Germany
| | - Jonathan D Victor
- Feil Family Brain and Mind Research Institute, Weill Cornell Medical College, New York City, NY, USA
| | - Martina Poletti
- Center for Visual Science, University of Rochester, Rochester, NY, USA; Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| | - Michele Rucci
- Center for Visual Science, University of Rochester, Rochester, NY, USA; Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA.
| |
Collapse
|
5
|
Fitzpatrick MJ, Krizan J, Hsiang JC, Shen N, Kerschensteiner D. A pupillary contrast response in mice and humans: Neural mechanisms and visual functions. Neuron 2024; 112:2404-2422.e9. [PMID: 38697114 PMCID: PMC11257825 DOI: 10.1016/j.neuron.2024.04.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 12/21/2023] [Accepted: 04/10/2024] [Indexed: 05/04/2024]
Abstract
In the pupillary light response (PLR), increases in ambient light constrict the pupil to dampen increases in retinal illuminance. Here, we report that the pupillary reflex arc implements a second input-output transformation; it senses temporal contrast to enhance spatial contrast in the retinal image and increase visual acuity. The pupillary contrast response (PCoR) is driven by rod photoreceptors via type 6 bipolar cells and M1 ganglion cells. Temporal contrast is transformed into sustained pupil constriction by the M1's conversion of excitatory input into spike output. Computational modeling explains how the PCoR shapes retinal images. Pupil constriction improves acuity in gaze stabilization and predation in mice. Humans exhibit a PCoR with similar tuning properties to mice, which interacts with eye movements to optimize the statistics of the visual input for retinal encoding. Thus, we uncover a conserved component of active vision, its cell-type-specific pathway, computational mechanisms, and optical and behavioral significance.
Collapse
Affiliation(s)
- Michael J Fitzpatrick
- Department of Ophthalmology and Visual Sciences, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA; Graduate Program in Neuroscience, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA; Medical Scientist Training Program, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA
| | - Jenna Krizan
- Department of Ophthalmology and Visual Sciences, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA; Graduate Program in Neuroscience, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA
| | - Jen-Chun Hsiang
- Department of Ophthalmology and Visual Sciences, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA
| | - Ning Shen
- Department of Ophthalmology and Visual Sciences, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA
| | - Daniel Kerschensteiner
- Department of Ophthalmology and Visual Sciences, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA; Department of Neuroscience, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA; Department of Biomedical Engineering, Washington University School of Medicine in St. Louis, St. Louis, MO 63110, USA.
| |
Collapse
|
6
|
Rolfs M, Hübner C. Blink and you see it. Proc Natl Acad Sci U S A 2024; 121:e2404021121. [PMID: 38578986 PMCID: PMC11032442 DOI: 10.1073/pnas.2404021121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2024] Open
Affiliation(s)
- Martin Rolfs
- Department of Psychology, Humboldt-Universität zu Berlin, 10099Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität zu Berlin, Berlin10115, Germany
- Exzellenzcluster Science of Intelligence, Technische Universität Berlin, 10587Berlin, Germany
| | - Carolin Hübner
- Department of Psychology, Humboldt-Universität zu Berlin, 10099Berlin, Germany
- Department of Psychology, Technische Universität Chemnitz, 09120Chemnitz, Germany
| |
Collapse
|
7
|
Yang B, Intoy J, Rucci M. Eye blinks as a visual processing stage. Proc Natl Acad Sci U S A 2024; 121:e2310291121. [PMID: 38564641 PMCID: PMC11009678 DOI: 10.1073/pnas.2310291121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 02/12/2024] [Indexed: 04/04/2024] Open
Abstract
Humans blink their eyes frequently during normal viewing, more often than it seems necessary for keeping the cornea well lubricated. Since the closure of the eyelid disrupts the image on the retina, eye blinks are commonly assumed to be detrimental to visual processing. However, blinks also provide luminance transients rich in spatial information to neural pathways highly sensitive to temporal changes. Here, we report that the luminance modulations from blinks enhance visual sensitivity. By coupling high-resolution eye tracking in human observers with modeling of blink transients and spectral analysis of visual input signals, we show that blinking increases the power of retinal stimulation and that this effect significantly enhances visibility despite the time lost in exposure to the external scene. We further show that, as predicted from the spectral content of input signals, this enhancement is selective for stimuli at low spatial frequencies and occurs irrespective of whether the luminance transients are actively generated or passively experienced. These findings indicate that, like eye movements, blinking acts as a computational component of a visual processing strategy that uses motor behavior to reformat spatial information into the temporal domain.
Collapse
Affiliation(s)
- Bin Yang
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY14627
- Center for Visual Science, University of Rochester, Rochester, NY14627
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY14627
- Center for Visual Science, University of Rochester, Rochester, NY14627
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY14627
- Center for Visual Science, University of Rochester, Rochester, NY14627
| |
Collapse
|
8
|
Burlingham CS, Sendhilnathan N, Komogortsev O, Murdison TS, Proulx MJ. Motor "laziness" constrains fixation selection in real-world tasks. Proc Natl Acad Sci U S A 2024; 121:e2302239121. [PMID: 38470927 PMCID: PMC10962974 DOI: 10.1073/pnas.2302239121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 02/02/2024] [Indexed: 03/14/2024] Open
Abstract
Humans coordinate their eye, head, and body movements to gather information from a dynamic environment while maximizing reward and minimizing biomechanical and energetic costs. However, such natural behavior is not possible in traditional experiments employing head/body restraints and artificial, static stimuli. Therefore, it is unclear to what extent mechanisms of fixation selection discovered in lab studies, such as inhibition-of-return (IOR), influence everyday behavior. To address this gap, participants performed nine real-world tasks, including driving, visually searching for an item, and building a Lego set, while wearing a mobile eye tracker (169 recordings; 26.6 h). Surprisingly, in all tasks, participants most often returned to what they just viewed and saccade latencies were shorter preceding return than forward saccades, i.e., consistent with facilitation, rather than inhibition, of return. We hypothesize that conservation of eye and head motor effort ("laziness") contributes. Correspondingly, we observed center biases in fixation position and duration relative to the head's orientation. A model that generates scanpaths by randomly sampling these distributions reproduced all return phenomena we observed, including distinct 3-fixation sequences for forward versus return saccades. After controlling for orbital eccentricity, one task (building a Lego set) showed evidence for IOR. This, along with small discrepancies between model and data, indicates that the brain balances minimization of motor costs with maximization of rewards (e.g., accomplished by IOR and other mechanisms) and that the optimal balance varies according to task demands. Supporting this account, the orbital range of motion used in each task traded off lawfully with fixation duration.
Collapse
Affiliation(s)
- Charlie S. Burlingham
- Reality Labs Research, Meta Platforms Inc., Redmond, WA98052
- Department of Psychology, New York University, New York, NY10003
| | | | - Oleg Komogortsev
- Reality Labs Research, Meta Platforms Inc., Redmond, WA98052
- Department of Computer Science, Texas State University, San Marcos, TX78666
| | | | | |
Collapse
|
9
|
Samonds JM, Szinte M, Barr C, Montagnini A, Masson GS, Priebe NJ. Mammals Achieve Common Neural Coverage of Visual Scenes Using Distinct Sampling Behaviors. eNeuro 2024; 11:ENEURO.0287-23.2023. [PMID: 38164577 PMCID: PMC10860624 DOI: 10.1523/eneuro.0287-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/24/2023] [Accepted: 10/30/2023] [Indexed: 01/03/2024] Open
Abstract
Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across fixations to construct a complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of mice, cats, marmosets, macaques, and humans. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.
Collapse
Affiliation(s)
- Jason M Samonds
- Center for Learning and Memory and the Institute for Neuroscience, The University of Texas at Austin, Austin 78712, Texas
| | - Martin Szinte
- Institut de Neurosciences de la Timone (UMR 7289), Centre National de la Recherche Scientifique and Aix-Marseille Université, 13385 Marseille, France
| | - Carrie Barr
- Center for Learning and Memory and the Institute for Neuroscience, The University of Texas at Austin, Austin 78712, Texas
| | - Anna Montagnini
- Institut de Neurosciences de la Timone (UMR 7289), Centre National de la Recherche Scientifique and Aix-Marseille Université, 13385 Marseille, France
| | - Guillaume S Masson
- Institut de Neurosciences de la Timone (UMR 7289), Centre National de la Recherche Scientifique and Aix-Marseille Université, 13385 Marseille, France
| | - Nicholas J Priebe
- Center for Learning and Memory and the Institute for Neuroscience, The University of Texas at Austin, Austin 78712, Texas
| |
Collapse
|
10
|
Verghese P, Nyström M, Foulsham T, McGraw PV. Eye movements in visual impairment. Vision Res 2023; 211:108296. [PMID: 37506496 PMCID: PMC10529007 DOI: 10.1016/j.visres.2023.108296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 07/12/2023] [Indexed: 07/30/2023]
Abstract
This Special Issue describes the impact of visual impairment on visuomotor function. It includes contributions that examine gaze control in conditions associated with abnormal visual development such as amblyopia, dyslexia and neurofibromatosis as well as disorders associated with field loss later in life, such as macular degeneration and stroke. Specifically, the papers address both gaze holding (fixation), and gaze-following behavior (single saccades, sequences of saccades and smooth-pursuit) that characterize active vision in daily life and evaluate the influence of both pathological and simulated field loss. Several papers address the challenges to reading and visual search; describing how the patterns of eye movements in these real-world tasks adapt to visual impairment and highlighting how they could serve as diagnostic markers of visuomotor function.
Collapse
Affiliation(s)
- Preeti Verghese
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA.
| | | | - Tom Foulsham
- Department of Psychology, University of Essex, Wivenhoe Park, Colchester, UK
| | - Paul V McGraw
- Visual Neuroscience Group, School of Psychology, University of Nottingham, University Park, Nottingham NG7 2RD, UK
| |
Collapse
|
11
|
Poletti M. An eye for detail: Eye movements and attention at the foveal scale. Vision Res 2023; 211:108277. [PMID: 37379763 PMCID: PMC10528557 DOI: 10.1016/j.visres.2023.108277] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 06/08/2023] [Accepted: 06/08/2023] [Indexed: 06/30/2023]
Abstract
Human vision relies on a tiny region of the retina, the 1-deg foveola, to achieve high spatial resolution. Foveal vision is of paramount importance in daily activities, yet its study is challenging, as eye movements incessantly displace stimuli across this region. Here I will review work that, building on recent advances in eye-tracking and gaze-contingent display, examines how attention and eye movements operate at the foveal level. This research highlights how exploration of fine spatial detail unfolds following visuomotor strategies reminiscent of those occurring at larger scales. It shows that, together with highly precise control of attention, this motor activity is linked to non-homogenous processing within the foveola and selectively modulates sensitivity both in space and time. Overall, the picture emerges of a highly dynamic foveal perception in which fine spatial vision, rather than simply being the result of placing a stimulus at the center of gaze, is the result of a finely tuned and orchestrated synergy of motor, cognitive, and attentional processes.
Collapse
Affiliation(s)
- Martina Poletti
- Department of Brain and Cognitive Sciences, University of Rochester, United States; Center for Visual Science, University of Rochester, United States; Department of Neuroscience, University of Rochester, United States.
| |
Collapse
|
12
|
Meermeier A, Lappe M, Li YH, Rifai K, Wahl S, Rucci M. Fine-scale measurement of the blind spot borders. Vision Res 2023; 211:108208. [PMID: 37454560 PMCID: PMC10494866 DOI: 10.1016/j.visres.2023.108208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 12/04/2022] [Accepted: 02/20/2023] [Indexed: 07/18/2023]
Abstract
The blind spot is both a necessity and a nuisance for seeing. It is the portion of the visual field projecting to where the optic nerve crosses the retina, a region devoid of photoreceptors and hence visual input. The precise way in which vision transitions into blindness at the blind spot border is to date unknown. A chief challenge to map this transition is the incessant movement of the eye, which unavoidably smears measurements across space. In this study, we used high-resolution eye-tracking and state-of-the-art retinal stabilization to finely map the blind spot borders. Participants reported the onset of tiny high-contrast probes that were briefly flashed at precise positions around the blind spot. This method has sufficient resolution to enable mapping of blood vessels from psychophysical measurements. Our data show that, even after accounting for eye movements, the transition zones at the edges of the blind spot are considerable. On the horizontal meridian, the regions with detection rates between 80% and 20% span approximately 25% of the overall width of the blind spot. These borders also vary considerably in size across different axes. These data show that the transition from full visibility to blindness at the blind spot border is not abrupt but occurs over a broad area.
Collapse
Affiliation(s)
- Annegret Meermeier
- Institute for Psychology, University of Muenster, Muenster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Muenster, Germany
| | - Markus Lappe
- Institute for Psychology, University of Muenster, Muenster, Germany; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Muenster, Germany
| | - Yuanhao H Li
- Department of Brain & Cognitive Sciences, University of Rochester, New York, USA; Center for Visual Science, University of Rochester, New York, USA
| | | | - Siegfried Wahl
- Carl Zeiss Vision International GmbH, Aalen, Germany; Institute for Ophthalmic Research, University Tübingen, Tübingen, Germany
| | - Michele Rucci
- Department of Brain & Cognitive Sciences, University of Rochester, New York, USA; Center for Visual Science, University of Rochester, New York, USA
| |
Collapse
|
13
|
Samonds JM, Szinte M, Barr C, Montagnini A, Masson GS, Priebe NJ. Mammals achieve common neural coverage of visual scenes using distinct sampling behaviors. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.20.533210. [PMID: 36993477 PMCID: PMC10055212 DOI: 10.1101/2023.03.20.533210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/31/2023]
Abstract
Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across several fixations to construct a more complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact, and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of different species. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.
Collapse
|
14
|
Yates JL, Coop SH, Sarch GH, Wu RJ, Butts DA, Rucci M, Mitchell JF. Detailed characterization of neural selectivity in free viewing primates. Nat Commun 2023; 14:3656. [PMID: 37339973 PMCID: PMC10282080 DOI: 10.1038/s41467-023-38564-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Accepted: 05/08/2023] [Indexed: 06/22/2023] Open
Abstract
Fixation constraints in visual tasks are ubiquitous in visual and cognitive neuroscience. Despite its widespread use, fixation requires trained subjects, is limited by the accuracy of fixational eye movements, and ignores the role of eye movements in shaping visual input. To overcome these limitations, we developed a suite of hardware and software tools to study vision during natural behavior in untrained subjects. We measured visual receptive fields and tuning properties from multiple cortical areas of marmoset monkeys who freely viewed full-field noise stimuli. The resulting receptive fields and tuning curves from primary visual cortex (V1) and area MT match reported selectivity from the literature which was measured using conventional approaches. We then combined free viewing with high-resolution eye tracking to make the first detailed 2D spatiotemporal measurements of foveal receptive fields in V1. These findings demonstrate the power of free viewing to characterize neural responses in untrained animals while simultaneously studying the dynamics of natural behavior.
Collapse
Affiliation(s)
- Jacob L Yates
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA.
- Center for Visual Science, University of Rochester, Rochester, NY, USA.
- Department of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA.
- Herbert Wertheim School of Optometry and Vision Science, UC Berkeley, Berkeley, CA, USA.
| | - Shanna H Coop
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Center for Visual Science, University of Rochester, Rochester, NY, USA
- Neurobiology, Stanford University, Stanford, CA, USA
| | - Gabriel H Sarch
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Ruei-Jr Wu
- Center for Visual Science, University of Rochester, Rochester, NY, USA
- Institute of Optics, University of Rochester, Rochester, NY, USA
| | - Daniel A Butts
- Department of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA
| | - Michele Rucci
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Center for Visual Science, University of Rochester, Rochester, NY, USA
| | - Jude F Mitchell
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Center for Visual Science, University of Rochester, Rochester, NY, USA
| |
Collapse
|
15
|
Wu RJ, Clark AM, Cox MA, Intoy J, Jolly PC, Zhao Z, Rucci M. High-resolution eye-tracking via digital imaging of Purkinje reflections. J Vis 2023; 23:4. [PMID: 37140912 PMCID: PMC10166114 DOI: 10.1167/jov.23.5.4] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2023] Open
Abstract
Reliably measuring eye movements and determining where the observer looks are fundamental needs in vision science. A classical approach to achieve high-resolution oculomotor measurements is the so-called dual Purkinje image (DPI) method, a technique that relies on the relative motion of the reflections generated by two distinct surfaces in the eye, the cornea and the back of the lens. This technique has been traditionally implemented in fragile and difficult to operate analog devices, which have remained exclusive use of specialized oculomotor laboratories. Here we describe progress on the development of a digital DPI, a system that builds on recent advances in digital imaging to enable fast, highly precise eye-tracking without the complications of previous analog devices. This system integrates an optical setup with no moving components with a digital imaging module and dedicated software on a fast processing unit. Data from both artificial and human eyes demonstrate subarcminute resolution at 1 kHz. Furthermore, when coupled with previously developed gaze-contingent calibration methods, this system enables localization of the line of sight within a few arcminutes.
Collapse
Affiliation(s)
- Ruei-Jr Wu
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Ashley M Clark
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Michele A Cox
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Janis Intoy
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Paul C Jolly
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Zhetuo Zhao
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| | - Michele Rucci
- Department of Brain & Cognitive Sciences and Center for Visual Science, University of Rochester, 310 Meliora Hall, Rochester, NY, USA
| |
Collapse
|
16
|
Niemeyer JE, Akers-Campbell S, Gregoire A, Paradiso MA. Perceptual enhancement and suppression correlate with V1 neural activity during active sensing. Curr Biol 2022; 32:2654-2667.e4. [PMID: 35584697 PMCID: PMC9233080 DOI: 10.1016/j.cub.2022.04.067] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 03/03/2022] [Accepted: 04/22/2022] [Indexed: 11/26/2022]
Abstract
Perception in multiple sensory modalities is an active process that involves exploratory behaviors. In humans and other primates, vision results from sensory sampling guided by saccadic eye movements. Saccades are known to modulate visual perception, and a corollary discharge signal associated with saccades appears to establish a sense of visual stability. Neural recordings have shown that saccades also modulate activity widely across the brain. To investigate the neural basis of saccadic effects on perception, simultaneous recordings from multiple neurons in area V1 were made as animals performed a contrast detection task. Perceptual and neural measures were compared when the animal made real saccades that brought a stimulus into V1 receptive fields and when simulated saccades were made (identical retinal stimulation but no eye movement). When real saccades were made and low spatial frequency stimuli were presented, we observed a reduction in both perceptual sensitivity and neural activity compared with simulated saccades; conversely, with higher spatial frequency stimuli, saccades increased visual sensitivity and neural activity. The performance of neural decoders, which used the activity of the population of simultaneously recorded neurons, showed saccade effects on sensitivity that mirrored the frequency-dependent perceptual changes, suggesting that the V1 population activity could support the perceptual effects. A minority of V1 neurons had significant choice probabilities, and the saccades decreased both average choice probability and pairwise noise correlations. Taken together, the findings suggest that a signal related to saccadic eye movements alters V1 spiking to increase the independence of spiking neurons and bias the system toward processing higher spatial frequencies, presumably to enhance object recognition. The effects of saccades on visual perception and noise correlations appear to parallel effects observed in other sensory modalities, suggesting a general principle of active sensory processing.
Collapse
Affiliation(s)
- James E Niemeyer
- Department of Neurological Surgery, Weill Cornell Medicine, New York, NY, USA; Department of Neuroscience, Brown University, Providence, RI, USA
| | | | - Aaron Gregoire
- School of Engineering, Brown University, Providence, RI, USA
| | | |
Collapse
|
17
|
Binda P, Morrone MC. Vision: Optimizing each glimpse. Curr Biol 2022; 32:R567-R569. [PMID: 35728527 DOI: 10.1016/j.cub.2022.05.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
A new study uses a rigorous approach to isolate the consequences of eye movements on cortical visual processing, showing that our visual system does not shut down during saccades but specifically modulates sensitivity to selected stimuli.
Collapse
Affiliation(s)
- Paola Binda
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Maria Concetta Morrone
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy; IRCCS Stella-Maris Foundation, Pisa, Italy.
| |
Collapse
|
18
|
Pandey P, Ray S. Influence of the Location of a Decision Cue on the Dynamics of Pupillary Light Response. Front Hum Neurosci 2022; 15:755383. [PMID: 35153699 PMCID: PMC8826249 DOI: 10.3389/fnhum.2021.755383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Accepted: 12/22/2021] [Indexed: 11/16/2022] Open
Abstract
The pupils of the eyes reflexively constrict in light and dilate in dark to optimize retinal illumination. Non-visual cognitive factors, like attention, arousal, decision-making, etc., also influence pupillary light response (PLR). During passive viewing, the eccentricity of a stimulus modulates the pupillary aperture size driven by spatially weighted corneal flux density (CFD), which is the product of luminance and the area of the stimulus. Whether the scope of attention also influences PLR remains unclear. In this study, we contrasted the pupil dynamics between diffused and focused attentional conditions during decision-making, while the global CFD remained the same in the two conditions. A population of 20 healthy humans participated in a pair of forced choice tasks. They distributed attention to the peripheral decision cue in one task, and concentrated at the center in the other to select the target from four alternatives for gaze orientation. The location of this cue did not influence participants' reaction time (RT). However, the magnitude of constriction was significantly less in the task that warranted attention to be deployed at the center than on the periphery. We observed similar pupil dynamics when participants either elicited or canceled a saccadic eye movement, which ruled out pre-saccadic obligatory attentional orientation contributing to PLR. We further addressed how the location of attentional deployment might have influenced PLR. We simulated a biomechanical model of PLR with visual stimulation of different strengths as inputs corresponding to the two attentional conditions. In this homeomorphic model, the computational characteristic of each element was derived from the physiological and/or mechanical properties of the corresponding biological element. The simulation of this model successfully mimicked the observed data. In contrast to common belief that the global ambient luminosity drives pupillary response, the results of our study suggest that the effective CFD (eCFD) determined via the luminance multiplied by the size of the stimulus at the location of deployed attention in the visual space is critical for the magnitude of pupillary constriction.
Collapse
Affiliation(s)
| | - Supriya Ray
- Centre of Behavioural and Cognitive Sciences, University of Allahabad, Prayagraj, India
| |
Collapse
|
19
|
Mahanama B, Jayawardana Y, Rengarajan S, Jayawardena G, Chukoskie L, Snider J, Jayarathna S. Eye Movement and Pupil Measures: A Review. FRONTIERS IN COMPUTER SCIENCE 2022. [DOI: 10.3389/fcomp.2021.733531] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first describe the main oculomotor events studied in the literature, and their characteristics exploited by different measures. Next, we review various eye movement and pupil measures from prior literature. Finally, we discuss our observations based on applications of these measures, the benefits and practical challenges involving these measures, and our recommendations on future eye-tracking research directions.
Collapse
|
20
|
Hübner C, Schütz AC. Rapid visual adaptation persists across saccades. iScience 2021; 24:102986. [PMID: 34485868 PMCID: PMC8403744 DOI: 10.1016/j.isci.2021.102986] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 05/28/2021] [Accepted: 07/09/2021] [Indexed: 11/26/2022] Open
Abstract
Neurons in the visual cortex quickly adapt to constant input, which should lead to perceptual fading within few tens of milliseconds. However, perceptual fading is rarely observed in everyday perception, possibly because eye movements refresh retinal input. Recently, it has been suggested that amplitudes of large saccadic eye movements are scaled to maximally decorrelate presaccadic and postsaccadic inputs and thus to annul perceptual fading. However, this argument builds on the assumption that adaptation within naturally brief fixation durations is strong enough to survive any visually disruptive saccade and affect perception. We tested this assumption by measuring the effect of luminance adaptation on postsaccadic contrast perception. We found that postsaccadic contrast perception was affected by presaccadic luminance adaptation during brief periods of fixation. This adaptation effect emerges within 100 milliseconds and persists over seconds. These results indicate that adaptation during natural fixation periods can affect perception even after visually disruptive saccades.
Collapse
Affiliation(s)
- Carolin Hübner
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, 35037 Marburg, Germany.,Institut für Psychologie, Humboldt-Universität zu Berlin, 12489 Berlin, Germany
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, 35037 Marburg, Germany.,Center for Mind, Brain and Behavior, Philipps-Universität Marburg, 35037 Marburg, Germany
| |
Collapse
|
21
|
Fast and nonuniform dynamics of perisaccadic vision in the central fovea. Proc Natl Acad Sci U S A 2021; 118:2101259118. [PMID: 34497123 PMCID: PMC8449317 DOI: 10.1073/pnas.2101259118] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2021] [Indexed: 01/05/2023] Open
Abstract
Humans shift their gaze more frequently than their heart beats. These rapid eye movements (saccades) enable high visual acuity by redirecting the tiny high-resolution region of the retina (the foveola). But in doing so, they abruptly sweep the image across receptors, raising questions on how the visual system achieves stable percepts. It is well established that visual sensitivity is transiently attenuated during saccades. However, little is known about the time course of foveal vision despite its disproportionate importance, as technical challenges have so far prevented study of how saccades affect the foveola. Here we show that saccades modulate this region in a nonuniform manner, providing stronger and faster changes at its very center, a locus with higher sensitivity. Humans use rapid eye movements (saccades) to inspect stimuli with the foveola, the region of the retina where receptors are most densely packed. It is well established that visual sensitivity is generally attenuated during these movements, a phenomenon known as saccadic suppression. This effect is commonly studied with large, often peripheral, stimuli presented during instructed saccades. However, little is known about how saccades modulate the foveola and how the resulting dynamics unfold during natural visual exploration. Here we measured the foveal dynamics of saccadic suppression in a naturalistic high-acuity task, a task designed after primates’ social grooming, which—like most explorations of fine patterns—primarily elicits minute saccades (microsaccades). Leveraging on recent advances in gaze-contingent display control, we were able to systematically map the perisaccadic time course of sensitivity across the foveola. We show that contrast sensitivity is not uniform across this region and that both the extent and dynamics of saccadic suppression vary within the foveola. Suppression is stronger and faster in the most central portion, where sensitivity is generally higher and selectively rebounds at the onset of a new fixation. These results shed light on the modulations experienced by foveal vision during the saccade-fixation cycle and explain some of the benefits of microsaccades.
Collapse
|
22
|
Pandey P, Ray S. Pupil dynamics: A potential proxy of neural preparation for goal-directed eye movement. Eur J Neurosci 2021; 54:6587-6607. [PMID: 34510602 DOI: 10.1111/ejn.15453] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 08/22/2021] [Accepted: 09/03/2021] [Indexed: 01/10/2023]
Abstract
The pupils reflexively constrict or dilate to regulate the influx of light on the retinae. Pupillary light reflex (PLR) is susceptible to many non-visual cognitive processes including covert orientation of attention and planning rapid saccadic eye movement. The frontal eye field (FEF) and superior colliculus (SC), which also send projections to the PLR pathway, are two important areas in primate's brain for planning saccade and orientation of attention. The saccadic reaction time (SRT) and the rate of increase in activity of movement neurons in these areas are inversely correlated. This study addressed how pupil dynamics, activity in the FEF and SC and SRT are related in a saccadic decision-making task. The rate of visually evoked pupil constriction was found inversely related to SRT. This was further verified by simulating a homeomorphic biomechanical model of pupillary muscle plants, wherein we projected signals similar to build-up activity in the FEF and SC to the parasympathetic (constriction) and sympathetic (dilation) division of the PLR pathway, respectively. A striking similarity between simulated and observed dynamics of pupil constriction suggests that PLR is a potential proxy of saccade planning by movement neurons in the FEF and SC. Indistinguishable pupil dynamics when planned saccades were elicited versus when they were cancelled eliminated the possibility that the obligatory pre-saccadic shift of attention alone influenced the rate of pupil constriction. Our study envisages a mechanism of how the oculomotor system influences the autonomic activity in an attempt to timely minimize saccadic visual transients by regulating the influx of light.
Collapse
Affiliation(s)
- Pragya Pandey
- Centre of Behavioural and Cognitive Sciences, University of Allahabad, Prayagraj, India
| | - Supriya Ray
- Centre of Behavioural and Cognitive Sciences, University of Allahabad, Prayagraj, India
| |
Collapse
|
23
|
Park ASY, Schütz AC. Selective postsaccadic enhancement of motion perception. Vision Res 2021; 188:42-50. [PMID: 34280816 PMCID: PMC7611369 DOI: 10.1016/j.visres.2021.06.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Revised: 06/15/2021] [Accepted: 06/20/2021] [Indexed: 11/23/2022]
Abstract
Saccadic eye movements can drastically affect motion perception: during saccades, the stationary surround is swept rapidly across the retina and contrast sensitivity is suppressed. However, after saccades, contrast sensitivity is enhanced for color and high-spatial frequency stimuli and reflexive tracking movements known as ocular following responses (OFR) are enhanced in response to large field motion. Additionally, OFR and postsaccadic enhancement of neural activity in primate motion processing areas are well correlated. It is not yet known how this postsaccadic enhancement arises. Therefore, we tested if the enhancement can be explained by changes in the balance of centre-surround antagonism in motion processing, where spatial summation is favoured at low contrasts and surround suppression is favoured at high contrasts. We found motion perception was selectively enhanced immediately after saccades for high spatial frequency stimuli, consistent with previously reported selective postsaccadic enhancement of contrast sensitivity for flashed high spatial frequency stimuli. The observed enhancement was also associated with changes in spatial summation and suppression, as well as contrast facilitation and inhibition, suggesting that motion processing is augmented to maximise visual perception immediately after saccades. The results highlight that spatial and contrast properties of underlying neural mechanisms for motion processing can be affected by an antecedent saccade for highly detailed stimuli and are in line with studies that show behavioural and neuronal enhancement of motion processing in non-human primates.
Collapse
Affiliation(s)
- Adela S Y Park
- Experimental and Biological Psychology, University of Marburg, Marburg, Germany.
| | - Alexander C Schütz
- Experimental and Biological Psychology, University of Marburg, Marburg, Germany; Center for Mind, Brain and Behavior, University of Marburg, Marburg, Germany
| |
Collapse
|
24
|
Fabius JH, Van der Stigchel S. Vision while the eyes move: Getting the full picture. SCIENCE ADVANCES 2021; 7:eabk0043. [PMID: 34301609 PMCID: PMC8302122 DOI: 10.1126/sciadv.abk0043] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 06/18/2021] [Indexed: 06/13/2023]
Abstract
Visual information is continuously sampled from our environment, even as the eyes move, which helps the visual system create a stable view of the world.
Collapse
Affiliation(s)
- Jasper H Fabius
- Institute of Neuroscience and Psychology, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, UK.
| | | |
Collapse
|
25
|
Kern M, Schulze-Bonhage A, Ball T. Blink- and saccade-related suppression effects in early visual areas of the human brain: Intracranial EEG investigations during natural viewing conditions. Neuroimage 2021; 230:117788. [PMID: 33503480 DOI: 10.1016/j.neuroimage.2021.117788] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 01/07/2021] [Accepted: 01/12/2021] [Indexed: 01/07/2023] Open
Abstract
Blinks and saccades, both ubiquitous in natural viewing conditions, cause rapid changes of visual inputs that are hardly consciously perceived. The neural dynamics in early visual areas of the human brain underlying this remarkable visual stability are still incompletely understood. We used electrocorticography (ECoG) from electrodes directly implanted on the human early visual areas V1, V2, V3d/v, V4d/v and the fusiform gyrus to investigate blink- and saccade-related neuronal suppression effects during non-experimental, free viewing conditions. We found a characteristic, biphasic, broadband gamma power decrease-increase pattern in all investigated visual areas. During saccades, a decrease in gamma power clearly preceded eye movement onset, at least in V1. This may indicate that cortical information processing is actively suppressed in human early visual areas before and during saccades, which then possibly mediates perceptual visual suppression. The following eye movement offset-related increase in gamma power may indicate the recovery of visual perception and the resumption of visual processing.
Collapse
Affiliation(s)
- Markus Kern
- Neuromedical AI Lab, Department of Neurosurgery, Medical Center - University of Freiburg, Engelbergerstr.21, D-79106 Freiburg im Breisgau, Germany; Epilepsy Center, Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany; Neurobiology and Biophysics, Faculty of Biology, University of Freiburg, Schänzlestrasse 1, 79104 Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany.
| | - Andreas Schulze-Bonhage
- Epilepsy Center, Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany
| | - Tonio Ball
- Neuromedical AI Lab, Department of Neurosurgery, Medical Center - University of Freiburg, Engelbergerstr.21, D-79106 Freiburg im Breisgau, Germany; Epilepsy Center, Department of Neurosurgery, Medical Center - University of Freiburg, Freiburg, Germany; BrainLinks-BrainTools Cluster of Excellence, University of Freiburg, Freiburg, Germany
| |
Collapse
|
26
|
Tan KWS, Scholes C, Roach NW, Haris EM, McGraw PV. Impact of microsaccades on visual shape processing. J Neurophysiol 2020; 125:609-619. [PMID: 33378248 DOI: 10.1152/jn.00454.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Sensitivity to subtle changes in the shape of visual objects has been attributed to the existence of global pooling mechanisms that integrate local form information across space. Although global pooling is typically demonstrated under steady fixation, other work suggests prolonged fixation can lead to a collapse of global structure. Here, we ask whether small ballistic eye movements that naturally occur during periods of fixation affect the global processing of radial frequency (RF) patterns-closed contours created by sinusoidally modulating the radius of a circle. Observers were asked to discriminate the shapes of circular patterns and RF-modulated patterns while fixational eye movements were recorded binocularly at 500 Hz. Microsaccades were detected using a velocity-based algorithm, allowing trials to be sorted according to the relative timing of stimulus and microsaccade onset. Results revealed clear perisaccadic changes in shape discrimination thresholds. Performance was impaired when microsaccades occurred close to stimulus onset, but facilitated when they occurred shortly afterward. In contrast, global integration of shape was unaffected by the timing of microsaccades. These findings suggest that microsaccades alter the discrimination sensitivity to briefly presented shapes but do not disrupt the spatial pooling of local form signals.NEW & NOTEWORTHY Microsaccades cause rapid displacement of visual images during fixation and dramatically alter the perception of basic image features. However, their effect on more complex aspects of visual processing is not well understood. Here, we demonstrate a dissociation in the impact of microsaccades on shape perception. Although overall shape discrimination performance is modulated around the time of microsaccades, the pooling efficiency of global mechanisms that combine local form information across space remains unaffected.
Collapse
Affiliation(s)
- Ken W S Tan
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Chris Scholes
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Neil W Roach
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Elizabeth M Haris
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Paul V McGraw
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|