1
|
Duyar A, Carrasco M. Eyes on the past: Gaze stability differs between temporal expectation and temporal attention. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.07.598015. [PMID: 38895241 PMCID: PMC11185784 DOI: 10.1101/2024.06.07.598015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Temporal expectation and temporal attention distinctly improve performance and gaze stability, and interact at the behavioral and neural levels. Foreperiod-the interval between the preparatory signal and stimulus onset-facilitates temporal expectation. Preceding foreperiod-the foreperiod in the previous trial-modulates expectation at behavioral and oculomotor levels. Here, we investigated whether preceding foreperiod guides temporal attention. Regardless of the preceding foreperiod, temporal attention improved performance, particularly at early moments,and consistently accelerated gaze stability onset and offset by shifting microsaccade timing. However, only with preceding expected foreperiods, attention inhibited microsaccade rates. Moreover, preceding late foreperiods weakened expectation effects on microsaccade rates, but such a weakening was overridden by attention. Altogether, these findings reveal that the oculomotor system's flexibility does not translate to performance, and suggest that although selection history can be utilized as one of the sources of expectation in subsequent trials, it does not necessarily determine, strengthen, or guide attentional deployment.
Collapse
Affiliation(s)
- Aysun Duyar
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
2
|
Gupta P, Sridharan D. Presaccadic attention does not facilitate the detection of changes in the visual field. PLoS Biol 2024; 22:e3002485. [PMID: 38271460 PMCID: PMC10810526 DOI: 10.1371/journal.pbio.3002485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 01/02/2024] [Indexed: 01/27/2024] Open
Abstract
Planning a rapid eye movement (saccade) changes how we perceive our visual world. Even before we move the eyes visual discrimination sensitivity improves at the impending target of eye movements, a phenomenon termed "presaccadic attention." Yet, it is unknown if such presaccadic selection merely affects perceptual sensitivity, or also affects downstream decisional processes, such as choice bias. We report a surprising lack of presaccadic perceptual benefits in a common, everyday setting-detection of changes in the visual field. Despite the lack of sensitivity benefits, choice bias for reporting changes increased reliably for the saccade target. With independent follow-up experiments, we show that presaccadic change detection is rendered more challenging because percepts at the saccade target location are biased toward, and more precise for, only the most recent of two successive stimuli. With a Bayesian model, we show how such perceptual and choice biases are crucial to explain the effects of saccade plans on change detection performance. In sum, visual change detection sensitivity does not improve presaccadically, a result that is readily explained by teasing apart distinct components of presaccadic selection. The findings may have critical implications for real-world scenarios, like driving, that require rapid gaze shifts in dynamically changing environments.
Collapse
Affiliation(s)
- Priyanka Gupta
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | | |
Collapse
|
3
|
Bogadhi AR, Hafed ZM. Express detection of visual objects by primate superior colliculus neurons. Sci Rep 2023; 13:21730. [PMID: 38066070 PMCID: PMC10709564 DOI: 10.1038/s41598-023-48979-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 12/02/2023] [Indexed: 12/18/2023] Open
Abstract
Primate superior colliculus (SC) neurons exhibit visual feature tuning properties and are implicated in a subcortical network hypothesized to mediate fast threat and/or conspecific detection. However, the mechanisms through which SC neurons contribute to peripheral object detection, for supporting rapid orienting responses, remain unclear. Here we explored whether, and how quickly, SC neurons detect real-life object stimuli. We presented experimentally-controlled gray-scale images of seven different object categories, and their corresponding luminance- and spectral-matched image controls, within the extrafoveal response fields of SC neurons. We found that all of our functionally-identified SC neuron types preferentially detected real-life objects even in their very first stimulus-evoked visual bursts. Intriguingly, even visually-responsive motor-related neurons exhibited such robust early object detection. We further identified spatial frequency information in visual images as an important, but not exhaustive, source for the earliest (within 100 ms) but not for the late (after 100 ms) component of object detection by SC neurons. Our results demonstrate rapid and robust detection of extrafoveal visual objects by the SC. Besides supporting recent evidence that even SC saccade-related motor bursts can preferentially represent visual objects, these results reveal a plausible mechanism through which rapid orienting responses to extrafoveal visual objects can be mediated.
Collapse
Affiliation(s)
- Amarender R Bogadhi
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, Otfried-Müller Str. 25, 72076, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, University of Tübingen, 72076, Tübingen, Germany
- Central Nervous System Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, 88400, Biberach, Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, Otfried-Müller Str. 25, 72076, Tübingen, Germany.
- Hertie Institute for Clinical Brain Research, University of Tübingen, 72076, Tübingen, Germany.
| |
Collapse
|
4
|
Khademi F, Zhang T, Baumann MP, Buonocore A, Malevich T, Yu Y, Hafed ZM. Visual feature tuning properties of stimulus-driven saccadic inhibition in macaque monkeys. J Neurophysiol 2023; 130:1282-1302. [PMID: 37818591 DOI: 10.1152/jn.00289.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 10/03/2023] [Accepted: 10/03/2023] [Indexed: 10/12/2023] Open
Abstract
Saccadic inhibition refers to a short-latency transient cessation of saccade generation after visual sensory transients. This oculomotor phenomenon occurs with a latency that is consistent with a rapid influence of sensory responses, such as stimulus-induced visual bursts, on oculomotor control circuitry. However, the neural mechanisms underlying saccadic inhibition are not well understood. Here, we exploited the fact that macaque monkeys experience robust saccadic inhibition to test the hypothesis that inhibition time and strength exhibit systematic visual feature tuning properties to a multitude of visual feature dimensions commonly used in vision science. We measured saccades in three monkeys actively controlling their gaze on a target, and we presented visual onset events at random times. Across seven experiments, the visual onsets tested size, spatial frequency, contrast, orientation, motion direction, and motion speed dependencies of saccadic inhibition. We also investigated how inhibition might depend on the behavioral relevance of the appearing stimuli. We found that saccadic inhibition starts earlier, and is stronger, for large stimuli of low spatial frequencies and high contrasts. Moreover, saccadic inhibition timing depends on motion direction and orientation, with earlier inhibition systematically occurring for horizontally drifting vertical gratings. On the other hand, saccadic inhibition is stronger for faster motions and when the appearing stimuli are subsequently foveated. Besides documenting a range of feature tuning dimensions of saccadic inhibition to the properties of exogenous visual stimuli, our results establish macaque monkeys as an ideal model system for unraveling the neural mechanisms underlying a ubiquitous oculomotor phenomenon in visual neuroscience.NEW & NOTEWORTHY Visual onsets dramatically reduce saccade generation likelihood with very short latencies. Such latencies suggest that stimulus-induced visual responses, normally jump-starting perceptual and scene analysis processes, can also directly impact the decision of whether to generate saccades or not, causing saccadic inhibition. Consistent with this, we found that changing the appearance of the visual onsets systematically alters the properties of saccadic inhibition. These results constrain neurally inspired models of coordination between saccade generation and exogenous sensory stimulation.
Collapse
Affiliation(s)
- Fatemeh Khademi
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Tong Zhang
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Antimo Buonocore
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
- Department of Educational, Psychological and Communication Sciences, Suor Orsola Benincasa University, Naples, Italy
| | - Tatiana Malevich
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Yue Yu
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| |
Collapse
|
5
|
Fracasso A, Buonocore A, Hafed ZM. Peri-Saccadic Orientation Identification Performance and Visual Neural Sensitivity Are Higher in the Upper Visual Field. J Neurosci 2023; 43:6884-6897. [PMID: 37640553 PMCID: PMC10573757 DOI: 10.1523/jneurosci.1740-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Revised: 08/02/2023] [Accepted: 08/06/2023] [Indexed: 08/31/2023] Open
Abstract
Visual neural processing is distributed among a multitude of sensory and sensory-motor brain areas exhibiting varying degrees of functional specializations and spatial representational anisotropies. Such diversity raises the question of how perceptual performance is determined, at any one moment in time, during natural active visual behavior. Here, exploiting a known dichotomy between the primary visual cortex (V1) and superior colliculus (SC) in representing either the upper or lower visual fields, we asked whether peri-saccadic orientation identification performance is dominated by one or the other spatial anisotropy. Humans (48 participants, 29 females) reported the orientation of peri-saccadic upper visual field stimuli significantly better than lower visual field stimuli, unlike their performance during steady-state gaze fixation, and contrary to expected perceptual superiority in the lower visual field in the absence of saccades. Consistent with this, peri-saccadic superior colliculus visual neural responses in two male rhesus macaque monkeys were also significantly stronger in the upper visual field than in the lower visual field. Thus, peri-saccadic orientation identification performance is more in line with oculomotor, rather than visual, map spatial anisotropies.SIGNIFICANCE STATEMENT Different brain areas respond to visual stimulation, but they differ in the degrees of functional specializations and spatial anisotropies that they exhibit. For example, the superior colliculus (SC) both responds to visual stimulation, like the primary visual cortex (V1), and controls oculomotor behavior. Compared with the primary visual cortex, the superior colliculus exhibits an opposite pattern of upper/lower visual field anisotropy, being more sensitive to the upper visual field. Here, we show that human peri-saccadic orientation identification performance is better in the upper compared with the lower visual field. Consistent with this, monkey superior colliculus visual neural responses to peri-saccadic stimuli follow a similar pattern. Our results indicate that peri-saccadic perceptual performance reflects oculomotor, rather than visual, map spatial anisotropies.
Collapse
Affiliation(s)
- Alessio Fracasso
- School of Psychology and Neuroscience, University of Glasgow, Glasgow G12 8QE, Scotland, United Kingdom
| | - Antimo Buonocore
- Department of Educational, Psychological and Communication Sciences, Suor Orsola Benincasa University, Naples 80135, Italy
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen 72076, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen 72076, Germany
| |
Collapse
|
6
|
Heusser MR, Jagadisan UK, Gandhi NJ. Drifting population dynamics with transient resets characterize sensorimotor transformation in the monkey superior colliculus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.03.522634. [PMID: 36711849 PMCID: PMC9881850 DOI: 10.1101/2023.01.03.522634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
To produce goal-directed eye movements known as saccades, we must channel sensory input from our environment through a process known as sensorimotor transformation. The behavioral output of this phenomenon (an accurate eye movement) is straightforward, but the coordinated activity of neurons underlying its dynamics is not well understood. We searched for a neural correlate of sensorimotor transformation in the activity patterns of simultaneously recorded neurons in the superior colliculus (SC) of three male rhesus monkeys performing a visually guided, delayed saccade task. Neurons in the intermediate layers produce a burst of spikes both following the appearance of a visual (sensory) stimulus and preceding an eye movement command, but many also exhibit a sustained activity level during the intervening time ("delay period"). This sustained activity could be representative of visual processing or motor preparation, along with countless cognitive processes. Using a novel measure we call the Visuomotor Proximity Index (VMPI), we pitted visual and motor signals against each other by measuring the degree to which each session's population activity (as summarized in a low-dimensional framework) could be considered more visual-like or more motor-like. The analysis highlighted two salient features of sensorimotor transformation. One, population activity on average drifted systematically toward a motor-like representation and intermittently reverted to a visual-like representation following a microsaccade. Two, activity patterns that drift to a stronger motor-like representation by the end of the delay period may enable a more rapid initiation of a saccade, substantiating the idea that this movement initiation mechanism is conserved across motor systems.
Collapse
Affiliation(s)
- Michelle R Heusser
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA
| | - Uday K Jagadisan
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA
| | - Neeraj J Gandhi
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
7
|
Willett SM, Mayo JP. Microsaccades are directed toward the midpoint between targets in a variably cued attention task. Proc Natl Acad Sci U S A 2023; 120:e2220552120. [PMID: 37155892 PMCID: PMC10194007 DOI: 10.1073/pnas.2220552120] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Accepted: 04/10/2023] [Indexed: 05/10/2023] Open
Abstract
Reliable, noninvasive biomarkers that reveal the internal state of a subject are an invaluable tool for neurological diagnoses. Small fixational eye movements, called microsaccades, are a candidate biomarker thought to reflect a subject's focus of attention [Z. M. Hafed, J. J. Clark, VisionRes. 42, 2533-2545 (2002); R. Engbert, R. Kliegl, VisionRes. 43, 1035-1045 (2003)]. The linkage between the direction of microsaccades and attention has mainly been demonstrated using explicit and unambiguous attentional cues. However, the natural world is seldom predictable and rarely provides unambiguous information. Thus, a useful biomarker must be robust to such changes in environmental statistics. To determine how well microsaccades reveal visual-spatial attention across behavioral contexts, we analyzed these fixational eye movements in monkeys performing a conventional change detection task. The task included two stimulus locations and variable cue validities across blocks of trials. Subjects were adept at the task, showing precise and graded modulations of visual attention for subtle target changes and performing better and faster when the cue was more reliable [J. P. Mayo, J. H. R. Maunsell, J. Neurosci. 36, 5353 (2016)]. However, over tens of thousands of microsaccades, we found no difference in microsaccade direction between cued locations when cue variability was high nor between hit and miss trials. Instead, microsaccades were made toward the midpoint of the two target locations, not toward individual targets. Our results suggest that the direction of microsaccades should be interpreted with caution and may not be a reliable measure of covert spatial attention in more complex viewing conditions.
Collapse
Affiliation(s)
- Shawn M. Willett
- Department of Ophthalmology, Center for the Neural Basis of Cognition, University of Pittsburgh, 15213 Pittsburgh, PA
| | - J. Patrick Mayo
- Department of Ophthalmology, Center for the Neural Basis of Cognition, University of Pittsburgh, 15213 Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, 15260 Pittsburgh, PA
| |
Collapse
|
8
|
Watamaniuk SNJ, Badler JB, Heinen SJ. Peripheral targets attenuate miniature eye movements during fixation. Sci Rep 2023; 13:7418. [PMID: 37150766 PMCID: PMC10164736 DOI: 10.1038/s41598-023-34066-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 04/24/2023] [Indexed: 05/09/2023] Open
Abstract
Fixating a small dot is a universal technique for stabilizing gaze in vision and eye movement research, and for clinical imaging of normal and diseased retinae. During fixation, microsaccades and drifts occur that presumably benefit vision, yet microsaccades compromise image stability and usurp task attention. Previous work suggested that microsaccades and smooth pursuit catch-up saccades are controlled by similar mechanisms. This, and other previous work showing fewer catch-up saccades during smooth pursuit of peripheral targets suggested that a peripheral target might similarly mitigate microsaccades. Here, human observers fixated one of three stimuli: a small central dot, the center of a peripheral, circular array of small dots, or a central/peripheral stimulus created by combining the two. The microsaccade rate was significantly lower with the peripheral array than with the dot. However, inserting the dot into the array increased the microsaccade rate to single-dot levels. Drift speed also decreased with the peripheral array, both with and without the central dot. Eye position variability was higher with the array than with the composite stimulus. The results suggest that analogous to the foveal pursuit, foveating a stationary target engages the saccadic system likely compromising retinal-image stability. In contrast, fixating a peripheral stimulus improves stability, thereby affording better retinal imaging and releasing attention for experimental tasks.
Collapse
Affiliation(s)
- Scott N J Watamaniuk
- Wright State University, Dayton, USA.
- The Smith-Kettlewell Eye Research Institute, San Francisco, USA.
| | - Jeremy B Badler
- The Smith-Kettlewell Eye Research Institute, San Francisco, USA
- University of Marburg, Marburg, Germany
| | | |
Collapse
|
9
|
Willett SM, Mayo JP. Microsaccades are directed towards the midpoint between targets in a variably cued attention task. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.24.525403. [PMID: 36747814 PMCID: PMC9900773 DOI: 10.1101/2023.01.24.525403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
Reliable, non-invasive biomarkers that reveal the internal state of a subject are an invaluable tool for neurological diagnoses. Small fixational eye movements, called microsaccades, are a candidate biomarker thought to reflect a subject's focus of attention (1, 2). The linkage between the direction of microsaccades and attention has mainly been demonstrated using explicit and unambiguous attentional cues. However, the natural world is seldom predictable and rarely provides unambiguous information. Thus, a useful biomarker must be robust to such changes in environmental statistics. To determine how well microsaccades reveal visual-spatial attention across behavioral contexts, we analyzed these fixational eye movements in monkeys performing a conventional change detection task. The task included two stimulus locations and variable cue validities across blocks of trials. Subjects were adept at the task, showing precise and graded modulations of visual attention for subtle target changes and performing better and faster when the cue was more reliable (3). However, over tens of thousands of microsaccades, we found no difference in microsaccade direction between cued locations when cue variability was high nor between hit and miss trials. Instead, microsaccades were made towards the midpoint of the two target locations, not towards individual targets. Our results suggest that the direction of microsaccades should be interpreted with caution and may not be a reliable measure of covert spatial attention in more complex viewing conditions. Significance Statement Small fixational eye movements called microsaccades are thought to "point" towards a location that is being attended in the visual periphery. This phenomenon has largely been studied using visual cues that unambiguously indicate the location of the upcoming stimulus change. Because the natural world is rarely unambiguous, we studied the relationship between microsaccade direction and spatial attention using less reliable cues. We found that monkeys' microsaccade directions in a standard visuospatial attention task did not indicate the animals' focus of attention, despite behavioral and neuronal evidence of spatial attention. Instead, microsaccades were made towards the midpoint between the target locations in both animals, suggesting a more complex relationship between microsaccades and attention in naturalistic settings.
Collapse
|
10
|
Abstract
Human perceptual learning, experience-induced gains in sensory discrimination, typically yields long-term performance improvements. Recent research revealed long-lasting transfer at the untrained location enabled by feature-based attention (FBA), reminiscent of its global effect (Hung & Carrasco, Scientific Reports, 11(1), 13914, (2021)). Visual Perceptual Learning (VPL) is typically studied while observers maintain fixation, but the role of fixational eye movements is unknown. Microsaccades - the largest of fixational eye movements - provide a continuous, online, physiological measure from the oculomotor system that reveals dynamic processing, which is unavailable from behavioral measures alone. We investigated whether and how microsaccades change after training in an orientation discrimination task. For human observers trained with or without FBA, microsaccade rates were significantly reduced during the response window in both trained and untrained locations and orientations. Critically, consistent with long-term training benefits, this microsaccade-rate reduction persisted over a year. Furthermore, microsaccades were biased toward the target location prior to stimulus onset and were more suppressed for incorrect than correct trials after observers' responses. These findings reveal that fixational eye movements and VPL are tightly coupled and that learning-induced microsaccade changes are long lasting. Thus, microsaccades reflect functional dynamics of the oculomotor system during information encoding, maintenance and readout, and may serve as a reliable long-term physiological correlate in VPL.
Collapse
|
11
|
Faster Detection of "Darks" than "Brights" by Monkey Superior Colliculus Neurons. J Neurosci 2022; 42:9356-9371. [PMID: 36319117 PMCID: PMC9794369 DOI: 10.1523/jneurosci.1489-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Revised: 09/28/2022] [Accepted: 10/25/2022] [Indexed: 12/30/2022] Open
Abstract
Visual processing is segregated into ON and OFF channels as early as in the retina, and the superficial (output) layers of the primary visual cortex (V1) are dominated by neurons preferring dark stimuli. However, it is not clear how the timing of neural processing differs between "darks" and "brights" in general, especially in light of psychophysical evidence; it is also equally not clear how subcortical visual pathways that are critical for active orienting represent stimuli of positive (luminance increments) and negative (luminance decrements) contrast polarity. Here, we recorded from all visually-responsive neuron types in the superior colliculus (SC) of two male rhesus macaque monkeys. We presented a disk (0.51° radius) within the response fields (RFs) of neurons, and we varied, across trials, stimulus Weber contrast relative to a gray background. We also varied contrast polarity. There was a large diversity of preferences for darks and brights across the population. However, regardless of individual neural sensitivity, most neurons responded significantly earlier to dark than bright stimuli. This resulted in a dissociation between neural preference and visual response onset latency: a neuron could exhibit a weaker response to a dark stimulus than to a bright stimulus of the same contrast, but it would still have an earlier response to the dark stimulus. Our results highlight an additional candidate visual neural pathway for explaining behavioral differences between the processing of darks and brights, and they demonstrate the importance of temporal aspects in the visual neural code for orienting eye movements.SIGNIFICANCE STATEMENT Objects in our environment, such as birds flying across a bright sky, often project shadows (or images darker than the surround) on our retina. We studied how primate superior colliculus (SC) neurons visually process such dark stimuli. We found that the overall population of SC neurons represented both dark and bright stimuli equally well, as evidenced by a relatively equal distribution of neurons that were either more or less sensitive to darks. However, independent of sensitivity, the great majority of neurons detected dark stimuli earlier than bright stimuli, evidenced by a smaller response latency for the dark stimuli. Thus, SC neural response latency can be dissociated from response sensitivity, and it favors the faster detection of dark image contrasts.
Collapse
|
12
|
Zhang T, Malevich T, Baumann MP, Hafed ZM. Superior colliculus saccade motor bursts do not dictate movement kinematics. Commun Biol 2022; 5:1222. [DOI: 10.1038/s42003-022-04203-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Accepted: 11/01/2022] [Indexed: 11/13/2022] Open
Abstract
AbstractThe primate superior colliculus (SC) contains a topographic map of space, such that the anatomical location of active neurons defines a desired eye movement vector. Complementing such a spatial code, SC neurons also exhibit saccade-related bursts that are tightly synchronized with movement onset. Current models suggest that such bursts constitute a rate code dictating movement kinematics. Here, using two complementary approaches, we demonstrate a dissociation between the SC rate code and saccade kinematics. First, we show that SC burst strength systematically varies depending on whether saccades of the same amplitude are directed towards the upper or lower visual fields, but the movements themselves have similar kinematics. Second, we show that for the same saccade vector, when saccades are significantly slowed down by the absence of a visible saccade target, SC saccade-related burst strengths can be elevated rather than diminished. Thus, SC saccade-related motor bursts do not necessarily dictate movement kinematics.
Collapse
|
13
|
Wu Y, Wang T, Zhou T, Li Y, Yang Y, Dai W, Zhang Y, Han C, Xing D. V1-bypassing suppression leads to direction-specific microsaccade modulation in visual coding and perception. Nat Commun 2022; 13:6366. [PMID: 36289224 PMCID: PMC9606005 DOI: 10.1038/s41467-022-34057-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 10/11/2022] [Indexed: 12/25/2022] Open
Abstract
Microsaccades play a critical role in refreshing visual information and have been shown to have direction-specific influences on human perception. However, the neural mechanisms underlying such direction-specific effects remains unknown. Here, we report the emergence of direction-specific microsaccade modulation in the middle layer of V2 but not in V1: responses of V2 neurons after microsaccades moved toward their receptive fields were stronger than those when microsaccades moved away. The decreased responses from V1 to V2, which are correlated with the amplitude of microsaccades away from receptive fields, suggest topographically location-specific suppression from an oculomotor source. Consistent with directional effects in V2, microsaccades function as a guide for monkeys' behavior in a peripheral detection task; both can be explained by a dynamic neural network. Our findings suggest a V1-bypassing suppressive circuit for direction-specific microsaccade modulation in V2 and its functional influence on visual sensitivity, which highlights the optimal sampling nature of microsaccades.
Collapse
Affiliation(s)
- Yujie Wu
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Tian Wang
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China ,grid.20513.350000 0004 1789 9964College of Life Sciences, Beijing Normal University, Beijing, 100875 China
| | - Tingting Zhou
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Yang Li
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Yi Yang
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Weifeng Dai
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Yange Zhang
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Chuanliang Han
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| | - Dajun Xing
- grid.20513.350000 0004 1789 9964State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875 China
| |
Collapse
|
14
|
Ishibashi T, Matsumoto C, Nomoto H, Tanabe F, Narita I, Ishibashi M, Okuyama S, Kayazawa T, Kimura S, Yamanaka K, Kusaka S. Measurement of Fixational Eye Movements With the Head-Mounted Perimeter Imo. Transl Vis Sci Technol 2022; 11:26. [PMID: 36018585 PMCID: PMC9428364 DOI: 10.1167/tvst.11.8.26] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose Although visual field testing is conducted with the subject gazing at a fixation target, constant minute eye movements, called fixational eye movements, do occur during fixation. We examined dynamic changes in fixational eye movements associated with stimulus presentation during visual field testing. Methods We used the head-mounted perimeter imo, which is capable of measurement under binocular conditions, with the frame rate of its fixation monitoring camera improved to 300 Hz, to assess fixational eye movements in 18 healthy individuals. We measured changes in fixational eye movements during testing under monocular and binocular conditions and analyzed these changes based on the bivariate contour ellipse area (BCEA). We also assessed the changes in the horizontal and vertical microsaccade rates separately. Results Both the BCEA and horizontal microsaccade rates were higher at 400 to 600 msec after stimulus presentation than during stimulus presentation (P < 0.01). Additionally, the BCEA and vertical microsaccade rates were significantly lower in the binocular condition than in the monocular condition (P < 0.01 and P < 0.05, respectively). We did not observe a significant correlation between the test locations and microsaccade direction during visual field testing. Conclusions Fixational eye movements, especially vertical microsaccade rates, were lower in the binocular condition than in the monocular condition. Visual field testing under binocular conditions is a useful method for suppressing fixational eye movements and stabilizing the fixation during testing and may improve the reliability of the test results. Translational Relevance Visual field testing under binocular conditions can make the fixation more stable during the testing compared with monocular conditions.
Collapse
Affiliation(s)
- Takuya Ishibashi
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Chota Matsumoto
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Hiroki Nomoto
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Fumi Tanabe
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Ikumi Narita
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Marika Ishibashi
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Sachiko Okuyama
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Tomoyasu Kayazawa
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| | - Shinji Kimura
- CREWT Medical Systems, Inc., Shinjuku-ku, Tokyo, Japan
| | | | - Shunji Kusaka
- Department of Ophthalmology, Kindai University Faculty of Medicine, Osakasayama City, Osaka, Japan
| |
Collapse
|
15
|
Suppression without inhibition: how retinal computation contributes to saccadic suppression. Commun Biol 2022; 5:692. [PMID: 35821404 PMCID: PMC9276698 DOI: 10.1038/s42003-022-03526-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 05/23/2022] [Indexed: 11/08/2022] Open
Abstract
Visual perception remains stable across saccadic eye movements, despite the concurrent strongly disruptive visual flow. This stability is partially associated with a reduction in visual sensitivity, known as saccadic suppression, which already starts in the retina with reduced ganglion cell sensitivity. However, the retinal circuit mechanisms giving rise to such suppression remain unknown. Here, we describe these mechanisms using electrophysiology in mouse, pig, and macaque retina, 2-photon calcium imaging, computational modeling, and human psychophysics. We find that sequential stimuli, like those that naturally occur during saccades, trigger three independent suppressive mechanisms in the retina. The main mechanism is triggered by contrast-reversing sequential stimuli and originates within the receptive field center of ganglion cells. It does not involve inhibition or other known suppressive mechanisms like saturation or adaptation. Instead, it relies on temporal filtering of the inherently slow response of cone photoreceptors coupled with downstream nonlinearities. Two further mechanisms of suppression are present predominantly in ON ganglion cells and originate in the receptive field surround, highlighting another disparity between ON and OFF ganglion cells. The mechanisms uncovered here likely play a role in shaping the retinal output following eye movements and other natural viewing conditions where sequential stimulation is ubiquitous.
Collapse
|
16
|
Niemeyer JE, Akers-Campbell S, Gregoire A, Paradiso MA. Perceptual enhancement and suppression correlate with V1 neural activity during active sensing. Curr Biol 2022; 32:2654-2667.e4. [PMID: 35584697 PMCID: PMC9233080 DOI: 10.1016/j.cub.2022.04.067] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 03/03/2022] [Accepted: 04/22/2022] [Indexed: 11/26/2022]
Abstract
Perception in multiple sensory modalities is an active process that involves exploratory behaviors. In humans and other primates, vision results from sensory sampling guided by saccadic eye movements. Saccades are known to modulate visual perception, and a corollary discharge signal associated with saccades appears to establish a sense of visual stability. Neural recordings have shown that saccades also modulate activity widely across the brain. To investigate the neural basis of saccadic effects on perception, simultaneous recordings from multiple neurons in area V1 were made as animals performed a contrast detection task. Perceptual and neural measures were compared when the animal made real saccades that brought a stimulus into V1 receptive fields and when simulated saccades were made (identical retinal stimulation but no eye movement). When real saccades were made and low spatial frequency stimuli were presented, we observed a reduction in both perceptual sensitivity and neural activity compared with simulated saccades; conversely, with higher spatial frequency stimuli, saccades increased visual sensitivity and neural activity. The performance of neural decoders, which used the activity of the population of simultaneously recorded neurons, showed saccade effects on sensitivity that mirrored the frequency-dependent perceptual changes, suggesting that the V1 population activity could support the perceptual effects. A minority of V1 neurons had significant choice probabilities, and the saccades decreased both average choice probability and pairwise noise correlations. Taken together, the findings suggest that a signal related to saccadic eye movements alters V1 spiking to increase the independence of spiking neurons and bias the system toward processing higher spatial frequencies, presumably to enhance object recognition. The effects of saccades on visual perception and noise correlations appear to parallel effects observed in other sensory modalities, suggesting a general principle of active sensory processing.
Collapse
Affiliation(s)
- James E Niemeyer
- Department of Neurological Surgery, Weill Cornell Medicine, New York, NY, USA; Department of Neuroscience, Brown University, Providence, RI, USA
| | | | - Aaron Gregoire
- School of Engineering, Brown University, Providence, RI, USA
| | | |
Collapse
|
17
|
Severe distortion in the representation of foveal visual image locations in short-term memory. Proc Natl Acad Sci U S A 2022; 119:e2121860119. [PMID: 35675430 PMCID: PMC9214507 DOI: 10.1073/pnas.2121860119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
The foveal visual image region provides the human visual system with the highest acuity. However, it is unclear whether such a high fidelity representational advantage is maintained when foveal image locations are committed to short-term memory. Here, we describe a paradoxically large distortion in foveal target location recall by humans. We briefly presented small, but high contrast, points of light at eccentricities ranging from 0.1 to 12°, while subjects maintained their line of sight on a stable target. After a brief memory period, the subjects indicated the remembered target locations via computer controlled cursors. The biggest localization errors, in terms of both directional deviations and amplitude percentage overshoots or undershoots, occurred for the most foveal targets, and such distortions were still present, albeit with qualitatively different patterns, when subjects shifted their gaze to indicate the remembered target locations. Foveal visual images are severely distorted in short-term memory.
Collapse
|
18
|
Johnston R, Snyder AC, Schibler RS, Smith MA. EEG Signals Index a Global Signature of Arousal Embedded in Neuronal Population Recordings. eNeuro 2022; 9:ENEURO.0012-22.2022. [PMID: 35606150 PMCID: PMC9186107 DOI: 10.1523/eneuro.0012-22.2022] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 05/04/2022] [Accepted: 05/05/2022] [Indexed: 01/01/2023] Open
Abstract
Electroencephalography (EEG) has long been used to index brain states, from early studies describing activity in the presence and absence of visual stimulation to modern work employing complex perceptual tasks. These studies have shed light on brain-wide signals but often lack explanatory power at the single neuron level. Similarly, single neuron recordings can suffer from an inability to measure brain-wide signals accessible using EEG. Here, we combined these techniques while monkeys performed a change detection task and discovered a novel link between spontaneous EEG activity and a neural signal embedded in the spiking responses of neuronal populations. This "slow drift" was associated with fluctuations in the subjects' arousal levels over time: decreases in prestimulus α power were accompanied by increases in pupil size and decreases in microsaccade rate. These results show that brain-wide EEG signals can be used to index modes of activity present in single neuron recordings, that in turn reflect global changes in brain state that influence perception and behavior.
Collapse
Affiliation(s)
- Richard Johnston
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA 15213
| | - Adam C Snyder
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, PA 14627
- Department of Neuroscience, University of Rochester, Rochester, NY 14642
- Center for Visual Science, University of Rochester, Rochester, NY 14627
| | | | - Matthew A Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA 15213
| |
Collapse
|
19
|
Yu G, Herman JP, Katz LN, Krauzlis RJ. Microsaccades as a marker not a cause for attention-related modulation. eLife 2022; 11:74168. [PMID: 35289268 PMCID: PMC8923660 DOI: 10.7554/elife.74168] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 01/26/2022] [Indexed: 11/13/2022] Open
Abstract
Recent evidence suggests that microsaccades are causally linked to the attention-related modulation of neurons—specifically, that microsaccades toward the attended location are required for the subsequent changes in firing rate. These findings have raised questions about whether attention-related modulation is due to different states of attention as traditionally assumed or might instead be a secondary effect of microsaccades. Here, in two rhesus macaques, we tested the relationship between microsaccades and attention-related modulation in the superior colliculus (SC), a brain structure crucial for allocating attention. We found that attention-related modulation emerged even in the absence of microsaccades, was already present prior to microsaccades toward the cued stimulus, and persisted through the suppression of activity that accompanied all microsaccades. Nonetheless, consistent with previous findings, we also found significant attention-related modulation when microsaccades were directed toward, rather than away from, the cued location. Thus, despite the clear links between microsaccades and attention, microsaccades are not necessary for attention-related modulation, at least not in the SC. They do, however, provide an additional marker for the state of attention, especially at times when attention is shifting from one location to another.
Collapse
Affiliation(s)
- Gongchen Yu
- Laboratory of Sensorimotor Research, National Eye Institute
| | - James P Herman
- Department of Ophthalmology, University of Pittsburgh School of Medicine
| | - Leor N Katz
- Laboratory of Sensorimotor Research, National Eye Institute
| | | |
Collapse
|
20
|
Rima S, Schmid MC. Reading Specific Small Saccades Predict Individual Phonemic Awareness and Reading Speed. Front Neurosci 2021; 15:663242. [PMID: 34966251 PMCID: PMC8710594 DOI: 10.3389/fnins.2021.663242] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Accepted: 11/12/2021] [Indexed: 11/30/2022] Open
Abstract
Small fixational eye-movements are a fundamental aspect of vision and thought to reflect fine shifts in covert attention during active viewing. While the perceptual benefits of these small eye movements have been demonstrated during a wide range of experimental tasks including during free viewing, their function during reading remains surprisingly unclear. Previous research demonstrated that readers with increased microsaccade rates displayed longer reading speeds. To what extent increased fixational eye movements are, however, specific to reading and might be indicative of reading skill deficits remains, however, unknown. To address this topic, we compared the eye movement scan paths of 13 neurotypical individuals and 13 subjects diagnosed with developmental dyslexia during short story reading and free viewing of natural scenes. We found that during reading only, dyslexics tended to display small eye movements more frequently compared to neurotypicals, though this effect was not significant at the population level, as it could also occur in slow readers not diagnosed as dyslexics. In line with previous research, neurotypical readers had twice as many regressive compared to progressive microsaccades, which did not occur during free viewing. In contrast, dyslexics showed similar amounts of regressive and progressive small fixational eye movements during both reading and free viewing. We also found that participants with smaller fixational saccades from both neurotypical and dyslexic samples displayed reduced reading speeds and lower scores during independent tests of reading skill. Slower readers also displayed greater variability in the landing points and temporal occurrence of their fixational saccades. Both the rate and spatio-temporal variability of fixational saccades were associated with lower phonemic awareness scores. As none of the observed differences between dyslexics and neurotypical readers occurred during control experiments with free viewing, the reported effects appear to be directly related to reading. In summary, our results highlight the predictive value of small saccades for reading skill, but not necessarily for developmental dyslexia.
Collapse
Affiliation(s)
- Samy Rima
- Department of Sport and Neuroscience, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland
| | - Michael C Schmid
- Department of Sport and Neuroscience, Faculty of Science and Medicine, University of Fribourg, Fribourg, Switzerland.,Bioscience Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
21
|
Superior colliculus projections to target populations in the supraoculomotor area of the macaque monkey. Vis Neurosci 2021; 38. [DOI: 10.1017/s095252382100016x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Abstract
A projection by the superior colliculus to the supraoculomotor area (SOA) located dorsal to the oculomotor complex was first described in 1978. This projection’s targets have yet to be identified, although the initial study suggested that vertical gaze motoneuron dendrites might receive this input. Defining the tectal targets is complicated by the fact the SOA contains a number of different cell populations. In the present study, we used anterograde tracers to characterize collicular axonal arbors and retrograde tracers to label prospective SOA target populations in macaque monkeys. Close associations were not found with either superior or medial rectus motoneurons whose axons supply singly innervated muscle fibers. S-group motoneurons, which supply superior rectus multiply innervated muscle fibers, appeared to receive a very minor input, but C-group motoneurons, which supply medial rectus multiply innervated muscle fibers, received no input. A number of labeled boutons were observed in close association with SOA neurons projecting to the spinal cord, or the reticular formation in the pons and medulla. These descending output neurons are presumed to be peptidergic cells within the centrally projecting Edinger–Westphal population. It is possible the collicular input provides a signaling function for neurons in this population that serve roles in either stress responses, or in eating and drinking behavior. Finally, a number of close associations were observed between tectal terminals and levator palpebrae superioris motoneurons, suggesting the possibility that the superior colliculus provides a modest direct input for raising the eyelids during upward saccades.
Collapse
|
22
|
Hsu TY, Chen JT, Tseng P, Wang CA. Role of the frontal eye field in human microsaccade responses: A TMS study. Biol Psychol 2021; 165:108202. [PMID: 34634433 DOI: 10.1016/j.biopsycho.2021.108202] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 09/22/2021] [Accepted: 10/01/2021] [Indexed: 01/02/2023]
Abstract
Microsaccade is a type of fixational eye movements that is modulated by various sensory and cognitive processes, and impact our visual perception. Although studies in monkeys have demonstrated a functional role for the superior colliculus and frontal eye field (FEF) in controlling microsaccades, our understanding of the neural mechanisms underlying the generation of microsaccades is still limited. By applying continuous theta-burst stimulation (cTBS) over the right FEF and the vertex, we investigated the role of the FEF in generating human microsaccade responses evoked by salient stimuli or by changes in background luminance. We observed higher microsaccade rates prior to target appearance, and larger rebound in microsaccade occurrence following salient stimuli, when disruptive cTBS was applied over FEF compared to vertex stimulation. Moreover, the microsaccade direction modulation after changes in background luminance was disrupted with FEF stimulation. Together, our results constitute the first evidence of FEF modulation in human microsaccade responses.
Collapse
Affiliation(s)
- Tzu-Yu Hsu
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
| | - Jui-Tai Chen
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan; Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Philip Tseng
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
| | - Chin-An Wang
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan; Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City, Taiwan.
| |
Collapse
|
23
|
Markanday A, Inoue J, Dicke PW, Thier P. Cerebellar complex spikes multiplex complementary behavioral information. PLoS Biol 2021; 19:e3001400. [PMID: 34529650 PMCID: PMC8478165 DOI: 10.1371/journal.pbio.3001400] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2020] [Revised: 09/28/2021] [Accepted: 08/25/2021] [Indexed: 12/02/2022] Open
Abstract
Purkinje cell (PC) discharge, the only output of cerebellar cortex, involves 2 types of action potentials, high-frequency simple spikes (SSs) and low-frequency complex spikes (CSs). While there is consensus that SSs convey information needed to optimize movement kinematics, the function of CSs, determined by the PC’s climbing fiber input, remains controversial. While initially thought to be specialized in reporting information on motor error for the subsequent amendment of behavior, CSs seem to contribute to other aspects of motor behavior as well. When faced with the bewildering diversity of findings and views unraveled by highly specific tasks, one may wonder if there is just one true function with all the other attributions wrong? Or is the diversity of findings a reflection of distinct pools of PCs, each processing specific streams of information conveyed by climbing fibers? With these questions in mind, we recorded CSs from the monkey oculomotor vermis deploying a repetitive saccade task that entailed sizable motor errors as well as small amplitude saccades, correcting them. We demonstrate that, in addition to carrying error-related information, CSs carry information on the metrics of both primary and small corrective saccades in a time-specific manner, with changes in CS firing probability coupled with changes in CS duration. Furthermore, we also found CS activity that seemed to predict the upcoming events. Hence PCs receive a multiplexed climbing fiber input that merges complementary streams of information on the behavior, separable by the recipient PC because they are staggered in time. Purkinje cell (PC) discharge, the only output of cerebellar cortex, involves both high-frequency simple spikes and low-frequency complex spikes; the function of the latter, determined by a PC’s climbing fibre input, remains controversial. This study shows that PCs receive a multiplexed climbing fibre input that merges complementary streams of information relevant for behaviour.
Collapse
Affiliation(s)
- Akshay Markanday
- Hertie Institute for Clinical Brain Research, Tübingen, Germany
- Graduate School of Neural and Behavioral Sciences, International Max Planck Research School, Tübingen University, Tübingen, Germany
- * E-mail: (AM); (PT)
| | - Junya Inoue
- Graduate School of Neural and Behavioral Sciences, International Max Planck Research School, Tübingen University, Tübingen, Germany
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
| | - Peter W. Dicke
- Hertie Institute for Clinical Brain Research, Tübingen, Germany
| | - Peter Thier
- Hertie Institute for Clinical Brain Research, Tübingen, Germany
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- * E-mail: (AM); (PT)
| |
Collapse
|
24
|
Fast and nonuniform dynamics of perisaccadic vision in the central fovea. Proc Natl Acad Sci U S A 2021; 118:2101259118. [PMID: 34497123 PMCID: PMC8449317 DOI: 10.1073/pnas.2101259118] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2021] [Indexed: 01/05/2023] Open
Abstract
Humans shift their gaze more frequently than their heart beats. These rapid eye movements (saccades) enable high visual acuity by redirecting the tiny high-resolution region of the retina (the foveola). But in doing so, they abruptly sweep the image across receptors, raising questions on how the visual system achieves stable percepts. It is well established that visual sensitivity is transiently attenuated during saccades. However, little is known about the time course of foveal vision despite its disproportionate importance, as technical challenges have so far prevented study of how saccades affect the foveola. Here we show that saccades modulate this region in a nonuniform manner, providing stronger and faster changes at its very center, a locus with higher sensitivity. Humans use rapid eye movements (saccades) to inspect stimuli with the foveola, the region of the retina where receptors are most densely packed. It is well established that visual sensitivity is generally attenuated during these movements, a phenomenon known as saccadic suppression. This effect is commonly studied with large, often peripheral, stimuli presented during instructed saccades. However, little is known about how saccades modulate the foveola and how the resulting dynamics unfold during natural visual exploration. Here we measured the foveal dynamics of saccadic suppression in a naturalistic high-acuity task, a task designed after primates’ social grooming, which—like most explorations of fine patterns—primarily elicits minute saccades (microsaccades). Leveraging on recent advances in gaze-contingent display control, we were able to systematically map the perisaccadic time course of sensitivity across the foveola. We show that contrast sensitivity is not uniform across this region and that both the extent and dynamics of saccadic suppression vary within the foveola. Suppression is stronger and faster in the most central portion, where sensitivity is generally higher and selectively rebounds at the onset of a new fixation. These results shed light on the modulations experienced by foveal vision during the saccade-fixation cycle and explain some of the benefits of microsaccades.
Collapse
|
25
|
Spontaneous modulations of high-frequency cortical activity. Clin Neurophysiol 2021; 132:2391-2403. [PMID: 34454266 DOI: 10.1016/j.clinph.2021.06.020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Revised: 05/15/2021] [Accepted: 06/01/2021] [Indexed: 11/20/2022]
Abstract
OBJECTIVE We clarified the clinical and mechanistic significance of physiological modulations of high-frequency broadband cortical activity associated with spontaneous saccadic eye movements during a resting state. METHODS We studied 30 patients who underwent epilepsy surgery following extraoperative electrocorticography and electrooculography recordings. We determined whether high-gamma activity at 70-110 Hz preceding saccade onset would predict upcoming ocular behaviors. We assessed how accurately the model incorporating saccade-related high-gamma modulations would localize the primary visual cortex defined by electrical stimulation. RESULTS The dynamic atlas demonstrated transient high-gamma suppression in the striatal cortex before saccade onset and high-gamma augmentation subsequently involving the widespread posterior brain regions. More intense striatal high-gamma suppression predicted the upcoming saccade directed to the ipsilateral side and lasting longer in duration. The bagged-tree-ensemble model demonstrated that intense saccade-related high-gamma modulations localized the visual cortex with an accuracy of 95%. CONCLUSIONS We successfully animated the neural dynamics supporting saccadic suppression, a principal mechanism minimizing the perception of blurred vision during rapid eye movements. The primary visual cortex per se may prepare actively in advance for massive image motion expected during upcoming prolonged saccades. SIGNIFICANCE Measuring saccade-related electrocorticographic signals may help localize the visual cortex and avoid misperceiving physiological high-frequency activity as epileptogenic.
Collapse
|
26
|
Huber-Huber C, Buonocore A, Melcher D. The extrafoveal preview paradigm as a measure of predictive, active sampling in visual perception. J Vis 2021; 21:12. [PMID: 34283203 PMCID: PMC8300052 DOI: 10.1167/jov.21.7.12] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Accepted: 05/18/2021] [Indexed: 01/02/2023] Open
Abstract
A key feature of visual processing in humans is the use of saccadic eye movements to look around the environment. Saccades are typically used to bring relevant information, which is glimpsed with extrafoveal vision, into the high-resolution fovea for further processing. With the exception of some unusual circumstances, such as the first fixation when walking into a room, our saccades are mainly guided based on this extrafoveal preview. In contrast, the majority of experimental studies in vision science have investigated "passive" behavioral and neural responses to suddenly appearing and often temporally or spatially unpredictable stimuli. As reviewed here, a growing number of studies have investigated visual processing of objects under more natural viewing conditions in which observers move their eyes to a stationary stimulus, visible previously in extrafoveal vision, during each trial. These studies demonstrate that the extrafoveal preview has a profound influence on visual processing of objects, both for behavior and neural activity. Starting from the preview effect in reading research we follow subsequent developments in vision research more generally and finally argue that taking such evidence seriously leads to a reconceptualization of the nature of human visual perception that incorporates the strong influence of prediction and action on sensory processing. We review theoretical perspectives on visual perception under naturalistic viewing conditions, including theories of active vision, active sensing, and sampling. Although the extrafoveal preview paradigm has already provided useful information about the timing of, and potential mechanisms for, the close interaction of the oculomotor and visual systems while reading and in natural scenes, the findings thus far also raise many new questions for future research.
Collapse
Affiliation(s)
- Christoph Huber-Huber
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, The Netherlands
- CIMeC, University of Trento, Italy
| | - Antimo Buonocore
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, BW, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, BW, Germany
| | - David Melcher
- CIMeC, University of Trento, Italy
- Division of Science, New York University Abu Dhabi, UAE
| |
Collapse
|
27
|
Full gaze contingency provides better reading performance than head steering alone in a simulation of prosthetic vision. Sci Rep 2021; 11:11121. [PMID: 34045485 PMCID: PMC8160142 DOI: 10.1038/s41598-021-86996-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 03/23/2021] [Indexed: 11/08/2022] Open
Abstract
The visual pathway is retinotopically organized and sensitive to gaze position, leading us to hypothesize that subjects using visual prostheses incorporating eye position would perform better on perceptual tasks than with devices that are merely head-steered. We had sighted subjects read sentences from the MNREAD corpus through a simulation of artificial vision under conditions of full gaze compensation, and head-steered viewing. With 2000 simulated phosphenes, subjects (n = 23) were immediately able to read under full gaze compensation and were assessed at an equivalent visual acuity of 1.0 logMAR, but were nearly unable to perform the task under head-steered viewing. At the largest font size tested, 1.4 logMAR, subjects read at 59 WPM (50% of normal speed) with 100% accuracy under the full-gaze condition, but at 0.7 WPM (under 1% of normal) with below 15% accuracy under head-steering. We conclude that gaze-compensated prostheses are likely to produce considerably better patient outcomes than those not incorporating eye movements.
Collapse
|
28
|
Baumann MP, Idrees S, Münch TA, Hafed ZM. Dependence of perceptual saccadic suppression on peri-saccadic image flow properties and luminance contrast polarity. J Vis 2021; 21:15. [PMID: 34003243 PMCID: PMC8131999 DOI: 10.1167/jov.21.5.15] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Across saccades, perceptual detectability of brief visual stimuli is strongly diminished. We recently observed that this perceptual suppression phenomenon is jumpstarted in the retina, suggesting that the phenomenon might be significantly more visual in nature than normally acknowledged. Here, we explicitly compared saccadic suppression strength when saccades were made across a uniform image of constant luminance versus when saccades were made across image patches of different luminance, width, and trans-saccadic luminance polarity. We measured perceptual contrast thresholds of human subjects for brief peri-saccadic flashes of positive (luminance increments) or negative (luminance decrements) polarity. Thresholds were >6–7 times higher when saccades translated a luminance stripe or edge across the retina than when saccades were made over a completely uniform image patch. Critically, both background luminance and flash luminance polarity strongly modulated peri-saccadic contrast thresholds. In addition, all of these very same visual dependencies also occurred in the absence of any saccades, but with qualitatively similar rapid translations of image patches across the retina. This similarity of visual dependencies with and without saccades supports the notion that perceptual saccadic suppression may be fundamentally a visual phenomenon, which strongly motivates neurophysiological and theoretical investigations on the role of saccadic eye movement commands in modulating its properties.
Collapse
Affiliation(s)
- Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany.,
| | - Saad Idrees
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,
| | - Thomas A Münch
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany.,
| |
Collapse
|
29
|
Raffi M, Trofè A, Perazzolo M, Meoni A, Piras A. Sensory Input Modulates Microsaccades during Heading Perception. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:2865. [PMID: 33799672 PMCID: PMC8000400 DOI: 10.3390/ijerph18062865] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 03/04/2021] [Accepted: 03/07/2021] [Indexed: 11/21/2022]
Abstract
Microsaccades are small eye movements produced during attempted fixation. During locomotion, the eyes scan the environment; the gaze is not always directed to the focus of expansion of the optic flow field. We sought to investigate whether the microsaccadic activity was modulated by eye position during the view of radial optic flow stimuli, and if the presence or lack of a proprioceptive input signal may influence the microsaccade characteristics during self-motion perception. We recorded the oculomotor activity when subjects were either standing or sitting in front of a screen during the view of optic flow stimuli that simulated specific heading directions with different gaze positions. We recorded five trials of each stimulus. Results showed that microsaccade duration, peak velocity, and rate were significantly modulated by optic flow stimuli and trial sequence. We found that the microsaccade rate increased in each condition from trial 1 to trial 5. Microsaccade peak velocity and duration were significantly different across trials. The analysis of the microsaccade directions showed that the different combinations of optic flow and eye position evoked non-uniform directions of microsaccades in standing condition with mean vectors in the upper-left quadrant of the visual field, uncorrelated with optic flow directions and eye positions. In sitting conditions, all stimuli evoked uniform directions of microsaccades. Present results indicate that the proprioceptive signals when the subjects stand up creates a different input that could alter the eye-movement characteristics during heading perceptions.
Collapse
Affiliation(s)
- Milena Raffi
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| | - Aurelio Trofè
- Department of Quality of Life, University of Bologna, 47921 Rimini, Italy;
| | - Monica Perazzolo
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| | - Andrea Meoni
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| | - Alessandro Piras
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| |
Collapse
|
30
|
Hafed ZM, Yoshida M, Tian X, Buonocore A, Malevich T. Dissociable Cortical and Subcortical Mechanisms for Mediating the Influences of Visual Cues on Microsaccadic Eye Movements. Front Neural Circuits 2021; 15:638429. [PMID: 33776656 PMCID: PMC7991613 DOI: 10.3389/fncir.2021.638429] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Accepted: 02/22/2021] [Indexed: 12/13/2022] Open
Abstract
Visual selection in primates is intricately linked to eye movements, which are generated by a network of cortical and subcortical neural circuits. When visual selection is performed covertly, without foveating eye movements toward the selected targets, a class of fixational eye movements, called microsaccades, is still involved. Microsaccades are small saccades that occur when maintaining precise gaze fixation on a stationary point, and they exhibit robust modulations in peripheral cueing paradigms used to investigate covert visual selection mechanisms. These modulations consist of changes in both microsaccade directions and frequencies after cue onsets. Over the past two decades, the properties and functional implications of these modulations have been heavily studied, revealing a potentially important role for microsaccades in mediating covert visual selection effects. However, the neural mechanisms underlying cueing effects on microsaccades are only beginning to be investigated. Here we review the available causal manipulation evidence for these effects' cortical and subcortical substrates. In the superior colliculus (SC), activity representing peripheral visual cues strongly influences microsaccade direction, but not frequency, modulations. In the cortical frontal eye fields (FEF), activity only compensates for early reflexive effects of cues on microsaccades. Using evidence from behavior, theoretical modeling, and preliminary lesion data from the primary visual cortex and microstimulation data from the lower brainstem, we argue that the early reflexive microsaccade effects arise subcortically, downstream of the SC. Overall, studying cueing effects on microsaccades in primates represents an important opportunity to link perception, cognition, and action through unaddressed cortical-subcortical neural interactions. These interactions are also likely relevant in other sensory and motor modalities during other active behaviors.
Collapse
Affiliation(s)
- Ziad M. Hafed
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Masatoshi Yoshida
- Center for Human Nature, Artificial Intelligence, and Neuroscience, Hokkaido University, Sapporo, Japan
| | - Xiaoguang Tian
- Department of Neurobiology, University of Pittsburgh Brain Institute, University of Pittsburgh, Pittsburgh, PA, United States
| | - Antimo Buonocore
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Tatiana Malevich
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
- Graduate School of Neural and Behavioural Sciences, International Max-Planck Research School, Tübingen University, Tübingen, Germany
| |
Collapse
|
31
|
Hafed ZM, Chen CY, Tian X, Baumann MP, Zhang T. Active vision at the foveal scale in the primate superior colliculus. J Neurophysiol 2021; 125:1121-1138. [PMID: 33534661 DOI: 10.1152/jn.00724.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023] Open
Abstract
The primate superior colliculus (SC) has recently been shown to possess both a large foveal representation as well as a varied visual processing repertoire. This structure is also known to contribute to eye movement generation. Here, we describe our current understanding of how SC visual and movement-related signals interact within the realm of small eye movements associated with the foveal scale of visuomotor behavior. Within the SC's foveal representation, there is a full spectrum of visual, visual-motor, and motor-related discharge for fixational eye movements. Moreover, a substantial number of neurons only emit movement-related discharge when microsaccades are visually guided, but not when similar movements are generated toward a blank. This represents a particularly striking example of integrating vision and action at the foveal scale. Beyond that, SC visual responses themselves are strongly modulated, and in multiple ways, by the occurrence of small eye movements. Intriguingly, this impact can extend to eccentricities well beyond the fovea, causing both sensitivity enhancement and suppression in the periphery. Because of large foveal magnification of neural tissue, such long-range eccentricity effects are neurally warped into smaller differences in anatomical space, providing a structural means for linking peripheral and foveal visual modulations around fixational eye movements. Finally, even the retinal-image visual flows associated with tiny fixational eye movements are signaled fairly faithfully by peripheral SC neurons with relatively large receptive fields. These results demonstrate how studying active vision at the foveal scale represents an opportunity for understanding primate vision during natural behaviors involving ever-present foveating eye movements.NEW & NOTEWORTHY The primate superior colliculus (SC) is ideally suited for active vision at the foveal scale: it enables detailed foveal visual analysis by accurately driving small eye movements, and it also possesses a visual processing machinery that is sensitive to active eye movement behavior. Studying active vision at the foveal scale in the primate SC is informative for broader aspects of active perception, including the overt and covert processing of peripheral extra-foveal visual scene locations.
Collapse
Affiliation(s)
- Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Chih-Yang Chen
- Institute for the Advanced Study of Human Biology (WPI-ASHBi), Kyoto University, Kyoto, Japan
| | - Xiaoguang Tian
- University of Pittsburgh Brain Institute, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Tong Zhang
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| |
Collapse
|
32
|
Tan KWS, Scholes C, Roach NW, Haris EM, McGraw PV. Impact of microsaccades on visual shape processing. J Neurophysiol 2020; 125:609-619. [PMID: 33378248 DOI: 10.1152/jn.00454.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Sensitivity to subtle changes in the shape of visual objects has been attributed to the existence of global pooling mechanisms that integrate local form information across space. Although global pooling is typically demonstrated under steady fixation, other work suggests prolonged fixation can lead to a collapse of global structure. Here, we ask whether small ballistic eye movements that naturally occur during periods of fixation affect the global processing of radial frequency (RF) patterns-closed contours created by sinusoidally modulating the radius of a circle. Observers were asked to discriminate the shapes of circular patterns and RF-modulated patterns while fixational eye movements were recorded binocularly at 500 Hz. Microsaccades were detected using a velocity-based algorithm, allowing trials to be sorted according to the relative timing of stimulus and microsaccade onset. Results revealed clear perisaccadic changes in shape discrimination thresholds. Performance was impaired when microsaccades occurred close to stimulus onset, but facilitated when they occurred shortly afterward. In contrast, global integration of shape was unaffected by the timing of microsaccades. These findings suggest that microsaccades alter the discrimination sensitivity to briefly presented shapes but do not disrupt the spatial pooling of local form signals.NEW & NOTEWORTHY Microsaccades cause rapid displacement of visual images during fixation and dramatically alter the perception of basic image features. However, their effect on more complex aspects of visual processing is not well understood. Here, we demonstrate a dissociation in the impact of microsaccades on shape perception. Although overall shape discrimination performance is modulated around the time of microsaccades, the pooling efficiency of global mechanisms that combine local form information across space remains unaffected.
Collapse
Affiliation(s)
- Ken W S Tan
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Chris Scholes
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Neil W Roach
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Elizabeth M Haris
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Paul V McGraw
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|
33
|
Chen CY, Matrov D, Veale R, Onoe H, Yoshida M, Miura K, Isa T. Properties of visually guided saccadic behavior and bottom-up attention in marmoset, macaque, and human. J Neurophysiol 2020; 125:437-457. [PMID: 33356912 DOI: 10.1152/jn.00312.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
Saccades are stereotypic behaviors whose investigation improves our understanding of how primate brains implement precise motor control. Furthermore, saccades offer an important window into the cognitive and attentional state of the brain. Historically, saccade studies have largely relied on macaques. However, the cortical network giving rise to the saccadic command is difficult to study in macaques because relevant cortical areas lie in deep sulci and are difficult to access. Recently, a New World monkey. the marmoset, has garnered attention as an alternative to macaques because of advantages including its smooth cortical surface. However, adoption of the marmoset for oculomotor research has been limited due to a lack of in-depth descriptions of marmoset saccade kinematics and their ability to perform psychophysical tasks. Here, we directly compare free-viewing and visually guided behavior of marmoset, macaque, and human engaged in identical tasks under similar conditions. In the video free-viewing task, all species exhibited qualitatively similar saccade kinematics up to 25° in amplitude although with different parameters. Furthermore, the conventional bottom-up saliency model predicted gaze targets at similar rates for all species. We further verified their visually guided behavior by training them with step and gap saccade tasks. In the step paradigm, marmosets did not show shorter saccade reaction time for upward saccades whereas macaques and humans did. In the gap paradigm, all species showed similar gap effect and express saccades. Our results suggest that the marmoset can serve as a model for oculomotor, attentional, and cognitive research while we need to be aware of their difference from macaque or human.NEW & NOTEWORTHY We directly compared the results of a video free-viewing task and visually guided saccade tasks (step and gap) among three different species: marmoset, macaque, and human. We found that all species exhibit qualitatively similar saccadic kinematics and saliency-driven saccadic behavior albeit with different parameters. Our results suggest that the marmoset possesses similar neural mechanisms to macaque and human for saccadic control, and it is an appropriate model to study neural mechanisms for active vision and attention.
Collapse
Affiliation(s)
- Chih-Yang Chen
- Department of Neuroscience, Graduate School of Medicine, Kyoto University, Kyoto, Japan.,Institute for the Advanced Study of Human Biology, Kyoto University, Kyoto, Japan
| | - Denis Matrov
- Department of Neuroscience, Graduate School of Medicine, Kyoto University, Kyoto, Japan.,Division of Neuropsychopharmacology, Department of Psychology, University of Tartu, Tartu, Estonia
| | - Richard Veale
- Department of Neuroscience, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Hirotaka Onoe
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Masatoshi Yoshida
- Center for Human Nature, Artificial Intelligence, and Neuroscience, Hokkaido University, Sapporo, Japan
| | - Kenichiro Miura
- Department of Integrative Brain Science, Graduate School of Medicine, Kyoto University, Kyoto, Japan.,Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo, Japan
| | - Tadashi Isa
- Department of Neuroscience, Graduate School of Medicine, Kyoto University, Kyoto, Japan.,Institute for the Advanced Study of Human Biology, Kyoto University, Kyoto, Japan.,Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| |
Collapse
|
34
|
Chen L, Liao HI. Microsaccadic Eye Movements but not Pupillary Dilation Response Characterizes the Crossmodal Freezing Effect. Cereb Cortex Commun 2020; 1:tgaa072. [PMID: 34296132 PMCID: PMC8153075 DOI: 10.1093/texcom/tgaa072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Revised: 09/24/2020] [Accepted: 09/25/2020] [Indexed: 11/14/2022] Open
Abstract
In typical spatial orienting tasks, the perception of crossmodal (e.g., audiovisual) stimuli evokes greater pupil dilation and microsaccade inhibition than unisensory stimuli (e.g., visual). The characteristic pupil dilation and microsaccade inhibition has been observed in response to "salient" events/stimuli. Although the "saliency" account is appealing in the spatial domain, whether this occurs in the temporal context remains largely unknown. Here, in a brief temporal scale (within 1 s) and with the working mechanism of involuntary temporal attention, we investigated how eye metric characteristics reflect the temporal dynamics of perceptual organization, with and without multisensory integration. We adopted the crossmodal freezing paradigm using the classical Ternus apparent motion. Results showed that synchronous beeps biased the perceptual report for group motion and triggered the prolonged sound-induced oculomotor inhibition (OMI), whereas the sound-induced OMI was not obvious in a crossmodal task-free scenario (visual localization without audiovisual integration). A general pupil dilation response was observed in the presence of sounds in both visual Ternus motion categorization and visual localization tasks. This study provides the first empirical account of crossmodal integration by capturing microsaccades within a brief temporal scale; OMI but not pupillary dilation response characterizes task-specific audiovisual integration (shown by the crossmodal freezing effect).
Collapse
Affiliation(s)
- Lihan Chen
- Department of Brain and Cognitive Sciences, Schools of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, 100871, China
| | - Hsin-I Liao
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, 243-0198, Japan
| |
Collapse
|
35
|
Abstract
Saccadic eye movements can allude to emotional states and visual attention. Recent studies have shown that microsaccadic responses (i.e., small fixational eye movements) reflect advanced brain activity during attentional and cognitive tasks. Moreover, the microsaccadic activity related to emotional attention provides new insights into this field. For example, emotional pictures attenuate the microsaccadic rate, and microsaccadic responses to covert attention occur in the direction opposite to a negative emotional target. However, the effects of various emotional events on microsaccadic activity remain debatable. This review introduces visual attention and eye movement studies that support findings on the modulation of microsaccadic responses to emotional events, comparing them with typical microsaccadic responses. This review also discusses the brain neuronal mechanisms governing microsaccadic responses to the attentional shifts triggered by emotion-related stimuli. It is hard to reveal the direct brain pathway of the microsaccadic modulation, especially in advanced (e.g., sustained anger, envy, distrust, guilt, frustration, delight, attraction, trust, and love), but also in basic human emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). However, non-human primates and human studies can uncover the possible brain pathways of emotional attention and microsaccades, thus providing future research directions. In particular, the facilitated (or reduced) attention is common evidence that microsaccadic activities change under a variety of social modalities (e.g., cognition, music, mental illness, and working memory) that elicit emotions and feelings.
Collapse
Affiliation(s)
- Koji Kashihara
- College of Information Science and Engineering, Ritsumeikan University, 1-1-1 Noji-higashi, Kusatsu, Shiga, 525-8577, Japan.
- Graduate School of Technology, Industrial and Social Sciences, Tokushima University, 2-1 Minamijyousanjima, Tokushima, 770-8506, Japan.
| |
Collapse
|
36
|
Badde S, Myers CF, Yuval-Greenberg S, Carrasco M. Oculomotor freezing reflects tactile temporal expectation and aids tactile perception. Nat Commun 2020; 11:3341. [PMID: 32620746 PMCID: PMC7335189 DOI: 10.1038/s41467-020-17160-1] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Accepted: 06/08/2020] [Indexed: 01/10/2023] Open
Abstract
The oculomotor system keeps the eyes steady in expectation of visual events. Here, recording microsaccades while people performed a tactile, frequency discrimination task enabled us to test whether the oculomotor system shows an analogous preparatory response for unrelated tactile events. We manipulated the temporal predictability of tactile targets using tactile cues, which preceded the target by either constant (high predictability) or variable (low predictability) time intervals. We find that microsaccades are inhibited prior to tactile targets and more so for constant than variable intervals, revealing a tight crossmodal link between tactile temporal expectation and oculomotor action. These findings portray oculomotor freezing as a marker of crossmodal temporal expectation. Moreover, microsaccades occurring around the tactile target presentation are associated with reduced task performance, suggesting that oculomotor freezing mitigates potential detrimental, concomitant effects of microsaccades and revealing a crossmodal coupling between tactile perception and oculomotor action.
Collapse
Affiliation(s)
- Stephanie Badde
- Department of Psychology, New York University, 6 Washington Place, New York, NY, 10003, USA.
- Center for Neural Science, New York University, 6 Washington Place, New York, NY, 10003, USA.
| | - Caroline F Myers
- Department of Psychology, New York University, 6 Washington Place, New York, NY, 10003, USA
| | - Shlomit Yuval-Greenberg
- School of Psychological Sciences, Tel-Aviv University, Ramat Aviv, 6997801, Tel Aviv-Yafo, Israel
- Sagol School of Neuroscience, Tel-Aviv University, Ramat Aviv, 6997801, Tel Aviv-Yafo, Israel
| | - Marisa Carrasco
- Department of Psychology, New York University, 6 Washington Place, New York, NY, 10003, USA
- Center for Neural Science, New York University, 6 Washington Place, New York, NY, 10003, USA
| |
Collapse
|
37
|
Abstract
It is known that attention shifts prior to a saccade to start processing the saccade target before it lands in the foveola, the high-resolution region of the retina. Yet, once the target is foveated, microsaccades, tiny saccades maintaining the fixated object within the fovea, continue to occur. What is the link between these eye movements and attention? There is growing evidence that these eye movements are associated with covert shifts of attention in the visual periphery, when the attended stimuli are presented far from the center of gaze. Yet, microsaccades are primarily used to explore complex foveal stimuli and to optimize fine spatial vision in the foveola, suggesting that the influences of microsaccades on attention may predominantly impact vision at this scale. To address this question we tracked gaze position with high precision and briefly presented high-acuity stimuli at predefined foveal locations right before microsaccade execution. Our results show that visual discrimination changes prior to microsaccade onset. An enhancement occurs at the microsaccade target location. This modulation is highly selective and it is coupled with a drastic impairment at the opposite foveal location, just a few arcminutes away. This effect is strongest when stimuli are presented closer to the eye movement onset time. These findings reveal that the link between attention and microsaccades is deeper than previously thought, exerting its strongest effects within the foveola. As a result, during fixation, foveal vision is constantly being reshaped both in space and in time with the occurrence of microsaccades.
Collapse
|
38
|
Khademi F, Chen CY, Hafed ZM. Visual feature tuning of superior colliculus neural reafferent responses after fixational microsaccades. J Neurophysiol 2020; 123:2136-2153. [PMID: 32347160 DOI: 10.1152/jn.00077.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The primate superior colliculus (SC) is causally involved in microsaccade generation. Moreover, visually responsive SC neurons across this structure's topographic map, even at peripheral eccentricities much larger than the tiny microsaccade amplitudes, exhibit significant modulations of evoked response sensitivity when stimuli appear perimicrosaccadically. However, during natural viewing, visual stimuli are normally stably present in the environment and are only shifted on the retina by eye movements. Here we investigated this scenario for the case of microsaccades, asking whether and how SC neurons respond to microsaccade-induced image jitter. We recorded neural activity from two male rhesus macaque monkeys. Within the response field (RF) of a neuron, there was a stable stimulus consisting of a grating of one of three possible spatial frequencies. The grating was stable on the display, but microsaccades periodically jittered the retinotopic RF location over it. We observed clear short-latency visual reafferent responses after microsaccades. These responses were weaker, but earlier (relative to new fixation onset after microsaccade end), than responses to sudden stimulus onsets without microsaccades. The reafferent responses clearly depended on microsaccade amplitude as well as microsaccade direction relative to grating orientation. Our results indicate that one way for microsaccades to influence vision is through modulating how the spatio-temporal landscape of SC visual neural activity represents stable stimuli in the environment. Such representation depends on the specific pattern of temporal luminance modulations expected from the relative relationship between eye movement vector (size and direction) on one hand and spatial visual pattern layout on the other.NEW & NOTEWORTHY Despite being diminutive, microsaccades still jitter retinal images. We investigated how such jitter affects superior colliculus (SC) activity. We found that SC neurons exhibit short-latency visual reafferent bursts after microsaccades. These bursts reflect not only the spatial luminance profiles of visual patterns but also how such profiles are shifted by eye movement size and direction. These results indicate that the SC continuously represents visual patterns, even as they are jittered by the smallest possible saccades.
Collapse
Affiliation(s)
- Fatemeh Khademi
- Werner Reichardt Centre for Integrative Neuroscience, Tuebingen University, Tuebingen, Germany.,Hertie Institute for Clinical Brain Research, Tuebingen University, Tuebingen, Germany
| | - Chih-Yang Chen
- Werner Reichardt Centre for Integrative Neuroscience, Tuebingen University, Tuebingen, Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tuebingen University, Tuebingen, Germany.,Hertie Institute for Clinical Brain Research, Tuebingen University, Tuebingen, Germany
| |
Collapse
|
39
|
Abstract
Visual sensitivity, probed through perceptual detectability of very brief visual stimuli, is strongly impaired around the time of rapid eye movements. This robust perceptual phenomenon, called saccadic suppression, is frequently attributed to active suppressive signals that are directly derived from eye movement commands. Here we show instead that visual-only mechanisms, activated by saccade-induced image shifts, can account for all perceptual properties of saccadic suppression that we have investigated. Such mechanisms start at, but are not necessarily exclusive to, the very first stage of visual processing in the brain, the retina. Critically, neural suppression originating in the retina outlasts perceptual suppression around the time of saccades, suggesting that extra-retinal movement-related signals, rather than causing suppression, may instead act to shorten it. Our results demonstrate a far-reaching contribution of visual processing mechanisms to perceptual saccadic suppression, starting in the retina, without the need to invoke explicit motor-based suppression commands. Saccadic suppression is frequently attributed to active suppressive signals derived from eye movement commands. Here, the authors show that visual-only mechanisms starting in the retina can account for perceptual saccadic suppression properties without the need for motor-based suppression commands.
Collapse
|
40
|
Baumeler D, Schönhammer JG, Born S. Microsaccade dynamics in the attentional repulsion effect. Vision Res 2020; 170:46-52. [PMID: 32247899 DOI: 10.1016/j.visres.2020.03.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2019] [Revised: 01/26/2020] [Accepted: 03/13/2020] [Indexed: 11/19/2022]
Abstract
A briefly flashed peripheral cue has been shown to repulse the perceived position of a subsequently presented foveal probe - a bias called the Attentional Repulsion Effect (ARE). While this bias has originally been assumed to reflect attentional capturing by the cue, its attentional nature has recently been questioned. To investigate the ARE's attentional properties, we recorded microsaccades as an attentional marker in the ARE paradigm. Microsaccades, small fixational eye movements performed during fixation, have previously been described to reflect the dynamics of spatial attention deployment. Our results favor an attentional explanation for the ARE: In trials in which an ARE was found, microsaccades were directed more often toward the cue, presumably reflecting the covert shift of attention. In contrast, more cue-incongruent microsaccades were observed in trials in which no ARE was found. Therefore, both repulsion as well as measured microsaccade modulations, are most likely an outcome of the preceding shifts of covert attention.
Collapse
Affiliation(s)
- Denise Baumeler
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève, 40 Boulevard du Pont d'Arve, 1205 Genève, Switzerland.
| | - Josef G Schönhammer
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève, 40 Boulevard du Pont d'Arve, 1205 Genève, Switzerland
| | - Sabine Born
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève, 40 Boulevard du Pont d'Arve, 1205 Genève, Switzerland
| |
Collapse
|
41
|
Le QV, Le QV, Nishimaru H, Matsumoto J, Takamura Y, Hori E, Maior RS, Tomaz C, Ono T, Nishijo H. A Prototypical Template for Rapid Face Detection Is Embedded in the Monkey Superior Colliculus. Front Syst Neurosci 2020; 14:5. [PMID: 32158382 PMCID: PMC7025518 DOI: 10.3389/fnsys.2020.00005] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2019] [Accepted: 01/20/2020] [Indexed: 01/30/2023] Open
Abstract
Human babies respond preferentially to faces or face-like images. It has been proposed that an innate and rapid face detection system is present at birth before the cortical visual pathway is developed in many species, including primates. However, in primates, the visual area responsible for this process is yet to be unraveled. We hypothesized that the superior colliculus (SC) that receives direct and indirect retinal visual inputs may serve as an innate rapid face-detection system in primates. To test this hypothesis, we examined the responsiveness of monkey SC neurons to first-order information of faces required for face detection (basic spatial layout of facial features including eyes, nose, and mouth), by analyzing neuronal responses to line drawing images of: (1) face-like patterns with contours and properly placed facial features; (2) non-face patterns including face contours only; and (3) nonface random patterns with contours and randomly placed face features. Here, we show that SC neurons respond stronger and faster to upright and inverted face-like patterns compared to the responses to nonface patterns, regardless of contrast polarity and contour shapes. Furthermore, SC neurons with central receptive fields (RFs) were more selective to face-like patterns. In addition, the population activity of SC neurons with central RFs can discriminate face-like patterns from nonface patterns as early as 50 ms after the stimulus onset. Our results provide strong neurophysiological evidence for the involvement of the primate SC in face detection and suggest the existence of a broadly tuned template for face detection in the subcortical visual pathway.
Collapse
Affiliation(s)
- Quang Van Le
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Quan Van Le
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Hiroshi Nishimaru
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Jumpei Matsumoto
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Yusaku Takamura
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Etsuro Hori
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Rafael S Maior
- Primate Center and Laboratory of Neurosciences and Behavior, Department of Physiological Sciences, Institute of Biology, University of Brasília, Brasilia, Brazil
| | - Carlos Tomaz
- Laboratory of Neuroscience and Behavior, CEUMA University, São Luis, Brazil
| | - Taketoshi Ono
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| | - Hisao Nishijo
- System Emotional Science, Faculty of Medicine, University of Toyama, Toyama, Japan
| |
Collapse
|
42
|
Hafed ZM, Goffart L. Gaze direction as equilibrium: more evidence from spatial and temporal aspects of small-saccade triggering in the rhesus macaque monkey. J Neurophysiol 2019; 123:308-322. [PMID: 31825698 DOI: 10.1152/jn.00588.2019] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Rigorous behavioral studies made in human subjects have shown that small-eccentricity target displacements are associated with increased saccadic reaction times, but the reasons for this remain unclear. Before characterizing the neurophysiological foundations underlying this relationship between the spatial and temporal aspects of saccades, we tested the triggering of small saccades in the male rhesus macaque monkey. We also compared our results to those obtained in human subjects, both from the existing literature and through our own additional measurements. Using a variety of behavioral tasks exercising visual and nonvisual guidance of small saccades, we found that small saccades consistently require more time than larger saccades to be triggered in the nonhuman primate, even in the absence of any visual guidance and when valid advance information about the saccade landing position is available. We also found a strong asymmetry in the reaction times of small upper versus lower visual field visually guided saccades, a phenomenon that has not been described before for small saccades, even in humans. Following the suggestion that an eye movement is not initiated as long as the visuo-oculomotor system is within a state of balance, in which opposing commands counterbalance each other, we propose that the longer reaction times are a signature of enhanced times needed to create the symmetry-breaking condition that puts downstream premotor neurons into a push-pull regime necessary for rotating the eyeballs. Our results provide an important catalog of nonhuman primate oculomotor capabilities on the miniature scale, allowing concrete predictions on underlying neurophysiological mechanisms.NEW & NOTEWORTHY Leveraging a multitude of neurophysiological investigations in the rhesus macaque monkey, we generated and tested hypotheses about small-saccade latencies in this animal model. We found that small saccades always take longer, on average, than larger saccades to trigger, regardless of visual and cognitive context. Moreover, small downward saccades have the longest latencies overall. Our results provide an important documentation of oculomotor capabilities of an indispensable animal model for neuroscientific research in vision, cognition, and action.
Collapse
Affiliation(s)
- Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tuebingen University, Tuebingen, Germany.,Hertie Institute for Clinical Brain Research, Tuebingen University, Tuebingen, Germany
| | - Laurent Goffart
- Aix Marseille University, Centre National de la Recherche Scientifique, Institut de Neurosciences de la Timone, Marseille, France
| |
Collapse
|
43
|
Abstract
Despite strong evidence to the contrary in the literature, microsaccades are overwhelmingly described as involuntary eye movements. Here we show in both human subjects and monkeys that individual microsaccades of any direction can easily be triggered: (1) on demand, based on an arbitrary instruction, (2) without any special training, (3) without visual guidance by a stimulus, and (4) in a spatially and temporally accurate manner. Subjects voluntarily generated instructed "memory-guided" microsaccades readily, and similarly to how they made normal visually-guided ones. In two monkeys, we also observed midbrain superior colliculus neurons that exhibit movement-related activity bursts exclusively for memory-guided microsaccades, but not for similarly-sized visually-guided movements. Our results demonstrate behavioral and neural evidence for voluntary control over individual microsaccades, supporting recently discovered functional contributions of individual microsaccade generation to visual performance alterations and covert visual selection, as well as observations that microsaccades optimize eye position during high acuity visually-guided behavior.
Collapse
|
44
|
|
45
|
Chen J, Valsecchi M, Gegenfurtner KR. Saccadic suppression measured by steady-state visual evoked potentials. J Neurophysiol 2019; 122:251-258. [PMID: 30943105 DOI: 10.1152/jn.00712.2018] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023] Open
Abstract
Visual sensitivity is severely impaired during the execution of saccadic eye movements. This phenomenon has been extensively characterized in human psychophysics and nonhuman primate single-neuron studies, but a physiological characterization in humans is less established. Here, we used a method based on steady-state visually evoked potential (SSVEP), an oscillatory brain response to periodic visual stimulation, to examine how saccades affect visual sensitivity. Observers made horizontal saccades back and forth, while horizontal black-and-white gratings flickered at 5-30 Hz in the background. We analyzed EEG epochs with a length of 0.3 s either centered at saccade onset (saccade epochs) or centered at fixations half a second before the saccade (fixation epochs). Compared with fixation epochs, saccade epochs showed a broadband power increase, which most likely resulted from saccade-related EEG activity. The execution of saccades, however, led to an average reduction of 57% in the SSVEP amplitude at the stimulation frequency. This result provides additional evidence for an active saccadic suppression in the early visual cortex in humans. Compared with previous functional MRI and EEG studies, an advantage of this approach lies in its capability to trace the temporal dynamics of neural activity throughout the time course of a saccade. In contrast to previous electrophysiological studies in nonhuman primates, we did not find any evidence for postsaccadic enhancement, even though simulation results show that our method would have been able to detect it. We conclude that SSVEP is a useful technique to investigate the neural correlates of visual perception during saccadic eye movements in humans. NEW & NOTEWORTHY We make fast ballistic saccadic eye movements a few times every second. At the time of saccades, visual sensitivity is severely impaired. The present study uses steady-state visually evoked potentials to reveal a neural correlate of the fine temporal dynamics of these modulations at the time of saccades in humans. We observed a strong reduction (57%) of visually driven neural activity associated with saccades but did not find any evidence for postsaccadic enhancement.
Collapse
Affiliation(s)
- Jing Chen
- School of Psychology, Shanghai University of Sport , Shanghai , China
| | - Matteo Valsecchi
- Abteilung Allgemeine Psychologie, Justus-Liebig-Universität Gießen, Gießen , Germany
| | - Karl R Gegenfurtner
- Abteilung Allgemeine Psychologie, Justus-Liebig-Universität Gießen, Gießen , Germany
| |
Collapse
|
46
|
Perdziak M, Gryncewicz W, Witkowska D, Sawosz P, Ober J. Gap effect and express saccades generation in amblyopia. J Vis 2019; 19:17. [PMID: 30977772 DOI: 10.1167/19.4.17] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Amblyopia is a neurodevelopmental vision disorder that is associated with abnormal visual stimulation during early childhood. Although our knowledge regarding spatial vision deficits in amblyopic subjects is well established, the neural control of eye movements in amblyopia is yet to be explored. In the present study we have evaluated the gap effect, and for the first time (to our best knowledge), express saccades generation in amblyopic (strabismic as well as anisometropic) and age-matched control subjects. We have compared the saccadic latency under different gap conditions ("no gap," 50 ms gap, and 200 ms gap), between the amblyopic and control groups. Our results have shown that saccadic latency was reduced during the gap paradigms both for amblyopic and control groups for all viewing conditions. Furthermore, the size of the gap effect was comparable for all groups and viewing conditions (both for short and long gap durations). In addition, consistent with previous results, the amblyopic eye has manifested an increased saccadic latency as compared to the nondominant eye in the control group. Regarding the occurrence of express saccades, the 200 ms gap condition was associated with an increased number of express saccades as compared to 50 ms gap and "no gap" conditions, both for amblyopic and control subjects. We did not observe any significant difference in terms of express saccades production between the control and amblyopic subjects. Our findings may suggest that amblyopia does not alter physiological mechanisms related to the efficiency of visual attention/fixation disengagement as supported by the observation that the gap effect and express saccades production was comparable between the normal and amblyopic subjects.
Collapse
Affiliation(s)
- Maciej Perdziak
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland.,Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznan, Poland
| | - Wojciech Gryncewicz
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland
| | - Dagmara Witkowska
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland
| | - Piotr Sawosz
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland
| | - Jan Ober
- Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, Warsaw, Poland
| |
Collapse
|
47
|
Watanabe M, Okada KI, Hamasaki Y, Funamoto M, Kobayashi Y, MacAskill M, Anderson T. Ocular drift reflects volitional action preparation. Eur J Neurosci 2019; 50:1892-1910. [PMID: 30719791 DOI: 10.1111/ejn.14365] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Revised: 01/29/2019] [Accepted: 01/30/2019] [Indexed: 11/30/2022]
Abstract
Human cognitive behavior is predictive rather than reflexive because of volitional action preparation. Recent studies have shown that the covert process of volitional action preparation can be decoded from overt fixational eye movements of fixational/microsaccades and pupil dilation. Ocular drift, the slowest fixational eye movements, is also under the active neural control, but its relationship with cognitive behavior is unknown. Here, we examined whether ocular drift also reflects volitional action preparation. We analyzed ocular drift while adult humans maintained fixation on a central visual stimulus as they prepared to generate a volitional saccade. We adopted the antisaccade paradigm in which subjects generate a targeting saccade toward the opposite direction of a peripheral visual stimulus. Our findings are the following five points. First, ocular drift was slower when subjects prepared for targeting saccade initiation than when such preparation was unnecessary. Second, ocular drift was slowed down with elapsed time from fixation initiation, which was associated with the facilitation of targeting saccade initiation. Third, ocular drift was further slowed on correct antisaccade trials than when subjects failed to suppress targeting saccades toward peripheral stimuli. Fourth, such correlation with antisaccade performance was observed immediately after fixation initiation in ocular drift, but it emerged more slowly in the other fixational eye movements. Fifth, subjects with unstable fixation because of faster ocular drift had poorer antisaccade performance. We suggest that fixation stability measured by ocular drift can be used to decode the covert process of volitional action preparation along with the other fixational eye movements.
Collapse
Affiliation(s)
| | - Ken-Ichi Okada
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan.,Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
| | - Yuta Hamasaki
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| | - Mari Funamoto
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| | - Yasushi Kobayashi
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan.,Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan.,Research Center for Behavioral Economics, Osaka University, Osaka, Japan
| | - Michael MacAskill
- New Zealand Brain Research Institute, Christchurch, New Zealand.,Department of Medicine, University of Otago, Christchurch, New Zealand
| | - Tim Anderson
- New Zealand Brain Research Institute, Christchurch, New Zealand.,Department of Medicine, University of Otago, Christchurch, New Zealand.,Department of Neurology, Canterbury District Health Board, Christchurch, New Zealand
| |
Collapse
|
48
|
Eye Position Error Influence over "Open-Loop" Smooth Pursuit Initiation. J Neurosci 2019; 39:2709-2721. [PMID: 30709895 DOI: 10.1523/jneurosci.2178-18.2019] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Revised: 12/15/2018] [Accepted: 01/13/2019] [Indexed: 11/21/2022] Open
Abstract
The oculomotor system integrates a variety of visual signals into appropriate motor plans, but such integration can have widely varying time scales. For example, smooth pursuit eye movements to follow a moving target are slower and longer lasting than saccadic eye movements and it has been suggested that initiating a smooth pursuit eye movement involves an obligatory "open-loop" interval in which new visual motion signals presumably cannot influence the ensuing motor plan for up to 100 ms after movement initiation. However, this view is contrary to the idea that the oculomotor periphery has privileged access to short-latency visual signals. Here, we show that smooth pursuit initiation is sensitive to visual inputs, even in open-loop intervals. We instructed male rhesus macaque monkeys to initiate saccade-free smooth pursuit eye movements and injected a transient, instantaneous eye position error signal at different times relative to movement initiation. We found robust short-latency modulations in eye velocity and acceleration, starting only ∼50 ms after transient signal occurrence and even during open-loop pursuit initiation. Critically, the spatial direction of the injected position error signal had predictable effects on smooth pursuit initiation, with forward errors increasing eye acceleration and backward errors reducing it. Catch-up saccade frequencies and amplitudes were also similarly altered ∼50 ms after transient signals, much like the well known effects on microsaccades during fixation. Our results demonstrate that smooth pursuit initiation is highly sensitive to visual signals and that catch-up saccade generation is reset after a visual transient.SIGNIFICANCE STATEMENT Smooth pursuit eye movements allow us to track moving objects. The first ∼100 ms of smooth pursuit initiation are characterized by smooth eye acceleration and are overwhelmingly described as being "open-loop"; that is, unmodifiable by new visual motion signals. We found that all phases of smooth pursuit, including the so-called open-loop intervals, are reliably modifiable by visual signals. We injected transient flashes resulting in very brief, spatially specific position error signals to smooth pursuit and observed very short-latency changes in smooth eye movements to minimize such errors. Our results highlight the flexibility of the oculomotor system in reacting to environmental events and suggest a functional role for the pervasiveness of visual sensitivity in oculomotor control brain regions.
Collapse
|
49
|
Paraskevoudi N, Pezaris JS. Eye Movement Compensation and Spatial Updating in Visual Prosthetics: Mechanisms, Limitations and Future Directions. Front Syst Neurosci 2019; 12:73. [PMID: 30774585 PMCID: PMC6368147 DOI: 10.3389/fnsys.2018.00073] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2018] [Accepted: 12/21/2018] [Indexed: 01/01/2023] Open
Abstract
Despite appearing automatic and effortless, perceiving the visual world is a highly complex process that depends on intact visual and oculomotor function. Understanding the mechanisms underlying spatial updating (i.e., gaze contingency) represents an important, yet unresolved issue in the fields of visual perception and cognitive neuroscience. Many questions regarding the processes involved in updating visual information as a function of the movements of the eyes are still open for research. Beyond its importance for basic research, gaze contingency represents a challenge for visual prosthetics as well. While most artificial vision studies acknowledge its importance in providing accurate visual percepts to the blind implanted patients, the majority of the current devices do not compensate for gaze position. To-date, artificial percepts to the blind population have been provided either by intraocular light-sensing circuitry or by using external cameras. While the former commonly accounts for gaze shifts, the latter requires the use of eye-tracking or similar technology in order to deliver percepts based on gaze position. Inspired by the need to overcome the hurdle of gaze contingency in artificial vision, we aim to provide a thorough overview of the research addressing the neural underpinnings of eye compensation, as well as its relevance in visual prosthetics. The present review outlines what is currently known about the mechanisms underlying spatial updating and reviews the attempts of current visual prosthetic devices to overcome the hurdle of gaze contingency. We discuss the limitations of the current devices and highlight the need to use eye-tracking methodology in order to introduce gaze-contingent information to visual prosthetics.
Collapse
Affiliation(s)
- Nadia Paraskevoudi
- Brainlab – Cognitive Neuroscience Research Group, Department of Clinical Psychology and Psychobiology, University of Barcelona, Barcelona, Spain
- Institute of Neurosciences, University of Barcelona, Barcelona, Spain
| | - John S. Pezaris
- Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, United States
- Department of Neurosurgery, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
50
|
Denison RN, Yuval-Greenberg S, Carrasco M. Directing Voluntary Temporal Attention Increases Fixational Stability. J Neurosci 2019; 39:353-363. [PMID: 30459223 PMCID: PMC6325259 DOI: 10.1523/jneurosci.1926-18.2018] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Revised: 11/07/2018] [Accepted: 11/13/2018] [Indexed: 11/21/2022] Open
Abstract
Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.
Collapse
Affiliation(s)
- Rachel N Denison
- Department of Psychology and Center for Neural Science, New York University, New York, New York 10003 and
| | - Shlomit Yuval-Greenberg
- School of Psychological Sciences and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, New York 10003 and
| |
Collapse
|