1
|
Purokayastha S, Roberts M, Carrasco M. Do microsaccades vary with discriminability around the visual field? J Vis 2024; 24:11. [PMID: 38869372 PMCID: PMC11178122 DOI: 10.1167/jov.24.6.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Accepted: 04/19/2024] [Indexed: 06/14/2024] Open
Abstract
Microsaccades-tiny fixational eye movements-improve discriminability in high-acuity tasks in the foveola. To investigate whether they help compensate for low discriminability at the perifovea, we examined microsaccade characteristics relative to the adult visual performance field, which is characterized by two perceptual asymmetries: horizontal-vertical anisotropy (better discrimination along the horizontal than vertical meridian) and vertical meridian asymmetry (better discrimination along the lower than upper vertical meridian). We investigated whether and to what extent microsaccade directionality varies when stimuli are at isoeccentric locations along the cardinals under conditions of heterogeneous discriminability (Experiment 1) and homogeneous discriminability, equated by adjusting stimulus contrast (Experiment 2). Participants performed a two-alternative forced-choice orientation discrimination task. In both experiments, performance was better on trials without microsaccades between ready signal onset and stimulus offset than on trials with microsaccades. Across the trial sequence, the microsaccade rate and directional pattern were similar across locations. Our results indicate that microsaccades were similar regardless of stimulus discriminability and target location, except during the response period-once the stimuli were no longer present and target location no longer uncertain-when microsaccades were biased toward the target location. Thus, this study reveals that microsaccades do not flexibly adapt as a function of varying discriminability in a basic visual task around the visual field.
Collapse
Affiliation(s)
| | - Mariel Roberts
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
- Carrasco Lab, New York University, New York, NY, USA
| |
Collapse
|
2
|
Gu Q, Zhang Q, Han Y, Li P, Gao Z, Shen M. Microsaccades reflect attention shifts: a mini review of 20 years of microsaccade research. Front Psychol 2024; 15:1364939. [PMID: 38440250 PMCID: PMC10909968 DOI: 10.3389/fpsyg.2024.1364939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 02/06/2024] [Indexed: 03/06/2024] Open
Abstract
Microsaccades are small, involuntary eye movements that occur during fixation. Since the 1950s, researchers have conducted extensive research on the role of microsaccades in visual information processing, and found that they also play an important role in human advanced visual cognitive activities. Research over the past 20 years further suggested that there is a close relationship between microsaccades and visual attention, yet lacking a timely review. The current article aims to provide a state-of-the-art review and bring microsaccades studies into the sight of attention research. We firstly introduce basic characteristics about microsaccades, then summarized the empirical evidence supporting the view that microsaccades can reflect both external (perception) and internal (working memory) attention shifts. We finally conclude and highlight three promising avenues for future research.
Collapse
Affiliation(s)
- Quan Gu
- Yongjiang Laboratory, Ningbo, China
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Qikai Zhang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Yueming Han
- Shanghai Institute of Technical Physics of the Chinese Academy of Sciences, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | | | - Zaifeng Gao
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Mowei Shen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| |
Collapse
|
3
|
Purokayastha S, Roberts M, Carrasco M. Do microsaccades vary with discriminability around the visual field? BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.11.575288. [PMID: 38260406 PMCID: PMC10802594 DOI: 10.1101/2024.01.11.575288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Microsaccades-tiny fixational eye movements- improve discriminability in high acuity tasks in the foveola. To investigate whether they help compensate for low discriminability at perifovea, we examined MS characteristics relative to the adult visual performance field, which is characterized by two perceptual asymmetries: Horizontal-Vertical Anisotropy (better discrimination along the horizontal than vertical meridian), and Vertical Meridian Asymmetry (better discrimination along the lower- than upper-vertical meridian). We investigated whether and to what extent microsaccade directionality varies when stimuli are at isoeccentric locations along the cardinals under conditions of heterogeneous discriminability (Experiment 1) and homogeneous discriminability, equated by adjusting stimulus contrast (Experiment 2). Participants performed a two-alternative forced-choice orientation discrimination task. In both experiments, performance was better on trials without microsaccades between ready signal onset and stimulus offset than on trials with microsaccades. Across the trial sequence the microsaccade rate and directional pattern were similar across locations. Our results indicate that microsaccades were similar regardless of stimulus discriminability and target location, except during the response period-once the stimuli were no longer present and target location no longer uncertain-when microsaccades were biased toward the target location. Thus, this study reveals that microsaccades do not flexibly adapt as a function of varying discriminability in a basic visual task around the visual field.
Collapse
Affiliation(s)
| | - Mariel Roberts
- Department of Psychology, New York University, New York, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, USA
- Center for Neural Science, New York University, New York, USA
| |
Collapse
|
4
|
Guzhang Y, Shelchkova N, Clark AM, Poletti M. Ultra-fine resolution of pre-saccadic attention in the fovea. Curr Biol 2024; 34:147-155.e2. [PMID: 38154463 PMCID: PMC10842882 DOI: 10.1016/j.cub.2023.11.064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 10/13/2023] [Accepted: 11/29/2023] [Indexed: 12/30/2023]
Abstract
Microsaccades, the tiny gaze relocations that occurr during fixation, have been linked to covert attention deployed degrees away from the center of gaze. However, the link between attention and microsaccades is deeper in that it also unfolds at the foveal scale. Here, we have examined the spatial grain of pre-microsaccadic attention across the 1° foveola. Through the use of high-precision eye-tracking and gaze-contingent display system that achieves arcminute precision in gaze localization, we have shown that the spotlight of attention at this scale can reach a strikingly high resolution, in the order of 0.17°. Further, when a microsaccade occurs, vision is modulated in a peculiar way across the foveola; whereas fine spatial vision is enhanced at the microsaccade goal location, it drops at the very center of gaze, where acuity is normally highest. These results reveal the finesse of the visuomotor system and of the interplay between eye movements and attention.
Collapse
Affiliation(s)
- Yue Guzhang
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA
| | - Natalya Shelchkova
- Graduate Program in Computational Neuroscience, University of Chicago, 5812 S. Ellis Avenue, Chicago, IL 60637, USA
| | - Ashley M Clark
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA
| | - Martina Poletti
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Department of Neuroscience, University of Rochester, 601 Elmwood Avenue, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, 361 Meliora Hall, Rochester, NY 14627, USA.
| |
Collapse
|
5
|
Ester E, Weese R. Temporally Dissociable Mechanisms of Spatial, Feature, and Motor Selection during Working Memory-guided Behavior. J Cogn Neurosci 2023; 35:2014-2027. [PMID: 37788302 DOI: 10.1162/jocn_a_02061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/05/2023]
Abstract
Working memory (WM) is a capacity- and duration-limited system that forms a temporal bridge between fleeting sensory phenomena and possible actions. But how are the contents of WM used to guide behavior? A recent high-profile study reported evidence for simultaneous access to WM content and linked motor plans during WM-guided behavior, challenging serial models where task-relevant WM content is first selected and then mapped on to a task-relevant motor response. However, the task used in that study was not optimized to distinguish the selection of spatial versus nonspatial visual information stored in memory, nor to distinguish whether or how the chronometry of selecting nonspatial visual information stored in memory might differ from the selection of linked motor plans. Here, we revisited the chronometry of spatial, feature, and motor selection during WM-guided behavior using a task optimized to disentangle these processes. Concurrent EEG and eye position recordings revealed clear evidence for temporally dissociable spatial, feature, and motor selection during this task. Thus, our data reveal the existence of multiple WM selection mechanisms that belie conceptualizations of WM-guided behavior based on purely serial or parallel visuomotor processing.
Collapse
|
6
|
Khademi F, Zhang T, Baumann MP, Buonocore A, Malevich T, Yu Y, Hafed ZM. Visual feature tuning properties of stimulus-driven saccadic inhibition in macaque monkeys. J Neurophysiol 2023; 130:1282-1302. [PMID: 37818591 DOI: 10.1152/jn.00289.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 10/03/2023] [Accepted: 10/03/2023] [Indexed: 10/12/2023] Open
Abstract
Saccadic inhibition refers to a short-latency transient cessation of saccade generation after visual sensory transients. This oculomotor phenomenon occurs with a latency that is consistent with a rapid influence of sensory responses, such as stimulus-induced visual bursts, on oculomotor control circuitry. However, the neural mechanisms underlying saccadic inhibition are not well understood. Here, we exploited the fact that macaque monkeys experience robust saccadic inhibition to test the hypothesis that inhibition time and strength exhibit systematic visual feature tuning properties to a multitude of visual feature dimensions commonly used in vision science. We measured saccades in three monkeys actively controlling their gaze on a target, and we presented visual onset events at random times. Across seven experiments, the visual onsets tested size, spatial frequency, contrast, orientation, motion direction, and motion speed dependencies of saccadic inhibition. We also investigated how inhibition might depend on the behavioral relevance of the appearing stimuli. We found that saccadic inhibition starts earlier, and is stronger, for large stimuli of low spatial frequencies and high contrasts. Moreover, saccadic inhibition timing depends on motion direction and orientation, with earlier inhibition systematically occurring for horizontally drifting vertical gratings. On the other hand, saccadic inhibition is stronger for faster motions and when the appearing stimuli are subsequently foveated. Besides documenting a range of feature tuning dimensions of saccadic inhibition to the properties of exogenous visual stimuli, our results establish macaque monkeys as an ideal model system for unraveling the neural mechanisms underlying a ubiquitous oculomotor phenomenon in visual neuroscience.NEW & NOTEWORTHY Visual onsets dramatically reduce saccade generation likelihood with very short latencies. Such latencies suggest that stimulus-induced visual responses, normally jump-starting perceptual and scene analysis processes, can also directly impact the decision of whether to generate saccades or not, causing saccadic inhibition. Consistent with this, we found that changing the appearance of the visual onsets systematically alters the properties of saccadic inhibition. These results constrain neurally inspired models of coordination between saccade generation and exogenous sensory stimulation.
Collapse
Affiliation(s)
- Fatemeh Khademi
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Tong Zhang
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Antimo Buonocore
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
- Department of Educational, Psychological and Communication Sciences, Suor Orsola Benincasa University, Naples, Italy
| | - Tatiana Malevich
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Yue Yu
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
| |
Collapse
|
7
|
Giari G, Vignali L, Xu Y, Bottini R. MEG frequency tagging reveals a grid-like code during attentional movements. Cell Rep 2023; 42:113209. [PMID: 37804506 DOI: 10.1016/j.celrep.2023.113209] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 08/25/2023] [Accepted: 09/18/2023] [Indexed: 10/09/2023] Open
Abstract
Grid-cells firing fields tile the environment with a 6-fold periodicity during both locomotion and visual exploration. Here, we tested, in humans, whether movements of covert attention elicit grid-like coding using frequency tagging. Participants observed visual trajectories presented sequentially at fixed rate, allowing different spatial periodicities (e.g., 4-, 6-, and 8-fold) to have corresponding temporal periodicities (e.g., 1, 1.5, and 2 Hz), thus resulting in distinct spectral responses. We found a higher response for the (grid-like) 6-fold periodicity and localized this effect in medial-temporal sources. In a control experiment featuring the same temporal periodicity but lacking spatial structure, the 6-fold effect did not emerge, suggesting its dependency on spatial movements of attention. We report evidence that grid-like signals in the human medial-temporal lobe can be elicited by covert attentional movements and suggest that attentional coding may provide a suitable mechanism to support the activation of cognitive maps during conceptual navigation.
Collapse
Affiliation(s)
- Giuliano Giari
- Center for Mind/Brain Sciences (CIMeC), University of Trento, 38123 Trento, Italy.
| | - Lorenzo Vignali
- Center for Mind/Brain Sciences (CIMeC), University of Trento, 38123 Trento, Italy
| | - Yangwen Xu
- Center for Mind/Brain Sciences (CIMeC), University of Trento, 38123 Trento, Italy
| | - Roberto Bottini
- Center for Mind/Brain Sciences (CIMeC), University of Trento, 38123 Trento, Italy.
| |
Collapse
|
8
|
Hung SC, Barbot A, Carrasco M. Visual perceptual learning modulates microsaccade rate and directionality. Sci Rep 2023; 13:16525. [PMID: 37783775 PMCID: PMC10545683 DOI: 10.1038/s41598-023-42768-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 09/14/2023] [Indexed: 10/04/2023] Open
Abstract
Microsaccades, incessant "fixational eye movements" (< 1°), are an important window into cognitive functions. Yet, its role in visual perceptual learning (VPL)-improvements in visual discrimination due to practice-remains practically unexplored. Here we investigated whether and how microsaccades change in VPL. Human observers performed a Landolt acuity task for 5 consecutive days and were assigned to the Neutral or Attention group. On each trial, two peripheral Landolt squares were presented briefly along a diagonal. Observers reported the gap side of the target stimulus. Training improved acuity and modified the microsaccade rate; with training, the rate decreased during the fixation period but increased during the response cue. Furthermore, microsaccade direction during the response cue was biased toward the target location, and training enhanced and sped up this bias. Finally, the microsaccade rate during a task-free fixation period correlated with observers' initial acuity threshold, indicating that the fewer the microsaccades during fixation the better the individual visual acuity. All these results, which were similar for both the Neutral and Attention groups and at both trained and untrained locations, suggest that microsaccades could serve as a physiological marker reflecting functional dynamics in human perceptual learning.
Collapse
Affiliation(s)
- Shao-Chin Hung
- Department of Psychology, New York University, New York, USA.
| | - Antoine Barbot
- Department of Psychology, New York University, New York, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, USA
- Center for Neural Science, New York University, New York, USA
| |
Collapse
|
9
|
Poletti M. An eye for detail: Eye movements and attention at the foveal scale. Vision Res 2023; 211:108277. [PMID: 37379763 PMCID: PMC10528557 DOI: 10.1016/j.visres.2023.108277] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 06/08/2023] [Accepted: 06/08/2023] [Indexed: 06/30/2023]
Abstract
Human vision relies on a tiny region of the retina, the 1-deg foveola, to achieve high spatial resolution. Foveal vision is of paramount importance in daily activities, yet its study is challenging, as eye movements incessantly displace stimuli across this region. Here I will review work that, building on recent advances in eye-tracking and gaze-contingent display, examines how attention and eye movements operate at the foveal level. This research highlights how exploration of fine spatial detail unfolds following visuomotor strategies reminiscent of those occurring at larger scales. It shows that, together with highly precise control of attention, this motor activity is linked to non-homogenous processing within the foveola and selectively modulates sensitivity both in space and time. Overall, the picture emerges of a highly dynamic foveal perception in which fine spatial vision, rather than simply being the result of placing a stimulus at the center of gaze, is the result of a finely tuned and orchestrated synergy of motor, cognitive, and attentional processes.
Collapse
Affiliation(s)
- Martina Poletti
- Department of Brain and Cognitive Sciences, University of Rochester, United States; Center for Visual Science, University of Rochester, United States; Department of Neuroscience, University of Rochester, United States.
| |
Collapse
|
10
|
Yu G, Katz LN, Quaia C, Messinger A, Krauzlis RJ. Short-latency preference for faces in the primate superior colliculus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.06.556401. [PMID: 37886488 PMCID: PMC10602035 DOI: 10.1101/2023.09.06.556401] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2023]
Abstract
Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here we report that visual neurons in the midbrain superior colliculus (SC) display a preference for faces, that the preference emerges within 50ms of stimulus onset - well before "face patches" in visual cortex - and that this activity can distinguish faces from other visual objects with accuracies of ~80%. This short-latency preference in SC depends on signals routed through early visual cortex, because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.
Collapse
Affiliation(s)
- Gongchen Yu
- Laboratory of Sensorimotor Research, National Eye Institute; Bethesda, Maryland, 20892, USA
| | - Leor N. Katz
- Laboratory of Sensorimotor Research, National Eye Institute; Bethesda, Maryland, 20892, USA
| | - Christian Quaia
- Laboratory of Sensorimotor Research, National Eye Institute; Bethesda, Maryland, 20892, USA
| | - Adam Messinger
- Laboratory of Sensorimotor Research, National Eye Institute; Bethesda, Maryland, 20892, USA
| | - Richard J. Krauzlis
- Laboratory of Sensorimotor Research, National Eye Institute; Bethesda, Maryland, 20892, USA
| |
Collapse
|
11
|
Zhou Y, Zhu O, Freedman DJ. Posterior Parietal Cortex Plays a Causal Role in Abstract Memory-Based Visual Categorical Decisions. J Neurosci 2023; 43:4315-4328. [PMID: 37137703 PMCID: PMC10255012 DOI: 10.1523/jneurosci.2241-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 04/13/2023] [Accepted: 04/17/2023] [Indexed: 05/05/2023] Open
Abstract
Neural activity in the lateral intraparietal cortex (LIP) correlates with both sensory evaluation and motor planning underlying visuomotor decisions. We previously showed that LIP plays a causal role in visually-based perceptual and categorical decisions, and preferentially contributes to evaluating sensory stimuli over motor planning. In that study, however, monkeys reported their decisions with a saccade to a colored target associated with the correct motion category or direction. Since LIP is known to play a role in saccade planning, it remains unclear whether LIP's causal role in such decisions extend to decision-making tasks which do not involve saccades. Here, we employed reversible pharmacological inactivation of LIP neural activity while two male monkeys performed delayed match to category (DMC) and delayed match to sample (DMS) tasks. In both tasks, monkeys needed to maintain gaze fixation throughout the trial and report whether a test stimulus was a categorical match or nonmatch to the previous sample stimulus by releasing a touch bar. LIP inactivation impaired monkeys' behavioral performance in both tasks, with deficits in both accuracy and reaction time (RT). Furthermore, we recorded LIP neural activity in the DMC task targeting the same cortical locations as in the inactivation experiments. We found significant neural encoding of the sample category, which was correlated with monkeys' categorical decisions in the DMC task. Taken together, our results demonstrate that LIP plays a generalized role in visual categorical decisions independent of the task-structure and motor response modality.SIGNIFICANCE STATEMENT Neural activity in the lateral intraparietal cortex (LIP) correlates with perceptual and categorical decisions, in addition to its role in mediating saccadic eye movements. Past work found that LIP is causally involved in visual decisions that are rapidly reported by saccades in a reaction time based decision making task. Here we use reversible inactivation of LIP to test whether LIP is also causally involved in visual decisions when reported by hand movements during delayed matching tasks. Here we show that LIP inactivation impaired monkeys' task performance during both memory-based discrimination and categorization tasks. These results demonstrate that LIP plays a generalized role in visual categorical decisions independent of the task-structure and motor response modality.
Collapse
Affiliation(s)
- Yang Zhou
- Department of Neurobiology, The University of Chicago, Chicago, Illinois 60637
- School of Psychological and Cognitive Sciences, IDG/McGovern Institute for Brain Research, Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| | - Ou Zhu
- Department of Neurobiology, The University of Chicago, Chicago, Illinois 60637
| | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, Illinois 60637
- Neuroscience Institute, The University of Chicago, Chicago, Illinois 60637
| |
Collapse
|
12
|
Willett SM, Mayo JP. Microsaccades are directed toward the midpoint between targets in a variably cued attention task. Proc Natl Acad Sci U S A 2023; 120:e2220552120. [PMID: 37155892 PMCID: PMC10194007 DOI: 10.1073/pnas.2220552120] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Accepted: 04/10/2023] [Indexed: 05/10/2023] Open
Abstract
Reliable, noninvasive biomarkers that reveal the internal state of a subject are an invaluable tool for neurological diagnoses. Small fixational eye movements, called microsaccades, are a candidate biomarker thought to reflect a subject's focus of attention [Z. M. Hafed, J. J. Clark, VisionRes. 42, 2533-2545 (2002); R. Engbert, R. Kliegl, VisionRes. 43, 1035-1045 (2003)]. The linkage between the direction of microsaccades and attention has mainly been demonstrated using explicit and unambiguous attentional cues. However, the natural world is seldom predictable and rarely provides unambiguous information. Thus, a useful biomarker must be robust to such changes in environmental statistics. To determine how well microsaccades reveal visual-spatial attention across behavioral contexts, we analyzed these fixational eye movements in monkeys performing a conventional change detection task. The task included two stimulus locations and variable cue validities across blocks of trials. Subjects were adept at the task, showing precise and graded modulations of visual attention for subtle target changes and performing better and faster when the cue was more reliable [J. P. Mayo, J. H. R. Maunsell, J. Neurosci. 36, 5353 (2016)]. However, over tens of thousands of microsaccades, we found no difference in microsaccade direction between cued locations when cue variability was high nor between hit and miss trials. Instead, microsaccades were made toward the midpoint of the two target locations, not toward individual targets. Our results suggest that the direction of microsaccades should be interpreted with caution and may not be a reliable measure of covert spatial attention in more complex viewing conditions.
Collapse
Affiliation(s)
- Shawn M. Willett
- Department of Ophthalmology, Center for the Neural Basis of Cognition, University of Pittsburgh, 15213 Pittsburgh, PA
| | - J. Patrick Mayo
- Department of Ophthalmology, Center for the Neural Basis of Cognition, University of Pittsburgh, 15213 Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, 15260 Pittsburgh, PA
| |
Collapse
|
13
|
Palmieri H, Fernández A, Carrasco M. Microsaccades and temporal attention at different locations of the visual field. J Vis 2023; 23:6. [PMID: 37145653 PMCID: PMC10168009 DOI: 10.1167/jov.23.5.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/06/2023] Open
Abstract
Temporal attention, the prioritization of information at specific points in time, improves performance in behavioral tasks but cannot ameliorate the perceptual asymmetries that exist across the visual field. That is, even after attentional deployment, performance is better along the horizontal than vertical meridian and worse at the upper than lower vertical meridian. Here we asked whether and how microsaccades-tiny fixational eye-movements-could mirror or alternatively attempt to compensate for these performance asymmetries by assessing temporal profiles and direction of microsaccades as a function of visual field location. Observers were asked to report the orientation of one of two targets presented at different time points, in one of three blocked locations (fovea, right horizontal meridian, upper vertical meridian). We found the following: (1) Microsaccade occurrence did not affect either task performance or the magnitude of the temporal attention effect. (2) Temporal attention modulated the microsaccade temporal profiles, and this modulation varied with polar angle location. At all locations, microsaccade rates were significantly more suppressed in anticipation of the target when temporally cued than in the neutral condition. Moreover, microsaccade rates were more suppressed during target presentation in the fovea than in the right horizontal meridian. (3) Across locations and attention conditions, there was a pronounced bias toward the upper hemifield. Overall, these results reveal that temporal attention benefits performance similarly around the visual field, microsaccade suppression is more pronounced for attention than expectation (neutral trials) across locations, and the directional bias toward the upper hemifield could reflect an attempt to compensate for typical poor performance at the upper vertical meridian.
Collapse
Affiliation(s)
- Helena Palmieri
- Department of Psychology, New York University, New York, NY, USA
| | - Antonio Fernández
- Department of Psychology, New York University, New York, NY, USA
- Department of Psychology, University of Texas in Austin, Austin, TX, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
14
|
Liu B, Nobre AC, van Ede F. Microsaccades transiently lateralise EEG alpha activity. Prog Neurobiol 2023; 224:102433. [PMID: 36907349 PMCID: PMC10074474 DOI: 10.1016/j.pneurobio.2023.102433] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 03/08/2023] [Accepted: 03/09/2023] [Indexed: 03/12/2023]
Abstract
The lateralisation of 8-12 Hz alpha activity is a canonical signature of human spatial cognition that is typically studied under strict fixation requirements. Yet, even during attempted fixation, the brain produces small involuntary eye movements known as microsaccades. Here we report how spontaneous microsaccades - made in the absence of incentives to look elsewhere - can themselves drive transient lateralisation of EEG alpha power according to microsaccade direction. This transient lateralisation of posterior alpha power occurs similarly following start and return microsaccades and is, at least for start microsaccades, driven by increased alpha power ipsilateral to microsaccade direction. This reveals new links between spontaneous microsaccades and human electrophysiological brain activity. It highlights how microsaccades are an important factor to consider in studies relating alpha activity - including spontaneous fluctuations in alpha activity - to spatial cognition, such as studies on visual attention, anticipation, and working memory.
Collapse
Affiliation(s)
- Baiwei Liu
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, the Netherlands.
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, United Kingdom; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, United Kingdom
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, the Netherlands; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, United Kingdom.
| |
Collapse
|
15
|
Yao T, Vanduffel W. Spike rates of frontal eye field neurons predict reaction times in a spatial attention task. Cell Rep 2023; 42:112384. [PMID: 37043349 PMCID: PMC10157294 DOI: 10.1016/j.celrep.2023.112384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 02/08/2023] [Accepted: 03/28/2023] [Indexed: 04/13/2023] Open
Abstract
Which neuronal signal(s) predict reaction times when subjects respond to a target at covertly attended locations? Although recent studies showed that spike rates are not predictive, it remains a highly contested question. Therefore, we record single-unit activity from frontal eye field (FEF) neurons while macaques are performing a covert spatial attention task. We find that the attentional modulation of spike rates of FEF neurons is strongly correlated with behavioral reaction times. Moreover, this correlation already emerges 1 s before target dimming, which triggers the behavioral responses. This prediction of reaction times by spike rates is found in neurons showing attention-dependent enhanced and suppressed activity for targets and distractors, respectively, yet in varying degrees across subjects. Thus, spike rates of FEF neurons can predict reaction times persistently and well before the operant behavior during selective attention tasks. Such long prediction windows will be useful for developing spike-based brain-machine interfaces.
Collapse
Affiliation(s)
- Tao Yao
- Department of Neurosciences, Laboratory of Neuro- and Psychophysiology, KU Leuven Medical School, 3000 Leuven, Belgium; Leuven Brain Institute, KU Leuven, 3000 Leuven, Belgium.
| | - Wim Vanduffel
- Department of Neurosciences, Laboratory of Neuro- and Psychophysiology, KU Leuven Medical School, 3000 Leuven, Belgium; Leuven Brain Institute, KU Leuven, 3000 Leuven, Belgium; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02129, USA; Department of Radiology, Harvard Medical School, Boston, MA 02144, USA.
| |
Collapse
|
16
|
Willett SM, Mayo JP. Microsaccades are directed towards the midpoint between targets in a variably cued attention task. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.24.525403. [PMID: 36747814 PMCID: PMC9900773 DOI: 10.1101/2023.01.24.525403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
Reliable, non-invasive biomarkers that reveal the internal state of a subject are an invaluable tool for neurological diagnoses. Small fixational eye movements, called microsaccades, are a candidate biomarker thought to reflect a subject's focus of attention (1, 2). The linkage between the direction of microsaccades and attention has mainly been demonstrated using explicit and unambiguous attentional cues. However, the natural world is seldom predictable and rarely provides unambiguous information. Thus, a useful biomarker must be robust to such changes in environmental statistics. To determine how well microsaccades reveal visual-spatial attention across behavioral contexts, we analyzed these fixational eye movements in monkeys performing a conventional change detection task. The task included two stimulus locations and variable cue validities across blocks of trials. Subjects were adept at the task, showing precise and graded modulations of visual attention for subtle target changes and performing better and faster when the cue was more reliable (3). However, over tens of thousands of microsaccades, we found no difference in microsaccade direction between cued locations when cue variability was high nor between hit and miss trials. Instead, microsaccades were made towards the midpoint of the two target locations, not towards individual targets. Our results suggest that the direction of microsaccades should be interpreted with caution and may not be a reliable measure of covert spatial attention in more complex viewing conditions. Significance Statement Small fixational eye movements called microsaccades are thought to "point" towards a location that is being attended in the visual periphery. This phenomenon has largely been studied using visual cues that unambiguously indicate the location of the upcoming stimulus change. Because the natural world is rarely unambiguous, we studied the relationship between microsaccade direction and spatial attention using less reliable cues. We found that monkeys' microsaccade directions in a standard visuospatial attention task did not indicate the animals' focus of attention, despite behavioral and neuronal evidence of spatial attention. Instead, microsaccades were made towards the midpoint between the target locations in both animals, suggesting a more complex relationship between microsaccades and attention in naturalistic settings.
Collapse
|
17
|
Fernández A, Hanning NM, Carrasco M. Transcranial magnetic stimulation to frontal but not occipital cortex disrupts endogenous attention. Proc Natl Acad Sci U S A 2023; 120:e2219635120. [PMID: 36853947 PMCID: PMC10013745 DOI: 10.1073/pnas.2219635120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 01/27/2023] [Indexed: 03/01/2023] Open
Abstract
Covert endogenous (voluntary) attention improves visual performance. Human neuroimaging studies suggest that the putative human homolog of macaque frontal eye fields (FEF+) is critical for this improvement, whereas early visual areas are not. Yet, correlational MRI methods do not manipulate brain function. We investigated whether rFEF+ or V1/V2 plays a causal role in endogenous attention. We used transcranial magnetic stimulation (TMS) to alter activity in the visual cortex or rFEF+ when observers performed an orientation discrimination task while attention was manipulated. On every trial, they received double-pulse TMS at a predetermined site (stimulated region) around V1/V2 or rFEF+. Two cortically magnified gratings were presented, one in the stimulated region (contralateral to the stimulated area) and another in the symmetric (ipsilateral) nonstimulated region. Grating contrast was varied to measure contrast response functions (CRFs) for all attention and stimulation combinations. In experiment 1, the CRFs were similar at the stimulated and nonstimulated regions, indicating that early visual areas do not modulate endogenous attention during stimulus presentation. In contrast, occipital TMS eliminates exogenous (involuntary) attention effects on performance [A. Fernández, M. Carrasco,Curr. Biol. 30, 4078-4084 (2020)]. In experiment 2, rFEF+ stimulation decreased the overall attentional effect; neither benefits at the attended location nor costs at the unattended location were significant. The frequency and directionality of microsaccades mimicked this pattern: Whereas occipital stimulation did not affect microsaccades, rFEF+ stimulation caused a higher microsaccade rate directed toward the stimulated hemifield. These results provide causal evidence of the role of this frontal region for endogenous attention.
Collapse
Affiliation(s)
| | - Nina M. Hanning
- Department of Psychology, New York University, New York, NY10003
- Center for Neural Science, New York University, New York, NY10003
- Department of Psychology, Humboldt-Universität zu Berlin, 12489Berlin, Germany
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY10003
- Center for Neural Science, New York University, New York, NY10003
| |
Collapse
|
18
|
Mei Chow H, Spering M. Eye movements during optic flow perception. Vision Res 2023; 204:108164. [PMID: 36566560 DOI: 10.1016/j.visres.2022.108164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 11/22/2022] [Accepted: 12/07/2022] [Indexed: 12/24/2022]
Abstract
Optic flow is an important visual cue for human perception and locomotion and naturally triggers eye movements. Here we investigate whether the perception of optic flow direction is limited or enhanced by eye movements. In Exp. 1, 23 human observers localized the focus of expansion (FOE) of an optic flow pattern; in Exp. 2, 18 observers had to detect brief visual changes at the FOE. Both tasks were completed during free viewing and fixation conditions while eye movements were recorded. Task difficulty was varied by manipulating the coherence of radial motion from the FOE (4 %-90 %). During free viewing, observers tracked the optic flow pattern with a combination of saccades and smooth eye movements. During fixation, observers nevertheless made small-scale eye movements. Despite differences in spatial scale, eye movements during free viewing and fixation were similarly directed toward the FOE (saccades) and away from the FOE (smooth tracking). Whereas FOE localization sensitivity was not affected by eye movement instructions (Exp. 1), observers' sensitivity to detect brief changes at the FOE was 27 % higher (p <.001) during free-viewing compared to fixation (Exp. 2). This performance benefit was linked to reduced saccade endpoint errors, indicating the direct beneficial impact of foveating eye movements on performance in a fine-grain perceptual task, but not during coarse perceptual localization.
Collapse
Affiliation(s)
- Hiu Mei Chow
- Dept. of Psychology, St. Thomas University, Fredericton, Canada; Dept. of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada.
| | - Miriam Spering
- Dept. of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada; Djavad Mowafaghian Center for Brain Health, University of British Columbia, Vancouver, Canada; Institute for Computing, Information and Cognitive Systems, University of British Columbia, Vancouver, Canada
| |
Collapse
|
19
|
Umemoto S, Hirata Y. Emerging order of anomalous eye movements with progressive drowsiness. J Vis 2023; 23:17. [PMID: 36696121 PMCID: PMC9896843 DOI: 10.1167/jov.23.1.17] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023] Open
Abstract
It has been widely recognized that human alertness is reflected in the eyes (e.g., when drowsiness, miosis, slow saccades, divergence, less compensatory vestibulo-ocular reflex, and less-accurate optokinetic response and smooth pursuit emerge). Previous studies that discovered these pupil/oculomotor anomalous behaviors along with lowering alertness evaluated only one or a few of them simultaneously, thus their emergence order is yet unknown. Presently, we focused on the following five pupil/oculomotor behaviors that can be evaluated under a natural stationary environment without giving external sensory stimulations: saccades, slow-phase eye movements, vergence, pupil diameter, and blinks. We demonstrate that their anomalous behaviors emerge in the following order: first: frequent saccades; second: slow saccades; third: divergence & miosis, then slow eye movement, while elongated eyelid closure duration emerges randomly in this sequence. These results provide a basis for the oculo-pupillometry-enabling objective monitoring of progressive drowsiness.
Collapse
Affiliation(s)
- Shunya Umemoto
- Department of Computer Science, Chubu University Graduate School of Engineering, Aichi, Japan.,
| | - Yutaka Hirata
- Department of Robotic Science and Technology, Chubu University College of Engineering, Aichi, Japan.,Academy of Emerging Sciences, Chubu University, Aichi, Japan.,Center for Mathematical Science and Artificial Intelligence, Chubu University, Aichi, Japan.,
| |
Collapse
|
20
|
Chen YD, Kaestner M, Norcia AM. Cognitive penetrability of scene representations based on horizontal image disparities. Sci Rep 2022; 12:17902. [PMID: 36284130 PMCID: PMC9596438 DOI: 10.1038/s41598-022-22670-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Accepted: 10/18/2022] [Indexed: 01/20/2023] Open
Abstract
The structure of natural scenes is signaled by many visual cues. Principal amongst them are the binocular disparities created by the laterally separated viewpoints of the two eyes. Disparity cues are believed to be processed hierarchically, first in terms of local measurements of absolute disparity and second in terms of more global measurements of relative disparity that allow extraction of the depth structure of a scene. Psychophysical and oculomotor studies have suggested that relative disparities are particularly relevant to perception, whilst absolute disparities are not. Here, we compare neural responses to stimuli that isolate the absolute disparity cue with stimuli that contain additional relative disparity cues, using the high temporal resolution of EEG to determine the temporal order of absolute and relative disparity processing. By varying the observers' task, we assess the extent to which each cue is cognitively penetrable. We find that absolute disparity is extracted before relative disparity, and that task effects arise only at or after the extraction of relative disparity. Our results indicate a hierarchy of disparity processing stages leading to the formation of a proto-object representation upon which higher cognitive processes can act.
Collapse
Affiliation(s)
- Yulan D Chen
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA, USA
- Wu-Tsai Neuroscience Institute, Stanford University, 290 Jane Stanford Way, Stanford, CA, USA
| | - Milena Kaestner
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA, USA.
- Wu-Tsai Neuroscience Institute, Stanford University, 290 Jane Stanford Way, Stanford, CA, USA.
| | - Anthony M Norcia
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA, USA
- Wu-Tsai Neuroscience Institute, Stanford University, 290 Jane Stanford Way, Stanford, CA, USA
| |
Collapse
|
21
|
Functional but not obligatory link between microsaccades and neural modulation by covert spatial attention. Nat Commun 2022; 13:3503. [PMID: 35715471 PMCID: PMC9205986 DOI: 10.1038/s41467-022-31217-3] [Citation(s) in RCA: 35] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Accepted: 06/08/2022] [Indexed: 11/23/2022] Open
Abstract
Covert spatial attention is associated with spatial modulation of neural activity as well as with directional biases in fixational eye movements known as microsaccades. We studied how these two ‘fingerprints’ of attention are interrelated in humans. We investigated spatial modulation of 8-12 Hz EEG alpha activity and microsaccades when attention is directed internally within the spatial layout of visual working memory. Consistent with a common origin, spatial modulations of alpha activity and microsaccades co-vary: alpha lateralisation is stronger in trials with microsaccades toward versus away from the memorised location of the to-be-attended item and occurs earlier in trials with earlier microsaccades toward this item. Critically, however, trials without attention-driven microsaccades nevertheless show clear spatial modulation of alpha activity – comparable to trials with attention-driven microsaccades. Thus, directional biases in microsaccades correlate with neural signatures of spatial attention, but they are not necessary for neural modulation by spatial attention to be manifest. Covert visual spatial attention modulates neural activity and biases the direction of small eye movements, known as microsaccades. Here, the authors show that these two markers co-vary, but that microsaccades are not necessary for neural modulation by attention to occur.
Collapse
|
22
|
Abstract
Eye movements are neither necessary nor sufficient to account for the neural effects associated with covert attention.
Collapse
Affiliation(s)
- Alessandro Benedetto
- Department of Brain and Cognitive Sciences and Center for Visual Science, University of Rochester, New York, United States
| | - Martina Poletti
- Department of Brain and Cognitive Sciences, the Center for Visual Science and the Department of Neuroscience, University of Rochester, Rochester, United States
| |
Collapse
|