1
|
Harrison WJ, Stead I, Wallis TSA, Bex PJ, Mattingley JB. A computational account of transsaccadic attentional allocation based on visual gain fields. Proc Natl Acad Sci U S A 2024; 121:e2316608121. [PMID: 38941277 PMCID: PMC11228487 DOI: 10.1073/pnas.2316608121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2023] [Accepted: 05/13/2024] [Indexed: 06/30/2024] Open
Abstract
Coordination of goal-directed behavior depends on the brain's ability to recover the locations of relevant objects in the world. In humans, the visual system encodes the spatial organization of sensory inputs, but neurons in early visual areas map objects according to their retinal positions, rather than where they are in the world. How the brain computes world-referenced spatial information across eye movements has been widely researched and debated. Here, we tested whether shifts of covert attention are sufficiently precise in space and time to track an object's real-world location across eye movements. We found that observers' attentional selectivity is remarkably precise and is barely perturbed by the execution of saccades. Inspired by recent neurophysiological discoveries, we developed an observer model that rapidly estimates the real-world locations of objects and allocates attention within this reference frame. The model recapitulates the human data and provides a parsimonious explanation for previously reported phenomena in which observers allocate attention to task-irrelevant locations across eye movements. Our findings reveal that visual attention operates in real-world coordinates, which can be computed rapidly at the earliest stages of cortical processing.
Collapse
Affiliation(s)
- William J. Harrison
- Psychology, School of Health, University of the Sunshine Coast, Sippy Downs, QLD4556, Australia
- Queensland Brain Institute, The University of Queensland, St. Lucia, QLD4072, Australia
- The School of Psychology, The University of Queensland, St. Lucia, QLD4072, Australia
| | - Imogen Stead
- Queensland Brain Institute, The University of Queensland, St. Lucia, QLD4072, Australia
| | - Thomas S. A. Wallis
- Centre for Cognitive Science and Institute of Psychology, Technical University of Darmstadt, Darmstadt64283, Germany
- Center for Mind, Brain and Behavior (CMBB), Universities of Marburg, Giessen, and Darmstadt, Marburg35032, Germany
| | - Peter J. Bex
- Department of Psychology, Northeastern University, Boston, MA02115
| | - Jason B. Mattingley
- Queensland Brain Institute, The University of Queensland, St. Lucia, QLD4072, Australia
- The School of Psychology, The University of Queensland, St. Lucia, QLD4072, Australia
- Canadian Institute for Advanced Research, Toronto, ONM5G 1M1, Canada
| |
Collapse
|
2
|
Liu X, Melcher D, Carrasco M, Hanning NM. Pre-saccadic Preview Shapes Post-Saccadic Processing More Where Perception is Poor. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.05.18.541028. [PMID: 37292871 PMCID: PMC10245755 DOI: 10.1101/2023.05.18.541028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The pre-saccadic preview of a peripheral target enhances the efficiency of its post-saccadic processing, termed the extrafoveal preview effect. Peripheral visual performance -and thus the quality of the preview- varies around the visual field, even at iso-eccentric locations: it is better along the horizontal than vertical meridian and along the lower than upper vertical meridian. To investigate whether these polar angle asymmetries influence the preview effect, we asked human participants (to preview four tilted gratings at the cardinals, until a central cue indicated to which one to saccade. During the saccade, the target orientation either remained or slightly changed (valid/invalid preview). After saccade landing, participants discriminated the orientation of the (briefly presented) second grating. Stimulus contrast was titrated with adaptive staircases to assess visual performance. Expectedly, valid previews increased participants' post-saccadic contrast sensitivity. This preview benefit, however, was inversely related to polar angle perceptual asymmetries; largest at the upper, and smallest at the horizontal meridian. This finding reveals that the visual system compensates for peripheral asymmetries when integrating information across saccades, by selectively assigning higher weights to the less-well perceived preview information. Our study supports the recent line of evidence showing that perceptual dynamics around saccades vary with eye movement direction.
Collapse
|
3
|
DeYoe EA, Huddleston W, Greenberg AS. Are neuronal mechanisms of attention universal across human sensory and motor brain maps? Psychon Bull Rev 2024:10.3758/s13423-024-02495-3. [PMID: 38587756 DOI: 10.3758/s13423-024-02495-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2024] [Indexed: 04/09/2024]
Abstract
One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.
Collapse
Affiliation(s)
- Edgar A DeYoe
- Department of Radiology, Medical College of Wisconsin, 8701 Watertown Plank Rd, Milwaukee, WI, 53226, USA.
- , Signal Mountain, USA.
| | - Wendy Huddleston
- School of Rehabilitation Sciences and Technology, College of Health Professions and Sciences, University of Wisconsin - Milwaukee, 3409 N. Downer Ave, Milwaukee, WI, 53211, USA
| | - Adam S Greenberg
- Department of Biomedical Engineering, Medical College of Wisconsin and Marquette University, Milwaukee, WI, 53226, USA
| |
Collapse
|
4
|
Hanning NM, Himmelberg MM, Carrasco M. Presaccadic Attention Depends on Eye Movement Direction and Is Related to V1 Cortical Magnification. J Neurosci 2024; 44:e1023232023. [PMID: 38316562 PMCID: PMC10957215 DOI: 10.1523/jneurosci.1023-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 09/08/2023] [Accepted: 09/11/2023] [Indexed: 02/07/2024] Open
Abstract
With every saccadic eye movement, humans bring new information into their fovea to be processed with high visual acuity. Notably, perception is enhanced already before a relevant item is foveated: During saccade preparation, presaccadic attention shifts to the upcoming fixation location, which can be measured via behavioral correlates such as enhanced visual performance or modulations of sensory feature tuning. The coupling between saccadic eye movements and attention is assumed to be robust and mandatory and considered a mechanism facilitating the integration of pre- and postsaccadic information. However, until recently it had not been investigated as a function of saccade direction. Here, we measured contrast response functions during fixation and saccade preparation in male and female observers and found that the pronounced response gain benefit typically elicited by presaccadic attention is selectively lacking before upward saccades at the group level-some observers even showed a cost. Individual observer's sensitivity before upward saccades was negatively related to their amount of surface area in primary visual cortex representing the saccade target, suggesting a potential compensatory mechanism that optimizes the use of the limited neural resources processing the upper vertical meridian. Our results raise the question of how perceptual continuity is achieved and how upward saccades can be accurately targeted despite the lack of-theoretically required-presaccadic attention.
Collapse
Affiliation(s)
- Nina M Hanning
- Department of Psychology, New York University, New York, New York 10003
- Center for Neural Science, New York University, New York, New York 10003
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin 12489, Germany
| | - Marc M Himmelberg
- Department of Psychology, New York University, New York, New York 10003
- Center for Neural Science, New York University, New York, New York 10003
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, New York 10003
- Center for Neural Science, New York University, New York, New York 10003
| |
Collapse
|
5
|
Goldstein AT, Stanford TR, Salinas E. Coupling of saccade plans to endogenous attention during urgent choices. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.01.583058. [PMID: 38496491 PMCID: PMC10942325 DOI: 10.1101/2024.03.01.583058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
The neural mechanisms that willfully direct attention to specific locations in space are closely related to those for generating targeting eye movements (saccades). However, the degree to which the voluntary deployment of attention to a location is necessarily accompanied by a corresponding saccade plan remains unclear. One problem is that attention and saccades are both automatically driven by salient sensory events; another is that the underlying processes unfold within tens of milliseconds only. Here, we use an urgent task design to resolve the evolution of a visuomotor choice on a moment-by-moment basis while independently controlling the endogenous (goal-driven) and exogenous (salience-driven) contributions to performance. Human participants saw a peripheral cue and, depending on its color, either looked at it (prosaccade) or looked at a diametrically opposite, uninformative non-cue (antisaccade). By varying the luminance of the stimuli, the exogenous contributions could be cleanly dissociated from the endogenous process guiding the choice over time. According to the measured timecourses, generating a correct antisaccade requires about 30 ms more processing time than generating a correct prosaccade based on the same perceptual signal. The results indicate that saccade plans are biased toward the location where attention is endogenously deployed, but the coupling is weak and can be willfully overridden very rapidly.
Collapse
Affiliation(s)
- Allison T Goldstein
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC 27157-1010, USA
| | - Terrence R Stanford
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC 27157-1010, USA
| | - Emilio Salinas
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC 27157-1010, USA
| |
Collapse
|
6
|
Lehet M, Rolfs M, Bao J, Fattal J, Thakkar KN. Pre-saccadic shifts of attention in individuals diagnosed with schizophrenia. Brain Behav 2024; 14:e3466. [PMID: 38450916 PMCID: PMC10918725 DOI: 10.1002/brb3.3466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 02/15/2024] [Accepted: 02/18/2024] [Indexed: 03/08/2024] Open
Abstract
INTRODUCTION Pathophysiological theories of schizophrenia (SZ) symptoms posit an abnormality in using predictions to guide behavior. One such prediction is based on imminent movements, via corollary discharge signals (CD) that relay information about planned movement kinematics to sensory brain regions. Empirical evidence suggests a reduced influence of sensorimotor predictions in individuals with SZ within multiple sensory systems, including in the visual system. One function of CD in the visual system is to selectively enhance visual sensitivity at the location of planned eye movements (pre-saccadic attention), thus enabling a prediction of the to-be-foveated stimulus. We expected pre-saccadic attention shifts to be less pronounced in individuals with SZ than in healthy controls (HC), resulting in unexpected sensory consequences of eye movements, which may relate to symptoms than can be explained in the context of altered allocation of attention. METHODS We examined this question by testing 30 SZ and 30 HC on a pre-saccadic attention task. On each trial participants made a saccade to a cued location in an array of four stimuli. A discrimination target that was either congruent or incongruent with the cued location was briefly presented after the cue, during saccade preparation. Pre-saccadic attention was quantified by comparing accuracy on congruent trials to incongruent trials within the interval preceding the saccade. RESULTS Although SZs were less accurate overall, the magnitude of the pre-saccadic attention effect generally did not differ across groups nor show a convincing relationship with symptom severity. We did, however, observe that SZ had reduced pre-saccadic attention effects when the discrimination target (probe) was presented at early stages of saccade planning, when pre-saccadic attention effects first emerged in HC. CONCLUSION These findings suggest generally intact pre-saccadic shifts of attention in SZ, albeit slightly delayed. Results contribute to our understanding of altered sensory predictions in people with schizophrenia.
Collapse
Affiliation(s)
- Matthew Lehet
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
| | - Martin Rolfs
- Department of PsychologyHumboldt UniversityBerlinGermany
| | - Jacqueline Bao
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
| | - Jessica Fattal
- Department of PsychologyNorthwestern UniversityEvanstonIllinoisUSA
| | - Katharine N. Thakkar
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
- Psychiatry and Behavioral MedicineMichigan State University College of Human MedicineEast LansingMichiganUSA
| |
Collapse
|
7
|
Coop SH, Yates JL, Mitchell JF. Pre-saccadic Neural Enhancements in Marmoset Area MT. J Neurosci 2024; 44:e2034222023. [PMID: 38050176 PMCID: PMC10860570 DOI: 10.1523/jneurosci.2034-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 09/15/2023] [Accepted: 11/20/2023] [Indexed: 12/06/2023] Open
Abstract
Each time we make an eye movement, attention moves before the eyes, resulting in a perceptual enhancement at the target. Recent psychophysical studies suggest that this pre-saccadic attention enhances the visual features at the saccade target, whereas covert attention causes only spatially selective enhancements. While previous nonhuman primate studies have found that pre-saccadic attention does enhance neural responses spatially, no studies have tested whether changes in neural tuning reflect an automatic feature enhancement. Here we examined pre-saccadic attention using a saccade foraging task developed for marmoset monkeys (one male and one female). We recorded from neurons in the middle temporal area with peripheral receptive fields that contained a motion stimulus, which would either be the target of a saccade or a distracter as a saccade was made to another location. We established that marmosets, like macaques, show enhanced pre-saccadic neural responses for saccades toward the receptive field, including increases in firing rate and motion information. We then examined if the specific changes in neural tuning might support feature enhancements for the target. Neurons exhibited diverse changes in tuning but predominantly showed additive and multiplicative increases that were uniformly applied across motion directions. These findings confirm that marmoset monkeys, like macaques, exhibit pre-saccadic neural enhancements during saccade foraging tasks with minimal training requirements. However, at the level of individual neurons, the lack of feature-tuned enhancements is similar to neural effects reported during covert spatial attention.
Collapse
Affiliation(s)
- Shanna H Coop
- Brain and Cognitive Sciences, University of Rochester, Rochester 14627-0268, New York
- Center for Visual Science, University of Rochester, Rochester 14627-0268, New York
| | - Jacob L Yates
- Brain and Cognitive Sciences, University of Rochester, Rochester 14627-0268, New York
- Center for Visual Science, University of Rochester, Rochester 14627-0268, New York
- Department of Biology, University of Maryland College Park, College Park, Maryland, 20742-5025
| | - Jude F Mitchell
- Brain and Cognitive Sciences, University of Rochester, Rochester 14627-0268, New York
- Center for Visual Science, University of Rochester, Rochester 14627-0268, New York
| |
Collapse
|
8
|
Gupta P, Sridharan D. Presaccadic attention does not facilitate the detection of changes in the visual field. PLoS Biol 2024; 22:e3002485. [PMID: 38271460 PMCID: PMC10810526 DOI: 10.1371/journal.pbio.3002485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 01/02/2024] [Indexed: 01/27/2024] Open
Abstract
Planning a rapid eye movement (saccade) changes how we perceive our visual world. Even before we move the eyes visual discrimination sensitivity improves at the impending target of eye movements, a phenomenon termed "presaccadic attention." Yet, it is unknown if such presaccadic selection merely affects perceptual sensitivity, or also affects downstream decisional processes, such as choice bias. We report a surprising lack of presaccadic perceptual benefits in a common, everyday setting-detection of changes in the visual field. Despite the lack of sensitivity benefits, choice bias for reporting changes increased reliably for the saccade target. With independent follow-up experiments, we show that presaccadic change detection is rendered more challenging because percepts at the saccade target location are biased toward, and more precise for, only the most recent of two successive stimuli. With a Bayesian model, we show how such perceptual and choice biases are crucial to explain the effects of saccade plans on change detection performance. In sum, visual change detection sensitivity does not improve presaccadically, a result that is readily explained by teasing apart distinct components of presaccadic selection. The findings may have critical implications for real-world scenarios, like driving, that require rapid gaze shifts in dynamically changing environments.
Collapse
Affiliation(s)
- Priyanka Gupta
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | | |
Collapse
|
9
|
Huber-Huber C, Melcher D. Saccade execution increases the preview effect with faces: An EEG and eye-tracking coregistration study. Atten Percept Psychophys 2023:10.3758/s13414-023-02802-5. [PMID: 37917292 DOI: 10.3758/s13414-023-02802-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/27/2023] [Indexed: 11/04/2023]
Abstract
Under naturalistic viewing conditions, humans conduct about three to four saccadic eye movements per second. These dynamics imply that in real life, humans rarely see something completely new; there is usually a preview of the upcoming foveal input from extrafoveal regions of the visual field. In line with results from the field of reading research, we have shown with EEG and eye-tracking coregistration that an extrafoveal preview also affects postsaccadic visual object processing and facilitates discrimination. Here, we ask whether this preview effect in the fixation-locked N170, and in manual responses to the postsaccadic target face (tilt discrimination), requires saccade execution. Participants performed a gaze-contingent experiment in which extrafoveal face images could change their orientation during a saccade directed to them. In a control block, participants maintained stable gaze throughout the experiment and the extrafoveal face reappeared foveally after a simulated saccade latency. Compared with this no-saccade condition, the neural and the behavioral preview effects were much larger in the saccade condition. We also found shorter first fixation durations after an invalid preview, which is in contrast to reading studies. We interpret the increased preview effect under saccade execution as the result of the additional sensorimotor processes that come with gaze behavior compared with visual perception under stable fixation. In addition, our findings call into question whether EEG studies with fixed gaze capture key properties and dynamics of active, natural vision.
Collapse
Affiliation(s)
- Christoph Huber-Huber
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Corso Bettini 31, 38068, Rovereto, Italy.
| | - David Melcher
- Center for Brain & Health, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- Psychology Program, Division of Science, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
10
|
Poletti M. An eye for detail: Eye movements and attention at the foveal scale. Vision Res 2023; 211:108277. [PMID: 37379763 PMCID: PMC10528557 DOI: 10.1016/j.visres.2023.108277] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 06/08/2023] [Accepted: 06/08/2023] [Indexed: 06/30/2023]
Abstract
Human vision relies on a tiny region of the retina, the 1-deg foveola, to achieve high spatial resolution. Foveal vision is of paramount importance in daily activities, yet its study is challenging, as eye movements incessantly displace stimuli across this region. Here I will review work that, building on recent advances in eye-tracking and gaze-contingent display, examines how attention and eye movements operate at the foveal level. This research highlights how exploration of fine spatial detail unfolds following visuomotor strategies reminiscent of those occurring at larger scales. It shows that, together with highly precise control of attention, this motor activity is linked to non-homogenous processing within the foveola and selectively modulates sensitivity both in space and time. Overall, the picture emerges of a highly dynamic foveal perception in which fine spatial vision, rather than simply being the result of placing a stimulus at the center of gaze, is the result of a finely tuned and orchestrated synergy of motor, cognitive, and attentional processes.
Collapse
Affiliation(s)
- Martina Poletti
- Department of Brain and Cognitive Sciences, University of Rochester, United States; Center for Visual Science, University of Rochester, United States; Department of Neuroscience, University of Rochester, United States.
| |
Collapse
|
11
|
Li HH, Curtis CE. Neural population dynamics of human working memory. Curr Biol 2023; 33:3775-3784.e4. [PMID: 37595590 PMCID: PMC10528783 DOI: 10.1016/j.cub.2023.07.067] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 06/20/2023] [Accepted: 07/31/2023] [Indexed: 08/20/2023]
Abstract
The activity of neurons in macaque prefrontal cortex (PFC) persists during working memory (WM) delays, providing a mechanism for memory.1,2,3,4,5,6,7,8,9,10,11 Although theory,11,12 including formal network models,13,14 assumes that WM codes are stable over time, PFC neurons exhibit dynamics inconsistent with these assumptions.15,16,17,18,19 Recently, multivariate reanalyses revealed the coexistence of both stable and dynamic WM codes in macaque PFC.20,21,22,23 Human EEG studies also suggest that WM might contain dynamics.24,25 Nonetheless, how WM dynamics vary across the cortical hierarchy and which factors drive dynamics remain unknown. To elucidate WM dynamics in humans, we decoded WM content from fMRI responses across multiple cortical visual field maps.26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48 We found coexisting stable and dynamic neural representations of WM during a memory-guided saccade task. Geometric analyses of neural subspaces revealed that early visual cortex exhibited stronger dynamics than high-level visual and frontoparietal cortex. Leveraging models of population receptive fields, we visualized and made the neural dynamics interpretable. We found that during WM delays, V1 population initially encoded a narrowly tuned bump of activation centered on the peripheral memory target. Remarkably, this bump then spread inward toward foveal locations, forming a vector along the trajectory of the forthcoming memory-guided saccade. In other words, the neural code transformed into an abstraction of the stimulus more proximal to memory-guided behavior. Therefore, theories of WM must consider both sensory features and their task-relevant abstractions because changes in the format of memoranda naturally drive neural dynamics.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, NY 10003, USA; Center for Neural Science, New York University, New York, NY 10003, USA
| | - Clayton E Curtis
- Department of Psychology, New York University, New York, NY 10003, USA; Center for Neural Science, New York University, New York, NY 10003, USA.
| |
Collapse
|
12
|
Hanning NM, Fernández A, Carrasco M. Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention. Nat Commun 2023; 14:5381. [PMID: 37666805 PMCID: PMC10477327 DOI: 10.1038/s41467-023-40678-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 08/03/2023] [Indexed: 09/06/2023] Open
Abstract
Shortly before saccadic eye movements, visual sensitivity at the saccade target is enhanced, at the expense of sensitivity elsewhere. Some behavioral and neural correlates of this presaccadic shift of attention resemble those of covert attention, deployed during fixation. Microstimulation in non-human primates has shown that presaccadic attention modulates perception via feedback from oculomotor to visual areas. This mechanism also seems plausible in humans, as both oculomotor and visual areas are active during saccade planning. We investigated this hypothesis by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show their causal and differential roles in contralateral presaccadic attention effects: Whereas rFEF+ stimulation enhanced sensitivity opposite the saccade target throughout saccade preparation, V1/V2 stimulation reduced sensitivity at the saccade target only shortly before saccade onset. These findings are consistent with presaccadic attention modulating perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.
Collapse
Affiliation(s)
- Nina M Hanning
- Department of Psychology & Center for Neural Sciences, New York University, New York, NY, USA.
- Institut für Psychologie, Humboldt Universität zu Berlin, Berlin, Germany.
| | - Antonio Fernández
- Department of Psychology & Center for Neural Sciences, New York University, New York, NY, USA
- Department of Psychology, University of Texas at Austin, Austin, TX, USA
| | - Marisa Carrasco
- Department of Psychology & Center for Neural Sciences, New York University, New York, NY, USA
| |
Collapse
|
13
|
Talcott TN, Kiat JE, Luck SJ, Gaspelin N. Is covert attention necessary for programming accurate saccades? Evidence from saccade-locked event-related potentials. Atten Percept Psychophys 2023:10.3758/s13414-023-02775-5. [PMID: 37612581 DOI: 10.3758/s13414-023-02775-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/03/2023] [Indexed: 08/25/2023]
Abstract
For decades, researchers have assumed that shifts of covert attention mandatorily occur prior to eye movements to improve perceptual processing of objects before they are fixated. However, recent research suggests that the N2pc component-a neural measure of covert attentional allocation-does not always precede eye movements. The current study investigated whether the N2pc component mandatorily precedes eye movements and assessed its role in the accuracy of gaze control. In three experiments, participants searched for a letter of a specific color (e.g., red) and directed gaze to it as a response. Electroencephalograms and eye movements were coregistered to determine whether neural markers of covert attention preceded the initial shift of gaze. The results showed that the presaccadic N2pc only occurred under limited conditions: when there were many potential target locations and distractors. Crucially, there was no evidence that the presence or magnitude of the presaccadic N2pc was associated with improved eye movement accuracy in any of the experiments. Interestingly, ERP decoding analyses were able to classify the target location well before the eyes started to move, which likely reflects a presaccadic cognitive process that is distinct from the attentional process measured by the N2pc. Ultimately, we conclude that the covert attentional mechanism indexed by the N2pc is not necessary for precise gaze control.
Collapse
Affiliation(s)
- Travis N Talcott
- Department of Psychology, Binghamton University, State University of New York, P.O. Box 6000, Binghamton, NY, 13902-6000, USA.
| | - John E Kiat
- Center for Mind and Brain, University of California, Davis, CA, USA
| | - Steven J Luck
- Center for Mind and Brain, University of California, Davis, CA, USA
| | - Nicholas Gaspelin
- Department of Psychology, Binghamton University, State University of New York, P.O. Box 6000, Binghamton, NY, 13902-6000, USA
- Department of Psychological Sciences, University of Missouri, Columbia, MO, USA
| |
Collapse
|
14
|
Koevoet D, Strauch C, Naber M, der Stigchel SV. The Costs of Paying Overt and Covert Attention Assessed With Pupillometry. Psychol Sci 2023; 34:887-898. [PMID: 37314425 DOI: 10.1177/09567976231179378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023] Open
Abstract
Attention can be shifted with or without an accompanying saccade (i.e., overtly or covertly, respectively). Thus far, it is unknown how cognitively costly these shifts are, yet such quantification is necessary to understand how and when attention is deployed overtly or covertly. In our first experiment (N = 24 adults), we used pupillometry to show that shifting attention overtly is more costly than shifting attention covertly, likely because planning saccades is more complex. We pose that these differential costs will, in part, determine whether attention is shifted overtly or covertly in a given context. A subsequent experiment (N = 24 adults) showed that relatively complex oblique saccades are more costly than relatively simple saccades in horizontal or vertical directions. This provides a possible explanation for the cardinal-direction bias of saccades. The utility of a cost perspective as presented here is vital to furthering our understanding of the multitude of decisions involved in processing and interacting with the external world efficiently.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University
| | | | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University
| | | |
Collapse
|
15
|
Hanning NM, Fernández A, Carrasco M. Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention - evidence from TMS. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.23.529691. [PMID: 36865228 PMCID: PMC9980111 DOI: 10.1101/2023.02.23.529691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/03/2023]
Abstract
Shortly before each saccadic eye movement, presaccadic attention improves visual sensitivity at the saccade target 1-5 at the expense of lowered sensitivity at non-target locations 6-11 . Some behavioral and neural correlates of presaccadic attention and covert attention -which likewise enhances sensitivity, but during fixation 12 -are similar 13 . This resemblance has led to the debatable 13-18 notion that presaccadic and covert attention are functionally equivalent and rely on the same neural circuitry 19-21 . At a broad scale, oculomotor brain structures (e.g., FEF) are also modulated during covert attention 22-24 - yet by distinct neuronal subpopulations 25-28 . Perceptual benefits of presaccadic attention rely on feedback from oculomotor structures to visual cortices 29,30 ( Fig. 1a ); micro-stimulation of FEF in non-human primates affects activity in visual cortex 31-34 and enhances visual sensitivity at the movement field of the stimulated neurons 35-37 . Similar feedback projections seem to exist in humans: FEF+ activation precedes occipital activation during saccade preparation 38,39 and FEF TMS modulates activity in visual cortex 40-42 and enhances perceived contrast in the contralateral hemifield 40 . We investigated presaccadic feedback in humans by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show the causal and differential roles of these brain regions in contralateral presaccadic benefits at the saccade target and costs at non-targets: Whereas rFEF+ stimulation reduced presaccadic costs throughout saccade preparation, V1/V2 stimulation reduced benefits only shortly before saccade onset. These effects provide causal evidence that presaccadic attention modulates perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.
Collapse
|
16
|
Abstract
Visual perception is limited by spatial resolution, the ability to discriminate fine details. Spatial resolution not only declines with eccentricity but also differs for polar angle locations around the visual field, also known as 'performance fields'. To compensate for poor peripheral resolution, we make rapid eye movements-saccades-to bring peripheral objects into high-acuity foveal vision. Already before saccade onset, visual attention shifts to the saccade target location and prioritizes visual processing. This presaccadic shift of attention improves performance in many visual tasks, but whether it changes resolution is unknown. Here, we investigated whether presaccadic attention sharpens peripheral spatial resolution; and if so, whether such effect interacts with performance fields asymmetries. We measured acuity thresholds in an orientation discrimination task during fixation and saccade preparation around the visual field. The results revealed that presaccadic attention sharpens acuity, which can facilitate a smooth transition from peripheral to foveal representation. This acuity enhancement is similar across the four cardinal locations; thus, the typically robust effect of presaccadic attention does not change polar angle differences in resolution.
Collapse
|
17
|
A new technique for estimating the probability of attentional capture. Atten Percept Psychophys 2023; 85:543-559. [PMID: 36624200 DOI: 10.3758/s13414-022-02639-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/05/2022] [Indexed: 01/11/2023]
Abstract
Latency-based metrics of attentional capture are limited: They indicate whether or not capture occurred, but they do not indicate how often capture occurred. The present study introduces a new technique for estimating the probability of capture. In a spatial cueing paradigm, participants searched for a target letter defined by color while attempting to ignore salient cues that were drawn in either a relevant or irrelevant color. The results demonstrated the typical contingent capture effect: larger cue validity effects from relevant cues than irrelevant cues. Importantly, using a novel analytical approach, we were able to estimate the probability that the salient cue captured attention. This approach revealed a surprisingly low probability of attentional capture in the spatial cuing paradigm. Relevant cues are thought to be one of the strongest attractors of attention, yet they were estimated to capture attention on only about 30% of trials. This new metric provides an index of capture strength that can be meaningfully compared across different experimental contexts, which was not possible until now.
Collapse
|
18
|
Ouerfelli-Ethier J, Comtois Bona I, Fournet R, Pisella L, Khan AZ. Pre-saccadic attention relies more on suppression than does covert attention. J Vis 2023; 23:1. [PMID: 36595283 PMCID: PMC9819743 DOI: 10.1167/jov.23.1.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
During covert and pre-saccadic attentional shifts, it is unclear how facilitation and suppression processes interact for target selection. A recent countermanding task pointed to greater suppression at unattended locations during trials with saccades compared to trials without saccades (i.e., fixation and successful stop trials), whereas target facilitation did not differ. It is unknown whether this finding is restricted to countermanding paradigms that involve inhibitory processes. To test this, we adapted Gaspelin and colleagues (2015)'s attention capture task where, within the same block, one location was primed with frequent line discrimination trials, and all locations were occasionally probed using letters report trials. Participants also performed a baseline condition without priming. We tested 15 participants and examined how performance at non-primed locations was affected by covert versus pre-saccadic attention in blocks of four or six items, as well as by position from the primed location and timing from saccade onset. For both attention conditions, letter report at non-primed locations was worse compared to baseline, demonstrating suppression, and letter report at primed location was better, demonstrating facilitation. In saccades trials, letter report was better at primed locations and worse at non-primed locations compared to fixation trials. The timing of this additional pre-saccadic suppression differed from saccadic suppression. In both attention conditions, suppression was greater when primed and non-primed locations were within the same hemifield or in diagonal opposite quadrants. These results confirmed that attention preceding saccade execution suppressed non-primed locations to a larger extent than covert attention, with the same spatial quadrant effect.
Collapse
Affiliation(s)
- Julie Ouerfelli-Ethier
- School of Optometry, University of Montreal, Montreal, Canada.,Lyon Neuroscience Research Center, Trajectoires team, University of Lyon I Claude-Bernard, Bron, France.,
| | | | - Romain Fournet
- School of Optometry, University of Montreal, Montreal, Canada.,
| | - Laure Pisella
- Lyon Neuroscience Research Center, Trajectoires team, University of Lyon I Claude-Bernard, Bron, France.,
| | | |
Collapse
|
19
|
Allocation of Visuospatial Attention Indexes Evidence Accumulation for Reach Decisions. eNeuro 2022; 9:ENEURO.0313-22.2022. [PMID: 36302633 PMCID: PMC9651207 DOI: 10.1523/eneuro.0313-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 09/19/2022] [Accepted: 09/22/2022] [Indexed: 12/24/2022] Open
Abstract
Visuospatial attention is a prerequisite for the performance of visually guided movements: perceptual discrimination is regularly enhanced at target locations before movement initiation. It is known that this attentional prioritization evolves over the time of movement preparation; however, it is not clear whether this build-up simply reflects a time requirement of attention formation or whether, instead, attention build-up reflects the emergence of the movement decision. To address this question, we combined behavioral experiments, psychophysics, and computational decision-making models to characterize the time course of attention build-up during motor preparation. Participants (n = 46, 29 female) executed center-out reaches to one of two potential target locations and reported the identity of a visual discrimination target (DT) that occurred concurrently at one of various time-points during movement preparation and execution. Visual discrimination increased simultaneously at the two potential target locations but was modulated by the experiment-wide probability that a given location would become the final goal. Attention increased further for the location that was then designated as the final goal location, with a time course closely related to movement initiation. A sequential sampling model of decision-making faithfully predicted key temporal characteristics of attentional allocation. Together, these findings provide evidence that visuospatial attentional prioritization during motor preparation does not simply reflect that a spatial location has been selected as movement goal, but rather indexes the time-extended, cumulative decision that leads to the selection, hence constituting a link between perceptual and motor aspects of sensorimotor decisions.
Collapse
|
20
|
Hanning NM, Deubel H. The effect of spatial structure on presaccadic attention costs and benefits assessed with dynamic 1/f noise. J Neurophysiol 2022; 127:1586-1592. [PMID: 35544761 DOI: 10.1152/jn.00084.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 05/05/2022] [Accepted: 05/09/2022] [Indexed: 11/22/2022] Open
Abstract
Already before the onset of a saccadic eye movement, we preferentially process visual information at the upcoming eye fixation. This 'presaccadic shift of attention' is typically assessed via localized test items, which potentially bias the attention measurement. Here we show how presaccadic attention shapes perception from saccade origin to target when no scene-structuring items are presented. Participants made saccades into a 1/f ('pink') noise field, in which we embedded a brief orientation signal at various locations shortly before saccade onset. Local orientation discrimination performance served as a proxy for the allocation of attention. Results demonstrate that (1) the presaccadic attention shift is accompanied by considerable attentional costs at the presaccadic eye fixation; (2) saccades are preceded by shifts of attention to their goal location even if they are directed into an unstructured visual field, but the spread of attention, compared to target-directed saccades, is broad; We conclude that the absence or presence of saccade target objects markedly shapes the distribution of presaccadic attention, and likely the underlying (space-based or object-based) cortical control mechanism. Our findings demonstrate the relevance of an item-free approach for measuring attentional dynamics across the visual field.
Collapse
Affiliation(s)
- Nina M Hanning
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department of Psychology and Center for Neural Science, New York University, New York, NY, United States
- Institut für Psychologie, Humboldt Universität zu Berlin, Berlin, Germany
| | - Heiner Deubel
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| |
Collapse
|
21
|
Yu G, Herman JP, Katz LN, Krauzlis RJ. Microsaccades as a marker not a cause for attention-related modulation. eLife 2022; 11:74168. [PMID: 35289268 PMCID: PMC8923660 DOI: 10.7554/elife.74168] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 01/26/2022] [Indexed: 11/13/2022] Open
Abstract
Recent evidence suggests that microsaccades are causally linked to the attention-related modulation of neurons—specifically, that microsaccades toward the attended location are required for the subsequent changes in firing rate. These findings have raised questions about whether attention-related modulation is due to different states of attention as traditionally assumed or might instead be a secondary effect of microsaccades. Here, in two rhesus macaques, we tested the relationship between microsaccades and attention-related modulation in the superior colliculus (SC), a brain structure crucial for allocating attention. We found that attention-related modulation emerged even in the absence of microsaccades, was already present prior to microsaccades toward the cued stimulus, and persisted through the suppression of activity that accompanied all microsaccades. Nonetheless, consistent with previous findings, we also found significant attention-related modulation when microsaccades were directed toward, rather than away from, the cued location. Thus, despite the clear links between microsaccades and attention, microsaccades are not necessary for attention-related modulation, at least not in the SC. They do, however, provide an additional marker for the state of attention, especially at times when attention is shifting from one location to another.
Collapse
Affiliation(s)
- Gongchen Yu
- Laboratory of Sensorimotor Research, National Eye Institute
| | - James P Herman
- Department of Ophthalmology, University of Pittsburgh School of Medicine
| | - Leor N Katz
- Laboratory of Sensorimotor Research, National Eye Institute
| | | |
Collapse
|
22
|
Hanning NM, Himmelberg MM, Carrasco M. Presaccadic attention enhances contrast sensitivity, but not at the upper vertical meridian. iScience 2022; 25:103851. [PMID: 35198902 PMCID: PMC8850791 DOI: 10.1016/j.isci.2022.103851] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 11/29/2021] [Accepted: 01/25/2022] [Indexed: 11/25/2022] Open
Abstract
Visual performance has striking polar performance asymmetries: At a fixed eccentricity, it is better along the horizontal than vertical meridian and the lower than upper vertical meridian. These asymmetries are not alleviated by covert exogenous or endogenous attention, but have been studied exclusively during eye fixation. However, a major driver of everyday attentional orienting is saccade preparation, during which attention automatically shifts to the future eye fixation. This presaccadic attention shift is considered strong and compulsory, and relies on different neural computations and substrates than covert attention. Thus, we asked: Can presaccadic attention compensate for the ubiquitous performance asymmetries observed during eye fixation? Our data replicate polar performance asymmetries during fixation and document the same asymmetries during saccade preparation. Crucially, however, presaccadic attention enhanced contrast sensitivity at the horizontal and lower vertical meridian, but not at the upper vertical meridian. Thus, instead of attenuating performance asymmetries, presaccadic attention exacerbates them. Can presaccadic attention attenuate polar angle asymmetries in visual perception Presaccadic attention enhances sensitivity at horizontal and lower vertical meridians But presaccadic attention does not enhance sensitivity at the upper vertical meridian Thus, presaccadic attention even exacerbates polar angle asymmetries in perception
Collapse
Affiliation(s)
- Nina M Hanning
- Department of Psychology, New York University, New York, NY 10003, USA.,Center for Neural Sciences, New York University, New York, NY 10003, USA
| | - Marc M Himmelberg
- Department of Psychology, New York University, New York, NY 10003, USA.,Center for Neural Sciences, New York University, New York, NY 10003, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY 10003, USA.,Center for Neural Sciences, New York University, New York, NY 10003, USA
| |
Collapse
|
23
|
Diana L, Scotti G, Aiello EN, Pilastro P, Eberhard-Moscicka AK, Müri RM, Bolognini N. Conventional and HD-tDCS May (or May Not) Modulate Overt Attentional Orienting: An Integrated Spatio-Temporal Approach and Methodological Reflections. Brain Sci 2021; 12:brainsci12010071. [PMID: 35053814 PMCID: PMC8773815 DOI: 10.3390/brainsci12010071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 12/29/2021] [Accepted: 12/30/2021] [Indexed: 11/16/2022] Open
Abstract
Transcranial Direct Current Stimulation (tDCS) has been employed to modulate visuo-spatial attentional asymmetries, however, further investigation is needed to characterize tDCS-associated variability in more ecological settings. In the present research, we tested the effects of offline, anodal conventional tDCS (Experiment 1) and HD-tDCS (Experiment 2) delivered over the posterior parietal cortex (PPC) and Frontal Eye Field (FEF) of the right hemisphere in healthy participants. Attentional asymmetries were measured by means of an eye tracking-based, ecological paradigm, that is, a Free Visual Exploration task of naturalistic pictures. Data were analyzed from a spatiotemporal perspective. In Experiment 1, a pre-post linear mixed model (LMM) indicated a leftward attentional shift after PPC tDCS; this effect was not confirmed when the individual baseline performance was considered. In Experiment 2, FEF HD-tDCS was shown to induce a significant leftward shift of gaze position, which emerged after 6 s of picture exploration and lasted for 200 ms. The present results do not allow us to conclude on a clear efficacy of offline conventional tDCS and HD-tDCS in modulating overt visuospatial attention in an ecological setting. Nonetheless, our findings highlight a complex relationship among stimulated area, focality of stimulation, spatiotemporal aspects of deployment of attention, and the role of individual baseline performance in shaping the effects of tDCS.
Collapse
Affiliation(s)
- Lorenzo Diana
- Ph.D. Program in Neuroscience, School of Medicine and Surgery, University of Milano-Bicocca, 20900 Monza, Italy;
- Correspondence:
| | - Giulia Scotti
- Department of Psychology, University of Milano-Bicocca, 20126 Milan, Italy; (G.S.); (P.P.)
| | - Edoardo N. Aiello
- Ph.D. Program in Neuroscience, School of Medicine and Surgery, University of Milano-Bicocca, 20900 Monza, Italy;
| | - Patrick Pilastro
- Department of Psychology, University of Milano-Bicocca, 20126 Milan, Italy; (G.S.); (P.P.)
| | - Aleksandra K. Eberhard-Moscicka
- Perception and Eye Movement Laboratory, Departments of Neurology and BioMedical Research, Bern University Hospital Inselspital, University of Bern, 3010 Bern, Switzerland; (A.K.E.-M.); (R.M.M.)
- Department of Neurology, Bern University Hospital Inselspital, University of Bern, 3010 Bern, Switzerland
| | - René M. Müri
- Perception and Eye Movement Laboratory, Departments of Neurology and BioMedical Research, Bern University Hospital Inselspital, University of Bern, 3010 Bern, Switzerland; (A.K.E.-M.); (R.M.M.)
- Department of Neurology, Bern University Hospital Inselspital, University of Bern, 3010 Bern, Switzerland
| | - Nadia Bolognini
- Department of Psychology & Milan Center for Neuroscience (NeuroMI), University of Milano-Bicocca, 20126 Milan, Italy;
- Laboratory of Neuropsychology, Istituto Auxologico Italiano, IRCCS, 20122 Milan, Italy
| |
Collapse
|