1
|
Gupta P, Sridharan D. Presaccadic attention does not facilitate the detection of changes in the visual field. PLoS Biol 2024; 22:e3002485. [PMID: 38271460 PMCID: PMC10810526 DOI: 10.1371/journal.pbio.3002485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 01/02/2024] [Indexed: 01/27/2024] Open
Abstract
Planning a rapid eye movement (saccade) changes how we perceive our visual world. Even before we move the eyes visual discrimination sensitivity improves at the impending target of eye movements, a phenomenon termed "presaccadic attention." Yet, it is unknown if such presaccadic selection merely affects perceptual sensitivity, or also affects downstream decisional processes, such as choice bias. We report a surprising lack of presaccadic perceptual benefits in a common, everyday setting-detection of changes in the visual field. Despite the lack of sensitivity benefits, choice bias for reporting changes increased reliably for the saccade target. With independent follow-up experiments, we show that presaccadic change detection is rendered more challenging because percepts at the saccade target location are biased toward, and more precise for, only the most recent of two successive stimuli. With a Bayesian model, we show how such perceptual and choice biases are crucial to explain the effects of saccade plans on change detection performance. In sum, visual change detection sensitivity does not improve presaccadically, a result that is readily explained by teasing apart distinct components of presaccadic selection. The findings may have critical implications for real-world scenarios, like driving, that require rapid gaze shifts in dynamically changing environments.
Collapse
Affiliation(s)
- Priyanka Gupta
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | | |
Collapse
|
2
|
The dynamics of microsaccade amplitude reflect shifting of covert attention. Conscious Cogn 2022; 101:103322. [PMID: 35395549 DOI: 10.1016/j.concog.2022.103322] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Revised: 03/27/2022] [Accepted: 03/30/2022] [Indexed: 11/24/2022]
Abstract
Attention flexibly shifts between spatial locations to accommodate task demands. The present study examined if the dynamics of attentional shifting are seen in microsaccades whose direction has been shown to accompany the shifts of covert attention. In a spatial cueing task, the cue predicted the target location on 100%, 75%, or 50% of the trials. The results revealed that microsaccade rate and amplitude were both reduced following cue onset and then rebounded. Both microsaccade rate and amplitude were biased towards the opposite direction of the cue and then returned to the cued direction. Importantly, the cue validity modulated the temporal profile of microsaccade amplitude but had little impact on the temporal profile of microsaccade rate. In line with this, the cueing effect measured with target response accuracy was correlated with the microsaccade amplitude only. These results indicate that the temporal dynamics of microsaccade amplitude reflect shifting of covert attention.
Collapse
|
3
|
Wilmott JP, Michel MM. Transsaccadic integration of visual information is predictive, attention-based, and spatially precise. J Vis 2021; 21:14. [PMID: 34374744 PMCID: PMC8366295 DOI: 10.1167/jov.21.8.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2020] [Accepted: 03/23/2021] [Indexed: 11/29/2022] Open
Abstract
Eye movements produce shifts in the positions of objects in the retinal image, but observers are able to integrate these shifting retinal images into a coherent representation of visual space. This ability is thought to be mediated by attention-dependent saccade-related neural activity that is used by the visual system to anticipate the retinal consequences of impending eye movements. Previous investigations of the perceptual consequences of this predictive activity typically infer attentional allocation using indirect measures such as accuracy or reaction time. Here, we investigated the perceptual consequences of saccades using an objective measure of attentional allocation, reverse correlation. Human observers executed a saccade while monitoring a flickering target object flanked by flickering distractors and reported whether the average luminance of the target was lighter or darker than the background. Successful task performance required subjects to integrate visual information across the saccade. A reverse correlation analysis yielded a spatiotemporal "psychophysical kernel" characterizing how different parts of the stimulus contributed to the luminance decision throughout each trial. Just before the saccade, observers integrated luminance information from a distractor located at the post-saccadic retinal position of the target, indicating a predictive perceptual updating of the target. Observers did not integrate information from distractors placed in alternative locations, even when they were nearer to the target object. We also observed simultaneous predictive perceptual updating for two spatially distinct targets. These findings suggest both that shifting neural representations mediate the coherent representation of visual space, and that these shifts have significant consequences for transsaccadic perception.
Collapse
Affiliation(s)
- James P Wilmott
- Department of Cognitive, Linguistic, & Psychological Sciences, Brown University, Providence, RI, USA
| | - Melchi M Michel
- Department of Psychology and Center for Cognitive Science (RuCCS), Rutgers University, Piscataway, NJ, USA
- https://mmmlab.org/
| |
Collapse
|
4
|
Bansal S, Joiner WM. Transsaccadic visual perception of foveal compared to peripheral environmental changes. J Vis 2021; 21:12. [PMID: 34160578 PMCID: PMC8237106 DOI: 10.1167/jov.21.6.12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The maintenance of stable visual perception across eye movements is hypothesized to be aided by extraretinal information (e.g., corollary discharge [CD]). Previous studies have focused on the benefits of this information for perception at the fovea. However, there is little information on the extent that CD benefits peripheral visual perception. Here we systematically examined the extent that CD supports the ability to perceive transsaccadic changes at the fovea compared to peripheral changes. Human subjects made saccades to targets positioned at different amplitudes (4° or 8°) and directions (rightward or upward). On each trial there was a reference point located either at (fovea) or 4° away (periphery) from the target. During the saccade the target and reference disappeared and, after a blank period, the reference reappeared at a shifted location. Subjects reported the perceived shift direction, and we determined the perceptual threshold for detection and estimate of the reference location. We also simulated the detection and location if subjects solely relied on the visual error of the shifted reference experienced after the saccade. The comparison of the reference location under these two conditions showed that overall the perceptual estimate was approximately 53% more accurate and 30% less variable than estimates based solely on visual information at the fovea. These values for peripheral shifts were consistently lower than that at the fovea: 34% more accurate and 9% less variable. Overall, the results suggest that CD information does support stable visual perception in the periphery, but is consistently less beneficial compared to the fovea.
Collapse
Affiliation(s)
- Sonia Bansal
- Department of Neuroscience, George Mason University, Fairfax, VA, USA.,Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD, USA.,
| | - Wilsaan M Joiner
- Department of Bioengineering, George Mason University, Fairfax, VA, USA.,Department of Neurobiology, Physiology and Behavior, University of California Davis, Davis, CA, USA.,Department of Neurology, University of California Davis, Davis, CA, USA.,
| |
Collapse
|
5
|
Schwenk JCB, Klingenhoefer S, Werner BO, Dowiasch S, Bremmer F. Perisaccadic encoding of temporal information in macaque area V4. J Neurophysiol 2021; 125:785-795. [PMID: 33502931 DOI: 10.1152/jn.00387.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The accurate processing of temporal information is of critical importance in everyday life. Yet, psychophysical studies in humans have shown that the perception of time is distorted around saccadic eye movements. The neural correlates of this misperception are still poorly understood. Behavioral and neural evidence suggest that it is tightly linked to other known perisaccadic modulations of visual perception. To further our understanding of how temporal processing is affected by saccades, we studied the representations of brief visual time intervals during fixation and saccades in area V4 of two awake macaques. We presented random sequences of vertical bar stimuli and extracted neural responses to double-pulse stimulation at varying interstimulus intervals. Our results show that temporal information about very brief intervals of as brief as 20 ms is reliably represented in the multiunit activity in area V4. Response latencies were not systematically modulated by the saccade. However, a general increase in perisaccadic activity altered the ratio of response amplitudes within stimulus pairs compared with fixation. In line with previous studies showing that the perception of brief time intervals is partly based on response levels, this may be seen as a possible correlate of the perisaccadic misperception of time.NEW & NOTEWORTHY We investigated for the first time how temporal information on very brief timescales is represented in area V4 around the time of saccadic eye movements. Overall, the responses showed an unexpectedly precise representation of time intervals. Our finding of a perisaccadic modulation of relative response amplitudes introduces a new possible correlate of saccade-related perceptual distortions of time.
Collapse
Affiliation(s)
- Jakob C B Schwenk
- Department of Neurophysics, Philipps-Universität Marburg, Marburg, Germany.,Center for Mind, Brain and Behavior (CMBB), Philipps-Universität Marburg and Justus-Liebig-University Giessen, Germany
| | | | - Björn-Olaf Werner
- Department of Neurophysics, Philipps-Universität Marburg, Marburg, Germany
| | - Stefan Dowiasch
- Department of Neurophysics, Philipps-Universität Marburg, Marburg, Germany.,Center for Mind, Brain and Behavior (CMBB), Philipps-Universität Marburg and Justus-Liebig-University Giessen, Germany
| | - Frank Bremmer
- Department of Neurophysics, Philipps-Universität Marburg, Marburg, Germany
| |
Collapse
|
6
|
Neupane S, Guitton D, Pack CC. Perisaccadic remapping: What? How? Why? Rev Neurosci 2020; 31:505-520. [PMID: 32242834 DOI: 10.1515/revneuro-2019-0097] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2019] [Accepted: 12/31/2019] [Indexed: 11/15/2022]
Abstract
About 25 years ago, the discovery of receptive field (RF) remapping in the parietal cortex of nonhuman primates revealed that visual RFs, widely assumed to have a fixed retinotopic organization, can change position before every saccade. Measuring such changes can be deceptively difficult. As a result, studies that followed have generated a fascinating but somewhat confusing picture of the phenomenon. In this review, we describe how observations of RF remapping depend on the spatial and temporal sampling of visual RFs and saccade directions. Further, we summarize some of the theories of how remapping might occur in neural circuitry. Finally, based on neurophysiological and psychophysical observations, we discuss the ways in which remapping information might facilitate computations in downstream brain areas.
Collapse
Affiliation(s)
- Sujaya Neupane
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Daniel Guitton
- Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec H3A2B4, Canada
| | - Christopher C Pack
- Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec H3A2B4, Canada
| |
Collapse
|
7
|
Watson TL, Lappe M. Fixation related shifts of perceptual localization counter to saccade direction. J Vis 2019; 19:18. [PMID: 31755903 DOI: 10.1167/19.13.18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Perisaccadic compression of the perceived location of flashed visual stimuli toward a saccade target occurs from about 50 ms before a saccade. Here we show that between 150 and 80 ms before a saccade, perceived locations are shifted toward the fixation point. To establish the cause of the "reverse" presaccadic perceptual distortion, participants completed several versions of a saccade task. After a cue to saccade, a probe bar stimulus was briefly presented within the saccade trajectory. In Experiment 1 participants made (a) overlap saccades with immediate return saccades, (b) overlap saccades, and (c) step saccades. In Experiment 2 participants made gap saccades in complete darkness. In Experiment 3 participants maintained fixation with the probe stimuli masked at various interstimulus intervals. Participants indicated the bar's location using a mouse cursor. In all conditions in Experiment 1 presaccadic compression was preceded by compression toward the initial fixation. In Experiment 2, saccadic compression was maintained but the preceding countercompression was not observed. Stimuli masked at fixation were not compressed. This suggests the two opposing compression effects are related to the act of executing an eye movement. They are also not caused by the requirement to make two sequential saccades ending at the initial fixation location and are not caused by continuous presence of the fixation markers. We propose that countercompression is related to fixation activity and is part of the sequence of motor preparations to execute a cued saccade.
Collapse
Affiliation(s)
- Tamara L Watson
- School of Social Sciences and Psychology, Western Sydney University, NSW, Australia
| | - Markus Lappe
- Institute for Psychology and Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Germany
| |
Collapse
|
8
|
Characterizing and dissociating multiple time-varying modulatory computations influencing neuronal activity. PLoS Comput Biol 2019; 15:e1007275. [PMID: 31513570 PMCID: PMC6759185 DOI: 10.1371/journal.pcbi.1007275] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Revised: 09/24/2019] [Accepted: 07/18/2019] [Indexed: 11/19/2022] Open
Abstract
In many brain areas, sensory responses are heavily modulated by factors including attentional state, context, reward history, motor preparation, learned associations, and other cognitive variables. Modelling the effect of these modulatory factors on sensory responses has proven challenging, mostly due to the time-varying and nonlinear nature of the underlying computations. Here we present a computational model capable of capturing and dissociating multiple time-varying modulatory effects on neuronal responses on the order of milliseconds. The model’s performance is tested on extrastriate perisaccadic visual responses in nonhuman primates. Visual neurons respond to stimuli presented around the time of saccades differently than during fixation. These perisaccadic changes include sensitivity to the stimuli presented at locations outside the neuron’s receptive field, which suggests a contribution of multiple sources to perisaccadic response generation. Current computational approaches cannot quantitatively characterize the contribution of each modulatory source in response generation, mainly due to the very short timescale on which the saccade takes place. In this study, we use a high spatiotemporal resolution experimental paradigm along with a novel extension of the generalized linear model framework (GLM), termed the sparse-variable GLM, to allow for time-varying model parameters representing the temporal evolution of the system with a resolution on the order of milliseconds. We used this model framework to precisely map the temporal evolution of the spatiotemporal receptive field of visual neurons in the middle temporal area during the execution of a saccade. Moreover, an extended model based on a factorization of the sparse-variable GLM allowed us to disassociate and quantify the contribution of individual sources to the perisaccadic response. Our results show that our novel framework can precisely capture the changes in sensitivity of neurons around the time of saccades, and provide a general framework to quantitatively track the role of multiple modulatory sources over time. The sensory responses of neurons in many brain areas, particularly those in higher prefrontal or parietal areas, are strongly influenced by factors including task rules, attentional state, context, reward history, motor preparation, learned associations, and other cognitive variables. These modulations often occur in combination, or on fast timescales which present a challenge for both experimental and modelling approaches aiming to describe the underlying mechanisms or computations. Here we present a computational model capable of capturing and dissociating multiple time-varying modulatory effects on spiking responses on the order of milliseconds. The model’s performance is evaluated by testing its ability to reproduce and dissociate multiple changes in visual sensitivity occurring in extrastriate visual cortex around the time of rapid eye movements. No previous model is capable of capturing these changes with as fine a resolution as that presented here. Our model both provides specific insight into the nature and time course of changes in visual sensitivity around the time of eye movements, and offers a general framework applicable to a wide variety of contexts in which sensory processing is modulated dynamically by multiple time-varying cognitive or behavioral factors, to understand the neuronal computations underpinning these modulations and make predictions about the underlying mechanisms.
Collapse
|
9
|
Grujic N, Brehm N, Gloge C, Zhuo W, Hafed ZM. Perisaccadic perceptual mislocalization is different for upward saccades. J Neurophysiol 2018; 120:3198-3216. [PMID: 30332326 DOI: 10.1152/jn.00350.2018] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Saccadic eye movements, which dramatically alter retinal images, are associated with robust perimovement perceptual alterations. Such alterations, thought to reflect brain mechanisms for maintaining perceptual stability in the face of saccade-induced retinal image disruptions, are often studied by asking subjects to localize brief stimuli presented around the time of horizontal saccades. However, other saccade directions are not usually explored. Motivated by recently discovered asymmetries in upper and lower visual field representations in the superior colliculus, a structure important for both saccade generation and visual analysis, we observed significant differences in perisaccadic perceptual alterations for upward saccades relative to other saccade directions. We also found that, even for purely horizontal saccades, perceptual alterations differ for upper vs. lower retinotopic stimulus locations. Our results, coupled with conceptual modeling, suggest that perisaccadic perceptual alterations might critically depend on neural circuits, such as superior colliculus, that asymmetrically represent the upper and lower visual fields. NEW & NOTEWORTHY Brief visual stimuli are robustly mislocalized around the time of saccades. Such mislocalization is thought to arise because oculomotor and visual neural maps distort space through foveal magnification. However, other neural asymmetries, such as upper visual field magnification in the superior colliculus, may also exist, raising the possibility that interactions between saccades and visual stimuli would depend on saccade direction. We confirmed this behaviorally by exploring and characterizing perisaccadic perception for upward saccades.
Collapse
Affiliation(s)
- Nikola Grujic
- Graduate School of Neural and Behavioural Sciences, International Max Planck Research School, Tübingen University , Tübingen , Germany
| | - Nils Brehm
- Master's Program for Neurobiology, Tübingen University , Tübingen , Germany
| | - Cordula Gloge
- Master's Program for Neurobiology, Tübingen University , Tübingen , Germany
| | - Weijie Zhuo
- Master's Program for Neurobiology, Tübingen University , Tübingen , Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University , Tübingen , Germany.,Hertie Institute for Clinical Brain Research, Tübingen University , Tübingen , Germany
| |
Collapse
|
10
|
Magosso E, Cuppini C, Bertini C. Audiovisual Rehabilitation in Hemianopia: A Model-Based Theoretical Investigation. Front Comput Neurosci 2018; 11:113. [PMID: 29326578 PMCID: PMC5736575 DOI: 10.3389/fncom.2017.00113] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2017] [Accepted: 12/04/2017] [Indexed: 12/12/2022] Open
Abstract
Hemianopic patients exhibit visual detection improvement in the blind field when audiovisual stimuli are given in spatiotemporally coincidence. Beyond this “online” multisensory improvement, there is evidence of long-lasting, “offline” effects induced by audiovisual training: patients show improved visual detection and orientation after they were trained to detect and saccade toward visual targets given in spatiotemporal proximity with auditory stimuli. These effects are ascribed to the Superior Colliculus (SC), which is spared in these patients and plays a pivotal role in audiovisual integration and oculomotor behavior. Recently, we developed a neural network model of audiovisual cortico-collicular loops, including interconnected areas representing the retina, striate and extrastriate visual cortices, auditory cortex, and SC. The network simulated unilateral V1 lesion with possible spared tissue and reproduced “online” effects. Here, we extend the previous network to shed light on circuits, plastic mechanisms, and synaptic reorganization that can mediate the training effects and functionally implement visual rehabilitation. The network is enriched by the oculomotor SC-brainstem route, and Hebbian mechanisms of synaptic plasticity, and is used to test different training paradigms (audiovisual/visual stimulation in eye-movements/fixed-eyes condition) on simulated patients. Results predict different training effects and associate them to synaptic changes in specific circuits. Thanks to the SC multisensory enhancement, the audiovisual training is able to effectively strengthen the retina-SC route, which in turn can foster reinforcement of the SC-brainstem route (this occurs only in eye-movements condition) and reinforcement of the SC-extrastriate route (this occurs in presence of survived V1 tissue, regardless of eye condition). The retina-SC-brainstem circuit may mediate compensatory effects: the model assumes that reinforcement of this circuit can translate visual stimuli into short-latency saccades, possibly moving the stimuli into visual detection regions. The retina-SC-extrastriate circuit is related to restitutive effects: visual stimuli can directly elicit visual detection with no need for eye movements. Model predictions and assumptions are critically discussed in view of existing behavioral and neurophysiological data, forecasting that other oculomotor compensatory mechanisms, beyond short-latency saccades, are likely involved, and stimulating future experimental and theoretical investigations.
Collapse
Affiliation(s)
- Elisa Magosso
- Department of Electrical, Electronic, and Information Engineering "Guglielmo Marconi", University of Bologna, Cesena, Italy
| | - Cristiano Cuppini
- Department of Electrical, Electronic, and Information Engineering "Guglielmo Marconi", University of Bologna, Cesena, Italy
| | - Caterina Bertini
- Centre for Studies and Research in Cognitive Neuroscience, University of Bologna, Cesena, Italy.,Department of Psychology, University of Bologna, Italy
| |
Collapse
|
11
|
Neupane S, Guitton D, Pack CC. Dissociation of forward and convergent remapping in primate visual cortex. Curr Biol 2017; 26:R491-R492. [PMID: 27326707 DOI: 10.1016/j.cub.2016.04.050] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
A fundamental concept in neuroscience is the receptive field, the area of space over which a neuron gathers information. Until about 25 years ago, visual receptive fields were thought to be determined entirely by the pattern of retinal inputs, so it was quite surprising to find neurons in primate cortex with receptive fields that changed position every time a saccade was executed [1]. Although this discovery has figured prominently into theories of visual perception, there is still much debate about the nature of the phenomenon: Some studies report forward remapping[1-3], in which receptive fields shift to their postsaccadic locations, and others report convergent remapping, in which receptive fields shift toward the saccade target [4]. These two possibilities can be difficult to distinguish, particularly when the two types of remapping lead to receptive field shifts in similar directions [5], as was the case in virtually all previous experiments. Here we report new data from neurons in primate cortical area V4, where both types of remapping have previously been reported [3,6]. Using an experimental configuration in which forward and convergent remapping would lead to receptive field shifts in opposite directions, we show that forward remapping is the dominant type of receptive field shift in V4.
Collapse
Affiliation(s)
- Sujaya Neupane
- Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Quebec, Canada.
| | - Daniel Guitton
- Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Quebec, Canada
| | - Christopher C Pack
- Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Quebec, Canada
| |
Collapse
|
12
|
Hartmann TS, Zirnsak M, Marquis M, Hamker FH, Moore T. Two Types of Receptive Field Dynamics in Area V4 at the Time of Eye Movements? Front Syst Neurosci 2017; 11:13. [PMID: 28377700 PMCID: PMC5359274 DOI: 10.3389/fnsys.2017.00013] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2017] [Accepted: 03/01/2017] [Indexed: 11/13/2022] Open
Abstract
How we perceive the world as stable despite the frequent disruptions of the retinal image caused by eye movements is one of the fundamental questions in sensory neuroscience. Seemingly convergent evidence points towards a mechanism which dynamically updates representations of visual space in anticipation of a movement (Wurtz, 2008). In particular, receptive fields (RFs) of neurons, predominantly within oculomotor and attention related brain structures (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 1997), are thought to "remap" to their future, post-movement location prior to an impending eye movement. New studies (Neupane et al., 2016a,b) report observations on RF dynamics at the time of eye movements of neurons in area V4. These dynamics are interpreted as being largely dominated by a remapping of RFs. Critically, these observations appear at odds with a previous study reporting a different type of RF dynamics within the same brain structure (Tolias et al., 2001), consisting of a shrinkage and shift of RFs towards the movement target. Importantly, RFs have been measured with different techniques in those studies. Here, we measured V4 RFs comparable to Neupane et al. (2016a,b) and observe a shrinkage and shift of RFs towards the movement target when analyzing the immediate stimulus response (Zirnsak et al., 2014). When analyzing the late stimulus response (Neupane et al., 2016a,b), we observe RF shifts resembling remapping. We discuss possible causes for these shifts and point out important issues which future studies on RF dynamics need to address.
Collapse
Affiliation(s)
- Till S Hartmann
- Department of Neurobiology, Harvard Medical School Boston, MA, USA
| | - Marc Zirnsak
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University School of Medicine Stanford, CA, USA
| | - Michael Marquis
- Department of Neurobiology, Harvard Medical School Boston, MA, USA
| | - Fred H Hamker
- Department of Computer Science, Chemnitz University of Technology Chemnitz, Germany
| | - Tirin Moore
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University School of Medicine Stanford, CA, USA
| |
Collapse
|
13
|
Abstract
Selective visual attention describes the tendency of visual processing to be confined largely to stimuli that are relevant to behavior. It is among the most fundamental of cognitive functions, particularly in humans and other primates for whom vision is the dominant sense. We review recent progress in identifying the neural mechanisms of selective visual attention. We discuss evidence from studies of different varieties of selective attention and examine how these varieties alter the processing of stimuli by neurons within the visual system, current knowledge of their causal basis, and methods for assessing attentional dysfunctions. In addition, we identify some key questions that remain in identifying the neural mechanisms that give rise to the selective processing of visual information.
Collapse
Affiliation(s)
- Tirin Moore
- Department of Neurobiology, Stanford University School of Medicine, Stanford, California 94305; , .,Howard Hughes Medical Institute, Stanford, California 94305
| | - Marc Zirnsak
- Department of Neurobiology, Stanford University School of Medicine, Stanford, California 94305; , .,Howard Hughes Medical Institute, Stanford, California 94305
| |
Collapse
|
14
|
Rao HM, Mayo JP, Sommer MA. Circuits for presaccadic visual remapping. J Neurophysiol 2016; 116:2624-2636. [PMID: 27655962 DOI: 10.1152/jn.00182.2016] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2016] [Accepted: 09/14/2016] [Indexed: 01/08/2023] Open
Abstract
Saccadic eye movements rapidly displace the image of the world that is projected onto the retinas. In anticipation of each saccade, many neurons in the visual system shift their receptive fields. This presaccadic change in visual sensitivity, known as remapping, was first documented in the parietal cortex and has been studied in many other brain regions. Remapping requires information about upcoming saccades via corollary discharge. Analyses of neurons in a corollary discharge pathway that targets the frontal eye field (FEF) suggest that remapping may be assembled in the FEF's local microcircuitry. Complementary data from reversible inactivation, neural recording, and modeling studies provide evidence that remapping contributes to transsaccadic continuity of action and perception. Multiple forms of remapping have been reported in the FEF and other brain areas, however, and questions remain about the reasons for these differences. In this review of recent progress, we identify three hypotheses that may help to guide further investigations into the structure and function of circuits for remapping.
Collapse
Affiliation(s)
- Hrishikesh M Rao
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, North Carolina;
| | - J Patrick Mayo
- Department of Neurobiology, Duke School of Medicine, Duke University, Durham, North Carolina; and
| | - Marc A Sommer
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, North Carolina.,Department of Neurobiology, Duke School of Medicine, Duke University, Durham, North Carolina; and.,Center for Cognitive Neuroscience, Duke University, Durham, North Carolina
| |
Collapse
|
15
|
Hafed ZM, Chen CY, Tian X. Vision, Perception, and Attention through the Lens of Microsaccades: Mechanisms and Implications. Front Syst Neurosci 2015; 9:167. [PMID: 26696842 PMCID: PMC4667031 DOI: 10.3389/fnsys.2015.00167] [Citation(s) in RCA: 70] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2015] [Accepted: 11/17/2015] [Indexed: 11/13/2022] Open
Abstract
Microsaccades are small saccades. Neurophysiologically, microsaccades are generated using similar brainstem mechanisms as larger saccades. This suggests that peri-saccadic changes in vision that accompany large saccades might also be expected to accompany microsaccades. In this review, we highlight recent evidence demonstrating this. Microsaccades are not only associated with suppressed visual sensitivity and perception, as in the phenomenon of saccadic suppression, but they are also associated with distorted spatial representations, as in the phenomenon of saccadic compression, and pre-movement response gain enhancement, as in the phenomenon of pre-saccadic attention. Surprisingly, the impacts of peri-microsaccadic changes in vision are far reaching, both in time relative to movement onset as well as spatial extent relative to movement size. Periods of ~100 ms before and ~100 ms after microsaccades exhibit significant changes in neuronal activity and behavior, and this happens at eccentricities much larger than the eccentricities targeted by the microsaccades themselves. Because microsaccades occur during experiments enforcing fixation, these effects create a need to consider the impacts of microsaccades when interpreting a variety of experiments on vision, perception, and cognition using awake, behaving subjects. The clearest example of this idea to date has been on the links between microsaccades and covert visual attention. Recent results have demonstrated that peri-microsaccadic changes in vision play a significant role in both neuronal and behavioral signatures of covert visual attention, so much so that in at least some attentional cueing paradigms, there is very tight synchrony between microsaccades and the emergence of attentional effects. Just like large saccades, microsaccades are genuine motor outputs, and their impacts can be substantial even during perceptual and cognitive experiments not concerned with overt motor generation per se.
Collapse
Affiliation(s)
- Ziad M Hafed
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, University of Tuebingen Tuebingen, Germany
| | - Chih-Yang Chen
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, University of Tuebingen Tuebingen, Germany ; Graduate School of Neural and Behavioural Sciences, International Max-Planck Research School, University of Tuebingen Tuebingen, Germany
| | - Xiaoguang Tian
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, University of Tuebingen Tuebingen, Germany ; Graduate School of Neural and Behavioural Sciences, International Max-Planck Research School, University of Tuebingen Tuebingen, Germany
| |
Collapse
|
16
|
Chen CY, Ignashchenkova A, Thier P, Hafed Z. Neuronal Response Gain Enhancement prior to Microsaccades. Curr Biol 2015; 25:2065-74. [DOI: 10.1016/j.cub.2015.06.022] [Citation(s) in RCA: 62] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2015] [Revised: 06/01/2015] [Accepted: 06/09/2015] [Indexed: 10/23/2022]
|
17
|
Zirnsak M, Moore T. Saccades and shifting receptive fields: anticipating consequences or selecting targets? Trends Cogn Sci 2014; 18:621-8. [PMID: 25455690 DOI: 10.1016/j.tics.2014.10.002] [Citation(s) in RCA: 63] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2014] [Revised: 10/06/2014] [Accepted: 10/07/2014] [Indexed: 11/28/2022]
Abstract
Saccadic eye movements cause frequent and substantial displacements of the retinal image, but those displacements go unnoticed. It has been widely assumed that this perceived stability emerges from the shifting of visual receptive fields from their current, presaccadic locations to their future, postsaccadic locations in anticipation of the retinal consequences of saccades. Although evidence consistent with this anticipatory remapping has accumulated over the years, more recent work suggests an alternative view. In this opinion article, we examine the evidence of presaccadic receptive field shifts and their relationship to the perceptual changes that accompany saccades. We argue that both reflect the selection of targets for saccades rather than the anticipation of a displaced retinal image.
Collapse
Affiliation(s)
- Marc Zirnsak
- Department of Neurobiology, and Howard Hughes Medical Institute, Stanford University School of Medicine, Stanford, CA 94305, USA.
| | - Tirin Moore
- Department of Neurobiology, and Howard Hughes Medical Institute, Stanford University School of Medicine, Stanford, CA 94305, USA
| |
Collapse
|
18
|
Visual space is compressed in prefrontal cortex before eye movements. Nature 2014; 507:504-7. [PMID: 24670771 PMCID: PMC4064801 DOI: 10.1038/nature13149] [Citation(s) in RCA: 130] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2013] [Accepted: 02/13/2014] [Indexed: 11/08/2022]
Abstract
We experience the visual world through a series of saccadic eye movements, each one shifting our gaze to bring objects of interest to the fovea for further processing. Although such movements lead to frequent and substantial displacements of the retinal image, these displacements go unnoticed. It is widely assumed that a primary mechanism underlying this apparent stability is an anticipatory shifting of visual receptive fields (RFs) from their presaccadic to their postsaccadic locations before movement onset. Evidence of this predictive 'remapping' of RFs has been particularly apparent within brain structures involved in gaze control. However, critically absent among that evidence are detailed measurements of visual RFs before movement onset. Here we show that during saccade preparation, rather than remap, RFs of neurons in a prefrontal gaze control area massively converge towards the saccadic target. We mapped the visual RFs of prefrontal neurons during stable fixation and immediately before the onset of eye movements, using multi-electrode recordings in monkeys. Following movements from an initial fixation point to a target, RFs remained stationary in retinocentric space. However, in the period immediately before movement onset, RFs shifted by as much as 18 degrees of visual angle, and converged towards the target location. This convergence resulted in a threefold increase in the proportion of RFs responding to stimuli near the target region. In addition, like in human observers, the population of prefrontal neurons grossly mislocalized presaccadic stimuli as being closer to the target. Our results show that RF shifts do not predict the retinal displacements due to saccades, but instead reflect the overriding perception of target space during eye movements.
Collapse
|
19
|
Ziesche A, Hamker FH. Brain circuits underlying visual stability across eye movements-converging evidence for a neuro-computational model of area LIP. Front Comput Neurosci 2014; 8:25. [PMID: 24653691 PMCID: PMC3949326 DOI: 10.3389/fncom.2014.00025] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2013] [Accepted: 02/14/2014] [Indexed: 11/13/2022] Open
Abstract
The understanding of the subjective experience of a visually stable world despite the occurrence of an observer's eye movements has been the focus of extensive research for over 20 years. These studies have revealed fundamental mechanisms such as anticipatory receptive field (RF) shifts and the saccadic suppression of stimulus displacements, yet there currently exists no single explanatory framework for these observations. We show that a previously presented neuro-computational model of peri-saccadic mislocalization accounts for the phenomenon of predictive remapping and for the observation of saccadic suppression of displacement (SSD). This converging evidence allows us to identify the potential ingredients of perceptual stability that generalize beyond different data sets in a formal physiology-based model. In particular we propose that predictive remapping stabilizes the visual world across saccades by introducing a feedback loop and, as an emergent result, small displacements of stimuli are not noticed by the visual system. The model provides a link from neural dynamics, to neural mechanism and finally to behavior, and thus offers a testable comprehensive framework of visual stability.
Collapse
Affiliation(s)
- Arnold Ziesche
- Artificial Intelligence, Computer Science, Chemnitz University of Technology Chemnitz, Germany ; Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster Muenster, Germany
| | - Fred H Hamker
- Artificial Intelligence, Computer Science, Chemnitz University of Technology Chemnitz, Germany
| |
Collapse
|
20
|
|
21
|
Ahissar E, Arieli A. Seeing via Miniature Eye Movements: A Dynamic Hypothesis for Vision. Front Comput Neurosci 2012; 6:89. [PMID: 23162458 PMCID: PMC3492788 DOI: 10.3389/fncom.2012.00089] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2012] [Accepted: 10/05/2012] [Indexed: 11/20/2022] Open
Abstract
During natural viewing, the eyes are never still. Even during fixation, miniature movements of the eyes move the retinal image across tens of foveal photoreceptors. Most theories of vision implicitly assume that the visual system ignores these movements and somehow overcomes the resulting smearing. However, evidence has accumulated to indicate that fixational eye movements cannot be ignored by the visual system if fine spatial details are to be resolved. We argue that the only way the visual system can achieve its high resolution given its fixational movements is by seeing via these movements. Seeing via eye movements also eliminates the instability of the image, which would be induced by them otherwise. Here we present a hypothesis for vision, in which coarse details are spatially encoded in gaze-related coordinates, and fine spatial details are temporally encoded in relative retinal coordinates. The temporal encoding presented here achieves its highest resolution by encoding along the elongated axes of simple-cell receptive fields and not across these axes as suggested by spatial models of vision. According to our hypothesis, fine details of shape are encoded by inter-receptor temporal phases, texture by instantaneous intra-burst rates of individual receptors, and motion by inter-burst temporal frequencies. We further describe the ability of the visual system to readout the encoded information and recode it internally. We show how reading out of retinal signals can be facilitated by neuronal phase-locked loops (NPLLs), which lock to the retinal jitter; this locking enables recoding of motion information and temporal framing of shape and texture processing. A possible implementation of this locking-and-recoding process by specific thalamocortical loops is suggested. Overall it is suggested that high-acuity vision is based primarily on temporal mechanisms of the sort presented here and low-acuity vision is based primarily on spatial mechanisms.
Collapse
Affiliation(s)
- Ehud Ahissar
- Department of Neurobiology, Weizmann Institute of Science Rehovot, Israel
| | | |
Collapse
|
22
|
Abstract
The locations of visual objects to which we attend are initially mapped in a retinotopic frame of reference. Because each saccade results in a shift of images on the retina, however, the retinotopic mapping of spatial attention must be updated around the time of each eye movement. Mathôt and Theeuwes [1] recently demonstrated that a visual cue draws attention not only to the cue's current retinotopic location, but also to a location shifted in the direction of the saccade, the “future-field”. Here we asked whether retinotopic and future-field locations have special status, or whether cue-related attention benefits exist between these locations. We measured responses to targets that appeared either at the retinotopic or future-field location of a brief, non-predictive visual cue, or at various intermediate locations between them. Attentional cues facilitated performance at both the retinotopic and future-field locations for cued relative to uncued targets, as expected. Critically, this cueing effect also occurred at intermediate locations. Our results, and those reported previously [1], imply a systematic bias of attention in the direction of the saccade, independent of any predictive remapping of attention that compensates for retinal displacements of objects across saccades [2].
Collapse
|
23
|
Shin S, Sommer MA. Division of labor in frontal eye field neurons during presaccadic remapping of visual receptive fields. J Neurophysiol 2012; 108:2144-59. [PMID: 22815407 DOI: 10.1152/jn.00204.2012] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Our percept of visual stability across saccadic eye movements may be mediated by presaccadic remapping. Just before a saccade, neurons that remap become visually responsive at a future field (FF), which anticipates the saccade vector. Hence, the neurons use corollary discharge of saccades. Many of the neurons also decrease their response at the receptive field (RF). Presaccadic remapping occurs in several brain areas including the frontal eye field (FEF), which receives corollary discharge of saccades in its layer IV from a collicular-thalamic pathway. We studied, at two levels, the microcircuitry of remapping in the FEF. At the laminar level, we compared remapping between layers IV and V. At the cellular level, we compared remapping between different neuron types of layer IV. In the FEF in four monkeys (Macaca mulatta), we identified 27 layer IV neurons with orthodromic stimulation and 57 layer V neurons with antidromic stimulation from the superior colliculus. With the use of established criteria, we classified the layer IV neurons as putative excitatory (n = 11), putative inhibitory (n = 12), or ambiguous (n = 4). We found that just before a saccade, putative excitatory neurons increased their visual response at the RF, putative inhibitory neurons showed no change, and ambiguous neurons increased their visual response at the FF. None of the neurons showed presaccadic visual changes at both RF and FF. In contrast, neurons in layer V showed full remapping (at both the RF and FF). Our data suggest that elemental signals for remapping are distributed across neuron types in early cortical processing and combined in later stages of cortical microcircuitry.
Collapse
Affiliation(s)
- Sooyoon Shin
- Department of Neuroscience, Center for the Neural Basis of Cognition, and Center for Neuroscience at the University of Pittsburgh, University of Pittsburgh, Pittsburgh, PA, USA
| | | |
Collapse
|
24
|
Ritchie KL, Hunt AR, Sahraie A. Trans-saccadic priming in hemianopia: sighted-field sensitivity is boosted by a blind-field prime. Neuropsychologia 2012; 50:997-1005. [PMID: 22361254 PMCID: PMC3507622 DOI: 10.1016/j.neuropsychologia.2012.02.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2011] [Revised: 02/03/2012] [Accepted: 02/07/2012] [Indexed: 11/28/2022]
Abstract
We experience visual stability despite shifts of the visual array across the retina produced by eye movements. A process known as remapping is thought to keep track of the spatial locations of objects as they move on the retina. We explored remapping in damaged visual cortex by presenting a stimulus in the blind field of two patients with hemianopia. When they executed a saccadic eye movement that would bring the stimulated location into the sighted field, reported awareness of the stimulus increased, even though the stimulus was removed before the saccade began and so never actually fell in the sighted field. Moreover, when a location was primed by a blind-field stimulus and then brought into the sighted field by a saccade, detection sensitivity for near-threshold targets appearing at this location increased dramatically. The results demonstrate that brain areas supporting conscious vision are not necessary for remapping, and suggest visual stability is maintained for salient objects even when they are not consciously perceived.
Collapse
Affiliation(s)
- Kay L Ritchie
- Vision and Attention Laboratories, School of Psychology, University of Aberdeen, Aberdeen AB24 3FX, UK
| | | | | |
Collapse
|
25
|
Abstract
As we shift our gaze to explore the visual world, information enters cortex in a sequence of successive snapshots, interrupted by phases of blur. Our experience, in contrast, appears like a movie of a continuous stream of objects embedded in a stable world. This perception of stability across eye movements has been linked to changes in spatial sensitivity of visual neurons anticipating the upcoming saccade, often referred to as shifting receptive fields (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 1997; Nakamura and Colby, 2002). How exactly these receptive field dynamics contribute to perceptual stability is currently not clear. Anticipatory receptive field shifts toward the future, postsaccadic position may bridge the transient perisaccadic epoch (Sommer and Wurtz, 2006; Wurtz, 2008; Melcher and Colby, 2008). Alternatively, a presaccadic shift of receptive fields toward the saccade target area (Tolias et al., 2001) may serve to focus visual resources onto the most relevant objects in the postsaccadic scene (Hamker et al., 2008). In this view, shifts of feature detectors serve to facilitate the processing of the peripheral visual content before it is foveated. While this conception is consistent with previous observations on receptive field dynamics and on perisaccadic compression (Ross et al., 1997; Morrone et al., 1997; Kaiser and Lappe, 2004), it predicts that receptive fields beyond the saccade target shift toward the saccade target rather than in the direction of the saccade. We have tested this prediction in human observers via the presaccadic transfer of the tilt-aftereffect (Melcher, 2007).
Collapse
|
26
|
Chien SE, Ono F, Watanabe K. Mislocalization of visual stimuli: independent effects of static and dynamic attention. PLoS One 2011; 6:e28371. [PMID: 22163009 PMCID: PMC3230626 DOI: 10.1371/journal.pone.0028371] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2011] [Accepted: 11/07/2011] [Indexed: 11/30/2022] Open
Abstract
Shifts of visual attention cause systematic distortions of the perceived locations of visual objects around the focus of attention. In the attention repulsion effect, the perceived location of a visual target is shifted away from an attention-attracting cue when the cue is presented before the target. Recently it has been found that, if the visual cue is presented after the target, the perceived location of the target shifts toward the location of the following cue. One unanswered question is whether a single mechanism underlies both attentional repulsion and attraction effects. We presented participants with two disks at diagonal locations as visual cues and two vertical lines as targets. Participants were asked to perform a forced-choice task to judge targets' positions. The present study examined whether the magnitude of the repulsion effect and the attraction effect would differ (Experiment 1), whether the two effects would interact (Experiment 2), and whether the location or the dynamic shift of attentional focus would determine the distortions effects (Experiment 3). The results showed that the effect size of the attraction effect was slightly larger than the repulsion effect and the preceding and following cues have independent influences on the perceived positions. The repulsion effect was caused by the location of attnetion and the attraction effect was due to the dynamic shift of attentional focus, suggesting that the underlying mechanisms for the retrospective attraction effect might be different from those for the repulsion effect.
Collapse
Affiliation(s)
- Sung-en Chien
- Research Center of Advanced Science and Technology (Cognitive Science), The University of Tokyo, Tokyo, Japan.
| | | | | |
Collapse
|
27
|
Churan J, Guitton D, Pack CC. Context dependence of receptive field remapping in superior colliculus. J Neurophysiol 2011; 106:1862-74. [PMID: 21753030 DOI: 10.1152/jn.00288.2011] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Our perception of the positions of objects in our surroundings is surprisingly unaffected by movements of the eyes, head, and body. This suggests that the brain has a mechanism for maintaining perceptual stability, based either on the spatial relationships among visible objects or internal copies of its own motor commands. Strong evidence for the latter mechanism comes from the remapping of visual receptive fields that occurs around the time of a saccade. Remapping occurs when a single neuron responds to visual stimuli placed presaccadically in the spatial location that will be occupied by its receptive field after the completion of a saccade. Although evidence for remapping has been found in many brain areas, relatively little is known about how it interacts with sensory context. This interaction is important for understanding perceptual stability more generally, as the brain may rely on extraretinal signals or visual signals to different degrees in different contexts. Here, we have studied the interaction between visual stimulation and remapping by recording from single neurons in the superior colliculus of the macaque monkey, using several different visual stimulus conditions. We find that remapping responses are highly sensitive to low-level visual signals, with the overall luminance of the visual background exerting a particularly powerful influence. Specifically, although remapping was fairly common in complete darkness, such responses were usually decreased or abolished in the presence of modest background illumination. Thus the brain might make use of a strategy that emphasizes visual landmarks over extraretinal signals whenever the former are available.
Collapse
Affiliation(s)
- Jan Churan
- Montreal Neurological Institute, McGill University, Montreal, Canada.
| | | | | |
Collapse
|
28
|
Hamker FH, Zirnsak M, Ziesche A, Lappe M. Computational models of spatial updating in peri-saccadic perception. Philos Trans R Soc Lond B Biol Sci 2011; 366:554-71. [PMID: 21242143 DOI: 10.1098/rstb.2010.0229] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Perceptual phenomena that occur around the time of a saccade, such as peri-saccadic mislocalization or saccadic suppression of displacement, have often been linked to mechanisms of spatial stability. These phenomena are usually regarded as errors in processes of trans-saccadic spatial transformations and they provide important tools to study these processes. However, a true understanding of the underlying brain processes that participate in the preparation for a saccade and in the transfer of information across it requires a closer, more quantitative approach that links different perceptual phenomena with each other and with the functional requirements of ensuring spatial stability. We review a number of computational models of peri-saccadic spatial perception that provide steps in that direction. Although most models are concerned with only specific phenomena, some generalization and interconnection between them can be obtained from a comparison. Our analysis shows how different perceptual effects can coherently be brought together and linked back to neuronal mechanisms on the way to explaining vision across saccades.
Collapse
Affiliation(s)
- Fred H Hamker
- Department of Psychology, Westfälische Wilhelms University Münster, Münster, Germany.
| | | | | | | |
Collapse
|
29
|
Abstract
In the present review, we address the relationship between attention and visual stability. Even though with each eye, head and body movement the retinal image changes dramatically, we perceive the world as stable and are able to perform visually guided actions. However, visual stability is not as complete as introspection would lead us to believe. We attend to only a few items at a time and stability is maintained only for those items. There appear to be two distinct mechanisms underlying visual stability. The first is a passive mechanism: the visual system assumes the world to be stable, unless there is a clear discrepancy between the pre- and post-saccadic image of the region surrounding the saccade target. This is related to the pre-saccadic shift of attention, which allows for an accurate preview of the saccade target. The second is an active mechanism: information about attended objects is remapped within retinotopic maps to compensate for eye movements. The locus of attention itself, which is also characterized by localized retinotopic activity, is remapped as well. We conclude that visual attention is crucial in our perception of a stable world.
Collapse
Affiliation(s)
- Sebastiaan Mathôt
- Department of Cognitive Psychology, Vrije Universiteit, Amsterdam, The Netherlands.
| | | |
Collapse
|
30
|
|