1
|
Chan HH, Mitchell AG, Sandilands E, Balslev D. Gaze and attention: Mechanisms underlying the therapeutic effect of optokinetic stimulation in spatial neglect. Neuropsychologia 2024; 199:108883. [PMID: 38599567 DOI: 10.1016/j.neuropsychologia.2024.108883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 02/19/2024] [Accepted: 04/05/2024] [Indexed: 04/12/2024]
Abstract
Left smooth pursuit eye movement training in response to large-field visual motion (optokinetic stimulation) has become a promising rehabilitation method in left spatial inattention or neglect. The mechanisms underlying the therapeutic effect, however, remain unknown. During optokinetic stimulation, there is an error in visual localisation ahead of the line of sight. This could indicate a change in the brain's estimate of one's own direction of gaze. We hypothesized that optokinetic stimulation changes the brain's estimate of gaze. Because this estimate is critical for coding the locus of attention in the visual space relative to the body and across sensory modalities, its change might underlie the change in spatial attention. Here, we report that in healthy participants optokinetic stimulation causes not only a directional bias in the proprioceptive signal from the extraocular muscles, but also a corresponding shift of the locus of attention. Both changes outlasted the period of stimulation. This result forms a step in investigating a causal link between the adaptation in the sensorimotor gaze signals and the recovery in spatial neglect.
Collapse
Affiliation(s)
- H H Chan
- School of Psychology and Neuroscience, University of St Andrews, South Street, St. Andrews, KY16 9J, United Kingdom
| | - A G Mitchell
- School of Psychology and Neuroscience, University of St Andrews, South Street, St. Andrews, KY16 9J, United Kingdom
| | - E Sandilands
- School of Psychology and Neuroscience, University of St Andrews, South Street, St. Andrews, KY16 9J, United Kingdom
| | - D Balslev
- School of Psychology and Neuroscience, University of St Andrews, South Street, St. Andrews, KY16 9J, United Kingdom.
| |
Collapse
|
2
|
Lehet M, Rolfs M, Bao J, Fattal J, Thakkar KN. Pre-saccadic shifts of attention in individuals diagnosed with schizophrenia. Brain Behav 2024; 14:e3466. [PMID: 38450916 PMCID: PMC10918725 DOI: 10.1002/brb3.3466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 02/15/2024] [Accepted: 02/18/2024] [Indexed: 03/08/2024] Open
Abstract
INTRODUCTION Pathophysiological theories of schizophrenia (SZ) symptoms posit an abnormality in using predictions to guide behavior. One such prediction is based on imminent movements, via corollary discharge signals (CD) that relay information about planned movement kinematics to sensory brain regions. Empirical evidence suggests a reduced influence of sensorimotor predictions in individuals with SZ within multiple sensory systems, including in the visual system. One function of CD in the visual system is to selectively enhance visual sensitivity at the location of planned eye movements (pre-saccadic attention), thus enabling a prediction of the to-be-foveated stimulus. We expected pre-saccadic attention shifts to be less pronounced in individuals with SZ than in healthy controls (HC), resulting in unexpected sensory consequences of eye movements, which may relate to symptoms than can be explained in the context of altered allocation of attention. METHODS We examined this question by testing 30 SZ and 30 HC on a pre-saccadic attention task. On each trial participants made a saccade to a cued location in an array of four stimuli. A discrimination target that was either congruent or incongruent with the cued location was briefly presented after the cue, during saccade preparation. Pre-saccadic attention was quantified by comparing accuracy on congruent trials to incongruent trials within the interval preceding the saccade. RESULTS Although SZs were less accurate overall, the magnitude of the pre-saccadic attention effect generally did not differ across groups nor show a convincing relationship with symptom severity. We did, however, observe that SZ had reduced pre-saccadic attention effects when the discrimination target (probe) was presented at early stages of saccade planning, when pre-saccadic attention effects first emerged in HC. CONCLUSION These findings suggest generally intact pre-saccadic shifts of attention in SZ, albeit slightly delayed. Results contribute to our understanding of altered sensory predictions in people with schizophrenia.
Collapse
Affiliation(s)
- Matthew Lehet
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
| | - Martin Rolfs
- Department of PsychologyHumboldt UniversityBerlinGermany
| | - Jacqueline Bao
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
| | - Jessica Fattal
- Department of PsychologyNorthwestern UniversityEvanstonIllinoisUSA
| | - Katharine N. Thakkar
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
- Psychiatry and Behavioral MedicineMichigan State University College of Human MedicineEast LansingMichiganUSA
| |
Collapse
|
3
|
Qin C, Michon F, Onuki Y, Ishishita Y, Otani K, Kawai K, Fries P, Gazzola V, Keysers C. Predictability alters information flow during action observation in human electrocorticographic activity. Cell Rep 2023; 42:113432. [PMID: 37963020 DOI: 10.1016/j.celrep.2023.113432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 07/27/2023] [Accepted: 10/29/2023] [Indexed: 11/16/2023] Open
Abstract
The action observation network (AON) has been extensively studied using short, isolated motor acts. How activity in the network is altered when these isolated acts are embedded in meaningful sequences of actions remains poorly understood. Here we utilized intracranial electrocorticography to characterize how the exchange of information across key nodes of the AON-the precentral, supramarginal, and visual cortices-is affected by such embedding and the resulting predictability. We found more top-down beta oscillation from precentral to supramarginal contacts during the observation of predictable actions in meaningful sequences compared to the same actions in randomized, and hence less predictable, order. In addition, we find that expectations enabled by the embedding lead to a suppression of bottom-up visual responses in the high-gamma range in visual areas. These results, in line with predictive coding, inform how nodes of the AON integrate information to process the actions of others.
Collapse
Affiliation(s)
- Chaoyi Qin
- Social Brain Lab, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Art and Sciences, 1105 BA Amsterdam, the Netherlands
| | - Frederic Michon
- Social Brain Lab, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Art and Sciences, 1105 BA Amsterdam, the Netherlands
| | - Yoshiyuki Onuki
- Department of Neurosurgery, Jichi Medical University, Tochigi 329-0498, Japan
| | - Yohei Ishishita
- Department of Neurosurgery, Jichi Medical University, Tochigi 329-0498, Japan
| | - Keisuke Otani
- Department of Neurosurgery, Jichi Medical University, Tochigi 329-0498, Japan
| | - Kensuke Kawai
- Department of Neurosurgery, Jichi Medical University, Tochigi 329-0498, Japan
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Donders Institute for Brain, Cognition and Behaviour, Radboud University, Kapittelweg 29, 6525 EN Nijmegen, the Netherlands
| | - Valeria Gazzola
- Social Brain Lab, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Art and Sciences, 1105 BA Amsterdam, the Netherlands; University of Amsterdam, Department of Psychology, Brain & Cognition, Amsterdam, the Netherlands.
| | - Christian Keysers
- Social Brain Lab, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Art and Sciences, 1105 BA Amsterdam, the Netherlands; University of Amsterdam, Department of Psychology, Brain & Cognition, Amsterdam, the Netherlands.
| |
Collapse
|
4
|
Smith DT, Beierholm U, Avery M. A presaccadic perceptual impairment at the postsaccadic location of the blindspot. PLoS One 2023; 18:e0291582. [PMID: 37708131 PMCID: PMC10501568 DOI: 10.1371/journal.pone.0291582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 08/31/2023] [Indexed: 09/16/2023] Open
Abstract
Saccadic eye movements are preceded by profound changes in visual perception. These changes have been linked to the phenomenon of 'forward remapping', in which cells begin to respond to stimuli that appear in their post-saccadic receptive field before the eye has moved. Few studies have examined the perceptual consequences of remapping of areas of impaired sensory acuity, such as the blindspot. Understanding the perceptual consequences of remapping of scotomas may produce important insights into why some neurovisual deficits, such as hemianopia are so intractable for rehabilitation. The current study took advantage of a naturally occurring scotoma in healthy participants (the blindspot) to examine pre-saccadic perception at the upcoming location of the blindspot. Participants viewed stimuli monocularly and were required to make stimulus-driven vertical eye-movements. At a variable latency between the onset of saccade target (ST) and saccade execution a discrimination target (DT) was presented at one of 4 possible locations; within the blindspot, contralateral to the blindspot, in post-saccadic location of the blindspot and contralateral to the post-saccadic location of the blindspot. There was a significant perceptual impairment at the post-saccadic location of the blindspot relative to the contralateral post-saccadic location of the blindspot and the post-saccadic location of the blindspot in a no-saccade control condition. These data are consistent with the idea that the visual system includes a representation of the blindspot which is remapped prior to saccade onset.
Collapse
Affiliation(s)
- Daniel T. Smith
- Department of Psychology, Durham University, Durham, United Kingdom
| | - Ulrik Beierholm
- Department of Psychology, Durham University, Durham, United Kingdom
| | - Mark Avery
- Department of Psychology, Durham University, Durham, United Kingdom
| |
Collapse
|
5
|
Li HH, Curtis CE. Neural population dynamics of human working memory. Curr Biol 2023; 33:3775-3784.e4. [PMID: 37595590 PMCID: PMC10528783 DOI: 10.1016/j.cub.2023.07.067] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 06/20/2023] [Accepted: 07/31/2023] [Indexed: 08/20/2023]
Abstract
The activity of neurons in macaque prefrontal cortex (PFC) persists during working memory (WM) delays, providing a mechanism for memory.1,2,3,4,5,6,7,8,9,10,11 Although theory,11,12 including formal network models,13,14 assumes that WM codes are stable over time, PFC neurons exhibit dynamics inconsistent with these assumptions.15,16,17,18,19 Recently, multivariate reanalyses revealed the coexistence of both stable and dynamic WM codes in macaque PFC.20,21,22,23 Human EEG studies also suggest that WM might contain dynamics.24,25 Nonetheless, how WM dynamics vary across the cortical hierarchy and which factors drive dynamics remain unknown. To elucidate WM dynamics in humans, we decoded WM content from fMRI responses across multiple cortical visual field maps.26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48 We found coexisting stable and dynamic neural representations of WM during a memory-guided saccade task. Geometric analyses of neural subspaces revealed that early visual cortex exhibited stronger dynamics than high-level visual and frontoparietal cortex. Leveraging models of population receptive fields, we visualized and made the neural dynamics interpretable. We found that during WM delays, V1 population initially encoded a narrowly tuned bump of activation centered on the peripheral memory target. Remarkably, this bump then spread inward toward foveal locations, forming a vector along the trajectory of the forthcoming memory-guided saccade. In other words, the neural code transformed into an abstraction of the stimulus more proximal to memory-guided behavior. Therefore, theories of WM must consider both sensory features and their task-relevant abstractions because changes in the format of memoranda naturally drive neural dynamics.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, NY 10003, USA; Center for Neural Science, New York University, New York, NY 10003, USA
| | - Clayton E Curtis
- Department of Psychology, New York University, New York, NY 10003, USA; Center for Neural Science, New York University, New York, NY 10003, USA.
| |
Collapse
|
6
|
Yates JL, Coop SH, Sarch GH, Wu RJ, Butts DA, Rucci M, Mitchell JF. Detailed characterization of neural selectivity in free viewing primates. Nat Commun 2023; 14:3656. [PMID: 37339973 PMCID: PMC10282080 DOI: 10.1038/s41467-023-38564-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Accepted: 05/08/2023] [Indexed: 06/22/2023] Open
Abstract
Fixation constraints in visual tasks are ubiquitous in visual and cognitive neuroscience. Despite its widespread use, fixation requires trained subjects, is limited by the accuracy of fixational eye movements, and ignores the role of eye movements in shaping visual input. To overcome these limitations, we developed a suite of hardware and software tools to study vision during natural behavior in untrained subjects. We measured visual receptive fields and tuning properties from multiple cortical areas of marmoset monkeys who freely viewed full-field noise stimuli. The resulting receptive fields and tuning curves from primary visual cortex (V1) and area MT match reported selectivity from the literature which was measured using conventional approaches. We then combined free viewing with high-resolution eye tracking to make the first detailed 2D spatiotemporal measurements of foveal receptive fields in V1. These findings demonstrate the power of free viewing to characterize neural responses in untrained animals while simultaneously studying the dynamics of natural behavior.
Collapse
Affiliation(s)
- Jacob L Yates
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA.
- Center for Visual Science, University of Rochester, Rochester, NY, USA.
- Department of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA.
- Herbert Wertheim School of Optometry and Vision Science, UC Berkeley, Berkeley, CA, USA.
| | - Shanna H Coop
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Center for Visual Science, University of Rochester, Rochester, NY, USA
- Neurobiology, Stanford University, Stanford, CA, USA
| | - Gabriel H Sarch
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Ruei-Jr Wu
- Center for Visual Science, University of Rochester, Rochester, NY, USA
- Institute of Optics, University of Rochester, Rochester, NY, USA
| | - Daniel A Butts
- Department of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA
| | - Michele Rucci
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Center for Visual Science, University of Rochester, Rochester, NY, USA
| | - Jude F Mitchell
- Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Center for Visual Science, University of Rochester, Rochester, NY, USA
| |
Collapse
|
7
|
Barrett LF. Context reconsidered: Complex signal ensembles, relational meaning, and population thinking in psychological science. AMERICAN PSYCHOLOGIST 2022; 77:894-920. [PMID: 36409120 PMCID: PMC9683522 DOI: 10.1037/amp0001054] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
This article considers the status and study of "context" in psychological science through the lens of research on emotional expressions. The article begins by updating three well-trod methodological debates on the role of context in emotional expressions to reconsider several fundamental assumptions lurking within the field's dominant methodological tradition: namely, that certain expressive movements have biologically prepared, inherent emotional meanings that issue from singular, universal processes which are independent of but interact with contextual influences. The second part of this article considers the scientific opportunities that await if we set aside this traditional understanding of "context" as a moderator of signals with inherent psychological meaning and instead consider the possibility that psychological events emerge in ecosystems of signal ensembles, such that the psychological meaning of any individual signal is entirely relational. Such a fundamental shift has radical implications not only for the science of emotion but for psychological science more generally. It offers opportunities to improve the validity and trustworthiness of psychological science beyond what can be achieved with improvements to methodological rigor alone. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
|
8
|
Microsaccades, Drifts, Hopf Bundle and Neurogeometry. J Imaging 2022; 8:jimaging8030076. [PMID: 35324631 PMCID: PMC8953095 DOI: 10.3390/jimaging8030076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 03/03/2022] [Accepted: 03/04/2022] [Indexed: 02/01/2023] Open
Abstract
The first part of the paper contains a short review of the image processing in early vision is static, when the eyes and the stimulus are stable, and in dynamics, when the eyes participate in fixation eye movements. In the second part, we give an interpretation of Donders’ and Listing’s law in terms of the Hopf fibration of the 3-sphere over the 2-sphere. In particular, it is shown that the configuration space of the eye ball (when the head is fixed) is the 2-dimensional hemisphere SL+, called Listing hemisphere, and saccades are described as geodesic segments of SL+ with respect to the standard round metric. We study fixation eye movements (drift and microsaccades) in terms of this model and discuss the role of fixation eye movements in vision. A model of fixation eye movements is proposed that gives an explanation of presaccadic shift of receptive fields.
Collapse
|
9
|
Wilmott JP, Michel MM. Transsaccadic integration of visual information is predictive, attention-based, and spatially precise. J Vis 2021; 21:14. [PMID: 34374744 PMCID: PMC8366295 DOI: 10.1167/jov.21.8.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2020] [Accepted: 03/23/2021] [Indexed: 11/29/2022] Open
Abstract
Eye movements produce shifts in the positions of objects in the retinal image, but observers are able to integrate these shifting retinal images into a coherent representation of visual space. This ability is thought to be mediated by attention-dependent saccade-related neural activity that is used by the visual system to anticipate the retinal consequences of impending eye movements. Previous investigations of the perceptual consequences of this predictive activity typically infer attentional allocation using indirect measures such as accuracy or reaction time. Here, we investigated the perceptual consequences of saccades using an objective measure of attentional allocation, reverse correlation. Human observers executed a saccade while monitoring a flickering target object flanked by flickering distractors and reported whether the average luminance of the target was lighter or darker than the background. Successful task performance required subjects to integrate visual information across the saccade. A reverse correlation analysis yielded a spatiotemporal "psychophysical kernel" characterizing how different parts of the stimulus contributed to the luminance decision throughout each trial. Just before the saccade, observers integrated luminance information from a distractor located at the post-saccadic retinal position of the target, indicating a predictive perceptual updating of the target. Observers did not integrate information from distractors placed in alternative locations, even when they were nearer to the target object. We also observed simultaneous predictive perceptual updating for two spatially distinct targets. These findings suggest both that shifting neural representations mediate the coherent representation of visual space, and that these shifts have significant consequences for transsaccadic perception.
Collapse
Affiliation(s)
- James P Wilmott
- Department of Cognitive, Linguistic, & Psychological Sciences, Brown University, Providence, RI, USA
| | - Melchi M Michel
- Department of Psychology and Center for Cognitive Science (RuCCS), Rutgers University, Piscataway, NJ, USA
- https://mmmlab.org/
| |
Collapse
|
10
|
Abstract
Our visual system is fundamentally retinotopic. When viewing a stable scene, each eye movement shifts object features and locations on the retina. Thus, sensory representations must be updated, or remapped, across saccades to align presaccadic and postsaccadic inputs. The earliest remapping studies focused on anticipatory, presaccadic shifts of neuronal spatial receptive fields. Over time, it has become clear that there are multiple forms of remapping and that different forms of remapping may be mediated by different neural mechanisms. This review attempts to organize the various forms of remapping into a functional taxonomy based on experimental data and ongoing debates about forward versus convergent remapping, presaccadic versus postsaccadic remapping, and spatial versus attentional remapping. We integrate findings from primate neurophysiological, human neuroimaging and behavioral, and computational modeling studies. We conclude by discussing persistent open questions related to remapping, with specific attention to binding of spatial and featural information during remapping and speculations about remapping's functional significance. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Julie D Golomb
- Department of Psychology, The Ohio State University, Columbus, Ohio 43210, USA;
| | - James A Mazer
- Department of Microbiology and Cell Biology, Montana State University, Bozeman, Montana 59717, USA;
| |
Collapse
|
11
|
Abstract
Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.
Collapse
Affiliation(s)
- Emma E M Stewart
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,
| | - Matteo Valsecchi
- Dipartimento di Psicologia, Universitá di Bologna, Bologna, Italy.,
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,Center for Mind, Brain and Behavior, Philipps-Universität Marburg, Marburg, Germany., https://www.uni-marburg.de/en/fb04/team-schuetz/team/alexander-schutz
| |
Collapse
|
12
|
Caruso VC, Pages DS, Sommer MA, Groh JM. Compensating for a shifting world: evolving reference frames of visual and auditory signals across three multimodal brain areas. J Neurophysiol 2021; 126:82-94. [PMID: 33852803 DOI: 10.1152/jn.00385.2020] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Stimulus locations are detected differently by different sensory systems, but ultimately they yield similar percepts and behavioral responses. How the brain transcends initial differences to compute similar codes is unclear. We quantitatively compared the reference frames of two sensory modalities, vision and audition, across three interconnected brain areas involved in generating saccades, namely the frontal eye fields (FEF), lateral and medial parietal cortex (M/LIP), and superior colliculus (SC). We recorded from single neurons in head-restrained monkeys performing auditory- and visually guided saccades from variable initial fixation locations and evaluated whether their receptive fields were better described as eye-centered, head-centered, or hybrid (i.e. not anchored uniquely to head- or eye-orientation). We found a progression of reference frames across areas and across time, with considerable hybrid-ness and persistent differences between modalities during most epochs/brain regions. For both modalities, the SC was more eye-centered than the FEF, which in turn was more eye-centered than the predominantly hybrid M/LIP. In all three areas and temporal epochs from stimulus onset to movement, visual signals were more eye-centered than auditory signals. In the SC and FEF, auditory signals became more eye-centered at the time of the saccade than they were initially after stimulus onset, but only in the SC at the time of the saccade did the auditory signals become "predominantly" eye-centered. The results indicate that visual and auditory signals both undergo transformations, ultimately reaching the same final reference frame but via different dynamics across brain regions and time.NEW & NOTEWORTHY Models for visual-auditory integration posit that visual signals are eye-centered throughout the brain, whereas auditory signals are converted from head-centered to eye-centered coordinates. We show instead that both modalities largely employ hybrid reference frames: neither fully head- nor eye-centered. Across three hubs of the oculomotor network (intraparietal cortex, frontal eye field, and superior colliculus) visual and auditory signals evolve from hybrid to a common eye-centered format via different dynamics across brain areas and time.
Collapse
Affiliation(s)
- Valeria C Caruso
- Duke Institute for Brain Sciences, Duke University, Durham, North Carolina.,Center for Cognitive Neuroscience, Duke University, Durham, North Carolina.,Department of Psychology and Neuroscience, Duke University, Durham, North Carolina.,Department of Neurobiology, Duke University, Durham, North Carolina.,Department of Psychiatry, University of Michigan, Ann Arbor, Michigan
| | - Daniel S Pages
- Duke Institute for Brain Sciences, Duke University, Durham, North Carolina.,Center for Cognitive Neuroscience, Duke University, Durham, North Carolina.,Department of Psychology and Neuroscience, Duke University, Durham, North Carolina.,Department of Neurobiology, Duke University, Durham, North Carolina
| | - Marc A Sommer
- Duke Institute for Brain Sciences, Duke University, Durham, North Carolina.,Center for Cognitive Neuroscience, Duke University, Durham, North Carolina.,Department of Neurobiology, Duke University, Durham, North Carolina.,Department of Biomedical Engineering, Duke University, Durham, North Carolina
| | - Jennifer M Groh
- Duke Institute for Brain Sciences, Duke University, Durham, North Carolina.,Center for Cognitive Neuroscience, Duke University, Durham, North Carolina.,Department of Psychology and Neuroscience, Duke University, Durham, North Carolina.,Department of Neurobiology, Duke University, Durham, North Carolina.,Department of Biomedical Engineering, Duke University, Durham, North Carolina
| |
Collapse
|
13
|
Gallivan JP, Chapman CS, Gale DJ, Flanagan JR, Culham JC. Selective Modulation of Early Visual Cortical Activity by Movement Intention. Cereb Cortex 2020; 29:4662-4678. [PMID: 30668674 DOI: 10.1093/cercor/bhy345] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Revised: 11/21/2018] [Accepted: 12/22/2018] [Indexed: 12/22/2022] Open
Abstract
The primate visual system contains myriad feedback projections from higher- to lower-order cortical areas, an architecture that has been implicated in the top-down modulation of early visual areas during working memory and attention. Here we tested the hypothesis that these feedback projections also modulate early visual cortical activity during the planning of visually guided actions. We show, across three separate human functional magnetic resonance imaging (fMRI) studies involving object-directed movements, that information related to the motor effector to be used (i.e., limb, eye) and action goal to be performed (i.e., grasp, reach) can be selectively decoded-prior to movement-from the retinotopic representation of the target object(s) in early visual cortex. We also find that during the planning of sequential actions involving objects in two different spatial locations, that motor-related information can be decoded from both locations in retinotopic cortex. Together, these findings indicate that movement planning selectively modulates early visual cortical activity patterns in an effector-specific, target-centric, and task-dependent manner. These findings offer a neural account of how motor-relevant target features are enhanced during action planning and suggest a possible role for early visual cortex in instituting a sensorimotor estimate of the visual consequences of movement.
Collapse
Affiliation(s)
- Jason P Gallivan
- Department of Psychology, Queen's University, Kingston, Ontario, Canada.,Department of Biomedical and Molecular Sciences, Queen's University, Kingston, Ontario, Canada.,Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Craig S Chapman
- Faculty of Physical Education and Recreation, University of Alberta, Alberta, Canada
| | - Daniel J Gale
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - J Randall Flanagan
- Department of Psychology, Queen's University, Kingston, Ontario, Canada.,Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Jody C Culham
- Department of Psychology, University of Western Ontario, London, Ontario, Canada.,Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
| |
Collapse
|
14
|
Mostofi N, Zhao Z, Intoy J, Boi M, Victor JD, Rucci M. Spatiotemporal Content of Saccade Transients. Curr Biol 2020; 30:3999-4008.e2. [PMID: 32916116 DOI: 10.1016/j.cub.2020.07.085] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Revised: 07/21/2020] [Accepted: 07/28/2020] [Indexed: 11/25/2022]
Abstract
Humans use rapid gaze shifts, known as saccades, to explore visual scenes. These movements yield abrupt luminance changes on the retina, which elicit robust neural discharges at fixation onsets. Yet little is known about the spatial content of saccade transients. Here, we show that saccades redistribute spatial information within the temporal range of retinal sensitivity following two distinct regimes: saccade modulations counterbalance (whiten) the spectral density of natural scenes at low spatial frequencies and follow the external power distribution at higher frequencies. This redistribution is a consequence of saccade dynamics, particularly the speed/amplitude/duration relation known as the main sequence. It resembles the redistribution resulting from inter-saccadic eye drifts, revealing a continuum in the modulations given by different eye movements, with oculomotor transitions primarily acting by regulating the bandwidth of whitening. Our findings suggest important computational roles for saccade transients in the establishment of spatial representations and lead to testable predictions about their consequences for visual functions and encoding mechanisms.
Collapse
Affiliation(s)
- Naghmeh Mostofi
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA 02215, USA
| | - Zhetuo Zhao
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Meliora Hall, Rochester, NY 14627, USA.
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Graduate Program for Neuroscience, Boston University, 24 Cummington Mall, Boston, MA 02215, USA
| | - Marco Boi
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA 02215, USA
| | - Jonathan D Victor
- Feil Family Brain and Mind Research Institute, Weill Cornell Medical College, 1300 York Avenue, New York, NY 10065, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Meliora Hall, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Meliora Hall, Rochester, NY 14627, USA.
| |
Collapse
|
15
|
Neupane S, Guitton D, Pack CC. Perisaccadic remapping: What? How? Why? Rev Neurosci 2020; 31:505-520. [PMID: 32242834 DOI: 10.1515/revneuro-2019-0097] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2019] [Accepted: 12/31/2019] [Indexed: 11/15/2022]
Abstract
About 25 years ago, the discovery of receptive field (RF) remapping in the parietal cortex of nonhuman primates revealed that visual RFs, widely assumed to have a fixed retinotopic organization, can change position before every saccade. Measuring such changes can be deceptively difficult. As a result, studies that followed have generated a fascinating but somewhat confusing picture of the phenomenon. In this review, we describe how observations of RF remapping depend on the spatial and temporal sampling of visual RFs and saccade directions. Further, we summarize some of the theories of how remapping might occur in neural circuitry. Finally, based on neurophysiological and psychophysical observations, we discuss the ways in which remapping information might facilitate computations in downstream brain areas.
Collapse
Affiliation(s)
- Sujaya Neupane
- Department of Brain and Cognitive Sciences, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Daniel Guitton
- Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec H3A2B4, Canada
| | - Christopher C Pack
- Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec H3A2B4, Canada
| |
Collapse
|
16
|
Sato TK. Long-range connections enrich cortical computations. Neurosci Res 2020; 162:1-12. [PMID: 32470355 DOI: 10.1016/j.neures.2020.05.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 04/28/2020] [Accepted: 05/15/2020] [Indexed: 10/24/2022]
Abstract
The cerebral cortex can perform powerful computations, including those involved in higher cognitive functions. Cortical processing for such computations is executed by local circuits and is further enriched by long-range connectivity. This connectivity is activated under specific conditions and modulates local processing, providing flexibility in the computational performance of the cortex. For instance, long-range connectivity in the primary visual cortex exerts facilitatory impacts when the cortex is silent but suppressive impacts when the cortex is strongly sensory-stimulated. These dual impacts can be captured by a divisive gain control model. Recent methodological advances such as optogenetics, anatomical tracing, and two-photon microscopy have enabled neuroscientists to probe the circuit and synaptic bases of long-range connectivity in detail. Here, I review a series of evidence indicating essential roles of long-range connectivity in visual and hierarchical processing involving numerous cortical areas. I also describe an overview of the challenges encountered in investigating underlying synaptic mechanisms and highlight recent technical approaches that may overcome these difficulties and provide new insights into synaptic mechanisms for cortical processing involving long-range connectivity.
Collapse
Affiliation(s)
- Tatsuo K Sato
- Dept. of Physiology, Neuroscience Program, Biomedicine Discovery Inst., Monash University, Clayton, VIC 3800, Australia; PRESTO, Japan Science and Technology Agency, Saitama 332-0012, Japan.
| |
Collapse
|
17
|
Murdison TS, Blohm G, Bremmer F. Saccade-induced changes in ocular torsion reveal predictive orientation perception. J Vis 2020; 19:10. [PMID: 31533148 DOI: 10.1167/19.11.10] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Natural orienting of gaze often results in a retinal image that is rotated relative to space due to ocular torsion. However, we perceive neither this rotation nor a moving world despite visual rotational motion on the retina. This perceptual stability is often attributed to the phenomenon known as predictive remapping, but the current remapping literature ignores this torsional component. In addition, studies often simply measure remapping across either space or features (e.g., orientation) but in natural circumstances, both components are bound together for stable perception. One natural circumstance in which the perceptual system must account for the current and future eye orientation to correctly interpret the orientation of external stimuli occurs during movements to or from oblique eye orientations (i.e., eye orientations with both a horizontal and vertical angular component relative to the primary position). Here we took advantage of oblique eye orientation-induced ocular torsion to examine perisaccadic orientation perception. First, we found that orientation perception was largely predicted by the rotated retinal image. Second, we observed a presaccadic remapping of orientation perception consistent with maintaining a stable (but spatially inaccurate) retinocentric perception throughout the saccade. These findings strongly suggest that our seamless perceptual stability relies on retinocentric signals that are predictively remapped in all three ocular dimensions with each saccade.
Collapse
Affiliation(s)
- T Scott Murdison
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Canadian Action and Perception Network (CAPnet), Toronto, Ontario, Canada.,Association for Canadian Neuroinformatics and Computational Neuroscience (CNCN), Kingston, Ontario, Canada
| | - Gunnar Blohm
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Canadian Action and Perception Network (CAPnet), Toronto, Ontario, Canada.,Association for Canadian Neuroinformatics and Computational Neuroscience (CNCN), Kingston, Ontario, Canada
| | - Frank Bremmer
- Department of Neurophysics, Philipps-Universität Marburg, Germany
| |
Collapse
|
18
|
Watson TL, Lappe M. Fixation related shifts of perceptual localization counter to saccade direction. J Vis 2019; 19:18. [PMID: 31755903 DOI: 10.1167/19.13.18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Perisaccadic compression of the perceived location of flashed visual stimuli toward a saccade target occurs from about 50 ms before a saccade. Here we show that between 150 and 80 ms before a saccade, perceived locations are shifted toward the fixation point. To establish the cause of the "reverse" presaccadic perceptual distortion, participants completed several versions of a saccade task. After a cue to saccade, a probe bar stimulus was briefly presented within the saccade trajectory. In Experiment 1 participants made (a) overlap saccades with immediate return saccades, (b) overlap saccades, and (c) step saccades. In Experiment 2 participants made gap saccades in complete darkness. In Experiment 3 participants maintained fixation with the probe stimuli masked at various interstimulus intervals. Participants indicated the bar's location using a mouse cursor. In all conditions in Experiment 1 presaccadic compression was preceded by compression toward the initial fixation. In Experiment 2, saccadic compression was maintained but the preceding countercompression was not observed. Stimuli masked at fixation were not compressed. This suggests the two opposing compression effects are related to the act of executing an eye movement. They are also not caused by the requirement to make two sequential saccades ending at the initial fixation location and are not caused by continuous presence of the fixation markers. We propose that countercompression is related to fixation activity and is part of the sequence of motor preparations to execute a cued saccade.
Collapse
Affiliation(s)
- Tamara L Watson
- School of Social Sciences and Psychology, Western Sydney University, NSW, Australia
| | - Markus Lappe
- Institute for Psychology and Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Muenster, Germany
| |
Collapse
|
19
|
Characterizing and dissociating multiple time-varying modulatory computations influencing neuronal activity. PLoS Comput Biol 2019; 15:e1007275. [PMID: 31513570 PMCID: PMC6759185 DOI: 10.1371/journal.pcbi.1007275] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Revised: 09/24/2019] [Accepted: 07/18/2019] [Indexed: 11/19/2022] Open
Abstract
In many brain areas, sensory responses are heavily modulated by factors including attentional state, context, reward history, motor preparation, learned associations, and other cognitive variables. Modelling the effect of these modulatory factors on sensory responses has proven challenging, mostly due to the time-varying and nonlinear nature of the underlying computations. Here we present a computational model capable of capturing and dissociating multiple time-varying modulatory effects on neuronal responses on the order of milliseconds. The model’s performance is tested on extrastriate perisaccadic visual responses in nonhuman primates. Visual neurons respond to stimuli presented around the time of saccades differently than during fixation. These perisaccadic changes include sensitivity to the stimuli presented at locations outside the neuron’s receptive field, which suggests a contribution of multiple sources to perisaccadic response generation. Current computational approaches cannot quantitatively characterize the contribution of each modulatory source in response generation, mainly due to the very short timescale on which the saccade takes place. In this study, we use a high spatiotemporal resolution experimental paradigm along with a novel extension of the generalized linear model framework (GLM), termed the sparse-variable GLM, to allow for time-varying model parameters representing the temporal evolution of the system with a resolution on the order of milliseconds. We used this model framework to precisely map the temporal evolution of the spatiotemporal receptive field of visual neurons in the middle temporal area during the execution of a saccade. Moreover, an extended model based on a factorization of the sparse-variable GLM allowed us to disassociate and quantify the contribution of individual sources to the perisaccadic response. Our results show that our novel framework can precisely capture the changes in sensitivity of neurons around the time of saccades, and provide a general framework to quantitatively track the role of multiple modulatory sources over time. The sensory responses of neurons in many brain areas, particularly those in higher prefrontal or parietal areas, are strongly influenced by factors including task rules, attentional state, context, reward history, motor preparation, learned associations, and other cognitive variables. These modulations often occur in combination, or on fast timescales which present a challenge for both experimental and modelling approaches aiming to describe the underlying mechanisms or computations. Here we present a computational model capable of capturing and dissociating multiple time-varying modulatory effects on spiking responses on the order of milliseconds. The model’s performance is evaluated by testing its ability to reproduce and dissociate multiple changes in visual sensitivity occurring in extrastriate visual cortex around the time of rapid eye movements. No previous model is capable of capturing these changes with as fine a resolution as that presented here. Our model both provides specific insight into the nature and time course of changes in visual sensitivity around the time of eye movements, and offers a general framework applicable to a wide variety of contexts in which sensory processing is modulated dynamically by multiple time-varying cognitive or behavioral factors, to understand the neuronal computations underpinning these modulations and make predictions about the underlying mechanisms.
Collapse
|
20
|
Stewart EEM, Schütz AC. Transsaccadic integration benefits are not limited to the saccade target. J Neurophysiol 2019; 122:1491-1501. [PMID: 31365324 PMCID: PMC6783298 DOI: 10.1152/jn.00420.2019] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
Across saccades, humans can integrate the low-resolution presaccadic information of an upcoming saccade target with the high-resolution postsaccadic information. There is converging evidence to suggest that transsaccadic integration occurs at the saccade target. However, given divergent evidence on the spatial specificity of related mechanisms such as attention, visual working memory, and remapping, it is unclear whether integration is also possible at locations other than the saccade target. We tested the spatial profile of transsaccadic integration, by testing perceptual performance at six locations around the saccade target and between the saccade target and initial fixation. Results show that integration benefits do not differ between the saccade target and surrounding locations. Transsaccadic integration benefits are not specific to the saccade target and can occur at other locations when they are behaviorally relevant, although there is a trend for worse performance for the location above initial fixation compared with those in the direction of the saccade. This suggests that transsaccadic integration may be a more general mechanism used to reconcile task-relevant pre- and postsaccadic information at attended locations other than the saccade target. NEW & NOTEWORTHY This study shows that integration of pre- and postsaccadic information across saccades is not restricted to the saccade target. We found performance benefits of transsaccadic integration at attended locations other than the saccade target, and these benefits did not differ from those found at the saccade target. This suggests that transsaccadic integration may be a more general mechanism used to reconcile pre- and postsaccadic information at task-relevant locations.
Collapse
Affiliation(s)
- Emma E M Stewart
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany
| |
Collapse
|
21
|
Freedman DJ, Ibos G. An Integrative Framework for Sensory, Motor, and Cognitive Functions of the Posterior Parietal Cortex. Neuron 2019; 97:1219-1234. [PMID: 29566792 DOI: 10.1016/j.neuron.2018.01.044] [Citation(s) in RCA: 69] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2017] [Revised: 01/12/2018] [Accepted: 01/23/2018] [Indexed: 11/28/2022]
Abstract
Throughout the history of modern neuroscience, the parietal cortex has been associated with a wide array of sensory, motor, and cognitive functions. The use of non-human primates as a model organism has been instrumental in our current understanding of how areas in the posterior parietal cortex (PPC) modulate our perception and influence our behavior. In this Perspective, we highlight a series of influential studies over the last five decades examining the role of the PPC in visual perception and motor planning. We also integrate long-standing views of PPC functions with more recent evidence to propose a more general model framework to explain integrative sensory, motor, and cognitive functions of the PPC.
Collapse
Affiliation(s)
- David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA; Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, IL 60637, USA.
| | - Guilhem Ibos
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA; Institut de Neuroscience de la Timone, UMR 7289 CNRS & Aix-Marseille Université, Marseille, France.
| |
Collapse
|
22
|
Abstract
Our vision depends upon shifting our high-resolution fovea to objects of interest in the visual field. Each saccade displaces the image on the retina, which should produce a chaotic scene with jerks occurring several times per second. It does not. This review examines how an internal signal in the primate brain (a corollary discharge) contributes to visual continuity across saccades. The article begins with a review of evidence for a corollary discharge in the monkey and evidence from inactivation experiments that it contributes to perception. The next section examines a specific neuronal mechanism for visual continuity, based on corollary discharge that is referred to as visual remapping. Both the basic characteristics of this anticipatory remapping and the factors that control it are enumerated. The last section considers hypotheses relating remapping to the perceived visual continuity across saccades, including remapping's contribution to perceived visual stability across saccades.
Collapse
Affiliation(s)
- Robert H Wurtz
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, Maryland 20892-4435, USA;
| |
Collapse
|
23
|
Arkesteijn K, Belopolsky AV, Smeets JBJ, Donk M. The Limits of Predictive Remapping of Attention Across Eye Movements. Front Psychol 2019; 10:1146. [PMID: 31178788 PMCID: PMC6543634 DOI: 10.3389/fpsyg.2019.01146] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2018] [Accepted: 05/01/2019] [Indexed: 12/20/2022] Open
Abstract
With every eye movement, visual input projected onto our retina changes drastically. The fundamental question of how we keep track of relevant objects and movement targets has puzzled scientists for more than a century. Recent advances suggested that this can be accomplished through the process of predictive remapping of visual attention to the future post-saccadic locations of relevant objects. Evidence for the existence of predictive remapping of attention was first provided by Rolfs et al. (2011) (Nature Neuroscience, 14, 252–256). However, they used a single distant control location away from the task-relevant locations, which could have biased the allocation of visual attention. In this study we used a similar experimental paradigm as Rolfs et al. (2011), but probed attention equally likely at all possible locations. Our results showed that discrimination performance was higher at the remapped location than at a distant control location, but not compared to the other two control locations. A re-analysis of the results obtained by Rolfs et al. (2011) revealed a similar pattern. Together, these findings suggest that it is likely that previous reports of the predictive remapping of attention were due to a diffuse spread of attention to the task-relevant locations rather than to a specific shift toward the target’s future retinotopic location.
Collapse
Affiliation(s)
- Kiki Arkesteijn
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Department of Human Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Artem V Belopolsky
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Jeroen B J Smeets
- Department of Human Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Mieke Donk
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
24
|
He T, Fritsche M, de Lange FP. Predictive remapping of visual features beyond saccadic targets. J Vis 2019; 18:20. [PMID: 30593063 DOI: 10.1167/18.13.20] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Visual stability is thought to be mediated by predictive remapping of the relevant object information from its current, presaccadic location to its future, postsaccadic location on the retina. However, it is heavily debated whether and what feature information is predictively remapped during the presaccadic interval. Here we examined the spatial and featural properties of predictive remapping in a set of three psychophysical studies. We made use of an orientation-adaptation paradigm, in which we induced a tilt aftereffect by prolonged exposure to an oriented adaptor stimulus. Following this adaptation phase, a test stimulus was presented shortly before saccade onset. We found strong evidence for predictive remapping of the features of this test stimulus presented shortly before saccade onset, evidenced by a large tilt aftereffect elicited when the adaptor was positioned at the postsaccadic retinal location of the test stimulus. Conversely, the adaptation state itself, caused by the exposure to the adaptor stimulus, was not predictively remapped. Furthermore, we establish that predictive remapping also occurs for stimuli that are not saccade targets, pointing toward a forward remapping process operating across the whole visual field. Together, our findings suggest that predictive feature remapping of object information plays an important role in mediating visual stability.
Collapse
Affiliation(s)
- Tao He
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Matthias Fritsche
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Floris P de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
25
|
Szinte M, Jonikaitis D, Rangelov D, Deubel H. Pre-saccadic remapping relies on dynamics of spatial attention. eLife 2018; 7:37598. [PMID: 30596475 PMCID: PMC6328271 DOI: 10.7554/elife.37598] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2018] [Accepted: 12/30/2018] [Indexed: 01/01/2023] Open
Abstract
Each saccade shifts the projections of the visual scene on the retina. It has been proposed that the receptive fields of neurons in oculomotor areas are predictively remapped to account for these shifts. While remapping of the whole visual scene seems prohibitively complex, selection by attention may limit these processes to a subset of attended locations. Because attentional selection consumes time, remapping of attended locations should evolve in time, too. In our study, we cued a spatial location by presenting an attention-capturing cue at different times before a saccade and constructed maps of attentional allocation across the visual field. We observed no remapping of attention when the cue appeared shortly before saccade. In contrast, when the cue appeared sufficiently early before saccade, attentional resources were reallocated precisely to the remapped location. Our results show that pre-saccadic remapping takes time to develop suggesting that it relies on the spatial and temporal dynamics of spatial attention.
Collapse
Affiliation(s)
- Martin Szinte
- Department of Cognitive Psychology, Vrije Universiteit, Amsterdam, The Netherlands
| | - Donatas Jonikaitis
- Department of Neurobiology, Howard Hughes Medical Institute, Stanford University School of Medicine, Stanford, United States
| | - Dragan Rangelov
- Queensland Brain Institute, The University of Queensland, Brisbane, Australia
| | - Heiner Deubel
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
26
|
Loberg O, Hautala J, Hämäläinen JA, Leppänen PHT. Semantic anomaly detection in school-aged children during natural sentence reading - A study of fixation-related brain potentials. PLoS One 2018; 13:e0209741. [PMID: 30589889 PMCID: PMC6307749 DOI: 10.1371/journal.pone.0209741] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2018] [Accepted: 12/11/2018] [Indexed: 11/19/2022] Open
Abstract
In this study, we investigated the effects of context-related semantic anomalies on the fixation-related brain potentials of 12-13-year-old Finnish children in grade 6 during sentence reading. The detection of such anomalies is typically reflected in the N400 event-related potential. We also examined whether the representation invoked by the sentence context extends to the orthographic representation level by replacing the final words of the sentence with an anomalous word neighbour of a plausible word. The eye-movement results show that the anomalous word neighbours of plausible words cause similar first-fixation and gaze duration reactions, as do other anomalous words. Similarly, we observed frontal negativity in the fixation-related potential of the unrelated anomalous words and in the anomalous word neighbours. This frontal negativity was larger in both anomalous conditions than in the response elicited by the plausible condition. We thus show that the brain successfully uses context to separate anomalous words from plausible words on a single letter level during free reading. From the P600 response of the scalp waveform, we observed that the P600 was delayed in the anomalous word neighbour condition. We performed group-level decomposition on the data with ICA (independent component analysis) and analysed the time course and source structure of the decomposed data. This analysis of decomposed brain signals not only confirmed the delay of the P600 response but also revealed that the frontal negativity concealed s more typical and separate N400 response, which was similarly delayed in the anomalous word neighbour condition, as was the P600 response. Source analysis of these independent components implicated the right frontal eye field as the cortical source for the frontal negativity and the middle temporal and parietal regions as cortical sources for the components resembling the N400 and P600 responses. We interpret the delays present in N400 and P600 responses to anomalous word neighbours to reflect competition with the representation of the plausible word just one letter different.
Collapse
Affiliation(s)
- Otto Loberg
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | | | | | | |
Collapse
|
27
|
Grujic N, Brehm N, Gloge C, Zhuo W, Hafed ZM. Perisaccadic perceptual mislocalization is different for upward saccades. J Neurophysiol 2018; 120:3198-3216. [PMID: 30332326 DOI: 10.1152/jn.00350.2018] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Saccadic eye movements, which dramatically alter retinal images, are associated with robust perimovement perceptual alterations. Such alterations, thought to reflect brain mechanisms for maintaining perceptual stability in the face of saccade-induced retinal image disruptions, are often studied by asking subjects to localize brief stimuli presented around the time of horizontal saccades. However, other saccade directions are not usually explored. Motivated by recently discovered asymmetries in upper and lower visual field representations in the superior colliculus, a structure important for both saccade generation and visual analysis, we observed significant differences in perisaccadic perceptual alterations for upward saccades relative to other saccade directions. We also found that, even for purely horizontal saccades, perceptual alterations differ for upper vs. lower retinotopic stimulus locations. Our results, coupled with conceptual modeling, suggest that perisaccadic perceptual alterations might critically depend on neural circuits, such as superior colliculus, that asymmetrically represent the upper and lower visual fields. NEW & NOTEWORTHY Brief visual stimuli are robustly mislocalized around the time of saccades. Such mislocalization is thought to arise because oculomotor and visual neural maps distort space through foveal magnification. However, other neural asymmetries, such as upper visual field magnification in the superior colliculus, may also exist, raising the possibility that interactions between saccades and visual stimuli would depend on saccade direction. We confirmed this behaviorally by exploring and characterizing perisaccadic perception for upward saccades.
Collapse
Affiliation(s)
- Nikola Grujic
- Graduate School of Neural and Behavioural Sciences, International Max Planck Research School, Tübingen University , Tübingen , Germany
| | - Nils Brehm
- Master's Program for Neurobiology, Tübingen University , Tübingen , Germany
| | - Cordula Gloge
- Master's Program for Neurobiology, Tübingen University , Tübingen , Germany
| | - Weijie Zhuo
- Master's Program for Neurobiology, Tübingen University , Tübingen , Germany
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University , Tübingen , Germany.,Hertie Institute for Clinical Brain Research, Tübingen University , Tübingen , Germany
| |
Collapse
|
28
|
Knudsen EI. Neural Circuits That Mediate Selective Attention: A Comparative Perspective. Trends Neurosci 2018; 41:789-805. [PMID: 30075867 DOI: 10.1016/j.tins.2018.06.006] [Citation(s) in RCA: 56] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2018] [Revised: 05/31/2018] [Accepted: 06/14/2018] [Indexed: 10/28/2022]
Abstract
Selective attention is central to cognition. Dramatic advances have been made in understanding the neural circuits that mediate selective attention. Forebrain networks, most elaborated in primates, control all forms of attention based on task demands and the physical salience of stimuli. These networks contain circuits that distribute top-down signals to sensory processing areas and enhance information processing in those areas. A midbrain network, most elaborated in birds, controls spatial attention. It contains circuits that continuously compute the highest priority stimulus location and route sensory information from the selected location to forebrain networks that make cognitive decisions. The identification of these circuits, their functions and mechanisms represent a major advance in our understanding of how the vertebrate brain mediates selective attention.
Collapse
Affiliation(s)
- Eric I Knudsen
- Department of Neurobiology, Stanford University, School of Medicine, Stanford, CA 94305-5125, USA.
| |
Collapse
|
29
|
Wang S, Mamelak AN, Adolphs R, Rutishauser U. Encoding of Target Detection during Visual Search by Single Neurons in the Human Brain. Curr Biol 2018; 28:2058-2069.e4. [PMID: 29910078 DOI: 10.1016/j.cub.2018.04.092] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2018] [Revised: 04/03/2018] [Accepted: 04/27/2018] [Indexed: 10/14/2022]
Abstract
Neurons in the primate medial temporal lobe (MTL) respond selectively to visual categories such as faces, contributing to how the brain represents stimulus meaning. However, it remains unknown whether MTL neurons continue to encode stimulus meaning when it changes flexibly as a function of variable task demands imposed by goal-directed behavior. While classically associated with long-term memory, recent lesion and neuroimaging studies show that the MTL also contributes critically to the online guidance of goal-directed behaviors such as visual search. Do such tasks modulate responses of neurons in the MTL, and if so, do their responses mirror bottom-up input from visual cortices or do they reflect more abstract goal-directed properties? To answer these questions, we performed concurrent recordings of eye movements and single neurons in the MTL and medial frontal cortex (MFC) in human neurosurgical patients performing a memory-guided visual search task. We identified a distinct population of target-selective neurons in both the MTL and MFC whose response signaled whether the currently fixated stimulus was a target or distractor. This target-selective response was invariant to visual category and predicted whether a target was detected or missed behaviorally during a given fixation. The response latencies, relative to fixation onset, of MFC target-selective neurons preceded those in the MTL by ∼200 ms, suggesting a frontal origin for the target signal. The human MTL thus represents not only fixed stimulus identity, but also task-specified stimulus relevance due to top-down goal relevance.
Collapse
Affiliation(s)
- Shuo Wang
- Department of Chemical and Biomedical Engineering, and Rockefeller Neuroscience Institute, West Virginia University, 1 Medical Center Dr, Morgantown, WV 26506, USA; Computation and Neural Systems, California Institute of Technology, 1200 E California Blvd, Pasadena, CA 91125, USA.
| | - Adam N Mamelak
- Departments of Neurosurgery and Neurology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048, USA
| | - Ralph Adolphs
- Computation and Neural Systems, California Institute of Technology, 1200 E California Blvd, Pasadena, CA 91125, USA; Division of Biology and Biological Engineering, California Institute of Technology, 1200 E California Blvd, Pasadena, CA 91125, USA.
| | - Ueli Rutishauser
- Departments of Neurosurgery and Neurology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048, USA; Center for Neural Science and Medicine, Department of Biomedical Sciences, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048, USA; Division of Biology and Biological Engineering, California Institute of Technology, 1200 E California Blvd, Pasadena, CA 91125, USA.
| |
Collapse
|
30
|
Bansal S, Ford JM, Spering M. The function and failure of sensory predictions. Ann N Y Acad Sci 2018; 1426:199-220. [PMID: 29683518 DOI: 10.1111/nyas.13686] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2017] [Revised: 02/26/2018] [Accepted: 02/27/2018] [Indexed: 01/24/2023]
Abstract
Humans and other primates are equipped with neural mechanisms that allow them to automatically make predictions about future events, facilitating processing of expected sensations and actions. Prediction-driven control and monitoring of perceptual and motor acts are vital to normal cognitive functioning. This review provides an overview of corollary discharge mechanisms involved in predictions across sensory modalities and discusses consequences of predictive coding for cognition and behavior. Converging evidence now links impairments in corollary discharge mechanisms to neuropsychiatric symptoms such as hallucinations and delusions. We review studies supporting a prediction-failure hypothesis of perceptual and cognitive disturbances. We also outline neural correlates underlying prediction function and failure, highlighting similarities across the visual, auditory, and somatosensory systems. In linking basic psychophysical and psychophysiological evidence of visual, auditory, and somatosensory prediction failures to neuropsychiatric symptoms, our review furthers our understanding of disease mechanisms.
Collapse
Affiliation(s)
- Sonia Bansal
- Maryland Psychiatric Research Center, University of Maryland, Catonsville, Maryland
| | - Judith M Ford
- University of California and Veterans Affairs Medical Center, San Francisco, California
| | - Miriam Spering
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
31
|
Caruso VC, Pages DS, Sommer MA, Groh JM. Beyond the labeled line: variation in visual reference frames from intraparietal cortex to frontal eye fields and the superior colliculus. J Neurophysiol 2018; 119:1411-1421. [PMID: 29357464 PMCID: PMC5966730 DOI: 10.1152/jn.00584.2017] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2017] [Revised: 12/16/2017] [Accepted: 12/18/2017] [Indexed: 11/22/2022] Open
Abstract
We accurately perceive the visual scene despite moving our eyes ~3 times per second, an ability that requires incorporation of eye position and retinal information. In this study, we assessed how this neural computation unfolds across three interconnected structures: frontal eye fields (FEF), intraparietal cortex (LIP/MIP), and the superior colliculus (SC). Single-unit activity was assessed in head-restrained monkeys performing visually guided saccades from different initial fixations. As previously shown, the receptive fields of most LIP/MIP neurons shifted to novel positions on the retina for each eye position, and these locations were not clearly related to each other in either eye- or head-centered coordinates (defined as hybrid coordinates). In contrast, the receptive fields of most SC neurons were stable in eye-centered coordinates. In FEF, visual signals were intermediate between those patterns: around 60% were eye-centered, whereas the remainder showed changes in receptive field location, boundaries, or responsiveness that rendered the response patterns hybrid or occasionally head-centered. These results suggest that FEF may act as a transitional step in an evolution of coordinates between LIP/MIP and SC. The persistence across cortical areas of mixed representations that do not provide unequivocal location labels in a consistent reference frame has implications for how these representations must be read out. NEW & NOTEWORTHY How we perceive the world as stable using mobile retinas is poorly understood. We compared the stability of visual receptive fields across different fixation positions in three visuomotor regions. Irregular changes in receptive field position were ubiquitous in intraparietal cortex, evident but less common in the frontal eye fields, and negligible in the superior colliculus (SC), where receptive fields shifted reliably across fixations. Only the SC provides a stable labeled-line code for stimuli across saccades.
Collapse
Affiliation(s)
- Valeria C Caruso
- Duke Institute for Brain Sciences, Duke University , Durham, North Carolina
- Center for Cognitive Neuroscience, Duke University , Durham, North Carolina
- Department of Psychology and Neuroscience, Duke University , Durham, North Carolina
- Department of Neurobiology, Duke University , Durham, North Carolina
| | - Daniel S Pages
- Duke Institute for Brain Sciences, Duke University , Durham, North Carolina
- Center for Cognitive Neuroscience, Duke University , Durham, North Carolina
- Department of Psychology and Neuroscience, Duke University , Durham, North Carolina
- Department of Neurobiology, Duke University , Durham, North Carolina
| | - Marc A Sommer
- Duke Institute for Brain Sciences, Duke University , Durham, North Carolina
- Center for Cognitive Neuroscience, Duke University , Durham, North Carolina
- Department of Neurobiology, Duke University , Durham, North Carolina
- Department of Biomedical Engineering, Duke University , Durham, North Carolina
| | - Jennifer M Groh
- Duke Institute for Brain Sciences, Duke University , Durham, North Carolina
- Center for Cognitive Neuroscience, Duke University , Durham, North Carolina
- Department of Psychology and Neuroscience, Duke University , Durham, North Carolina
- Department of Neurobiology, Duke University , Durham, North Carolina
| |
Collapse
|
32
|
Chen X, Zirnsak M, Moore T. Dissonant Representations of Visual Space in Prefrontal Cortex during Eye Movements. Cell Rep 2018; 22:2039-2052. [PMID: 29466732 PMCID: PMC5850980 DOI: 10.1016/j.celrep.2018.01.078] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2017] [Revised: 10/30/2017] [Accepted: 01/25/2018] [Indexed: 11/25/2022] Open
Abstract
We used local field potentials (LFPs) and spikes to investigate representations of visual space in prefrontal cortex and the dynamics of those representations during eye movements. Spatial information contained in LFPs of the frontal eye field (FEF) was differentially distributed across frequencies, with a majority of that information being carried in alpha and high-gamma bands and minimal signal in the low-gamma band. During fixation, spatial information from alpha and high-gamma bands and spiking activity was robust across cortical layers. Receptive fields (RFs) derived from alpha and high-gamma bands were retinocentrically organized, and they were spatially correlated both with each other and with spiking RFs. However, alpha and high-gamma RFs probed before eye movements were dissociated. Whereas high-gamma and spiking RFs immediately converged toward the movement goal, alpha RFs remained largely unchanged during the initial probe response, but they converged later. These observations reveal possible mechanisms of dynamic spatial representations that underlie visual perception during eye movements.
Collapse
Affiliation(s)
- Xiaomo Chen
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA 94305, USA; Howard Hughes Medical Institute, USA.
| | - Marc Zirnsak
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA 94305, USA; Howard Hughes Medical Institute, USA
| | - Tirin Moore
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA 94305, USA; Howard Hughes Medical Institute, USA
| |
Collapse
|
33
|
Itokazu T, Hasegawa M, Kimura R, Osaki H, Albrecht UR, Sohya K, Chakrabarti S, Itoh H, Ito T, Sato TK, Sato TR. Streamlined sensory motor communication through cortical reciprocal connectivity in a visually guided eye movement task. Nat Commun 2018; 9:338. [PMID: 29362373 PMCID: PMC5780522 DOI: 10.1038/s41467-017-02501-4] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2017] [Accepted: 12/05/2017] [Indexed: 12/19/2022] Open
Abstract
Cortical computation is distributed across multiple areas of the cortex by networks of reciprocal connectivity. However, how such connectivity contributes to the communication between the connected areas is not clear. In this study, we examine the communication between sensory and motor cortices. We develop an eye movement task in mice and combine it with optogenetic suppression and two-photon calcium imaging techniques. We identify a small region in the secondary motor cortex (MOs) that controls eye movements and reciprocally connects with a rostrolateral part of the higher visual areas (VRL/A/AL). These two regions encode both motor signals and visual information; however, the information flow between the regions depends on the direction of the connectivity: motor information is conveyed preferentially from the MOs to the VRL/A/AL, and sensory information is transferred primarily in the opposite direction. We propose that reciprocal connectivity streamlines information flow, enhancing the computational capacity of a distributed network. Reciprocal connectivity enables tightly coupled information processing across cortical areas. Here the authors develop a visual oculomotor task in mice, identify a small motor area required for it, and demonstrate selective exchange of sensory and motor information between the motor and sensory areas.
Collapse
Affiliation(s)
- Takahide Itokazu
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany
| | - Masashi Hasegawa
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany
| | - Rui Kimura
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany
| | - Hironobu Osaki
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany.,Department of Physiology, Tokyo Women's Medical University, Tokyo, 162-8666, Japan
| | - Urban-Raphael Albrecht
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany
| | - Kazuhiro Sohya
- Department of Mental Disorder Research, National Institute of Neuroscience, National Center of Neurology and Psychiatry, Tokyo, 187-8502, Japan
| | - Shubhodeep Chakrabarti
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany
| | - Hideaki Itoh
- Graduate School of Science and Engineering, Saga University, Saga, 840-8502, Japan
| | - Tetsufumi Ito
- Department of Anatomy, Kanazawa Medical University, Ishikawa, 920-0293, Japan
| | - Tatsuo K Sato
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany. .,Institute of Neuroscience, Technical University of Munich, 80802, Munich, Germany.
| | - Takashi R Sato
- Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076, Tübingen, Germany. .,Department of Mental Disorder Research, National Institute of Neuroscience, National Center of Neurology and Psychiatry, Tokyo, 187-8502, Japan. .,PRESTO, Japan Science and Technology Agency, Saitama, 332-0012, Japan.
| |
Collapse
|
34
|
Zhang X, Golomb JD. Target Localization after Saccades and at Fixation: Nontargets both Facilitate and Bias Responses. VISUAL COGNITION 2018; 26:734-752. [PMID: 30906199 DOI: 10.1080/13506285.2018.1553810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
The image on our retina changes every time we make an eye movement. To maintain visual stability after saccades, specifically to locate visual targets, we may use nontarget objects as "landmarks". In the current study, we compared how the presence of nontargets affects target localization after saccades and during sustained fixation. Participants fixated a target object, which either maintained its location on the screen (sustained-fixation trials), or displaced to trigger a saccade (saccade trials). After the target disappeared, participants reported the most recent target location with a mouse click. We found that the presence of nontargets decreased response error magnitude and variability. However, this nontarget facilitation effect was not larger for saccade trials than sustained-fixation trials, indicating that nontarget facilitation might be a general effect for target localization, rather than of particular importance to post-saccadic stability. Additionally, participants' responses were biased towards the nontarget locations, particularly when the nontarget-target relationships were preserved in relative coordinates across the saccade. This nontarget bias interacted with biases from other spatial references, e.g. eye movement paths, possibly in a way that emphasized non-redundant information. In summary, the presence of nontargets is one of several sources of reference that combine to influence (both facilitate and bias) target localization.
Collapse
Affiliation(s)
- Xiaoli Zhang
- Department of Psychology, The Ohio State University, Columbus, OH 43210, USA
| | - Julie D Golomb
- Department of Psychology, The Ohio State University, Columbus, OH 43210, USA
| |
Collapse
|
35
|
Minxha J, Mosher C, Morrow JK, Mamelak AN, Adolphs R, Gothard KM, Rutishauser U. Fixations Gate Species-Specific Responses to Free Viewing of Faces in the Human and Macaque Amygdala. Cell Rep 2017; 18:878-891. [PMID: 28122239 DOI: 10.1016/j.celrep.2016.12.083] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2016] [Revised: 10/05/2016] [Accepted: 12/22/2016] [Indexed: 10/20/2022] Open
Abstract
Neurons in the primate amygdala respond prominently to faces. This implicates the amygdala in the processing of socially significant stimuli, yet its contribution to social perception remains poorly understood. We evaluated the representation of faces in the primate amygdala during naturalistic conditions by recording from both human and macaque amygdala neurons during free viewing of identical arrays of images with concurrent eye tracking. Neurons responded to faces only when they were fixated, suggesting that neuronal activity was gated by visual attention. Further experiments in humans utilizing covert attention confirmed this hypothesis. In both species, the majority of face-selective neurons preferred faces of conspecifics, a bias also seen behaviorally in first fixation preferences. Response latencies, relative to fixation onset, were shortest for conspecific-selective neurons and were ∼100 ms shorter in monkeys compared to humans. This argues that attention to faces gates amygdala responses, which in turn prioritize species-typical information for further processing.
Collapse
Affiliation(s)
- Juri Minxha
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA 90025, USA
| | - Clayton Mosher
- Department of Physiology, College of Medicine, University of Arizona, Tucson, AZ 85724, USA
| | - Jeremiah K Morrow
- Department of Physiology, College of Medicine, University of Arizona, Tucson, AZ 85724, USA
| | - Adam N Mamelak
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA
| | - Ralph Adolphs
- Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA 90025, USA; Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 90025, USA; Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 90025, USA
| | - Katalin M Gothard
- Department of Physiology, College of Medicine, University of Arizona, Tucson, AZ 85724, USA
| | - Ueli Rutishauser
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA; Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 90025, USA; Department of Neurology, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA.
| |
Collapse
|
36
|
Neupane S, Guitton D, Pack CC. Dissociation of forward and convergent remapping in primate visual cortex. Curr Biol 2017; 26:R491-R492. [PMID: 27326707 DOI: 10.1016/j.cub.2016.04.050] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
A fundamental concept in neuroscience is the receptive field, the area of space over which a neuron gathers information. Until about 25 years ago, visual receptive fields were thought to be determined entirely by the pattern of retinal inputs, so it was quite surprising to find neurons in primate cortex with receptive fields that changed position every time a saccade was executed [1]. Although this discovery has figured prominently into theories of visual perception, there is still much debate about the nature of the phenomenon: Some studies report forward remapping[1-3], in which receptive fields shift to their postsaccadic locations, and others report convergent remapping, in which receptive fields shift toward the saccade target [4]. These two possibilities can be difficult to distinguish, particularly when the two types of remapping lead to receptive field shifts in similar directions [5], as was the case in virtually all previous experiments. Here we report new data from neurons in primate cortical area V4, where both types of remapping have previously been reported [3,6]. Using an experimental configuration in which forward and convergent remapping would lead to receptive field shifts in opposite directions, we show that forward remapping is the dominant type of receptive field shift in V4.
Collapse
Affiliation(s)
- Sujaya Neupane
- Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Quebec, Canada.
| | - Daniel Guitton
- Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Quebec, Canada
| | - Christopher C Pack
- Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Quebec, Canada
| |
Collapse
|
37
|
Buonocore A, Fracasso A, Melcher D. Pre-saccadic perception: Separate time courses for enhancement and spatial pooling at the saccade target. PLoS One 2017; 12:e0178902. [PMID: 28614367 PMCID: PMC5470679 DOI: 10.1371/journal.pone.0178902] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2016] [Accepted: 05/19/2017] [Indexed: 11/25/2022] Open
Abstract
We interact with complex scenes using eye movements to select targets of interest. Studies have shown that the future target of a saccadic eye movement is processed differently by the visual system. A number of effects have been reported, including a benefit for perceptual performance at the target (“enhancement”), reduced influences of backward masking (“un-masking”), reduced crowding (“un-crowding”) and spatial compression towards the saccade target. We investigated the time course of these effects by measuring orientation discrimination for targets that were spatially crowded or temporally masked. In four experiments, we varied the target-flanker distance, the presence of forward/backward masks, the orientation of the flankers and whether participants made a saccade. Masking and randomizing flanker orientation reduced performance in both fixation and saccade trials. We found a small improvement in performance on saccade trials, compared to fixation trials, with a time course that was consistent with a general enhancement at the saccade target. In addition, a decrement in performance (reporting the average flanker orientation, rather than the target) was found in the time bins nearest saccade onset when random oriented flankers were used, consistent with spatial pooling around the saccade target. We did not find strong evidence for un-crowding. Overall, our pattern of results was consistent with both an early, general enhancement at the saccade target and a later, peri-saccadic compression/pooling towards the saccade target.
Collapse
Affiliation(s)
- Antimo Buonocore
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany
- * E-mail:
| | - Alessio Fracasso
- Spinoza Center for Neuroimaging, Amsterdam Zuidoost, Netherlands
- Radiology, Imaging Division, University Medical Center Utrecht, Utrecht, Netherlands
| | - David Melcher
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| |
Collapse
|
38
|
Shafer-Skelton A, Kupitz CN, Golomb JD. Object-location binding across a saccade: A retinotopic spatial congruency bias. Atten Percept Psychophys 2017; 79:765-781. [PMID: 28070793 PMCID: PMC5354979 DOI: 10.3758/s13414-016-1263-8] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Despite frequent eye movements that rapidly shift the locations of objects on our retinas, our visual system creates a stable perception of the world. To do this, it must convert eye-centered (retinotopic) input to world-centered (spatiotopic) percepts. Moreover, for successful behavior we must also incorporate information about object features/identities during this updating - a fundamental challenge that remains to be understood. Here we adapted a recent behavioral paradigm, the "spatial congruency bias," to investigate object-location binding across an eye movement. In two initial baseline experiments, we showed that the spatial congruency bias was present for both gabor and face stimuli in addition to the object stimuli used in the original paradigm. Then, across three main experiments, we found the bias was preserved across an eye movement, but only in retinotopic coordinates: Subjects were more likely to perceive two stimuli as having the same features/identity when they were presented in the same retinotopic location. Strikingly, there was no evidence of location binding in the more ecologically relevant spatiotopic (world-centered) coordinates; the reference frame did not update to spatiotopic even at longer post-saccade delays, nor did it transition to spatiotopic with more complex stimuli (gabors, shapes, and faces all showed a retinotopic congruency bias). Our results suggest that object-location binding may be tied to retinotopic coordinates, and that it may need to be re-established following each eye movement rather than being automatically updated to spatiotopic coordinates.
Collapse
Affiliation(s)
- Anna Shafer-Skelton
- Department of Psychology, The Ohio State University, Columbus, OH, 43210, USA
| | - Colin N Kupitz
- Department of Psychology, The Ohio State University, Columbus, OH, 43210, USA
| | - Julie D Golomb
- Department of Psychology, The Ohio State University, Columbus, OH, 43210, USA.
| |
Collapse
|
39
|
Hartmann TS, Zirnsak M, Marquis M, Hamker FH, Moore T. Two Types of Receptive Field Dynamics in Area V4 at the Time of Eye Movements? Front Syst Neurosci 2017; 11:13. [PMID: 28377700 PMCID: PMC5359274 DOI: 10.3389/fnsys.2017.00013] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2017] [Accepted: 03/01/2017] [Indexed: 11/13/2022] Open
Abstract
How we perceive the world as stable despite the frequent disruptions of the retinal image caused by eye movements is one of the fundamental questions in sensory neuroscience. Seemingly convergent evidence points towards a mechanism which dynamically updates representations of visual space in anticipation of a movement (Wurtz, 2008). In particular, receptive fields (RFs) of neurons, predominantly within oculomotor and attention related brain structures (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 1997), are thought to "remap" to their future, post-movement location prior to an impending eye movement. New studies (Neupane et al., 2016a,b) report observations on RF dynamics at the time of eye movements of neurons in area V4. These dynamics are interpreted as being largely dominated by a remapping of RFs. Critically, these observations appear at odds with a previous study reporting a different type of RF dynamics within the same brain structure (Tolias et al., 2001), consisting of a shrinkage and shift of RFs towards the movement target. Importantly, RFs have been measured with different techniques in those studies. Here, we measured V4 RFs comparable to Neupane et al. (2016a,b) and observe a shrinkage and shift of RFs towards the movement target when analyzing the immediate stimulus response (Zirnsak et al., 2014). When analyzing the late stimulus response (Neupane et al., 2016a,b), we observe RF shifts resembling remapping. We discuss possible causes for these shifts and point out important issues which future studies on RF dynamics need to address.
Collapse
Affiliation(s)
- Till S Hartmann
- Department of Neurobiology, Harvard Medical School Boston, MA, USA
| | - Marc Zirnsak
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University School of Medicine Stanford, CA, USA
| | - Michael Marquis
- Department of Neurobiology, Harvard Medical School Boston, MA, USA
| | - Fred H Hamker
- Department of Computer Science, Chemnitz University of Technology Chemnitz, Germany
| | - Tirin Moore
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University School of Medicine Stanford, CA, USA
| |
Collapse
|
40
|
Northmore DPM. Holding visual attention for 400millionyears: A model of tectum and torus longitudinalis in teleost fishes. Vision Res 2017; 131:44-56. [PMID: 28025052 DOI: 10.1016/j.visres.2016.12.001] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2016] [Revised: 11/20/2016] [Accepted: 12/08/2016] [Indexed: 11/30/2022]
Abstract
Only ray-finned fishes possess a torus longitudinalis (TL), a paired, elongated body attached to the medial margins of the optic tectum. Its granule cells project large numbers of fine fibers running laterally over adjacent tectum, synapsing excitatorily on the spiny dendrites of pyramidal cells. Sustained TL activity is evoked visuotopically by dark stimuli; TL bursting is a corollary discharge of saccadic eye movements. To suggest a function for this ancient structure, neural network models were constructed to show that: (1) pyramidal cells could form an attentional locus, selecting one out of several moving objects to track, but rapid image shifts caused by saccades disrupt tracking; (2) TL could supply both the pre-saccade position of a locus, and the shift predicted from a saccade so as to prime pyramidal dendrites at the target location, ensuring the locus stays with the attended object; (3) that the specific pattern of synaptic connections required for such predictive priming could be learned by an unsupervised rule; (4) temporal and spatial filtering of visual pattern input to TL allows learning from a complex scene. The principles thus evinced could apply to trans-saccadic attention and visual stability in other species.
Collapse
Affiliation(s)
- David P M Northmore
- Dept. of Psychological and Brain Sciences, University of Delaware, Newark, DE 19716, USA.
| |
Collapse
|
41
|
Abstract
Selective visual attention describes the tendency of visual processing to be confined largely to stimuli that are relevant to behavior. It is among the most fundamental of cognitive functions, particularly in humans and other primates for whom vision is the dominant sense. We review recent progress in identifying the neural mechanisms of selective visual attention. We discuss evidence from studies of different varieties of selective attention and examine how these varieties alter the processing of stimuli by neurons within the visual system, current knowledge of their causal basis, and methods for assessing attentional dysfunctions. In addition, we identify some key questions that remain in identifying the neural mechanisms that give rise to the selective processing of visual information.
Collapse
Affiliation(s)
- Tirin Moore
- Department of Neurobiology, Stanford University School of Medicine, Stanford, California 94305; , .,Howard Hughes Medical Institute, Stanford, California 94305
| | - Marc Zirnsak
- Department of Neurobiology, Stanford University School of Medicine, Stanford, California 94305; , .,Howard Hughes Medical Institute, Stanford, California 94305
| |
Collapse
|
42
|
Fabius JH, Fracasso A, Van der Stigchel S. Spatiotopic updating facilitates perception immediately after saccades. Sci Rep 2016; 6:34488. [PMID: 27686998 PMCID: PMC5043283 DOI: 10.1038/srep34488] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2016] [Accepted: 09/14/2016] [Indexed: 11/08/2022] Open
Abstract
As the neural representation of visual information is initially coded in retinotopic coordinates, eye movements (saccades) pose a major problem for visual stability. If no visual information were maintained across saccades, retinotopic representations would have to be rebuilt after each saccade. It is currently strongly debated what kind of information (if any at all) is accumulated across saccades, and when this information becomes available after a saccade. Here, we use a motion illusion to examine the accumulation of visual information across saccades. In this illusion, an annulus with a random texture slowly rotates, and is then replaced with a second texture (motion transient). With increasing rotation durations, observers consistently perceive the transient as large rotational jumps in the direction opposite to rotation direction (backward jumps). We first show that accumulated motion information is updated spatiotopically across saccades. Then, we show that this accumulated information is readily available after a saccade, immediately biasing postsaccadic perception. The current findings suggest that presaccadic information is used to facilitate postsaccadic perception and are in support of a forward model of transsaccadic perception, aiming at anticipating the consequences of eye movements and operating within the narrow perisaccadic time window.
Collapse
Affiliation(s)
- Jasper H. Fabius
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584 CS Utrecht, The Netherlands
| | - Alessio Fracasso
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584 CS Utrecht, The Netherlands
- Radiology, Center for Image Sciences, University Medical Center Utrecht, 3584 CX Utrecht, The Netherlands
- Spinoza Centre for Neuroimaging, University of Amsterdam, 1105 BK Amsterdam, The Netherlands
| | - Stefan Van der Stigchel
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584 CS Utrecht, The Netherlands
| |
Collapse
|
43
|
Szinte M, Jonikaitis D, Rolfs M, Cavanagh P, Deubel H. Presaccadic motion integration between current and future retinotopic locations of attended objects. J Neurophysiol 2016; 116:1592-1602. [PMID: 27385792 DOI: 10.1152/jn.00171.2016] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2016] [Accepted: 07/05/2016] [Indexed: 11/22/2022] Open
Abstract
Object tracking across eye movements is thought to rely on presaccadic updating of attention between the object's current and its "remapped" location (i.e., the postsaccadic retinotopic location). We report evidence for a bifocal, presaccadic sampling between these two positions. While preparing a saccade, participants viewed four spatially separated random dot kinematograms, one of which was cued by a colored flash. They reported the direction of a coherent motion signal at the cued location while a second signal occurred simultaneously either at the cue's remapped location or at one of several control locations. Motion integration between the signals occurred only when the two motion signals were congruent and were shown at the cue and at its remapped location. This shows that the visual system integrates features between both the current and the future retinotopic locations of an attended object and that such presaccadic sampling is feature specific.
Collapse
Affiliation(s)
- Martin Szinte
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany;
| | - Donatas Jonikaitis
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Martin Rolfs
- Bernstein Center for Computational Neuroscience and Department of Psychology, Humboldt Universität zu Berlin, Berlin, Germany
| | - Patrick Cavanagh
- Laboratoire Psychologie de la Perception, Université Paris Descartes and Centre National de la Recherche Scientifique (UMR 8242), Paris, France; and Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire
| | - Heiner Deubel
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
44
|
Lescroart MD, Kanwisher N, Golomb JD. No Evidence for Automatic Remapping of Stimulus Features or Location Found with fMRI. Front Syst Neurosci 2016; 10:53. [PMID: 27378866 PMCID: PMC4904027 DOI: 10.3389/fnsys.2016.00053] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2016] [Accepted: 05/27/2016] [Indexed: 11/21/2022] Open
Abstract
The input to our visual system shifts every time we move our eyes. To maintain a stable percept of the world, visual representations must be updated with each saccade. Near the time of a saccade, neurons in several visual areas become sensitive to the regions of visual space that their receptive fields occupy after the saccade. This process, known as remapping, transfers information from one set of neurons to another, and may provide a mechanism for visual stability. However, it is not clear whether remapping transfers information about stimulus features in addition to information about stimulus location. To investigate this issue, we recorded blood-oxygen-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses while human subjects viewed images of faces and houses (two visual categories with many feature differences). Immediately after some image presentations, subjects made a saccade that moved the previously stimulated location to the opposite side of the visual field. We then used a combination of univariate analyses and multivariate pattern analyses to test whether information about stimulus location and stimulus features were remapped to the ipsilateral hemisphere after the saccades. We found no reliable indication of stimulus feature remapping in any region. However, we also found no reliable indication of stimulus location remapping, despite the fact that our paradigm was highly similar to previous fMRI studies of remapping. The absence of location remapping in our study precludes strong conclusions regarding feature remapping. However, these results also suggest that measurement of location remapping with fMRI depends strongly on the details of the experimental paradigm used. We highlight differences in our approach from the original fMRI studies of remapping, discuss potential reasons for the failure to generalize prior location remapping results, and suggest directions for future research.
Collapse
Affiliation(s)
- Mark D Lescroart
- Helen Wills Neuroscience Institute, University of California Berkeley, CA, USA
| | - Nancy Kanwisher
- McGovern Center for Brain Research, Massachusetts Institute of Technology Cambridge, MA, USA
| | - Julie D Golomb
- Department of Psychology, Center for Cognitive and Brain Sciences, Ohio State University Columbus, OH, USA
| |
Collapse
|
45
|
Abstract
Saccadic remapping, a presaccadic increase in neural activity when a saccade is about to bring an object into a neuron's receptive field, may be crucial for our perception of a stable world. Studies of perception and saccadic remapping, like ours, focus on the presaccadic acquisition of information from the saccade target, with no direct reference to underlying physiology. While information is known to be acquired prior to a saccade, it is unclear whether object-selective or feature-specific information is remapped. To test this, we performed a series of psychophysical experiments in which we presented a peripheral, nonfoveated face as a presaccadic target. The target face disappeared at saccade onset. After making a saccade to the location of the peripheral target face (which was no longer visible), subjects misperceived the expression of a subsequent, foveally presented neutral face as being repelled away from the peripheral presaccadic face target. This effect was similar to a sequential shape contrast or negative aftereffect but required a saccade, because covert attention was not sufficient to generate the illusion. Additional experiments further revealed that inverting the faces disrupted the illusion, suggesting that presaccadic remapping is object-selective and not based on low-level features. Our results demonstrate that saccadic remapping can be an object-selective process, spatially tuned to the target of the saccade and distinct from covert attention in the absence of a saccade.
Collapse
|
46
|
Abstract
UNLABELLED Saccadic eye movements direct the high-resolution foveae of our retinas toward objects of interest. With each saccade, the image jumps on the retina, causing a discontinuity in visual input. Our visual perception, however, remains stable. Philosophers and scientists over centuries have proposed that visual stability depends upon an internal neuronal signal that is a copy of the neuronal signal driving the eye movement, now referred to as a corollary discharge (CD) or efference copy. In the old world monkey, such a CD circuit for saccades has been identified extending from superior colliculus through MD thalamus to frontal cortex, but there is little evidence that this circuit actually contributes to visual perception. We tested the influence of this CD circuit on visual perception by first training macaque monkeys to report their perceived eye direction, and then reversibly inactivating the CD as it passes through the thalamus. We found that the monkey's perception changed; during CD inactivation, there was a difference between where the monkey perceived its eyes to be directed and where they were actually directed. Perception and saccade were decoupled. We established that the perceived eye direction at the end of the saccade was not derived from proprioceptive input from eye muscles, and was not altered by contextual visual information. We conclude that the CD provides internal information contributing to the brain's creation of perceived visual stability. More specifically, the CD might provide the internal saccade vector used to unite separate retinal images into a stable visual scene. SIGNIFICANCE STATEMENT Visual stability is one of the most remarkable aspects of human vision. The eyes move rapidly several times per second, displacing the retinal image each time. The brain compensates for this disruption, keeping our visual perception stable. A major hypothesis explaining this stability invokes a signal within the brain, a corollary discharge, that informs visual regions of the brain when and where the eyes are about to move. Such a corollary discharge circuit for eye movements has been identified in macaque monkey. We now show that selectively inactivating this brain circuit alters the monkey's visual perception. We conclude that this corollary discharge provides a critical signal that can be used to unite jumping retinal images into a consistent visual scene.
Collapse
|
47
|
Rolfs M, Szinte M. Remapping Attention Pointers: Linking Physiology and Behavior. Trends Cogn Sci 2016; 20:399-401. [PMID: 27118641 DOI: 10.1016/j.tics.2016.04.003] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2016] [Accepted: 04/12/2016] [Indexed: 10/21/2022]
Abstract
Our eyes rapidly scan visual scenes, displacing the projection on the retina with every move. Yet these frequent retinal image shifts do not appear to hamper vision. Two recent physiological studies shed new light on the role of attention in visual processing across saccadic eye movements.
Collapse
Affiliation(s)
- Martin Rolfs
- Department of Psychology and Bernstein Center for Computational Neuroscience, Humboldt Universität zu Berlin, 10099 Berlin, Germany.
| | - Martin Szinte
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, 80802, Germany
| |
Collapse
|
48
|
Wang X, Fung CCA, Guan S, Wu S, Goldberg ME, Zhang M. Perisaccadic Receptive Field Expansion in the Lateral Intraparietal Area. Neuron 2016; 90:400-9. [PMID: 27041502 DOI: 10.1016/j.neuron.2016.02.035] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2015] [Revised: 01/27/2016] [Accepted: 02/19/2016] [Indexed: 11/26/2022]
Abstract
Humans and monkeys have access to an accurate representation of visual space despite a constantly moving eye. One mechanism by which the brain accomplishes this is by remapping visual receptive fields around the time of a saccade. In this process a neuron can be excited by a probe stimulus in the current receptive field, and also simultaneously by a probe stimulus in the location that will be brought into the neuron's receptive field by the saccade (the future receptive field), even before saccade begins. Here we show that perisaccadic neuronal excitability is not limited to the current and future receptive fields but encompasses the entire region of visual space across which the current receptive field will be swept by the saccade. A computational model shows that this receptive field expansion is consistent with the propagation of a wave of activity across the cerebral cortex as saccade planning and remapping proceed.
Collapse
Affiliation(s)
- Xiaolan Wang
- Department of Neuroscience, College of Physicians and Surgeons, Columbia University, New York, NY 10032, USA; Kavli Institute for Neuroscience, Columbia University, New York, NY 10032, USA
| | - C C Alan Fung
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China; Department of Physics, The Hong Kong University of Science and Technology, Clear Water, Hong Kong, China
| | - Shaobo Guan
- Department of Neuroscience, Brown University, Providence, RI 02912, USA
| | - Si Wu
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China.
| | - Michael E Goldberg
- Department of Neuroscience, College of Physicians and Surgeons, Columbia University, New York, NY 10032, USA; Mahoney-Keck Center for Brain and Behavior Research, Department of Neuroscience, College of Physicians and Surgeons, Columbia University, New York, NY 10032, USA; Departments of Neurology, Psychiatry, and Ophthalmology, College of Physicians and Surgeons, Columbia University, New York, NY 10032, USA; Kavli Institute for Neuroscience, Columbia University, New York, NY 10032, USA; Division of Neurobiology and Behavior, New York State Psychiatric Institute, New York, NY 10032, USA
| | - Mingsha Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, China.
| |
Collapse
|
49
|
Born S, Krüger HM, Zimmermann E, Cavanagh P. Compression of Space for Low Visibility Probes. Front Syst Neurosci 2016; 10:21. [PMID: 27013989 PMCID: PMC4785237 DOI: 10.3389/fnsys.2016.00021] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2015] [Accepted: 02/20/2016] [Indexed: 11/26/2022] Open
Abstract
Stimuli briefly flashed just before a saccade are perceived closer to the saccade target, a phenomenon known as perisaccadic compression of space (Ross et al., 1997). More recently, we have demonstrated that brief probes are attracted towards a visual reference when followed by a mask, even in the absence of saccades (Zimmermann et al., 2014a). Here, we ask whether spatial compression depends on the transient disruptions of the visual input stream caused by either a mask or a saccade. Both of these degrade the probe visibility but we show that low probe visibility alone causes compression in the absence of any disruption. In a first experiment, we varied the regions of the screen covered by a transient mask, including areas where no stimulus was presented and a condition without masking. In all conditions, we adjusted probe contrast to make the probe equally hard to detect. Compression effects were found in all conditions. To obtain compression without a mask, the probe had to be presented at much lower contrasts than with masking. Comparing mislocalizations at different probe detection rates across masking, saccades and low contrast conditions without mask or saccade, Experiment 2 confirmed this observation and showed a strong influence of probe contrast on compression. Finally, in Experiment 3, we found that compression decreased as probe duration increased both for masks and saccades although here we did find some evidence that factors other than simply visibility as we measured it contribute to compression. Our experiments suggest that compression reflects how the visual system localizes weak targets in the context of highly visible stimuli.
Collapse
Affiliation(s)
- Sabine Born
- Centre Attention & Vision, Laboratoire Psychologie de la Perception, Université Paris Descartes, Sorbonne Paris Cité, CNRS UMR 8242Paris, France; Equipe Cognition Visuelle, Faculté de Psychologie et des Sciences de l'Education, Université de GenèveGenève, Switzerland
| | - Hannah M Krüger
- Centre Attention & Vision, Laboratoire Psychologie de la Perception, Université Paris Descartes, Sorbonne Paris Cité, CNRS UMR 8242 Paris, France
| | - Eckart Zimmermann
- Cognitive Neuroscience, Institute of Neuroscience and Medicine (INM-3), Research Centre Jülich Jülich, Germany
| | - Patrick Cavanagh
- Centre Attention & Vision, Laboratoire Psychologie de la Perception, Université Paris Descartes, Sorbonne Paris Cité, CNRS UMR 8242Paris, France; Department of Psychological and Brain Sciences, Dartmouth CollegeHanover, NH, USA
| |
Collapse
|
50
|
Yao T, Treue S, Krishna BS. An Attention-Sensitive Memory Trace in Macaque MT Following Saccadic Eye Movements. PLoS Biol 2016; 14:e1002390. [PMID: 26901857 PMCID: PMC4764326 DOI: 10.1371/journal.pbio.1002390] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2015] [Accepted: 01/26/2016] [Indexed: 12/02/2022] Open
Abstract
We experience a visually stable world despite frequent retinal image displacements induced by eye, head, and body movements. The neural mechanisms underlying this remain unclear. One mechanism that may contribute is transsaccadic remapping, in which the responses of some neurons in various attentional, oculomotor, and visual brain areas appear to anticipate the consequences of saccades. The functional role of transsaccadic remapping is actively debated, and many of its key properties remain unknown. Here, recording from two monkeys trained to make a saccade while directing attention to one of two spatial locations, we show that neurons in the middle temporal area (MT), a key locus in the motion-processing pathway of humans and macaques, show a form of transsaccadic remapping called a memory trace. The memory trace in MT neurons is enhanced by the allocation of top-down spatial attention. Our data provide the first demonstration, to our knowledge, of the influence of top-down attention on the memory trace anywhere in the brain. We find evidence only for a small and transient effect of motion direction on the memory trace (and in only one of two monkeys), arguing against a role for MT in the theoretically critical yet empirically contentious phenomenon of spatiotopic feature-comparison and adaptation transfer across saccades. Our data support the hypothesis that transsaccadic remapping represents the shift of attentional pointers in a retinotopic map, so that relevant locations can be tracked and rapidly processed across saccades. Our results resolve important issues concerning the perisaccadic representation of visual stimuli in the dorsal stream and demonstrate a significant role for top-down attention in modulating this representation. How does the brain keep track of specific attended features after eye movements? A new study of the macaque brain implicates the middle temporal (MT) area in the remapping of attentional pointers across saccades. Humans experience a visually stable world despite the fact that eye, head, and body movements cause frequent shifts of the image on the retina. Humans and monkeys are also able to keep track of visual stimuli across such movements. One mechanism that may contribute to these abilities is “transsaccadic remapping,” in which the responses of some neurons in various attentional, oculomotor, and visual brain areas appear to anticipate the consequences of saccades. A current hypothesis proposes that the brain maintains “attentional pointers” to the locations of relevant stimuli and that, via transsaccadic remapping, it rapidly relocates these pointers to compensate for intervening eye movements. Whether stimulus features are also remapped across saccades (along with their location) remains unclear. Here, we show the presence of transsaccadic remapping in a macaque monkey brain area critical for visual motion processing, the middle temporal area (MT). This remapped response is stronger for an attended stimulus. We find only weak evidence for motion-direction information in the remapped response. These results support the attentional pointer hypothesis and demonstrate for the first time, to our knowledge, the impact of top-down attention on transsaccadic remapping in the brain.
Collapse
Affiliation(s)
- Tao Yao
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany
- * E-mail: (TY); (BSK)
| | - Stefan Treue
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany
- Bernstein Center for Computational Neuroscience, Goettingen, Germany
- Faculty of Biology and Psychology, Goettingen University, Goettingen, Germany
| | - B. Suresh Krishna
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany
- * E-mail: (TY); (BSK)
| |
Collapse
|