1
|
Veale R, Takahashi M. Pathways for Naturalistic Looking Behavior in Primate II. Superior Colliculus Integrates Parallel Top-down and Bottom-up Inputs. Neuroscience 2024; 545:86-110. [PMID: 38484836 DOI: 10.1016/j.neuroscience.2024.03.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Revised: 02/15/2024] [Accepted: 03/01/2024] [Indexed: 03/24/2024]
Abstract
Volitional signals for gaze control are provided by multiple parallel pathways converging on the midbrain superior colliculus (SC), whose deeper layers output to the brainstem gaze circuits. In the first of two papers (Takahashi and Veale, 2023), we described the properties of gaze behavior of several species under both laboratory and natural conditions, as well as the current understanding of the brainstem and spinal cord circuits implementing gaze control in primate. In this paper, we review the parallel pathways by which sensory and task information reaches SC and how these sensory and task signals interact within SC's multilayered structure. This includes both bottom-up (world statistics) signals mediated by sensory cortex, association cortex, and subcortical structures, as well as top-down (goal and task) influences which arrive via either direct excitatory pathways from cerebral cortex, or via indirect basal ganglia relays resulting in inhibition or dis-inhibition as appropriate for alternative behaviors. Models of attention such as saliency maps serve as convenient frameworks to organize our understanding of both the separate computations of each neural pathway, as well as the interaction between the multiple parallel pathways influencing gaze. While the spatial interactions between gaze's neural pathways are relatively well understood, the temporal interactions between and within pathways will be an important area of future study, requiring both improved technical methods for measurement and improvement of our understanding of how temporal dynamics results in the observed spatiotemporal allocation of gaze.
Collapse
Affiliation(s)
- Richard Veale
- Department of Neurobiology, Graduate School of Medicine, Kyoto University, Japan
| | - Mayu Takahashi
- Department of Systems Neurophysiology, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Japan.
| |
Collapse
|
2
|
Ayar EC, Heusser MR, Bourrelly C, Gandhi NJ. Distinct context- and content-dependent population codes in superior colliculus during sensation and action. Proc Natl Acad Sci U S A 2023; 120:e2303523120. [PMID: 37748075 PMCID: PMC10556644 DOI: 10.1073/pnas.2303523120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 08/23/2023] [Indexed: 09/27/2023] Open
Abstract
Sensorimotor transformation is the process of first sensing an object in the environment and then producing a movement in response to that stimulus. For visually guided saccades, neurons in the superior colliculus (SC) emit a burst of spikes to register the appearance of stimulus, and many of the same neurons discharge another burst to initiate the eye movement. We investigated whether the neural signatures of sensation and action in SC depend on context. Spiking activity along the dorsoventral axis was recorded with a laminar probe as Rhesus monkeys generated saccades to the same stimulus location in tasks that require either executive control to delay saccade onset until permission is granted or the production of an immediate response to a target whose onset is predictable. Using dimensionality reduction and discriminability methods, we show that the subspaces occupied during the visual and motor epochs were both distinct within each task and differentiable across tasks. Single-unit analyses, in contrast, show that the movement-related activity of SC neurons was not different between tasks. These results demonstrate that statistical features in neural activity of simultaneously recorded ensembles provide more insight than single neurons. They also indicate that cognitive processes associated with task requirements are multiplexed in SC population activity during both sensation and action and that downstream structures could use this activity to extract context. Additionally, the entire manifolds associated with sensory and motor responses, respectively, may be larger than the subspaces explored within a certain set of experiments.
Collapse
Affiliation(s)
- Eve C. Ayar
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA15213
- Program in Neural Computation, Carnegie Mellon University, Pittsburgh, PA15213
- Center for Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA15213
| | - Michelle R. Heusser
- Center for Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA15213
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA15213
| | - Clara Bourrelly
- Center for Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA15213
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA15213
| | - Neeraj J. Gandhi
- Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA15213
- Program in Neural Computation, Carnegie Mellon University, Pittsburgh, PA15213
- Center for Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA15213
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA15213
- Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA15213
| |
Collapse
|
3
|
Conroy C, Nanjappa R, McPeek RM. Inhibitory tagging in the superior colliculus during visual search. J Neurophysiol 2023; 130:824-837. [PMID: 37671440 PMCID: PMC10637734 DOI: 10.1152/jn.00095.2023] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 08/29/2023] [Accepted: 08/30/2023] [Indexed: 09/07/2023] Open
Abstract
Inhibitory tagging is an important feature of many models of saccade target selection, in particular those that are based on the notion of a neural priority map. The superior colliculus (SC) has been suggested as a potential site of such a map, yet it is unknown whether inhibitory tagging is represented in the SC during visual search. In this study, we tested the hypothesis that SC neurons represent inhibitory tagging during search, as might be expected if they contribute to a priority map. To do so, we recorded the activity of SC neurons in a multisaccade visual-search task. On each trial, a single reward-bearing target was embedded in an array of physically identical, potentially reward-bearing targets and physically distinct, non-reward-bearing distractors. The task was to fixate the reward-bearing target. We found that, in the context of this task, the activity of many SC neurons was greater when their response field stimulus was a target than when it was a distractor and was reduced when it had been previously fixated relative to when it had not. Moreover, we found that the previous-fixation-related reduction of activity was larger for targets than for distractors and decreased with increasing time (or number of saccades) since fixation. Taken together, the results suggest that fixated stimuli are transiently inhibited in the SC during search, consistent with the notion that inhibitory tagging plays an important role in visual search and that SC neurons represent this inhibition as part of a priority map used for saccade target selection.NEW & NOTEWORTHY Searching a cluttered scene for an object of interest is a ubiquitous task in everyday life, which we often perform relatively quickly and efficiently. It has been suggested that to achieve such speed and efficiency an inhibitory-tagging mechanism inhibits saccades to objects in the scene once they have been searched and rejected. Here, we demonstrate that the superior colliculus represents this type of inhibition during search, consistent with its role in saccade target selection.
Collapse
Affiliation(s)
- Christopher Conroy
- Department of Biological and Vision Sciences, SUNY College of Optometry, New York, New York, United States
| | - Rakesh Nanjappa
- Department of Biological and Vision Sciences, SUNY College of Optometry, New York, New York, United States
- School of Medical and Allied Sciences, G D Goenka University, Gurugram, India
| | - Robert M McPeek
- Department of Biological and Vision Sciences, SUNY College of Optometry, New York, New York, United States
| |
Collapse
|
4
|
Basso MA, Bickford ME, Cang J. Unraveling circuits of visual perception and cognition through the superior colliculus. Neuron 2021; 109:918-937. [PMID: 33548173 PMCID: PMC7979487 DOI: 10.1016/j.neuron.2021.01.013] [Citation(s) in RCA: 82] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Revised: 12/29/2020] [Accepted: 01/13/2021] [Indexed: 12/11/2022]
Abstract
The superior colliculus is a conserved sensorimotor structure that integrates visual and other sensory information to drive reflexive behaviors. Although the evidence for this is strong and compelling, a number of experiments reveal a role for the superior colliculus in behaviors usually associated with the cerebral cortex, such as attention and decision-making. Indeed, in addition to collicular outputs targeting brainstem regions controlling movements, the superior colliculus also has ascending projections linking it to forebrain structures including the basal ganglia and amygdala, highlighting the fact that the superior colliculus, with its vast inputs and outputs, can influence processing throughout the neuraxis. Today, modern molecular and genetic methods combined with sophisticated behavioral assessments have the potential to make significant breakthroughs in our understanding of the evolution and conservation of neuronal cell types and circuits in the superior colliculus that give rise to simple and complex behaviors.
Collapse
Affiliation(s)
- Michele A Basso
- Fuster Laboratory of Cognitive Neuroscience, Department of Psychiatry and Biobehavioral Sciences, Jane and Terry Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
| | | | - Jianhua Cang
- University of Virginia, Charlottesville, VA, USA
| |
Collapse
|
5
|
Abstract
Our vision depends upon shifting our high-resolution fovea to objects of interest in the visual field. Each saccade displaces the image on the retina, which should produce a chaotic scene with jerks occurring several times per second. It does not. This review examines how an internal signal in the primate brain (a corollary discharge) contributes to visual continuity across saccades. The article begins with a review of evidence for a corollary discharge in the monkey and evidence from inactivation experiments that it contributes to perception. The next section examines a specific neuronal mechanism for visual continuity, based on corollary discharge that is referred to as visual remapping. Both the basic characteristics of this anticipatory remapping and the factors that control it are enumerated. The last section considers hypotheses relating remapping to the perceived visual continuity across saccades, including remapping's contribution to perceived visual stability across saccades.
Collapse
Affiliation(s)
- Robert H Wurtz
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, Maryland 20892-4435, USA;
| |
Collapse
|
6
|
Updating spatial working memory in a dynamic visual environment. Cortex 2019; 119:267-286. [PMID: 31170650 DOI: 10.1016/j.cortex.2019.04.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Revised: 04/17/2019] [Accepted: 04/26/2019] [Indexed: 11/22/2022]
Abstract
The present review describes recent developments regarding the role of the eye movement system in representing spatial information and keeping track of locations of relevant objects. First, we discuss the active vision perspective and why eye movements are considered crucial for perception and attention. The second part focuses on the question of how the oculomotor system is used to represent spatial attentional priority, and the role of the oculomotor system in maintenance of this spatial information. Lastly, we discuss recent findings demonstrating rapid updating of information across saccadic eye movements. We argue that the eye movement system plays a key role in maintaining and rapidly updating spatial information. Furthermore, we suggest that rapid updating emerges primarily to make sure actions are minimally affected by intervening eye movements, allowing us to efficiently interact with the world around us.
Collapse
|
7
|
Abstract
Each time we make an eye movement, positions of objects on the retina change. In order to keep track of relevant objects their positions have to be updated. The situation becomes even more complex if the object is no longer present in the world and has to be held in memory. In the present study, we used saccadic curvature to investigate the time-course of updating a memorized location across saccades. Previous studies have shown that a memorized location competes with a saccade target for selection on the oculomotor map, which leads to saccades curving away from it. In our study participants performed a sequence of two saccades while keeping a location in memory. The trajectory of the second saccade was used to measure when the memorized location was updated after the first saccade. The results showed that the memorized location was rapidly updated with the eyes curving away from its spatial coordinates within 130 ms after the first eye movement. The time-course of updating was comparable to the updating of an exogenously attended location, and depended on how well the location was memorized.
Collapse
|
8
|
Abstract
The superior colliculus is one of the most well-studied structures in the brain, and with each new report, its proposed role in behavior seems to increase in complexity. Forty years of evidence show that the colliculus is critical for reorienting an organism toward objects of interest. In monkeys, this involves saccadic eye movements. Recent work in the monkey colliculus and in the homologous optic tectum of the bird extends our understanding of the role of the colliculus in higher mental functions, such as attention and decision making. In this review, we highlight some of these recent results, as well as those capitalizing on circuit-based methodologies using transgenic mice models, to understand the contribution of the colliculus to attention and decision making. The wealth of information we have about the colliculus, together with new tools, provides a unique opportunity to obtain a detailed accounting of the neurons, circuits, and computations that underlie complex behavior.
Collapse
Affiliation(s)
- Michele A Basso
- Fuster Laboratory of Cognitive Neuroscience, Department of Psychiatry and Biobehavioral Sciences and Neurobiology, Semel Institute for Neuroscience and Human Behavior, Brain Research Institute, David Geffen School of Medicine, University of California, Los Angeles, California 90095;
| | - Paul J May
- Department of Neurobiology and Anatomical Sciences, University of Mississippi Medical Center, Jackson, Mississippi 39216
| |
Collapse
|
9
|
Boon PJ, Belopolsky AV, Theeuwes J. The Role of the Oculomotor System in Updating Visual-Spatial Working Memory across Saccades. PLoS One 2016; 11:e0161829. [PMID: 27631767 PMCID: PMC5025159 DOI: 10.1371/journal.pone.0161829] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2016] [Accepted: 08/14/2016] [Indexed: 01/08/2023] Open
Abstract
Visual-spatial working memory (VSWM) helps us to maintain and manipulate visual information in the absence of sensory input. It has been proposed that VSWM is an emergent property of the oculomotor system. In the present study we investigated the role of the oculomotor system in updating of spatial working memory representations across saccades. Participants had to maintain a location in memory while making a saccade to a different location. During the saccade the target was displaced, which went unnoticed by the participants. After executing the saccade, participants had to indicate the memorized location. If memory updating fully relies on cancellation driven by extraretinal oculomotor signals, the displacement should have no effect on the perceived location of the memorized stimulus. However, if postsaccadic retinal information about the location of the saccade target is used, the perceived location will be shifted according to the target displacement. As it has been suggested that maintenance of accurate spatial representations across saccades is especially important for action control, we used different ways of reporting the location held in memory; a match-to-sample task, a mouse click or by making another saccade. The results showed a small systematic target displacement bias in all response modalities. Parametric manipulation of the distance between the to-be-memorized stimulus and saccade target revealed that target displacement bias increased over time and changed its spatial profile from being initially centered on locations around the saccade target to becoming spatially global. Taken together results suggest that we neither rely exclusively on extraretinal nor on retinal information in updating working memory representations across saccades. The relative contribution of retinal signals is not fixed but depends on both the time available to integrate these signals as well as the distance between the saccade target and the remembered location.
Collapse
Affiliation(s)
- Paul J. Boon
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, The Netherlands
- * E-mail:
| | - Artem V. Belopolsky
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, The Netherlands
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit, Amsterdam, The Netherlands
| |
Collapse
|
10
|
Inaba N, Kawano K. Eye position effects on the remapped memory trace of visual motion in cortical area MST. Sci Rep 2016; 6:22013. [PMID: 26903084 PMCID: PMC4763206 DOI: 10.1038/srep22013] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2015] [Accepted: 02/03/2016] [Indexed: 11/09/2022] Open
Abstract
After a saccade, most MST neurons respond to moving visual stimuli that had existed in their post-saccadic receptive fields and turned off before the saccade ("trans-saccadic memory remapping"). Neuronal responses in higher visual processing areas are known to be modulated in relation to gaze angle to represent image location in spatiotopic coordinates. In the present study, we investigated the eye position effects after saccades and found that the gaze angle modulated the visual sensitivity of MST neurons after saccades both to the actually existing visual stimuli and to the visual memory traces remapped by the saccades. We suggest that two mechanisms, trans-saccadic memory remapping and gaze modulation, work cooperatively in individual MST neurons to represent a continuous visual world.
Collapse
Affiliation(s)
- Naoko Inaba
- Department of Integrative Brain Science, Graduate School of Medicine, Kyoto University. Kyoto 606-8501, Japan.,Department of Physiology, Hokkaido University School of Medicine. Sapporo 060-8638, Japan
| | - Kenji Kawano
- Department of Integrative Brain Science, Graduate School of Medicine, Kyoto University. Kyoto 606-8501, Japan
| |
Collapse
|
11
|
Transsaccadic processing: stability, integration, and the potential role of remapping. Atten Percept Psychophys 2015; 77:3-27. [PMID: 25380979 DOI: 10.3758/s13414-014-0751-y] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
While our frequent saccades allow us to sample the complex visual environment in a highly efficient manner, they also raise certain challenges for interpreting and acting upon visual input. In the present, selective review, we discuss key findings from the domains of cognitive psychology, visual perception, and neuroscience concerning two such challenges: (1) maintaining the phenomenal experience of visual stability despite our rapidly shifting gaze, and (2) integrating visual information across discrete fixations. In the first two sections of the article, we focus primarily on behavioral findings. Next, we examine the possibility that a neural phenomenon known as predictive remapping may provide an explanation for aspects of transsaccadic processing. In this section of the article, we delineate and critically evaluate multiple proposals about the potential role of predictive remapping in light of both theoretical principles and empirical findings.
Collapse
|
12
|
Mender BMW, Stringer SM. A self-organizing model of perisaccadic visual receptive field dynamics in primate visual and oculomotor system. Front Comput Neurosci 2015; 9:17. [PMID: 25717301 PMCID: PMC4324147 DOI: 10.3389/fncom.2015.00017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2014] [Accepted: 01/30/2015] [Indexed: 11/13/2022] Open
Abstract
We propose and examine a model for how perisaccadic visual receptive field dynamics, observed in a range of primate brain areas such as LIP, FEF, SC, V3, V3A, V2, and V1, may develop through a biologically plausible process of unsupervised visually guided learning. These dynamics are associated with remapping, which is the phenomenon where receptive fields anticipate the consequences of saccadic eye movements. We find that a neural network model using a local associative synaptic learning rule, when exposed to visual scenes in conjunction with saccades, can account for a range of associated phenomena. In particular, our model demonstrates predictive and pre-saccadic remapping, responsiveness shifts around the time of saccades, and remapping from multiple directions.
Collapse
Affiliation(s)
- Bedeho M W Mender
- Department of Experimental Psychology, Centre for Theoretical Neuroscience and Artificial Intelligence, University of Oxford Oxford, UK
| | - Simon M Stringer
- Department of Experimental Psychology, Centre for Theoretical Neuroscience and Artificial Intelligence, University of Oxford Oxford, UK
| |
Collapse
|
13
|
Excitatory synaptic feedback from the motor layer to the sensory layers of the superior colliculus. J Neurosci 2014; 34:6822-33. [PMID: 24828636 DOI: 10.1523/jneurosci.3137-13.2014] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Neural circuits that translate sensory information into motor commands are organized in a feedforward manner converting sensory information into motor output. The superior colliculus (SC) follows this pattern as it plays a role in converting visual information from the retina and visual cortex into motor commands for rapid eye movements (saccades). Feedback from movement to sensory regions is hypothesized to play critical roles in attention, visual image stability, and saccadic suppression, but in contrast to feedforward pathways, motor feedback to sensory regions has received much less attention. The present study used voltage imaging and patch-clamp recording in slices of rat SC to test the hypothesis of an excitatory synaptic pathway from the motor layers of the SC back to the sensory superficial layers. Voltage imaging revealed an extensive depolarization of the superficial layers evoked by electrical stimulation of the motor layers. A pharmacologically isolated excitatory synaptic potential in the superficial layers depended on stimulus strength in the motor layers in a manner consistent with orthodromic excitation. Patch-clamp recording from neurons in the sensory layers revealed excitatory synaptic potentials in response to glutamate application in the motor layers. The location, size, and morphology of responsive neurons indicated they were likely to be narrow-field vertical cells. This excitatory projection from motor to sensory layers adds an important element to the circuitry of the SC and reveals a novel feedback pathway that could play a role in enhancing sensory responses to attended targets as well as visual image stabilization.
Collapse
|
14
|
Hall N, Colby C. S-cone Visual Stimuli Activate Superior Colliculus Neurons in Old World Monkeys: Implications for Understanding Blindsight. J Cogn Neurosci 2014; 26:1234-56. [DOI: 10.1162/jocn_a_00555] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
The superior colliculus (SC) is thought to be unresponsive to stimuli that activate only short wavelength-sensitive cones (S-cones) in the retina. The apparent lack of S-cone input to the SC was recognized by Sumner et al. [Sumner, P., Adamjee, T., & Mollon, J. D. Signals invisible to the collicular and magnocellular pathways can capture visual attention. Current Biology, 12, 1312–1316, 2002] as an opportunity to test SC function. The idea is that visual behavior dependent on the SC should be impaired when S-cone stimuli are used because they are invisible to the SC. The SC plays a critical role in blindsight. If the SC is insensitive to S-cone stimuli blindsight behavior should be impaired when S-cone stimuli are used. Many clinical and behavioral studies have been based on the assumption that S-cone-specific stimuli do not activate neurons in the SC. Our goal was to test whether single neurons in macaque SC respond to stimuli that activate only S-cones. Stimuli were calibrated psychophysically in each animal and at each individual spatial location used in experimental testing [Hall, N. J., & Colby, C. L. Psychophysical definition of S-cone stimuli in the macaque. Journal of Vision, 13, 2013]. We recorded from 178 visually responsive neurons in two awake, behaving rhesus monkeys. Contrary to the prevailing view, we found that nearly all visual SC neurons can be activated by S-cone-specific visual stimuli. Most of these neurons were sensitive to the degree of S-cone contrast. Of 178 visual SC neurons, 155 (87%) had stronger responses to a high than to a low S-cone contrast. Many of these neurons' responses (56/178 or 31%) significantly distinguished between the high and low S-cone contrast stimuli. The latency and amplitude of responses depended on S-cone contrast. These findings indicate that stimuli that activate only S-cones cannot be used to diagnose collicular mediation.
Collapse
|
15
|
Neurons in cortical area MST remap the memory trace of visual motion across saccadic eye movements. Proc Natl Acad Sci U S A 2014; 111:7825-30. [PMID: 24821778 DOI: 10.1073/pnas.1401370111] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Perception of a stable visual world despite eye motion requires integration of visual information across saccadic eye movements. To investigate how the visual system deals with localization of moving visual stimuli across saccades, we observed spatiotemporal changes of receptive fields (RFs) of motion-sensitive neurons across periods of saccades in the middle temporal (MT) and medial superior temporal (MST) areas. We found that the location of the RFs moved with shifts of eye position due to saccades, indicating that motion-sensitive neurons in both areas have retinotopic RFs across saccades. Different characteristic responses emerged when the moving visual stimulus was turned off before the saccades. For MT neurons, virtually no response was observed after the saccade, suggesting that the responses of these neurons simply reflect the reafferent visual information. In contrast, most MST neurons increased their firing rates when a saccade brought the location of the visual stimulus into their RFs, where the visual stimulus itself no longer existed. These findings suggest that the responses of such MST neurons after saccades were evoked by a memory of the stimulus that had preexisted in the postsaccadic RFs ("memory remapping"). A delayed-saccade paradigm further revealed that memory remapping in MST was linked to the saccade itself, rather than to a shift in attention. Thus, the visual motion information across saccades was integrated in spatiotopic coordinates and represented in the activity of MST neurons. This is likely to contribute to the perception of a stable visual world in the presence of eye movements.
Collapse
|
16
|
Shimegi S, Soma S, Suematsu N, Mizuyama R, Tanaka Y, Fujie H. How a neuron perceives visual motion during self-motion. JOURNAL OF PHYSICAL FITNESS AND SPORTS MEDICINE 2014. [DOI: 10.7600/jpfsm.3.235] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
17
|
Stream-related preferences of inputs to the superior colliculus from areas of dorsal and ventral streams of mouse visual cortex. J Neurosci 2013; 33:1696-705. [PMID: 23345242 DOI: 10.1523/jneurosci.3067-12.2013] [Citation(s) in RCA: 65] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022] Open
Abstract
Previous studies of intracortical connections in mouse visual cortex have revealed two subnetworks that resemble the dorsal and ventral streams in primates. Although calcium imaging studies have shown that many areas of the ventral stream have high spatial acuity whereas areas of the dorsal stream are highly sensitive for transient visual stimuli, there are some functional inconsistencies that challenge a simple grouping into "what/perception" and "where/action" streams known in primates. The superior colliculus (SC) is a major center for processing of multimodal sensory information and the motor control of orienting the eyes, head, and body. Visual processing is performed in superficial layers, whereas premotor activity is generated in deep layers of the SC. Because the SC is known to receive input from visual cortex, we asked whether the projections from 10 visual areas of the dorsal and ventral streams terminate in differential depth profiles within the SC. We found that inputs from primary visual cortex are by far the strongest. Projections from the ventral stream were substantially weaker, whereas the sparsest input originated from areas of the dorsal stream. Importantly, we found that ventral stream inputs terminated in superficial layers, whereas dorsal stream inputs tended to be patchy and either projected equally to superficial and deep layers or strongly preferred deep layers. The results suggest that the anatomically defined ventral and dorsal streams contain areas that belong to distinct functional systems, specialized for the processing of visual information and visually guided action, respectively.
Collapse
|
18
|
Abstract
It has been suggested that one way we may create a stable percept of the visual world across multiple eye movements is to pass information from one set of neurons to another around the time of each eye movement. Previous studies have shown that some neurons in the lateral intraparietal area (LIP) exhibit anticipatory remapping: these neurons produce a visual response to a stimulus that will enter their receptive field after a saccade but before it actually does so. LIP responses during fixation are thought to represent attentional priority, behavioral relevance, or value. In this study, we test whether the remapped response represents this attentional priority by examining the activity of LIP neurons while animals perform a visual foraging task. We find that the population responds more to a target than to a distractor before the saccade even begins to bring the stimulus into the receptive field. Within 20 ms of the saccade ending, the responses in almost one-third of LIP neurons closely resemble the responses that will emerge during stable fixation. Finally, we show that, in these neurons and in the population as a whole, this remapping occurs for all stimuli in all locations across the visual field and for both long and short saccades. We conclude that this complete remapping of attentional priority across the visual field could underlie spatial stability across saccades.
Collapse
|
19
|
Perisaccadic remapping and rescaling of visual responses in macaque superior colliculus. PLoS One 2012; 7:e52195. [PMID: 23284931 PMCID: PMC3524080 DOI: 10.1371/journal.pone.0052195] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2012] [Accepted: 11/14/2012] [Indexed: 11/23/2022] Open
Abstract
Visual neurons have spatial receptive fields that encode the positions of objects relative to the fovea. Because foveate animals execute frequent saccadic eye movements, this position information is constantly changing, even though the visual world is generally stationary. Interestingly, visual receptive fields in many brain regions have been found to exhibit changes in strength, size, or position around the time of each saccade, and these changes have often been suggested to be involved in the maintenance of perceptual stability. Crucial to the circuitry underlying perisaccadic changes in visual receptive fields is the superior colliculus (SC), a brainstem structure responsible for integrating visual and oculomotor signals. In this work we have studied the time-course of receptive field changes in the SC. We find that the distribution of the latencies of SC responses to stimuli placed outside the fixation receptive field is bimodal: The first mode is comprised of early responses that are temporally locked to the onset of the visual probe stimulus and stronger for probes placed closer to the classical receptive field. We suggest that such responses are therefore consistent with a perisaccadic rescaling, or enhancement, of weak visual responses within a fixed spatial receptive field. The second mode is more similar to the remapping that has been reported in the cortex, as responses are time-locked to saccade onset and stronger for stimuli placed in the postsaccadic receptive field location. We suggest that these two temporal phases of spatial updating may represent different sources of input to the SC.
Collapse
|
20
|
Churan J, Guitton D, Pack CC. Spatiotemporal structure of visual receptive fields in macaque superior colliculus. J Neurophysiol 2012; 108:2653-67. [DOI: 10.1152/jn.00389.2012] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Saccades are useful for directing the high-acuity fovea to visual targets that are of behavioral relevance. The selection of visual targets for eye movements involves the superior colliculus (SC), where many neurons respond to visual stimuli. Many of these neurons are also activated before and during saccades of specific directions and amplitudes. Although the role of the SC in controlling eye movements has been thoroughly examined, far less is known about the nature of the visual responses in this area. We have, therefore, recorded from neurons in the intermediate layers of the macaque SC, while using a sparse-noise mapping procedure to obtain a detailed characterization of the spatiotemporal structure of visual receptive fields. We find that SC responses to flashed visual stimuli start roughly 50 ms after the onset of the stimulus and last for on average ∼70 ms. About 50% of these neurons are strongly suppressed by visual stimuli flashed at certain locations flanking the excitatory center, and the spatiotemporal pattern of suppression exerts a predictable influence on the timing of saccades. This suppression may, therefore, contribute to the filtering of distractor stimuli during target selection. We also find that saccades affect the processing of visual stimuli by SC neurons in a manner that is quite similar to the saccadic suppression and postsaccadic enhancement that has been observed in the cortex and in perception. However, in contrast to what has been observed in the cortex, decreased visual sensitivity was generally associated with increased firing rates, while increased sensitivity was associated with decreased firing rates. Overall, these results suggest that the processing of visual stimuli by SC receptive fields can influence oculomotor behavior and that oculomotor signals originating in the SC can shape perisaccadic visual perception.
Collapse
Affiliation(s)
- Jan Churan
- Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Daniel Guitton
- Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Christopher C. Pack
- Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
21
|
Shin S, Sommer MA. Division of labor in frontal eye field neurons during presaccadic remapping of visual receptive fields. J Neurophysiol 2012; 108:2144-59. [PMID: 22815407 DOI: 10.1152/jn.00204.2012] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Our percept of visual stability across saccadic eye movements may be mediated by presaccadic remapping. Just before a saccade, neurons that remap become visually responsive at a future field (FF), which anticipates the saccade vector. Hence, the neurons use corollary discharge of saccades. Many of the neurons also decrease their response at the receptive field (RF). Presaccadic remapping occurs in several brain areas including the frontal eye field (FEF), which receives corollary discharge of saccades in its layer IV from a collicular-thalamic pathway. We studied, at two levels, the microcircuitry of remapping in the FEF. At the laminar level, we compared remapping between layers IV and V. At the cellular level, we compared remapping between different neuron types of layer IV. In the FEF in four monkeys (Macaca mulatta), we identified 27 layer IV neurons with orthodromic stimulation and 57 layer V neurons with antidromic stimulation from the superior colliculus. With the use of established criteria, we classified the layer IV neurons as putative excitatory (n = 11), putative inhibitory (n = 12), or ambiguous (n = 4). We found that just before a saccade, putative excitatory neurons increased their visual response at the RF, putative inhibitory neurons showed no change, and ambiguous neurons increased their visual response at the FF. None of the neurons showed presaccadic visual changes at both RF and FF. In contrast, neurons in layer V showed full remapping (at both the RF and FF). Our data suggest that elemental signals for remapping are distributed across neuron types in early cortical processing and combined in later stages of cortical microcircuitry.
Collapse
Affiliation(s)
- Sooyoon Shin
- Department of Neuroscience, Center for the Neural Basis of Cognition, and Center for Neuroscience at the University of Pittsburgh, University of Pittsburgh, Pittsburgh, PA, USA
| | | |
Collapse
|
22
|
Abstract
Spatial attention enables the brain to analyse and evaluate information selectively from a specific location in space, a capacity essential for any animal to behave adaptively in a complex world. We usually think of spatial attention as being controlled by a frontoparietal network in the forebrain. However, emerging evidence shows that a midbrain network also plays a critical role in controlling spatial attention. Moreover, the highly differentiated, retinotopic organization of the midbrain network, especially in birds, makes it amenable to detailed analysis with modern techniques that can elucidate circuit, cellular and synaptic mechanisms of attention. The following review discusses the role of the midbrain network in controlling attention, the neural circuits that support this role and current knowledge about the computations performed by these circuits.
Collapse
Affiliation(s)
- Eric I Knudsen
- Department of Neurobiology, 299 Campus Dr., Stanford University School of Medicine, Stanford, CA 94305-5125, USA.
| |
Collapse
|
23
|
Churan J, Guitton D, Pack CC. Context dependence of receptive field remapping in superior colliculus. J Neurophysiol 2011; 106:1862-74. [PMID: 21753030 DOI: 10.1152/jn.00288.2011] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Our perception of the positions of objects in our surroundings is surprisingly unaffected by movements of the eyes, head, and body. This suggests that the brain has a mechanism for maintaining perceptual stability, based either on the spatial relationships among visible objects or internal copies of its own motor commands. Strong evidence for the latter mechanism comes from the remapping of visual receptive fields that occurs around the time of a saccade. Remapping occurs when a single neuron responds to visual stimuli placed presaccadically in the spatial location that will be occupied by its receptive field after the completion of a saccade. Although evidence for remapping has been found in many brain areas, relatively little is known about how it interacts with sensory context. This interaction is important for understanding perceptual stability more generally, as the brain may rely on extraretinal signals or visual signals to different degrees in different contexts. Here, we have studied the interaction between visual stimulation and remapping by recording from single neurons in the superior colliculus of the macaque monkey, using several different visual stimulus conditions. We find that remapping responses are highly sensitive to low-level visual signals, with the overall luminance of the visual background exerting a particularly powerful influence. Specifically, although remapping was fairly common in complete darkness, such responses were usually decreased or abolished in the presence of modest background illumination. Thus the brain might make use of a strategy that emphasizes visual landmarks over extraretinal signals whenever the former are available.
Collapse
Affiliation(s)
- Jan Churan
- Montreal Neurological Institute, McGill University, Montreal, Canada.
| | | | | |
Collapse
|
24
|
Abstract
Visual perception is based on both incoming sensory signals and information about ongoing actions. Recordings from single neurons have shown that corollary discharge signals can influence visual representations in parietal, frontal and extrastriate visual cortex, as well as the superior colliculus (SC). In each of these areas, visual representations are remapped in conjunction with eye movements. Remapping provides a mechanism for creating a stable, eye-centred map of salient locations. Temporal and spatial aspects of remapping are highly variable from cell to cell and area to area. Most neurons in the lateral intraparietal area remap stimulus traces, as do many neurons in closely allied areas such as the frontal eye fields the SC and extrastriate area V3A. Remapping is not purely a cortical phenomenon. Stimulus traces are remapped from one hemifield to the other even when direct cortico-cortical connections are removed. The neural circuitry that produces remapping is distinguished by significant plasticity, suggesting that updating of salient stimuli is fundamental for spatial stability and visuospatial behaviour. These findings provide new evidence that a unified and stable representation of visual space is constructed by redundant circuitry, comprising cortical and subcortical pathways, with a remarkable capacity for reorganization.
Collapse
Affiliation(s)
- Nathan J Hall
- Department of Neuroscience and Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA 15260, USA
| | | |
Collapse
|
25
|
Thompson AA, Henriques DY. The coding and updating of visuospatial memory for goal-directed reaching and pointing. Vision Res 2011; 51:819-26. [DOI: 10.1016/j.visres.2011.01.006] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2010] [Revised: 12/15/2010] [Accepted: 01/10/2011] [Indexed: 10/18/2022]
|
26
|
Wurtz RH, McAlonan K, Cavanaugh J, Berman RA. Thalamic pathways for active vision. Trends Cogn Sci 2011; 15:177-84. [PMID: 21414835 PMCID: PMC3070860 DOI: 10.1016/j.tics.2011.02.004] [Citation(s) in RCA: 90] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2011] [Revised: 02/10/2011] [Accepted: 02/10/2011] [Indexed: 11/16/2022]
Abstract
Active vision requires the integration of information coming from the retina with that generated internally within the brain, especially by saccadic eye movements. Just as visual information reaches cortex via the lateral geniculate nucleus of the thalamus, this internal information reaches the cerebral cortex through other higher-order nuclei of the thalamus. This review summarizes recent work on four of these thalamic nuclei. The first two pathways convey internal information about upcoming saccades (a corollary discharge) and probably contribute to the neuronal mechanisms that underlie stable visual perception. The second two pathways might contribute to the neuronal mechanisms underlying visual spatial attention in cortex and in the thalamus itself.
Collapse
Affiliation(s)
- Robert H Wurtz
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD 20892, USA.
| | | | | | | |
Collapse
|
27
|
Dunn CA, Colby CL. Representation of the ipsilateral visual field by neurons in the macaque lateral intraparietal cortex depends on the forebrain commissures. J Neurophysiol 2010; 104:2624-33. [PMID: 20660427 DOI: 10.1152/jn.00752.2009] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Our eyes are constantly moving, allowing us to attend to different visual objects in the environment. With each eye movement, a given object activates an entirely new set of visual neurons, yet we perceive a stable scene. One neural mechanism that may contribute to visual stability is remapping. Neurons in several brain regions respond to visual stimuli presented outside the receptive field when an eye movement brings the stimulated location into the receptive field. The stored representation of a visual stimulus is remapped, or updated, in conjunction with the saccade. Remapping depends on neurons being able to receive visual information from outside the classic receptive field. In previous studies, we asked whether remapping across hemifields depends on the forebrain commissures. We found that, when the forebrain commissures are transected, behavior dependent on accurate spatial updating is initially impaired but recovers over time. Moreover, neurons in lateral intraparietal cortex (LIP) continue to remap information across hemifields in the absence of the forebrain commissures. One possible explanation for the preserved across-hemifield remapping in split-brain animals is that neurons in a single hemisphere could represent visual information from both visual fields. In the present study, we measured receptive fields of LIP neurons in split-brain monkeys and compared them with receptive fields in intact monkeys. We found a small number of neurons with bilateral receptive fields in the intact monkeys. In contrast, we found no such neurons in the split-brain animals. We conclude that bilateral representations in area LIP following forebrain commissures transection cannot account for remapping across hemifields.
Collapse
Affiliation(s)
- Catherine A Dunn
- Department of Neuroscience and Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | | |
Collapse
|