1
|
Nicolas G, Castet E, Rabier A, Kristensen E, Dojat M, Guérin-Dugué A. Neural correlates of intra-saccadic motion perception. J Vis 2021; 21:19. [PMID: 34698810 PMCID: PMC8556557 DOI: 10.1167/jov.21.11.19] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Retinal motion of the visual scene is not consciously perceived during ocular saccades in normal everyday conditions. It has been suggested that extra-retinal signals actively suppress intra-saccadic motion perception to preserve stable perception of the visual world. However, using stimuli optimized to preferentially activate the M-pathway, Castet and Masson (2000) demonstrated that motion can be perceived during a saccade. Based on this psychophysical paradigm, we used electroencephalography and eye-tracking recordings to investigate the neural correlates related to the conscious perception of intra-saccadic motion. We demonstrated the effective involvement during saccades of the cortical areas V1-V2 and MT-V5, which convey motion information along the M-pathway. We also showed that individual motion perception was related to retinal temporal frequency.
Collapse
Affiliation(s)
- Gaëlle Nicolas
- Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-Lab, 38000 Grenoble, France.,
| | - Eric Castet
- LPC, Laboratoire de Psychologie Cognitive (UMR 7290), Aix-Marseille Univ, CNRS, LPC, Marseille, France.,
| | - Adrien Rabier
- Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-Lab, 38000 Grenoble, France.,
| | | | - Michel Dojat
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut Neurosciences, GIN, 38000 Grenoble, France.,
| | - Anne Guérin-Dugué
- Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-Lab, 38000 Grenoble, France.,
| |
Collapse
|
2
|
Leszczynski M, Chaieb L, Staudigl T, Enkirch SJ, Fell J, Schroeder CE. Neural activity in the human anterior thalamus during natural vision. Sci Rep 2021; 11:17480. [PMID: 34471183 PMCID: PMC8410783 DOI: 10.1038/s41598-021-96588-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 08/11/2021] [Indexed: 12/23/2022] Open
Abstract
In natural vision humans and other primates explore environment by active sensing, using saccadic eye movements to relocate the fovea and sample different bits of information multiple times per second. Saccades induce a phase reset of ongoing neuronal oscillations in primary and higher-order visual cortices and in the medial temporal lobe. As a result, neuron ensembles are shifted to a common state at the time visual input propagates through the system (i.e., just after fixation). The extent of the brain’s circuitry that is modulated by saccades is not yet known. Here, we evaluate the possibility that saccadic phase reset impacts the anterior nuclei of the thalamus (ANT). Using recordings in the human thalamus of three surgical patients during natural vision, we found that saccades and visual stimulus onset both modulate neural activity, but with distinct field potential morphologies. Specifically, we found that fixation-locked field potentials had a component that preceded saccade onset. It was followed by an early negativity around 50 ms after fixation onset which is significantly faster than any response to visual stimulus presentation. The timing of these events suggests that the ANT is predictively modulated before the saccadic eye movement. We also found oscillatory phase concentration, peaking at 3–4 Hz, coincident with suppression of Broadband High-frequency Activity (BHA; 80–180 Hz), both locked to fixation onset supporting the idea that neural oscillations in these nuclei are reorganized to a low excitability state right after fixation onset. These findings show that during real-world natural visual exploration neural dynamics in the human ANT is influenced by visual and oculomotor events, which supports the idea that ANT, apart from their contribution to episodic memory, also play a role in natural vision.
Collapse
Affiliation(s)
- Marcin Leszczynski
- Department of Psychiatry, College of Physicians and Surgeons, Columbia University Medical Center, 1051 Riverside Drive Kolb Annex Rm 561, New York, NY, 10032, USA. .,Translational Neuroscience Division, Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA.
| | - Leila Chaieb
- Department of Epileptology, University Hospital Bonn, Bonn, Germany
| | - Tobias Staudigl
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | | | - Juergen Fell
- Department of Epileptology, University Hospital Bonn, Bonn, Germany
| | - Charles E Schroeder
- Department of Psychiatry, College of Physicians and Surgeons, Columbia University Medical Center, 1051 Riverside Drive Kolb Annex Rm 561, New York, NY, 10032, USA.,Translational Neuroscience Division, Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
| |
Collapse
|
3
|
Baumann MP, Idrees S, Münch TA, Hafed ZM. Dependence of perceptual saccadic suppression on peri-saccadic image flow properties and luminance contrast polarity. J Vis 2021; 21:15. [PMID: 34003243 PMCID: PMC8131999 DOI: 10.1167/jov.21.5.15] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Across saccades, perceptual detectability of brief visual stimuli is strongly diminished. We recently observed that this perceptual suppression phenomenon is jumpstarted in the retina, suggesting that the phenomenon might be significantly more visual in nature than normally acknowledged. Here, we explicitly compared saccadic suppression strength when saccades were made across a uniform image of constant luminance versus when saccades were made across image patches of different luminance, width, and trans-saccadic luminance polarity. We measured perceptual contrast thresholds of human subjects for brief peri-saccadic flashes of positive (luminance increments) or negative (luminance decrements) polarity. Thresholds were >6–7 times higher when saccades translated a luminance stripe or edge across the retina than when saccades were made over a completely uniform image patch. Critically, both background luminance and flash luminance polarity strongly modulated peri-saccadic contrast thresholds. In addition, all of these very same visual dependencies also occurred in the absence of any saccades, but with qualitatively similar rapid translations of image patches across the retina. This similarity of visual dependencies with and without saccades supports the notion that perceptual saccadic suppression may be fundamentally a visual phenomenon, which strongly motivates neurophysiological and theoretical investigations on the role of saccadic eye movement commands in modulating its properties.
Collapse
Affiliation(s)
- Matthias P Baumann
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany.,
| | - Saad Idrees
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,
| | - Thomas A Münch
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,
| | - Ziad M Hafed
- Werner Reichardt Centre for Integrative Neuroscience, Tübingen University, Tübingen, Germany.,Hertie Institute for Clinical Brain Research, Tübingen University, Tübingen, Germany.,
| |
Collapse
|
4
|
Chen J, Valsecchi M, Gegenfurtner KR. Saccadic suppression measured by steady-state visual evoked potentials. J Neurophysiol 2019; 122:251-258. [PMID: 30943105 DOI: 10.1152/jn.00712.2018] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023] Open
Abstract
Visual sensitivity is severely impaired during the execution of saccadic eye movements. This phenomenon has been extensively characterized in human psychophysics and nonhuman primate single-neuron studies, but a physiological characterization in humans is less established. Here, we used a method based on steady-state visually evoked potential (SSVEP), an oscillatory brain response to periodic visual stimulation, to examine how saccades affect visual sensitivity. Observers made horizontal saccades back and forth, while horizontal black-and-white gratings flickered at 5-30 Hz in the background. We analyzed EEG epochs with a length of 0.3 s either centered at saccade onset (saccade epochs) or centered at fixations half a second before the saccade (fixation epochs). Compared with fixation epochs, saccade epochs showed a broadband power increase, which most likely resulted from saccade-related EEG activity. The execution of saccades, however, led to an average reduction of 57% in the SSVEP amplitude at the stimulation frequency. This result provides additional evidence for an active saccadic suppression in the early visual cortex in humans. Compared with previous functional MRI and EEG studies, an advantage of this approach lies in its capability to trace the temporal dynamics of neural activity throughout the time course of a saccade. In contrast to previous electrophysiological studies in nonhuman primates, we did not find any evidence for postsaccadic enhancement, even though simulation results show that our method would have been able to detect it. We conclude that SSVEP is a useful technique to investigate the neural correlates of visual perception during saccadic eye movements in humans. NEW & NOTEWORTHY We make fast ballistic saccadic eye movements a few times every second. At the time of saccades, visual sensitivity is severely impaired. The present study uses steady-state visually evoked potentials to reveal a neural correlate of the fine temporal dynamics of these modulations at the time of saccades in humans. We observed a strong reduction (57%) of visually driven neural activity associated with saccades but did not find any evidence for postsaccadic enhancement.
Collapse
Affiliation(s)
- Jing Chen
- School of Psychology, Shanghai University of Sport , Shanghai , China
| | - Matteo Valsecchi
- Abteilung Allgemeine Psychologie, Justus-Liebig-Universität Gießen, Gießen , Germany
| | - Karl R Gegenfurtner
- Abteilung Allgemeine Psychologie, Justus-Liebig-Universität Gießen, Gießen , Germany
| |
Collapse
|
5
|
Chang YCC, Khan S, Taulu S, Kuperberg G, Brown EN, Hämäläinen MS, Temereanca S. Left-Lateralized Contributions of Saccades to Cortical Activity During a One-Back Word Recognition Task. Front Neural Circuits 2018; 12:38. [PMID: 29867372 PMCID: PMC5964218 DOI: 10.3389/fncir.2018.00038] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2017] [Accepted: 04/20/2018] [Indexed: 01/08/2023] Open
Abstract
Saccadic eye movements are an inherent component of natural reading, yet their contribution to information processing at subsequent fixation remains elusive. Here we use anatomically-constrained magnetoencephalography (MEG) to examine cortical activity following saccades as healthy human subjects engaged in a one-back word recognition task. This activity was compared with activity following external visual stimulation that mimicked saccades. A combination of procedures was employed to eliminate saccadic ocular artifacts from the MEG signal. Both saccades and saccade-like external visual stimulation produced early-latency responses beginning ~70 ms after onset in occipital cortex and spreading through the ventral and dorsal visual streams to temporal, parietal and frontal cortices. Robust differential activity following the onset of saccades vs. similar external visual stimulation emerged during 150-350 ms in a left-lateralized cortical network. This network included: (i) left lateral occipitotemporal (LOT) and nearby inferotemporal (IT) cortex; (ii) left posterior Sylvian fissure (PSF) and nearby multimodal cortex; and (iii) medial parietooccipital (PO), posterior cingulate and retrosplenial cortices. Moreover, this left-lateralized network colocalized with word repetition priming effects. Together, results suggest that central saccadic mechanisms influence a left-lateralized language network in occipitotemporal and temporal cortex above and beyond saccadic influences at preceding stages of information processing during visual word recognition.
Collapse
Affiliation(s)
- Yu-Cherng C Chang
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States
| | - Sheraz Khan
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States.,Harvard Medical School, Harvard University, Boston, MA, United States
| | - Samu Taulu
- Institute for Learning and Brain Sciences, University of Washington, Seattle, WA, United States.,Department of Physics, University of Washington, Seattle, WA, United States
| | - Gina Kuperberg
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States.,Harvard Medical School, Harvard University, Boston, MA, United States.,Department of Psychology, Tufts University, Medford, MA, United States
| | - Emery N Brown
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, United States.,Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States.,Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, United States.,Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Matti S Hämäläinen
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States.,Harvard Medical School, Harvard University, Boston, MA, United States
| | - Simona Temereanca
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States.,Harvard Medical School, Harvard University, Boston, MA, United States.,Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States.,Department of Neuroscience, Brown University, Providence, RI, United States
| |
Collapse
|
6
|
Towards building a more complex view of the lateral geniculate nucleus: Recent advances in understanding its role. Prog Neurobiol 2017. [DOI: 10.1016/j.pneurobio.2017.06.002] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
7
|
Distinct fMRI Responses to Self-Induced versus Stimulus Motion during Free Viewing in the Macaque. J Neurosci 2017; 36:9580-9. [PMID: 27629710 DOI: 10.1523/jneurosci.1152-16.2016] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2016] [Accepted: 07/22/2016] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED Visual motion responses in the brain are shaped by two distinct sources: the physical movement of objects in the environment and motion resulting from one's own actions. The latter source, termed visual reafference, stems from movements of the head and body, and in primates from the frequent saccadic eye movements that mark natural vision. To study the relative contribution of reafferent and stimulus motion during natural vision, we measured fMRI activity in the brains of two macaques as they freely viewed >50 hours of naturalistic video footage depicting dynamic social interactions. We used eye movements obtained during scanning to estimate the level of reafferent retinal motion at each moment in time. We also estimated the net stimulus motion by analyzing the video content during the same time periods. Mapping the responses to these distinct sources of retinal motion, we found a striking dissociation in the distribution of visual responses throughout the brain. Reafferent motion drove fMRI activity in the early retinotopic areas V1, V2, V3, and V4, particularly in their central visual field representations, as well as lateral aspects of the caudal inferotemporal cortex (area TEO). However, stimulus motion dominated fMRI responses in the superior temporal sulcus, including areas MT, MST, and FST as well as more rostral areas. We discuss this pronounced separation of motion processing in the context of natural vision, saccadic suppression, and the brain's utilization of corollary discharge signals. SIGNIFICANCE STATEMENT Visual motion arises not only from events in the external world, but also from the movements of the observer. For example, even if objects are stationary in the world, the act of walking through a room or shifting one's eyes causes motion on the retina. This "reafferent" motion propagates into the brain as signals that must be interpreted in the context of real object motion. The delineation of whole-brain responses to stimulus versus self-generated retinal motion signals is critical for understanding visual perception and is of pragmatic importance given the increasing use of naturalistic viewing paradigms. The present study uses fMRI to demonstrate that the brain exhibits a fundamentally different pattern of responses to these two sources of retinal motion.
Collapse
|
8
|
Voges C, Helmchen C, Heide W, Sprenger A. Ganzfeld stimulation or sleep enhance long term motor memory consolidation compared to normal viewing in saccadic adaptation paradigm. PLoS One 2015; 10:e0123831. [PMID: 25867186 PMCID: PMC4395077 DOI: 10.1371/journal.pone.0123831] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2014] [Accepted: 12/17/2014] [Indexed: 11/18/2022] Open
Abstract
Adaptation of saccade amplitude in response to intra-saccadic target displacement is a type of implicit motor learning which is required to compensate for physiological changes in saccade performance. Once established trials without intra-saccadic target displacement lead to de-adaptation or extinction, which has been attributed either to extra-retinal mechanisms of spatial constancy or to the influence of the stable visual surroundings. Therefore we investigated whether visual deprivation ("Ganzfeld"-stimulation or sleep) can partially maintain this motor learning compared to free viewing of the natural surroundings. Thirty-five healthy volunteers performed two adaptation blocks of 100 inward adaptation trials - interspersed by an extinction block - which were followed by a two-hour break with or without visual deprivation (VD). Using additional adaptation and extinction blocks short and long (4 weeks) term memory of this implicit motor learning were tested. In the short term, motor memory tested immediately after free viewing was superior to adaptation performance after VD. In the long run, however, effects were opposite: motor memory and relearning of adaptation was superior in the VD conditions. This could imply independent mechanisms that underlie the short-term ability of retrieving learned saccadic gain and its long term consolidation. We suggest that subjects mainly rely on visual cues (i.e., retinal error) in the free viewing condition which makes them prone to changes of the visual stimulus in the extinction block. This indicates the role of a stable visual array for resetting adapted saccade amplitudes. In contrast, visual deprivation (GS and sleep), might train subjects to rely on extra-retinal cues, e.g., efference copy or prediction to remap their internal representations of saccade targets, thus leading to better consolidation of saccadic adaptation.
Collapse
Affiliation(s)
- Caroline Voges
- Department of Neurology, University Luebeck, Luebeck, Germany
| | | | - Wolfgang Heide
- Department of Neurology, General Hospital Celle, Celle, Germany
| | - Andreas Sprenger
- Department of Neurology, University Luebeck, Luebeck, Germany
- Institute of Psychology II, University Luebeck, Luebeck, Germany
| |
Collapse
|
9
|
Moradi F, Buračas GT, Buxton RB. Attention strongly increases oxygen metabolic response to stimulus in primary visual cortex. Neuroimage 2011; 59:601-7. [PMID: 21839179 DOI: 10.1016/j.neuroimage.2011.07.078] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2011] [Revised: 06/30/2011] [Accepted: 07/25/2011] [Indexed: 11/15/2022] Open
Abstract
Top-down attention enhances neural processing, but its effect on metabolic activity in primary visual cortex (V1) is unclear. Combined blood flow and oxygenation measurements provide the best tool for investigating modulations of oxidative metabolism. We measured the human V1 response to a peripheral low contrast stimulus using fMRI and found a larger fractional modulation of blood flow with attention compared to the blood oxygenation level dependent (BOLD) response, thus indicating a much larger modulation of oxygen metabolism than was previously thought. These findings point to different aspects of neural activity driving flow and metabolic changes to different degrees. We propose that V1 flow is driven strongly but not exclusively by the initial sensory-driven neural activity, which dominates the response in the unattended condition, while V1 oxygen metabolism is driven strongly by the overall neural activity, which is modulated by top-down signals related to attention.
Collapse
Affiliation(s)
- Farshad Moradi
- Center for Functional MRI and Department of Radiology, University of California, San Diego, CA 92103-8756, USA.
| | | | | |
Collapse
|
10
|
Abstract
Visual stimuli presented just before or during an eye movement are more difficult to detect than those same visual stimuli presented during fixation. This laboratory phenomenon--behavioral saccadic suppression--is thought to underlie the everyday experience of not perceiving the motion created by our own eye movements-saccadic omission. At the neural level, many cortical and subcortical areas respond differently to perisaccadic visual stimuli than to stimuli presented during fixation. Those neural response changes, however, are complex and the link to the behavioral phenomena of reduced detectability remains tentative. We used a well established model of human visual detection performance to provide a quantitative description of behavioral saccadic suppression and thereby allow a more focused search for its neural mechanisms. We used an equivalent noise method to distinguish between three mechanisms that could underlie saccadic suppression. The first hypothesized mechanism reduces the gain of the visual system, the second increases internal noise levels in a stimulus-dependent manner, and the third increases stimulus uncertainty. All three mechanisms predict that perisaccadic stimuli should be more difficult to detect, but each mechanism predicts a unique pattern of detectability as a function of the amount of external noise. Our experimental finding was that saccades increased detection thresholds at low external noise, but had little influence on thresholds at high levels of external noise. A formal analysis of these data in the equivalent noise analysis framework showed that the most parsimonious mechanism underlying saccadic suppression is a stimulus-independent reduction in response gain.
Collapse
|
11
|
Wandell BA, Winawer J. Imaging retinotopic maps in the human brain. Vision Res 2011; 51:718-37. [PMID: 20692278 PMCID: PMC3030662 DOI: 10.1016/j.visres.2010.08.004] [Citation(s) in RCA: 228] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2010] [Revised: 08/02/2010] [Accepted: 08/02/2010] [Indexed: 11/29/2022]
Abstract
A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.
Collapse
Affiliation(s)
- Brian A Wandell
- Psychology Department, Stanford University, Stanford, CA 94305, United States.
| | | |
Collapse
|
12
|
Effects of fixational saccades on response timing in macaque lateral geniculate nucleus. Vis Neurosci 2010; 27:171-81. [PMID: 20932359 DOI: 10.1017/s0952523810000258] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Even during active fixation, small eye movements persist that might be expected to interfere with vision. Numerous brain mechanisms probably contribute to discounting this jitter. Changes in the timing of responses in the visual thalamus associated with fixational saccades are considered in this study. Activity of single neurons in alert monkey lateral geniculate nucleus (LGN) was recorded during fixation while pseudorandom visual noise stimuli were presented. The position of the stimulus on the display monitor was adjusted based on eye position measurements to control for changes in retinal locations due to eye movements. A method for extracting nonstationary first-order response mechanisms was applied, so that changes around the times of saccades could be observed. Saccade-related changes were seen in both amplitude and timing of geniculate responses. Amplitudes were greatly reduced around saccades. Timing was retarded slightly during a window of about 200 ms around saccades. That is, responses became more sustained. These effects were found in both parvocellular and magnocellular neurons. Timing changes in LGN might play a role in maintaining cortical responses to visual stimuli in the presence of eye movements, compensating for the spatial shifts caused by saccades via these shifts in timing.
Collapse
|
13
|
Duggins AJ. A complex vector space model of single neuronal coding and experience. Biosystems 2010; 102:124-33. [PMID: 20826194 DOI: 10.1016/j.biosystems.2010.08.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2010] [Revised: 08/26/2010] [Accepted: 08/31/2010] [Indexed: 11/19/2022]
Abstract
A model of consciousness is proposed, in which the experience attributable to a single sensory neuron is related to its instantaneous firing rate. In that this can only be quantified within statistical limits from the incidence of spikes across multiple presentations of a stimulus, consciousness remains inaccessible to direct measurement on a single trial. In this way, the model disambiguates subjective experience from objective neural properties. The model adopts a quantum mechanical formalism, in which the state of the neuron is represented as a vector in a complex vector space.
Collapse
Affiliation(s)
- Andrew John Duggins
- Western Clinical School, Westmead Hospital, Hawkesbury Road, Westmead, NSW 2145, Australia.
| |
Collapse
|
14
|
Schroeder CE, Wilson DA, Radman T, Scharfman H, Lakatos P. Dynamics of Active Sensing and perceptual selection. Curr Opin Neurobiol 2010; 20:172-6. [PMID: 20307966 DOI: 10.1016/j.conb.2010.02.010] [Citation(s) in RCA: 390] [Impact Index Per Article: 27.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2010] [Accepted: 02/23/2010] [Indexed: 11/15/2022]
Abstract
Sensory processing is often regarded as a passive process in which biological receptors like photoreceptors and mechanoreceptors transduce physical energy into a neural code. Recent findings, however, suggest that: first, most sensory processing is active, and largely determined by motor/attentional sampling routines; second, owing to rhythmicity in the motor routine, as well as to its entrainment of ambient rhythms in sensory regions, sensory inflow tends to be rhythmic; third, attentional manipulation of rhythms in sensory pathways is instrumental to perceptual selection. These observations outline the essentials of an Active Sensing paradigm, and argue for increased emphasis on the study of sensory processes as specific to the dynamic motor/attentional context in which inputs are acquired.
Collapse
Affiliation(s)
- Charles E Schroeder
- Cognitive Neuroscience and Schizophrenia Program, Nathan Kline Institute for Psychiatric Research, USA.
| | | | | | | | | |
Collapse
|
15
|
Abstract
The stability of visual perception is partly maintained by saccadic suppression: the selective reduction of visual sensitivity that accompanies rapid eye movements. The neural mechanisms responsible for this reduced perisaccadic visibility remain unknown, but the Lateral Geniculate Nucleus (LGN) has been proposed as a likely site. Our data show, however, that the saccadic suppression of a target flashed in the right visual hemifield increased with an increase in background luminance in the left visual hemifield. Because each LGN only receives retinal input from a single hemifield, this hemifield interaction cannot be explained solely on the basis of neural mechanisms operating in the LGN. Instead, this suggests that saccadic suppression must involve processing in higher level cortical areas that have access to a considerable part of the ipsilateral hemifield.
Collapse
Affiliation(s)
- George Chahine
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey, United States of America
| | - Bart Krekelberg
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey, United States of America
- * E-mail:
| |
Collapse
|
16
|
Watson TL, Krekelberg B. The relationship between saccadic suppression and perceptual stability. Curr Biol 2009; 19:1040-3. [PMID: 19481454 DOI: 10.1016/j.cub.2009.04.052] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2009] [Revised: 04/10/2009] [Accepted: 04/20/2009] [Indexed: 12/01/2022]
Abstract
Introspection makes it clear that we do not see the visual motion generated by our saccadic eye movements. We refer to the lack of awareness of the motion across the retina that is generated by a saccade as saccadic omission [1]: the visual stimulus generated by the saccade is omitted from our subjective awareness. In the laboratory, saccadic omission is often studied by investigating saccadic suppression, the reduction in visual sensitivity before and during a saccade (see Ross et al. [2] and Wurtz [3] for reviews). We investigated whether perceptual stability requires that a mechanism like saccadic suppression removes perisaccadic stimuli from visual processing to prevent their presumed harmful effect on perceptual stability [4, 5]. Our results show that a stimulus that undergoes saccadic omission can nevertheless generate a shape contrast illusion. This illusion can be generated when the inducer and test stimulus are separated in space and is therefore thought to be generated at a later stage of visual processing [6]. This shows that perceptual stability is attained without removing stimuli from processing and suggests a conceptually new view of perceptual stability in which perisaccadic stimuli are processed by the early visual system, but these signals are prevented from reaching awareness at a later stage of processing.
Collapse
Affiliation(s)
- Tamara L Watson
- Center for Molecular and Behavioral Neuroscience, Rutgers University, 197 University Avenue, Newark, NJ 07102, USA.
| | | |
Collapse
|
17
|
Human brain activity time-locked to rapid eye movements during REM sleep. Exp Brain Res 2008; 192:657-67. [PMID: 18830586 DOI: 10.1007/s00221-008-1579-2] [Citation(s) in RCA: 92] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2008] [Accepted: 09/12/2008] [Indexed: 10/21/2022]
Abstract
To identify the neural substrate of rapid eye movements (REMs) during REM sleep in humans, we conducted simultaneous functional magnetic resonance imaging (fMRI) and polysomnographic recording during REM sleep. Event-related fMRI analysis time-locked to the occurrence of REMs revealed that the pontine tegmentum, ventroposterior thalamus, primary visual cortex, putamen and limbic areas (the anterior cingulate, parahippocampal gyrus and amygdala) were activated in association with REMs. A control experiment during which subjects made self-paced saccades in total darkness showed no activation in the visual cortex. The REM-related activation of the primary visual cortex without visual input from the retina provides neural evidence for the existence of human ponto-geniculo-occipital waves (PGO waves) and a link between REMs and dreaming. Furthermore, the time-course analysis of blood oxygenation level-dependent responses indicated that the activation of the pontine tegmentum, ventroposterior thalamus and primary visual cortex started before the occurrence of REMs. On the other hand, the activation of the putamen and limbic areas accompanied REMs. The activation of the parahippocampal gyrus and amygdala simultaneously with REMs suggests that REMs and/or their generating mechanism are not merely an epiphenomenon of PGO waves, but may be linked to the triggering activation of these areas.
Collapse
|
18
|
Rieger JW, Schoenfeld MA, Heinze HJ, Bodis-Wollner I. Different spatial organizations of saccade related BOLD-activation in parietal and striate cortex. Brain Res 2008; 1233:89-97. [DOI: 10.1016/j.brainres.2008.07.108] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2008] [Revised: 07/16/2008] [Accepted: 07/26/2008] [Indexed: 10/21/2022]
|
19
|
Berman R, Colby C. Attention and active vision. Vision Res 2008; 49:1233-48. [PMID: 18627774 DOI: 10.1016/j.visres.2008.06.017] [Citation(s) in RCA: 44] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2007] [Revised: 06/11/2008] [Accepted: 06/14/2008] [Indexed: 11/27/2022]
Abstract
Visual perception results from the interaction of incoming sensory signals and top down cognitive and motor signals. Here we focus on the representation of attended locations in parietal cortex and in earlier visual cortical areas. We review evidence that these spatial representations are modulated not only by selective attention but also by the intention to move the eyes. We describe recent experiments in monkey and human that elucidate the mechanisms and circuitry involved in updating, or remapping, the representations of salient stimuli. Two central ideas emerge. First, selective attention and remapping are closely intertwined, and together contribute to the percept of spatial stability. Second, remapping is accomplished not by a single area but by the participation of parietal, frontal and extrastriate cortex as well as subcortical structures. This neural circuitry is distinguished by significant redundancy and plasticity, suggesting that the updating of salient stimuli is fundamental for spatial stability and visuospatial behavior. We conclude that multiple processes and pathways contribute to active vision in the primate brain.
Collapse
Affiliation(s)
- Rebecca Berman
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Bethesda, MD 20892, USA.
| | | |
Collapse
|
20
|
Forgacs PB, von Gizycki H, Selesnick I, Syed NA, Ebrahim K, Avitable M, Amassian V, Lytton W, Bodis-Wollner I. Perisaccadic Parietal and Occipital Gamma Power in Light and in Complete Darkness. Perception 2008; 37:419-32. [DOI: 10.1068/p5875] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Our objective was to determine perisaccadic gamma range oscillations in the EEG during voluntary saccades in humans. We evaluated occipital perisaccadic gamma activity both in the presence and absence of visual input, when the observer was blindfolded. We quantified gamma power in the time periods before, during, and after horizontal saccades. The corresponding EEG was evaluated for individual saccades and the wavelet transformed EEG averaged for each time window, without averaging the EEG first. We found that, in both dark and light, parietal and occipital gamma power increased during the saccade and peaked prior to reaching new fixation. We show that this is not the result of muscle activity and not the result of visual input during saccades. Saccade direction affects the laterality of gamma power over posterior electrodes. Gamma power recorded over the posterior scalp increases during a saccade. The phasic modulation of gamma by saccades in darkness—when occipital activity is decoupled from visual input—provides electrophysiological evidence that voluntary saccades affect ongoing EEG. We suggest that saccade-phasic gamma modulation may contribute to short-term plasticity required to realign the visual space to the intended fixation point of a saccade and provides a mechanism for neuronal assembly formation prior to achieving the intended saccadic goal. The wavelet-transformed perisaccadic EEG could provide an electrophysiological tool applicable in humans for the purpose of fine analysis and potential separation of stages of ‘planning’ and ‘action’.
Collapse
Affiliation(s)
| | | | - Ivan Selesnick
- Department of Electrical & Computer Engineering, Polytechnic University, Brooklyn, NY 11201, USA
| | | | | | | | | | | | | |
Collapse
|
21
|
Bartels A, Zeki S, Logothetis NK. Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain. Cereb Cortex 2007; 18:705-17. [PMID: 17615246 DOI: 10.1093/cercor/bhm107] [Citation(s) in RCA: 109] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Visual changes in feature movies, like in real-live, can be partitioned into global flow due to self/camera motion, local/differential flow due to object motion, and residuals, for example, due to illumination changes. We correlated these measures with brain responses of human volunteers viewing movies in an fMRI scanner. Early visual areas responded only to residual changes, thus lacking responses to equally large motion-induced changes, consistent with predictive coding. Motion activated V5+ (MT+), V3A, medial posterior parietal cortex (mPPC) and, weakly, lateral occipital cortex (LOC). V5+ responded to local/differential motion and depended on visual contrast, whereas mPPC responded to global flow spanning the whole visual field and was contrast independent. mPPC thus codes for flow compatible with unbiased heading estimation in natural scenes and for the comparison of visual flow with nonretinal, multimodal motion cues in it or downstream. mPPC was functionally connected to anterior portions of V5+, whereas laterally neighboring putative homologue of lateral intraparietal area (LIP) connected with frontal eye fields. Our results demonstrate a progression of selectivity from local and contrast-dependent motion processing in V5+ toward global and contrast-independent motion processing in mPPC. The function, connectivity, and anatomical neighborhood of mPPC imply several parallels to monkey ventral intraparietal area (VIP).
Collapse
Affiliation(s)
- A Bartels
- Max Planck Institute for Biological Cybernetics, Department of Physiology of Cognitive Processes, 72076 Tübingen, Germany.
| | | | | |
Collapse
|
22
|
Abstract
The immediacy and directness of our subjective visual experience belies the complexity of the neural mechanisms involved, which remain incompletely understood. This review focuses on how the subjective contents of human visual awareness are encoded in neural activity. Empirical evidence to date suggests that no single brain area is both necessary and sufficient for consciousness. Instead, necessary and sufficient conditions appear to involve both activation of a distributed representation of the visual scene in primary visual cortex and ventral visual areas, plus parietal and frontal activity. The key empirical focus is now on characterizing qualitative differences in the type of neural activity in these areas underlying conscious and unconscious processing. To this end, recent progress in developing novel approaches to accurately decoding the contents of consciousness from brief samples of neural activity show great promise.
Collapse
Affiliation(s)
- Geraint Rees
- Institute of Cognitive Neuroscience and Wellcome Trust Centre for Neuroimaging, University College London, 17 Queen Square, London WC1N 3AR, UK.
| |
Collapse
|
23
|
Tong J, Aydin M, Bedell HE. Direction and extent of perceived motion smear during pursuit eye movement. Vision Res 2007; 47:1011-9. [PMID: 17239420 DOI: 10.1016/j.visres.2006.12.002] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2006] [Revised: 11/18/2006] [Accepted: 12/04/2006] [Indexed: 11/23/2022]
Abstract
Smooth pursuit eye movements superimpose additional motion on the retinal image of untracked visual targets, potentially leading to the perception of motion smear and a distortion of the perceived direction of motion. Previously, we demonstrated an attenuation of perceived motion smear when the untracked target moves in the opposite direction of an ongoing pursuit eye movement. In this study, the extent of perceived motion smear and the direction of perceived smear were compared for a single bright dot that moved in a wide range of directions with respective to horizontal pursuit at 8 deg/s. Comparable data were obtained during fixation as a control. The results indicate that a significant attenuation of perceived motion smear occurs when the dot's motion includes a horizontal component in the opposite direction of eye movement. In contrast, the direction of perceived smear approximates the trajectory of the retinal image motion, during both fixation and pursuit. These results suggest a selective application of extra-retinal signals to compensate specific aspects of visual perception that results from the retinal image motion during smooth pursuit eye movements.
Collapse
Affiliation(s)
- Jianliang Tong
- College of Optometry, University of Houston, Houston, TX, USA
| | | | | |
Collapse
|
24
|
Abstract
With each eye movement, stationary objects in the world change position on the retina, yet we perceive the world as stable. Spatial updating, or remapping, is one neural mechanism by which the brain compensates for shifts in the retinal image caused by voluntary eye movements. Remapping of a visual representation is believed to arise from a widespread neural circuit including parietal and frontal cortex. The current experiment tests the hypothesis that extrastriate visual areas in human cortex have access to remapped spatial information. We tested this hypothesis using functional magnetic resonance imaging (fMRI). We first identified the borders of several occipital lobe visual areas using standard retinotopic techniques. We then tested subjects while they performed a single-step saccade task analogous to the task used in neurophysiological studies in monkeys, and two conditions that control for visual and motor effects. We analyzed the fMRI time series data with a nonlinear, fully Bayesian hierarchical statistical model. We identified remapping as activity in the single-step task that could not be attributed to purely visual or oculomotor effects. The strength of remapping was roughly monotonic with position in the visual hierarchy: remapped responses were largest in areas V3A and hV4 and smallest in V1 and V2. These results demonstrate that updated visual representations are present in cortical areas that are directly linked to visual perception.
Collapse
Affiliation(s)
- Elisha P Merriam
- Department of Neuroscience, and Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA.
| | | | | |
Collapse
|
25
|
Stenbacka L, Vanni S. Central luminance flicker can activate peripheral retinotopic representation. Neuroimage 2006; 34:342-8. [PMID: 17049885 DOI: 10.1016/j.neuroimage.2006.08.029] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2006] [Revised: 08/08/2006] [Accepted: 08/09/2006] [Indexed: 11/22/2022] Open
Abstract
We aimed to study cortical responses to uniform luminance stimulus in different conditions. We stimulated the central visual field with luminance flicker and reversal of checkerboard pattern contrast and mapped the visual field representation up to 50 degrees of eccentricity. Our results show spreading of cortical BOLD responses when visual stimulus contains mean luminance change in dark surround and no spreading when the stimulus surround has bright illumination. No cortical region was more sensitive to luminance flicker than to pattern reversal during both stimulation setups. We suggest that the spread of luminance responses in retinotopic cortical areas results from intraocular scattering of light. Light scattered inside the eye spreads visual stimulation on the retina, and the contrast of the scattered light is strongest when the surround of the stimulus is dark. The stray light is potential and often neglected source of an artefact in visual experiments, and the responses due to stray light can erroneously be interpreted as indicators for local cortical sensitivity to luminance.
Collapse
Affiliation(s)
- Linda Stenbacka
- Brain Research Unit, Low Temperature Laboratory, Helsinki University of Technology, PO Box 3000, FIN-02015 Espoo, Finland.
| | | |
Collapse
|
26
|
Vallines I, Greenlee MW. Saccadic suppression of retinotopically localized blood oxygen level-dependent responses in human primary visual area V1. J Neurosci 2006; 26:5965-9. [PMID: 16738238 PMCID: PMC6675218 DOI: 10.1523/jneurosci.0817-06.2006] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2005] [Revised: 04/21/2006] [Accepted: 04/21/2006] [Indexed: 11/21/2022] Open
Abstract
Saccadic eye movements are responsible for bringing relevant parts of the visual field onto the fovea for detailed analysis. Because the retina is physiologically unable to deliver sharp images at very high transsaccadic speeds, the visual system minimizes the repercussion of the blurry images we would otherwise perceive during transsaccadic vision by reducing general visual sensitivity and increasing the detection threshold for visual stimuli. Ruling out a pure retinal origin, the effects of saccadic suppression can be already observed some 75 ms before the onset of a saccadic eye movement and are maximal at the onset of motion. The perception of a briefly presented stimulus immediately before the onset of any retinal motion is thus impaired despite the fact that this stimulus is projected onto the stationary retina and is, therefore, physically identical to that presented when no saccadic programming is in course. In this functional magnetic resonance imaging event-related study, we flashed Gabor patches at different times before the onset of a horizontal saccade and measured blood oxygen level-dependent responses at their encoding regions in primary visual cortex (V1) while subjects judged the relative orientation of the stimuli. Closely matching the significant reduction in behavioral performance, the amplitude of the responses in V1 consistently decreased as the stimuli were presented closer to the saccadic onset. These results demonstrate that the neural processes underlying saccade programming transiently modulate cortical responses to briefly presented visual stimuli in areas as early a V1, providing additional evidence for the existence of an active saccadic suppression mechanism in humans.
Collapse
Affiliation(s)
- Ignacio Vallines
- Department of Experimental Psychology, University of Regensburg, D-93053 Regensburg, Germany.
| | | |
Collapse
|