1
|
Xiao W, Sharma S, Kreiman G, Livingstone MS. Feature-selective responses in macaque visual cortex follow eye movements during natural vision. Nat Neurosci 2024; 27:1157-1166. [PMID: 38684892 PMCID: PMC11156562 DOI: 10.1038/s41593-024-01631-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 03/26/2024] [Indexed: 05/02/2024]
Abstract
In natural vision, primates actively move their eyes several times per second via saccades. It remains unclear whether, during this active looking, visual neurons exhibit classical retinotopic properties, anticipate gaze shifts or mirror the stable quality of perception, especially in complex natural scenes. Here, we let 13 monkeys freely view thousands of natural images across 4.6 million fixations, recorded 883 h of neuronal responses in six areas spanning primary visual to anterior inferior temporal cortex and analyzed spatial, temporal and featural selectivity in these responses. Face neurons tracked their receptive field contents, indicated by category-selective responses. Self-consistency analysis showed that general feature-selective responses also followed eye movements and remained gaze-dependent over seconds of viewing the same image. Computational models of feature-selective responses located retinotopic receptive fields during free viewing. We found limited evidence for feature-selective predictive remapping and no viewing-history integration. Thus, ventral visual neurons represent the world in a predominantly eye-centered reference frame during natural vision.
Collapse
Affiliation(s)
- Will Xiao
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA.
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA.
| | - Saloni Sharma
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Gabriel Kreiman
- Department of Ophthalmology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | | |
Collapse
|
2
|
Callara AL, Greco A, Scilingo EP, Bonfiglio L. Neuronal correlates of eyeblinks are an expression of primary consciousness phenomena. Sci Rep 2023; 13:12617. [PMID: 37537328 PMCID: PMC10400571 DOI: 10.1038/s41598-023-39500-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 07/26/2023] [Indexed: 08/05/2023] Open
Abstract
The blinking rate far exceeds that required for moistening the cornea and changes depending on whether a person is resting or engaged in cognitive tasks. During ecological cognitive tasks (such as speaking, reading, and watching videos), blinks occur at breakpoints of attention suggesting a role in information segmentation, but the close relationship between cognition dynamics and blink timing still escapes a full understanding. The aim of the present study is to seek (1) if there is a temporal relationship between blink events and the consecutive steps of cognitive processing, and (2) if blink timing and the intensity of blink-related EEG responses are affected by task-relevance of stimuli. Our results show that, in a classical visual oddball task, (i) the occurrence of blinks is influenced by stimuli, irrespective of their relevance, (ii) blinks following relevant stimuli are only apparently delayed due to the need of finalizing a behavioural response, and (iii) stimulus relevance does not affect the intensity of the blink-related EEG response. This evidence reinforce the idea that blinks are not emitted until the last step of the processing sequence has been completed and suggests that blink-related EEG responses are generated by primary consciousness phenomena which are considered by their nature non-modulable (all-or-nothing) phenomena.
Collapse
Affiliation(s)
- Alejandro Luis Callara
- Dipartimento di Ingegneria dell'Informazione, University of Pisa, Via G. Caruso 16, 56122, Pisa, Italy
- Research Center "E. Piaggio", University of Pisa, Largo Lucio Lazzarino 1, 56122, Pisa, Italy
| | - Alberto Greco
- Dipartimento di Ingegneria dell'Informazione, University of Pisa, Via G. Caruso 16, 56122, Pisa, Italy
- Research Center "E. Piaggio", University of Pisa, Largo Lucio Lazzarino 1, 56122, Pisa, Italy
| | - Enzo Pasquale Scilingo
- Dipartimento di Ingegneria dell'Informazione, University of Pisa, Via G. Caruso 16, 56122, Pisa, Italy
- Research Center "E. Piaggio", University of Pisa, Largo Lucio Lazzarino 1, 56122, Pisa, Italy
| | - Luca Bonfiglio
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy.
- Unit of Developmental Neurorehabilitation, Maternal and Child Department, Pisa University Hospital, Pisa, Italy.
| |
Collapse
|
3
|
Vishne G, Gerber EM, Knight RT, Deouell LY. Distinct ventral stream and prefrontal cortex representational dynamics during sustained conscious visual perception. Cell Rep 2023; 42:112752. [PMID: 37422763 PMCID: PMC10530642 DOI: 10.1016/j.celrep.2023.112752] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 05/12/2023] [Accepted: 06/20/2023] [Indexed: 07/11/2023] Open
Abstract
Instances of sustained stationary sensory input are ubiquitous. However, previous work focused almost exclusively on transient onset responses. This presents a critical challenge for neural theories of consciousness, which should account for the full temporal extent of experience. To address this question, we use intracranial recordings from ten human patients with epilepsy to view diverse images of multiple durations. We reveal that, in sensory regions, despite dramatic changes in activation magnitude, the distributed representation of categories and exemplars remains sustained and stable. In contrast, in frontoparietal regions, we find transient content representation at stimulus onset. Our results highlight the connection between the anatomical and temporal correlates of experience. To the extent perception is sustained, it may rely on sensory representations and to the extent perception is discrete, centered on perceptual updating, it may rely on frontoparietal representations.
Collapse
Affiliation(s)
- Gal Vishne
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel.
| | - Edden M Gerber
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Leon Y Deouell
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel; Department of Psychology, The Hebrew University of Jerusalem, Jerusalem 9190501, Israel.
| |
Collapse
|
4
|
Broday-Dvir R, Norman Y, Harel M, Mehta AD, Malach R. Perceptual stability reflected in neuronal pattern similarities in human visual cortex. Cell Rep 2023; 42:112614. [PMID: 37285270 DOI: 10.1016/j.celrep.2023.112614] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 03/14/2023] [Accepted: 05/22/2023] [Indexed: 06/09/2023] Open
Abstract
The magnitude of neuronal activation is commonly considered a critical factor for conscious perception of visual content. However, this dogma contrasts with the phenomenon of rapid adaptation, in which the magnitude of neuronal activation drops dramatically in a rapid manner while the visual stimulus and the conscious experience it elicits remain stable. Here, we report that the profiles of multi-site activation patterns and their relational geometry-i.e., the similarity distances between activation patterns, as revealed using intracranial electroencephalographic (iEEG) recordings-are sustained during extended visual stimulation despite the major magnitude decrease. These results are compatible with the hypothesis that conscious perceptual content is associated with the neuronal pattern profiles and their similarity distances, rather than the overall activation magnitude, in human visual cortex.
Collapse
Affiliation(s)
- Rotem Broday-Dvir
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Yitzhak Norman
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94143, USA
| | - Michal Harel
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Ashesh D Mehta
- Department of Neurosurgery, Zucker School of Medicine at Hofstra/Northwell, and the Feinstein Institute for Medical Research, Manhasset, NY 11030, USA
| | - Rafael Malach
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot 76100, Israel.
| |
Collapse
|
5
|
Nentwich M, Leszczynski M, Russ BE, Hirsch L, Markowitz N, Sapru K, Schroeder CE, Mehta AD, Bickel S, Parra LC. Semantic novelty modulates neural responses to visual change across the human brain. Nat Commun 2023; 14:2910. [PMID: 37217478 PMCID: PMC10203305 DOI: 10.1038/s41467-023-38576-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Accepted: 05/08/2023] [Indexed: 05/24/2023] Open
Abstract
Our continuous visual experience in daily life is dominated by change. Previous research has focused on visual change due to stimulus motion, eye movements or unfolding events, but not their combined impact across the brain, or their interactions with semantic novelty. We investigate the neural responses to these sources of novelty during film viewing. We analyzed intracranial recordings in humans across 6328 electrodes from 23 individuals. Responses associated with saccades and film cuts were dominant across the entire brain. Film cuts at semantic event boundaries were particularly effective in the temporal and medial temporal lobe. Saccades to visual targets with high visual novelty were also associated with strong neural responses. Specific locations in higher-order association areas showed selectivity to either high or low-novelty saccades. We conclude that neural activity associated with film cuts and eye movements is widespread across the brain and is modulated by semantic novelty.
Collapse
Affiliation(s)
- Maximilian Nentwich
- Department of Biomedical Engineering, The City College of New York, New York, NY, USA.
| | - Marcin Leszczynski
- Departments of Psychiatry and Neurology, Columbia University College of Physicians and Surgeons, New York, NY, USA
- Translational Neuroscience Lab Division, Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
- Cognitive Science Department, Institute of Philosophy, Jagiellonian University, Kraków, Poland
| | - Brian E Russ
- Translational Neuroscience Lab Division, Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine, New York, NY, USA
- Department of Psychiatry, New York University at Langone, New York, NY, USA
| | - Lukas Hirsch
- Department of Biomedical Engineering, The City College of New York, New York, NY, USA
| | - Noah Markowitz
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
| | - Kaustubh Sapru
- Department of Biomedical Engineering, The City College of New York, New York, NY, USA
| | - Charles E Schroeder
- Departments of Psychiatry and Neurology, Columbia University College of Physicians and Surgeons, New York, NY, USA
- Translational Neuroscience Lab Division, Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
| | - Ashesh D Mehta
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Departments of Neurosurgery and Neurology, Zucker School of Medicine at Hofstra/Northwell, Manhasset, NY, USA
| | - Stephan Bickel
- Translational Neuroscience Lab Division, Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Departments of Neurosurgery and Neurology, Zucker School of Medicine at Hofstra/Northwell, Manhasset, NY, USA
| | - Lucas C Parra
- Department of Biomedical Engineering, The City College of New York, New York, NY, USA.
| |
Collapse
|
6
|
Axelrod V, Rozier C, Sohier E, Lehongre K, Adam C, Lambrecq V, Navarro V, Naccache L. Intracranial study in humans: Neural spectral changes during watching comedy movie of Charlie Chaplin. Neuropsychologia 2023; 185:108558. [PMID: 37061128 DOI: 10.1016/j.neuropsychologia.2023.108558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 03/01/2023] [Accepted: 04/04/2023] [Indexed: 04/17/2023]
Abstract
Humor plays a prominent role in our lives. Thus, understanding the cognitive and neural mechanisms of humor is particularly important. Previous studies that investigated neural substrates of humor used functional MRI and to a lesser extent EEG. In the present study, we conducted intracranial recording in human patients, enabling us to obtain the signal with high temporal precision from within specific brain locations. Our analysis focused on the temporal lobe and the surrounding areas, the temporal lobe was most densely covered in our recording. Thirteen patients watched a fragment of a Charlie Chaplin movie. An independent group of healthy participants rated the same movie fragment, helping us to identify the most funny and the least funny frames of the movie. We compared neural activity occurring during the most funny and least funny frames across frequencies in the range of 1-170 Hz. The most funny compared to least funny parts of the movie were associated with activity modulation in the broadband high-gamma (70-170 Hz; mostly activation) and to a lesser extent gamma band (40-69Hz; activation) and low frequencies (1-12 Hz, delta, theta, alpha bands; mostly deactivation). With regard to regional specificity, we found three types of brain areas: (I) temporal pole, middle and inferior temporal gyrus (both anterior and posterior) in which there was both activation in the high-gamma/gamma bands and deactivation in low frequencies; (II) ventral part of the temporal lobe such as the fusiform gyrus, in which there was mostly deactivation the low frequencies; (III) posterior temporal cortex and its environment, such as the middle occipital and the temporo-parietal junction, in which there was activation in the high-gamma/gamma band. Overall, our results suggest that humor appreciation might be achieved by neural activity across the frequency spectrum.
Collapse
Affiliation(s)
- Vadim Axelrod
- The Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Ramat Gan, 52900, Israel.
| | - Camille Rozier
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Elisa Sohier
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Katia Lehongre
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Claude Adam
- AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France
| | - Virginie Lambrecq
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France; AP-HP, EEG Unit, Neurophysiology Department, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France
| | - Vincent Navarro
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France; AP-HP, EEG Unit, Neurophysiology Department, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France; AP-HP, Center of Reference for Rare Epilepsies, Pitié-Salpêtrière Hospital, Paris, France
| | - Lionel Naccache
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France; AP-HP, Groupe hospitalier Pitié-Salpêtrière, Department of Neurophysiology, 47-83 boulevard de l'Hôpital, Paris 75013, France
| |
Collapse
|
7
|
Mercier MR, Dubarry AS, Tadel F, Avanzini P, Axmacher N, Cellier D, Vecchio MD, Hamilton LS, Hermes D, Kahana MJ, Knight RT, Llorens A, Megevand P, Melloni L, Miller KJ, Piai V, Puce A, Ramsey NF, Schwiedrzik CM, Smith SE, Stolk A, Swann NC, Vansteensel MJ, Voytek B, Wang L, Lachaux JP, Oostenveld R. Advances in human intracranial electroencephalography research, guidelines and good practices. Neuroimage 2022; 260:119438. [PMID: 35792291 DOI: 10.1016/j.neuroimage.2022.119438] [Citation(s) in RCA: 47] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/23/2022] [Accepted: 06/30/2022] [Indexed: 12/11/2022] Open
Abstract
Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.
Collapse
|
8
|
Ashmaig O, Hamilton LS, Modur P, Buchanan RJ, Preston AR, Watrous AJ. A Platform for Cognitive Monitoring of Neurosurgical Patients During Hospitalization. Front Hum Neurosci 2021; 15:726998. [PMID: 34880738 PMCID: PMC8645698 DOI: 10.3389/fnhum.2021.726998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 10/29/2021] [Indexed: 12/02/2022] Open
Abstract
Intracranial recordings in epilepsy patients are increasingly utilized to gain insight into the electrophysiological mechanisms of human cognition. There are currently several practical limitations to conducting research with these patients, including patient and researcher availability and the cognitive abilities of patients, which limit the amount of task-related data that can be collected. Prior studies have synchronized clinical audio, video, and neural recordings to understand naturalistic behaviors, but these recordings are centered on the patient to understand their seizure semiology and thus do not capture and synchronize audiovisual stimuli experienced by patients. Here, we describe a platform for cognitive monitoring of neurosurgical patients during their hospitalization that benefits both patients and researchers. We provide the full specifications for this system and describe some example use cases in perception, memory, and sleep research. We provide results obtained from a patient passively watching TV as proof-of-principle for the naturalistic study of cognition. Our system opens up new avenues to collect more data per patient using real-world behaviors, affording new possibilities to conduct longitudinal studies of the electrophysiological basis of human cognition under naturalistic conditions.
Collapse
Affiliation(s)
- Omer Ashmaig
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, United States
- Center for Learning and Memory, The University of Texas at Austin, Austin, TX, United States
| | - Liberty S. Hamilton
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, United States
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, United States
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, United States
| | - Pradeep Modur
- Seton Brain and Spine Institute, Division of Neurosurgery, Austin, TX, United States
| | - Robert J. Buchanan
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, United States
- Seton Brain and Spine Institute, Division of Neurosurgery, Austin, TX, United States
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, United States
- Department of Psychiatry and Behavioral Sciences, Dell Medical School, The University of Texas at Austin, Austin, TX, United States
| | - Alison R. Preston
- Center for Learning and Memory, The University of Texas at Austin, Austin, TX, United States
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, United States
- Department of Psychology, The University of Texas at Austin, Austin, TX, United States
- Department of Neuroscience, The University of Texas at Austin, Austin, TX, United States
| | - Andrew J. Watrous
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, United States
- Center for Learning and Memory, The University of Texas at Austin, Austin, TX, United States
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, United States
- Department of Psychology, The University of Texas at Austin, Austin, TX, United States
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, United States
| |
Collapse
|
9
|
Malach R. Local neuronal relational structures underlying the contents of human conscious experience. Neurosci Conscious 2021; 2021:niab028. [PMID: 34513028 PMCID: PMC8415036 DOI: 10.1093/nc/niab028] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 08/02/2021] [Accepted: 08/12/2021] [Indexed: 01/04/2023] Open
Abstract
While most theories of consciousness posit some kind of dependence on global network activities, I consider here an alternative, localist perspective-in which localized cortical regions each underlie the emergence of a unique category of conscious experience. Under this perspective, the large-scale activation often found in the cortex is a consequence of the complexity of typical conscious experiences rather than an obligatory condition for the emergence of conscious awareness-which can flexibly shift, depending on the richness of its contents, from local to more global activation patterns. This perspective fits a massive body of human imaging, recordings, lesions and stimulation data but opens a fundamental problem: how can the information, defining each content, be derived locally in each cortical region. Here, I will discuss a solution echoing pioneering structuralist ideas in which the content of a conscious experience is defined by its relationship to all other contents within an experiential category. In neuronal terms, this relationship structure between contents is embodied by the local geometry of similarity distances between cortical activation patterns generated during each conscious experience, likely mediated via networks of local neuronal connections. Thus, in order for any conscious experience to appear in an individual's mind, two central conditions must be met. First, a specific configural pattern ("bar-code") of neuronal activity must appear within a local relational geometry, i.e. a cortical area. Second, the individual neurons underlying the activated pattern must be bound into a unified functional ensemble through a burst of recurrent neuronal firing: local "ignitions".
Collapse
Affiliation(s)
- Rafael Malach
- Department of Brain Sciences, Weizmann Institute of Science, 200 Herzl St. POB 76100, Rehovot, Israel
- The School of Psychological Sciences, Tel Aviv University, P.O. Box 39040, Tel Aviv 6997801, Israel
| |
Collapse
|
10
|
Cheviet A, Pisella L, Pélisson D. The posterior parietal cortex processes visuo-spatial and extra-retinal information for saccadic remapping: A case study. Cortex 2021; 139:134-151. [PMID: 33862400 DOI: 10.1016/j.cortex.2021.02.026] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 11/10/2020] [Accepted: 02/28/2021] [Indexed: 11/26/2022]
Abstract
Optimally collecting information and controlling behaviour require that we constantly scan our visual environment through eye movements. How the dynamic interaction between short-lived retinal images and extra-retinal signals of eye motion results in our subjective experience of visual stability remains a major issue in Cognitive Neuroscience. The present study aimed to assess and determine the nature of the contribution of the posterior parietal cortex (PPC) to the saccadic remapping mechanisms which contribute to such perceptual visual constancy. Perceptual responses in transsaccadic visual localization tasks were measured in a patient presenting with a PPC lesion and manifesting optic ataxia in the left hemifield with no neglect. Two perceptual localization tasks, each with versus without an intervening saccade, were used: the saccadic suppression of displacement (SSD) task (Ostendorf, Liebermann, & Ploner, 2010) and the peri-saccadic flash localization (LOC) task (Zimmerman & Lappe, 2010). Compared to a group of age-matched healthy subjects, the patient showed a specific pattern of perceptual deficits in the ataxic (left) hemifield. First, a significant impairment occurred in the stationary eye conditions, attesting for an alteration of visuo-spatial encoding. Second, in the saccade conditions, an additional perceptual deficit (an error of ~5° along the saccade direction) was observed in both tasks and mainly in conditions where extra-retinal signals are thought to be critically involved, revealing a constant underestimation by extra-retinal signals of the saccade size, despite preserved saccade accuracy. These findings highlight a crucial role of the PPC in saccadic remapping processes underlying perceptual visual constancy and provide empirical evidence for models such as Ziesche and Hamker's (2014).
Collapse
Affiliation(s)
- Alexis Cheviet
- IMPACT Team, Lyon Neuroscience Research Center, INSERM, U1028, CNRS, UMR5292, University of Lyon, Bron Cedex, France.
| | - Laure Pisella
- IMPACT Team, Lyon Neuroscience Research Center, INSERM, U1028, CNRS, UMR5292, University of Lyon, Bron Cedex, France.
| | - Denis Pélisson
- IMPACT Team, Lyon Neuroscience Research Center, INSERM, U1028, CNRS, UMR5292, University of Lyon, Bron Cedex, France.
| |
Collapse
|
11
|
Broday-Dvir R, Malach R. Resting-State Fluctuations Underlie Free and Creative Verbal Behaviors in the Human Brain. Cereb Cortex 2020; 31:213-232. [PMID: 32935840 DOI: 10.1093/cercor/bhaa221] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 06/22/2020] [Accepted: 07/17/2020] [Indexed: 11/13/2022] Open
Abstract
Resting-state fluctuations are ubiquitous and widely studied phenomena of the human brain, yet we are largely in the dark regarding their function in human cognition. Here we examined the hypothesis that resting-state fluctuations underlie the generation of free and creative human behaviors. In our experiment, participants were asked to perform three voluntary verbal tasks: a verbal fluency task, a verbal creativity task, and a divergent thinking task, during functional magnetic resonance imaging scanning. Blood oxygenation level dependent (BOLD)-activity during these tasks was contrasted with a control- deterministic verbal task, in which the behavior was fully determined by external stimuli. Our results reveal that all voluntary verbal-generation responses displayed a gradual anticipatory buildup that preceded the deterministic control-related responses. Critically, the time-frequency dynamics of these anticipatory buildups were significantly correlated with resting-state fluctuations' dynamics. These correlations were not a general BOLD-related or verbal-response related result, as they were not found during the externally determined verbal control condition. Furthermore, they were located in brain regions known to be involved in language production, specifically the left inferior frontal gyrus. These results suggest a common function of resting-state fluctuations as the neural mechanism underlying the generation of free and creative behaviors in the human cortex.
Collapse
Affiliation(s)
- Rotem Broday-Dvir
- Department of Neurobiology, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Rafael Malach
- Department of Neurobiology, Weizmann Institute of Science, Rehovot 76100, Israel
| |
Collapse
|
12
|
Leopold DA, Park SH. Studying the visual brain in its natural rhythm. Neuroimage 2020; 216:116790. [PMID: 32278093 DOI: 10.1016/j.neuroimage.2020.116790] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2019] [Revised: 03/26/2020] [Accepted: 03/30/2020] [Indexed: 12/27/2022] Open
Abstract
How the brain fluidly orchestrates visual behavior is a central question in cognitive neuroscience. Researchers studying neural responses in humans and nonhuman primates have mapped out visual response profiles and cognitive modulation in a large number of brain areas, most often using pared down stimuli and highly controlled behavioral paradigms. The historical emphasis on reductionism has placed most studies at one pole of an inherent trade-off between strictly controlled experimental variables and open designs that monitor the brain during its natural modes of operation. This bias toward simplified experiments has strongly shaped the field of visual neuroscience, with little guarantee that the principles and concepts established within that framework will apply more generally. In recent years, a growing number of studies have begun to relax strict experimental control with the aim of understanding how the brain responds under more naturalistic conditions. In this article, we survey research that has explicitly embraced the complexity and rhythm of natural vision. We focus on those studies most pertinent to understanding high-level visual specializations in brains of humans and nonhuman primates. We conclude that representationalist concepts borne from conventional visual experiments fall short in their ability to capture the real-life visual operations undertaken by the brain. More naturalistic approaches, though fraught with experimental and analytic challenges, provide fertile ground for neuroscientists seeking new inroads to investigate how the brain supports core aspects of our daily visual experience.
Collapse
Affiliation(s)
- David A Leopold
- Section on Cognitive Neurophysiology and Imaging, Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, 20892, USA; Neurophysiology Imaging Facility, National Institute of Mental Health, National Institute of Neurological Disorders and Stroke, National Eye Institute, National Institutes of Health, Bethesda, MD, 20892, USA.
| | - Soo Hyun Park
- Section on Cognitive Neurophysiology and Imaging, Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, 20892, USA
| |
Collapse
|
13
|
Kupers ER, Wang HX, Amano K, Kay KN, Heeger DJ, Winawer J. A non-invasive, quantitative study of broadband spectral responses in human visual cortex. PLoS One 2018. [PMID: 29529085 PMCID: PMC5846788 DOI: 10.1371/journal.pone.0193107] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023] Open
Abstract
Currently, non-invasive methods for studying the human brain do not routinely and reliably measure spike-rate-dependent signals, independent of responses such as hemodynamic coupling (fMRI) and subthreshold neuronal synchrony (oscillations and event-related potentials). In contrast, invasive methods—microelectrode recordings and electrocorticography (ECoG)—have recently measured broadband power elevation in field potentials (~50–200 Hz) as a proxy for locally averaged spike rates. Here, we sought to detect and quantify stimulus-related broadband responses using magnetoencephalography (MEG). Extracranial measurements like MEG and EEG have multiple global noise sources and relatively low signal-to-noise ratios; moreover high frequency artifacts from eye movements can be confounded with stimulus design and mistaken for signals originating from brain activity. For these reasons, we developed an automated denoising technique that helps reveal the broadband signal of interest. Subjects viewed 12-Hz contrast-reversing patterns in the left, right, or bilateral visual field. Sensor time series were separated into evoked (12-Hz amplitude) and broadband components (60–150 Hz). In all subjects, denoised broadband responses were reliably measured in sensors over occipital cortex, even in trials without microsaccades. The broadband pattern was stimulus-dependent, with greater power contralateral to the stimulus. Because we obtain reliable broadband estimates with short experiments (~20 minutes), and with sufficient signal-to-noise to distinguish responses to different stimuli, we conclude that MEG broadband signals, denoised with our method, offer a practical, non-invasive means for characterizing spike-rate-dependent neural activity for addressing scientific questions about human brain function.
Collapse
Affiliation(s)
- Eline R. Kupers
- Department of Psychology and Center for Neural Science, New York University, New York, New York, United States of America
- * E-mail:
| | - Helena X. Wang
- Department of Psychology and Center for Neural Science, New York University, New York, New York, United States of America
| | - Kaoru Amano
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
| | - Kendrick N. Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota, United States of America
| | - David J. Heeger
- Department of Psychology and Center for Neural Science, New York University, New York, New York, United States of America
| | - Jonathan Winawer
- Department of Psychology and Center for Neural Science, New York University, New York, New York, United States of America
| |
Collapse
|
14
|
Golan T, Davidesco I, Meshulam M, Groppe DM, Mégevand P, Yeagle EM, Goldfinger MS, Harel M, Melloni L, Schroeder CE, Deouell LY, Mehta AD, Malach R. Increasing suppression of saccade-related transients along the human visual hierarchy. eLife 2017; 6. [PMID: 28850030 PMCID: PMC5576487 DOI: 10.7554/elife.27819] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2017] [Accepted: 08/08/2017] [Indexed: 11/13/2022] Open
Abstract
A key hallmark of visual perceptual awareness is robustness to instabilities arising from unnoticeable eye and eyelid movements. In previous human intracranial (iEEG) work (Golan et al., 2016) we found that excitatory broadband high-frequency activity transients, driven by eye blinks, are suppressed in higher-level but not early visual cortex. Here, we utilized the broad anatomical coverage of iEEG recordings in 12 eye-tracked neurosurgical patients to test whether a similar stabilizing mechanism operates following small saccades. We compared saccades (1.3°−3.7°) initiated during inspection of large individual visual objects with similarly-sized external stimulus displacements. Early visual cortex sites responded with positive transients to both conditions. In contrast, in both dorsal and ventral higher-level sites the response to saccades (but not to external displacements) was suppressed. These findings indicate that early visual cortex is highly unstable compared to higher-level visual regions which apparently constitute the main target of stabilizing extra-retinal oculomotor influences.
Collapse
Affiliation(s)
- Tal Golan
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Ido Davidesco
- Department of Psychology, New York University, New York, United States
| | - Meir Meshulam
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | - David M Groppe
- Department of Neurosurgery, Hofstra Northwell School of Medicine, Manhasset, United States.,The Feinstein Institute for Medical Research, Manhasset, United States.,The Krembil Neuroscience Centre, Toronto, Canada
| | - Pierre Mégevand
- Department of Neurosurgery, Hofstra Northwell School of Medicine, Manhasset, United States.,The Feinstein Institute for Medical Research, Manhasset, United States
| | - Erin M Yeagle
- Department of Neurosurgery, Hofstra Northwell School of Medicine, Manhasset, United States.,The Feinstein Institute for Medical Research, Manhasset, United States
| | - Matthew S Goldfinger
- Department of Neurosurgery, Hofstra Northwell School of Medicine, Manhasset, United States.,The Feinstein Institute for Medical Research, Manhasset, United States
| | - Michal Harel
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | - Lucia Melloni
- Department of Neurophysiology, Max Planck Institute for Brain Research, Frankfurt am Main, Germany.,NYU Comprehensive Epilepsy Center, Department of Neurology, School of Medicine, New York University, New York, United States
| | - Charles E Schroeder
- Department of Neurosurgery, Columbia University College of Physicians and Surgeons, New York, United States.,Cognitive Neuroscience and Schizophrenia Program, Nathan Kline Institute, Orangeburg, United States
| | - Leon Y Deouell
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel.,Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Ashesh D Mehta
- Department of Neurosurgery, Hofstra Northwell School of Medicine, Manhasset, United States.,The Feinstein Institute for Medical Research, Manhasset, United States
| | - Rafael Malach
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| |
Collapse
|
15
|
Isik L, Singer J, Madsen JR, Kanwisher N, Kreiman G. What is changing when: Decoding visual information in movies from human intracranial recordings. Neuroimage 2017; 180:147-159. [PMID: 28823828 DOI: 10.1016/j.neuroimage.2017.08.027] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2017] [Revised: 08/07/2017] [Accepted: 08/08/2017] [Indexed: 11/19/2022] Open
Abstract
The majority of visual recognition studies have focused on the neural responses to repeated presentations of static stimuli with abrupt and well-defined onset and offset times. In contrast, natural vision involves unique renderings of visual inputs that are continuously changing without explicitly defined temporal transitions. Here we considered commercial movies as a coarse proxy to natural vision. We recorded intracranial field potential signals from 1,284 electrodes implanted in 15 patients with epilepsy while the subjects passively viewed commercial movies. We could rapidly detect large changes in the visual inputs within approximately 100 ms of their occurrence, using exclusively field potential signals from ventral visual cortical areas including the inferior temporal gyrus and inferior occipital gyrus. Furthermore, we could decode the content of those visual changes even in a single movie presentation, generalizing across the wide range of transformations present in a movie. These results present a methodological framework for studying cognition during dynamic and natural vision.
Collapse
Affiliation(s)
- Leyla Isik
- Department of Ophthalmology, Boston Children's Hospital, Harvard Medical School, Boston, MA, United States; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States.
| | - Jedediah Singer
- Department of Ophthalmology, Boston Children's Hospital, Harvard Medical School, Boston, MA, United States
| | - Joseph R Madsen
- Department of Neurosurgery, Boston Children's Hospital, Harvard Medical School, Boston, MA, United States
| | - Nancy Kanwisher
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Gabriel Kreiman
- Department of Ophthalmology, Boston Children's Hospital, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
16
|
Human Neurophysiology: Sampling the Perceptual World. Curr Biol 2017; 27:R71-R73. [DOI: 10.1016/j.cub.2016.11.051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|