1
|
Michelmann S, Dugan P, Doyle W, Friedman D, Melloni L, Strauss CK, Devore S, Flinker A, Devinsky O, Hasson U, Norman KA. Fast-timescale hippocampal processes bridge between slowly unfurling neocortical states during memory search. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2025:2025.02.11.637471. [PMID: 39990462 PMCID: PMC11844493 DOI: 10.1101/2025.02.11.637471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 02/25/2025]
Abstract
Prior behavioral work showed that event structure plays a key role in our ability to mentally search through memories of continuous naturalistic experience. We hypothesized that, neurally, this mem- ory search process involves a division of labor between slowly un- furling neocortical states representing event knowledge and fast hippocampal-neocortical communication that supports retrieval of new information at transitions between events. To test this, we tracked slow neural state-patterns in a sample of ten patients under- going intracranial electroencephalography as they viewed a movie and then searched their memories in a structured naturalistic in- terview. As patients answered questions ("after X, when does Y happen next?"), state-patterns from movie-viewing were reinstated in neocortex; during memory-search, states unfurled in a forward di- rection. Moments of state-transition were marked by low-frequency power decreases in cortex and preceded by power decreases in hip- pocampus that correlated with reinstatement. Connectivity-analysis revealed information-flow from hippocampus to cortex underpinning state-transitions. Together, these results support our hypothesis that fast hippocampal processes bridge between slow neocortical states during memory search.
Collapse
|
2
|
López-Madrona VJ, Trébuchon A, Bénar CG, Schön D, Morillon B. Different sustained and induced alpha oscillations emerge in the human auditory cortex during sound processing. Commun Biol 2024; 7:1570. [PMID: 39592826 PMCID: PMC11599602 DOI: 10.1038/s42003-024-07297-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2024] [Accepted: 11/19/2024] [Indexed: 11/28/2024] Open
Abstract
Alpha oscillations in the auditory cortex have been associated with attention and the suppression of irrelevant information. However, their anatomical organization and interaction with other neural processes remain unclear. Do alpha oscillations function as a local mechanism within most neural sources to regulate their internal excitation/inhibition balance, or do they belong to separated inhibitory sources gating information across the auditory network? To address this question, we acquired intracerebral electrophysiological recordings from epilepsy patients during rest and tones listening. Thanks to independent component analysis, we disentangled the different neural sources and labeled them as "oscillatory" if they presented strong alpha oscillations at rest, and/or "evoked" if they displayed a significant evoked response to the stimulation. Our results show that 1) sources are condition-specific and segregated in the auditory cortex, 2) both sources have a high-gamma response followed by an induced alpha suppression, 3) only oscillatory sources present a sustained alpha suppression during all the stimulation period. We hypothesize that there are two different alpha oscillations in the auditory cortex: an induced bottom-up response indicating a selective engagement of the primary cortex to process the stimuli, and a sustained suppression reflecting a general disinhibited state of the network to process sensory information.
Collapse
Affiliation(s)
- Víctor J López-Madrona
- Institute of Language, Communication, and the Brain, Aix-Marseille Univ, Marseille, France.
- Aix-Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille, France.
| | - Agnès Trébuchon
- APHM, Timone Hospital, Epileptology and cerebral rhythmology, Marseille, 13005, France
- APHM, Timone Hospital, Functional and stereotactic neurosurgery, Marseille, 13005, France
| | - Christian G Bénar
- Aix-Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille, France
| | - Daniele Schön
- Aix-Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille, France
| | - Benjamin Morillon
- Aix-Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille, France
| |
Collapse
|
3
|
Zada Z, Goldstein A, Michelmann S, Simony E, Price A, Hasenfratz L, Barham E, Zadbood A, Doyle W, Friedman D, Dugan P, Melloni L, Devore S, Flinker A, Devinsky O, Nastase SA, Hasson U. A shared model-based linguistic space for transmitting our thoughts from brain to brain in natural conversations. Neuron 2024; 112:3211-3222.e5. [PMID: 39096896 PMCID: PMC11427153 DOI: 10.1016/j.neuron.2024.06.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 03/26/2024] [Accepted: 06/25/2024] [Indexed: 08/05/2024]
Abstract
Effective communication hinges on a mutual understanding of word meaning in different contexts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We developed a model-based coupling framework that aligns brain activity in both speaker and listener to a shared embedding space from a large language model (LLM). The context-sensitive LLM embeddings allow us to track the exchange of linguistic information, word by word, from one brain to another in natural conversations. Linguistic content emerges in the speaker's brain before word articulation and rapidly re-emerges in the listener's brain after word articulation. The contextual embeddings better capture word-by-word neural alignment between speaker and listener than syntactic and articulatory models. Our findings indicate that the contextual embeddings learned by LLMs can serve as an explicit numerical model of the shared, context-rich meaning space humans use to communicate their thoughts to one another.
Collapse
Affiliation(s)
- Zaid Zada
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA.
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA; Department of Cognitive and Brain Sciences and Business School, Hebrew University, Jerusalem 9190501, Israel
| | - Sebastian Michelmann
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| | - Erez Simony
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA; Faculty of Engineering, Holon Institute of Technology, Holon 5810201, Israel
| | - Amy Price
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| | - Emily Barham
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA; Department of Psychology, Columbia University, New York, NY 10027, USA
| | - Werner Doyle
- Grossman School of Medicine, New York University, New York, NY 10016, USA
| | - Daniel Friedman
- Grossman School of Medicine, New York University, New York, NY 10016, USA
| | - Patricia Dugan
- Grossman School of Medicine, New York University, New York, NY 10016, USA
| | - Lucia Melloni
- Grossman School of Medicine, New York University, New York, NY 10016, USA
| | - Sasha Devore
- Grossman School of Medicine, New York University, New York, NY 10016, USA
| | - Adeen Flinker
- Grossman School of Medicine, New York University, New York, NY 10016, USA; Tandon School of Engineering, New York University, New York, NY 10016, USA
| | - Orrin Devinsky
- Grossman School of Medicine, New York University, New York, NY 10016, USA
| | - Samuel A Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| |
Collapse
|
4
|
Huang H, Ojeda Valencia G, Gregg NM, Osman GM, Montoya MN, Worrell GA, Miller KJ, Hermes D. CARLA: Adjusted common average referencing for cortico-cortical evoked potential data. J Neurosci Methods 2024; 407:110153. [PMID: 38710234 PMCID: PMC11149384 DOI: 10.1016/j.jneumeth.2024.110153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 02/22/2024] [Accepted: 04/27/2024] [Indexed: 05/08/2024]
Abstract
Human brain connectivity can be mapped by single pulse electrical stimulation during intracranial EEG measurements. The raw cortico-cortical evoked potentials (CCEP) are often contaminated by noise. Common average referencing (CAR) removes common noise and preserves response shapes but can introduce bias from responsive channels. We address this issue with an adjusted, adaptive CAR algorithm termed "CAR by Least Anticorrelation (CARLA)". CARLA was tested on simulated CCEP data and real CCEP data collected from four human participants. In CARLA, the channels are ordered by increasing mean cross-trial covariance, and iteratively added to the common average until anticorrelation between any single channel and all re-referenced channels reaches a minimum, as a measure of shared noise. We simulated CCEP data with true responses in 0-45 of 50 total channels. We quantified CARLA's error and found that it erroneously included 0 (median) truly responsive channels in the common average with ≤42 responsive channels, and erroneously excluded ≤2.5 (median) unresponsive channels at all responsiveness levels. On real CCEP data, signal quality was quantified with the mean R2 between all pairs of channels, which represents inter-channel dependency and is low for well-referenced data. CARLA re-referencing produced significantly lower mean R2 than standard CAR, CAR using a fixed bottom quartile of channels by covariance, and no re-referencing. CARLA minimizes bias in re-referenced CCEP data by adaptively selecting the optimal subset of non-responsive channels. It showed high specificity and sensitivity on simulated CCEP data and lowered inter-channel dependency compared to CAR on real CCEP data.
Collapse
Affiliation(s)
- Harvey Huang
- Mayo Clinic Medical Scientist Training Program, Rochester, MN, USA.
| | | | | | - Gamaleldin M Osman
- Department of Neurology, Mayo Clinic, Rochester, MN, USA; Division of Child Neurology, Department of Pediatrics, McGovern Medical School at UTHealth, Houston, TX, USA
| | - Morgan N Montoya
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA
| | - Gregory A Worrell
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA; Department of Neurology, Mayo Clinic, Rochester, MN, USA
| | - Kai J Miller
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA; Department of Neurologic Surgery, Mayo Clinic, Rochester, MN, USA
| | - Dora Hermes
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA; Department of Neurology, Mayo Clinic, Rochester, MN, USA; Department of Radiology, Mayo Clinic, Rochester, MN 55901, USA.
| |
Collapse
|
5
|
Krugliakova E, Karpovich A, Stieglitz L, Huwiler S, Lustenberger C, Imbach L, Bujan B, Jedrysiak P, Jacomet M, Baumann CR, Fattinger S. Exploring the local field potential signal from the subthalamic nucleus for phase-targeted auditory stimulation in Parkinson's disease. Brain Stimul 2024; 17:769-779. [PMID: 38906529 DOI: 10.1016/j.brs.2024.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 05/26/2024] [Accepted: 06/12/2024] [Indexed: 06/23/2024] Open
Abstract
BACKGROUND Enhancing slow waves, the electrophysiological (EEG) manifestation of non-rapid eye movement (NREM) sleep, could potentially benefit patients with Parkinson's disease (PD) by improving sleep quality and slowing disease progression. Phase-targeted auditory stimulation (PTAS) is an approach to enhance slow waves, which are detected in real-time in the surface EEG signal. OBJECTIVE We aimed to test whether the local-field potential of the subthalamic nucleus (STN-LFP) can be used to detect frontal slow waves and assess the electrophysiological changes related to PTAS. METHODS We recruited patients diagnosed with PD and undergoing Percept™ PC neurostimulator (Medtronic) implantation for deep brain stimulation of STN (STN-DBS) in a two-step surgery. Patients underwent three full-night recordings, including one between-surgeries recording and two during rehabilitation, one with DBS+ (on) and one with DBS- (off). Surface EEG and STN-LFP signals from Percept PC were recorded simultaneously, and PTAS was applied during sleep in all three recording sessions. RESULTS Our results show that during NREM sleep, slow waves of the cortex and STN are time-locked. PTAS application resulted in power and coherence changes, which can be detected in STN-LFP. CONCLUSION Our findings suggest the feasibility of implementing PTAS using solely STN-LFP signal for slow wave detection, thus without a need for an external EEG device alongside the implanted neurostimulator. Moreover, we propose options for more efficient STN-LFP signal preprocessing, including different referencing and filtering to enhance the reliability of cortical slow wave detection in STN-LFP recordings.
Collapse
Affiliation(s)
- Elena Krugliakova
- Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Artyom Karpovich
- Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Lennart Stieglitz
- Department of Neurosurgery, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Stephanie Huwiler
- Neural Control of Movement Lab, Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Caroline Lustenberger
- Neural Control of Movement Lab, Institute of Human Movement Sciences and Sport, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Lukas Imbach
- Swiss Epilepsy Center, Clinic Lengg, Zurich, Switzerland
| | - Bartosz Bujan
- Neurorehabilitation, Clinic Lengg, Zurich, Switzerland
| | | | - Maria Jacomet
- Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Christian R Baumann
- Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Sara Fattinger
- Department of Neurology, Clinical Neuroscience Center, University Hospital Zurich, University of Zurich, Zurich, Switzerland.
| |
Collapse
|
6
|
Hamzah HA, Abdalla KK. EEG-based emotion recognition systems; comprehensive study. Heliyon 2024; 10:e31485. [PMID: 38818173 PMCID: PMC11137547 DOI: 10.1016/j.heliyon.2024.e31485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Accepted: 05/16/2024] [Indexed: 06/01/2024] Open
Abstract
Emotion recognition technology through EEG signal analysis is currently a fundamental concept in artificial intelligence. This recognition has major practical implications in emotional health care, human-computer interaction, and so on. This paper provides a comprehensive study of different methods for extracting electroencephalography (EEG) features for emotion recognition from four different perspectives, including time domain features, frequency domain features, time-frequency features, and nonlinear features. We summarize the current pattern recognition methods adopted in most related works, and with the rapid development of deep learning (DL) attracting the attention of researchers in this field, we pay more attention to deep learning-based studies and analyse the characteristics, advantages, disadvantages, and applicable scenarios. Finally, the current challenges and future development directions in this field were summarized. This paper can help novice researchers in this field gain a systematic understanding of the current status of emotion recognition research based on EEG signals and provide ideas for subsequent related research.
Collapse
Affiliation(s)
- Hussein Ali Hamzah
- Electrical Engineering Department, College of Engineering, University of Babylon, Iraq
| | - Kasim K. Abdalla
- Electrical Engineering Department, College of Engineering, University of Babylon, Iraq
| |
Collapse
|
7
|
López-Madrona VJ, Trébuchon A, Mindruta I, Barbeau EJ, Barborica A, Pistol C, Oane I, Alario FX, Bénar CG. Identification of Early Hippocampal Dynamics during Recognition Memory with Independent Component Analysis. eNeuro 2024; 11:ENEURO.0183-23.2023. [PMID: 38514193 PMCID: PMC10993203 DOI: 10.1523/eneuro.0183-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 11/24/2023] [Accepted: 12/11/2023] [Indexed: 03/23/2024] Open
Abstract
The hippocampus is generally considered to have relatively late involvement in recognition memory, its main electrophysiological signature being between 400 and 800 ms after stimulus onset. However, most electrophysiological studies have analyzed the hippocampus as a single responsive area, selecting only a single-site signal exhibiting the strongest effect in terms of amplitude. These classical approaches may not capture all the dynamics of this structure, hindering the contribution of other hippocampal sources that are not located in the vicinity of the selected site. We combined intracerebral electroencephalogram recordings from epileptic patients with independent component analysis during a recognition memory task involving the recognition of old and new images. We identified two sources with different responses emerging from the hippocampus: a fast one (maximal amplitude at ∼250 ms) that could not be directly identified from raw recordings and a latter one, peaking at ∼400 ms. The former component presented different amplitudes between old and new items in 6 out of 10 patients. The latter component had different delays for each condition, with a faster activation (∼290 ms after stimulus onset) for recognized items. We hypothesize that both sources represent two steps of hippocampal recognition memory, the faster reflecting the input from other structures and the latter the hippocampal internal processing. Recognized images evoking early activations would facilitate neural computation in the hippocampus, accelerating memory retrieval of complementary information. Overall, our results suggest that the hippocampal activity is composed of several sources with an early activation related to recognition memory.
Collapse
Affiliation(s)
| | - Agnès Trébuchon
- Epileptology and Cerebral Rhythmology, APHM, Timone Hospital, Marseille 13005, France
- Functional and Stereotactic Neurosurgery, APHM, Timone Hospital, Marseille 13005, France
| | - Ioana Mindruta
- Physics Department, University of Bucharest, Bucharest, Romania
| | - Emmanuel J Barbeau
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
| | | | - Costi Pistol
- Physics Department, University of Bucharest, Bucharest, Romania
| | - Irina Oane
- Physics Department, University of Bucharest, Bucharest, Romania
| | | | - Christian G Bénar
- Inst Neurosci Syst, INS, INSERM, Aix Marseille Univ, Marseille 13005, France
| |
Collapse
|
8
|
Man V, Cockburn J, Flouty O, Gander PE, Sawada M, Kovach CK, Kawasaki H, Oya H, Howard Iii MA, O'Doherty JP. Temporally organized representations of reward and risk in the human brain. Nat Commun 2024; 15:2162. [PMID: 38461343 PMCID: PMC10924934 DOI: 10.1038/s41467-024-46094-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 02/13/2024] [Indexed: 03/11/2024] Open
Abstract
The value and uncertainty associated with choice alternatives constitute critical features relevant for decisions. However, the manner in which reward and risk representations are temporally organized in the brain remains elusive. Here we leverage the spatiotemporal precision of intracranial electroencephalography, along with a simple card game designed to elicit the unfolding computation of a set of reward and risk variables, to uncover this temporal organization. Reward outcome representations across wide-spread regions follow a sequential order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We further highlight the role of the anterior insula in generalizing between reward prediction error and risk prediction error codes. Together our results emphasize the importance of neural dynamics for understanding value-based decisions under uncertainty.
Collapse
Affiliation(s)
- Vincent Man
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.
| | - Jeffrey Cockburn
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Oliver Flouty
- Department of Neurosurgery and Brain Repair, University of South Florida, Tampa, FL, 33606, USA
| | - Phillip E Gander
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Iowa Neuroscience Institute, University of Iowa Carver College of Medicine, Iowa City, IA, 52242, USA
| | - Masahiro Sawada
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
| | - Christopher K Kovach
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Department of Neurosurgery, University of Nebraska Medical Center, Omaha, NE, 68198, USA
| | - Hiroto Kawasaki
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
| | - Hiroyuki Oya
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Iowa Neuroscience Institute, University of Iowa Carver College of Medicine, Iowa City, IA, 52242, USA
| | - Matthew A Howard Iii
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, 52242, USA
- Iowa Neuroscience Institute, University of Iowa Carver College of Medicine, Iowa City, IA, 52242, USA
| | - John P O'Doherty
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA
- Computation and Neural Systems, California Institute of Technology, Pasadena, CA, 91125, USA
| |
Collapse
|
9
|
Peterson V, Vissani M, Luo S, Rabbani Q, Crone NE, Bush A, Mark Richardson R. A supervised data-driven spatial filter denoising method for speech artifacts in intracranial electrophysiological recordings. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.05.535577. [PMID: 37066306 PMCID: PMC10104030 DOI: 10.1101/2023.04.05.535577] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
Neurosurgical procedures that enable direct brain recordings in awake patients offer unique opportunities to explore the neurophysiology of human speech. The scarcity of these opportunities and the altruism of participating patients compel us to apply the highest rigor to signal analysis. Intracranial electroencephalography (iEEG) signals recorded during overt speech can contain a speech artifact that tracks the fundamental frequency (F0) of the participant's voice, involving the same high-gamma frequencies that are modulated during speech production and perception. To address this artifact, we developed a spatial-filtering approach to identify and remove acoustic-induced contaminations of the recorded signal. We found that traditional reference schemes jeopardized signal quality, whereas our data-driven method denoised the recordings while preserving underlying neural activity.
Collapse
Affiliation(s)
- Victoria Peterson
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, United States
- Instituto de Matemática Aplicada del Litoral, IMAL, FIQ-UNL, CONICET, Santa Fe, Argentina
| | - Matteo Vissani
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, United States
| | - Shiyu Luo
- Department of Biomedical Engineering, The Johns Hopkins University School of Medicine
| | - Qinwan Rabbani
- Department of Electrical & Computer Engineering, The Johns Hopkins University
| | - Nathan E. Crone
- Department of Neurology, The Johns Hopkins University School of Medicine
| | - Alan Bush
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, United States
| | - R. Mark Richardson
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, United States
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
| |
Collapse
|
10
|
Dong L, Lai Y, Duan M, Qin Y, Luo C, Wang L, Wang Y, Cai X, Huang P, Cui H, Yao D. Rereferencing of clinical EEGs with nonunipolar mastoid reference to infinity reference by REST. Clin Neurophysiol 2023; 151:1-9. [PMID: 37116379 DOI: 10.1016/j.clinph.2023.03.361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 03/07/2023] [Accepted: 03/30/2023] [Indexed: 04/30/2023]
Abstract
OBJECTIVE Conventional electroencephalography (EEG) offline subtraction rereferencing is invalid for many clinical practices when adopting a specific nonunipolar recording montage (e.g., the ipsilateral mastoid (IM) and contralateral mastoid (CM)). Further comparative analyses would thus be blocked due to the lack of a uniform offline reference. Therefore, our goal was to resolve this problem by introducing and assessing the reference electrode standardization technique (REST) to transform nonunipolar mastoid montages into a computational zero reference at infinity (IR) offline. METHODS For EEG signals and power/connectivity configurations, simulation and clinical schizophrenia resting-state EEG datasets were used to investigate the performance of REST. RESULTS REST produced small absolute errors (signal level: 1.21-1.26; power: 0.0057-0.021; connectivity: 0.066-0.088) and high correlations (>0.9) between the IM/CM-IR and true IR references. Using clinical data with the IM online reference, REST revealed valuable changes in spectral and connectivity (P < 0.05) in schizophrenia patients, consistent with previous studies. CONCLUSIONS These results demonstrated that REST transformation could be adopted to resolve the offline rereferencing of clinical EEGs with specific nonunipolar mastoid references. SIGNIFICANCE REST could be an effective and robust resolution for nonunipolar clinical EEGs and could therefore retrieve these data for further analysis by deriving a favorable offline reference IR.
Collapse
Affiliation(s)
- Li Dong
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China; Sichuan Institute for Brain Science and Brain-Inspired Intelligence, Chengdu 611731, China
| | - Yongxiu Lai
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China
| | - Mingjun Duan
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Sichuan Institute for Brain Science and Brain-Inspired Intelligence, Chengdu 611731, China
| | - Yun Qin
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China; Sichuan Institute for Brain Science and Brain-Inspired Intelligence, Chengdu 611731, China
| | - Cheng Luo
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China; Sichuan Institute for Brain Science and Brain-Inspired Intelligence, Chengdu 611731, China
| | - Liping Wang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China
| | - Yongchao Wang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China
| | - Xiyu Cai
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China
| | - Pan Huang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China
| | - Huizhen Cui
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China
| | - Dezhong Yao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China; Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035 Chengdu, China; School of Electrical Engineering, Zhengzhou University, Zhengzhou 450001, China; Sichuan Institute for Brain Science and Brain-Inspired Intelligence, Chengdu 611731, China.
| |
Collapse
|
11
|
Zada Z, Goldstein A, Michelmann S, Simony E, Price A, Hasenfratz L, Barham E, Zadbood A, Doyle W, Friedman D, Dugan P, Melloni L, Devore S, Flinker A, Devinsky O, Nastase SA, Hasson U. A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.27.546708. [PMID: 37425747 PMCID: PMC10327051 DOI: 10.1101/2023.06.27.546708] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speaker's brain before word articulation, and the same linguistic content rapidly reemerged in the listener's brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts.
Collapse
Affiliation(s)
- Zaid Zada
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
- Department of Cognitive and Brain Sciences and Business School, Hebrew University; Jerusalem, 9190501, Israel
| | - Sebastian Michelmann
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Erez Simony
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
- Faculty of Engineering, Holon Institute of Technology, Holon, 5810201, Israel
| | - Amy Price
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Emily Barham
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
- Department of Psychology, Columbia University; New York, 10027, USA
| | - Werner Doyle
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Daniel Friedman
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Patricia Dugan
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Lucia Melloni
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Sasha Devore
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Adeen Flinker
- Grossman School of Medicine, New York University; New York, 10016, USA
- Tandon School of Engineering, New York University; New York, 10016, USA
| | - Orrin Devinsky
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Samuel A. Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| |
Collapse
|
12
|
Man V, Cockburn J, Flouty O, Gander PE, Sawada M, Kovach CK, Kawasaki H, Oya H, Howard MA, O'Doherty JP. Temporally organized representations of reward and risk in the human brain. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.09.539916. [PMID: 37214975 PMCID: PMC10197553 DOI: 10.1101/2023.05.09.539916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
The value and uncertainty associated with choice alternatives constitute critical features along which decisions are made. While the neural substrates supporting reward and risk processing have been investigated, the temporal organization by which these computations are encoded remains elusive. Here we leverage the high spatiotemporal precision of intracranial electroencephalography (iEEG) to uncover how representations of decision-related computations unfold in time. We present evidence of locally distributed representations of reward and risk variables that are temporally organized across multiple regions of interest. Reward outcome representations across wide-spread regions follow a temporally cascading order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We highlight the role of the anterior insula in generalizing between reward prediction error (RePE) and risk prediction error (RiPE), within which the encoding of RePE in the distributed iEEG signal predicts RiPE. Together our results emphasize the utility of uncovering temporal dynamics in the human brain for understanding how computational processes critical for value-based decisions under uncertainty unfold.
Collapse
|
13
|
Jiang Z, Liu Y, Li W, Dai Y, Zou L. Integration of Simultaneous fMRI and EEG source localization in emotional decision problems. Behav Brain Res 2023; 448:114445. [PMID: 37094717 DOI: 10.1016/j.bbr.2023.114445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Revised: 04/08/2023] [Accepted: 04/21/2023] [Indexed: 04/26/2023]
Abstract
Simultaneous EEG-fMRI has been a powerful technique to understand the mechanism of the brain in recent years. In this paper, we develop an integrating method by integrating the EEG data into the fMRI data based on the parametric empirical Bayesian (PEB) model to improve the accuracy of the brain source location. The gambling task, a classic paradigm, is used for the emotional decision-making study in this paper. The proposed method was conducted on 21 participants, including 16 men and 5 women. Contrary to the previous method that only localizes the area widely distributed across the ventral striatum and orbitofrontal cortex, the proposed method localizes accurately at the orbital frontal cortex during the process of the brain's emotional decision-making. The activated brain regions extracted by source localization were mainly located in the prefrontal and orbitofrontal lobes; the activation of the temporal pole regions unrelated to reward processing disappeared, and the activation of the somatosensory cortex and motor cortex was significantly reduced. The log evidence shows that the integration of simultaneous fMRI and EEG method based on synchronized data evidence is 22420, the largest value among the three methods. The integration method always takes on a larger value of log evidence and describes a better performance in analysis associated with source localization. DATA AVAILABILITY: The data used in the current study are available from the corresponding authouponon reasonable request.
Collapse
Affiliation(s)
- Zhongyi Jiang
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, Jiangsu 213164, China
| | - Yin Liu
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, Jiangsu 213164, China
| | - Wenjie Li
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, Jiangsu 213164, China
| | - Yakang Dai
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu, 215163, China
| | - Ling Zou
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, Jiangsu 213164, China; School of Microelectronics and Control Engineering, Changzhou University, Changzhou, Jiangsu 213164, China; Key Laboratory of Brain Machine Collaborative Intelligence Foundation of Zhejiang Province, Hangzhou, Zhejiang, 310018, China.
| |
Collapse
|
14
|
Saint Amour di Chanaz L, Pérez-Bellido A, Wu X, Lonzano-Soldevilla D, Pacheco-Estefan D, Lehongre K, Conde-Blanco E, Roldan P, Adam C, Lambrecq V, Frazzini V, Donaire A, Carreño M, Navarro V, Valero-Cabré A, Fuentemilla L. Gamma amplitude is coupled to opposed hippocampal theta-phase states during the encoding and retrieval of episodic memories in humans. Curr Biol 2023; 33:1836-1843.e6. [PMID: 37060906 DOI: 10.1016/j.cub.2023.03.073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 01/05/2023] [Accepted: 03/24/2023] [Indexed: 04/17/2023]
Abstract
Computational models and in vivo studies in rodents suggest that the emergence of gamma activity (40-140 Hz) during memory encoding and retrieval is coupled to opposed-phase states of the underlying hippocampal theta rhythm (4-9 Hz).1,2,3,4,5,6,7,8,9,10 However, direct evidence for whether human hippocampal gamma-modulated oscillatory activity in memory processes is coupled to opposed-phase states of the ongoing theta rhythm remains elusive. Here, we recorded local field potentials (LFPs) directly from the hippocampus of 10 patients with epilepsy, using depth electrodes. We used a memory encoding and retrieval task whereby trial unique sequences of pictures depicting real-life episodes were presented, and 24 h later, participants were asked to recall them upon the appearance of the first picture of the encoded episodic sequence. We found theta-to-gamma cross-frequency coupling that was specific to the hippocampus during both the encoding and retrieval of episodic memories. We also revealed that gamma was coupled to opposing theta phases during both encoding and recall processes. Additionally, we observed that the degree of theta-gamma phase opposition between encoding and recall was associated with participants' memory performance, so gamma power was modulated by theta phase for both remembered and forgotten trials, although only for remembered trials the dominant theta phase was different for encoding and recall trials. The current results offer direct empirical evidence in support of hippocampal theta-gamma phase opposition models in human long-term memory and provide fundamental insights into mechanistic predictions derived from computational and animal work, thereby contributing to establishing similarities and differences across species.
Collapse
Affiliation(s)
- Ludovico Saint Amour di Chanaz
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain; Institute of Neurosciences, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain
| | - Alexis Pérez-Bellido
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain; Institute of Neurosciences, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain
| | - Xiongbo Wu
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain; Institute of Neurosciences, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain; Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Diego Lonzano-Soldevilla
- Laboratory for Clinical Neuroscience, Centre for Biomedical Technology, Universidad Politécnica de Madrid, Crta. M40, Km. 38, Pozuelo de Alarcón, Madrid 28223, Spain
| | - Daniel Pacheco-Estefan
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, 44801 Bochum, Germany
| | - Katia Lehongre
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, APHP, Pitié-Salpêtrière Hospital, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France
| | - Estefanía Conde-Blanco
- Epilepsy Program, Neurology Department, Hospital Clínic de Barcelona, EpiCARE: European Reference Network for Epilepsy, Institut D'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), C. de Villarroel, 170, 08036 Barcelona, Spain
| | - Pedro Roldan
- Epilepsy Program, Neurology Department, Hospital Clínic de Barcelona, EpiCARE: European Reference Network for Epilepsy, Institut D'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), C. de Villarroel, 170, 08036 Barcelona, Spain
| | - Claude Adam
- AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France
| | - Virginie Lambrecq
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, APHP, Pitié-Salpêtrière Hospital, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Département de Neurophysiologie, Hôpital PitiéSalpêtrière, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France
| | - Valerio Frazzini
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, APHP, Pitié-Salpêtrière Hospital, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Département de Neurophysiologie, Hôpital PitiéSalpêtrière, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France
| | - Antonio Donaire
- Epilepsy Program, Neurology Department, Hospital Clínic de Barcelona, EpiCARE: European Reference Network for Epilepsy, Institut D'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), C. de Villarroel, 170, 08036 Barcelona, Spain
| | - Mar Carreño
- Epilepsy Program, Neurology Department, Hospital Clínic de Barcelona, EpiCARE: European Reference Network for Epilepsy, Institut D'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), C. de Villarroel, 170, 08036 Barcelona, Spain
| | - Vincent Navarro
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, APHP, Pitié-Salpêtrière Hospital, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Département de Neurophysiologie, Hôpital PitiéSalpêtrière, DMU Neurosciences, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; AP-HP, Center of Reference for Rare Epilepsies, Pitié-Salpêtrière Hospital, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France
| | - Antoni Valero-Cabré
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, APHP, Pitié-Salpêtrière Hospital, 47-83, Boulevard de l'Hôpital, 75651 Paris Cedex 13, France; Cerebral Dynamics, Plasticity and Rehabilitation Group, FRONTLAB team, CNRS UMR 7225, INSERM U1127, Paris, France; Faculty of Health and Science, Cognitive Neurolab, Neuroscience and Information Technology Research Program, Open University of Catalonia (UOC), Avinguda del Tibidabo, 39-43, 08035 Barcelona, Spain; Laboratory for Cerebral Dynamics Plasticity and Rehabilitation, Boston University School of Medicine, 72 E Concord Street, Boston, MA 02118, USA
| | - Lluís Fuentemilla
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain; Institute of Neurosciences, University of Barcelona, Pg Vall Hebrón 171, 08035 Barcelona, Spain; Institute for Biomedical Research of Bellvitge, C/ Feixa Llarga, s/n - Pavelló de Govern -Edifici Modular, L'Hospitalet de Llobregat, 08907 Barcelona, Spain.
| |
Collapse
|
15
|
López-Madrona VJ, Villalon SM, Velmurugan J, Semeux-Bernier A, Garnier E, Badier JM, Schön D, Bénar CG. Reconstruction and localization of auditory sources from intracerebral SEEG using independent component analysis. Neuroimage 2023; 269:119905. [PMID: 36720438 DOI: 10.1016/j.neuroimage.2023.119905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 01/11/2023] [Accepted: 01/26/2023] [Indexed: 01/30/2023] Open
Abstract
Stereo-electroencephalography (SEEG) is the surgical implantation of electrodes in the brain to better localize the epileptic network in pharmaco-resistant epileptic patients. This technique has exquisite spatial and temporal resolution. Still, the number and the position of the electrodes in the brain is limited and determined by the semiology and/or preliminary non-invasive examinations, leading to a large number of unexplored brain structures in each patient. Here, we propose a new approach to reconstruct the activity of non-sampled structures in SEEG, based on independent component analysis (ICA) and dipole source localization. We have tested this approach with an auditory stimulation dataset in ten patients. The activity directly recorded from the auditory cortex served as ground truth and was compared to the ICA applied on all non-auditory electrodes. Our results show that the activity from the auditory cortex can be reconstructed at the single trial level from contacts as far as ∼40 mm from the source. Importantly, this reconstructed activity is localized via dipole fitting in the proximity of the original source. In addition, we show that the size of the confidence interval of the dipole fitting is a good indicator of the reliability of the result, which depends on the geometry of the SEEG implantation. Overall, our approach allows reconstructing the activity of structures far from the electrode locations, partially overcoming the spatial sampling limitation of intracerebral recordings.
Collapse
Affiliation(s)
| | - Samuel Medina Villalon
- Aix Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille 13005, France; APHM, Timone Hospital, Epileptology and cerebral rhythmology, Marseille 13005, France
| | - Jayabal Velmurugan
- Aix Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille 13005, France
| | | | - Elodie Garnier
- Aix Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille 13005, France
| | - Jean-Michel Badier
- Aix Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille 13005, France
| | - Daniele Schön
- Aix Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille 13005, France
| | - Christian-G Bénar
- Aix Marseille Univ, INSERM, INS, Inst Neurosci Syst, Marseille 13005, France.
| |
Collapse
|
16
|
Khademi Z, Ebrahimi F, Kordy HM. A review of critical challenges in MI-BCI: From conventional to deep learning methods. J Neurosci Methods 2023; 383:109736. [PMID: 36349568 DOI: 10.1016/j.jneumeth.2022.109736] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 09/20/2022] [Accepted: 10/27/2022] [Indexed: 11/08/2022]
Abstract
Brain-computer interfaces (BCIs) have achieved significant success in controlling external devices through the Electroencephalogram (EEG) signal processing. BCI-based Motor Imagery (MI) system bridges brain and external devices as communication tools to control, for example, wheelchair for people with disabilities, robotic control, and exoskeleton control. This success largely depends on the machine learning (ML) approaches like deep learning (DL) models. DL algorithms provide effective and powerful models to analyze compact and complex EEG data optimally for MI-BCI applications. DL models with CNN network have revolutionized computer vision through end-to-end learning from raw data. Meanwhile, RNN networks have been able to decode EEG signals by processing sequences of time series data. However, many challenges in the MI-BCI field have affected the performance of DL models. A major challenge is the individual differences in the EEG signal of different subjects. Therefore, the model must be retrained from the scratch for each new subject, which leads to computational costs. Analyzing the EEG signals is challenging due to its low signal to noise ratio and non-stationary nature. Additionally, limited size of existence datasets can lead to overfitting which can be prevented by using transfer learning (TF) approaches. The main contributions of this study are discovering major challenges in the MI-BCI field by reviewing the state of art machine learning models and then suggesting solutions to address these challenges by focusing on feature selection, feature extraction and classification methods.
Collapse
Affiliation(s)
- Zahra Khademi
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Shariati Ave., Babol, Iran.
| | - Farideh Ebrahimi
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Shariati Ave., Babol, Iran.
| | - Hussain Montazery Kordy
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Shariati Ave., Babol, Iran.
| |
Collapse
|
17
|
Mercier MR, Dubarry AS, Tadel F, Avanzini P, Axmacher N, Cellier D, Vecchio MD, Hamilton LS, Hermes D, Kahana MJ, Knight RT, Llorens A, Megevand P, Melloni L, Miller KJ, Piai V, Puce A, Ramsey NF, Schwiedrzik CM, Smith SE, Stolk A, Swann NC, Vansteensel MJ, Voytek B, Wang L, Lachaux JP, Oostenveld R. Advances in human intracranial electroencephalography research, guidelines and good practices. Neuroimage 2022; 260:119438. [PMID: 35792291 PMCID: PMC10190110 DOI: 10.1016/j.neuroimage.2022.119438] [Citation(s) in RCA: 56] [Impact Index Per Article: 18.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/23/2022] [Accepted: 06/30/2022] [Indexed: 12/11/2022] Open
Abstract
Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.
Collapse
Affiliation(s)
- Manuel R Mercier
- INSERM, INS, Institut de Neurosciences des Systèmes, Aix-Marseille University, Marseille, France.
| | | | - François Tadel
- Signal & Image Processing Institute, University of Southern California, Los Angeles, CA United States of America
| | - Pietro Avanzini
- Institute of Neuroscience, National Research Council of Italy, Parma, Italy
| | - Nikolai Axmacher
- Department of Neuropsychology, Faculty of Psychology, Institute of Cognitive Neuroscience, Ruhr University Bochum, Universitätsstraße 150, Bochum 44801, Germany; State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, 19 Xinjiekou Outer St, Beijing 100875, China
| | - Dillan Cellier
- Department of Cognitive Science, University of California, La Jolla, San Diego, United States of America
| | - Maria Del Vecchio
- Institute of Neuroscience, National Research Council of Italy, Parma, Italy
| | - Liberty S Hamilton
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, United States of America; Institute for Neuroscience, The University of Texas at Austin, Austin, TX, United States of America; Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, United States of America
| | - Dora Hermes
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, United States of America
| | - Michael J Kahana
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Robert T Knight
- Department of Psychology and the Helen Wills Neuroscience Institute, University of California, Berkeley, CA 94720, United States of America
| | - Anais Llorens
- Helen Wills Neuroscience Institute, University of California, Berkeley, United States of America
| | - Pierre Megevand
- Department of Clinical neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Lucia Melloni
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, Frankfurt am Main 60322, Germany; Department of Neurology, NYU Grossman School of Medicine, 145 East 32nd Street, Room 828, New York, NY 10016, United States of America
| | - Kai J Miller
- Department of Neurosurgery, Mayo Clinic, Rochester, MN 55905, USA
| | - Vitória Piai
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Department of Medical Psychology, Radboudumc, Donders Centre for Medical Neuroscience, Nijmegen, the Netherlands
| | - Aina Puce
- Department of Psychological & Brain Sciences, Programs in Neuroscience, Cognitive Science, Indiana University, Bloomington, IN, United States of America
| | - Nick F Ramsey
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, UMC Utrecht, the Netherlands
| | - Caspar M Schwiedrzik
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Göttingen, Germany; Perception and Plasticity Group, German Primate Center, Leibniz Institute for Primate Research, Göttingen, Germany
| | - Sydney E Smith
- Neurosciences Graduate Program, University of California, La Jolla, San Diego, United States of America
| | - Arjen Stolk
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; Psychological and Brain Sciences, Dartmouth College, Hanover, NH, United States of America
| | - Nicole C Swann
- University of Oregon in the Department of Human Physiology, United States of America
| | - Mariska J Vansteensel
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, UMC Utrecht, the Netherlands
| | - Bradley Voytek
- Department of Cognitive Science, University of California, La Jolla, San Diego, United States of America; Neurosciences Graduate Program, University of California, La Jolla, San Diego, United States of America; Halıcıoğlu Data Science Institute, University of California, La Jolla, San Diego, United States of America; Kavli Institute for Brain and Mind, University of California, La Jolla, San Diego, United States of America
| | - Liang Wang
- CAS Key Laboratory of Mental Health, Institute of Psychology, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Jean-Philippe Lachaux
- Lyon Neuroscience Research Center, EDUWELL Team, INSERM UMRS 1028, CNRS UMR 5292, Université Claude Bernard Lyon 1, Université de Lyon, Lyon F-69000, France
| | - Robert Oostenveld
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands; NatMEG, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
18
|
Liu AA, Henin S, Abbaspoor S, Bragin A, Buffalo EA, Farrell JS, Foster DJ, Frank LM, Gedankien T, Gotman J, Guidera JA, Hoffman KL, Jacobs J, Kahana MJ, Li L, Liao Z, Lin JJ, Losonczy A, Malach R, van der Meer MA, McClain K, McNaughton BL, Norman Y, Navas-Olive A, de la Prida LM, Rueckemann JW, Sakon JJ, Skelin I, Soltesz I, Staresina BP, Weiss SA, Wilson MA, Zaghloul KA, Zugaro M, Buzsáki G. A consensus statement on detection of hippocampal sharp wave ripples and differentiation from other fast oscillations. Nat Commun 2022; 13:6000. [PMID: 36224194 PMCID: PMC9556539 DOI: 10.1038/s41467-022-33536-x] [Citation(s) in RCA: 49] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 09/21/2022] [Indexed: 02/05/2023] Open
Abstract
Decades of rodent research have established the role of hippocampal sharp wave ripples (SPW-Rs) in consolidating and guiding experience. More recently, intracranial recordings in humans have suggested their role in episodic and semantic memory. Yet, common standards for recording, detection, and reporting do not exist. Here, we outline the methodological challenges involved in detecting ripple events and offer practical recommendations to improve separation from other high-frequency oscillations. We argue that shared experimental, detection, and reporting standards will provide a solid foundation for future translational discovery.
Collapse
Affiliation(s)
- Anli A Liu
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, USA
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA
| | - Simon Henin
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, USA
| | - Saman Abbaspoor
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| | - Anatol Bragin
- Department of Neurology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Elizabeth A Buffalo
- Department of Physiology and Biophysics, Washington National Primate Center, University of Washington, Seattle, WA, USA
| | - Jordan S Farrell
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - David J Foster
- Department of Psychology and Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
| | - Loren M Frank
- Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience and Department of Physiology, University of California San Francisco, San Francisco, CA, USA
- Howard Hughes Medical Institute, Chevy Chase, MD, USA
| | - Tamara Gedankien
- Department of Biomedical Engineering, Department of Neurological Surgery, Columbia University, New York, NY, USA
| | - Jean Gotman
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Jennifer A Guidera
- Kavli Institute for Fundamental Neuroscience, Center for Integrative Neuroscience and Department of Physiology, University of California San Francisco, San Francisco, CA, USA
- Medical Scientist Training Program, Department of Bioengineering, University of California, San Francisco, San Francisco, CA, USA
| | - Kari L Hoffman
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | - Joshua Jacobs
- Department of Biomedical Engineering, Department of Neurological Surgery, Columbia University, New York, NY, USA
| | - Michael J Kahana
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Lin Li
- Department of Biomedical Engineering, University of North Texas, Denton, TX, USA
| | - Zhenrui Liao
- Department of Neuroscience, Columbia University, New York, NY, USA
| | - Jack J Lin
- Department of Neurology, Center for Mind and Brain, University of California Davis, Oakland, CA, USA
| | - Attila Losonczy
- Department of Neuroscience, Columbia University, New York, NY, USA
| | - Rafael Malach
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
| | | | - Kathryn McClain
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA
| | - Bruce L McNaughton
- The Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, AB, Canada
| | - Yitzhak Norman
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
- Department of Neurological Surgery, University of California, San Francisco, CA, USA
| | | | | | - Jon W Rueckemann
- Department of Physiology and Biophysics, Washington National Primate Center, University of Washington, Seattle, WA, USA
| | - John J Sakon
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Ivan Skelin
- Department of Neurology, Center for Mind and Brain, University of California Davis, Oakland, CA, USA
| | - Ivan Soltesz
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Bernhard P Staresina
- Department of Experimental Psychology, Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| | - Shennan A Weiss
- Brookdale Hospital Medical Center, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Matthew A Wilson
- Department of Brain and Cognitive Sciences and Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Kareem A Zaghloul
- Surgical Neurology Branch, National Institute of Neurological Disorders and Stroke (NINDS), National Institutes of Health, Bethesda, MD, USA
| | - Michaël Zugaro
- Center for Interdisciplinary Research in Biology (CIRB), Collège de France, CNRS, INSERM, Université PSL, Paris, France
| | - György Buzsáki
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, USA.
- Neuroscience Institute, NYU Langone Medical Center, New York, NY, USA.
| |
Collapse
|
19
|
Xu M, Jie J, Zhou W, Zhou H, Jin S. Synthetic Epileptic Brain Activities with TripleGAN. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:2841228. [PMID: 36065378 PMCID: PMC9440850 DOI: 10.1155/2022/2841228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Revised: 07/10/2022] [Accepted: 08/12/2022] [Indexed: 11/18/2022]
Abstract
Epilepsy is a chronic noninfectious disease caused by sudden abnormal discharge of brain neurons, which leads to intermittent brain dysfunction. It is also one of the most common neurological diseases in the world. The automatic detection of epilepsy based on electroencephalogram through machine learning, correlation analysis, and temporal-frequency analysis plays an important role in epilepsy early warning and automatic recognition. In this study, we propose a method to realize EEG epilepsy recognition by means of triple genetic antagonism network (GAN). TripleGAN is used for EEG temporal domain, frequency domain, and temporal-frequency domain, respectively. The experiment was conducted through CHB-MIT datasets, which operated at the latest level in the same industry in the world. In the CHB-MIT dataset, the classification accuracy, sensitivity, and specificity exceeded 1.19%, 1.36%, and 0.27%, respectively. The crossobject ratio exceeded 0.53%, 2.2%, and 0.37%, respectively. It shows that the established deep learning model of TripleGAN has a good effect on EEG epilepsy classification through simulation and classification optimization of real signals.
Collapse
Affiliation(s)
- Meiyan Xu
- Minnan Normal University, China
- OYMotion Technologies Co., Ltd., China
| | | | | | | | - Shunshan Jin
- Beidahuang Industry Group General Hospital, China
| |
Collapse
|
20
|
Khademi Z, Ebrahimi F, Kordy HM. A transfer learning-based CNN and LSTM hybrid deep learning model to classify motor imagery EEG signals. Comput Biol Med 2022; 143:105288. [PMID: 35168083 DOI: 10.1016/j.compbiomed.2022.105288] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 01/21/2022] [Accepted: 01/24/2022] [Indexed: 12/26/2022]
Abstract
In the Motor Imagery (MI)-based Brain Computer Interface (BCI), users' intention is converted into a control signal through processing a specific pattern in brain signals reflecting motor characteristics. There are such restrictions as the limited size of the existing datasets and low signal to noise ratio in the classification of MI Electroencephalogram (EEG) signals. Machine learning (ML) methods, particularly Deep Learning (DL), have overcome these limitations relatively. In this study, three hybrid models were proposed to classify the EEG signal in the MI-based BCI. The proposed hybrid models consist of the convolutional neural networks (CNN) and the Long-Short Term Memory (LSTM). In the first model, the CNN with different number of convolutional-pooling blocks (from shallow to deep CNN) was examined; a two-block CNN model not affected by the vanishing gradient descent and yet able to extract desirable features employed; the second and third models contained pre-trained CNNs conducing to the exploration of more complex features. The transfer learning strategy and data augmentation methods were applied to overcome the limited size of the datasets by transferring learning from one model to another. This was achieved by employing two powerful pre-trained convolutional neural networks namely ResNet-50 and Inception-v3. The continuous wavelet transform (CWT) was used to generate images for the CNN. The performance of the proposed models was evaluated on the BCI Competition IV dataset 2a. The mean accuracy vlaues of 86%, 90%, and 92%, and mean Kappa values of 81%, 86%, and 88% were obtained for the hybrid neural network with the customized CNN, the hybrid neural network with ResNet-50 and the hybrid neural network with Inception-v3, respectively. Despite the promising performance of the three proposed models, the hybrid neural network with Inception-v3 outperformed the two other models. The best obtained result in the present study improved the previous best result in the literature by 7% in terms of classification accuracy. From the findings, it can be concluded that transfer learning based on a pre-trained CNN in combination with LSTM is a novel method in MI-based BCI. The study also has implications for the discrimination of motor imagery tasks in each EEG recording channel and in different brain regions which can reduce computational time in future works by only selecting the most effective channels.
Collapse
Affiliation(s)
- Zahra Khademi
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Shariati Ave., Babol, Iran.
| | - Farideh Ebrahimi
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Shariati Ave., Babol, Iran.
| | - Hussain Montazery Kordy
- Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Shariati Ave., Babol, Iran.
| |
Collapse
|
21
|
Goldstein A, Zada Z, Buchnik E, Schain M, Price A, Aubrey B, Nastase SA, Feder A, Emanuel D, Cohen A, Jansen A, Gazula H, Choe G, Rao A, Kim C, Casto C, Fanda L, Doyle W, Friedman D, Dugan P, Melloni L, Reichart R, Devore S, Flinker A, Hasenfratz L, Levy O, Hassidim A, Brenner M, Matias Y, Norman KA, Devinsky O, Hasson U. Shared computational principles for language processing in humans and deep language models. Nat Neurosci 2022; 25:369-380. [PMID: 35260860 PMCID: PMC8904253 DOI: 10.1038/s41593-022-01026-4] [Citation(s) in RCA: 127] [Impact Index Per Article: 42.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Accepted: 01/27/2022] [Indexed: 11/17/2022]
Abstract
Departing from traditional linguistic models, advances in deep learning have resulted in a new type of predictive (autoregressive) deep language models (DLMs). Using a self-supervised next-word prediction task, these models generate appropriate linguistic responses in a given context. In the current study, nine participants listened to a 30-min podcast while their brain responses were recorded using electrocorticography (ECoG). We provide empirical evidence that the human brain and autoregressive DLMs share three fundamental computational principles as they process the same natural narrative: (1) both are engaged in continuous next-word prediction before word onset; (2) both match their pre-onset predictions to the incoming word to calculate post-onset surprise; (3) both rely on contextual embeddings to represent words in natural contexts. Together, our findings suggest that autoregressive DLMs provide a new and biologically feasible computational framework for studying the neural basis of language.
Collapse
Affiliation(s)
- Ariel Goldstein
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
- Google Research, Mountain View, CA, USA.
| | - Zaid Zada
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | | | | | - Amy Price
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Bobbi Aubrey
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
- New York University Grossman School of Medicine, New York, NY, USA
| | - Samuel A Nastase
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | | | | | | | | | - Harshvardhan Gazula
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Gina Choe
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
- New York University Grossman School of Medicine, New York, NY, USA
| | - Aditi Rao
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
- New York University Grossman School of Medicine, New York, NY, USA
| | - Catherine Kim
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
- New York University Grossman School of Medicine, New York, NY, USA
| | - Colton Casto
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Lora Fanda
- New York University Grossman School of Medicine, New York, NY, USA
| | - Werner Doyle
- New York University Grossman School of Medicine, New York, NY, USA
| | - Daniel Friedman
- New York University Grossman School of Medicine, New York, NY, USA
| | - Patricia Dugan
- New York University Grossman School of Medicine, New York, NY, USA
| | - Lucia Melloni
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | - Roi Reichart
- Faculty of Industrial Engineering and Management, Technion, Israel Institute of Technology, Haifa, Israel
| | - Sasha Devore
- New York University Grossman School of Medicine, New York, NY, USA
| | - Adeen Flinker
- New York University Grossman School of Medicine, New York, NY, USA
| | - Liat Hasenfratz
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Omer Levy
- Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | | | - Michael Brenner
- Google Research, Mountain View, CA, USA
- School of Engineering and Applied Science, Harvard University, Cambridge, MA, USA
| | | | - Kenneth A Norman
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Orrin Devinsky
- New York University Grossman School of Medicine, New York, NY, USA
| | - Uri Hasson
- Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA
- Google Research, Mountain View, CA, USA
| |
Collapse
|
22
|
Michelmann S, Price AR, Aubrey B, Strauss CK, Doyle WK, Friedman D, Dugan PC, Devinsky O, Devore S, Flinker A, Hasson U, Norman KA. Moment-by-moment tracking of naturalistic learning and its underlying hippocampo-cortical interactions. Nat Commun 2021; 12:5394. [PMID: 34518520 PMCID: PMC8438040 DOI: 10.1038/s41467-021-25376-y] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 08/02/2021] [Indexed: 01/10/2023] Open
Abstract
Humans form lasting memories of stimuli that were only encountered once. This naturally occurs when listening to a story, however it remains unclear how and when memories are stored and retrieved during story-listening. Here, we first confirm in behavioral experiments that participants can learn about the structure of a story after a single exposure and are able to recall upcoming words when the story is presented again. We then track mnemonic information in high frequency activity (70–200 Hz) as patients undergoing electrocorticographic recordings listen twice to the same story. We demonstrate predictive recall of upcoming information through neural responses in auditory processing regions. This neural measure correlates with behavioral measures of event segmentation and learning. Event boundaries are linked to information flow from cortex to hippocampus. When listening for a second time, information flow from hippocampus to cortex precedes moments of predictive recall. These results provide insight on a fine-grained temporal scale into how episodic memory encoding and retrieval work under naturalistic conditions. When listening to a story, humans learn about its structure and content. Here the authors reveal the neural processes behind episodic memory and predictive recall at a fine temporal scale in this naturalistic setting
Collapse
Affiliation(s)
- Sebastian Michelmann
- Department of Psychology, Princeton University, Princeton, NJ, USA. .,Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
| | - Amy R Price
- Department of Psychology, Princeton University, Princeton, NJ, USA.,Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Bobbi Aubrey
- Department of Psychology, Princeton University, Princeton, NJ, USA.,Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Camilla K Strauss
- Department of Psychology, Princeton University, Princeton, NJ, USA.,Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Werner K Doyle
- School of Medicine, New York University, New York, NY, USA
| | | | | | - Orrin Devinsky
- School of Medicine, New York University, New York, NY, USA
| | - Sasha Devore
- School of Medicine, New York University, New York, NY, USA
| | - Adeen Flinker
- School of Medicine, New York University, New York, NY, USA
| | - Uri Hasson
- Department of Psychology, Princeton University, Princeton, NJ, USA.,Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Kenneth A Norman
- Department of Psychology, Princeton University, Princeton, NJ, USA.,Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| |
Collapse
|
23
|
Schaworonkow N, Voytek B. Enhancing oscillations in intracranial electrophysiological recordings with data-driven spatial filters. PLoS Comput Biol 2021; 17:e1009298. [PMID: 34411096 PMCID: PMC8407590 DOI: 10.1371/journal.pcbi.1009298] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 08/31/2021] [Accepted: 07/22/2021] [Indexed: 11/19/2022] Open
Abstract
In invasive electrophysiological recordings, a variety of neural oscillations can be detected across the cortex, with overlap in space and time. This overlap complicates measurement of neural oscillations using standard referencing schemes, like common average or bipolar referencing. Here, we illustrate the effects of spatial mixing on measuring neural oscillations in invasive electrophysiological recordings and demonstrate the benefits of using data-driven referencing schemes in order to improve measurement of neural oscillations. We discuss referencing as the application of a spatial filter. Spatio-spectral decomposition is used to estimate data-driven spatial filters, a computationally fast method which specifically enhances signal-to-noise ratio for oscillations in a frequency band of interest. We show that application of these data-driven spatial filters has benefits for data exploration, investigation of temporal dynamics and assessment of peak frequencies of neural oscillations. We demonstrate multiple use cases, exploring between-participant variability in presence of oscillations, spatial spread and waveform shape of different rhythms as well as narrowband noise removal with the aid of spatial filters. We find high between-participant variability in the presence of neural oscillations, a large variation in spatial spread of individual rhythms and many non-sinusoidal rhythms across the cortex. Improved measurement of cortical rhythms will yield better conditions for establishing links between cortical activity and behavior, as well as bridging scales between the invasive intracranial measurements and noninvasive macroscale scalp measurements.
Collapse
Affiliation(s)
- Natalie Schaworonkow
- Department of Cognitive Science, University of California, San Diego, California, United States of America
| | - Bradley Voytek
- Department of Cognitive Science, University of California, San Diego, California, United States of America
- Halıcıoğlu Data Science Institute, University of California, San Diego, California, United States of America
- Neurosciences Graduate Program, University of California, San Diego, California, United States of America
- Kavli Institute for Brain and Mind, University of California, San Diego, California, United States of America
| |
Collapse
|
24
|
Schüller T, Gruendler TOJ, Smith EE, Baldermann JC, Kohl S, Fischer AG, Visser-Vandewalle V, Ullsperger M, Kuhn J, Huys D. Performance monitoring in obsessive-compulsive disorder: Insights from internal capsule/nucleus accumbens deep brain stimulation. NEUROIMAGE-CLINICAL 2021; 31:102746. [PMID: 34229156 PMCID: PMC8261082 DOI: 10.1016/j.nicl.2021.102746] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Revised: 06/23/2021] [Accepted: 06/24/2021] [Indexed: 11/25/2022]
Abstract
Theta phase coherence is increased following negative performance feedback. Deep brain stimulation globally modulates theta phase coherence. Fronto-striatal connectivity is related to OCD symptom severity.
Background Symptoms of obsessive–compulsive disorder (OCD) are partly related to impaired cognitive control processes and theta modulations constitute an important electrophysiological marker for cognitive control processes such as signaling negative performance feedback in a fronto-striatal network. Deep brain stimulation (DBS) targeting the anterior limb of the internal capsule (ALIC)/nucleus accumbens (NAc) shows clinical efficacy in OCD, while the exact influence on the performance monitoring system remains largely unknown. Methods Seventeen patients with treatment-refractory OCD performed a probabilistic reinforcement learning task. Analyses were focused on 4–8 Hz (theta) power, intertrial phase coherence (ITPC) and debiased weighted Phase-Lag Index (dwPLI) in response to negative performance feedback. Combined EEG and local field potential (LFP) recordings were obtained shortly after DBS electrode implantation to investigate fronto-striatal network modulations. To assess the impact of clinically effective DBS on negative performance feedback modulations, EEG recordings were obtained pre-surgery and at follow-up with DBS on and off. Results Medial frontal cortex ITPC, striatal ITPC and striato-frontal dwPLI were increased following negative performance feedback. Decreased right-lateralized dwPLI was associated with pre-surgery symptom severity. ITPC was globally decreased during DBS-off. Conclusion We observed a theta phase coherence mediated fronto-striatal performance monitoring network. Within this network, decreased connectivity was related to increased OCD symptomatology, consistent with the idea of impaired cognitive control in OCD. While ALIC/NAc DBS decreased theta network activity globally, this effect was unrelated to clinical efficacy and performance monitoring.
Collapse
Affiliation(s)
- Thomas Schüller
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Psychiatry and Psychotherapy, Cologne, Germany.
| | - Theo O J Gruendler
- Center for Military Mental Health, Military Hospital Berlin, Berlin, Germany
| | - Ezra E Smith
- Division of Translational Epidemiology, New York State Psychiatric Institute, New York, NY, USA
| | - Juan Carlos Baldermann
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Psychiatry and Psychotherapy, Cologne, Germany; University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Neurology, Cologne, Germany
| | - Sina Kohl
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Psychiatry and Psychotherapy, Cologne, Germany
| | - Adrian G Fischer
- Otto von Guericke University, Center for Behavioral Brain Sciences, Magdeburg, Germany; Freie Universität Berlin, Center for Cognitive Neuroscience, Berlin, Germany
| | - Veerle Visser-Vandewalle
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Stereotactic and Functional Neurosurgery, Cologne, Germany
| | - Markus Ullsperger
- Otto von Guericke University, Center for Behavioral Brain Sciences, Magdeburg, Germany; Otto von Guericke University, Institute of Psychology, Magdeburg, Germany
| | - Jens Kuhn
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Psychiatry and Psychotherapy, Cologne, Germany; Johanniter Hospital Oberhausen, Department of Psychiatry, Psychotherapy and Psychosomatic, Oberhausen, Germany
| | - Daniel Huys
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Psychiatry and Psychotherapy, Cologne, Germany
| |
Collapse
|
25
|
Sonkusare S, Nguyen VT, Moran R, van der Meer J, Ren Y, Koussis N, Dionisio S, Breakspear M, Guo C. Intracranial-EEG evidence for medial temporal pole driving amygdala activity induced by multi-modal emotional stimuli. Cortex 2020; 130:32-48. [PMID: 32640373 DOI: 10.1016/j.cortex.2020.05.018] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 05/13/2020] [Accepted: 05/29/2020] [Indexed: 12/13/2022]
Abstract
The temporal pole (TP) is an associative cortical region required for complex cognitive functions such as social and emotional cognition. However, mapping the TP with functional magnetic resonance imaging is technically challenging and thus understanding its interaction with other key emotional circuitry, such as the amygdala, remains elusive. We exploited the unique advantages of stereo-electroencephalography (sEEG) to assess the responses of the TP and the amygdala during the perception of emotionally salient stimuli of pictures, music and movies. These stimuli consistently elicited high gamma responses (70-140 Hz) in both the TP and the amygdala, accompanied by functional connectivity in the low frequency range (2-12 Hz). Computational analyses suggested that the TP drove this effect in the theta frequency range, modulated by the emotional valence of the stimuli. Notably, cross-frequency analysis indicated the phase of theta oscillations in the TP modulated the amplitude of high gamma activity in the amygdala. These results were reproducible across three types of sensory inputs including naturalistic stimuli. Our results suggest that multimodal emotional stimuli induce a hierarchical influence of the TP over the amygdala.
Collapse
Affiliation(s)
- Saurabh Sonkusare
- QIMR Berghofer Medical Research Institute, Brisbane, Australia; School of Medicine, The University of Queensland, Brisbane, Australia.
| | - Vinh T Nguyen
- QIMR Berghofer Medical Research Institute, Brisbane, Australia
| | - Rosalyn Moran
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | | | - Yudan Ren
- QIMR Berghofer Medical Research Institute, Brisbane, Australia; School of Information Science and Technology, Northwest University, Xi'an, China
| | - Nikitas Koussis
- QIMR Berghofer Medical Research Institute, Brisbane, Australia
| | - Sasha Dionisio
- Mater Advanced Epilepsy Unit, Mater Hospital, Brisbane, Australia
| | - Michael Breakspear
- QIMR Berghofer Medical Research Institute, Brisbane, Australia; Hunter Medical Research Institute, University of Newcastle, Newcastle, Australia.
| | - Christine Guo
- QIMR Berghofer Medical Research Institute, Brisbane, Australia
| |
Collapse
|
26
|
Shen L, Liu Z, Li Y. EEG based dynamic RDS recognition with frequency domain selection and bispectrum feature optimization. J Neurosci Methods 2020; 337:108650. [PMID: 32135211 DOI: 10.1016/j.jneumeth.2020.108650] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2019] [Revised: 02/03/2020] [Accepted: 02/23/2020] [Indexed: 11/26/2022]
Abstract
BACKGROUND Stereopsis plays a vital role in many aspects of human daily life. Random-dot stereogram (RDS) is often used to detect stereoacuity and perform research on visual cognition. Electroencephalogram (EEG) is one of the commonly adopted visual cognition techniques due to its noninvasive collection. NEW METHOD In this study, a methodology named WPT-BED based on wavelet packet transform (WPT) and bispectral eigenvalues of differential signals (BED) is proposed, which can classify the three-pattern EEG signals evoked by dynamic RDS (DRDS). Specifically, the signals are decomposed into different frequency bands by WPT. The appropriate sub-bands are selected for reconstruction. Finally, the optimized bispectrum features are extracted for classification to achieve higher accuracy. RESULTS The classification performance of the proposed method in different periods of signal processing are investigated. The method WPT-BED has the highest classification accuracy 84.38%, and the average classification accuracy is 73.98%. The active channels with higher accuracy are focused on the visual pathway in the human cerebral cortex. COMPARISON WITH EXISTING METHODS Comparison with other methods for EEG signals classification is performed to identify the effectiveness of the proposed methodology. CONCLUSIONS The proposed methodology can effectively distinguish the EEG signals evoked by DRDS. It demonstrates the feasibility of DRDS recognition based on EEG.
Collapse
Affiliation(s)
- Lili Shen
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China.
| | - Zhijian Liu
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Yueping Li
- Tianjin Eye Hospital, Clinical College of Ophthalmology of Tianjin Medical University, Tianjin Key Laboratory of Ophthalmology and Vision Science, Tianjin 300020, China.
| |
Collapse
|
27
|
Meisler SL, Kahana MJ, Ezzyat Y. Does data cleaning improve brain state classification? J Neurosci Methods 2019; 328:108421. [PMID: 31541912 PMCID: PMC11225530 DOI: 10.1016/j.jneumeth.2019.108421] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2019] [Revised: 08/14/2019] [Accepted: 09/03/2019] [Indexed: 12/11/2022]
Abstract
BACKGROUND Neuroscientists routinely seek to identify and remove noisy or artifactual observations from their data. They do so with the belief that removing such data improves power to detect relations between neural activity and behavior, which are often subtle and can be overwhelmed by noise. Whereas standard methods can exclude certain well-defined noise sources (e.g., 50/60 Hz electrical noise), in many situations there is not a clear difference between noise and signals so it is not obvious how to separate the two. Here we ask whether methods routinely used to "clean" human electrophysiological recordings lead to greater power to detect brain-behavior relations. NEW METHOD This, to the authors' knowledge, is the first large-scale simultaneous evaluation of multiple commonly used methods for removing noise from intracranial EEG recordings. RESULTS We find that several commonly used data cleaning methods (automated methods based on statistical signal properties and manual methods based on expert review) do not increase the power to detect univariate and multivariate electrophysiological biomarkers of successful episodic memory encoding, a well-characterized broadband pattern of neural activity observed across the brain. COMPARISON WITH EXISTING METHODS Researchers may be more likely to increase statistical power to detect physiological phenomena of interest by allocating resources away from cleaning noisy data and toward collecting more within-patient observations. CONCLUSIONS These findings highlight the challenge of partitioning signal and noise in the analysis of brain-behavior relations, and suggest increasing sample size and numbers of observations, rather than data cleaning, as the best approach to improving statistical power.
Collapse
Affiliation(s)
- Steven L Meisler
- Dept. of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Michael J Kahana
- Dept. of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Youssef Ezzyat
- Dept. of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| |
Collapse
|
28
|
Detection of focal epilepsy in brain maps through a novel pattern recognition technique. Neural Comput Appl 2019. [DOI: 10.1007/s00521-019-04544-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
29
|
Dong L, Liu X, Zhao L, Lai Y, Gong D, Liu T, Yao D. A Comparative Study of Different EEG Reference Choices for Event-Related Potentials Extracted by Independent Component Analysis. Front Neurosci 2019; 13:1068. [PMID: 31680810 PMCID: PMC6798171 DOI: 10.3389/fnins.2019.01068] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Accepted: 09/24/2019] [Indexed: 12/16/2022] Open
Abstract
In the event-related potential (ERP) of scalp electroencephalography (EEG) studies, the vertex reference (Cz), linked mastoids or ears (LM), and average reference (AVG) are popular reference methods, and the reference electrode standardization technique (REST) is increasingly applied. Because scalp EEG recordings are considered as spatially degraded signals, independent component analysis (ICA) is a widely used data-driven method for obtaining ERPs by decomposing EEG data. However, the accurate estimation of the differences in ERP components extracted by ICA with different references remains unclear. In this study, we first provided formal descriptions of the above reference methods (Cz, LM, AVG, and REST) and ICA decomposition in ERP and then investigated the influences of different reference techniques on simulation and real EEG datasets. The results revealed that (1) the reference method did not change the peak amplitudes and latencies of relative ERPs corresponding to some IC time courses; (2) there were non-negligible effects of different reference methods on both temporal ERPs and spatial topographies of some ICs; and (3) compared to Cz, LM, and AR, considering both the performances of temporal ERPs and spatial topographies, the REST reference had overall superiority. These findings provide a recommended choice of REST for ICA analysis at the trial level and contribute to empirical investigations regarding the use of reference methods in ERP domains with ICA analysis.
Collapse
Affiliation(s)
- Li Dong
- MOE Key Laboratory for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu, China.,School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiaobo Liu
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Lingling Zhao
- School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Yongxiu Lai
- MOE Key Laboratory for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu, China.,School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Diankun Gong
- MOE Key Laboratory for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu, China.,School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Tiejun Liu
- MOE Key Laboratory for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu, China.,School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Dezhong Yao
- MOE Key Laboratory for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu, China.,School of Life Science and Technology, Center for Information in Medicine, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
30
|
Kunz L, Wang L, Lachner-Piza D, Zhang H, Brandt A, Dümpelmann M, Reinacher PC, Coenen VA, Chen D, Wang WX, Zhou W, Liang S, Grewe P, Bien CG, Bierbrauer A, Navarro Schröder T, Schulze-Bonhage A, Axmacher N. Hippocampal theta phases organize the reactivation of large-scale electrophysiological representations during goal-directed navigation. SCIENCE ADVANCES 2019; 5:eaav8192. [PMID: 31281882 PMCID: PMC6609163 DOI: 10.1126/sciadv.aav8192] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/23/2018] [Accepted: 05/24/2019] [Indexed: 05/11/2023]
Abstract
Humans are adept in simultaneously following multiple goals, but the neural mechanisms for maintaining specific goals and distinguishing them from other goals are incompletely understood. For short time scales, working memory studies suggest that multiple mental contents are maintained by theta-coupled reactivation, but evidence for similar mechanisms during complex behaviors such as goal-directed navigation is scarce. We examined intracranial electroencephalography recordings of epilepsy patients performing an object-location memory task in a virtual environment. We report that large-scale electrophysiological representations of objects that cue for specific goal locations are dynamically reactivated during goal-directed navigation. Reactivation of different cue representations occurred at stimulus-specific hippocampal theta phases. Locking to more distinct theta phases predicted better memory performance, identifying hippocampal theta phase coding as a mechanism for separating competing goals. Our findings suggest shared neural mechanisms between working memory and goal-directed navigation and provide new insights into the functions of the hippocampal theta rhythm.
Collapse
Affiliation(s)
- Lukas Kunz
- Epilepsy Center, Medical Center—University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany
- Corresponding author. (L.K.); (N.A.)
| | - Liang Wang
- CAS Key Laboratory of Mental Health, Institute of Psychology, Beijing, China
- CAS Center for Excellence in Brain Science and Intelligence Technology, Shanghai, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Daniel Lachner-Piza
- Epilepsy Center, Medical Center—University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany
| | - Hui Zhang
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany
| | - Armin Brandt
- Epilepsy Center, Medical Center—University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany
| | - Matthias Dümpelmann
- Epilepsy Center, Medical Center—University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany
| | - Peter C. Reinacher
- University Medical Center, Stereotactic and Functional Neurosurgery, Freiburg im Breisgau, Germany
| | - Volker A. Coenen
- University Medical Center, Stereotactic and Functional Neurosurgery, Freiburg im Breisgau, Germany
| | - Dong Chen
- School of Systems Science, Beijing Normal University, Beijing, China
| | - Wen-Xu Wang
- School of Systems Science, Beijing Normal University, Beijing, China
| | - Wenjing Zhou
- Department of Epilepsy Center, Tsinghua University Yuquan Hospital, Beijing, China
| | - Shuli Liang
- Department of Neurosurgery, First Affiliated Hospital of General Hospital of PLA, Beijing, China
| | - Philip Grewe
- Bethel Epilepsy Centre, Krankenhaus Mara, Bielefeld, Germany
| | | | - Anne Bierbrauer
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany
| | - Tobias Navarro Schröder
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Andreas Schulze-Bonhage
- Epilepsy Center, Medical Center—University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany
| | - Nikolai Axmacher
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany
- Corresponding author. (L.K.); (N.A.)
| |
Collapse
|
31
|
Correlation Structure in Micro-ECoG Recordings is Described by Spatially Coherent Components. PLoS Comput Biol 2019; 15:e1006769. [PMID: 30742605 PMCID: PMC6386410 DOI: 10.1371/journal.pcbi.1006769] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Revised: 02/22/2019] [Accepted: 01/03/2019] [Indexed: 01/17/2023] Open
Abstract
Electrocorticography (ECoG) is becoming more prevalent due to improvements in fabrication and recording technology as well as its ease of implantation compared to intracortical electrophysiology, larger cortical coverage, and potential advantages for use in long term chronic implantation. Given the flexibility in the design of ECoG grids, which is only increasing, it remains an open question what geometry of the electrodes is optimal for an application. Conductive polymer, PEDOT:PSS, coated microelectrodes have an advantage that they can be made very small without losing low impedance. This makes them suitable for evaluating the required granularity of ECoG recording in humans and experimental animals. We used two-dimensional (2D) micro-ECoG grids to record intra-operatively in humans and during acute implantations in mouse with separation distance between neighboring electrodes (i.e., pitch) of 0.4 mm and 0.2/0.25 mm respectively. To assess the spatial properties of the signals, we used the average correlation between electrodes as a function of the pitch. In agreement with prior studies, we find a strong frequency dependence in the spatial scale of correlation. By applying independent component analysis (ICA), we find that the spatial pattern of correlation is largely due to contributions from multiple spatially extended, time-locked sources present at any given time. Our analysis indicates the presence of spatially structured activity down to the sub-millimeter spatial scale in ECoG despite the effects of volume conduction, justifying the use of dense micro-ECoG grids. Electrocorticography (ECoG) is a type of electrophysiological monitoring that uses electrodes placed directly on the exposed surface of the brain. ECoG is a promising technique for studying the brain, and EcoG signals can be used to control brain-computer interfaces. Advances have made it possible to record simultaneously with an increasing number of smaller, and more closely spaced electrodes. However, a property of electrical recording from outside the brain is that common signals appear on different electrodes at different locations, and this affects decisions about how to best distribute a limited number of electrodes to maximize the information that can be gathered. Large spacing of electrodes around one centimeter apart on the brain’s surface has proven useful for clinical and research use, but how much benefit there is to recording from more locations in a smaller area remains to be answered. We found that we can explain the commonality between the different locations as the combination of different patterns of brain activity that are present at multiple electrode locations, and that signals recorded from very closely spaced electrodes, around a millimeter or less apart, are able to identify patterns that are at this small scale.
Collapse
|