1
|
Kurteff GL, Field AM, Asghar S, Tyler-Kabara EC, Clarke D, Weiner HL, Anderson AE, Watrous AJ, Buchanan RJ, Modur PN, Hamilton LS. Processing of auditory feedback in perisylvian and insular cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.14.593257. [PMID: 38798574 PMCID: PMC11118286 DOI: 10.1101/2024.05.14.593257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
When we speak, we not only make movements with our mouth, lips, and tongue, but we also hear the sound of our own voice. Thus, speech production in the brain involves not only controlling the movements we make, but also auditory and sensory feedback. Auditory responses are typically suppressed during speech production compared to perception, but how this manifests across space and time is unclear. Here we recorded intracranial EEG in seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy who performed a reading/listening task to investigate how other auditory responses are modulated during speech production. We identified onset and sustained responses to speech in bilateral auditory cortex, with a selective suppression of onset responses during speech production. Onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, the posterior insula responded at sentence onset for both perception and production, suggesting a role in multisensory integration during feedback control.
Collapse
Affiliation(s)
- Garret Lynn Kurteff
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
| | - Alyssa M. Field
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
| | - Saman Asghar
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Elizabeth C. Tyler-Kabara
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Department of Pediatrics, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Dave Clarke
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Department of Pediatrics, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Howard L. Weiner
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Anne E. Anderson
- Department of Pediatrics, Baylor College of Medicine, Houston, TX, USA
| | - Andrew J. Watrous
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX, USA
| | - Robert J. Buchanan
- Department of Neurosurgery, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Pradeep N. Modur
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
| | - Liberty S. Hamilton
- Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin, Austin, TX, USA
- Department of Neurology, Dell Medical School, The University of Texas at Austin, Austin, TX, USA
- Lead contact
| |
Collapse
|
2
|
Guerreiro Fernandes F, Raemaekers M, Freudenburg Z, Ramsey N. Considerations for implanting speech brain computer interfaces based on functional magnetic resonance imaging. J Neural Eng 2024; 21:036005. [PMID: 38648782 DOI: 10.1088/1741-2552/ad4178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 04/22/2024] [Indexed: 04/25/2024]
Abstract
Objective.Brain-computer interfaces (BCIs) have the potential to reinstate lost communication faculties. Results from speech decoding studies indicate that a usable speech BCI based on activity in the sensorimotor cortex (SMC) can be achieved using subdurally implanted electrodes. However, the optimal characteristics for a successful speech implant are largely unknown. We address this topic in a high field blood oxygenation level dependent functional magnetic resonance imaging (fMRI) study, by assessing the decodability of spoken words as a function of hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal-axis.Approach.Twelve subjects conducted a 7T fMRI experiment in which they pronounced 6 different pseudo-words over 6 runs. We divided the SMC by hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal axis. Classification was performed on in these SMC areas using multiclass support vector machine (SVM).Main results.Significant classification was possible from the SMC, but no preference for the left or right hemisphere, nor for the precentral or postcentral gyrus for optimal word classification was detected. Classification while using information from the cortical surface was slightly better than when using information from deep in the central sulcus and was highest within the ventral 50% of SMC. Confusion matrices where highly similar across the entire SMC. An SVM-searchlight analysis revealed significant classification in the superior temporal gyrus and left planum temporale in addition to the SMC.Significance.The current results support a unilateral implant using surface electrodes, covering the ventral 50% of the SMC. The added value of depth electrodes is unclear. We did not observe evidence for variations in the qualitative nature of information across SMC. The current results need to be confirmed in paralyzed patients performing attempted speech.
Collapse
Affiliation(s)
- F Guerreiro Fernandes
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - M Raemaekers
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Z Freudenburg
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - N Ramsey
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
3
|
Duraivel S, Rahimpour S, Chiang CH, Trumpis M, Wang C, Barth K, Harward SC, Lad SP, Friedman AH, Southwell DG, Sinha SR, Viventi J, Cogan GB. High-resolution neural recordings improve the accuracy of speech decoding. Nat Commun 2023; 14:6938. [PMID: 37932250 PMCID: PMC10628285 DOI: 10.1038/s41467-023-42555-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 10/13/2023] [Indexed: 11/08/2023] Open
Abstract
Patients suffering from debilitating neurodegenerative diseases often lose the ability to communicate, detrimentally affecting their quality of life. One solution to restore communication is to decode signals directly from the brain to enable neural speech prostheses. However, decoding has been limited by coarse neural recordings which inadequately capture the rich spatio-temporal structure of human brain signals. To resolve this limitation, we performed high-resolution, micro-electrocorticographic (µECoG) neural recordings during intra-operative speech production. We obtained neural signals with 57× higher spatial resolution and 48% higher signal-to-noise ratio compared to macro-ECoG and SEEG. This increased signal quality improved decoding by 35% compared to standard intracranial signals. Accurate decoding was dependent on the high-spatial resolution of the neural interface. Non-linear decoding models designed to utilize enhanced spatio-temporal neural information produced better results than linear techniques. We show that high-density µECoG can enable high-quality speech decoding for future neural speech prostheses.
Collapse
Affiliation(s)
| | - Shervin Rahimpour
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA
- Department of Neurosurgery, Clinical Neuroscience Center, University of Utah, Salt Lake City, UT, USA
| | - Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Charles Wang
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Katrina Barth
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Stephen C Harward
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, USA
| | - Shivanand P Lad
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA
| | - Allan H Friedman
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA
| | - Derek G Southwell
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, USA
- Department of Neurobiology, Duke School of Medicine, Durham, NC, USA
| | - Saurabh R Sinha
- Penn Epilepsy Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC, USA.
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA.
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, USA.
- Department of Neurobiology, Duke School of Medicine, Durham, NC, USA.
| | - Gregory B Cogan
- Department of Biomedical Engineering, Duke University, Durham, NC, USA.
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, USA.
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, USA.
- Department of Neurology, Duke School of Medicine, Durham, NC, USA.
- Department of Psychology and Neuroscience, Duke University, Durham, NC, USA.
- Center for Cognitive Neuroscience, Duke University, Durham, NC, USA.
| |
Collapse
|
4
|
Zada Z, Goldstein A, Michelmann S, Simony E, Price A, Hasenfratz L, Barham E, Zadbood A, Doyle W, Friedman D, Dugan P, Melloni L, Devore S, Flinker A, Devinsky O, Nastase SA, Hasson U. A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.27.546708. [PMID: 37425747 PMCID: PMC10327051 DOI: 10.1101/2023.06.27.546708] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speaker's brain before word articulation, and the same linguistic content rapidly reemerged in the listener's brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts.
Collapse
Affiliation(s)
- Zaid Zada
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
- Department of Cognitive and Brain Sciences and Business School, Hebrew University; Jerusalem, 9190501, Israel
| | - Sebastian Michelmann
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Erez Simony
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
- Faculty of Engineering, Holon Institute of Technology, Holon, 5810201, Israel
| | - Amy Price
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Emily Barham
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
- Department of Psychology, Columbia University; New York, 10027, USA
| | - Werner Doyle
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Daniel Friedman
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Patricia Dugan
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Lucia Melloni
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Sasha Devore
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Adeen Flinker
- Grossman School of Medicine, New York University; New York, 10016, USA
- Tandon School of Engineering, New York University; New York, 10016, USA
| | - Orrin Devinsky
- Grossman School of Medicine, New York University; New York, 10016, USA
| | - Samuel A. Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University; New Jersey, 08544, USA
| |
Collapse
|
5
|
Keshishian M, Akkol S, Herrero J, Bickel S, Mehta AD, Mesgarani N. Joint, distributed and hierarchically organized encoding of linguistic features in the human auditory cortex. Nat Hum Behav 2023; 7:740-753. [PMID: 36864134 PMCID: PMC10417567 DOI: 10.1038/s41562-023-01520-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Accepted: 01/05/2023] [Indexed: 03/04/2023]
Abstract
The precise role of the human auditory cortex in representing speech sounds and transforming them to meaning is not yet fully understood. Here we used intracranial recordings from the auditory cortex of neurosurgical patients as they listened to natural speech. We found an explicit, temporally ordered and anatomically distributed neural encoding of multiple linguistic features, including phonetic, prelexical phonotactics, word frequency, and lexical-phonological and lexical-semantic information. Grouping neural sites on the basis of their encoded linguistic features revealed a hierarchical pattern, with distinct representations of prelexical and postlexical features distributed across various auditory areas. While sites with longer response latencies and greater distance from the primary auditory cortex encoded higher-level linguistic features, the encoding of lower-level features was preserved and not discarded. Our study reveals a cumulative mapping of sound to meaning and provides empirical evidence for validating neurolinguistic and psycholinguistic models of spoken word recognition that preserve the acoustic variations in speech.
Collapse
Affiliation(s)
- Menoua Keshishian
- Department of Electrical Engineering, Columbia University, New York, NY, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Serdar Akkol
- Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
| | - Jose Herrero
- Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Department of Neurosurgery, Hofstra-Northwell School of Medicine, Manhasset, NY, USA
| | - Stephan Bickel
- Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Department of Neurosurgery, Hofstra-Northwell School of Medicine, Manhasset, NY, USA
| | - Ashesh D Mehta
- Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Department of Neurosurgery, Hofstra-Northwell School of Medicine, Manhasset, NY, USA
| | - Nima Mesgarani
- Department of Electrical Engineering, Columbia University, New York, NY, USA.
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA.
| |
Collapse
|
6
|
Peterson V, Merk T, Bush A, Nikulin V, Kühn AA, Neumann WJ, Richardson RM. Movement decoding using spatio-spectral features of cortical and subcortical local field potentials. Exp Neurol 2023; 359:114261. [PMID: 36349662 DOI: 10.1016/j.expneurol.2022.114261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 09/26/2022] [Accepted: 10/25/2022] [Indexed: 12/30/2022]
Abstract
The first commercially sensing enabled deep brain stimulation (DBS) devices for the treatment of movement disorders have recently become available. In the future, such devices could leverage machine learning based brain signal decoding strategies to individualize and adapt therapy in real-time. As multi-channel recordings become available, spatial information may provide an additional advantage for informing machine learning models. To investigate this concept, we compared decoding performances from single channels vs. spatial filtering techniques using intracerebral multitarget electrophysiology in Parkinson's disease patients undergoing DBS implantation. We investigated the feasibility of spatial filtering in invasive neurophysiology and the putative utility of combined cortical ECoG and subthalamic local field potential signals for decoding grip-force, a well-defined and continuous motor readout. We found that adding spatial information to the model can improve decoding (6% gain in decoding), but the spatial patterns and additional benefit was highly individual. Beyond decoding performance results, spatial filters and patterns can be used to obtain meaningful neurophysiological information about the brain networks involved in target behavior. Our results highlight the importance of individualized approaches for brain signal decoding, for which multielectrode recordings and spatial filtering can improve precision medicine approaches for clinical brain computer interfaces.
Collapse
Affiliation(s)
- Victoria Peterson
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, USA.
| | - Timon Merk
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Alan Bush
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, USA
| | - Vadim Nikulin
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Andrea A Kühn
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Wolf-Julian Neumann
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - R Mark Richardson
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, USA
| |
Collapse
|
7
|
Mercier MR, Dubarry AS, Tadel F, Avanzini P, Axmacher N, Cellier D, Vecchio MD, Hamilton LS, Hermes D, Kahana MJ, Knight RT, Llorens A, Megevand P, Melloni L, Miller KJ, Piai V, Puce A, Ramsey NF, Schwiedrzik CM, Smith SE, Stolk A, Swann NC, Vansteensel MJ, Voytek B, Wang L, Lachaux JP, Oostenveld R. Advances in human intracranial electroencephalography research, guidelines and good practices. Neuroimage 2022; 260:119438. [PMID: 35792291 DOI: 10.1016/j.neuroimage.2022.119438] [Citation(s) in RCA: 41] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/23/2022] [Accepted: 06/30/2022] [Indexed: 12/11/2022] Open
Abstract
Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.
Collapse
|
8
|
Baratham VL, Dougherty ME, Hermiz J, Ledochowitsch P, Maharbiz MM, Bouchard KE. Columnar Localization and Laminar Origin of Cortical Surface Electrical Potentials. J Neurosci 2022; 42:3733-3748. [PMID: 35332084 PMCID: PMC9087723 DOI: 10.1523/jneurosci.1787-21.2022] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 02/09/2022] [Accepted: 03/09/2022] [Indexed: 11/21/2022] Open
Abstract
Electrocorticography (ECoG) methodologically bridges basic neuroscience and understanding of human brains in health and disease. However, the localization of ECoG signals across the surface of the brain and the spatial distribution of their generating neuronal sources are poorly understood. To address this gap, we recorded from rat auditory cortex using customized μECoG, and simulated cortical surface electrical potentials with a full-scale, biophysically detailed cortical column model. Experimentally, μECoG-derived auditory representations were tonotopically organized and signals were anisotropically localized to less than or equal to ±200 μm, that is, a single cortical column. Biophysical simulations reproduce experimental findings and indicate that neurons in cortical layers V and VI contribute ∼85% of evoked high-gamma signal recorded at the surface. Cell number and synchrony were the primary biophysical properties determining laminar contributions to evoked μECoG signals, whereas distance was only a minimal factor. Thus, evoked μECoG signals primarily originate from neurons in the infragranular layers of a single cortical column.SIGNIFICANCE STATEMENT ECoG methodologically bridges basic neuroscience and understanding of human brains in health and disease. However, the localization of ECoG signals across the surface of the brain and the spatial distribution of their generating neuronal sources are poorly understood. We investigated the localization and origins of sensory-evoked ECoG responses. We experimentally found that ECoG responses were anisotropically localized to a cortical column. Biophysically detailed simulations revealed that neurons in layers V and VI were the primary sources of evoked ECoG responses. These results indicate that evoked ECoG high-gamma responses are primarily generated by the population spike rate of pyramidal neurons in layers V and VI of single cortical columns and highlight the possibility of understanding how microscopic sources produce mesoscale signals.
Collapse
Affiliation(s)
- Vyassa L Baratham
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California 94720
- Department of Physics, University of California-Berkeley, Berkeley, California 94720
| | - Maximilian E Dougherty
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California 94720
| | - John Hermiz
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California 94720
| | | | - Michel M Maharbiz
- Center for Neural Engineering and Prosthesis, University of California-Berkeley/San Francisco, Berkeley, California 94720-3370
- Department of Electrical Engineering and Computer Science, University of California-Berkeley, Berkeley, California 94720
| | - Kristofer E Bouchard
- Center for Neural Engineering and Prosthesis, University of California-Berkeley/San Francisco, Berkeley, California 94720-3370
- Helen Wills Neuroscience Institute and Redwood Center for Theoretical Neuroscience, University of California-Berkeley, Berkeley, California 94720
- Scientific Data Division, Lawerence Berkeley National Lab, Berkeley, California 94720
- Biological Systems and Engineering Division, Lawerence Berkeley National Lab, Berkeley, California 94720
| |
Collapse
|
9
|
Kiroy V, Bakhtin O, Krivko E, Lazurenko D, Aslanyan E, Shaposhnikov D, Shcherban I. Spoken and Inner Speech-related EEG Connectivity in Different Spatial Direction. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103224] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
|
10
|
Davis TS, Caston RM, Philip B, Charlebois CM, Anderson DN, Weaver KE, Smith EH, Rolston JD. LeGUI: A Fast and Accurate Graphical User Interface for Automated Detection and Anatomical Localization of Intracranial Electrodes. Front Neurosci 2021; 15:769872. [PMID: 34955721 PMCID: PMC8695687 DOI: 10.3389/fnins.2021.769872] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Accepted: 11/18/2021] [Indexed: 11/24/2022] Open
Abstract
Accurate anatomical localization of intracranial electrodes is important for identifying the seizure foci in patients with epilepsy and for interpreting effects from cognitive studies employing intracranial electroencephalography. Localization is typically performed by coregistering postimplant computed tomography (CT) with preoperative magnetic resonance imaging (MRI). Electrodes are then detected in the CT, and the corresponding brain region is identified using the MRI. Many existing software packages for electrode localization chain together separate preexisting programs or rely on command line instructions to perform the various localization steps, making them difficult to install and operate for a typical user. Further, many packages provide solutions for some, but not all, of the steps needed for confident localization. We have developed software, Locate electrodes Graphical User Interface (LeGUI), that consists of a single interface to perform all steps needed to localize both surface and depth/penetrating intracranial electrodes, including coregistration of the CT to MRI, normalization of the MRI to the Montreal Neurological Institute template, automated electrode detection for multiple types of electrodes, electrode spacing correction and projection to the brain surface, electrode labeling, and anatomical targeting. The software is written in MATLAB, core image processing is performed using the Statistical Parametric Mapping toolbox, and standalone executable binaries are available for Windows, Mac, and Linux platforms. LeGUI was tested and validated on 51 datasets from two universities. The total user and computational time required to process a single dataset was approximately 1 h. Automatic electrode detection correctly identified 4362 of 4695 surface and depth electrodes with only 71 false positives. Anatomical targeting was verified by comparing electrode locations from LeGUI to locations that were assigned by an experienced neuroanatomist. LeGUI showed a 94% match with the 482 neuroanatomist-assigned locations. LeGUI combines all the features needed for fast and accurate anatomical localization of intracranial electrodes into a single interface, making it a valuable tool for intracranial electrophysiology research.
Collapse
Affiliation(s)
- Tyler S Davis
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, United States
| | - Rose M Caston
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| | - Brian Philip
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| | - Chantel M Charlebois
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| | - Daria Nesterovich Anderson
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, United States.,Department of Pharmacology and Toxicology, University of Utah, Salt Lake City, UT, United States
| | - Kurt E Weaver
- Department of Radiology, University of Washington, Seattle, WA, United States.,Department of Biological Structure, University of Washington, Seattle, WA, United States
| | - Elliot H Smith
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, United States
| | - John D Rolston
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, United States.,Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
11
|
Anderson DN, Charlebois CM, Smith EH, Arain AM, Davis TS, Rolston JD. Probabilistic comparison of gray and white matter coverage between depth and surface intracranial electrodes in epilepsy. Sci Rep 2021; 11:24155. [PMID: 34921176 PMCID: PMC8683494 DOI: 10.1038/s41598-021-03414-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 11/23/2021] [Indexed: 11/20/2022] Open
Abstract
In this study, we quantified the coverage of gray and white matter during intracranial electroencephalography in a cohort of epilepsy patients with surface and depth electrodes. We included 65 patients with strip electrodes (n = 12), strip and grid electrodes (n = 24), strip, grid, and depth electrodes (n = 7), or depth electrodes only (n = 22). Patient-specific imaging was used to generate probabilistic gray and white matter maps and atlas segmentations. Gray and white matter coverage was quantified using spherical volumes centered on electrode centroids, with radii ranging from 1 to 15 mm, along with detailed finite element models of local electric fields. Gray matter coverage was highly dependent on the chosen radius of influence (RoI). Using a 2.5 mm RoI, depth electrodes covered more gray matter than surface electrodes; however, surface electrodes covered more gray matter at RoI larger than 4 mm. White matter coverage and amygdala and hippocampal coverage was greatest for depth electrodes at all RoIs. This study provides the first probabilistic analysis to quantify coverage for different intracranial recording configurations. Depth electrodes offer increased coverage of gray matter over other recording strategies if the desired signals are local, while subdural grids and strips sample more gray matter if the desired signals are diffuse.
Collapse
Affiliation(s)
- Daria Nesterovich Anderson
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, USA. .,Department of Pharmacology and Toxicology, University of Utah, Salt Lake City, UT, USA.
| | - Chantel M Charlebois
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, USA
| | - Elliot H Smith
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, USA
| | - Amir M Arain
- Department of Neurology, University of Utah, Salt Lake City, UT, USA
| | - Tyler S Davis
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, USA
| | - John D Rolston
- Department of Neurosurgery, University of Utah, Salt Lake City, UT, USA. .,Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, USA.
| |
Collapse
|
12
|
Liu X, Ren C, Huang Z, Wilson M, Kim JH, Lu Y, Ramezani M, Komiyama T, Kuzum D. Decoding of cortex-wide brain activity from local recordings of neural potentials. J Neural Eng 2021; 18. [PMID: 34706356 DOI: 10.1088/1741-2552/ac33e7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 10/27/2021] [Indexed: 11/11/2022]
Abstract
Objective. Electrical recordings of neural activity from brain surface have been widely employed in basic neuroscience research and clinical practice for investigations of neural circuit functions, brain-computer interfaces, and treatments for neurological disorders. Traditionally, these surface potentials have been believed to mainly reflect local neural activity. It is not known how informative the locally recorded surface potentials are for the neural activities across multiple cortical regions.Approach. To investigate that, we perform simultaneous local electrical recording and wide-field calcium imaging in awake head-fixed mice. Using a recurrent neural network model, we try to decode the calcium fluorescence activity of multiple cortical regions from local electrical recordings.Main results. The mean activity of different cortical regions could be decoded from locally recorded surface potentials. Also, each frequency band of surface potentials differentially encodes activities from multiple cortical regions so that including all the frequency bands in the decoding model gives the highest decoding performance. Despite the close spacing between recording channels, surface potentials from different channels provide complementary information about the large-scale cortical activity and the decoding performance continues to improve as more channels are included. Finally, we demonstrate the successful decoding of whole dorsal cortex activity at pixel-level using locally recorded surface potentials.Significance. These results show that the locally recorded surface potentials indeed contain rich information of the large-scale neural activities, which could be further demixed to recover the neural activity across individual cortical regions. In the future, our cross-modality inference approach could be adapted to virtually reconstruct cortex-wide brain activity, greatly expanding the spatial reach of surface electrical recordings without increasing invasiveness. Furthermore, it could be used to facilitate imaging neural activity across the whole cortex in freely moving animals, without requirement of head-fixed microscopy configurations.
Collapse
Affiliation(s)
- Xin Liu
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America
| | - Chi Ren
- Neurobiology Section, Division of Biological Sciences, University of California San Diego, La Jolla, CA, United States of America.,Center for Neural Circuits and Behavior, University of California San Diego, La Jolla, CA, United States of America.,Department of Neurosciences, University of California San Diego, La Jolla, CA, United States of America
| | - Zhisheng Huang
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America
| | - Madison Wilson
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America
| | - Jeong-Hoon Kim
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America
| | - Yichen Lu
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America
| | - Mehrdad Ramezani
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America
| | - Takaki Komiyama
- Neurobiology Section, Division of Biological Sciences, University of California San Diego, La Jolla, CA, United States of America.,Center for Neural Circuits and Behavior, University of California San Diego, La Jolla, CA, United States of America.,Department of Neurosciences, University of California San Diego, La Jolla, CA, United States of America.,Halıcıoğlu Data Science Institute, University of California San Diego, La Jolla, CA, United States of America
| | - Duygu Kuzum
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, United States of America.,Halıcıoğlu Data Science Institute, University of California San Diego, La Jolla, CA, United States of America
| |
Collapse
|
13
|
Konno D, Nishimoto S, Suzuki T, Ikegaya Y, Matsumoto N. Multiple states in ongoing neural activity in the rat visual cortex. PLoS One 2021; 16:e0256791. [PMID: 34437630 PMCID: PMC8389421 DOI: 10.1371/journal.pone.0256791] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Accepted: 08/16/2021] [Indexed: 01/04/2023] Open
Abstract
The brain continuously produces internal activity in the absence of afferently salient sensory input. Spontaneous neural activity is intrinsically defined by circuit structures and associated with the mode of information processing and behavioral responses. However, the spatiotemporal dynamics of spontaneous activity in the visual cortices of behaving animals remain almost elusive. Using a custom-made electrode array, we recorded 32-site electrocorticograms in the primary and secondary visual cortex of freely behaving rats and determined the propagation patterns of spontaneous neural activity. Nonlinear dimensionality reduction and unsupervised clustering revealed multiple discrete states of the activity patterns. The activity remained stable in one state and suddenly jumped to another state. The diversity and dynamics of the internally switching cortical states would imply flexibility of neural responses to various external inputs.
Collapse
Affiliation(s)
- Daichi Konno
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
- Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Shinji Nishimoto
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita City, Osaka, Japan
| | - Takafumi Suzuki
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita City, Osaka, Japan
| | - Yuji Ikegaya
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Suita City, Osaka, Japan
- Institute for AI and Beyond, The University of Tokyo, Tokyo, Japan
| | - Nobuyoshi Matsumoto
- Graduate School of Pharmaceutical Sciences, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
14
|
Sellers KK, Chung JE, Zhou J, Triplett MG, Dawes HE, Haque R, Chang EF. Thin-film microfabrication and intraoperative testing of µECoG and iEEG depth arrays for sense and stimulation. J Neural Eng 2021; 18:10.1088/1741-2552/ac1984. [PMID: 34330113 PMCID: PMC10495194 DOI: 10.1088/1741-2552/ac1984] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2021] [Accepted: 07/30/2021] [Indexed: 11/11/2022]
Abstract
Objective.Intracranial neural recordings and electrical stimulation are tools used in an increasing range of applications, including intraoperative clinical mapping and monitoring, therapeutic neuromodulation, and brain computer interface control and feedback. However, many of these applications suffer from a lack of spatial specificity and localization, both in terms of sensed neural signal and applied stimulation. This stems from limited manufacturing processes of commercial-off-the-shelf (COTS) arrays unable to accommodate increased channel density, higher channel count, and smaller contact size.Approach.Here, we describe a manufacturing and assembly approach using thin-film microfabrication for 32-channel high density subdural micro-electrocorticography (µECoG) surface arrays (contacts 1.2 mm diameter, 2 mm pitch) and intracranial electroencephalography (iEEG) depth arrays (contacts 0.5 mm × 1.5 mm, pitch 0.8 mm × 2.5 mm). Crucially, we tackle the translational hurdle and test these arrays during intraoperative studies conducted in four humans under regulatory approval.Main results.We demonstrate that the higher-density contacts provide additional unique information across the recording span compared to the density of COTS arrays which typically have electrode pitch of 8 mm or greater; 4 mm in case of specially ordered arrays. Our intracranial stimulation study results reveal that refined spatial targeting of stimulation elicits evoked potentials with differing spatial spread.Significance.Thin-film,μECoG and iEEG depth arrays offer a promising substrate for advancing a number of clinical and research applications reliant on high-resolution neural sensing and intracranial stimulation.
Collapse
Affiliation(s)
- Kristin K Sellers
- Department of Neurological Surgery, Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, United States of America
- These authors contributed equally
| | - Jason E Chung
- Department of Neurological Surgery, Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, United States of America
- These authors contributed equally
| | - Jenny Zhou
- Lawrence Livermore National Laboratories, Livermore, CA, United States of America
| | - Michael G Triplett
- Lawrence Livermore National Laboratories, Livermore, CA, United States of America
| | - Heather E Dawes
- Department of Neurological Surgery, Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, United States of America
| | - Razi Haque
- Lawrence Livermore National Laboratories, Livermore, CA, United States of America
| | - Edward F Chang
- Department of Neurological Surgery, Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, United States of America
| |
Collapse
|
15
|
Schaworonkow N, Voytek B. Enhancing oscillations in intracranial electrophysiological recordings with data-driven spatial filters. PLoS Comput Biol 2021; 17:e1009298. [PMID: 34411096 PMCID: PMC8407590 DOI: 10.1371/journal.pcbi.1009298] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 08/31/2021] [Accepted: 07/22/2021] [Indexed: 11/19/2022] Open
Abstract
In invasive electrophysiological recordings, a variety of neural oscillations can be detected across the cortex, with overlap in space and time. This overlap complicates measurement of neural oscillations using standard referencing schemes, like common average or bipolar referencing. Here, we illustrate the effects of spatial mixing on measuring neural oscillations in invasive electrophysiological recordings and demonstrate the benefits of using data-driven referencing schemes in order to improve measurement of neural oscillations. We discuss referencing as the application of a spatial filter. Spatio-spectral decomposition is used to estimate data-driven spatial filters, a computationally fast method which specifically enhances signal-to-noise ratio for oscillations in a frequency band of interest. We show that application of these data-driven spatial filters has benefits for data exploration, investigation of temporal dynamics and assessment of peak frequencies of neural oscillations. We demonstrate multiple use cases, exploring between-participant variability in presence of oscillations, spatial spread and waveform shape of different rhythms as well as narrowband noise removal with the aid of spatial filters. We find high between-participant variability in the presence of neural oscillations, a large variation in spatial spread of individual rhythms and many non-sinusoidal rhythms across the cortex. Improved measurement of cortical rhythms will yield better conditions for establishing links between cortical activity and behavior, as well as bridging scales between the invasive intracranial measurements and noninvasive macroscale scalp measurements.
Collapse
Affiliation(s)
- Natalie Schaworonkow
- Department of Cognitive Science, University of California, San Diego, California, United States of America
| | - Bradley Voytek
- Department of Cognitive Science, University of California, San Diego, California, United States of America
- Halıcıoğlu Data Science Institute, University of California, San Diego, California, United States of America
- Neurosciences Graduate Program, University of California, San Diego, California, United States of America
- Kavli Institute for Brain and Mind, University of California, San Diego, California, United States of America
| |
Collapse
|
16
|
Chiang CH, Won SM, Orsborn AL, Yu KJ, Trumpis M, Bent B, Wang C, Xue Y, Min S, Woods V, Yu C, Kim BH, Kim SB, Huq R, Li J, Seo KJ, Vitale F, Richardson A, Fang H, Huang Y, Shepard K, Pesaran B, Rogers JA, Viventi J. Development of a neural interface for high-definition, long-term recording in rodents and nonhuman primates. Sci Transl Med 2021; 12:12/538/eaay4682. [PMID: 32269166 DOI: 10.1126/scitranslmed.aay4682] [Citation(s) in RCA: 81] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2019] [Accepted: 02/28/2020] [Indexed: 12/25/2022]
Abstract
Long-lasting, high-resolution neural interfaces that are ultrathin and flexible are essential for precise brain mapping and high-performance neuroprosthetic systems. Scaling to sample thousands of sites across large brain regions requires integrating powered electronics to multiplex many electrodes to a few external wires. However, existing multiplexed electrode arrays rely on encapsulation strategies that have limited implant lifetimes. Here, we developed a flexible, multiplexed electrode array, called "Neural Matrix," that provides stable in vivo neural recordings in rodents and nonhuman primates. Neural Matrix lasts over a year and samples a centimeter-scale brain region using over a thousand channels. The long-lasting encapsulation (projected to last at least 6 years), scalable device design, and iterative in vivo optimization described here are essential components to overcoming current hurdles facing next-generation neural technologies.
Collapse
Affiliation(s)
- Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA.
| | - Sang Min Won
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Amy L Orsborn
- Center for Neural Science, New York University, New York, NY 10003, USA.,Department of Electrical and Computer Engineering, University of Washington, Seattle, WA 98195, USA.,Department of Bioengineering, University of Washington, Seattle, WA 98195, USA
| | - Ki Jun Yu
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Republic of Korea
| | - Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Brinnae Bent
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Charles Wang
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Yeguang Xue
- Department of Civil and Environmental Engineering, Northwestern University, Evanston, IL 60208, USA.,Department of Mechanical Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Seunghwan Min
- Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA
| | - Virginia Woods
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Chunxiu Yu
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA.,Department of Biological Science, Michigan Technological University, Houghton, MI 49931, USA
| | - Bong Hoon Kim
- Department of Organic Materials and Fiber Engineering, Soongsil University, Seoul 06978, Republic of Korea.,Department of Information Communication, Materials, and Chemistry Convergence Technology, Soongsil University, Seoul 06978, Republic of Korea
| | - Sung Bong Kim
- Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Rizwan Huq
- Department of Electrical Engineering, Columbia University, New York, NY 10027, USA
| | - Jinghua Li
- Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA.,Department of Materials Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA.,Department of Materials Science and Engineering, Center for Chronic Brain Injury, The Ohio State University, Columbus, OH 43210, USA
| | - Kyung Jin Seo
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA 02115, USA
| | - Flavia Vitale
- Department of Neurology, Department of Bioengineering, Department of Physical Medicine & Rehabilitation, Center for Neuroengineering and Therapeutics, University of Pennsylvania, PA 19104, USA.,Center of Neurotrauma, Neurodegeneration, and Restoration, Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA 19104, USA
| | - Andrew Richardson
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Hui Fang
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA 02115, USA
| | - Yonggang Huang
- Department of Civil and Environmental Engineering, Northwestern University, Evanston, IL 60208, USA.,Department of Mechanical Engineering, Northwestern University, Evanston, IL 60208, USA.,Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA.,Center for Bio-integrated Electronics, Northwestern University, Evanston, IL 60208, USA
| | - Kenneth Shepard
- Department of Electrical Engineering, Columbia University, New York, NY 10027, USA.,Department of Biomedical Engineering, Columbia University, New York, NY 10027, USA
| | - Bijan Pesaran
- Center for Neural Science, New York University, New York, NY 10003, USA. .,Department of Neurology, NYU Langone Health, New York, NY 10016, USA
| | - John A Rogers
- Department of Civil and Environmental Engineering, Northwestern University, Evanston, IL 60208, USA. .,Department of Mechanical Engineering, Northwestern University, Evanston, IL 60208, USA.,Materials Science and Engineering, Northwestern University, Evanston, IL 60208, USA.,Department of Materials Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA.,Center for Bio-integrated Electronics, Northwestern University, Evanston, IL 60208, USA.,Simpson Querrey Institute, Northwestern University, Chicago, IL 60611, USA.,Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, USA.,Department of Chemistry, Northwestern University, Evanston, IL 60208, USA.,Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA. .,Department of Neurobiology, Duke University, Durham, NC 27708, USA.,Department of Neurosurgery, Duke University, Durham, NC 27708, USA
| |
Collapse
|
17
|
Chiang CH, Wang C, Barth K, Rahimpour S, Trumpis M, Duraivel S, Rachinskiy I, Dubey A, Wingel KE, Wong M, Witham NS, Odell T, Woods V, Bent B, Doyle W, Friedman D, Bihler E, Reiche CF, Southwell DG, Haglund MM, Friedman AH, Lad SP, Devore S, Devinsky O, Solzbacher F, Pesaran B, Cogan G, Viventi J. Flexible, high-resolution thin-film electrodes for human and animal neural research. J Neural Eng 2021; 18:10.1088/1741-2552/ac02dc. [PMID: 34010815 PMCID: PMC8496685 DOI: 10.1088/1741-2552/ac02dc] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 05/19/2021] [Indexed: 11/11/2022]
Abstract
Objective.Brain functions such as perception, motor control, learning, and memory arise from the coordinated activity of neuronal assemblies distributed across multiple brain regions. While major progress has been made in understanding the function of individual neurons, circuit interactions remain poorly understood. A fundamental obstacle to deciphering circuit interactions is the limited availability of research tools to observe and manipulate the activity of large, distributed neuronal populations in humans. Here we describe the development, validation, and dissemination of flexible, high-resolution, thin-film (TF) electrodes for recording neural activity in animals and humans.Approach.We leveraged standard flexible printed-circuit manufacturing processes to build high-resolution TF electrode arrays. We used biocompatible materials to form the substrate (liquid crystal polymer; LCP), metals (Au, PtIr, and Pd), molding (medical-grade silicone), and 3D-printed housing (nylon). We designed a custom, miniaturized, digitizing headstage to reduce the number of cables required to connect to the acquisition system and reduce the distance between the electrodes and the amplifiers. A custom mechanical system enabled the electrodes and headstages to be pre-assembled prior to sterilization, minimizing the setup time required in the operating room. PtIr electrode coatings lowered impedance and enabled stimulation. High-volume, commercial manufacturing enables cost-effective production of LCP-TF electrodes in large quantities.Main Results. Our LCP-TF arrays achieve 25× higher electrode density, 20× higher channel count, and 11× reduced stiffness than conventional clinical electrodes. We validated our LCP-TF electrodes in multiple human intraoperative recording sessions and have disseminated this technology to >10 research groups. Using these arrays, we have observed high-frequency neural activity with sub-millimeter resolution.Significance.Our LCP-TF electrodes will advance human neuroscience research and improve clinical care by enabling broad access to transformative, high-resolution electrode arrays.
Collapse
Affiliation(s)
- Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- These authors contributed equally to this work
| | - Charles Wang
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- These authors contributed equally to this work
| | - Katrina Barth
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Shervin Rahimpour
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | | | - Iakov Rachinskiy
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Agrita Dubey
- Center for Neural Science, New York University, NY, NY, United States of America
| | - Katie E Wingel
- Center for Neural Science, New York University, NY, NY, United States of America
| | - Megan Wong
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Nicholas S Witham
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Thomas Odell
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Virginia Woods
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Brinnae Bent
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Werner Doyle
- Department of Neurosurgery, NYU Langone Medical Center, New York City, NY, United States of America
| | - Daniel Friedman
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | | | - Christopher F Reiche
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Derek G Southwell
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Michael M Haglund
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Allan H Friedman
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Shivanand P Lad
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Sasha Devore
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | - Orrin Devinsky
- Department of Neurosurgery, NYU Langone Medical Center, New York City, NY, United States of America
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
- Comprehensive Epilepsy Center, NYU Langone Health, NY, NY, United States of America
| | - Florian Solzbacher
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Materials Science & Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Bijan Pesaran
- Center for Neural Science, New York University, NY, NY, United States of America
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | - Gregory Cogan
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
- Department of Psychology and Neuroscience, Duke University, Durham, NC, United States of America
- Center for Cognitive Neuroscience, Duke University, Durham, NC, United States of America
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, United States of America
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
- Department of Neurobiology, Duke School of Medicine, Durham, NC, United States of America
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, United States of America
| |
Collapse
|
18
|
Delfino E, Pastore A, Zucchini E, Cruz MFP, Ius T, Vomero M, D'Ausilio A, Casile A, Skrap M, Stieglitz T, Fadiga L. Prediction of Speech Onset by Micro-Electrocorticography of the Human Brain. Int J Neural Syst 2021; 31:2150025. [PMID: 34130614 DOI: 10.1142/s0129065721500258] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Recent technological advances show the feasibility of offline decoding speech from neuronal signals, paving the way to the development of chronically implanted speech brain computer interfaces (sBCI). Two key steps that still need to be addressed for the online deployment of sBCI are, on the one hand, the definition of relevant design parameters of the recording arrays, on the other hand, the identification of robust physiological markers of the patient's intention to speak, which can be used to online trigger the decoding process. To address these issues, we acutely recorded speech-related signals from the frontal cortex of two human patients undergoing awake neurosurgery for brain tumors using three different micro-electrocorticographic ([Formula: see text]ECoG) devices. First, we observed that, at the smallest investigated pitch (600[Formula: see text][Formula: see text]m), neighboring channels are highly correlated, suggesting that more closely spaced electrodes would provide some redundant information. Second, we trained a classifier to recognize speech-related motor preparation from high-gamma oscillations (70-150[Formula: see text]Hz), demonstrating that these neuronal signals can be used to reliably predict speech onset. Notably, our model generalized both across subjects and recording devices showing the robustness of its performance. These findings provide crucial information for the design of future online sBCI.
Collapse
Affiliation(s)
- Emanuela Delfino
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Aldo Pastore
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Elena Zucchini
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Maria Francisca Porto Cruz
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering (IMTEK), University of Freiburg, Georges-Köhler-Allee 102, Freiburg im Breisgau 79110, Germany
| | - Tamara Ius
- Struttura Complessa di Neurochirurgia, Azienda Ospedaliero-Universitaria Santa Maria, della Misericordia, Piazzale Santa Maria, della Misericordia 15, Udine 33100, Italy
| | - Maria Vomero
- Bioelectronic Systems Laboratory, Columbia University, 500 West 120th Street, New York, NY 10027, USA
| | - Alessandro D'Ausilio
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Antonino Casile
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Miran Skrap
- Struttura Complessa di Neurochirurgia, Azienda Ospedaliero-Universitaria Santa Maria, della Misericordia, Piazzale Santa Maria, della Misericordia 15, Udine 33100, Italy
| | - Thomas Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering (IMTEK), University of Freiburg, Georges-Köhler-Allee 102, Freiburg im Breisgau 79110, Germany.,BrainLinks-BrainTools Center, University of Freiburg, Georges-Köhler-Allee 80, Freiburg im Breisgau 79110, Germany
| | - Luciano Fadiga
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| |
Collapse
|
19
|
Crocker B, Ostrowski L, Williams ZM, Dougherty DD, Eskandar EN, Widge AS, Chu CJ, Cash SS, Paulk AC. Local and distant responses to single pulse electrical stimulation reflect different forms of connectivity. Neuroimage 2021; 237:118094. [PMID: 33940142 DOI: 10.1016/j.neuroimage.2021.118094] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2020] [Revised: 03/13/2021] [Accepted: 04/13/2021] [Indexed: 12/17/2022] Open
Abstract
Measuring connectivity in the human brain involves innumerable approaches using both noninvasive (fMRI, EEG) and invasive (intracranial EEG or iEEG) recording modalities, including the use of external probing stimuli, such as direct electrical stimulation. To examine how different measures of connectivity correlate with one another, we compared 'passive' measures of connectivity during resting state conditions to the more 'active' probing measures of connectivity with single pulse electrical stimulation (SPES). We measured the network engagement and spread of the cortico-cortico evoked potential (CCEP) induced by SPES at 53 out of 104 total sites across the brain, including cortical and subcortical regions, in patients with intractable epilepsy (N=11) who were undergoing intracranial recordings as a part of their clinical care for identifying seizure onset zones. We compared the CCEP network to functional, effective, and structural measures of connectivity during a resting state in each patient. Functional and effective connectivity measures included correlation or Granger causality measures applied to stereoEEG (sEEGs) recordings. Structural connectivity was derived from diffusion tensor imaging (DTI) acquired before intracranial electrode implant and monitoring (N=8). The CCEP network was most similar to the resting state voltage correlation network in channels near to the stimulation location. In contrast, the distant CCEP network was most similar to the DTI network. Other connectivity measures were not as similar to the CCEP network. These results demonstrate that different connectivity measures, including those derived from active stimulation-based probing, measure different, complementary aspects of regional interrelationships in the brain.
Collapse
Affiliation(s)
- Britni Crocker
- Harvard-MIT Health Sciences and Technology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, 02139; Department of Neurology, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Lauren Ostrowski
- Department of Neurology, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Ziv M Williams
- Nayef Al-Rodhan Laboratories, Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, USA
| | - Darin D Dougherty
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, 02129
| | - Emad N Eskandar
- Nayef Al-Rodhan Laboratories, Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, USA; Department of Neurosurgery, Albert Einstein College of Medicine, Montefiore Medical Center, Bronx, NY 10467
| | - Alik S Widge
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, 02129; Picower Institute for Learning & Memory, Massachusetts Institute of Technology, Cambridge, MA 02124; Department of Psychiatry, University of Minnesota, Minneapolis, MN 55455
| | - Catherine J Chu
- Department of Neurology, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Boston, MA 02114, USA; Nayef Al-Rodhan Laboratories, Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, USA.
| |
Collapse
|
20
|
Panachakel JT, Ramakrishnan AG. Decoding Covert Speech From EEG-A Comprehensive Review. Front Neurosci 2021; 15:642251. [PMID: 33994922 PMCID: PMC8116487 DOI: 10.3389/fnins.2021.642251] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Accepted: 03/18/2021] [Indexed: 11/13/2022] Open
Abstract
Over the past decade, many researchers have come up with different implementations of systems for decoding covert or imagined speech from EEG (electroencephalogram). They differ from each other in several aspects, from data acquisition to machine learning algorithms, due to which, a comparison between different implementations is often difficult. This review article puts together all the relevant works published in the last decade on decoding imagined speech from EEG into a single framework. Every important aspect of designing such a system, such as selection of words to be imagined, number of electrodes to be recorded, temporal and spatial filtering, feature extraction and classifier are reviewed. This helps a researcher to compare the relative merits and demerits of the different approaches and choose the one that is most optimal. Speech being the most natural form of communication which human beings acquire even without formal education, imagined speech is an ideal choice of prompt for evoking brain activity patterns for a BCI (brain-computer interface) system, although the research on developing real-time (online) speech imagery based BCI systems is still in its infancy. Covert speech based BCI can help people with disabilities to improve their quality of life. It can also be used for covert communication in environments that do not support vocal communication. This paper also discusses some future directions, which will aid the deployment of speech imagery based BCI for practical applications, rather than only for laboratory experiments.
Collapse
Affiliation(s)
- Jerrin Thomas Panachakel
- Medical Intelligence and Language Engineering Laboratory, Department of Electrical Engineering, Indian Institute of Science, Bangalore, India
| | | |
Collapse
|
21
|
Trumpis M, Chiang CH, Orsborn AL, Bent B, Li J, Rogers JA, Pesaran B, Cogan G, Viventi J. Sufficient sampling for kriging prediction of cortical potential in rat, monkey, and human µECoG. J Neural Eng 2021; 18. [PMID: 33326943 DOI: 10.1088/1741-2552/abd460] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 12/16/2020] [Indexed: 12/22/2022]
Abstract
Objective. Large channel count surface-based electrophysiology arrays (e.g. µECoG) are high-throughput neural interfaces with good chronic stability. Electrode spacing remains ad hoc due to redundancy and nonstationarity of field dynamics. Here, we establish a criterion for electrode spacing based on the expected accuracy of predicting unsampled field potential from sampled sites.Approach. We applied spatial covariance modeling and field prediction techniques based on geospatial kriging to quantify sufficient sampling for thousands of 500 ms µECoG snapshots in human, monkey, and rat. We calculated a probably approximately correct (PAC) spacing based on kriging that would be required to predict µECoG fields at≤10% error for most cases (95% of observations).Main results. Kriging theory accurately explained the competing effects of electrode density and noise on predicting field potential. Across five frequency bands from 4-7 to 75-300 Hz, PAC spacing was sub-millimeter for auditory cortex in anesthetized and awake rats, and posterior superior temporal gyrus in anesthetized human. At 75-300 Hz, sub-millimeter PAC spacing was required in all species and cortical areas.Significance. PAC spacing accounted for the effect of signal-to-noise on prediction quality and was sensitive to the full distribution of non-stationary covariance states. Our results show that µECoG arrays should sample at sub-millimeter resolution for applications in diverse cortical areas and for noise resilience.
Collapse
Affiliation(s)
- Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Amy L Orsborn
- Center for Neural Science, New York University, New York, NY 10003, United States of America.,Department of Electrical & Computer Engineering, University of Washington, Seattle, WA 98195, United States of America.,Department of Bioengineering, University of Washington, Seattle, Washington 98105, United States of America.,Washington National Primate Research Center, Seattle, Washington 98195, United States of America
| | - Brinnae Bent
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Jinghua Li
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, United States of America.,Department of Materials Science and Engineering, The Ohio State University, Columbus, OH 43210, United States of America.,Chronic Brain Injury Program, The Ohio State University, Columbus, OH 43210, United States of America
| | - John A Rogers
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, United States of America.,Simpson Querrey Institute, Northwestern University, Chicago, IL 60611, United States of America.,Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, United States of America.,Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, United States of America
| | - Bijan Pesaran
- Center for Neural Science, New York University, New York, NY 10003, United States of America
| | - Gregory Cogan
- Department of Neurosurgery, Duke School of Medicine, Durham, NC 27710, United States of America.,Department of Psychology and Neuroscience, Duke University, Durham, NC 27708, United States of America.,Center for Cognitive Neuroscience, Duke University, Durham, NC 27708, United States of America.,Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC 27710, United States of America
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America.,Department of Neurosurgery, Duke School of Medicine, Durham, NC 27710, United States of America.,Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC 27710, United States of America.,Department of Neurobiology, Duke School of Medicine, Durham, NC 27710, United States of America
| |
Collapse
|
22
|
Archila-Meléndez ME, Valente G, Gommer ED, Correia JM, Ten Oever S, Peters JC, Reithler J, Hendriks MPH, Cornejo Ochoa W, Schijns OEMG, Dings JTA, Hilkman DMW, Rouhl RPW, Jansma BM, van Kranen-Mastenbroek VHJM, Roberts MJ. Combining Gamma With Alpha and Beta Power Modulation for Enhanced Cortical Mapping in Patients With Focal Epilepsy. Front Hum Neurosci 2020; 14:555054. [PMID: 33408621 PMCID: PMC7779799 DOI: 10.3389/fnhum.2020.555054] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 11/17/2020] [Indexed: 12/03/2022] Open
Abstract
About one third of patients with epilepsy have seizures refractory to the medical treatment. Electrical stimulation mapping (ESM) is the gold standard for the identification of “eloquent” areas prior to resection of epileptogenic tissue. However, it is time-consuming and may cause undesired side effects. Broadband gamma activity (55–200 Hz) recorded with extraoperative electrocorticography (ECoG) during cognitive tasks may be an alternative to ESM but until now has not proven of definitive clinical value. Considering their role in cognition, the alpha (8–12 Hz) and beta (15–25 Hz) bands could further improve the identification of eloquent cortex. We compared gamma, alpha and beta activity, and their combinations for the identification of eloquent cortical areas defined by ESM. Ten patients with intractable focal epilepsy (age: 35.9 ± 9.1 years, range: 22–48, 8 females, 9 right handed) participated in a delayed-match-to-sample task, where syllable sounds were compared to visually presented letters. We used a generalized linear model (GLM) approach to find the optimal weighting of each band for predicting ESM-defined categories and estimated the diagnostic ability by calculating the area under the receiver operating characteristic (ROC) curve. Gamma activity increased more in eloquent than in non-eloquent areas, whereas alpha and beta power decreased more in eloquent areas. Diagnostic ability of each band was close to 0.7 for all bands but depended on multiple factors including the time period of the cognitive task, the location of the electrodes and the patient’s degree of attention to the stimulus. We show that diagnostic ability can be increased by 3–5% by combining gamma and alpha and by 7.5–11% when gamma and beta were combined. We then show how ECoG power modulation from cognitive testing can be used to map the probability of eloquence in individual patients and how this probability map can be used in clinical settings to optimize ESM planning. We conclude that the combination of gamma and beta power modulation during cognitive testing can contribute to the identification of eloquent areas prior to ESM in patients with refractory focal epilepsy.
Collapse
Affiliation(s)
- Mario E Archila-Meléndez
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Neuroscientific MR-Physics Research Group, Department of Diagnostic and Interventional Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Munich, Germany.,Technical University of Munich Neuroimaging Center (TUM-NIC), Klinikum rechts der Isar, School of Medicine, Technische Universität München, Munich, Germany
| | - Giancarlo Valente
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Center (M-BIC), Maastricht University, Maastricht, Netherlands
| | - Erik D Gommer
- Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Department of Clinical Neurophysiology, Maastricht University Medical Center, Maastricht University, Maastricht, Netherlands
| | - João M Correia
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Basque Center on Cognition, Brain and Language (BCBL), Donostia-San Sebastian, Spain.,Centre for Biomedical Research (CBMR)/Department of Psychology, Universidade do Algarve, Faro, Portugal
| | - Sanne Ten Oever
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Center (M-BIC), Maastricht University, Maastricht, Netherlands
| | - Judith C Peters
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Center (M-BIC), Maastricht University, Maastricht, Netherlands.,Department of Vision & Cognition, Netherlands Institute for Neuroscience, An Institute of the Royal Netherlands Academy of Arts and Sciences (KNAW), Amsterdam, Netherlands
| | - Joel Reithler
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Center (M-BIC), Maastricht University, Maastricht, Netherlands.,Department of Vision & Cognition, Netherlands Institute for Neuroscience, An Institute of the Royal Netherlands Academy of Arts and Sciences (KNAW), Amsterdam, Netherlands
| | - Marc P H Hendriks
- Academic Center for Epileptology, Kempenhaeghe/Maastricht University Medical Center, Maastricht, Netherlands.,Department of Neurosurgery, Maastricht University Medical Center Maastricht, Maastricht University, Maastricht, Netherlands.,Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
| | - William Cornejo Ochoa
- Grupo Pediaciencias, Facultad de Medicina, Universidad de Antioquia, Medellín, Antioquia, Colombia
| | - Olaf E M G Schijns
- Academic Center for Epileptology, Kempenhaeghe/Maastricht University Medical Center, Maastricht, Netherlands.,Department of Neurosurgery, Maastricht University Medical Center Maastricht, Maastricht University, Maastricht, Netherlands.,School for Mental Health and Neuroscience (MHeNS), Maastricht University, Maastricht, Netherlands
| | - Jim T A Dings
- Academic Center for Epileptology, Kempenhaeghe/Maastricht University Medical Center, Maastricht, Netherlands.,Department of Neurosurgery, Maastricht University Medical Center Maastricht, Maastricht University, Maastricht, Netherlands
| | - Danny M W Hilkman
- Department of Clinical Neurophysiology, Maastricht University Medical Center, Maastricht University, Maastricht, Netherlands.,Academic Center for Epileptology, Kempenhaeghe/Maastricht University Medical Center, Maastricht, Netherlands
| | - Rob P W Rouhl
- Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Academic Center for Epileptology, Kempenhaeghe/Maastricht University Medical Center, Maastricht, Netherlands.,School for Mental Health and Neuroscience (MHeNS), Maastricht University, Maastricht, Netherlands.,Department of Neurology, Maastricht University Medical Center, Maastricht, Netherlands
| | - Bernadette M Jansma
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Center (M-BIC), Maastricht University, Maastricht, Netherlands
| | - Vivianne H J M van Kranen-Mastenbroek
- Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands.,Department of Clinical Neurophysiology, Maastricht University Medical Center, Maastricht University, Maastricht, Netherlands.,Academic Center for Epileptology, Kempenhaeghe/Maastricht University Medical Center, Maastricht, Netherlands.,Department of Neurology, Maastricht University Medical Center, Maastricht, Netherlands
| | - Mark J Roberts
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Center for Integrative Neuroscience (CIN), Maastricht University, Maastricht, Netherlands
| |
Collapse
|
23
|
Erhardt JB, Lottner T, Pasluosta CF, Gessner I, Mathur S, Schuettler M, Bock M, Stieglitz T. Fabrication and validation of reference structures for the localization of subdural standard- and micro-electrodes in MRI. J Neural Eng 2020; 17:046044. [PMID: 32764195 DOI: 10.1088/1741-2552/abad7a] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Report simple reference structure fabrication and validate the precise localization of subdural micro- and standard electrodes in magnetic resonance imaging (MRI) in phantom experiments. APPROACH Electrode contacts with diameters of 0.3 mm and 4 mm are localized in 1.5 T MRI using reference structures made of silicone and iron oxide nanoparticle doping. The precision of the localization procedure was assessed for several standard MRI sequences and implant orientations in phantom experiments and compared to common clinical localization procedures. MAIN RESULTS A localization precision of 0.41 ± 0.20 mm could be achieved for both electrode diameters compared to 1.46 ± 0.69 mm that was achieved for 4 mm standard electrode contacts localized using a common clinical standard method. The new reference structures are intrinsically bio-compatible, and they can be detected with currently available feature detection software so that a clinical implementation of this technology should be feasible. SIGNIFICANCE Neuropathologies are increasingly diagnosed and treated with subdural electrodes, where the exact localization of the electrode contacts with respect to the patient's cortical anatomy is a prerequisite for the procedure. Post-implantation electrode localization using MRI may be advantageous compared to the common alternative of CT-MRI image co-registration, as it avoids systematic localization errors associated with the co-registration itself, as well as brain shift and implant movement. Additionally, MRI provides superior soft tissue contrast for the identification of brain lesions without exposing the patient to ionizing radiation. Recent studies show that smaller electrodes and high-density electrode grids are ideal for clinical and research purposes, but the localization of these devices in MRI has not been demonstrated.
Collapse
Affiliation(s)
- Johannes B Erhardt
- Department of Microsystems Engineering-IMTEK, University of Freiburg, Freiburg, Germany. BrainLinks-BrainTools, Freiburg, Germany
| | | | | | | | | | | | | | | |
Collapse
|
24
|
Herff C, Krusienski DJ, Kubben P. The Potential of Stereotactic-EEG for Brain-Computer Interfaces: Current Progress and Future Directions. Front Neurosci 2020; 14:123. [PMID: 32174810 PMCID: PMC7056827 DOI: 10.3389/fnins.2020.00123] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Accepted: 01/30/2020] [Indexed: 12/17/2022] Open
Abstract
Stereotactic electroencephalogaphy (sEEG) utilizes localized, penetrating depth electrodes to measure electrophysiological brain activity. It is most commonly used in the identification of epileptogenic zones in cases of refractory epilepsy. The implanted electrodes generally provide a sparse sampling of a unique set of brain regions including deeper brain structures such as hippocampus, amygdala and insula that cannot be captured by superficial measurement modalities such as electrocorticography (ECoG). Despite the overlapping clinical application and recent progress in decoding of ECoG for Brain-Computer Interfaces (BCIs), sEEG has thus far received comparatively little attention for BCI decoding. Additionally, the success of the related deep-brain stimulation (DBS) implants bodes well for the potential for chronic sEEG applications. This article provides an overview of sEEG technology, BCI-related research, and prospective future directions of sEEG for long-term BCI applications.
Collapse
Affiliation(s)
- Christian Herff
- Department of Neurosurgery, School of Mental Health and Neurosciences, Maastricht University, Maastricht, Netherlands
| | - Dean J Krusienski
- ASPEN Lab, Biomedical Engineering Department, Virginia Commonwealth University, Richmond, VA, United States
| | - Pieter Kubben
- Department of Neurosurgery, Maastricht University Medical Center, Maastricht, Netherlands
| |
Collapse
|
25
|
Betzel RF, Medaglia JD, Kahn AE, Soffer J, Schonhaut DR, Bassett DS. Structural, geometric and genetic factors predict interregional brain connectivity patterns probed by electrocorticography. Nat Biomed Eng 2019; 3:902-916. [DOI: 10.1038/s41551-019-0404-5] [Citation(s) in RCA: 60] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2018] [Accepted: 04/15/2019] [Indexed: 01/05/2023]
|
26
|
Correlation Structure in Micro-ECoG Recordings is Described by Spatially Coherent Components. PLoS Comput Biol 2019; 15:e1006769. [PMID: 30742605 PMCID: PMC6386410 DOI: 10.1371/journal.pcbi.1006769] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Revised: 02/22/2019] [Accepted: 01/03/2019] [Indexed: 01/17/2023] Open
Abstract
Electrocorticography (ECoG) is becoming more prevalent due to improvements in fabrication and recording technology as well as its ease of implantation compared to intracortical electrophysiology, larger cortical coverage, and potential advantages for use in long term chronic implantation. Given the flexibility in the design of ECoG grids, which is only increasing, it remains an open question what geometry of the electrodes is optimal for an application. Conductive polymer, PEDOT:PSS, coated microelectrodes have an advantage that they can be made very small without losing low impedance. This makes them suitable for evaluating the required granularity of ECoG recording in humans and experimental animals. We used two-dimensional (2D) micro-ECoG grids to record intra-operatively in humans and during acute implantations in mouse with separation distance between neighboring electrodes (i.e., pitch) of 0.4 mm and 0.2/0.25 mm respectively. To assess the spatial properties of the signals, we used the average correlation between electrodes as a function of the pitch. In agreement with prior studies, we find a strong frequency dependence in the spatial scale of correlation. By applying independent component analysis (ICA), we find that the spatial pattern of correlation is largely due to contributions from multiple spatially extended, time-locked sources present at any given time. Our analysis indicates the presence of spatially structured activity down to the sub-millimeter spatial scale in ECoG despite the effects of volume conduction, justifying the use of dense micro-ECoG grids. Electrocorticography (ECoG) is a type of electrophysiological monitoring that uses electrodes placed directly on the exposed surface of the brain. ECoG is a promising technique for studying the brain, and EcoG signals can be used to control brain-computer interfaces. Advances have made it possible to record simultaneously with an increasing number of smaller, and more closely spaced electrodes. However, a property of electrical recording from outside the brain is that common signals appear on different electrodes at different locations, and this affects decisions about how to best distribute a limited number of electrodes to maximize the information that can be gathered. Large spacing of electrodes around one centimeter apart on the brain’s surface has proven useful for clinical and research use, but how much benefit there is to recording from more locations in a smaller area remains to be answered. We found that we can explain the commonality between the different locations as the combination of different patterns of brain activity that are present at multiple electrode locations, and that signals recorded from very closely spaced electrodes, around a millimeter or less apart, are able to identify patterns that are at this small scale.
Collapse
|
27
|
Towards reconstructing intelligible speech from the human auditory cortex. Sci Rep 2019; 9:874. [PMID: 30696881 PMCID: PMC6351601 DOI: 10.1038/s41598-018-37359-z] [Citation(s) in RCA: 86] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2018] [Accepted: 11/30/2018] [Indexed: 11/08/2022] Open
Abstract
Auditory stimulus reconstruction is a technique that finds the best approximation of the acoustic stimulus from the population of evoked neural activity. Reconstructing speech from the human auditory cortex creates the possibility of a speech neuroprosthetic to establish a direct communication with the brain and has been shown to be possible in both overt and covert conditions. However, the low quality of the reconstructed speech has severely limited the utility of this method for brain-computer interface (BCI) applications. To advance the state-of-the-art in speech neuroprosthesis, we combined the recent advances in deep learning with the latest innovations in speech synthesis technologies to reconstruct closed-set intelligible speech from the human auditory cortex. We investigated the dependence of reconstruction accuracy on linear and nonlinear (deep neural network) regression methods and the acoustic representation that is used as the target of reconstruction, including auditory spectrogram and speech synthesis parameters. In addition, we compared the reconstruction accuracy from low and high neural frequency ranges. Our results show that a deep neural network model that directly estimates the parameters of a speech synthesizer from all neural frequencies achieves the highest subjective and objective scores on a digit recognition task, improving the intelligibility by 65% over the baseline method which used linear regression to reconstruct the auditory spectrogram. These results demonstrate the efficacy of deep learning and speech synthesis algorithms for designing the next generation of speech BCI systems, which not only can restore communications for paralyzed patients but also have the potential to transform human-computer interaction technologies.
Collapse
|
28
|
Rabbani Q, Milsap G, Crone NE. The Potential for a Speech Brain-Computer Interface Using Chronic Electrocorticography. Neurotherapeutics 2019; 16:144-165. [PMID: 30617653 PMCID: PMC6361062 DOI: 10.1007/s13311-018-00692-2] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
A brain-computer interface (BCI) is a technology that uses neural features to restore or augment the capabilities of its user. A BCI for speech would enable communication in real time via neural correlates of attempted or imagined speech. Such a technology would potentially restore communication and improve quality of life for locked-in patients and other patients with severe communication disorders. There have been many recent developments in neural decoders, neural feature extraction, and brain recording modalities facilitating BCI for the control of prosthetics and in automatic speech recognition (ASR). Indeed, ASR and related fields have developed significantly over the past years, and many lend many insights into the requirements, goals, and strategies for speech BCI. Neural speech decoding is a comparatively new field but has shown much promise with recent studies demonstrating semantic, auditory, and articulatory decoding using electrocorticography (ECoG) and other neural recording modalities. Because the neural representations for speech and language are widely distributed over cortical regions spanning the frontal, parietal, and temporal lobes, the mesoscopic scale of population activity captured by ECoG surface electrode arrays may have distinct advantages for speech BCI, in contrast to the advantages of microelectrode arrays for upper-limb BCI. Nevertheless, there remain many challenges for the translation of speech BCIs to clinical populations. This review discusses and outlines the current state-of-the-art for speech BCI and explores what a speech BCI using chronic ECoG might entail.
Collapse
Affiliation(s)
- Qinwan Rabbani
- Department of Electrical Engineering, The Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA.
| | - Griffin Milsap
- Department of Biomedical Engineering, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Nathan E Crone
- Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
29
|
Woods V, Trumpis M, Bent B, Palopoli-Trojani K, Chiang CH, Wang C, Yu C, Insanally MN, Froemke RC, Viventi J. Long-term recording reliability of liquid crystal polymer µECoG arrays. J Neural Eng 2018; 15:066024. [PMID: 30246690 PMCID: PMC6342453 DOI: 10.1088/1741-2552/aae39d] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE The clinical use of microsignals recorded over broad cortical regions is largely limited by the chronic reliability of the implanted interfaces. APPROACH We evaluated the chronic reliability of novel 61-channel micro-electrocorticographic (µECoG) arrays in rats chronically implanted for over one year and using accelerated aging. Devices were encapsulated with polyimide (PI) or liquid crystal polymer (LCP), and fabricated using commercial manufacturing processes. In vitro failure modes and predicted lifetimes were determined from accelerated soak testing. Successful designs were implanted epidurally over the rodent auditory cortex. Trends in baseline signal level, evoked responses and decoding performance were reported for over one year of implantation. MAIN RESULTS Devices fabricated with LCP consistently had longer in vitro lifetimes than PI encapsulation. Our accelerated aging results predicted device integrity beyond 3.4 years. Five implanted arrays showed stable performance over the entire implantation period (247-435 d). Our regression analysis showed that impedance predicted signal quality and information content only in the first 31 d of recordings and had little predictive value in the chronic phase (>31 d). In the chronic phase, site impedances slightly decreased yet decoding performance became statistically uncorrelated with impedance. We also employed an improved statistical model of spatial variation to measure sensitivity to locally varying fields, which is typically concealed in standard signal power calculations. SIGNIFICANCE These findings show that µECoG arrays can reliably perform in chronic applications in vivo for over one year, which facilitates the development of a high-density, clinically viable interface.
Collapse
Affiliation(s)
- Virginia Woods
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | | | | | | | | | | | | | | | | | | |
Collapse
|
30
|
John SE, Opie NL, Wong YT, Rind GS, Ronayne SM, Gerboni G, Bauquier SH, O'Brien TJ, May CN, Grayden DB, Oxley TJ. Signal quality of simultaneously recorded endovascular, subdural and epidural signals are comparable. Sci Rep 2018; 8:8427. [PMID: 29849104 PMCID: PMC5976775 DOI: 10.1038/s41598-018-26457-7] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2017] [Accepted: 05/10/2018] [Indexed: 02/07/2023] Open
Abstract
Recent work has demonstrated the feasibility of minimally-invasive implantation of electrodes into a cortical blood vessel. However, the effect of the dura and blood vessel on recording signal quality is not understood and may be a critical factor impacting implementation of a closed-loop endovascular neuromodulation system. The present work compares the performance and recording signal quality of a minimally-invasive endovascular neural interface with conventional subdural and epidural interfaces. We compared bandwidth, signal-to-noise ratio, and spatial resolution of recorded cortical signals using subdural, epidural and endovascular arrays four weeks after implantation in sheep. We show that the quality of the signals (bandwidth and signal-to-noise ratio) of the endovascular neural interface is not significantly different from conventional neural sensors. However, the spatial resolution depends on the array location and the frequency of recording. We also show that there is a direct correlation between the signal-noise-ratio and classification accuracy, and that decoding accuracy is comparable between electrode arrays. These results support the consideration for use of an endovascular neural interface in a clinical trial of a novel closed-loop neuromodulation technology.
Collapse
Affiliation(s)
- Sam E John
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Australia. .,Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia. .,Florey Institute of Neuroscience and Mental Health, Parkville, Australia. .,SmartStent Pty Ltd, Parkville, Australia.
| | - Nicholas L Opie
- Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia.,Florey Institute of Neuroscience and Mental Health, Parkville, Australia.,SmartStent Pty Ltd, Parkville, Australia
| | - Yan T Wong
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Australia.,Department of Physiology and Department of Electrical and Computer Systems Engineering, Monash University, Clayton, Australia
| | - Gil S Rind
- Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia.,Florey Institute of Neuroscience and Mental Health, Parkville, Australia.,SmartStent Pty Ltd, Parkville, Australia
| | - Stephen M Ronayne
- Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia.,Florey Institute of Neuroscience and Mental Health, Parkville, Australia.,SmartStent Pty Ltd, Parkville, Australia
| | - Giulia Gerboni
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Australia.,Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia.,Florey Institute of Neuroscience and Mental Health, Parkville, Australia
| | - Sebastien H Bauquier
- Department of Veterinary Science, The University of Melbourne, Werribee, Australia
| | - Terence J O'Brien
- Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia.,Florey Institute of Neuroscience and Mental Health, Parkville, Australia
| | - Clive N May
- Florey Institute of Neuroscience and Mental Health, Parkville, Australia
| | - David B Grayden
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Australia.,Centre for Neural Engineering, The University of Melbourne, Carlton, Australia
| | - Thomas J Oxley
- Vascular Bionics Laboratory, Department of Medicine, Royal Melbourne Hospital, (RMH), The University of Melbourne, Parkville, Australia.,Florey Institute of Neuroscience and Mental Health, Parkville, Australia.,SmartStent Pty Ltd, Parkville, Australia
| |
Collapse
|
31
|
|
32
|
Hermiz J, Rogers N, Kaestner E, Ganji M, Cleary DR, Carter BS, Barba D, Dayeh SA, Halgren E, Gilja V. Sub-millimeter ECoG pitch in human enables higher fidelity cognitive neural state estimation. Neuroimage 2018; 176:454-464. [PMID: 29678760 DOI: 10.1016/j.neuroimage.2018.04.027] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2017] [Revised: 03/09/2018] [Accepted: 04/11/2018] [Indexed: 10/17/2022] Open
Abstract
Electrocorticography (ECoG), electrophysiological recording from the pial surface of the brain, is a critical measurement technique for clinical neurophysiology, basic neurophysiology studies, and demonstrates great promise for the development of neural prosthetic devices for assistive applications and the treatment of neurological disorders. Recent advances in device engineering are poised to enable orders of magnitude increase in the resolution of ECoG without comprised measurement quality. This enhancement in cortical sensing enables the observation of neural dynamics from the cortical surface at the micrometer scale. While these technical capabilities may be enabling, the extent to which finer spatial scale recording enhances functionally relevant neural state inference is unclear. We examine this question by employing a high-density and low impedance 400 μm pitch microECoG (μECoG) grid to record neural activity from the human cortical surface during cognitive tasks. By applying machine learning techniques to classify task conditions from the envelope of high-frequency band (70-170Hz) neural activity collected from two study participants, we demonstrate that higher density grids can lead to more accurate binary task condition classification. When controlling for grid area and selecting task informative sub-regions of the complete grid, we observed a consistent increase in mean classification accuracy with higher grid density; in particular, 400 μm pitch grids outperforming spatially sub-sampled lower density grids up to 23%. We also introduce a modeling framework to provide intuition for how spatial properties of measurements affect the performance gap between high and low density grids. To our knowledge, this work is the first quantitative demonstration of human sub-millimeter pitch cortical surface recording yielding higher-fidelity state estimation relative to devices at the millimeter-scale, motivating the development and testing of μECoG for basic and clinical neurophysiology as well as towards the realization of high-performance neural prostheses.
Collapse
Affiliation(s)
- John Hermiz
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093, USA
| | - Nicholas Rogers
- Department of Physics, University of California San Diego, La Jolla, CA, 92161, USA
| | - Erik Kaestner
- Neurosciences Program, University of California San Diego, La Jolla, CA, 92096, USA
| | - Mehran Ganji
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093, USA
| | - Daniel R Cleary
- Department of Neurosurgery, University of California San Diego, La Jolla, CA, 92103, USA
| | - Bob S Carter
- Department of Neurosurgery, University of California San Diego, La Jolla, CA, 92103, USA
| | - David Barba
- Department of Neurosurgery, University of California San Diego, La Jolla, CA, 92103, USA
| | - Shadi A Dayeh
- Department of Nanoengineering, University of California San Diego, La Jolla, CA, 92093, USA; Department of Materials Science and Engineering, University of California San Diego, La Jolla, CA, 92093, USA
| | - Eric Halgren
- Department of Radiology, University of California San Diego, La Jolla, CA, 92103, USA; Department of Neurosciences, University of California San Diego, La Jolla, CA, 92103, USA
| | - Vikash Gilja
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093, USA.
| |
Collapse
|
33
|
Muller L, Chavane F, Reynolds J, Sejnowski TJ. Cortical travelling waves: mechanisms and computational principles. Nat Rev Neurosci 2018; 19:255-268. [PMID: 29563572 DOI: 10.1038/nrn.2018.20] [Citation(s) in RCA: 236] [Impact Index Per Article: 39.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Multichannel recording technologies have revealed travelling waves of neural activity in multiple sensory, motor and cognitive systems. These waves can be spontaneously generated by recurrent circuits or evoked by external stimuli. They travel along brain networks at multiple scales, transiently modulating spiking and excitability as they pass. Here, we review recent experimental findings that have found evidence for travelling waves at single-area (mesoscopic) and whole-brain (macroscopic) scales. We place these findings in the context of the current theoretical understanding of wave generation and propagation in recurrent networks. During the large low-frequency rhythms of sleep or the relatively desynchronized state of the awake cortex, travelling waves may serve a variety of functions, from long-term memory consolidation to processing of dynamic visual stimuli. We explore new avenues for experimental and computational understanding of the role of spatiotemporal activity patterns in the cortex.
Collapse
Affiliation(s)
- Lyle Muller
- Salk Institute for Biological Studies, La Jolla, CA, USA
| | - Frédéric Chavane
- Institut de Neurosciences de la Timone (INT), Centre National de la Recherche Scientifique (CNRS) and Aix-Marseille Université, Marseille, France
| | - John Reynolds
- Salk Institute for Biological Studies, La Jolla, CA, USA
| | - Terrence J Sejnowski
- Salk Institute for Biological Studies, La Jolla, CA, USA.,Division of Biological Sciences, University of California, La Jolla, CA, USA
| |
Collapse
|
34
|
Thukral A, Ershad F, Enan N, Rao Z, Yu C. Soft Ultrathin Silicon Electronics for Soft Neural Interfaces: A Review of Recent Advances of Soft Neural Interfaces Based on Ultrathin Silicon. IEEE NANOTECHNOLOGY MAGAZINE 2018. [DOI: 10.1109/mnano.2017.2781290] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Anish Thukral
- Mechanical Engineering, University of Houston, Houston, Texas United States
| | - Faheem Ershad
- Biomedical Engineering, University of Houston, Houston, Texas United States
| | - Nada Enan
- Biomedical Engineering, University of Houston, Houston, Texas United States
| | - Zhoulyu Rao
- Materials Science and Engineering, University of Houston, Houston, Texas United States
| | - Cunjiang Yu
- Mechanical Engineering, University of Houston, Houston, Texas United States
| |
Collapse
|
35
|
Human Sensorimotor Cortex Control of Directly Measured Vocal Tract Movements during Vowel Production. J Neurosci 2018; 38:2955-2966. [PMID: 29439164 DOI: 10.1523/jneurosci.2382-17.2018] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2017] [Revised: 01/27/2018] [Accepted: 01/29/2018] [Indexed: 11/21/2022] Open
Abstract
During speech production, we make vocal tract movements with remarkable precision and speed. Our understanding of how the human brain achieves such proficient control is limited, in part due to the challenge of simultaneously acquiring high-resolution neural recordings and detailed vocal tract measurements. To overcome this challenge, we combined ultrasound and video monitoring of the supralaryngeal articulators (lips, jaw, and tongue) with electrocorticographic recordings from the cortical surface of 4 subjects (3 female, 1 male) to investigate how neural activity in the ventral sensory-motor cortex (vSMC) relates to measured articulator movement kinematics (position, speed, velocity, acceleration) during the production of English vowels. We found that high-gamma activity at many individual vSMC electrodes strongly encoded the kinematics of one or more articulators, but less so for vowel formants and vowel identity. Neural population decoding methods further revealed the structure of kinematic features that distinguish vowels. Encoding of articulator kinematics was sparsely distributed across time and primarily occurred during the time of vowel onset and offset. In contrast, encoding was low during the steady-state portion of the vowel, despite sustained neural activity at some electrodes. Significant representations were found for all kinematic parameters, but speed was the most robust. These findings enabled by direct vocal tract monitoring demonstrate novel insights into the representation of articulatory kinematic parameters encoded in the vSMC during speech production.SIGNIFICANCE STATEMENT Speaking requires precise control and coordination of the vocal tract articulators (lips, jaw, and tongue). Despite the impressive proficiency with which humans move these articulators during speech production, our understanding of how the brain achieves such control is rudimentary, in part because the movements themselves are difficult to observe. By simultaneously measuring speech movements and the neural activity that gives rise to them, we demonstrate how neural activity in sensorimotor cortex produces complex, coordinated movements of the vocal tract.
Collapse
|
36
|
Hamilton LS, Chang DL, Lee MB, Chang EF. Semi-automated Anatomical Labeling and Inter-subject Warping of High-Density Intracranial Recording Electrodes in Electrocorticography. Front Neuroinform 2017; 11:62. [PMID: 29163118 PMCID: PMC5671481 DOI: 10.3389/fninf.2017.00062] [Citation(s) in RCA: 62] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2017] [Accepted: 10/05/2017] [Indexed: 11/13/2022] Open
Abstract
In this article, we introduce img_pipe, our open source python package for preprocessing of imaging data for use in intracranial electrocorticography (ECoG) and intracranial stereo-EEG analyses. The process of electrode localization, labeling, and warping for use in ECoG currently varies widely across laboratories, and it is usually performed with custom, lab-specific code. This python package aims to provide a standardized interface for these procedures, as well as code to plot and display results on 3D cortical surface meshes. It gives the user an easy interface to create anatomically labeled electrodes that can also be warped to an atlas brain, starting with only a preoperative T1 MRI scan and a postoperative CT scan. We describe the full capabilities of our imaging pipeline and present a step-by-step protocol for users.
Collapse
Affiliation(s)
- Liberty S Hamilton
- Department of Neurosurgery, University of California, San Francisco, San Francisco, CA, United States.,Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - David L Chang
- Department of Neurosurgery, University of California, San Francisco, San Francisco, CA, United States.,Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - Morgan B Lee
- Department of Neurosurgery, University of California, San Francisco, San Francisco, CA, United States.,Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - Edward F Chang
- Department of Neurosurgery, University of California, San Francisco, San Francisco, CA, United States.,Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| |
Collapse
|
37
|
Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids. Neuroimage 2017; 180:301-311. [PMID: 28993231 DOI: 10.1016/j.neuroimage.2017.10.011] [Citation(s) in RCA: 58] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2017] [Revised: 10/04/2017] [Accepted: 10/06/2017] [Indexed: 12/19/2022] Open
Abstract
For people who cannot communicate due to severe paralysis or involuntary movements, technology that decodes intended speech from the brain may offer an alternative means of communication. If decoding proves to be feasible, intracranial Brain-Computer Interface systems can be developed which are designed to translate decoded speech into computer generated speech or to instructions for controlling assistive devices. Recent advances suggest that such decoding may be feasible from sensorimotor cortex, but it is not clear how this challenge can be approached best. One approach is to identify and discriminate elements of spoken language, such as phonemes. We investigated feasibility of decoding four spoken phonemes from the sensorimotor face area, using electrocorticographic signals obtained with high-density electrode grids. Several decoding algorithms including spatiotemporal matched filters, spatial matched filters and support vector machines were compared. Phonemes could be classified correctly at a level of over 75% with spatiotemporal matched filters. Support Vector machine analysis reached a similar level, but spatial matched filters yielded significantly lower scores. The most informative electrodes were clustered along the central sulcus. Highest scores were achieved from time windows centered around voice onset time, but a 500 ms window before onset time could also be classified significantly. The results suggest that phoneme production involves a sequence of robust and reproducible activity patterns on the cortical surface. Importantly, decoding requires inclusion of temporal information to capture the rapid shifts of robust patterns associated with articulator muscle group contraction during production of a phoneme. The high classification scores are likely to be enabled by the use of high density grids, and by the use of discrete phonemes. Implications for use in Brain-Computer Interfaces are discussed.
Collapse
|
38
|
Kaiju T, Doi K, Yokota M, Watanabe K, Inoue M, Ando H, Takahashi K, Yoshida F, Hirata M, Suzuki T. High Spatiotemporal Resolution ECoG Recording of Somatosensory Evoked Potentials with Flexible Micro-Electrode Arrays. Front Neural Circuits 2017; 11:20. [PMID: 28442997 PMCID: PMC5386975 DOI: 10.3389/fncir.2017.00020] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2016] [Accepted: 03/10/2017] [Indexed: 11/13/2022] Open
Abstract
Electrocorticogram (ECoG) has great potential as a source signal, especially for clinical BMI. Until recently, ECoG electrodes were commonly used for identifying epileptogenic foci in clinical situations, and such electrodes were low-density and large. Increasing the number and density of recording channels could enable the collection of richer motor/sensory information, and may enhance the precision of decoding and increase opportunities for controlling external devices. Several reports have aimed to increase the number and density of channels. However, few studies have discussed the actual validity of high-density ECoG arrays. In this study, we developed novel high-density flexible ECoG arrays and conducted decoding analyses with monkey somatosensory evoked potentials (SEPs). Using MEMS technology, we made 96-channel Parylene electrode arrays with an inter-electrode distance of 700 μm and recording site area of 350 μm2. The arrays were mainly placed onto the finger representation area in the somatosensory cortex of the macaque, and partially inserted into the central sulcus. With electrical finger stimulation, we successfully recorded and visualized finger SEPs with a high spatiotemporal resolution. We conducted offline analyses in which the stimulated fingers and intensity were predicted from recorded SEPs using a support vector machine. We obtained the following results: (1) Very high accuracy (~98%) was achieved with just a short segment of data (~15 ms from stimulus onset). (2) High accuracy (~96%) was achieved even when only a single channel was used. This result indicated placement optimality for decoding. (3) Higher channel counts generally improved prediction accuracy, but the efficacy was small for predictions with feature vectors that included time-series information. These results suggest that ECoG signals with high spatiotemporal resolution could enable greater decoding precision or external device control.
Collapse
Affiliation(s)
- Taro Kaiju
- Graduate School of Frontier Biosciences, Osaka UniversityOsaka, Japan.,Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| | - Keiichi Doi
- Graduate School of Frontier Biosciences, Osaka UniversityOsaka, Japan.,Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| | - Masashi Yokota
- Graduate School of Frontier Biosciences, Osaka UniversityOsaka, Japan.,Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| | - Kei Watanabe
- Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| | - Masato Inoue
- Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| | - Hiroshi Ando
- Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| | - Kazutaka Takahashi
- Department of Organismal Biology and Anatomy, University of ChicagoChicago, IL, USA
| | - Fumiaki Yoshida
- Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan.,Endowed Research Department of Clinical Neuroengineering, Global Center for Medical Engineering and Informatics, Osaka UniversityOsaka, Japan
| | - Masayuki Hirata
- Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan.,Endowed Research Department of Clinical Neuroengineering, Global Center for Medical Engineering and Informatics, Osaka UniversityOsaka, Japan
| | - Takafumi Suzuki
- Center for Information and Neural Networks, National Institute of Information and Communications Technology and Osaka UniversityOsaka, Japan
| |
Collapse
|