1
|
Miller KJ. A library of human electrocorticographic data and analyses. Nat Hum Behav 2019; 3:1225-1235. [PMID: 31451738 DOI: 10.1038/s41562-019-0678-3] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2018] [Accepted: 07/05/2019] [Indexed: 11/09/2022]
Abstract
Electrophysiological data from implanted electrodes in the human brain are rare, and therefore scientific access to such data has remained somewhat exclusive. Here we present a freely available curated library of implanted electrocorticographic data and analyses for 16 behavioural experiments, with 204 individual datasets from 34 patients recorded with the same amplifiers and at the same settings. For each dataset, electrode positions were carefully registered to brain anatomy. A large set of fully annotated analysis scripts with which to interpret these data is embedded in the library alongside them. All data, anatomical locations and analysis files (MATLAB code) are provided in a shared file structure at https://searchworks.stanford.edu/view/zk881ps0522.
Collapse
Affiliation(s)
- Kai J Miller
- Department of Neurosurgery, Stanford University, Stanford, CA, USA. .,Department of Neurologic Surgery, Mayo Clinic, Rochester, MN, USA.
| |
Collapse
|
2
|
Miller KJ, Schalk G, Hermes D, Ojemann JG, Rao RPN. Spontaneous Decoding of the Timing and Content of Human Object Perception from Cortical Surface Recordings Reveals Complementary Information in the Event-Related Potential and Broadband Spectral Change. PLoS Comput Biol 2016; 12:e1004660. [PMID: 26820899 PMCID: PMC4731148 DOI: 10.1371/journal.pcbi.1004660] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2015] [Accepted: 11/17/2015] [Indexed: 11/19/2022] Open
Abstract
The link between object perception and neural activity in visual cortical areas is a problem of fundamental importance in neuroscience. Here we show that electrical potentials from the ventral temporal cortical surface in humans contain sufficient information for spontaneous and near-instantaneous identification of a subject's perceptual state. Electrocorticographic (ECoG) arrays were placed on the subtemporal cortical surface of seven epilepsy patients. Grayscale images of faces and houses were displayed rapidly in random sequence. We developed a template projection approach to decode the continuous ECoG data stream spontaneously, predicting the occurrence, timing and type of visual stimulus. In this setting, we evaluated the independent and joint use of two well-studied features of brain signals, broadband changes in the frequency power spectrum of the potential and deflections in the raw potential trace (event-related potential; ERP). Our ability to predict both the timing of stimulus onset and the type of image was best when we used a combination of both the broadband response and ERP, suggesting that they capture different and complementary aspects of the subject's perceptual state. Specifically, we were able to predict the timing and type of 96% of all stimuli, with less than 5% false positive rate and a ~20ms error in timing.
Collapse
Affiliation(s)
- Kai J. Miller
- Departments of Neurosurgery, Stanford University, Stanford, California, United States of America
- NASA—Johnson Space Center, Houston, Texas, United States of America
- Program in Neurobiology and Behavior, University of Washington, Seattle, Washington, United States of America
| | - Gerwin Schalk
- National Center for Adaptive Neurotechnologies, Wadsworth Center, New York State Department of Health, Albany, New York, United States of America
| | - Dora Hermes
- Psychology, Stanford University, Stanford, California, United States of America
| | - Jeffrey G. Ojemann
- Program in Neurobiology and Behavior, University of Washington, Seattle, Washington, United States of America
- Department of Neurological Surgery, University of Washington, Seattle, Washington, United States of America
- Center for Sensorimotor Neural Engineering, University of Washington, Seattle, Washington, United States of America
| | - Rajesh P. N. Rao
- Program in Neurobiology and Behavior, University of Washington, Seattle, Washington, United States of America
- Center for Sensorimotor Neural Engineering, University of Washington, Seattle, Washington, United States of America
- Computer Science and Engineering, University of Washington, Seattle, Washington, United States of America
| |
Collapse
|
3
|
Kubanek J, Schalk G. NeuralAct: A Tool to Visualize Electrocortical (ECoG) Activity on a Three-Dimensional Model of the Cortex. Neuroinformatics 2015; 13:167-74. [PMID: 25381641 PMCID: PMC5580037 DOI: 10.1007/s12021-014-9252-3] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Electrocorticography (ECoG) records neural signals directly from the surface of the cortex. Due to its high temporal and favorable spatial resolution, ECoG has emerged as a valuable new tool in acquiring cortical activity in cognitive and systems neuroscience. Many studies using ECoG visualized topographies of cortical activity or statistical tests on a three-dimensional model of the cortex, but a dedicated tool for this function has not yet been described. In this paper, we describe the NeuralAct package that serves this purpose. This package takes as input the 3D coordinates of the recording sensors, a cortical model in the same coordinate system (e.g., Talairach), and the activation data to be visualized at each sensor. It then aligns the sensor coordinates with the cortical model, convolves the activation data with a spatial kernel, and renders the resulting activations in color on the cortical model. The NeuralAct package can plot cortical activations of an individual subject as well as activations averaged over subjects. It is capable to render single images as well as sequences of images. The software runs under Matlab and is stable and robust. We here provide the tool and describe its visualization capabilities and procedures. The provided package contains thoroughly documented code and includes a simple demo that guides the researcher through the functionality of the tool.
Collapse
Affiliation(s)
- Jan Kubanek
- Department of Anatomy & Neurobiology, Washington University in St. Louis, St. Louis, MO, 63130, USA,
| | | |
Collapse
|
4
|
Mugler EM, Patton JL, Flint RD, Wright ZA, Schuele SU, Rosenow J, Shih JJ, Krusienski DJ, Slutzky MW. Direct classification of all American English phonemes using signals from functional speech motor cortex. J Neural Eng 2014; 11:035015. [PMID: 24836588 PMCID: PMC4097188 DOI: 10.1088/1741-2560/11/3/035015] [Citation(s) in RCA: 114] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Although brain-computer interfaces (BCIs) can be used in several different ways to restore communication, communicative BCI has not approached the rate or efficiency of natural human speech. Electrocorticography (ECoG) has precise spatiotemporal resolution that enables recording of brain activity distributed over a wide area of cortex, such as during speech production. In this study, we sought to decode elements of speech production using ECoG. APPROACH We investigated words that contain the entire set of phonemes in the general American accent using ECoG with four subjects. Using a linear classifier, we evaluated the degree to which individual phonemes within each word could be correctly identified from cortical signal. MAIN RESULTS We classified phonemes with up to 36% accuracy when classifying all phonemes and up to 63% accuracy for a single phoneme. Further, misclassified phonemes follow articulation organization described in phonology literature, aiding classification of whole words. Precise temporal alignment to phoneme onset was crucial for classification success. SIGNIFICANCE We identified specific spatiotemporal features that aid classification, which could guide future applications. Word identification was equivalent to information transfer rates as high as 3.0 bits s(-1) (33.6 words min(-1)), supporting pursuit of speech articulation for BCI control.
Collapse
Affiliation(s)
- Emily M Mugler
- Bioengineering, University of Illinois at Chicago, 851 S. Morgan Street, Chicago, IL 60607, USA
| | | | | | | | | | | | | | | | | |
Collapse
|
5
|
Yang AI, Wang X, Doyle WK, Halgren E, Carlson C, Belcher TL, Cash SS, Devinsky O, Thesen T. Localization of dense intracranial electrode arrays using magnetic resonance imaging. Neuroimage 2012; 63:157-165. [PMID: 22759995 PMCID: PMC4408869 DOI: 10.1016/j.neuroimage.2012.06.039] [Citation(s) in RCA: 92] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2012] [Revised: 06/17/2012] [Accepted: 06/20/2012] [Indexed: 10/28/2022] Open
Abstract
Intracranial electrode arrays are routinely used in the pre-surgical evaluation of patients with medically refractory epilepsy, and recordings from these electrodes have been increasingly employed in human cognitive neurophysiology due to their high spatial and temporal resolution. For both researchers and clinicians, it is critical to localize electrode positions relative to the subject-specific neuroanatomy. In many centers, a post-implantation MRI is utilized for electrode detection because of its higher sensitivity for surgical complications and the absence of radiation. However, magnetic susceptibility artifacts surrounding each electrode prohibit unambiguous detection of individual electrodes, especially those that are embedded within dense grid arrays. Here, we present an efficient method to accurately localize intracranial electrode arrays based on pre- and post-implantation MR images that incorporates array geometry and the individual's cortical surface. Electrodes are directly visualized relative to the underlying gyral anatomy of the reconstructed cortical surface of individual patients. Validation of this approach shows high spatial accuracy of the localized electrode positions (mean of 0.96 mm ± 0.81 mm for 271 electrodes across 8 patients). Minimal user input, short processing time, and utilization of radiation-free imaging are strong incentives to incorporate quantitatively accurate localization of intracranial electrode arrays with MRI for research and clinical purposes. Co-registration to a standard brain atlas further allows inter-subject comparisons and relation of intracranial EEG findings to the larger body of neuroimaging literature.
Collapse
Affiliation(s)
- Andrew I. Yang
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
| | - Xiuyuan Wang
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
| | - Werner K. Doyle
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
- Department of Neurosurgery, New York University School of Medicine, New York, NY 10016, USA
| | - Eric Halgren
- Department of Radiology, University of California at San Diego, San Diego, CA 92093, USA
- Department of Neurosciences, University of California at San Diego, San Diego, CA 92093, USA
- Department of Psychiatry, University of California at San Diego, San Diego, CA 92093, USA
| | - Chad Carlson
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
| | - Thomas L. Belcher
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
| | - Sydney S. Cash
- Department of Neurology, Epilepsy Division, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02114, USA
| | - Orrin Devinsky
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
- Department of Neurosurgery, New York University School of Medicine, New York, NY 10016, USA
| | - Thomas Thesen
- Comprehensive Epilepsy Center, New York University School of Medicine, New York, NY 10016, USA
- Department of Radiology, University of California at San Diego, San Diego, CA 92093, USA
- Department of Neurosciences, University of California at San Diego, San Diego, CA 92093, USA
- Department of Psychiatry, University of California at San Diego, San Diego, CA 92093, USA
| |
Collapse
|
6
|
Miller KJ, Hermes D, Honey CJ, Hebb AO, Ramsey NF, Knight RT, Ojemann JG, Fetz EE. Human motor cortical activity is selectively phase-entrained on underlying rhythms. PLoS Comput Biol 2012; 8:e1002655. [PMID: 22969416 PMCID: PMC3435268 DOI: 10.1371/journal.pcbi.1002655] [Citation(s) in RCA: 159] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2012] [Accepted: 07/05/2012] [Indexed: 11/18/2022] Open
Abstract
The functional significance of electrical rhythms in the mammalian brain remains uncertain. In the motor cortex, the 12-20 Hz beta rhythm is known to transiently decrease in amplitude during movement, and to be altered in many motor diseases. Here we show that the activity of neuronal populations is phase-coupled with the beta rhythm on rapid timescales, and describe how the strength of this relation changes with movement. To investigate the relationship of the beta rhythm to neuronal dynamics, we measured local cortical activity using arrays of subdural electrocorticographic (ECoG) electrodes in human patients performing simple movement tasks. In addition to rhythmic brain processes, ECoG potentials also reveal a spectrally broadband motif that reflects the aggregate neural population activity beneath each electrode. During movement, the amplitude of this broadband motif follows the dynamics of individual fingers, with somatotopically specific responses for different fingers at different sites on the pre-central gyrus. The 12-20 Hz beta rhythm, in contrast, is widespread as well as spatially coherent within sulcal boundaries and decreases in amplitude across the pre- and post-central gyri in a diffuse manner that is not finger-specific. We find that the amplitude of this broadband motif is entrained on the phase of the beta rhythm, as well as rhythms at other frequencies, in peri-central cortex during fixation. During finger movement, the beta phase-entrainment is diminished or eliminated. We suggest that the beta rhythm may be more than a resting rhythm, and that this entrainment may reflect a suppressive mechanism for actively gating motor function.
Collapse
Affiliation(s)
- Kai J. Miller
- Department of Neurosurgery, Stanford University, Stanford, California, United States of America
- Program in Neurobiology and Behavior, University of Washington, Seattle, Washington, United States of America
- Department of Physics, University of Washington, Seattle, Washington, United States of America
- * E-mail: (KJM); (EEF)
| | - Dora Hermes
- Department of Neurology and Neurological Sciences, Stanford University, Stanford, California, United States of America
- Section Brain Function and Plasticity, Department of Neurology and Neurosurgery, Rudolf Magnus Institute of Neuroscience, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Christopher J. Honey
- Department of Psychology and Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, United States of America
| | - Adam O. Hebb
- Department of Neurological Surgery, University of Washington, Seattle, Washington, United States of America
| | - Nick F. Ramsey
- Section Brain Function and Plasticity, Department of Neurology and Neurosurgery, Rudolf Magnus Institute of Neuroscience, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Robert T. Knight
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America
| | - Jeffrey G. Ojemann
- Department of Neurological Surgery, University of Washington, Seattle, Washington, United States of America
| | - Eberhard E. Fetz
- Program in Neurobiology and Behavior, University of Washington, Seattle, Washington, United States of America
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington, United States of America
- * E-mail: (KJM); (EEF)
| |
Collapse
|
7
|
Abstract
OBJECT Emerging research in evoked broadband electrocorticographic (ECoG) measurement from the cortical surface suggests that it might cleanly delineate the functional organization of cortex. The authors sought to demonstrate whether this could be done in a same-session, online manner to identify receptive and expressive language areas. METHODS The authors assessed the efficacy of simple integration of "χ-band" (76-200 Hz) change in the ECoG signal by implementing a simple band-pass filter to estimate broadband spectral change. Following a brief (less than 10-second) period to characterize baseline activity, χ-band activity was integrated while 7 epileptic patients with implanted ECoG electrodes performed a verb-generation task. RESULTS While the patients were performing verb-generation or noun-reading tasks, cortical activation was consistently identified in primary mouth motor area, superior temporal gyrus, and Broca and Wernicke association areas. Maps were robust after a mean time of 47 seconds (using an "activation overlap" measure). Correlation with electrocortical stimulation was not complete and was stronger for noun reading than verb generation. CONCLUSIONS Broadband ECoG changes can be captured online to identify eloquent cortex. This demonstrates the existence of a powerful new tool for functional mapping in the operative and chronic implant setting.
Collapse
|
8
|
Miller KJ, Hermes D, Honey CJ, Sharma M, Rao RPN, den Nijs M, Fetz EE, Sejnowski TJ, Hebb AO, Ojemann JG, Makeig S, Leuthardt EC. Dynamic modulation of local population activity by rhythm phase in human occipital cortex during a visual search task. Front Hum Neurosci 2010; 4:197. [PMID: 21119778 PMCID: PMC2990655 DOI: 10.3389/fnhum.2010.00197] [Citation(s) in RCA: 60] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2010] [Accepted: 09/29/2010] [Indexed: 12/22/2022] Open
Abstract
Brain rhythms are more than just passive phenomena in visual cortex. For the first time, we show that the physiology underlying brain rhythms actively suppresses and releases cortical areas on a second-to-second basis during visual processing. Furthermore, their influence is specific at the scale of individual gyri. We quantified the interaction between broadband spectral change and brain rhythms on a second-to-second basis in electrocorticographic (ECoG) measurement of brain surface potentials in five human subjects during a visual search task. Comparison of visual search epochs with a blank screen baseline revealed changes in the raw potential, the amplitude of rhythmic activity, and in the decoupled broadband spectral amplitude. We present new methods to characterize the intensity and preferred phase of coupling between broadband power and band-limited rhythms, and to estimate the magnitude of rhythm-to-broadband modulation on a trial-by-trial basis. These tools revealed numerous coupling motifs between the phase of low-frequency (δ, θ, α, β, and γ band) rhythms and the amplitude of broadband spectral change. In the θ and β ranges, the coupling of phase to broadband change is dynamic during visual processing, decreasing in some occipital areas and increasing in others, in a gyrally specific pattern. Finally, we demonstrate that the rhythms interact with one another across frequency ranges, and across cortical sites.
Collapse
Affiliation(s)
- Kai J Miller
- Neurobiology and Behavior, University of Washington Seattle, WA, USA
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|