1
|
Carvalho VR, Mendes EMAM, Fallah A, Sejnowski TJ, Comstock L, Lainscsek C. Decoding imagined speech with delay differential analysis. Front Hum Neurosci 2024; 18:1398065. [PMID: 38826617 PMCID: PMC11140152 DOI: 10.3389/fnhum.2024.1398065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Accepted: 04/25/2024] [Indexed: 06/04/2024] Open
Abstract
Speech decoding from non-invasive EEG signals can achieve relatively high accuracy (70-80%) for strictly delimited classification tasks, but for more complex tasks non-invasive speech decoding typically yields a 20-50% classification accuracy. However, decoder generalization, or how well algorithms perform objectively across datasets, is complicated by the small size and heterogeneity of existing EEG datasets. Furthermore, the limited availability of open access code hampers a comparison between methods. This study explores the application of a novel non-linear method for signal processing, delay differential analysis (DDA), to speech decoding. We provide a systematic evaluation of its performance on two public imagined speech decoding datasets relative to all publicly available deep learning methods. The results support DDA as a compelling alternative or complementary approach to deep learning methods for speech decoding. DDA is a fast and efficient time-domain open-source method that fits data using only few strong features and does not require extensive preprocessing.
Collapse
Affiliation(s)
- Vinícius Rezende Carvalho
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Postgraduate Program in Electrical Engineering, Universidade Federal de Minas Gerais, Belo Horizonte, MG, Brazil
| | | | - Aria Fallah
- Department of Neurosurgery, University of California, Los Angeles, Los Angeles, CA, United States
| | - Terrence J. Sejnowski
- Computational Neurobiology Laboratory, The Salk Institute for Biological Studies, La Jolla, CA, United States
- Institute for Neural Computation University of California, San Diego, La Jolla, CA, United States
- Department of Neurobiology, University of California, San Diego, La Jolla, CA, United States
| | - Lindy Comstock
- Department of Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, CA, United States
| | - Claudia Lainscsek
- Computational Neurobiology Laboratory, The Salk Institute for Biological Studies, La Jolla, CA, United States
- Institute for Neural Computation University of California, San Diego, La Jolla, CA, United States
| |
Collapse
|
2
|
Lainscsek C, Salami P, Carvalho VR, Mendes EMAM, Fan M, Cash SS, Sejnowski TJ. Network-motif delay differential analysis of brain activity during seizures. CHAOS (WOODBURY, N.Y.) 2023; 33:123136. [PMID: 38156987 PMCID: PMC10757649 DOI: 10.1063/5.0165904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Accepted: 11/28/2023] [Indexed: 01/03/2024]
Abstract
Delay Differential Analysis (DDA) is a nonlinear method for analyzing time series based on principles from nonlinear dynamical systems. DDA is extended here to incorporate network aspects to improve the dynamical characterization of complex systems. To demonstrate its effectiveness, DDA with network capabilities was first applied to the well-known Rössler system under different parameter regimes and noise conditions. Network-motif DDA, based on cortical regions, was then applied to invasive intracranial electroencephalographic data from drug-resistant epilepsy patients undergoing presurgical monitoring. The directional network motifs between brain areas that emerge from this analysis change dramatically before, during, and after seizures. Neural systems provide a rich source of complex data, arising from varying internal states generated by network interactions.
Collapse
Affiliation(s)
| | - Pariya Salami
- Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts 02114, USA
| | | | - Eduardo M. A. M. Mendes
- Laboratório de Modelagem, Análise e Controle de Sistemas Não Lineares, Universidade Federal de Minas Gerais, Av. Antônio Carlos 6627, 31270-901 Belo Horizonte, MG, Brazil
| | - Miaolin Fan
- Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts 02114, USA
| | - Sydney S. Cash
- Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts 02114, USA
| | | |
Collapse
|
3
|
Lainscsek X, Taher L. Predicting chromosomal compartments directly from the nucleotide sequence with DNA-DDA. Brief Bioinform 2023; 24:bbad198. [PMID: 37264486 PMCID: PMC10359093 DOI: 10.1093/bib/bbad198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 04/18/2023] [Accepted: 05/08/2023] [Indexed: 06/03/2023] Open
Abstract
Three-dimensional (3D) genome architecture is characterized by multi-scale patterns and plays an essential role in gene regulation. Chromatin conformation capturing experiments have revealed many properties underlying 3D genome architecture, such as the compartmentalization of chromatin based on transcriptional states. However, they are complex, costly and time consuming, and therefore only a limited number of cell types have been examined using these techniques. Increasing effort is being directed towards deriving computational methods that can predict chromatin conformation and associated structures. Here we present DNA-delay differential analysis (DDA), a purely sequence-based method based on chaos theory to predict genome-wide A and B compartments. We show that DNA-DDA models derived from a 20 Mb sequence are sufficient to predict genome wide compartmentalization at the scale of 100 kb in four different cell types. Although this is a proof-of-concept study, our method shows promise in elucidating the mechanisms responsible for genome folding as well as modeling the impact of genetic variation on 3D genome architecture and the processes regulated thereby.
Collapse
Affiliation(s)
- Xenia Lainscsek
- Institute of Biomedical Informatics, Graz University of Technology, Austria
| | - Leila Taher
- Institute of Biomedical Informatics, Graz University of Technology, Austria
| |
Collapse
|
4
|
Subritzky-Katz V, Sampson AL, Emeric E, Lipski W, Moreira-González S, González-Martínez J, Sarma S, Stuphorn V, Niebur E. Quantifying Phase-Amplitude Modulation in Neural Data. ... ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS. ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS 2023; 2023:10.1109/CISS56502.2023.10089691. [PMID: 38250522 PMCID: PMC10799684 DOI: 10.1109/ciss56502.2023.10089691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Abstract
Phase-amplitude modulation (the modulation of the amplitude of higher frequency oscillations by the phase of lower frequency oscillations) is a specific type of cross-frequency coupling that has been observed in neural recordings from multiple species in a range of behavioral contexts. Given its potential importance, care must be taken with how it is measured and quantified. Previous studies have quantified phase-amplitude modulation by measuring the distance of the amplitude distribution from a uniform distribution. While this method is of general applicability, it is not targeted to the specific modulation pattern frequently observed with low-frequency oscillations. Here we develop a new method that has increased specificity to detect modulation in the sinusoidal shape commonly observed in neural data.
Collapse
Affiliation(s)
| | - Aaron L Sampson
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Erik Emeric
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Witold Lipski
- Cortical Systems Lab, University of Pittsburgh Medical School, Pittsburgh, PA, USA
| | | | | | - Sridevi Sarma
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Veit Stuphorn
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Ernst Niebur
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
5
|
Chen P, Chen D, Zhang L, Tang Y, Li X. Automated sleep spindle detection with mixed EEG features. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.103026] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
6
|
Johnson JK, Geng S, Hoffman MW, Adesnik H, Wessel R. Precision multidimensional neural population code recovered from single intracellular recordings. Sci Rep 2020; 10:15997. [PMID: 32994474 PMCID: PMC7524839 DOI: 10.1038/s41598-020-72936-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2020] [Accepted: 08/20/2020] [Indexed: 11/08/2022] Open
Abstract
Neurons in sensory cortices are more naturally and deeply integrated than any current neural population recording tools (e.g. electrode arrays, fluorescence imaging). Two concepts facilitate efforts to observe population neural code with single-cell recordings. First, even the highest quality single-cell recording studies find a fraction of the stimulus information in high-dimensional population recordings. Finding any of this missing information provides proof of principle. Second, neurons and neural populations are understood as coupled nonlinear differential equations. Therefore, fitted ordinary differential equations provide a basis for single-trial single-cell stimulus decoding. We obtained intracellular recordings of fluctuating transmembrane current and potential in mouse visual cortex during stimulation with drifting gratings. We use mean deflection from baseline when comparing to prior single-cell studies because action potentials are too sparse and the deflection response to drifting grating stimuli (e.g. tuning curves) are well studied. Equation-based decoders allowed more precise single-trial stimulus discrimination than tuning-curve-base decoders. Performance varied across recorded signal types in a manner consistent with population recording studies and both classification bases evinced distinct stimulus-evoked phases of population dynamics, providing further corroboration. Naturally and deeply integrated observations of population dynamics would be invaluable. We offer proof of principle and a versatile framework.
Collapse
Affiliation(s)
| | | | | | | | - Ralf Wessel
- Washington University in St. Louis, St. Louis, USA
| |
Collapse
|
7
|
Ujma PP, Bódizs R, Dresler M. Sleep and intelligence: critical review and future directions. Curr Opin Behav Sci 2020. [DOI: 10.1016/j.cobeha.2020.01.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
8
|
Abstract
Neural oscillations are widely studied using methods based on the Fourier transform, which models data as sums of sinusoids. This has successfully uncovered numerous links between oscillations and cognition or disease. However, neural data are nonsinusoidal, and these nonsinusoidal features are increasingly linked to a variety of behavioral and cognitive states, pathophysiology, and underlying neuronal circuit properties. We present a new analysis framework, one that is complementary to existing Fourier and Hilbert transform-based approaches, that quantifies oscillatory features in the time domain on a cycle-by-cycle basis. We have released this cycle-by-cycle analysis suite as "bycycle," a fully documented, open-source Python package with detailed tutorials and troubleshooting cases. This approach performs tests to assess whether an oscillation is present at any given moment and, if so, quantifies each oscillatory cycle by its amplitude, period, and waveform symmetry, the latter of which is missed with the use of conventional approaches. In a series of simulated event-related studies, we show how conventional Fourier and Hilbert transform approaches can conflate event-related changes in oscillation burst duration as increased oscillatory amplitude and as a change in the oscillation frequency, even though those features were unchanged in simulation. Our approach avoids these errors. Furthermore, we validate this approach in simulation and against experimental recordings of patients with Parkinson's disease, who are known to have nonsinusoidal beta (12-30 Hz) oscillations.NEW & NOTEWORTHY We introduce a fully documented, open-source Python package, bycycle, for analyzing neural oscillations on a cycle-by-cycle basis. This approach is complementary to traditional Fourier and Hilbert transform-based approaches but avoids specific pitfalls. First, bycycle confirms an oscillation is present, to avoid analyzing aperiodic, nonoscillatory data as oscillations. Next, it quantifies nonsinusoidal aspects of oscillations, increasingly linked to neural circuit physiology, behavioral states, and diseases. This approach is tested against simulated and real data.
Collapse
Affiliation(s)
- Scott Cole
- Neurosciences Graduate Program, University of California, San Diego, La Jolla, California
| | - Bradley Voytek
- Neurosciences Graduate Program, University of California, San Diego, La Jolla, California.,Department of Cognitive Science, University of California, San Diego, La Jolla, California.,Halıcıoğlu Data Science Institute, University of California, San Diego, La Jolla, California
| |
Collapse
|
9
|
Nonlinear dynamics underlying sensory processing dysfunction in schizophrenia. Proc Natl Acad Sci U S A 2019; 116:3847-3852. [PMID: 30808768 DOI: 10.1073/pnas.1810572116] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Natural systems, including the brain, often seem chaotic, since they are typically driven by complex nonlinear dynamical processes. Disruption in the fluid coordination of multiple brain regions contributes to impairments in information processing and the constellation of symptoms observed in neuropsychiatric disorders. Schizophrenia (SZ), one of the most debilitating mental illnesses, is thought to arise, in part, from such a network dysfunction, leading to impaired auditory information processing as well as cognitive and psychosocial deficits. Current approaches to neurophysiologic biomarker analyses predominantly rely on linear methods and may, therefore, fail to capture the wealth of information contained in whole EEG signals, including nonlinear dynamics. In this study, delay differential analysis (DDA), a nonlinear method based on embedding theory from theoretical physics, was applied to EEG recordings from 877 SZ patients and 753 nonpsychiatric comparison subjects (NCSs) who underwent mismatch negativity (MMN) testing via their participation in the Consortium on the Genetics of Schizophrenia (COGS-2) study. DDA revealed significant nonlinear dynamical architecture related to auditory information processing in both groups. Importantly, significant DDA changes preceded those observed with traditional linear methods. Marked abnormalities in both linear and nonlinear features were detected in SZ patients. These results illustrate the benefits of nonlinear analysis of brain signals and underscore the need for future studies to investigate the relationship between DDA features and pathophysiology of information processing.
Collapse
|