1
|
Jiao M, Xian X, Wang B, Zhang Y, Yang S, Chen S, Sun H, Liu F. XDL-ESI: Electrophysiological Sources Imaging via explainable deep learning framework with validation on simultaneous EEG and iEEG. Neuroimage 2024; 299:120802. [PMID: 39173694 PMCID: PMC11549933 DOI: 10.1016/j.neuroimage.2024.120802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 08/17/2024] [Accepted: 08/19/2024] [Indexed: 08/24/2024] Open
Abstract
Electroencephalography (EEG) or Magnetoencephalography (MEG) source imaging aims to estimate the underlying activated brain sources to explain the observed EEG/MEG recordings. Solving the inverse problem of EEG/MEG Source Imaging (ESI) is challenging due to its ill-posed nature. To achieve a unique solution, it is essential to apply sophisticated regularization constraints to restrict the solution space. Traditionally, the design of regularization terms is based on assumptions about the spatiotemporal structure of the underlying source dynamics. In this paper, we propose a novel paradigm for ESI via an Explainable Deep Learning framework, termed as XDL-ESI, which connects the iterative optimization algorithm with deep learning architecture by unfolding the iterative updates with neural network modules. The proposed framework has the advantages of (1) establishing a data-driven approach to model the source solution structure instead of using hand-crafted regularization terms; (2) improving the robustness of source solutions by introducing a topological loss that leverages the geometric spatial information applying varying penalties on distinct localization errors; (3) improving the reconstruction efficiency and interpretability as it inherits the advantages from both the iterative optimization algorithms (interpretability) and deep learning approaches (function approximation). The proposed XDL-ESI framework provides an efficient, accurate, and interpretable paradigm to solve the ESI inverse problem with satisfactory performance in both simulated data and real clinical data. Specially, this approach is further validated using simultaneous EEG and intracranial EEG (iEEG).
Collapse
Affiliation(s)
- Meng Jiao
- Department of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, 07030, United States
| | - Xiaochen Xian
- H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, United States
| | - Boyu Wang
- Department of Computer Science, University of Western Ontario, Ontario, N6A 3K7, Canada
| | - Yu Zhang
- Department of Bioengineering, Lehigh University, Bethlehem, PA, 18015, United States
| | - Shihao Yang
- Department of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, 07030, United States
| | - Spencer Chen
- Department of Neurosurgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, 08901, United States
| | - Hai Sun
- Department of Neurosurgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, 08901, United States
| | - Feng Liu
- Department of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, 07030, United States; Semcer Center for Healthcare Innovation, Stevens Institute of Technology, Hoboken, NJ, 07030, United States.
| |
Collapse
|
2
|
Jiao M, Yang S, Xian X, Fotedar N, Liu F. Multi-Modal Electrophysiological Source Imaging With Attention Neural Networks Based on Deep Fusion of EEG and MEG. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2492-2502. [PMID: 38976470 PMCID: PMC11329068 DOI: 10.1109/tnsre.2024.3424669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/10/2024]
Abstract
The process of reconstructing underlying cortical and subcortical electrical activities from Electroencephalography (EEG) or Magnetoencephalography (MEG) recordings is called Electrophysiological Source Imaging (ESI). Given the complementarity between EEG and MEG in measuring radial and tangential cortical sources, combined EEG/MEG is considered beneficial in improving the reconstruction performance of ESI algorithms. Traditional algorithms mainly emphasize incorporating predesigned neurophysiological priors to solve the ESI problem. Deep learning frameworks aim to directly learn the mapping from scalp EEG/MEG measurements to the underlying brain source activities in a data-driven manner, demonstrating superior performance compared to traditional methods. However, most of the existing deep learning approaches for the ESI problem are performed on a single modality of EEG or MEG, meaning the complementarity of these two modalities has not been fully utilized. How to fuse the EEG and MEG in a more principled manner under the deep learning paradigm remains a challenging question. This study develops a Multi-Modal Deep Fusion (MMDF) framework using Attention Neural Networks (ANN) to fully leverage the complementary information between EEG and MEG for solving the ESI inverse problem, which is termed as MMDF-ANN. Specifically, our proposed brain source imaging approach consists of four phases, including feature extraction, weight generation, deep feature fusion, and source mapping. Our experimental results on both synthetic dataset and real dataset demonstrated that using a fusion of EEG and MEG can significantly improve the source localization accuracy compared to using a single-modality of EEG or MEG. Compared to the benchmark algorithms, MMDF-ANN demonstrated good stability when reconstructing sources with extended activation areas and situations of EEG/MEG measurements with a low signal-to-noise ratio.
Collapse
|
3
|
Tok S, Ahnaou A, Drinkenburg W. Functional Neurophysiological Biomarkers of Early-Stage Alzheimer's Disease: A Perspective of Network Hyperexcitability in Disease Progression. J Alzheimers Dis 2021; 88:809-836. [PMID: 34420957 PMCID: PMC9484128 DOI: 10.3233/jad-210397] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Network hyperexcitability (NH) has recently been suggested as a potential neurophysiological indicator of Alzheimer’s disease (AD), as new, more accurate biomarkers of AD are sought. NH has generated interest as a potential indicator of certain stages in the disease trajectory and even as a disease mechanism by which network dysfunction could be modulated. NH has been demonstrated in several animal models of AD pathology and multiple lines of evidence point to the existence of NH in patients with AD, strongly supporting the physiological and clinical relevance of this readout. Several hypotheses have been put forward to explain the prevalence of NH in animal models through neurophysiological, biochemical, and imaging techniques. However, some of these hypotheses have been built on animal models with limitations and caveats that may have derived NH through other mechanisms or mechanisms without translational validity to sporadic AD patients, potentially leading to an erroneous conclusion of the underlying cause of NH occurring in patients with AD. In this review, we discuss the substantiation for NH in animal models of AD pathology and in human patients, as well as some of the hypotheses considering recently developed animal models that challenge existing hypotheses and mechanisms of NH. In addition, we provide a preclinical perspective on how the development of animal models incorporating AD-specific NH could provide physiologically relevant translational experimental data that may potentially aid the discovery and development of novel therapies for AD.
Collapse
Affiliation(s)
- Sean Tok
- Department of Neuroscience, Janssen Research & Development, Janssen Pharmaceutica NV, Beerse, Belgium.,Groningen Institute for Evolutionary Life Sciences, Faculty of Science and Engineering, University of Groningen, The Netherlands
| | - Abdallah Ahnaou
- Department of Neuroscience, Janssen Research & Development, Janssen Pharmaceutica NV, Beerse, Belgium
| | - Wilhelmus Drinkenburg
- Department of Neuroscience, Janssen Research & Development, Janssen Pharmaceutica NV, Beerse, Belgium.,Groningen Institute for Evolutionary Life Sciences, Faculty of Science and Engineering, University of Groningen, The Netherlands
| |
Collapse
|
4
|
Chowdhury RA, Pellegrino G, Aydin Ü, Lina JM, Dubeau F, Kobayashi E, Grova C. Reproducibility of EEG-MEG fusion source analysis of interictal spikes: Relevance in presurgical evaluation of epilepsy. Hum Brain Mapp 2017; 39:880-901. [PMID: 29164737 DOI: 10.1002/hbm.23889] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2017] [Revised: 11/03/2017] [Accepted: 11/07/2017] [Indexed: 11/06/2022] Open
Abstract
Fusion of electroencephalography (EEG) and magnetoencephalography (MEG) data using maximum entropy on the mean method (MEM-fusion) takes advantage of the complementarities between EEG and MEG to improve localization accuracy. Simulation studies demonstrated MEM-fusion to be robust especially in noisy conditions such as single spike source localizations (SSSL). Our objective was to assess the reliability of SSSL using MEM-fusion on clinical data. We proposed to cluster SSSL results to find the most reliable and consistent source map from the reconstructed sources, the so-called consensus map. Thirty-four types of interictal epileptic discharges (IEDs) were analyzed from 26 patients with well-defined epileptogenic focus. SSSLs were performed on EEG, MEG, and fusion data and consensus maps were estimated using hierarchical clustering. Qualitative (spike-to-spike reproducibility rate, SSR) and quantitative (localization error and spatial dispersion) assessments were performed using the epileptogenic focus as clinical reference. Fusion SSSL provided significantly better results than EEG or MEG alone. Fusion found at least one cluster concordant with the clinical reference in all cases. This concordant cluster was always the one involving the highest number of spikes. Fusion yielded highest reproducibility (SSR EEG = 55%, MEG = 71%, fusion = 90%) and lowest localization error. Also, using only few channels from either modality (21EEG + 272MEG or 54EEG + 25MEG) was sufficient to reach accurate fusion. MEM-fusion with consensus map approach provides an objective way of finding the most reliable and concordant generators of IEDs. We, therefore, suggest the pertinence of SSSL using MEM-fusion as a valuable clinical tool for presurgical evaluation of epilepsy.
Collapse
Affiliation(s)
- Rasheda Arman Chowdhury
- Multimodal Functional Imaging Lab, Biomedical Engineering Department, McGill University, Montreal, Québec, Canada
| | | | - Ümit Aydin
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM Centre, Concordia University, Montreal, Québec, Canada
| | - Jean-Marc Lina
- Ecole de Technologie Supérieure, Montréal, Québec, Canada.,Centre de Recherches Mathématiques, Université de Montréal, Montréal, Québec, Canada
| | - François Dubeau
- Neurology and Neurosurgery Department, Montreal Neurological Institute, McGill University, Montreal, Québec, Canada
| | - Eliane Kobayashi
- Neurology and Neurosurgery Department, Montreal Neurological Institute, McGill University, Montreal, Québec, Canada
| | - Christophe Grova
- Multimodal Functional Imaging Lab, Biomedical Engineering Department, McGill University, Montreal, Québec, Canada.,Centre de Recherches Mathématiques, Université de Montréal, Montréal, Québec, Canada.,Neurology and Neurosurgery Department, Montreal Neurological Institute, McGill University, Montreal, Québec, Canada.,Multimodal Functional Imaging Lab, Department of Physics and PERFORM Centre, Concordia University, Montreal, Québec, Canada
| |
Collapse
|
5
|
Code-modulated visual evoked potentials using fast stimulus presentation and spatiotemporal beamformer decoding. Sci Rep 2017; 7:15037. [PMID: 29118386 PMCID: PMC5678079 DOI: 10.1038/s41598-017-15373-x] [Citation(s) in RCA: 38] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Accepted: 10/26/2017] [Indexed: 11/15/2022] Open
Abstract
When encoding visual targets using various lagged versions of a pseudorandom binary sequence of luminance changes, the EEG signal recorded over the viewer’s occipital pole exhibits so-called code-modulated visual evoked potentials (cVEPs), the phase lags of which can be tied to these targets. The cVEP paradigm has enjoyed interest in the brain-computer interfacing (BCI) community for the reported high information transfer rates (ITR, in bits/min). In this study, we introduce a novel decoding algorithm based on spatiotemporal beamforming, and show that this algorithm is able to accurately identify the gazed target. Especially for a small number of repetitions of the coding sequence, our beamforming approach significantly outperforms an optimised support vector machine (SVM)-based classifier, which is considered state-of-the-art in cVEP-based BCI. In addition to the traditional 60 Hz stimulus presentation rate for the coding sequence, we also explore the 120 Hz rate, and show that the latter enables faster communication, with a maximal median ITR of 172.87 bits/min. Finally, we also report on a transition effect in the EEG signal following the onset of the stimulus sequence, and recommend to exclude the first 150 ms of the trials from decoding when relying on a single presentation of the stimulus sequence.
Collapse
|
6
|
Multiple Signal Classification Algorithm Based Electric Dipole Source Localization Method in an Underwater Environment. Symmetry (Basel) 2017. [DOI: 10.3390/sym9100231] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|
7
|
Klinzing JG, Mölle M, Weber F, Supp G, Hipp JF, Engel AK, Born J. Spindle activity phase-locked to sleep slow oscillations. Neuroimage 2016; 134:607-616. [DOI: 10.1016/j.neuroimage.2016.04.031] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2015] [Revised: 03/08/2016] [Accepted: 04/13/2016] [Indexed: 10/21/2022] Open
|
8
|
MEG-EEG Information Fusion and Electromagnetic Source Imaging: From Theory to Clinical Application in Epilepsy. Brain Topogr 2015; 28:785-812. [PMID: 26016950 PMCID: PMC4600479 DOI: 10.1007/s10548-015-0437-3] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2014] [Accepted: 05/04/2015] [Indexed: 11/26/2022]
Abstract
The purpose of this study is to develop and quantitatively assess whether fusion of EEG and MEG (MEEG) data within the maximum entropy on the mean (MEM) framework increases the spatial accuracy of source localization, by yielding better recovery of the spatial extent and propagation pathway of the underlying generators of inter-ictal epileptic discharges (IEDs). The key element in this study is the integration of the complementary information from EEG and MEG data within the MEM framework. MEEG was compared with EEG and MEG when localizing single transient IEDs. The fusion approach was evaluated using realistic simulation models involving one or two spatially extended sources mimicking propagation patterns of IEDs. We also assessed the impact of the number of EEG electrodes required for an efficient EEG–MEG fusion. MEM was compared with minimum norm estimate, dynamic statistical parametric mapping, and standardized low-resolution electromagnetic tomography. The fusion approach was finally assessed on real epileptic data recorded from two patients showing IEDs simultaneously in EEG and MEG. Overall the localization of MEEG data using MEM provided better recovery of the source spatial extent, more sensitivity to the source depth and more accurate detection of the onset and propagation of IEDs than EEG or MEG alone. MEM was more accurate than the other methods. MEEG proved more robust than EEG and MEG for single IED localization in low signal-to-noise ratio conditions. We also showed that only few EEG electrodes are required to bring additional relevant information to MEG during MEM fusion.
Collapse
|
9
|
Ha T, Kim K, Lim S, Yu KK, Kwon H. Three-dimensional reconstruction of a cardiac outline by magnetocardiography. IEEE Trans Biomed Eng 2014; 62:60-9. [PMID: 25020011 DOI: 10.1109/tbme.2014.2336671] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
A 3-D cardiac visualization is significantly helpful toward clinical applications of magnetocardiography (MCG), but the cardiac reconstruction requires a segmentation process using additional image modalities. This paper proposes a 3-D cardiac outline reconstruction method using only MCG measurement data without further imaging techniques. The cardiac outline was reconstructed by a combination of both spatial filtering and coherence mapping method. The strength of cardiac activities was first estimated by the array-gain constraint minimum-norm spatial filter with recursively updated gram matrix (AGMN-RUG). Then, waveforms were reconstructed at whole source grids, and the maximum source points of an atrium and ventricle were selected as a reference, respectively. Next, the coherence between each maximum source point and whole source points was compared by the coherence mapping method. A reconstructed cardiac outline was validated by comparing with an overlapped volume ratio when the reconstructed volume was identically matched with the original volume. The results obtained by the AGMN-RUG were compared to the results by other spatial filters. The accuracy of numerical simulation and phantom experiment by the AGMN-RUG was superior 10% and 8%, respectively, than the accuracy by the standardized low-resolution electromagnetic tomography. This accuracy demonstrated the efficacy of the proposed 3-D cardiac reconstruction method.
Collapse
|
10
|
Ahn M, Ahn S, Hong JH, Cho H, Kim K, Kim BS, Chang JW, Jun SC. Gamma band activity associated with BCI performance: simultaneous MEG/EEG study. Front Hum Neurosci 2013; 7:848. [PMID: 24367322 PMCID: PMC3853408 DOI: 10.3389/fnhum.2013.00848] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2013] [Accepted: 11/21/2013] [Indexed: 11/16/2022] Open
Abstract
While brain computer interface (BCI) can be employed with patients and healthy subjects, there are problems that must be resolved before BCI can be useful to the public. In the most popular motor imagery (MI) BCI system, a significant number of target users (called “BCI-Illiterates”) cannot modulate their neuronal signals sufficiently to use the BCI system. This causes performance variability among subjects and even among sessions within a subject. The mechanism of such BCI-Illiteracy and possible solutions still remain to be determined. Gamma oscillation is known to be involved in various fundamental brain functions, and may play a role in MI. In this study, we investigated the association of gamma activity with MI performance among subjects. Ten simultaneous MEG/EEG experiments were conducted; MI performance for each was estimated by EEG data, and the gamma activity associated with BCI performance was investigated with MEG data. Our results showed that gamma activity had a high positive correlation with MI performance in the prefrontal area. This trend was also found across sessions within one subject. In conclusion, gamma rhythms generated in the prefrontal area appear to play a critical role in BCI performance.
Collapse
Affiliation(s)
- Minkyu Ahn
- School of Information and Communications, Gwangju Institute of Science and Technology Gwangju, South Korea
| | - Sangtae Ahn
- School of Information and Communications, Gwangju Institute of Science and Technology Gwangju, South Korea
| | - Jun H Hong
- School of Information and Communications, Gwangju Institute of Science and Technology Gwangju, South Korea
| | - Hohyun Cho
- School of Information and Communications, Gwangju Institute of Science and Technology Gwangju, South Korea
| | - Kiwoong Kim
- Korea Research Institute of Standards and Science Daejeon, South Korea
| | - Bong S Kim
- Department of Neurosurgery, Brain Research Institute, Yonsei University College of Medicine Seoul, South Korea
| | - Jin W Chang
- Department of Neurosurgery, Brain Research Institute, Yonsei University College of Medicine Seoul, South Korea
| | - Sung C Jun
- School of Information and Communications, Gwangju Institute of Science and Technology Gwangju, South Korea ; Wadsworth Center, New York State Health Department, Albany NY, USA
| |
Collapse
|