1
|
Ji D, He L, Dong X, Li H, Zhong X, Liu G, Zhou W. Epileptic Seizure Prediction Using Spatiotemporal Feature Fusion on EEG. Int J Neural Syst 2024; 34:2450041. [PMID: 38770650 DOI: 10.1142/s0129065724500412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Electroencephalography (EEG) plays a crucial role in epilepsy analysis, and epileptic seizure prediction has significant value for clinical treatment of epilepsy. Currently, prediction methods using Convolutional Neural Network (CNN) primarily focus on local features of EEG, making it challenging to simultaneously capture the spatial and temporal features from multi-channel EEGs to identify the preictal state effectively. In order to extract inherent spatial relationships among multi-channel EEGs while obtaining their temporal correlations, this study proposed an end-to-end model for the prediction of epileptic seizures by incorporating Graph Attention Network (GAT) and Temporal Convolutional Network (TCN). Low-pass filtered EEG signals were fed into the GAT module for EEG spatial feature extraction, and followed by TCN to capture temporal features, allowing the end-to-end model to acquire the spatiotemporal correlations of multi-channel EEGs. The system was evaluated on the publicly available CHB-MIT database, yielding segment-based accuracy of 98.71%, specificity of 98.35%, sensitivity of 99.07%, and F1-score of 98.71%, respectively. Event-based sensitivity of 97.03% and False Positive Rate (FPR) of 0.03/h was also achieved. Experimental results demonstrated this system can achieve superior performance for seizure prediction by leveraging the fusion of EEG spatiotemporal features without the need of feature engineering.
Collapse
Affiliation(s)
- Dezan Ji
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Landi He
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Xingchen Dong
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Haotian Li
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Xiangwen Zhong
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Guoyang Liu
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Weidong Zhou
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| |
Collapse
|
2
|
Li H, Liao J, Wang H, Zhan CA, Yang F. EEG power spectra parameterization and adaptive channel selection towards semi-supervised seizure prediction. Comput Biol Med 2024; 175:108510. [PMID: 38691913 DOI: 10.1016/j.compbiomed.2024.108510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 03/27/2024] [Accepted: 04/21/2024] [Indexed: 05/03/2024]
Abstract
BACKGROUND The seizure prediction algorithms have demonstrated their potential in mitigating epilepsy risks by detecting the pre-ictal state using ongoing electroencephalogram (EEG) signals. However, most of them require high-density EEG, which is burdensome to the patients for daily monitoring. Moreover, prevailing seizure models require extensive training with significant labeled data which is very time-consuming and demanding for the epileptologists. METHOD To address these challenges, here we propose an adaptive channel selection strategy and a semi-supervised deep learning model respectively to reduce the number of EEG channels and to limit the amount of labeled data required for accurate seizure prediction. Our channel selection module is centered on features from EEG power spectra parameterization that precisely characterize the epileptic activities to identify the seizure-associated channels for each patient. The semi-supervised model integrates generative adversarial networks and bidirectional long short-term memory networks to enhance seizure prediction. RESULTS Our approach is evaluated on the CHB-MIT and Siena epilepsy datasets. With utilizing only 4 channels, the method demonstrates outstanding performance with an AUC of 93.15% on the CHB-MIT dataset and an AUC of 88.98% on the Siena dataset. Experimental results also demonstrate that our selection approach reduces the model parameters and training time. CONCLUSIONS Adaptive channel selection coupled with semi-supervised learning can offer the possible bases for a light weight and computationally efficient seizure prediction system, making the daily monitoring practical to improve patients' quality of life.
Collapse
Affiliation(s)
- Hanyi Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China
| | - Jiahui Liao
- School of Electronics and Information Engineering, Harbin Institute of Technology at Shenzhen, Shenzhen, 518055, China
| | - Hongxiao Wang
- Department of Neurosurgery, Nanfang Hospital, Southern Medical University, Guangzhou, 510515, China
| | - Chang'an A Zhan
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China; Department of Rehabilitation Medicine, Zhujiang Hospital, Southern Medical University, Guangzhou, 510280, China.
| | - Feng Yang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou, China.
| |
Collapse
|
3
|
Ma H, Wu Y, Tang Y, Chen R, Xu T, Zhang W. Parallel Dual-Branch Fusion Network for Epileptic Seizure Prediction. Comput Biol Med 2024; 176:108565. [PMID: 38744007 DOI: 10.1016/j.compbiomed.2024.108565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 04/09/2024] [Accepted: 05/05/2024] [Indexed: 05/16/2024]
Abstract
Epilepsy is a prevalent chronic disorder of the central nervous system. The timely and accurate seizure prediction using the scalp Electroencephalography (EEG) signal can make patients adopt reasonable preventive measures before seizures occur and thus reduce harm to patients. In recent years, deep learning-based methods have made significant progress in solving the problem of epileptic seizure prediction. However, most current methods mainly focus on modeling short- or long-term dependence in EEG, while neglecting to consider both. In this study, we propose a Parallel Dual-Branch Fusion Network (PDBFusNet) which aims to combine the complementary advantages of Convolutional Neural Network (CNN) and Transformer. Specifically, the features of the EEG signal are first extracted using Mel Frequency Cepstral Coefficients (MFCC). Then, the extracted features are delivered into the parallel dual-branches to simultaneously capture the short- and long-term dependencies of EEG signal. Further, regarding the Transformer branch, a novel feature fusion module is developed to enhance the ability of utilizing time, frequency, and channel information. To evaluate our proposal, we perform sufficient experiments on the public epileptic EEG dataset CHB-MIT, where the accuracy, sensitivity, specificity and precision are 95.76%, 95.81%, 95.71% and 95.71%, respectively. PDBFusNet shows superior performance compared to state-of-the-art competitors, which confirms the effectiveness of our proposal.
Collapse
Affiliation(s)
- Hongcheng Ma
- School of Information and Communication Engineering, Hainan University, Haikou, China; State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Yajing Wu
- State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Yongqiang Tang
- State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Rui Chen
- School of Information and Communication Engineering, Hainan University, Haikou, China; State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| | - Tao Xu
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China.
| | - Wensheng Zhang
- School of Information and Communication Engineering, Hainan University, Haikou, China; State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Computer Science and Cyber Engineering, Guangzhou University, Guangzhou, China.
| |
Collapse
|
4
|
Zhang Y, Xiao T, Wang Z, Lv H, Wang S, Feng H, Zhao S, Zhao Y. Hybrid Network for Patient-Specific Seizure Prediction from EEG Data. Int J Neural Syst 2023; 33:2350056. [PMID: 37899653 DOI: 10.1142/s0129065723500569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2023]
Abstract
Seizure prediction can improve the quality of life for patients with drug-resistant epilepsy. With the rapid development of deep learning, lots of seizure prediction methods have been proposed. However, seizure prediction based on single convolution models is limited by the inherent defects of convolution itself. Convolution pays attention to the local features while underestimates the global features. The long-term dependence of the electroencephalogram (EEG) data cannot be captured. In view of these defects, a hybrid model called STCNN based on Swin transformer (ST) and 2D convolutional neural network (2DCNN) is proposed. Time-frequency features extracted by short-term Fourier transform (STFT) are taken as the input of STCNN. ST blocks are used in STCNN to capture the global information and long-term dependencies of EEGs. Meanwhile, the 2DCNN blocks are adopted to capture the local information and short-term dependent features. The combination of the two blocks can fully exploit the seizure-related information thus improve the prediction performance. Comprehensive experiments are performed on the CHB-MIT scalp EEG dataset. The average seizure prediction sensitivity, the area under the ROC curve (AUC) and the false positive rate (FPR) are 92.94%, 95.56% and 0.073, respectively.
Collapse
Affiliation(s)
- Yongfeng Zhang
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| | - Tiantian Xiao
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| | - Ziwei Wang
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| | - Hongbin Lv
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| | - Shuai Wang
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| | - Hailing Feng
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| | - Shanshan Zhao
- Department of Hematology, Heze Hospital of Traditional Chinese Medicine, Heze 274000, P. R. China
| | - Yanna Zhao
- School of Information Science and Engineering, Shandong Normal University, Jinan 250358, P. R. China
| |
Collapse
|
5
|
Liu D, Dong X, Bian D, Zhou W. Epileptic Seizure Prediction Using Attention Augmented Convolutional Network. Int J Neural Syst 2023; 33:2350054. [PMID: 37675593 DOI: 10.1142/s0129065723500545] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/08/2023]
Abstract
Early seizure prediction is crucial for epilepsy patients to reduce accidental injuries and improve their quality of life. Identifying pre-ictal EEG from the inter-ictal state is particularly challenging due to their nonictal nature and remarkable similarities. In this study, a novel epileptic seizure prediction method is proposed based on multi-head attention (MHA) augmented convolutional neural network (CNN) to address the issue of CNN's limit of capturing global information of input signals. First, data enhancement is performed on original EEG recordings to balance the pre-ictal and inter-ictal EEG data, and the EEG recordings are sliced into 6-second-long EEG segments. Subsequently, EEG time-frequency distribution is obtained using Stockwell transform (ST), and the attention augmented convolutional network is employed for feature extraction and classification. Finally, post-processing is utilized to reduce the false prediction rate (FPR). The CHB-MIT EEG database was used to evaluate the system. The validation results showed a segment-based sensitivity of 98.24% and an event-based sensitivity of 94.78% with a FPR of 0.05/h were yielded, respectively. The satisfying results of the proposed method demonstrate its possible potential for clinical applications.
Collapse
Affiliation(s)
- Dongsheng Liu
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| | - Xingchen Dong
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| | - Dong Bian
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| | - Weidong Zhou
- School of Microelectronics, Shandong University, Jinan 250100, P. R. China
| |
Collapse
|
6
|
Guo L, Yu T, Zhao S, Li X, Liao X, Li Y. CLEP: Contrastive Learning for Epileptic Seizure Prediction Using a Spatio-Temporal-Spectral Network. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3915-3926. [PMID: 37796668 DOI: 10.1109/tnsre.2023.3322275] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/07/2023]
Abstract
Seizure prediction of epileptic preictal period through electroencephalogram (EEG) signals is important for clinical epilepsy diagnosis. However, recent deep learning-based methods commonly employ intra-subject training strategy and need sufficient data, which are laborious and time-consuming for a practical system and pose a great challenge for seizure predicting. Besides, multi-domain characterizations, including spatio-temporal-spectral dependencies in an epileptic brain are generally neglected or not considered simultaneously in current approaches, and this insufficiency commonly leads to suboptimal seizure prediction performance. To tackle the above issues, in this paper, we propose Contrastive Learning for Epileptic seizure Prediction (CLEP) using a Spatio-Temporal-Spectral Network (STS-Net). Specifically, the CLEP learns intrinsic epileptic EEG patterns across subjects by contrastive learning. The STS-Net extracts multi-scale temporal and spectral representations under different rhythms from raw EEG signals. Then, a novel triple attention layer (TAL) is employed to construct inter-dimensional interaction among multi-domain features. Moreover, a spatio dynamic graph convolution network (sdGCN) is proposed to dynamically model the spatial relationships between electrodes and aggregate spatial information. The proposed CLEP-STS-Net achieves a sensitivity of 96.7% and a false prediction rate of 0.072/h on the CHB-MIT scalp EEG database. We also validate the proposed method on clinical intracranial EEG (iEEG) database from our Xuanwu Hospital of Capital Medical University, and the predicting system yielded a sensitivity of 95%, a false prediction rate of 0.087/h. The experimental results outperform the state-of-the-art studies which validate the efficacy of our method. Our code is available at https://github.com/LianghuiGuo/CLEP-STS-Net.
Collapse
|
7
|
Wang J, Liang S, Zhang J, Wu Y, Zhang L, Gao R, He D, Shi CJR. EEG Signal Epilepsy Detection With a Weighted Neighbor Graph Representation and Two-Stream Graph-Based Framework. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3176-3187. [PMID: 37506006 DOI: 10.1109/tnsre.2023.3299839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/30/2023]
Abstract
Epilepsy is one of the most common neurological diseases. Clinically, epileptic seizure detection is usually performed by analyzing electroencephalography (EEG) signals. At present, deep learning models have been widely used for single-channel EEG signal epilepsy detection, but this method is difficult to explain the classification results. Researchers have attempted to solve interpretive problems by combining graph representation of EEG signals with graph neural network models. Recently, the combination of graph representations and graph neural network (GNN) models has been increasingly applied to single-channel epilepsy detection. By this methodology, the raw EEG signal is transformed to its graph representation, and a GNN model is used to learn latent features and classify whether the data indicates an epileptic seizure episode. However, existing methods are faced with two major challenges. First, existing graph representations tend to have high time complexity as they generally require each vertex to traverse all other vertices to construct a graph structure. Some of them also have high space complexity for being dense. Second, while separate graph representations can be derived from a single-channel EEG signal in both time and frequency domains, existing GNN models for epilepsy detection can learn from a single graph representation, which makes it hard to let the information from the two domains complement each other. For addressing these challenges, we propose a Weighted Neighbour Graph (WNG) representation for EEG signals. Reducing the redundant edges of the existing graph, WNG can be both time and space-efficient, and as informative as its less efficient counterparts. We then propose a two-stream graph-based framework to simultaneously learn features from WNG in both time and frequency domain. Extensive experiments demonstrate the effectiveness and efficiency of the proposed methods.
Collapse
|
8
|
Yang CY, Chen PC, Huang WC. Cross-Domain Transfer of EEG to EEG or ECG Learning for CNN Classification Models. SENSORS (BASEL, SWITZERLAND) 2023; 23:2458. [PMID: 36904661 PMCID: PMC10007254 DOI: 10.3390/s23052458] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 02/19/2023] [Accepted: 02/20/2023] [Indexed: 06/18/2023]
Abstract
Electroencephalography (EEG) is often used to evaluate several types of neurological brain disorders because of its noninvasive and high temporal resolution. In contrast to electrocardiography (ECG), EEG can be uncomfortable and inconvenient for patients. Moreover, deep-learning techniques require a large dataset and a long time for training from scratch. Therefore, in this study, EEG-EEG or EEG-ECG transfer learning strategies were applied to explore their effectiveness for the training of simple cross-domain convolutional neural networks (CNNs) used in seizure prediction and sleep staging systems, respectively. The seizure model detected interictal and preictal periods, whereas the sleep staging model classified signals into five stages. The patient-specific seizure prediction model with six frozen layers achieved 100% accuracy for seven out of nine patients and required only 40 s of training time for personalization. Moreover, the cross-signal transfer learning EEG-ECG model for sleep staging achieved an accuracy approximately 2.5% higher than that of the ECG model; additionally, the training time was reduced by >50%. In summary, transfer learning from an EEG model to produce personalized models for a more convenient signal can both reduce the training time and increase the accuracy; moreover, challenges such as data insufficiency, variability, and inefficiency can be effectively overcome.
Collapse
|
9
|
Epileptic Seizure Detection Using a Hybrid 1D CNN-Machine Learning Approach from EEG Data. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:9579422. [PMID: 36483658 PMCID: PMC9726261 DOI: 10.1155/2022/9579422] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 10/24/2022] [Accepted: 11/15/2022] [Indexed: 12/02/2022]
Abstract
Electroencephalography (EEG) is a widely used technique for the detection of epileptic seizures. It can be recorded in a noninvasive manner to present the electrical activity of the brain. The visual inspection of nonlinear and highly complex EEG signals is both costly and time-consuming. Therefore, an effective automatic detection system is needed to assist in the long-term evaluation and treatment of patients. Traditional approaches based on machine learning require feature extraction, while deep learning approaches are time-consuming and require more layers for effective feature learning and processing of complex EEG waveforms. Deep learning-based approaches also have weak generalization ability. This paper proposes a solution based on the combination of convolution neural networks (CNN) and machine learning classifiers. It preprocesses the EEG signal using the Butterworth filter and performs feature extraction using CNN. From the extracted set of features, the approach selects only the relevant features using mutual information-based estimators to reduce the curse of dimensionality and improve classification accuracy. The selected features are then passed as input to different machine learning classifiers. The suggested solution is evaluated on the University of Bonn dataset and CHB-MIT datasets. Our model effectively predicts 2, 3, 4, and 5 classes with accuracy of 100%, 99%, 94.6%, and 94%, respectively, for the Bonn dataset and 98% for CHB-MIT datasets.
Collapse
|