1
|
Lin N, Gao W, Li L, Chen J, Liang Z, Yuan G, Sun H, Liu Q, Chen J, Jin L, Huang Y, Zhou X, Zhang S, Hu P, Dai C, He H, Dong Y, Cui L, Lu Q. vEpiNet: A multimodal interictal epileptiform discharge detection method based on video and electroencephalogram data. Neural Netw 2024; 175:106319. [PMID: 38640698 DOI: 10.1016/j.neunet.2024.106319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 03/08/2024] [Accepted: 04/11/2024] [Indexed: 04/21/2024]
Abstract
To enhance deep learning-based automated interictal epileptiform discharge (IED) detection, this study proposes a multimodal method, vEpiNet, that leverages video and electroencephalogram (EEG) data. Datasets comprise 24 931 IED (from 484 patients) and 166 094 non-IED 4-second video-EEG segments. The video data is processed by the proposed patient detection method, with frame difference and Simple Keypoints (SKPS) capturing patients' movements. EEG data is processed with EfficientNetV2. The video and EEG features are fused via a multilayer perceptron. We developed a comparative model, termed nEpiNet, to test the effectiveness of the video feature in vEpiNet. The 10-fold cross-validation was used for testing. The 10-fold cross-validation showed high areas under the receiver operating characteristic curve (AUROC) in both models, with a slightly superior AUROC (0.9902) in vEpiNet compared to nEpiNet (0.9878). Moreover, to test the model performance in real-world scenarios, we set a prospective test dataset, containing 215 h of raw video-EEG data from 50 patients. The result shows that the vEpiNet achieves an area under the precision-recall curve (AUPRC) of 0.8623, surpassing nEpiNet's 0.8316. Incorporating video data raises precision from 70% (95% CI, 69.8%-70.2%) to 76.6% (95% CI, 74.9%-78.2%) at 80% sensitivity and reduces false positives by nearly a third, with vEpiNet processing one-hour video-EEG data in 5.7 min on average. Our findings indicate that video data can significantly improve the performance and precision of IED detection, especially in prospective real clinic testing. It suggests that vEpiNet is a clinically viable and effective tool for IED analysis in real-world applications.
Collapse
Affiliation(s)
- Nan Lin
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Weifang Gao
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Lian Li
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Junhui Chen
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Zi Liang
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Gonglin Yuan
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Heyang Sun
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Qing Liu
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Jianhua Chen
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Liri Jin
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Yan Huang
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Xiangqin Zhou
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China
| | - Shaobo Zhang
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Peng Hu
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Chaoyue Dai
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Haibo He
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Yisu Dong
- NetEase Media Technology Co., Ltd., Beijing, 100084, China
| | - Liying Cui
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China.
| | - Qiang Lu
- Department of Neurology, Peking Union Medical College Hospital, Beijing, 100730, China.
| |
Collapse
|
2
|
Chaibi S, Mahjoub C, Ayadi W, Kachouri A. Epileptic EEG patterns recognition through machine learning techniques and relevant time-frequency features. BIOMED ENG-BIOMED TE 2024; 69:111-123. [PMID: 37899292 DOI: 10.1515/bmt-2023-0332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 10/09/2023] [Indexed: 10/31/2023]
Abstract
OBJECTIVES The present study is designed to explore the process of epileptic patterns' automatic detection, specifically, epileptic spikes and high-frequency oscillations (HFOs), via a selection of machine learning (ML) techniques. The primary motivation for conducting such a research lies mainly in the need to investigate the long-term electroencephalography (EEG) recordings' visual examination process, often considered as a time-consuming and potentially error-prone procedure, requiring a great deal of mental focus and highly experimented neurologists. On attempting to resolve such a challenge, a number of state-of-the-art ML algorithms have been evaluated and compare in terms of performance, to pinpoint the most effective algorithm fit for accurately extracting epileptic EEG patterns. CONTENT Based on intracranial as well as simulated EEG data, the attained findings turn out to reveal that the randomforest (RF) method proved to be the most consistently effective approach, significantly outperforming the entirety of examined methods in terms of EEG recordings epileptic-pattern identification. Indeed, the RF classifier appeared to record an average balanced classification rate (BCR) of 92.38 % in regard to spikes recognition process, and 78.77 % in terms of HFOs detection. SUMMARY Compared to other approaches, our results provide valuable insights into the RF classifier's effectiveness as a powerful ML technique, fit for detecting EEG signals born epileptic bursts. OUTLOOK As a potential future work, we envisage to further validate and sustain our major reached findings through incorporating a larger EEG dataset. We also aim to explore the generative adversarial networks (GANs) application so as to generate synthetic EEG signals or combine signal generation techniques with deep learning approaches. Through this new vein of thought, we actually preconize to enhance and boost the automated detection methods' performance even more, thereby, noticeably enhancing the epileptic EEG pattern recognition area.
Collapse
Affiliation(s)
- Sahbi Chaibi
- AFD2E Laboratory, National Engineering School, Sfax University, Sfax, Tunisia
- Faculty of Sciences of Monastir, Monastir University, Monastir, Tunisia
| | - Chahira Mahjoub
- AFD2E Laboratory, National Engineering School, Sfax University, Sfax, Tunisia
| | - Wadhah Ayadi
- Faculty of Sciences of Monastir, Monastir University, Monastir, Tunisia
| | | |
Collapse
|
3
|
Bagheri E, Jin J, Dauwels J, Cash S, Westover MB. A fast machine learning approach to facilitate the detection of interictal epileptiform discharges in the scalp electroencephalogram. J Neurosci Methods 2019; 326:108362. [PMID: 31310822 DOI: 10.1016/j.jneumeth.2019.108362] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Revised: 06/28/2019] [Accepted: 07/11/2019] [Indexed: 11/28/2022]
Abstract
BACKGROUND Finding interictal epileptiform discharges (IEDs) in the EEG is a part of diagnosing epilepsy. Automated software for annotating EEGs of patients with suspected epilepsy can therefore help with reaching a diagnosis. A large amount of data is required for training and evaluating an effective IED detection system. IEDs occur infrequently in the most patients' EEG, therefore, interictal EEG recordings contain mostly background waveforms. NEW METHOD As the first step to detect IEDs, we propose a machine learning technique eliminating most EEG background data using an ensemble of simple fast classifiers based on several EEG features. This could save computation time for an IED detection method, allowing the remaining waveforms to be classified by more computationally intensive methods. We consider several efficient features and reject background by applying thresholds on them in consecutive steps. RESULTS We applied the proposed algorithm on a dataset of 156 EEGs (93 and 63 with and without IEDs, respectively). We were able to eliminate 78% of background waveforms while retaining 97% of IEDs on our cross-validated dataset. COMPARISON WITH EXISTING METHODS We applied support vector machine, k-nearest neighbours, and random forest classifiers to detect IEDs with and without initial background rejection. Results show that rejecting background by our proposed method speeds up the overall classification by a factor ranging from 1.8 to 4.7 for the considered classifiers. CONCLUSIONS The proposed method successfully reduces computation time of an IED detection system. Therefore, it is beneficial in speeding up IED detection especially when utilizing large EEG datasets.
Collapse
Affiliation(s)
- Elham Bagheri
- Nanyang Technological University, School of Electrical and Electronic Engineering, Singapore 639798, Singapore.
| | - Jing Jin
- Nanyang Technological University, School of Electrical and Electronic Engineering, Singapore 639798, Singapore; Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Harvard Medical School, Cambridge, MA, USA
| | - Justin Dauwels
- Nanyang Technological University, School of Electrical and Electronic Engineering, Singapore 639798, Singapore
| | - Sydney Cash
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Harvard Medical School, Cambridge, MA, USA
| | - M Brandon Westover
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Harvard Medical School, Cambridge, MA, USA
| |
Collapse
|