1
|
Paliwal V, Das K, Doesburg SM, Medvedev G, Xi P, Ribary U, Pachori RB, Vakorin VA. Classifying Routine Clinical Electroencephalograms With Multivariate Iterative Filtering and Convolutional Neural Networks. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2038-2048. [PMID: 38768007 DOI: 10.1109/tnsre.2024.3403198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Electroencephalogram (EEG) is widely used in basic and clinical neuroscience to explore neural states in various populations, and classifying these EEG recordings is a fundamental challenge. While machine learning shows promising results in classifying long multivariate time series, optimal prediction models and feature extraction methods for EEG classification remain elusive. Our study addressed the problem of EEG classification under the framework of brain age prediction, applying a deep learning model on EEG time series. We hypothesized that decomposing EEG signals into oscillatory modes would yield more accurate age predictions than using raw or canonically frequency-filtered EEG. Specifically, we employed multivariate intrinsic mode functions (MIMFs), an empirical mode decomposition (EMD) variant based on multivariate iterative filtering (MIF), with a convolutional neural network (CNN) model. Testing a large dataset of routine clinical EEG scans (n = 6540) from patients aged 1 to 103 years, we found that an ad-hoc CNN model without fine-tuning could reasonably predict brain age from EEGs. Crucially, MIMF decomposition significantly improved performance compared to canonical brain rhythms (from delta to lower gamma oscillations). Our approach achieved a mean absolute error (MAE) of 13.76 ± 0.33 and a correlation coefficient of 0.64 ± 0.01 in brain age prediction over the entire lifespan. Our findings indicate that CNN models applied to EEGs, preserving their original temporal structure, remains a promising framework for EEG classification, wherein the adaptive signal decompositions such as the MIF can enhance CNN models' performance in this task.
Collapse
|
2
|
Brookshire G, Kasper J, Blauch NM, Wu YC, Glatt R, Merrill DA, Gerrol S, Yoder KJ, Quirk C, Lucero C. Data leakage in deep learning studies of translational EEG. Front Neurosci 2024; 18:1373515. [PMID: 38765672 PMCID: PMC11099244 DOI: 10.3389/fnins.2024.1373515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 04/04/2024] [Indexed: 05/22/2024] Open
Abstract
A growing number of studies apply deep neural networks (DNNs) to recordings of human electroencephalography (EEG) to identify a range of disorders. In many studies, EEG recordings are split into segments, and each segment is randomly assigned to the training or test set. As a consequence, data from individual subjects appears in both the training and the test set. Could high test-set accuracy reflect data leakage from subject-specific patterns in the data, rather than patterns that identify a disease? We address this question by testing the performance of DNN classifiers using segment-based holdout (in which segments from one subject can appear in both the training and test set), and comparing this to their performance using subject-based holdout (where all segments from one subject appear exclusively in either the training set or the test set). In two datasets (one classifying Alzheimer's disease, and the other classifying epileptic seizures), we find that performance on previously-unseen subjects is strongly overestimated when models are trained using segment-based holdout. Finally, we survey the literature and find that the majority of translational DNN-EEG studies use segment-based holdout. Most published DNN-EEG studies may dramatically overestimate their classification performance on new subjects.
Collapse
Affiliation(s)
| | - Jake Kasper
- SPARK Neuro Inc., New York, NY, United States
| | - Nicholas M. Blauch
- SPARK Neuro Inc., New York, NY, United States
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, United States
| | | | - Ryan Glatt
- Pacific Brain Health Center, Pacific Neuroscience Institute and Foundation, Santa Monica, CA, United States
| | - David A. Merrill
- Pacific Brain Health Center, Pacific Neuroscience Institute and Foundation, Santa Monica, CA, United States
- Saint John's Cancer Institute at Providence Saint John's Health Center, Santa Monica, CA, United States
- Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine at University of California, Los Angeles, Los Angeles, CA, United States
| | | | | | - Colin Quirk
- SPARK Neuro Inc., New York, NY, United States
| | - Ché Lucero
- SPARK Neuro Inc., New York, NY, United States
| |
Collapse
|
3
|
Şeker M, Özerdem MS. Deep insights into MCI diagnosis: A comparative deep learning analysis of EEG time series. J Neurosci Methods 2024; 403:110057. [PMID: 38215948 DOI: 10.1016/j.jneumeth.2024.110057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 12/25/2023] [Accepted: 01/05/2024] [Indexed: 01/14/2024]
Abstract
BACKGROUND Individuals in the early stages of Alzheimer's Disease (AD) are typically diagnosed with Mild Cognitive Impairment (MCI). MCI represents a transitional phase between normal cognitive function and AD. Electroencephalography (EEG) records carry valuable insights into cerebral cortex brain activities to analyze neuronal degeneration. To enhance the precision of dementia diagnosis, automatic and intelligent methods are required for the analysis and processing of EEG signals. NEW METHODS This paper aims to address the challenges associated with MCI diagnosis by leveraging EEG signals and deep learning techniques. The analysis in this study focuses on processing the information embedded within the sequence of raw EEG time series data. EEG recordings are collected from 10 Healthy Controls (HC) and 10 MCI participants using 19 electrodes during a 30 min eyes-closed session. EEG time series are transformed into 2 separate formats of input tensors and applied to deep neural network architectures. Convolutional Neural Network (CNN) and ResNet from scratch are performed with 2D time series with different segment lengths. Furthermore, EEGNet and DeepConvNet architectures are utilized for 1D time series. RESULTS ResNet demonstrates superior effectiveness in detecting MCI when compared to CNN architecture. Complete discrimination is achieved using EEGNet and DeepConvNet for noisy segments. COMPARISON WITH EXISTING METHODS ResNet has yielded a 3 % higher accuracy rate compared to CNN. None of the architectures in the literature have achieved 100 % accuracy except proposed EEGNet and DeepConvnet. CONCLUSION Deep learning architectures hold great promise in enhancing the accuracy of early MCI detection.
Collapse
Affiliation(s)
- Mesut Şeker
- Department of Electrical and Electronics Engineering, Dicle University, Diyarbakir, Turkey.
| | - Mehmet Siraç Özerdem
- Department of Electrical and Electronics Engineering, Dicle University, Diyarbakir, Turkey.
| |
Collapse
|
4
|
Xu X, Li J, Zhu Z, Zhao L, Wang H, Song C, Chen Y, Zhao Q, Yang J, Pei Y. A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis. Bioengineering (Basel) 2024; 11:219. [PMID: 38534493 DOI: 10.3390/bioengineering11030219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 02/15/2024] [Accepted: 02/21/2024] [Indexed: 03/28/2024] Open
Abstract
Disease diagnosis represents a critical and arduous endeavor within the medical field. Artificial intelligence (AI) techniques, spanning from machine learning and deep learning to large model paradigms, stand poised to significantly augment physicians in rendering more evidence-based decisions, thus presenting a pioneering solution for clinical practice. Traditionally, the amalgamation of diverse medical data modalities (e.g., image, text, speech, genetic data, physiological signals) is imperative to facilitate a comprehensive disease analysis, a topic of burgeoning interest among both researchers and clinicians in recent times. Hence, there exists a pressing need to synthesize the latest strides in multi-modal data and AI technologies in the realm of medical diagnosis. In this paper, we narrow our focus to five specific disorders (Alzheimer's disease, breast cancer, depression, heart disease, epilepsy), elucidating advanced endeavors in their diagnosis and treatment through the lens of artificial intelligence. Our survey not only delineates detailed diagnostic methodologies across varying modalities but also underscores commonly utilized public datasets, the intricacies of feature engineering, prevalent classification models, and envisaged challenges for future endeavors. In essence, our research endeavors to contribute to the advancement of diagnostic methodologies, furnishing invaluable insights for clinical decision making.
Collapse
Affiliation(s)
- Xi Xu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Jianqiang Li
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Zhichao Zhu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Linna Zhao
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Huina Wang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Changwei Song
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Yining Chen
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Qing Zhao
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Jijiang Yang
- Tsinghua National Laboratory for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Yan Pei
- School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Japan
| |
Collapse
|
5
|
Ho NH, Jeong YH, Kim J. Multimodal multitask learning for predicting MCI to AD conversion using stacked polynomial attention network and adaptive exponential decay. Sci Rep 2023; 13:11243. [PMID: 37433809 PMCID: PMC10336016 DOI: 10.1038/s41598-023-37500-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 06/22/2023] [Indexed: 07/13/2023] Open
Abstract
Early identification and treatment of moderate cognitive impairment (MCI) can halt or postpone Alzheimer's disease (AD) and preserve brain function. For prompt diagnosis and AD reversal, precise prediction in the early and late phases of MCI is essential. This research investigates multimodal framework-based multitask learning in the following situations: (1) Differentiating early mild cognitive impairment (eMCI) from late MCI and (2) predicting when an MCI patient would acquire AD. Clinical data and two radiomics features on three brain areas deduced from magnetic resonance imaging were investigated (MRI). We proposed an attention-based module, Stack Polynomial Attention Network (SPAN), to firmly encode clinical and radiomics data input characteristics for successful representation from a small dataset. To improve multimodal data learning, we computed a potent factor using adaptive exponential decay (AED). We used experiments from the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort study, which included 249 eMCI and 427 lMCI participants at baseline visits. The proposed multimodal strategy yielded the best c-index score in time prediction of MCI to AD conversion (0.85) and the best accuracy in MCI-stage categorization ([Formula: see text]). Moreover, our performance was equivalent to that of contemporary research.
Collapse
Affiliation(s)
- Ngoc-Huynh Ho
- Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju, 61186, South Korea
| | - Yang-Hyung Jeong
- Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju, 61186, South Korea.
| | - Jahae Kim
- Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju, 61186, South Korea
- Department of Nuclear Medicine, Chonnam National University Hospital, Gwangju, 61469, South Korea
| |
Collapse
|
6
|
Simfukwe C, Youn YC, Kim MJ, Paik J, Han SH. CNN for a Regression Machine Learning Algorithm for Predicting Cognitive Impairment Using qEEG. Neuropsychiatr Dis Treat 2023; 19:851-863. [PMID: 37077704 PMCID: PMC10106803 DOI: 10.2147/ndt.s404528] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 04/05/2023] [Indexed: 04/21/2023] Open
Abstract
Purpose Electroencephalogram (EEG) signals give detailed information on the electrical brain activities occurring in the cerebral cortex. They are used to study brain-related disorders such as mild cognitive impairment (MCI) and Alzheimer's disease (AD). Brain signals obtained using an EEG machine can be a neurophysiological biomarker for early diagnosis of dementia through quantitative EEG (qEEG) analysis. This paper proposes a machine learning methodology to detect MCI and AD from qEEG time-frequency (TF) images of the subjects in an eyes-closed resting state (ECR). Participants and Methods The dataset consisted of 16,910 TF images from 890 subjects: 269 healthy controls (HC), 356 MCI, and 265 AD. First, EEG signals were transformed into TF images using a Fast Fourier Transform (FFT) containing different event-rated changes of frequency sub-bands preprocessed from the EEGlab toolbox in the MATLAB R2021a environment software. The preprocessed TF images were applied in a convolutional neural network (CNN) with adjusted parameters. For classification, the computed image features were concatenated with age data and went through the feed-forward neural network (FNN). Results The trained models', HC vs MCI, HC vs AD, and HC vs CASE (MCI + AD), performance metrics were evaluated based on the test dataset of the subjects. The accuracy, sensitivity, and specificity were evaluated: HC vs MCI was 83%, 93%, and 73%, HC vs AD was 81%, 80%, and 83%, and HC vs CASE (MCI + AD) was 88%, 80%, and 90%, respectively. Conclusion The proposed models trained with TF images and age can be used to assist clinicians as a biomarker in detecting cognitively impaired subjects at an early stage in clinical sectors.
Collapse
Affiliation(s)
- Chanda Simfukwe
- Department of Neurology, Chung-Ang University College of Medicine, Seoul, South Korea
| | - Young Chul Youn
- Department of Neurology, Chung-Ang University College of Medicine, Seoul, South Korea
- Correspondence: Young Chul Youn; Su-Hyun Han, Department of Neurology, Chung-Ang University Hospital, Seoul, Republic of Korea, Email ;
| | - Min-Jae Kim
- Department of Image, Chung-Ang University, Seoul, South Korea
| | - Joonki Paik
- Department of Image, Chung-Ang University, Seoul, South Korea
| | - Su-Hyun Han
- Department of Neurology, Chung-Ang University College of Medicine, Seoul, South Korea
| |
Collapse
|
7
|
Drage R, Escudero J, Parra MA, Scally B, Anghinah R, De Araujo AVL, Basile LF, Abasolo D. A novel deep learning approach using AlexNet for the classification of electroencephalograms in Alzheimer's Disease and Mild Cognitive Impairment. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3175-3178. [PMID: 36085668 DOI: 10.1109/embc48229.2022.9871497] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Alzheimer's Disease (AD) is the most common form of dementia. Mild Cognitive Impairment (MCI) is the term given to the stage describing prodromal AD and represents a 'risk factor' in early-stage AD diagnosis from normal cognitive decline due to ageing. The electroencephalogram (EEG) has been studied extensively for AD characterization, but reliable early-stage diagnosis continues to present a challenge. The aim of this study was to introduce a novel way of classifying between AD patients, MCI subjects, and age-matched healthy control (HC) subjects using EEG-derived feature images and deep learning techniques. The EEG recordings of 141 age-matched subjects (52 AD, 37 MCI, 52 HC) were converted into 2D greyscale images representing the Pearson correlation coefficients and the distance Lempel-Ziv Complexity (dLZC) between the 21 EEG channels. Each feature type was computed from EEG epochs of 1s, 2s, 5s and 10s segmented from the original recording. The CNN architecture AlexNet was modified and employed for this three-way classification task and a 70/30 split was used for training and validation with each of the different epoch lengths and EEG-derived images. Whilst a maximum classification accuracy of 73.49% was obtained using dLZC-derived images from 10s epochs as input to the model, the classification accuracy reached 98.13% using the images obtained from Pearson correlation coefficients and 5s epochs. Clinical Relevance- The preliminary findings from this study show that deep learning applied to the analysis of the EEG can classify subjects with accuracies close to 100.
Collapse
|
8
|
Gkenios G, Latsiou K, Diamantaras K, Chouvarda I, Tsolaki M. Diagnosis of Alzheimer's disease and Mild Cognitive Impairment using EEG and Recurrent Neural Networks. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3179-3182. [PMID: 36086481 DOI: 10.1109/embc48229.2022.9871302] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Alzheimer's disease (AD) is the main cause of dementia and Mild cognitive impairment (MCI) is a prodromal stage of AD whose early detection is considered crucial as it can contribute in slowing the progression of AD. In our study we attempted to classify a subject into AD, MCI, or Healthy Control (HC) groups with the use of electroencephalogram (EEG) data. Due to the time-series nature of EEG we exper-imented with the powerful recurrent neural network (RNN) classifiers and more specifically with models including basic or bidirectional Long Short-Term Memory (LSTM) modules. The EEG signals from 17 channels were preprocessed using a 0.1-32 Hz band-pass filter and then segmented into 2-second epochs during which, the subject had closed eyes. Finally, on each segment Fast Fourier Transform (FFT) was applied. To evaluate our models we studied four different classification problems: problem 1: separating subject into three classes (HC, MCI, AD) and problems 2-4: pairwise classifications AD vs. MCI, AD vs. HC and MCI vs. HC. For each problem we employed two different cross-validation approaches ( a) by segment and (b) by patient. In the first one, segments from a subject EEG may exist in both training and validations set, while in the second one, all the EEG segments of a subject can only exist in either the training or the validation set. In the AD-MCI-HC classification we achieved an accuracy of 99% by segment cross-validation, which was an improvement to earlier studies that utilized recurrent neural network models. In the pairwise classification problems we achieved over 90% accuracy by segment and over 80% by subject.
Collapse
|
9
|
Li X, Zhou T, Qiu S. Alzheimer's Disease Analysis Algorithm Based on No-threshold Recurrence Plot Convolution Network. Front Aging Neurosci 2022; 14:888577. [PMID: 35619941 PMCID: PMC9127346 DOI: 10.3389/fnagi.2022.888577] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 04/07/2022] [Indexed: 11/13/2022] Open
Abstract
Alzheimer's disease is a neurological disorder characterized by progressive cognitive dysfunction and behavioral impairment that occurs in old. Early diagnosis and treatment of Alzheimer's disease is great significance. Electroencephalography (EEG) signals can be used to detect Alzheimer's disease due to its non-invasive advantage. To solve the problem of insufficient analysis by single-channel EEG signal, we analyze the relationship between multiple channels and build PLV framework. To solve the problem of insufficient representation of 1D signal, a threshold-free recursive plot convolution network was constructed to realize 2D representation. To solve the problem of insufficient EEG signal characterization, a fusion algorithm of clinical features and imaging features was proposed to detect Alzheimer's disease. Experimental results show that the algorithm has good performance and robustness.
Collapse
Affiliation(s)
- Xuemei Li
- School of Mechanical and Electrical Engineering, Chengdu University of Technology, Chengdu, China
| | - Tao Zhou
- School of Computer Science and Engineering, North Minzu University, Yinchuan, China
- *Correspondence: Tao Zhou
| | - Shi Qiu
- Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, China
- Shi Qiu
| |
Collapse
|
10
|
Song Z, Deng B, Wang J, Yi G. An EEG-based systematic explainable detection framework for probing and localizing abnormal patterns in Alzheimer's disease. J Neural Eng 2022; 19. [PMID: 35453136 DOI: 10.1088/1741-2552/ac697d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 04/22/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Electroencephalography (EEG) is a potential source of downstream biomarkers for the early diagnosis of Alzheimer's disease (AD) due to its low-cost, non-invasive, and portable advantages. Accurately detecting AD-induced patterns from EEG signals is essential for understanding AD-related neurodegeneration at the EEG level and further evaluating the risk of AD at an early stage. This paper proposes a deep learning-based, functional explanatory framework that probes AD abnormalities from short-sequence EEG data. APPROACH The framework is a learning-based automatic detection system consisting of three encoding pathways that analyze EEG signals in frequency, complexity, and synchronous domains. We integrated the proposed EEG descriptors with the neural network components into one learning system to detect AD patterns. A transfer learning-based model was used to learn the deep representations, and a modified generative adversarial module was attached to the model to overcome feature sparsity. Furthermore, we utilized activation mapping to obtain the AD-related neurodegeneration at brain rhythm, dynamic complexity, and functional connectivity levels. MAIN RESULTS The proposed framework can accurately (100%) detect AD patterns based on our raw EEG recordings without delicate preprocessing. Meanwhile, the system indicates that 1) the power of different brain rhythms exhibits abnormal in the frontal lobes of AD patients, and such abnormality spreads to central lobes in the alpha and beta rhythms, 2) the difference in nonlinear complexity varies with the temporal scales, and 3) all the connections of pair-wise brain regions except bilateral temporal connectivity are weak in AD patterns. The proposed method outperforms other related methods in detection performance. SIGNIFICANCE We provide a new method for revealing abnormalities and corresponding localizations in different feature domains of EEG from AD patients. This study is a significant foundation for our future work on identifying individuals at high risk of AD at an early stage.
Collapse
Affiliation(s)
- Zhenxi Song
- Tianjin University, No.92 Weijin Road, Nankai District, Tianjin 300072, China, Tianjin, 300072, CHINA
| | - Bin Deng
- Tianjin University, No.92 Weijin Road, Nankai District, Tianjin 300072, China, Tianjin, Tianjin, 300072, CHINA
| | - Jiang Wang
- School of Electrical Engineering and Automation, Tianjin University, No.92 Weijin Road, Nankai District, Tianjin 300072, China, P. R. China, Tianjin, Tianjin, 300072, CHINA
| | - Guosheng Yi
- School of Electrical and Information Engineering, Tianjin University, No.92 Weijin Road, Nankai District, Tianjin 300072, China, Tianjin, Tianjin, 300072, CHINA
| |
Collapse
|
11
|
Geng D, Wang C, Fu Z, Zhang Y, Yang K, An H. Sleep EEG-Based Approach to Detect Mild Cognitive Impairment. Front Aging Neurosci 2022; 14:865558. [PMID: 35493944 PMCID: PMC9045132 DOI: 10.3389/fnagi.2022.865558] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 03/07/2022] [Indexed: 11/25/2022] Open
Abstract
Mild Cognitive Impairment (MCI) is an early stage of dementia, which may lead to Alzheimer's disease (AD) in older adults. Therefore, early detection of MCI and implementation of treatment and intervention can effectively slow down or even inhibit the progression of the disease, thus minimizing the risk of AD. Currently, we know that published work relies on an analysis of awake EEG recordings. However, recent studies have suggested that changes in the structure of sleep may lead to cognitive decline. In this work, we propose a sleep EEG-based method for MCI detection, extracting specific features of sleep to characterize neuroregulatory deficit emergent with MCI. This study analyzed the EEGs of 40 subjects (20 MCI, 20 HC) with the developed algorithm. We extracted sleep slow waves and spindles features, combined with spectral and complexity features from sleep EEG, and used the SVM classifier and GRU network to identify MCI. In addition, the classification results of different feature sets (including with sleep features from sleep EEG and without sleep features from awake EEG) and different classification methods were evaluated. Finally, the MCI classification accuracy of the GRU network based on features extracted from sleep EEG was the highest, reaching 93.46%. Experimental results show that compared with the awake EEG, sleep EEG can provide more useful information to distinguish between MCI and HC. This method can not only improve the classification performance but also facilitate the early intervention of AD.
Collapse
Affiliation(s)
- Duyan Geng
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China
- Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, Hebei University of Technology, Tianjin, China
| | - Chao Wang
- Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, Hebei University of Technology, Tianjin, China
| | - Zhigang Fu
- Physical Examination Center, The 983 Hospital of Joint Logistics Support Force of the Chinese People’s Liberation Army, Tianjin, China
| | - Yi Zhang
- Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, Hebei University of Technology, Tianjin, China
| | - Kai Yang
- Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, Hebei University of Technology, Tianjin, China
| | - Hongxia An
- Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, Hebei University of Technology, Tianjin, China
| |
Collapse
|
12
|
Alvi AM, Siuly S, Wang H. Neurological abnormality detection from electroencephalography data: a review. Artif Intell Rev 2021. [DOI: 10.1007/s10462-021-10062-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
13
|
Deng Y, Lu L, Aponte L, Angelidi AM, Novak V, Karniadakis GE, Mantzoros CS. Deep transfer learning and data augmentation improve glucose levels prediction in type 2 diabetes patients. NPJ Digit Med 2021; 4:109. [PMID: 34262114 PMCID: PMC8280162 DOI: 10.1038/s41746-021-00480-x] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 06/21/2021] [Indexed: 12/12/2022] Open
Abstract
Accurate prediction of blood glucose variations in type 2 diabetes (T2D) will facilitate better glycemic control and decrease the occurrence of hypoglycemic episodes as well as the morbidity and mortality associated with T2D, hence increasing the quality of life of patients. Owing to the complexity of the blood glucose dynamics, it is difficult to design accurate predictive models in every circumstance, i.e., hypo/normo/hyperglycemic events. We developed deep-learning methods to predict patient-specific blood glucose during various time horizons in the immediate future using patient-specific every 30-min long glucose measurements by the continuous glucose monitoring (CGM) to predict future glucose levels in 5 min to 1 h. In general, the major challenges to address are (1) the dataset of each patient is often too small to train a patient-specific deep-learning model, and (2) the dataset is usually highly imbalanced given that hypo- and hyperglycemic episodes are usually much less common than normoglycemia. We tackle these two challenges using transfer learning and data augmentation, respectively. We systematically examined three neural network architectures, different loss functions, four transfer-learning strategies, and four data augmentation techniques, including mixup and generative models. Taken together, utilizing these methodologies we achieved over 95% prediction accuracy and 90% sensitivity for a time period within the clinically useful 1 h prediction horizon that would allow a patient to react and correct either hypoglycemia and/or hyperglycemia. We have also demonstrated that the same network architecture and transfer-learning methods perform well for the type 1 diabetes OhioT1DM public dataset.
Collapse
Affiliation(s)
- Yixiang Deng
- School of Engineering, Brown University, Providence, RI, 02912, USA
| | - Lu Lu
- Department of Chemical and Biomolecular Engineering, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Laura Aponte
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02215, USA
| | - Angeliki M Angelidi
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02215, USA
| | - Vera Novak
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02215, USA
| | - George Em Karniadakis
- School of Engineering, Brown University, Providence, RI, 02912, USA.
- Division of Applied Mathematics, Brown University, Providence, RI, 02912, USA.
| | - Christos S Mantzoros
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, 02215, USA.
- VA Boston Healthcare System, Harvard Medical School, Boston, MA, 02215, USA.
| |
Collapse
|
14
|
Deep Learning-Based Stroke Disease Prediction System Using Real-Time Bio Signals. SENSORS 2021; 21:s21134269. [PMID: 34206540 PMCID: PMC8271462 DOI: 10.3390/s21134269] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 06/15/2021] [Accepted: 06/16/2021] [Indexed: 11/17/2022]
Abstract
The emergence of an aging society is inevitable due to the continued increases in life expectancy and decreases in birth rate. These social changes require new smart healthcare services for use in daily life, and COVID-19 has also led to a contactless trend necessitating more non-face-to-face health services. Due to the improvements that have been achieved in healthcare technologies, an increasing number of studies have attempted to predict and analyze certain diseases in advance. Research on stroke diseases is actively underway, particularly with the aging population. Stroke, which is fatal to the elderly, is a disease that requires continuous medical observation and monitoring, as its recurrence rate and mortality rate are very high. Most studies examining stroke disease to date have used MRI or CT images for simple classification. This clinical approach (imaging) is expensive and time-consuming while requiring bulky equipment. Recently, there has been increasing interest in using non-invasive measurable EEGs to compensate for these shortcomings. However, the prediction algorithms and processing procedures are both time-consuming because the raw data needs to be separated before the specific attributes can be obtained. Therefore, in this paper, we propose a new methodology that allows for the immediate application of deep learning models on raw EEG data without using the frequency properties of EEG. This proposed deep learning-based stroke disease prediction model was developed and trained with data collected from real-time EEG sensors. We implemented and compared different deep-learning models (LSTM, Bidirectional LSTM, CNN-LSTM, and CNN-Bidirectional LSTM) that are specialized in time series data classification and prediction. The experimental results confirmed that the raw EEG data, when wielded by the CNN-bidirectional LSTM model, can predict stroke with 94.0% accuracy with low FPR (6.0%) and FNR (5.7%), thus showing high confidence in our system. These experimental results demonstrate the feasibility of non-invasive methods that can easily measure brain waves alone to predict and monitor stroke diseases in real time during daily life. These findings are expected to lead to significant improvements for early stroke detection with reduced cost and discomfort compared to other measuring techniques.
Collapse
|
15
|
Huggins CJ, Escudero J, Parra MA, Scally B, Anghinah R, Vitória Lacerda De Araújo A, Basile LF, Abasolo D. Deep learning of resting-state electroencephalogram signals for three-class classification of Alzheimer's disease, mild cognitive impairment and healthy ageing. J Neural Eng 2021; 18. [PMID: 34044374 DOI: 10.1088/1741-2552/ac05d8] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Accepted: 05/27/2021] [Indexed: 11/12/2022]
Abstract
Objective.This study aimed to produce a novel deep learning (DL) model for the classification of subjects with Alzheimer's disease (AD), mild cognitive impairment (MCI) subjects and healthy ageing (HA) subjects using resting-state scalp electroencephalogram (EEG) signals.Approach.The raw EEG data were pre-processed to remove unwanted artefacts and sources of noise. The data were then processed with the continuous wavelet transform, using the Morse mother wavelet, to create time-frequency graphs with a wavelet coefficient scale range of 0-600. The graphs were combined into tiled topographical maps governed by the 10-20 system orientation for scalp electrodes. The application of this processing pipeline was used on a data set of resting-state EEG samples from age-matched groups of 52 AD subjects (82.3 ± 4.7 years of age), 37 MCI subjects (78.4 ± 5.1 years of age) and 52 HA subjects (79.6 ± 6.0 years of age). This resulted in the formation of a data set of 16197 topographical images. This image data set was then split into training, validation and test images and used as input to an AlexNet DL model. This model was comprised of five hidden convolutional layers and optimised for various parameters such as learning rate, learning rate schedule, optimiser, and batch size.Main results.The performance was assessed by a tenfold cross-validation strategy, which produced an average accuracy result of 98.9 ± 0.4% for the three-class classification of AD vs MCI vs HA. The results showed minimal overfitting and bias between classes, further indicating the strength of the model produced.Significance.These results provide significant improvement for this classification task compared to previous studies in this field and suggest that DL could contribute to the diagnosis of AD from EEG recordings.
Collapse
Affiliation(s)
- Cameron J Huggins
- Centre for Biomedical Engineering, Department of Mechanical Engineering Sciences, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford, United Kingdom
| | - Javier Escudero
- School of Engineering, Institute for Digital Communications, University of Edinburgh, Edinburgh, United Kingdom
| | - Mario A Parra
- School of Psychological Sciences and Health, University of Strathclyde, Glasgow, United Kingdom
| | - Brian Scally
- Institute of Psychological Sciences, University of Leeds, Leeds, United Kingdom
| | - Renato Anghinah
- Reference Center of Behavioural Disturbances and Dementia, School of Medicine, University of São Paulo, São Paulo, Brazil.,Traumatic Brain Injury Cognitive Rehabilitation Out-Patient Center, University of São Paulo, São Paulo, Brazil
| | | | - Luis F Basile
- Division of Neurosurgery, University of São Paulo Medical School, University of São Paulo, São Paulo, Brazil
| | - Daniel Abasolo
- Centre for Biomedical Engineering, Department of Mechanical Engineering Sciences, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford, United Kingdom
| |
Collapse
|
16
|
Abstract
Electroencephalogram signals are used to assess neurodegenerative diseases and develop sophisticated brain machine interfaces for rehabilitation and gaming. Most of the applications use only motor imagery or evoked potentials. Here, a deep learning network based on a sensory motor paradigm (auditory, olfactory, movement, and motor-imagery) that employs a subject-agnostic Bidirectional Long Short-Term Memory (BLSTM) Network is developed to assess cognitive functions and identify its relationship with brain signal features, which is hypothesized to consistently indicate cognitive decline. Testing occurred with healthy subjects of age 20–40, 40–60, and >60, and mildly cognitive impaired subjects. Auditory and olfactory stimuli were presented to the subjects and the subjects imagined and conducted movement of each arm during which Electroencephalogram (EEG)/Electromyogram (EMG) signals were recorded. A deep BLSTM Neural Network is trained with Principal Component features from evoked signals and assesses their corresponding pathways. Wavelet analysis is used to decompose evoked signals and calculate the band power of component frequency bands. This deep learning system performs better than conventional deep neural networks in detecting MCI. Most features studied peaked at the age range 40–60 and were lower for the MCI group than for any other group tested. Detection accuracy of left-hand motor imagery signals best indicated cognitive aging (p = 0.0012); here, the mean classification accuracy per age group declined from 91.93% to 81.64%, and is 69.53% for MCI subjects. Motor-imagery-evoked band power, particularly in gamma bands, best indicated (p = 0.007) cognitive aging. Although the classification accuracy of the potentials effectively distinguished cognitive aging from MCI (p < 0.05), followed by gamma-band power.
Collapse
|
17
|
Rim B, Sung NJ, Min S, Hong M. Deep Learning in Physiological Signal Data: A Survey. SENSORS (BASEL, SWITZERLAND) 2020; 20:E969. [PMID: 32054042 PMCID: PMC7071412 DOI: 10.3390/s20040969] [Citation(s) in RCA: 73] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 01/31/2020] [Accepted: 02/09/2020] [Indexed: 12/11/2022]
Abstract
Deep Learning (DL), a successful promising approach for discriminative and generative tasks, has recently proved its high potential in 2D medical imaging analysis; however, physiological data in the form of 1D signals have yet to be beneficially exploited from this novel approach to fulfil the desired medical tasks. Therefore, in this paper we survey the latest scientific research on deep learning in physiological signal data such as electromyogram (EMG), electrocardiogram (ECG), electroencephalogram (EEG), and electrooculogram (EOG). We found 147 papers published between January 2018 and October 2019 inclusive from various journals and publishers. The objective of this paper is to conduct a detailed study to comprehend, categorize, and compare the key parameters of the deep-learning approaches that have been used in physiological signal analysis for various medical applications. The key parameters of deep-learning approach that we review are the input data type, deep-learning task, deep-learning model, training architecture, and dataset sources. Those are the main key parameters that affect system performance. We taxonomize the research works using deep-learning method in physiological signal analysis based on: (1) physiological signal data perspective, such as data modality and medical application; and (2) deep-learning concept perspective such as training architecture and dataset sources.
Collapse
Affiliation(s)
- Beanbonyka Rim
- Department of Computer Science, Soonchunhyang University, Asan 31538, Korea
| | - Nak-Jun Sung
- Department of Computer Science, Soonchunhyang University, Asan 31538, Korea
| | - Sedong Min
- Department of Medical IT Engineering, Soonchunhyang University, Asan 31538, Korea
| | - Min Hong
- Department of Computer Software Engineering, Soonchunhyang University, Asan 31538, Korea
| |
Collapse
|
18
|
Gautam R, Sharma M. Prevalence and Diagnosis of Neurological Disorders Using Different Deep Learning Techniques: A Meta-Analysis. J Med Syst 2020; 44:49. [DOI: 10.1007/s10916-019-1519-7] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Accepted: 12/12/2019] [Indexed: 02/06/2023]
|
19
|
Craik A, He Y, Contreras-Vidal JL. Deep learning for electroencephalogram (EEG) classification tasks: a review. J Neural Eng 2019; 16:031001. [PMID: 30808014 DOI: 10.1088/1741-2552/ab0ab5] [Citation(s) in RCA: 444] [Impact Index Per Article: 88.8] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
OBJECTIVE Electroencephalography (EEG) analysis has been an important tool in neuroscience with applications in neuroscience, neural engineering (e.g. Brain-computer interfaces, BCI's), and even commercial applications. Many of the analytical tools used in EEG studies have used machine learning to uncover relevant information for neural classification and neuroimaging. Recently, the availability of large EEG data sets and advances in machine learning have both led to the deployment of deep learning architectures, especially in the analysis of EEG signals and in understanding the information it may contain for brain functionality. The robust automatic classification of these signals is an important step towards making the use of EEG more practical in many applications and less reliant on trained professionals. Towards this goal, a systematic review of the literature on deep learning applications to EEG classification was performed to address the following critical questions: (1) Which EEG classification tasks have been explored with deep learning? (2) What input formulations have been used for training the deep networks? (3) Are there specific deep learning network structures suitable for specific types of tasks? APPROACH A systematic literature review of EEG classification using deep learning was performed on Web of Science and PubMed databases, resulting in 90 identified studies. Those studies were analyzed based on type of task, EEG preprocessing methods, input type, and deep learning architecture. MAIN RESULTS For EEG classification tasks, convolutional neural networks, recurrent neural networks, deep belief networks outperform stacked auto-encoders and multi-layer perceptron neural networks in classification accuracy. The tasks that used deep learning fell into five general groups: emotion recognition, motor imagery, mental workload, seizure detection, event related potential detection, and sleep scoring. For each type of task, we describe the specific input formulation, major characteristics, and end classifier recommendations found through this review. SIGNIFICANCE This review summarizes the current practices and performance outcomes in the use of deep learning for EEG classification. Practical suggestions on the selection of many hyperparameters are provided in the hope that they will promote or guide the deployment of deep learning to EEG datasets in future research.
Collapse
|