1
|
Metin SZ, Uyulan Ç, Farhad S, Ergüzel TT, Türk Ö, Metin B, Çerezci Ö, Tarhan N. Deep Learning-Based Artificial Intelligence Can Differentiate Treatment-Resistant and Responsive Depression Cases with High Accuracy. Clin EEG Neurosci 2025; 56:119-130. [PMID: 39251228 DOI: 10.1177/15500594241273181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Abstract
Background: Although there are many treatment options available for depression, a large portion of patients with depression are diagnosed with treatment-resistant depression (TRD), which is characterized by an inadequate response to antidepressant treatment. Identifying the TRD population is crucial in terms of saving time and resources in depression treatment. Recently several studies employed various methods on EEG datasets for automatic depression detection or treatment outcome prediction. However, no previous study has used the deep learning (DL) approach and EEG signals for detecting treatment resistance. Method: 77 patients with TRD, 43 patients with non-TRD, and 40 healthy controls were compared using GoogleNet convolutional neural network and DL on EEG data. Additionally, Class Activation Maps (CAMs) acquired from the TRD and non-TRD groups were used to obtain distinctive regions for classification. Results: GoogleNet classified the healthy controls and non-TRD group with 88.43%, the healthy controls and TRD subjects with 89.73%, and the TRD and non-TRD group with 90.05% accuracy. The external validation accuracy for the TRD-non-TRD classification was 73.33%. Finally, the CAM analysis revealed that the TRD group contained dominant features in class detection of deep learning architecture in almost all electrodes. Limitations: Our study is limited by the moderate sample size of clinical groups and the retrospective nature of the study. Conclusion: These findings suggest that EEG-based deep learning can be used to classify treatment resistance in depression and may in the future prove to be a useful tool in psychiatry practice to identify patients who need more vigorous intervention.
Collapse
Affiliation(s)
| | - Çağlar Uyulan
- Department of Mechanical Engineering, Katip Çelebi University, İzmir, Turkey
| | - Shams Farhad
- Department of Neuroscience, Uskudar University, Istanbul, Turkey
| | - Türker Tekin Ergüzel
- Department of Software Engineering, Faculty of Engineering and Natural Sciences, Uskudar University, Istanbul, Turkey
| | - Ömer Türk
- Department of Computer Technologies, Artuklu University, Mardin, Turkey
| | - Barış Metin
- Neurology Department, Medical Faculty, Uskudar University, Istanbul, Turkey
| | - Önder Çerezci
- Department of Physioterapy and Rehabilitation, Faculty of Health SciencesUskudar University, Istanbul, Turkey
| | - Nevzat Tarhan
- Department of Psychiatry, Uskudar University, Istanbul, Turkey
| |
Collapse
|
2
|
Chen Q, Xia M, Li J, Luo Y, Wang X, Li F, Liang Y, Zhang Y. MDD-SSTNet: detecting major depressive disorder by exploring spectral-spatial-temporal information on resting-state electroencephalography data based on deep neural network. Cereb Cortex 2025; 35:bhae505. [PMID: 39841100 DOI: 10.1093/cercor/bhae505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2024] [Revised: 11/13/2024] [Accepted: 12/27/2024] [Indexed: 01/23/2025] Open
Abstract
Major depressive disorder (MDD) is a psychiatric disorder characterized by persistent lethargy that can lead to suicide in severe cases. Hence, timely and accurate diagnosis and treatment are crucial. Previous neuroscience studies have demonstrated that major depressive disorder subjects exhibit topological brain network changes and different temporal electroencephalography (EEG) characteristics compared to healthy controls. Based on these phenomena, we proposed a novel model, termed as MDD-SSTNet, for detecting major depressive disorder by exploring spectral-spatial-temporal information from resting-state EEG with deep convolutional neural network. Firstly, MDD-SSTNet used the Sinc filter to obtain specific frequency band features from pre-processed EEG data. Secondly, two parallel branches were used to extract temporal and spatial features through convolution and other operations. Finally, the model was trained with a combined loss function of center loss and Binary Cross-Entropy Loss. Using leave-one-subject-out cross-validation on the HUSM dataset and MODMA dataset, the MDD-SSTNet model outperformed six baseline models, achieving average classification accuracies of 93.85% and 65.08%, respectively. These results indicate that MDD-SSTNet could effectively mine spatial-temporal difference information between major depressive disorder subjects and healthy control subjects, and it holds promise to provide an efficient approach for MDD detection with EEG data.
Collapse
Affiliation(s)
- Qiurong Chen
- School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, 621010 Mianyang, China
| | - Min Xia
- School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, 621010 Mianyang, China
| | - Jinfei Li
- School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, 621010 Mianyang, China
| | - Yiqian Luo
- School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, 621010 Mianyang, China
| | - Xiuzhu Wang
- School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, 621010 Mianyang, China
| | - Fali Li
- School of Life Science and Technology, The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, 611731 Chengdu, China
- Research Unit of NeuroInformation, Chinese Academy of Medical Sciences, 2019RU035, Chengdu, China
- Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, 999078, Macau, China
| | - Yi Liang
- Department of Neurology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 610072 Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, 610072 Chengdu, China
| | - Yangsong Zhang
- School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, 621010 Mianyang, China
- School of Life Science and Technology, The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, 611731 Chengdu, China
| |
Collapse
|
3
|
Elnaggar K, El-Gayar MM, Elmogy M. Depression Detection and Diagnosis Based on Electroencephalogram (EEG) Analysis: A Systematic Review. Diagnostics (Basel) 2025; 15:210. [PMID: 39857094 PMCID: PMC11765027 DOI: 10.3390/diagnostics15020210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2024] [Revised: 01/03/2025] [Accepted: 01/07/2025] [Indexed: 01/27/2025] Open
Abstract
Background: Mental disorders are disturbances of brain functions that cause cognitive, affective, volitional, and behavioral functions to be disrupted to varying degrees. One of these disorders is depression, a significant factor contributing to the increase in suicide cases worldwide. Consequently, depression has become a significant public health issue globally. Electroencephalogram (EEG) data can be utilized to diagnose mild depression disorder (MDD), offering valuable insights into the pathophysiological mechanisms underlying mental disorders and enhancing the understanding of MDD. Methods: This survey emphasizes the critical role of EEG in advancing artificial intelligence (AI)-driven approaches for depression diagnosis. By focusing on studies that integrate EEG with machine learning (ML) and deep learning (DL) techniques, we systematically analyze methods utilizing EEG signals to identify depression biomarkers. The survey highlights advancements in EEG preprocessing, feature extraction, and model development, showcasing how these approaches enhance the diagnostic precision, scalability, and automation of depression detection. Results: This survey is distinguished from prior reviews by addressing their limitations and providing researchers with valuable insights for future studies. It offers a comprehensive comparison of ML and DL approaches utilizing EEG and an overview of the five key steps in depression detection. The survey also presents existing datasets for depression diagnosis and critically analyzes their limitations. Furthermore, it explores future directions and challenges, such as enhancing diagnostic robustness with data augmentation techniques and optimizing EEG channel selection for improved accuracy. The potential of transfer learning and encoder-decoder architectures to leverage pre-trained models and enhance diagnostic performance is also discussed. Advancements in feature extraction methods for automated depression diagnosis are highlighted as avenues for improving ML and DL model performance. Additionally, integrating Internet of Things (IoT) devices with EEG for continuous mental health monitoring and distinguishing between different types of depression are identified as critical research areas. Finally, the review emphasizes improving the reliability and predictability of computational intelligence-based models to advance depression diagnosis. Conclusions: This study will serve as a well-organized and helpful reference for researchers working on detecting depression using EEG signals and provide insights into the future directions outlined above, guiding further advancements in the field.
Collapse
Affiliation(s)
- Kholoud Elnaggar
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
| | - Mostafa M. El-Gayar
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
- Department of Computer Science, Arab East Colleges, Riyadh 11583, Saudi Arabia
| | - Mohammed Elmogy
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
| |
Collapse
|
4
|
Chung KH, Chang YS, Yen WT, Lin L, Abimannan S. Depression assessment using integrated multi-featured EEG bands deep neural network models: Leveraging ensemble learning techniques. Comput Struct Biotechnol J 2024; 23:1450-1468. [PMID: 38623563 PMCID: PMC11016871 DOI: 10.1016/j.csbj.2024.03.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 03/24/2024] [Accepted: 03/25/2024] [Indexed: 04/17/2024] Open
Abstract
Mental Status Assessment (MSA) holds significant importance in psychiatry. In recent years, several studies have leveraged Electroencephalogram (EEG) technology to gauge an individual's mental state or level of depression. This study introduces a novel multi-tier ensemble learning approach to integrate multiple EEG bands for conducting mental state or depression assessments. Initially, the EEG signal is divided into eight sub-bands, and then a Long Short-Term Memory (LSTM)-based Deep Neural Network (DNN) model is trained for each band. Subsequently, the integration of multi-band EEG frequency models and the evaluation of mental state or depression level are facilitated through a two-tier ensemble learning approach based on Multiple Linear Regression (MLR). The authors conducted numerous experiments to validate the performance of the proposed method under different evaluation metrics. For clarity and conciseness, the research employs the simplest commercialized one-channel EEG sensor, positioned at FP1, to collect data from 57 subjects (49 depressed and 18 healthy subjects). The obtained results, including an accuracy of 0.897, F1-score of 0.921, precision of 0.935, negative predictive value of 0.829, recall of 0.908, specificity of 0.875, and AUC of 0.8917, provide evidence of the superior performance of the proposed method compared to other ensemble learning techniques. This method not only proves effective but also holds the potential to significantly enhance the accuracy of depression assessment.
Collapse
Affiliation(s)
- Kuo-Hsuan Chung
- Department of Psychiatry and Psychiatric Research Center, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Psychiatry, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Yue-Shan Chang
- National Taipei University, Sanxia District, New Taipei City 237, Taiwan
| | - Wei-Ting Yen
- National Taipei University, Sanxia District, New Taipei City 237, Taiwan
| | - Linen Lin
- Department of Psychiatry, En Chu Kong Hospital, Taiwan
| | - Satheesh Abimannan
- Amity School of Engineering and Technology, Amity University Maharashtra, Mumbai, India
| |
Collapse
|
5
|
Khosravi M, Parsaei H, Rezaee K, Helfroush MS. Fusing convolutional learning and attention-based Bi-LSTM networks for early Alzheimer's diagnosis from EEG signals towards IoMT. Sci Rep 2024; 14:26002. [PMID: 39472526 PMCID: PMC11522596 DOI: 10.1038/s41598-024-77876-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Accepted: 10/25/2024] [Indexed: 11/02/2024] Open
Abstract
The Internet of Medical Things (IoMT) is poised to play a pivotal role in future medical support systems, enabling pervasive health monitoring in smart cities. Alzheimer's disease (AD) afflicts millions globally, and this paper explores the potential of electroencephalogram (EEG) data in addressing this challenge. We propose the Convolutional Learning Attention-Bidirectional Time-Aware Long-Short-Term Memory (CL-ATBiLSTM) model, a deep learning approach designed to classify different AD phases through EEG data analysis. The model utilizes Discrete Wavelet Transform (DWT) to decompose EEG data into distinct frequency bands, allowing for targeted analysis of AD-related brain activity patterns. Additionally, the data is segmented into smaller windows to handle the dynamic nature of EEG signals, and these segments are transformed into spectrogram images, visually depicting brain activity distribution over time and frequency. The CL-ATBiLSTM model incorporates convolutional layers to capture spatial features, attention mechanisms to emphasize crucial data, and BiLSTM networks to explore temporal relationships within the sequences. To optimize the model's performance, Bayesian optimization is employed to fine-tune the hyperparameters of the ATBiLSTM network, enhancing its ability to generalize and accurately classify AD stages. Incorporating Bayesian learning ensures the most effective model configuration, improving sensitivity and specificity for identifying AD-related patterns. Our model extracts discriminative features from EEG data to differentiate between AD, Mild Cognitive Impairment (MCI), and healthy controls (CO), offering a more comprehensive approach than existing two-class detection algorithms. By including the MCI category, our method facilitates earlier identification and potentially more impactful therapy interventions. Achieving a 96.52% accuracy on Figshare datasets containing AD, MCI, and CO groups, our approach demonstrates strong potential for practical use, accelerating AD identification, enhancing patient care, and contributing to the development of targeted treatments for this debilitating condition.
Collapse
Affiliation(s)
- Mohamadreza Khosravi
- Department of Medical Physics and Engineering, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran.
- IT Services, Lidoma Sanat Mehregan Part Ltd., Shiraz 71581, Fars, Iran.
- Shandong Provincial University Laboratory for Protected Horticulture (SPUL4PH), Weifang University of Science and Technology, Weifang 262700, China.
| | - Hossein Parsaei
- Department of Medical Physics and Engineering, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran.
- Shiraz Neuroscience Research Center, Shiraz University of Medical Sciences, Shiraz, Iran.
| | - Khosro Rezaee
- Department of Biomedical Engineering, Meybod University, Meybod, Iran
| | | |
Collapse
|
6
|
Lin H, Fang J, Zhang J, Zhang X, Piao W, Liu Y. Resting-State Electroencephalogram Depression Diagnosis Based on Traditional Machine Learning and Deep Learning: A Comparative Analysis. SENSORS (BASEL, SWITZERLAND) 2024; 24:6815. [PMID: 39517712 PMCID: PMC11548331 DOI: 10.3390/s24216815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Revised: 10/06/2024] [Accepted: 10/16/2024] [Indexed: 11/16/2024]
Abstract
The global prevalence of Major Depressive Disorder (MDD) is increasing at an alarming rate, underscoring the urgent need for timely and accurate diagnoses to facilitate effective interventions and treatments. Electroencephalography remains a widely used neuroimaging technique in psychiatry, due to its non-invasive nature and cost-effectiveness. With the rise of computational psychiatry, the integration of EEG with artificial intelligence has yielded remarkable results in diagnosing depression. This review offers a comparative analysis of two predominant methodologies in research: traditional machine learning and deep learning methods. Furthermore, this review addresses key challenges in current research and suggests potential solutions. These insights aim to enhance diagnostic accuracy for depression and also foster further development in the area of computational psychiatry.
Collapse
Affiliation(s)
- Haijun Lin
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China
| | - Jing Fang
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China
| | - Junpeng Zhang
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China
| | - Xuhui Zhang
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China
| | - Weiying Piao
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China
| | - Yukun Liu
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China
| |
Collapse
|
7
|
Shang S, Shi Y, Zhang Y, Liu M, Zhang H, Wang P, Zhuang L. Artificial intelligence for brain disease diagnosis using electroencephalogram signals. J Zhejiang Univ Sci B 2024; 25:914-940. [PMID: 39420525 PMCID: PMC11494159 DOI: 10.1631/jzus.b2400103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 08/27/2024] [Indexed: 10/19/2024]
Abstract
Brain signals refer to electrical signals or metabolic changes that occur as a consequence of brain cell activity. Among the various non-invasive measurement methods, electroencephalogram (EEG) stands out as a widely employed technique, providing valuable insights into brain patterns. The deviations observed in EEG reading serve as indicators of abnormal brain activity, which is associated with neurological diseases. Brain‒computer interface (BCI) systems enable the direct extraction and transmission of information from the human brain, facilitating interaction with external devices. Notably, the emergence of artificial intelligence (AI) has had a profound impact on the enhancement of precision and accuracy in BCI technology, thereby broadening the scope of research in this field. AI techniques, encompassing machine learning (ML) and deep learning (DL) models, have demonstrated remarkable success in classifying and predicting various brain diseases. This comprehensive review investigates the application of AI in EEG-based brain disease diagnosis, highlighting advancements in AI algorithms.
Collapse
Affiliation(s)
- Shunuo Shang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
- The MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310027, China
| | - Yingqian Shi
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Yajie Zhang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Mengxue Liu
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Hong Zhang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Ping Wang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China.
- The MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou 310027, China.
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 310027, China.
| | - Liujing Zhuang
- Biosensor National Special Laboratory, Key Laboratory for Biomedical Engineering of Education Ministry, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China.
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou 310027, China.
| |
Collapse
|
8
|
Abidi MH, Moiduddin K, Ayub R, Mohammed MK, Shankar A, Shiaeles S. EEGDepressionNet: A Novel Self Attention-Based Gated DenseNet With Hybrid Heuristic Adopted Mental Depression Detection Model Using EEG Signals. IEEE J Biomed Health Inform 2024; 28:5168-5179. [PMID: 38748519 DOI: 10.1109/jbhi.2024.3401389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/07/2024]
Abstract
World Health Organization (WHO) has identified depression as a significant contributor to global disability, creating a complex thread in both public and private health. Electroencephalogram (EEG) can accurately reveal the working condition of the human brain, and it is considered an effective tool for analyzing depression. However, manual depression detection using EEG signals is time-consuming and tedious. To address this, fully automatic depression identification models have been designed using EEG signals to assist clinicians. In this study, we propose a novel automated deep learning-based depression detection system using EEG signals. The required EEG signals are gathered from publicly available databases, and three sets of features are extracted from the original EEG signal. Firstly, spectrogram images are generated from the original EEG signal, and 3-dimensional Convolutional Neural Networks (3D-CNN) are employed to extract deep features. Secondly, 1D-CNN is utilized to extract deep features from the collected EEG signal. Thirdly, spectral features are extracted from the collected EEG signal. Following feature extraction, optimal weights are fused with the three sets of features. The selection of optimal features is carried out using the developed Chaotic Owl Invasive Weed Search Optimization (COIWSO) algorithm. Subsequently, the fused features undergo analysis using the Self-Attention-based Gated Densenet (SA-GDensenet) for depression detection. The parameters within the detection network are optimized with the assistance of the same COIWSO. Finally, implementation results are analyzed in comparison to existing detection models. The experimentation findings of the developed model show 96% of accuracy. Throughout the empirical result, the findings of the developed model show better performance than traditional approaches.
Collapse
|
9
|
Shen J, Li K, Liang H, Zhao Z, Ma Y, Wu J, Zhang J, Zhang Y, Hu B. HEMAsNet: A Hemisphere Asymmetry Network Inspired by the Brain for Depression Recognition From Electroencephalogram Signals. IEEE J Biomed Health Inform 2024; 28:5247-5259. [PMID: 38781058 DOI: 10.1109/jbhi.2024.3404664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/25/2024]
Abstract
Depression is a prevalent mental disorder that affects a significant portion of the global population. Despite recent advancements in EEG-based depression recognition models rooted in machine learning and deep learning approaches, many lack comprehensive consideration of depression's pathogenesis, leading to limited neuroscientific interpretability. To address these issues, we propose a hemisphere asymmetry network (HEMAsNet) inspired by the brain for depression recognition from EEG signals. HEMAsNet employs a combination of multi-scale Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) blocks to extract temporal features from both hemispheres of the brain. Moreover, the model introduces a unique 'Callosum-like' block, inspired by the corpus callosum's pivotal role in facilitating inter-hemispheric information transfer within the brain. This block enhances information exchange between hemispheres, potentially improving depression recognition accuracy. To validate the performance of HEMAsNet, we first confirmed the asymmetric features of frontal lobe EEG in the MODMA dataset. Subsequently, our method achieved a depression recognition accuracy of 0.8067, indicating its effectiveness in increasing classification performance. Furthermore, we conducted a comprehensive investigation from spatial and frequency perspectives, demonstrating HEMAsNet's innovation in explaining model decisions. The advantages of HEMAsNet lie in its ability to achieve more accurate and interpretable recognition of depression through the simulation of physiological processes, integration of spatial information, and incorporation of the Callosum-like block.
Collapse
|
10
|
Yin J, Jia X, Li H, Zhao B, Yang Y, Ren TL. Recent Progress in Biosensors for Depression Monitoring-Advancing Personalized Treatment. BIOSENSORS 2024; 14:422. [PMID: 39329797 PMCID: PMC11430531 DOI: 10.3390/bios14090422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Revised: 08/26/2024] [Accepted: 08/28/2024] [Indexed: 09/28/2024]
Abstract
Depression is currently a major contributor to unnatural deaths and the healthcare burden globally, and a patient's battle with depression is often a long one. Because the causes, symptoms, and effects of medications are complex and highly individualized, early identification and personalized treatment of depression are key to improving treatment outcomes. The development of wearable electronics, machine learning, and other technologies in recent years has provided more possibilities for the realization of this goal. Conducting regular monitoring through biosensing technology allows for a more comprehensive and objective analysis than previous self-evaluations. This includes identifying depressive episodes, distinguishing somatization symptoms, analyzing etiology, and evaluating the effectiveness of treatment programs. This review summarizes recent research on biosensing technologies for depression. Special attention is given to technologies that can be portable or wearable, with the potential to enable patient use outside of the hospital, for long periods.
Collapse
Affiliation(s)
- Jiaju Yin
- School of Integrated Circuits, Tsinghua University, Beijing 100084, China; (J.Y.); (B.Z.)
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Xinyuan Jia
- Xingjian College, Tsinghua University, Beijing 100084, China;
| | - Haorong Li
- Weiyang College, Tsinghua University, Beijing 100084, China;
| | - Bingchen Zhao
- School of Integrated Circuits, Tsinghua University, Beijing 100084, China; (J.Y.); (B.Z.)
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Yi Yang
- School of Integrated Circuits, Tsinghua University, Beijing 100084, China; (J.Y.); (B.Z.)
| | - Tian-Ling Ren
- School of Integrated Circuits, Tsinghua University, Beijing 100084, China; (J.Y.); (B.Z.)
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
- Center for Flexible Electronics Technology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
11
|
Kim HG, Song S, Cho BH, Jang DP. Deep learning-based stress detection for daily life use using single-channel EEG and GSR in a virtual reality interview paradigm. PLoS One 2024; 19:e0305864. [PMID: 38959272 PMCID: PMC11221693 DOI: 10.1371/journal.pone.0305864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Accepted: 06/04/2024] [Indexed: 07/05/2024] Open
Abstract
This research aims to establish a practical stress detection framework by integrating physiological indicators and deep learning techniques. Utilizing a virtual reality (VR) interview paradigm mirroring real-world scenarios, our focus is on classifying stress states through accessible single-channel electroencephalogram (EEG) and galvanic skin response (GSR) data. Thirty participants underwent stress-inducing VR interviews, with biosignals recorded for deep learning models. Five convolutional neural network (CNN) architectures and one Vision Transformer model, including a multiple-column structure combining EEG and GSR features, showed heightened predictive capabilities and an enhanced area under the receiver operating characteristic curve (AUROC) in stress prediction compared to single-column models. Our experimental protocol effectively elicited stress responses, observed through fluctuations in stress visual analogue scale (VAS), EEG, and GSR metrics. In the single-column architecture, ResNet-152 excelled with a GSR AUROC of 0.944 (±0.027), while the Vision Transformer performed well in EEG, achieving peak AUROC values of 0.886 (±0.069) respectively. Notably, the multiple-column structure, based on ResNet-50, achieved the highest AUROC value of 0.954 (±0.018) in stress classification. Through VR-based simulated interviews, our study induced social stress responses, leading to significant modifications in GSR and EEG measurements. Deep learning models precisely classified stress levels, with the multiple-column strategy demonstrating superiority. Additionally, discreetly placing single-channel EEG measurements behind the ear enhances the convenience and accuracy of stress detection in everyday situations.
Collapse
Affiliation(s)
- Hun-gyeom Kim
- Department of Biomedical Engineering, Hanyang University, Seoul, Korea
| | - Solwoong Song
- Department of Biomedical Engineering, Hanyang University, Seoul, Korea
| | - Baek Hwan Cho
- Department of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Korea
- Institute of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Korea
| | - Dong Pyo Jang
- Department of Biomedical Engineering, Hanyang University, Seoul, Korea
| |
Collapse
|
12
|
Tong W, Yue W, Chen F, Shi W, Zhang L, Wan J. MSE-VGG: A Novel Deep Learning Approach Based on EEG for Rapid Ischemic Stroke Detection. SENSORS (BASEL, SWITZERLAND) 2024; 24:4234. [PMID: 39001013 PMCID: PMC11244239 DOI: 10.3390/s24134234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 06/12/2024] [Accepted: 06/27/2024] [Indexed: 07/16/2024]
Abstract
Ischemic stroke is a type of brain dysfunction caused by pathological changes in the blood vessels of the brain which leads to brain tissue ischemia and hypoxia and ultimately results in cell necrosis. Without timely and effective treatment in the early time window, ischemic stroke can lead to long-term disability and even death. Therefore, rapid detection is crucial in patients with ischemic stroke. In this study, we developed a deep learning model based on fusion features extracted from electroencephalography (EEG) signals for the fast detection of ischemic stroke. Specifically, we recruited 20 ischemic stroke patients who underwent EEG examination during the acute phase of stroke and collected EEG signals from 19 adults with no history of stroke as a control group. Afterwards, we constructed correlation-weighted Phase Lag Index (cwPLI), a novel feature, to explore the synchronization information and functional connectivity between EEG channels. Moreover, the spatio-temporal information from functional connectivity and the nonlinear information from complexity were fused by combining the cwPLI matrix and Sample Entropy (SaEn) together to further improve the discriminative ability of the model. Finally, the novel MSE-VGG network was employed as a classifier to distinguish ischemic stroke from non-ischemic stroke data. Five-fold cross-validation experiments demonstrated that the proposed model possesses excellent performance, with accuracy, sensitivity, and specificity reaching 90.17%, 89.86%, and 90.44%, respectively. Experiments on time consumption verified that the proposed method is superior to other state-of-the-art examinations. This study contributes to the advancement of the rapid detection of ischemic stroke, shedding light on the untapped potential of EEG and demonstrating the efficacy of deep learning in ischemic stroke identification.
Collapse
Affiliation(s)
- Wei Tong
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Weiqi Yue
- School of Computer Science, Hangzhou Dianzi University, Hangzhou 310018, China;
| | - Fangni Chen
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Wei Shi
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Lei Zhang
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Jian Wan
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| |
Collapse
|
13
|
Fernandez Rojas R, Joseph C, Bargshady G, Ou KL. Empirical comparison of deep learning models for fNIRS pain decoding. Front Neuroinform 2024; 18:1320189. [PMID: 38420133 PMCID: PMC10899478 DOI: 10.3389/fninf.2024.1320189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 01/26/2024] [Indexed: 03/02/2024] Open
Abstract
Introduction Pain assessment is extremely important in patients unable to communicate and it is often done by clinical judgement. However, assessing pain using observable indicators can be challenging for clinicians due to the subjective perceptions, individual differences in pain expression, and potential confounding factors. Therefore, the need for an objective pain assessment method that can assist medical practitioners. Functional near-infrared spectroscopy (fNIRS) has shown promising results to assess the neural function in response of nociception and pain. Previous studies have explored the use of machine learning with hand-crafted features in the assessment of pain. Methods In this study, we aim to expand previous studies by exploring the use of deep learning models Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and (CNN-LSTM) to automatically extract features from fNIRS data and by comparing these with classical machine learning models using hand-crafted features. Results The results showed that the deep learning models exhibited favourable results in the identification of different types of pain in our experiment using only fNIRS input data. The combination of CNN and LSTM in a hybrid model (CNN-LSTM) exhibited the highest performance (accuracy = 91.2%) in our problem setting. Statistical analysis using one-way ANOVA with Tukey's (post-hoc) test performed on accuracies showed that the deep learning models significantly improved accuracy performance as compared to the baseline models. Discussion Overall, deep learning models showed their potential to learn features automatically without relying on manually-extracted features and the CNN-LSTM model could be used as a possible method of assessment of pain in non-verbal patients. Future research is needed to evaluate the generalisation of this method of pain assessment on independent populations and in real-life scenarios.
Collapse
Affiliation(s)
- Raul Fernandez Rojas
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| | - Calvin Joseph
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| | - Ghazal Bargshady
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| | - Keng-Liang Ou
- Department of Dentistry, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Dentistry, Taipei Medical University-Shuang Ho Hospital, New Taipei City, Taiwan
- 3D Global Biotech Inc., New Taipei City, Taiwan
| |
Collapse
|
14
|
Wang Y, Zhao S, Jiang H, Li S, Luo B, Li T, Pan G. DiffMDD: A Diffusion-Based Deep Learning Framework for MDD Diagnosis Using EEG. IEEE Trans Neural Syst Rehabil Eng 2024; 32:728-738. [PMID: 38294930 DOI: 10.1109/tnsre.2024.3360465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2024]
Abstract
Major Depression Disorder (MDD) is a common yet destructive mental disorder that affects millions of people worldwide. Making early and accurate diagnosis of it is very meaningful. Recently, EEG, a non-invasive technique of recording spontaneous electrical activity of brains, has been widely used for MDD diagnosis. However, there are still some challenges in data quality and data size of EEG: (1) A large amount of noise is inevitable during EEG collection, making it difficult to extract discriminative features from raw EEG; (2) It is difficult to recruit a large number of subjects to collect sufficient and diverse data for model training. Both of the challenges cause the overfitting problem, especially for deep learning methods. In this paper, we propose DiffMDD, a diffusion-based deep learning framework for MDD diagnosis using EEG. Specifically, we extract more noise-irrelevant features to improve the model's robustness by designing the Forward Diffusion Noisy Training Module. Then we increase the size and diversity of data to help the model learn more generalized features by designing the Reverse Diffusion Data Augmentation Module. Finally, we re-train the classifier on the augmented dataset for MDD diagnosis. We conducted comprehensive experiments to test the overall performance and each module's effectiveness. The framework was validated on two public MDD diagnosis datasets, achieving the state-of-the-art performance.
Collapse
|
15
|
Sun X, Xu Y, Zhao Y, Zheng X, Zheng Y, Cui L. Multi-Granularity Graph Convolution Network for Major Depressive Disorder Recognition. IEEE Trans Neural Syst Rehabil Eng 2024; 32:559-569. [PMID: 37665697 DOI: 10.1109/tnsre.2023.3311458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
Major depressive disorder (MDD) is the most common psychological disease. To improve the recognition accuracy of MDD, more and more machine learning methods have been proposed to mining EEG features, i.e. typical brain functional patterns and recognition methods that are closely related to depression using resting EEG signals. Most existing methods typically utilize threshold methods to filter weak connections in the brain functional connectivity network (BFCN) and construct quantitative statistical features of brain function to measure the BFCN. However, these thresholds may excessively remove weak connections with functional relevance, which is not conducive to discovering potential hidden patterns in weak connections. In addition, statistical features cannot describe the topological structure features and information network propagation patterns of the brain's different functional regions. To solve these problems, we propose a novel MDD recognition method based on a multi-granularity graph convolution network (MGGCN). On the one hand, this method applies multiple sets of different thresholds to build a multi-granularity functional neural network, which can remove noise while fully retaining valuable weak connections. On the other hand, this method utilizes graph neural network to learn the topological structure features and brain saliency patterns of changes between brain functional regions on the multi-granularity functional neural network. Experimental results on the benchmark datasets validate the superior performance and time complexity of MGGCN. The analysis shows that as the granularity increases, the connectivity defects in the right frontal(RF) and right temporal (RT) regions, left temporal(LT) and left posterior(LP) regions increase. The brain functional connections in these regions can serve as potential biomarkers for MDD recognition.
Collapse
|
16
|
Chugh N, Aggarwal S, Balyan A. The Hybrid Deep Learning Model for Identification of Attention-Deficit/Hyperactivity Disorder Using EEG. Clin EEG Neurosci 2024; 55:22-33. [PMID: 37682533 DOI: 10.1177/15500594231193511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Common misbehavior among children that prevents them from paying attention to tasks and interacting with their surroundings appropriately is attention-deficit/hyperactivity disorder (ADHD). Studies of children's behavior presently face a significant problem in the early and timely diagnosis of this disease. To diagnose this disease, doctors often use the patient's description and questionnaires, psychological tests, and the patient's behavior in which reliability is questionable. Convolutional neural network (CNN) is one deep learning technique that has been used for the diagnosis of ADHD. CNN, however, does not account for how signals change over time, which leads to low classification performances and ambiguous findings. In this study, the authors designed a hybrid deep learning model that combines long-short-term memory (LSTM) and CNN to simultaneously extract and learn the spatial features and long-term dependencies of the electroencephalography (EEG) data. The effectiveness of the proposed hybrid deep learning model was assessed using 2 publicly available EEG datasets. The suggested model achieves a classification accuracy of 98.86% on the ADHD dataset and 98.28% on the FOCUS dataset, respectively. The experimental findings show that the proposed hybrid CNN-LSTM model outperforms the state-of-the-art methods to diagnose ADHD using EEG. Hence, the proposed hybrid CNN-LSTM model could therefore be utilized to help with the clinical diagnosis of ADHD patients.
Collapse
Affiliation(s)
- Nupur Chugh
- Netaji Subhas Institute of Technology, New Delhi, India
| | - Swati Aggarwal
- Netaji Subhas University of Technology, New Delhi, India
| | - Arnav Balyan
- Netaji Subhas Institute of Technology, New Delhi, India
| |
Collapse
|
17
|
Tian F, Zhu L, Shi Q, Wang R, Zhang L, Dong Q, Qian K, Zhao Q, Hu B. The Three-Lead EEG Sensor: Introducing an EEG-Assisted Depression Diagnosis System Based on Ant Lion Optimization. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2023; 17:1305-1318. [PMID: 37402182 DOI: 10.1109/tbcas.2023.3292237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/06/2023]
Abstract
For depression diagnosis, traditional methods such as interviews and clinical scales have been widely leveraged in the past few decades, but they are subjective, time-consuming, and labor-consuming. With the development of affective computing and Artificial Intelligence (AI) technologies, Electroencephalogram (EEG)-based depression detection methods have emerged. However, previous research has virtually neglected practical application scenarios, as most studies have focused on analyzing and modeling EEG data. Furthermore, EEG data is typically obtained from specialized devices that are large, complex to operate, and poorly ubiquitous. To address these challenges, a wearable three-lead EEG sensor with flexible electrodes was developed to obtain prefrontal-lobe EEG data. Experimental measurements show that the EEG sensor achieves promising performance (background noise of no more than 0.91 μVpp, Signal-to-Noise Ratio (SNR) of 26--48 dB, and electrode-skin contact impedance of less than 1 K Ω). In addition, EEG data from 70 depressed patients and 108 healthy controls were collected using the EEG sensor, and the linear and nonlinear features were extracted. The features were then weighted and selected using the Ant Lion Optimization (ALO) algorithm to improve classification performance. The experimental results show that the k-NN classifier achieves a classification accuracy of 90.70%, specificity of 96.53%, and sensitivity of 81.79%, indicating the promising potential of the three-lead EEG sensor combined with the ALO algorithm and the k-NN classifier for EEG-assisted depression diagnosis.
Collapse
|
18
|
Tigga NP, Garg S. Efficacy of novel attention-based gated recurrent units transformer for depression detection using electroencephalogram signals. Health Inf Sci Syst 2023; 11:1. [PMID: 36590874 PMCID: PMC9800680 DOI: 10.1007/s13755-022-00205-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 12/13/2022] [Indexed: 12/30/2022] Open
Abstract
Purpose Depression is a global challenge causing psychological and intellectual problems that require efficient diagnosis. Electroencephalogram (EEG) signals represent the functional state of the human brain and can help build an accurate and viable technique for the early prediction and treatment of depression. Methods An attention-based gated recurrent units transformer (AttGRUT) time-series model is proposed to efficiently identify EEG perturbations in depressive patients. Statistical, spectral and wavelet features were first extracted from the 60-channel EEG signal data. Then, two feature selection techniques, recursive feature elimination and the Boruta algorithm, both with Shapley additive explanations, were utilised for selecting essential features. Results The proposed model outperformed the two baseline and two hybrid time-series models-long short-term memory (LSTM), gated recurrent units (GRU), convolutional neural network-LSTM (CNN-LSTM), and CNN-GRU-achieving an accuracy of up to 98.67%. Feature selection considerably increased the performance across all time-series models. Conclusion Based on the obtained results, novel feature selection greatly affected the results of the baseline and hybrid time-series models. The proposed AttGRUT can be implemented and tested in other domains by using different modalities for prediction. Supplementary Information The online version contains supplementary material available at 10.1007/s13755-022-00205-8.
Collapse
Affiliation(s)
| | - Shruti Garg
- Birla Institute of Technology, Mesra, Ranchi, India
| |
Collapse
|
19
|
Wang HG, Meng QH, Jin LC, Hou HR. AMGCN-L: an adaptive multi-time-window graph convolutional network with long-short-term memory for depression detection. J Neural Eng 2023; 20:056038. [PMID: 37844566 DOI: 10.1088/1741-2552/ad038b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 10/16/2023] [Indexed: 10/18/2023]
Abstract
Objective.Depression is a common chronic mental disorder characterized by high rates of prevalence, recurrence, suicide, and disability as well as heavy disease burden. An accurate diagnosis of depression is a prerequisite for treatment. However, existing questionnaire-based diagnostic methods are limited by the innate subjectivity of medical practitioners and subjects. In the search for a more objective diagnostic methods for depression, researchers have recently started to use deep learning approaches.Approach.In this work, a deep-learning network, named adaptively multi-time-window graph convolutional network (GCN) with long-short-term memory (LSTM) (i.e. AMGCN-L), is proposed. This network can automatically categorize depressed and non-depressed people by testing for the existence of inherent brain functional connectivity and spatiotemporal features contained in electroencephalogram (EEG) signals. AMGCN-L is mainly composed of two sub-networks: the first sub-network is an adaptive multi-time-window graph generation block with which adjacency matrices that contain brain functional connectivity on different time periods are adaptively designed. The second sub-network consists of GCN and LSTM, which are used to fully extract the innate spatial and temporal features of EEG signals, respectively.Main results.Two public datasets, namely the patient repository for EEG data and computational tools, and the multi-modal open dataset for mental-disorder analysis, were used to test the performance of the proposed network; the depression recognition accuracies achieved in both datasets (using tenfold cross-validation) were 90.38% and 90.57%, respectively.Significance.This work demonstrates that GCN and LSTM have eminent effects on spatial and temporal feature extraction, respectively, suggesting that the exploration of brain connectivity and the exploitation of spatiotemporal features benefit the detection of depression. Moreover, the proposed method provides effective support and supplement for the detection of clinical depression and later treatment procedures.
Collapse
Affiliation(s)
- Han-Guang Wang
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| | - Qing-Hao Meng
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| | - Li-Cheng Jin
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| | - Hui-Rang Hou
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| |
Collapse
|
20
|
Xu Y, Zhong H, Ying S, Liu W, Chen G, Luo X, Li G. Depressive Disorder Recognition Based on Frontal EEG Signals and Deep Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:8639. [PMID: 37896732 PMCID: PMC10611358 DOI: 10.3390/s23208639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 10/10/2023] [Accepted: 10/18/2023] [Indexed: 10/29/2023]
Abstract
Depressive disorder (DD) has become one of the most common mental diseases, seriously endangering both the affected person's psychological and physical health. Nowadays, a DD diagnosis mainly relies on the experience of clinical psychiatrists and subjective scales, lacking objective, accurate, practical, and automatic diagnosis technologies. Recently, electroencephalogram (EEG) signals have been widely applied for DD diagnosis, but mainly with high-density EEG, which can severely limit the efficiency of the EEG data acquisition and reduce the practicability of diagnostic techniques. The current study attempts to achieve accurate and practical DD diagnoses based on combining frontal six-channel electroencephalogram (EEG) signals and deep learning models. To this end, 10 min clinical resting-state EEG signals were collected from 41 DD patients and 34 healthy controls (HCs). Two deep learning models, multi-resolution convolutional neural network (MRCNN) combined with long short-term memory (LSTM) (named MRCNN-LSTM) and MRCNN combined with residual squeeze and excitation (RSE) (named MRCNN-RSE), were proposed for DD recognition. The results of this study showed that the higher EEG frequency band obtained the better classification performance for DD diagnosis. The MRCNN-RSE model achieved the highest classification accuracy of 98.48 ± 0.22% with 8-30 Hz EEG signals. These findings indicated that the proposed analytical framework can provide an accurate and practical strategy for DD diagnosis, as well as essential theoretical and technical support for the treatment and efficacy evaluation of DD.
Collapse
Affiliation(s)
- Yanting Xu
- College of Engineering, Zhejiang Normal University, Jinhua 321004, China; (Y.X.); (S.Y.)
| | - Hongyang Zhong
- College of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; (H.Z.); (W.L.); (G.C.)
| | - Shangyan Ying
- College of Engineering, Zhejiang Normal University, Jinhua 321004, China; (Y.X.); (S.Y.)
| | - Wei Liu
- College of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; (H.Z.); (W.L.); (G.C.)
| | - Guibin Chen
- College of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; (H.Z.); (W.L.); (G.C.)
| | - Xiaodong Luo
- The Second Hospital of Jinhua, Jinhua 321016, China
| | - Gang Li
- College of Mathematical Medicine, Zhejiang Normal University, Jinhua 321004, China
| |
Collapse
|
21
|
Luo G, Rao H, An P, Li Y, Hong R, Chen W, Chen S. Exploring Adaptive Graph Topologies and Temporal Graph Networks for EEG-Based Depression Detection. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3947-3957. [PMID: 37773916 DOI: 10.1109/tnsre.2023.3320693] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/01/2023]
Abstract
In recent years, Graph Neural Networks (GNNs) based on deep learning techniques have achieved promising results in EEG-based depression detection tasks but still have some limitations. Firstly, most existing GNN-based methods use pre-computed graph adjacency matrices, which ignore the differences in brain networks between individuals. Additionally, methods based on graph-structured data do not consider the temporal dependency information of brain networks. To address these issues, we propose a deep learning algorithm that explores adaptive graph topologies and temporal graph networks for EEG-based depression detection. Specifically, we designed an Adaptive Graph Topology Generation (AGTG) module that can adaptively model the real-time connectivity of the brain networks, revealing differences between individuals. In addition, we designed a Graph Convolutional Gated Recurrent Unit (GCGRU) module to capture the temporal dynamical changes of brain networks. To further explore the differential features between depressed and healthy individuals, we adopt Graph Topology-based Max-Pooling (GTMP) module to extract graph representation vectors accurately. We conduct a comparative analysis with several advanced algorithms on both public and our own datasets. The results reveal that our final model achieves the highest Area Under the Receiver Operating Characteristic Curve (AUROC) on both datasets, with values of 83% and 99%, respectively. Furthermore, we perform extensive validation experiments demonstrating our proposed method's effectiveness and advantages. Finally, we present a comprehensive discussion on the differences in brain networks between healthy and depressed individuals based on the outputs of our final model's AGTG and GTMP modules.
Collapse
|
22
|
Qi X, Xu W, Li G. Neuroimaging Study of Brain Functional Differences in Generalized Anxiety Disorder and Depressive Disorder. Brain Sci 2023; 13:1282. [PMID: 37759883 PMCID: PMC10526432 DOI: 10.3390/brainsci13091282] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 08/23/2023] [Accepted: 08/31/2023] [Indexed: 09/29/2023] Open
Abstract
Generalized anxiety disorder (GAD) and depressive disorder (DD) are distinct mental disorders, which are characterized by complex and unique neuroelectrophysiological mechanisms in psychiatric neurosciences. The understanding of the brain functional differences between GAD and DD is crucial for the accurate diagnosis and clinical efficacy evaluation. The aim of this study was to reveal the differences in functional brain imaging between GAD and DD based on multidimensional electroencephalogram (EEG) characteristics. To this end, 10 min resting-state EEG signals were recorded from 38 GAD and 34 DD individuals. Multidimensional EEG features were subsequently extracted, which include power spectrum density (PSD), fuzzy entropy (FE), and phase lag index (PLI). Then, a direct statistical analysis (i.e., ANOVA) and three ensemble learning models (i.e., Random Forest (RF), Light Gradient Boosting Machine (LightGBM), eXtreme Gradient Boosting (XGBoost)) were used on these EEG features for the differential recognitions. Our results showed that DD has significantly higher PSD values in the alpha1 and beta band, and a higher FE in the beta band, in comparison with GAD, along with the aberrant functional connections in all four bands between GAD and DD. Moreover, machine learning analysis further revealed that the distinct features predominantly occurred in the beta band and functional connections. Here, we show that DD has higher power and more complex brain activity patterns in the beta band and reorganized brain functional network structures in all bands compared to GAD. In sum, these findings move towards the practical identification of brain functional differences between GAD and DD.
Collapse
Affiliation(s)
- Xuchen Qi
- Department of Neurosurgery, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310000, China;
- Department of Neurosurgery, Shaoxing People’s Hospital, Shaoxing 312000, China
| | - Wanxiu Xu
- College of Engineering, Zhejiang Normal University, Jinhua 321004, China;
| | - Gang Li
- College of Mathematical Medicine, Zhejiang Normal University, Jinhua 321004, China
| |
Collapse
|
23
|
Shahabi MS, Shalbaf A, Rostami R. Prediction of response to repetitive transcranial magnetic stimulation for major depressive disorder using hybrid Convolutional recurrent neural networks and raw Electroencephalogram Signal. Cogn Neurodyn 2023; 17:909-920. [PMID: 37522037 PMCID: PMC10374518 DOI: 10.1007/s11571-022-09881-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 08/03/2022] [Accepted: 08/28/2022] [Indexed: 11/30/2022] Open
Abstract
Major Depressive Disorder (MDD) is a high prevalence disease that needs an effective and timely treatment to prevent its progress and additional costs. Repetitive Transcranial Magnetic Stimulation (rTMS) is an effective treatment option for MDD patients which uses strong magnetic pulses to stimulate specific regions of the brain. However, some patients do not respond to this treatment which causes the waste of multiple weeks as treatment time and clinical resources. Therefore developing an effective way for the prediction of response to the rTMS treatment of depression is necessary. In this work, we proposed a hybrid model created by pre-trained Convolutional Neural Networks (CNN) models and Bidirectional Long Short-Term Memory (BLSTM) cells to predict response to rTMS treatment from raw EEG signal. Three pre-trained CNN models named VGG16, InceptionResNetV2, and EffecientNetB0 were utilized as Transfer Learning (TL) models to construct hybrid TL-BLSTM models. Then an ensemble of these models was created using weighted majority voting which the weights were optimized by Differential Evolution (DE) optimization algorithm. Evaluation of these models shows the superior performance of the ensemble model by the accuracy of 98.51%, sensitivity of 98.64%, specificity of 98.36%, F1-score of 98.6%, and AUC of 98.5%. Therefore, the ensemble of the proposed hybrid convolutional recurrent networks can efficiently predict the treatment outcome of rTMS using raw EEG data.
Collapse
Affiliation(s)
- Mohsen Sadat Shahabi
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Reza Rostami
- Department of Psychology, University of Tehran, Tehran, Iran
| |
Collapse
|
24
|
Ksibi A, Zakariah M, Menzli LJ, Saidani O, Almuqren L, Hanafieh RAM. Electroencephalography-Based Depression Detection Using Multiple Machine Learning Techniques. Diagnostics (Basel) 2023; 13:1779. [PMID: 37238263 PMCID: PMC10217709 DOI: 10.3390/diagnostics13101779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 04/28/2023] [Accepted: 05/08/2023] [Indexed: 05/28/2023] Open
Abstract
The growth of biomedical engineering has made depression diagnosis via electroencephalography (EEG) a trendy issue. The two significant challenges to this application are EEG signals' complexity and non-stationarity. Additionally, the effects caused by individual variances may hamper the generalization of detection systems. Given the association between EEG signals and particular demographics, such as gender and age, and the influences of these demographic characteristics on the incidence of depression, it would be preferable to include demographic factors during EEG modeling and depression detection. The main objective of this work is to develop an algorithm that can recognize depression patterns by studying EEG data. Following a multiband analysis of such signals, machine learning and deep learning techniques were used to detect depression patients automatically. EEG signal data are collected from the multi-modal open dataset MODMA and employed in studying mental diseases. The EEG dataset contains information from a traditional 128-electrode elastic cap and a cutting-edge wearable 3-electrode EEG collector for widespread applications. In this project, resting EEG readings of 128 channels are considered. According to CNN, training with 25 epoch iterations had a 97% accuracy rate. The patient's status has to be divided into two basic categories: major depressive disorder (MDD) and healthy control. Additional MDD include the following six classes: obsessive-compulsive disorders, addiction disorders, conditions brought on by trauma and stress, mood disorders, schizophrenia, and the anxiety disorders discussed in this paper are a few examples of mental illnesses. According to the study, a natural combination of EEG signals and demographic data is promising for the diagnosis of depression.
Collapse
Affiliation(s)
- Amel Ksibi
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Mohammed Zakariah
- Department of Computer Science, College of Computer and Information Sciences, Riyadh 11442, Saudi Arabia
| | - Leila Jamel Menzli
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Oumaima Saidani
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Latifah Almuqren
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Rosy Awny Mohamed Hanafieh
- Department of Computer Science, College of Computing in Al-Qunfudah, Umm Al-Qura University, Makkah 24382, Saudi Arabia
| |
Collapse
|
25
|
KAYA Ş, TASCİ B. Electroencephalogram-Based Major Depressive Disorder Classification Using Convolutional Neural Network and Transfer Learning. TURKISH JOURNAL OF SCIENCE AND TECHNOLOGY 2023; 18:207-214. [DOI: 10.55525/tjst.1242881] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/05/2024]
Abstract
Major Depressive Disorder (MDD) is a worldwide common disease with a high risk of becoming chronic, suicidal, and recurrence, with serious consequences such as loss of workforce. Objective tests such as EEG, EKG, brain MRI, and Doppler USG are used to aid diagnosis in MDD detection. With advances in artificial intelligence and sample data from objective testing for depression, an early depression detection system can be developed as a way to reduce the number of individuals affected by MDD. In this study, MDD was tried to be diagnosed automatically with a deep learning-based approach using EEG signals. In the study, 3-channel modma dataset was used as a dataset. Modma dataset consists of EEG signals of 29 controls and 26 MDD patients. ResNet18 convolutional neural network was used for feature extraction. The ReliefF algorithm is used for feature selection. In the classification phase, kNN was preferred. The accuracy was yielded 95.65% for Channel 1, 87.00% for Channel 2, and 86.94% for Channel 3.
Collapse
Affiliation(s)
- Şuheda KAYA
- Elazığ Ruh Sağlığı ve Hastalıkları Hastanesi
| | | |
Collapse
|
26
|
Zhang J, Xu B, Yin H. Depression screening using hybrid neural network. MULTIMEDIA TOOLS AND APPLICATIONS 2023; 82:1-16. [PMID: 37362740 PMCID: PMC9992920 DOI: 10.1007/s11042-023-14860-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 08/03/2022] [Accepted: 02/06/2023] [Indexed: 06/28/2023]
Abstract
Depression is a common cause of increased suicides worldwide, and studies have shown that the number of patients suffering from major depressive disorder (MDD) increased several-fold during the COVID-19 pandemic, highlighting the importance of disease detection and depression management, while increasing the need for effective diagnostic tools. In recent years, machine learning and deep learning methods based on electroencephalography (EEG) have achieved significant results in the field of automatic depression detection. However, most current studies have focused on a small number of EEG signal channels, and experimental data require special processing by professionals. In this study, 128 channels of EEG signals were simply filtered and 24-fold leave-one-out cross-validation experiments were performed using 2DCNN-LSTM classifier, support vector machine, K-nearest neighbor and decision tree. The current results show that the proposed 2DCNN-LSTM model has an average classification accuracy of 95.1% with an AUC of 0.98 for depression detection of 6-second participant EEG signals, and the model is much better than 72.05%, 79.7% and 79.49% for support vector machine, K nearest neighbor and decision tree. In addition, we found that the model achieved a 100% probability of correctly classifying the EEG signals of 300-second participants.
Collapse
Affiliation(s)
- Jiao Zhang
- School of Computer and Information Technology, Beijing Jiaotong University, Beijing, China
| | - Baomin Xu
- School of Computer and Information Technology, Beijing Jiaotong University, Beijing, China
| | - Hongfeng Yin
- School of Computer and Information Technology, Cangzhou Jiaotong College, Cangzhou, Hebei China
| |
Collapse
|
27
|
Shusharina N, Yukhnenko D, Botman S, Sapunov V, Savinov V, Kamyshov G, Sayapin D, Voznyuk I. Modern Methods of Diagnostics and Treatment of Neurodegenerative Diseases and Depression. Diagnostics (Basel) 2023; 13:573. [PMID: 36766678 PMCID: PMC9914271 DOI: 10.3390/diagnostics13030573] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 01/27/2023] [Accepted: 01/29/2023] [Indexed: 02/09/2023] Open
Abstract
This paper discusses the promising areas of research into machine learning applications for the prevention and correction of neurodegenerative and depressive disorders. These two groups of disorders are among the leading causes of decline in the quality of life in the world when estimated using disability-adjusted years. Despite decades of research, the development of new approaches for the assessment (especially pre-clinical) and correction of neurodegenerative diseases and depressive disorders remains among the priority areas of research in neurophysiology, psychology, genetics, and interdisciplinary medicine. Contemporary machine learning technologies and medical data infrastructure create new research opportunities. However, reaching a consensus on the application of new machine learning methods and their integration with the existing standards of care and assessment is still a challenge to overcome before the innovations could be widely introduced to clinics. The research on the development of clinical predictions and classification algorithms contributes towards creating a unified approach to the use of growing clinical data. This unified approach should integrate the requirements of medical professionals, researchers, and governmental regulators. In the current paper, the current state of research into neurodegenerative and depressive disorders is presented.
Collapse
Affiliation(s)
- Natalia Shusharina
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Denis Yukhnenko
- Department of Social Security and Humanitarian Technologies, N. I. Lobachevsky State University of Nizhny Novgorod, 603022 Nizhny Novgorod, Russia
| | - Stepan Botman
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Viktor Sapunov
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Vladimir Savinov
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Gleb Kamyshov
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Dmitry Sayapin
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Igor Voznyuk
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
- Department of Neurology, Pavlov First Saint Petersburg State Medical University, 197022 Saint Petersburg, Russia
| |
Collapse
|
28
|
Barua PD, Vicnesh J, Lih OS, Palmer EE, Yamakawa T, Kobayashi M, Acharya UR. Artificial intelligence assisted tools for the detection of anxiety and depression leading to suicidal ideation in adolescents: a review. Cogn Neurodyn 2022:1-22. [PMID: 36467993 PMCID: PMC9684805 DOI: 10.1007/s11571-022-09904-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 09/26/2022] [Accepted: 10/17/2022] [Indexed: 11/24/2022] Open
Abstract
Epidemiological studies report high levels of anxiety and depression amongst adolescents. These psychiatric conditions and complex interplays of biological, social and environmental factors are important risk factors for suicidal behaviours and suicide, which show a peak in late adolescence and early adulthood. Although deaths by suicide have fallen globally in recent years, suicide deaths are increasing in some countries, such as the US. Suicide prevention is a challenging global public health problem. Currently, there aren't any validated clinical biomarkers for suicidal diagnosis, and traditional methods exhibit limitations. Artificial intelligence (AI) is budding in many fields, including in the diagnosis of medical conditions. This review paper summarizes recent studies (past 8 years) that employed AI tools for the automated detection of depression and/or anxiety disorder and discusses the limitations and effects of some modalities. The studies assert that AI tools produce promising results and could overcome the limitations of traditional diagnostic methods. Although using AI tools for suicidal ideation exhibits limitations, these are outweighed by the advantages. Thus, this review article also proposes extracting a fusion of features such as facial images, speech signals, and visual and clinical history features from deep models for the automated detection of depression and/or anxiety disorder in individuals, for future work. This may pave the way for the identification of individuals with suicidal thoughts.
Collapse
Affiliation(s)
- Prabal Datta Barua
- School of Management and Enterprise, University of Southern Queensland, Springfield, Australia
| | - Jahmunah Vicnesh
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
| | - Oh Shu Lih
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
| | - Elizabeth Emma Palmer
- Discipline of Pediatric and Child Health, School of Clinical Medicine, University of New South Wales, Kensington, Australia
- Sydney Children’s Hospitals Network, Sydney, Australia
| | - Toshitaka Yamakawa
- Department of Computer Science and Electrical Engineering, Kumamoto University, Kumamoto, Japan
| | - Makiko Kobayashi
- Department of Computer Science and Electrical Engineering, Kumamoto University, Kumamoto, Japan
| | - Udyavara Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
- School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
- Department of Bioinformatics and Medical Engineering, Asia University, Taizhong, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, Japan
| |
Collapse
|
29
|
RNN and BiLSTM Fusion for Accurate Automatic Epileptic Seizure Diagnosis Using EEG Signals. LIFE (BASEL, SWITZERLAND) 2022; 12:life12121946. [PMID: 36556313 PMCID: PMC9784456 DOI: 10.3390/life12121946] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 11/17/2022] [Accepted: 11/18/2022] [Indexed: 11/24/2022]
Abstract
Epilepsy is a common neurological condition. The effects of epilepsy are not restricted to seizures alone. They comprise a wide spectrum of problems that might impair and reduce quality of life. Even with medication, 30% of epilepsy patients still have recurring seizures. An epileptic seizure is caused by significant neuronal electrical activity, which affects brain activity. EEG shows these changes as high-amplitude spiky and sluggish waves. Recognizing seizures on an electroencephalogram (EEG) manually by a professional neurologist is a time-consuming and labor-intensive process, hence an efficient automated approach is necessary for the identification of epileptic seizure. One technique to increase the speed and accuracy with which a diagnosis of epileptic seizures could be made is by utilizing computer-aided diagnosis systems that are built on deep neural networks, or DNN. This study introduces a fusion of recurrent neural networks (RNNs) and bi-directional long short-term memories (BiLSTMs) for automatic epileptic seizure identification via EEG signal processing in order to tackle the aforementioned informational challenges. An electroencephalogram's (EEG) raw data were first normalized after undergoing pre-processing. A RNN model was fed the normalized EEG sequence data and trained to accurately extract features from the data. Afterwards, the features were passed to the BiLSTM layers for processing so that further temporal information could be retrieved. In addition, the proposed RNN-BiLSTM model was tested in an experimental setting using the freely accessible UCI epileptic seizure dataset. Experimental findings of the suggested model have achieved avg values of 98.90%, 98.50%, 98. 20%, and 98.60%, respectively, for accuracy, sensitivity, precision, and specificity. To further verify the new model's efficacy, it is compared to other models, such as the RNN-LSTM and the RNN-GRU learning models, and is shown to have improved the same metrics by 1.8%, 1.69%, 1.95%, and 2.2% on using 5-fold. Additionally, the proposed method was compared to state-of-the-art approaches and proved to be a more accurate categorization of such techniques.
Collapse
|
30
|
Yang B, Huang Y, Li Z, Hu X. Management of Post-stroke Depression (PSD) by Electroencephalography for Effective Rehabilitation. ENGINEERED REGENERATION 2022. [DOI: 10.1016/j.engreg.2022.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
|
31
|
Aguilera-Martos I, García-Vico ÁM, Luengo J, Damas S, Melero FJ, Valle-Alonso JJ, Herrera F. TSFEDL: A Python Library for Time Series Spatio-Temporal Feature Extraction and Prediction using Deep Learning. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.10.062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
32
|
Benchmarks for machine learning in depression discrimination using electroencephalography signals. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04159-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
33
|
Li Y, Shen Y, Fan X, Huang X, Yu H, Zhao G, Ma W. A novel EEG-based major depressive disorder detection framework with two-stage feature selection. BMC Med Inform Decis Mak 2022; 22:209. [PMID: 35933348 PMCID: PMC9357341 DOI: 10.1186/s12911-022-01956-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 07/29/2022] [Indexed: 11/16/2022] Open
Abstract
Background Major depressive disorder (MDD) is a common mental illness, characterized by persistent depression, sadness, despair, etc., troubling people’s daily life and work seriously. Methods In this work, we present a novel automatic MDD detection framework based on EEG signals. First of all, we derive highly MDD-correlated features, calculating the ratio of extracted features from EEG signals at frequency bands between \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\beta$$\end{document}β and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha$$\end{document}α. Then, a two-stage feature selection method named PAR is presented with the sequential combination of Pearson correlation coefficient (PCC) and recursive feature elimination (RFE), where the advantages lie in minimizing the feature searching space. Finally, we employ widely used machine learning methods of support vector machine (SVM), logistic regression (LR), and linear regression (LNR) for MDD detection with the merit of feature interpretability. Results Experiment results show that our proposed MDD detection framework achieves competitive results. The accuracy and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$F_{1}$$\end{document}F1 score are up to 0.9895 and 0.9846, respectively. Meanwhile, the regression determination coefficient \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R^2$$\end{document}R2 for MDD severity assessment is up to 0.9479. Compared with existing MDD detection methods with the best accuracy of 0.9840 and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$F_1$$\end{document}F1 score of 0.97, our proposed framework achieves the state-of-the-art MDD detection performance. Conclusions Development of this MDD detection framework can be potentially deployed into a medical system to aid physicians to screen out MDD patients.
Collapse
Affiliation(s)
- Yujie Li
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Yingshan Shen
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Xiaomao Fan
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China.
| | - Xingxian Huang
- Department of Acupuncture and Moxibustion, Shenzhen Traditional Chinese Medicine Hospital, Shenzhen, China
| | - Haibo Yu
- Department of Acupuncture and Moxibustion, Shenzhen Traditional Chinese Medicine Hospital, Shenzhen, China
| | - Gansen Zhao
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Wenjun Ma
- School of Computer Science, South China Normal University, Guangzhou, China
| |
Collapse
|
34
|
Shen J, Liu N, Li D, Zhang B. Behavioral Analysis of EEG Signals in Loss-Gain Decision-Making Experiments. Behav Neurol 2022; 2022:3070608. [PMID: 35874640 PMCID: PMC9307401 DOI: 10.1155/2022/3070608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2021] [Accepted: 06/17/2022] [Indexed: 11/18/2022] Open
Abstract
Extraction and analysis of the EEG (electroencephalograph) information features generated during behavioral decision-making can provide a better understanding of the state of mind. Previous studies have focused more on the brainwave features after behavioral decision-making. In fact, the EEG before decision-making is more worthy of our attention. In this study, we introduce a new index based on the reaction time of subjects before decision-making, called the Prestimulus Time (PT), which have important reference value for the study of cognitive function, neurological diseases, and other fields. In our experiments, we use a wearable EEG feature signal acquisition device and a systematic reward and punishment experiment to obtain the EEG features before and after behavioral decision-making. The experimental results show that the EEG generated after behavioral decision due to loss is more intense than that generated by gain in the medial frontal cortex (MFC). In addition, different characteristics of EEG signals are generated prior to behavioral decisions because people have different expectations of the outcome. It will produce more significant negative-polarity event-related potential (ERP) in the forebrain area when the humans are optimistic about the outcomes.
Collapse
Affiliation(s)
- Jiaquan Shen
- School of Information Science, Luoyang Normal University, Luoyang 471022, China
| | - Ningzhong Liu
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Jiangsu Nanjing 211106, China
| | - Deguang Li
- School of Information Science, Luoyang Normal University, Luoyang 471022, China
| | - Binbin Zhang
- School of Information Science, Luoyang Normal University, Luoyang 471022, China
| |
Collapse
|
35
|
Tato A, Nkambou R. Infusing Expert Knowledge Into a Deep Neural Network Using Attention Mechanism for Personalized Learning Environments. Front Artif Intell 2022; 5:921476. [PMID: 35719689 PMCID: PMC9203682 DOI: 10.3389/frai.2022.921476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 05/13/2022] [Indexed: 11/19/2022] Open
Abstract
Machine learning models are biased toward data seen during the training steps. The models will tend to give good results in classes where there are many examples and poor results in those with few examples. This problem generally occurs when the classes to predict are imbalanced and this is frequent in educational data where for example, there are skills that are very difficult or very easy to master. There will be less data on students that correctly answered questions related to difficult skills and who incorrectly answered those related to skills easy to master. In this paper, we tackled this problem by proposing a hybrid architecture combining Deep Neural Network architectures— especially Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN)—with expert knowledge for user modeling. The proposed solution uses attention mechanism to infuse expert knowledge into the Deep Neural Network. It has been tested in two contexts: knowledge tracing in an intelligent tutoring system (ITS) called Logic-Muse and prediction of socio-moral reasoning in a serious game called MorALERT. The proposed solution is compared to state-of-the-art machine learning solutions and experiments show that the resulting model can accurately predict the current student's knowledge state (in Logic-Muse) and thus enable an accurate personalization of the learning process. Other experiments show that the model can also be used to predict the level of socio-moral reasoning skills (in MorALERT). Our findings suggest the need for hybrid neural networks that integrate prior expert knowledge (especially when it is necessary to compensate for the strong dependency—of deep learning methods—on data size or the possible unbalanced datasets). Many domains can benefit from such an approach to building models that allow generalization even when there are small training data.
Collapse
|
36
|
Deng X, Fan X, Lv X, Sun K. SparNet: A Convolutional Neural Network for EEG Space-Frequency Feature Learning and Depression Discrimination. Front Neuroinform 2022; 16:914823. [PMID: 35722169 PMCID: PMC9201718 DOI: 10.3389/fninf.2022.914823] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 05/06/2022] [Indexed: 11/13/2022] Open
Abstract
Depression affects many people around the world today and is considered a global problem. Electroencephalogram (EEG) measurement is an appropriate way to understand the underlying mechanisms of major depressive disorder (MDD) to distinguish depression from normal control. With the development of deep learning methods, many researchers have adopted deep learning models to improve the classification accuracy of depression recognition. However, there are few studies on designing convolution filters for spatial and frequency domain feature learning in different brain regions. In this study, SparNet, a convolutional neural network composed of five parallel convolutional filters and the SENet, is proposed to learn EEG space-frequency domain characteristics and distinguish between depressive and normal control. The model is trained and tested by the cross-validation method of subject division. The results show that SparNet achieves a sensitivity of 95.07%, a specificity of 93.66%, and an accuracy of 94.37% in classification. Therefore, our results can conclude that the proposed SparNet model is effective in detecting depression using EEG signals. It also indicates that the combination of spatial information and frequency domain information is an effective way to identify patients with depression.
Collapse
Affiliation(s)
| | - Xufeng Fan
- Key Laboratory of Data Engineering and Visual Computing, College of Computer Science and Technology, Chongqing University of Posts and Telecommunication, Chongqing, China
| | | | | |
Collapse
|
37
|
Liu W, Jia K, Wang Z, Ma Z. A Depression Prediction Algorithm Based on Spatiotemporal Feature of EEG Signal. Brain Sci 2022; 12:630. [PMID: 35625016 PMCID: PMC9139403 DOI: 10.3390/brainsci12050630] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 04/29/2022] [Accepted: 05/09/2022] [Indexed: 11/16/2022] Open
Abstract
Depression has gradually become the most common mental disorder in the world. The accuracy of its diagnosis may be affected by many factors, while the primary diagnosis seems to be difficult to define. Finding a way to identify depression by satisfying both objective and effective conditions is an urgent issue. In this paper, a strategy for predicting depression based on spatiotemporal features is proposed, and is expected to be used in the auxiliary diagnosis of depression. Firstly, electroencephalogram (EEG) signals were denoised through the filter to obtain the power spectra of the three corresponding frequency ranges, Theta, Alpha and Beta. Using orthogonal projection, the spatial positions of the electrodes were mapped to the brainpower spectrum, thereby obtaining three brain maps with spatial information. Then, the three brain maps were superimposed on a new brain map with frequency domain and spatial characteristics. A Convolutional Neural Network (CNN) and Gated Recurrent Unit (GRU) were applied to extract the sequential feature. The proposed strategy was validated with a public EEG dataset, achieving an accuracy of 89.63% and an accuracy of 88.56% with the private dataset. The network had less complexity with only six layers. The results show that our strategy is credible, less complex and useful in predicting depression using EEG signals.
Collapse
Affiliation(s)
- Wei Liu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
- Beijing Laboratory of Advanced Information Networks, Beijing 100124, China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
| | - Kebin Jia
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
- Beijing Laboratory of Advanced Information Networks, Beijing 100124, China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
| | - Zhuozheng Wang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
| | - Zhuo Ma
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
| |
Collapse
|
38
|
Zhang B, Cai H, Song Y, Tao L, Li Y. Computer-aided Recognition Based on Decision-level Multimodal Fusion for Depression. IEEE J Biomed Health Inform 2022; 26:3466-3477. [PMID: 35389872 DOI: 10.1109/jbhi.2022.3165640] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Aiming at the problem of depression recognition, this paper proposes a computer-aided recognition framework based on decision-level multimodal fusion. In Song Dynasty of China, the idea of multimodal fusion was contained in "one gets different impressions of a mountain when viewing it from the front or sideways, at a close range or from afar" poetry. Objective and comprehensive analysis of depression can more accurately restore its essence, and multimodal can represent more information about depression compared to single modal. Linear electroencephalography (EEG) features based on adaptive auto regression (AR) model and typical nonlinear EEG features are extracted. EEG features related to depression and graph metric features in depression related brain regions are selected as the data basis of multimodal fusion to ensure data diversity. Based on the theory of multi-agent cooperation, the computer-aided depression recognition model of decision-level is realized. The experimental data comes from 24 depressed patients and 29 healthy controls (HC). The results of multi-group controlled trials show that compared with single modal or independent classifiers, the decision-level multimodal fusion method has a stronger ability to recognize depression, and the highest accuracy rate 92.13% was obtained. In addition, our results suggest that improving the brain region associated with information processing can help alleviate and treat depression. In the field of classification and recognition, our results clarify that there is no universal classifier suitable for any condition.
Collapse
|
39
|
Automated diagnosis of depression from EEG signals using traditional and deep learning approaches: A comparative analysis. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2021.12.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|
40
|
Safayari A, Bolhasani H. Depression diagnosis by deep learning using EEG signals: A systematic review. MEDICINE IN NOVEL TECHNOLOGY AND DEVICES 2021. [DOI: 10.1016/j.medntd.2021.100102] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
|
41
|
Shoeibi A, Sadeghi D, Moridian P, Ghassemi N, Heras J, Alizadehsani R, Khadem A, Kong Y, Nahavandi S, Zhang YD, Gorriz JM. Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models. Front Neuroinform 2021; 15:777977. [PMID: 34899226 PMCID: PMC8657145 DOI: 10.3389/fninf.2021.777977] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/22/2021] [Indexed: 11/13/2022] Open
Abstract
Schizophrenia (SZ) is a mental disorder whereby due to the secretion of specific chemicals in the brain, the function of some brain regions is out of balance, leading to the lack of coordination between thoughts, actions, and emotions. This study provides various intelligent deep learning (DL)-based methods for automated SZ diagnosis via electroencephalography (EEG) signals. The obtained results are compared with those of conventional intelligent methods. To implement the proposed methods, the dataset of the Institute of Psychiatry and Neurology in Warsaw, Poland, has been used. First, EEG signals were divided into 25 s time frames and then were normalized by z-score or norm L2. In the classification step, two different approaches were considered for SZ diagnosis via EEG signals. In this step, the classification of EEG signals was first carried out by conventional machine learning methods, e.g., support vector machine, k-nearest neighbors, decision tree, naïve Bayes, random forest, extremely randomized trees, and bagging. Various proposed DL models, namely, long short-term memories (LSTMs), one-dimensional convolutional networks (1D-CNNs), and 1D-CNN-LSTMs, were used in the following. In this step, the DL models were implemented and compared with different activation functions. Among the proposed DL models, the CNN-LSTM architecture has had the best performance. In this architecture, the ReLU activation function with the z-score and L2-combined normalization was used. The proposed CNN-LSTM model has achieved an accuracy percentage of 99.25%, better than the results of most former studies in this field. It is worth mentioning that to perform all simulations, the k-fold cross-validation method with k = 5 has been used.
Collapse
Affiliation(s)
- Afshin Shoeibi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Delaram Sadeghi
- Department of Medical Engineering, Islamic Azad University of Mashhad, Mashhad, Iran
| | - Parisa Moridian
- Faculty of Engineering, Islamic Azad University of Science and Research, Tehran, Iran
| | - Navid Ghassemi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Jónathan Heras
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Ali Khadem
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yinan Kong
- School of Engineering, Macquarie University, Sydney, NSW, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Yu-Dong Zhang
- Department of Informatics, University of Leicester, Leicester, United Kingdom
| | - Juan Manuel Gorriz
- Department of Signal Theory, Telematics and Communications, ETS of Computer and Telecommunications Engineering, University of Granada, Granada, Spain
| |
Collapse
|
42
|
Tan JL, Liang ZF, Zhang R, Dong YQ, Li GH, Zhang M, Wang H, Xu N. Suppressing of Power Line Artifact From Electroencephalogram Measurements Using Sparsity in Frequency Domain. Front Neurosci 2021; 15:780373. [PMID: 34776860 PMCID: PMC8581206 DOI: 10.3389/fnins.2021.780373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 10/08/2021] [Indexed: 11/13/2022] Open
Abstract
Electroencephalogram (EEG) plays an important role in brain disease diagnosis and research of brain-computer interface (BCI). However, the measurements of EEG are often exposed to strong interference of power line artifact (PLA). Digital notch filters (DNFs) can be applied to remove the PLA effectively, but it also results in severe signal distortions in the time domain. To address this problem, spectrum correction (SC) based methods can be utilized. These methods estimate harmonic parameters of the PLA such that compensation signals are produced to remove the noise. In order to ensure high accuracy during harmonic parameter estimations, a novel approach is proposed in this paper. This novel approach is based on the combination of sparse representation (SR) and SC. It can deeply mine the information of PLA in the frequency domain. Firstly, a ratio-based spectrum correction (RBSC) using rectangular window is employed to make rough estimation of the harmonic parameters of PLA. Secondly, the two spectral line closest to the estimated frequency are calculated. Thirdly, the two spectral lines with high amplitudes can be utilized as input of RBSC to make finer estimations of the harmonic parameters. Finally, a compensation signal, based on the extracted harmonic parameters, is generated to suppress PLA. Numerical simulations and actual EEG signals with PLA were used to evaluate the effectiveness of the improved approach. It is verified that this approach can effectively suppress the PLA without distorting the time-domain waveform of the EEG signal.
Collapse
Affiliation(s)
- Jin-Lin Tan
- School of Aerospace Science and Technology, Xidian University, Xi'an, China.,Shaanxi Aerospace Technology Application Research Institute Co., Ltd, Xi'an, China
| | - Zhi-Feng Liang
- Shaanxi Aerospace Technology Application Research Institute Co., Ltd, Xi'an, China
| | - Rui Zhang
- Shaanxi Aerospace Technology Application Research Institute Co., Ltd, Xi'an, China
| | - You-Qiang Dong
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Guang-Hui Li
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Min Zhang
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Hai Wang
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Na Xu
- The Second Affiliated Hospital of Xiamen Medical College, Xiamen, China
| |
Collapse
|
43
|
Aydemir E, Tuncer T, Dogan S, Gururajan R, Acharya UR. Automated major depressive disorder detection using melamine pattern with EEG signals. APPL INTELL 2021. [DOI: 10.1007/s10489-021-02426-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
44
|
Musallam YK, AlFassam NI, Muhammad G, Amin SU, Alsulaiman M, Abdul W, Altaheri H, Bencherif MA, Algabri M. Electroencephalography-based motor imagery classification using temporal convolutional network fusion. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102826] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
|
45
|
Tadalagi M, Joshi AM. AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor. Med Biol Eng Comput 2021; 59:1339-1354. [PMID: 34091864 DOI: 10.1007/s11517-021-02358-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Accepted: 03/26/2021] [Indexed: 11/25/2022]
Abstract
The psychological health of a person plays an important role in their daily life activities. The paper addresses depression issues with the machine learning model using facial expressions of the patient. Some research has already been done on visual based on depression detection methods, but those are illumination variant. The paper uses feature extraction using LBP (Local Binary Pattern) descriptor, which is illumination invariant. The Viola-Jones algorithm is used for face detection and SVM (support vector machine) is considered for classification along with the LBP descriptor to make a complete model for depression level detection. The proposed method captures frontal face from the videos of subjects and their facial features are extracted from each frame. Subsequently, the facial features are analyzed to detect depression levels with the post-processing model. The performance of the proposed system is evaluated using machine learning algorithms in MATLAB. For the real-time system design, it is necessary to test it on the hardware platform. The LBP descriptor has been implemented on FPGA using Xilinx VIVADO 16.4. The results of the proposed method show satisfactory performance and accuracy for depression detection comparison with similar previous work.
Collapse
Affiliation(s)
| | - Amit M Joshi
- Malaviya National Institute of Technology, Jaipur, India.
| |
Collapse
|