1
|
Chung KH, Chang YS, Yen WT, Lin L, Abimannan S. Depression assessment using integrated multi-featured EEG bands deep neural network models: Leveraging ensemble learning techniques. Comput Struct Biotechnol J 2024; 23:1450-1468. [PMID: 38623563 PMCID: PMC11016871 DOI: 10.1016/j.csbj.2024.03.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 03/24/2024] [Accepted: 03/25/2024] [Indexed: 04/17/2024] Open
Abstract
Mental Status Assessment (MSA) holds significant importance in psychiatry. In recent years, several studies have leveraged Electroencephalogram (EEG) technology to gauge an individual's mental state or level of depression. This study introduces a novel multi-tier ensemble learning approach to integrate multiple EEG bands for conducting mental state or depression assessments. Initially, the EEG signal is divided into eight sub-bands, and then a Long Short-Term Memory (LSTM)-based Deep Neural Network (DNN) model is trained for each band. Subsequently, the integration of multi-band EEG frequency models and the evaluation of mental state or depression level are facilitated through a two-tier ensemble learning approach based on Multiple Linear Regression (MLR). The authors conducted numerous experiments to validate the performance of the proposed method under different evaluation metrics. For clarity and conciseness, the research employs the simplest commercialized one-channel EEG sensor, positioned at FP1, to collect data from 57 subjects (49 depressed and 18 healthy subjects). The obtained results, including an accuracy of 0.897, F1-score of 0.921, precision of 0.935, negative predictive value of 0.829, recall of 0.908, specificity of 0.875, and AUC of 0.8917, provide evidence of the superior performance of the proposed method compared to other ensemble learning techniques. This method not only proves effective but also holds the potential to significantly enhance the accuracy of depression assessment.
Collapse
Affiliation(s)
- Kuo-Hsuan Chung
- Department of Psychiatry and Psychiatric Research Center, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Psychiatry, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Yue-Shan Chang
- National Taipei University, Sanxia District, New Taipei City 237, Taiwan
| | - Wei-Ting Yen
- National Taipei University, Sanxia District, New Taipei City 237, Taiwan
| | - Linen Lin
- Department of Psychiatry, En Chu Kong Hospital, Taiwan
| | - Satheesh Abimannan
- Amity School of Engineering and Technology, Amity University Maharashtra, Mumbai, India
| |
Collapse
|
2
|
Metin SZ, Uyulan Ç, Farhad S, Ergüzel TT, Türk Ö, Metin B, Çerezci Ö, Tarhan N. Deep Learning-Based Artificial Intelligence Can Differentiate Treatment-Resistant and Responsive Depression Cases with High Accuracy. Clin EEG Neurosci 2024:15500594241273181. [PMID: 39251228 DOI: 10.1177/15500594241273181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Abstract
Background: Although there are many treatment options available for depression, a large portion of patients with depression are diagnosed with treatment-resistant depression (TRD), which is characterized by an inadequate response to antidepressant treatment. Identifying the TRD population is crucial in terms of saving time and resources in depression treatment. Recently several studies employed various methods on EEG datasets for automatic depression detection or treatment outcome prediction. However, no previous study has used the deep learning (DL) approach and EEG signals for detecting treatment resistance. Method: 77 patients with TRD, 43 patients with non-TRD, and 40 healthy controls were compared using GoogleNet convolutional neural network and DL on EEG data. Additionally, Class Activation Maps (CAMs) acquired from the TRD and non-TRD groups were used to obtain distinctive regions for classification. Results: GoogleNet classified the healthy controls and non-TRD group with 88.43%, the healthy controls and TRD subjects with 89.73%, and the TRD and non-TRD group with 90.05% accuracy. The external validation accuracy for the TRD-non-TRD classification was 73.33%. Finally, the CAM analysis revealed that the TRD group contained dominant features in class detection of deep learning architecture in almost all electrodes. Limitations: Our study is limited by the moderate sample size of clinical groups and the retrospective nature of the study. Conclusion: These findings suggest that EEG-based deep learning can be used to classify treatment resistance in depression and may in the future prove to be a useful tool in psychiatry practice to identify patients who need more vigorous intervention.
Collapse
Affiliation(s)
| | - Çağlar Uyulan
- Department of Mechanical Engineering, Katip Çelebi University, İzmir, Turkey
| | - Shams Farhad
- Department of Neuroscience, Uskudar University, Istanbul, Turkey
| | - Türker Tekin Ergüzel
- Department of Software Engineering, Faculty of Engineering and Natural Sciences, Uskudar University, Istanbul, Turkey
| | - Ömer Türk
- Department of Computer Technologies, Artuklu University, Mardin, Turkey
| | - Barış Metin
- Neurology Department, Medical Faculty, Uskudar University, Istanbul, Turkey
| | - Önder Çerezci
- Department of Physioterapy and Rehabilitation, Faculty of Health SciencesUskudar University, Istanbul, Turkey
| | - Nevzat Tarhan
- Department of Psychiatry, Uskudar University, Istanbul, Turkey
| |
Collapse
|
3
|
Kim HG, Song S, Cho BH, Jang DP. Deep learning-based stress detection for daily life use using single-channel EEG and GSR in a virtual reality interview paradigm. PLoS One 2024; 19:e0305864. [PMID: 38959272 PMCID: PMC11221693 DOI: 10.1371/journal.pone.0305864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Accepted: 06/04/2024] [Indexed: 07/05/2024] Open
Abstract
This research aims to establish a practical stress detection framework by integrating physiological indicators and deep learning techniques. Utilizing a virtual reality (VR) interview paradigm mirroring real-world scenarios, our focus is on classifying stress states through accessible single-channel electroencephalogram (EEG) and galvanic skin response (GSR) data. Thirty participants underwent stress-inducing VR interviews, with biosignals recorded for deep learning models. Five convolutional neural network (CNN) architectures and one Vision Transformer model, including a multiple-column structure combining EEG and GSR features, showed heightened predictive capabilities and an enhanced area under the receiver operating characteristic curve (AUROC) in stress prediction compared to single-column models. Our experimental protocol effectively elicited stress responses, observed through fluctuations in stress visual analogue scale (VAS), EEG, and GSR metrics. In the single-column architecture, ResNet-152 excelled with a GSR AUROC of 0.944 (±0.027), while the Vision Transformer performed well in EEG, achieving peak AUROC values of 0.886 (±0.069) respectively. Notably, the multiple-column structure, based on ResNet-50, achieved the highest AUROC value of 0.954 (±0.018) in stress classification. Through VR-based simulated interviews, our study induced social stress responses, leading to significant modifications in GSR and EEG measurements. Deep learning models precisely classified stress levels, with the multiple-column strategy demonstrating superiority. Additionally, discreetly placing single-channel EEG measurements behind the ear enhances the convenience and accuracy of stress detection in everyday situations.
Collapse
Affiliation(s)
- Hun-gyeom Kim
- Department of Biomedical Engineering, Hanyang University, Seoul, Korea
| | - Solwoong Song
- Department of Biomedical Engineering, Hanyang University, Seoul, Korea
| | - Baek Hwan Cho
- Department of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Korea
- Institute of Biomedical Informatics, CHA University School of Medicine, CHA University, Seongnam, Korea
| | - Dong Pyo Jang
- Department of Biomedical Engineering, Hanyang University, Seoul, Korea
| |
Collapse
|
4
|
Tong W, Yue W, Chen F, Shi W, Zhang L, Wan J. MSE-VGG: A Novel Deep Learning Approach Based on EEG for Rapid Ischemic Stroke Detection. SENSORS (BASEL, SWITZERLAND) 2024; 24:4234. [PMID: 39001013 PMCID: PMC11244239 DOI: 10.3390/s24134234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 06/12/2024] [Accepted: 06/27/2024] [Indexed: 07/16/2024]
Abstract
Ischemic stroke is a type of brain dysfunction caused by pathological changes in the blood vessels of the brain which leads to brain tissue ischemia and hypoxia and ultimately results in cell necrosis. Without timely and effective treatment in the early time window, ischemic stroke can lead to long-term disability and even death. Therefore, rapid detection is crucial in patients with ischemic stroke. In this study, we developed a deep learning model based on fusion features extracted from electroencephalography (EEG) signals for the fast detection of ischemic stroke. Specifically, we recruited 20 ischemic stroke patients who underwent EEG examination during the acute phase of stroke and collected EEG signals from 19 adults with no history of stroke as a control group. Afterwards, we constructed correlation-weighted Phase Lag Index (cwPLI), a novel feature, to explore the synchronization information and functional connectivity between EEG channels. Moreover, the spatio-temporal information from functional connectivity and the nonlinear information from complexity were fused by combining the cwPLI matrix and Sample Entropy (SaEn) together to further improve the discriminative ability of the model. Finally, the novel MSE-VGG network was employed as a classifier to distinguish ischemic stroke from non-ischemic stroke data. Five-fold cross-validation experiments demonstrated that the proposed model possesses excellent performance, with accuracy, sensitivity, and specificity reaching 90.17%, 89.86%, and 90.44%, respectively. Experiments on time consumption verified that the proposed method is superior to other state-of-the-art examinations. This study contributes to the advancement of the rapid detection of ischemic stroke, shedding light on the untapped potential of EEG and demonstrating the efficacy of deep learning in ischemic stroke identification.
Collapse
Affiliation(s)
- Wei Tong
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Weiqi Yue
- School of Computer Science, Hangzhou Dianzi University, Hangzhou 310018, China;
| | - Fangni Chen
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Wei Shi
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Lei Zhang
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| | - Jian Wan
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; (W.T.); (W.S.); (L.Z.); (J.W.)
| |
Collapse
|
5
|
Fernandez Rojas R, Joseph C, Bargshady G, Ou KL. Empirical comparison of deep learning models for fNIRS pain decoding. Front Neuroinform 2024; 18:1320189. [PMID: 38420133 PMCID: PMC10899478 DOI: 10.3389/fninf.2024.1320189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 01/26/2024] [Indexed: 03/02/2024] Open
Abstract
Introduction Pain assessment is extremely important in patients unable to communicate and it is often done by clinical judgement. However, assessing pain using observable indicators can be challenging for clinicians due to the subjective perceptions, individual differences in pain expression, and potential confounding factors. Therefore, the need for an objective pain assessment method that can assist medical practitioners. Functional near-infrared spectroscopy (fNIRS) has shown promising results to assess the neural function in response of nociception and pain. Previous studies have explored the use of machine learning with hand-crafted features in the assessment of pain. Methods In this study, we aim to expand previous studies by exploring the use of deep learning models Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and (CNN-LSTM) to automatically extract features from fNIRS data and by comparing these with classical machine learning models using hand-crafted features. Results The results showed that the deep learning models exhibited favourable results in the identification of different types of pain in our experiment using only fNIRS input data. The combination of CNN and LSTM in a hybrid model (CNN-LSTM) exhibited the highest performance (accuracy = 91.2%) in our problem setting. Statistical analysis using one-way ANOVA with Tukey's (post-hoc) test performed on accuracies showed that the deep learning models significantly improved accuracy performance as compared to the baseline models. Discussion Overall, deep learning models showed their potential to learn features automatically without relying on manually-extracted features and the CNN-LSTM model could be used as a possible method of assessment of pain in non-verbal patients. Future research is needed to evaluate the generalisation of this method of pain assessment on independent populations and in real-life scenarios.
Collapse
Affiliation(s)
- Raul Fernandez Rojas
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| | - Calvin Joseph
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| | - Ghazal Bargshady
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| | - Keng-Liang Ou
- Department of Dentistry, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Dentistry, Taipei Medical University-Shuang Ho Hospital, New Taipei City, Taiwan
- 3D Global Biotech Inc., New Taipei City, Taiwan
| |
Collapse
|
6
|
Chugh N, Aggarwal S, Balyan A. The Hybrid Deep Learning Model for Identification of Attention-Deficit/Hyperactivity Disorder Using EEG. Clin EEG Neurosci 2024; 55:22-33. [PMID: 37682533 DOI: 10.1177/15500594231193511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Common misbehavior among children that prevents them from paying attention to tasks and interacting with their surroundings appropriately is attention-deficit/hyperactivity disorder (ADHD). Studies of children's behavior presently face a significant problem in the early and timely diagnosis of this disease. To diagnose this disease, doctors often use the patient's description and questionnaires, psychological tests, and the patient's behavior in which reliability is questionable. Convolutional neural network (CNN) is one deep learning technique that has been used for the diagnosis of ADHD. CNN, however, does not account for how signals change over time, which leads to low classification performances and ambiguous findings. In this study, the authors designed a hybrid deep learning model that combines long-short-term memory (LSTM) and CNN to simultaneously extract and learn the spatial features and long-term dependencies of the electroencephalography (EEG) data. The effectiveness of the proposed hybrid deep learning model was assessed using 2 publicly available EEG datasets. The suggested model achieves a classification accuracy of 98.86% on the ADHD dataset and 98.28% on the FOCUS dataset, respectively. The experimental findings show that the proposed hybrid CNN-LSTM model outperforms the state-of-the-art methods to diagnose ADHD using EEG. Hence, the proposed hybrid CNN-LSTM model could therefore be utilized to help with the clinical diagnosis of ADHD patients.
Collapse
Affiliation(s)
- Nupur Chugh
- Netaji Subhas Institute of Technology, New Delhi, India
| | - Swati Aggarwal
- Netaji Subhas University of Technology, New Delhi, India
| | - Arnav Balyan
- Netaji Subhas Institute of Technology, New Delhi, India
| |
Collapse
|
7
|
Tian F, Zhu L, Shi Q, Wang R, Zhang L, Dong Q, Qian K, Zhao Q, Hu B. The Three-Lead EEG Sensor: Introducing an EEG-Assisted Depression Diagnosis System Based on Ant Lion Optimization. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2023; 17:1305-1318. [PMID: 37402182 DOI: 10.1109/tbcas.2023.3292237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/06/2023]
Abstract
For depression diagnosis, traditional methods such as interviews and clinical scales have been widely leveraged in the past few decades, but they are subjective, time-consuming, and labor-consuming. With the development of affective computing and Artificial Intelligence (AI) technologies, Electroencephalogram (EEG)-based depression detection methods have emerged. However, previous research has virtually neglected practical application scenarios, as most studies have focused on analyzing and modeling EEG data. Furthermore, EEG data is typically obtained from specialized devices that are large, complex to operate, and poorly ubiquitous. To address these challenges, a wearable three-lead EEG sensor with flexible electrodes was developed to obtain prefrontal-lobe EEG data. Experimental measurements show that the EEG sensor achieves promising performance (background noise of no more than 0.91 μVpp, Signal-to-Noise Ratio (SNR) of 26--48 dB, and electrode-skin contact impedance of less than 1 K Ω). In addition, EEG data from 70 depressed patients and 108 healthy controls were collected using the EEG sensor, and the linear and nonlinear features were extracted. The features were then weighted and selected using the Ant Lion Optimization (ALO) algorithm to improve classification performance. The experimental results show that the k-NN classifier achieves a classification accuracy of 90.70%, specificity of 96.53%, and sensitivity of 81.79%, indicating the promising potential of the three-lead EEG sensor combined with the ALO algorithm and the k-NN classifier for EEG-assisted depression diagnosis.
Collapse
|
8
|
Tigga NP, Garg S. Efficacy of novel attention-based gated recurrent units transformer for depression detection using electroencephalogram signals. Health Inf Sci Syst 2023; 11:1. [PMID: 36590874 PMCID: PMC9800680 DOI: 10.1007/s13755-022-00205-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 12/13/2022] [Indexed: 12/30/2022] Open
Abstract
Purpose Depression is a global challenge causing psychological and intellectual problems that require efficient diagnosis. Electroencephalogram (EEG) signals represent the functional state of the human brain and can help build an accurate and viable technique for the early prediction and treatment of depression. Methods An attention-based gated recurrent units transformer (AttGRUT) time-series model is proposed to efficiently identify EEG perturbations in depressive patients. Statistical, spectral and wavelet features were first extracted from the 60-channel EEG signal data. Then, two feature selection techniques, recursive feature elimination and the Boruta algorithm, both with Shapley additive explanations, were utilised for selecting essential features. Results The proposed model outperformed the two baseline and two hybrid time-series models-long short-term memory (LSTM), gated recurrent units (GRU), convolutional neural network-LSTM (CNN-LSTM), and CNN-GRU-achieving an accuracy of up to 98.67%. Feature selection considerably increased the performance across all time-series models. Conclusion Based on the obtained results, novel feature selection greatly affected the results of the baseline and hybrid time-series models. The proposed AttGRUT can be implemented and tested in other domains by using different modalities for prediction. Supplementary Information The online version contains supplementary material available at 10.1007/s13755-022-00205-8.
Collapse
Affiliation(s)
| | - Shruti Garg
- Birla Institute of Technology, Mesra, Ranchi, India
| |
Collapse
|
9
|
Wang HG, Meng QH, Jin LC, Hou HR. AMGCN-L: an adaptive multi-time-window graph convolutional network with long-short-term memory for depression detection. J Neural Eng 2023; 20:056038. [PMID: 37844566 DOI: 10.1088/1741-2552/ad038b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 10/16/2023] [Indexed: 10/18/2023]
Abstract
Objective.Depression is a common chronic mental disorder characterized by high rates of prevalence, recurrence, suicide, and disability as well as heavy disease burden. An accurate diagnosis of depression is a prerequisite for treatment. However, existing questionnaire-based diagnostic methods are limited by the innate subjectivity of medical practitioners and subjects. In the search for a more objective diagnostic methods for depression, researchers have recently started to use deep learning approaches.Approach.In this work, a deep-learning network, named adaptively multi-time-window graph convolutional network (GCN) with long-short-term memory (LSTM) (i.e. AMGCN-L), is proposed. This network can automatically categorize depressed and non-depressed people by testing for the existence of inherent brain functional connectivity and spatiotemporal features contained in electroencephalogram (EEG) signals. AMGCN-L is mainly composed of two sub-networks: the first sub-network is an adaptive multi-time-window graph generation block with which adjacency matrices that contain brain functional connectivity on different time periods are adaptively designed. The second sub-network consists of GCN and LSTM, which are used to fully extract the innate spatial and temporal features of EEG signals, respectively.Main results.Two public datasets, namely the patient repository for EEG data and computational tools, and the multi-modal open dataset for mental-disorder analysis, were used to test the performance of the proposed network; the depression recognition accuracies achieved in both datasets (using tenfold cross-validation) were 90.38% and 90.57%, respectively.Significance.This work demonstrates that GCN and LSTM have eminent effects on spatial and temporal feature extraction, respectively, suggesting that the exploration of brain connectivity and the exploitation of spatiotemporal features benefit the detection of depression. Moreover, the proposed method provides effective support and supplement for the detection of clinical depression and later treatment procedures.
Collapse
Affiliation(s)
- Han-Guang Wang
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| | - Qing-Hao Meng
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| | - Li-Cheng Jin
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| | - Hui-Rang Hou
- Tianjin University, Tianjin Key Laboratory of Process Measurement and Control, Institute of Robotics and Autonomous Systems, School of Electrical and Information, Tianjin, People's Republic of China
| |
Collapse
|
10
|
Xu Y, Zhong H, Ying S, Liu W, Chen G, Luo X, Li G. Depressive Disorder Recognition Based on Frontal EEG Signals and Deep Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:8639. [PMID: 37896732 PMCID: PMC10611358 DOI: 10.3390/s23208639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 10/10/2023] [Accepted: 10/18/2023] [Indexed: 10/29/2023]
Abstract
Depressive disorder (DD) has become one of the most common mental diseases, seriously endangering both the affected person's psychological and physical health. Nowadays, a DD diagnosis mainly relies on the experience of clinical psychiatrists and subjective scales, lacking objective, accurate, practical, and automatic diagnosis technologies. Recently, electroencephalogram (EEG) signals have been widely applied for DD diagnosis, but mainly with high-density EEG, which can severely limit the efficiency of the EEG data acquisition and reduce the practicability of diagnostic techniques. The current study attempts to achieve accurate and practical DD diagnoses based on combining frontal six-channel electroencephalogram (EEG) signals and deep learning models. To this end, 10 min clinical resting-state EEG signals were collected from 41 DD patients and 34 healthy controls (HCs). Two deep learning models, multi-resolution convolutional neural network (MRCNN) combined with long short-term memory (LSTM) (named MRCNN-LSTM) and MRCNN combined with residual squeeze and excitation (RSE) (named MRCNN-RSE), were proposed for DD recognition. The results of this study showed that the higher EEG frequency band obtained the better classification performance for DD diagnosis. The MRCNN-RSE model achieved the highest classification accuracy of 98.48 ± 0.22% with 8-30 Hz EEG signals. These findings indicated that the proposed analytical framework can provide an accurate and practical strategy for DD diagnosis, as well as essential theoretical and technical support for the treatment and efficacy evaluation of DD.
Collapse
Affiliation(s)
- Yanting Xu
- College of Engineering, Zhejiang Normal University, Jinhua 321004, China; (Y.X.); (S.Y.)
| | - Hongyang Zhong
- College of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; (H.Z.); (W.L.); (G.C.)
| | - Shangyan Ying
- College of Engineering, Zhejiang Normal University, Jinhua 321004, China; (Y.X.); (S.Y.)
| | - Wei Liu
- College of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; (H.Z.); (W.L.); (G.C.)
| | - Guibin Chen
- College of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; (H.Z.); (W.L.); (G.C.)
| | - Xiaodong Luo
- The Second Hospital of Jinhua, Jinhua 321016, China
| | - Gang Li
- College of Mathematical Medicine, Zhejiang Normal University, Jinhua 321004, China
| |
Collapse
|
11
|
Luo G, Rao H, An P, Li Y, Hong R, Chen W, Chen S. Exploring Adaptive Graph Topologies and Temporal Graph Networks for EEG-Based Depression Detection. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3947-3957. [PMID: 37773916 DOI: 10.1109/tnsre.2023.3320693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/01/2023]
Abstract
In recent years, Graph Neural Networks (GNNs) based on deep learning techniques have achieved promising results in EEG-based depression detection tasks but still have some limitations. Firstly, most existing GNN-based methods use pre-computed graph adjacency matrices, which ignore the differences in brain networks between individuals. Additionally, methods based on graph-structured data do not consider the temporal dependency information of brain networks. To address these issues, we propose a deep learning algorithm that explores adaptive graph topologies and temporal graph networks for EEG-based depression detection. Specifically, we designed an Adaptive Graph Topology Generation (AGTG) module that can adaptively model the real-time connectivity of the brain networks, revealing differences between individuals. In addition, we designed a Graph Convolutional Gated Recurrent Unit (GCGRU) module to capture the temporal dynamical changes of brain networks. To further explore the differential features between depressed and healthy individuals, we adopt Graph Topology-based Max-Pooling (GTMP) module to extract graph representation vectors accurately. We conduct a comparative analysis with several advanced algorithms on both public and our own datasets. The results reveal that our final model achieves the highest Area Under the Receiver Operating Characteristic Curve (AUROC) on both datasets, with values of 83% and 99%, respectively. Furthermore, we perform extensive validation experiments demonstrating our proposed method's effectiveness and advantages. Finally, we present a comprehensive discussion on the differences in brain networks between healthy and depressed individuals based on the outputs of our final model's AGTG and GTMP modules.
Collapse
|
12
|
Qi X, Xu W, Li G. Neuroimaging Study of Brain Functional Differences in Generalized Anxiety Disorder and Depressive Disorder. Brain Sci 2023; 13:1282. [PMID: 37759883 PMCID: PMC10526432 DOI: 10.3390/brainsci13091282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 08/23/2023] [Accepted: 08/31/2023] [Indexed: 09/29/2023] Open
Abstract
Generalized anxiety disorder (GAD) and depressive disorder (DD) are distinct mental disorders, which are characterized by complex and unique neuroelectrophysiological mechanisms in psychiatric neurosciences. The understanding of the brain functional differences between GAD and DD is crucial for the accurate diagnosis and clinical efficacy evaluation. The aim of this study was to reveal the differences in functional brain imaging between GAD and DD based on multidimensional electroencephalogram (EEG) characteristics. To this end, 10 min resting-state EEG signals were recorded from 38 GAD and 34 DD individuals. Multidimensional EEG features were subsequently extracted, which include power spectrum density (PSD), fuzzy entropy (FE), and phase lag index (PLI). Then, a direct statistical analysis (i.e., ANOVA) and three ensemble learning models (i.e., Random Forest (RF), Light Gradient Boosting Machine (LightGBM), eXtreme Gradient Boosting (XGBoost)) were used on these EEG features for the differential recognitions. Our results showed that DD has significantly higher PSD values in the alpha1 and beta band, and a higher FE in the beta band, in comparison with GAD, along with the aberrant functional connections in all four bands between GAD and DD. Moreover, machine learning analysis further revealed that the distinct features predominantly occurred in the beta band and functional connections. Here, we show that DD has higher power and more complex brain activity patterns in the beta band and reorganized brain functional network structures in all bands compared to GAD. In sum, these findings move towards the practical identification of brain functional differences between GAD and DD.
Collapse
Affiliation(s)
- Xuchen Qi
- Department of Neurosurgery, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310000, China;
- Department of Neurosurgery, Shaoxing People’s Hospital, Shaoxing 312000, China
| | - Wanxiu Xu
- College of Engineering, Zhejiang Normal University, Jinhua 321004, China;
| | - Gang Li
- College of Mathematical Medicine, Zhejiang Normal University, Jinhua 321004, China
| |
Collapse
|
13
|
Shahabi MS, Shalbaf A, Rostami R. Prediction of response to repetitive transcranial magnetic stimulation for major depressive disorder using hybrid Convolutional recurrent neural networks and raw Electroencephalogram Signal. Cogn Neurodyn 2023; 17:909-920. [PMID: 37522037 PMCID: PMC10374518 DOI: 10.1007/s11571-022-09881-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 08/03/2022] [Accepted: 08/28/2022] [Indexed: 11/30/2022] Open
Abstract
Major Depressive Disorder (MDD) is a high prevalence disease that needs an effective and timely treatment to prevent its progress and additional costs. Repetitive Transcranial Magnetic Stimulation (rTMS) is an effective treatment option for MDD patients which uses strong magnetic pulses to stimulate specific regions of the brain. However, some patients do not respond to this treatment which causes the waste of multiple weeks as treatment time and clinical resources. Therefore developing an effective way for the prediction of response to the rTMS treatment of depression is necessary. In this work, we proposed a hybrid model created by pre-trained Convolutional Neural Networks (CNN) models and Bidirectional Long Short-Term Memory (BLSTM) cells to predict response to rTMS treatment from raw EEG signal. Three pre-trained CNN models named VGG16, InceptionResNetV2, and EffecientNetB0 were utilized as Transfer Learning (TL) models to construct hybrid TL-BLSTM models. Then an ensemble of these models was created using weighted majority voting which the weights were optimized by Differential Evolution (DE) optimization algorithm. Evaluation of these models shows the superior performance of the ensemble model by the accuracy of 98.51%, sensitivity of 98.64%, specificity of 98.36%, F1-score of 98.6%, and AUC of 98.5%. Therefore, the ensemble of the proposed hybrid convolutional recurrent networks can efficiently predict the treatment outcome of rTMS using raw EEG data.
Collapse
Affiliation(s)
- Mohsen Sadat Shahabi
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Reza Rostami
- Department of Psychology, University of Tehran, Tehran, Iran
| |
Collapse
|
14
|
Ksibi A, Zakariah M, Menzli LJ, Saidani O, Almuqren L, Hanafieh RAM. Electroencephalography-Based Depression Detection Using Multiple Machine Learning Techniques. Diagnostics (Basel) 2023; 13:diagnostics13101779. [PMID: 37238263 DOI: 10.3390/diagnostics13101779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 04/28/2023] [Accepted: 05/08/2023] [Indexed: 05/28/2023] Open
Abstract
The growth of biomedical engineering has made depression diagnosis via electroencephalography (EEG) a trendy issue. The two significant challenges to this application are EEG signals' complexity and non-stationarity. Additionally, the effects caused by individual variances may hamper the generalization of detection systems. Given the association between EEG signals and particular demographics, such as gender and age, and the influences of these demographic characteristics on the incidence of depression, it would be preferable to include demographic factors during EEG modeling and depression detection. The main objective of this work is to develop an algorithm that can recognize depression patterns by studying EEG data. Following a multiband analysis of such signals, machine learning and deep learning techniques were used to detect depression patients automatically. EEG signal data are collected from the multi-modal open dataset MODMA and employed in studying mental diseases. The EEG dataset contains information from a traditional 128-electrode elastic cap and a cutting-edge wearable 3-electrode EEG collector for widespread applications. In this project, resting EEG readings of 128 channels are considered. According to CNN, training with 25 epoch iterations had a 97% accuracy rate. The patient's status has to be divided into two basic categories: major depressive disorder (MDD) and healthy control. Additional MDD include the following six classes: obsessive-compulsive disorders, addiction disorders, conditions brought on by trauma and stress, mood disorders, schizophrenia, and the anxiety disorders discussed in this paper are a few examples of mental illnesses. According to the study, a natural combination of EEG signals and demographic data is promising for the diagnosis of depression.
Collapse
Affiliation(s)
- Amel Ksibi
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Mohammed Zakariah
- Department of Computer Science, College of Computer and Information Sciences, Riyadh 11442, Saudi Arabia
| | - Leila Jamel Menzli
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Oumaima Saidani
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Latifah Almuqren
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Rosy Awny Mohamed Hanafieh
- Department of Computer Science, College of Computing in Al-Qunfudah, Umm Al-Qura University, Makkah 24382, Saudi Arabia
| |
Collapse
|
15
|
Zhang J, Xu B, Yin H. Depression screening using hybrid neural network. MULTIMEDIA TOOLS AND APPLICATIONS 2023; 82:1-16. [PMID: 37362740 PMCID: PMC9992920 DOI: 10.1007/s11042-023-14860-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 08/03/2022] [Accepted: 02/06/2023] [Indexed: 06/28/2023]
Abstract
Depression is a common cause of increased suicides worldwide, and studies have shown that the number of patients suffering from major depressive disorder (MDD) increased several-fold during the COVID-19 pandemic, highlighting the importance of disease detection and depression management, while increasing the need for effective diagnostic tools. In recent years, machine learning and deep learning methods based on electroencephalography (EEG) have achieved significant results in the field of automatic depression detection. However, most current studies have focused on a small number of EEG signal channels, and experimental data require special processing by professionals. In this study, 128 channels of EEG signals were simply filtered and 24-fold leave-one-out cross-validation experiments were performed using 2DCNN-LSTM classifier, support vector machine, K-nearest neighbor and decision tree. The current results show that the proposed 2DCNN-LSTM model has an average classification accuracy of 95.1% with an AUC of 0.98 for depression detection of 6-second participant EEG signals, and the model is much better than 72.05%, 79.7% and 79.49% for support vector machine, K nearest neighbor and decision tree. In addition, we found that the model achieved a 100% probability of correctly classifying the EEG signals of 300-second participants.
Collapse
Affiliation(s)
- Jiao Zhang
- School of Computer and Information Technology, Beijing Jiaotong University, Beijing, China
| | - Baomin Xu
- School of Computer and Information Technology, Beijing Jiaotong University, Beijing, China
| | - Hongfeng Yin
- School of Computer and Information Technology, Cangzhou Jiaotong College, Cangzhou, Hebei China
| |
Collapse
|
16
|
Shusharina N, Yukhnenko D, Botman S, Sapunov V, Savinov V, Kamyshov G, Sayapin D, Voznyuk I. Modern Methods of Diagnostics and Treatment of Neurodegenerative Diseases and Depression. Diagnostics (Basel) 2023; 13:573. [PMID: 36766678 PMCID: PMC9914271 DOI: 10.3390/diagnostics13030573] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 01/27/2023] [Accepted: 01/29/2023] [Indexed: 02/09/2023] Open
Abstract
This paper discusses the promising areas of research into machine learning applications for the prevention and correction of neurodegenerative and depressive disorders. These two groups of disorders are among the leading causes of decline in the quality of life in the world when estimated using disability-adjusted years. Despite decades of research, the development of new approaches for the assessment (especially pre-clinical) and correction of neurodegenerative diseases and depressive disorders remains among the priority areas of research in neurophysiology, psychology, genetics, and interdisciplinary medicine. Contemporary machine learning technologies and medical data infrastructure create new research opportunities. However, reaching a consensus on the application of new machine learning methods and their integration with the existing standards of care and assessment is still a challenge to overcome before the innovations could be widely introduced to clinics. The research on the development of clinical predictions and classification algorithms contributes towards creating a unified approach to the use of growing clinical data. This unified approach should integrate the requirements of medical professionals, researchers, and governmental regulators. In the current paper, the current state of research into neurodegenerative and depressive disorders is presented.
Collapse
Affiliation(s)
- Natalia Shusharina
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Denis Yukhnenko
- Department of Social Security and Humanitarian Technologies, N. I. Lobachevsky State University of Nizhny Novgorod, 603022 Nizhny Novgorod, Russia
| | - Stepan Botman
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Viktor Sapunov
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Vladimir Savinov
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Gleb Kamyshov
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Dmitry Sayapin
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
| | - Igor Voznyuk
- Baltic Center for Neurotechnologies and Artificial Intelligence, Immanuel Kant Baltic Federal University, 236041 Kaliningrad, Russia
- Department of Neurology, Pavlov First Saint Petersburg State Medical University, 197022 Saint Petersburg, Russia
| |
Collapse
|
17
|
Barua PD, Vicnesh J, Lih OS, Palmer EE, Yamakawa T, Kobayashi M, Acharya UR. Artificial intelligence assisted tools for the detection of anxiety and depression leading to suicidal ideation in adolescents: a review. Cogn Neurodyn 2022:1-22. [PMID: 36467993 PMCID: PMC9684805 DOI: 10.1007/s11571-022-09904-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 09/26/2022] [Accepted: 10/17/2022] [Indexed: 11/24/2022] Open
Abstract
Epidemiological studies report high levels of anxiety and depression amongst adolescents. These psychiatric conditions and complex interplays of biological, social and environmental factors are important risk factors for suicidal behaviours and suicide, which show a peak in late adolescence and early adulthood. Although deaths by suicide have fallen globally in recent years, suicide deaths are increasing in some countries, such as the US. Suicide prevention is a challenging global public health problem. Currently, there aren't any validated clinical biomarkers for suicidal diagnosis, and traditional methods exhibit limitations. Artificial intelligence (AI) is budding in many fields, including in the diagnosis of medical conditions. This review paper summarizes recent studies (past 8 years) that employed AI tools for the automated detection of depression and/or anxiety disorder and discusses the limitations and effects of some modalities. The studies assert that AI tools produce promising results and could overcome the limitations of traditional diagnostic methods. Although using AI tools for suicidal ideation exhibits limitations, these are outweighed by the advantages. Thus, this review article also proposes extracting a fusion of features such as facial images, speech signals, and visual and clinical history features from deep models for the automated detection of depression and/or anxiety disorder in individuals, for future work. This may pave the way for the identification of individuals with suicidal thoughts.
Collapse
Affiliation(s)
- Prabal Datta Barua
- School of Management and Enterprise, University of Southern Queensland, Springfield, Australia
| | - Jahmunah Vicnesh
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
| | - Oh Shu Lih
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
| | - Elizabeth Emma Palmer
- Discipline of Pediatric and Child Health, School of Clinical Medicine, University of New South Wales, Kensington, Australia
- Sydney Children’s Hospitals Network, Sydney, Australia
| | - Toshitaka Yamakawa
- Department of Computer Science and Electrical Engineering, Kumamoto University, Kumamoto, Japan
| | - Makiko Kobayashi
- Department of Computer Science and Electrical Engineering, Kumamoto University, Kumamoto, Japan
| | - Udyavara Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore
- School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
- Department of Bioinformatics and Medical Engineering, Asia University, Taizhong, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, Japan
| |
Collapse
|
18
|
RNN and BiLSTM Fusion for Accurate Automatic Epileptic Seizure Diagnosis Using EEG Signals. LIFE (BASEL, SWITZERLAND) 2022; 12:life12121946. [PMID: 36556313 PMCID: PMC9784456 DOI: 10.3390/life12121946] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 11/17/2022] [Accepted: 11/18/2022] [Indexed: 11/24/2022]
Abstract
Epilepsy is a common neurological condition. The effects of epilepsy are not restricted to seizures alone. They comprise a wide spectrum of problems that might impair and reduce quality of life. Even with medication, 30% of epilepsy patients still have recurring seizures. An epileptic seizure is caused by significant neuronal electrical activity, which affects brain activity. EEG shows these changes as high-amplitude spiky and sluggish waves. Recognizing seizures on an electroencephalogram (EEG) manually by a professional neurologist is a time-consuming and labor-intensive process, hence an efficient automated approach is necessary for the identification of epileptic seizure. One technique to increase the speed and accuracy with which a diagnosis of epileptic seizures could be made is by utilizing computer-aided diagnosis systems that are built on deep neural networks, or DNN. This study introduces a fusion of recurrent neural networks (RNNs) and bi-directional long short-term memories (BiLSTMs) for automatic epileptic seizure identification via EEG signal processing in order to tackle the aforementioned informational challenges. An electroencephalogram's (EEG) raw data were first normalized after undergoing pre-processing. A RNN model was fed the normalized EEG sequence data and trained to accurately extract features from the data. Afterwards, the features were passed to the BiLSTM layers for processing so that further temporal information could be retrieved. In addition, the proposed RNN-BiLSTM model was tested in an experimental setting using the freely accessible UCI epileptic seizure dataset. Experimental findings of the suggested model have achieved avg values of 98.90%, 98.50%, 98. 20%, and 98.60%, respectively, for accuracy, sensitivity, precision, and specificity. To further verify the new model's efficacy, it is compared to other models, such as the RNN-LSTM and the RNN-GRU learning models, and is shown to have improved the same metrics by 1.8%, 1.69%, 1.95%, and 2.2% on using 5-fold. Additionally, the proposed method was compared to state-of-the-art approaches and proved to be a more accurate categorization of such techniques.
Collapse
|
19
|
Yang B, Huang Y, Li Z, Hu X. Management of Post-stroke Depression (PSD) by Electroencephalography for Effective Rehabilitation. ENGINEERED REGENERATION 2022. [DOI: 10.1016/j.engreg.2022.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
|
20
|
Aguilera-Martos I, García-Vico ÁM, Luengo J, Damas S, Melero FJ, Valle-Alonso JJ, Herrera F. TSFEDL: A Python Library for Time Series Spatio-Temporal Feature Extraction and Prediction using Deep Learning. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.10.062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
21
|
Benchmarks for machine learning in depression discrimination using electroencephalography signals. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04159-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
22
|
Li Y, Shen Y, Fan X, Huang X, Yu H, Zhao G, Ma W. A novel EEG-based major depressive disorder detection framework with two-stage feature selection. BMC Med Inform Decis Mak 2022; 22:209. [PMID: 35933348 PMCID: PMC9357341 DOI: 10.1186/s12911-022-01956-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 07/29/2022] [Indexed: 11/16/2022] Open
Abstract
Background Major depressive disorder (MDD) is a common mental illness, characterized by persistent depression, sadness, despair, etc., troubling people’s daily life and work seriously. Methods In this work, we present a novel automatic MDD detection framework based on EEG signals. First of all, we derive highly MDD-correlated features, calculating the ratio of extracted features from EEG signals at frequency bands between \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\beta$$\end{document}β and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha$$\end{document}α. Then, a two-stage feature selection method named PAR is presented with the sequential combination of Pearson correlation coefficient (PCC) and recursive feature elimination (RFE), where the advantages lie in minimizing the feature searching space. Finally, we employ widely used machine learning methods of support vector machine (SVM), logistic regression (LR), and linear regression (LNR) for MDD detection with the merit of feature interpretability. Results Experiment results show that our proposed MDD detection framework achieves competitive results. The accuracy and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$F_{1}$$\end{document}F1 score are up to 0.9895 and 0.9846, respectively. Meanwhile, the regression determination coefficient \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R^2$$\end{document}R2 for MDD severity assessment is up to 0.9479. Compared with existing MDD detection methods with the best accuracy of 0.9840 and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$F_1$$\end{document}F1 score of 0.97, our proposed framework achieves the state-of-the-art MDD detection performance. Conclusions Development of this MDD detection framework can be potentially deployed into a medical system to aid physicians to screen out MDD patients.
Collapse
Affiliation(s)
- Yujie Li
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Yingshan Shen
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Xiaomao Fan
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China.
| | - Xingxian Huang
- Department of Acupuncture and Moxibustion, Shenzhen Traditional Chinese Medicine Hospital, Shenzhen, China
| | - Haibo Yu
- Department of Acupuncture and Moxibustion, Shenzhen Traditional Chinese Medicine Hospital, Shenzhen, China
| | - Gansen Zhao
- School of Computer Science, South China Normal University, Guangzhou, China
| | - Wenjun Ma
- School of Computer Science, South China Normal University, Guangzhou, China
| |
Collapse
|
23
|
Shen J, Liu N, Li D, Zhang B. Behavioral Analysis of EEG Signals in Loss-Gain Decision-Making Experiments. Behav Neurol 2022; 2022:3070608. [PMID: 35874640 PMCID: PMC9307401 DOI: 10.1155/2022/3070608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2021] [Accepted: 06/17/2022] [Indexed: 11/18/2022] Open
Abstract
Extraction and analysis of the EEG (electroencephalograph) information features generated during behavioral decision-making can provide a better understanding of the state of mind. Previous studies have focused more on the brainwave features after behavioral decision-making. In fact, the EEG before decision-making is more worthy of our attention. In this study, we introduce a new index based on the reaction time of subjects before decision-making, called the Prestimulus Time (PT), which have important reference value for the study of cognitive function, neurological diseases, and other fields. In our experiments, we use a wearable EEG feature signal acquisition device and a systematic reward and punishment experiment to obtain the EEG features before and after behavioral decision-making. The experimental results show that the EEG generated after behavioral decision due to loss is more intense than that generated by gain in the medial frontal cortex (MFC). In addition, different characteristics of EEG signals are generated prior to behavioral decisions because people have different expectations of the outcome. It will produce more significant negative-polarity event-related potential (ERP) in the forebrain area when the humans are optimistic about the outcomes.
Collapse
Affiliation(s)
- Jiaquan Shen
- School of Information Science, Luoyang Normal University, Luoyang 471022, China
| | - Ningzhong Liu
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Jiangsu Nanjing 211106, China
| | - Deguang Li
- School of Information Science, Luoyang Normal University, Luoyang 471022, China
| | - Binbin Zhang
- School of Information Science, Luoyang Normal University, Luoyang 471022, China
| |
Collapse
|
24
|
Tato A, Nkambou R. Infusing Expert Knowledge Into a Deep Neural Network Using Attention Mechanism for Personalized Learning Environments. Front Artif Intell 2022; 5:921476. [PMID: 35719689 PMCID: PMC9203682 DOI: 10.3389/frai.2022.921476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 05/13/2022] [Indexed: 11/19/2022] Open
Abstract
Machine learning models are biased toward data seen during the training steps. The models will tend to give good results in classes where there are many examples and poor results in those with few examples. This problem generally occurs when the classes to predict are imbalanced and this is frequent in educational data where for example, there are skills that are very difficult or very easy to master. There will be less data on students that correctly answered questions related to difficult skills and who incorrectly answered those related to skills easy to master. In this paper, we tackled this problem by proposing a hybrid architecture combining Deep Neural Network architectures— especially Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN)—with expert knowledge for user modeling. The proposed solution uses attention mechanism to infuse expert knowledge into the Deep Neural Network. It has been tested in two contexts: knowledge tracing in an intelligent tutoring system (ITS) called Logic-Muse and prediction of socio-moral reasoning in a serious game called MorALERT. The proposed solution is compared to state-of-the-art machine learning solutions and experiments show that the resulting model can accurately predict the current student's knowledge state (in Logic-Muse) and thus enable an accurate personalization of the learning process. Other experiments show that the model can also be used to predict the level of socio-moral reasoning skills (in MorALERT). Our findings suggest the need for hybrid neural networks that integrate prior expert knowledge (especially when it is necessary to compensate for the strong dependency—of deep learning methods—on data size or the possible unbalanced datasets). Many domains can benefit from such an approach to building models that allow generalization even when there are small training data.
Collapse
|
25
|
Deng X, Fan X, Lv X, Sun K. SparNet: A Convolutional Neural Network for EEG Space-Frequency Feature Learning and Depression Discrimination. Front Neuroinform 2022; 16:914823. [PMID: 35722169 PMCID: PMC9201718 DOI: 10.3389/fninf.2022.914823] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 05/06/2022] [Indexed: 11/13/2022] Open
Abstract
Depression affects many people around the world today and is considered a global problem. Electroencephalogram (EEG) measurement is an appropriate way to understand the underlying mechanisms of major depressive disorder (MDD) to distinguish depression from normal control. With the development of deep learning methods, many researchers have adopted deep learning models to improve the classification accuracy of depression recognition. However, there are few studies on designing convolution filters for spatial and frequency domain feature learning in different brain regions. In this study, SparNet, a convolutional neural network composed of five parallel convolutional filters and the SENet, is proposed to learn EEG space-frequency domain characteristics and distinguish between depressive and normal control. The model is trained and tested by the cross-validation method of subject division. The results show that SparNet achieves a sensitivity of 95.07%, a specificity of 93.66%, and an accuracy of 94.37% in classification. Therefore, our results can conclude that the proposed SparNet model is effective in detecting depression using EEG signals. It also indicates that the combination of spatial information and frequency domain information is an effective way to identify patients with depression.
Collapse
Affiliation(s)
| | - Xufeng Fan
- Key Laboratory of Data Engineering and Visual Computing, College of Computer Science and Technology, Chongqing University of Posts and Telecommunication, Chongqing, China
| | | | | |
Collapse
|
26
|
Liu W, Jia K, Wang Z, Ma Z. A Depression Prediction Algorithm Based on Spatiotemporal Feature of EEG Signal. Brain Sci 2022; 12:630. [PMID: 35625016 PMCID: PMC9139403 DOI: 10.3390/brainsci12050630] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 04/29/2022] [Accepted: 05/09/2022] [Indexed: 11/16/2022] Open
Abstract
Depression has gradually become the most common mental disorder in the world. The accuracy of its diagnosis may be affected by many factors, while the primary diagnosis seems to be difficult to define. Finding a way to identify depression by satisfying both objective and effective conditions is an urgent issue. In this paper, a strategy for predicting depression based on spatiotemporal features is proposed, and is expected to be used in the auxiliary diagnosis of depression. Firstly, electroencephalogram (EEG) signals were denoised through the filter to obtain the power spectra of the three corresponding frequency ranges, Theta, Alpha and Beta. Using orthogonal projection, the spatial positions of the electrodes were mapped to the brainpower spectrum, thereby obtaining three brain maps with spatial information. Then, the three brain maps were superimposed on a new brain map with frequency domain and spatial characteristics. A Convolutional Neural Network (CNN) and Gated Recurrent Unit (GRU) were applied to extract the sequential feature. The proposed strategy was validated with a public EEG dataset, achieving an accuracy of 89.63% and an accuracy of 88.56% with the private dataset. The network had less complexity with only six layers. The results show that our strategy is credible, less complex and useful in predicting depression using EEG signals.
Collapse
Affiliation(s)
- Wei Liu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
- Beijing Laboratory of Advanced Information Networks, Beijing 100124, China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
| | - Kebin Jia
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
- Beijing Laboratory of Advanced Information Networks, Beijing 100124, China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
| | - Zhuozheng Wang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
| | - Zhuo Ma
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (W.L.); (Z.W.); (Z.M.)
| |
Collapse
|
27
|
Zhang B, Cai H, Song Y, Tao L, Li Y. Computer-aided Recognition Based on Decision-level Multimodal Fusion for Depression. IEEE J Biomed Health Inform 2022; 26:3466-3477. [PMID: 35389872 DOI: 10.1109/jbhi.2022.3165640] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Aiming at the problem of depression recognition, this paper proposes a computer-aided recognition framework based on decision-level multimodal fusion. In Song Dynasty of China, the idea of multimodal fusion was contained in "one gets different impressions of a mountain when viewing it from the front or sideways, at a close range or from afar" poetry. Objective and comprehensive analysis of depression can more accurately restore its essence, and multimodal can represent more information about depression compared to single modal. Linear electroencephalography (EEG) features based on adaptive auto regression (AR) model and typical nonlinear EEG features are extracted. EEG features related to depression and graph metric features in depression related brain regions are selected as the data basis of multimodal fusion to ensure data diversity. Based on the theory of multi-agent cooperation, the computer-aided depression recognition model of decision-level is realized. The experimental data comes from 24 depressed patients and 29 healthy controls (HC). The results of multi-group controlled trials show that compared with single modal or independent classifiers, the decision-level multimodal fusion method has a stronger ability to recognize depression, and the highest accuracy rate 92.13% was obtained. In addition, our results suggest that improving the brain region associated with information processing can help alleviate and treat depression. In the field of classification and recognition, our results clarify that there is no universal classifier suitable for any condition.
Collapse
|
28
|
Automated diagnosis of depression from EEG signals using traditional and deep learning approaches: A comparative analysis. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2021.12.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|
29
|
Safayari A, Bolhasani H. Depression diagnosis by deep learning using EEG signals: A systematic review. MEDICINE IN NOVEL TECHNOLOGY AND DEVICES 2021. [DOI: 10.1016/j.medntd.2021.100102] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
|
30
|
Shoeibi A, Sadeghi D, Moridian P, Ghassemi N, Heras J, Alizadehsani R, Khadem A, Kong Y, Nahavandi S, Zhang YD, Gorriz JM. Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models. Front Neuroinform 2021; 15:777977. [PMID: 34899226 PMCID: PMC8657145 DOI: 10.3389/fninf.2021.777977] [Citation(s) in RCA: 50] [Impact Index Per Article: 16.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/22/2021] [Indexed: 11/13/2022] Open
Abstract
Schizophrenia (SZ) is a mental disorder whereby due to the secretion of specific chemicals in the brain, the function of some brain regions is out of balance, leading to the lack of coordination between thoughts, actions, and emotions. This study provides various intelligent deep learning (DL)-based methods for automated SZ diagnosis via electroencephalography (EEG) signals. The obtained results are compared with those of conventional intelligent methods. To implement the proposed methods, the dataset of the Institute of Psychiatry and Neurology in Warsaw, Poland, has been used. First, EEG signals were divided into 25 s time frames and then were normalized by z-score or norm L2. In the classification step, two different approaches were considered for SZ diagnosis via EEG signals. In this step, the classification of EEG signals was first carried out by conventional machine learning methods, e.g., support vector machine, k-nearest neighbors, decision tree, naïve Bayes, random forest, extremely randomized trees, and bagging. Various proposed DL models, namely, long short-term memories (LSTMs), one-dimensional convolutional networks (1D-CNNs), and 1D-CNN-LSTMs, were used in the following. In this step, the DL models were implemented and compared with different activation functions. Among the proposed DL models, the CNN-LSTM architecture has had the best performance. In this architecture, the ReLU activation function with the z-score and L2-combined normalization was used. The proposed CNN-LSTM model has achieved an accuracy percentage of 99.25%, better than the results of most former studies in this field. It is worth mentioning that to perform all simulations, the k-fold cross-validation method with k = 5 has been used.
Collapse
Affiliation(s)
- Afshin Shoeibi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Delaram Sadeghi
- Department of Medical Engineering, Islamic Azad University of Mashhad, Mashhad, Iran
| | - Parisa Moridian
- Faculty of Engineering, Islamic Azad University of Science and Research, Tehran, Iran
| | - Navid Ghassemi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Jónathan Heras
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Ali Khadem
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yinan Kong
- School of Engineering, Macquarie University, Sydney, NSW, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Yu-Dong Zhang
- Department of Informatics, University of Leicester, Leicester, United Kingdom
| | - Juan Manuel Gorriz
- Department of Signal Theory, Telematics and Communications, ETS of Computer and Telecommunications Engineering, University of Granada, Granada, Spain
| |
Collapse
|
31
|
Tan JL, Liang ZF, Zhang R, Dong YQ, Li GH, Zhang M, Wang H, Xu N. Suppressing of Power Line Artifact From Electroencephalogram Measurements Using Sparsity in Frequency Domain. Front Neurosci 2021; 15:780373. [PMID: 34776860 PMCID: PMC8581206 DOI: 10.3389/fnins.2021.780373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 10/08/2021] [Indexed: 11/13/2022] Open
Abstract
Electroencephalogram (EEG) plays an important role in brain disease diagnosis and research of brain-computer interface (BCI). However, the measurements of EEG are often exposed to strong interference of power line artifact (PLA). Digital notch filters (DNFs) can be applied to remove the PLA effectively, but it also results in severe signal distortions in the time domain. To address this problem, spectrum correction (SC) based methods can be utilized. These methods estimate harmonic parameters of the PLA such that compensation signals are produced to remove the noise. In order to ensure high accuracy during harmonic parameter estimations, a novel approach is proposed in this paper. This novel approach is based on the combination of sparse representation (SR) and SC. It can deeply mine the information of PLA in the frequency domain. Firstly, a ratio-based spectrum correction (RBSC) using rectangular window is employed to make rough estimation of the harmonic parameters of PLA. Secondly, the two spectral line closest to the estimated frequency are calculated. Thirdly, the two spectral lines with high amplitudes can be utilized as input of RBSC to make finer estimations of the harmonic parameters. Finally, a compensation signal, based on the extracted harmonic parameters, is generated to suppress PLA. Numerical simulations and actual EEG signals with PLA were used to evaluate the effectiveness of the improved approach. It is verified that this approach can effectively suppress the PLA without distorting the time-domain waveform of the EEG signal.
Collapse
Affiliation(s)
- Jin-Lin Tan
- School of Aerospace Science and Technology, Xidian University, Xi'an, China.,Shaanxi Aerospace Technology Application Research Institute Co., Ltd, Xi'an, China
| | - Zhi-Feng Liang
- Shaanxi Aerospace Technology Application Research Institute Co., Ltd, Xi'an, China
| | - Rui Zhang
- Shaanxi Aerospace Technology Application Research Institute Co., Ltd, Xi'an, China
| | - You-Qiang Dong
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Guang-Hui Li
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Min Zhang
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Hai Wang
- School of Aerospace Science and Technology, Xidian University, Xi'an, China
| | - Na Xu
- The Second Affiliated Hospital of Xiamen Medical College, Xiamen, China
| |
Collapse
|
32
|
Aydemir E, Tuncer T, Dogan S, Gururajan R, Acharya UR. Automated major depressive disorder detection using melamine pattern with EEG signals. APPL INTELL 2021. [DOI: 10.1007/s10489-021-02426-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
33
|
Musallam YK, AlFassam NI, Muhammad G, Amin SU, Alsulaiman M, Abdul W, Altaheri H, Bencherif MA, Algabri M. Electroencephalography-based motor imagery classification using temporal convolutional network fusion. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102826] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
|
34
|
Tadalagi M, Joshi AM. AutoDep: automatic depression detection using facial expressions based on linear binary pattern descriptor. Med Biol Eng Comput 2021; 59:1339-1354. [PMID: 34091864 DOI: 10.1007/s11517-021-02358-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Accepted: 03/26/2021] [Indexed: 11/25/2022]
Abstract
The psychological health of a person plays an important role in their daily life activities. The paper addresses depression issues with the machine learning model using facial expressions of the patient. Some research has already been done on visual based on depression detection methods, but those are illumination variant. The paper uses feature extraction using LBP (Local Binary Pattern) descriptor, which is illumination invariant. The Viola-Jones algorithm is used for face detection and SVM (support vector machine) is considered for classification along with the LBP descriptor to make a complete model for depression level detection. The proposed method captures frontal face from the videos of subjects and their facial features are extracted from each frame. Subsequently, the facial features are analyzed to detect depression levels with the post-processing model. The performance of the proposed system is evaluated using machine learning algorithms in MATLAB. For the real-time system design, it is necessary to test it on the hardware platform. The LBP descriptor has been implemented on FPGA using Xilinx VIVADO 16.4. The results of the proposed method show satisfactory performance and accuracy for depression detection comparison with similar previous work.
Collapse
Affiliation(s)
| | - Amit M Joshi
- Malaviya National Institute of Technology, Jaipur, India.
| |
Collapse
|