1
|
Xu X, Li J, Zhu Z, Zhao L, Wang H, Song C, Chen Y, Zhao Q, Yang J, Pei Y. A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis. Bioengineering (Basel) 2024; 11:219. [PMID: 38534493 DOI: 10.3390/bioengineering11030219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 02/15/2024] [Accepted: 02/21/2024] [Indexed: 03/28/2024] Open
Abstract
Disease diagnosis represents a critical and arduous endeavor within the medical field. Artificial intelligence (AI) techniques, spanning from machine learning and deep learning to large model paradigms, stand poised to significantly augment physicians in rendering more evidence-based decisions, thus presenting a pioneering solution for clinical practice. Traditionally, the amalgamation of diverse medical data modalities (e.g., image, text, speech, genetic data, physiological signals) is imperative to facilitate a comprehensive disease analysis, a topic of burgeoning interest among both researchers and clinicians in recent times. Hence, there exists a pressing need to synthesize the latest strides in multi-modal data and AI technologies in the realm of medical diagnosis. In this paper, we narrow our focus to five specific disorders (Alzheimer's disease, breast cancer, depression, heart disease, epilepsy), elucidating advanced endeavors in their diagnosis and treatment through the lens of artificial intelligence. Our survey not only delineates detailed diagnostic methodologies across varying modalities but also underscores commonly utilized public datasets, the intricacies of feature engineering, prevalent classification models, and envisaged challenges for future endeavors. In essence, our research endeavors to contribute to the advancement of diagnostic methodologies, furnishing invaluable insights for clinical decision making.
Collapse
Affiliation(s)
- Xi Xu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Jianqiang Li
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Zhichao Zhu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Linna Zhao
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Huina Wang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Changwei Song
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Yining Chen
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Qing Zhao
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Jijiang Yang
- Tsinghua National Laboratory for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Yan Pei
- School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Japan
| |
Collapse
|
2
|
Wu X, Yang J, Shao Y, Chen X. Mental fatigue assessment by an arbitrary channel EEG based on morphological features and LSTM-CNN. Comput Biol Med 2023; 167:107652. [PMID: 37950945 DOI: 10.1016/j.compbiomed.2023.107652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 10/05/2023] [Accepted: 10/31/2023] [Indexed: 11/13/2023]
Abstract
In order to achieve more sensitive mental fatigue assessment (MFA) based on an arbitrary channel EEG, this study proposed a series of feature extraction methods that combine mathematical morphology (MM), as well as an LSTM-CNN architecture. Firstly, 37 subjects had their resting-state EEGs collected at rested wakefulness (RW) and after 24 h of sleep deprivation (SD) using a 30-channel EEG acquisition device, the RW and SD groups were regarded as the negative and positive groups of mental fatigue, respectively, and the EEG collection were further categorized into two conditions: eye-opened state (EO) and eye-closed state (EC). Then, since MM can reflect the morphological characteristics of EEG rhythms and their potentials relatively independently of the time-frequency analysis and phase calculation, the MM methods were found to better reflect the mental fatigue after SD statistically, whether for single features (ANOVA: p<0.000001), multiple features (clustering by K-means, t-test: p<0.01), or time series feature spaces (calculating CD, t-test: p<0.01) of a single channel. Finally, the LSTM-CNN enhanced the generalization ability when dealing with different single-channel EEG by combining GRUs with convolutional layers: comparing the AUCs of different architectures for MFA based on an arbitrary channel, LSTM-CNN (0.992) > LSTM network (0.94) > CNN (0.831) > MLP (0.754). Moreover, the use of MM also improved the accuracy of analyzed architectures, and the true/false positive rate (TPR/FPR) of the LSTM-CNN architecture for MFA based on an arbitrary channel reached 97.024 %/3.497 %, which provided a feasible solution for the arbitrary channel EEG-based MFA.
Collapse
Affiliation(s)
- Xiaolong Wu
- School of Mechanical Engineering, University of Science and Technology Beijing, Beijing, China; Shunde Innovation School, University of Science and Technology Beijing, Guangdong, China
| | - Jianhong Yang
- School of Mechanical Engineering, University of Science and Technology Beijing, Beijing, China; Shunde Innovation School, University of Science and Technology Beijing, Guangdong, China; Technical Support Center for Prevention and Control of Disastrous Accidents in Metal Smelting, University of Science and Technology Beijing, Beijing, China.
| | - Yongcong Shao
- School of Psychology, Beijing Sport University, Beijing, China; Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science, Suzhou, China
| | - Xuewei Chen
- Institute of Environmental and Operational Medicine, Academy of Military Sciences, Tianjin, China
| |
Collapse
|
3
|
Sakib N, Islam MK, Faruk T. Machine Learning Model for Computer-Aided Depression Screening among Young Adults Using Wireless EEG Headset. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:1701429. [PMID: 37293375 PMCID: PMC10247322 DOI: 10.1155/2023/1701429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Revised: 04/09/2023] [Accepted: 04/17/2023] [Indexed: 06/10/2023]
Abstract
Depression is a disorder that if not treated can hamper the quality of life. EEG has shown great promise in detecting depressed individuals from depression control individuals. It overcomes the limitations of traditional questionnaire-based methods. In this study, a machine learning-based method for detecting depression among young adults using EEG data recorded by the wireless headset is proposed. For this reason, EEG data has been recorded using an Emotiv Epoc+ headset. A total of 32 young adults participated and the PHQ9 screening tool was used to identify depressed participants. Features such as skewness, kurtosis, variance, Hjorth parameters, Shannon entropy, and Log energy entropy from 1 to 5 sec data filtered at different band frequencies were applied to KNN and SVM classifiers with different kernels. At AB band (8-30 Hz) frequency, 98.43 ± 0.15% accuracy was achieved by extracting Hjorth parameters, Shannon entropy, and Log energy entropy from 5 sec samples with a 5-fold CV using a KNN classifier. And with the same features and classifier overall accuracy = 98.10 ± 0.11, NPV = 0.977, precision = 0.984, sensitivity = 0.984, specificity = 0.976, and F1 score = 0.984 was achieved after splitting the data to 70/30 ratio for training and testing with 5-fold CV. From the findings, it can be concluded that EEG data from an Emotiv headset can be used to detect depression with the proposed method.
Collapse
Affiliation(s)
- Nazmus Sakib
- Department of Electrical and Electronic Engineering, Independent University Bangladesh (IUB), Dhaka, Bangladesh
- Biomedical Instrumentation and Signal Processing Lab (BISPL), Independent University Bangladesh (IUB), Dhaka, Bangladesh
| | - Md Kafiul Islam
- Department of Electrical and Electronic Engineering, Independent University Bangladesh (IUB), Dhaka, Bangladesh
- Biomedical Instrumentation and Signal Processing Lab (BISPL), Independent University Bangladesh (IUB), Dhaka, Bangladesh
| | - Tasnuva Faruk
- Biomedical Instrumentation and Signal Processing Lab (BISPL), Independent University Bangladesh (IUB), Dhaka, Bangladesh
- Department of Public Health, Independent University Bangladesh (IUB), Dhaka, Bangladesh
| |
Collapse
|
4
|
Wang ZY, Liu L, Liu Y. A multi-source behavioral and physiological recording system for cognitive assessment. Sci Rep 2023; 13:8149. [PMID: 37208418 DOI: 10.1038/s41598-023-35289-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 05/16/2023] [Indexed: 05/21/2023] Open
Abstract
Cognitive assessment has a broad application prospect, including estimate of childhood neuro development and maturation, diagnosis of neurodegenerative diseases, and selection for special profession. With the development of computer technique and behavioral recording sensors, the method of cognitive assessment has been replaced from paper scale test to human-computer interaction. We can not only obtain the results of tasks, but also make it possible to acquire multiple behavioral and physiological data during the task. However, there is still a strong challenge of recording multi-source data synchronously during multi-dimensional cognitive assessments. Therefore, we built a multi-source cognitive assessment system can record multi-pattern behavioral and physiological data and feedback at different spatiotemporal levels. Under this system, we developed a multi-source diagnostic toolset for cognitive assessment, including eye tracking, hand movement, EEG and human-computer interaction data during the cognitive task. 238 participants with different mental disorders were assessed using this system. The results showed that our diagnostic toolset can be used to study the behavioral abnormalities of patients with mental disorders through the characteristics of multi-source data. Furthermore, this system can provide some objective diagnostic criteria such as behavioral characters and EEG features for diagnosis of mental disorders.
Collapse
Affiliation(s)
- Zi-Yang Wang
- State Key Laboratory of Multimodal Artificial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Li Liu
- State Key Laboratory of Multimodal Artificial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Yu Liu
- State Key Laboratory of Multimodal Artificial Intelligence Systems, The Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
5
|
Wang B, Kang Y, Huo D, Chen D, Song W, Zhang F. Depression signal correlation identification from different EEG channels based on CNN feature extraction. Psychiatry Res Neuroimaging 2023; 328:111582. [PMID: 36565553 DOI: 10.1016/j.pscychresns.2022.111582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 11/24/2022] [Accepted: 12/17/2022] [Indexed: 12/24/2022]
Abstract
Depression is a mental illness and can even lead to suicide if not be diagnosed and treated. Electroencephalograph (EEG) is used to diagnose depression and it is more complexity to extract the features from all the multimodal channel information . In order to simplify the diagnose process and detect clinical depression, the EEG channels with strong depression information should be identified firstly. Therefore, a depression signal correlation identification method based on convolutional neural network (CNN) is proposed. In the method, the labeled multi-channel EEG is used as data. The EEG signals of each channel are divided into neural network training data set and these data is trained by AlexNet network. Then the correlation classification of each channel for depression is identified based on the trained sample. Accuracy and loss functions are used to evaluate classification index.Conversely, the correlation is lower. An experiments is conducted and the results show that the correlation is not consistent. A few of channels are strongly correlated with depression, such as 13, 17, 28, 40, 46, 66 and 69. These EEG channels are selected to diagnose depression.
Collapse
|
6
|
Zhang B, Wei D, Yan G, Lei T, Cai H, Yang Z. Feature-level fusion based on spatial-temporal of pervasive EEG for depression recognition. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 226:107113. [PMID: 36103735 DOI: 10.1016/j.cmpb.2022.107113] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 08/23/2022] [Accepted: 09/04/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE In view of the depression characteristics such as high prevalence, high disability rate, high fatality rate, and high recurrence rate, early identification and early intervention are the most effective methods to prevent irreversible damage of brain function over time. The traditional method of depression recognition based on questionnaires and interviews is time-consuming and labor-intensive, and heavily depends on the doctor's subjective experience. Therefore, accurate, convenient and effective recognition of depression has important social value and scientific significance. METHODS This paper proposes a depression recognition framework based on feature-level fusion of spatial-temporal pervasive electroencephalography (EEG). Time series EEG data were collected by portable three-electrode EEG acquisition instrument, and mapped to a spatial complex network called visibility graph (VG). Then temporal EEG features and spatial VG metric features were extracted and selected. Based on the correlation between features and categories, the differences in contribution of individual feature are explored, and different contribution coefficients are assigned to different features as the data basis of feature-level fusion to ensure the diversity of data. A cascade forest model based on three different decision forests is designed to realize the efficient depression recognition using spatial-temporal feature-level fusion data. RESULTS Experimental data were obtained from 26 depressed patients and 29 healthy controls (HC). The results of multiple control experiments show that compared with single type feature, feature-level fusion without contribution coefficient, and independent classifiers, the feature-level method with contribution coefficient of spatial-temporal has a stronger recognition ability of depression, and the highest accuracy is 92.48%. CONCLUSION Feature-level fusion method provides an effective computer-aided tool for rapid clinical diagnosis of depression.
Collapse
Affiliation(s)
- Bingtao Zhang
- School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China; School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China.
| | - Dan Wei
- School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
| | - Guanghui Yan
- School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
| | - Tao Lei
- School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology, Xi'an 710021, China
| | - Haishu Cai
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Zhifei Yang
- School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
| |
Collapse
|
7
|
Wu X, Yang J. The superiority verification of morphological features in the EEG-based assessment of depression. J Neurosci Methods 2022; 381:109690. [PMID: 36007848 DOI: 10.1016/j.jneumeth.2022.109690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 08/16/2022] [Accepted: 08/19/2022] [Indexed: 12/14/2022]
Affiliation(s)
- Xiaolong Wu
- School of Mechanical Engineering, University of Science and Technology Beijing, Beijing, 100083, China; Shunde Graduate School, University of Science and Technology Beijing, Guangdong 528399, China.
| | - Jianhong Yang
- School of Mechanical Engineering, University of Science and Technology Beijing, Beijing, 100083, China; Shunde Graduate School, University of Science and Technology Beijing, Guangdong 528399, China; Technical Support Center for Prevention and Control of Disastrous Accidents in Metal Smelting, University of Science and Technology Beijing, Beijing 100083, China.
| |
Collapse
|
8
|
Wang B, Kang Y, Huo D, Feng G, Zhang J, Li J. EEG diagnosis of depression based on multi-channel data fusion and clipping augmentation and convolutional neural network. Front Physiol 2022; 13:1029298. [PMID: 36338469 PMCID: PMC9632488 DOI: 10.3389/fphys.2022.1029298] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Accepted: 09/23/2022] [Indexed: 09/29/2023] Open
Abstract
Depression is an undetectable mental disease. Most of the patients with depressive symptoms do not know that they are suffering from depression. Since the novel Coronavirus pandemic 2019, the number of patients with depression has increased rapidly. There are two kinds of traditional depression diagnosis. One is that professional psychiatrists make diagnosis results for patients, but it is not conducive to large-scale depression detection. Another is to use electroencephalography (EEG) to record neuronal activity. Then, the features of the EEG are extracted using manual or traditional machine learning methods to diagnose the state and type of depression. Although this method achieves good results, it does not fully utilize the multi-channel information of EEG. Aiming at this problem, an EEG diagnosis method for depression based on multi-channel data fusion cropping enhancement and convolutional neural network is proposed. First, the multi-channel EEG data are transformed into 2D images after multi-channel fusion (MCF) and multi-scale clipping (MSC) augmentation. Second, it is trained by a multi-channel convolutional neural network (MCNN). Finally, the trained model is loaded into the detection device to classify the input EEG signals. The experimental results show that the combination of MCF and MSC can make full use of the information contained in the single sensor records, and significantly improve the classification accuracy and clustering effect of depression diagnosis. The method has the advantages of low complexity and good robustness in signal processing and feature extraction, which is beneficial to the wide application of detection systems.
Collapse
Affiliation(s)
- Baiyang Wang
- School of Information Science and Engineering, Linyi University, Linyi, China
| | - Yuyun Kang
- School of Logistics, Linyi University, Linyi, China
| | - Dongyue Huo
- School of Information Science and Engineering, Linyi University, Linyi, China
| | - Guifang Feng
- School of Life Science, Linyi University, Linyi, China
- International College, Philippine Christian University, Manila, Philippines
| | - Jiawei Zhang
- Linyi Trade Logistics Science and Technology Industry Research Institute, Linyi, China
| | - Jiadong Li
- School of Logistics, Linyi University, Linyi, China
| |
Collapse
|
9
|
EEG based depression recognition using improved graph convolutional neural network. Comput Biol Med 2022; 148:105815. [DOI: 10.1016/j.compbiomed.2022.105815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2022] [Revised: 06/11/2022] [Accepted: 07/03/2022] [Indexed: 11/19/2022]
|
10
|
Abstract
BACKGROUND In this modern era, depression is one of the most prevalent mental disorders from which millions of individuals are affected today. The symptoms of depression are heterogeneous and often coincide with other disorders such as bipolar disorder, Parkinson's, schizophrenia, etc. It is a serious mental illness that may lead to other health problems if left untreated. Currently, identifying individuals with depression is totally based on the expertise of the clinician's experience. In order to assist clinicians in identifying the characteristics and classifying depressed people, different types of data modalities and machine learning techniques have been incorporated by researchers in this field. This study aims to find the answers to some important questions related to the trend of publications, data modality, machine learning models, dataset usage, pre-processing techniques and feature extraction and selection techniques that are prevalent and guide the direction of future research on depression diagnosis. METHODS This systematic review was conducted using a broad range of articles from two major databases: IEEE Xplore and PubMed. Studies ranging from the years 2011 to April 2021 were retrieved from the databases resulting in a total of 590 articles (53 articles from the IEEE Xplore database and 537 articles from the PubMed database). Out of those, the articles which satisfied the defined inclusion criteria were investigated for further analysis. RESULTS A total of 135 articles were identified and analysed for this review. High growth in the number of publications has been observed in recent years. Furthermore, significant diversity in the use of data modalities and machine learning classifiers has also been noted in this study. fMRI data with an SVM classifier was found to be the most popular choice among researchers. In most of the studies, data scarcity and small sample size, particularly for neuroimaging data are major concerns. The use of identical data pre-processing tools for similar data modalities can be seen. This study also provides statistical analysis of the current framework with respect to the modality, machine learning classifier, sample size and accuracy by applying one-way ANOVA and the Tukey - Kramer test. CONCLUSION The results indicate that an effective fusion of machine learning techniques with a potential data modality has a promising future for assisting clinicians in automatic depression diagnosis.
Collapse
Affiliation(s)
- Sweta Bhadra
- Department of CS & IT, Cotton University, Guwahati, India
| | | |
Collapse
|
11
|
Zhang B, Cai H, Song Y, Tao L, Li Y. Computer-aided Recognition Based on Decision-level Multimodal Fusion for Depression. IEEE J Biomed Health Inform 2022; 26:3466-3477. [PMID: 35389872 DOI: 10.1109/jbhi.2022.3165640] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Aiming at the problem of depression recognition, this paper proposes a computer-aided recognition framework based on decision-level multimodal fusion. In Song Dynasty of China, the idea of multimodal fusion was contained in "one gets different impressions of a mountain when viewing it from the front or sideways, at a close range or from afar" poetry. Objective and comprehensive analysis of depression can more accurately restore its essence, and multimodal can represent more information about depression compared to single modal. Linear electroencephalography (EEG) features based on adaptive auto regression (AR) model and typical nonlinear EEG features are extracted. EEG features related to depression and graph metric features in depression related brain regions are selected as the data basis of multimodal fusion to ensure data diversity. Based on the theory of multi-agent cooperation, the computer-aided depression recognition model of decision-level is realized. The experimental data comes from 24 depressed patients and 29 healthy controls (HC). The results of multi-group controlled trials show that compared with single modal or independent classifiers, the decision-level multimodal fusion method has a stronger ability to recognize depression, and the highest accuracy rate 92.13% was obtained. In addition, our results suggest that improving the brain region associated with information processing can help alleviate and treat depression. In the field of classification and recognition, our results clarify that there is no universal classifier suitable for any condition.
Collapse
|
12
|
Uyulan C, de la Salle S, Erguzel TT, Lynn E, Blier P, Knott V, Adamson MM, Zelka M, Tarhan N. Depression Diagnosis Modeling With Advanced Computational Methods: Frequency-Domain eMVAR and Deep Learning. Clin EEG Neurosci 2022; 53:24-36. [PMID: 34080925 DOI: 10.1177/15500594211018545] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Electroencephalogram (EEG)-based automated depression diagnosis systems have been suggested for early and accurate detection of mood disorders. EEG signals are highly irregular, nonlinear, and nonstationary in nature and are traditionally studied from a linear viewpoint by means of statistical and frequency features. Since, linear metrics present certain limitations and nonlinear methods have proven to be an efficient tool in understanding the complexities of the brain in the identification of underlying behavior of biological signals, such as electrocardiogram, EEG and magnetoencephalogram and thus, can be applied to all nonstationary signals. Various nonlinear algorithms can be used in the analysis of EEG signals. In this research paper, we aim to develop a novel methodology for EEG-based depression diagnosis utilizing 2 advanced computational techniques: frequency-domain extended multivariate autoregressive (eMVAR) and deep learning (DL). We proposed a hybrid method comprising a pretrained ResNet-50 and long-short term memory (LSTM) to capture depression-specific information and compared with a strong conventional machine learning (ML) framework having eMVAR connectivity features. The following 8 causality measures, which interpret the interaction mechanisms among spectrally decomposed oscillations, were used to extract features from multivariate EEG time series: directed coherence (DC), directed transfer function (DTF), partial DC (PDC), generalized PDC (gPDC), extended DC (eDC), delayed DC (dDC), extended PDC (ePDC), and delayed PDC (dPDC). The classification accuracies were 84% with DC, 85% with DTF, 95.3% with PDC, 95.1% with gPDC, 84.8% with eDC, 84.6% with dDC, 84.2% with ePDC, and 95.9% with dPDC for the eMVAR framework. Through a DL framework (ResNet-50 + LSTM), the classification accuracy was achieved as 90.22%. The results demonstrate that our DL methodology is a competitive alternative to the strong feature extraction-based ML methods in depression classification.
Collapse
Affiliation(s)
| | - Sara de la Salle
- Institute of Mental Health Research, 6363University of Ottawa, Ottawa, ON, Canada.,6363University of Ottawa, Ottawa, ON, Canada
| | | | - Emma Lynn
- Institute of Mental Health Research, 6363University of Ottawa, Ottawa, ON, Canada.,6363University of Ottawa, Ottawa, ON, Canada
| | - Pierre Blier
- Institute of Mental Health Research, 6363University of Ottawa, Ottawa, ON, Canada.,6363University of Ottawa, Ottawa, ON, Canada
| | - Verner Knott
- Institute of Mental Health Research, 6363University of Ottawa, Ottawa, ON, Canada.,6363University of Ottawa, Ottawa, ON, Canada
| | | | | | - Nevzat Tarhan
- 232990Uskudar University, Istanbul, Turkey.,NPIstanbul Hospital, Istanbul, Turkey
| |
Collapse
|
13
|
Liu Y, Pu C, Xia S, Deng D, Wang X, Li M. Machine learning approaches for diagnosing depression using EEG: A review. Transl Neurosci 2022; 13:224-235. [PMID: 36045698 PMCID: PMC9375981 DOI: 10.1515/tnsci-2022-0234] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 06/18/2022] [Accepted: 07/04/2022] [Indexed: 12/02/2022] Open
Abstract
Depression has become one of the most crucial public health issues, threatening the quality of life of over 300 million people throughout the world. Nevertheless, the clinical diagnosis of depression is now still hampered by behavioral diagnostic methods. Due to the lack of objective laboratory diagnostic criteria, accurate identification and diagnosis of depression remained elusive. With the rise of computational psychiatry, a growing number of studies have combined resting-state electroencephalography with machine learning (ML) to alleviate diagnosis of depression in recent years. Despite the exciting results, these were worrisome of these studies. As a result, ML prediction models should be continuously improved to better screen and diagnose depression. Finally, this technique would be used for the diagnosis of other psychiatric disorders in the future.
Collapse
Affiliation(s)
- Yuan Liu
- Department of Psychosomatic Medicine, The First Affiliated Hospital of Nanchang University, No.17 Yongwaizheng Street, Donghu District, Nanchang 330006, Jiangxi Province, China
| | - Changqin Pu
- Queen Mary College, Nanchang University, Nanchang 330031, Jiangxi Province, China
| | - Shan Xia
- Department of Psychosomatic Medicine, The First Affiliated Hospital of Nanchang University, No.17 Yongwaizheng Street, Donghu District, Nanchang 330006, Jiangxi Province, China
| | - Dingyu Deng
- Department of Internal Neurology, The First Affiliated Hospital of Nanchang University, Nanchang 330006, Jiangxi Province, China
| | - Xing Wang
- School of Life Sciences, Nanchang University, No.999 Xuefu Avenue, Honggutan District, Nanchang 330036, Jiangxi Province, China.,Clinical Diagnostics Laboratory, Clinical Medical Experiment Center, Nanchang University, Nanchang 330036, China
| | - Mengqian Li
- Department of Psychosomatic Medicine, The First Affiliated Hospital of Nanchang University, No.17 Yongwaizheng Street, Donghu District, Nanchang 330006, Jiangxi Province, China
| |
Collapse
|
14
|
Automated diagnosis of depression from EEG signals using traditional and deep learning approaches: A comparative analysis. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2021.12.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|
15
|
Wu CT, Huang HC, Huang S, Chen IM, Liao SC, Chen CK, Lin C, Lee SH, Chen MH, Tsai CF, Weng CH, Ko LW, Jung TP, Liu YH. Resting-State EEG Signal for Major Depressive Disorder Detection: A Systematic Validation on a Large and Diverse Dataset. BIOSENSORS 2021; 11:499. [PMID: 34940256 PMCID: PMC8699348 DOI: 10.3390/bios11120499] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 11/26/2021] [Accepted: 12/04/2021] [Indexed: 05/09/2023]
Abstract
Major depressive disorder (MDD) is a global healthcare issue and one of the leading causes of disability. Machine learning combined with non-invasive electroencephalography (EEG) has recently been shown to have the potential to diagnose MDD. However, most of these studies analyzed small samples of participants recruited from a single source, raising serious concerns about the generalizability of these results in clinical practice. Thus, it has become critical to re-evaluate the efficacy of various common EEG features for MDD detection across large and diverse datasets. To address this issue, we collected resting-state EEG data from 400 participants across four medical centers and tested classification performance of four common EEG features: band power (BP), coherence, Higuchi's fractal dimension, and Katz's fractal dimension. Then, a sequential backward selection (SBS) method was used to determine the optimal subset. To overcome the large data variability due to an increased data size and multi-site EEG recordings, we introduced the conformal kernel (CK) transformation to further improve the MDD as compared with the healthy control (HC) classification performance of support vector machine (SVM). The results show that (1) coherence features account for 98% of the optimal feature subset; (2) the CK-SVM outperforms other classifiers such as K-nearest neighbors (K-NN), linear discriminant analysis (LDA), and SVM; (3) the combination of the optimal feature subset and CK-SVM achieves a high five-fold cross-validation accuracy of 91.07% on the training set (140 MDD and 140 HC) and 84.16% on the independent test set (60 MDD and 60 HC). The current results suggest that the coherence-based connectivity is a more reliable feature for achieving high and generalizable MDD detection performance in real-life clinical practice.
Collapse
Affiliation(s)
- Chien-Te Wu
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study (UTIAS), The University of Tokyo, Tokyo 113-0033, Japan;
| | - Hao-Chuan Huang
- Hipposcreen Neurotech Corp. (HNC), Taipei 114, Taiwan; (H.-C.H.); (S.H.); (C.-H.W.)
| | - Shiuan Huang
- Hipposcreen Neurotech Corp. (HNC), Taipei 114, Taiwan; (H.-C.H.); (S.H.); (C.-H.W.)
| | - I-Ming Chen
- Division of Psychosomatic Medicine, Department of Psychiatry, National Taiwan University Hospital, Taipei 100229, Taiwan; (I.-M.C.); (S.-C.L.)
- Institute of Health Policy and Management, National Taiwan University, Taipei 10617, Taiwan
| | - Shih-Cheng Liao
- Division of Psychosomatic Medicine, Department of Psychiatry, National Taiwan University Hospital, Taipei 100229, Taiwan; (I.-M.C.); (S.-C.L.)
| | - Chih-Ken Chen
- Department of Psychiatry & Community Medicine Research Center, Chang Gung Memorial Hospital, Keelung 204, Taiwan; (C.-K.C.); (C.L.)
- College of Medicine, Chang Gung University, Taoyuan 33302, Taiwan;
| | - Chemin Lin
- Department of Psychiatry & Community Medicine Research Center, Chang Gung Memorial Hospital, Keelung 204, Taiwan; (C.-K.C.); (C.L.)
- College of Medicine, Chang Gung University, Taoyuan 33302, Taiwan;
| | - Shwu-Hua Lee
- College of Medicine, Chang Gung University, Taoyuan 33302, Taiwan;
- Department of Psychiatry, Chang Gung Memorial Hospital, Taoyuan 33305, Taiwan
| | - Mu-Hong Chen
- Department of Psychiatry, Taipei Veterans General Hospital, Taipei 11217, Taiwan; (M.-H.C.); (C.-F.T.)
- Faculty of Medicine, National Yang Ming Chiao Tung University, Taipei 11217, Taiwan
| | - Chia-Fen Tsai
- Department of Psychiatry, Taipei Veterans General Hospital, Taipei 11217, Taiwan; (M.-H.C.); (C.-F.T.)
- Faculty of Medicine, National Yang Ming Chiao Tung University, Taipei 11217, Taiwan
| | - Chang-Hsin Weng
- Hipposcreen Neurotech Corp. (HNC), Taipei 114, Taiwan; (H.-C.H.); (S.H.); (C.-H.W.)
| | - Li-Wei Ko
- Department of Bio Science & Tech., National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan;
| | - Tzyy-Ping Jung
- Institute for Neural Computation, University of California, San Diego, CA 92093, USA
| | - Yi-Hung Liu
- Department of Mechanical Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan
| |
Collapse
|
16
|
Qiao YL, Zhou JJ, Liang JH, Deng XP, Zhang ZJ, Huang HL, Li S, Dai SF, Liu CQ, Luan ZL, Yu ZL, Sun CP, Ma XC. Uncaria rhynchophylla ameliorates unpredictable chronic mild stress-induced depression in mice via activating 5-HT 1A receptor: Insights from transcriptomics. PHYTOMEDICINE : INTERNATIONAL JOURNAL OF PHYTOTHERAPY AND PHYTOPHARMACOLOGY 2021; 81:153436. [PMID: 33360346 DOI: 10.1016/j.phymed.2020.153436] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Revised: 11/29/2020] [Accepted: 12/03/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND Depression is a pervasive or persistent mental disorder that causes mood, cognitive and memory deficits. Uncaria rhynchophylla has been widely used to treat central nervous system diseases for a long history, although its efficacy and potential mechanism are still uncertain. PURPOSE The present study aimed to investigate anti-depression effect and potential mechanism of U. rhynchophylla extract (URE). STUDY DESIGN AND METHODS A mouse depression model was established using unpredictable chronic mild stress (UCMS). Effects of URE on depression-like behaviours, neurotransmitters, and neuroendocrine hormones were investigated in UCMS-induced mice. The potential target of URE was analyzed by transcriptomics and bioinformatics methods and validated by RT-PCR and Western blot. The agonistic effect on 5-HT1A receptor was assayed by dual-luciferase reporter system. RESULTS URE ameliorated depression-like behaviours, and modulated levels of neurotransmitters and neuroendocrine hormones, including 5-hydroxytryptamine (5-HT), 5-hydroxyindole acetic acid (5-HIAA), dopamine (DA), 3,4-dihydroxyphenylacetic acid (DOPAC), homovanillic acid (HVA), corticosterone (CORT), corticotropin-releasing hormone (CRH), and adrenocorticotropic hormone (ACTH), in UCMS-induced mice. Transcriptomics and bioinformatics results indicated that URE could regulate glutamatergic, cholinergic, serotonergic, and GABAergic systems, especially neuroactive ligand-receptor and cAMP signaling pathways, revealing that Htr1a encoding 5-HT1A receptor was a potential target of URE. The expression levels of downstream proteins of 5-HT1A signaling pathway 5-HT1A, CREB, BDNF, and PKA were increased in UCMS-induced mice after URE administration, and URE also displayed an agonistic effect against 5-HT1A receptor with an EC50 value of 17.42 μg/ml. CONCLUSION U. rhynchophylla ameliorated depression-like behaviours in UCMS-induced mice through activating 5-HT1A receptor.
Collapse
Affiliation(s)
- Yan-Ling Qiao
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Jun-Jun Zhou
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Jia-Hao Liang
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Xiao-Peng Deng
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Zhan-Jun Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Hui-Lian Huang
- Laboratory of Modern Preparation of Traditional Chinese Medicine, Ministry of Education, Jiangxi University of Traditional Chinese Medicine, Nanchang, China
| | - Song Li
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Shu-Fang Dai
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Chun-Qing Liu
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Zhi-Lin Luan
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Zhen-Long Yu
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China
| | - Cheng-Peng Sun
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China.
| | - Xiao-Chi Ma
- Dalian Key Laboratory of Metabolic Target Characterization and Traditional Chinese Medicine, College of Pharmacy, College of Integrative Medicine, Department of Neurosurgery, The First and Second Affiliated Hospital of Dalian Medical University, Dalian Medical University, Dalian, China; State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
| |
Collapse
|
17
|
Wosiak A, Dura A. Hybrid Method of Automated EEG Signals' Selection Using Reversed Correlation Algorithm for Improved Classification of Emotions. SENSORS 2020; 20:s20247083. [PMID: 33321895 PMCID: PMC7764031 DOI: 10.3390/s20247083] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 12/07/2020] [Accepted: 12/08/2020] [Indexed: 11/16/2022]
Abstract
Based on the growing interest in encephalography to enhance human-computer interaction (HCI) and develop brain-computer interfaces (BCIs) for control and monitoring applications, efficient information retrieval from EEG sensors is of great importance. It is difficult due to noise from the internal and external artifacts and physiological interferences. The enhancement of the EEG-based emotion recognition processes can be achieved by selecting features that should be taken into account in further analysis. Therefore, the automatic feature selection of EEG signals is an important research area. We propose a multistep hybrid approach incorporating the Reversed Correlation Algorithm for automated frequency band-electrode combinations selection. Our method is simple to use and significantly reduces the number of sensors to only three channels. The proposed method has been verified by experiments performed on the DEAP dataset. The obtained effects have been evaluated regarding the accuracy of two emotions-valence and arousal. In comparison to other research studies, our method achieved classification results that were 4.20-8.44% greater. Moreover, it can be perceived as a universal EEG signal classification technique, as it belongs to unsupervised methods.
Collapse
|
18
|
Chen F, Zhao L, Li B, Yang L. Depression evaluation based on prefrontal EEG signals in resting state using fuzzy measure entropy. Physiol Meas 2020; 41:095007. [PMID: 33021227 DOI: 10.1088/1361-6579/abb144] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Depression is a mental disorder that causes emotional changes and even suicide. However, there is still a lack of objective physiological data to support current clinical depression diagnosis. Accurate computer-aided diagnosis systems are becoming more and more crucial and urgent for future depression diagnosis. The purpose of this study is to analyze the electroencephalogram (EEG) regularity of depression using fuzzy measure entropy (FMEn), and thus to explore its role in the computer-aided diagnosis of depression. APPROACH Three-channel EEG signals among 35 subjects (divided into two groups according to the severity of the disease) were recorded in this study. First, the frontal delta, theta, alpha and beta frequency bands were extracted after preprocessing, and the sample entropy (SEn) and the FMEn were calculated. Then, the difference between the two groups and the correlation between the entropy values and the Hamilton Depression Rating Scale scores were analyzed using statistical analysis. Finally, the results of FMEn were compared with those of SEn. MAIN RESULTS A better statistically significant difference between the two groups using FMEn was revealed, with p < 0.01 in the theta and alpha bands. In terms of SEn, only SEn_Fp2 in the delta band, SEn_Fp2 in the theta band and SEn_Fp1 in the alpha band performed better, showing significant differences with p = 0.0006, p = 0.002 and p = 0.0114. SIGNIFICANCE These findings suggest that frontal EEG signal complexity analysis with depression using FMEn might be more sensitive than that using SEn. FMEn could be considered as a promising biomarker for future clinical depression detection.
Collapse
Affiliation(s)
- Feifei Chen
- School of Control Science and Engineering, Shandong University, Jinan, People's Republic of China
| | | | | | | |
Collapse
|
19
|
Liu R, Xu M, Zhang Y, Peli E, Hwang AD. A Pilot Study on EEG-Based Evaluation of Visually Induced Motion Sickness. J Imaging Sci Technol 2020; 64:205011-2050110. [PMID: 33907364 PMCID: PMC8075303 DOI: 10.2352/j.imagingsci.technol.2020.64.2.020501] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022]
Abstract
The most prominent problem in virtual reality (VR) technology is that users may experience motion sickness-like symptoms when they immerse into a VR environment. These symptoms are recognized as visually induced motion sickness (VIMS) or virtual reality motion sickness (VRMS). The objectives of this study were to investigate the association between the electroencephalogram (EEG) and subjectively rated VIMS level (VIMSL) and find the EEG markers for VIMS evaluation. In this study, a VR-based vehicle-driving simulator (VDS) was used to induce VIMS symptoms, and a wearable EEG device with four electrodes, the Muse, was used to collect EEG data of subjects. Our results suggest that individual tolerance, susceptibility, and recoverability to VIMS varied largely among subjects; the following markers were shown to be significantly different from no-VIMS and VIMS states (P < 0.05): (1) Means of gravity frequency (GF) for theta@FP1, alpha@TP9, alpha@FP2, alpha@TP10, and beta@FP1; (2) Standard deviation of GF for alpha@TP9, alpha@FP1, alpha@FP2, alpha@TP10, and alpha@(FP2-FP1); (3) Standard deviation of power spectral entropy (PSE) for FP1; (4) Means of Kolmogorov complexity (KC) for TP9, FP1, and FP2. These results also demonstrate that it is feasible to perform VIMS evaluation using an EEG device with a small number of electrodes.
Collapse
Affiliation(s)
- Ran Liu
- College of Computer Science, Chongqing University, Chongqing, China
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, USA
- School of microelectronics and communication engineering, Chongqing University, Chongqing, China
| | - Miao Xu
- College of Information Science and Engineering, Shanxi Agricultural University, Taigu County, Jinzhong City, Shanxi Province, China
| | - Yanzhen Zhang
- School of microelectronics and communication engineering, Chongqing University, Chongqing, China
| | - Eli Peli
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, USA
| | - Alex D Hwang
- Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
20
|
Depression biomarkers using non-invasive EEG: A review. Neurosci Biobehav Rev 2019; 105:83-93. [DOI: 10.1016/j.neubiorev.2019.07.021] [Citation(s) in RCA: 88] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 07/25/2019] [Accepted: 07/28/2019] [Indexed: 02/04/2023]
|