1
|
Latreche I, Slatnia S, Kazar O, Harous S, Khelili MA. Identification and diagnosis of schizophrenia based on multichannel EEG and CNN deep learning model. Schizophr Res 2024; 271:28-35. [PMID: 39002527 DOI: 10.1016/j.schres.2024.07.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Revised: 07/06/2024] [Accepted: 07/07/2024] [Indexed: 07/15/2024]
Abstract
This paper proposes a high-accuracy EEG-based schizophrenia (SZ) detection approach. Unlike comparable literature studies employing conventional machine learning algorithms, our method autonomously extracts the necessary features for network training from EEG recordings. The proposed model is a ten-layered CNN that contains a max pooling layer, a Global Average Pooling layer, four convolution layers, two dropout layers for overfitting prevention, and two fully connected layers. The efficiency of the suggested method was assessed using the ten-fold-cross validation technique and the EEG records of 14 healthy subjects and 14 SZ patients. The obtained mean accuracy score was 99.18 %. To confirm the high mean accuracy attained, we tested the model on unseen data with a near-perfect accuracy score (almost 100 %). In addition, the results we obtained outperform numerous other comparable works.
Collapse
Affiliation(s)
- Imene Latreche
- Department of Computer Science, University of Biskra, Biskra, Algeria.
| | - Sihem Slatnia
- Department of Computer Science, University of Biskra, Biskra, Algeria.
| | - Okba Kazar
- College of Arts, Sciences & Information Technology, University of Kalba, Sharjah, United Arab Emirates
| | - Saad Harous
- College of Computing and Informatics, Department of Computer Science, University of Sharjah, Sharjah, United Arab Emirates.
| | - Mohamed Akram Khelili
- Department of Computer Science, University of Biskra, Biskra, Algeria; Numidia Institute of Technology, Algiers, Algeria.
| |
Collapse
|
2
|
Bhushan S, Arunkumar S, Eisa TAE, Nasser M, Singh AK, Kumar P. AI-Enhanced Dyscalculia Screening: A Survey of Methods and Applications for Children. Diagnostics (Basel) 2024; 14:1441. [PMID: 39001330 PMCID: PMC11241753 DOI: 10.3390/diagnostics14131441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2024] [Revised: 06/13/2024] [Accepted: 07/02/2024] [Indexed: 07/16/2024] Open
Abstract
New forms of interaction made possible by developments in special educational technologies can now help students with dyscalculia. Artificial intelligence (AI) has emerged as a promising tool in recent decades, particularly between 2001 and 2010, offering avenues to enhance the quality of education for individuals with dyscalculia. Therefore, the implementation of AI becomes crucial in addressing the needs of students with dyscalculia. Content analysis techniques were used to examine the literature covering the influence of AI on dyscalculia and its potential to assist instructors in promoting education for individuals with dyscalculia. The study sought to create a foundation for a more inclusive dyscalculia education in the future through in-depth studies. AI integration has had a big impact on educational institutions as well as people who struggle with dyscalculia. This paper highlights the importance of AI in improving the educational outcomes of students affected by dyscalculia.
Collapse
Affiliation(s)
- Shashi Bhushan
- Department of Computer & Information Sciences, Universiti Teknologi Petronas, Seri Iskandar 32610, Perak, Malaysia;
| | - Sharmila Arunkumar
- Raj Kumar Goel Institute of Technology, Ghaziabad 201017, Uttar Pradesh, India;
| | | | - Maged Nasser
- Department of Computer & Information Sciences, Universiti Teknologi Petronas, Seri Iskandar 32610, Perak, Malaysia;
| | - Anuj Kumar Singh
- School of Computing Science and Engineering, Galgotias University, Greater Noida 201310, Uttar Pradesh, India;
| | - Pramod Kumar
- Himalayan School of Science and Technology, Swami Rama Himalayan University, Dehradun 248016, Uttarakhand, India;
| |
Collapse
|
3
|
Brookshire G, Kasper J, Blauch NM, Wu YC, Glatt R, Merrill DA, Gerrol S, Yoder KJ, Quirk C, Lucero C. Data leakage in deep learning studies of translational EEG. Front Neurosci 2024; 18:1373515. [PMID: 38765672 PMCID: PMC11099244 DOI: 10.3389/fnins.2024.1373515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 04/04/2024] [Indexed: 05/22/2024] Open
Abstract
A growing number of studies apply deep neural networks (DNNs) to recordings of human electroencephalography (EEG) to identify a range of disorders. In many studies, EEG recordings are split into segments, and each segment is randomly assigned to the training or test set. As a consequence, data from individual subjects appears in both the training and the test set. Could high test-set accuracy reflect data leakage from subject-specific patterns in the data, rather than patterns that identify a disease? We address this question by testing the performance of DNN classifiers using segment-based holdout (in which segments from one subject can appear in both the training and test set), and comparing this to their performance using subject-based holdout (where all segments from one subject appear exclusively in either the training set or the test set). In two datasets (one classifying Alzheimer's disease, and the other classifying epileptic seizures), we find that performance on previously-unseen subjects is strongly overestimated when models are trained using segment-based holdout. Finally, we survey the literature and find that the majority of translational DNN-EEG studies use segment-based holdout. Most published DNN-EEG studies may dramatically overestimate their classification performance on new subjects.
Collapse
Affiliation(s)
| | - Jake Kasper
- SPARK Neuro Inc., New York, NY, United States
| | - Nicholas M. Blauch
- SPARK Neuro Inc., New York, NY, United States
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, United States
| | | | - Ryan Glatt
- Pacific Brain Health Center, Pacific Neuroscience Institute and Foundation, Santa Monica, CA, United States
| | - David A. Merrill
- Pacific Brain Health Center, Pacific Neuroscience Institute and Foundation, Santa Monica, CA, United States
- Saint John's Cancer Institute at Providence Saint John's Health Center, Santa Monica, CA, United States
- Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine at University of California, Los Angeles, Los Angeles, CA, United States
| | | | | | - Colin Quirk
- SPARK Neuro Inc., New York, NY, United States
| | - Ché Lucero
- SPARK Neuro Inc., New York, NY, United States
| |
Collapse
|
4
|
Srinivasan S, Johnson SD. Optimizing feature subset for schizophrenia detection using multichannel EEG signals and rough set theory. Cogn Neurodyn 2024; 18:431-446. [PMID: 38699607 PMCID: PMC11061098 DOI: 10.1007/s11571-023-10011-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 06/06/2023] [Accepted: 09/16/2023] [Indexed: 05/05/2024] Open
Abstract
Schizophrenia (SZ) is a mental disorder that causes lifelong disorders based on delusions, cognitive deficits, and hallucinations. By visual assessment, SZ diagnosis is time-consuming and complicated, because brain states are more effectively revealed by electroencephalogram (EEG) signals, which are effectively used in SZ diagnosis. The application of existing deep learning methods in SZ detection is effective in the classification of 2-dimensional images, and these methods require more computational resources. Therefore, dimensionality reduction is necessary for SZ diagnosis using EEG signals. To reduce the dimensionality of the data, an improved CAO (ICAO) dimensionality reduction method is proposed, which integrates horizontal and vertical crossover approaches with AOA. The optimal feature subset is achieved by satisfying the ICAO conditions, and a fitness function is evaluated based on rough sets for improved accuracy in feature selection. Therefore a Crossover-boosted Archimedes optimization algorithm (AOA) with rough sets for Schizophrenia detection (CAORS-SD) was proposed using multichannel EEG signals from both SZ and normal patients. The signals are decomposed using multivariate empirical mode decomposition into multivariate intrinsic mode functions (MIMFs). Entropy metrics such as spectral entropy, permutation entropy, approximate entropy, sample entropy, and SVD entropy are evaluated on the MIMF domain to detect SZ. The processing time of the kernel support vector machine classifier is minimized with fewer features, reducing the risk Fof overfitting. Accuracy, sensitivity, specificity, precision, and F1-score of the CAORS-SD model should be conducted to diagnose SZ. Therefore, the proposed CAORS-SD method achieves the higher performance of accuracy, sensitivity, specificity, precision, and F1-score values of 96.34, 98.95, 96.86, 98.52, and 96.74% respectively. Also, the CAORS-SD method minimizes the error rate and significantly reduces the execution time.
Collapse
|
5
|
Ellis CA, Sancho ML, Miller RL, Calhoun VD. Identifying EEG Biomarkers of Depression with Novel Explainable Deep Learning Architectures. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.19.585728. [PMID: 38562835 PMCID: PMC10983917 DOI: 10.1101/2024.03.19.585728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Deep learning methods are increasingly being applied to raw electroencephalogram (EEG) data. However, if these models are to be used in clinical or research contexts, methods to explain them must be developed, and if these models are to be used in research contexts, methods for combining explanations across large numbers of models must be developed to counteract the inherent randomness of existing training approaches. Model visualization-based explainability methods for EEG involve structuring a model architecture such that its extracted features can be characterized and have the potential to offer highly useful insights into the patterns that they uncover. Nevertheless, model visualization-based explainability methods have been underexplored within the context of multichannel EEG, and methods to combine their explanations across folds have not yet been developed. In this study, we present two novel convolutional neural network-based architectures and apply them for automated major depressive disorder diagnosis. Our models obtain slightly lower classification performance than a baseline architecture. However, across 50 training folds, they find that individuals with MDD exhibit higher β power, potentially higher δ power, and higher brain-wide correlation that is most strongly represented within the right hemisphere. This study provides multiple key insights into MDD and represents a significant step forward for the domain of explainable deep learning applied to raw EEG. We hope that it will inspire future efforts that will eventually enable the development of explainable EEG deep learning models that can contribute both to clinical care and novel medical research discoveries.
Collapse
Affiliation(s)
- Charles A Ellis
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
| | - Martina Lapera Sancho
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
| | - Robyn L Miller
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
| | - Vince D Calhoun
- Center for Translational Research in Neuroimaging and Data Science at Georgia State University, the Georgia Institute of Technology and Emory University, Atlanta GA 30303, USA
- Department of Computer Science, Georgia State University, Atlanta GA 30303, USA
| |
Collapse
|
6
|
Aksoy G, Cattan G, Chakraborty S, Karabatak M. Quantum Machine-Based Decision Support System for the Detection of Schizophrenia from EEG Records. J Med Syst 2024; 48:29. [PMID: 38441727 PMCID: PMC10914922 DOI: 10.1007/s10916-024-02048-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 02/18/2024] [Indexed: 03/07/2024]
Abstract
Schizophrenia is a serious chronic mental disorder that significantly affects daily life. Electroencephalography (EEG), a method used to measure mental activities in the brain, is among the techniques employed in the diagnosis of schizophrenia. The symptoms of the disease typically begin in childhood and become more pronounced as one grows older. However, it can be managed with specific treatments. Computer-aided methods can be used to achieve an early diagnosis of this illness. In this study, various machine learning algorithms and the emerging technology of quantum-based machine learning algorithm were used to detect schizophrenia using EEG signals. The principal component analysis (PCA) method was applied to process the obtained data in quantum systems. The data, which were reduced in dimensionality, were transformed into qubit form using various feature maps and provided as input to the Quantum Support Vector Machine (QSVM) algorithm. Thus, the QSVM algorithm was applied using different qubit numbers and different circuits in addition to classical machine learning algorithms. All analyses were conducted in the simulator environment of the IBM Quantum Platform. In the classification of this EEG dataset, it is evident that the QSVM algorithm demonstrated superior performance with a 100% success rate when using Pauli X and Pauli Z feature maps. This study serves as proof that quantum machine learning algorithms can be effectively utilized in the field of healthcare.
Collapse
Affiliation(s)
- Gamzepelin Aksoy
- Department of Software Engineering, Firat University, Elazig, Türkiye.
| | | | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, 2351, Australia
- Centre for Advanced Modelling and Geospatial Information Systems (CAMGIS), School of Civil and Environmental Engineering, Faculty of Engineering and IT, University of Technology Sydney, Ultimo, NSW, 2007, Australia
- Griffith Business School, Griffith University, Brisbane, QLD, 4111, Australia
| | - Murat Karabatak
- Department of Software Engineering, Firat University, Elazig, Türkiye
| |
Collapse
|
7
|
Sancho ML, Ellis CA, Miller RL, Calhoun VD. Identifying Reproducibly Important EEG Markers of Schizophrenia with an Explainable Multi-Model Deep Learning Approach. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.09.579600. [PMID: 38405889 PMCID: PMC10888920 DOI: 10.1101/2024.02.09.579600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
The diagnosis of schizophrenia (SZ) can be challenging due to its diverse symptom presentation. As such, many studies have sought to identify diagnostic biomarkers of SZ using explainable machine learning methods. However, the generalizability of identified biomarkers in many machine learning-based studies is highly questionable given that most studies only analyze explanations from a small number of models. In this study, we present (1) a novel feature interaction-based explainability approach and (2) several new approaches for summarizing multi-model explanations. We implement our approach within the context of electroencephalogram (EEG) spectral power data. We further analyze both training and test set explanations with the goal of extracting generalizable insights from the models. Importantly, our analyses identify effects of SZ upon the α, β, and θ frequency bands, the left hemisphere of the brain, and interhemispheric interactions across a majority of folds. We hope that our analysis will provide helpful insights into SZ and inspire the development of robust approaches for identifying neuropsychiatric disorder biomarkers from explainable machine learning models.
Collapse
Affiliation(s)
- Martina Lapera Sancho
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, and Emory University Atlanta, USA
| | - Charles A Ellis
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, and Emory University Atlanta, USA
| | - Robyn L Miller
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, and Emory University Atlanta, USA
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, and Emory University Atlanta, USA
| |
Collapse
|
8
|
Tveitstøl T, Tveter M, Pérez T. AS, Hatlestad-Hall C, Yazidi A, Hammer HL, Hebold Haraldsen IRJ. Introducing Region Based Pooling for handling a varied number of EEG channels for deep learning models. Front Neuroinform 2024; 17:1272791. [PMID: 38351907 PMCID: PMC10861709 DOI: 10.3389/fninf.2023.1272791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 12/07/2023] [Indexed: 02/16/2024] Open
Abstract
Introduction A challenge when applying an artificial intelligence (AI) deep learning (DL) approach to novel electroencephalography (EEG) data, is the DL architecture's lack of adaptability to changing numbers of EEG channels. That is, the number of channels cannot vary neither in the training data, nor upon deployment. Such highly specific hardware constraints put major limitations on the clinical usability and scalability of the DL models. Methods In this work, we propose a technique for handling such varied numbers of EEG channels by splitting the EEG montages into distinct regions and merge the channels within the same region to a region representation. The solution is termed Region Based Pooling (RBP). The procedure of splitting the montage into regions is performed repeatedly with different region configurations, to minimize potential loss of information. As RBP maps a varied number of EEG channels to a fixed number of region representations, both current and future DL architectures may apply RBP with ease. To demonstrate and evaluate the adequacy of RBP to handle a varied number of EEG channels, sex classification based solely on EEG was used as a test example. The DL models were trained on 129 channels, and tested on 32, 65, and 129-channels versions of the data using the same channel positions scheme. The baselines for comparison were zero-filling the missing channels and applying spherical spline interpolation. The performances were estimated using 5-fold cross validation. Results For the 32-channel system version, the mean AUC values across the folds were: RBP (93.34%), spherical spline interpolation (93.36%), and zero-filling (76.82%). Similarly, on the 65-channel system version, the performances were: RBP (93.66%), spherical spline interpolation (93.50%), and zero-filling (85.58%). Finally, the 129-channel system version produced the following results: RBP (94.68%), spherical spline interpolation (93.86%), and zero-filling (91.92%). Conclusion In conclusion, RBP obtained similar results to spherical spline interpolation, and superior results to zero-filling. We encourage further research and development of DL models in the cross-dataset setting, including the use of methods such as RBP and spherical spline interpolation to handle a varied number of EEG channels.
Collapse
Affiliation(s)
- Thomas Tveitstøl
- Department of Neurology, Oslo University Hospital, Oslo, Norway
- Institute of Clinical Medicine, Faculty of Medicine, University of Oslo, Oslo, Norway
| | - Mats Tveter
- Department of Neurology, Oslo University Hospital, Oslo, Norway
- Institute of Clinical Medicine, Faculty of Medicine, University of Oslo, Oslo, Norway
| | - Ana S. Pérez T.
- Department of Neurology, Oslo University Hospital, Oslo, Norway
- Institute of Clinical Medicine, Faculty of Medicine, University of Oslo, Oslo, Norway
| | | | - Anis Yazidi
- Department of Computer Science, Oslo Metropolitan University, Oslo, Norway
| | - Hugo L. Hammer
- Department of Computer Science, Oslo Metropolitan University, Oslo, Norway
- Department of Holistic Systems, SimulaMet, Oslo, Norway
| | | |
Collapse
|
9
|
Ellis CA, Miller RL, Calhoun VD. Evaluating Augmentation Approaches for Deep Learning-based Major Depressive Disorder Diagnosis with Raw Electroencephalogram Data. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.12.15.571938. [PMID: 38187601 PMCID: PMC10769199 DOI: 10.1101/2023.12.15.571938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
While deep learning methods are increasingly applied in research contexts for neuropsychiatric disorder diagnosis, small dataset size limits their potential for clinical translation. Data augmentation (DA) could address this limitation, but the utility of EEG DA methods remains relatively underexplored in neuropsychiatric disorder diagnosis. In this study, we train a model for major depressive disorder diagnosis. We then evaluate the utility of 6 EEG DA approaches. Importantly, to remove the bias that could be introduced by comparing performance for models trained on larger augmented training sets to models trained on smaller baseline sets, we also introduce a new baseline trained on duplicate training data to better. We lastly examine the effects of the DA approaches upon representations learned by the model with a pair of explainability analyses. We find that while most approaches boost model performance, they do not improve model performance beyond that of simply using a duplicate training set without DA. The exception to this is channel dropout augmentation, which does improve model performance. These findings suggest the importance of comparing EEG DA methods to a baseline with a duplicate training set of equal size to the augmented training set. We also found that some DA methods increased model robustness to frequency (Fourier transform surrogates) and channel (channel dropout) perturbation. While our findings on EEG DA efficacy are restricted to our dataset and model, we hope that future studies on deep learning for small EEG datasets and on new EEG DA methods will find our findings helpful.
Collapse
Affiliation(s)
- Charles A Ellis
- Center for Translational Research in Neuroimaging and Data Science Georgia State University, Emory University, Georgia Institute of Technology Atlanta, USA
| | - Robyn L Miller
- Center for Translational Research in Neuroimaging and Data Science Georgia State University, Emory University, Georgia Institute of Technology Atlanta, USA
| | - Vince D Calhoun
- Center for Translational Research in Neuroimaging and Data Science Georgia State University, Emory University, Georgia Institute of Technology Atlanta, USA
| |
Collapse
|
10
|
Ellis CA, Miller RL, Calhoun VD. Cross-Sampling Rate Transfer Learning for Enhanced Raw EEG Deep Learning Classifier Performance in Major Depressive Disorder Diagnosis. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.13.566915. [PMID: 38014293 PMCID: PMC10680672 DOI: 10.1101/2023.11.13.566915] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
Transfer learning offers a route for developing robust deep learning models on small raw electroencephalography (EEG) datasets. Nevertheless, the utility of applying representations learned from large datasets with a lower sampling rate to smaller datasets with higher sampling rates remains relatively unexplored. In this study, we transfer representations learned by a convolutional neural network on a large, publicly available sleep dataset with a 100 Hertz sampling rate to a major depressive disorder (MDD) diagnosis task at a sampling rate of 200 Hertz. Importantly, we find that the early convolutional layers contain representations that are generalizable across tasks. Moreover, our approach significantly increases mean model accuracy from 82.33% to 86.99%, increases the model's use of lower frequencies, (θ-band), and increases its robustness to channel loss. We expect this analysis to provide useful guidance and enable more widespread use of transfer learning in EEG deep learning studies.
Collapse
|
11
|
Sattiraju A, Ellis CA, Miller RL, Calhoun VD. An Explainable and Robust Deep Learning Approach for Automated Electroencephalography-based Schizophrenia Diagnosis. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.27.542592. [PMID: 37398173 PMCID: PMC10312438 DOI: 10.1101/2023.05.27.542592] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Abstract
Schizophrenia (SZ) is a neuropsychiatric disorder that affects millions globally. Current diagnosis of SZ is symptom-based, which poses difficulty due to the variability of symptoms across patients. To this end, many recent studies have developed deep learning methods for automated diagnosis of SZ, especially using raw EEG, which provides high temporal precision. For such methods to be productionized, they must be both explainable and robust. Explainable models are essential to identify biomarkers of SZ, and robust models are critical to learn generalizable patterns, especially amidst changes in the implementation environment. One common example is channel loss during EEG recording, which could be detrimental to classifier performance. In this study, we developed a novel channel dropout (CD) approach to increase the robustness of explainable deep learning models trained on EEG data for SZ diagnosis to channel loss. We developed a baseline convolutional neural network (CNN) architecture and implement our approach as a CD layer added to the baseline (CNN-CD). We then applied two explainability approaches to both models for insight into learned spatial and spectral features and show that the application of CD decreases model sensitivity to channel loss. The CNN and CNN-CD achieved accuracies of 81.9% and 80.9% on testing data, respectively. Furthermore, our models heavily prioritized the parietal electrodes and the α-band, which is supported by existing literature. It is our hope that this study motivates the further development of explainable and robust models and bridges the transition from research to application in a clinical decision support role.
Collapse
Affiliation(s)
- Abhinav Sattiraju
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| | - Charles A Ellis
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| | - Robyn L Miller
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| |
Collapse
|
12
|
Iglesias-Parro S, Soriano MF, Ibáñez-Molina AJ, Pérez-Matres AV, Ruiz de Miras J. Examining Neural Connectivity in Schizophrenia Using Task-Based EEG: A Graph Theory Approach. SENSORS (BASEL, SWITZERLAND) 2023; 23:8722. [PMID: 37960422 PMCID: PMC10647645 DOI: 10.3390/s23218722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 10/19/2023] [Accepted: 10/23/2023] [Indexed: 11/15/2023]
Abstract
Schizophrenia (SZ) is a complex disorder characterized by a range of symptoms and behaviors that have significant consequences for individuals, families, and society in general. Electroencephalography (EEG) is a valuable tool for understanding the neural dynamics and functional abnormalities associated with schizophrenia. Research studies utilizing EEG have identified specific patterns of brain activity in individuals diagnosed with schizophrenia that may reflect disturbances in neural synchronization and information processing in cortical circuits. Considering the temporal dynamics of functional connectivity provides a more comprehensive understanding of brain networks' organization and how they change during different cognitive states. This temporal perspective would enhance our understanding of the underlying mechanisms of schizophrenia. In the present study, we will use measures based on graph theory to obtain dynamic and static indicators in order to evaluate differences in the functional connectivity of individuals diagnosed with SZ and healthy controls using an ecologically valid task. At the static level, patients showed alterations in their ability to segregate information, particularly in the default mode network (DMN). As for dynamic measures, patients showed reduced values in most metrics (segregation, integration, centrality, and resilience), reflecting a reduced number of dynamic states of brain networks. Our results show the utility of combining static and dynamic indicators of functional connectivity from EEG sensors.
Collapse
Affiliation(s)
| | - María F. Soriano
- Mental Health Unit, San Agustín Hospital de Linares, 23700 Linares, Spain
| | | | - Ana V. Pérez-Matres
- Department of Software Engineering, University of Granada, 18071 Granada, Spain
| | - Juan Ruiz de Miras
- Department of Software Engineering, University of Granada, 18071 Granada, Spain
| |
Collapse
|
13
|
Ellis CA, Sattiraju A, Miller RL, Calhoun VD. Improving Multichannel Raw Electroencephalography-based Diagnosis of Major Depressive Disorder via Transfer Learning with Single Channel Sleep Stage Data. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.29.538813. [PMID: 37873255 PMCID: PMC10592604 DOI: 10.1101/2023.04.29.538813] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
As the field of deep learning has grown in recent years, its application to the domain of raw resting-state electroencephalography (EEG) has also increased. Relative to traditional machine learning methods or deep learning methods applied to manually engineered features, there are fewer methods for developing deep learning models on small raw EEG datasets. One potential approach for enhancing deep learning performance, in this case, is the use of transfer learning. While a number of studies have presented transfer learning approaches for manually engineered EEG features, relatively few approaches have been developed for raw resting-state EEG. In this study, we propose a novel EEG transfer learning approach wherein we first train a model on a large publicly available single-channel sleep stage classification dataset. We then use the learned representations to develop a classifier for automated major depressive disorder diagnosis with raw multichannel EEG. Statistical testing reveals that our approach significantly improves the performance of our model (p < 0.05), and we also find that the performance of our approach exceeds that of many previous studies using both engineered features and raw EEG. We further examine how transfer learning affected the representations learned by the model through a pair of explainability analyses, identifying key frequency bands and channels utilized across models. Our proposed approach represents a significant step forward for the domain of raw resting-state EEG classification and has broader implications for use with other electrophysiology and time-series modalities. Importantly, it has the potential to expand the use of deep learning methods across a greater variety of raw EEG datasets and lead to the development of more reliable EEG classifiers.
Collapse
Affiliation(s)
- Charles A Ellis
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, Emory University Atlanta, USA
| | - Abhinav Sattiraju
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, Emory University Atlanta, USA
| | - Robyn L Miller
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, Emory University Atlanta, USA
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science Georgia State University, Georgia Institute of Technology, Emory University Atlanta, USA
| |
Collapse
|
14
|
Parsa M, Rad HY, Vaezi H, Hossein-Zadeh GA, Setarehdan SK, Rostami R, Rostami H, Vahabie AH. EEG-based classification of individuals with neuropsychiatric disorders using deep neural networks: A systematic review of current status and future directions. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 240:107683. [PMID: 37406421 DOI: 10.1016/j.cmpb.2023.107683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2022] [Revised: 05/23/2023] [Accepted: 06/18/2023] [Indexed: 07/07/2023]
Abstract
The use of deep neural networks for electroencephalogram (EEG) classification has rapidly progressed and gained popularity in recent years, but automatic feature extraction from EEG signals remains a challenging task. The classification of neuropsychiatric disorders demands the extraction of neuro-markers for use in automated EEG classification. Numerous advanced deep learning algorithms can be used for this purpose. In this article, we present a comprehensive review of the main factors and parameters that affect the performance of deep neural networks in classifying different neuropsychiatric disorders using EEG signals. We also analyze the EEG features used for improving classification performance. Our analysis includes 82 scientific journal papers that applied deep neural networks for subject-wise classification based on EEG signals. We extracted information on the EEG dataset and types of disorders, deep neural network structures, performance, and hyperparameters. The results show that most studies have focused on clinical classification, achieving an average accuracy of 91.83 ± 7.34, with convolutional neural networks (CNNs) being the most frequently used network architecture and resting-state EEG signals being the most commonly used data type. Additionally, the review reveals that depression (N = 18), Alzheimer's (N = 11), and schizophrenia (N = 11) were studied more frequently than other types of neuropsychiatric disorders. Our review provides insight into the performance of deep neural networks in EEG classification and highlights the importance of EEG feature extraction in improving classification accuracy. By identifying the main factors and parameters that affect deep neural network performance in EEG classification, our review can guide future research in this area. We hope that our findings will encourage further exploration of deep learning methods for EEG classification and contribute to the development of more accurate and effective methods for diagnosing and monitoring neuropsychiatric disorders using EEG signals.
Collapse
Affiliation(s)
- Mohsen Parsa
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, North Kargar St., P.O. Box 14395/515, Tehran, Iran; School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Artesh Highway, P.O. Box 19568-36484, Tehran, Iran
| | - Habib Yousefi Rad
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, North Kargar St., P.O. Box 14395/515, Tehran, Iran; School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Artesh Highway, P.O. Box 19568-36484, Tehran, Iran
| | - Hadi Vaezi
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, North Kargar St., P.O. Box 14395/515, Tehran, Iran; School of Cognitive Sciences, Institute for Research in Fundamental Sciences, Artesh Highway, P.O. Box 19568-36484, Tehran, Iran
| | - Gholam-Ali Hossein-Zadeh
- Control and Intelligent Processing Center of Excellence, Faculty of Electrical and Computer Engineering, University of Tehran, North Kargar St., P.O. Box 14395/515, Tehran, Iran
| | - Seyed Kamaledin Setarehdan
- Control and Intelligent Processing Center of Excellence, Faculty of Electrical and Computer Engineering, University of Tehran, North Kargar St., P.O. Box 14395/515, Tehran, Iran
| | - Reza Rostami
- Faculty of Psychology and Education, University of Tehran, Jalal-Al-e-Ahmed, P.O. Box 14155-6456, Tehran, Iran
| | - Hana Rostami
- ACNC, Atieh Clinical Neuroscience Center, Valiasr St., P.O. Box 19697-13663, Tehran, Iran
| | - Abdol-Hossein Vahabie
- Faculty of Psychology and Education, University of Tehran, Jalal-Al-e-Ahmed, P.O. Box 14155-6456, Tehran, Iran; Cognitive Systems Laboratory, Control and Intelligent Processing Center of Excellence (CIPCE), School of Electrical and Computer Engineering, College of Engineering, University of Tehran, P.O. Box 14395/515, Tehran, Iran; Pasargad Institute for Advanced Innovative Solutions (PIAIS), Tehran, Iran.
| |
Collapse
|
15
|
Gashkarimov VR, Sultanova RI, Efremov IS, Asadullin AR. Machine learning techniques in diagnostics and prediction of the clinical features of schizophrenia: a narrative review. CONSORTIUM PSYCHIATRICUM 2023; 4:43-53. [PMID: 38249535 PMCID: PMC10795943 DOI: 10.17816/cp11030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/07/2023] [Indexed: 01/23/2024] Open
Abstract
BACKGROUND Schizophrenia is a severe psychiatric disorder associated with a significant negative impact. Early diagnosis and treatment of schizophrenia has a favorable effect on the clinical outcome and patients quality of life. In this context, machine learning techniques open up new opportunities for a more accurate diagnosis and prediction of the clinical features of this illness. AIM This literature review is aimed to search for information on the use of machine learning techniques in the prediction and diagnosis of schizophrenia and the determination of its clinical features. METHODS The Google Scholar, PubMed, and eLIBRARY.ru databases were used to search for relevant data. The review included articles that had been published not earlier than January 1, 2010, and not later than March 31, 2023. Combinations of the following keywords were applied for search queries: machine learning, deep learning, schizophrenia, neural network, predictors, artificial intelligence, diagnostics, suicide, depressive, insomnia, and cognitive. Original articles regardless of their design were included in the review. Descriptive analysis was used to summarize the retrieved data. RESULTS Machine learning techniques are widely used in the functional assessment of patients with schizophrenia. They are used for interpretation of MRI, EEG, and actigraphy findings. Also, models created using machine learning algorithms can analyze speech, behavior, and the creativity of people and these data can be used for the diagnosis of psychiatric disorders. It has been found that different machine learning-based models can help specialists predict and diagnose schizophrenia based on medical history and genetic data, as well as epigenetic information. Machine learning techniques can also be used to build effective models that can help specialists diagnose and predict clinical manifestations and complications of schizophrenia, such as insomnia, depressive symptoms, suicide risk, aggressive behavior, and changes in cognitive functions over time. CONCLUSION Machine learning techniques play an important role in psychiatry, as they have been used in models that help specialists in the diagnosis of schizophrenia and determination of its clinical features. The use of machine learning algorithms is one of the most promising direction in psychiatry, and it can significantly improve the effectiveness of the diagnosis and treatment of schizophrenia.
Collapse
Affiliation(s)
| | - Renata I Sultanova
- Moscow Research and Clinical Center for Neuropsychiatry of Moscow Healthcare Department
| | - Ilya S Efremov
- Bashkir State Medical University
- V.M. Bekhterev National Medical Research Centre for Psychiatry and Neurology
| | - Azat R Asadullin
- Bashkir State Medical University
- V.M. Bekhterev National Medical Research Centre for Psychiatry and Neurology
- Republican Clinical Psychotherapeutic Center
| |
Collapse
|
16
|
Yin G, Chang Y, Zhao Y, Liu C, Yin M, Fu Y, Shi D, Wang L, Jin L, Huang J, Li D, Niu Y, Wang B, Tan S. Automatic recognition of schizophrenia from brain-network features using graph convolutional neural network. Asian J Psychiatr 2023; 87:103687. [PMID: 37418809 DOI: 10.1016/j.ajp.2023.103687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 06/25/2023] [Accepted: 06/30/2023] [Indexed: 07/09/2023]
Abstract
Schizophrenia is a severe mental illness that imposes considerable economic burden on families and society. However, its clinical diagnosis primarily relies on scales and doctors' clinical experience and lacks an objective and accurate diagnostic approach. In recent years, graph convolutional neural networks (GCN) have been used to assist in psychiatric diagnosis owing to their ability to learn spatial-association information. Therefore, this study proposes a schizophrenia automatic recognition model based on graph convolutional neural network. Herein, the resting-state electroencephalography (EEG) data of 103 first-episode schizophrenia patients and 92 normal controls (NCs) were obtained. The automatic recognition model was trained with a nodal feature matrix that comprised the time and frequency-domain features of the EEG signals and local features of the brain network. The most significant regions that contributed to the model classification were identified, and the correlation between the node topological features of each significant region and clinical evaluation metrics was explored. Experiments were conducted to evaluate the performance of the model using 10-fold cross-validation. The best performance in the theta frequency band with a 6 s epoch length and phase-locked value. The recognition accuracy was 90.01%. The most significant region for identifying with first-episode schizophrenia patients and NCs was located in the parietal lobe. The results of this study verify the applicability of the proposed novel method for the identification and diagnosis of schizophrenia.
Collapse
Affiliation(s)
- Guimei Yin
- College of Computer Science and Technology, Taiyuan Normal University, City Jinzhong 030619 Shanxi, China
| | - Ying Chang
- Departs of Ultrasonography, Xuan Wu Hospital, Capital Medical University, Beijing 100053, China
| | - Yanli Zhao
- Peking University Huilonguan Clinical Medical School, Psychiatry Research Center, Beijing Huilongguan Hospital, Beijing 100096, China
| | - Chenxu Liu
- College of Computer Science and Technology, Taiyuan Normal University, City Jinzhong 030619 Shanxi, China
| | - Mengzhen Yin
- College of Computer Science and Technology, Taiyuan Normal University, City Jinzhong 030619 Shanxi, China
| | - Yongcan Fu
- College of Computer Science and Technology, Taiyuan Normal University, City Jinzhong 030619 Shanxi, China
| | - Dongli Shi
- College of Computer Science and Technology, Taiyuan Normal University, City Jinzhong 030619 Shanxi, China
| | - Lin Wang
- College of Computer Science and Technology, Taiyuan Normal University, City Jinzhong 030619 Shanxi, China
| | - Lizhong Jin
- Taiyuan University of Science and Technology, Taiyuan 030024 Shanxi, China
| | - Jie Huang
- Peking University Huilonguan Clinical Medical School, Psychiatry Research Center, Beijing Huilongguan Hospital, Beijing 100096, China
| | - Dandan Li
- Taiyuan University of Technology, Jinzhong 030600 Shanxi, China
| | - Yan Niu
- Taiyuan University of Technology, Jinzhong 030600 Shanxi, China
| | - Bin Wang
- Taiyuan University of Technology, Jinzhong 030600 Shanxi, China.
| | - Shuping Tan
- Peking University Huilonguan Clinical Medical School, Psychiatry Research Center, Beijing Huilongguan Hospital, Beijing 100096, China.
| |
Collapse
|
17
|
Tang Y, Tong G, Xiong X, Zhang C, Zhang H, Yang Y. Multi-site diagnostic classification of Autism spectrum disorder using adversarial deep learning on resting-state fMRI. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
18
|
Gosala B, Dindayal Kapgate P, Jain P, Nath Chaurasia R, Gupta M. Wavelet transforms for feature engineering in EEG data processing: An application on Schizophrenia. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/05/2023]
|
19
|
Kozyrev EA, Ermakov EA, Boiko AS, Mednova IA, Kornetova EG, Bokhan NA, Ivanova SA. Building Predictive Models for Schizophrenia Diagnosis with Peripheral Inflammatory Biomarkers. Biomedicines 2023; 11:1990. [PMID: 37509629 PMCID: PMC10377576 DOI: 10.3390/biomedicines11071990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 07/10/2023] [Accepted: 07/12/2023] [Indexed: 07/30/2023] Open
Abstract
Machine learning and artificial intelligence technologies are known to be a convenient tool for analyzing multi-domain data in precision psychiatry. In the case of schizophrenia, the most commonly used data sources for such purposes are neuroimaging, voice and language patterns, and mobile phone data. Data on peripheral markers can also be useful for building predictive models. Here, we have developed five predictive models for the binary classification of schizophrenia patients and healthy individuals. Data on serum concentrations of cytokines, chemokines, growth factors, and age were among 38 parameters used to build these models. The sample consisted of 217 schizophrenia patients and 90 healthy individuals. The models architecture was involved logistic regression, deep neural networks, decision trees, support vector machine, and k-nearest neighbors algorithms. It was shown that the algorithm based on a deep neural network (consisting of five layers) showed a slightly higher sensitivity (0.87 ± 0.04) and specificity (0.52 ± 0.06) than other algorithms. Combining all variables into a single classifier showed a cumulative effect that exceeded the effectiveness of individual variables, indicating the need to use multiple biomarkers to diagnose schizophrenia. Thus, the data obtained showed the promise of using data on peripheral biomarkers and machine learning methods for diagnosing schizophrenia.
Collapse
Affiliation(s)
- Evgeny A Kozyrev
- Budker Institute of Nuclear Physics, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia
| | - Evgeny A Ermakov
- Institute of Chemical Biology and Fundamental Medicine, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia
| | - Anastasiia S Boiko
- Mental Health Research Institute, Tomsk National Research Medical Center of the Russian Academy of Sciences, 634014 Tomsk, Russia
| | - Irina A Mednova
- Mental Health Research Institute, Tomsk National Research Medical Center of the Russian Academy of Sciences, 634014 Tomsk, Russia
| | - Elena G Kornetova
- Mental Health Research Institute, Tomsk National Research Medical Center of the Russian Academy of Sciences, 634014 Tomsk, Russia
- University Hospital, Siberian State Medical University, 634050 Tomsk, Russia
| | - Nikolay A Bokhan
- Mental Health Research Institute, Tomsk National Research Medical Center of the Russian Academy of Sciences, 634014 Tomsk, Russia
- Psychiatry, Addiction Psychiatry and Psychotherapy Department, Siberian State Medical University, 634050 Tomsk, Russia
| | - Svetlana A Ivanova
- Mental Health Research Institute, Tomsk National Research Medical Center of the Russian Academy of Sciences, 634014 Tomsk, Russia
- Psychiatry, Addiction Psychiatry and Psychotherapy Department, Siberian State Medical University, 634050 Tomsk, Russia
| |
Collapse
|
20
|
Ellis CA, Sattiraju A, Miller RL, Calhoun VD. Improving Multichannel Raw Electroencephalography-based Diagnosis of Major Depressive Disorder by Pretraining Deep Learning Models with Single Channel Sleep Stage Data. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.29.542700. [PMID: 37398050 PMCID: PMC10312836 DOI: 10.1101/2023.05.29.542700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Abstract
As the field of deep learning has grown in recent years, its application to the domain of raw resting-state electroencephalography (EEG) has also increased. Relative to traditional machine learning methods or deep learning methods applied to extracted features, there are fewer methods for developing deep learning models on small raw EEG datasets. One potential approach for enhancing deep learning performance in this case is the use of transfer learning. In this study, we propose a novel EEG transfer learning approach wherein we first train a model on a large publicly available sleep stage classification dataset. We then use the learned representations to develop a classifier for automated major depressive disorder diagnosis with raw multichannel EEG. We find that our approach improves model performance, and we further examine how transfer learning affected the representations learned by the model through a pair of explainability analyses. Our proposed approach represents a significant step forward for the domain raw resting-state EEG classification. Furthermore, it has the potential to expand the use of deep learning methods across more raw EEG datasets and lead to the development of more reliable EEG classifiers.
Collapse
Affiliation(s)
- Charles A Ellis
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| | - Abhinav Sattiraju
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| | - Robyn L Miller
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303 USA
| |
Collapse
|
21
|
Siuly S, Guo Y, Alcin OF, Li Y, Wen P, Wang H. Exploring deep residual network based features for automatic schizophrenia detection from EEG. Phys Eng Sci Med 2023; 46:561-574. [PMID: 36947384 DOI: 10.1007/s13246-023-01225-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 01/16/2023] [Indexed: 03/23/2023]
Abstract
Schizophrenia is a severe mental illness which can cause lifelong disability. Most recent studies on the Electroencephalogram (EEG)-based diagnosis of schizophrenia rely on bespoke/hand-crafted feature extraction techniques. Traditional manual feature extraction methods are time-consuming, imprecise, and have a limited ability to balance accuracy and efficiency. Addressing this issue, this study introduces a deep residual network (deep ResNet) based feature extraction design that can automatically extract representative features from EEG signal data for identifying schizophrenia. This proposed method consists of three stages: signal pre-processing by average filtering method, extraction of hidden patterns of EEG signals by deep ResNet, and classification of schizophrenia by softmax layer. To assess the performance of the obtained deep features, ResNet softmax classifier and also several machine learning (ML) techniques are applied on the same feature set. The experimental results for a Kaggle schizophrenia EEG dataset show that the deep features with support vector machine classifier could achieve the highest performances (99.23% accuracy) compared to the ResNet classifier. Furthermore, the proposed model performs better than the existing approaches. The findings suggest that our proposed strategy has capability to discover important biomarkers for automatic diagnosis of schizophrenia from EEG, which will aid in the development of a computer assisted diagnostic system by specialists.
Collapse
Affiliation(s)
- Siuly Siuly
- Institute for Sustainable Industries & Liveable Cities, Victoria University, Melbourne, Australia.
- Centre for Health Research, University of Southern Queensland, Toowoomba, Australia.
| | - Yanhui Guo
- Department of Computer Science, University of Illinois at Springfield, Springfield, IL, 62703, USA
| | - Omer Faruk Alcin
- Department of Electrical-Electronics Engineering, Faculty of Engineering and Natural Sciences, Malatya Turgut Ozal University, Malatya, Turkey
| | - Yan Li
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, Australia
| | - Peng Wen
- School of Engineering, University of Southern Queensland, Toowoomba, Australia
| | - Hua Wang
- Institute for Sustainable Industries & Liveable Cities, Victoria University, Melbourne, Australia
| |
Collapse
|
22
|
Baygin M, Barua PD, Chakraborty S, Tuncer I, Dogan S, Palmer E, Tuncer T, Kamath AP, Ciaccio EJ, Acharya UR. CCPNet136: automated detection of schizophrenia using carbon chain pattern and iterative TQWT technique with EEG signals. Physiol Meas 2023; 44. [PMID: 36599170 DOI: 10.1088/1361-6579/acb03c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 01/04/2023] [Indexed: 01/05/2023]
Abstract
Objective.Schizophrenia (SZ) is a severe, chronic psychiatric-cognitive disorder. The primary objective of this work is to present a handcrafted model using state-of-the-art technique to detect SZ accurately with EEG signals.Approach.In our proposed work, the features are generated using a histogram-based generator and an iterative decomposition model. The graph-based molecular structure of the carbon chain is employed to generate low-level features. Hence, the developed feature generation model is called the carbon chain pattern (CCP). An iterative tunable q-factor wavelet transform (ITQWT) technique is implemented in the feature extraction phase to generate various sub-bands of the EEG signal. The CCP was applied to the generated sub-bands to obtain several feature vectors. The clinically significant features were selected using iterative neighborhood component analysis (INCA). The selected features were then classified using the k nearest neighbor (kNN) with a 10-fold cross-validation strategy. Finally, the iterative weighted majority method was used to obtain the results in multiple channels.Main results.The presented CCP-ITQWT and INCA-based automated model achieved an accuracy of 95.84% and 99.20% using a single channel and majority voting method, respectively with kNN classifier.Significance.Our results highlight the success of the proposed CCP-ITQWT and INCA-based model in the automated detection of SZ using EEG signals.
Collapse
Affiliation(s)
- Mehmet Baygin
- Department of Computer Engineering, College of Engineering, Ardahan University, Ardahan, Turkey
| | - Prabal Datta Barua
- School of Management & Enterprise, University of Southern Queensland, Australia.,Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, 2351, Australia.,Center for Advanced Modelling and Geospatial Information Systems, Faculty of Engineering and IT, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Ilknur Tuncer
- Elazig Governorship, Interior Ministry, Elazig, Turkey
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Elizabeth Palmer
- Centre of Clinical Genetics, Sydney Children's Hospitals Network, Randwick 2031, Australia.,School of Women's and Children's Health, University of New South Wales, Randwick 2031, Australia
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Aditya P Kamath
- Biomedical Engineering, Brown University, Providence, RI, United States of America
| | - Edward J Ciaccio
- Department of Medicine, Columbia University Irving Medical Center, United States of America
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, S599489, Singapore.,Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore.,Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
23
|
Khare SK, Bajaj V, Acharya UR. SchizoNET: a robust and accurate Margenau-Hill time-frequency distribution based deep neural network model for schizophrenia detection using EEG signals. Physiol Meas 2023; 44. [PMID: 36787641 DOI: 10.1088/1361-6579/acbc06] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Accepted: 02/14/2023] [Indexed: 02/16/2023]
Abstract
Objective.Schizophrenia (SZ) is a severe chronic illness characterized by delusions, cognitive dysfunctions, and hallucinations that impact feelings, behaviour, and thinking. Timely detection and treatment of SZ are necessary to avoid long-term consequences. Electroencephalogram (EEG) signals are one form of a biomarker that can reveal hidden changes in the brain during SZ. However, the EEG signals are non-stationary in nature with low amplitude. Therefore, extracting the hidden information from the EEG signals is challenging.Approach.The time-frequency domain is crucial for the automatic detection of SZ. Therefore, this paper presents the SchizoNET model combining the Margenau-Hill time-frequency distribution (MH-TFD) and convolutional neural network (CNN). The instantaneous information of EEG signals is captured in the time-frequency domain using MH-TFD. The time-frequency amplitude is converted to two-dimensional plots and fed to the developed CNN model.Results.The SchizoNET model is developed using three different validation techniques, including holdout, five-fold cross-validation, and ten-fold cross-validation techniques using three separate public SZ datasets (Dataset 1, 2, and 3). The proposed model achieved an accuracy of 97.4%, 99.74%, and 96.35% on Dataset 1 (adolescents: 45 SZ and 39 HC subjects), Dataset 2 (adults: 14 SZ and 14 HC subjects), and Dataset 3 (adults: 49 SZ and 32 HC subjects), respectively. We have also evaluated six performance parameters and the area under the curve to evaluate the performance of our developed model.Significance.The SchizoNET is robust, effective, and accurate, as it performed better than the state-of-the-art techniques. To the best of our knowledge, this is the first work to explore three publicly available EEG datasets for the automated detection of SZ. Our SchizoNET model can help neurologists detect the SZ in various scenarios.
Collapse
Affiliation(s)
- Smith K Khare
- Electrical and Computer Engineering Department, Aarhus University, Denmark
| | - Varun Bajaj
- Discipline of Electronics and Communication Engineering, Indian Institute of Information Technology, Design, and Manufacturing (IIITDM) Jabalpur, India
| | - U Rajendra Acharya
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, Australia.,Department of Biomedical Engineering, School of Science and Technology, University of Social Sciences, Singapore.,Department of Biomedical Informatics and Medical Engineering, Asia University, Taiwan.,Distinguished Professor, Kumamoto University, Japan.,Adjunct Professor, University of Malaya, Malaysia
| |
Collapse
|
24
|
Sharma M, Patel RK, Garg A, SanTan R, Acharya UR. Automated detection of schizophrenia using deep learning: a review for the last decade. Physiol Meas 2023; 44. [PMID: 36630717 DOI: 10.1088/1361-6579/acb24d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 01/11/2023] [Indexed: 01/12/2023]
Abstract
Schizophrenia (SZ) is a devastating mental disorder that disrupts higher brain functions like thought, perception, etc., with a profound impact on the individual's life. Deep learning (DL) can detect SZ automatically by learning signal data characteristics hierarchically without the need for feature engineering associated with traditional machine learning. We performed a systematic review of DL models for SZ detection. Various deep models like long short-term memory, convolution neural networks, AlexNet, etc., and composite methods have been published based on electroencephalographic signals, and structural and/or functional magnetic resonance imaging acquired from SZ patients and healthy patients control subjects in diverse public and private datasets. The studies, the study datasets, and model methodologies are reported in detail. In addition, the challenges of DL models for SZ diagnosis and future works are discussed.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Ruchit Kumar Patel
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Akshat Garg
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure Technology Research and Management, Ahmedabad 380026, India
| | - Ru SanTan
- Department of Cardiology, National Heart Centre Singapore, Singapore 169609, Singapore
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 639798, Singapore.,Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan.,Department of Biomedical Engineering, School of Science and Technology, Singapore 639798, Singapore
| |
Collapse
|
25
|
Shah SJH, Albishri A, Kang SS, Lee Y, Sponheim SR, Shim M. ETSNet: A deep neural network for EEG-based temporal-spatial pattern recognition in psychiatric disorder and emotional distress classification. Comput Biol Med 2023; 158:106857. [PMID: 37044046 DOI: 10.1016/j.compbiomed.2023.106857] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 03/06/2023] [Accepted: 03/30/2023] [Indexed: 04/03/2023]
Abstract
The use of EEG for evaluating and diagnosing neurological abnormalities related to psychiatric diseases and identifying human emotions has been improved by deep learning advancements. This research aims to categorize individuals with schizophrenia (SZ), their biological relatives (REL), and healthy controls (HC) using resting EEG brain source signal data defined by regions of interest (ROIs). The proposed solution is a deep neural network for the cortical source signals of the ROIs, incorporating a Squeeze-and-Excitation Block and multiple CNNs designed for eyes-open and closed resting states. The model, called EEG Temporal Spatial Network (ETSNet), has two variants: ETSNets and ETSNetf. Two evaluations were conducted to show the effectiveness of the proposed model. The average accuracy for the classification of SZ, REL, and HC using EEG resting data was 99.57% (ETSNetf), and the average accuracy for the classification of eyes-open (EO) and eyes-closed (EC) resting states was 93.15% (ETSNets). An ablation study was also conducted using two public datasets for intellectual and developmental disorders and emotional states, showing improved classification accuracy compared to advanced EEG classification algorithms when using ETSNets.
Collapse
|
26
|
Artificial intelligence system for verification of schizophrenia via theta-EEG rhythm. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
27
|
Ellis CA, Sattiraju A, Miller RL, Calhoun VD. NOVEL APPROACH EXPLAINS SPATIO-SPECTRAL INTERACTIONS IN RAW ELECTROENCEPHALOGRAM DEEP LEARNING CLASSIFIERS. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.26.530118. [PMID: 36909628 PMCID: PMC10002614 DOI: 10.1101/2023.02.26.530118] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/02/2023]
Abstract
The application of deep learning classifiers to resting-state electroencephalography (rs-EEG) data has become increasingly common. However, relative to studies using traditional machine learning methods and extracted features, deep learning methods are less explainable. A growing number of studies have presented explainability approaches for rs-EEG deep learning classifiers. However, to our knowledge, no approaches give insight into spatio-spectral interactions (i.e., how spectral activity in one channel may interact with activity in other channels). In this study, we combine gradient and perturbation-based explainability approaches to give insight into spatio-spectral interactions in rs-EEG deep learning classifiers for the first time. We present the approach within the context of major depressive disorder (MDD) diagnosis identifying differences in frontal δ activity and reduced interactions between frontal electrodes and other electrodes. Our approach provides novel insights and represents a significant step forward for the field of explainable EEG classification.
Collapse
Affiliation(s)
- Charles A Ellis
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, United States
| | - Abhinav Sattiraju
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, United States
| | - Robyn L Miller
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, United States
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science: Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, United States
| |
Collapse
|
28
|
Agarwal M, Singhal A. Fusion of pattern-based and statistical features for Schizophrenia detection from EEG signals. Med Eng Phys 2023; 112:103949. [PMID: 36842772 DOI: 10.1016/j.medengphy.2023.103949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 12/01/2022] [Accepted: 01/03/2023] [Indexed: 01/06/2023]
Abstract
Schizophrenia (SZ) is a chronic disorder affecting the functioning of the brain. It can lead to irrational behaviour amongst the patients suffering from this disease. A low-cost diagnostic needs to be developed for SZ so that timely treatment can be provided to the patients. In this work, we propose an accurate and easy-to-implement system to detect SZ using electroencephalogram (EEG) signals. The signal is divided into sub-band components by a Fourier-based technique that can be implemented in real-time using fast Fourier transform. Thereafter, statistical features are computed from these components. Further, look ahead pattern (LAP) is developed as a feature to capture local variations in the EEG signal. The fusion of these two distinct schemes enables a thorough examination of EEG signals. Kruskal-Wallis test is utilized for the selection of significant features. Various machine learning classifiers are employed and the proposed framework achieves 98.62% and 99.24% accuracy in identifying SZ cases, considering two distinct datasets, using boosted trees classifier. This method provides a promising candidate for widespread deployment in efficient real-time systems for SZ detection.
Collapse
Affiliation(s)
- Megha Agarwal
- Department of Electronics & Communication Engineering, Jaypee Institute of Information Technology, Noida, India.
| | - Amit Singhal
- Department of Electronics & Communication Engineering, Netaji Subhas University of Technology, Delhi, India.
| |
Collapse
|
29
|
Balasubramanian K, Ramya K, Gayathri Devi K. Optimized adaptive neuro-fuzzy inference system based on hybrid grey wolf-bat algorithm for schizophrenia recognition from EEG signals. Cogn Neurodyn 2023; 17:133-151. [PMID: 36704627 PMCID: PMC9871147 DOI: 10.1007/s11571-022-09817-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 03/23/2022] [Accepted: 04/27/2022] [Indexed: 02/01/2023] Open
Abstract
Schizophrenia is a chronic mental disorder that impairs a person's thinking capacity, feelings and emotions, behavioural traits, etc., Emotional distortions, delusions, hallucinations, and incoherent speech are all some of the symptoms of schizophrenia, and cause disruption of routine activities. Computer-assisted diagnosis of schizophrenia is significantly needed to give its patients a higher quality of life. Hence, an improved adaptive neuro-fuzzy inference system based on the Hybrid Grey Wolf-Bat Algorithm for accurate prediction of schizophrenia from multi-channel EEG signals is presented in this study. The EEG signals are pre-processed using a Butterworth band pass filter and wICA initially, from which statistical, time-domain, frequency-domain, and spectral features are extracted. Discriminating features are selected using the ReliefF algorithm and are then forwarded to ANFIS for classification into either schizophrenic or normal. ANFIS is optimized by the Hybrid Grey Wolf-Bat Algorithm (HWBO) for better efficiency. The method is experimented on two separate EEG datasets-1 and 2, demonstrating an accuracy of 99.54% and 99.35%, respectively, with appreciable F1-score and MCC. Further experiments reveal the efficiency of the Hybrid Wolf-Bat algorithm in optimizing the ANFIS parameters when compared with traditional ANFIS model and other proven algorithms like genetic algorithm-ANFIS, particle optimization-ANFIS, crow search optimization algorithm-ANFIS and ant colony optimization algorithm-ANFIS, showing high R2 value and low RSME value. To provide a bias free classification, tenfold cross validation is performed which produced an accuracy of 97.8% and 98.5% on the two datasets respectively. Experimental outcomes demonstrate the superiority of the Hybrid Grey Wolf-Bat Algorithm over the similar techniques in predicting schizophrenia.
Collapse
Affiliation(s)
| | - K. Ramya
- PA College of Engineering and Technology, Pollachi, India
| | | |
Collapse
|
30
|
Shor O, Yaniv-Rosenfeld A, Valevski A, Weizman A, Khrennikov A, Benninger F. EEG-based spatio-temporal relation signatures for the diagnosis of depression and schizophrenia. Sci Rep 2023; 13:776. [PMID: 36641536 PMCID: PMC9840633 DOI: 10.1038/s41598-023-28009-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 01/11/2023] [Indexed: 01/15/2023] Open
Abstract
The diagnosis of psychiatric disorders is currently based on a clinical and psychiatric examination (intake). Ancillary tests are used minimally or only to exclude other disorders. Here, we demonstrate a novel mathematical approach based on the field of p-adic numbers and using electroencephalograms (EEGs) to identify and differentiate patients with schizophrenia and depression from healthy controls. This novel approach examines spatio-temporal relations of single EEG electrode signals and characterizes the topological structure of these relations in the individual patient. Our results indicate that the relational topological structures, characterized by either the personal universal dendrographic hologram (DH) signature (PUDHS) or personal block DH signature (PBDHS), form a unique range for each group of patients, with impressive correspondence to the clinical condition. This newly developed approach results in an individual patient signature calculated from the spatio-temporal relations of EEG electrodes signals and might help the clinician with a new objective tool for the diagnosis of a multitude of psychiatric disorders.
Collapse
Affiliation(s)
- Oded Shor
- Felsenstein Medical Research Centre, Petach Tikva, Israel.
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Amit Yaniv-Rosenfeld
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
- Shalvata Mental Health Centre, Hod Hasharon, Israel
| | - Avi Valevski
- Geha Mental Health Centre, Petach Tikva, Israel
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Abraham Weizman
- Felsenstein Medical Research Centre, Petach Tikva, Israel
- Geha Mental Health Centre, Petach Tikva, Israel
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Andrei Khrennikov
- Faculty of Technology, Department of Mathematics, Linnaeus University, Vaxjö, Sweden
| | - Felix Benninger
- Felsenstein Medical Research Centre, Petach Tikva, Israel
- Department of Neurology, Rabin Medical Centre, Petach Tikva, Israel
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
31
|
Making movies of children's cortical electrical potentials: A practical procedure for dynamic source localization analysis with validating simulation. BRAIN MULTIPHYSICS 2023. [DOI: 10.1016/j.brain.2023.100064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2023] Open
|
32
|
Khayretdinova M, Shovkun A, Degtyarev V, Kiryasov A, Pshonkovskaya P, Zakharov I. Predicting age from resting-state scalp EEG signals with deep convolutional neural networks on TD-brain dataset. Front Aging Neurosci 2022; 14:1019869. [PMID: 36561135 PMCID: PMC9764861 DOI: 10.3389/fnagi.2022.1019869] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 11/02/2022] [Indexed: 12/12/2022] Open
Abstract
Introduction Brain age prediction has been shown to be clinically relevant, with errors in its prediction associated with various psychiatric and neurological conditions. While the prediction from structural and functional magnetic resonance imaging data has been feasible with high accuracy, whether the same results can be achieved with electroencephalography is unclear. Methods The current study aimed to create a new deep learning solution for brain age prediction using raw resting-state scalp EEG. To this end, we utilized the TD-BRAIN dataset, including 1,274 subjects (both healthy controls and individuals with various psychiatric disorders, with a total of 1,335 recording sessions). To achieve the best age prediction, we used data augmentation techniques to increase the diversity of the training set and developed a deep convolutional neural network model. Results The model's training was done with 10-fold cross-subject cross-validation, with the EEG recordings of the subjects used for training not considered to test the model. In training, using the relative rather than the absolute loss function led to a better mean absolute error of 5.96 years in cross-validation. We found that the best performance could be achieved when both eyes-open and eyes-closed states are used simultaneously. The frontocentral electrodes played the most important role in age prediction. Discussion The architecture and training method of the proposed deep convolutional neural networks (DCNN) improve state-of-the-art metrics in the age prediction task using raw resting-state EEG data by 13%. Given that brain age prediction might be a potential biomarker of numerous brain diseases, inexpensive and precise EEG-based estimation of brain age will be in demand for clinical practice.
Collapse
|
33
|
Prabhakar SK, Ju YG, Rajaguru H, Won DO. Sparse measures with swarm-based pliable hidden Markov model and deep learning for EEG classification. Front Comput Neurosci 2022; 16:1016516. [DOI: 10.3389/fncom.2022.1016516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Accepted: 10/10/2022] [Indexed: 11/17/2022] Open
Abstract
In comparison to other biomedical signals, electroencephalography (EEG) signals are quite complex in nature, so it requires a versatile model for feature extraction and classification. The structural information that prevails in the originally featured matrix is usually lost when dealing with standard feature extraction and conventional classification techniques. The main intention of this work is to propose a very novel and versatile approach for EEG signal modeling and classification. In this work, a sparse representation model along with the analysis of sparseness measures is done initially for the EEG signals and then a novel convergence of utilizing these sparse representation measures with Swarm Intelligence (SI) techniques based Hidden Markov Model (HMM) is utilized for the classification. The SI techniques utilized to compute the hidden states of the HMM are Particle Swarm Optimization (PSO), Differential Evolution (DE), Whale Optimization Algorithm (WOA), and Backtracking Search Algorithm (BSA), thereby making the HMM more pliable. Later, a deep learning methodology with the help of Convolutional Neural Network (CNN) was also developed with it and the results are compared to the standard pattern recognition classifiers. To validate the efficacy of the proposed methodology, a comprehensive experimental analysis is done over publicly available EEG datasets. The method is supported by strong statistical tests and theoretical analysis and results show that when sparse representation is implemented with deep learning, the highest classification accuracy of 98.94% is obtained and when sparse representation is implemented with SI-based HMM method, a high classification accuracy of 95.70% is obtained.
Collapse
|
34
|
Keihani A, Sajadi SS, Hasani M, Ferrarelli F. Bayesian Optimization of Machine Learning Classification of Resting-State EEG Microstates in Schizophrenia: A Proof-of-Concept Preliminary Study Based on Secondary Analysis. Brain Sci 2022; 12:1497. [PMID: 36358423 PMCID: PMC9688063 DOI: 10.3390/brainsci12111497] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Revised: 10/22/2022] [Accepted: 11/02/2022] [Indexed: 01/19/2024] Open
Abstract
Resting-state electroencephalography (EEG) microstates reflect sub-second, quasi-stable states of brain activity. Several studies have reported alterations of microstate features in patients with schizophrenia (SZ). Based on these findings, it has been suggested that microstates may represent neurophysiological biomarkers for the classification of SZ. To explore this possibility, machine learning approaches can be employed. Bayesian optimization is a machine learning approach that selects the best-fitted machine learning model with tuned hyperparameters from existing models to improve the classification. In this proof-of-concept preliminary study based on secondary analysis, 20 microstate features were extracted from 14 SZ patients and 14 healthy controls' EEG signals. These parameters were then ranked as predictors based on their importance, and an optimized machine learning approach was applied to evaluate the performance of the classification. SZ patients had altered microstate features compared to healthy controls. Furthermore, Bayesian optimization outperformed conventional multivariate analyses and showed the highest accuracy (90.93%), AUC (0.90), sensitivity (91.37%), and specificity (90.48%), with reliable results using just six microstate predictors. Altogether, in this proof-of-concept study, we showed that machine learning with Bayesian optimization can be utilized to characterize EEG microstate alterations and contribute to the classification of SZ patients.
Collapse
Affiliation(s)
- Ahmadreza Keihani
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Seyed Saman Sajadi
- Department of Medical Physics & Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran 1416634793, Iran
| | - Mahsa Hasani
- Institute of Medical Science and Technology, Shahid Beheshti University, Tehran 1985717443, Iran
| | - Fabio Ferrarelli
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA 15213, USA
| |
Collapse
|
35
|
Akter S, Prodhan RA, Pias TS, Eisenberg D, Fresneda Fernandez J. M1M2: Deep-Learning-Based Real-Time Emotion Recognition from Neural Activity. SENSORS (BASEL, SWITZERLAND) 2022; 22:8467. [PMID: 36366164 PMCID: PMC9654596 DOI: 10.3390/s22218467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 10/20/2022] [Accepted: 10/28/2022] [Indexed: 06/16/2023]
Abstract
Emotion recognition, or the ability of computers to interpret people's emotional states, is a very active research area with vast applications to improve people's lives. However, most image-based emotion recognition techniques are flawed, as humans can intentionally hide their emotions by changing facial expressions. Consequently, brain signals are being used to detect human emotions with improved accuracy, but most proposed systems demonstrate poor performance as EEG signals are difficult to classify using standard machine learning and deep learning techniques. This paper proposes two convolutional neural network (CNN) models (M1: heavily parameterized CNN model and M2: lightly parameterized CNN model) coupled with elegant feature extraction methods for effective recognition. In this study, the most popular EEG benchmark dataset, the DEAP, is utilized with two of its labels, valence, and arousal, for binary classification. We use Fast Fourier Transformation to extract the frequency domain features, convolutional layers for deep features, and complementary features to represent the dataset. The M1 and M2 CNN models achieve nearly perfect accuracy of 99.89% and 99.22%, respectively, which outperform every previous state-of-the-art model. We empirically demonstrate that the M2 model requires only 2 seconds of EEG signal for 99.22% accuracy, and it can achieve over 96% accuracy with only 125 milliseconds of EEG data for valence classification. Moreover, the proposed M2 model achieves 96.8% accuracy on valence using only 10% of the training dataset, demonstrating our proposed system's effectiveness. Documented implementation codes for every experiment are published for reproducibility.
Collapse
Affiliation(s)
- Sumya Akter
- Martin Tuchman School of Management, New Jersey Institute of Technology, Newark, NJ 07102, USA
| | - Rumman Ahmed Prodhan
- Martin Tuchman School of Management, New Jersey Institute of Technology, Newark, NJ 07102, USA
| | - Tanmoy Sarkar Pias
- Department of Computer Science, Virginia Tech, Blacksburg, VA 24061, USA
| | - David Eisenberg
- Department of Information Systems, Ying Wu College of Computing, New Jersey Institute of Technology, Newark, NJ 07102, USA
| | | |
Collapse
|
36
|
Huang J, Zhao Y, Qu W, Tian Z, Tan Y, Wang Z, Tan S. Automatic recognition of schizophrenia from facial videos using 3D convolutional neural network. Asian J Psychiatr 2022; 77:103263. [PMID: 36152565 DOI: 10.1016/j.ajp.2022.103263] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 08/22/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022]
Abstract
Schizophrenia affects patients and their families and society because of chronic impairments in cognition, behavior, and emotion. However, its clinical diagnosis mainly depends on the clinicians' knowledge of the patients' symptoms. Other auxiliary diagnostic methods such as MRI and EEG are cumbersome and time-consuming. Recently, the convolutional neural network (CNN) has been applied to the auxiliary diagnosis of psychiatry. Hence, in this study, a method based on deep learning and facial videos is proposed for the rapid detection of schizophrenia. Herein, 125 videos from 125 schizophrenic patients and 75 videos from 75 healthy controls based on emotional stimulation tasks were obtained. The video preprocessing included the experiment clips extraction, face detection, facial region cropping, resizing to 500 × 500 pixel size, and uniform sampling of 100 frames. The preprocessed facial videos were used to train the Resnet18_3D. We utilized ten-fold cross-validation, and held-out testing set to evaluate the model with the accuracy, the precision, the sensitivity, the specificity, the balanced accuracy, and the AUC. The Resnet18_3D trained on Film_order achieved the best performance with accuracy, sensitivity, specificity, balanced accuracy, and AUC of 89.00%, 96.80%, 76.00%, 86.40% and 0.9397. The neural network model indeed recognizes healthy controls and schizophrenic patients through the changes in the area of the face. The results show that facial video under emotional stimulation can be used to classify schizophrenic patients and help clinicians with diagnosis in the clinical environment. Among the different types of stimuli, the video stimuli with fixed emotional order showed the best classification performance.
Collapse
Affiliation(s)
- Jie Huang
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China
| | - Yanli Zhao
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China
| | - Wei Qu
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China
| | - Zhanxiao Tian
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China
| | - Yunlong Tan
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China
| | - Zhiren Wang
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China
| | - Shuping Tan
- Beijing HuiLongGuan Hospital, Peking University HuiLongGuan Clinical Medical School, Beijing, 100096, China.
| |
Collapse
|
37
|
Parija S, Sahani M, Bisoi R, Dash PK. Autoencoder-based improved deep learning approach for schizophrenic EEG signal classification. Pattern Anal Appl 2022. [DOI: 10.1007/s10044-022-01107-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
38
|
Siuly S, Li Y, Wen P, Alcin OF. SchizoGoogLeNet: The GoogLeNet-Based Deep Feature Extraction Design for Automatic Detection of Schizophrenia. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1992596. [PMID: 36120676 PMCID: PMC9477585 DOI: 10.1155/2022/1992596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 08/08/2022] [Indexed: 11/17/2022]
Abstract
Schizophrenia (SZ) is a severe and prolonged disorder of the human brain where people interpret reality in an abnormal way. Traditional methods of SZ detection are based on handcrafted feature extraction methods (manual process), which are tedious and unsophisticated, and also limited in their ability to balance efficiency and accuracy. To solve this issue, this study designed a deep learning-based feature extraction scheme involving the GoogLeNet model called "SchizoGoogLeNet" that can efficiently and automatically distinguish schizophrenic patients from healthy control (HC) subjects using electroencephalogram (EEG) signals with improved performance. The proposed framework involves multiple stages of EEG data processing. First, this study employs the average filtering method to remove noise and artifacts from the raw EEG signals to improve the signal-to-noise ratio. After that, a GoogLeNet model is designed to discover significant hidden features from denoised signals to identify schizophrenic patients from HC subjects. Finally, the obtained deep feature set is evaluated by the GoogleNet classifier and also some renowned machine learning classifiers to find a sustainable classification method for the obtained deep feature set. Experimental results show that the proposed deep feature extraction model with a support vector machine performs the best, producing a 99.02% correct classification rate for SZ, with an overall accuracy of 98.84%. Furthermore, our proposed model outperforms other existing methods. The proposed design is able to accurately discriminate SZ from HC, and it will be useful for developing a diagnostic tool for SZ detection.
Collapse
Affiliation(s)
- Siuly Siuly
- Institute for Sustainable Industries & Liveable Cities, Victoria University, Melbourne, Australia
| | - Yan Li
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, Australia
| | - Peng Wen
- School of Engineering, University of Southern Queensland, Toowoomba, Australia
| | - Omer Faruk Alcin
- Department of Electrical and Electronics Engineering, Turgut Ozal University, Malatya, Turkey
| |
Collapse
|
39
|
Magwai T, Oginga FO, Chiliza B, Mpofana T, Xulu KR. Genome-wide DNA methylation in an animal model and human studies of schizophrenia: a protocol for a meta-analysis. BMJ OPEN SCIENCE 2022; 6:e100264. [DOI: 10.1136/bmjos-2021-100264] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 07/25/2022] [Indexed: 11/03/2022] Open
Abstract
Introduction and objectiveNeuropsychiatric disorders like schizophrenia are heterogeneous in that they occur because of the interaction of factors. These factors include but are not limited to genetic, epigenetic, neurobiological and environmental factors. Methylation of DNA, like other erpigenetic modifications, is risk factors for neuropsychiatric disorders. Candidate gene approach projects have produced contradictory results to find candidate gene methylation. The current genome-wide studies have limitations.Search strategyAn exhaustive search strategy was designed to recover studies on genome-wide DNA methylation in schizophrenia patients or schizophrenia rat models. The Medline (PubMed), SCOPUS and Web of Science, databases were searched, giving 4077 references in total.Screening and annotationStudies will undergo two phases of screening, title and abstract screening and article screening, for inclusion by two reviewers. A third reviewer will resolve any disagreements in the article screening phase. Data will be collected using the Systematic Review Facility (http://syrf.org.uk/) tool. All included studies will undergo study quality and risk of bias assessment.Data management and reportingData will be extracted and used to calculate effect sizes. For the purpose of this meta-analysis, a random effects model will be used to combine effect sizes. Heterogeneity will be assessed, and the sources identified. A risk-of-bias assessment will be carried out to assess the quality of the studies. An assessment of publication bias will also be carried out.Ethics and disseminationNo ethical approval is required as there are no participants in the study. We will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines and disseminate the findings through publication and conference presentationPROSPERO registration numberCRD42021283159.
Collapse
|
40
|
EEG-Based Schizophrenia Diagnosis through Time Series Image Conversion and Deep Learning. ELECTRONICS 2022. [DOI: 10.3390/electronics11142265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Schizophrenia, a mental disorder experienced by more than 20 million people worldwide, is emerging as a serious issue in society. Currently, the diagnosis of schizophrenia is based only on mental disorder diagnosis and/or diagnosis by a psychiatrist or mental health professional using DSM-5, a diagnostic and statistical manual of mental disorders. Furthermore, patients in countries with insufficient access to healthcare are difficult to diagnose for schizophrenia and early diagnosis is even more problematic. While various studies are being conducted to solve the challenges of schizophrenia diagnosis, methodology is considered to be limited, and diagnostic accuracy needs to be improved. In this study, a new approach using EEG data and deep learning is proposed to increase objectivity and efficiency of schizophrenia diagnosis. Existing deep learning studies use EEG data to classify schizophrenic patients and healthy subjects by learning EEG in the form of graphs or tables. However, in this study, EEG, a time series data, was converted into an image to improve classification accuracy, and is then studied in deep learning models. This study used EEG data of 81 people, in which the difference in N100 EEG between schizophrenic patients and healthy patients had been analyzed in prior research. EEGs were converted into images using time series image conversion algorithms, Recurrence Plot (RP) and Gramian Angular Field (GAF), and converted EEG images were learned with Convolutional Neural Network (CNN) models built based on VGGNet. When the trained deep learning model was applied to the same data from prior research, it was demonstrated that classification accuracy improved when compared to previous studies. Among the two algorithms used for image conversion, the deep learning model that learned through GAF showed significantly higher classification accuracy. The results of this study suggest that the use of GAF and CNN models based on EEG results can be an effective way to increase objectivity and efficiency in diagnosing various mental disorders, including schizophrenia.
Collapse
|
41
|
Sadeghi D, Shoeibi A, Ghassemi N, Moridian P, Khadem A, Alizadehsani R, Teshnehlab M, Gorriz JM, Khozeimeh F, Zhang YD, Nahavandi S, Acharya UR. An overview of artificial intelligence techniques for diagnosis of Schizophrenia based on magnetic resonance imaging modalities: Methods, challenges, and future works. Comput Biol Med 2022; 146:105554. [DOI: 10.1016/j.compbiomed.2022.105554] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 04/11/2022] [Accepted: 04/11/2022] [Indexed: 12/21/2022]
|
42
|
Bagherzadeh S, Shahabi MS, Shalbaf A. Detection of schizophrenia using hybrid of deep learning and brain effective connectivity image from electroencephalogram signal. Comput Biol Med 2022; 146:105570. [DOI: 10.1016/j.compbiomed.2022.105570] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 04/14/2022] [Accepted: 04/25/2022] [Indexed: 02/06/2023]
|
43
|
Prabhakar SK, Rajaguru H, Kim C, Won DO. A Fusion-Based Technique With Hybrid Swarm Algorithm and Deep Learning for Biosignal Classification. Front Hum Neurosci 2022; 16:895761. [PMID: 35721347 PMCID: PMC9203681 DOI: 10.3389/fnhum.2022.895761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 05/02/2022] [Indexed: 12/02/2022] Open
Abstract
The vital data about the electrical activities of the brain are carried by the electroencephalography (EEG) signals. The recordings of the electrical activity of brain neurons in a rhythmic and spontaneous manner from the scalp surface are measured by EEG. One of the most important aspects in the field of neuroscience and neural engineering is EEG signal analysis, as it aids significantly in dealing with the commercial applications as well. To uncover the highly useful information for neural classification activities, EEG studies incorporated with machine learning provide good results. In this study, a Fusion Hybrid Model (FHM) with Singular Value Decomposition (SVD) Based Estimation of Robust Parameters is proposed for efficient feature extraction of the biosignals and to understand the essential information it has for analyzing the brain functionality. The essential features in terms of parameter components are extracted using the developed hybrid model, and a specialized hybrid swarm technique called Hybrid Differential Particle Artificial Bee (HDPAB) algorithm is proposed for feature selection. To make the EEG more practical and to be used in a plethora of applications, the robust classification of these signals is necessary thereby relying less on the trained professionals. Therefore, the classification is done initially using the proposed Zero Inflated Poisson Mixture Regression Model (ZIPMRM) and then it is also classified with a deep learning methodology, and the results are compared with other standard machine learning techniques. This proposed flow of methodology is validated on a few standard Biosignal datasets, and finally, a good classification accuracy of 98.79% is obtained for epileptic dataset and 98.35% is obtained for schizophrenia dataset.
Collapse
Affiliation(s)
- Sunil Kumar Prabhakar
- Department of Artificial Intelligence Convergence, Hallym University, Chuncheon, South Korea
| | - Harikumar Rajaguru
- Department of Electronics and Communication Engineering, Bannari Amman Institute of Technology, Sathyamangalam, India
| | - Chulho Kim
- Department of Neurology, Chuncheon Sacred Heart Hospital, Chuncheon, South Korea
| | - Dong-Ok Won
- Department of Artificial Intelligence Convergence, Hallym University, Chuncheon, South Korea
- *Correspondence: Dong-Ok Won,
| |
Collapse
|
44
|
Tanko D, Barua PD, Dogan S, Tuncer T, Palmer E, Ciaccio EJ, Acharya UR. EPSPatNet86: eight-pointed star pattern learning network for detection ADHD disorder using EEG signals. Physiol Meas 2022; 43. [PMID: 35377344 DOI: 10.1088/1361-6579/ac59dc] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 03/01/2022] [Indexed: 12/22/2022]
Abstract
Objective.The main objective of this work is to present a hand-modelled one-dimensional signal classification system to detect Attention-Deficit Hyperactivity Disorder (ADHD) disorder using electroencephalography (EEG) signals.Approach.A novel handcrafted feature extraction method is presented in this research. Our proposed method uses a directed graph and an eight-pointed star pattern (EPSPat). Also, tunable q wavelet transforms (TQWT), wavelet packet decomposition (WPD), statistical extractor, iterative Chi2 (IChi2) selector, and the k-nearest neighbors (kNN) classifier have been utilized to develop the EPSPat based learning model. This network uses two wavelet decomposition methods (TQWT and WPD), and 85 wavelet coefficient bands are extracted. The proposed EPSPat and statistical feature creator generate features from the 85 wavelet coefficient bands and the original EEG signal. The learning network is termed EPSPatNet86. The main purpose of the presented EPSPatNet86 is to detect abnormalities of the EEG signals. Therefore, 85 wavelet subbands have been generated to extract features. The created 86 feature vectors have been evaluated using the Chi2 selector and the kNN classifier in the loss value calculation phase. The final features vector is created by employing a minimum loss-valued eight feature vectors. The IChi2 selector selects the best feature vector, which is fed to the kNN classifier. An EEG signal dataset has been used to demonstrate the presented model's EEG signal classification ability. We have used an ADHD EEG dataset since ADHD is a commonly seen brain-related ailment.Main results.Our developed EPSPatNet86 model can detect the ADHD EEG signals with 97.19% and 87.60% accuracy using 10-fold cross and subject-wise validations, respectively.Significance.The calculated results demonstrate that the presented EPSPatNet86 attained satisfactory EEG classification ability. Results show that we can apply our developed EPSPatNet86 model to other EEG signal datasets to detect abnormalities.
Collapse
Affiliation(s)
- Dahiru Tanko
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey
| | - Prabal Datta Barua
- School of Management & Enterprise, University of Southern Queensland, Australia.,Faculty of Engineering and Information Technology, University of Technology Sydney, Australia.,Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
| | - Sengul Dogan
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey
| | - Turker Tuncer
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey
| | - Elizabeth Palmer
- Centre of Clinical Genetics, Sydney Children's Hospitals Network, Randwick 2031, Australia.,School of Women's and Children's Health, University of New South Wales, Randwick 2031, Australia
| | - Edward J Ciaccio
- Department of Medicine, Columbia University Irving Medical Center, United States of America
| | - U Rajendra Acharya
- Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, 599489, Singapore.,Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore.,Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
45
|
Loh HW, Xu S, Faust O, Ooi CP, Barua PD, Chakraborty S, Tan RS, Molinari F, Acharya UR. Application of photoplethysmography signals for healthcare systems: An in-depth review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 216:106677. [PMID: 35139459 DOI: 10.1016/j.cmpb.2022.106677] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 01/30/2022] [Accepted: 01/30/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVES Photoplethysmography (PPG) is a device that measures the amount of light absorbed by the blood vessel, blood, and tissues, which can, in turn, translate into various measurements such as the variation in blood flow volume, heart rate variability, blood pressure, etc. Hence, PPG signals can produce a wide variety of biological information that can be useful for the detection and diagnosis of various health problems. In this review, we are interested in the possible health disorders that can be detected using PPG signals. METHODS We applied PRISMA guidelines to systematically search various journal databases and identified 43 PPG studies that fit the criteria of this review. RESULTS Twenty-five health issues were identified from these studies that were classified into six categories: cardiac, blood pressure, sleep health, mental health, diabetes, and miscellaneous. Various routes were employed in these PPG studies to perform the diagnosis: machine learning, deep learning, and statistical routes. The studies were reviewed and summarized. CONCLUSIONS We identified limitations such as poor standardization of sampling frequencies and lack of publicly available PPG databases. We urge that future work should consider creating more publicly available databases so that a wide spectrum of health problems can be covered. We also want to promote the use of PPG signals as a potential precision medicine tool in both ambulatory and hospital settings.
Collapse
Affiliation(s)
- Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, Singapore
| | - Shuting Xu
- Cogninet Australia, Sydney, New South Wales 2010, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
| | - Oliver Faust
- Department of Engineering and Mathematics, Sheffield Hallam University, Sheffield S1 1WB, United Kingdom
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore
| | - Prabal Datta Barua
- Faculty of Engineering and Information Technology, University of Technology Sydney, Australia; School of Business (Information Systems), Faculty of Business, Education, Law and Arts, University of Southern Queensland, Australia
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia; Centre for Advanced Modelling and Geospatial lnformation Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
| | - Ru-San Tan
- Department of Cardiology, National Heart Centre Singapore, 169609, Singapore; Duke-NUS Medical School, 169857, Singapore
| | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, Italy
| | - U Rajendra Acharya
- School of Science and Technology, Singapore University of Social Sciences, Singapore; School of Business (Information Systems), Faculty of Business, Education, Law and Arts, University of Southern Queensland, Australia; School of Engineering, Ngee Ann Polytechnic, 535 Clementi Road, 599489, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taiwan; Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, Japan.
| |
Collapse
|
46
|
Sobahi N, Sengur A, Tan RS, Acharya UR. Attention-based 3D CNN with residual connections for efficient ECG-based COVID-19 detection. Comput Biol Med 2022; 143:105335. [PMID: 35219186 PMCID: PMC8858432 DOI: 10.1016/j.compbiomed.2022.105335] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 02/17/2022] [Accepted: 02/17/2022] [Indexed: 02/09/2023]
Abstract
BACKGROUND The world has been suffering from the COVID-19 pandemic since 2019. More than 5 million people have died. Pneumonia is caused by the COVID-19 virus, which can be diagnosed using chest X-ray and computed tomography (CT) scans. COVID-19 also causes clinical and subclinical cardiovascular injury that may be detected on electrocardiography (ECG), which is easily accessible. METHOD For ECG-based COVID-19 detection, we developed a novel attention-based 3D convolutional neural network (CNN) model with residual connections (RC). In this paper, the deep learning (DL) approach was developed using 12-lead ECG printouts obtained from 250 normal subjects, 250 patients with COVID-19 and 250 with abnormal heartbeat. For binary classification, the COVID-19 and normal classes were considered; and for multiclass classification, all classes. The ECGs were preprocessed into standard ECG lead segments that were channeled into 12-dimensional volumes as input to the network model. Our developed model comprised of 19 layers with three 3D convolutional, three batch normalization, three rectified linear unit, two dropouts, two additional (for residual connections), one attention, and one fully connected layer. The RC were used to improve gradient flow through the developed network, and attention layer, to connect the second residual connection to the fully connected layer through the batch normalization layer. RESULTS A publicly available dataset was used in this work. We obtained average accuracies of 99.0% and 92.0% for binary and multiclass classifications, respectively, using ten-fold cross-validation. Our proposed model is ready to be tested with a huge ECG database.
Collapse
Affiliation(s)
- Nebras Sobahi
- King Abdulaziz University, Department of Electrical and Computer Engineering, Jeddah, Saudi Arabia.
| | - Abdulkadir Sengur
- Firat University, Technology Faculty, Electrical and Electronics Engineering Department, Elazig, Turkey
| | - Ru-San Tan
- National Heart Centre Singapore, Singapore and Duke-NUS Medical School, Singapore
| | - U Rajendra Acharya
- Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, 599489, Singapore; Biomedical Engineering, School of Science and Technology, SUSS University, Singapore; Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
47
|
Korda A, Ventouras E, Asvestas P, Toumaian M, Matsopoulos G, Smyrnis N. Convolutional neural network propagation on electroencephalographic scalograms for detection of schizophrenia. Clin Neurophysiol 2022; 139:90-105. [DOI: 10.1016/j.clinph.2022.04.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 02/11/2022] [Accepted: 04/01/2022] [Indexed: 11/28/2022]
|
48
|
Aydemir E, Dogan S, Baygin M, Ooi CP, Barua PD, Tuncer T, Acharya UR. CGP17Pat: Automated Schizophrenia Detection Based on a Cyclic Group of Prime Order Patterns Using EEG Signals. Healthcare (Basel) 2022; 10:healthcare10040643. [PMID: 35455821 PMCID: PMC9027158 DOI: 10.3390/healthcare10040643] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/18/2022] [Accepted: 03/25/2022] [Indexed: 11/16/2022] Open
Abstract
Background and Purpose: Machine learning models have been used to diagnose schizophrenia. The main purpose of this research is to introduce an effective schizophrenia hand-modeled classification method. Method: A public electroencephalogram (EEG) signal data set was used in this work, and an automated schizophrenia detection model is presented using a cyclic group of prime order with a modulo 17 operator. Therefore, the presented feature extractor was named as the cyclic group of prime order pattern, CGP17Pat. Using the proposed CGP17Pat, a new multilevel feature extraction model is presented. To choose a highly distinctive feature, iterative neighborhood component analysis (INCA) was used, and these features were classified using k-nearest neighbors (kNN) with the 10-fold cross-validation and leave-one-subject-out (LOSO) validation techniques. Finally, iterative hard majority voting was employed in the last phase to obtain channel-wise results, and the general results were calculated. Results: The presented CGP17Pat-based EEG classification model attained 99.91% accuracy employing 10-fold cross-validation and 84.33% accuracy using the LOSO strategy. Conclusions: The findings and results depicted the high classification ability of the presented cryptologic pattern for the data set used.
Collapse
Affiliation(s)
- Emrah Aydemir
- Department of Management Information Systems, Management Faculty, Sakarya University, Sakarya 54050, Turkey;
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey;
- Correspondence: ; Tel.: +90-424-2370000-7634
| | - Mehmet Baygin
- Department of Computer Engineering, College of Engineering, Ardahan University, Ardahan 75000, Turkey;
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Prabal Datta Barua
- School of Business (Information System), University of Southern Queensland, Toowoomba, QLD 4350, Australia;
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey;
| | - U. Rajendra Acharya
- Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, Singapore 599489, Singapore;
- Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore 599491, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 413, Taiwan
| |
Collapse
|
49
|
Using Artificial Neural Network for System Education Eye Disease Recognition Web-Based. JOURNAL OF BIOMIMETICS BIOMATERIALS AND BIOMEDICAL ENGINEERING 2022. [DOI: 10.4028/p-7z9xpt] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
According to Vision Indonesia, data on people with eye diseases in Indonesia in 2018-2019 were 3 million people or about 1.5% of the total population. So far, public information or knowledge about the recognition of eye disease disorders is still lacking. The problem in this study is how to educate the public about the introduction of eye diseases based on information on symptoms of the disease and how to apply the web-based Artificial Neural Network (ANN) algorithm for the introduction of eye diseases. The ANN algorithm in the eye disease recognition education system can conclude knowledge even though it does not have certainty and takes it into account sequentially so that the process is faster. In terms of educational content about eye disease recognition, this is a novelty to use. This research aims to create an educational system for introducing eye diseases based on information on symptoms of the disease and applying a web-based Artificial Neural Network (ANN) algorithm for the recognition of eye diseases. The method used is the Artificial Neural Network algorithm method. The work of ANN in the education system for the introduction of eye diseases is to make parameters of eye disease symptoms or indicators that will produce the type of eye disease. The research material used is data on types of eye diseases and symptoms of each type of eye disease. The research results are to create an education system that can help the public recognise eye diseases based on the symptoms of these eye diseases that can be run on a web platform. The Artificial Neural Network (ANN) algorithm can manage input analysis data from disease indicators and show the initial results of eye diseases that can be detected. suffered by someone based on Training Results Weights and Bias v11= 1.6769, v01= 0.4356, w11= -1.5233, w01= 0.3242. Based on white box testing, the test results are free from logical errors. The results of this study indicate that the use of the ANN algorithm for eye disease recognition shows accurate results based on eye disease symptom data.
Collapse
|
50
|
Fractal Nature Bridge between Neural Networks and Graph Theory Approach within Material Structure Characterization. FRACTAL AND FRACTIONAL 2022. [DOI: 10.3390/fractalfract6030134] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Many recently published research papers examine the representation of nanostructures and biomimetic materials, especially using mathematical methods. For this purpose, it is important that the mathematical method is simple and powerful. Theory of fractals, artificial neural networks and graph theory are most commonly used in such papers. These methods are useful tools for applying mathematics in nanostructures, especially given the diversity of the methods, as well as their compatibility and complementarity. The purpose of this paper is to provide an overview of existing results in the field of electrochemical and magnetic nanostructures parameter modeling by applying the three methods that are “easy to use”: theory of fractals, artificial neural networks and graph theory. We also give some new conclusions about applicability, advantages and disadvantages in various different circumstances.
Collapse
|