1
|
Huang Q, Ding J, Wang X. A Method to Extract Task-Related EEG Feature Based on Lightweight Convolutional Neural Network. Neurosci Bull 2024:10.1007/s12264-024-01247-6. [PMID: 38956006 DOI: 10.1007/s12264-024-01247-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 03/07/2024] [Indexed: 07/04/2024] Open
Abstract
Unlocking task-related EEG spectra is crucial for neuroscience. Traditional convolutional neural networks (CNNs) effectively extract these features but face limitations like overfitting due to small datasets. To address this issue, we propose a lightweight CNN and assess its interpretability through the fully connected layer (FCL). Initially tested with two tasks (Task 1: open vs closed eyes, Task 2: interictal vs ictal stage), the CNN demonstrated enhanced spectral features in the alpha band for Task 1 and the theta band for Task 2, aligning with established neurophysiological characteristics. Subsequent experiments on two brain-computer interface tasks revealed a correlation between delta activity (around 1.55 Hz) and hand movement, with consistent results across pericentral electroencephalogram (EEG) channels. Compared to recent research, our method stands out by delivering task-related spectral features through FCL, resulting in significantly fewer trainable parameters while maintaining comparable interpretability. This indicates its potential suitability for a wider array of EEG decoding scenarios.
Collapse
Affiliation(s)
- Qi Huang
- Department of Neurology, Zhongshan Hospital, Fudan University, Shanghai, 200032, China
| | - Jing Ding
- Department of Neurology, Zhongshan Hospital, Fudan University, Shanghai, 200032, China.
| | - Xin Wang
- Department of Neurology, Zhongshan Hospital, Fudan University, Shanghai, 200032, China.
- Department of the State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Institutes of Brain Science, Fudan University, Shanghai, 200032, China.
| |
Collapse
|
2
|
A novel approach based on wavelet analysis and arithmetic coding for automated detection and diagnosis of epileptic seizure in EEG signals using machine learning techniques. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101707] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
3
|
Kasatkin DS, Bogomolov YV, Spirin NN. [Steps to personalized therapy of multiple sclerosis: predicting safety of treatment using mathematical modeling]. Zh Nevrol Psikhiatr Im S S Korsakova 2019; 118:70-76. [PMID: 30160671 DOI: 10.17116/jnevro201811808270] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
AIM To construct a mathematical model capable of predicting the drug safety of a patient receiving multiple sclerosis disease modifying drugs (DMD), on a model of flu-like syndrome (FLS). MATERIAL AND METHODS The study included 457 patients with multiple sclerosis (MS), aged from 18 to 68 years, mean 38.79 years, the mean duration of disease 122.58 months. All patients received first-line injections drug (interferon-beta). The sample included data from a three-year prospective dynamic observation with a frequency of observation of 1 every 6 months, with only the data of those examinations for which the presence or absence of FLS was known for the next 6 months (1203 cases). At the first step, the frequency of factors in the compared groups using the W Wald-Wolkovitz test, then the prognostic coefficients (PC) and the Kulbak informativity coefficient (CI) were calculated for each factor gradation. To determine the predictive ability of signs, the Spearman's R criterion was used. At the second step, a model of a two-layer neural network was constructed based on the data obtained. RESULTS A simple static model and algorithm were developed to assess the risks of the onset and persistence of FLS during the next 6 months of interferon beta therapy. An attempt was also made to create an active model using neural network technology. Both models showed good sensitivity and specificity - 81.2% and 80.6% for the neural network, and 73.4 and 71.6% for the static model. CONCLUSION Using of these algorithms allows to significantly increase the possibility of predicting the occurrence of AE at the time of drug prescribing. From the mathematical point of view, for the first time the mechanism and possibilities of using a neural network in conditions of incomplete initial information were determined.
Collapse
Affiliation(s)
- D S Kasatkin
- Yaroslavl State Medical University, Yaroslavl, Russia
| | | | - N N Spirin
- Yaroslavl State Medical University, Yaroslavl, Russia
| |
Collapse
|
4
|
Tarkhaneh O, Shen H. Training of feedforward neural networks for data classification using hybrid particle swarm optimization, Mantegna Lévy flight and neighborhood search. Heliyon 2019; 5:e01275. [PMID: 30993220 PMCID: PMC6449775 DOI: 10.1016/j.heliyon.2019.e01275] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2018] [Revised: 01/08/2019] [Accepted: 02/20/2019] [Indexed: 11/17/2022] Open
Abstract
Artificial Neural networks (ANNs) are often applied to data classification problems. However, training ANNs remains a challenging task due to the large and high dimensional nature of search space particularly in the process of fine-tuning the best set of control parameters in terms of weight and bias. Evolutionary algorithms are proved to be a reliable optimization method for training the parameters. While a number of conventional training algorithms have been proposed and applied to various applications, most of them share the common disadvantages of local optima stagnation and slow convergence. In this paper, we propose a new evolutionary training algorithm referred to as LPSONS, which combines the velocity operators in Particle Swarm Optimization (PSO) with Mantegna Lévy distribution to produce more diverse solutions by dividing the population and generation between different sections of the algorithm. It further combines Neighborhood Search with Mantegna Lévy distribution to mitigate premature convergence and avoid local minima. The proposed algorithm can find optimal results and at the same time avoid stagnation in local optimum solutions as well as prevent premature convergence in training Feedforward Multi-Layer Perceptron (MLP) ANNs. Experiments with fourteen standard datasets from UCI machine learning repository confirm that the LPSONS algorithm significantly outperforms a gradient-based approach as well as some well-known evolutionary algorithms that are also based on enhancing PSO.
Collapse
Affiliation(s)
- Omid Tarkhaneh
- Department of Computer Science, University of Tabriz, Tabriz, Iran
| | - Haifeng Shen
- Peter Faber Business School, Australian Catholic University, Australia
| |
Collapse
|
5
|
González-Durruthy M, Monserrat JM, Rasulev B, Casañola-Martín GM, Barreiro Sorrivas JM, Paraíso-Medina S, Maojo V, González-Díaz H, Pazos A, Munteanu CR. Carbon Nanotubes' Effect on Mitochondrial Oxygen Flux Dynamics: Polarography Experimental Study and Machine Learning Models using Star Graph Trace Invariants of Raman Spectra. NANOMATERIALS 2017; 7:nano7110386. [PMID: 29137126 PMCID: PMC5707603 DOI: 10.3390/nano7110386] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2017] [Revised: 11/06/2017] [Accepted: 11/08/2017] [Indexed: 11/16/2022]
Abstract
This study presents the impact of carbon nanotubes (CNTs) on mitochondrial oxygen mass flux (Jm) under three experimental conditions. New experimental results and a new methodology are reported for the first time and they are based on CNT Raman spectra star graph transform (spectral moments) and perturbation theory. The experimental measures of Jm showed that no tested CNT family can inhibit the oxygen consumption profiles of mitochondria. The best model for the prediction of Jm for other CNTs was provided by random forest using eight features, obtaining test R-squared (R2) of 0.863 and test root-mean-square error (RMSE) of 0.0461. The results demonstrate the capability of encoding CNT information into spectral moments of the Raman star graphs (SG) transform with a potential applicability as predictive tools in nanotechnology and material risk assessments.
Collapse
Affiliation(s)
- Michael González-Durruthy
- Institute of Biological Science (ICB), Federal University of Rio Grande, Rio Grande, RS 96270-900, Brazil.
| | - Jose M Monserrat
- Institute of Biological Science (ICB), Federal University of Rio Grande, Rio Grande, RS 96270-900, Brazil.
| | - Bakhtiyor Rasulev
- Department of Coatings and Polymeric Materials, North Dakota State University (NDSU), Fargo, ND 58102, USA.
| | | | - José María Barreiro Sorrivas
- Computer Science School (ETSIINF), Polytechnic University of Madrid (UPM), Calle de losCiruelos, Boadilla del Monte, 28660 Madrid, Spain.
| | - Sergio Paraíso-Medina
- Biomedical Informatics Group, Artificial Intelligence Department, Polytechnic University of Madrid, Calle de los Ciruelos, Boadilla del Monte, 28660 Madrid, Spain.
| | - Víctor Maojo
- Biomedical Informatics Group, Artificial Intelligence Department, Polytechnic University of Madrid, Calle de los Ciruelos, Boadilla del Monte, 28660 Madrid, Spain.
| | - Humberto González-Díaz
- Department of Organic Chemistry II, University of the Basque Country UPV/EHU, 48940 Leioa, Biscay, Spain.
- IKERBASQUE, Basque Foundation for Science, 48011 Bilbao, Biscay, Spain.
| | - Alejandro Pazos
- INIBIC Institute of Biomedical Research, CHUAC, UDC, 15006 Coruña, Spain.
- RNASA-IMEDIR, Computer Sciences Faculty, University of Coruña, 15071 Coruña, Spain.
| | - Cristian R Munteanu
- INIBIC Institute of Biomedical Research, CHUAC, UDC, 15006 Coruña, Spain.
- RNASA-IMEDIR, Computer Sciences Faculty, University of Coruña, 15071 Coruña, Spain.
| |
Collapse
|
6
|
González-Durruthy M, Alberici LC, Curti C, Naal Z, Atique-Sawazaki DT, Vázquez-Naya JM, González-Díaz H, Munteanu CR. Experimental-Computational Study of Carbon Nanotube Effects on Mitochondrial Respiration: In Silico Nano-QSPR Machine Learning Models Based on New Raman Spectra Transform with Markov-Shannon Entropy Invariants. J Chem Inf Model 2017; 57:1029-1044. [PMID: 28414908 DOI: 10.1021/acs.jcim.6b00458] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
The study of selective toxicity of carbon nanotubes (CNTs) on mitochondria (CNT-mitotoxicity) is of major interest for future biomedical applications. In the current work, the mitochondrial oxygen consumption (E3) is measured under three experimental conditions by exposure to pristine and oxidized CNTs (hydroxylated and carboxylated). Respiratory functional assays showed that the information on the CNT Raman spectroscopy could be useful to predict structural parameters of mitotoxicity induced by CNTs. The in vitro functional assays show that the mitochondrial oxidative phosphorylation by ATP-synthase (or state V3 of respiration) was not perturbed in isolated rat-liver mitochondria. For the first time a star graph (SG) transform of the CNT Raman spectra is proposed in order to obtain the raw information for a nano-QSPR model. Box-Jenkins and perturbation theory operators are used for the SG Shannon entropies. A modified RRegrs methodology is employed to test four regression methods such as multiple linear regression (LM), partial least squares regression (PLS), neural networks regression (NN), and random forest (RF). RF provides the best models to predict the mitochondrial oxygen consumption in the presence of specific CNTs with R2 of 0.998-0.999 and RMSE of 0.0068-0.0133 (training and test subsets). This work is aimed at demonstrating that the SG transform of Raman spectra is useful to encode CNT information, similarly to the SG transform of the blood proteome spectra in cancer or electroencephalograms in epilepsy and also as a prospective chemoinformatics tool for nanorisk assessment. All data files and R object models are available at https://dx.doi.org/10.6084/m9.figshare.3472349 .
Collapse
Affiliation(s)
| | | | | | | | | | - José M Vázquez-Naya
- RNASA-IMEDIR, Computer Science Faculty, University of A Coruna , Campus de Elviña s/n, 15071 A Coruña, Spain
| | - Humberto González-Díaz
- Department of Organic Chemistry II, Faculty of Science and Technology, University of the Basque Country UPV/EHU , 48940, Leioa, Bizkaia, Spain.,IKERBASQUE, Basque Foundation for Science , 48011, Bilbao, Bizkaia, Spain
| | - Cristian R Munteanu
- RNASA-IMEDIR, Computer Science Faculty, University of A Coruna , Campus de Elviña s/n, 15071 A Coruña, Spain.,Instituto de Investigación Biomédica de A Coruña (INIBIC), Complexo Hospitalario Universitario de A Coruña (CHUAC) , A Coruña, 15006, Spain
| |
Collapse
|
7
|
Faris H, Aljarah I, Al-Madi N, Mirjalili S. Optimizing the Learning Process of Feedforward Neural Networks Using Lightning Search Algorithm. INT J ARTIF INTELL T 2016. [DOI: 10.1142/s0218213016500330] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Evolutionary Neural Networks are proven to be beneficial in solving challenging datasets mainly due to the high local optima avoidance. Stochastic operators in such techniques reduce the probability of stagnation in local solutions and assist them to supersede conventional training algorithms such as Back Propagation (BP) and Levenberg-Marquardt (LM). According to the No-Free-Lunch (NFL), however, there is no optimization technique for solving all optimization problems. This means that a Neural Network trained by a new algorithm has the potential to solve a new set of problems or outperform the current techniques in solving existing problems. This motivates our attempts to investigate the efficiency of the recently proposed Evolutionary Algorithm called Lightning Search Algorithm (LSA) in training Neural Network for the first time in the literature. The LSA-based trainer is benchmarked on 16 popular medical diagnosis problems and compared to BP, LM, and 6 other evolutionary trainers. The quantitative and qualitative results show that the LSA algorithm is able to show not only better local solutions avoidance but also faster convergence speed compared to the other algorithms employed. In addition, the statistical test conducted proves that the LSA-based trainer is significantly superior in comparison with the current algorithms on the majority of datasets.
Collapse
Affiliation(s)
- Hossam Faris
- Business Information Technology Department, King Abdullah II School for Information Technology, The University of Jordan, Amman, Jordan
| | - Ibrahim Aljarah
- Business Information Technology Department, King Abdullah II School for Information Technology, The University of Jordan, Amman, Jordan
| | - Nailah Al-Madi
- The King Hussein Faculty of Computing Sciences, Princess Sumaya University for Technology, Amman, Jordan
| | - Seyedali Mirjalili
- School of Information and Communication Technology, Griffith University, Nathan, Brisbane, QLD 4111, Australia
| |
Collapse
|
8
|
Automated detection of epileptic EEGs using a novel fusion feature and extreme learning machine. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.10.070] [Citation(s) in RCA: 64] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
9
|
Smart O, Burrell L. Genetic Programming and Frequent Itemset Mining to Identify Feature Selection Patterns of iEEG and fMRI Epilepsy Data. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2015; 39:198-214. [PMID: 25580059 PMCID: PMC4285716 DOI: 10.1016/j.engappai.2014.12.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Pattern classification for intracranial electroencephalogram (iEEG) and functional magnetic resonance imaging (fMRI) signals has furthered epilepsy research toward understanding the origin of epileptic seizures and localizing dysfunctional brain tissue for treatment. Prior research has demonstrated that implicitly selecting features with a genetic programming (GP) algorithm more effectively determined the proper features to discern biomarker and non-biomarker interictal iEEG and fMRI activity than conventional feature selection approaches. However for each the iEEG and fMRI modalities, it is still uncertain whether the stochastic properties of indirect feature selection with a GP yield (a) consistent results within a patient data set and (b) features that are specific or universal across multiple patient data sets. We examined the reproducibility of implicitly selecting features to classify interictal activity using a GP algorithm by performing several selection trials and subsequent frequent itemset mining (FIM) for separate iEEG and fMRI epilepsy patient data. We observed within-subject consistency and across-subject variability with some small similarity for selected features, indicating a clear need for patient-specific features and possible need for patient-specific feature selection or/and classification. For the fMRI, using nearest-neighbor classification and 30 GP generations, we obtained over 60% median sensitivity and over 60% median selectivity. For the iEEG, using nearest-neighbor classification and 30 GP generations, we obtained over 65% median sensitivity and over 65% median selectivity except one patient.
Collapse
Affiliation(s)
- Otis Smart
- Corresponding author: Otis Smart, PhD, Department of Neurosurgery, Emory University School of Medicine, Woodruff Memorial Research Building, 101 Woodruff Circle, Room 6329, Atlanta, GA 30322, USA, , 404.423.8503 (phone), 404.712.8576 (fax)
| | - Lauren Burrell
- Intelligent Control Systems Laboratory, Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332
| |
Collapse
|
10
|
|