1
|
Nilashi M, Abumalloh RA, Ahmadi H, Samad S, Alghamdi A, Alrizq M, Alyami S, Nayer FK. Electroencephalography (EEG) eye state classification using learning vector quantization and bagged trees. Heliyon 2023; 9:e15258. [PMID: 37101630 PMCID: PMC10123194 DOI: 10.1016/j.heliyon.2023.e15258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 03/30/2023] [Accepted: 03/31/2023] [Indexed: 04/08/2023] Open
Abstract
The analysis of Electroencephalography (EEG) signals has been an effective way of eye state identification. Its significance is highlighted by studies that examined the classification of eye states using machine learning techniques. In previous studies, supervised learning techniques have been widely used in EEG signals analysis for eye state classification. Their main goal has been the improvement of classification accuracy through the use of novel algorithms. The trade-off between classification accuracy and computation complexity is an important task in EEG signals analysis. In this paper, a hybrid method that can handle multivariate signals and non-linear is proposed with supervised and un-supervised learning to achieve a fast EEG eye state classification with high prediction accuracy to provide real-time decision-making applicability. We use the Learning Vector Quantization (LVQ) technique and bagged tree techniques. The method was evaluated on a real-world EEG dataset which included 14976 instances after the removal of outlier instances. Using LVQ, 8 clusters were generated from the data. The bagged tree was applied on 8 clusters and compared with other classifiers. Our experiments revealed that LVQ combined with the bagged tree provides the best results (Accuracy = 0.9431) compared with the bagged tree, CART (Classification And Regression Tree) (Accuracy = 0.8200), LDA (Linear Discriminant Analysis) (Accuracy = 0.7931), Random Trees (Accuracy = 0.8311), Naïve Bayes (Accuracy = 0.8331) and Multilayer Perceptron (Accuracy = 0.7718), which demonstrates the effectiveness of incorporating ensemble learning and clustering approaches in the analysis of EEG signals. We also provided the time complexity of the methods for prediction speed (Observation/Second). The result showed that LVQ + Bagged Tree provides the best result for prediction speed (58942 Obs/Sec) in relation to Bagged Tree (28453 Obs/Sec), CART (27784 Obs/Sec), LDA (26435 Obs/Sec), Random Trees (27921), Naïve Bayes (27217) and Multilayer Perceptron (24163).
Collapse
|
2
|
Pan H, Li Z, Tian C, Wang L, Fu Y, Qin X, Liu F. The LightGBM-based classification algorithm for Chinese characters speech imagery BCI system. Cogn Neurodyn 2023; 17:373-384. [PMID: 37007202 PMCID: PMC10050290 DOI: 10.1007/s11571-022-09819-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 03/26/2022] [Accepted: 04/09/2022] [Indexed: 11/03/2022] Open
Abstract
Brain-computer interface (BCI) can obtain text information by decoding language induced electroencephalogram (EEG) signals, so as to restore communication ability for patients with language impairment. At present, the BCI system based on speech imagery of Chinese characters has the problem of low accuracy of features classification. In this paper, the light gradient boosting machine (LightGBM) is adopted to recognize Chinese characters and solve the above problems. Firstly, the Db4 wavelet basis function is selected to decompose the EEG signals in six-layer of full frequency band, and the correlation features of Chinese characters speech imagery with high time resolution and high frequency resolution are extracted. Secondly, the two core algorithms of LightGBM, gradient-based one-side sampling and exclusive feature bundling, are used to classify the extracted features. Finally, we verify that classification performance of LightGBM is more accurate and applicable than the traditional classifiers according to the statistical analysis methods. We evaluate the proposed method through contrast experiment. The experimental results show that the average classification accuracy of the subjects' silent reading of Chinese characters "(left)", "(one)" and simultaneous silent reading is improved by 5.24%, 4.90% and 12.44% respectively.
Collapse
Affiliation(s)
- Hongguang Pan
- College of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an, 710054 Shaanxi China
| | - Zhuoyi Li
- College of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an, 710054 Shaanxi China
| | - Chen Tian
- Shaanxi Broadcasting Corporation, Xi’an, 710061 Shaanxi China
| | - Li Wang
- School of Electronics and Communication Engineering, Guangzhou University, Guangzhou, 510006 Guangdong China
| | - Yunpeng Fu
- College of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an, 710054 Shaanxi China
| | - Xuebin Qin
- College of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an, 710054 Shaanxi China
| | - Fei Liu
- College of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an, 710054 Shaanxi China
| |
Collapse
|
3
|
Khan DM, Yahya N, Kamel N, Faye I. A novel method for efficient estimation of brain effective connectivity in EEG. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 228:107242. [PMID: 36423484 DOI: 10.1016/j.cmpb.2022.107242] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 09/20/2022] [Accepted: 11/09/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND AND OBJECTIVE Brain connectivity plays a pivotal role in understanding the brain's information processing functions by providing various details including magnitude, direction, and temporal dynamics of inter-neuron connections. While the connectivity may be classified as structural, functional and causal, a complete in-vivo directional analysis is guaranteed by the latter and is referred to as Effective Connectivity (EC). Two most widely used EC techniques are Directed Transfer Function (DTF) and Partial Directed Coherence (PDC) which are based on multivariate autoregressive models. The drawbacks of these techniques include poor frequency resolution and the requirement for experimental approach to determine signal normalization and thresholding techniques in identifying significant connectivities between multivariate sources. METHODS In this study, the drawbacks of DTF and PDC are addressed by proposing a novel technique, termed as Efficient Effective Connectivity (EEC), for the estimation of EC between multivariate sources using AR spectral estimation and Granger causality principle. In EEC, a linear predictive filter with AR coefficients obtained via multivariate EEG is used for signal prediction. This leads to the estimation of full-length signals which are then transformed into frequency domain by using Burg spectral estimation method. Furthermore, the newly proposed normalization method addressed the effect on each source in EEC using the sum of maximum connectivity values over the entire frequency range. Lastly, the proposed dynamic thresholding works by subtracting the first moment of causal effects of all the sources on one source from individual connections present for that source. RESULTS The proposed method is evaluated using synthetic and real resting-state EEG of 46 healthy controls. A 3D-Convolutional Neural Network is trained and tested using the PDC and EEC samples. The result indicates that compared to PDC, EEC improves the EEG eye-state classification accuracy, sensitivity and specificity by 5.57%, 3.15% and 8.74%, respectively. CONCLUSION Correct identification of all connections in synthetic data and improved resting-state classification performance using EEC proved that EEC gives better estimation of directed causality and indicates that it can be used for reliable understanding of brain mechanisms. Conclusively, the proposed technique may open up new research dimensions for clinical diagnosis of mental disorders.
Collapse
Affiliation(s)
- Danish M Khan
- Centre for Intelligent Signal & Imaging Research (CISIR), Electrical & Electronic Engineering Department, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 32610, Perak, Malaysia; Department of Telecommunications Engineering, NED University of Engineering & Technology, University Road, Karachi 75270, Pakistan.
| | - Norashikin Yahya
- Centre for Intelligent Signal & Imaging Research (CISIR), Electrical & Electronic Engineering Department, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 32610, Perak, Malaysia.
| | - Nidal Kamel
- Centre for Intelligent Signal & Imaging Research (CISIR), Electrical & Electronic Engineering Department, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 32610, Perak, Malaysia; VinUniversity, College of Engineering and Computer Science, Vinhomes Ocean Park, Gia Lam District, Hanoi, Vietnam
| | - Ibrahima Faye
- Centre for Intelligent Signal & Imaging Research (CISIR), Electrical & Electronic Engineering Department, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 32610, Perak, Malaysia
| |
Collapse
|
4
|
Mattiev J, Sajovic J, Drevenšek G, Rogelj P. Assessment of Model Accuracy in Eyes Open and Closed EEG Data: Effect of Data Pre-Processing and Validation Methods. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 10:bioengineering10010042. [PMID: 36671614 PMCID: PMC9854523 DOI: 10.3390/bioengineering10010042] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 12/21/2022] [Accepted: 12/25/2022] [Indexed: 12/31/2022]
Abstract
Eyes open and eyes closed data is often used to validate novel human brain activity classification methods. The cross-validation of models trained on minimally preprocessed data is frequently utilized, regardless of electroencephalography data comprised of data resulting from muscle activity and environmental noise, affecting classification accuracy. Moreover, electroencephalography data of a single subject is often divided into smaller parts, due to limited availability of large datasets. The most frequently used method for model validation is cross-validation, even though the results may be affected by overfitting to the specifics of brain activity of limited subjects. To test the effects of preprocessing and classifier validation on classification accuracy, we tested fourteen classification algorithms implemented in WEKA and MATLAB, tested on comprehensively and simply preprocessed electroencephalography data. Hold-out and cross-validation were used to compare the classification accuracy of eyes open and closed data. The data of 50 subjects, with four minutes of data with eyes closed and open each was used. The algorithms trained on simply preprocessed data were superior to the ones trained on comprehensively preprocessed data in cross-validation testing. The reverse was true when hold-out accuracy was examined. Significant increases in hold-out accuracy were observed if the data of different subjects was not strictly separated between the test and training datasets, showing the presence of overfitting. The results show that comprehensive data preprocessing can be advantageous for subject invariant classification, while higher subject-specific accuracy can be attained with simple preprocessing. Researchers should thus state the final intended use of their classifier.
Collapse
Affiliation(s)
- Jamolbek Mattiev
- Department of Information Technologies, Urgench State University, Khamid Alimdjan 14, Urgench 220100, Uzbekistan
- Correspondence:
| | - Jakob Sajovic
- Department of Orthodontics, University Medical Centre Ljubljana, Hrvatski trg 6, 1000 Ljubljana, Slovenia
- Faculty of Medicine, University of Ljubljana, Korytkova 2, 1000 Ljubljana, Slovenia
| | - Gorazd Drevenšek
- Faculty of Medicine, University of Ljubljana, Korytkova 2, 1000 Ljubljana, Slovenia
- Faculty of Mathematics, Natural Sciences and Information Technologies, University of Primorska, Glagoljaška 8, 6000 Koper, Slovenia
| | - Peter Rogelj
- Faculty of Mathematics, Natural Sciences and Information Technologies, University of Primorska, Glagoljaška 8, 6000 Koper, Slovenia
| |
Collapse
|
5
|
Hernández-Álvarez L, Barbierato E, Caputo S, Mucchi L, Hernández Encinas L. EEG Authentication System Based on One- and Multi-Class Machine Learning Classifiers. SENSORS (BASEL, SWITZERLAND) 2022; 23:186. [PMID: 36616785 PMCID: PMC9823500 DOI: 10.3390/s23010186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 12/15/2022] [Accepted: 12/20/2022] [Indexed: 06/17/2023]
Abstract
In the current Information Age, it is usual to access our personal and professional information, such as bank account data or private documents, in a telematic manner. To ensure the privacy of this information, user authentication systems should be accurately developed. In this work, we focus on biometric authentication, as it depends on the user's inherent characteristics and, therefore, offers personalized authentication systems. Specifically, we propose an electrocardiogram (EEG)-based user authentication system by employing One-Class and Multi-Class Machine Learning classifiers. In this sense, the main novelty of this article is the introduction of Isolation Forest and Local Outlier Factor classifiers as new tools for user authentication and the investigation of their suitability with EEG data. Additionally, we identify the EEG channels and brainwaves with greater contribution to the authentication and compare them with the traditional dimensionality reduction techniques, Principal Component Analysis, and χ2 statistical test. In our final proposal, we elaborate on a hybrid system resistant to random forgery attacks using an Isolation Forest and a Random Forest classifiers, obtaining a final accuracy of 82.3%, a precision of 91.1% and a recall of 75.3%.
Collapse
Affiliation(s)
- Luis Hernández-Álvarez
- Computer Security Lab, Universidad Carlos III de Madrid, 28911 Leganés, Spain
- Institute of Physical and Information Technologies, Spanish National Research Council, 28006 Madrid, Spain
| | - Elena Barbierato
- Department of Agriculture, Food, Environment and Forestry, University of Florence, 50144 Firenze, Italy
| | - Stefano Caputo
- Department of Information Engineering, University of Florence, 50139 Firenze, Italy
| | - Lorenzo Mucchi
- Department of Information Engineering, University of Florence, 50139 Firenze, Italy
| | - Luis Hernández Encinas
- Institute of Physical and Information Technologies, Spanish National Research Council, 28006 Madrid, Spain
| |
Collapse
|
6
|
Sharma A, Mishra PK. Image enhancement techniques on deep learning approaches for automated diagnosis of COVID-19 features using CXR images. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:42649-42690. [PMID: 35938148 PMCID: PMC9340712 DOI: 10.1007/s11042-022-13486-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 09/16/2021] [Accepted: 07/13/2022] [Indexed: 06/15/2023]
Abstract
The outbreak of novel coronavirus (COVID-19) disease has infected more than 135.6 million people globally. For its early diagnosis, researchers consider chest X-ray examinations as a standard screening technique in addition to RT-PCR test. Majority of research work till date focused only on application of deep learning approaches that is relevant but lacking in better pre-processing of CXR images. Towards this direction, this study aims to explore cumulative effects of image denoising and enhancement approaches on the performance of deep learning approaches. Regarding pre-processing, suitable methods for X-ray images, Histogram equalization, CLAHE and gamma correction have been tested individually and along with adaptive median filter, median filter, total variation filter and gaussian denoising filters. Proposed study compared eleven combinations in exploration of most coherent approach in greedy manner. For more robust analysis, we compared ten CNN architectures for performance evaluation with and without enhancement approaches. These models are InceptionV3, InceptionResNetV2, MobileNet, MobileNetV2, Vgg19, NASNetMobile, ResNet101, DenseNet121, DenseNet169, DenseNet201. These models are trained in 4-way (COVID-19 pneumonia vs Viral vs Bacterial pneumonia vs Normal) and 3-way classification scenario (COVID-19 vs Pneumonia vs Normal) on two benchmark datasets. The proposed methodology determines with TVF + Gamma, models achieve higher classification accuracy and sensitivity. In 4-way classification MobileNet with TVF + Gamma achieves top accuracy of 93.25% with 1.91% improvement in accuracy score, COVID-19 sensitivity of 98.72% and F1-score of 92.14%. In 3-way classification our DenseNet201 with TVF + Gamma gains accuracy of 91.10% with improvement of 1.47%, COVID-19 sensitivity of 100% and F1-score of 91.09%. Proposed study concludes that deep learning modes with gamma correction and TVF + Gamma has superior performance compared to state-of-the-art models. This not only minimizes overlapping between COVID-19 and virus pneumonia but advantageous in time required to converge best possible results.
Collapse
Affiliation(s)
- Ajay Sharma
- Department of Computer Science, Institute of Science, Banaras Hindu University, Varanasi, 221005 India
| | - Pramod Kumar Mishra
- Department of Computer Science, Institute of Science, Banaras Hindu University, Varanasi, 221005 India
| |
Collapse
|
7
|
Abenna S, Nahid M, Bouyghf H, Ouacha B. EEG-based BCI: A novel improvement for EEG signals classification based on real-time preprocessing. Comput Biol Med 2022; 148:105931. [DOI: 10.1016/j.compbiomed.2022.105931] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 07/12/2022] [Accepted: 07/30/2022] [Indexed: 11/27/2022]
|
8
|
Ketu S, Mishra PK. Empirical Analysis of Machine Learning Algorithms on Imbalance Electrocardiogram Based Arrhythmia Dataset for Heart Disease Detection. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2021. [DOI: 10.1007/s13369-021-05972-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
9
|
Scalable kernel-based SVM classification algorithm on imbalance air quality data for proficient healthcare. COMPLEX INTELL SYST 2021. [DOI: 10.1007/s40747-021-00435-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractIn the last decade, we have seen drastic changes in the air pollution level, which has become a critical environmental issue. It should be handled carefully towards making the solutions for proficient healthcare. Reducing the impact of air pollution on human health is possible only if the data is correctly classified. In numerous classification problems, we are facing the class imbalance issue. Learning from imbalanced data is always a challenging task for researchers, and from time to time, possible solutions have been developed by researchers. In this paper, we are focused on dealing with the imbalanced class distribution in a way that the classification algorithm will not compromise its performance. The proposed algorithm is based on the concept of the adjusting kernel scaling (AKS) method to deal with the multi-class imbalanced dataset. The kernel function's selection has been evaluated with the help of weighting criteria and the chi-square test. All the experimental evaluation has been performed on sensor-based Indian Central Pollution Control Board (CPCB) dataset. The proposed algorithm with the highest accuracy of 99.66% wins the race among all the classification algorithms i.e. Adaboost (59.72%), Multi-Layer Perceptron (95.71%), GaussianNB (80.87%), and SVM (96.92). The results of the proposed algorithm are also better than the existing literature methods. It is also clear from these results that our proposed algorithm is efficient for dealing with class imbalance problems along with enhanced performance. Thus, accurate classification of air quality through our proposed algorithm will be useful for improving the existing preventive policies and will also help in enhancing the capabilities of effective emergency response in the worst pollution situation.
Collapse
|