1
|
Ma W, Wang C, Sun X, Lin X, Niu L, Wang Y. MBGA-Net: A multi-branch graph adaptive network for individualized motor imagery EEG classification. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 240:107641. [PMID: 37327754 DOI: 10.1016/j.cmpb.2023.107641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 05/21/2023] [Accepted: 05/31/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVE The development of deep learning has led to significant improvements in the decoding accuracy of Motor Imagery (MI) EEG signal classification. However, current models are inadequate in ensuring high levels of classification accuracy for an individual. Since MI EEG data is primarily used in medical rehabilitation and intelligent control, it is crucial to ensure that each individual's EEG signal is recognized with precision. METHODS We propose a multi-branch graph adaptive network (MBGA-Net), which matches each individual EEG signal with a suitable time-frequency domain processing method based on spatio-temporal domain features. We then feed the signal into the relevant model branch using an adaptive technique. Through an enhanced attention mechanism and deep convolutional method with residual connectivity, each model branch more effectively harvests the features of the related format data. RESULTS We validate the proposed model using the BCI Competition IV dataset 2a and dataset 2b. On dataset 2a, the average accuracy and kappa values are 87.49% and 0.83, respectively. The standard deviation of individual kappa values is only 0.08. For dataset 2b, the average classification accuracies obtained by feeding the data into the three branches of MBGA-Net are 85.71%, 85.83%, and 86.99%, respectively. CONCLUSIONS The experimental results demonstrate that MBGA-Net could effectively perform the classification task of motor imagery EEG signals, and it exhibits strong generalization performance. The proposed adaptive matching technique enhances the classification accuracy of each individual, which is beneficial for the practical application of EEG classification.
Collapse
Affiliation(s)
- Weifeng Ma
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, PR China
| | - Chuanlai Wang
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, PR China
| | - Xiaoyong Sun
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, PR China
| | - Xuefen Lin
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, PR China
| | - Lei Niu
- Faculty of Artificial Intelligence Education, Central China Normal University Wollongong Joint Institude, Wuhan 430079, PR China
| | - Yuchen Wang
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, PR China.
| |
Collapse
|
2
|
Ma W, Wang C, Sun X, Lin X, Wang Y. A double-branch graph convolutional network based on individual differences weakening for motor imagery EEG classification. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
|
3
|
Arı E, Taçgın E. Input Shape Effect on Classification Performance of Raw EEG Motor Imagery Signals with Convolutional Neural Networks for Use in Brain-Computer Interfaces. Brain Sci 2023; 13:brainsci13020240. [PMID: 36831784 PMCID: PMC9954790 DOI: 10.3390/brainsci13020240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2023] [Revised: 01/26/2023] [Accepted: 01/28/2023] [Indexed: 02/04/2023] Open
Abstract
EEG signals are interpreted, analyzed and classified by many researchers for use in brain-computer interfaces. Although there are many different EEG signal acquisition methods, one of the most interesting is motor imagery signals. Many different signal processing methods, machine learning and deep learning models have been developed for the classification of motor imagery signals. Among these, Convolutional Neural Network models generally achieve better results than other models. Because the size and shape of the data is important for training Convolutional Neural Network models and discovering the right relationships, researchers have designed and experimented with many different input shape structures. However, no study has been found in the literature evaluating the effect of different input shapes on model performance and accuracy. In this study, the effects of different input shapes on model performance and accuracy in the classification of EEG motor imagery signals were investigated, which had not been specifically studied before. In addition, signal preprocessing methods, which take a long time before classification, were not used; rather, two CNN models were developed for training and classification using raw data. Two different datasets, BCI Competition IV 2A and 2B, were used in classification processes. For different input shapes, 53.03-89.29% classification accuracy and 2-23 s epoch time were obtained for 2A dataset, 64.84-84.94% classification accuracy and 4-10 s epoch time were obtained for 2B dataset. This study showed that the input shape has a significant effect on the classification performance, and when the correct input shape is selected and the correct CNN architecture is developed, feature extraction and classification can be done well by the CNN architecture without any signal preprocessing.
Collapse
Affiliation(s)
- Emre Arı
- Department of Mechanical Engineering, Faculty of Engineering, Marmara University, Istanbul 34840, Turkey
- Department of Mechanical Engineering, Faculty of Engineering, Dicle University, Diyarbakır 21280, Turkey
- Correspondence:
| | - Ertuğrul Taçgın
- Department of Mechanical Engineering, Faculty of Engineering, Doğuş University, Istanbul 34775, Turkey
| |
Collapse
|
4
|
Li H, Chen H, Jia Z, Zhang R, Yin F. A parallel multi-scale time-frequency block convolutional neural network based on channel attention module for motor imagery classification. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
5
|
Mid- to Long-Term Electric Load Forecasting Based on the EMD–Isomap–Adaboost Model. SUSTAINABILITY 2022. [DOI: 10.3390/su14137608] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Accurate load forecasting is an important issue for the reliable and efficient operation of a power system. In this study, a hybrid algorithm (EMDIA) that combines empirical mode decomposition (EMD), isometric mapping (Isomap), and Adaboost to construct a prediction mode for mid- to long-term load forecasting is developed. Based on full consideration of the meteorological and economic factors affecting the power load trend, the EMD method is used to decompose the load and its influencing factors into multiple intrinsic mode functions (IMF) and residuals. Through correlation analysis, the power load is divided into fluctuation term and trend term. Then, the key influencing factors of feature sequences are extracted by Isomap to eliminate the correlations and redundancy of the original multidimensional sequences and reduce the dimension of model input. Eventually, the Adaboost prediction method is adopted to realize the prediction of the electrical load. In comparison with the RF, LSTM, GRU, BP, and single Adaboost method, the prediction obtained by this proposed model has higher accuracy in the mean absolute percentage error (MAPE), mean absolute error (MAE), root mean square error (RMSE), and determination coefficient (R2). Compared with the single Adaboost algorithm, the EMDIA reduces MAE by 11.58, MAPE by 0.13%, and RMSE by 49.93 and increases R2 by 0.04.
Collapse
|
6
|
An efficient multi-scale CNN model with intrinsic feature integration for motor imagery EEG subject classification in brain-machine interfaces. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103496] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
|
7
|
Lashgari E, Ott J, Connelly A, Baldi P, Maoz U. An end-to-end CNN with attentional mechanism applied to raw EEG in a BCI classification task. J Neural Eng 2021; 18. [PMID: 34352734 DOI: 10.1088/1741-2552/ac1ade] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 08/05/2021] [Indexed: 11/12/2022]
Abstract
Objective.Motor-imagery (MI) classification base on electroencephalography (EEG) has been long studied in neuroscience and more recently widely used in healthcare applications such as mobile assistive robots and neurorehabilitation. In particular, EEG-based MI classification methods that rely on convolutional neural networks (CNNs) have achieved relatively high classification accuracy. However, naively training CNNs to classify raw EEG data from all channels, especially for high-density EEG, is computationally demanding and requires huge training sets. It often also introduces many irrelevant input features, making it difficult for the CNN to extract the informative ones. This problem is compounded by a dearth of training data, which is particularly acute for MI tasks, because these are cognitively demanding and thus fatigue inducing.Approach.To address these issues, we proposed an end-to-end CNN-based neural network with attentional mechanism together with different data augmentation (DA) techniques. We tested it on two benchmark MI datasets, brain-computer interface (BCI) competition IV 2a and 2b. In addition, we collected a new dataset, recorded using high-density EEG, and containing both MI and motor execution (ME) tasks, which we share with the community.Main results.Our proposed neural-network architecture outperformed all state-of-the-art methods that we found in the literature, with and without DA, reaching an average classification accuracy of 93.6% and 87.83% on BCI 2a and 2b, respectively. We also directly compare decoding of MI and ME tasks. Focusing on MI classification, we find optimal channel configurations and the best DA techniques as well as investigate combining data across participants and the role of transfer learning.Significance.Our proposed approach improves the classification accuracy for MI in the benchmark datasets. In addition, collecting our own dataset enables us to compare MI and ME and investigate various aspects of EEG decoding critical for neuroscience and BCI.
Collapse
Affiliation(s)
- Elnaz Lashgari
- Schmid College of Science and Technology, Chapman University, Orange, CA, United States of America.,Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, United States of America
| | - Jordan Ott
- Department of Computer Science, University of California, Irvine, CA, United States of America
| | - Akima Connelly
- Schmid College of Science and Technology, Chapman University, Orange, CA, United States of America.,Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, United States of America
| | - Pierre Baldi
- Department of Computer Science, University of California, Irvine, CA, United States of America.,Center for Machine Learning and Intelligent Systems, University of California Irvine, Irvine, CA, United States of America.,Institute for Genomics and Bioinformatics, University of California Irvine, Irvine, CA, United States of America
| | - Uri Maoz
- Schmid College of Science and Technology, Chapman University, Orange, CA, United States of America.,Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, United States of America.,Computational Neuroscience and Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, CA, United States of America.,Fowler School of Engineering, Chapman University, Orange, CA, United States of America.,Anderson School of Management, University of California Los Angeles, Los Angeles, CA, United States of America.,Biology and Bioengineering, California Institute of Technology, Pasadena, CA, United States of America
| |
Collapse
|
8
|
Xiao X, Fang Y. Motor Imagery EEG Signal Recognition Using Deep Convolution Neural Network. Front Neurosci 2021; 15:655599. [PMID: 33841094 PMCID: PMC8027090 DOI: 10.3389/fnins.2021.655599] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 03/03/2021] [Indexed: 11/21/2022] Open
Abstract
Brain computer interaction (BCI) based on EEG can help patients with limb dyskinesia to carry out daily life and rehabilitation training. However, due to the low signal-to-noise ratio and large individual differences, EEG feature extraction and classification have the problems of low accuracy and efficiency. To solve this problem, this paper proposes a recognition method of motor imagery EEG signal based on deep convolution network. This method firstly aims at the problem of low quality of EEG signal characteristic data, and uses short-time Fourier transform (STFT) and continuous Morlet wavelet transform (CMWT) to preprocess the collected experimental data sets based on time series characteristics. So as to obtain EEG signals that are distinct and have time-frequency characteristics. And based on the improved CNN network model to efficiently recognize EEG signals, to achieve high-quality EEG feature extraction and classification. Further improve the quality of EEG signal feature acquisition, and ensure the high accuracy and precision of EEG signal recognition. Finally, the proposed method is validated based on the BCI competiton dataset and laboratory measured data. Experimental results show that the accuracy of this method for EEG signal recognition is 0.9324, the precision is 0.9653, and the AUC is 0.9464. It shows good practicality and applicability.
Collapse
Affiliation(s)
- Xiongliang Xiao
- College of Electronic Science and Engineering, Hunan University of Information Technology, Changsha, China
| | - Yuee Fang
- College of Electric Power Engineering, Hunan Polytechnic of Water Resources and Electric Power, Changsha, China
| |
Collapse
|
9
|
Zhang C, Kim YK, Eskandarian A. EEG-inception: an accurate and robust end-to-end neural network for EEG-based motor imagery classification. J Neural Eng 2021; 18. [PMID: 33691299 DOI: 10.1088/1741-2552/abed81] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 03/10/2021] [Indexed: 12/14/2022]
Abstract
Classification of EEG-based motor imagery (MI) is a crucial non-invasive application in brain-computer interface (BCI) research. This paper proposes a novel convolutional neural network (CNN) architecture for accurate and robust EEG-based MI classification that outperforms the state-of-the-art methods. The proposed CNN model, namely EEG-Inception, is built on the backbone of the Inception-Time network, which has showed to be highly efficient and accurate for time-series classification. Also, the proposed network is an end-to-end classification, as it takes the raw EEG signals as the input and does not require complex EEG signal-preprocessing. Furthermore, this paper proposes a novel data augmentation method for EEG signals to enhance the accuracy, at least by 3%, and reduce overfitting with limited BCI datasets. The proposed model outperforms all state-of-the-art methods by achieving the average accuracy of 88.4% and 88.6% on the 2008 BCI Competition IV 2a (four-classes) and 2b datasets (binary-classes), respectively. Furthermore, it takes less than 0.025 seconds to test a sample suitable for real-time processing. Moreover, the classification standard deviation for nine different subjects achieves the lowest value of 5.5 for the 2b dataset and 7.1 for the 2a dataset, which validates that the proposed method is highly robust. From the experiment results, it can be inferred that the EEG-Inception network exhibits a strong potential as a subject-independent classifier for EEG-based MI tasks.
Collapse
Affiliation(s)
- Ce Zhang
- Mechanical Engineering, Virginia Polytechnic Institute and State University, 635 Prices Fork Rd, Blacksburg, Virginia, 24061-0131, UNITED STATES
| | - Young-Keun Kim
- Mechanical and Control Eng. Dept, Handong Global University, 558 Handong-ro Buk-gu, Pohang Gyeongbuk, Pohang, 37554, Korea (the Republic of)
| | - Azim Eskandarian
- Mechanical Engineering, Virginia Polytechnic Institute and State University, 635 Prices Fork Rd, Blacksburg, Virginia, 24060, UNITED STATES
| |
Collapse
|
10
|
Identifying motor imagery activities in brain computer interfaces based on the intelligent selection of most informative timeframe. SN APPLIED SCIENCES 2020. [DOI: 10.1007/s42452-020-2020-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022] Open
|
11
|
Dai G, Zhou J, Huang J, Wang N. HS-CNN: a CNN with hybrid convolution scale for EEG motor imagery classification. J Neural Eng 2020; 17:016025. [PMID: 31476743 DOI: 10.1088/1741-2552/ab405f] [Citation(s) in RCA: 99] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
OBJECTIVE Electroencephalography (EEG) motor imagery classification has been widely used in healthcare applications such as mobile assistive robots and post-stroke rehabilitation. Recently, EEG motor imagery classification methods based on convolutional neural networks (CNNs) have been proposed and have achieved relatively high classification accuracy. However, these methods use single convolution scale in the CNN, while the best convolution scale differs from subject to subject. This limits the classification accuracy. Another issue is that the classification accuracy degrades when training data is limited. APPROACH To address these issues, we have proposed a hybrid-scale CNN architecture with a data augmentation method for EEG motor imagery classification. MAIN RESULTS Compared with several state-of-the-art methods, the proposed method achieves an average classification accuracy of 91.57% and 87.6% on two commonly used datasets, which outperforms several state-of-the-art EEG motor imagery classification methods. SIGNIFICANCE The proposed method effectively addresses the issues of existing CNN-based EEG motor imagery classification methods and improves the classification accuracy.
Collapse
Affiliation(s)
- Guanghai Dai
- School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, People's Republic of China
| | | | | | | |
Collapse
|
12
|
Li H, Trocan M. Sparse reconstruction of ISOMAP representations. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2019. [DOI: 10.3233/jifs-179359] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Honggui Li
- School of Information Engineering, Yangzhou University, Jiangsu, China
| | - Maria Trocan
- LISITE Research Laboratory, Institut Supérieur d’Électronique de Paris, Paris, France
| |
Collapse
|
13
|
An Incremental Version of L-MVU for the Feature Extraction of MI-EEG. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2019; 2019:4317078. [PMID: 31191631 PMCID: PMC6525943 DOI: 10.1155/2019/4317078] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2019] [Revised: 04/04/2019] [Accepted: 04/07/2019] [Indexed: 11/17/2022]
Abstract
Due to the nonlinear and high-dimensional characteristics of motor imagery electroencephalography (MI-EEG), it can be challenging to get high online accuracy. As a nonlinear dimension reduction method, landmark maximum variance unfolding (L-MVU) can completely retain the nonlinear features of MI-EEG. However, L-MVU still requires considerable computation costs for out-of-sample data. An incremental version of L-MVU (denoted as IL-MVU) is proposed in this paper. The low-dimensional representation of the training data is generated by L-MVU. For each out-of-sample data, its nearest neighbors will be found in the high-dimensional training samples and the corresponding reconstruction weight matrix be calculated to generate its low-dimensional representation as well. IL-MVU is further combined with the dual-tree complex wavelet transform (DTCWT), which develops a hybrid feature extraction method (named as IL-MD). IL-MVU is applied to extract the nonlinear features of the specific subband signals, which are reconstructed by DTCWT and have the obvious event-related synchronization/event-related desynchronization phenomenon. The average energy features of α and β waves are calculated simultaneously. The two types of features are fused and are evaluated by a linear discriminant analysis classifier. Based on the two public datasets with 12 subjects, extensive experiments were conducted. The average recognition accuracies of 10-fold cross-validation are 92.50% on Dataset 3b and 88.13% on Dataset 2b, and they gain at least 1.43% and 3.45% improvement, respectively, compared to existing methods. The experimental results show that IL-MD can extract more accurate features with relatively lower consumption cost, and it also has better feature visualization and self-adaptive characteristics to subjects. The t-test results and Kappa values suggest the proposed feature extraction method reaches statistical significance and has high consistency in classification.
Collapse
|
14
|
An Investigation into the Acoustic Emissions of Internal Combustion Engines with Modelling and Wavelet Package Analysis for Monitoring Lubrication Conditions. ENERGIES 2019. [DOI: 10.3390/en12040640] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Online monitoring of the lubrication and friction conditions in internal combustion engines can provide valuable information and thereby enables optimal maintenance actions to be undertaken to ensure safe and efficient operations. Acoustic emission (AE) has attracted significant attention in condition monitoring due to its high sensitivity to light defects on sliding surfaces. However, limited understanding of the AE mechanisms in fluid-lubricated conjunctions, such as piston rings and cylinder liners, confines the development of AE-based lubrication monitoring techniques. Therefore, this study focuses on developing new AE models and effective AE signal process methods in order to achieve accurate online lubrication monitoring. Based on the existing AE model for asperity–asperity collision (AAC), a new model for fluid–asperity shearing (FAS)-induced AE is proposed that will explain AE responses from the tribological conjunction of the piston ring and cylinder. These two AE models can then jointly demonstrate AE responses from the lubrication conjunction of engine ring–liner. In particular, FAS allows the observable AE responses in the middle of engine strokes to be characterised in association with engine speeds and lubricant viscosity. However, these AE components are relatively weak and noisy compared to others, with movements such as valve taring, fuel injection and combustions. To accurately extract these weaker AE’s for lubricant monitoring, an optimised wavelet packet transform (WPT) analysis is applied to the raw AE data from a running engine. This results in four distinctive narrow band indicators to describe the AE amplitude in the middle of an engine power stroke. Experimental evaluation shows the linear increasing trend of AE indicator with engine speeds allows a full separation of two baseline engine lubricants (CD-10W30 and CD-15W40), previously unused over a wide range of speeds. Moreover, the used oil can also be diagnosed by using the nonlinear and unstable behaviours of the indicator at various speeds. This model has demonstrated the high performance of using AE signals processed with the optimised WPT spectrum in monitoring the lubrication conditions between the ring and liner in IC engines.
Collapse
|
15
|
Induction Motors Dynamic Eccentricity Fault Diagnosis Based on the Combined Use of WPD and EMD-Simulation Study. APPLIED SCIENCES-BASEL 2018. [DOI: 10.3390/app8101709] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The frequency-domain analysis using the fast Fourier transform (FFT) for diagnosis of eccentricity fault has been widely used in squirrel-cage induction motor (IM). However, with the restriction of sampling frequency and time acquisition, FFT analysis could not provide ideal results under low levels of dynamic eccentricity (DE). In this paper, a combined use of the wavelet packet decomposition (WPD) and empirical mode decomposition (EMD) method is presented to diagnose the IM fault under low degrees of purely DE. The proposed method is based on the decomposition of apparent power signal and extracts the characteristic component. The fault severity factor (FSF) has been defined to evaluate the eccentricity severity. Simulation results using the finite element method (FEM) are tested to verify the effectiveness of the presented method under different load conditions.
Collapse
|