1
|
Miao M, Yang Z, Sheng Z, Xu B, Zhang W, Cheng X. Multi-source deep domain adaptation ensemble framework for cross-dataset motor imagery EEG transfer learning. Physiol Meas 2024; 45:055024. [PMID: 38772402 DOI: 10.1088/1361-6579/ad4e95] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2023] [Accepted: 05/21/2024] [Indexed: 05/23/2024]
Abstract
Objective. Electroencephalography (EEG) is an important kind of bioelectric signal for measuring physiological activities of the brain, and motor imagery (MI) EEG has significant clinical application prospects. Convolutional neural network has become a mainstream algorithm for MI EEG classification, however lack of subject-specific data considerably restricts its decoding accuracy and generalization performance. To address this challenge, a novel transfer learning (TL) framework using auxiliary dataset to improve the MI EEG classification performance of target subject is proposed in this paper.Approach. We developed a multi-source deep domain adaptation ensemble framework (MSDDAEF) for cross-dataset MI EEG decoding. The proposed MSDDAEF comprises three main components: model pre-training, deep domain adaptation, and multi-source ensemble. Moreover, for each component, different designs were examined to verify the robustness of MSDDAEF.Main results. Bidirectional validation experiments were performed on two large public MI EEG datasets (openBMI and GIST). The highest average classification accuracy of MSDDAEF reaches 74.28% when openBMI serves as target dataset and GIST serves as source dataset. While the highest average classification accuracy of MSDDAEF is 69.85% when GIST serves as target dataset and openBMI serves as source dataset. In addition, the classification performance of MSDDAEF surpasses several well-established studies and state-of-the-art algorithms.Significance. The results of this study show that cross-dataset TL is feasible for left/right-hand MI EEG decoding, and further indicate that MSDDAEF is a promising solution for addressing MI EEG cross-dataset variability.
Collapse
Affiliation(s)
- Minmin Miao
- School of Information Engineering, Huzhou University, Huzhou, People's Republic of China
- Zhejiang Province Key Laboratory of Smart Management & Application of Modern Agricultural Resources, Huzhou University, Huzhou, People's Republic of China
| | - Zhong Yang
- School of Information Engineering, Huzhou University, Huzhou, People's Republic of China
| | - Zhenzhen Sheng
- School of Information Engineering, Huzhou University, Huzhou, People's Republic of China
- Zhejiang Province Key Laboratory of Smart Management & Application of Modern Agricultural Resources, Huzhou University, Huzhou, People's Republic of China
| | - Baoguo Xu
- School of Instrument Science and Engineering, Southeast University, Nanjing, People's Republic of China
| | - Wenbin Zhang
- College of Computer Science and Software Engineering, Hohai University, Nanjing, Jiangsu Province, People's Republic of China
| | - Xinmin Cheng
- School of Information Engineering, Huzhou University, Huzhou, People's Republic of China
- Zhejiang Province Key Laboratory of Smart Management & Application of Modern Agricultural Resources, Huzhou University, Huzhou, People's Republic of China
| |
Collapse
|
2
|
Yang L, Tang Q, Chen Z, Zhang S, Mu Y, Yan Y, Xu P, Yao D, Li F, Li C. EEG based emotion recognition by hierarchical bayesian spectral regression framework. J Neurosci Methods 2024; 402:110015. [PMID: 38000636 DOI: 10.1016/j.jneumeth.2023.110015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 10/22/2023] [Accepted: 11/16/2023] [Indexed: 11/26/2023]
Abstract
Spectral regression (SR), a graph-based learning regression model, can be used to extract features from graphs to realize efficient dimensionality reduction. However, due to the SR method remains a regularized least squares problem and being defined in L2-norm space, the effect of artifacts in EEG signals cannot be efficiently resisted. In this work, to further improve the robustness of the graph-based regression models, we propose to utilize the prior distribution estimation in the Bayesian framework and develop a robust hierarchical Bayesian spectral regression framework (named HB-SR), which is designed with the hierarchical Bayesian ensemble strategies. In the proposed HB-SR, the impact of noises can be effectively reduced by the adaptive adjustment approach in model parameters with the data-driven manner. Specifically, in the current work, three different distributions have been elaborately designed to enhance the universality of the proposed HB-SR, i.e., Gaussian distribution, Laplace distribution, and Student-t distribution. To objectively evaluate the performance of the HB-SR framework, we conducted both simulation studies and emotion recognition experiments based on emotional EEG signals. Experimental results have consistently indicated that compared with other existing spectral regression methods, the proposed HB-SR can effectively suppress the influence of noises and achieve robust EEG emotion recognition.
Collapse
Affiliation(s)
- Lei Yang
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Qi Tang
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Zhaojin Chen
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Shuhan Zhang
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Yufeng Mu
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Ye Yan
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Peng Xu
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Dezhong Yao
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China.
| | - Fali Li
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China.
| | - Cunbo Li
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China.
| |
Collapse
|
3
|
Gao X, Zhang S, Liu K, Tan Z, Zhao G, Han Y, Cheng Y, Li C, Li F, Tian Y, Li P. An Adaptive Joint CCA-ICA Method for Ocular Artifact Removal and its Application to Emotion Classification. J Neurosci Methods 2023; 390:109841. [PMID: 36948359 DOI: 10.1016/j.jneumeth.2023.109841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Revised: 03/10/2023] [Accepted: 03/19/2023] [Indexed: 03/24/2023]
Abstract
BACKGROUND The quality of Electroencephalogram (EEG) signals is critical for revealing the neural mechanism of emotions. However, ocular artifacts decreased the signal to noise ratio (SNR) and covered the inherent cognitive component of EEGs, which pose a great challenge in neuroscience research. NEW METHOD We proposed a novel unsupervised learning algorithm to adaptively remove the ocular artifacts by combining canonical correlation analysis (CCA), independent component analysis (ICA), higher-order statistics, empirical mode decomposition (EMD), and wavelet denoising techniques. Specifically, the combination of CCA and ICA aimed to improve the quality of source separation, while the higher-order statistics further located the source of ocular artifacts. Subsequently, these noised sources were further corrected by EMD and wavelet denoising to improve SNR of EEG signals. RESULTS We evaluated the performance of our proposed method with simulation studies and real EEG applications. The results of simulation study showed our proposed method could significantly improve the quality of signals under almost all noise conditions compared to four state-of-art methods. Consistently, the experiments of real EEG applications showed that the proposed methods could efficiently restrict the components of ocular artifacts and preserve the inherent information of cognition processing to improve the reliability of related analysis such as power spectral density (PSD) and emotion recognition. COMPARISON WITH EXISTING METHODS Our proposed model outperforms the comparative methods in EEG recovery, which further improve the application performance such as PSD analysis and emotion recognition. CONCLUSIONS The superior performance of our proposed method suggests that it is promising for removing ocular artifacts from EEG signals, which offers an efficient EEG preprocessing technology for the development of brain computer interface such as emotion recognition.
Collapse
Affiliation(s)
- Xiaohui Gao
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Shilai Zhang
- the Clinical Hospital of Chengdu Brain Science In-stitute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China
| | - Ke Liu
- the Chongqing University of Posts and Telecommunications Chongqing Key Laboratory of Computational Intelligence Chongqing, 400065, China
| | - Ziqin Tan
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Guanyi Zhao
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Yumeng Han
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Yue Cheng
- the Key Laboratory of Intelligent Analysis and Decision on Complex Systems, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| | - Cunbo Li
- the Clinical Hospital of Chengdu Brain Science In-stitute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China
| | - Fali Li
- the Clinical Hospital of Chengdu Brain Science In-stitute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China.
| | - Yin Tian
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications.
| | - Peiyang Li
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications.
| |
Collapse
|
4
|
Gao X, Huang W, Liu Y, Zhang Y, Zhang J, Li C, Chelangat Bore J, Wang Z, Si Y, Tian Y, Li P. A novel robust Student’s t-based Granger causality for EEG based brain network analysis. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|