1
|
Jiao Y, Zheng Q, Qiao D, Lang X, Xie L, Pan Y. EEG rhythm separation and time-frequency analysis of fast multivariate empirical mode decomposition for motor imagery BCI. BIOLOGICAL CYBERNETICS 2024; 118:21-37. [PMID: 38472417 DOI: 10.1007/s00422-024-00984-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 02/11/2024] [Indexed: 03/14/2024]
Abstract
Motor imagery electroencephalogram (EEG) is widely employed in brain-computer interface (BCI) systems. As a time-frequency analysis method for nonlinear and non-stationary signals, multivariate empirical mode decomposition (MEMD) and its noise-assisted version (NA-MEMD) has been widely used in the preprocessing step of BCI systems for separating EEG rhythms corresponding to specific brain activities. However, when applied to multichannel EEG signals, MEMD or NA-MEMD often demonstrate low robustness to noise and high computational complexity. To address these issues, we have explored the advantages of our recently proposed fast multivariate empirical mode decomposition (FMEMD) and its noise-assisted version (NA-FMEMD) for analyzing motor imagery data. We emphasize that FMEMD enables a more accurate estimation of EEG frequency information and exhibits a more noise-robust decomposition performance with improved computational efficiency. Comparative analysis with MEMD on simulation data and real-world EEG validates the above assertions. The joint average frequency measure is employed to automatically select intrinsic mode functions that correspond to specific frequency bands. Thus, FMEMD-based classification architecture is proposed. Using FMEMD as a preprocessing algorithm instead of MEMD can improve the classification accuracy by 2.3% on the BCI Competition IV dataset. On the Physiobank Motor/Mental Imagery dataset and BCI Competition IV Dataset 2a, FMEMD-based architecture also attained a comparable performance to complex algorithms. The results indicate that FMEMD proficiently extracts feature information from small benchmark datasets while mitigating dimensionality constraints resulting from computational complexity. Hence, FMEMD or NA-FMEMD can be a powerful time-frequency preprocessing method for BCI.
Collapse
Affiliation(s)
- Yang Jiao
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518026, China
- University of Nottingham Ningbo China, Ningbo, 315100, China
| | - Qian Zheng
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518026, China.
| | - Dan Qiao
- State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, 310027, China
| | - Xun Lang
- Department of Electronic Engineering, Information School, Yunnan University, Kunming, 650091, China
| | - Lei Xie
- State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, 310027, China
| | - Yi Pan
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518026, China.
| |
Collapse
|
2
|
Mohseni M, Shalchyan V, Jochumsen M, Niazi IK. Upper limb complex movements decoding from pre-movement EEG signals using wavelet common spatial patterns. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 183:105076. [PMID: 31546195 DOI: 10.1016/j.cmpb.2019.105076] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2019] [Revised: 09/07/2019] [Accepted: 09/09/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Decoding functional movements from electroencephalographic (EEG) activity for motor disability rehabilitation is essential to develop home-use brain-computer interface systems. In this paper, the classification of five complex functional upper limb movements is studied by using only the pre-movement planning and preparation recordings of EEG data. METHODS Nine healthy volunteers performed five different upper limb movements. Different frequency bands of the EEG signal are extracted by the stationary wavelet transform. Common spatial patterns are used as spatial filters to enhance separation of the five movements in each frequency band. In order to increase the efficiency of the system, a mutual information-based feature selection algorithm is applied. The selected features are classified using the k-nearest neighbor, support vector machine, and linear discriminant analysis methods. RESULTS K-nearest neighbor method outperformed the other classifiers and resulted in an average classification accuracy of 94.0 ± 2.7% for five classes of movements across subjects. Further analysis of each frequency band's contribution in the optimal feature set, showed that the gamma and beta frequency bands had the most contribution in the classification. To reduce the complexity of the EEG recording system setup, we selected a subset of the 10 most effective EEG channels from 64 channels, by which we could reach an accuracy of 70%. Those EEG channels were mostly distributed over the prefrontal and frontal areas. CONCLUSIONS Overall, the results indicate that it is possible to classify complex movements before the movement onset by using spatially selected EEG data.
Collapse
Affiliation(s)
- Mahdieh Mohseni
- Neuroscience and Neuroengineering Research Lab, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science & Technology (IUST), Narmak, Tehran, Iran
| | - Vahid Shalchyan
- Neuroscience and Neuroengineering Research Lab, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science & Technology (IUST), Narmak, Tehran, Iran.
| | - Mads Jochumsen
- Centre for Sensory-Motor Interactions (SMI), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Imran Khan Niazi
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland, New Zealand; Faculty of Health & Environmental Sciences, Health & Rehabilitation Research Institute, AUT University, Auckland, New Zealand; Centre for Sensory-Motor Interactions (SMI), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark.
| |
Collapse
|
3
|
Abdalsalam M E, Yusoff MZ, Mahmoud D, Malik AS, Bahloul MR. Discrimination of four class simple limb motor imagery movements for brain–computer interface. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.04.010] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
4
|
Hwang B, You J, Vaessen T, Myin-Germeys I, Park C, Zhang BT. Deep ECGNet: An Optimal Deep Learning Framework for Monitoring Mental Stress Using Ultra Short-Term ECG Signals. Telemed J E Health 2018; 24:753-772. [PMID: 29420125 DOI: 10.1089/tmj.2017.0250] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Stress recognition using electrocardiogram (ECG) signals requires the intractable long-term heart rate variability (HRV) parameter extraction process. This study proposes a novel deep learning framework to recognize the stressful states, the Deep ECGNet, using ultra short-term raw ECG signals without any feature engineering methods. METHODS The Deep ECGNet was developed through various experiments and analysis of ECG waveforms. We proposed the optimal recurrent and convolutional neural networks architecture, and also the optimal convolution filter length (related to the P, Q, R, S, and T wave durations of ECG) and pooling length (related to the heart beat period) based on the optimization experiments and analysis on the waveform characteristics of ECG signals. The experiments were also conducted with conventional methods using HRV parameters and frequency features as a benchmark test. The data used in this study were obtained from Kwangwoon University in Korea (13 subjects, Case 1) and KU Leuven University in Belgium (9 subjects, Case 2). Experiments were designed according to various experimental protocols to elicit stressful conditions. RESULTS The proposed framework to recognize stress conditions, the Deep ECGNet, outperformed the conventional approaches with the highest accuracy of 87.39% for Case 1 and 73.96% for Case 2, respectively, that is, 16.22% and 10.98% improvements compared with those of the conventional HRV method. CONCLUSIONS We proposed an optimal deep learning architecture and its parameters for stress recognition, and the theoretical consideration on how to design the deep learning structure based on the periodic patterns of the raw ECG data. Experimental results in this study have proved that the proposed deep learning model, the Deep ECGNet, is an optimal structure to recognize the stress conditions using ultra short-term ECG data.
Collapse
Affiliation(s)
- Bosun Hwang
- 1 Department of Computer Science and Engineering, Seoul National University , Seoul, Korea
| | - Jiwoo You
- 2 Department of Computer Engineering, Kwangwoon University , Nowon-gu, Seoul, Korea
| | - Thomas Vaessen
- 3 KU Leuven, Department of Neurosciences, Center for Contextual Psychiatry , Leuven, Belgium
| | - Inez Myin-Germeys
- 3 KU Leuven, Department of Neurosciences, Center for Contextual Psychiatry , Leuven, Belgium
| | - Cheolsoo Park
- 2 Department of Computer Engineering, Kwangwoon University , Nowon-gu, Seoul, Korea
| | - Byoung-Tak Zhang
- 1 Department of Computer Science and Engineering, Seoul National University , Seoul, Korea
| |
Collapse
|
5
|
Zhang Y, Xu P, Li P, Duan K, Wen Y, Yang Q, Zhang T, Yao D. Noise-assisted multivariate empirical mode decomposition for multichannel EMG signals. Biomed Eng Online 2017; 16:107. [PMID: 28835251 PMCID: PMC5569569 DOI: 10.1186/s12938-017-0397-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2016] [Accepted: 08/17/2017] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND Ensemble Empirical Mode Decomposition (EEMD) has been popularised for single-channel Electromyography (EMG) signal processing as it can effectively extract the temporal information of the EMG time series. However, few papers examine the temporal and spatial characteristics across multiple muscle groups in relation to multichannel EMG signals. EXPERIMENT The experimental data was obtained from the Center for Machine Learning and Intelligent Systems, University of California Irvine (UCI). The data was donated by the Nueva Granada Military University and the Technopark node Manizales in Colombia. The databases of 11 male subjects from the healthy group were taken into the study. The subjects undergo three exercise programs, leg extension from a sitting position (sitting), flexion of the leg up (standing), and gait (walking), while four electrodes were placed on biceps femoris (BF), vastus medialis (VM), rectus femoris (RF), and semitendinosus (ST). METHODS Based on the experimental data, a comparative study is provided by assessing the Empirical Mode Decomposition (EMD)-based approaches, EEMD, Multivariate EMD (MEMD), and Noise-Assisted MEMD (NA-MEMD). The outcomes from these approaches are then quantitatively estimated on the basis of three criterions, the number of Intrinsic Mode Functions (IMFs), mode-alignment and mode-mixing. RESULTS Both MEMD and NA-MEMD methods (except EEMD) can guarantee equal numbers of IMFs. For mode-alignment and mode-mixing, NA-MEMD is optimal compared with MEMD and EEMD, and MEMD is merely better than EEMD. CONCLUSIONS This study proposes the NA-MEMD approach for multichannel EMG signal processing. This finding implies that NA-MEMD is effective for simultaneously analysing IMFs based frequency bands. It has a vital clinical implication in exploring the neuromuscular patterns that enable the multiple muscle groups to coordinate while performing the functional activities of daily living.
Collapse
Affiliation(s)
- Yi Zhang
- School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu, 611731 China
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, Chengdu, 610054 China
- Center for Information in BioMedicine, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, 610054 Chengdu, China
| | - Peng Xu
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, Chengdu, 610054 China
- Center for Information in BioMedicine, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, 610054 Chengdu, China
| | - Peiyang Li
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, Chengdu, 610054 China
- Center for Information in BioMedicine, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, 610054 Chengdu, China
| | - Keyi Duan
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, Chengdu, 610054 China
- Center for Information in BioMedicine, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, 610054 Chengdu, China
| | - Yuexin Wen
- School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu, 611731 China
| | - Qin Yang
- School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu, 611731 China
| | - Tao Zhang
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, Chengdu, 610054 China
- Center for Information in BioMedicine, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, 610054 Chengdu, China
| | - Dezhong Yao
- Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, Chengdu, 610054 China
- Center for Information in BioMedicine, University of Electronic Science and Technology of China, No. 4, Section 2 of North Jianshe Road, 610054 Chengdu, China
| |
Collapse
|
6
|
Courellis H, Mullen T, Poizner H, Cauwenberghs G, Iversen JR. EEG-Based Quantification of Cortical Current Density and Dynamic Causal Connectivity Generalized across Subjects Performing BCI-Monitored Cognitive Tasks. Front Neurosci 2017; 11:180. [PMID: 28566997 PMCID: PMC5434743 DOI: 10.3389/fnins.2017.00180] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 03/20/2017] [Indexed: 11/13/2022] Open
Abstract
Quantification of dynamic causal interactions among brain regions constitutes an important component of conducting research and developing applications in experimental and translational neuroscience. Furthermore, cortical networks with dynamic causal connectivity in brain-computer interface (BCI) applications offer a more comprehensive view of brain states implicated in behavior than do individual brain regions. However, models of cortical network dynamics are difficult to generalize across subjects because current electroencephalography (EEG) signal analysis techniques are limited in their ability to reliably localize sources across subjects. We propose an algorithmic and computational framework for identifying cortical networks across subjects in which dynamic causal connectivity is modeled among user-selected cortical regions of interest (ROIs). We demonstrate the strength of the proposed framework using a "reach/saccade to spatial target" cognitive task performed by 10 right-handed individuals. Modeling of causal cortical interactions was accomplished through measurement of cortical activity using (EEG), application of independent component clustering to identify cortical ROIs as network nodes, estimation of cortical current density using cortically constrained low resolution electromagnetic brain tomography (cLORETA), multivariate autoregressive (MVAR) modeling of representative cortical activity signals from each ROI, and quantification of the dynamic causal interaction among the identified ROIs using the Short-time direct Directed Transfer function (SdDTF). The resulting cortical network and the computed causal dynamics among its nodes exhibited physiologically plausible behavior, consistent with past results reported in the literature. This physiological plausibility of the results strengthens the framework's applicability in reliably capturing complex brain functionality, which is required by applications, such as diagnostics and BCI.
Collapse
Affiliation(s)
- Hristos Courellis
- Swartz Center for Computational Neuroscience, University of California, San DiegoSan Diego, CA, United States.,Department of Bioengineering, University of California, San DiegoSan Diego, CA, United States
| | - Tim Mullen
- Swartz Center for Computational Neuroscience, University of California, San DiegoSan Diego, CA, United States
| | - Howard Poizner
- Institute for Neural Computation, University of California, San DiegoSan Diego, CA, United States
| | - Gert Cauwenberghs
- Department of Bioengineering, University of California, San DiegoSan Diego, CA, United States.,Institute for Neural Computation, University of California, San DiegoSan Diego, CA, United States
| | - John R Iversen
- Swartz Center for Computational Neuroscience, University of California, San DiegoSan Diego, CA, United States
| |
Collapse
|
7
|
Amo C, de Santiago L, Barea R, López-Dorado A, Boquete L. Analysis of Gamma-Band Activity from Human EEG Using Empirical Mode Decomposition. SENSORS (BASEL, SWITZERLAND) 2017; 17:E989. [PMID: 28468250 PMCID: PMC5469342 DOI: 10.3390/s17050989] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2017] [Revised: 04/25/2017] [Accepted: 04/26/2017] [Indexed: 12/17/2022]
Abstract
The purpose of this paper is to determine whether gamma-band activity detection is improved when a filter, based on empirical mode decomposition (EMD), is added to the pre-processing block of single-channel electroencephalography (EEG) signals. EMD decomposes the original signal into a finite number of intrinsic mode functions (IMFs). EEGs from 25 control subjects were registered in basal and motor activity (hand movements) using only one EEG channel. Over the basic signal, IMF signals are computed. Gamma-band activity is computed using power spectrum density in the 30-60 Hz range. Event-related synchronization (ERS) was defined as the ratio of motor and basal activity. To evaluate the performance of the new EMD based method, ERS was computed from the basic and IMF signals. The ERS obtained using IMFs improves, from 31.00% to 73.86%, on the original ERS for the right hand, and from 22.17% to 47.69% for the left hand. As EEG processing is improved, the clinical applications of gamma-band activity will expand.
Collapse
Affiliation(s)
- Carlos Amo
- Departamento de Electrónica, Grupo de Ingeniería Biomédica, Universidad de Alcalá, Alcalá de Henares 28801, Spain.
| | - Luis de Santiago
- Departamento de Electrónica, Grupo de Ingeniería Biomédica, Universidad de Alcalá, Alcalá de Henares 28801, Spain.
| | - Rafael Barea
- Departamento de Electrónica, Grupo de Ingeniería Biomédica, Universidad de Alcalá, Alcalá de Henares 28801, Spain.
| | - Almudena López-Dorado
- Departamento de Electrónica, Grupo de Ingeniería Biomédica, Universidad de Alcalá, Alcalá de Henares 28801, Spain.
| | - Luciano Boquete
- Departamento de Electrónica, Grupo de Ingeniería Biomédica, Universidad de Alcalá, Alcalá de Henares 28801, Spain.
| |
Collapse
|