1
|
Padfield N, Zabalza J, Zhao H, Masero V, Ren J. EEG-Based Brain-Computer Interfaces Using Motor-Imagery: Techniques and Challenges. SENSORS (BASEL, SWITZERLAND) 2019; 19:E1423. [PMID: 30909489 PMCID: PMC6471241 DOI: 10.3390/s19061423] [Citation(s) in RCA: 157] [Impact Index Per Article: 31.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Revised: 03/10/2019] [Accepted: 03/19/2019] [Indexed: 12/11/2022]
Abstract
Electroencephalography (EEG)-based brain-computer interfaces (BCIs), particularly those using motor-imagery (MI) data, have the potential to become groundbreaking technologies in both clinical and entertainment settings. MI data is generated when a subject imagines the movement of a limb. This paper reviews state-of-the-art signal processing techniques for MI EEG-based BCIs, with a particular focus on the feature extraction, feature selection and classification techniques used. It also summarizes the main applications of EEG-based BCIs, particularly those based on MI data, and finally presents a detailed discussion of the most prevalent challenges impeding the development and commercialization of EEG-based BCIs.
Collapse
Affiliation(s)
- Natasha Padfield
- Centre for Signal and Image Processing, University of Strathclyde, Glasgow G1 1XW, UK.
| | - Jaime Zabalza
- Centre for Signal and Image Processing, University of Strathclyde, Glasgow G1 1XW, UK.
| | - Huimin Zhao
- School of Computer Sciences, Guangdong Polytechnic Normal University, Guangzhou 510665, China.
- The Guangzhou Key Laboratory of Digital Content Processing and Security Technologies, Guangzhou 510665, China.
| | - Valentin Masero
- Department of Computer Systems and Telematics Engineering, Universidad de Extremadura, 06007 Badajoz, Spain.
| | - Jinchang Ren
- Centre for Signal and Image Processing, University of Strathclyde, Glasgow G1 1XW, UK.
- School of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan 030024, China.
| |
Collapse
|
2
|
Hsu WY. An integrated-mental brainwave system for analyses and judgments of consumer preference. TELEMATICS AND INFORMATICS 2017. [DOI: 10.1016/j.tele.2016.11.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
3
|
Quitadamo LR, Cavrini F, Sbernini L, Riillo F, Bianchi L, Seri S, Saggio G. Support vector machines to detect physiological patterns for EEG and EMG-based human-computer interaction: a review. J Neural Eng 2017; 14:011001. [PMID: 28068295 DOI: 10.1088/1741-2552/14/1/011001] [Citation(s) in RCA: 47] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Support vector machines (SVMs) are widely used classifiers for detecting physiological patterns in human-computer interaction (HCI). Their success is due to their versatility, robustness and large availability of free dedicated toolboxes. Frequently in the literature, insufficient details about the SVM implementation and/or parameters selection are reported, making it impossible to reproduce study analysis and results. In order to perform an optimized classification and report a proper description of the results, it is necessary to have a comprehensive critical overview of the applications of SVM. The aim of this paper is to provide a review of the usage of SVM in the determination of brain and muscle patterns for HCI, by focusing on electroencephalography (EEG) and electromyography (EMG) techniques. In particular, an overview of the basic principles of SVM theory is outlined, together with a description of several relevant literature implementations. Furthermore, details concerning reviewed papers are listed in tables and statistics of SVM use in the literature are presented. Suitability of SVM for HCI is discussed and critical comparisons with other classifiers are reported.
Collapse
Affiliation(s)
- L R Quitadamo
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy. School of Life and Health Sciences, Aston Brain Center, Aston University, Birmingham, UK
| | | | | | | | | | | | | |
Collapse
|
4
|
Abstract
Single-trial electroencephalogram (EEG) data are analyzed with similarity measure. Time-frequency representation is constructed from EEG signals. It is then weighted with t-statistics. Finally, the test data are discriminated with similarity measure. Compared with non-weighted version, the experimental results indicate that the proposed method obtains better results in classification accuracy.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, 168 University Rd. Sec. 1, Min-Hsiung Township, Chiayi County 621, Taiwan.,Advanced Institute of Manufacturing with High-tech Innovations, National Chung Cheng University, 168 University Rd. Sec. 1, Min-Hsiung Township, Chiayi County 621, Taiwan. Tel.: +886 5 2720411, #34621;Fax: +886 5 2721501; E-mails: ,
| |
Collapse
|
5
|
Hsu WY. Assembling A Multi-Feature EEG Classifier for Left–Right Motor Imagery Data Using Wavelet-Based Fuzzy Approximate Entropy for Improved Accuracy. Int J Neural Syst 2015; 25:1550037. [DOI: 10.1142/s0129065715500379] [Citation(s) in RCA: 55] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
An EEG classifier is proposed for application in the analysis of motor imagery (MI) EEG data from a brain–computer interface (BCI) competition in this study. Applying subject-action-related brainwave data acquired from the sensorimotor cortices, the system primarily consists of artifact and background removal, feature extraction, feature selection and classification. In addition to background noise, the electrooculographic (EOG) artifacts are also automatically removed to further improve the analysis of EEG signals. Several potential features, including amplitude modulation, spectral power and asymmetry ratio, adaptive autoregressive model, and wavelet fuzzy approximate entropy (wfApEn) that can measure and quantify the complexity or irregularity of EEG signals, are then extracted for subsequent classification. Finally, the significant sub-features are selected from feature combination by quantum-behaved particle swarm optimization and then classified by support vector machine (SVM). Compared with feature extraction without wfApEn on MI data from two data sets for nine subjects, the results indicate that the proposed system including wfApEn obtains better performance in average classification accuracy of 88.2% and average number of commands per minute of 12.1, which is promising in the BCI work applications.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, No. 168, Sec. 1, University Rd., Min-Hsiung Township, Chiayi County 621, Taiwan
- Advanced Institute of Manufacturing with High-tech Innovations, National Chung Cheng University, No. 168, Sec. 1, University Rd. Min-Hsiung Township, Chiayi County 621, Taiwan
| |
Collapse
|
6
|
Hsu WY, Hu YP. Artificial bee colony algorithm for single-trial electroencephalogram analysis. Clin EEG Neurosci 2015; 46:119-25. [PMID: 25392006 DOI: 10.1177/1550059414538808] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/19/2014] [Accepted: 05/12/2014] [Indexed: 11/16/2022]
Abstract
In this study, we propose an analysis system combined with feature selection to further improve the classification accuracy of single-trial electroencephalogram (EEG) data. Acquiring event-related brain potential data from the sensorimotor cortices, the system comprises artifact and background noise removal, feature extraction, feature selection, and feature classification. First, the artifacts and background noise are removed automatically by means of independent component analysis and surface Laplacian filter, respectively. Several potential features, such as band power, autoregressive model, and coherence and phase-locking value, are then extracted for subsequent classification. Next, artificial bee colony (ABC) algorithm is used to select features from the aforementioned feature combination. Finally, selected subfeatures are classified by support vector machine. Comparing with and without artifact removal and feature selection, using a genetic algorithm on single-trial EEG data for 6 subjects, the results indicate that the proposed system is promising and suitable for brain-computer interface applications.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, Chiayi, Taiwan Advanced Institute of Manufacturing with High-tech Innovations, National Chung Cheng University, Chiayi, Taiwan
| | - Ya-Ping Hu
- Department of Information Management, National Chung Cheng University, Chiayi, Taiwan
| |
Collapse
|
7
|
Abstract
In this study, an electroencephalogram (EEG) analysis system combined with feature selection, is proposed to enhance the classification of motor imagery (MI) data. It principally comprises feature extraction, feature selection, and classification. First, several features, including adaptive autoregressive (AAR) parameters, spectral power, asymmetry ratio, coherence and phase-locking value are extracted for subsequent classification. A genetic algorithm is then used to select features from the combination of the aforementioned features. Finally, the selected features are classified by support vector machine (SVM). Compared with "without feature selection" and back-propagation neural network (BPNN) on MI data from 2 data sets, the proposed system achieves better classification accuracy and is suitable for the applications of brain-computer interface (BCI).
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, Chiayi County, Taiwan
| |
Collapse
|
8
|
Hsu WY. Embedded grey relation theory in Hopfield neural network: application to motor imagery EEG recognition. Clin EEG Neurosci 2013; 44:257-64. [PMID: 23536381 DOI: 10.1177/1550059413477090] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
In this study, grey-based Hopfield neural network (GHNN), is proposed for the unsupervised analysis of motor imagery (MI) electroencephalogram (EEG) data. Combined with segment selection and feature extraction, GHNN is used for the recognition of left and right MI data. A Gaussian-like filter is proposed to reduce noise, to further enhance performance of active segment selection. Features are extracted by coherence from wavelet data, and then discriminated by GHNN, which is an unsupervised approach suitable for the online classification of nonstationary biomedical signals. Compared to EEG data without segment selection, several usual features, and classifiers, the proposed system is potentially an analytic approach in brain-computer interface (BCI) applications.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, Taiwan
| |
Collapse
|
9
|
HSU WEIYEN. Application of quantum-behaved particle swarm optimization to motor imagery EEG classification. Int J Neural Syst 2013; 23:1350026. [PMID: 24156669 DOI: 10.1142/s0129065713500263] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
In this study, we propose a recognition system for single-trial analysis of motor imagery (MI) electroencephalogram (EEG) data. Applying event-related brain potential (ERP) data acquired from the sensorimotor cortices, the system chiefly consists of automatic artifact elimination, feature extraction, feature selection and classification. In addition to the use of independent component analysis, a similarity measure is proposed to further remove the electrooculographic (EOG) artifacts automatically. Several potential features, such as wavelet-fractal features, are then extracted for subsequent classification. Next, quantum-behaved particle swarm optimization (QPSO) is used to select features from the feature combination. Finally, selected sub-features are classified by support vector machine (SVM). Compared with without artifact elimination, feature selection using a genetic algorithm (GA) and feature classification with Fisher's linear discriminant (FLD) on MI data from two data sets for eight subjects, the results indicate that the proposed method is promising in brain-computer interface (BCI) applications.
Collapse
Affiliation(s)
- WEI-YEN HSU
- Department of Information Management, Advanced Institute of Manufacturing with High-tech Innovations, National Chung Cheng University, No. 168, Sec. 1, University Rd., Min-Hsiung Township, Chia-yi County 621, Taiwan
| |
Collapse
|
10
|
Hsu WY. A Practical Approach Based on Analytic Deformable Algorithm for Scenic Image Registration. PLoS One 2013; 8:e66656. [PMID: 23805257 PMCID: PMC3689666 DOI: 10.1371/journal.pone.0066656] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2013] [Accepted: 05/08/2013] [Indexed: 12/19/2022] Open
Abstract
Background Image registration is to produce an entire scene by aligning all the acquired image sequences. A registration algorithm is necessary to tolerance as much as possible for intensity and geometric variation among images. However, captured image views of real scene usually produce unexpected distortions. They are generally derived from the optic characteristics of image sensors or caused by the specific scenes and objects. Methods and Findings An analytic registration algorithm considering the deformation is proposed for scenic image applications in this study. After extracting important features by the wavelet-based edge correlation method, an analytic registration approach is then proposed to achieve deformable and accurate matching of point sets. Finally, the registration accuracy is further refined to obtain subpixel precision by a feature-based Levenberg-Marquardt (FLM) method. It converges evidently faster than most other methods because of its feature-based characteristic. Conclusions We validate the performance of proposed method by testing with synthetic and real image sequences acquired by a hand-held digital still camera (DSC) and in comparison with an optical flow-based motion technique in terms of the squared sum of intensity differences (SSD) and correlation coefficient (CC). The results indicate that the proposed method is satisfactory in the registration accuracy and quality of DSC images.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, Chiayi County, Taiwan
- * E-mail:
| |
Collapse
|
11
|
HSU WEIYEN. SINGLE-TRIAL MOTOR IMAGERY CLASSIFICATION USING ASYMMETRY RATIO, PHASE RELATION, WAVELET-BASED FRACTAL, AND THEIR SELECTED COMBINATION. Int J Neural Syst 2013; 23:1350007. [PMID: 23578057 DOI: 10.1142/s012906571350007x] [Citation(s) in RCA: 47] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
An electroencephalogram (EEG) analysis system is proposed for single-trial classification of motor imagery (MI) data in this study. Applying event-related brain potential (ERP) data acquired from the sensorimotor cortices, the system mainly consists of enhanced active segment selection, feature extraction, feature selection and classification. In addition to the original use of continuous wavelet transform (CWT) and Student's two-sample t-statistics, the 2D anisotropic Gaussian filter is proposed to further refine the selection of active segments. We then extract several features, including spectral power and asymmetry ratio, coherence and phase-locking value, and multiresolution fractal feature vector, for subsequent classification. Next, genetic algorithm (GA) is used to select features from the combination of above-mentioned features. Finally, support vector machine (SVM) is used for classification. Compared with "without enhanced active segment selection," several potential features and linear discriminant analysis (LDA) on MI data from two data sets for 10 subjects, the results indicate that the proposed method achieves 86.7% average classification accuracy, which is promising in BCI applications.
Collapse
Affiliation(s)
- WEI-YEN HSU
- Department of Information Management, National Chung Cheng University, No. 168, Sec. 1, University Rd., Min-Hsiung Township, Chia-yi County 621, Taiwan
| |
Collapse
|
12
|
Hsu WY. Independent component analysis and multiresolution asymmetry ratio for brain-computer interface. Clin EEG Neurosci 2013; 44:105-11. [PMID: 23372028 DOI: 10.1177/1550059412463660] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This study proposes a brain-computer interface (BCI) system for the recognition of single-trial electroencephalogram (EEG) data. With the combination of independent component analysis (ICA) and multiresolution asymmetry ratio, a support vector machine (SVM) is used to classify left and right finger lifting or motor imagery. First, ICA and similarity measures are proposed to eliminate the electrooculography (EOG) artifacts automatically. The features are then extracted from the wavelet data by means of an asymmetry ratio. Finally, the SVM classifier is used to discriminate between the features. Compared to the EEG data without EOG artifact removal, band power, and adoptive autoregressive (AAR) parameter features, the proposed system achieves promising results in BCI applications.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, Taiwan.
| |
Collapse
|
13
|
Abstract
In this study, an analysis system embedding neuron-fuzzy prediction in feature extraction is proposed for brain-computer interface (BCI) applications. Wavelet-fractal features combined with neuro-fuzzy predictions are applied for feature extraction in motor imagery (MI) discrimination. The features are extracted from the electroencephalography (EEG) signals recorded from participants performing left and right MI. Time-series predictions are performed by training 2 adaptive neuro-fuzzy inference systems (ANFIS) for respective left and right MI data. Features are then calculated from the difference in multi-resolution fractal feature vector (MFFV) between the predicted and actual signals through a window of EEG signals. Finally, the support vector machine is used for classification. The proposed method estimates its performance in comparison with the linear adaptive autoregressive (AAR) model and the AAR time-series prediction of 6 participants from 2 data sets. The results indicate that the proposed method is promising in MI classification.
Collapse
Affiliation(s)
- Wei-Yen Hsu
- Department of Information Management, National Chung Cheng University, Taiwan.
| |
Collapse
|