1
|
Li R, Bai D, Li Z, Yang S, Liu W, Zhang Y, Zhou J, Luo J, Wang W. The SSHVEP Paradigm-Based Brain Controlled Method for Grasping Robot Using MVMD Combined CNN Model. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2564-2578. [PMID: 38980788 DOI: 10.1109/tnsre.2024.3425636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/11/2024]
Abstract
In recent years, the steady-state visual evoked potentials (SSVEP) based brain control method has been employed to help people with disabilities because of its advantages of high information transmission rate and low training time. However, the existing SSVEP brain control methods cannot adapt to dynamic or unstructured environments. Moreover, the recognition accuracy from the conventional decoding algorithm still needs to improve. To address the above problems, this study proposed a steady-state hybrid visual evoked potentials (SSHVEP) paradigm using the grasping targets in their environment to improve the connection between the subjects' and their dynamic environments. Moreover, a novel EEG decoding method, using the multivariate variational mode decomposition (MVMD) algorithm for adaptive sub-band division and convolutional neural network (CNN) for target recognition, was applied to improve the decoding accuracy of the SSHVEPs. 18 subjects participated in the offline and online experiments. The offline accuracy across 18 subjects by the 9-target SSHVEP paradigm was up to 95.41 ± 2.70 %, which is a 5.80% improvement compared to the conventional algorithm. To further validate the performance of the proposed method, the brain-controlled grasping robot system using the SSHVEP paradigm was built. The average accuracy reached 93.21 ± 10.18 % for the online experiment. All the experimental results demonstrated the effectiveness of the brain-computer interaction method based on the SSHVEP paradigm and the MVMD combined CNN algorithm studied in this paper.
Collapse
|
2
|
Niu L, Bin J, kong shuai Wang J, Zhan G, Zhang L, Gan Z, Kang X. A dynamically optimized time-window length for SSVEP based hybrid BCI-VR system. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2023]
|
3
|
Fu R, Li Z, Wang S, Xu D, Huang X, Liang H. EEG-based driver states discrimination by noise fraction analysis and novel clustering algorithm. BIOMED ENG-BIOMED TE 2023:bmt-2022-0395. [PMID: 36848391 DOI: 10.1515/bmt-2022-0395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 02/10/2023] [Indexed: 03/01/2023]
Abstract
Driver states are reported as one of the principal factors in driving safety. Distinguishing the driving driver state based on the artifact-free electroencephalogram (EEG) signal is an effective means, but redundant information and noise will inevitably reduce the signal-to-noise ratio of the EEG signal. This study proposes a method to automatically remove electrooculography (EOG) artifacts by noise fraction analysis. Specifically, multi-channel EEG recordings are collected after the driver experiences a long time driving and after a certain period of rest respectively. Noise fraction analysis is then applied to remove EOG artifacts by separating the multichannel EEG into components by optimizing the signal-to-noise quotient. The representation of data characteristics of the EEG after denoising is found in the Fisher ratio space. Additionally, a novel clustering algorithm is designed to identify denoising EEG by combining cluster ensemble and probability mixture model (CEPM). The EEG mapping plot is used to illustrate the effectiveness and efficiency of noise fraction analysis on the denoising of EEG signals. Adjusted rand index (ARI) and accuracy (ACC) are used to demonstrate clustering performance and precision. The results showed that the noise artifacts in the EEG were removed and the clustering accuracy of all participants was above 90%, resulting in a high driver fatigue recognition rate.
Collapse
Affiliation(s)
- Rongrong Fu
- Department of Electrical Engineering, Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, China
| | - Zheyu Li
- Department of Electrical Engineering, Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, China
| | - Shiwei Wang
- Jiangxi New Energy Technology Institute, Xinyu, China
| | - Dong Xu
- Department of Electrical Engineering, Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, China
| | - Xiaodong Huang
- Department of Electrical Engineering, Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, China
| | - Haifeng Liang
- Department of Electrical Engineering, Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, China
| |
Collapse
|
4
|
Cherloo MN, Amiri HK, Daliri MR. Spatio-Spectral CCA (SS-CCA): A Novel Approach for Frequency Recognition in SSVEP-Based BCI. J Neurosci Methods 2022; 371:109499. [DOI: 10.1016/j.jneumeth.2022.109499] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 01/31/2022] [Accepted: 02/08/2022] [Indexed: 12/24/2022]
|
5
|
Carvalho SND, Vargas GV, da Silva Costa TB, de Arruda Leite HM, Coradine L, Boccato L, Soriano DC, Attux R. Space-time filter for SSVEP brain-computer interface based on the minimum variance distortionless response. Med Biol Eng Comput 2021; 59:1133-1150. [PMID: 33909252 DOI: 10.1007/s11517-021-02345-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Accepted: 03/17/2021] [Indexed: 11/25/2022]
Abstract
Brain-computer interfaces (BCI) based on steady-state visually evoked potentials (SSVEP) have been increasingly used in different applications, ranging from entertainment to rehabilitation. Filtering techniques are crucial to detect the SSVEP response since they can increase the accuracy of the system. Here, we present an analysis of a space-time filter based on the Minimum Variance Distortionless Response (MVDR). We have compared the performance of a BCI-SSVEP using the MVDR filter to other classical approaches: Common Average Reference (CAR) and Canonical Correlation Analysis (CCA). Moreover, we combined the CAR and MVDR techniques, totalling four filtering scenarios. Feature extraction was performed using Welch periodogram, Fast Fourier transform, and CCA (as extractor) with one and two harmonics. Feature selection was performed by forward wrappers, and a linear classifier was employed for discrimination. The main analyses were carried out over a database of ten volunteers, considering two cases: four and six visual stimuli. The results show that the BCI-SSVEP using the MVDR filter achieves the best performance among the analysed scenarios. Interestingly, the system's accuracy using the MVDR filter is practically constant even when the number of visual stimuli was increased, whereas degradation was observed for the other techniques.
Collapse
Affiliation(s)
- Sarah Negreiros de Carvalho
- Institute of Exact and Applied Sciences, Federal University of Ouro Preto, UFOP, Ouro Preto, Brazil.
- Brazilian Institute of Neuroscience and Neurotechnology, BRAINN, Campinas, Brazil.
| | | | - Thiago Bulhões da Silva Costa
- Brazilian Institute of Neuroscience and Neurotechnology, BRAINN, Campinas, Brazil
- School of Computer and Electrical Engineering, University of Campinas, UNICAMP, Campinas, Brazil
| | - Harlei Miguel de Arruda Leite
- Institute of Exact and Applied Sciences, Federal University of Ouro Preto, UFOP, Ouro Preto, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, BRAINN, Campinas, Brazil
| | - Luís Coradine
- Institute of Computing, Federal University of Alagoas, UFAL, Maceió, Brazil
| | - Levy Boccato
- School of Computer and Electrical Engineering, University of Campinas, UNICAMP, Campinas, Brazil
| | - Diogo Coutinho Soriano
- Brazilian Institute of Neuroscience and Neurotechnology, BRAINN, Campinas, Brazil
- Engineering, Modeling and Applied Social Sciences Center, Federal University of ABC, UFABC, Santo André, Brazil
| | - Romis Attux
- Brazilian Institute of Neuroscience and Neurotechnology, BRAINN, Campinas, Brazil
- School of Computer and Electrical Engineering, University of Campinas, UNICAMP, Campinas, Brazil
| |
Collapse
|
6
|
Qin K, Wang R, Zhang Y. Filter Bank-Driven Multivariate Synchronization Index for Training-Free SSVEP BCI. IEEE Trans Neural Syst Rehabil Eng 2021; 29:934-943. [PMID: 33852389 DOI: 10.1109/tnsre.2021.3073165] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In recent years, multivariate synchronization index (MSI) algorithm, as a novel frequency detection method, has attracted increasing attentions in the study of brain-computer interfaces (BCIs) based on steady state visual evoked potential (SSVEP). However, MSI algorithm is hard to fully exploit SSVEP-related harmonic components in the electroencephalogram (EEG), which limits the application of MSI algorithm in BCI systems. In this paper, we propose a novel filter bank-driven MSI algorithm (FBMSI) to overcome the limitation and further improve the accuracy of SSVEP recognition. We evaluate the efficacy of the FBMSI method by developing a 6-command SSVEP-NAO robot system with extensive experimental analyses. An offline experimental study is first performed with EEG collected from nine subjects to investigate the effects of varying parameters on the model performance. Offline results show that the proposed method has achieved a stable improvement effect. We further conduct an online experiment with six subjects to assess the efficacy of the developed FBMSI algorithm in a real-time BCI application. The online experimental results show that the FBMSI algorithm yields a promising average accuracy of 83.56% using a data length of even only one second, which was 12.26% higher than the standard MSI algorithm. These extensive experimental results confirmed the effectiveness of the FBMSI algorithm in SSVEP recognition and demonstrated its potential application in the development of improved BCI systems.
Collapse
|
7
|
Lee HK, Choi YS. Enhancing SSVEP-Based Brain-Computer Interface with Two-Step Task-Related Component Analysis. SENSORS 2021; 21:s21041315. [PMID: 33673137 PMCID: PMC7918701 DOI: 10.3390/s21041315] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Revised: 02/06/2021] [Accepted: 02/09/2021] [Indexed: 11/16/2022]
Abstract
Among various methods for frequency recognition of the steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) study, a task-related component analysis (TRCA), which extracts discriminative spatial filters for classifying electroencephalogram (EEG) signals, has gathered much interest. The TRCA-based SSVEP method yields lower computational cost and higher classification performance compared to existing SSVEP methods. In spite of its utility, the TRCA-based SSVEP method still suffers from the degradation of the frequency recognition rate in cases where EEG signals with a short length window are used. To address this issue, here, we propose an improved strategy for decoding SSVEPs, which is insensitive to a window length by carrying out two-step TRCA. The proposed method reuses the spatial filters corresponding to target frequencies generated by the TRCA. Followingly, the proposed method accentuates features for target frequencies by correlating individual template and test data. For the evaluation of the performance of the proposed method, we used a benchmark dataset with 35 subjects and confirmed significantly improved performance comparing with other existing SSVEP methods. These results imply the suitability as an efficient frequency recognition strategy for SSVEP-based BCI applications.
Collapse
|