1
|
Li X, Yang S, Fei N, Wang J, Huang W, Hu Y. A Convolutional Neural Network for SSVEP Identification by Using a Few-Channel EEG. Bioengineering (Basel) 2024; 11:613. [PMID: 38927850 PMCID: PMC11200714 DOI: 10.3390/bioengineering11060613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Revised: 05/11/2024] [Accepted: 06/08/2024] [Indexed: 06/28/2024] Open
Abstract
The application of wearable electroencephalogram (EEG) devices is growing in brain-computer interfaces (BCI) owing to their good wearability and portability. Compared with conventional devices, wearable devices typically support fewer EEG channels. Devices with few-channel EEGs have been proven to be available for steady-state visual evoked potential (SSVEP)-based BCI. However, fewer-channel EEGs can cause the BCI performance to decrease. To address this issue, an attention-based complex spectrum-convolutional neural network (atten-CCNN) is proposed in this study, which combines a CNN with a squeeze-and-excitation block and uses the spectrum of the EEG signal as the input. The proposed model was assessed on a wearable 40-class dataset and a public 12-class dataset under subject-independent and subject-dependent conditions. The results show that whether using a three-channel EEG or single-channel EEG for SSVEP identification, atten-CCNN outperformed the baseline models, indicating that the new model can effectively enhance the performance of SSVEP-BCI with few-channel EEGs. Therefore, this SSVEP identification algorithm based on a few-channel EEG is particularly suitable for use with wearable EEG devices.
Collapse
Affiliation(s)
- Xiaodong Li
- Orthopedics Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen 518053, China
- Department of Orthopaedics and Traumatology, The University of Hong Kong, Hong Kong SAR, China
| | - Shuoheng Yang
- Orthopedics Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen 518053, China
- Department of Orthopaedics and Traumatology, The University of Hong Kong, Hong Kong SAR, China
| | - Ningbo Fei
- Department of Orthopaedics and Traumatology, The University of Hong Kong, Hong Kong SAR, China
| | - Junlin Wang
- Orthopedics Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen 518053, China
- Department of Orthopaedics and Traumatology, The University of Hong Kong, Hong Kong SAR, China
| | - Wei Huang
- Department of Rehabilitation, The Second Affiliated Hospital of Guangdong Medical University, Zhanjiang 524003, China
| | - Yong Hu
- Orthopedics Center, The University of Hong Kong-Shenzhen Hospital, Shenzhen 518053, China
- Department of Orthopaedics and Traumatology, The University of Hong Kong, Hong Kong SAR, China
- Department of Rehabilitation, The Second Affiliated Hospital of Guangdong Medical University, Zhanjiang 524003, China
| |
Collapse
|
2
|
Chen SY, Chang CM, Chiang KJ, Wei CS. SSVEP-DAN: Cross-Domain Data Alignment for SSVEP-Based Brain-Computer Interfaces. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2027-2037. [PMID: 38781061 DOI: 10.1109/tnsre.2024.3404432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/25/2024]
Abstract
Steady-state visual-evoked potential (SSVEP)-based brain-computer interfaces (BCIs) offer a non-invasive means of communication through high-speed speller systems. However, their efficiency is highly dependent on individual training data acquired during time-consuming calibration sessions. To address the challenge of data insufficiency in SSVEP-based BCIs, we introduce SSVEP-DAN, the first dedicated neural network model designed to align SSVEP data across different domains, encompassing various sessions, subjects, or devices. Our experimental results demonstrate the ability of SSVEP-DAN to transform existing source SSVEP data into supplementary calibration data. This results in a significant improvement in SSVEP decoding accuracy while reducing the calibration time. We envision SSVEP-DAN playing a crucial role in future applications of high-performance SSVEP-based BCIs. The source code for this work is available at: https://github.com/CECNL/SSVEP-DAN.
Collapse
|
3
|
Gu M, Pei W, Gao X, Wang Y. An open dataset for human SSVEPs in the frequency range of 1-60 Hz. Sci Data 2024; 11:196. [PMID: 38351064 PMCID: PMC10864273 DOI: 10.1038/s41597-024-03023-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 01/30/2024] [Indexed: 02/16/2024] Open
Abstract
A steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) system relies on the photic driving response to effectively elicit characteristic electroencephalogram (EEG) signals. However, traditional visual stimuli mainly adopt high-contrast black-and-white flickering stimulations, which are easy to cause visual fatigue. This paper presents an SSVEP dataset acquired at a wide frequency range from 1 to 60 Hz with an interval of 1 Hz using flickering stimuli under two different modulation depths. This dataset contains 64-channel EEG data from 30 healthy subjects when they fixated on a single flickering stimulus. The stimulus was rendered on an LCD display with a refresh rate of 240 Hz. Initially, the dataset was rigorously validated through comprehensive data analysis to investigate SSVEP responses and user experiences. Subsequently, BCI performance was evaluated through offline simulations of frequency-coded and phase-coded BCI paradigms. This dataset provides comprehensive and high-quality data for studying and developing SSVEP-based BCI systems.
Collapse
Affiliation(s)
- Meng Gu
- Key Laboratory of Solid-State Optoelectronics Information Technology, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China
- College of Materials Science and Opto-Electronic Technology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Weihua Pei
- Key Laboratory of Solid-State Optoelectronics Information Technology, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China
- School of Future Technology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Yijun Wang
- Key Laboratory of Solid-State Optoelectronics Information Technology, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China.
- School of Future Technology, University of Chinese Academy of Sciences, Beijing, 100049, China.
- Chinese Institute for Brain Research, Beijing, 102206, China.
| |
Collapse
|
4
|
Mu J, Liu S, Burkitt AN, Grayden DB. Multi-frequency steady-state visual evoked potential dataset. Sci Data 2024; 11:26. [PMID: 38177151 PMCID: PMC10766626 DOI: 10.1038/s41597-023-02841-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 12/11/2023] [Indexed: 01/06/2024] Open
Abstract
The Steady-State Visual Evoked Potential (SSVEP) is a widely used modality in Brain-Computer Interfaces (BCIs). Existing research has demonstrated the capabilities of SSVEP that use single frequencies for each target in various applications with relatively small numbers of commands required in the BCI. Multi-frequency SSVEP has been developed to extend the capability of single-frequency SSVEP to tasks that involve large numbers of commands. However, the development on multi-frequency SSVEP methodologies is falling behind compared to the number of studies with single-frequency SSVEP. This dataset was constructed to promote research in multi-frequency SSVEP by making SSVEP signals collected with different frequency stimulation settings publicly available. In this dataset, SSVEPs were collected from 35 participants using single-, dual-, and tri-frequency stimulation and with three different multi-frequency stimulation variants.
Collapse
Affiliation(s)
- Jing Mu
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, 3010, Australia.
- Graeme Clark Institute, The University of Melbourne, Parkville, Victoria, 3010, Australia.
| | - Shuo Liu
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, 3010, Australia
| | - Anthony N Burkitt
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, 3010, Australia
| | - David B Grayden
- Department of Biomedical Engineering, The University of Melbourne, Parkville, Victoria, 3010, Australia
- Graeme Clark Institute, The University of Melbourne, Parkville, Victoria, 3010, Australia
| |
Collapse
|
5
|
Maiseli B, Abdalla AT, Massawe LV, Mbise M, Mkocha K, Nassor NA, Ismail M, Michael J, Kimambo S. Brain-computer interface: trend, challenges, and threats. Brain Inform 2023; 10:20. [PMID: 37540385 PMCID: PMC10403483 DOI: 10.1186/s40708-023-00199-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Accepted: 07/01/2023] [Indexed: 08/05/2023] Open
Abstract
Brain-computer interface (BCI), an emerging technology that facilitates communication between brain and computer, has attracted a great deal of research in recent years. Researchers provide experimental results demonstrating that BCI can restore the capabilities of physically challenged people, hence improving the quality of their lives. BCI has revolutionized and positively impacted several industries, including entertainment and gaming, automation and control, education, neuromarketing, and neuroergonomics. Notwithstanding its broad range of applications, the global trend of BCI remains lightly discussed in the literature. Understanding the trend may inform researchers and practitioners on the direction of the field, and on where they should invest their efforts more. Noting this significance, we have analyzed 25,336 metadata of BCI publications from Scopus to determine advancement of the field. The analysis shows an exponential growth of BCI publications in China from 2019 onwards, exceeding those from the United States that started to decline during the same period. Implications and reasons for this trend are discussed. Furthermore, we have extensively discussed challenges and threats limiting exploitation of BCI capabilities. A typical BCI architecture is hypothesized to address two prominent BCI threats, privacy and security, as an attempt to make the technology commercially viable to the society.
Collapse
Affiliation(s)
- Baraka Maiseli
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania.
| | - Abdi T Abdalla
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Libe V Massawe
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Mercy Mbise
- Department of Computer Science and Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Khadija Mkocha
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Nassor Ally Nassor
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Moses Ismail
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - James Michael
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Samwel Kimambo
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| |
Collapse
|
6
|
Liang L, Zhang Q, Zhou J, Li W, Gao X. Dataset Evaluation Method and Application for Performance Testing of SSVEP-BCI Decoding Algorithm. SENSORS (BASEL, SWITZERLAND) 2023; 23:6310. [PMID: 37514603 PMCID: PMC10385518 DOI: 10.3390/s23146310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 06/24/2023] [Accepted: 07/07/2023] [Indexed: 07/30/2023]
Abstract
Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems have been extensively researched over the past two decades, and multiple sets of standard datasets have been published and widely used. However, there are differences in sample distribution and collection equipment across different datasets, and there is a lack of a unified evaluation method. Most new SSVEP decoding algorithms are tested based on self-collected data or offline performance verification using one or two previous datasets, which can lead to performance differences when used in actual application scenarios. To address these issues, this paper proposed a SSVEP dataset evaluation method and analyzed six datasets with frequency and phase modulation paradigms to form an SSVEP algorithm evaluation dataset system. Finally, based on the above datasets, performance tests were carried out on the four existing SSVEP decoding algorithms. The findings reveal that the performance of the same algorithm varies significantly when tested on diverse datasets. Substantial performance variations were observed among subjects, ranging from the best-performing to the worst-performing. The above results demonstrate that the SSVEP dataset evaluation method can integrate six datasets to form a SSVEP algorithm performance testing dataset system. This system can test and verify the SSVEP decoding algorithm from different perspectives such as different subjects, different environments, and different equipment, which is helpful for the research of new SSVEP decoding algorithms and has significant reference value for other BCI application fields.
Collapse
Affiliation(s)
- Liyan Liang
- China Academy of Information and Communications Technology, Beijing 100161, China
| | - Qian Zhang
- China Academy of Information and Communications Technology, Beijing 100161, China
| | - Jie Zhou
- China Academy of Information and Communications Technology, Beijing 100161, China
| | - Wenyu Li
- China Academy of Information and Communications Technology, Beijing 100161, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| |
Collapse
|
7
|
Mu J, Grayden DB, Tan Y, Oetomo D. Experimental validation on dual-frequency outperforms single-frequency SSVEP with large numbers of targets within a given frequency range. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082777 DOI: 10.1109/embc40787.2023.10340718] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Multi-frequency steady-state visual evoked potential (SSVEP) aims to increase the number of targets in SSVEP-based brain-computer interfaces. However, the effectiveness of multi-frequency SSVEP when there is a large number of targets compared to traditional single-frequency SSVEP has not been demonstrated to date. It is also unclear the degree to which multi-frequency SSVEP outperforms single-frequency SSVEP as the number of targets increases. This study directly compares single-frequency and dual-frequency SSVEPs for different numbers of targets within a fixed (5 Hz) frequency range. Our results demonstrate that dual-frequency SSVEP maintains its performance at a high level of accuracy in the range while single-frequency SSVEP performance falls as the number of targets becomes very high within the given frequency range. In this particular study, dual-frequency SSVEP has a clear advantage when there are more than 120 targets in a 5 Hz frequency range.
Collapse
|
8
|
Chailloux Peguero JD, Hernández-Rojas LG, Mendoza-Montoya O, Caraza R, Antelis JM. SSVEP detection assessment by combining visual stimuli paradigms and no-training detection methods. Front Neurosci 2023; 17:1142892. [PMID: 37274188 PMCID: PMC10233154 DOI: 10.3389/fnins.2023.1142892] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 04/25/2023] [Indexed: 06/06/2023] Open
Abstract
Introduction Brain-Computer Interfaces (BCI) based on Steady-State Visually Evoked Potentials (SSVEP) have great potential for use in communication applications because of their relatively simple assembly and in some cases the possibility of bypassing the time-consuming training stage. However, among multiple factors, the efficient performance of this technology is highly dependent on the stimulation paradigm applied in combination with the SSVEP detection algorithm employed. This paper proposes the performance assessment of the classification of target events with respect to non-target events by applying four types of visual paradigms, rectangular modulated On-Off (OOR), sinusoidal modulated On-Off (OOS), rectangular modulated Checkerboard (CBR), and sinusoidal modulated Checkerboard (CBS), with three types of SSVEP detection methods, Canonical Correlation Analysis (CCA), Filter-Bank CCA (FBCCA), and Minimum Energy Combination (MEC). Methods We set up an experimental protocol in which the four types of visual stimuli were presented randomly to twenty-seven participants and after acquiring their electroencephalographic responses to five stimulation frequencies (8.57, 10.909, 15, 20, and 24 Hz), the three detection methods were applied to the collected data. Results The results are conclusive, obtaining the best performance with the combination of either OOR or OOS visual stimulus and the FBCCA as a detection method, however, this finding contrasts with the opinion of almost half of the participants in terms of visual comfort, where the 51.9% of the subjects felt more comfortable and focused with CBR or CBS stimulation. Discussion Finally, the EEG recordings correspond to the SSVEP response of 27 subjects to four visual paradigms when selecting five items on a screen, which is useful in BCI navigation applications. The dataset is available to anyone interested in studying and evaluating signal processing and machine-learning algorithms for SSVEP-BCI systems.
Collapse
Affiliation(s)
| | | | | | - Ricardo Caraza
- Tecnologico de Monterrey, School of Medicine and Health Sciences, Monterrey, Mexico
| | - Javier M. Antelis
- Tecnologico de Monterrey, School of Engineering and Sciences, Monterrey, Mexico
| |
Collapse
|
9
|
Xu D, Tang F, Li Y, Zhang Q, Feng X. An Analysis of Deep Learning Models in SSVEP-Based BCI: A Survey. Brain Sci 2023; 13:483. [PMID: 36979293 PMCID: PMC10046535 DOI: 10.3390/brainsci13030483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 03/04/2023] [Accepted: 03/10/2023] [Indexed: 03/15/2023] Open
Abstract
The brain-computer interface (BCI), which provides a new way for humans to directly communicate with robots without the involvement of the peripheral nervous system, has recently attracted much attention. Among all the BCI paradigms, BCIs based on steady-state visual evoked potentials (SSVEPs) have the highest information transfer rate (ITR) and the shortest training time. Meanwhile, deep learning has provided an effective and feasible solution for solving complex classification problems in many fields, and many researchers have started to apply deep learning to classify SSVEP signals. However, the designs of deep learning models vary drastically. There are many hyper-parameters that influence the performance of the model in an unpredictable way. This study surveyed 31 deep learning models (2011-2023) that were used to classify SSVEP signals and analyzed their design aspects including model input, model structure, performance measure, etc. Most of the studies that were surveyed in this paper were published in 2021 and 2022. This survey is an up-to-date design guide for researchers who are interested in using deep learning models to classify SSVEP signals.
Collapse
Affiliation(s)
- Dongcen Xu
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (D.X.); (F.T.); (Y.L.); (Q.Z.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Fengzhen Tang
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (D.X.); (F.T.); (Y.L.); (Q.Z.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| | - Yiping Li
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (D.X.); (F.T.); (Y.L.); (Q.Z.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| | - Qifeng Zhang
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (D.X.); (F.T.); (Y.L.); (Q.Z.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| | - Xisheng Feng
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (D.X.); (F.T.); (Y.L.); (Q.Z.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| |
Collapse
|
10
|
Zhang L, Deng Y, Hui R, Tang Y, Yu S, Li Y, Hu Y, Li N. The effects of acupuncture on clinical efficacy and steady-state visual evoked potentials in insomnia patients with emotional disorders: A randomized single-blind sham-controlled trial. Front Neurol 2023; 13:1053642. [PMID: 36742043 PMCID: PMC9889562 DOI: 10.3389/fneur.2022.1053642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 12/13/2022] [Indexed: 01/20/2023] Open
Abstract
The aim of this study was to observe the clinical effects and brain electrical potential changes following acupuncture in the treatment of insomnia patients with mood disorders. Ninety patients with insomnia who met the inclusion criteria were randomly divided into the active acupuncture group (AA group, n = 44) and sham acupuncture group (SA group, n = 46) at a ratio of 1:1. The primary outcome was the total score of the Pittsburgh Sleep Quality Index (PSQI), and the secondary outcomes were the total effective rate, Self-Rating Anxiety Scale (SAS), Self-Rating Depression Scale (SDS) scores, and values of steady-state visual evoked potentials (SSVEP). The two groups received acupuncture or sham acupuncture 10 times (2 weeks). Finally, the total PSQI scores of the AA group and SA group were significantly different (p < 0.05) at 2 weeks (6.11 ± 2.33 vs. 10.37 ± 4.73), 6 weeks (6.27 ± 1.39 vs. 11.93 ± 3.07), 18 weeks (6.32 ± 2.84 vs. 11.78 ± 2.95) and 42 weeks (8.05 ± 3.14 vs. 12.54 ± 2.81). Further analysis found that AA group patients received acupuncture treatment at any age after the same effect (p > 0.05). The SAS and SDS scores of the AA group were also significantly different from those of the SA group at each assessment time point (p < 0.05). The total effective rate of the AA group was 81.82%, while that of the SA group was 30.43% (p < 0.05). There was no significant difference between the AA group and SA group only in the brain potential of the parietal lobe (F4), left temporal lobe (C3) and right temporal lobe (T8) (P > 0.05), but there was a significant difference between other brain regions (P < 0.05). In addition, correlation analysis showed that there was a certain positive correlation between the total PSQI score, SAS score, efficacy level, and SSVEP value in the AA group as follows: C4 and the total PSQI score (r = 0.595, P = 0.041), F3 and SAS score (r = 0.604, P = 0.037), FPz and efficiency level of the frontal lobe (r = 0.581, P = 0.048), and O2 and efficiency level of the occipital lobe (r = 0.704, P = 0.011). Therefore, acupuncture have a good clinical effect on patients with insomnia and emotional disorders and have a significant regulatory effect on abnormally excited brain potentials.
Collapse
Affiliation(s)
- Leixiao Zhang
- Department of Integrated Traditional and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Yanli Deng
- Sichuan Second Chinese Medicine Hospital, Chengdu, China
| | - Ruting Hui
- Chengdu First People's Hospital, Chengdu, China
| | - Yu Tang
- Chongqing Emergency Medical Center, Chongqing, China
| | - Siyi Yu
- Acupuncture and Tuina School, Chengdu University of Traditional Chinese Medicine, Chengdu, China
| | - Ying Li
- Acupuncture and Tuina School, Chengdu University of Traditional Chinese Medicine, Chengdu, China
| | - Youping Hu
- Acupuncture and Tuina School, Chengdu University of Traditional Chinese Medicine, Chengdu, China,*Correspondence: Youping Hu ✉
| | - Ning Li
- Department of Integrated Traditional and Western Medicine, West China Hospital, Sichuan University, Chengdu, China,Ning Li ✉
| |
Collapse
|
11
|
Mu J, Grayden DB, Tan Y, Oetomo D. Frequency set selection for multi-frequency steady-state visual evoked potential-based brain-computer interfaces. Front Neurosci 2022; 16:1057010. [PMID: 36620442 PMCID: PMC9811191 DOI: 10.3389/fnins.2022.1057010] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 11/30/2022] [Indexed: 12/24/2022] Open
Abstract
Objective Multi-frequency steady-state visual evoked potential (SSVEP) stimulation and decoding methods enable the representation of a large number of visual targets in brain-computer interfaces (BCIs). However, unlike traditional single-frequency SSVEP, multi-frequency SSVEP is not yet widely used. One of the key reasons is that the redundancy in the input options requires an additional selection process to define an effective set of frequencies for the interface. This study investigates systematic frequency set selection methods. Methods An optimization strategy based on the analysis of the frequency components in the resulting multi-frequency SSVEP is proposed, investigated and compared to existing methods, which are constructed based on the analysis of the stimulation (input) signals. We hypothesized that minimizing the occurrence of common sums in the multi-frequency SSVEP improves the performance of the interface, and that selection by pairs further increases the accuracy compared to selection by frequencies. An experiment with 12 participants was conducted to validate the hypotheses. Results Our results demonstrated a statistically significant improvement in decoding accuracy with the proposed optimization strategy based on multi-frequency SSVEP features compared to conventional techniques. Both hypotheses were validated by the experiments. Conclusion Performing selection by pairs and minimizing the number of common sums in selection by pairs are effective ways to select suitable frequency sets that improve multi-frequency SSVEP-based BCI accuracies. Significance This study provides guidance on frequency set selection in multi-frequency SSVEP. The proposed method in this study shows significant improvement in BCI performance (decoding accuracy) compared to existing methods in the literature.
Collapse
Affiliation(s)
- Jing Mu
- Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, Australia,*Correspondence: Jing Mu ✉
| | - David B. Grayden
- Department of Biomedical Engineering, The University of Melbourne, Parkville, VIC, Australia,Graeme Clark Institute for Biomedical Engineering, The University of Melbourne, Parkville, VIC, Australia
| | - Ying Tan
- Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, Australia,Graeme Clark Institute for Biomedical Engineering, The University of Melbourne, Parkville, VIC, Australia
| | - Denny Oetomo
- Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, Australia,Graeme Clark Institute for Biomedical Engineering, The University of Melbourne, Parkville, VIC, Australia
| |
Collapse
|
12
|
Oikonomou VP. An Adaptive Task-Related Component Analysis Method for SSVEP Recognition. SENSORS (BASEL, SWITZERLAND) 2022; 22:7715. [PMID: 36298064 PMCID: PMC9607074 DOI: 10.3390/s22207715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 09/23/2022] [Accepted: 10/06/2022] [Indexed: 06/16/2023]
Abstract
Steady-State Visual Evoked Potential (SSVEP) recognition methods use a subject's calibration data to differentiate between brain responses, hence, providing the SSVEP-based brain-computer interfaces (BCIs) with high performance. However, they require sufficient calibration EEG trials to achieve that. This study develops a new method to learn from limited calibration EEG trials, and it proposes and evaluates a novel adaptive data-driven spatial filtering approach for enhancing SSVEP detection. The spatial filter learned from each stimulus utilizes temporal information from the corresponding EEG trials. To introduce the temporal information into the overall procedure, a multitask learning approach, based on the Bayesian framework, is adopted. The performance of the proposed method was evaluated into two publicly available benchmark datasets, and the results demonstrated that our method outperformed competing methods by a significant margin.
Collapse
Affiliation(s)
- Vangelis P Oikonomou
- Information Technologies Institute, Centre for Research and Technology Hellas, Thermi-Thessaloniki, 57001 Thessaloniki, Greece
| |
Collapse
|
13
|
Driving Mode Selection through SSVEP-Based BCI and Energy Consumption Analysis. SENSORS 2022; 22:s22155631. [PMID: 35957188 PMCID: PMC9371069 DOI: 10.3390/s22155631] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 07/20/2022] [Accepted: 07/25/2022] [Indexed: 12/04/2022]
Abstract
Background: The brain–computer interface (BCI) is a highly cross-discipline technology and its successful application in various domains has received increasing attention. However, the BCI-enabled automobile industry is has been comparatively less investigated. In particular, there are currently no studies focusing on brain-controlled driving mode selection. Specifically, different driving modes indicate different driving styles which can be selected according to the road condition or the preference of individual drivers. Methods: In this paper, a steady-state visual-evoked potential (SSVEP)-based driving mode selection system is proposed. Upon this system, drivers can select the intended driving modes by only gazing at the corresponding SSVEP stimuli. A novel EEG processing algorithm named inter-trial distance minimization analysis (ITDMA) is proposed to enhance SSVEP detection. Both offline and real-time experiments were carried out to validate the effectiveness of the proposed system. Conclusion: The results show that a high selection accuracy of up to 92.3% can be realized, although this depends on the specific choice of flickering duration, the number of EEG channels, and the number of training signals. Additionally, energy consumption is investigated in terms of which the proposed brain-controlled system considerably differs from a traditional driving mode selection system, and the main reason is shown to be the existence of a detection error.
Collapse
|
14
|
Zhang X, Qiu S, Zhang Y, Wang K, Wang Y, He H. Bidirectional siamese correlation analysis method for enhancing the detection of SSVEPs. J Neural Eng 2022; 19. [PMID: 35853437 DOI: 10.1088/1741-2552/ac823e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 07/19/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have attracted increasing attention due to their high information transfer rate. To improve the performance of SSVEP detection, we propose a bidirectional Siamese correlation analysis (bi-SiamCA) model. APPROACH In this model, an LSTM-based Siamese architecture is designed to measure the similarity between the SSVEP signal and the template in each frequency and obtain the probability that the SSVEP signal belongs to each frequency. Additionally, a maximize agreement module with a designed contrastive loss is adopted in the Siamese architecture to increase the similarity between the SSVEP signal and the reference signal in the same frequency. Moreover, a two-way signal processing mechanism is built to effectively integrate complementary information from two temporal directions of the input signals. Our model uses raw SSVEPs as inputs and can be trained end-to-end. MAIN RESULTS Experimental results on a 40-class dataset and a 12-class dataset indicate that bi-SiamCA can significantly improve the classification accuracy compared with the prominent traditional and deep learning methods, especially under short data lengths. Feature visualizations show that the similarity between the SSVEP signal and the reference signal in the same frequency gradually improved in our model. CONCLUSION The proposed bi-SiamCA model enhances the performance of SSVEP detection and outperforms the compared methods. SIGNIFICANCE Due to its high decoding accuracy under short signals, our approach has great potential to implement a high-speed SSVEP-based BCI.
Collapse
Affiliation(s)
- Xinyi Zhang
- Chinese Academy of Sciences Institute of Automation, 95 Zhongguancun East Road, Haidian District, Beijing, Beijing, 100190, CHINA
| | - Shuang Qiu
- Chinese Academy of Sciences Institute of Automation, 95 Zhongguancun East Road, Haidian District, Beijing, Beijing, Beijing, 100190, CHINA
| | - Yukun Zhang
- Institute of Automation Chinese Academy of Sciences, 95 Zhongguancun East Road, Haidian District, Beijing, Beijing, 100190, CHINA
| | - Kangning Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Weijin Road Campus: No.92 Weijin Road, Nankai District.Tianjin., Tianjin, 300072, CHINA
| | - Yijun Wang
- State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Science, Beijing, China, Beijing, 100083, CHINA
| | - Huiguang He
- Institute of Automation Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing, China, Beijing, 100190, CHINA
| |
Collapse
|
15
|
Liu X, Liu B, Dong G, Gao X, Wang Y. Facilitating Applications of SSVEP-Based BCIs by Within-Subject Information Transfer. Front Neurosci 2022; 16:863359. [PMID: 35720721 PMCID: PMC9198902 DOI: 10.3389/fnins.2022.863359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 04/19/2022] [Indexed: 11/13/2022] Open
Abstract
The steady-state visual evoked potential based brain–computer interface (SSVEP–BCI) can provide high-speed alternative and augmentative communication in real-world applications. For individuals using a long-term BCI, within-subject (i.e., cross-day and cross-electrode) transfer learning could improve the BCI performance and reduce the calibration burden. To validate the within-subject transfer learning scheme, this study designs a 40-target SSVEP–BCI. Sixteen subjects are recruited, each of whom has performed experiments on three different days and has undergone the experiments of the SSVEP–BCIs based on the dry and wet electrodes. Several transfer directions, including the cross-day directions in parallel with the cross-electrode directions, are analyzed, and it is found that the transfer learning-based approach can maintain stable performance by zero training. Compared with the fully calibrated approaches, the transfer learning-based approach can achieve significantly better or comparable performance in different transfer directions. This result verifies that the transfer learning-based scheme is well suited for implementing a high-speed zero-training SSVEP–BCI, especially the dry electrode-based SSVEP–BCI system. A validation experiment of the cross-day wet-to-dry transfer, involving nine subjects, has shown that the average accuracy is 85.97 ± 5.60% for the wet-to-dry transfer and 77.69 ± 6.42% for the fully calibrated method with dry electrodes. By leveraging the electroencephalography data acquired on different days by different electrodes via transfer learning, this study lays the foundation for facilitating the long-term usage of the SSVEP–BCI and advancing the frontier of the dry electrode-based SSVEP–BCI in real-world applications.
Collapse
Affiliation(s)
- Xiaobing Liu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei Key Laboratory of Bioelectromagnetics and Neural Engineering, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, China
| | - Bingchuan Liu
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Guoya Dong
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei Key Laboratory of Bioelectromagnetics and Neural Engineering, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Yijun Wang
- State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, China.,Chinese Institute for Brain Research, Beijing, China
| |
Collapse
|
16
|
Liu B, Wang Y, Gao X, Chen X. eldBETA: A Large Eldercare-oriented Benchmark Database of SSVEP-BCI for the Aging Population. Sci Data 2022; 9:252. [PMID: 35641547 PMCID: PMC9156785 DOI: 10.1038/s41597-022-01372-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 05/05/2022] [Indexed: 11/10/2022] Open
Abstract
Global population aging poses an unprecedented challenge and calls for a rising effort in eldercare and healthcare. Steady-state visual evoked potential based brain-computer interface (SSVEP-BCI) boasts its high transfer rate and shows great promise in real-world applications to support aging. Public database is critically important for designing the SSVEP-BCI systems. However, the SSVEP-BCI database tailored for the elder is scarce in existing studies. Therefore, in this study, we present a large eldercare-oriented BEnchmark database of SSVEP-BCI for The Aging population (eldBETA). The eldBETA database consisted of the 64-channel electroencephalogram (EEG) from 100 elder participants, each of whom performed seven blocks of 9-target SSVEP-BCI task. The quality and characteristics of the eldBETA database were validated by a series of analyses followed by a classification analysis of thirteen frequency recognition methods. We expect that the eldBETA database would provide a substrate for the design and optimization of the BCI systems intended for the elders. The eldBETA database is open-access for research and can be downloaded from the website 10.6084/m9.figshare.18032669. Measurement(s) | Steady-state visual evoked potential (SSVEP) | Technology Type(s) | Electroencephalography (EEG) | Factor Type(s) | Elder population | Sample Characteristic - Organism | Homo sapiens | Sample Characteristic - Environment | Electromagnetic shielding room |
Collapse
Affiliation(s)
- Bingchuan Liu
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Yijun Wang
- State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China
| | - Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, China
| | - Xiaogang Chen
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin, 300192, China.
| |
Collapse
|
17
|
Bassi PRAS, Attux R. FBDNN: filter banks and deep neural networks for portable and fast brain-computer interfaces. Biomed Phys Eng Express 2022; 8. [PMID: 35358959 DOI: 10.1088/2057-1976/ac6300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Accepted: 03/31/2022] [Indexed: 11/11/2022]
Abstract
Objective.To propose novel SSVEP classification methodologies using deep neural networks (DNNs) and improve performances in single-channel and user-independent brain-computer interfaces (BCIs) with small data lengths.Approach.We propose the utilization of filter banks (creating sub-band components of the EEG signal) in conjunction with DNNs. In this context, we created three different models: a recurrent neural network (FBRNN) analyzing the time domain, a 2D convolutional neural network (FBCNN-2D) processing complex spectrum features and a 3D convolutional neural network (FBCNN-3D) analyzing complex spectrograms, which we introduce in this study as possible input for SSVEP classification. We tested our neural networks on three open datasets and conceived them so as not to require calibration from the final user, simulating a user-independent BCI.Results.The DNNs with the filter banks surpassed the accuracy of similar networks without this preprocessing step by considerable margins, and they outperformed common SSVEP classification methods (SVM and FBCCA) by even higher margins.Conclusion and significance.Filter banks allow different types of deep neural networks to more efficiently analyze the harmonic components of SSVEP. Complex spectrograms carry more information than complex spectrum features and the magnitude spectrum, allowing the FBCNN-3D to surpass the other CNNs. The performances obtained in the challenging classification problems indicates a strong potential for the construction of portable, economical, fast and low-latency BCIs.
Collapse
Affiliation(s)
- Pedro R A S Bassi
- Department of Computer Engineering and Industrial Automation, School of Electrical and Computer Engineering, University of Campinas-UNICAMP. 13083-970, Campinas, SP, Brazil.,Alma Mater Studiorum-University of Bologna, 40126, Bologna, BO, Italy
| | - Romis Attux
- Department of Computer Engineering and Industrial Automation, School of Electrical and Computer Engineering, University of Campinas-UNICAMP. 13083-970, Campinas, SP, Brazil
| |
Collapse
|
18
|
A Personalized Compression Method for Steady-State Visual Evoked Potential EEG Signals. INFORMATION 2022. [DOI: 10.3390/info13040186] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
As an informative electroencephalogram (EEG) signal, steady-state visual evoked potential (SSVEP) stands out from many paradigms for application in wireless wearable devices. However, its data are usually enormous, occupy too many bandwidth sources and require immense power when transmitted in the raw data form, so it is necessary to compress the signal. This paper proposes a personalized EEG compression and reconstruction algorithm for the SSVEP application. In the algorithm, to realize personalization, a primary artificial neural network (ANN) model is first pre-trained with the open benchmark database towards BCI application (BETA). Then, an adaptive ANN model is generated with incremental learning for each subject to compress their individual data. Additionally, a personalized, non-uniform quantization method is proposed to reduce the errors caused by compression. The recognition accuracy only decreases by 3.79% when the compression rate is 12.7 times, and is tested on BETA. The proposed algorithm can reduce signal loss by from 50.43% to 81.08% in the accuracy test compared to the case without ANN and uniform quantization.
Collapse
|
19
|
Pei W, Wu X, Zhang X, Zha A, Tian S, Wang Y, Gao X. A Pre-gelled EEG Electrode and Its Application in SSVEP-based BCI. IEEE Trans Neural Syst Rehabil Eng 2022; 30:843-850. [PMID: 35324444 DOI: 10.1109/tnsre.2022.3161989] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Electroencephalogram (EEG) electrodes are critical devices for brain-computer interface and neurofeedback. A pre-gelled (PreG) electrode was developed in this paper for EEG signal acquisition with a short installation time and good comfort. A hydrogel probe was placed in advance on the Ag/AgCl electrode before wearing the EEG headband instead of a time-consuming gel injection after wearing the headband. The impedance characteristics were compared between the PreG electrode and the wet electrode. The PreG electrode and the wet electrode performed the Brain-Computer Interface (BCI) application experiment to evaluate their performance. The average impedance of the PreG electrode can be decreased to 43 kΩ or even lower, which is higher than the wet electrode with an impedance of 8 kΩ. However, there is no significant difference in classification accuracy and information transmission rate (ITR) between the PreG electrode and the wet electrode in a 40 target BCI system based on Steady State Visually Evoked Potential (SSVEP). This study validated the efficiency of the proposed PreG electrode in the SSVEP-based BCI. The proposed PreG electrode will be an excellent substitute for wet electrodes in an actual application with convenience and good comfort.
Collapse
|
20
|
Mu J, Grayden DB, Tan Y, Oetomo D. Frequency Superposition - A Multi-Frequency Stimulation Method in SSVEP-based BCIs. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:5924-5927. [PMID: 34892467 DOI: 10.1109/embc46164.2021.9630511] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The steady-state visual evoked potential (SSVEP) is one of the most widely used modalities in brain-computer interfaces (BCIs) due to its many advantages. However, the existence of harmonics and the limited range of responsive frequencies in SSVEP make it challenging to further expand the number of targets without sacrificing other aspects of the interface or putting additional constraints on the system. This paper introduces a novel multi-frequency stimulation method for SSVEP and investigates its potential to effectively and efficiently increase the number of targets presented. The proposed stimulation method, obtained by the superposition of the stimulation signals at different frequencies, is size-efficient, allows single-step target identification, puts no strict constraints on the usable frequency range, can be suited to self-paced BCIs, and does not require specific light sources. In addition to the stimulus frequencies and their harmonics, the evoked SSVEP waveforms include frequencies that are integer linear combinations of the stimulus frequencies. Results of decoding SSVEPs collected from nine subjects using canonical correlation analysis (CCA) with only the frequencies and harmonics as reference, also demonstrate the potential of using such a stimulation paradigm in SSVEP-based BCIs.
Collapse
|
21
|
Sarmiento LC, Villamizar S, López O, Collazos AC, Sarmiento J, Rodríguez JB. Recognition of EEG Signals from Imagined Vowels Using Deep Learning Methods. SENSORS (BASEL, SWITZERLAND) 2021; 21:6503. [PMID: 34640824 PMCID: PMC8512781 DOI: 10.3390/s21196503] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/17/2021] [Accepted: 09/24/2021] [Indexed: 01/27/2023]
Abstract
The use of imagined speech with electroencephalographic (EEG) signals is a promising field of brain-computer interfaces (BCI) that seeks communication between areas of the cerebral cortex related to language and devices or machines. However, the complexity of this brain process makes the analysis and classification of this type of signals a relevant topic of research. The goals of this study were: to develop a new algorithm based on Deep Learning (DL), referred to as CNNeeg1-1, to recognize EEG signals in imagined vowel tasks; to create an imagined speech database with 50 subjects specialized in imagined vowels from the Spanish language (/a/,/e/,/i/,/o/,/u/); and to contrast the performance of the CNNeeg1-1 algorithm with the DL Shallow CNN and EEGNet benchmark algorithms using an open access database (BD1) and the newly developed database (BD2). In this study, a mixed variance analysis of variance was conducted to assess the intra-subject and inter-subject training of the proposed algorithms. The results show that for intra-subject training analysis, the best performance among the Shallow CNN, EEGNet, and CNNeeg1-1 methods in classifying imagined vowels (/a/,/e/,/i/,/o/,/u/) was exhibited by CNNeeg1-1, with an accuracy of 65.62% for BD1 database and 85.66% for BD2 database.
Collapse
Affiliation(s)
- Luis Carlos Sarmiento
- Departamento de Tecnología, Universidad Pedagógica Nacional, Bogotá 111321, Colombia; (O.L.); (A.C.C.); (J.S.)
| | - Sergio Villamizar
- Department of Electrical and Electronics Engineering, School of Engineering, Universidad Nacional de Colombia, Bogotá 111321, Colombia; (S.V.); (J.B.R.)
| | - Omar López
- Departamento de Tecnología, Universidad Pedagógica Nacional, Bogotá 111321, Colombia; (O.L.); (A.C.C.); (J.S.)
| | - Ana Claros Collazos
- Departamento de Tecnología, Universidad Pedagógica Nacional, Bogotá 111321, Colombia; (O.L.); (A.C.C.); (J.S.)
| | - Jhon Sarmiento
- Departamento de Tecnología, Universidad Pedagógica Nacional, Bogotá 111321, Colombia; (O.L.); (A.C.C.); (J.S.)
| | - Jan Bacca Rodríguez
- Department of Electrical and Electronics Engineering, School of Engineering, Universidad Nacional de Colombia, Bogotá 111321, Colombia; (S.V.); (J.B.R.)
| |
Collapse
|
22
|
Liu B, Chen X, Shi N, Wang Y, Gao S, Gao X. Improving the Performance of Individually Calibrated SSVEP-BCI by Task- Discriminant Component Analysis. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1998-2007. [PMID: 34543200 DOI: 10.1109/tnsre.2021.3114340] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
A brain-computer interface (BCI) provides a direct communication channel between a brain and an external device. Steady-state visual evoked potential based BCI (SSVEP-BCI) has received increasing attention due to its high information transfer rate, which is accomplished by individual calibration for frequency recognition. Task-related component analysis (TRCA) is a recent and state-of-the-art method for individually calibrated SSVEP-BCIs. However, in TRCA, the spatial filter learned from each stimulus may be redundant and temporal information is not fully utilized. To address this issue, this paper proposes a novel method, i.e., task-discriminant component analysis (TDCA), to further improve the performance of individually calibrated SSVEP-BCI. The performance of TDCA was evaluated by two publicly available benchmark datasets, and the results demonstrated that TDCA outperformed ensemble TRCA and other competing methods by a significant margin. An offline and online experiment testing 12 subjects further validated the effectiveness of TDCA. The present study provides a new perspective for designing decoding methods in individually calibrated SSVEP-BCI and presents insight for its implementation in high-speed brain speller applications.
Collapse
|
23
|
Liu B, Chen X, Li X, Wang Y, Gao X, Gao S. Align and pool for EEG headset domain adaptation (ALPHA) to facilitate dry electrode based SSVEP-BCI. IEEE Trans Biomed Eng 2021; 69:795-806. [PMID: 34406934 DOI: 10.1109/tbme.2021.3105331] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE The steady-state visual evoked potential based brain-computer interface (SSVEP-BCI) implemented in dry electrodes is a promising paradigm for alternative and augmentative communication in real-world applications. To improve its performance and reduce the calibration effort for dry-electrode systems, we utilize cross-device transfer learning by exploiting auxiliary individual wet-electrode electroencephalogram (EEG). METHODS We proposed a novel transfer learning framework named ALign and Pool for EEG Headset domain Adaptation (ALPHA), which aligns the spatial pattern and the covariance for domain adaptation. To evaluate its efficacy, 75 subjects performed an experiment of 2 sessions involving a 12-target SSVEP-BCI task. RESULTS ALPHA significantly outperformed a baseline approach (canonical correlation analysis, CCA) and two competing transfer learning approaches (transfer template CCA, ttCCA and least square transformation, LST) in two transferring directions. When transferring from wet to dry EEG headsets, ALPHA significantly outperformed the fully calibrated approach of task-related component analysis (TRCA). CONCLUSION ALPHA advances the frontier of recalibration-free cross-device transfer learning for SSVEP-BCIs and boosts the performance of dry electrode based systems. SIGNIFICANCE ALPHA has methodological and practical implications and pushes the boundary of dry electrode based SSVEP-BCI toward real-world applications.
Collapse
|