A high-speed brain speller using steady-state visual evoked potentials

SSVEP-EEG Feature Enhancement Method Using an Image Sharpening Filter

Steady-state visual evoked potential (SSVEP) is widely used in brain computer interface (BCI), medical detection, and neuroscience, so there is significant interest in enhancing SSVEP features via signal processing for better performance. In this study, an image processing method was combined with brain signal analysis and a sharpening filter was used to extract image details and features for the enhancement of SSVEP features. The results demonstrated that sharpening filter could eliminate the SSVEP signal trend term and suppress its low-frequency component. Meanwhile, sharpening filter effectively enhanced the signal-to-noise ratios (SNRs) of the single-channel and multi-channel fused signals. Image sharpening filter also significantly improved the recognition accuracy of canonical correlation analysis (CCA), filter bank canonical correlation analysis (FBCCA), and task-related component analysis (TRCA). The tools developed here effectively enhanced the SSVEP signal features, suggesting that image processing methods can be considered for improved brain signal analysis.

A BCI-Based Study on the Relationship Between the SSVEP and Retinal Eccentricity in Overt and Covert Attention

Covert attention aids us in monitoring the environment and optimizing performance in visual tasks. Past behavioral studies have shown that covert attention can enhance spatial resolution. However, electroencephalography (EEG) activity related to neural processing between central and peripheral vision has not been systematically investigated. Here, we conducted an EEG study with 25 subjects who performed covert attentional tasks at different retinal eccentricities ranging from 0.75° to 13.90°, as well as tasks involving overt attention and no attention. EEG signals were recorded with a single stimulus frequency to evoke steady-state visual evoked potentials (SSVEPs) for attention evaluation. We found that the SSVEP response in fixating at the attended location was generally negatively correlated with stimulus eccentricity as characterized by Euclidean distance or horizontal and vertical distance. Moreover, more pronounced characteristics of SSVEP analysis were also acquired in overt attention than in covert attention. Furthermore, offline classification of overt attention, covert attention, and no attention yielded an average accuracy of 91.42%. This work contributes to our understanding of the SSVEP representation of attention in humans and may also lead to brain-computer interfaces (BCIs) that allow people to communicate with choices simply by shifting their attention to them.

Optimizing a left and right visual field biphasic stimulation paradigm for SSVEP-based BCIs with hairless region behind the ear

Objective.Steady-state visual evoked potential (SSVEP) based brain-computer interface (BCI) has the characteristics of fast communication speed, high stability, and wide applicability, thus it has been widely studied. With the rapid development in paradigm, algorithm, and system design, SSVEP-BCI is gradually applied in clinical and real-life scenarios. In order to improve the ease of use of the SSVEP-BCI system, many studies have been focusing on developing it on the hairless area, but due to the lack of redesigning the stimulation paradigm to better adapt to the new area, the electroencephalography response in the hairless area is worse than occipital region.Approach. This study first proposed a phase difference estimation method based on stimulating the left and right visual field separately, then developed and optimized a left and right visual field biphasic stimulation paradigm for SSVEP-based BCIs with hairless region behind the ear.Main results.In the 12-target online experiment, after a short model estimation training, all 16 subjects used their best stimulus condition. The paradigm designed in this study can increase the proportion of applicable subjects for the behind-ear SSVEP-BCI system from 58.3% to 75% and increase the accuracy from 74.6 ± 20.0% (the existing best SSVEP stimulus with hairless region behind the ear) to 84.2±14.7%, and the information transfer rate from 14.2±6.4 bits min^-1to 17.8±5.7 bits min^-1.Significance.These results demonstrated that the proposed paradigm can effectively improve the BCI performance using the signal from the hairless region behind the ear, compared with the standard SSVEP stimulation paradigm.

Filter bank approach for enhancement of supervised Canonical Correlation Analysis methods for SSVEP-based BCI spellers

Canonical correlation analysis (CCA) is one of the most used algorithms in the steady-state visual evoked potentials (SSVEP)-based brain-computer interface (BCI) systems due to its simplicity, efficiency, and robustness. Researchers have proposed modifications to CCA to improve its speed, allowing high-speed spelling and thus a more natural communication. In this work, we combine two approaches, the filter-bank (FB) approach to extract more information from the harmonics, and a range of different supervised methods which optimize the reference signals to improve the SSVEP detection. The proposed models are tested on the publicly available benchmark dataset for SSVEP-based BCIs and the results show improved performance compared to the state-of-the-art methods and, in particular, the proposed FBMwayCCA approach achieves the best results with an information transfer rate (ITR) of 134.8±8.4 bits/minute. This study indeed suggests the feasibility of combining the fundamental and harmonic SSVEP components with supervised methods in target identification to develop high-speed BCI spellers.

Optimizing spatial properties of a new checkerboard-like visual stimulus for user-friendly SSVEP-based BCIs

Objective.Low-frequency steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems with high performance are prone to cause visual discomfort and fatigue. High-frequency SSVEP-based BCI systems can alleviate the discomfort, but always obtain lower performance. This study optimized the spatial properties of a proposed checkerboard-like visual stimulus toward high-performance and user-friendly SSVEP-based BCI systems.Approach.On the one hand, two checkerboard-like stimuli with distinct spatial contrasts (the black- and white-background) were designed to balance the tradeoff between BCI performance and user experience and compared with the traditional flickering stimulus. On the other hand, the impacts of the spatial frequency of the new checkerboard-like stimulus on the flicker perception and the intensity of the elicited SSVEP were clarified. The SSVEP-based BCI systems were implemented based on the checkerboard-like stimuli under low-frequency and high-frequency conditions. The user experience for each stimulation pattern was estimated by questionnaires for subjective evaluation.Main results.The comparison results indicate that the black-background checkerboard-like stimulus with an optimized spatial frequency achieved comparable performance and enhanced visual comfort compared with the flickering stimulus. Furthermore, the online nine-target BCI system using the black-background checkerboard-like stimuli achieved averaged information transfer rates of 124.0 ± 2.3 and 109.0 ± 20.4 bits min^-1with low-frequency and high-frequency stimulation respectively.Significance.The new checkerboard-like stimuli with optimized properties show superiority of system performance and user experience in implementing SSVEP-based BCI, which will promote its practical applications in communication and control.

Information Bottleneck as Optimisation Method for SSVEP-Based BCI

In this study, the information bottleneck method is proposed as an optimisation method for steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI). The information bottleneck is an information-theoretic optimisation method for solving problems with a trade-off between preserving meaningful information and compression. Its main practical application in machine learning is in representation learning or feature extraction. In this study, we use the information bottleneck to find optimal classification rule for a BCI. This is a novel application for the information bottleneck. This approach is particularly suitable for BCIs since the information bottleneck optimises the amount of information transferred by the BCI. Steady-state visual evoked potential-based BCIs often classify targets using very simple rules like choosing the class corresponding to the largest feature value. We call this classifier the arg max classifier. It is unlikely that this approach is optimal, and in this study, we propose a classification method specifically designed to optimise the performance measure of BCIs. This approach gives an advantage over standard machine learning methods, which aim to optimise different measures. The performance of the proposed algorithm is tested on two publicly available datasets in offline experiments. We use the standard power spectral density analysis (PSDA) and canonical correlation analysis (CCA) feature extraction methods on one dataset and show that the current approach outperforms most of the related studies on this dataset. On the second dataset, we use the task-related component analysis (TRCA) method and demonstrate that the proposed method outperforms the standard argmax classification rule in terms of information transfer rate when using a small number of classes. To our knowledge, this is the first time the information bottleneck is used in the context of SSVEP-based BCIs. The approach is unique in the sense that optimisation is done over the space of classification functions. It potentially improves the performance of BCIs and makes it easier to calibrate the system for different subjects.

Improving the Performance of Individually Calibrated SSVEP-BCI by Task- Discriminant Component Analysis

A brain-computer interface (BCI) provides a direct communication channel between a brain and an external device. Steady-state visual evoked potential based BCI (SSVEP-BCI) has received increasing attention due to its high information transfer rate, which is accomplished by individual calibration for frequency recognition. Task-related component analysis (TRCA) is a recent and state-of-the-art method for individually calibrated SSVEP-BCIs. However, in TRCA, the spatial filter learned from each stimulus may be redundant and temporal information is not fully utilized. To address this issue, this paper proposes a novel method, i.e., task-discriminant component analysis (TDCA), to further improve the performance of individually calibrated SSVEP-BCI. The performance of TDCA was evaluated by two publicly available benchmark datasets, and the results demonstrated that TDCA outperformed ensemble TRCA and other competing methods by a significant margin. An offline and online experiment testing 12 subjects further validated the effectiveness of TDCA. The present study provides a new perspective for designing decoding methods in individually calibrated SSVEP-BCI and presents insight for its implementation in high-speed brain speller applications.

Enhancing Performance of SSVEP-Based Visual Acuity via Spatial Filtering

The purpose of this study was to enhance the performance of steady-state visual evoked potential (SSVEP)-based visual acuity assessment with spatial filtering methods. Using the vertical sinusoidal gratings at six spatial frequency steps as the visual stimuli for 11 subjects, SSVEPs were recorded from six occipital electrodes (O1, Oz, O2, PO3, POz, and PO4). Ten commonly used training-free spatial filtering methods, i.e., native combination (single-electrode), bipolar combination, Laplacian combination, average combination, common average reference (CAR), minimum energy combination (MEC), maximum contrast combination (MCC), canonical correlation analysis (CCA), multivariate synchronization index (MSI), and partial least squares (PLS), were compared for multielectrode signals combination in SSVEP visual acuity assessment by statistical analyses, e.g., Bland–Altman analysis and repeated-measures ANOVA. The SSVEP signal characteristics corresponding to each spatial filtering method were compared, determining the chosen spatial filtering methods of CCA and MSI with a higher performance than the native combination for further signal processing. After the visual acuity threshold estimation criterion, the agreement between the subjective Freiburg Visual Acuity and Contrast Test (FrACT) and SSVEP visual acuity for the native combination (0.253 logMAR), CCA (0.202 logMAR), and MSI (0.208 logMAR) was all good, and the difference between FrACT and SSVEP visual acuity was also all acceptable for the native combination (−0.095 logMAR), CCA (0.039 logMAR), and MSI (−0.080 logMAR), where CCA-based SSVEP visual acuity had the best performance and the native combination had the worst. The study proved that the performance of SSVEP-based visual acuity can be enhanced by spatial filtering methods of CCA and MSI and also recommended CCA as the spatial filtering method for multielectrode signals combination in SSVEP visual acuity assessment.

A Deep Neural Network for SSVEP-based Brain-Computer Interfaces

OBJECTIVE

Target identification in brain-computer interface (BCI) spellers refers to the electroencephalogram (EEG) classification for predicting the target character that the subject intends to spell. When the visual stimulus of each character is tagged with a distinct frequency, the EEG records steady-state visually evoked potentials (SSVEP) whose spectrum is dominated by the harmonics of the target frequency. In this setting, we address the target identification and propose a novel deep neural network (DNN) architecture.

METHOD

The proposed DNN processes the multi-channel SSVEP with convolutions across the sub-bands of harmonics, channels, time, and classifies at the fully connected layer. We test with two publicly available large scale (the benchmark and BETA) datasets consisting of in total 105 subjects with 40 characters. Our first stage training learns a global model by exploiting the statistical commonalities among all subjects, and the second stage fine tunes to each subject separately by exploiting the individualities.

RESULTS

Our DNN achieves impressive information transfer rates (ITRs) on both datasets, 265.23 bits/min and 196.59 bits/min, respectively, with only 0.4 seconds of stimulation. The code is available for reproducibility at https://github.com/osmanberke/Deep-SSVEP-BCI.

CONCLUSION

The presented DNN strongly outperforms the state-of-the-art techniques as our accuracy and ITR rates are the highest ever reported performance results on these datasets.

SIGNIFICANCE

Due to its unprecedentedly high speller ITRs and flawless applicability to general SSVEP systems, our technique has great potential in various biomedical engineering settings of BCIs such as communication, rehabilitation and control.

SSVEP-EEG Denoising via Image Filtering Methods

Steady-state visual evoked potential (SSVEP) is widely used in electroencephalogram (EEG) control, medical detection, cognitive neuroscience, and other fields. However, successful application requires improving the detection performance of SSVEP signal frequency characteristics. Most strategies to enhance the signal-to-noise ratio of SSVEP utilize application of a spatial filter. Here, we propose a method for image filtering denoising (IFD) of the SSVEP signal from the perspective of image analysis, as a preprocessing step for signal analysis. Arithmetic mean, geometric mean, Gaussian, and non-local means filtering methods were tested, and the experimental results show that image filtering of SSVEP cannot effectively remove the noise. Thus, we proposed a reverse solution in which the SSVEP noise signal was obtained by image filtering, and then the noise was subtracted from the original signal. Comparison of the recognition accuracy of the SSVEP signal before and after denoising was used to evaluate the denoising performance for stimuli of different duration. After IFD processing, SSVEP exhibited higher recognition accuracy, indicating the effectiveness of this proposed denoising method. Application of this method improves the detection performance of SSVEP signal frequency characteristics, combines image processing and brain signal analysis, and expands the research scope of brain signal analysis for widespread application.

Align and pool for EEG headset domain adaptation (ALPHA) to facilitate dry electrode based SSVEP-BCI

OBJECTIVE

The steady-state visual evoked potential based brain-computer interface (SSVEP-BCI) implemented in dry electrodes is a promising paradigm for alternative and augmentative communication in real-world applications. To improve its performance and reduce the calibration effort for dry-electrode systems, we utilize cross-device transfer learning by exploiting auxiliary individual wet-electrode electroencephalogram (EEG).

METHODS

We proposed a novel transfer learning framework named ALign and Pool for EEG Headset domain Adaptation (ALPHA), which aligns the spatial pattern and the covariance for domain adaptation. To evaluate its efficacy, 75 subjects performed an experiment of 2 sessions involving a 12-target SSVEP-BCI task.

RESULTS

ALPHA significantly outperformed a baseline approach (canonical correlation analysis, CCA) and two competing transfer learning approaches (transfer template CCA, ttCCA and least square transformation, LST) in two transferring directions. When transferring from wet to dry EEG headsets, ALPHA significantly outperformed the fully calibrated approach of task-related component analysis (TRCA).

CONCLUSION

ALPHA advances the frontier of recalibration-free cross-device transfer learning for SSVEP-BCIs and boosts the performance of dry electrode based systems.

SIGNIFICANCE

ALPHA has methodological and practical implications and pushes the boundary of dry electrode based SSVEP-BCI toward real-world applications.

Steady-State Visual Evoked Potential Classification Using Complex Valued Convolutional Neural Networks

The steady-state visual evoked potential (SSVEP), which is a kind of event-related potential in electroencephalograms (EEGs), has been applied to brain–computer interfaces (BCIs). SSVEP-based BCIs currently perform the best in terms of information transfer rate (ITR) among various BCI implementation methods. Canonical component analysis (CCA) or spectrum estimation, such as the Fourier transform, and their extensions have been used to extract features of SSVEPs. However, these signal extraction methods have a limitation in the available stimulation frequency; thus, the number of commands is limited. In this paper, we propose a complex valued convolutional neural network (CVCNN) to overcome the limitation of SSVEP-based BCIs. The experimental results demonstrate that the proposed method overcomes the limitation of the stimulation frequency, and it outperforms conventional SSVEP feature extraction methods.

Enhancing Detection of SSMVEP Induced by Action Observation Stimuli Based on Task-Related Component Analysis

Action observation (AO)-based brain-computer interface (BCI) is an important technology in stroke rehabilitation training. It has the advantage of simultaneously inducing steady-state motion visual evoked potential (SSMVEP) and activating sensorimotor rhythm. Moreover, SSMVEP could be utilized to perform classification. However, SSMVEP is composed of complex modulation frequencies. Traditional canonical correlation analysis (CCA) suffers from poor recognition performance in identifying those modulation frequencies at short stimulus duration. To address this issue, task-related component analysis (TRCA) was utilized to deal with SSMVEP for the first time. An interesting phenomenon was found: different modulated frequencies in SSMVEP distributed in different task-related components. On this basis, a multi-component TRCA method was proposed. All the significant task-related components were utilized to construct multiple spatial filters to enhance the detection of SSMVEP. Further, a combination of TRCA and CCA was proposed to utilize both advantages. Results showed that the accuracies using the proposed methods were significant higher than that using CCA at all window lengths and significantly higher than that using ensemble-TRCA at short window lengths (≤2 s). Therefore, the proposed methods further validate the induced modulation frequencies and will speed up the application of the AO-based BCI in rehabilitation.

Review of brain encoding and decoding mechanisms for EEG-based brain-computer interface

A brain-computer interface (BCI) can connect humans and machines directly and has achieved successful applications in the past few decades. Many new BCI paradigms and algorithms have been developed in recent years. Therefore, it is necessary to review new progress in BCIs. This paper summarizes progress for EEG-based BCIs from the perspective of encoding paradigms and decoding algorithms, which are two key elements of BCI systems. Encoding paradigms are grouped by their underlying neural meachanisms, namely sensory- and motor-related, vision-related, cognition-related and hybrid paradigms. Decoding algorithms are reviewed in four categories, namely decomposition algorithms, Riemannian geometry, deep learning and transfer learning. This review will provide a comprehensive overview of both modern primary paradigms and algorithms, making it helpful for those who are developing BCI systems.

Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up Survey

Incremental and quantitative improvements of two-way interactions with e x tended realities (XR) are contributing toward a qualitative leap into a state of XR ecosystems being efficient, user-friendly, and widely adopted. However, there are multiple barriers on the way toward the omnipresence of XR; among them are the following: computational and power limitations of portable hardware, social acceptance of novel interaction protocols, and usability and efficiency of interfaces. In this article, we overview and analyse novel natural user interfaces based on sensing electrical bio-signals that can be leveraged to tackle the challenges of XR input interactions. Electroencephalography-based brain-machine interfaces that enable thought-only hands-free interaction, myoelectric input methods that track body gestures employing electromyography, and gaze-tracking electrooculography input interfaces are the examples of electrical bio-signal sensing technologies united under a collective concept of ExG. ExG signal acquisition modalities provide a way to interact with computing systems using natural intuitive actions enriching interactions with XR. This survey will provide a bottom-up overview starting from (i) underlying biological aspects and signal acquisition techniques, (ii) ExG hardware solutions, (iii) ExG-enabled applications, (iv) discussion on social acceptance of such applications and technologies, as well as (v) research challenges, application directions, and open problems; evidencing the benefits that ExG-based Natural User Interfaces inputs can introduce to the area of XR.

Developments in the human machine interface technologies and their applications: a review

Human-machine interface (HMI) techniques use bioelectrical signals to gain real-time synchronised communication between the human body and machine functioning. HMI technology not only provides a real-time control access but also has the ability to control multiple functions at a single instance of time with modest human inputs and increased efficiency. The HMI technologies yield advanced control access on numerous applications such as health monitoring, medical diagnostics, development of prosthetic and assistive devices, automotive and aerospace industry, robotic controls and many more fields. In this paper, various physiological signals, their acquisition and processing techniques along with their respective applications in different HMI technologies have been discussed.

Spiking Neural Network for Augmenting Electroencephalographic Data for Brain Computer Interfaces

With the advent of advanced machine learning methods, the performance of brain–computer interfaces (BCIs) has improved unprecedentedly. However, electroencephalography (EEG), a commonly used brain imaging method for BCI, is characterized by a tedious experimental setup, frequent data loss due to artifacts, and is time consuming for bulk trial recordings to take advantage of the capabilities of deep learning classifiers. Some studies have tried to address this issue by generating artificial EEG signals. However, a few of these methods are limited in retaining the prominent features or biomarker of the signal. And, other deep learning-based generative methods require a huge number of samples for training, and a majority of these models can handle data augmentation of one category or class of data at any training session. Therefore, there exists a necessity for a generative model that can generate synthetic EEG samples with as few available trials as possible and generate multi-class while retaining the biomarker of the signal. Since EEG signal represents an accumulation of action potentials from neuronal populations beneath the scalp surface and as spiking neural network (SNN), a biologically closer artificial neural network, communicates via spiking behavior, we propose an SNN-based approach using surrogate-gradient descent learning to reconstruct and generate multi-class artificial EEG signals from just a few original samples. The network was employed for augmenting motor imagery (MI) and steady-state visually evoked potential (SSVEP) data. These artificial data are further validated through classification and correlation metrics to assess its resemblance with original data and in-turn enhanced the MI classification performance.

Brain-Computer Interface Speller Based on Steady-State Visual Evoked Potential: A Review Focusing on the Stimulus Paradigm and Performance

The steady-state visual evoked potential (SSVEP), measured by the electroencephalograph (EEG), has high rates of information transfer and signal-to-noise ratio, and has been used to construct brain-computer interface (BCI) spellers. In BCI spellers, the targets of alphanumeric characters are assigned different visual stimuli and the fixation of each target generates a unique SSVEP. Matching the SSVEP to the stimulus allows users to select target letters and numbers. Many BCI spellers that harness the SSVEP have been proposed over the past two decades. Various paradigms of visual stimuli, including the procedure of target selection, layout of targets, stimulus encoding, and the combination with other triggering methods are used and considered to influence on the BCI speller performance significantly. This paper reviews these stimulus paradigms and analyzes factors influencing their performance. The fundamentals of BCI spellers are first briefly described. SSVEP-based BCI spellers, where only the SSVEP is used, are classified by stimulus paradigms and described in chronological order. Furthermore, hybrid spellers that involve the use of the SSVEP are presented in parallel. Factors influencing the performance and visual fatigue of BCI spellers are provided. Finally, prevailing challenges and prospective research directions are discussed to promote the development of BCI spellers.

Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI)

Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.

Hybrid asynchronous brain-computer interface for yes/no communication in patients with disorders of consciousness

Objective.For patients with disorders of consciousness (DOC), such as vegetative state (VS) and minimally conscious state (MCS), communication is challenging. Currently, the communication methods of DOC patients are limited to behavioral responses. However, DOC patients cannot provide sufficient behavioral responses due to motor impairments and limited attention. In this study, we proposed a hybrid asynchronous brain-computer interface (BCI) system that provides a new communication channel for DOC patients.Approach.Seven DOC patients (3 VS and 4 MCS) and eleven healthy subjects participated in our experiment. Each subject was instructed to focus on the square with the Chinese words 'Yes' and 'No'. Then, the BCI system determined the target square with both P300 and steady-state visual evoked potential (SSVEP) detections. For the healthy group, we tested the performance of the hybrid system and the single-modality BCI system.Main results.All healthy subjects achieved significant accuracy (range from 72% to 100%) in both the hybrid system and the single-modality system. The hybrid asynchronous BCI system outperformed the P300-only and SSVEP-only systems. Furthermore, we employed the asynchronous approach to dynamically collect the EEG signals. Compared with the synchronous system, there was a 21% reduction in the average required rounds and a reduction of 105 s in the online experiment time. This asynchronous system was applied to detect the 'yes/no' communication function of seven DOC patients, and the results showed that three of the patients (3 MCS) showed significant accuracies (67 ± 3%) in the online experiment, and their Coma Recovery Scale-Revised (CRS-R) scores were also improved compared with the scores before the experiment. This result demonstrated that 3 of 7 patients were able to communicate using our hybrid asynchronous BCI system.Significance.This hybrid asynchronous BCI system represents a useful auxiliary bedside tool for simple communication with DOC patients.

An Introductory Tutorial on Brain–Computer Interfaces and Their Applications

The prospect and potentiality of interfacing minds with machines has long captured human imagination. Recent advances in biomedical engineering, computer science, and neuroscience are making brain–computer interfaces a reality, paving the way to restoring and potentially augmenting human physical and mental capabilities. Applications of brain–computer interfaces are being explored in applications as diverse as security, lie detection, alertness monitoring, gaming, education, art, and human cognition augmentation. The present tutorial aims to survey the principal features and challenges of brain–computer interfaces (such as reliable acquisition of brain signals, filtering and processing of the acquired brainwaves, ethical and legal issues related to brain–computer interface (BCI), data privacy, and performance assessment) with special emphasis to biomedical engineering and automation engineering applications. The content of this paper is aimed at students, researchers, and practitioners to glimpse the multifaceted world of brain–computer interfacing.

Enhancing detection of steady-state visual evoked potentials using channel ensemble method

OBJECTIVE

This study proposed and evaluated a channel ensemble approach to enhance detection of steady-state visual evoked potentials (SSVEPs).

APPROACH

Collected multi-channel electroencephalogram (EEG) signals were classified into multiple groups of new analysis signals based on correlation analysis, and each group of analysis signals contained signals from a different number of electrode channels. These groups of analysis signals were used as the input of a training-free feature extraction model, and the obtained feature coefficients were converted into feature probability values using the softmax function. The ensemble value of multiple sets of feature probability values was determined and used as the final discrimination coefficient.

MAIN RESULTS

Compared with canonical correlation analysis (CCA), likelihood ratio test (LRT), and multivariate synchronization index (MSI) analysis methods using a standard approach, the recognition accuracies of the methods using a channel ensemble approach were improved by 5.05%, 3.87%, and 3.42%, and the information transfer rates (ITRs) were improved by 6.00%, 4.61%, and 3.71%, respectively. The channel ensemble method also obtained better recognition results than the standard algorithm on the public dataset. This study validated the efficiency of the proposed method to enhance the detection of SSVEPs, demonstrating its potential use in practical brain-computer interface (BCI) systems.

SIGNIFICANCE

A SSVEP-based BCI system using a channel ensemble method could achieve high ITR, indicating great potential of this design for various applications with improved control and interaction.

Enhancing SSVEP-Based Brain-Computer Interface with Two-Step Task-Related Component Analysis

Among various methods for frequency recognition of the steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) study, a task-related component analysis (TRCA), which extracts discriminative spatial filters for classifying electroencephalogram (EEG) signals, has gathered much interest. The TRCA-based SSVEP method yields lower computational cost and higher classification performance compared to existing SSVEP methods. In spite of its utility, the TRCA-based SSVEP method still suffers from the degradation of the frequency recognition rate in cases where EEG signals with a short length window are used. To address this issue, here, we propose an improved strategy for decoding SSVEPs, which is insensitive to a window length by carrying out two-step TRCA. The proposed method reuses the spatial filters corresponding to target frequencies generated by the TRCA. Followingly, the proposed method accentuates features for target frequencies by correlating individual template and test data. For the evaluation of the performance of the proposed method, we used a benchmark dataset with 35 subjects and confirmed significantly improved performance comparing with other existing SSVEP methods. These results imply the suitability as an efficient frequency recognition strategy for SSVEP-based BCI applications.

An Open Dataset for Wearable SSVEP-Based Brain-Computer Interfaces

Brain-computer interfaces (BCIs) provide humans a new communication channel by encoding and decoding brain activities. Steady-state visual evoked potential (SSVEP)-based BCI stands out among many BCI paradigms because of its non-invasiveness, little user training, and high information transfer rate (ITR). However, the use of conductive gel and bulky hardware in the traditional Electroencephalogram (EEG) method hinder the application of SSVEP-based BCIs. Besides, continuous visual stimulation in long time use will lead to visual fatigue and pose a new challenge to the practical application. This study provides an open dataset, which is collected based on a wearable SSVEP-based BCI system, and comprehensively compares the SSVEP data obtained by wet and dry electrodes. The dataset consists of 8-channel EEG data from 102 healthy subjects performing a 12-target SSVEP-based BCI task. For each subject, 10 consecutive blocks were recorded using wet and dry electrodes, respectively. The dataset can be used to investigate the performance of wet and dry electrodes in SSVEP-based BCIs. Besides, the dataset provides sufficient data for developing new target identification algorithms to improve the performance of wearable SSVEP-based BCIs.

Toward New Modalities in VEP-Based BCI Applications Using Dynamical Stimuli: Introducing Quasi-Periodic and Chaotic VEP-Based BCI

Visual evoked potentials (VEPs) to periodic stimuli are commonly used in brain computer interfaces for their favorable properties such as high target identification accuracy, less training time, and low surrounding target interference. Conventional periodic stimuli can lead to subjective visual fatigue due to continuous and high contrast stimulation. In this study, we compared quasi-periodic and chaotic complex stimuli to common periodic stimuli for use with VEP-based brain computer interfaces (BCIs). Canonical correlation analysis (CCA) and coherence methods were used to evaluate the performance of the three stimulus groups. Subjective fatigue caused by the presented stimuli was evaluated by the Visual Analogue Scale (VAS). Using CCA with the M2 template approach, target identification accuracy was highest for the chaotic stimuli (M = 86.8, SE = 1.8) compared to the quasi-periodic (M = 78.1, SE = 2.6, p = 0.008) and periodic (M = 64.3, SE = 1.9, p = 0.0001) stimulus groups. The evaluation of fatigue rates revealed that the chaotic stimuli caused less fatigue compared to the quasi-periodic (p = 0.001) and periodic (p = 0.0001) stimulus groups. In addition, the quasi-periodic stimuli led to lower fatigue rates compared to the periodic stimuli (p = 0.011). We conclude that the target identification results were better for the chaotic group compared to the other two stimulus groups with CCA. In addition, the chaotic stimuli led to a less subjective visual fatigue compared to the periodic and quasi-periodic stimuli and can be suitable for designing new comfortable VEP-based BCIs.

A Training Data-Driven Canonical Correlation Analysis Algorithm for Designing Spatial Filters to Enhance Performance of SSVEP-Based BCIs

Canonical correlation analysis (CCA) is an effective spatial filtering algorithm widely used in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). In existing CCA methods, training data are used for constructing templates of stimulus targets and the spatial filters are created between the template signals and a single-trial testing signal. The fact that spatial filters rely on testing data, however, results in low classification performance of CCA compared to other state-of-the-art algorithms such as task-related component analysis (TRCA). In this study, we proposed a novel CCA method in which spatial filters are estimated using training data only. This is achieved by using observed EEG training data and their SSVEP components as the two inputs of CCA and the objective function is optimized by averaging multiple training trials. In this case, we proved in theory that the two spatial filters estimated by the CCA are equivalent, and that the CCA and TRCA are also equivalent under certain hypotheses. A benchmark SSVEP data set from 35 subjects was used to compare the performance of the two algorithms according to different lengths of data, numbers of channels and numbers of training trials. In addition, the CCA was also compared with power spectral density analysis (PSDA). The experimental results suggest that the CCA is equivalent to TRCA if the signal-to-noise ratio of training data is high enough; otherwise, the CCA outperforms TRCA in terms of classification accuracy. The CCA is much faster than PSDA in detecting time of targets. The robustness of the training data-driven CCA to noise gives it greater potential in practical applications.

Boosting template-based SSVEP decoding by cross-domain transfer learning

OBJECTIVE

This study aims to establish a generalized transfer-learning framework for boosting the performance of steady-state visual evoked potential(SSVEP)-based brain-computer interfaces (BCIs) by leveraging cross-domain data transferring.

APPROACH

We enhanced the state-of-the-art template-based SSVEP decoding through incorporating a least-squares transformation (LST)-based transfer learning to leverage calibration data across multiple domains (sessions, subjects, and EEG montages).

MAIN RESULTS

Study results verified the efficacy of LST in obviating the variability of SSVEPs when transferring existing data across domains. Furthermore, the LST-based method achieved significantly higher SSVEP-decoding accuracy than the standard task-related component analysis (TRCA)-based method and the non-LST naive transfer-learning method.

SIGNIFICANCE

This study demonstrated the capability of the LST-based transfer learning to leverage existing data across subjects and/or devices with an in-depth investigation of its rationale and behavior in various circumstances. The proposed framework significantly improved the SSVEP decoding accuracy over the standard TRCA approach when calibration data are limited. Its performance in calibration reduction could facilitate plug-and-play SSVEP-based BCIs and further practical applications.

Olfactory EEG Signal Classification Using a Trapezoid Difference-Based Electrode Sequence Hashing Approach

Olfactory-induced electroencephalogram (EEG) signal classification is of great significance in a variety of fields, such as disorder treatment, neuroscience research, multimedia applications and brain-computer interface. In this paper, a trapezoid difference-based electrode sequence hashing method is proposed for olfactory EEG signal classification. First, an N-layer trapezoid feature set whose size ratio of the top, bottom and height is 1:2:1 is constructed for each frequency band of each EEG sample. This construction is based on N optimized power-spectral-density features extracted from N real electrodes and N nonreal electrode's features. Subsequently, the N real electrodes' sequence (ES) codes of each layer of the constructed trapezoid feature set are obtained by arranging the feature values in ascending order. Finally, the nearest neighbor classification is used to find a class whose ES codes are the most similar to those of the testing sample. Thirteen-class olfactory EEG signals collected from 11 subjects are used to compare the classification performance of the proposed method with six traditional classification methods. The comparison shows that the proposed method gives average accuracy of 94.3%, Cohen's kappa value of 0.94, precision of 95.0%, and F1-measure of 94.6%, which are higher than those of the existing methods.

Review of semi-dry electrodes for EEG recording

Developing reliable and user-friendly electroencephalography (EEG) electrodes remains a challenge for emerging real-world EEG applications. Classic wet electrodes are the gold standard for recording EEG; however, they are difficult to implement and make users uncomfortable, thus severely restricting their widespread application in real-life scenarios. An alternative is dry electrodes, which do not require conductive gels or skin preparation. Despite their quick setup and improved user-friendliness, dry electrodes still have some inherent problems (invasive, relatively poor signal quality, or sensitivity to motion artifacts), which limit their practical utilization. In recent years, semi-dry electrodes, which require only a small amount of electrolyte fluid, have been successfully developed, combining the advantages of both wet and dry electrodes while addressing their respective drawbacks. Semi-dry electrodes can collect reliable EEG signals comparable to wet electrodes. Moreover, their setup is as fast and convenient similar to that of dry electrodes. Hence, semi-dry electrodes have shown tremendous application prospects for real-world EEG acquisition. Herein, we systematically summarize the development, evaluation methods, and practical design considerations of semi-dry electrodes. Some feasible suggestions and new ideas for the development of semi-dry electrodes have been presented. This review provides valuable technical support for the development of semi-dry electrodes toward emerging practical applications.

Implementation of an SSVEP-based intelligent home service robot system

BACKGROUND

People with severe neuromuscular disorders caused by an accident or congenital disease cannot normally interact with the physical environment. The intelligent robot technology offers the possibility to solve this problem. However, the robot can hardly carry out the task without understanding the subject's intention as it relays on speech or gestures. Brain-computer interface (BCI), a communication system that operates external devices by directly converting brain activity into digital signals, provides a solution for this.

OBJECTIVE

In this study, a noninvasive BCI-based humanoid robotic system was designed and implemented for home service.

METHODS

A humanoid robot that is equipped with multi-sensors navigates to the object placement area under the guidance of a specific symbol "Naomark", which has a unique ID, and then sends the information of the scanned object back to the user interface. Based on this information, the subject gives commands to the robot to grab the wanted object and give it to the subject. To identify the subject's intention, the channel projection-based canonical correlation analysis (CP-CCA) method was utilized for the steady state visual evoked potential-based BCI system.

RESULTS

The offline results showed that the average classification accuracy of all subjects reached 90%, and the online task completion rate was over 95%.

CONCLUSION

Users can complete the grab task with minimum commands, avoiding the control burden caused by complex commands. This would provide a useful assistance means for people with severe motor impairment in their daily life.

A CNN-based compare network for classification of SSVEPs in human walking

Brain-computer interface (BCI) can provide a way for the disabled to interact with the outside world. Steady-state visual evoked potential (SSVEP), which evokes potential through visual stimulation is one of important BCI paradigms. In laboratory environment, the classification accuracy of SSVEPs is excellent. However, in motion state, the accuracy will be greatly affected and reduce quite a lot. In this paper, in order to improve the classification accuracy of the SSVEP signals in the motion state, we collected SSVEP data of five targets at three speeds of 0km/h, 2.5km/h and 5km/h. A compare network based on convolutional neural network (CNN) was proposed to learn the relationship between EEG signal and the template corresponding to each stimulus frequency and classify. Compared with traditional methods (i.e., CCA, FBCCA and SVM) and state-of-the-art method (CNN) on the collected SSVEP datasets of 20 subjects, the method we proposed always performed best at different speeds. Therefore, these results validated the effectiveness of the method. In addition, compared with the speed of 0 km / h, the accuracy of the compare network at a high walking rate (5km/h) did not decrease much, and it could still maintain a good performance.

Statistically Optimized Spatial Filtering in Decoding Steady-State Visual Evoked Potentials Based on Task-Related Component Analysis

Task-related component analysis (TRCA) has been the most effective spatial filtering method in implementing high-speed brain-computer interfaces (BCIs) based on steady-state visual evoked potentials (SSVEPs). TRCA is a data-driven method, in which spatial filters are optimized to maximize inter-trial covariance of time-locked electroencephalographic (EEG) data, formulated as a generalized eigenvalue problem. Although multiple eigenvectors can be obtained by TRCA, the traditional TRCA-based SSVEP detection considered only one that corresponds to the largest eigenvalue to reduce its computational cost. This study proposes using multiple eigen-vectors to classify SSVEPs. Specifically, this study integrates a task consistency test, which statistically identifies whether the component reconstructed by each eigenvector is task-related or not, with the TRCA-based SSVEP detection method. The proposed method was evaluated by using a 12-class SSVEP dataset recorded from 10 subjects. The study results indicated that the task consistency test usually identified and suggested more than one eigenvectors (i.e., spatial filters). Further, the use of additional spatial filters significantly improved the classification accuracy of the TRCA-based SSVEP detection.

Synchrosqueezing with short-time fourier transform method for trinary frequency shift keying encoded SSVEP

BACKGROUND

The frequencies that can evoke strong steady state visual evoked potentials (SSVEP) are limited, which leads to brain-computer interface (BCI) instruction limitation in the current SSVEP-BCI. To solve this problem, the visual stimulus signal modulated by trinary frequency shift keying was introduced.

OBJECTIVE

The main purpose of this paper is to find a more reliable recognition algorithm for SSVEP-BCI based on trinary frequency shift keying modulated stimuli.

METHODS

First, the signal modulated by trinary frequency shift keying is simulated by MATLAB. At different noise levels, the empirical mode decomposition, singular value decomposition, and synchrosqueezing with the short-time Fourier transform are used to extract the characteristic frequency and reconstruct the signal. Then, the coherent method is used to demodulate the reconstructed signal. Second, in the paradigm of BCI using trinary frequency shift keying modulated stimuli, the three methods mentioned above are used to reconstruct EEG signals, and canonical correlation analysis and coherent demodulation are used to recognize the BCI instructions.

RESULTS

For simulated signals, it is found that synchrosqueezing with short-time Fourier transform has a better effect on extracting the characteristic frequencies. For the EEG signal, it is found that the method combining synchrosqueezing with short-time Fourier transform and coherent demodulation has a higher accuracy and information translate rate than other methods.

CONCLUSION

The method combining synchrosqueezing with short-time Fourier transform and coherent demodulation proposed in this paper can be applied in the SSVEP system based on trinary frequency shift keying modulated stimuli.

The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli

Steady-state visual evoked potential (SSVEP) is a periodic response to a repetitive visual stimulus at a specific frequency. Currently, SSVEP is widely treated as an attention tag in cognitive activities and is used as an input signal for brain-computer interfaces (BCIs). However, whether SSVEP can be used as a reliable indicator has been a controversial issue. We focused on the independence of SSVEP from frequency allocation and number of stimuli. First, a cue-target paradigm was adopted to examine the interaction between SSVEPs evoked by two stimuli with different frequency allocations under different attention conditions. Second, we explored whether signal strength and the performance of SSVEP-based BCIs were affected by the number of stimuli. The results revealed that no significant interaction of SSVEP responses appeared between attended and unattended stimuli under various frequency allocations, regardless of their appearance in the fundamental or second-order harmonic. The amplitude of SSVEP suffered no significant gain or loss under different numbers of stimuli, but the performance of SSVEP-based BCIs varied along with duration of stimuli; that is, the recognition rate was not affected by the number of stimuli when the duration of stimuli was long enough, while the information transfer rate (ITR) presented the opposite trend. It can be concluded that SSVEP is a reliable tool for marking and monitoring multiple stimuli simultaneously in cognitive studies, but much caution should be taken when choosing a suitable duration and the number of stimuli, in order to achieve optimal utility of BCIs in the future.

Optimizing a dual-frequency and phase modulation method for SSVEP-based BCIs

OBJECTIVE

The design of the stimulation paradigm plays an important role in steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) studies. Among various stimulation designs, the dual-frequency paradigm in which two frequencies are used to encode one target is of importance and interest. However, because the number of possible frequency combinations is huge, the existing dual-frequency modulation paradigms failed to optimize the encoding towards the best combinations. Thus, this work aiming at designing a new dual-frequency and phase modulation paradigm with the best combinations stimuli.

APPROACH

This study proposed a dual-frequency and phase modulation method, which can achieve a large number of targets by making different combinations of two frequencies and an initial phase. This study also designed a set of methods for quickly optimizing the stimulation codes for the dual-frequency and phase modulation method.

MAIN RESULTS

An online 40-class BCI experiment with 12 subjects obtained an accuracy of 96.06[Formula: see text]4.00% and an averaged information transfer rate (ITR) of 196.09[Formula: see text]15.25 bits min^-1, which were much higher than the existing dual-frequency modulation paradigms. Moreover, an offline simulation with a public dataset showed that the optimization method was also effective for optimizing the single-frequency and phase modulation paradigm.

SIGNIFICANCE

These results demonstrate the high performance of the proposed dual-frequency and phase modulation method and the high efficiency of the optimization method for designing SSVEP stimulation paradigms. In addition, the coding efficiency of the optimized dual-frequency and phase modulation paradigm is higher than that of the single-frequency and phase modulation paradigm, and it is expected to further realize the BCI paradigm with a large amount of targets.

Stress-Induced Effects in Resting EEG Spectra Predict the Performance of SSVEP-Based BCI

Most research in Brain-Computer-Interfaces (BCI) focuses on technologies to improve accuracy and speed. Little has been done on the effects of subject variability, both across individuals and within the same individual, on BCI performance. For example, stress, arousal, motivation, and fatigue can all affect the electroencephalogram (EEG) signals used by a BCI, which in turn impacts performance. Overcoming the impact of such user variability on BCI performance is an impending and inevitable challenge for routine applications of BCIs in the real world. To systematically explore the factors affecting BCI performance, this study embeds a Steady-State Visually Evoked Potential (SSVEP) based BCI into a "game with a purpose" (GWAP) to obtain data over significant lengths of time, under both high- and low-stress conditions. Ten healthy volunteers played a GWAP that resembles popular match-three games, such as Jewel Quest, Zoo Boom, or Candy Crush. We recorded the target search time, target search accuracy, and EEG signals during gameplay to investigate the impacts of stress on EEG signals and BCI performance. We used Canonical Correlation Analysis (CCA) to determine whether the subject had found and attended to the correct target. The experimental results show that SSVEP target-classification accuracy is reduced by stress. We also found a negative correlation between EEG spectra and the SNR of EEG in the frontal and occipital regions during gameplay, with a larger negative correlation for the high-stress conditions. Furthermore, CCA also showed that when the EEG alpha and theta power increased, the search accuracy decreased, and the spectral amplitude drop was more evident under the high-stress situation. These results provide new, valuable insights into research on how to improve the robustness of BCIs in real-world applications.

Optimizing SSVEP-Based BCI System towards Practical High-Speed Spelling

The brain–computer interface (BCI) spellers based on steady-state visual evoked potentials (SSVEPs) have recently been widely investigated for their high information transfer rates (ITRs). This paper aims to improve the practicability of the SSVEP-BCIs for high-speed spelling. The system acquired the electroencephalogram (EEG) data from a self-developed dedicated EEG device and the stimulation was arranged as a keyboard. The task-related component analysis (TRCA) spatial filter was modified (mTRCA) for target classification and showed significantly higher performance compared with the original TRCA in the offline analysis. In the online system, the dynamic stopping (DS) strategy based on Bayesian posterior probability was utilized to realize alterable stimulating time. In addition, the temporal filtering process and the programs were optimized to facilitate the online DS operation. Notably, the online ITR reached 330.4 ± 45.4 bits/min on average, which is significantly higher than that of fixed stopping (FS) strategy, and the peak value of 420.2 bits/min is the highest online spelling ITR with a SSVEP-BCI up to now. The proposed system with portable EEG acquisition, friendly interaction, and alterable time of command output provides more flexibility for SSVEP-based BCIs and is promising for practical high-speed spelling.

Self-adaptive shared control with brain state evaluation network for human-wheelchair cooperation

OBJECTIVE

For the shared control systems, how to trade off the control weight between robot autonomy and human operator is an important issue, especially for BCI-based systems. However, most of existing shared controllers have paid less attention to the effects caused by subjects with different levels of brain control ability.

APPROACH

In this paper, a brain state evaluation network, termed BSE-NET, is proposed to evaluate subjects' brain control ability online based on quantized attention-gated kernel reinforcement learning. With the output of BSE-NET (confidence score), a shared controller is designed to dynamically adjust the control weight between robot autonomy and human operator.

MAIN RESULTS

The experimental results show that most of subjects achieved high and stable experimental success rate of approximately 90%. Furthermore, for subjects with different accuracy on EEG decoding, a proper confidence score can be dynamically generated to reflect their levels of brain control ability, and the proposed system can effectively adjust the control weight in all-time shared control.

SIGNIFICANCE

We discuss how our proposed method shows promise for BCI applications that can evaluate subjects' brain control ability online as well as provide a method for the research on self-adaptive shared control to adaptively balance control weight between subject's instruction and robot autonomy.

Separable EEG Features Induced by Timing Prediction for Active Brain-Computer Interfaces

Brain–computer interfaces (BCI) have witnessed a rapid development in recent years. However, the active BCI paradigm is still underdeveloped with a lack of variety. It is imperative to adapt more voluntary mental activities for the active BCI control, which can induce separable electroencephalography (EEG) features. This study aims to demonstrate the brain function of timing prediction, i.e., the expectation of upcoming time intervals, is accessible for BCIs. Eighteen subjects were selected for this study. They were trained to have a precise idea of two sub-second time intervals, i.e., 400 ms and 600 ms, and were asked to measure a time interval of either 400 ms or 600 ms in mind after a cue onset. The EEG features induced by timing prediction were analyzed and classified using the combined discriminative canonical pattern matching and common spatial pattern. It was found that the ERPs in low-frequency (0~4 Hz) and energy in high-frequency (20~60 Hz) were separable for distinct timing predictions. The accuracy reached the highest of 93.75% with an average of 76.45% for the classification of 400 vs. 600 ms timing. This study first demonstrates that the cognitive EEG features induced by timing prediction are detectable and separable, which is feasible to be used in active BCIs controls and can broaden the category of BCIs.

BETA: A Large Benchmark Database Toward SSVEP-BCI Application

The brain-computer interface (BCI) provides an alternative means to communicate and it has sparked growing interest in the past two decades. Specifically, for Steady-State Visual Evoked Potential (SSVEP) based BCI, marked improvement has been made in the frequency recognition method and data sharing. However, the number of pubic databases is still limited in this field. Therefore, we present a BEnchmark database Towards BCI Application (BETA) in the study. The BETA database is composed of 64-channel Electroencephalogram (EEG) data of 70 subjects performing a 40-target cued-spelling task. The design and the acquisition of the BETA are in pursuit of meeting the demand from real-world applications and it can be used as a test-bed for these scenarios. We validate the database by a series of analyses and conduct the classification analysis of eleven frequency recognition methods on BETA. We recommend using the metric of wide-band signal-to-noise ratio (SNR) and BCI quotient to characterize the SSVEP at the single-trial and population levels, respectively. The BETA database can be downloaded from the following link http://bci.med.tsinghua.edu.cn/download.html.

A Multifocal SSVEPs-based Brain-Computer Interface with Less Calibration Time

For the past few years, electroencephalogram (EEG)-based brain-computer interfaces (BCIs) have gotten tremendous progress and attracted increasing attention. To broaden the application of BCIs, researchers have focused on the increasement of the BCI instruction number in recent years. However, with a large number of instructions, the BCI calibration time will be too long to be accepted in practical usage. This study proposed a new coding method based on multifocal steady-state visual evoked potentials (mfSSVEPs), in which 16 targets were binary coded by 4 frequencies. Notably, the training data needed for calibration corresponded to only five out of the sixteen targets. Five volunteers were recruited to test this paradigm. Task-related component analysis combined with a probabilistic model were employed for target recognition. As a result, the accuracy could reach as high as 93.1% with 1s-length data. The highest information transfer rate (ITR) was 101.1 bits/min with an average of 73.9 bits/min. The results indicate that this new paradigm is promising to encode a large BCI instruction set with less trainings.

Prediction of gait intention from pre-movement EEG signals: a feasibility study

BACKGROUND

Prediction of Gait intention from pre-movement Electroencephalography (EEG) signals is a vital step in developing a real-time Brain-computer Interface (BCI) for a proper neuro-rehabilitation system. In that respect, this paper investigates the feasibility of a fully predictive methodology to detect the intention to start and stop a gait cycle by utilizing EEG signals obtained before the event occurrence.

METHODS

An eight-channel, custom-made, EEG system with electrodes placed around the sensorimotor cortex was used to acquire EEG data from six healthy subjects and two amputees. A discrete wavelet transform-based method was employed to capture event related information in alpha and beta bands in the time-frequency domain. The Hjorth parameters, namely activity, mobility, and complexity, were extracted as features while a two-sample unpaired Wilcoxon test was used to get rid of redundant features for better classification accuracy. The feature set thus obtained was then used to classify between 'walk vs. stop' and 'rest vs. start' classes using support vector machine (SVM) classifier with RBF kernel in a ten-fold cross-validation scheme.

RESULTS

Using a fully predictive intention detection system, 76.41±4.47% accuracy, 72.85±7.48% sensitivity, and 79.93±5.50% specificity were achieved for 'rest vs. start' classification. While for 'walk vs. stop' classification, the obtained mean accuracy, sensitivity, and specificity were 74.12±4.12%, 70.24±6.45%, and 77.78±7.01% respectively. Overall average True Positive Rate achieved by this methodology was 72.06±8.27% with 1.45 False Positives/min.

CONCLUSION

Extensive simulations and resulting classification results show that it is possible to achieve statistically similar intention detection accuracy using either only pre-movement EEG features or trans-movement EEG features. The classifier performance shows the potential of the proposed methodology to predict human movement intention exclusively from the pre-movement EEG signal to be applied in real-life prosthetic and neuro-rehabilitation systems.