EEG Classification for Hybrid Brain-Computer Interface Using a Tensor Based Multiclass Multimodal Analysis Scheme

Tensor Decomposition Analysis of Longitudinal EEG Signals Reveals Differential Oscillatory Dynamics in Eyes-Closed and Eyes-Open Motor Imagery BCI: A Case Report

Functional dissociation of brain neural activity induced by opening or closing the eyes has been well established. However, how the temporal dynamics of the underlying neuronal modulations differ between these eye conditions during movement-related behaviours is less known. Using a robotic-assisted motor imagery brain-computer interface (MI BCI), we measured neural activity over the motor regions with electroencephalography (EEG) in a stroke survivor during his longitudinal rehabilitation training. We investigated lateralized oscillatory sensorimotor rhythm modulations while the patient imagined moving his hemiplegic hand with closed and open eyes to control an external robotic splint. In order to precisely identify the main profiles of neural activation affected by MI with eyes-open (MIEO) and eyes-closed (MIEC), a data-driven approach based on parallel factor analysis (PARAFAC) tensor decomposition was employed. Using the proposed framework, a set of narrow-band, subject-specific sensorimotor rhythms was identified; each of them had its own spatial and time signature. When MIEC trials were compared with MIEO trials, three key narrow-band rhythms whose peak frequencies centred at ∼8.0 Hz, ∼11.5 Hz, and ∼15.5 Hz, were identified with differently modulated oscillatory dynamics during movement preparation, initiation, and completion time frames. Furthermore, we observed that lower and higher sensorimotor oscillations represent different functional mechanisms within the MI paradigm, reinforcing the hypothesis that rhythmic activity in the human sensorimotor system is dissociated. Leveraging PARAFAC, this study achieves remarkable precision in estimating latent sensorimotor neural substrates, aiding the investigation of the specific functional mechanisms involved in the MI process.

Brain Activity Recognition Method Based on Attention-Based RNN Mode

Brain activity recognition based on electroencephalography (EEG) marks a major research orientation in intelligent medicine, especially in human intention prediction, human–computer control and neurological diagnosis. The literature research mainly focuses on the recognition of single-person binary brain activity, which is limited in the more extensive and complex scenarios. Therefore, brain activity recognition in multiperson and multi-objective scenarios has aroused increasingly more attention. Another challenge is the reduction of recognition accuracy caused by the interface of external noise as well as EEG’s low signal-to-noise ratio. In addition, traditional EEG feature analysis proves to be time-intensive and it relies heavily on mature experience. The paper proposes a novel EEG recognition method to address the above issues. The basic feature of EEG is first analyzed according to the band of EEG. The attention-based RNN model is then adopted to eliminate the interference to achieve the purpose of automatic recognition of the original EEG signal. Finally, we evaluate the proposed method with public and local data sets of EEG and perform lots of tests to investigate how factors affect the results of recognition. As shown by the test results, compared with some typical EEG recognition methods, the proposed method owns better recognition accuracy and suitability in multi-objective task scenarios.

Signal processing algorithms for SSVEP-based brain computer interface: State-of-the-art and recent developments

Over past two decades, steady-state evoked potentials (SSVEP)-based brain computer interface (BCI) systems have been extensively developed. As we all know, signal processing algorithms play an important role in this BCI. However, there is no comprehensive review of the latest development of signal processing algorithms for SSVEP-based BCI. By analyzing the papers published in authoritative journals in nearly five years, signal processing algorithms of preprocessing, feature extraction and classification modules are discussed in detail. In addition, other aspects existed in this BCI are mentioned. The following key problems are solved. (1) In recent years, which signal processing algorithms are frequently used in each module? (2) Which signal processing algorithms attract more attention in recent years? (3) Which modules are the key to signal processing in BCI field? This information is very important for choosing the appropriate algorithms, and can also be considered as a reference for further research. Simultaneously, we hope that this work can provide relevant BCI researchers with valuable information about the latest trends of signal processing algorithms for SSVEP-based BCI systems.

Motor imagery based brain-computer interface control of continuous passive motion for wrist extension recovery in chronic stroke patients

Motor recovery of wrist and fingers is still a great challenge for chronic stroke survivors. The present study aimed to verify the efficiency of motor imagery based brain-computer interface (BCI) control of continuous passive motion (CPM) in the recovery of wrist extension due to stroke. An observational study was conducted in 26 chronic stroke patients, aged 49.0 ± 15.4 years, with upper extremity motor impairment. All patients showed no wrist extension recovery. A 24-channel highresolution electroencephalogram (EEG) system was used to acquire cortical signal while they were imagining extension of the affected wrist. Then, 20 sessions of BCI-driven CPM training were carried out for 6 weeks. Primary outcome was the increase of active range of motion (ROM) of the affected wrist from the baseline to final evaluation. Improvement of modified Barthel Index, EEG classification and motor imagery pattern of wrist extension were recorded as secondary outcomes. Twenty-one patients finally passed the EEG screening and completed all the BCI-driven CPM trainings. From baseline to the final evaluation, the increase of active ROM of the affected wrists was (24.05 ± 14.46)˚. The increase of modified Barthel Index was 3.10 ± 4.02 points. But no statistical difference was detected between the baseline and final evaluations (P > 0.05). Both EEG classification and motor imagery pattern improved. The present study demonstrated beneficial outcomes of MI-based BCI control of CPM training in motor recovery of wrist extension using motor imagery signal of brain in chronic stroke patients.

Recent Advances in Hybrid Brain-Computer Interface Systems: A Technological and Quantitative Review

Brain-Computer Interface (BCI) is a system that enables users to transmit commands to the computer using their brain activity recorded by electroencephalography. In a Hybrid Brain-Computer Interface (HBCI), a BCI control signal combines with one or more BCI control signals or with Human-Machine Interface (HMI) biosignals to increase classification accuracy, boost system speed, and improve user’s satisfaction. HBCI systems are categorized according to the type of combined signals and the combination technique (simultaneous or sequential). They have been used in several applications such as cursor control, target selection, and spellers. Increasing the number of articles published in this field indicates the significance of these systems. In this paper, different HBCI combinations, their important features, and potential applications are discussed. In most cases, the combination of a BCI control signal with a HMI biosignal yields higher information transfer rate than two BCI control signals.

Hybrid Brain-Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review

In this article, non-invasive hybrid brain-computer interface (hBCI) technologies for improving classification accuracy and increasing the number of commands are reviewed. Hybridization combining more than two modalities is a new trend in brain imaging and prosthesis control. Electroencephalography (EEG), due to its easy use and fast temporal resolution, is most widely utilized in combination with other brain/non-brain signal acquisition modalities, for instance, functional near infrared spectroscopy (fNIRS), electromyography (EMG), electrooculography (EOG), and eye tracker. Three main purposes of hybridization are to increase the number of control commands, improve classification accuracy and reduce the signal detection time. Currently, such combinations of EEG + fNIRS and EEG + EOG are most commonly employed. Four principal components (i.e., hardware, paradigm, classifiers, and features) relevant to accuracy improvement are discussed. In the case of brain signals, motor imagination/movement tasks are combined with cognitive tasks to increase active brain-computer interface (BCI) accuracy. Active and reactive tasks sometimes are combined: motor imagination with steady-state evoked visual potentials (SSVEP) and motor imagination with P300. In the case of reactive tasks, SSVEP is most widely combined with P300 to increase the number of commands. Passive BCIs, however, are rare. After discussing the hardware and strategies involved in the development of hBCI, the second part examines the approaches used to increase the number of control commands and to enhance classification accuracy. The future prospects and the extension of hBCI in real-time applications for daily life scenarios are provided.

Stimulator Selection in SSVEP-Based Spatial Selective Attention Study

Steady-State Visual Evoked Potentials (SSVEPs) are widely used in spatial selective attention. In this process the two kinds of visual simulators, Light Emitting Diode (LED) and Liquid Crystal Display (LCD), are commonly used to evoke SSVEP. In this paper, the differences of SSVEP caused by these two stimulators in the study of spatial selective attention were investigated. Results indicated that LED could stimulate strong SSVEP component on occipital lobe, and the frequency of evoked SSVEP had high precision and wide range as compared to LCD. Moreover a significant difference between noticed and unnoticed frequencies in spectrum was observed whereas in LCD mode this difference was limited and selectable frequencies were also limited. Our experimental finding suggested that average classification accuracies among all the test subjects in our experiments were 0.938 and 0.853 in LED and LCD mode, respectively. These results indicate that LED simulator is appropriate for evoking the SSVEP for the study of spatial selective attention.