Portable brain-computer interface based on novel convolutional neural network

A general dual-pathway network for EEG denoising

Introduction

Scalp electroencephalogram (EEG) analysis and interpretation are crucial for tracking and analyzing brain activity. The collected scalp EEG signals, however, are weak and frequently tainted with various sorts of artifacts. The models based on deep learning provide comparable performance with that of traditional techniques. However, current deep learning networks applied to scalp EEG noise reduction are large in scale and suffer from overfitting.

Methods

Here, we propose a dual-pathway autoencoder modeling framework named DPAE for scalp EEG signal denoising and demonstrate the superiority of the model on multi-layer perceptron (MLP), convolutional neural network (CNN) and recurrent neural network (RNN), respectively. We validate the denoising performance on benchmark scalp EEG artifact datasets.

Results

The experimental results show that our model architecture not only significantly reduces the computational effort but also outperforms existing deep learning denoising algorithms in root relative mean square error (RRMSE)metrics, both in the time and frequency domains.

Discussion

The DPAE architecture does not require a priori knowledge of the noise distribution nor is it limited by the network layer structure, which is a general network model oriented toward blind source separation.

A Combined Virtual Electrode-Based ESA and CNN Method for MI-EEG Signal Feature Extraction and Classification

A Brain-Computer Interface (BCI) is a medium for communication between the human brain and computers, which does not rely on other human neural tissues, but only decodes Electroencephalography (EEG) signals and converts them into commands to control external devices. Motor Imagery (MI) is an important BCI paradigm that generates a spontaneous EEG signal without external stimulation by imagining limb movements to strengthen the brain's compensatory function, and it has a promising future in the field of computer-aided diagnosis and rehabilitation technology for brain diseases. However, there are a series of technical difficulties in the research of motor imagery-based brain-computer interface (MI-BCI) systems, such as: large individual differences in subjects and poor performance of the cross-subject classification model; a low signal-to-noise ratio of EEG signals and poor classification accuracy; and the poor online performance of the MI-BCI system. To address the above problems, this paper proposed a combined virtual electrode-based EEG Source Analysis (ESA) and Convolutional Neural Network (CNN) method for MI-EEG signal feature extraction and classification. The outcomes reveal that the online MI-BCI system developed based on this method can improve the decoding ability of multi-task MI-EEG after training, it can learn generalized features from multiple subjects in cross-subject experiments and has some adaptability to the individual differences of new subjects, and it can decode the EEG intent online and realize the brain control function of the intelligent cart, which provides a new idea for the research of an online MI-BCI system.

Paving the Way for Motor Imagery-Based Tele-Rehabilitation through a Fully Wearable BCI System

The present study introduces a brain-computer interface designed and prototyped to be wearable and usable in daily life. Eight dry electroencephalographic sensors were adopted to acquire the brain activity associated with motor imagery. Multimodal feedback in extended reality was exploited to improve the online detection of neurological phenomena. Twenty-seven healthy subjects used the proposed system in five sessions to investigate the effects of feedback on motor imagery. The sample was divided into two equal-sized groups: a "neurofeedback" group, which performed motor imagery while receiving feedback, and a "control" group, which performed motor imagery with no feedback. Questionnaires were administered to participants aiming to investigate the usability of the proposed system and an individual's ability to imagine movements. The highest mean classification accuracy across the subjects of the control group was about 62% with 3% associated type A uncertainty, and it was 69% with 3% uncertainty for the neurofeedback group. Moreover, the results in some cases were significantly higher for the neurofeedback group. The perceived usability by all participants was high. Overall, the study aimed at highlighting the advantages and the pitfalls of using a wearable brain-computer interface with dry sensors. Notably, this technology can be adopted for safe and economically viable tele-rehabilitation.

EEG-Based BCIs on Motor Imagery Paradigm Using Wearable Technologies: A Systematic Review

In recent decades, the automatic recognition and interpretation of brain waves acquired by electroencephalographic (EEG) technologies have undergone remarkable growth, leading to a consequent rapid development of brain-computer interfaces (BCIs). EEG-based BCIs are non-invasive systems that allow communication between a human being and an external device interpreting brain activity directly. Thanks to the advances in neurotechnologies, and especially in the field of wearable devices, BCIs are now also employed outside medical and clinical applications. Within this context, this paper proposes a systematic review of EEG-based BCIs, focusing on one of the most promising paradigms based on motor imagery (MI) and limiting the analysis to applications that adopt wearable devices. This review aims to evaluate the maturity levels of these systems, both from the technological and computational points of view. The selection of papers has been performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), leading to 84 publications considered in the last ten years (from 2012 to 2022). Besides technological and computational aspects, this review also aims to systematically list experimental paradigms and available datasets in order to identify benchmarks and guidelines for the development of new applications and computational models.

EEG Identity Authentication in Multi-Domain Features: A Multi-Scale 3D-CNN Approach

Electroencephalogram (EEG) authentication has become a research hotspot in the field of information security due to its advantages of living, internal, and anti-stress. However, the performance of identity authentication system is limited by the inherent attributes of EEG, such as low SNR, low stability, and strong randomness. Researchers generally believe that the in-depth fusion of features can improve the performance of identity authentication and have explored among various feature domains. This experiment invited 70 subjects to participate in the EEG identity authentication task, and the experimental materials were visual stimuli of the self and non-self-names. This paper proposes an innovative EEG authentication framework, including efficient three-dimensional representation of EEG signals, multi-scale convolution structure, and the combination of multiple authentication strategies. In this work, individual EEG signals are converted into spatial–temporal–frequency domain three-dimensional forms to provide multi-angle mixed feature representation. Then, the individual identity features are extracted by the various convolution kernel of multi-scale vision, and the strategy of combining multiple convolution kernels is explored. The results show that the small-size and long-shape convolution kernel is suitable for ERP tasks, which can obtain better convergence and accuracy. The experimental results show that the classification performance of the proposed framework is excellent, and the multi-scale convolution method is effective to extract high-quality identity characteristics across feature domains. The results show that the branch number matches the EEG component number can obtain the excellent cost performance. In addition, this paper explores the network training performance for multi-scale module combination strategy and provides reference for deep network construction strategy of EEG signal processing.

An efficient 3D column-only P300 speller paradigm utilizing few numbers of electrodes and flashings for practical BCI implementation

The event related P300 potentials, positive waveforms in electroencephalography (EEG) signals, are often utilized in brain computer interfaces (BCI). Many studies have been carried out to improve the performance of P300 speller systems either by developing signal processing algorithms and classifiers with different architectures or by designing new paradigms. In this study, a new paradigm is proposed for this purpose. The proposed paradigm combines two remarkable properties of being a 3D animation and utilizing column-only flashings as opposed to classical paradigms which are based on row-column flashings in 2D manner. The new paradigm is utilized in a traditional two-layer artificial neural networks model with a single output neuron, and numerous experiments are conducted to evaluate and compare the performance of the proposed paradigm with that of the classical approach. The experimental results, including statistical significance tests, are presented for single and multiple EEG electrode usage combinations in 1, 3 and 15 flashing repetitions to detect P300 waves as well as to recognize target characters. Using the proposed paradigm, the best average classification accuracy rates on the test data are improved from 89.97% to 93.90% (an improvement of 4.36%) for 1 flashing, from 97.11% to 98.10% (an improvement of 1.01%) for 3 flashings and from 99.70% to 99.81% (an improvement of 0.11%) for 15 flashings when all electrodes, included in the study, are utilized. On the other hand, the accuracy rates are improved by 9.69% for 1 flashing, 4.72% for 3 flashings and 1.73% for 15 flashings when the proposed paradigm is utilized with a single EEG electrode (P8). It is observed that the proposed speller paradigm is especially useful in BCI systems designed for few EEG electrodes usage, and hence, it is more suitable for practical implementations. Moreover, all participants, given a subjective test, declared that the proposed paradigm is more user-friendly than classical ones.

Evaluation of a Single-Channel EEG-Based Sleep Staging Algorithm

Sleep staging is the basis of sleep assessment and plays a crucial role in the early diagnosis and intervention of sleep disorders. Manual sleep staging by a specialist is time-consuming and is influenced by subjective factors. Moreover, some automatic sleep staging algorithms are complex and inaccurate. The paper proposes a single-channel EEG-based sleep staging method that provides reliable technical support for diagnosing sleep problems. In this study, 59 features were extracted from three aspects: time domain, frequency domain, and nonlinear indexes based on single-channel EEG data. Support vector machine, neural network, decision tree, and random forest classifier were used to classify sleep stages automatically. The results reveal that the random forest classifier has the best sleep staging performance among the four algorithms. The recognition rate of the Wake phase was the highest, at 92.13%, and that of the N1 phase was the lowest, at 73.46%, with an average accuracy of 83.61%. The embedded method was adopted for feature filtering. The results of sleep staging of the 11-dimensional features after filtering show that the random forest model achieved 83.51% staging accuracy under the condition of reduced feature dimensions, and the coincidence rate with the use of all features for sleep staging was 94.85%. Our study confirms the robustness of the random forest model in sleep staging, which also represents a high classification accuracy with appropriate classifier algorithms, even using single-channel EEG data. This study provides a new direction for the portability of clinical EEG monitoring.

A Multi-Scale Fusion Convolutional Neural Network Based on Attention Mechanism for the Visualization Analysis of EEG Signals Decoding

Brain-computer interface (BCI) based on motor imagery (MI) electroencephalogram (EEG) decoding helps motor-disabled patients to communicate with external devices directly, which can achieve the purpose of human-computer interaction and assisted living. MI EEG decoding has a core problem which is extracting as many multiple types of features as possible from the multi-channel time series of EEG to understand brain activity accurately. Recently, deep learning technology has been widely used in EEG decoding. However, the variability of the simple network framework is insufficient to satisfy the complex task of EEG decoding. A multi-scale fusion convolutional neural network based on the attention mechanism (MS-AMF) is proposed in this paper. The network extracts spatio temporal multi-scale features from multi-brain regions representation signals and is supplemented by a dense fusion strategy to retain the maximum information flow. The attention mechanism we added to the network has improved the sensitivity of the network. The experimental results show that the network has a better classification effect compared with the baseline method in the BCI Competition IV-2a dataset. We conducted visualization analysis in multiple parts of the network, and the results show that the attention mechanism is also convenient for analyzing the underlying information flow of EEG decoding, which verifies the effectiveness of the MS-AMF method.

An empirical survey of electroencephalography-based brain-computer interfaces

Objectives

The Electroencephalogram (EEG) signal is modified using the Motor Imagery (MI) and it is utilized for patients with high motor impairments. Hence, the direct relationship between the computer and brain is termed as an EEG-based brain-computer interface (BCI). The objective of this survey is to presents an analysis of the existing distinct BCIs based on EEG.

Methods

This survey provides a detailed review of more than 60 research papers presenting the BCI-based EEG, like motor imagery-based techniques, spatial filtering-based techniques, Steady-State Visual Evoked Potential (SSVEP)-based techniques, machine learning-based techniques, Event-Related Potential (ERP)-based techniques, and online EEG-based techniques. Subsequently, the research gaps and issues of several EEG-based BCI systems are adopted to help the researchers for better future scope.

Results

An elaborative analyses as well as discussion have been provided by concerning the parameters, like evaluation metrics, year of publication, accuracy, implementation tool, and utilized datasets obtained by various techniques.

Conclusions

This survey paper exposes research topics on BCI-based EEG, which helps the researchers and scholars, who are interested in this domain.

A Simplified CNN Classification Method for MI-EEG via the Electrode Pairs Signals

A brain-computer interface (BCI) based on electroencephalography (EEG) can provide independent information exchange and control channels for the brain and the outside world. However, EEG signals come from multiple electrodes, the data of which can generate multiple features. How to select electrodes and features to improve classification performance has become an urgent problem to be solved. This paper proposes a deep convolutional neural network (CNN) structure with separated temporal and spatial filters, which selects the raw EEG signals of the electrode pairs over the motor cortex region as hybrid samples without any preprocessing or artificial feature extraction operations. In the proposed structure, a 5-layer CNN has been applied to learn EEG features, a 4-layer max pooling has been used to reduce dimensionality, and a fully-connected (FC) layer has been utilized for classification. Dropout and batch normalization are also employed to reduce the risk of overfitting. In the experiment, the 4 s EEG data of 10, 20, 60, and 100 subjects from the Physionet database are used as the data source, and the motor imaginations (MI) tasks are divided into four types: left fist, right fist, both fists, and both feet. The results indicate that the global averaged accuracy on group-level classification can reach 97.28%, the area under the receiver operating characteristic (ROC) curve stands out at 0.997, and the electrode pair with the highest accuracy on 10 subjects dataset is FC3-FC4, with 98.61%. The research results also show that this CNN classification method with minimal (2) electrode can obtain high accuracy, which is an advantage over other methods on the same database. This proposed approach provides a new idea for simplifying the design of BCI systems, and accelerates the process of clinical application.

Cost-efficient and Custom Electrode-holder Assembly Infrastructure for EEG Recordings

Mobile electroencephalogram (EEG)-sensing technologies have rapidly progressed and made the access of neuroelectrical brain activity outside the laboratory in everyday life more realistic. However, most existing EEG headsets exhibit a fixed design, whereby its immobile montage in terms of electrode density and coverage inevitably poses a great challenge with applicability and generalizability to the fundamental study and application of the brain-computer interface (BCI). In this study, a cost-efficient, custom EEG-electrode holder infrastructure was designed through the assembly of primary components, including the sensor-positioning ring, inter-ring bridge, and bridge shield. It allows a user to (re)assemble a compact holder grid to accommodate a desired number of electrodes only to the regions of interest of the brain and iteratively adapt it to a given head size for optimal electrode-scalp contact and signal quality. This study empirically demonstrated its easy-to-fabricate nature by a low-end fused deposition modeling (FDM) 3D printer and proved its practicability of capturing event-related potential (ERP) and steady-state visual-evoked potential (SSVEP) signatures over 15 subjects. This paper highlights the possibilities for a cost-efficient electrode-holder assembly infrastructure with replaceable montage, flexibly retrofitted in an unlimited fashion, for an individual for distinctive fundamental EEG studies and BCI applications.