A Novel P300 Classification Algorithm Based on a Principal Component Analysis-Convolutional Neural Network

Single-trial P300 classification algorithm based on centralized multi-person data fusion CNN

Introduction

Currently, it is still a challenge to detect single-trial P300 from electroencephalography (EEG) signals. In this paper, to address the typical problems faced by existing single-trial P300 classification, such as complex, time-consuming and low accuracy processes, a single-trial P300 classification algorithm based on multiplayer data fusion convolutional neural network (CNN) is proposed to construct a centralized collaborative brain-computer interfaces (cBCI) for fast and highly accurate classification of P300 EEG signals.

Methods

In this paper, two multi-person data fusion methods (parallel data fusion and serial data fusion) are used in the data pre-processing stage to fuse multi-person EEG information stimulated by the same task instructions, and then the fused data is fed as input to the CNN for classification. In building the CNN network for single-trial P300 classification, the Conv layer was first used to extract the features of single-trial P300, and then the Maxpooling layer was used to connect the Flatten layer for secondary feature extraction and dimensionality reduction, thereby simplifying the computation. Finally batch normalisation is used to train small batches of data in order to better generalize the network and speed up single-trial P300 signal classification.

Results

In this paper, the above new algorithms were tested on the Kaggle dataset and the Brain-Computer Interface (BCI) Competition III dataset, and by analyzing the P300 waveform features and EEG topography and the four standard evaluation metrics, namely Accuracy, Precision, Recall and F1-score,it was demonstrated that the single-trial P300 classification algorithm after two multi-person data fusion CNNs significantly outperformed other classification algorithms.

Discussion

The results show that the single-trial P300 classification algorithm after two multi-person data fusion CNNs significantly outperformed the single-person model, and that the single-trial P300 classification algorithm with two multi-person data fusion CNNs involves smaller models, fewer training parameters, higher classification accuracy and improves the overall P300-cBCI classification rate and actual performance more effectively with a small amount of sample information compared to other algorithms.

A P300-Detection Method Based on Logistic Regression and a Convolutional Neural Network

Background

Electroencephalogram (EEG)-based brain-computer interface (BCI) systems are widely utilized in various fields, including health care, intelligent assistance, identity recognition, emotion recognition, and fatigue detection. P300, the main event-related potential, is the primary component detected by EEG-based BCI systems. Existing algorithms for P300 classification in EEG data usually perform well when tested in a single participant, although they exhibit significant decreases in accuracy when tested in new participants. We attempted to address this lack of generalizability associated with existing classification methods using a novel convolutional neural network (CNN) model developed using logistic regression (LR).

Materials and Methods

We proposed an LR-CNN model comprising two parts: a combined LR-based memory model and a CNN-based generalization model. The LR-based memory model can learn the individual features of participants and addresses the decrease in accuracy caused by individual differences when applied to new participants. The CNN-based generalization model can learn the common features among participants, thereby reducing overall classification bias and improving overall classification accuracy.

Results

We compared our method with existing, commonly used classification methods through three different sets of experiments. The experimental results indicated that our method could learn individual differences among participants. Compared with other commonly used classification methods, our method yielded a marked improvement (>90%) in classification among new participants.

Conclusion

The accuracy of the proposed model in the face of new participants is better than that of existing, commonly used classification methods. Such improvements in cross-subject test accuracy will aid in the development of BCI systems.

A Single-Trial P300 Detector Based on Symbolized EEG and Autoencoded-(1D)CNN to Improve ITR Performance in BCIs

In this paper, we propose a breakthrough single-trial P300 detector that maximizes the information translate rate (ITR) of the brain–computer interface (BCI), keeping high recognition accuracy performance. The architecture, designed to improve the portability of the algorithm, demonstrated full implementability on a dedicated embedded platform. The proposed P300 detector is based on the combination of a novel pre-processing stage based on the EEG signals symbolization and an autoencoded convolutional neural network (CNN). The proposed system acquires data from only six EEG channels; thus, it treats them with a low-complexity preprocessing stage including baseline correction, windsorizing and symbolization. The symbolized EEG signals are then sent to an autoencoder model to emphasize those temporal features that can be meaningful for the following CNN stage. This latter consists of a seven-layer CNN, including a 1D convolutional layer and three dense ones. Two datasets have been analyzed to assess the algorithm performance: one from a P300 speller application in BCI competition III data and one from self-collected data during a fluid prototype car driving experiment. Experimental results on the P300 speller dataset showed that the proposed method achieves an average ITR (on two subjects) of 16.83 bits/min, outperforming by +5.75 bits/min the state-of-the-art for this parameter. Jointly with the speed increase, the recognition performance returned disruptive results in terms of the harmonic mean of precision and recall (F1-Score), which achieve 51.78 ± 6.24%. The same method used in the prototype car driving led to an ITR of ~33 bit/min with an F1-Score of 70.00% in a single-trial P300 detection context, allowing fluid usage of the BCI for driving purposes. The realized network has been validated on an STM32L4 microcontroller target, for complexity and implementation assessment. The implementation showed an overall resource occupation of 5.57% of the total available ROM, ~3% of the available RAM, requiring less than 3.5 ms to provide the classification outcome.

Real-Time Implementation of EEG Oscillatory Phase-Informed Visual Stimulation Using a Least Mean Square-Based AR Model

It is a technically challenging problem to assess the instantaneous brain state using electroencephalography (EEG) in a real-time closed-loop setup because the prediction of future signals is required to define the current state, such as the instantaneous phase and amplitude. To accomplish this in real-time, a conventional Yule–Walker (YW)-based autoregressive (AR) model has been used. However, the brain state-dependent real-time implementation of a closed-loop system employing an adaptive method has not yet been explored. Our primary purpose was to investigate whether time-series forward prediction using an adaptive least mean square (LMS)-based AR model would be implementable in a real-time closed-loop system or not. EEG state-dependent triggers synchronized with the EEG peaks and troughs of alpha oscillations in both an open-eyes resting state and a visual task. For the resting and visual conditions, statistical results showed that the proposed method succeeded in giving triggers at a specific phase of EEG oscillations for all participants. These individual results showed that the LMS-based AR model was successfully implemented in a real-time closed-loop system targeting specific phases of alpha oscillations and can be used as an adaptive alternative to the conventional and machine-learning approaches with a low computational load.

Special Issue on Advanced Biometrics with Deep Learning

Biometrics, such as fingerprint, iris, face, hand print, hand vein, speech and gait recognition, etc [...]

Time-Series Prediction of the Oscillatory Phase of EEG Signals Using the Least Mean Square Algorithm-Based AR Model

Neural oscillations are vital for the functioning of a central nervous system because they assist in brain communication across a huge network of neurons. Alpha frequency oscillations are believed to depict idling or inhibition of task-irrelevant cortical activities. However, recent studies on alpha oscillations (particularly alpha phase) hypothesize that they have an active and direct role in the mechanisms of attention and working memory. To understand the role of alpha oscillations in several cognitive processes, accurate estimations of phase, amplitude, and frequency are required. Herein, we propose an approach for time-series forward prediction by comparing an autoregressive (AR) model and an adaptive method (least mean square (LMS)-based AR model). This study tested both methods for two prediction lengths of data. Our results indicate that for shorter data segments (prediction of 128 ms), the AR model outperforms the LMS-based AR model, while for longer prediction lengths (256 ms), the LMS- based AR model surpasses the AR model. LMS with low computational cost can aid in electroencephalography (EEG) phase prediction (alpha oscillations) in basic research to reveal the functional role of the oscillatory phase as well as for applications for brain-computer interfaces.