Toward optimal feature and time segment selection by divergence method for EEG signals classification

EEG Feature Extraction Using Evolutionary Algorithms for Brain-Computer Interface Development

Brain-computer interfaces are systems capable of mapping brain activity to specific commands, which enables to remotely automate different types of processes in hardware devices or software applications. However, the development of brain-computer interfaces has been limited by several factors that affect their performance, such as the characterization of events in brain signals and the excessive processing load generated by the high volume of data. In this paper, we propose a method based on computational intelligence techniques to handle these problems, turning them into a single optimization problem. An artificial neural network is used as a classifier for event detection, along with an evolutionary algorithm to find the optimal subset of electrodes and data points that better represents the target event. The obtained results indicate our approach is a competitive and viable alternative for feature extraction in electroencephalograms, leading to high accuracy values and allowing the reduction of a significant amount of data.

Discriminative Frequencies and Temporal EEG Segmentation in the Motor Imagery Classification Approach

A linear discriminant analysis transformation-based approach to the classification of three different motor imagery types for brain–computer interfaces was considered. The study involved 16 conditionally healthy subjects (12 men, 4 women, mean age of 21.5 years). First, the search for subject-specific discriminative frequencies was conducted in the task of movement-related activity. This procedure was shown to increase the classification accuracy compared to the conditional common spatial pattern (CSP) algorithm, followed by a linear classifier considered as a baseline approach. In addition, an original approach to finding discriminative temporal segments for each motor imagery was tested. This led to a further increase in accuracy under the conditions of using Hjorth parameters and interchannel correlation coefficients as features calculated for the EEG segments. In particular, classification by the latter feature led to the best accuracy of 71.6%, averaged over all subjects (intrasubject classification), and, surprisingly, it also allowed us to obtain a comparable value of intersubject classification accuracy of 68%. Furthermore, scatter plots demonstrated that two out of three pairs of motor imagery were discriminated by the approach presented.

Riemannian classification of single-trial surface EEG and sources during checkerboard and navigational images in humans

OBJECTIVE

Different visual stimuli are classically used for triggering visual evoked potentials comprising well-defined components linked to the content of the displayed image. These evoked components result from the average of ongoing EEG signals in which additive and oscillatory mechanisms contribute to the component morphology. The evoked related potentials often resulted from a mixed situation (power variation and phase-locking) making basic and clinical interpretations difficult. Besides, the grand average methodology produced artificial constructs that do not reflect individual peculiarities. This motivated new approaches based on single-trial analysis as recently used in the brain-computer interface field.

APPROACH

We hypothesize that EEG signals may include specific information about the visual features of the displayed image and that such distinctive traits can be identified by state-of-the-art classification algorithms based on Riemannian geometry. The same classification algorithms are also applied to the dipole sources estimated by sLORETA.

MAIN RESULTS AND SIGNIFICANCE

We show that our classification pipeline can effectively discriminate between the display of different visual items (Checkerboard versus 3D navigational image) in single EEG trials throughout multiple subjects. The present methodology reaches a single-trial classification accuracy of about 84% and 93% for inter-subject and intra-subject classification respectively using surface EEG. Interestingly, we note that the classification algorithms trained on sLORETA sources estimation fail to generalize among multiple subjects (63%), which may be due to either the average head model used by sLORETA or the subsequent spatial filtering failing to extract discriminative information, but reach an intra-subject classification accuracy of 82%.

On the characterization of cognitive tasks using activity-specific short-lived synchronization between electroencephalography channels

Accurate characterization of brain activity during a cognitive task is challenging due to the dynamically changing and the complex nature of the brain. The majority of the proposed approaches assume stationarity in brain activity and disregard the systematic timing organization among brain regions during cognitive tasks. In this study, we propose a novel cognitive activity recognition method that captures the activity-specific timing parameters from training data that elicits maximal average short-lived pairwise synchronization between electroencephalography signals. We evaluated the characterization power of the activity-specific timing parameter triplets in a motor imagery activity recognition framework. The activity-specific timing parameter triplets consist of latency of the maximally synchronized signal segments from activity onset Δt, the time lag between maximally synchronized signal segments τ, and the duration of the maximally synchronized signal segments w. We used cosine-based similarity, wavelet bi-coherence, phase-locking value, phase coherence value, linearized mutual information, and cross-correntropy to calculate the channel synchronizations at the specific timing parameters. Recognition performances as well as statistical analyses on both BCI Competition-III dataset IVa and PhysioNet Motor Movement/Imagery dataset, indicate that the inter-channel short-lived synchronization calculated using activity-specific timing parameter triplets elicit significantly distinct synchronization profiles for different motor imagery tasks and can thus reliably be used for cognitive task recognition purposes.

Dynamics of Long-Range Temporal Correlations in Broadband EEG During Different Motor Execution and Imagery Tasks

Brain activity is composed of oscillatory and broadband arrhythmic components; however, there is more focus on oscillatory sensorimotor rhythms to study movement, but temporal dynamics of broadband arrhythmic electroencephalography (EEG) remain unexplored. We have previously demonstrated that broadband arrhythmic EEG contains both short- and long-range temporal correlations that change significantly during movement. In this study, we build upon our previous work to gain a deeper understanding of these changes in the long-range temporal correlation (LRTC) in broadband EEG and contrast them with the well-known LRTC in alpha oscillation amplitude typically found in the literature. We investigate and validate changes in LRTCs during five different types of movements and motor imagery tasks using two independent EEG datasets recorded with two different paradigms-our finger tapping dataset with single self-initiated asynchronous finger taps and publicly available EEG dataset containing cued continuous movement and motor imagery of fists and feet. We quantified instantaneous changes in broadband LRTCs by detrended fluctuation analysis on single trial 2 s EEG sliding windows. The broadband LRTC increased significantly (p < 0.05) during all motor tasks as compared to the resting state. In contrast, the alpha oscillation LRTC, which had to be computed on longer stitched EEG segments, decreased significantly (p < 0.05) consistently with the literature. This suggests the complementarity of underlying fast and slow neuronal scale-free dynamics during movement and motor imagery. The single trial broadband LRTC gave high average binary classification accuracy in the range of 70.54±10.03% to 76.07±6.40% for all motor execution and imagery tasks and hence can be used in brain-computer interface (BCI). Thus, we demonstrate generalizability, robustness, and reproducibility of novel motor neural correlate, the single trial broadband LRTC, during different motor execution and imagery tasks in single asynchronous and cued continuous motor-BCI paradigms and its contrasting behavior with LRTC in alpha oscillation amplitude.

Correlation-based common spatial pattern (CCSP): A novel extension of CSP for classification of motor imagery signal

Common spatial pattern (CSP) is shown to be an effective pre-processing algorithm in order to discriminate different classes of motor-based EEG signals by obtaining suitable spatial filters. The performance of these filters can be improved by regularized CSP, in which available prior information is added in terms of regularization terms into the objective function of conventional CSP. Variety of prior information can be used in this way. In this paper, we used time correlation between different classes of EEG signal as the prior information, which is clarified similarity between different classes of signal for regularizing CSP. Furthermore, the proposed objective function can be easily extended to more than two-class problems. We used three different standard datasets to evaluate the performance of the proposed method. Correlation-based CSP (CCSP) outperformed original CSP as well as the existing regularized CSP, Principle Component Cnalysis (PCA) and Fisher Discriminate Analysis (FDA) in both two-class and multi-class scenarios. The simulation results showed that the proposed method outperformed conventional CSP by 6.9% in 2-class and 2.23% in multi-class problem in term of mean classification accuracy.

An Incremental Version of L-MVU for the Feature Extraction of MI-EEG

Due to the nonlinear and high-dimensional characteristics of motor imagery electroencephalography (MI-EEG), it can be challenging to get high online accuracy. As a nonlinear dimension reduction method, landmark maximum variance unfolding (L-MVU) can completely retain the nonlinear features of MI-EEG. However, L-MVU still requires considerable computation costs for out-of-sample data. An incremental version of L-MVU (denoted as IL-MVU) is proposed in this paper. The low-dimensional representation of the training data is generated by L-MVU. For each out-of-sample data, its nearest neighbors will be found in the high-dimensional training samples and the corresponding reconstruction weight matrix be calculated to generate its low-dimensional representation as well. IL-MVU is further combined with the dual-tree complex wavelet transform (DTCWT), which develops a hybrid feature extraction method (named as IL-MD). IL-MVU is applied to extract the nonlinear features of the specific subband signals, which are reconstructed by DTCWT and have the obvious event-related synchronization/event-related desynchronization phenomenon. The average energy features of α and β waves are calculated simultaneously. The two types of features are fused and are evaluated by a linear discriminant analysis classifier. Based on the two public datasets with 12 subjects, extensive experiments were conducted. The average recognition accuracies of 10-fold cross-validation are 92.50% on Dataset 3b and 88.13% on Dataset 2b, and they gain at least 1.43% and 3.45% improvement, respectively, compared to existing methods. The experimental results show that IL-MD can extract more accurate features with relatively lower consumption cost, and it also has better feature visualization and self-adaptive characteristics to subjects. The t-test results and Kappa values suggest the proposed feature extraction method reaches statistical significance and has high consistency in classification.

Multi-class EEG classification of motor imagery signal by finding optimal time segments and features using SNR-based mutual information

The electroencephalogram signals are used to distinguish different motor imagery tasks in brain-computer interfaces. In most studies, in order to classify the EEG signals recorded in a cue-guided BCI paradigm, time segments for feature extraction after the onset of the visual cue were selected manually. In addition, in these studies the authors have selected a single identical time segment for different subjects. The present study emphasized on the inter-individual variability and difference between different motor imagery tasks as the potential source of erroneous results and used mutual information and the subject specific time interval to overcome this problem. More specifically, a new method was proposed to automatically find the best subject specific time intervals for the classification of four-class motor imagery tasks by using MI between the BCI input and output. Moreover, the signal-to-noise ratio was used to calculate the MI values, while the MI values were used as feature selection criteria to select the discriminative features. The time segments and the best discriminative features were found by using training data and used to assess the evaluation data. Furthermore, the CSP algorithm was used to extract signal features. The dataset 2A of BCI competition IV used in this study consisted of four different motor imagery signals, which were obtained from nine different subjects. One Vs One decomposition scheme was used to deal with the multi-class nature of the problem. The MI values showed that the obtained time segments not only varied between different subjects but also varied between different classifiers of different pair of classes. Finally, the results suggested that the proposed method was efficient in classifying multi-class motor imagery signals as compared to other classification strategies proposed by the other studies.