Novel channel selection method based on position priori weighted permutation entropy and binary gravity search algorithm

A cross-dataset adaptive domain selection transfer learning framework for motor imagery-based brain-computer interfaces

Objective. In brain-computer interfaces (BCIs) that utilize motor imagery (MI), minimizing calibration time has become increasingly critical for real-world applications. Recently, transfer learning (TL) has been shown to effectively reduce the calibration time in MI-BCIs. However, variations in data distribution among subjects can significantly influence the performance of TL in MI-BCIs.Approach.We propose a cross-dataset adaptive domain selection transfer learning framework that integrates domain selection, data alignment, and an enhanced common spatial pattern (CSP) algorithm. Our approach uses a huge dataset of 109 subjects as the source domain. We begin by identifying non-BCI illiterate subjects from this huge dataset, then determine the source domain subjects most closely aligned with the target subjects using maximum mean discrepancy. After undergoing Euclidean alignment processing, features are extracted by multiple composite CSP. The final classification is carried out using the support vector machine.Main results.Our findings indicate that the proposed technique outperforms existing methods, achieving classification accuracies of 75.05% and 76.82% in two cross-dataset experiments, respectively.Significance.By reducing the need for extensive training data, yet maintaining high accuracy, our method optimizes the practical implementation of MI-BCIs.

[A review on electroencephalogram based channel selection]

The electroencephalogram (EEG) signal is the key signal carrier of the brain-computer interface (BCI) system. The EEG data collected by the whole-brain electrode arrangement is conducive to obtaining higher information representation. Personalized electrode layout, while ensuring the accuracy of EEG signal decoding, can also shorten the calibration time of BCI and has become an important research direction. This paper reviews the EEG signal channel selection methods in recent years, conducts a comparative analysis of the combined effects of different channel selection methods and different classification algorithms, obtains the commonly used channel combinations in motor imagery, P300 and other paradigms in BCI, and explains the application scenarios of the channel selection method in different paradigms are discussed, in order to provide stronger support for a more accurate and portable BCI system.

Variance characteristic preserving common spatial pattern for motor imagery BCI

Introduction

The common spatial patterns (CSP) algorithm is the most popular technique for extracting electroencephalogram (EEG) features in motor imagery based brain-computer interface (BCI) systems. CSP algorithm embeds the dimensionality of multichannel EEG data to extract features of motor imagery tasks. Most previous studies focused on the optimization of the time domain and the spectrum domain of EEG signal to improve the effectiveness of CSP, whereas ignoring the constraint on the projected feature space.

Methods

This study proposed a variance characteristic preserving CSP (VPCSP) that is modified by a regularization item based on graph theory. Specifically, we calculated the loss of abnormalities of the projected data while preserving the variance characteristic locally. Then the loss could be rewritten as a matrix with the introduction of the Laplace matrix, which turned it into a generalized eigenvalue problem equivalent to CSP. This study evaluated the proposed method on two public EEG datasets from the BCI competition. The modified method could extract robust and distinguishable features that provided higher classification performance. Experimental results showed that the proposed regularization improved the effectiveness of CSP significantly and achieved superior performance compared with reported modified CSP algorithms significantly.

Results

The classification accuracy of the proposed method achieved 87.88 %, 90.07 %, and 76.06 % on public dataset IV part I, III part IVa and the self-collected dataset, respectively. Comparative experiments are conducted on two public datasets and one self-collected dataset. Results showed that the proposed method outperformed the reported algorithm.

Discussion

The proposed method can extract robust features to increase the performance of BCI systems. And the proposal still has expandability. These results show that our proposal is a promising candidate for the performance improvement of MI-BCI.

Feature learning framework based on EEG graph self-attention networks for motor imagery BCI systems

Learning distinguishable features from raw EEG signals is crucial for accurate classification of motor imagery (MI) tasks. To incorporate spatial relationships between EEG sources, we developed a feature set based on an EEG graph. In this graph, EEG channels represent the nodes, with power spectral density (PSD) features defining their properties, and the edges preserving the spatial information. We designed an EEG based graph self-attention network (EGSAN) to learn low-dimensional embedding vector for EEG graph, which can be used as distinguishable features for motor imagery task classification. We evaluated our EGSAN model on two publicly available MI EEG datasets, each containing different types of motor imagery tasks. Our experiments demonstrate that our proposed model effectively extracts distinguishable features from EEG graphs, achieving significantly higher classification accuracies than existing state-of-the-art methods.

Novel channel selection model based on graph convolutional network for motor imagery

Multi-channel electroencephalography (EEG) is used to capture features associated with motor imagery (MI) based brain-computer interface (BCI) with a wide spatial coverage across the scalp. However, redundant EEG channels are not conducive to improving BCI performance. Therefore, removing irrelevant channels can help improve the classification performance of BCI systems. We present a new method for identifying relevant EEG channels. Our method is based on the assumption that useful channels share related information and that this can be measured by inter-channel connectivity. Specifically, we treat all candidate EEG channels as a graph and define channel selection as the problem of node classification on a graph. Then we design a graph convolutional neural network (GCN) model for channels classification. Channels are selected based on the outputs of our GCN model. We evaluate our proposed GCN-based channel selection (GCN-CS) method on three MI datasets. On three datasets, GCN-CS achieves performance improvements by reducing the number of channels. Specifically, we achieve classification accuracies of 79.76% on Dataset 1, 89.14% on Dataset 2 and 87.96% on Dataset 3, which outperform competing methods significantly.

Decoding motor imagery with a simplified distributed dipoles model at source level

Motor imagery (MI) based brain computer interface significantly oriented the development of neuro-rehabilitation, and the crucial issue is how to accurately detect the changes of cerebral cortex for MI decoding. The brain activity can be calculated based on the head model and observed scalp EEG, providing insights regarding cortical dynamics by using equivalent current dipoles with high spatial and temporal resolution. Now, all the dipoles within entire cortex or partial regions of interest are directly applied to data representation, this may make the key information weakened or lost, and it is worth studying how to choose the most important from numerous dipoles. In this paper, we devote to building a simplified distributed dipoles model (SDDM), which is combined with convolutional neural network (CNN), generating a MI decoding method at source level (called SDDM-CNN). First, all channels of raw MI-EEG signals are subdivided by a series of bandpass filters with width of 1 Hz, the average energies associated with any sub-band signals are calculated and ranked in a descending order to screen the top n sub-bands; then, the MI-EEG signals over each selected sub-band are mapped into source space by using EEG source imaging technology, and for each scout of neuroanatomical Desikan-Killiany partition, a centered dipole is selected as the most relevant dipole and put together to build a SDDM to reflect the neuroelectric activity of entire cerebral cortex; finally, the 4 dimensional (4D) magnitude matrix is constructed for each SDDM and fused into a novel data representation, which is further input to a well-designed 3DCNN with n parallel branches (nB3DCNN) to extract and classify the comprehensive features from time-frequency-space dimensions. Experiments are carried out on three public datasets, and the average ten-fold CV decoding accuracies achieve 95.09%, 97.98% and 94.53% respectively, and the statistical analysis is fulfilled by standard deviation, kappa value and confusion matrix. Experiment results suggest that it is beneficial to pick out the most sensitive sub-bands in sensor domain, and SDDM can sufficiently describe the dynamic changing of entire cortex, improving decoding performance while greatly reducing number of source signals. Also, nB3DCNN is capable of exploring spatial-temporal features from multi sub-bands.

Adaptive binary multi-objective harmony search algorithm for channel selection and cross-subject generalization in motor imagery-based BCI

OBJECTIVE

Multi-channel EEG data containing redundant information and noise may result in low classification accuracy and high computational complexity, which limits the practicality of motor imagery-based BCI systems. Therefore, channel selection can improve BCI performance and contribute to user convenience. Additionally, cross-subject generalization is a key topic in the channel selection of motor imagery-based BCI.

APPROACH

In this study, an adaptive binary multi-objective harmony search (ABMOHS) algorithm is proposed to select the optimal set of channels. Furthermore, a new adaptive crosssubject generalization model (ACGM) is proposed. Three public motor imagery datasets were used to validate the effectiveness of the proposed method.

MAIN RESULTS

The Wilcoxon signed-rank test was performed on the test accuracies, and the results indicated that the ABMOHS method significantly outperformed all channels (p<0.001), the C3-Cz-C4 channels (p<0.001), and 20 channels (p<0.001) in the sensorimotor cortex. The ABMOHS algorithm based on Fisher's linear discriminant analysis (FLDA) and support vector machine (SVM) classifiers greatly reduces the number of selected channels, especially for larger channel sizes (Dataset 2), and obtains a comparative classification performance. Although there was no significant difference in test classification performance between ABMOHS and non-dominated sorting genetic algorithm II (NSGA-II) when FLDA and SVM were used, ABMOHS required less computational time than NSGA-II. Furthermore, the number of channels obtained by ABMOHS algorithm were significantly smaller than those obtained by CSP-Rank and correlation-based channel selection algorithm (CCS). Additionally, the generalization of ACGM to untrained subjects shows that the mean test classification accuracy of ACGM created by a small sample of trained subjects is significantly better than that of Special-16 and Special-32.

SIGNIFICANCE

The proposed method can reduce the calibration time in the training phase and improve the practicability of MI-BCI.

Miniaturization for wearable EEG systems: recording hardware and data processing

As more people desire at-home diagnosis and treatment for their health improvement, healthcare devices have become more wearable, comfortable, and easy to use. In that sense, the miniaturization of electroencephalography (EEG) systems is a major challenge for developing daily-life healthcare devices. Recently, because of the intertwined relationship between EEG recording and processing, co-research of EEG recording hardware and data processing has been emphasized for whole-in-one miniaturized EEG systems. This paper introduces miniaturization techniques in analog-front-end hardware and processing algorithms for such EEG systems. To miniaturize EEG recording hardware, various types of compact electrodes and mm-sized integrated circuits (IC) techniques including artifact rejection are studied to record accurate EEG signals in a much smaller manner. Active electrode and in-ear EEG technologies are also researched to make small-form-factor EEG measurement structures. Furthermore, miniaturization techniques for EEG processing are discussed including channel selection techniques that reduce the number of required electrode channel and hardware implementation of processing algorithms that simplify the EEG processing stage.

Coupling feature extraction method of resting state EEG Signals from amnestic mild cognitive impairment with type 2 diabetes mellitus based on weight permutation conditional mutual information

This study aimed to find a good coupling feature extraction method to effectively analyze resting state EEG signals (rsEEG) of amnestic mild cognitive impairment(aMCI) with type 2 diabetes mellitus(T2DM) and normal control (NC) with T2DM. A method of EEG signal coupling feature extraction based on weight permutation conditional mutual information (WPCMI) was proposed in this research. With the WPCMI method, coupling feature strength of two time series in Alpha1, Alpha2, Beta1, Beta2 and Gamma bands for aMCI with T2DM and NC with T2DM could be extracted respectively. Then selected three frequency bands coupling feature matrix with the help of multi-spectral image transformation method to map it as spectral image characteristics. And finally classified these characteristics through the convolution neural network method(CNN). For aMCI with T2DM and NC with T2DM, the highest classification accuracy of 96%, 95%, 95% could be achieved respectively in the combination of three frequency bands (Alpha1, Alpha2, Gamma), (Beta1, Beta2 and Gamma) and (Alpha2, Beta1, Beta2). This WPCMI method highlighted the coupling dynamic characteristics of EEG signals, and its classification performance was better than all previous methods in aMCI with T2DM diagnosis field. WPCMI method could be used as an effective biomarker to distinguish EEG signals of aMCI with T2DM and NC with T2DM. The coupling feature extraction method used in this paper provided a new perspective for the EEG analysis of aMCI with T2DM.

Coefficient-of-variation-based channel selection with a new testing framework for MI-based BCI

In the motor-imagery (MI) based brain computer interface (BCI), multi-channel electroencephalogram (EEG) is often used to ensure the complete capture of physiological phenomena. With the redundant information and noise, EEG signals cannot be easily converted into separable features through feature extraction algorithms. Channel selection algorithms are proposed to address the issue, in which the filtering technique is widely used with the advantages of low computational cost and strong practicability. In this study, we proposed several improved methods for filtering channel selection algorithm. Specifically, based on the coefficient of variation and inter-class distance, a novel channel classification method was designed, which divided channels into different categories based on their contribution to feature extraction process. Then a filtering channel selection algorithm was proposed according to the previous classification method. Moreover, a new testing framework for filtering channel selection algorithms was proposed, which can better reflect the generalization ability of the algorithm. Experimental results indicated that the proposed channel classification method is effective, and the proposed testing framework is better than the original one. Meanwhile, the proposed channel selection algorithm achieved the accuracy of 87.7% and 81.7% in two BCI competition datasets, respectively, which was superior to competing algorithms.

Evaluation of color modulation in visual P300-speller using new stimulus patterns

Objective The stimulus color of P300-BCI systems has been successfully modified. However, the effects of different color combinations have not been widely investigated. In this study, we designed new stimulus patterns to evaluate the influence of color modulation on the BCI performance and waveforms of the evoked related potential (ERP).Methods Comparison was performed for three new stimulus patterns consisting of red face and colored block-shape, namely, red face with a white rectangle (RFW), red face with a blue rectangle (RFB), and red face with a red rectangle (RFR). Bayesian linear discriminant analysis (BLDA) was used to construct the individual classifier model. Repeated-measures ANOVA and Bonferroni correction were applied for statistical analysis. Results The RFW pattern obtained the highest average online accuracy with 96.94%, and those of RFR and RFB patterns were 93.61% and of 92.22% respectively. Significant differences in online accuracy and information transfer rate (ITR) were found between RFW and RFR patterns (p < 0.05). Conclusion Compared with RFR and RFB patterns, RFW yielded the best performance in P300-BCI. These new stimulus patterns with different color combinations have considerable importance to BCI applications and user-friendliness.

Evolutionary Multitasking-Based Multiobjective Optimization Algorithm for Channel Selection in Hybrid Brain Computer Interfacing Systems

Hybrid-modality brain-computer Interfaces (BCIs), which combine motor imagery (MI) bio-signals and steady-state visual evoked potentials (SSVEPs), has attracted wide attention in the research field of neural engineering. The number of channels should be as small as possible for real-life applications. However, most of recent works about channel selection only focus on either the performance of classification task or the effectiveness of device control. Few works conduct channel selection for MI and SSVEP classification tasks simultaneously. In this paper, a multitasking-based multiobjective evolutionary algorithm (EMMOA) was proposed to select appropriate channels for these two classification tasks at the same time. Moreover, a two-stage framework was introduced to balance the number of selected channels and the classification accuracy in the proposed algorithm. The experimental results verified the feasibility of multiobjective optimization methodology for channel selection of hybrid BCI tasks.

A novel classification method for EEG-based motor imagery with narrow band spatial filters and deep convolutional neural network

The Common Spatial Pattern (CSP) algorithm is the most widely used method for decoding Electroencephalography (EEG) signals from motor imagery (MI) paradigm. However, due to the inter-subject variability, the CSP algorithm heavily relies on the selection of filter bands and extensive analytical processing time required to build an effective model, which has been a challenge in current research. In this paper, we propose a narrow filter bank CSP (NFBCSP) algorithm, which automatically determines the optimal narrow band for two-class motor imagery by band search tree, and a high-performance classification model dedicated to each subject can be obtained in a short time for online processing or further offline analysis. The optimal narrow band is combined with the CSP algorithm to extract the dynamic features in the EEG signals. For the multi-class motor imagery task, it is first transformed into multiple One-Versus-Rest (OVR) tasks and determines the corresponding optimal narrow bands. After extracting the features of each optimal narrow band separately, the Deep Convolutional Neural Network (DCNN) is used for the fusion of band features and classification of multi-class motor imagery. Finally, we verified our method using two different motor imagery datasets, the BCI-VR dataset with two classes of motor imagery and the BCI Competition IV dataset 2a with four classes of motor imagery. The experimental results show that the proposed method achieves an average classification accuracy of 86.43% for the two-class motor imagery task, and 76.87% for the four-class motor imagery task, which outperforms other recent methods.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-021-09721-x.

BCI-Based Rehabilitation on the Stroke in Sequela Stage

Background

Stroke is the leading cause of serious and long-term disability worldwide. Survivors may recover some motor functions after rehabilitation therapy. However, many stroke patients missed the best time period for recovery and entered into the sequela stage of chronic stroke.

Method

Studies have shown that motor imagery- (MI-) based brain-computer interface (BCI) has a positive effect on poststroke rehabilitation. This study used both virtual limbs and functional electrical stimulation (FES) as feedback to provide patients with a closed-loop sensorimotor integration for motor rehabilitation. An MI-based BCI system acquired, analyzed, and classified motor attempts from electroencephalogram (EEG) signals. The FES system would be activated if the BCI detected that the user was imagining wrist dorsiflexion on the instructed side of the body. Sixteen stroke patients in the sequela stage were randomly assigned to a BCI group and a control group. All of them participated in rehabilitation training for four weeks and were assessed by the Fugl-Meyer Assessment (FMA) of motor function.

Results

The average improvement score of the BCI group was 3.5, which was higher than that of the control group (0.9). The active EEG patterns of the four patients in the BCI group whose FMA scores increased gradually became centralized and shifted to sensorimotor areas and premotor areas throughout the study.

Conclusions

Study results showed evidence that patients in the BCI group achieved larger functional improvements than those in the control group and that the BCI-FES system is effective in restoring motor function to upper extremities in stroke patients. This study provides a more autonomous approach than traditional treatments used in stroke rehabilitation.