Bispectrum-Based Channel Selection for Motor Imagery Based Brain-Computer Interfacing

Evaluation of fragility fracture risk using deep learning based on ultrasound radio frequency signal

BACKGROUND

It was essential to identify individuals at high risk of fragility fracture and prevented them due to the significant morbidity, mortality, and economic burden associated with fragility fracture. The quantitative ultrasound (QUS) showed promise in assessing bone structure characteristics and determining the risk of fragility fracture.

AIMS

To evaluate the performance of a multi-channel residual network (MResNet) based on ultrasonic radiofrequency (RF) signal to discriminate fragility fractures retrospectively in postmenopausal women, and compared it with the traditional parameter of QUS, speed of sound (SOS), and bone mineral density (BMD) acquired with dual X-ray absorptiometry (DXA).

METHODS

Using QUS, RF signal and SOS were acquired for 246 postmenopausal women. An MResNet was utilized, based on the RF signal, to categorize individuals with an elevated risk of fragility fracture. DXA was employed to obtain BMD at the lumbar, hip, and femoral neck. The fracture history of all adult subjects was gathered. Analyzing the odds ratios (OR) and the area under the receiver operator characteristic curves (AUC) was done to evaluate the effectiveness of various methods in discriminating fragility fracture.

RESULTS

Among the 246 postmenopausal women, 170 belonged to the non-fracture group, 50 to the vertebral group, and 26 to the non-vertebral fracture group. MResNet was competent to discriminate any fragility fracture (OR = 2.64; AUC = 0.74), Vertebral fracture (OR = 3.02; AUC = 0.77), and non-vertebral fracture (OR = 2.01; AUC = 0.69). After being modified by clinical covariates, the efficiency of MResNet was further improved to OR = 3.31-4.08, AUC = 0.81-0.83 among all fracture groups, which significantly surpassed QUS-SOS (OR = 1.32-1.36; AUC = 0.60) and DXA-BMD (OR = 1.23-2.94; AUC = 0.63-0.76).

CONCLUSIONS

This pilot cross-sectional study demonstrates that the MResNet model based on the ultrasonic RF signal shows promising performance in discriminating fragility fractures in postmenopausal women. When incorporating clinical covariates, the efficiency of the modified MResNet is further enhanced, surpassing the performance of QUS-SOS and DXA-BMD in terms of OR and AUC. These findings highlight the potential of the MResNet as a promising approach for fracture risk assessment. Future research should focus on larger and more diverse populations to validate these results and explore its clinical applications.

Hybrid optimization assisted channel selection of EEG for deep learning model-based classification of motor imagery task

OBJECTIVES

To design and develop an approach named HC + SMA-SSA scheme for classifying motor imagery task.

METHODS

The offered model employs a new method for classifying motor imagery task. Initially, down sampling is deployed to pre-process the incoming signal. Subsequently, "Modified Stockwell Transform (ST) and common spatial pattern (CSP) based features are extracted". Then, optimal channel selection is made by a novel hybrid optimization model named as Spider Monkey Assisted SSA (SMA-SSA). Here, "Long Short Term Memory (LSTM) and Bidirectional Gated Recurrent Unit (BI-GRU)" models are used for final classification, whose outcomes are averaged at the end. At last, the improvement of SMA-SSA based model is proven over different metrics.

RESULTS

A superior sensitivity of 0.939 is noted for HC + SMA-SSA that was higher over HC with no optimization and proposed with traditional ST.

CONCLUSIONS

The proposed method achieved effective classification performance in terms of performance measures.

Multilayer network-based channel selection for motor imagery brain-computer interface

Objective. The number of electrode channels in a motor imagery-based brain-computer interface (MI-BCI) system influences not only its decoding performance, but also its convenience for use in applications. Although many channel selection methods have been proposed in the literature, they are usually based on the univariate features of a single channel. This leads to a loss of the interaction between channels and the exchange of information between networks operating at different frequency bands.Approach. We integrate brain networks containing four frequency bands into a multilayer network framework and propose a multilayer network-based channel selection (MNCS) method for MI-BCI systems. A graph learning-based method is used to estimate the multilayer network from electroencephalogram (EEG) data that are filtered by multiple frequency bands. The multilayer participation coefficient of the multilayer network is then computed to select EEG channels that do not contain redundant information. Furthermore, the common spatial pattern (CSP) method is used to extract effective features. Finally, a support vector machine classifier with a linear kernel is trained to accurately identify MI tasks.Main results. We used three publicly available datasets from the BCI Competition containing data on 12 healthy subjects and one dataset containing data on 15 stroke patients to validate the effectiveness of our proposed method. The results showed that the proposed MNCS method outperforms all channels (85.8% vs. 93.1%, 84.4% vs. 89.0%, 71.7% vs. 79.4%, and 72.7% vs. 84.0%). Moreover, it achieved significantly higher decoding accuracies on MI-BCI systems than state-of-the-art methods (pairedt-tests,p< 0.05).Significance. The experimental results showed that the proposed MNCS method can select appropriate channels to improve the decoding performance as well as the convenience of the application of MI-BCI systems.

EEG-BCI-based motor imagery classification using double attention convolutional network

This article aims to improve and diversify signal processing techniques to execute a brain-computer interface (BCI) based on neurological phenomena observed when performing motor tasks using motor imagery (MI). The noise present in the original data, such as intermodulation noise, crosstalk, and other unwanted noise, is removed by Modify Least Mean Square (M-LMS) in the pre-processing stage. Traditional LMSs were unable to extract all the noise from the images. After pre-processing, the required features, such as statistical features, entropy features, etc., were extracted using Common Spatial Pattern (CSP) and Pearson's Correlation Coefficient (PCC) instead of the traditional single feature extraction model. The arithmetic optimization algorithm cannot select the features accurately and fails to reduce the feature dimensionality of the data. Thus, an Extended Arithmetic operation optimization (ExAo) algorithm is used to select the most significant attributes from the extracted features. The proposed model uses Double Attention Convolutional Neural Networks (DAttnConvNet) to classify the types of EEG signals based on optimal feature selection. Here, the attention mechanism is used to select and optimize the features to improve the classification accuracy and efficiency of the model. In EEG motor imagery datasets, the proposed model has been analyzed under class, which obtained an accuracy of 99.98% in class Baseline (B), 99.82% in class Imagined movement of a right fist (R) and 99.61% in class Imagined movement of both fists (RL). In the EEG dataset, the proposed model can obtain a high accuracy of 97.94% compared to EEG datasets of other models.

Multi-domain feature joint optimization based on multi-view learning for improving the EEG decoding

Background

Brain-computer interface (BCI) systems based on motor imagery (MI) have been widely used in neurorehabilitation. Feature extraction applied by the common spatial pattern (CSP) is very popular in MI classification. The effectiveness of CSP is highly affected by the frequency band and time window of electroencephalogram (EEG) segments and channels selected.

Objective

In this study, the multi-domain feature joint optimization (MDFJO) based on the multi-view learning method is proposed, which aims to select the discriminative features enhancing the classification performance.

Method

The channel patterns are divided using the Fisher discriminant criterion (FDC). Furthermore, the raw EEG is intercepted for multiple sub-bands and time interval signals. The high-dimensional features are constructed by extracting features from CSP on each EEG segment. Specifically, the multi-view learning method is used to select the optimal features, and the proposed feature sparsification strategy on the time level is proposed to further refine the optimal features.

Results

Two public EEG datasets are employed to validate the proposed MDFJO method. The average classification accuracy of the MDFJO in Data 1 and Data 2 is 88.29 and 87.21%, respectively. The classification result of MDFJO was significantly better than MSO (p < 0.05), FBCSP32 (p < 0.01), and other competing methods (p < 0.001).

Conclusion

Compared with the CSP, sparse filter band common spatial pattern (SFBCSP), and filter bank common spatial pattern (FBCSP) methods with channel numbers 16, 32 and all channels as well as MSO, the MDFJO significantly improves the test accuracy. The feature sparsification strategy proposed in this article can effectively enhance classification accuracy. The proposed method could improve the practicability and effectiveness of the BCI system.

Novel channel selection model based on graph convolutional network for motor imagery

Multi-channel electroencephalography (EEG) is used to capture features associated with motor imagery (MI) based brain-computer interface (BCI) with a wide spatial coverage across the scalp. However, redundant EEG channels are not conducive to improving BCI performance. Therefore, removing irrelevant channels can help improve the classification performance of BCI systems. We present a new method for identifying relevant EEG channels. Our method is based on the assumption that useful channels share related information and that this can be measured by inter-channel connectivity. Specifically, we treat all candidate EEG channels as a graph and define channel selection as the problem of node classification on a graph. Then we design a graph convolutional neural network (GCN) model for channels classification. Channels are selected based on the outputs of our GCN model. We evaluate our proposed GCN-based channel selection (GCN-CS) method on three MI datasets. On three datasets, GCN-CS achieves performance improvements by reducing the number of channels. Specifically, we achieve classification accuracies of 79.76% on Dataset 1, 89.14% on Dataset 2 and 87.96% on Dataset 3, which outperform competing methods significantly.

A Sparse Multiclass Motor Imagery EEG Classification Using 1D-ConvResNet

Multiclass motor imagery classification is essential for brain–computer interface systems such as prosthetic arms. The compressive sensing of EEG helps classify brain signals in real-time, which is necessary for a BCI system. However, compressive sensing is limited, despite its flexibility and data efficiency, because of its sparsity and high computational cost in reconstructing signals. Although the constraint of sparsity in compressive sensing has been addressed through neural networks, its signal reconstruction remains slow, and the computational cost increases to classify the signals further. Therefore, we propose a 1D-Convolutional Residual Network that classifies EEG features in the compressed (sparse) domain without reconstructing the signal. First, we extract only wavelet features (energy and entropy) from raw EEG epochs to construct a dictionary. Next, we classify the given test EEG data based on the sparse representation of the dictionary. The proposed method is computationally inexpensive, fast, and has high classification accuracy as it uses a single feature to classify without preprocessing. The proposed method is trained, validated, and tested using multiclass motor imagery data of 109 subjects from the PhysioNet database. The results demonstrate that the proposed method outperforms state-of-the-art classifiers with 96.6% accuracy.

Feature optimization based on improved novel global harmony search algorithm for motor imagery electroencephalogram classification

Background

Effectively decoding electroencephalogram (EEG) pattern for specific mental tasks is a crucial topic in the development of brain-computer interface (BCI). Extracting common spatial pattern (CSP) features from motor imagery EEG signals is often highly dependent on the selection of frequency band and time interval. Therefore, optimizing frequency band and time interval would contribute to effective feature extraction and accurate EEG decoding.

Objective

This study proposes an approach based on an improved novel global harmony search (INGHS) to optimize frequency-time parameters for effective CSP feature extraction.

Methods

The INGHS algorithm is applied to find the optimal frequency band and temporal interval. The linear discriminant analysis and support vector machine are used for EEG pattern decoding. Extensive experimental studies are conducted on three EEG datasets to assess the effectiveness of our proposed method.

Results

The average test accuracy obtained by the time-frequency parameters selected by the proposed INGHS method is slightly better than artificial bee colony (ABC) and particle swarm optimization (PSO) algorithms. Furthermore, the INGHS algorithm is superior to PSO and ABC in running time.

Conclusion

These superior experimental results demonstrate that the optimal frequency band and time interval selected by the INGHS algorithm could significantly improve the decoding accuracy compared with the traditional CSP method. This method has a potential to improve the performance of MI-based BCI systems.

EEG Channel Selection Techniques in Motor Imagery Applications: A Review and New Perspectives

Communication, neuro-prosthetics, and environmental control are just a few applications for disabled persons who use robots and manipulators that use brain-computer interface (BCI) systems. The brain's motor imagery (MI) signal is an essential input for a brain-related task in BCI applications. Due to their noninvasive, portability, and cost-effectiveness, electroencephalography (EEG) signals are the most widely used input in BCI systems. The EEG data are often collected from more than 100 different locations in the brain; channel selection techniques are critical for selecting the optimum channels for a given application. However, when analyzing EEG data, the principal purpose of channel selection is to reduce computational complexity, improve classification accuracy by avoiding overfitting, and reduce setup time. Several channel selection assessment algorithms, both with and without classification-based methods, extracted appropriate channel subsets using defined criteria. Therefore, based on the exhaustive analysis of the EEG channel selection, this manuscript analyses several existing studies to reduce the number of noisy channels and improve system performance. We review several existing works to find the most promising MI-based EEG channel selection algorithms and associated classification methodologies on various datasets. Moreover, we focus on channel selection methods that choose fewer channels with great precision. Finally, our main finding is that a smaller channel set, typically 10-30% of total channels, provided excellent performance compared to other existing studies.

A comparative analysis of masking empirical mode decomposition and a neural network with feed-forward and back propagation along with masking empirical mode decomposition to improve the classification performance for a reliable brain-computer interface

In general, extraction and classification are used in various fields like image processing, pattern recognition, signal processing, and so on. Extracting effective characteristics from raw electroencephalogram (EEG) signals is a crucial role of the brain-computer interface for motor imagery. Recently, there has been a great deal of focus on motor imagery in the EEG signals since they encode a person's intent to do an action. Researchers have been using MI signals to assist paralyzed people and even move them on their own with certain equipment, like wheelchairs. As a result, proper decoding is an important step required for the interconnection of the brain and the computer. EEG decoding is a challenging process because of poor SNR, complexity, and other reasons. However, choosing an appropriate method to extract the features to improve the performance of motor imagery recognition is still a research hotspot. To extract the features of the EEG signal in the classification task, this paper proposes a Masking Empirical Mode Decomposition (MEMD) based Feed Forward Back Propagation Neural Network (MEMD-FFBPNN). The dataset consists of EEG signals which are first normalized using the minimax method and given as input to the MEMD to extract the features and then given to the FFBPNN to classify the tasks. The accuracy of the proposed method MEMD-FFBPNN has been measured using the confusion matrix, mean square error and which has been recorded up to 99.9%. Thus, the proposed method gives better accuracy than the other conventional methods.

EEG channel selection based on sequential backward floating search for motor imagery classification

Brain-computer interfaces (BCIs) based on motor imagery (MI) utilizing multi-channel electroencephalogram (EEG) data are commonly used to improve motor function of people with motor disabilities. EEG channel selection can enhance MI classification accuracy by selecting informative channels, accordingly reducing redundant information. The sequential backward floating search (SBFS) approach has been considered as one of the best feature selection methods. In this paper, SBFS is first implemented to select the optimal EEG channels in MI-BCI. Further, to reduce the time complexity of SBFS, the modified SBFS is proposed and applied to left and right hand MI tasks. In the modified SBFS, based on the map of EEG channels at the scalp, the symmetrical channels are selected as channel pairs and acceleration is thus realized by removing or adding multiple channels in each iteration. Extensive experiments were conducted on four public BCI datasets. Experimental results show that the SBFS achieves significantly higher classification accuracy (p < 0.001) than using all channels and conventional MI channels (i.e., C3, C4, and Cz). Moreover, the proposed method outperforms the state-of-the-art selection methods.

Riemannian distance based channel selection and feature extraction combining discriminative time-frequency bands and Riemannian tangent space for MI-BCIs

OBJECTIVE

Motor imagery-based brain computer interfaces (MI-BCIs) have been widely researched because they do not demand external stimuli and have a high degree of maneuverability. In most scenarios, superabundant selected channels, fixed time windows, and frequency bands would certainly affect the performance of MI-BCIs due to the neurophysiological diversities between different individuals. In this study, we tended to effectively use the Riemannian geometry of spatial covariance matrix to extract more robust features and thus enhance the decoding efficiency.

APPROACH

First, we propose a Riemannian distance-based EEG channel selection method (RDCS), which preliminarily reduces the information redundancy in the first stage. Second, we extract discriminative Riemannian Tangent Space features of EEG signals of selected channels from the most discriminant time-frequency bands (DTFRTS) to further enhance decoding accuracy for MI-BCIs. Finally, we trained a support vector machine (SVM) model with a linear kernel to classify our extracted discriminative Riemannian features and evaluated our proposed method using publicly available BCI Competition Ⅳ dataset Ⅰ (DS1) and Competition Ⅲ dataset Ⅲa (DS2).

MAIN RESULTS

The experimental results showed that the average classification accuracy with the selected 10-channel EEG signals of our method is 88.1% and 91.6% in DS1 and DS2 respectively. The average improvements are 24.3% & 27.1% on DS1 and 4.4% & 14.2% on DS2 for 10 & 20 selected channels, respectively.

SIGNIFICANCE

These results showed that our proposed method is a promising candidate for performance improvement of MI-BCIs.

High-Frequency Vibrating Stimuli Using the Low-Cost Coin-Type Motors for SSSEP-Based BCI

Steady-state somatosensory-evoked potential- (SSSEP-) based brain-computer interfaces (BCIs) have been applied for assisting people with physical disabilities since it does not require gaze fixation or long-time training. Despite the advancement of various noninvasive electroencephalogram- (EEG-) based BCI paradigms, researches on SSSEP with the various frequency range and related classification algorithms are relatively unsettled. In this study, we investigated the feasibility of classifying the SSSEP within high-frequency vibration stimuli induced by a versatile coin-type eccentric rotating mass (ERM) motor. Seven healthy subjects performed selective attention (SA) tasks with vibration stimuli attached to the left and right index fingers. Three EEG feature extraction methods, followed by a support vector machine (SVM) classifier, have been tested: common spatial pattern (CSP), filter-bank CSP (FBCSP), and mutual information-based best individual feature (MIBIF) selection after the FBCSP. Consequently, the FBCSP showed the highest performance at $71.5\pm 2.5$ % for classifying the left and right-hand SA tasks than the other two methods (i.e., CSP and FBCSP-MIBIF). Based on our findings and approach, the high-frequency vibration stimuli using low-cost coin motors with the FBCSP-based feature selection can be potentially applied to developing practical SSSEP-based BCI systems.

An Effective Fusing Approach by Combining Connectivity Network Pattern and Temporal-Spatial Analysis for EEG-Based BCI Rehabilitation

Motor-modality-based brain computer interface (BCI) could promote the neural rehabilitation for stroke patients. Temporal-spatial analysis was commonly used for pattern recognition in this task. This paper introduced a novel connectivity network analysis for EEG-based feature selection. The network features of connectivity pattern not only captured the spatial activities responding to motor task, but also mined the interactive pattern among these cerebral regions. Furthermore, the effective combination between temporal-spatial analysis and network analysis was evaluated for improving the performance of BCI classification (81.7%). And the results demonstrated that it could raise the classification accuracies for most of patients (6 of 7 patients). This proposed method was meaningful for developing the effective BCI training program for stroke rehabilitation.

Adaptive binary multi-objective harmony search algorithm for channel selection and cross-subject generalization in motor imagery-based BCI

OBJECTIVE

Multi-channel EEG data containing redundant information and noise may result in low classification accuracy and high computational complexity, which limits the practicality of motor imagery-based BCI systems. Therefore, channel selection can improve BCI performance and contribute to user convenience. Additionally, cross-subject generalization is a key topic in the channel selection of motor imagery-based BCI.

APPROACH

In this study, an adaptive binary multi-objective harmony search (ABMOHS) algorithm is proposed to select the optimal set of channels. Furthermore, a new adaptive crosssubject generalization model (ACGM) is proposed. Three public motor imagery datasets were used to validate the effectiveness of the proposed method.

MAIN RESULTS

The Wilcoxon signed-rank test was performed on the test accuracies, and the results indicated that the ABMOHS method significantly outperformed all channels (p<0.001), the C3-Cz-C4 channels (p<0.001), and 20 channels (p<0.001) in the sensorimotor cortex. The ABMOHS algorithm based on Fisher's linear discriminant analysis (FLDA) and support vector machine (SVM) classifiers greatly reduces the number of selected channels, especially for larger channel sizes (Dataset 2), and obtains a comparative classification performance. Although there was no significant difference in test classification performance between ABMOHS and non-dominated sorting genetic algorithm II (NSGA-II) when FLDA and SVM were used, ABMOHS required less computational time than NSGA-II. Furthermore, the number of channels obtained by ABMOHS algorithm were significantly smaller than those obtained by CSP-Rank and correlation-based channel selection algorithm (CCS). Additionally, the generalization of ACGM to untrained subjects shows that the mean test classification accuracy of ACGM created by a small sample of trained subjects is significantly better than that of Special-16 and Special-32.

SIGNIFICANCE

The proposed method can reduce the calibration time in the training phase and improve the practicability of MI-BCI.

A novel channel selection scheme for olfactory EEG signal classification on Riemannian manifolds

OBJECTIVE

The classification of olfactory-induced electroencephalogram (olfactory EEG) signals has potential applications in disease diagnosis, emotion regulation, multimedia, and so on. To achieve high-precision classification, numerous EEG channels are usually used, but this also brings problems such as information redundancy, overfitting and high computational load. Consequently, channel selection is necessary to find and use the most effective channels.

APPROACH

In this study, we proposed a multi-strategy fusion binary harmony search (MFBHS) algorithm and combined it with the Riemannian geometry (RG) classification framework to select the optimal channel sets for olfactory EEG signal classification. MFBHS was designed by simultaneously integrating three strategies into the binary harmony search (BHS) algorithm, including an opposition-based learning strategy (OBL) for generating high-quality initial population, an adaptive parameter strategy (APS) for improving search capability, and a bitwise operation strategy (BOS) for maintaining population diversity. It performed channel selection directly on the covariance matrix of EEG signals, and used the number of selected channels and the classification accuracy computed by a Riemannian classifier to evaluate the newly generated subset of channels.

MAIN RESULTS

With five different classification protocols designed based on two public olfactory EEG datasets, the performance of MFBHS was evaluated and compared with some state-of-the-art algorithms. Experimental results reveal that our method can minimize the number of channels while achieving high classification accuracy compatible with using all the channels. In addition, cross-subject generalization tests of MFBHS channel selection show that subject-independent channels obtained through training can be directly used on untrained subjects without greatly compromising classification accuracy.

SIGNIFICANCE

The proposed MFBHS algorithm is a practical technique for effective use of EEG channels in olfactory recognition.

Riemannian geometry-based transfer learning for reducing training time in c-VEP BCIs

One of the main problems that a brain-computer interface (BCI) face is that a training stage is required for acquiring training data to calibrate its classification model just before every use. Transfer learning is a promising method for addressing the problem. In this paper, we propose a Riemannian geometry-based transfer learning algorithm for code modulated visual evoked potential (c-VEP)-based BCIs, which can effectively reduce the calibration time without sacrificing the classification accuracy. The algorithm includes the main procedures of log-Euclidean data alignment (LEDA), super-trial construction, covariance matrix estimation, training accuracy-based subject selection (TSS) and minimum distance to mean classification. Among them, the LEDA reduces the difference in data distribution between subjects, whereas the TSS promotes the similarity between a target subject and the source subjects. The resulting performance of transfer learning is improved significantly. Sixteen subjects participated in a c-VEP BCI experiment and the recorded data were used in offline analysis. Leave-one subject-out (LOSO) cross-validation was used to evaluate the proposed algorithm on the data set. The results showed that the algorithm achieved much higher classification accuracy than the subject-specific (baseline) algorithm with the same number of training trials. Equivalently, the algorithm reduces the training time of the BCI at the same performance level and thus facilitates its application in real world.

SincNet-based Hybrid Neural Network for Motor Imagery EEG Decoding

It is difficult to identify optimal cut-off frequencies for filters used with the common spatial pattern (CSP) method in motor imagery (MI)-based brain-computer interfaces (BCIs). Most current studies choose filter cut-frequencies based on experience or intuition, resulting in sub-optimal use of MI-related spectral information in the electroencephalography (EEG). To improve information utilization, we propose a SincNet-based hybrid neural network (SHNN) for MI-based BCIs. First, raw EEG is segmented into different time windows and mapped into the CSP feature space. Then, SincNets are used as filter bank band-pass filters to automatically filter the data. Next, we used squeeze-and-excitation modules to learn a sparse representation of the filtered data. The resulting sparse data were fed into convolutional neural networks to learn deep feature representations. Finally, these deep features were fed into a gated recurrent unit module to seek sequential relations, and a fully connected layer was used for classification. We used the BCI competition IV datasets 2a and 2b to verify the effectiveness of our SHNN method. The mean classification accuracies (kappa values) of our SHNN method are 0.7426 (0.6648) on dataset 2a and 0.8349 (0.6697) on dataset 2b, respectively. The statistical test results demonstrate that our SHNN can significantly outperform other state-of-the-art methods on these datasets.

Feature Extraction Method Based on Filter Banks and Riemannian Tangent Space in Motor-Imagery BCI

Optimal feature extraction for multi-category motor imagery brain-computer interfaces (MI-BCIs) is a research hotspot. The common spatial pattern (CSP) algorithm is one of the most widely used methods in MI-BCIs. However, its performance is adversely affected by variance in the operational frequency band and noise interference. Furthermore, the performance of CSP is not satisfactory when addressing multi-category classification problems. In this work, we propose a fusion method combining Filter Banks and Riemannian Tangent Space (FBRTS) in multiple time windows. FBRTS uses multiple filter banks to overcome the problem of variance in the operational frequency band. It also applies the Riemannian method to the covariance matrix extracted by the spatial filter to obtain more robust features in order to overcome the problem of noise interference. In addition, we use a One-Versus-Rest support vector machine (OVR-SVM) model to classify multi-category features. We evaluate our FBRTS method using BCI competition IV dataset 2a and 2b. The experimental results show that the average classification accuracy of our FBRTS method is 77.7% and 86.9% in datasets 2a and 2b respectively. By analyzing the influence of the different numbers of filter banks and time windows on the performance of our FBRTS method, we can identify the optimal number of filter banks and time windows. Additionally, our FBRTS method can obtain more distinctive features than the filter banks common spatial pattern (FBCSP) method in two-dimensional embedding space. These results show that our proposed method can improve the performance of MI-BCIs.

Brain Connectivity Changes During Bimanual and Rotated Motor Imagery

Motor imagery-based brain-computer interface (MI-BCI) currently represents a new trend in rehabilitation. However, individual differences in the responsive frequency bands and a poor understanding of the communication between the ipsilesional motor areas and other regions limit the use of MI-BCI therapy. Objective: Bimanual training has recently attracted attention as it achieves better outcomes as compared to repetitive one-handed training. This study compared the effects of three MI tasks with different visual feedback. Methods: Fourteen healthy subjects performed single hand motor imagery tasks while watching single static hand (traditional MI), single hand with rotation movement (rmMI), and bimanual coordination with a hand pedal exerciser (bcMI). Functional connectivity is estimated by Transfer Entropy (TE) analysis for brain information flow. Results: Brain connectivity of conducting three MI tasks showed that the bcMI demonstrated increased communications from the parietal to the bilateral prefrontal areas and increased contralateral connections between motor-related zones and spatial processing regions. Discussion/Conclusion: The results revealed bimanual coordination operation events increased spatial information and motor planning under the motor imagery task. And the proposed bimanual coordination MI-BCI (bcMI-BCI) can also achieve the effect of traditional motor imagery tasks and promotes more effective connections with different brain regions to better integrate motor-cortex functions for aiding the development of more effective MI-BCI therapy. Clinical and Translational Impact Statement The proposed bcMI-BCI provides more effective connections with different brain areas and integrates motor-cortex functions to promote motor imagery rehabilitation for patients’ impairment.

Multi-view optimization of time-frequency common spatial patterns for brain-computer interfaces

BACKGROUND

Common spatial pattern (CSP) is a prevalent method applied to feature extraction in motor imagery (MI)-based brain-computer interfaces (BCIs) recorded by electroencephalogram (EEG). The selection of time windows and frequency bands prominently affects the performance of CSP algorithms. Concerning the joint optimization of these two parameters, several studies have utilized a unified framework based on different feature selection strategies and achieved considerable improvement. However, during the feature selection process, useful information could be discarded inevitably and the underlying internal structure of features could be neglected.

NEW METHOD

In this paper, we proposed a novel framework termed time window filter bank common spatial pattern with multi-view optimization (TWFBCSP-MVO) to further boost the decoding of MI tasks. Concretely, after extracting CSP features from different time-frequency decompositions of EEG signals, a preliminary screening strategy based on variance ratio was devised to filter out the unrelated spatial patterns. We then introduced a multi-view learning strategy for the simultaneous optimization of time windows and frequency bands. A support vector machine classifier was trained to determine the output of the brain.

RESULTS

An experimental study was conducted on two public datasets to verify the effectiveness of TWFBCSP-MVO. Results showed that the proposed TWFBCSP-MVO could help improve the performance of MI classification.

COMPARISON WITH EXISTING METHODS

In comparison to other competing methods, the proposed method performed significantly better (p<0.01).

CONCLUSIONS

The proposed method is a promising contestant to improve the performance of practical MI-based BCIs.

Feature selection method based on Menger curvature and LDA theory for a P300 brain-computer interface

Brain-computer interface (BCI) systems decode electroencephalogram signals to establish a channel for direct interaction between the human brain and the external world without the need for muscle or nerve control. The P300 speller, one of the most widely used BCI applications, presents a selection of characters to the user and performs character recognition by identifying P300 event-related potentials from the EEG. Such P300-based BCI systems can reach good levels of accuracy but are difficult to use in day-to-day life due to redundancy and noisy signal. A room for improvement should be considered. We propose a novel hybrid feature selection method for the P300-based BCI system to address the problem of feature redundancy, which combines the Menger curvature and linear discriminant analysis. First, selected strategies are applied separately to a given dataset to estimate the gain for application to each feature. Then, each generated value set is ranked in descending order and judged by a predefined criterion to be suitable in classification models. The intersection of the two approaches is then evaluated to identify an optimal feature subset. The proposed method is evaluated using three public datasets, i.e., BCI Competition III dataset II, BNCI Horizon dataset, and EPFL dataset. Experimental results indicate that compared with other typical feature selection and classification methods, our proposed method has better or comparable performance. Additionally, our proposed method can achieve the best classification accuracy after all epochs in three datasets. In summary, our proposed method provides a new way to enhance the performance of the P300-based BCI speller.

Coefficient-of-variation-based channel selection with a new testing framework for MI-based BCI

In the motor-imagery (MI) based brain computer interface (BCI), multi-channel electroencephalogram (EEG) is often used to ensure the complete capture of physiological phenomena. With the redundant information and noise, EEG signals cannot be easily converted into separable features through feature extraction algorithms. Channel selection algorithms are proposed to address the issue, in which the filtering technique is widely used with the advantages of low computational cost and strong practicability. In this study, we proposed several improved methods for filtering channel selection algorithm. Specifically, based on the coefficient of variation and inter-class distance, a novel channel classification method was designed, which divided channels into different categories based on their contribution to feature extraction process. Then a filtering channel selection algorithm was proposed according to the previous classification method. Moreover, a new testing framework for filtering channel selection algorithms was proposed, which can better reflect the generalization ability of the algorithm. Experimental results indicated that the proposed channel classification method is effective, and the proposed testing framework is better than the original one. Meanwhile, the proposed channel selection algorithm achieved the accuracy of 87.7% and 81.7% in two BCI competition datasets, respectively, which was superior to competing algorithms.

Osteoporosis Diagnosis Based on Ultrasound Radio Frequency Signal via Multi-channel Convolutional Neural Network

Osteoporosis is a metabolic osteopathy syndrome, and the incidence of osteoporosis increases significantly with age. Currently, bone quantitative ultrasound (QUS) has been considered as a potential method for screening and diagnosing osteoporosis. However, its diagnostic accuracy is quite low. By contrast, deep learning based methods have shown the great power for extracting the most discriminative features from complex data. To improve the osteoporosis diagnostic accuracy and take advantages of QUS, we devise a deep learning method based on ultrasound radio frequency (RF) signal. Specifically, we construct a multi-channel convolutional neural network (MCNN) combined with a sliding window scheme, which can enhance the number of data as well. By using speed of sound (SOS), the quantitative experimental results of our preliminary study indicate that our proposed osteoporosis diagnosis method outperforms the conventional ultrasound methods, which may assist the clinician for osteoporosis screening.

Evolutionary Multitasking-Based Multiobjective Optimization Algorithm for Channel Selection in Hybrid Brain Computer Interfacing Systems

Hybrid-modality brain-computer Interfaces (BCIs), which combine motor imagery (MI) bio-signals and steady-state visual evoked potentials (SSVEPs), has attracted wide attention in the research field of neural engineering. The number of channels should be as small as possible for real-life applications. However, most of recent works about channel selection only focus on either the performance of classification task or the effectiveness of device control. Few works conduct channel selection for MI and SSVEP classification tasks simultaneously. In this paper, a multitasking-based multiobjective evolutionary algorithm (EMMOA) was proposed to select appropriate channels for these two classification tasks at the same time. Moreover, a two-stage framework was introduced to balance the number of selected channels and the classification accuracy in the proposed algorithm. The experimental results verified the feasibility of multiobjective optimization methodology for channel selection of hybrid BCI tasks.

Effective Connectivity for Decoding Electroencephalographic Motor Imagery Using a Probabilistic Neural Network

Motor imagery (MI)-based brain-computer interfaces have gained much attention in the last few years. They provide the ability to control external devices, such as prosthetic arms and wheelchairs, by using brain activities. Several researchers have reported the inter-communication of multiple brain regions during motor tasks, thus making it difficult to isolate one or two brain regions in which motor activities take place. Therefore, a deeper understanding of the brain's neural patterns is important for BCI in order to provide more useful and insightful features. Thus, brain connectivity provides a promising approach to solving the stated shortcomings by considering inter-channel/region relationships during motor imagination. This study used effective connectivity in the brain in terms of the partial directed coherence (PDC) and directed transfer function (DTF) as intensively unconventional feature sets for motor imagery (MI) classification. MANOVA-based analysis was performed to identify statistically significant connectivity pairs. Furthermore, the study sought to predict MI patterns by using four classification algorithms-an SVM, KNN, decision tree, and probabilistic neural network. The study provides a comparative analysis of all of the classification methods using two-class MI data extracted from the PhysioNet EEG database. The proposed techniques based on a probabilistic neural network (PNN) as a classifier and PDC as a feature set outperformed the other classification and feature extraction techniques with a superior classification accuracy and a lower error rate. The research findings indicate that when the PDC was used as a feature set, the PNN attained the greatest overall average accuracy of 98.65%, whereas the same classifier was used to attain the greatest accuracy of 82.81% with the DTF. This study validates the activation of multiple brain regions during a motor task by achieving better classification outcomes through brain connectivity as compared to conventional features. Since the PDC outperformed the DTF as a feature set with its superior classification accuracy and low error rate, it has great potential for application in MI-based brain-computer interfaces.

Prosthetic control system based on motor imagery

A brain-computer interface (BCI) can be used for function replacement through the control of devices, such as prostheses, by identifying the subject's intent from brain activity. We process electroencephalography (EEG) signals related to motor imagery to improve the accuracy of intent classification. The original signals are decomposed into three layers based on db4 wavelet basis. The wavelet soft threshold denoising method is used to improve the signal-to-noise ratio. The sample entropy algorithm is used to extract the features of the signal after noise reduction and reconstruction. Combined with event-related synchronisation/desynchronisation (ERS/ERD) phenomenon, the sample entropy in the motor imagery time periods of C3, C4 and Cz is selected as the feature value. Feature vectors are then used as the input of three classifiers. From the evaluated classifiers, the backpropagation (BP) neural network provides the best EEG signal classification (93% accuracy). BP neural network is thus selected as the final classifier and used to design a prosthetic control system based on motor imagery. The classification results are wirelessly transmitted to control a prosthesis successfully via commands of hand opening, fist clenching, and external wrist rotation. Such functionality may allow amputees to complete simple activities of daily living. Thus, this study is valuable for subsequent developments in rehabilitation.

Distinguishable spatial-spectral feature learning neural network framework for motor imagery-based brain-computer interface

Objective.Spatial and spectral features extracted from electroencephalogram (EEG) are critical for the classification of motor imagery (MI) tasks. As prevalently used methods, the common spatial pattern (CSP) and filter bank CSP (FBCSP) can effectively extract spatial-spectral features from MI-related EEG. To further improve the separability of the CSP features, we proposed a distinguishable spatial-spectral feature learning neural network (DSSFLNN) framework for MI-based brain-computer interfaces (BCIs) in this study.Approach.The first step of the DSSFLNN framework was to extract FBCSP features from raw EEG signals. Then two squeeze-and-excitation modules were used to re-calibrate CSP features along the band-wise axis and the class-wise axis, respectively. Next, we used a parallel convolutional neural network module to learn distinguishable spatial-spectral features. Finally, the distinguishable spatial-spectral features were fed to a fully connected layer for classification. To verify the effectiveness of the proposed framework, we compared it with the state-of-the-art methods on BCI competition IV datasets 2a and 2b.Main results.The results showed that the DSSFLNN framework can achieve a mean Cohen's kappa value of 0.7 on two datasets, which outperformed the state-of-the-art methods. Moreover, two additional experiments were conducted and they proved that the combination of band-wise feature learning and class-wise feature learning can achieve significantly better performance than only using either one of them.Significance.The proposed DSSFLNN can effectively improve the decoding performance of MI-based BCIs.

Enhancing P300 based character recognition performance using a combination of ensemble classifiers and a fuzzy fusion method

BACKGROUND

P300-based brain-computer interfaces provide communication pathways without the need for muscle activity by recognizing electrical signals from the brain. The P300 speller is one of the most commonly used BCI applications, as it is very simple and reliable, and it is capable of reaching satisfactory communication performance. However, as with other BCIs, it remains a challenge to improve the P300 speller's performance to increase its practical usability.

NEW METHODS

In this study, we propose a novel multi-feature subset fuzzy fusion (MSFF) framework for the P300 speller to recognize the users' spelling intention. This method includes two parts: 1) feature selection by the Lasso algorithm and feature division; 2) the construction of ensemble LDA classifiers and the fuzzy fusion of those classifiers to recognize user intention.

RESULTS

The proposed framework is evaluated in three public datasets and achieves an average accuracy of 100% after 4 epochs for BCI Competition II Dataset IIb, 96% for BCI Competition III dataset II and 98.3% for the BNCI Horizon Dataset. It indicates that the proposed MSFF method can make use of temporal information of signals and helps to enhance classification performance.

COMPARISON WITH EXISTING METHODS

The proposed MSFF method yields better or comparable performance than previously reported machine learning algorithms.

CONCLUSIONS

The proposed MSFF method is able to improve the performance of P300-based BCIs.

Sparse representation-based classification with two-dimensional dictionary optimization for motor imagery EEG pattern recognition

BACKGROUND

Sparse representation-based classification (SRC) has more advantages in motor imagery EEG pattern recognition, and the quality of dictionary construction directly determines the performance of SRC. In this paper, we proposed a two-dimensional dictionary optimization (TDDO) method to directly improve the performance of SRC.

NEW METHOD

Firstly, an initial dictionary was constructed with multi-band features extracted by filter band common spatial pattern (FBCSP). Then Lasso regression is used to select significant features in each atom synchronously in the horizontal direction, and the KNN-based method is used to clean up noise atoms in the vertical direction. Finally, an SRC method by training samples linearly representing test samples was implemented in classification.

RESULTS

The results show the necessity and rationality of TDDO-SRC method. The highest average classification accuracy of 86.5% and 92.4% is obtained on two public datasets.

COMPARISON WITH EXISTING METHOD(S)

The proposed method has more superior classification accuracy compared to traditional methods and existing winners' methods.

CONCLUSIONS

The quality of dictionary construction has a great impact on the robustness of SRC. And compared with the original SRC, the classification accuracy of the optimized TDDO-SRC is greatly improved.

Optimization of Model Training Based on Iterative Minimum Covariance Determinant In Motor-Imagery BCI

The common spatial patterns (CSP) algorithm is one of the most frequently used and effective spatial filtering methods for extracting relevant features for use in motor imagery brain-computer interfaces (MI-BCIs). However, the inherent defect of the traditional CSP algorithm is that it is highly sensitive to potential outliers, which adversely affects its performance in practical applications. In this work, we propose a novel feature optimization and outlier detection method for the CSP algorithm. Specifically, we use the minimum covariance determinant (MCD) to detect and remove outliers in the dataset, then we use the Fisher score to evaluate and select features. In addition, in order to prevent the emergence of new outliers, we propose an iterative minimum covariance determinant (IMCD) algorithm. We evaluate our proposed algorithm in terms of iteration times, classification accuracy and feature distribution using two BCI competition datasets. The experimental results show that the average classification performance of our proposed method is 12% and 22.9% higher than that of the traditional CSP method in two datasets ([Formula: see text]), and our proposed method obtains better performance in comparison with other competing methods. The results show that our method improves the performance of MI-BCI systems.

Optimal channel-based sparse time-frequency blocks common spatial pattern feature extraction method for motor imagery classification

Common spatial pattern (CSP) as a spatial filtering method has been most widely applied to electroencephalogram (EEG) feature extraction to classify motor imagery (MI) in brain-computer interface (BCI) applications. The effectiveness of CSP is determined by the quality of interception in a specific time window and frequency band. Although numerous algorithms have been designed to optimize CSP by splitting the EEG data with a sliding time window and dividing the frequency bands with a set of band-pass filters, simultaneously. However, they did not consider the drawbacks of the rapid increase in data volume and feature dimensions brought about by this method, which would reduce the classification accuracy and calculation efficiency of the model. Therefore, we propose an optimal channel-based sparse time-frequency blocks common spatial pattern (OCSB-CSP) feature extraction method to improve the model classification accuracy and computational efficiency. Comparative experiments on two public EEG datasets show that the proposed method can quickly select significant time-frequency blocks and improve classification performance. The average classification accuracies are higher than those of other winners' methods, providing a new idea for the improvement of BCI applications.

Abdul Majeed A. The classification of motor imagery response: an accuracy enhancement through the ensemble of random subspace k-NN

Brain-computer interface (BCI) is a viable alternative communication strategy for patients of neurological disorders as it facilitates the translation of human intent into device commands. The performance of BCIs primarily depends on the efficacy of the feature extraction and feature selection techniques, as well as the classification algorithms employed. More often than not, high dimensional feature set contains redundant features that may degrade a given classifier's performance. In the present investigation, an ensemble learning-based classification algorithm, namely random subspace k-nearest neighbour (k-NN) has been proposed to classify the motor imagery (MI) data. The common spatial pattern (CSP) has been applied to extract the features from the MI response, and the effectiveness of random forest (RF)-based feature selection algorithm has also been investigated. In order to evaluate the efficacy of the proposed method, an experimental study has been implemented using four publicly available MI dataset (BCI Competition III dataset 1 (data-1), dataset IIIA (data-2), dataset IVA (data-3) and BCI Competition IV dataset II (data-4)). It was shown that the ensemble-based random subspace k-NN approach achieved the superior classification accuracy (CA) of 99.21%, 93.19%, 93.57% and 90.32% for data-1, data-2, data-3 and data-4, respectively against other models evaluated, namely linear discriminant analysis, support vector machine, random forest, Naïve Bayes and the conventional k-NN. In comparison with other classification approaches reported in the recent studies, the proposed method enhanced the accuracy by 2.09% for data-1, 1.29% for data-2, 4.95% for data-3 and 5.71% for data-4, respectively. Moreover, it is worth highlighting that the RF feature selection technique employed in the present study was able to significantly reduce the feature dimension without compromising the overall CA. The outcome from the present study implies that the proposed method may significantly enhance the accuracy of MI data classification.

Effects of Skin Friction on Tactile P300 Brain-Computer Interface Performance

Tactile perception, the primary sensing channel of the tactile brain-computer interface (BCI), is a complicated process. Skin friction plays a vital role in tactile perception. This study aimed to examine the effects of skin friction on tactile P300 BCI performance. Two kinds of oddball paradigms were designed, silk-stim paradigm (SSP) and linen-stim paradigm (LSP), in which silk and linen were wrapped on target vibration motors, respectively. In both paradigms, the disturbance vibrators were wrapped in cotton. The experimental results showed that LSP could induce stronger event-related potentials (ERPs) and achieved a higher classification accuracy and information transfer rate (ITR) compared with SSP. The findings indicate that high skin friction can achieve high performance in tactile BCI. This work provides a novel research direction and constitutes a viable basis for the future tactile P300 BCI, which may benefit patients with visual impairments.

A Densely Connected Multi-Branch 3D Convolutional Neural Network for Motor Imagery EEG Decoding

Motor imagery (MI) is a classical method of brain–computer interaction (BCI), in which electroencephalogram (EEG) signal features evoked by imaginary body movements are recognized, and relevant information is extracted. Recently, various deep-learning methods are being focused on in finding an easy-to-use EEG representation method that can preserve both temporal information and spatial information. To further utilize the spatial and temporal features of EEG signals, an improved 3D representation of the EEG and a densely connected multi-branch 3D convolutional neural network (dense M3D CNN) for MI classification are introduced in this paper. Specifically, as compared to the original 3D representation, a new padding method is proposed to pad the points without electrodes with the mean of all the EEG signals. Based on this new 3D presentation, a densely connected multi-branch 3D CNN with a novel dense connectivity is proposed for extracting the EEG signal features. Experiments were carried out on the WAY-EEG-GAL and BCI competition IV 2a datasets to verify the performance of this proposed method. The experimental results show that the proposed framework achieves a state-of-the-art performance that significantly outperforms the multi-branch 3D CNN framework, with a 6.208% improvement in the average accuracy for the BCI competition IV 2a datasets and 6.281% improvement in the average accuracy for the WAY-EEG-GAL datasets, with a smaller standard deviation. The results also prove the effectiveness and robustness of the method, along with validating its use in MI-classification tasks.

Cluster decomposing and multi-objective optimization based-ensemble learning framework for motor imagery-based brain-computer interfaces

OBJECTIVE

Motor imagery (MI) is a mental representation of motor behavior and a widely used pattern in electroencephalogram (EEG) based brain-computer interface (BCI) systems. EEG is known for its non-stationary, non-linear features and sensitivity to artifacts from various sources. This study aimed to design a powerful classifier with a strong generalization capability for MI based BCIs.

APPROACH

In this study, we proposed a cluster decomposing based ensemble learning framework (CDECL) for EEG classification of MI based BCIs. The EEG data was decomposed into sub-data sets with different distributions by clustering decomposition. Then a set of heterogeneous classifiers was trained on each sub-data set for generating a diversified classifier search space. To obtain the optimal classifier combination, the ensemble learning was formulated as a multi-objective optimization problem and a stochastic fractal based binary multi-objective fruit fly optimization algorithm was proposed for solving the ensemble learning problem.

MAIN RESULTS

The proposed method was validated on two public EEG datasets (BCI Competition IV datasets IIb and BCI Competition IV dataset IIa) and compared with several other competing classification methods. Experimental results showed that the proposed CDECL based methods can effectively construct a diversity ensemble classifier and exhibits superior classification performance in comparison with several competing methods.

SIGNIFICANCE

The proposed method is promising for improving the performance of MI-based BCIs.

The Influence of Visual Attention on The Performance of A Novel Tactile P300 Brain-Computer Interface with Cheeks-Stim Paradigm

Tactile P300 brain-computer interface (BCI) generally has a worse accuracy and information transfer rate (ITR) than the visual-based BCI. It may be due to the fact that human beings have a relatively poor tactile perception. This study investigated the influence of visual attention on the performance of a tactile P300 BCI. We designed our paradigms based on a novel cheeks-stim paradigm which attached the stimulators on the subject's cheeks. Two paradigms were designed as follows: a paradigm with no visual attention and another paradigm with visual attention to the target position. Eleven subjects were invited to perform the two paradigms. We also recorded and analyzed the eyeball movement data during the paradigm with visual attention to explore whether the eyeball movement would have an effect on the BCI classification. The average online accuracy was 89.09% for the paradigm with visual attention, which was significantly higher than that of the paradigm with no visual attention (70.45%). Significant difference in ITR was also found between the two paradigms ([Formula: see text]). The results demonstrated that visual attention was an effective method to improve the performance of tactile P300 BCI. Our findings suggested that it may be feasible to complete an efficient tactile BCI system by adding visual attention.

Developing a Motor Imagery-Based Real-Time Asynchronous Hybrid BCI Controller for a Lower-Limb Exoskeleton

This study aimed to develop an intuitive gait-related motor imagery (MI)-based hybrid brain-computer interface (BCI) controller for a lower-limb exoskeleton and investigate the feasibility of the controller under a practical scenario including stand-up, gait-forward, and sit-down. A filter bank common spatial pattern (FBCSP) and mutual information-based best individual feature (MIBIF) selection were used in the study to decode MI electroencephalogram (EEG) signals and extract a feature matrix as an input to the support vector machine (SVM) classifier. A successive eye-blink switch was sequentially combined with the EEG decoder in operating the lower-limb exoskeleton. Ten subjects demonstrated more than 80% accuracy in both offline (training) and online. All subjects successfully completed a gait task by wearing the lower-limb exoskeleton through the developed real-time BCI controller. The BCI controller achieved a time ratio of 1.45 compared with a manual smartwatch controller. The developed system can potentially be benefit people with neurological disorders who may have difficulties operating manual control.