Golden subject is everyone: A subject transfer neural network for motor imagery-based brain computer interfaces

Boosted Harris Hawks Shuffled Shepherd Optimization Augmented Deep Learning based motor imagery classification for brain computer interface

Motor imagery (MI) classification has been commonly employed in making brain-computer interfaces (BCI) to manage the outside tools as a substitute neural muscular path. Effectual MI classification in BCI improves communication and mobility for people with a breakdown or motor damage, delivering a bridge between the brain's intentions and exterior actions. Employing electroencephalography (EEG) or aggressive neural recordings, machine learning (ML) methods are used to interpret patterns of brain action linked with motor image tasks. These models frequently depend upon models like support vector machine (SVM) or deep learning (DL) to distinguish among dissimilar MI classes, such as visualizing left or right limb actions. This procedure allows individuals, particularly those with motor disabilities, to utilize their opinions to command exterior devices like robotic limbs or computer borders. This article presents a Boosted Harris Hawks Shuffled Shepherd Optimization Augmented Deep Learning (BHHSHO-DL) technique based on Motor Imagery Classification for BCI. The BHHSHO-DL technique mainly exploits the hyperparameter-tuned DL approach for MI identification for BCI. Initially, the BHHSHO-DL technique performs data preprocessing utilizing the wavelet packet decomposition (WPD) model. Besides, the enhanced densely connected networks (DenseNet) model extracts the preprocessed data's complex and hierarchical feature patterns. Meanwhile, the BHHSHO technique-based hyperparameter tuning process is accomplished to elect optimal parameter values of the enhanced DenseNet model. Finally, the classification procedure is implemented by utilizing the convolutional autoencoder (CAE) model. The simulation value of the BHHSHO-DL methodology is performed on a benchmark dataset. The performance validation of the BHHSHO-DL methodology portrayed a superior accuracy value of 98.15% and 92.23% over other techniques under BCIC-III and BCIC-IV datasets.

Partial prior transfer learning based on self-attention CNN for EEG decoding in stroke patients

The utilization of motor imagery-based brain-computer interfaces (MI-BCI) has been shown to assist stroke patients activate motor regions in the brain. In particular, the brain regions activated by unilateral upper limb multi-task are more extensive, which is more beneficial for rehabilitation, but it also increases the difficulty of decoding. In this paper, self-attention convolutional neural network based partial prior transfer learning (SACNN-PPTL) is proposed to improve the classification performance of patients' MI multi-task. The backbone network of the algorithm is SACNN, which accords with the inherent features of electroencephalogram (EEG) and contains the temporal feature module, the spatial feature module and the feature generalization module. In addition, PPTL is introduced to transfer part of the target domain while preserving the generalization of the base model while improving the specificity of the target domain. In the experiment, five backbone networks and three training modes are selected as comparison algorithms. The experimental results show that SACNN-PPTL had a classification accuracy of 55.4%±0.17 in four types of MI tasks for 22 patients, which is significantly higher than comparison algorithms (P < 0.05). SACNN-PPTL effectively improves the decoding performance of MI tasks and promotes the development of BCI-based rehabilitation for unilateral upper limb.

Adaptive Time-Frequency Segment Optimization for Motor Imagery Classification

Motor imagery (MI)-based brain-computer interface (BCI) has emerged as a crucial method for rehabilitating stroke patients. However, the variability in the time-frequency distribution of MI-electroencephalography (EEG) among individuals limits the generalizability of algorithms that rely on non-customized time-frequency segments. In this study, we propose a novel method for optimizing time-frequency segments of MI-EEG using the sparrow search algorithm (SSA). Additionally, we apply a correlation-based channel selection (CCS) method that considers the correlation coefficient of features between each pair of EEG channels. Subsequently, we utilize a regularized common spatial pattern method to extract effective features. Finally, a support vector machine is employed for signal classification. The results on three BCI datasets confirmed that our algorithm achieved better accuracy (99.11% vs. 94.00% for BCI Competition III Dataset IIIa, 87.70% vs. 81.10% for Chinese Academy of Medical Sciences dataset, and 87.94% vs. 81.97% for BCI Competition IV Dataset 1) compared to algorithms with non-customized time-frequency segments. Our proposed algorithm enables adaptive optimization of EEG time-frequency segments, which is crucial for the development of clinically effective motor rehabilitation.

Effect of the VR-guided grasping task on the brain functional network

Virtual reality (VR) technology has been demonstrated to be effective in rehabilitation training with the assistance of VR games, but its impact on brain functional networks remains unclear. In this study, we used functional near-infrared spectroscopy imaging to examine the brain hemodynamic signals from 18 healthy participants during rest and grasping tasks with and without VR game intervention. We calculated and compared the graph theory-based topological properties of the brain networks using phase locking values (PLV). The results revealed significant differences in the brain network properties when VR games were introduced compared to the resting state. Specifically, for the VR-guided grasping task, the modularity of the brain network was significantly higher than the resting state, and the average clustering coefficient of the motor cortex was significantly lower compared to that of the resting state and the simple grasping task. Correlation analyses showed that a higher clustering coefficient, local efficiency, and modularity were associated with better game performance during VR game participation. This study demonstrates that a VR game task intervention can better modulate the brain functional network compared to simple grasping movements and may be more beneficial for the recovery of grasping abilities in post-stroke patients with hand paralysis.

Automatic Seizure Detection Based on Stockwell Transform and Transformer

Epilepsy is a chronic neurological disease associated with abnormal neuronal activity in the brain. Seizure detection algorithms are essential in reducing the workload of medical staff reviewing electroencephalogram (EEG) records. In this work, we propose a novel automatic epileptic EEG detection method based on Stockwell transform and Transformer. First, the S-transform is applied to the original EEG segments, acquiring accurate time-frequency representations. Subsequently, the obtained time-frequency matrices are grouped into different EEG rhythm blocks and compressed as vectors in these EEG sub-bands. After that, these feature vectors are fed into the Transformer network for feature selection and classification. Moreover, a series of post-processing methods were introduced to enhance the efficiency of the system. When evaluating the public CHB-MIT database, the proposed algorithm achieved an accuracy of 96.15%, a sensitivity of 96.11%, a specificity of 96.38%, a precision of 96.33%, and an area under the curve (AUC) of 0.98 in segment-based experiments, along with a sensitivity of 96.57%, a false detection rate of 0.38/h, and a delay of 20.62 s in event-based experiments. These outstanding results demonstrate the feasibility of implementing this seizure detection method in future clinical applications.

Improved motor imagery classification using adaptive spatial filters based on particle swarm optimization algorithm

Background

As a typical self-paced brain-computer interface (BCI) system, the motor imagery (MI) BCI has been widely applied in fields such as robot control, stroke rehabilitation, and assistance for patients with stroke or spinal cord injury. Many studies have focused on the traditional spatial filters obtained through the common spatial pattern (CSP) method. However, the CSP method can only obtain fixed spatial filters for specific input signals. In addition, the CSP method only focuses on the variance difference of two types of electroencephalogram (EEG) signals, so the decoding ability of EEG signals is limited.

Methods

To make up for these deficiencies, this study introduces a novel spatial filter-solving paradigm named adaptive spatial pattern (ASP), which aims to minimize the energy intra-class matrix and maximize the inter-class matrix of MI-EEG after spatial filtering. The filter bank adaptive and common spatial pattern (FBACSP), our proposed method for MI-EEG decoding, amalgamates ASP spatial filters with CSP features across multiple frequency bands. Through a dual-stage feature selection strategy, it employs the Particle Swarm Optimization algorithm for spatial filter optimization, surpassing traditional CSP approaches in MI classification. To streamline feature sets and enhance recognition efficiency, it first prunes CSP features in each frequency band using mutual information, followed by merging these with ASP features.

Results

Comparative experiments are conducted on two public datasets (2a and 2b) from BCI competition IV, which show the outstanding average recognition accuracy of FBACSP. The classification accuracy of the proposed method has reached 74.61 and 81.19% on datasets 2a and 2b, respectively. Compared with the baseline algorithm, filter bank common spatial pattern (FBCSP), the proposed algorithm improves by 11.44 and 7.11% on two datasets, respectively (p < 0.05).

Conclusion

It is demonstrated that FBACSP has a strong ability to decode MI-EEG. In addition, the analysis based on mutual information, t-SNE, and Shapley values further proves that ASP features have excellent decoding ability for MI-EEG signals and explains the improvement of classification performance by the introduction of ASP features. These findings may provide useful information to optimize EEG-based BCI systems and further improve the performance of non-invasive BCI.

Development of hybrid feature learner model integrating FDOSM for golden subject identification in motor imagery

Brain-computer interfaces (BCIs) based on motor imagery (MI) face challenges due to the complex nature of brain activity, nonstationary and high-dimensional properties, and individual variations in motor behaviour. The identification of a consistent "golden subject" in MI-based BCIs remains an open challenge, complicated by multiple evaluation metrics and conflicting trade-offs, presenting complex Multi-Criteria Decision Making (MCDM) problems. This study proposes a hybrid brain signal decoding model called Hybrid Adaboost Feature Learner (HAFL), which combines feature extraction and classification using VGG-19, STFT, and Adaboost classifier. The model is validated using a pre-recorded MI-EEG dataset from the BCI competition at Graz University. The fuzzy decision-making framework is integrated with HAFL to allocate a golden subject for MI-BCI applications through the Golden Subject Decision Matrix (GSDM) and the Fuzzy Decision by Opinion Score Method (FDOSM). The effectiveness of the HAFL model in addressing inter-subject variability in EEG-based MI-BCI is evaluated using an MI-EEG dataset involving nine subjects. Comparing subject performance fairly is challenging due to complexity variations, but the FDOSM method provides valuable insights. Through FDOSM-based External Group Aggregation (EGA), subject S5 achieves the highest score of 2.900, identified as the most promising golden subject for subject-to-subject transfer learning. The proposed methodology is compared against other benchmark studies from various key perspectives and exhibits significant novelty in several aspects. The findings contribute to the development of more robust and effective BCI systems, paving the way for advancements in subject-to-subject transfer learning for BCI-MI applications.

Explainable cross-task adaptive transfer learning for motor imagery EEG classification

Objective. In the field of motor imagery (MI) electroencephalography (EEG)-based brain-computer interfaces, deep transfer learning (TL) has proven to be an effective tool for solving the problem of limited availability in subject-specific data for the training of robust deep learning (DL) models. Although considerable progress has been made in the cross-subject/session and cross-device scenarios, the more challenging problem of cross-task deep TL remains largely unexplored.Approach. We propose a novel explainable cross-task adaptive TL method for MI EEG decoding. Firstly, similarity analysis and data alignment are performed for EEG data of motor execution (ME) and MI tasks. Afterwards, the MI EEG decoding model is obtained via pre-training with extensive ME EEG data and fine-tuning with partial MI EEG data. Finally, expected gradient-based post-hoc explainability analysis is conducted for the visualization of important temporal-spatial features.Main results. Extensive experiments are conducted on one large ME EEG High-Gamma dataset and two large MI EEG datasets (openBMI and GIST). The best average classification accuracy of our method reaches 80.00% and 72.73% for OpenBMI and GIST respectively, which outperforms several state-of-the-art algorithms. In addition, the results of the explainability analysis further validate the correlation between ME and MI EEG data and the effectiveness of ME/MI cross-task adaptation.Significance. This paper confirms that the decoding of MI EEG can be well facilitated by pre-existing ME EEG data, which largely relaxes the constraint of training samples for MI EEG decoding and is important in a practical sense.

Lightweight deep learning model incorporating an attention mechanism and feature fusion for automatic classification of gastric lesions in gastroscopic images

Accurate diagnosis of various lesions in the formation stage of gastric cancer is an important problem for doctors. Automatic diagnosis tools based on deep learning can help doctors improve the accuracy of gastric lesion diagnosis. Most of the existing deep learning-based methods have been used to detect a limited number of lesions in the formation stage of gastric cancer, and the classification accuracy needs to be improved. To this end, this study proposed an attention mechanism feature fusion deep learning model with only 14 million (M) parameters. Based on that model, the automatic classification of a wide range of lesions covering the stage of gastric cancer formation was investigated, including non-neoplasm(including gastritis and intestinal metaplasia), low-grade intraepithelial neoplasia, and early gastric cancer (including high-grade intraepithelial neoplasia and early gastric cancer). 4455 magnification endoscopy with narrow-band imaging(ME-NBI) images from 1188 patients were collected to train and test the proposed method. The results of the test dataset showed that compared with the advanced gastric lesions classification method with the best performance (overall accuracy = 94.3%, parameters = 23.9 M), the proposed method achieved both higher overall accuracy and a relatively lightweight model (overall accuracy =95.6%, parameter = 14 M). The accuracy, sensitivity, and specificity of low-grade intraepithelial neoplasia were 94.5%, 93.0%, and 96.5%, respectively, achieving state-of-the-art classification performance. In conclusion, our method has demonstrated its potential in diagnosing various lesions at the stage of gastric cancer formation.

Investigating the Impact of Guided Imagery on Stress, Brain Functions, and Attention: A Randomized Trial

The aim of this study was to investigate the potential impact of guided imagery (GI) on attentional control and cognitive performance and to explore the relationship between guided imagery, stress reduction, alpha brainwave activity, and attentional control using common cognitive performance tests. Executive function was assessed through the use of attentional control tests, including the anti-saccade, Stroop, and Go/No-go tasks. Participants underwent a guided imagery session while their brainwave activity was measured, followed by attentional control tests. The study's outcomes provide fresh insights into the influence of guided imagery on brain wave activity, particularly in terms of attentional control. The findings suggest that guided imagery has the potential to enhance attentional control by augmenting the alpha power and reducing stress levels. Given the limited existing research on the specific impact of guided imagery on attention control, the study's findings carry notable significance.

Dynamic pruning group equivariant network for motor imagery EEG recognition

Introduction: The decoding of the motor imaging electroencephalogram (MI-EEG) is the most critical part of the brain-computer interface (BCI) system. However, the inherent complexity of EEG signals makes it challenging to analyze and model them. Methods: In order to effectively extract and classify the features of EEG signals, a classification algorithm of motor imagery EEG signals based on dynamic pruning equal-variant group convolutional network is proposed. Group convolutional networks can learn powerful representations based on symmetric patterns, but they lack clear methods to learn meaningful relationships between them. The dynamic pruning equivariant group convolution proposed in this paper is used to enhance meaningful symmetric combinations and suppress unreasonable and misleading symmetric combinations. At the same time, a new dynamic pruning method is proposed to dynamically evaluate the importance of parameters, which can restore the pruned connections. Results and Discussion: The experimental results show that the pruning group equivariant convolution network is superior to the traditional benchmark method in the benchmark motor imagery EEG data set. This research can also be transferred to other research areas.

Bridging the BCI illiteracy gap: a subject-to-subject semantic style transfer for EEG-based motor imagery classification

Introduction

Brain-computer interfaces (BCIs) facilitate direct interaction between the human brain and computers, enabling individuals to control external devices through cognitive processes. Despite its potential, the problem of BCI illiteracy remains one of the major challenges due to inter-subject EEG variability, which hinders many users from effectively utilizing BCI systems. In this study, we propose a subject-to-subject semantic style transfer network (SSSTN) at the feature-level to address the BCI illiteracy problem in electroencephalogram (EEG)-based motor imagery (MI) classification tasks.

Methods

Our approach uses the continuous wavelet transform method to convert high-dimensional EEG data into images as input data. The SSSTN 1) trains a classifier for each subject, 2) transfers the distribution of class discrimination styles from the source subject (the best-performing subject for the classifier, i.e., BCI expert) to each subject of the target domain (the remaining subjects except the source subject, specifically BCI illiterates) through the proposed style loss, and applies a modified content loss to preserve the class-relevant semantic information of the target domain, and 3) finally merges the classifier predictions of both source and target subject using an ensemble technique.

Results and discussion

We evaluate the proposed method on the BCI Competition IV-2a and IV-2b datasets and demonstrate improved classification performance over existing methods, especially for BCI illiterate users. The ablation experiments and t-SNE visualizations further highlight the effectiveness of the proposed method in achieving meaningful feature-level semantic style transfer.

A novel heterogeneous transfer learning method based on data stitching for the sequential coding brain computer interface

OBJECTIVE

For the brain computer interface (BCI), it is necessary to collect enough electroencephalography (EEG) signals to train the classification model. When the operation dimension of BCI is large, it will bring great burden to data acquisition. Fortunately, this problem can be solved by our proposed transfer learning method.

METHOD

For the sequential coding experimental paradigm, the multi-band data stitching with label alignment and tangent space mapping (MDSLATSM) algorithm is proposed as a novel heterogeneous transfer learning method. After filtering by multi-band filtering, the artificial signals can be obtained by data stitching from the source domain, which build a bridge between the source domain and target domain. To make the distribution of two domains closer, their covariance matrices are aligned by label alignment. After mapping to the tangent space, the features are extracted from the Riemannian manifold. Finally, the classification results are obtained with feature selection and classification.

RESULTS

Our data set includes the EEG signals from 16 subjects. For the heterogeneous transfer learning of cross-label, the average classification accuracy is 78.28%. MDSLATSM is also tested for cross-subject, and the average classification accuracy is 64.01%, which is better than existing methods.

SIGNIFICANCE

Combining multi-band filtering, data stitching, label alignment and tangent space mapping, a novel heterogeneous transfer learning method can be achieved with superior performance, which promotes the practical application of the BCI systems.

Effects of indoor VOCs from paint on human brain activities during working memory tasks: An electroencephalogram study

As more and more people stay inside the building for a long time, the indoor environment has a great effect on their health, mood, and work efficiency. Electroencephalography (EEG) signals reflect electrical activity originating from neuronal firing when a task or activity is performed. Since there was no study on the effect of indoor air on nerves, this study utilized EEG to preliminarily explore the brain functions of subjects during working memory tasks with different difficulties. The subjects were divided into two groups according to the volatile organic compounds (VOCs) as odor irritants in the air. We expected to find the difference in subjects' EEG signals between VOCs and low-VOCs. The EEG signals from 60 electrodes were analyzed by event-related potential (ERP), event-related spectral power (ERSP), and correlation network methods to describe the brain activity. We compared the results of subjects in VOCs and low-VOCs and found significant differences between ERP and ERSP in the alpha band during a simple working memory task. Subjects were more sensitive to the VOCs in simple tasks than in complex tasks. Our work provided evidence of odor effects on brain functions and could be used to guide the design of indoor odor in home, offices, and classrooms.