Probability mapping based artifact detection and removal from single-channel EEG signals for brain-computer interface applications

Response coupling with an auxiliary neural signal for enhancing brain signal detection

Brain-computer interfaces (BCIs) offer an implicit, non-linguistic communication channel between users and machines. Despite their potential, BCIs are far from becoming a mainstream communication modality like text and speech. While non-invasive BCIs, such as Electroencephalography, are favored for their ease of use, their broader adoption is limited by challenges related to signal noise, artifacts, and variability across users. In this paper, we propose a novel method called response coupling, aimed at enhancing brain signal detection and reliability by pairing a brain signal with an artificially induced auxiliary signal and leveraging their interaction. Specifically, we use error-related potentials (ErrPs) as the primary signal and steady-state visual evoked potentials (SSVEPs) as the auxiliary signal. SSVEPs, known for their phase-locked responses to rhythmic stimuli, are selected because rhythmic neural activity plays a critical role in sensory and cognitive processes, with evidence suggesting that reinforcing these oscillations can improve neural performance. By exploring the interaction between these two signals, we demonstrate that response coupling significantly improves the detection accuracy of ErrPs, especially in the parietal and occipital regions. This method introduces a new paradigm for enhancing BCI performance, where the interaction between a primary and an auxiliary signal is harnessed to enhance the detection performance. Additionally, the phase-locking properties of SSVEPs allow for unsupervised rejection of suboptimal data, further increasing BCI reliability.

The Application of Entropy in Motor Imagery Paradigms of Brain-Computer Interfaces

Background: In motor imagery brain-computer interface (MI-BCI) research, electroencephalogram (EEG) signals are complex and nonlinear. This complexity and nonlinearity render signal processing and classification challenging when employing traditional linear methods. Information entropy, with its intrinsic nonlinear characteristics, effectively captures the dynamic behavior of EEG signals, thereby addressing the limitations of traditional methods in capturing linear features. However, the multitude of entropy types leads to unclear application scenarios, with a lack of systematic descriptions. Methods: This study conducted a review of 63 high-quality research articles focused on the application of entropy in MI-BCI, published between 2019 and 2023. It summarizes the names, functions, and application scopes of 13 commonly used entropy measures. Results: The findings indicate that sample entropy (16.3%), Shannon entropy (13%), fuzzy entropy (12%), permutation entropy (9.8%), and approximate entropy (7.6%) are the most frequently utilized entropy features in MI-BCI. The majority of studies employ a single entropy feature (79.7%), with dual entropy (9.4%) and triple entropy (4.7%) being the most prevalent combinations in multiple entropy applications. The incorporation of entropy features can significantly enhance pattern classification accuracy (by 8-10%). Most studies (67%) utilize public datasets for classification verification, while a minority design and conduct experiments (28%), and only 5% combine both methods. Conclusions: Future research should delve into the effects of various entropy features on specific problems to clarify their application scenarios. As research methodologies continue to evolve and advance, entropy features are poised to play a significant role in a wide array of fields and contexts.

The Effect of Processing Techniques on the Classification Accuracy of Brain-Computer Interface Systems

Background/Objectives: Accurately classifying Electroencephalography (EEG) signals is essential for the effective operation of Brain-Computer Interfaces (BCI), which is needed for reliable neurorehabilitation applications. However, many factors in the processing pipeline can influence classification performance. The objective of this study is to assess the effects of different processing steps on classification accuracy in EEG-based BCI systems. Methods: This study explores the impact of various processing techniques and stages, including the FASTER algorithm for artifact rejection (AR), frequency filtering, transfer learning, and cropped training. The Physionet dataset, consisting of four motor imagery classes, was used as input due to its relatively large number of subjects. The raw EEG was tested with EEGNet and Shallow ConvNet. To examine the impact of adding a spatial dimension to the input data, we also used the Multi-branch Conv3D Net and developed two new models, Conv2D Net and Conv3D Net. Results: Our analysis showed that classification accuracy can be affected by many factors at every stage. Applying the AR method, for instance, can either enhance or degrade classification performance, depending on the subject and the specific network architecture. Transfer learning was effective in improving the performance of all networks for both raw and artifact-rejected data. However, the improvement in classification accuracy for artifact-rejected data was less pronounced compared to unfiltered data, resulting in reduced precision. For instance, the best classifier achieved 46.1% accuracy on unfiltered data, which increased to 63.5% with transfer learning. In the filtered case, accuracy rose from 45.5% to only 55.9% when transfer learning was applied. An unexpected outcome regarding frequency filtering was observed: networks demonstrated better classification performance when focusing on lower-frequency components. Higher frequency ranges were more discriminative for EEGNet and Shallow ConvNet, but only when cropped training was applied. Conclusions: The findings of this study highlight the complex interaction between processing techniques and neural network performance, emphasizing the necessity for customized processing approaches tailored to specific subjects and network architectures.

Electroencephalogram based brain-computer interface: Applications, challenges, and opportunities

Brain-Computer Interfaces (BCI) is an exciting and emerging research area for researchers and scientists. It is a suitable combination of software and hardware to operate any device mentally. This review emphasizes the significant stages in the BCI domain, current problems, and state-of-the-art findings. This article also covers how current results can contribute to new knowledge about BCI, an overview of BCI from its early developments to recent advancements, BCI applications, challenges, and future directions. The authors pointed to unresolved issues and expressed how BCI is valuable for analyzing the human brain. Humans' dependence on machines has led humankind into a new future where BCI can play an essential role in improving this modern world.

High performance clean versus artifact dry electrode EEG data classification using Convolutional Neural Network transfer learning

Objective

Convolutional Neural Networks (CNNs) are promising for artifact detection in electroencephalography (EEG) data, but require large amounts of data. Despite increasing use of dry electrodes for EEG data acquisition, dry electrode EEG datasets are sparse. We aim to develop an algorithm for clean versus artifact dry electrode EEG data classification using transfer learning.

Methods

Dry electrode EEG data were acquired in 13 subjects while physiological and technical artifacts were induced. Data were per 2-second segment labeled as clean or artifact and split in an 80% train and 20% test set. With the train set, we fine-tuned a pre-trained CNN for clean versus artifact wet electrode EEG data classification using 3-fold cross validation. The three fine-tuned CNNs were combined in one final clean versus artifact classification algorithm, in which the majority vote was used for classification. We calculated accuracy, F1-score, precision, and recall of the pre-trained CNN and fine-tuned algorithm when applied to unseen test data.

Results

The algorithm was trained on 0.40 million and tested on 0.17 million overlapping EEG segments. The pre-trained CNN had a test accuracy of 65.6%. The fine-tuned clean versus artifact classification algorithm had an improved test accuracy of 90.7%, F1-score of 90.2%, precision of 89.1% and recall of 91.2%.

Conclusions

Despite a relatively small dry electrode EEG dataset, transfer learning enabled development of a high performing CNN-based algorithm for clean versus artifact classification.

Significance

Development of CNNs for classification of dry electrode EEG data is challenging as dry electrode EEG datasets are sparse. Here, we show that transfer learning can be used to overcome this problem.

EEG-based driver states discrimination by noise fraction analysis and novel clustering algorithm

Driver states are reported as one of the principal factors in driving safety. Distinguishing the driving driver state based on the artifact-free electroencephalogram (EEG) signal is an effective means, but redundant information and noise will inevitably reduce the signal-to-noise ratio of the EEG signal. This study proposes a method to automatically remove electrooculography (EOG) artifacts by noise fraction analysis. Specifically, multi-channel EEG recordings are collected after the driver experiences a long time driving and after a certain period of rest respectively. Noise fraction analysis is then applied to remove EOG artifacts by separating the multichannel EEG into components by optimizing the signal-to-noise quotient. The representation of data characteristics of the EEG after denoising is found in the Fisher ratio space. Additionally, a novel clustering algorithm is designed to identify denoising EEG by combining cluster ensemble and probability mixture model (CEPM). The EEG mapping plot is used to illustrate the effectiveness and efficiency of noise fraction analysis on the denoising of EEG signals. Adjusted rand index (ARI) and accuracy (ACC) are used to demonstrate clustering performance and precision. The results showed that the noise artifacts in the EEG were removed and the clustering accuracy of all participants was above 90%, resulting in a high driver fatigue recognition rate.

Mental workload accumulation effect of mobile phone distraction in L2 autopilot mode

As automated vehicles become more common, there is a need for precise measurement and definition of when and in what ways a driver can use a mobile phone in L2 autonomous driving mode, for how long it can be used, the complexity of the call content, and the accumulated mental workload. This study uses a 2 (driving mode) × 2 (call content complexity) × 6 (driving stage) three-factor mixed experimental design to investigate the effect of these factors on the driver's mental workload by measuring the driver's performance on Detection response tasks, pupil diameter, and EEG components in various brain regions in the alpha band. The results showed that drivers' mental workload levels converge between manual and automatic driving modes as the duration of driving increases, regardless of the level of complexity of the mobile phone conversation. This suggests that mobile phone conversations can also disrupt the driver's cognitive resource balance in L2 automatic driving mode, as it increases mental workload while also impairing the normal functioning of brain functions such as cognitive control, problem solving, and judgment, thereby compromising driving safety.

EEG-fNIRS-based hybrid image construction and classification using CNN-LSTM

The constantly evolving human–machine interaction and advancement in sociotechnical systems have made it essential to analyze vital human factors such as mental workload, vigilance, fatigue, and stress by monitoring brain states for optimum performance and human safety. Similarly, brain signals have become paramount for rehabilitation and assistive purposes in fields such as brain–computer interface (BCI) and closed-loop neuromodulation for neurological disorders and motor disabilities. The complexity, non-stationary nature, and low signal-to-noise ratio of brain signals pose significant challenges for researchers to design robust and reliable BCI systems to accurately detect meaningful changes in brain states outside the laboratory environment. Different neuroimaging modalities are used in hybrid settings to enhance accuracy, increase control commands, and decrease the time required for brain activity detection. Functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) measure the hemodynamic and electrical activity of the brain with a good spatial and temporal resolution, respectively. However, in hybrid settings, where both modalities enhance the output performance of BCI, their data compatibility due to the huge discrepancy between their sampling rate and the number of channels remains a challenge for real-time BCI applications. Traditional methods, such as downsampling and channel selection, result in important information loss while making both modalities compatible. In this study, we present a novel recurrence plot (RP)-based time-distributed convolutional neural network and long short-term memory (CNN-LSTM) algorithm for the integrated classification of fNIRS EEG for hybrid BCI applications. The acquired brain signals are first projected into a non-linear dimension with RPs and fed into the CNN to extract essential features without performing any downsampling. Then, LSTM is used to learn the chronological features and time-dependence relation to detect brain activity. The average accuracies achieved with the proposed model were 78.44% for fNIRS, 86.24% for EEG, and 88.41% for hybrid EEG-fNIRS BCI. Moreover, the maximum accuracies achieved were 85.9, 88.1, and 92.4%, respectively. The results confirm the viability of the RP-based deep-learning algorithm for successful BCI systems.

Adaptive single-channel EEG artifact removal for real-time clinical monitoring

OBJECTIVE

Electroencephalography (EEG) has become very common in clinical practice due to its relatively low cost, ease of installation, non-invasiveness, and good temporal resolution. Portable EEG devices are increasingly popular in clinical monitoring applications such as sleep scoring or anesthesia monitoring. In these situations, for reasons of speed and simplicity only few electrodes are used and contamination of the EEG signal by artifacts is inevitable. Visual inspection and manual removal of artifacts is often not possible, especially in real-time applications. Our goal is to develop a flexible technique to remove EEG artifacts in these contexts with minimal supervision.

METHODS

We propose here a new wavelet-based method which allows to remove artifacts from single-channel EEGs. The method is based on a data-driven renormalization of the wavelet components and is capable of adaptively attenuate artifacts of different nature. We benchmark our method against alternative artifact removal techniques.

RESULTS

We assessed the performance of the proposed method on publicly available datasets comprising ocular, muscular, and movement artifacts. The proposed method shows superior performances on different kinds of artifacts and signal-to-noise levels. Finally, we present an application of our method to the monitoring of general anesthesia.

CONCLUSIONS

We show that our method can successfully attenuate various types of artifacts in single-channel EEG.

SIGNIFICANCE

Thanks to its data-driven approach and low computational cost, the proposed method provides a valuable tool to remove artifacts in real-time EEG applications with few electrodes, such as monitoring in special care units.

Electrophysiological frequency domain analysis of driver passive fatigue under automated driving conditions

With the continuous improvement of automated vehicles, researchers have found that automated driving is more likely to cause passive fatigue. To explore the impact of automation and scenario complexity on the passive fatigue of a driver, we collected electroencephalography (EEG), detection-response task (DRT) performance, and the subjective report scores of 48 drivers. We found that in automated driving under monotonic conditions, after 40 min, the alpha power of the driver’s EEG indicators increased significantly, the accuracy of the detection reaction task decreased, and the reaction time became slower. The receiver characteristic curve was used to calculate the critical threshold of the alpha power during passive fatigue. The determination of the threshold further clarifies the occurrence time and physiological characteristics of passive fatigue and improves the passive fatigue theory.