Two-layer LSTM network-based prediction of epileptic seizures using EEG spectral features

A zero precision loss framework for EEG channel selection: enhancing efficiency and maintaining interpretability

The brain-computer interface (BCI) systems based on motor imagery typically rely on a large number of electrode channels to acquire information. The rational selection of electroencephalography (EEG) channel combinations is crucial for optimizing computational efficiency and enhancing practical applicability. However, evaluating all potential channel combinations individually is impractical. This study aims to explore a strategy for quickly achieving a balance between maximizing channel reduction and minimizing precision loss. To this end, we developed a spatio-temporal attention perception network named STAPNet. Based on the channel contributions adaptively generated by its subnetwork, we propose an extended step bi-directional search strategy that includes variable ratio channel selection (VRCS) and strided greedy channel selection (SGCS), designed to enhance global search capabilities and accelerate the optimization process. Experimental results show that on the High Gamma and BCI Competition IV 2a public datasets, the framework respectively achieved average maximum accuracies of 91.47% and 84.17%. Under conditions of zero precision loss, the average number of channels was reduced by a maximum of 87.5%. Additionally, to investigate the impact of neural information loss due to channel reduction on the interpretation of complex brain functions, we employed a heatmap visualization algorithm to verify the universal importance and complete symmetry of the selected optimal channel combination across multiple datasets. This is consistent with the brain's cooperative mechanism when processing tasks involving both the left and right hands.

Detection of Anxiety-Based Epileptic Seizures in EEG Signals Using Fuzzy Features and Parrot Optimization-Tuned LSTM

In humans, epilepsy is diagnosed through electroencephalography (EEG) signals. Epileptic seizures (ESs) arise due to anxiety. The detection of anxiety-based seizures is challenging for radiologists, and there is a limited availability of anxiety-based EEG signals. Data augmentation methods are required to increase the number of novel samples. An epileptic seizure arises due to anxiety, which manifests as variations in EEG signal patterns consisting of changes in the size and shape of the signal. In this study, anxiety EEG signals were synthesized by applying data augmentation methods such as random data augmentation (RDA) to existing epileptic seizure signals from the Bonn EEG dataset. The data-augmented anxiety seizure signals were processed using three algorithms-(i) fuzzy C-means-particle swarm optimization-long short-term memory (FCM-PS-LSTM), (ii) particle swarm optimization-long short-term memory (PS-LSTM), and (iii) parrot optimization LSTM (PO-LSTM)-for the detection of anxiety ESs via EEG signals. The predicted accuracies of detecting ESs through EEG signals using the proposed algorithms-namely, (i) FCM-PS-LSTM, (ii) PS-LSTM, and (iii) PO-LSTM-were about 98%, 98.5%, and 96%, respectively.

A Method for the Spatial Interpolation of EEG Signals Based on the Bidirectional Long Short-Term Memory Network

The precision of electroencephalograms (EEGs) significantly impacts the performance of brain-computer interfaces (BCI). Currently, the majority of research into BCI technology gives priority to lightweight design and a reduced electrode count to make it more suitable for application in wearable environments. This paper introduces a deep learning-based time series bidirectional (BiLSTM) network that is designed to capture the inherent characteristics of EEG channels obtained from neighboring electrodes. It aims to predict the EEG data time series and facilitate the conversion process from low-density EEG signals to high-density EEG signals. BiLSTM pays more attention to the dependencies in time series data rather than mathematical maps, and the root mean square error can be effectively restricted to below 0.4μV, which is less than half the error in traditional methods. After expanding the BCI Competition III 3a dataset from 18 channels to 60 channels, we conducted classification experiments on four types of motor imagery tasks. Compared to the original low-density EEG signals (18 channels), the classification accuracy was around 82%, an increase of about 20%. When juxtaposed with real high-density signals, the increment in the error rate remained below 5%. The expansion of the EEG channels showed a substantial and notable improvement compared with the original low-density signals.

Epileptic Seizure Prediction Using Spatiotemporal Feature Fusion on EEG

Electroencephalography (EEG) plays a crucial role in epilepsy analysis, and epileptic seizure prediction has significant value for clinical treatment of epilepsy. Currently, prediction methods using Convolutional Neural Network (CNN) primarily focus on local features of EEG, making it challenging to simultaneously capture the spatial and temporal features from multi-channel EEGs to identify the preictal state effectively. In order to extract inherent spatial relationships among multi-channel EEGs while obtaining their temporal correlations, this study proposed an end-to-end model for the prediction of epileptic seizures by incorporating Graph Attention Network (GAT) and Temporal Convolutional Network (TCN). Low-pass filtered EEG signals were fed into the GAT module for EEG spatial feature extraction, and followed by TCN to capture temporal features, allowing the end-to-end model to acquire the spatiotemporal correlations of multi-channel EEGs. The system was evaluated on the publicly available CHB-MIT database, yielding segment-based accuracy of 98.71%, specificity of 98.35%, sensitivity of 99.07%, and F1-score of 98.71%, respectively. Event-based sensitivity of 97.03% and False Positive Rate (FPR) of 0.03/h was also achieved. Experimental results demonstrated this system can achieve superior performance for seizure prediction by leveraging the fusion of EEG spatiotemporal features without the need of feature engineering.

SFT-Net: A Network for Detecting Fatigue From EEG Signals by Combining 4D Feature Flow and Attention Mechanism

Fatigued driving is a leading cause of traffic accidents, and accurately predicting driver fatigue can significantly reduce their occurrence. However, modern fatigue detection models based on neural networks often face challenges such as poor interpretability and insufficient input feature dimensions. This article proposes a novel Spatial-Frequency-Temporal Network (SFT-Net) method for detecting driver fatigue using electroencephalogram (EEG) data. Our approach integrates EEG signals' spatial, frequency, and temporal information to improve recognition performance. We transform the differential entropy of five frequency bands of EEG signals into a 4D feature tensor to preserve these three types of information. An attention module is then used to recalibrate the spatial and frequency information of each input 4D feature tensor time slice. The output of this module is fed into a depthwise separable convolution (DSC) module, which extracts spatial and frequency features after attention fusion. Finally, long short-term memory (LSTM) is used to extract the temporal dependence of the sequence, and the final features are output through a linear layer. We validate the effectiveness of our model on the SEED-VIG dataset, and experimental results demonstrate that SFT-Net outperforms other popular models for EEG fatigue detection. Interpretability analysis supports the claim that our model has a certain level of interpretability. Our work addresses the challenge of detecting driver fatigue from EEG data and highlights the importance of integrating spatial, frequency, and temporal information.

A hybrid 1D CNN-BiLSTM model for epileptic seizure detection using multichannel EEG feature fusion

Epilepsy, a chronic non-communicable disease is characterized by repeated unprovoked seizures, which are transient episodes of abnormal electrical activity in the brain. While Electroencephalography (EEG) is considered as the gold standard for diagnosis in current clinical practice, manual inspection of EEG is time consuming and biased. This paper presents a novel hybrid 1D CNN-Bi LSTM feature fusion model for automatically detecting seizures. The proposed model leverages spatial features extracted by one dimensional convolutional neural network and temporal features extracted by bi directional long short-term memory network. Ictal and inter ictal data is first acquired from the long multichannel EEG record. The acquired data is segmented and labelled using small fixed windows. Signal features are then extracted from the segments concurrently by the parallel combination of CNN and Bi-LSTM. The spatial and temporal features thus captured are then fused to enhance classification accuracy of model. The approach is validated using benchmark CHB-MIT dataset and 5-fold cross validation which resulted in an average accuracy of 95.90%, with precision 94.78%, F1 score 95.95%. Notably model achieved average sensitivity of 97.18% with false positivity rate at 0.05/hr. The significantly lower false positivity and false negativity rates indicate that the proposed model is a promising tool for detecting seizures in epilepsy patients. The employed parallel path network benefits from memory function of Bi-LSTM and strong feature extraction capabilities of CNN. Moreover, eliminating the need for any domain transformation or additional preprocessing steps, model effectively reduces complexity and enhances efficiency, making it suitable for use by clinicians during the epilepsy diagnostic process.

Electroencephalographic Signal Data Augmentation Based on Improved Generative Adversarial Network

EEG signals combined with deep learning play an important role in the study of human-computer interaction. However, the limited dataset makes it challenging to study EEG signals using deep learning methods. Inspired by the GAN network in image generation, this paper presents an improved generative adversarial network model L-C-WGAN-GP to generate artificial EEG data to augment training sets and improve the application of BCI in various fields. The generator consists of a long short-term memory (LSTM) network and the discriminator consists of a convolutional neural network (CNN) which uses the gradient penalty-based Wasserstein distance as the loss function in model training. The model can learn the statistical features of EEG signals and generate EEG data that approximate real samples. In addition, the performance of the compressed sensing reconstruction model can be improved by using augmented datasets. Experiments show that, compared with the existing advanced data amplification techniques, the proposed model produces EEG signals closer to the real EEG signals as measured by RMSE, FD and WTD indicators. In addition, in the compressed reconstruction of EEG signals, adding the new data reduces the loss by about 15% compared with the original data, which greatly improves the reconstruction accuracy of the EEG signals' compressed sensing.

TBEEG: A Two-Branch Manifold Domain Enhanced Transformer Algorithm for Learning EEG Decoding

The electroencephalogram-based (EEG) brain-computer interface (BCI) has garnered significant attention in recent research. However, the practicality of EEG remains constrained by the lack of efficient EEG decoding technology. The challenge lies in effectively translating intricate EEG into meaningful, generalizable information. EEG signal decoding primarily relies on either time domain or frequency domain information. There lacks a method capable of simultaneously and effectively extracting both time and frequency domain features, as well as efficiently fuse these features. Addressing these limitations, a two-branch Manifold Domain enhanced transformer algorithm is designed to holistically capture EEG's spatio-temporal information. Our method projects the time-domain information of EEG signals into the Riemannian spaces to fully decode the time dependence of EEG signals. Using wavelet transform, the time domain information is converted into frequency domain information, and the spatial information contained in the frequency domain information of EEG signal is mined through the spectrogram. The effectiveness of the proposed TBEEG algorithm is validated on BCIC-IV-2a dataset and MAMEM-SSVEP-II datasets.

Epileptic seizure prediction based on EEG using pseudo-three-dimensional CNN

Epileptic seizures are characterized by their sudden and unpredictable nature, posing significant risks to a patient's daily life. Accurate and reliable seizure prediction systems can provide alerts before a seizure occurs, as well as give the patient and caregivers provider enough time to take appropriate measure. This study presents an effective seizure prediction method based on deep learning that combine with handcrafted features. The handcrafted features were selected by Max-Relevance and Min-Redundancy (mRMR) to obtain the optimal set of features. To extract the epileptic features from the fused multidimensional structure, we designed a P3D-BiConvLstm3D model, which is a combination of pseudo-3D convolutional neural network (P3DCNN) and bidirectional convolutional long short-term memory 3D (BiConvLstm3D). We also converted EEG signals into a multidimensional structure that fused spatial, manual features, and temporal information. The multidimensional structure is then fed into a P3DCNN to extract spatial and manual features and feature-to-feature dependencies, followed by a BiConvLstm3D input to explore temporal dependencies while preserving the spatial features, and finally, a channel attention mechanism is implemented to emphasize the more representative information in the multichannel output. The proposed has an average accuracy of 98.13%, an average sensitivity of 98.03%, an average precision of 98.30% and an average specificity of 98.23% for the CHB-MIT scalp EEG database. A comparison of the proposed model with other baseline methods was done to confirm the better performance of features through time-space nonlinear feature fusion. The results show that the proposed P3DCNN-BiConvLstm3D-Attention3D method for epilepsy prediction by time-space nonlinear feature fusion is effective.

Identification of TLE Focus from EEG Signals by Using Deep Learning Approach

Temporal lobe epilepsy, a neurological disease that causes seizures as a result of excessive neural activities in the brain, is the most common type of focal seizure, accounting for 30-35% of all epilepsies. Detection of epilepsy and localization of epileptic focus are essential for treatment planning and epilepsy surgery. Currently, epileptic focus is decided by expert physician by examining the EEG records and determining EEG channel where epileptic patterns begins and continues intensely during seizure. Examination of long EEG recordings is very time-consuming process, requires attention and decision can vary depending on physician. In this study, to assist physicians in detecting epileptic focus side from EEG recordings, a novel deep learning-based computer-aided diagnosis system is presented. In the proposed framework, ictal epochs are detected using long short-term memory network fed with EEG subband features obtained by discrete wavelet transform, and then, epileptic focus identification is realized by using asymmetry score. This algorithm was tested on EEG database obtained from the Ankara University hospital. Experimental results showed ictal and interictal epochs were classified with accuracy of 86.84%, sensitivity of 86.96% and specificity of 89.68% on Ankara University hospital dataset, and 96.67% success rate was obtained on Bonn EEG dataset. In addition, epileptic focus was identified with accuracy of 96.10%, sensitivity of 100% and specificity of 93.80% by using the proposed deep learning-based algorithm and university hospital dataset. These results showed that proposed method can be used properly in clinical applications, epilepsy treatment and surgical planning as a medical decision support system.

Machine learning seizure prediction: one problematic but accepted practice

Objective.Epilepsy is one of the most common neurological disorders and can have a devastating effect on a person's quality of life. As such, the search for markers which indicate an upcoming seizure is a critically important area of research which would allow either on-demand treatment or early warning for people suffering with these disorders. There is a growing body of work which uses machine learning methods to detect pre-seizure biomarkers from electroencephalography (EEG), however the high prediction rates published do not translate into the clinical setting. Our objective is to investigate a potential reason for this.Approach.We conduct an empirical study of a commonly used data labelling method for EEG seizure prediction which relies on labelling small windows of EEG data in temporal groups then selecting randomly from those windows to validate results. We investigate a confound for this approach for seizure prediction and demonstrate the ease at which it can be inadvertently learned by a machine learning system.Main results.We find that non-seizure signals can create decision surfaces for machine learning approaches which can result in false high prediction accuracy on validation datasets. We prove this by training an artificial neural network to learn fake seizures (fully decoupled from biology) in real EEG.Significance.The significance of our findings is that many existing works may be reporting results based on this confound and that future work should adhere to stricter requirements in mitigating this confound. The problematic, but commonly accepted approach in the literature for seizure prediction labelling is potentially preventing real advances in developing solutions for these sufferers. By adhering to the guidelines in this paper future work in machine learning seizure prediction is more likely to be clinically relevant.

Epileptic Seizure Detection Using a Hybrid 1D CNN-Machine Learning Approach from EEG Data

Electroencephalography (EEG) is a widely used technique for the detection of epileptic seizures. It can be recorded in a noninvasive manner to present the electrical activity of the brain. The visual inspection of nonlinear and highly complex EEG signals is both costly and time-consuming. Therefore, an effective automatic detection system is needed to assist in the long-term evaluation and treatment of patients. Traditional approaches based on machine learning require feature extraction, while deep learning approaches are time-consuming and require more layers for effective feature learning and processing of complex EEG waveforms. Deep learning-based approaches also have weak generalization ability. This paper proposes a solution based on the combination of convolution neural networks (CNN) and machine learning classifiers. It preprocesses the EEG signal using the Butterworth filter and performs feature extraction using CNN. From the extracted set of features, the approach selects only the relevant features using mutual information-based estimators to reduce the curse of dimensionality and improve classification accuracy. The selected features are then passed as input to different machine learning classifiers. The suggested solution is evaluated on the University of Bonn dataset and CHB-MIT datasets. Our model effectively predicts 2, 3, 4, and 5 classes with accuracy of 100%, 99%, 94.6%, and 94%, respectively, for the Bonn dataset and 98% for CHB-MIT datasets.

A multi-frame network model for predicting seizure based on sEEG and iEEG data

Introduction

Analysis and prediction of seizures by processing the EEG signals could assist doctors in accurate diagnosis and improve the quality of the patient's life with epilepsy. Nowadays, seizure prediction models based on deep learning have become one of the most popular topics in seizure studies, and many models have been presented. However, the prediction results are strongly related to the various complicated pre-processing strategies of models, and cannot be directly applied to raw data in real-time applications. Moreover, due to the inherent deficiencies in single-frame models and the non-stationary nature of EEG signals, the generalization ability of the existing model frameworks is generally poor.

Methods

Therefore, we proposed an end-to-end seizure prediction model in this paper, where we designed a multi-frame network for automatic feature extraction and classification. Instance and sequence-based frames are proposed in our approach, which can help us simultaneously extract features of different modes for further classification. Moreover, complicated pre-processing steps are not included in our model, and the novel frames can be directly applied to the raw data. It should be noted that the approaches proposed in the paper can be easily used as the general model which has been validated and compared with existing model frames.

Results

The experimental results showed that the multi-frame network proposed in this paper was superior to the existing model frame in accuracy, sensitivity, specificity, F1-score, and AUC in the classification performance of EEG signals.

Discussion

Our results provided a new research idea for this field. Researchers can further integrate the idea of the multi-frame network into the state-of-the-art single-frame seizure prediction models and then achieve better results.

A novel dual-modal emotion recognition algorithm with fusing hybrid features of audio signal and speech context

With regard to human–machine interaction, accurate emotion recognition is a challenging problem. In this paper, efforts were taken to explore the possibility to complete the feature abstraction and fusion by the homogeneous network component, and propose a dual-modal emotion recognition framework that is composed of a parallel convolution (Pconv) module and attention-based bidirectional long short-term memory (BLSTM) module. The Pconv module employs parallel methods to extract multidimensional social features and provides more effective representation capacity. Attention-based BLSTM module is utilized to strengthen key information extraction and maintain the relevance between information. Experiments conducted on the CH-SIMS dataset indicate that the recognition accuracy reaches 74.70% on audio data and 77.13% on text, while the accuracy of the dual-modal fusion model reaches 90.02%. Through experiments it proves the feasibility to process heterogeneous information within homogeneous network component, and demonstrates that attention-based BLSTM module would achieve best coordination with the feature fusion realized by Pconv module. This can give great flexibility for the modality expansion and architecture design.

Classification of EEG Signals for Prediction of Epileptic Seizures

Epilepsy is a common brain disorder that causes patients to face multiple seizures in a single day. Around 65 million people are affected by epilepsy worldwide. Patients with focal epilepsy can be treated with surgery, whereas generalized epileptic seizures can be managed with medications. It has been noted that in more than 30% of cases, these medications fail to control epileptic seizures, resulting in accidents and limiting the patient’s life. Predicting epileptic seizures in such patients prior to the commencement of an oncoming seizure is critical so that the seizure can be treated with preventive medicines before it occurs. Electroencephalogram (EEG) signals of patients recorded to observe brain electrical activity during a seizure can be quite helpful in predicting seizures. Researchers have proposed methods that use machine and/or deep learning techniques to predict epileptic seizures using scalp EEG signals; however, prediction of seizures with increased accuracy is still a challenge. Therefore, we propose a three-step approach. It includes preprocessing of scalp EEG signals with PREP pipeline, which is a more sophisticated alternative to basic notch filtering. This method uses a regression-based technique to further enhance the SNR, with a combination of handcrafted, i.e., statistical features such as temporal mean, variance, and skewness, and automated features using CNN, followed by classification of interictal state and preictal state segments using LSTM to predict seizures. We train and validate our proposed technique on the CHB-MIT scalp EEG dataset and achieve accuracy of 94%, sensitivity of 93.8%, and 91.2% specificity. The proposed technique achieves better sensitivity and specificity than existing methods.