MIDNN- a classification approach for the EEG based motor imagery tasks using deep neural network

Identifying optimal channels and features for multi-participant motor imagery experiments across a participant's multi-day multi-class EEG data

The concept of the brain-computer interface (BCI) has become one of the popular research topics of recent times because it allows people to express their thoughts and control different applications and devices without actual movement. The communication between the brain and the computer or a machine is generally provided through Electroencephalogram (EEG) signals because they are cost-effective and easy to implement in normal life, not just in healthcare facilities. On the other hand, they are hard to process efficiently due to their nonlinearity and noisy nature. Thus, the field of BCI and EEG needs constant work and improvement. This paper focuses on generalizing the most efficient EEG channels and the most significant features of motor imagery (MI) signals by analyzing the recordings of one participant obtained over 20 different days. Because the classification performance usually decreases with an increasing number of class labels, we have realized the study by analyzing the signals through a new paradigm consisting of multi-class directional labels: right, left, forward, and backward. Afterward, the results are tested on EEG data obtained from 5 participants to see if the results are consistent with each other. The average accuracy of binary and multi-class classification using the Ensemble Subspace Discriminant classifier was found as 87.39 and 61.44%, respectively, with the most efficient 3-channel combination for daily BCI evaluation of one participant. On the other hand, the average accuracy of binary and multi-class classification was found as 71.84 and 50.42%, respectively, for 5 participants, with the most efficient channel combination of 4, where the first three are the same as the daily performance of one participant. During signal processing, the outliers of the signals were discarded by considering the channels separately. An algorithm was developed to dismiss the inconsistent samples within the classes. A novel adaptive filtering approach, correlation-based adaptive variational mode decomposition (CBAVMD), was proposed. The feature selection was realized based on the standard deviation values of the features between the classes. The paradigm based on the direction movements was found to be most effective, especially for binary classification of right and left directions. The generalization of effective channels and features was found to be generally successful.

EEG Amplitude Modulation Analysis across Mental Tasks: Towards Improved Active BCIs

Brain-computer interface (BCI) technology has emerged as an influential communication tool with extensive applications across numerous fields, including entertainment, marketing, mental state monitoring, and particularly medical neurorehabilitation. Despite its immense potential, the reliability of BCI systems is challenged by the intricacies of data collection, environmental factors, and noisy interferences, making the interpretation of high-dimensional electroencephalogram (EEG) data a pressing issue. While the current trends in research have leant towards improving classification using deep learning-based models, our study proposes the use of new features based on EEG amplitude modulation (AM) dynamics. Experiments on an active BCI dataset comprised seven mental tasks to show the importance of the proposed features, as well as their complementarity to conventional power spectral features. Through combining the seven mental tasks, 21 binary classification tests were explored. In 17 of these 21 tests, the addition of the proposed features significantly improved classifier performance relative to using power spectral density (PSD) features only. Specifically, the average kappa score for these classifications increased from 0.57 to 0.62 using the combined feature set. An examination of the top-selected features showed the predominance of the AM-based measures, comprising over 77% of the top-ranked features. We conclude this paper with an in-depth analysis of these top-ranked features and discuss their potential for use in neurophysiology.

A deep domain adaptation framework with correlation alignment for EEG-based motor imagery classification

It is impractical to collect sufficient and well-labeled EEG data in Brain-computer interface because of the time-consuming data acquisition and costly annotation. Conventional classification methods reusing EEG data from different subjects and time periods (across domains) significantly decrease the classification accuracy of motor imagery. In this paper, we propose a deep domain adaptation framework with correlation alignment (DDAF-CORAL) to solve the problem of distribution divergence for motor imagery classification across domains. Specifically, a two-stage framework is adopted to extract deep features for raw EEG data. The distribution divergence caused by subjected-related and time-related variations is further minimized by aligning the covariance of the source and target EEG feature distributions. Finally, the classification loss and adaptation loss are optimized simultaneously to achieve sufficient discriminative classification performance and low feature distribution divergence. Extensive experiments on three EEG datasets demonstrate that our proposed method can effectively reduce the distribution divergence between the source and target EEG data. The results show that our proposed method delivers outperformance (an average classification accuracy of 92.9% for within-session, an average kappa value of 0.761 for cross-session, and an average classification accuracy of 83.3% for cross-subject) in two-class classification tasks compared to other state-of-the-art methods.

Statistically significant features improve binary and multiple Motor Imagery task predictions from EEGs

In recent studies, in the field of Brain-Computer Interface (BCI), researchers have focused on Motor Imagery tasks. Motor Imagery-based electroencephalogram (EEG) signals provide the interaction and communication between the paralyzed patients and the outside world for moving and controlling external devices such as wheelchair and moving cursors. However, current approaches in the Motor Imagery-BCI system design require effective feature extraction methods and classification algorithms to acquire discriminative features from EEG signals due to the non-linear and non-stationary structure of EEG signals. This study investigates the effect of statistical significance-based feature selection on binary and multi-class Motor Imagery EEG signal classifications. In the feature extraction process performed 24 different time-domain features, 15 different frequency-domain features which are energy, variance, and entropy of Fourier transform within five EEG frequency subbands, 15 different time-frequency domain features which are energy, variance, and entropy of Wavelet transform based on five EEG frequency subbands, and 4 different Poincare plot-based non-linear parameters are extracted from each EEG channel. A total of 1,364 Motor Imagery EEG features are supplied from 22 channel EEG signals for each input EEG data. In the statistical significance-based feature selection process, the best one among all possible combinations of these features is tried to be determined using the independent t-test and one-way analysis of variance (ANOVA) test on binary and multi-class Motor Imagery EEG signal classifications, respectively. The whole extracted feature set and the feature set that contain statistically significant features only are classified in this study. We implemented 6 and 7 different classifiers in multi-class and binary (two-class) classification tasks, respectively. The classification process is evaluated using the five-fold cross-validation method, and each classification algorithm is tested 10 times. These repeated tests provide to check the repeatability of the results. The maximum of 61.86 and 47.36% for the two-class and four-class scenarios, respectively, are obtained with Ensemble Subspace Discriminant among all these classifiers using selected features including only statistically significant features. The results reveal that the introduced statistical significance-based feature selection approach improves the classifier performances by achieving higher classifier performances with fewer relevant components in Motor Imagery task classification. In conclusion, the main contribution of the presented study is two-fold evaluation of non-linear parameters as an alternative to the commonly used features and the prediction of multiple Motor Imagery tasks using statistically significant features.

Recognize enhanced temporal-spatial-spectral features with a parallel multi-branch CNN and GRU

Deep learning has been applied to the recognition of motor imagery electroencephalograms (MI-EEG) in brain-computer interface, and the performance results depend on data representation as well as neural network structure. Especially, MI-EEG is so complex with the characteristics of non-stationarity, specific rhythms, and uneven distribution; however, its multidimensional feature information is difficult to be fused and enhanced simultaneously in the existing recognition methods. In this paper, a novel channel importance (NCI) based on time-frequency analysis is proposed to develop an image sequence generation method (NCI-ISG) for enhancing the integrity of data representation and highlighting the contribution inequalities of different channels as well. Each electrode of MI-EEG is converted to a time-frequency spectrum by utilizing short-time Fourier transform; the corresponding part to 8-30 Hz is combined with random forest algorithm for computing NCI; and it is further divided into three sub-images covered by α (8-13 Hz), β₁ (13-21 Hz), and β₂ (21-30 Hz) bands; their spectral powers are further weighted by NCI and interpolated to 2-dimensional electrode coordinates, producing three main sub-band image sequences. Then, a parallel multi-branch convolutional neural network and gate recurrent unit (PMBCG) is designed to successively extract and identify the spatial-spectral and temporal features from the image sequences. Two public four-class MI-EEG datasets are adopted; the proposed classification method respectively achieves the average accuracies of 98.26% and 80.62% by 10-fold cross-validation experiment; and its statistical performance is also evaluated by multi-indexes, such as Kappa value, confusion matrix, and ROC curve. Extensive experiment results show that NCI-ISG + PMBCG can yield great performance on MI-EEG classification compared to state-of-the-art methods. The proposed NCI-ISG can enhance the feature representation of time-frequency-space domains and match well with PMBCG, which improves the recognition accuracies of MI tasks and demonstrates the preferable reliability and distinguishable ability. This paper proposes a novel channel importance (NCI) based on time-frequency analysis to develop an image sequences generation method (NCI-ISG) for enhancing the integrity of data representation and highlighting the contribution inequalities of different channels as well. Then, a parallel multi-branch convolutional neural network and gate recurrent unit (PMBCG) is designed to successively extract and identify the spatial-spectral and temporal features from the image sequences.

Brain-Computer Interface Based on Steady-State Visual Evoked Potential Using Quick-Response Code Pattern for Wheelchair Control

Brain-computer interfaces (BCIs) are widely utilized in control applications for people with severe physical disabilities. Several researchers have aimed to develop practical brain-controlled wheelchairs. An existing electroencephalogram (EEG)-based BCI based on steady-state visually evoked potential (SSVEP) was developed for device control. This study utilized a quick-response (QR) code visual stimulus pattern for a robust existing system. Four commands were generated using the proposed visual stimulation pattern with four flickering frequencies. Moreover, we employed a relative power spectrum density (PSD) method for the SSVEP feature extraction and compared it with an absolute PSD method. We designed experiments to verify the efficiency of the proposed system. The results revealed that the proposed SSVEP method and algorithm yielded an average classification accuracy of approximately 92% in real-time processing. For the wheelchair simulated via independent-based control, the proposed BCI control required approximately five-fold more time than the keyboard control for real-time control. The proposed SSVEP method using a QR code pattern can be used for BCI-based wheelchair control. However, it suffers from visual fatigue owing to long-time continuous control. We will verify and enhance the proposed system for wheelchair control in people with severe physical disabilities.

Status of deep learning for EEG-based brain-computer interface applications

In the previous decade, breakthroughs in the central nervous system bioinformatics and computational innovation have prompted significant developments in brain-computer interface (BCI), elevating it to the forefront of applied science and research. BCI revitalization enables neurorehabilitation strategies for physically disabled patients (e.g., disabled patients and hemiplegia) and patients with brain injury (e.g., patients with stroke). Different methods have been developed for electroencephalogram (EEG)-based BCI applications. Due to the lack of a large set of EEG data, methods using matrix factorization and machine learning were the most popular. However, things have changed recently because a number of large, high-quality EEG datasets are now being made public and used in deep learning-based BCI applications. On the other hand, deep learning is demonstrating great prospects for solving complex relevant tasks such as motor imagery classification, epileptic seizure detection, and driver attention recognition using EEG data. Researchers are doing a lot of work on deep learning-based approaches in the BCI field right now. Moreover, there is a great demand for a study that emphasizes only deep learning models for EEG-based BCI applications. Therefore, we introduce this study to the recent proposed deep learning-based approaches in BCI using EEG data (from 2017 to 2022). The main differences, such as merits, drawbacks, and applications are introduced. Furthermore, we point out current challenges and the directions for future studies. We argue that this review study will help the EEG research community in their future research.

MI-DABAN: A dual-attention-based adversarial network for motor imagery classification

The brain-computer interface (BCI) based on motor imagery electroencephalography (EEG) is widely used because of its convenience and safety. However, due to the distributional disparity between EEG signals, data from other subjects cannot be used directly to train a subject-specific classifier. For efficient use of the labeled data, domain transfer learning and adversarial learning are gradually applied to BCI classification tasks. While these methods improve classification performance, they only align globally and ignore task-specific class boundaries, which may lead to the blurring of features near the classification boundaries. Simultaneously, they employ fully shared generators to extract features, resulting in the loss of domain-specific information and the destruction of performance. To address these issues, we propose a novel dual-attention-based adversarial network for motor imagery classification (MI-DABAN). Our framework leverages multiple subjects' knowledge to improve a single subject's motor imagery classification performance by cleverly using a novel adversarial learning method and two unshared attention blocks. Specifically, without introducing additional domain discriminators, we iteratively maximize and minimize the output difference between the two classifiers to implement adversarial learning to ensure accurate domain alignment. Among them, maximization is used to identify easily confused samples near the decision boundary, and minimization is used to align the source and target domain distributions. Moreover, for the shallow features from source and target domains, we use two non-shared attention blocks to preserve domain-specific information, which can prevent the negative transfer of domain information and further improve the classification performance on test data. We conduct extensive experiments on two publicly available EEG datasets, namely BCI Competition IV Datasets 2a and 2b. The experiment results demonstrate our method's effectiveness and superiority.

An Effective Deep Learning Model for Health Monitoring and Detection of COVID-19 Infected Patients: An End-to-End Solution

The COVID-19 infection is the greatest danger to humankind right now because of the devastation it causes to the lives of its victims. It is important that infected people be tested in a timely manner in order to halt the spread of the disease. Physical approaches are time-consuming, expensive, and tedious. As a result, there is a pressing need for a cost-effective and efficient automated tool. A convolutional neural network is presented in this paper for analysing X-ray pictures of patients' chests. For the analysis of COVID-19 infections, this study investigates the most suitable pretrained deep learning models, which can be integrated with mobile or online apps and support the mobility of diagnostic instruments in the form of a portable tool. Patients can use the smartphone app to find the nearest healthcare testing facility, book an appointment, and get instantaneous results, while healthcare professionals can keep track of the details thanks to the web and mobile applications built for this study. Medical practitioners can apply the COVID-19 detection model for chest frontal X-ray pictures with ease. A user-friendly interface is created to make our end-to-end solution paradigm work. Based on the data, it appears that the model could be useful in the real world.

Detection of Adulteration in Food Using Recurrent Neural Network with Internet of Things

Food is an essential need for human survival. Throughout history, food has been recognised as a crucial need for people in order to maintain good health as well as to treat illness. As with all living things, it is one of the most basic necessities that man has as well as those of all other living creatures. In a recent publication, it was said that an extremely affordable, robust, and biocompatible impedance sensor that serves as a fractional-order element has been created and may be used to distinguish milk and tainted milk. A complete study on milk adulteration includes more than 160 academic articles on the topic. A comprehensive study on milk adulteration is available online. Specifically, the goal of this research is to discover various types of milk adulterants, different approaches for detecting each kind of adulterant, as well as the health hazards associated with milk product adulteration. In the proposed project, the fractional-order element would be investigated for its potential use in the detection of milk adulteration. With this fractional-order element-based impedance sensor, you can distinguish between different types of contaminated milk and different types of faking it, which is quite useful in the detection and differentiation of fake and real milk. According to the researchers, they have created a low-cost, user-friendly instrumentation system for detecting milk adulteration. They hope to commercialise it soon. An automated sensing system for the detection of synthetic milk, based on a microcontroller, has been created in order to reduce the reliance on specialised labour and to improve efficiency. In order to model the sensor, the dipole layer capacitance at the interface of the impedance sensor immersed in milk and the contaminated milk must be taken into account throughout the modelling process. In this study, an electrical equivalent circuit is built, and the correctness of the circuit is shown by both theoretical and experimental investigation. The detection of milk adulteration is classified with the use of Recurrent Neural Networks, and the status is updated in the cloud server with the help of the Internet of Things and Recurrent Neural Networks. It is estimated that the proposed work will have an accuracy rate of 92.31 percent, a sensitivity rate of 75.23 percent, and a specificity rate of 90.12 percent, all of which are higher than the present rate.

An Efficient Hybrid Model for Patient-Independent Seizure Prediction Using Deep Learning

Recently, many researchers have deployed different deep learning techniques to predict epileptic seizure, using electroencephalogram signals. However, most of this research requires very large amounts of memory and complicated feature extraction algorithms. In addition, they could not precisely examine EEG signal characteristics, which led to poor prediction performance. In this research, a non-patient-specific epileptic seizure prediction approach is proposed. The proposed model integrates Wavelet-based EEG signal processing with deep learning architectures for efficient prediction of pre-ictal and inter-ictal signals. The proposed system uses different models of one-dimensional convolutional neural networks to discriminate between inter-ictal signal and pre-ictal signals in order to enhance prediction performance. Experiments have been carried out on a benchmark dataset to validate the robustness of the proposed model. The experimental results showed that the proposed approach achieved 93.4% for 16 patients and 97.87% for 6 patients. Experiments showed that the proposed model can predict epileptic seizures effectively, which can have remarkable potential in clinical applications.

The Ensemble Machine Learning-Based Classification of Motor Imagery Tasks in Brain-Computer Interface

The Brain-Computer Interface (BCI) permits persons with impairments to interact with the real world without using the neuromuscular pathways. BCIs are based on artificial intelligence piloted systems. They collect brain activity patterns linked to the mental process and transform them into commands for actuators. The potential application of BCI systems is in the rehabilitation centres. In this context, a novel method is devised for automated identification of the Motor Imagery (MI) tasks. The contribution is an effective hybridization of the Multiscale Principal Component Analysis (MSPCA), Wavelet Packet Decomposition (WPD), statistical features extraction from subbands, and ensemble learning-based classifiers for categorization of the MI tasks. The intended electroencephalogram (EEG) signals are segmented and denoised. The denoising is achieved with a Daubechies algorithm-based wavelet transform (WT) incorporated in the MSPCA. The WT with the 5th level of decomposition is used. Onward, the Wavelet Packet Decomposition (WPD), with the 4th level of decomposition, is used for subbands formation. The statistical features are selected from each subband, namely, mean absolute value, average power, standard deviation, skewness, and kurtosis. Also, ratios of absolute mean values of adjacent subbands are computed and concatenated with other extracted features. Finally, the ensemble machine learning approach is used for the classification of MI tasks. The usefulness is evaluated by using the BCI competition III, MI dataset IVa. Results revealed that the suggested ensemble learning approach yields the highest classification accuracies of 98.69% and 94.83%, respectively, for the cases of subject-dependent and subject-independent problems.