Two-dimensional CNN-based distinction of human emotions from EEG channels selected by multi-objective evolutionary algorithm

Selecting EEG channels and features using multi-objective optimization for accurate MCI detection: validation using leave-one-subject-out strategy

Effective management of dementia requires the timely detection of mild cognitive impairment (MCI). This paper introduces a multi-objective optimization approach for selecting EEG channels (and features) for the purpose of detecting MCI. Firstly, each EEG signal from each channel is decomposed into subbands using either variational mode decomposition (VMD) or discrete wavelet transform (DWT). A feature is then extracted from each subband using one of the following measures: standard deviation, interquartile range, band power, Teager energy, Katz's and Higuchi's fractal dimensions, Shannon entropy, sure entropy, or threshold entropy. Different machine learning techniques are used to classify the features of MCI cases from those of healthy controls. The classifier's performance is validated using leave-one-subject-out (LOSO) cross-validation (CV). The non-dominated sorting genetic algorithm (NSGA)-II is designed with the aim of minimizing the number of EEG channels (or features) and maximizing classification accuracy. The performance is evaluated using a publicly available online dataset containing EEGs from 19 channels recorded from 24 participants. The results demonstrate a significant improvement in performance when utilizing the NSGA-II algorithm. By selecting only a few appropriate EEG channels, the LOSO CV-based results show a significant improvement compared to using all 19 channels. Additionally, the outcomes indicate that accuracy can be further improved by selecting suitable features from different channels. For instance, by combining VMD and Teager energy, the SVM accuracy obtained using all channels is 74.24%. Interestingly, when only five channels are selected using NSGA-II, the accuracy increases to 91.56%. The accuracy is further improved to 95.28% when using only 8 features selected from 7 channels. This demonstrates that by choosing informative features or channels while excluding noisy or irrelevant information, the impact of noise is reduced, resulting in improved accuracy. These promising findings indicate that, with a limited number of channels and features, accurate diagnosis of MCI is achievable, which opens the door for its application in clinical practice.

EEG source imaging of hand movement-related areas: an evaluation of the reconstruction and classification accuracy with optimized channels

The hand motor activity can be identified and converted into commands for controlling machines through a brain-computer interface (BCI) system. Electroencephalography (EEG) based BCI systems employ electrodes to measure the electrical brain activity projected at the scalp and discern patterns. However, the volume conduction problem attenuates the electric potential from the brain to the scalp and introduces spatial mixing to the signals. EEG source imaging (ESI) techniques can be applied to alleviate these issues and enhance the spatial segregation of information. Despite this potential solution, the use of ESI has not been extensively applied in BCI systems, largely due to accuracy concerns over reconstruction accuracy when using low-density EEG (ldEEG), which is commonly used in BCIs. To overcome these accuracy issues in low channel counts, recent studies have proposed reducing the number of EEG channels based on optimized channel selection. This work presents an evaluation of the spatial and temporal accuracy of ESI when applying optimized channel selection towards ldEEG number of channels. For this, a simulation study of source activity related to hand movement has been performed using as a starting point an EEG system with 339 channels. The results obtained after optimization show that the activity in the concerned areas can be retrieved with a spatial accuracy of 3.99, 10.69, and 14.29 mm (localization error) when using 32, 16, and 8 channel counts respectively. In addition, the use of optimally selected electrodes has been validated in a motor imagery classification task, obtaining a higher classification performance when using 16 optimally selected channels than 32 typical electrode distributions under 10-10 system, and obtaining higher classification performance when combining ESI methods with the optimal selected channels.

Neuro-Evolutionary Framework for Design Optimization of Two-Phase Transducer with Genetic Algorithms

Multilayer piezocomposite transducers are widely used in many applications where broad bandwidth is required for tracking and detection purposes. However, it is difficult to operate these multilayer transducers efficiently under frequencies of 100 kHz. Therefore, this work presents the modeling and optimization of a five-layer piezocomposite transducer with ten variables of nonuniform layer thicknesses and different volume fractions by exploiting the strength of the genetic algorithm (GA) with a one-dimensional model (ODM). The ODM executes matrix manipulation by resolving wave equations and produces mechanical output in the form of pressure and electrical impedance. The product of gain and bandwidth is the required function to be maximized in this multi-objective and multivariate optimization problem, which is a challenging task having ten variables. Converting it into the minimization problem, the reciprocal of the gain-bandwidth product is considered. The total thickness is adjusted to keep the central frequency at approximately 50-60 kHz. Piezocomposite transducers with three active materials, PZT5h, PZT4d, PMN-PT, and CY1301 polymer, as passive materials were designed, simulated, and statistically evaluated. The results show significant improvement in gain bandwidth compared to previous existing techniques.

Improved EEG-based emotion recognition through information enhancement in connectivity feature map

Electroencephalography (EEG), despite its inherited complexity, is a preferable brain signal for automatic human emotion recognition (ER), which is a challenging machine learning task with emerging applications. In any automatic ER, machine learning (ML) models classify emotions using the extracted features from the EEG signals, and therefore, such feature extraction is a crucial part of ER process. Recently, EEG channel connectivity features have been widely used in ER, where Pearson correlation coefficient (PCC), mutual information (MI), phase-locking value (PLV), and transfer entropy (TE) are well-known methods for connectivity feature map (CFM) construction. CFMs are typically formed in a two-dimensional configuration using the signals from two EEG channels, and such two-dimensional CFMs are usually symmetric and hold redundant information. This study proposes the construction of a more informative CFM that can lead to better ER. Specifically, the proposed innovative technique intelligently combines CFMs' measures of two different individual methods, and its outcomes are more informative as a fused CFM. Such CFM fusion does not incur additional computational costs in training the ML model. In this study, fused CFMs are constructed by combining every pair of methods from PCC, PLV, MI, and TE; and the resulting fused CFMs PCC + PLV, PCC + MI, PCC + TE, PLV + MI, PLV + TE, and MI + TE are used to classify emotion by convolutional neural network. Rigorous experiments on the DEAP benchmark EEG dataset show that the proposed CFMs deliver better ER performances than CFM with a single connectivity method (e.g., PCC). At a glance, PLV + MI-based ER is shown to be the most promising one as it outperforms the other methods.

Decoding Emotions From EEG Responses Elicited by Videos Using Machine Learning Techniques on Two Datasets

In recent times, we have seen extensive research in the field of EEG-based emotion identification. The majority of solutions suggested by current literature use sophisticated deep learning techniques for the identification of human emotions. These models are very complex and need huge resources to implement. Hence, in this work, a method for human emotion recognition is proposed which is based on much simpler architecture. For that, two publicly available datasets SEED and DEAP are used to perform experiments. First, the EEG signals of the two datasets are segmented into epochs of 1second duration. The epochs are also decomposed into different brain rhythms. The features computation is performed in two different ways, one is directly from the epochs and the other way is from the brain rhythms obtained after the decomposition of the epochs. Several features and their combination are examined with different classifiers. For the DEAP dataset baseline features are also utilised. It is observed that the support vector machine (SVM) has shown the best performance for the DEAP dataset when baseline feature correction and epoch decomposition are implemented together. The best achieved average accuracy is 96.50% and 96.71% for high versus low valence classes and high versus low arousal classes, respectively. For the SEED dataset, the best average accuracy of 86.89% is achieved using the multilayer perceptron (MLP) with 2 hidden layers.Clinical relevance- This work can be further explored to develop an automated mental health monitor which can assist doctors in their primary screening.

Motor Imagery Multi-Tasks Classification for BCIs Using the NVIDIA Jetson TX2 Board and the EEGNet Network

Nowadays, Brain-Computer Interfaces (BCIs) still captivate large interest because of multiple advantages offered in numerous domains, explicitly assisting people with motor disabilities in communicating with the surrounding environment. However, challenges of portability, instantaneous processing time, and accurate data processing remain for numerous BCI system setups. This work implements an embedded multi-tasks classifier based on motor imagery using the EEGNet network integrated into the NVIDIA Jetson TX2 card. Therefore, two strategies are developed to select the most discriminant channels. The former uses the accuracy based-classifier criterion, while the latter evaluates electrode mutual information to form discriminant channel subsets. Next, the EEGNet network is implemented to classify discriminant channel signals. Additionally, a cyclic learning algorithm is implemented at the software level to accelerate the model learning convergence and fully profit from the NJT2 hardware resources. Finally, motor imagery Electroencephalogram (EEG) signals provided by HaLT's public benchmark were used, in addition to the k-fold cross-validation method. Average accuracies of 83.7% and 81.3% were achieved by classifying EEG signals per subject and motor imagery task, respectively. Each task was processed with an average latency of 48.7 ms. This framework offers an alternative for online EEG-BCI systems' requirements, dealing with short processing times and reliable classification accuracy.

Visual Affective Stimulus Database: A Validated Set of Short Videos

Two hundred and ninety-nine videos representing four categories (people, animals, objects, and scenes) were standardized using Adobe Premiere Pro CC 2018, with a unified duration of 3 s, a resolution of 1080 pixels/inch, and a size of 1920 × 1080 mm². One-hundred and sixteen participants (mean age 22.60 ± 2.06 years; 51 males) assessed the videos by scoring, on a self-reported 9-point scale, three dimensions of emotion: valence, arousal, and dominance. The content was attributed a specific valence (positive, neutral, or negative) if more than 60% of the participants identified it with an emotion category. Results: In total, 242 short videos, including 112 positive videos, 47 neutral videos, and 83 negative videos, were retained in the video stimuli database. In the three-dimensional degree of emotion, the distribution relationship between them conformed to the fundamental characteristics of emotion. The internal consistency reliability coefficient for valence, arousal, and dominance was 0.968, 0.984, and 0.970. The internal consistency reliability of the emotional dimensions for people and faces, animals, objects, and scenes ranged between 0.799 and 0.968. Conclusions: The emotion short-video system contains multi-scene dynamic stimuli with good reliability and scoring distribution and is applicable in emotion and emotion-related research.