Fusion of Motif- and Spectrum-Related Features for Improved EEG-Based Emotion Recognition

Diagnostic efficacy of complexity metrics from cardiac MRI myocardial segmental motion curves in detecting late gadolinium enhancement in myocardial infarction patients

Background

Myocardial segmental motion is associated with cardiovascular pathology, often assessed through myocardial strain features. The stability of the motion can be influenced by myocardial fibrosis. This research aimed to explore the complexity metrics (CM) of myocardial segmental motion curves, observe their correlation with late gadolinium enhancement (LGE) transmural extension (TE), and assess diagnostic efficacy combined with segmental strains in different TE segments.

Methods

We included 42 myocardial infarction patients, dividing images into 672 myocardial segments (208 remote, 384 viable, and 80 unviable segments based on TE). Radial and circumferential segmental strain, along with CM for motion curves, were extracted. Correlation between CM and LGE, as well as the potential distinguishing role of CM, was evaluated using Pearson correlation, univariate linear regression (F-test), multivariate regression analysis (T-test), area under curve (AUC), machine learning models, and DeLong test.

Results

All CMs showed significant linear correlation with TE (P < 0.001). Six CMs were correlated with TE (r > 0.3), with radial frequency drift (FD) displayed the strongest correlation (r = 0.496, P < 0.001). Radial and circumferential FD significantly differed in higher TE myocardium than in remote segments (P < 0.05). Radial FD had practical diagnostic efficacy (remote vs. unviable AUC = 0.89, viable vs. unviable AUC = 0.77, remote vs. viable AUC = 0.65). Combining CM with segmental strain features boosted diagnostic efficacy than models using only segmental strain features (DeLong test, P < 0.05).

Conclusions

The CM of myocardial motion curves has been associated with LGE infarction, and combining CM with strain features improves the diagnosis of different myocardial LGE infarction degrees.

Emotion recognition of EEG signals based on variational mode decomposition and weighted cascade forest

Emotion recognition is of a great significance in intelligent medical treatment and intelligent transportation. With the development of human-computer interaction technology, emotion recognition based on Electroencephalogram (EEG) signals has been widely concerned by scholars. In this study, an EEG emotion recognition framework is proposed. Firstly, variational mode decomposition (VMD) is used to decompose the nonlinear and non-stationary EEG signals to obtain intrinsic mode functions (IMFs) at different frequencies. Then sliding window tactic is used to extract the characteristics of EEG signals under different frequency. Aiming at the issue of feature redundancy, a new variable selection method is proposed to improve the adaptive elastic net (AEN) by the minimum common redundancy maximum relevance criterion. Weighted cascade forest (CF) classifier is constructed for emotion recognition. The experimental results on the public dataset DEAP show that the valence classification accuracy of the proposed method reaches 80.94%, and the classification accuracy of arousal is 74.77%. Compared with some existing methods, it effectively improves the accuracy of EEG emotion recognition.

Entropy and the Emotional Brain: Overview of a Research Field

During the last years, there has been a notable increase in the number of studies focused on the assessment of brain dynamics for the recognition of emotional states by means of nonlinear methodologies. More precisely, different entropy metrics have been applied for the analysis of electroencephalographic recordings for the detection of emotions. In this sense, regularity-based entropy metrics, symbolic predictability-based entropy indices, and different multiscale and multilag variants of the aforementioned methods have been successfully tested in a series of studies for emotion recognition from the EEG recording. This chapter aims to unify all those contributions to this scientific area, summarizing the main discoverings recently achieved in this research field.

Semi-supervised EEG Emotion Recognition Model Based on Enhanced Graph Fusion and GCN

OBJECTIVE

To take full advantage of both labeled data and unlabeled ones, the Graph Convolutional Network (GCN) was introduced in electroencephalography (EEG) based emotion recognition to achieve feature propagation. However, a single feature cannot represent the emotional state entirely and precisely due to the instability of the EEG signal and the complexity of the emotional state. In addition, the noise existing in the graph may affect the performance greatly. To solve these problems, it was necessary to introduce feature/similarity fusion and noise reduction strategies.

APPROACH

A semi-supervised EEG emotion recognition model combining graph fusion, network enhancement, and feature fusion was proposed. Firstly, different features were extracted from EEG and then compacted by Principal Component Analysis (PCA), respectively. Secondly, a Sample-by-sample Similarity Matrix (SSM) was constructed based on each feature, and Similarity Network Fusion (SNF) was adopted to fuse the graphs corresponding to different SSMs to take advantage of their complementarity. Then, Network Enhancement (NE) was performed on the fused graph to reduce the noise in it. Finally, GCN was performed on the concatenated features and the enhanced fused graph to achieve feature propagation.

MAIN RESULTS

Experimental results demonstrated that: i) When 5.30% of SEED and 7.20% of SEED-IV samples were chosen as the labeled samples, respectively, the minimum classification accuracy improvement achieved by the proposed scheme over state-of-the-art schemes were 1.52% on SEED and 13.14% on SEED-IV, respectively. ii) When 8.00% of SEED and 9.60% of SEED-IV samples were chosen as the labeled samples, respectively, the minimum training time reduction achieved by the proposed scheme over state-of-the-art schemes were 46.75s and 22.55s, respectively. iii) Graph fusion, network enhancement, and feature fusion all contributed to the performance enhancement. iv) The key hyperparameters that affect the performance were relatively few and easy to set to obtain outstanding performance.

SIGNIFICANCE

This paper demonstrated that the combination of graph fusion, network enhancement, and feature fusion help to enhance GCN-based EEG emotion recognition.

Emotion Recognition Based on Dynamic Energy Features Using a Bi-LSTM Network

Among electroencephalogram (EEG) signal emotion recognition methods based on deep learning, most methods have difficulty in using a high-quality model due to the low resolution and the small sample size of EEG images. To solve this problem, this study proposes a deep network model based on dynamic energy features. In this method, first, to reduce the noise superposition caused by feature analysis and extraction, the concept of an energy sequence is proposed. Second, to obtain the feature set reflecting the time persistence and multicomponent complexity of EEG signals, the construction method of the dynamic energy feature set is given. Finally, to make the network model suitable for small datasets, we used fully connected layers and bidirectional long short-term memory (Bi-LSTM) networks. To verify the effectiveness of the proposed method, we used leave one subject out (LOSO) and 10-fold cross validation (CV) strategies to carry out experiments on the SEED and DEAP datasets. The experimental results show that the accuracy of the proposed method can reach 89.42% (SEED) and 77.34% (DEAP).

AI inspired EEG-based spatial feature selection method using multivariate empirical mode decomposition for emotion classification

Classification of human emotions based on electroencephalography (EEG) is a very popular topic nowadays in the provision of human health care and well-being. Fast and effective emotion recognition can play an important role in understanding a patient's emotions and in monitoring stress levels in real-time. Due to the noisy and non-linear nature of the EEG signal, it is still difficult to understand emotions and can generate large feature vectors. In this article, we have proposed an efficient spatial feature extraction and feature selection method with a short processing time. The raw EEG signal is first divided into a smaller set of eigenmode functions called (IMF) using the empirical model-based decomposition proposed in our work, known as intensive multivariate empirical mode decomposition (iMEMD). The Spatio-temporal analysis is performed with Complex Continuous Wavelet Transform (CCWT) to collect all the information in the time and frequency domains. The multiple model extraction method uses three deep neural networks (DNNs) to extract features and dissect them together to have a combined feature vector. To overcome the computational curse, we propose a method of differential entropy and mutual information, which further reduces feature size by selecting high-quality features and pooling the k-means results to produce less dimensional qualitative feature vectors. The system seems complex, but once the network is trained with this model, real-time application testing and validation with good classification performance is fast. The proposed method for selecting attributes for benchmarking is validated with two publicly available data sets, SEED, and DEAP. This method is less expensive to calculate than more modern sentiment recognition methods, provides real-time sentiment analysis, and offers good classification accuracy.

An Innovative Multi-Model Neural Network Approach for Feature Selection in Emotion Recognition Using Deep Feature Clustering

Emotional awareness perception is a largely growing field that allows for more natural interactions between people and machines. Electroencephalography (EEG) has emerged as a convenient way to measure and track a user’s emotional state. The non-linear characteristic of the EEG signal produces a high-dimensional feature vector resulting in high computational cost. In this paper, characteristics of multiple neural networks are combined using Deep Feature Clustering (DFC) to select high-quality attributes as opposed to traditional feature selection methods. The DFC method shortens the training time on the network by omitting unusable attributes. First, Empirical Mode Decomposition (EMD) is applied as a series of frequencies to decompose the raw EEG signal. The spatiotemporal component of the decomposed EEG signal is expressed as a two-dimensional spectrogram before the feature extraction process using Analytic Wavelet Transform (AWT). Four pre-trained Deep Neural Networks (DNN) are used to extract deep features. Dimensional reduction and feature selection are achieved utilising the differential entropy-based EEG channel selection and the DFC technique, which calculates a range of vocabularies using k-means clustering. The histogram characteristic is then determined from a series of visual vocabulary items. The classification performance of the SEED, DEAP and MAHNOB datasets combined with the capabilities of DFC show that the proposed method improves the performance of emotion recognition in short processing time and is more competitive than the latest emotion recognition methods.

Proposing a convolutional neural network for stress assessment by means of derived heart rate from functional near infrared spectroscopy

BACKGROUND

Stress is known as one of the major factors threatening human health. A large number of studies have been performed in order to either assess or relieve stress by analyzing the brain and heart-related signals.

METHOD

In this study, a method based on the Convolutional Neural Network (CNN) approach is proposed to assess stress induced by the Montreal Imaging Stress Task. The proposed model is trained on the heart rate signal derived from functional Near-Infrared Spectroscopy (fNIRS), which is referred to as HRF. In this regard, fNIRS signals of 20 healthy volunteers were recorded using a configuration of 23 channels located on the prefrontal cortex. The proposed deep learning system consists of two main parts where in the first part, the one-dimensional convolutional neural network is employed to build informative activation maps, and then in the second part, a stack of deep fully connected layers is used to predict the stress existence probability. Thereafter, the employed CNN method is compared with the Dense Neural Network, Support Vector Machine, and Random Forest regarding various classification metrics.

RESULTS

Results clearly showed the superiority of CNN over all other methods. Additionally, the trained HRF model significantly outperforms the model trained on the filtered fNIRS signals, where the HRF model could achieve 98.69 ± 0.45% accuracy, which is 10.09% greater than the accuracy obtained by the fNIRS model.

CONCLUSIONS

Employment of the proposed deep learning system trained on the HRF measurements leads to higher stress classification accuracy than the accuracy reported in the existing studies where the same experimental procedure has been done. Besides, the proposed method suggests better stability with lower variation in prediction. Furthermore, its low computational cost opens up the possibility to be applied in real-time monitoring of stress assessment.

Systematic Analysis of a Military Wearable Device Based on a Multi-Level Fusion Framework: Research Directions

With the development of the Internet of Battlefield Things (IoBT), soldiers have become key nodes of information collection and resource control on the battlefield. It has become a trend to develop wearable devices with diverse functions for the military. However, although densely deployed wearable sensors provide a platform for comprehensively monitoring the status of soldiers, wearable technology based on multi-source fusion lacks a generalized research system to highlight the advantages of heterogeneous sensor networks and information fusion. Therefore, this paper proposes a multi-level fusion framework (MLFF) based on Body Sensor Networks (BSNs) of soldiers, and describes a model of the deployment of heterogeneous sensor networks. The proposed framework covers multiple types of information at a single node, including behaviors, physiology, emotions, fatigue, environments, and locations, so as to enable Soldier-BSNs to obtain sufficient evidence, decision-making ability, and information resilience under resource constraints. In addition, we systematically discuss the problems and solutions of each unit according to the frame structure to identify research directions for the development of wearable devices for the military.