EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks across Subjects

A novel convolution bi-directional gated recurrent unit neural network for emotion recognition in multichannel electroencephalogram signals

BACKGROUND

Recognising emotions in humans is a great challenge in the present era and has several applications under affective computing. Deep learning (DL) found a success tool for predict for emotions in different modalities.

OBJECTIVE

To predict 3D emotions with high accuracy in multichannel physiological signals, i.e. electroencephalogram (EEG).

METHODS

A hybrid DL model consist of CNN and GRU is proposed in this work for emotion recognition in EEG recordings. A convolution neural network (CNN) has the capability of learning abstract representation, whereas gated recurrent units (GRU) have the capability of exploring temporal correlation. A bi-directional variation of GRU is used here to learn features in both directions. Discrete and dimensional emotion indices are recognised in two publicly available datasets namely SEED and DREAMER, respectively. A fused feature of energy and Shannon entropy (𝐸𝑛𝑆𝐸→) and energy and differential entropy (𝐸𝑛𝐷𝐸→) features are fed to the proposed classifier to improve the efficiency of the model.

RESULTS

The performance of the presented model is measured in terms of average accuracy, which is obtained as 86.9% and 93.9% for SEED and DREAMER datasets, respectively.

CONCLUSION

The proposed convolution bi-directional gated recurrent unit neural network (CNN-BiGRU) model outperforms most of the state-of-the-art and competitive hybrid DL models, which indicates the effectiveness of emotion recognition using EEG signals and provides a scientific base for the implementation of human-computer interaction (HCI).

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals

As a major daily task for the popularization of artificial intelligence technology, more and more attention has been paid to the scientific research of mental state electroencephalogram (EEG) in recent years. To retain the spatial information of EEG signals and fully mine the EEG timing-related information, this paper proposes a novel EEG emotion recognition method. First, to obtain the frequency, spatial, and temporal information of multichannel EEG signals more comprehensively, we choose the multidimensional feature structure as the input of the artificial neural network. Then, a neural network model based on depthwise separable convolution is proposed, extracting the input structure's frequency and spatial features. The network can effectively reduce the computational parameters. Finally, we modeled using the ordered neuronal long short-term memory (ON-LSTM) network, which can automatically learn hierarchical information to extract deep emotional features hidden in EEG time series. The experimental results show that the proposed model can reasonably learn the correlation and temporal dimension information content between EEG multi-channel and improve emotion classification performance. We performed the experimental validation of this paper in two publicly available EEG emotional datasets. In the experiments on the DEAP dataset (a dataset for emotion analysis using EEG, physiological, and video signals), the mean accuracy of emotion recognition for arousal and valence is 95.02% and 94.61%, respectively. In the experiments on the SEED dataset (a dataset collection for various purposes using EEG signals), the average accuracy of emotion recognition is 95.49%.

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

Recently, emotional electroencephalography (EEG) has been of great importance in brain-computer interfaces, and it is more urgent to realize automatic emotion recognition. The EEG signal has the disadvantages of being non-smooth, non-linear, stochastic, and susceptible to background noise. Additionally, EEG signal processing network models have the disadvantages of a large number of parameters and long training time. To address the above issues, a novel model is presented in this paper. Initially, a deep sparse autoencoder network (DSAE) was used to remove redundant information from the EEG signal and reconstruct its underlying features. Further, combining a convolutional neural network (CNN) with long short-term memory (LSTM) can extract relevant features from task-related features, mine the correlation between the 32 channels of the EEG signal, and integrate contextual information from these frames. The proposed DSAE + CNN + LSTM (DCRNN) model was experimented with on the public dataset DEAP. The classification accuracies of valence and arousal reached 76.70% and 81.43%, respectively. Meanwhile, we conducted experiments with other comparative methods to further demonstrate the effectiveness of the DCRNN method.