EEG emotion recognition using multichannel weighted multiscale permutation entropy

EEG Emotion Recognition Network Based on Attention and Spatiotemporal Convolution

Human emotions are complex psychological and physiological responses to external stimuli. Correctly identifying and providing feedback on emotions is an important goal in human-computer interaction research. Compared to facial expressions, speech, or other physiological signals, using electroencephalogram (EEG) signals for the task of emotion recognition has advantages in terms of authenticity, objectivity, and high reliability; thus, it is attracting increasing attention from researchers. However, the current methods have significant room for improvement in terms of the combination of information exchange between different brain regions and time-frequency feature extraction. Therefore, this paper proposes an EEG emotion recognition network, namely, self-organized graph pesudo-3D convolution (SOGPCN), based on attention and spatiotemporal convolution. Unlike previous methods that directly construct graph structures for brain channels, the proposed SOGPCN method considers that the spatial relationships between electrodes in each frequency band differ. First, a self-organizing map is constructed for each channel in each frequency band to obtain the 10 most relevant channels to the current channel, and graph convolution is employed to capture the spatial relationships between all channels in the self-organizing map constructed for each channel in each frequency band. Then, pseudo-three-dimensional convolution combined with partial dot product attention is implemented to extract the temporal features of the EEG sequence. Finally, LSTM is employed to learn the contextual information between adjacent time-series data. Subject-dependent and subject-independent experiments are conducted on the SEED dataset to evaluate the performance of the proposed SOGPCN method, which achieves recognition accuracies of 95.26% and 94.22%, respectively, indicating that the proposed method outperforms several baseline methods.

Predicting rock-paper-scissors choices based on single-trial EEG signals

Decision prediction based on neurophysiological signals is of great application value in many real-life situations, especially in human-AI collaboration or counteraction. Single-trial analysis of electroencephalogram (EEG) signals is a very valuable step in the development of an online decision-prediction system. However, previous EEG-based decision-prediction methods focused mainly on averaged EEG signals of all decision-making trials to predict an individual's general decision tendency (e.g., risk seeking or aversion) over a period rather than on a specific decision response in a single trial. In the present study, we used a rock-paper-scissors game, which is a common multichoice decision-making task, to explore how to predict participants' single-trial choice with EEG signals. Forty participants, comprising 20 females and 20 males, played the game with a computer player for 330 trials. Considering that the decision-making process of this game involves multiple brain regions and neural networks, we proposed a new algorithm named common spatial pattern-attractor metagene (CSP-AM) to extract CSP features from different frequency bands of EEG signals that occurred during decision making. The results showed that a multilayer perceptron classifier achieved an accuracy significantly exceeding the chance level among 88.57% (31 of 35) of participants, verifying the classification ability of CSP features in multichoice decision-making prediction. We believe that the CSP-AM algorithm could be used in the development of proactive AI systems.

A multi-head residual connection GCN for EEG emotion recognition

Electroencephalography (EEG) emotion recognition is a crucial aspect of human-computer interaction. However, conventional neural networks have limitations in extracting profound EEG emotional features. This paper introduces a novel multi-head residual graph convolutional neural network (MRGCN) model that incorporates complex brain networks and graph convolution networks. The decomposition of multi-band differential entropy (DE) features exposes the temporal intricacy of emotion-linked brain activity, and the combination of short and long-distance brain networks can explore complex topological characteristics. Moreover, the residual-based architecture not only enhances performance but also augments classification stability across subjects. The visualization of brain network connectivity offers a practical technique for investigating emotional regulation mechanisms. The MRGCN model exhibits average classification accuracies of 95.8% and 98.9% for the DEAP and SEED datasets, respectively, highlighting its excellent performance and robustness.

Dance emotion recognition based on linear predictive Meir frequency cepstrum coefficient and bidirectional long short-term memory from robot environment

Dance emotion recognition is an important research direction of automatic speech recognition, especially in the robot environment. It is an important research content of dance emotion recognition to extract the features that best represent speech emotion and to construct an acoustic model with strong robustness and generalization. The dance emotion data set is small in size and high in dimension. The traditional recurrent neural network (RNN) has the problem of long-range dependence disappearance, and due to the focus on local information of convolutional neural network (CNN), the mining of potential relationships between frames in the input sequence is insufficient. To solve the above problems, this paper proposes a novel linear predictive Meir frequency cepstrum coefficient and bidirectional long short-term memory (LSTM) for dance emotion recognition. In this paper, the linear prediction coefficient (LPC) and Meier frequency cepstrum coefficient (MFCC) are combined to obtain a new feature, namely the linear prediction Meier frequency cepstrum coefficient (LPMFCC). Then, the combined feature obtained by combining LPMFCC with energy feature is used as the extracted dance feature. The extracted features are input into the bidirectional LSTM network for training. Finally, support vector machine (SVM) is used to classify the obtained features through the full connection layer. Finally, we conduct experiments on public data sets and obtain the better effectiveness compared with the state-of-art dance motion recognition methods.

Fault Diagnosis Method Based on AUPLMD and RTSMWPE for a Reciprocating Compressor Valve

In order to effectively extract the key feature information hidden in the original vibration signal, this paper proposes a fault feature extraction method combining adaptive uniform phase local mean decomposition (AUPLMD) and refined time-shift multiscale weighted permutation entropy (RTSMWPE). The proposed method focuses on two aspects: solving the serious modal aliasing problem of local mean decomposition (LMD) and the dependence of permutation entropy on the length of the original time series. First, by adding a sine wave with a uniform phase as a masking signal, adaptively selecting the amplitude of the added sine wave, the optimal decomposition result is screened by the orthogonality and the signal is reconstructed based on the kurtosis value to remove the signal noise. Secondly, in the RTSMWPE method, the fault feature extraction is realized by considering the signal amplitude information and replacing the traditional coarse-grained multi-scale method with a time-shifted multi-scale method. Finally, the proposed method is applied to the analysis of the experimental data of the reciprocating compressor valve; the analysis results demonstrate the effectiveness of the proposed method.