1
|
Li J, Feng G, Ling C, Ren X, Liu X, Zhang S, Wang L, Chen Y, Zeng X, Chen R. A Resource-Efficient Multi-Entropy Fusion Method and Its Application for EEG-Based Emotion Recognition. ENTROPY (BASEL, SWITZERLAND) 2025; 27:96. [PMID: 39851716 DOI: 10.3390/e27010096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Revised: 12/26/2024] [Accepted: 01/19/2025] [Indexed: 01/26/2025]
Abstract
Emotion recognition is an advanced technology for understanding human behavior and psychological states, with extensive applications for mental health monitoring, human-computer interaction, and affective computing. Based on electroencephalography (EEG), the biomedical signals naturally generated by the brain, this work proposes a resource-efficient multi-entropy fusion method for classifying emotional states. First, Discrete Wavelet Transform (DWT) is applied to extract five brain rhythms, i.e., delta, theta, alpha, beta, and gamma, from EEG signals, followed by the acquisition of multi-entropy features, including Spectral Entropy (PSDE), Singular Spectrum Entropy (SSE), Sample Entropy (SE), Fuzzy Entropy (FE), Approximation Entropy (AE), and Permutation Entropy (PE). Then, such entropies are fused into a matrix to represent complex and dynamic characteristics of EEG, denoted as the Brain Rhythm Entropy Matrix (BREM). Next, Dynamic Time Warping (DTW), Mutual Information (MI), the Spearman Correlation Coefficient (SCC), and the Jaccard Similarity Coefficient (JSC) are applied to measure the similarity between the unknown testing BREM data and positive/negative emotional samples for classification. Experiments were conducted using the DEAP dataset, aiming to find a suitable scheme regarding similarity measures, time windows, and input numbers of channel data. The results reveal that DTW yields the best performance in similarity measures with a 5 s window. In addition, the single-channel input mode outperforms the single-region mode. The proposed method achieves 84.62% and 82.48% accuracy in arousal and valence classification tasks, respectively, indicating its effectiveness in reducing data dimensionality and computational complexity while maintaining an accuracy of over 80%. Such performances are remarkable when considering limited data resources as a concern, which opens possibilities for an innovative entropy fusion method that can help to design portable EEG-based emotion-aware devices for daily usage.
Collapse
Affiliation(s)
- Jiawen Li
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
- Hainan Provincial Key Laboratory of Sports and Health Promotion, Hainan Medical University, Haikou 571199, China
- Key Laboratory of Emergency and Trauma of Ministry of Education, The First Affiliated Hospital of Hainan Medical University, Haikou 571199, China
| | - Guanyuan Feng
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| | - Chen Ling
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| | - Ximing Ren
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| | - Xin Liu
- Department of Electrical and Computer Engineering, University of Macau, Macau 999078, China
| | - Shuang Zhang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610056, China
- School of Artificial Intelligence, Neijiang Normal University, Neijiang 641004, China
| | - Leijun Wang
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| | - Yanmei Chen
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| | - Xianxian Zeng
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
- Guangdong Provincial Key Laboratory of Big Data Computing, The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), Shenzhen 518172, China
- Guangdong Provincial Key Laboratory of Intellectual Property and Big Data, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| | - Rongjun Chen
- School of Computer Science, Guangdong Polytechnic Normal University, Guangzhou 510665, China
- Guangdong Provincial Key Laboratory of Intellectual Property and Big Data, Guangdong Polytechnic Normal University, Guangzhou 510665, China
| |
Collapse
|
2
|
Garcia-Moreno FM, Badenes-Sastre M, Expósito F, Rodriguez-Fortiz MJ, Bermudez-Edo M. EEG headbands vs caps: How many electrodes do I need to detect emotions? The case of the MUSE headband. Comput Biol Med 2025; 184:109463. [PMID: 39608032 DOI: 10.1016/j.compbiomed.2024.109463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 11/19/2024] [Accepted: 11/20/2024] [Indexed: 11/30/2024]
Abstract
BACKGROUND In the realm of emotion detection, comfort and portability play crucial roles in enhancing user experiences. However, few works study the reduction in the number of electrodes used to detect emotions, and none of them compare the location of these electrodes with a commercial low-cost headband. METHODS This work explores the potential of wearable EEG devices, specifically the Muse S headband, for emotion classification in terms of valence and arousal. We conducted a direct comparison between the Muse S, with its only four electrodes, and the DEAP dataset, which employs 32-electrode in a more intrusive headset. DEAP is a benchmark dataset constructed by emotions elicited by music. Our methodology focused on utilizing raw data and extracting four common frequency ranges. In particular, we select from DEAP the 4 electrodes that are similar to those in the Muse S. Additionally, we created a dataset using the Muse S, where we segmented the complete video into fixed-size temporal windows. Our 4-electrodes dataset uses film clips to elicit emotions, classified according to the Self-Assessment Manikin. RESULTS Our findings indicate that the Muse S, despite its limited electrode count, can effectively discriminate between high and low valence/arousal emotions with accuracy comparable to the accuracy obtained with all the DEAP electrodes. The Gamma band emerged as particularly effective for valence detection. Using a Muse device and raw data, the best performance achieved a G-Mean only 1-2% lower than that of the DEAP dataset, demonstrating that comparable results can be obtained with a simplified setup. CONCLUSIONS While the Muse-S did not reach DEAP in terms of outcomes, it proved to be a viable, lower-cost, less intrusive alternative, and adaptable for everyday use. The dataset created for this study is publicly available at https://doi.org/10.5281/zenodo.8431451.
Collapse
Affiliation(s)
- Francisco M Garcia-Moreno
- Department of Software Engineering, Computer Science School, University of Granada, Granada, Spain; Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, Granada, Spain.
| | | | | | - Maria Jose Rodriguez-Fortiz
- Department of Software Engineering, Computer Science School, University of Granada, Granada, Spain; Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, Granada, Spain
| | - Maria Bermudez-Edo
- Department of Software Engineering, Computer Science School, University of Granada, Granada, Spain; Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, Granada, Spain
| |
Collapse
|
3
|
Carretero A, Araujo A. Design Decisions for Wearable EEG to Detect Motor Imagery Movements. SENSORS (BASEL, SWITZERLAND) 2024; 24:4763. [PMID: 39123810 PMCID: PMC11314849 DOI: 10.3390/s24154763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 07/15/2024] [Accepted: 07/19/2024] [Indexed: 08/12/2024]
Abstract
The objective of this study was to make informed decisions regarding the design of wearable electroencephalography (wearable EEG) for the detection of motor imagery movements based on testing the critical features for the development of wearable EEG. Three datasets were utilized to determine the optimal acquisition frequency. The brain zones implicated in motor imagery movement were analyzed, with the aim of improving wearable-EEG comfort and portability. Two detection algorithms with different configurations were implemented. The detection output was classified using a tool with various classifiers. The results were categorized into three groups to discern differences between general hand movements and no movement; specific movements and no movement; and specific movements and other specific movements (between five different finger movements and no movement). Testing was conducted on the sampling frequencies, trials, number of electrodes, algorithms, and their parameters. The preferred algorithm was determined to be the FastICACorr algorithm with 20 components. The optimal sampling frequency is 1 kHz to avoid adding excessive noise and to ensure efficient handling. Twenty trials are deemed sufficient for training, and the number of electrodes will range from one to three, depending on the wearable EEG's ability to handle the algorithm parameters with good performance.
Collapse
Affiliation(s)
- Ana Carretero
- B105 Electronic Systems Lab, ETSI de Telecomunicación, Universidad Politécnica de Madrid, 28040 Madrid, Spain;
| | | |
Collapse
|
4
|
Zeydabadinezhad M, Jowers J, Buhl D, Cabaniss B, Mahmoudi B. A personalized earbud for non-invasive long-term EEG monitoring. J Neural Eng 2024; 21:026026. [PMID: 38479008 DOI: 10.1088/1741-2552/ad33af] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 03/13/2024] [Indexed: 04/05/2024]
Abstract
Objective. The primary objective of this study was to evaluate the reliability, comfort, and performance of a custom-fit, non-invasive long-term electrophysiologic headphone, known as Aware Hearable, for the ambulatory recording of brain activities. These recordings play a crucial role in diagnosing neurological disorders such as epilepsy and in studying neural dynamics during daily activities.Approach.The study uses commercial manufacturing processes common to the hearing aid industry, such as 3D scanning, computer-aided design modeling, and 3D printing. These processes enable the creation of the Aware Hearable with a personalized, custom-fit, thereby ensuring complete and consistent contact with the inner surfaces of the ear for high-quality data recordings. Additionally, the study employs a machine learning data analysis approach to validate the recordings produced by Aware Hearable, by comparing them to the gold standard intracranial electroencephalography recordings in epilepsy patients.Main results.The results indicate the potential of Aware Hearable to expedite the diagnosis of epilepsy by enabling extended periods of ambulatory recording.Significance.This offers significant reductions in burden to patients and their families. Furthermore, the device's utility may extend to a broader spectrum, making it suitable for other applications involving neurophysiological recordings in real-world settings.
Collapse
Affiliation(s)
- Mahmoud Zeydabadinezhad
- Department of Biomedical Informatics, Emory University, Atlanta, GA, United States of America
| | - Jon Jowers
- United Sciences, LLC, Atlanta, GA, United States of America
| | - Derek Buhl
- Takeda Pharmaceuticals Company Limited, Cambridge, MA, United States of America
| | - Brian Cabaniss
- Department of Neurology, Emory University School of Medicine, Atlanta, GA, United States of America
| | - Babak Mahmoudi
- Department of Biomedical Informatics, Emory University, Atlanta, GA, United States of America
- Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA, United States of America
| |
Collapse
|
5
|
Peksa J, Mamchur D. State-of-the-Art on Brain-Computer Interface Technology. SENSORS (BASEL, SWITZERLAND) 2023; 23:6001. [PMID: 37447849 DOI: 10.3390/s23136001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 06/23/2023] [Accepted: 06/26/2023] [Indexed: 07/15/2023]
Abstract
This paper provides a comprehensive overview of the state-of-the-art in brain-computer interfaces (BCI). It begins by providing an introduction to BCIs, describing their main operation principles and most widely used platforms. The paper then examines the various components of a BCI system, such as hardware, software, and signal processing algorithms. Finally, it looks at current trends in research related to BCI use for medical, educational, and other purposes, as well as potential future applications of this technology. The paper concludes by highlighting some key challenges that still need to be addressed before widespread adoption can occur. By presenting an up-to-date assessment of the state-of-the-art in BCI technology, this paper will provide valuable insight into where this field is heading in terms of progress and innovation.
Collapse
Affiliation(s)
- Janis Peksa
- Department of Information Technologies, Turiba University, Graudu Street 68, LV-1058 Riga, Latvia
- Institute of Information Technology, Riga Technical University, Kalku Street 1, LV-1658 Riga, Latvia
| | - Dmytro Mamchur
- Department of Information Technologies, Turiba University, Graudu Street 68, LV-1058 Riga, Latvia
- Computer Engineering and Electronics Department, Kremenchuk Mykhailo Ostrohradskyi National University, Pershotravneva 20, 39600 Kremenchuk, Ukraine
| |
Collapse
|
6
|
Li J, Pan W, Huang H, Pan J, Wang F. STGATE: Spatial-temporal graph attention network with a transformer encoder for EEG-based emotion recognition. Front Hum Neurosci 2023; 17:1169949. [PMID: 37125349 PMCID: PMC10133470 DOI: 10.3389/fnhum.2023.1169949] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 03/27/2023] [Indexed: 05/02/2023] Open
Abstract
Electroencephalogram (EEG) is a crucial and widely utilized technique in neuroscience research. In this paper, we introduce a novel graph neural network called the spatial-temporal graph attention network with a transformer encoder (STGATE) to learn graph representations of emotion EEG signals and improve emotion recognition performance. In STGATE, a transformer-encoder is applied for capturing time-frequency features which are fed into a spatial-temporal graph attention for emotion classification. Using a dynamic adjacency matrix, the proposed STGATE adaptively learns intrinsic connections between different EEG channels. To evaluate the cross-subject emotion recognition performance, leave-one-subject-out experiments are carried out on three public emotion recognition datasets, i.e., SEED, SEED-IV, and DREAMER. The proposed STGATE model achieved a state-of-the-art EEG-based emotion recognition performance accuracy of 90.37% in SEED, 76.43% in SEED-IV, and 76.35% in DREAMER dataset, respectively. The experiments demonstrated the effectiveness of the proposed STGATE model for cross-subject EEG emotion recognition and its potential for graph-based neuroscience research.
Collapse
Affiliation(s)
| | | | | | | | - Fei Wang
- School of Software, South China Normal University, Guangzhou, China
| |
Collapse
|