1
|
Kheirabadi R, Omranpour H. Learning classifiers in clustered data: BCI pattern recognition model for EEG-based human emotion recognition. Comput Methods Biomech Biomed Engin 2024; 27:1649-1663. [PMID: 37668071 DOI: 10.1080/10255842.2023.2252953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 07/25/2023] [Accepted: 08/17/2023] [Indexed: 09/06/2023]
Abstract
Evidence suggests that human emotions can be detected using Electroencephalography (EEG) brain signals. Recorded EEG signals, due to their large size, may not initially perform well in classification. For this reason, various feature selection methods are used to improve the performance of classification. The nature of EEG signals is complex and unstable. This article uses the Empirical Mode Decomposition (EMD) method, which is one of the most successful methods in analyzing these signals in recent years. In the proposed model, first, the EEG signals are decomposed using EMD into the number of Intrinsic Mode Functions (IMF), and then, the statistical properties of the IMFs are extracted. To improve the performance of the proposed model, using the RBF kernel and Least Absolute Shrinkage and Selection Operator (LASSO) feature selection, an effective subset of the features that have changed the space is selected. The data are then clustered, and finally, each cluster is classified with a decision tree and random forest and KNN. The purpose of clustering is to increase the accuracy of the classification, which is achieved by focusing each cluster on a limited number of classes. This experiment was performed on the DEAP dataset. The results show that the proposed model with 99.17% accuracy could perform better than recent research such as deep learning and show good performance. In the latest years, with the development of the BCI system, the demand for recognizing emotions based on EEG has increased. We provide a method for classifying clustered data that is efficient for high accuracy.
Collapse
Affiliation(s)
- Raoufeh Kheirabadi
- Department of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran
| | - Hesam Omranpour
- Department of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran
| |
Collapse
|
2
|
Patel P, Balasubramanian S, Annavarapu RN. Cross subject emotion identification from multichannel EEG sub-bands using Tsallis entropy feature and KNN classifier. Brain Inform 2024; 11:7. [PMID: 38441825 PMCID: PMC11358557 DOI: 10.1186/s40708-024-00220-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 02/05/2024] [Indexed: 08/29/2024] Open
Abstract
Human emotion recognition remains a challenging and prominent issue, situated at the convergence of diverse fields, such as brain-computer interfaces, neuroscience, and psychology. This study utilizes an EEG data set for investigating human emotion, presenting novel findings and a refined approach for EEG-based emotion detection. Tsallis entropy features, computed for q values of 2, 3, and 4, are extracted from signal bands, including theta-θ (4-7 Hz), alpha-α (8-15 Hz), beta-β (16-31 Hz), gamma-γ (32-55 Hz), and the overall frequency range (0-75 Hz). These Tsallis entropy features are employed to train and test a KNN classifier, aiming for accurate identification of two emotional states: positive and negative. In this study, the best average accuracy of 79% and an F-score of 0.81 were achieved in the gamma frequency range for the Tsallis parameter q = 3. In addition, the highest accuracy and F-score of 84% and 0.87 were observed. Notably, superior performance was noted in the anterior and left hemispheres compared to the posterior and right hemispheres in the context of emotion studies. The findings show that the proposed method exhibits enhanced performance, making it a highly competitive alternative to existing techniques. Furthermore, we identify and discuss the shortcomings of the proposed approach, offering valuable insights into potential avenues for improvements.
Collapse
Affiliation(s)
- Pragati Patel
- Department of Physics, Pondicherry University, Puducherry, 605014, India
| | | | | |
Collapse
|
3
|
Kaklauskas A, Abraham A, Ubarte I, Kliukas R, Luksaite V, Binkyte-Veliene A, Vetloviene I, Kaklauskiene L. A Review of AI Cloud and Edge Sensors, Methods, and Applications for the Recognition of Emotional, Affective and Physiological States. SENSORS (BASEL, SWITZERLAND) 2022; 22:7824. [PMID: 36298176 PMCID: PMC9611164 DOI: 10.3390/s22207824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 09/28/2022] [Accepted: 10/12/2022] [Indexed: 06/16/2023]
Abstract
Affective, emotional, and physiological states (AFFECT) detection and recognition by capturing human signals is a fast-growing area, which has been applied across numerous domains. The research aim is to review publications on how techniques that use brain and biometric sensors can be used for AFFECT recognition, consolidate the findings, provide a rationale for the current methods, compare the effectiveness of existing methods, and quantify how likely they are to address the issues/challenges in the field. In efforts to achieve the key goals of Society 5.0, Industry 5.0, and human-centered design better, the recognition of emotional, affective, and physiological states is progressively becoming an important matter and offers tremendous growth of knowledge and progress in these and other related fields. In this research, a review of AFFECT recognition brain and biometric sensors, methods, and applications was performed, based on Plutchik's wheel of emotions. Due to the immense variety of existing sensors and sensing systems, this study aimed to provide an analysis of the available sensors that can be used to define human AFFECT, and to classify them based on the type of sensing area and their efficiency in real implementations. Based on statistical and multiple criteria analysis across 169 nations, our outcomes introduce a connection between a nation's success, its number of Web of Science articles published, and its frequency of citation on AFFECT recognition. The principal conclusions present how this research contributes to the big picture in the field under analysis and explore forthcoming study trends.
Collapse
Affiliation(s)
- Arturas Kaklauskas
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Ajith Abraham
- Machine Intelligence Research Labs, Scientific Network for Innovation and Research Excellence, Auburn, WA 98071, USA
| | - Ieva Ubarte
- Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Romualdas Kliukas
- Department of Applied Mechanics, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Vaida Luksaite
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Arune Binkyte-Veliene
- Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Ingrida Vetloviene
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Loreta Kaklauskiene
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| |
Collapse
|
4
|
Garcia-Martinez B, Fernandez-Caballero A, Alcaraz R, Martinez-Rodrigo A. Application of Dispersion Entropy for the Detection of Emotions With Electroencephalographic Signals. IEEE Trans Cogn Dev Syst 2022. [DOI: 10.1109/tcds.2021.3099344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Beatriz Garcia-Martinez
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingenieros Industriales, Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, Albacete, Spain
| | - Antonio Fernandez-Caballero
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingenieros Industriales, Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, Albacete, Spain
| | - Raul Alcaraz
- Research Group in Electronic, Biomedical and Telecommunication Engineering, Escuela Politécnica de Cuenca, Universidad de Castilla-La Mancha, Cuenca, Spain
| | - Arturo Martinez-Rodrigo
- Research Group in Electronic, Biomedical and Telecommunication Engineering, Facultad de Comunicación, Instituto de Tecnologías Audiovisuales de Castilla-La Mancha, Universidad de Castilla-La Mancha, Cuenca, Spain
| |
Collapse
|
5
|
A Human Defecation Prediction Method Based on Multi-Domain Features and Improved Support Vector Machine. Symmetry (Basel) 2022. [DOI: 10.3390/sym14091763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
The difficulty of defecation seriously affects the quality of life of the bedridden elderly. To solve the problem that it is difficult to know the defecation time of the bedridden elderly, this paper proposed a human pre-defecation prediction method based on multi-domain features and improved support vector machine (SVM) using bowel sound as the original signal. The method includes three stages: multi-domain features extraction, feature optimization, and defecation prediction. In the stage of multi-domain features extraction, statistical analysis, fast Fourier transform (FFT), and wavelet packet transform are used to extract feature information in the time domain, frequency domain, and time-frequency domain. The symmetry of the bowel sound signal in the time domain, frequency domain, and time-frequency domain will change when the human has the urge to defecate. In the feature optimization stage, the Fisher Score (FS) algorithm is introduced to select meaningful and sensitive features according to the importance of each feature, aiming to remove redundant information and improve computational efficiency. In the stage of defecation prediction, SVM is optimized by the gray wolf optimization (GWO) algorithm to realize human defecation prediction. Finally, experimental analysis of the bowel sound data collected during the study is carried out. The experimental result shows that the proposed method could achieve an accuracy of 92.86% in defecation prediction, which proves the effectiveness of the proposed method.
Collapse
|
6
|
Anuragi A, Singh Sisodia D, Bilas Pachori R. EEG-based cross-subject Emotion Recognition using Fourier-Bessel series expansion based empirical wavelet transform and NCA feature selection method. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.07.121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
7
|
García-Martínez B, Fernández-Caballero A, Martínez-Rodrigo A. Entropy and the Emotional Brain: Overview of a Research Field. ARTIF INTELL 2022. [DOI: 10.5772/intechopen.98342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
During the last years, there has been a notable increase in the number of studies focused on the assessment of brain dynamics for the recognition of emotional states by means of nonlinear methodologies. More precisely, different entropy metrics have been applied for the analysis of electroencephalographic recordings for the detection of emotions. In this sense, regularity-based entropy metrics, symbolic predictability-based entropy indices, and different multiscale and multilag variants of the aforementioned methods have been successfully tested in a series of studies for emotion recognition from the EEG recording. This chapter aims to unify all those contributions to this scientific area, summarizing the main discoverings recently achieved in this research field.
Collapse
|
8
|
García-Martínez B, Fernández-Caballero A, Martínez-Rodrigo A, Alcaraz R, Novais P. Evaluation of Brain Functional Connectivity from Electroencephalographic Signals Under Different Emotional States. Int J Neural Syst 2022; 32:2250026. [PMID: 35469551 DOI: 10.1142/s0129065722500265] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The identification of the emotional states corresponding to the four quadrants of the valence/arousal space has been widely analyzed in the scientific literature by means of multiple techniques. Nevertheless, most of these methods were based on the assessment of each brain region separately, without considering the possible interactions among different areas. In order to study these interconnections, this study computes for the first time the functional connectivity metric called cross-sample entropy for the analysis of the brain synchronization in four groups of emotions from electroencephalographic signals. Outcomes reported a strong synchronization in the interconnections among central, parietal and occipital areas, while the interactions between left frontal and temporal structures with the rest of brain regions presented the lowest coordination. These differences were statistically significant for the four groups of emotions. All emotions were simultaneously classified with a 95.43% of accuracy, overcoming the results reported in previous studies. Moreover, the differences between high and low levels of valence and arousal, taking into account the state of the counterpart dimension, also provided notable findings about the degree of synchronization in the brain within different emotional conditions and the possible implications of these outcomes from a psychophysiological point of view.
Collapse
Affiliation(s)
- Beatriz García-Martínez
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingenieros Industriales, Universidad de Castilla-La Mancha, 02071 Albacete, Spain.,Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, 02071 Albacete, Spain
| | - Antonio Fernández-Caballero
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingenieros Industriales, Universidad de Castilla-La Mancha, 02071 Albacete, Spain.,Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, 02071 Albacete, Spain.,CIBERSAM (Biomedical Research Networking Centre in Mental Health), Madrid, Spain
| | - Arturo Martínez-Rodrigo
- Research Group in Electronic, Biomedical and Telecommunication Engineering, Facultad de Comunicación, Universidad de, Castilla-La Mancha, 16071 Cuenca, Spain.,Instituto de Tecnologías Audiovisuales de, Castilla-La Mancha, Universidad de Castilla-La, Mancha, 16071 Cuenca, Spain
| | - Raúl Alcaraz
- Research Group in Electronic, Biomedical and Telecommunication Engineering, Escuela Politécnica de Cuenca, Universidad, de Castilla-La Mancha, 16071 Cuenca, Spain
| | - Paulo Novais
- Algoritmi Center, Department of Informatics, Universidade do Minho, 4800-058 Guimaräes, Portugal
| |
Collapse
|
9
|
A Dataset for Emotion Recognition Using Virtual Reality and EEG (DER-VREEG): Emotional State Classification Using Low-Cost Wearable VR-EEG Headsets. BIG DATA AND COGNITIVE COMPUTING 2022. [DOI: 10.3390/bdcc6010016] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Emotions are viewed as an important aspect of human interactions and conversations, and allow effective and logical decision making. Emotion recognition uses low-cost wearable electroencephalography (EEG) headsets to collect brainwave signals and interpret these signals to provide information on the mental state of a person, with the implementation of a virtual reality environment in different applications; the gap between human and computer interaction, as well as the understanding process, would shorten, providing an immediate response to an individual’s mental health. This study aims to use a virtual reality (VR) headset to induce four classes of emotions (happy, scared, calm, and bored), to collect brainwave samples using a low-cost wearable EEG headset, and to run popular classifiers to compare the most feasible ones that can be used for this particular setup. Firstly, we attempt to build an immersive VR database that is accessible to the public and that can potentially assist with emotion recognition studies using virtual reality stimuli. Secondly, we use a low-cost wearable EEG headset that is both compact and small, and can be attached to the scalp without any hindrance, allowing freedom of movement for participants to view their surroundings inside the immersive VR stimulus. Finally, we evaluate the emotion recognition system by using popular machine learning algorithms and compare them for both intra-subject and inter-subject classification. The results obtained here show that the prediction model for the four-class emotion classification performed well, including the more challenging inter-subject classification, with the support vector machine (SVM Class Weight kernel) obtaining 85.01% classification accuracy. This shows that using less electrode channels but with proper parameter tuning and selection features affects the performance of the classifications.
Collapse
|
10
|
Galvão F, Alarcão SM, Fonseca MJ. Predicting Exact Valence and Arousal Values from EEG. SENSORS (BASEL, SWITZERLAND) 2021; 21:3414. [PMID: 34068895 PMCID: PMC8155937 DOI: 10.3390/s21103414] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 04/20/2021] [Accepted: 05/11/2021] [Indexed: 11/18/2022]
Abstract
Recognition of emotions from physiological signals, and in particular from electroencephalography (EEG), is a field within affective computing gaining increasing relevance. Although researchers have used these signals to recognize emotions, most of them only identify a limited set of emotional states (e.g., happiness, sadness, anger, etc.) and have not attempted to predict exact values for valence and arousal, which would provide a wider range of emotional states. This paper describes our proposed model for predicting the exact values of valence and arousal in a subject-independent scenario. To create it, we studied the best features, brain waves, and machine learning models that are currently in use for emotion classification. This systematic analysis revealed that the best prediction model uses a KNN regressor (K = 1) with Manhattan distance, features from the alpha, beta and gamma bands, and the differential asymmetry from the alpha band. Results, using the DEAP, AMIGOS and DREAMER datasets, show that our model can predict valence and arousal values with a low error (MAE < 0.06, RMSE < 0.16) and a strong correlation between predicted and expected values (PCC > 0.80), and can identify four emotional classes with an accuracy of 84.4%. The findings of this work show that the features, brain waves and machine learning models, typically used in emotion classification tasks, can be used in more challenging situations, such as the prediction of exact values for valence and arousal.
Collapse
Affiliation(s)
| | | | - Manuel J. Fonseca
- LASIGE, Faculdade de Ciências, Universidade de Lisboa, 1749-016 Lisboa, Portugal; (F.G.); (S.M.A.)
| |
Collapse
|
11
|
García-Martínez B, Fernández-Caballero A, Zunino L, Martínez-Rodrigo A. Recognition of Emotional States from EEG Signals with Nonlinear Regularity- and Predictability-Based Entropy Metrics. Cognit Comput 2020. [DOI: 10.1007/s12559-020-09789-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
12
|
Dzedzickis A, Kaklauskas A, Bucinskas V. Human Emotion Recognition: Review of Sensors and Methods. SENSORS (BASEL, SWITZERLAND) 2020; 20:E592. [PMID: 31973140 PMCID: PMC7037130 DOI: 10.3390/s20030592] [Citation(s) in RCA: 99] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Revised: 01/10/2020] [Accepted: 01/12/2020] [Indexed: 11/16/2022]
Abstract
Automated emotion recognition (AEE) is an important issue in various fields of activities which use human emotional reactions as a signal for marketing, technical equipment, or human-robot interaction. This paper analyzes scientific research and technical papers for sensor use analysis, among various methods implemented or researched. This paper covers a few classes of sensors, using contactless methods as well as contact and skin-penetrating electrodes for human emotion detection and the measurement of their intensity. The results of the analysis performed in this paper present applicable methods for each type of emotion and their intensity and propose their classification. The classification of emotion sensors is presented to reveal area of application and expected outcomes from each method, as well as their limitations. This paper should be relevant for researchers using human emotion evaluation and analysis, when there is a need to choose a proper method for their purposes or to find alternative decisions. Based on the analyzed human emotion recognition sensors and methods, we developed some practical applications for humanizing the Internet of Things (IoT) and affective computing systems.
Collapse
Affiliation(s)
- Andrius Dzedzickis
- Faculty of Mechanics, Vilnius Gediminas Technical University, J. Basanaviciaus g. 28, LT-03224 Vilnius, Lithuania;
| | - Artūras Kaklauskas
- Faculty of Civil engineering, Vilnius Gediminas Technical University, Sauletekio ave. 11, LT-10223 Vilnius, Lithuania;
| | - Vytautas Bucinskas
- Faculty of Mechanics, Vilnius Gediminas Technical University, J. Basanaviciaus g. 28, LT-03224 Vilnius, Lithuania;
| |
Collapse
|