1
|
Li K, Lu A, Deng R, Yi H. The Unique Cost of Human Eye Gaze in Cognitive Control: Being Human-Specific and Body-Related? PSICHOLOGIJA 2022. [DOI: 10.15388/psichol.2022.59] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
This study investigated the eye gaze cost in cognitive control and whether it is human-specific and body-related. In Experiment 1, we explored whether there was a cost of human eye gaze in cognitive control and extended it by focusing on the role of emotion in the cost. Stroop effect was found to be larger in eye-gaze condition than vertical grating condition, and to be comparable across positive, negative, and neutral trials. In Experiment 2, we explored whether the eye gaze cost in cognitive control was limited to human eyes. No larger Stroop effect was found in feline eye-gaze condition, neither the modulating role of emotion. In Experiment 3, we explored whether the mouth could elicit a cost in Stroop effect. Stroop effect was not significantly larger in mouth condition compared to vertical grating condition, nor across positive, negative, and neutral conditions. The results suggest that: (1) There is a robust cost of eye gaze in cognitive control; (2) Such eye-gaze cost was specific to human eyes but not to animal eyes; (3) Only human eyes could have such eye-gaze costs but not human mouth. This study supported the notion that presentation of social cues, such as human eyes, could influence attentional processing, and provided preliminary evidence that the human eye plays an important role in cognitive processing.
Collapse
|
2
|
Deep Learning-Based Approach for Emotion Recognition Using Electroencephalography (EEG) Signals Using Bi-Directional Long Short-Term Memory (Bi-LSTM). SENSORS 2022; 22:s22082976. [PMID: 35458962 PMCID: PMC9033053 DOI: 10.3390/s22082976] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/30/2022] [Accepted: 03/31/2022] [Indexed: 01/28/2023]
Abstract
Emotions are an essential part of daily human communication. The emotional states and dynamics of the brain can be linked by electroencephalography (EEG) signals that can be used by the Brain–Computer Interface (BCI), to provide better human–machine interactions. Several studies have been conducted in the field of emotion recognition. However, one of the most important issues facing the emotion recognition process, using EEG signals, is the accuracy of recognition. This paper proposes a deep learning-based approach for emotion recognition through EEG signals, which includes data selection, feature extraction, feature selection and classification phases. This research serves the medical field, as the emotion recognition model helps diagnose psychological and behavioral disorders. The research contributes to improving the performance of the emotion recognition model to obtain more accurate results, which, in turn, aids in making the correct medical decisions. A standard pre-processed Database of Emotion Analysis using Physiological signaling (DEAP) was used in this work. The statistical features, wavelet features, and Hurst exponent were extracted from the dataset. The feature selection task was implemented through the Binary Gray Wolf Optimizer. At the classification stage, the stacked bi-directional Long Short-Term Memory (Bi-LSTM) Model was used to recognize human emotions. In this paper, emotions are classified into three main classes: arousal, valence and liking. The proposed approach achieved high accuracy compared to the methods used in past studies, with an average accuracy of 99.45%, 96.87% and 99.68% of valence, arousal, and liking, respectively, which is considered a high performance for the emotion recognition model.
Collapse
|
3
|
Kheirkhah M, Baumbach P, Leistritz L, Witte OW, Walter M, Gilbert JR, Zarate Jr. CA, Klingner CM. The Right Hemisphere Is Responsible for the Greatest Differences in Human Brain Response to High-Arousing Emotional versus Neutral Stimuli: A MEG Study. Brain Sci 2021; 11:960. [PMID: 34439579 PMCID: PMC8412101 DOI: 10.3390/brainsci11080960] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 07/09/2021] [Accepted: 07/16/2021] [Indexed: 11/17/2022] Open
Abstract
Studies investigating human brain response to emotional stimuli-particularly high-arousing versus neutral stimuli-have obtained inconsistent results. The present study was the first to combine magnetoencephalography (MEG) with the bootstrapping method to examine the whole brain and identify the cortical regions involved in this differential response. Seventeen healthy participants (11 females, aged 19 to 33 years; mean age, 26.9 years) were presented with high-arousing emotional (pleasant and unpleasant) and neutral pictures, and their brain responses were measured using MEG. When random resampling bootstrapping was performed for each participant, the greatest differences between high-arousing emotional and neutral stimuli during M300 (270-320 ms) were found to occur in the right temporo-parietal region. This finding was observed in response to both pleasant and unpleasant stimuli. The results, which may be more robust than previous studies because of bootstrapping and examination of the whole brain, reinforce the essential role of the right hemisphere in emotion processing.
Collapse
Affiliation(s)
- Mina Kheirkhah
- Experimental Therapeutics and Pathophysiology Branch, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20814, USA; (J.R.G.); (C.A.Z.)
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany;
- Department of Psychiatry and Psychotherapy, Jena University Hospital, 07743 Jena, Germany;
| | - Philipp Baumbach
- Department of Anesthesiology and Intensive Care Medicine, Jena University Hospital, 07747 Jena, Germany;
| | - Lutz Leistritz
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, 07740 Jena, Germany;
| | - Otto W. Witte
- Hans Berger Department of Neurology, Jena University Hospital, 07747 Jena, Germany;
| | - Martin Walter
- Department of Psychiatry and Psychotherapy, Jena University Hospital, 07743 Jena, Germany;
| | - Jessica R. Gilbert
- Experimental Therapeutics and Pathophysiology Branch, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20814, USA; (J.R.G.); (C.A.Z.)
| | - Carlos A. Zarate Jr.
- Experimental Therapeutics and Pathophysiology Branch, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20814, USA; (J.R.G.); (C.A.Z.)
| | - Carsten M. Klingner
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany;
- Hans Berger Department of Neurology, Jena University Hospital, 07747 Jena, Germany;
| |
Collapse
|
4
|
Gaber A, Taher MF, Abdel Wahed M, Shalaby NM. SVM classification of facial functions based on facial landmarks and animation Units. Biomed Phys Eng Express 2021; 7. [PMID: 34198276 DOI: 10.1088/2057-1976/ac107c] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Accepted: 07/01/2021] [Indexed: 11/11/2022]
Abstract
Quantitative assessment and classification of facial paralysis (FP) are essential for treatment selection and progress evaluation of the condition. As part of a comprehensive framework towards this goal, this study aims to classify five normal facial functions: smiling, eye closure, raising the eyebrows, blowing cheeks, and whistling as well as the rest state. 3D facial landmarks and facial animation units (FAUs) were obtained using the Kinect V2, a fast and cost-effective depth camera. These were used to compute the features used in a Support Vector Machine (SVM) classifier. A dataset of 1650 records from 50 normal subjects was compiled for this study. The performances of different SVM kernel models were tested with different feature groups. The best performance (Accuracy = 96.7%, Sensitivity = 90.2%, and Specificity = 98%) was found when using the RBF kernel model applied on just nine differences in FAUs. This research will be developed and extended to include FP classification.
Collapse
Affiliation(s)
- Amira Gaber
- Systems and Biomedical Engineering Department, Faculty of Engineering, Cairo University, Giza, Egypt
| | - Mona F Taher
- Systems and Biomedical Engineering Department, Faculty of Engineering, Cairo University, Giza, Egypt
| | - Manal Abdel Wahed
- Systems and Biomedical Engineering Department, Faculty of Engineering, Cairo University, Giza, Egypt
| | | |
Collapse
|
5
|
Kheirkhah M, Baumbach P, Leistritz L, Brodoehl S, Götz T, Huonker R, Witte OW, Klingner CM. The Temporal and Spatial Dynamics of Cortical Emotion Processing in Different Brain Frequencies as Assessed Using the Cluster-Based Permutation Test: An MEG Study. Brain Sci 2020; 10:brainsci10060352. [PMID: 32517238 PMCID: PMC7349493 DOI: 10.3390/brainsci10060352] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Revised: 06/02/2020] [Accepted: 06/04/2020] [Indexed: 11/24/2022] Open
Abstract
The processing of emotions in the human brain is an extremely complex process that extends across a large number of brain areas and various temporal processing steps. In the case of magnetoencephalography (MEG) data, various frequency bands also contribute differently. Therefore, in most studies, the analysis of emotional processing has to be limited to specific sub-aspects. Here, we demonstrated that these problems can be overcome by using a nonparametric statistical test called the cluster-based permutation test (CBPT). To the best of our knowledge, our study is the first to apply the CBPT to MEG data of brain responses to emotional stimuli. For this purpose, different emotionally impacting (pleasant and unpleasant) and neutral pictures were presented to 17 healthy subjects. The CBPT was applied to the power spectra of five brain frequencies, comparing responses to emotional versus neutral stimuli over entire MEG channels and time intervals within 1500 ms post-stimulus. Our results showed significant clusters in different frequency bands, and agreed well with many previous emotion studies. However, the use of the CBPT allowed us to easily include large numbers of MEG channels, wide frequency, and long time-ranges in one study, which is a more reliable alternative to other studies that consider only specific sub-aspects.
Collapse
Affiliation(s)
- Mina Kheirkhah
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany; (M.K.); (S.B.); (T.G.); (R.H.)
| | - Philipp Baumbach
- Department of Anesthesiology and Intensive Care Medicine, Jena University Hospital, 07747 Jena, Germany;
| | - Lutz Leistritz
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, 07740 Jena, Germany;
| | - Stefan Brodoehl
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany; (M.K.); (S.B.); (T.G.); (R.H.)
- Hans Berger Department of Neurology, Jena University Hospital, 07747 Jena, Germany;
| | - Theresa Götz
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany; (M.K.); (S.B.); (T.G.); (R.H.)
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, 07740 Jena, Germany;
| | - Ralph Huonker
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany; (M.K.); (S.B.); (T.G.); (R.H.)
| | - Otto W. Witte
- Hans Berger Department of Neurology, Jena University Hospital, 07747 Jena, Germany;
| | - Carsten M. Klingner
- Biomagnetic Center, Jena University Hospital, 07747 Jena, Germany; (M.K.); (S.B.); (T.G.); (R.H.)
- Hans Berger Department of Neurology, Jena University Hospital, 07747 Jena, Germany;
- Correspondence:
| |
Collapse
|