1
|
Huang ST, Wu K, Guo MM, Shao S, Hua R, Zhang YM. Glutamatergic and GABAergic anteroventral BNST projections to PVN CRH neurons regulate maternal separation-induced visceral pain. Neuropsychopharmacology 2023; 48:1778-1788. [PMID: 37516802 PMCID: PMC10579407 DOI: 10.1038/s41386-023-01678-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 07/11/2023] [Accepted: 07/17/2023] [Indexed: 07/31/2023]
Abstract
Early-life stress (ELS) is thought to cause the development of visceral pain disorders. While some individuals are vulnerable to visceral pain, others are resilient, but the intrinsic circuit and molecular mechanisms involved remain largely unclear. Herein, we demonstrate that inbred mice subjected to maternal separation (MS) could be separated into susceptible and resilient subpopulations by visceral hypersensitivity evaluation. Through a combination of chemogenetics, optogenetics, fiber photometry, molecular and electrophysiological approaches, we discovered that susceptible mice presented activation of glutamatergic projections or inhibition of GABAergic projections from the anteroventral bed nucleus of the stria terminalis (avBNST) to paraventricular nucleus (PVN) corticotropin-releasing hormone (CRH) neurons. However, resilience develops as a behavioral adaptation partially due to restoration of PVN SK2 channel expression and function. Our findings suggest that PVN CRH neurons are dually regulated by functionally opposing avBNST neurons and that this circuit may be the basis for neurobiological vulnerability to visceral pain.
Collapse
Affiliation(s)
- Si-Ting Huang
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
| | - Ke Wu
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
| | - Miao-Miao Guo
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
| | - Shuai Shao
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
| | - Rong Hua
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China
- Emergency Department, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, 221116, Jiangsu, China
| | - Yong-Mei Zhang
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China.
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China.
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, 221004, Jiangsu, China.
| |
Collapse
|
2
|
Chen JY, Wu K, Guo MM, Song W, Huang ST, Zhang YM. The PrL Glu→avBNST GABA circuit rapidly modulates depression-like behaviors in male mice. iScience 2023; 26:107878. [PMID: 37810240 PMCID: PMC10551841 DOI: 10.1016/j.isci.2023.107878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 06/20/2023] [Accepted: 09/07/2023] [Indexed: 10/10/2023] Open
Abstract
Depression is a global disease with a high prevalence. Here, we examine the role of the circuit from prelimbic mPFC (PrL) to the anterior ventral bed nucleus of the stria terminalis (avBNST) in depression-like mice through behavioral tests, immunofluorescence, chemogenetics, optogenetics, pharmacology, and fiber photometry. Mice exposed to chronic restraint stress with individual housing displayed depression-like behaviors. Optogenetic or chemogenetic activation of the avBNST-projecting glutamatergic neurons in the PrL had an antidepressant effect. Moreover, we found that α-amino-3-hydroxy-5-methyl-4-isoxazole-propionicacid receptors (AMPARs) play a dominant role in this circuit. Systemic administration of ketamine profoundly alleviated depression-like behaviors in the mice and rapidly rescued the decreased activity in the PrLGlu→avBNSTGABA circuit. Furthermore, the fast-acting effect of ketamine on depressive behaviors was diminished when the circuit was inhibited. To summarize, activating the PrLGlu→avBNSTGABA circuit quickly ameliorated depression-like behaviors. Thus, we propose the PrLGlu→avBNSTGABA circuit as a target for fast regulation of depression.
Collapse
Affiliation(s)
- Jie-ying Chen
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou, Jiangsu 221002, China
| | - Ke Wu
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou, Jiangsu 221002, China
| | - Miao-miao Guo
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou, Jiangsu 221002, China
| | - Wei Song
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou, Jiangsu 221002, China
| | - Si-ting Huang
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou, Jiangsu 221002, China
| | - Yong-mei Zhang
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, Jiangsu 221002, China
- NMPA Key Laboratory for Research and Evaluation of Narcotic and Psychotropic Drugs, Xuzhou, Jiangsu 221002, China
| |
Collapse
|
3
|
Sorinas J, Troyano JCF, Ferrández JM, Fernandez E. Unraveling the Development of an Algorithm for Recognizing Primary Emotions Through Electroencephalography. Int J Neural Syst 2023; 33:2250057. [PMID: 36495049 DOI: 10.1142/s0129065722500575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
The large range of potential applications, not only for patients but also for healthy people, that could be achieved by affective brain-computer interface (aBCI) makes more latent the necessity of finding a commonly accepted protocol for real-time EEG-based emotion recognition. Based on wavelet package for spectral feature extraction, attending to the nature of the EEG signal, we have specified some of the main parameters needed for the implementation of robust positive and negative emotion classification. Twelve seconds has resulted as the most appropriate sliding window size; from that, a set of 20 target frequency-location variables have been proposed as the most relevant features that carry the emotional information. Lastly, QDA and KNN classifiers and population rating criterion for stimuli labeling have been suggested as the most suitable approaches for EEG-based emotion recognition. The proposed model reached a mean accuracy of 98% (s.d. 1.4) and 98.96% (s.d. 1.28) in a subject-dependent (SD) approach for QDA and KNN classifier, respectively. This new model represents a step forward towards real-time classification. Moreover, new insights regarding subject-independent (SI) approximation have been discussed, although the results were not conclusive.
Collapse
Affiliation(s)
- Jennifer Sorinas
- Institute of Bioengineering, University Miguel Hernandez and CIBER BBN, Elche 03202, Spain
| | - Juan C Fernandez Troyano
- Department of Electronics and Computer Technology, University of Cartagena, Cartagena 30202, Spain
| | - Jose Manuel Ferrández
- Department of Electronics and Computer Technology, University of Cartagena, Cartagena 30202, Spain
| | - Eduardo Fernandez
- Institute of Bioengineering, University Miguel Hernandez and CIBER BBN, Elche 03202, Spain
| |
Collapse
|
4
|
Classification of Contrasting Discrete Emotional States Indicated by EEG Based Graph Theoretical Network Measures. Neuroinformatics 2022; 20:863-877. [PMID: 35286574 DOI: 10.1007/s12021-022-09579-2] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/22/2022] [Indexed: 12/31/2022]
Abstract
The present study shows new findings that reveal the high association between emotional arousal and neuro-functional brain connectivity measures. For this purpose, contrasting discrete emotional states (happiness vs sadness, amusement vs disgust, calmness vs excitement, calmness vs anger, fear vs anger) are classified by using Support Vector Machines (SVMs) driven by Graph Theoretical segregation (clustering coefficients, transitivity, modularity) and integration (global efficiency, local efficiency) measures of the brain network. Emotional EEG data mediated by short duration video film clips is downloaded from publicly available database called DREAMER. Pearson Correlation (PC) and Spearman Correlation have been examined to estimate statistical dependencies between relatively shorter (6 sec) and longer (12 sec) non-overlapped EEG segments across the cortex. Then the corresponding brain connectivity encoded as a graph is transformed into binary numbers with respect to two different thresholds (60%max and mean). Statistical differences between contrasting emotions are obtained by using both one-way Anova tests and step-wise logistic regression modelling in accordance with variables (dependency estimation, segment length, threshold, network measure). Combined integration measures provided the highest classification accuracies (CAs) (75.00% 80.65%) when PC is applied to longer segments in accordance with particular threshold as the mean. The segregation measures also provided useful CAs (74.13% 80.00%), while the combination of both measures did not. The results reveal that discrete emotional states are characterized by balanced network measures even if both segregation and integration measures vary depending on arousal scores of audio-visual stimuli due to neurotransmitter release during video watching.
Collapse
|
5
|
Yang H, Huang S, Guo S, Sun G. Multi-Classifier Fusion Based on MI–SFFS for Cross-Subject Emotion Recognition. ENTROPY 2022; 24:e24050705. [PMID: 35626587 PMCID: PMC9141183 DOI: 10.3390/e24050705] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 05/09/2022] [Accepted: 05/10/2022] [Indexed: 02/01/2023]
Abstract
With the widespread use of emotion recognition, cross-subject emotion recognition based on EEG signals has become a hot topic in affective computing. Electroencephalography (EEG) can be used to detect the brain’s electrical activity associated with different emotions. The aim of this research is to improve the accuracy by enhancing the generalization of features. A Multi-Classifier Fusion method based on mutual information with sequential forward floating selection (MI_SFFS) is proposed. The dataset used in this paper is DEAP, which is a multi-modal open dataset containing 32 EEG channels and multiple other physiological signals. First, high-dimensional features are extracted from 15 EEG channels of DEAP after using a 10 s time window for data slicing. Second, MI and SFFS are integrated as a novel feature-selection method. Then, support vector machine (SVM), k-nearest neighbor (KNN) and random forest (RF) are employed to classify positive and negative emotions to obtain the output probabilities of classifiers as weighted features for further classification. To evaluate the model performance, leave-one-out cross-validation is adopted. Finally, cross-subject classification accuracies of 0.7089, 0.7106 and 0.7361 are achieved by the SVM, KNN and RF classifiers, respectively. The results demonstrate the feasibility of the model by splicing different classifiers’ output probabilities as a portion of the weighted features.
Collapse
Affiliation(s)
- Haihui Yang
- College of Electronic Engineering, Heilongjiang University, Harbin 150080, China; (H.Y.); (S.H.); (S.G.)
- Key Laboratory of Information Fusion Estimation and Detection, Harbin 150080, China
| | - Shiguo Huang
- College of Electronic Engineering, Heilongjiang University, Harbin 150080, China; (H.Y.); (S.H.); (S.G.)
- Key Laboratory of Information Fusion Estimation and Detection, Harbin 150080, China
| | - Shengwei Guo
- College of Electronic Engineering, Heilongjiang University, Harbin 150080, China; (H.Y.); (S.H.); (S.G.)
- Key Laboratory of Information Fusion Estimation and Detection, Harbin 150080, China
| | - Guobing Sun
- College of Electronic Engineering, Heilongjiang University, Harbin 150080, China; (H.Y.); (S.H.); (S.G.)
- Key Laboratory of Information Fusion Estimation and Detection, Harbin 150080, China
- Correspondence: ; Tel.: +86-18946119665
| |
Collapse
|
6
|
De Lope J, Graña M. A Hybrid Time-Distributed Deep Neural Architecture for Speech Emotion Recognition. Int J Neural Syst 2022; 32:2250024. [DOI: 10.1142/s0129065722500241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
In recent years, speech emotion recognition (SER) has emerged as one of the most active human–machine interaction research areas. Innovative electronic devices, services and applications are increasingly aiming to check the user emotional state either to issue alerts under some predefined conditions or to adapt the system responses to the user emotions. Voice expression is a very rich and noninvasive source of information for emotion assessment. This paper presents a novel SER approach based on that is a hybrid of a time-distributed convolutional neural network (TD-CNN) and a long short-term memory (LSTM) network. Mel-frequency log-power spectrograms (MFLPSs) extracted from audio recordings are parsed by a sliding window that selects the input for the TD-CNN. The TD-CNN transforms the input image data into a sequence of high-level features that are feed to the LSTM, which carries out the overall signal interpretation. In order to reduce overfitting, the MFLPS representation allows innovative image data augmentation techniques that have no immediate equivalent on the original audio signal. Validation of the proposed hybrid architecture achieves an average recognition accuracy of 73.98% on the most widely and hardest publicly distributed database for SER benchmarking. A permutation test confirms that this result is significantly different from random classification ([Formula: see text]). The proposed architecture outperforms state-of-the-art deep learning models as well as conventional machine learning techniques evaluated on the same database trying to identify the same number of emotions.
Collapse
Affiliation(s)
- Javier De Lope
- Department of Artificial Intelligence, Universidad Politécnica de Madrid (UPM), Madrid, Spain
| | - Manuel Graña
- Computational Intelligence Group, University of the Basque Country (UPV), San Sebastian, Spain
| |
Collapse
|
7
|
Cai Z, Wang L, Guo M, Xu G, Guo L, Li Y. From Intricacy to Conciseness: A Progressive Transfer Strategy for EEG-Based Cross-Subject Emotion Recognition. Int J Neural Syst 2022; 32:2250005. [PMID: 35023812 DOI: 10.1142/s0129065722500058] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Emotion plays a significant role in human daily activities, and it can be effectively recognized from EEG signals. However, individual variability limits the generalization of emotion classifiers across subjects. Domain adaptation (DA) is a reliable method to solve the issue. Due to the nonstationarity of EEG, the inferior-quality source domain data bring negative transfer in DA procedures. To solve this problem, an auto-augmentation joint distribution adaptation (AA-JDA) method and a burden-lightened and source-preferred JDA (BLSP-JDA) approach are proposed in this paper. The methods are based on a novel transfer idea, learning the specific knowledge of the target domain from the samples that are appropriate for transfer, which reduces the difficulty of transfer between two domains. On multiple emotion databases, our model shows state-of-the-art performance.
Collapse
Affiliation(s)
- Ziliang Cai
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, P. R. China
| | - Lingyue Wang
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, P. R. China
| | - Miaomiao Guo
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, P. R. China
| | - Guizhi Xu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, P. R. China
| | - Lei Guo
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, P. R. China
| | - Ying Li
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300401, P. R. China
| |
Collapse
|
8
|
Sun H, Jin J, Xu R, Cichocki A. Feature Selection Combining Filter and Wrapper Methods for Motor-Imagery Based Brain-Computer Interfaces. Int J Neural Syst 2021; 31:2150040. [PMID: 34376122 DOI: 10.1142/s0129065721500404] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Motor imagery (MI) based brain-computer interfaces help patients with movement disorders to regain the ability to control external devices. Common spatial pattern (CSP) is a popular algorithm for feature extraction in decoding MI tasks. However, due to noise and nonstationarity in electroencephalography (EEG), it is not optimal to combine the corresponding features obtained from the traditional CSP algorithm. In this paper, we designed a novel CSP feature selection framework that combines the filter method and the wrapper method. We first evaluated the importance of every CSP feature by the infinite latent feature selection method. Meanwhile, we calculated Wasserstein distance between feature distributions of the same feature under different tasks. Then, we redefined the importance of every CSP feature based on two indicators mentioned above, which eliminates half of CSP features to create a new CSP feature subspace according to the new importance indicator. At last, we designed the improved binary gravitational search algorithm (IBGSA) by rebuilding its transfer function and applied IBGSA on the new CSP feature subspace to find the optimal feature set. To validate the proposed method, we conducted experiments on three public BCI datasets and performed a numerical analysis of the proposed algorithm for MI classification. The accuracies were comparable to those reported in related studies and the presented model outperformed other methods in literature on the same underlying data.
Collapse
Affiliation(s)
- Hao Sun
- Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Jing Jin
- Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Ren Xu
- Guger Technologies OG, Graz, Austria
| | - Andrzej Cichocki
- Skolkovo Institute of Science and Technology (SKOLTECH), 121205 Moscow, Russia.,Nicolaus Copernicus University (UMK), 87-100 Torun, Poland
| |
Collapse
|
9
|
Jin J, Fang H, Daly I, Xiao R, Miao Y, Wang X, Cichocki A. Optimization of Model Training Based on Iterative Minimum Covariance Determinant In Motor-Imagery BCI. Int J Neural Syst 2021; 31:2150030. [PMID: 34176450 DOI: 10.1142/s0129065721500301] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The common spatial patterns (CSP) algorithm is one of the most frequently used and effective spatial filtering methods for extracting relevant features for use in motor imagery brain-computer interfaces (MI-BCIs). However, the inherent defect of the traditional CSP algorithm is that it is highly sensitive to potential outliers, which adversely affects its performance in practical applications. In this work, we propose a novel feature optimization and outlier detection method for the CSP algorithm. Specifically, we use the minimum covariance determinant (MCD) to detect and remove outliers in the dataset, then we use the Fisher score to evaluate and select features. In addition, in order to prevent the emergence of new outliers, we propose an iterative minimum covariance determinant (IMCD) algorithm. We evaluate our proposed algorithm in terms of iteration times, classification accuracy and feature distribution using two BCI competition datasets. The experimental results show that the average classification performance of our proposed method is 12% and 22.9% higher than that of the traditional CSP method in two datasets ([Formula: see text]), and our proposed method obtains better performance in comparison with other competing methods. The results show that our method improves the performance of MI-BCI systems.
Collapse
Affiliation(s)
- Jing Jin
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Hua Fang
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Ian Daly
- Brain-Computer Interfacing and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex CO43SQ, UK
| | - Ruocheng Xiao
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Yangyang Miao
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Xingyu Wang
- Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, P. R. China
| | - Andrzej Cichocki
- Skolkowo Institute of Science and Technology (SKOLTECH), 143026 Moscow, Russia.,Systems Research Institute of Polish Academy of Science, 01-447 Warsaw, Poland.,Department of Informatics, Nicolaus Copernicus University, 87-100 Torun, Poland.,College of Computer Science, Hangzhou Dianzi University, 310018 Hangzhou, P. R. China
| |
Collapse
|
10
|
Hajek P, Barushka A, Munk M. Neural Networks with Emotion Associations, Topic Modeling and Supervised Term Weighting for Sentiment Analysis. Int J Neural Syst 2021; 31:2150013. [PMID: 33573532 DOI: 10.1142/s0129065721500131] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Automated sentiment analysis is becoming increasingly recognized due to the growing importance of social media and e-commerce platform review websites. Deep neural networks outperform traditional lexicon-based and machine learning methods by effectively exploiting contextual word embeddings to generate dense document representation. However, this representation model is not fully adequate to capture topical semantics and the sentiment polarity of words. To overcome these problems, a novel sentiment analysis model is proposed that utilizes richer document representations of word-emotion associations and topic models, which is the main computational novelty of this study. The sentiment analysis model integrates word embeddings with lexicon-based sentiment and emotion indicators, including negations and emoticons, and to further improve its performance, a topic modeling component is utilized together with a bag-of-words model based on a supervised term weighting scheme. The effectiveness of the proposed model is evaluated using large datasets of Amazon product reviews and hotel reviews. Experimental results prove that the proposed document representation is valid for the sentiment analysis of product and hotel reviews, irrespective of their class imbalance. The results also show that the proposed model improves on existing machine learning methods.
Collapse
Affiliation(s)
- Petr Hajek
- Science and Research Centre, Faculty of Economics and Administration, University of Pardubice, Studentska 84, 532 10 Pardubice, Czech Republic
| | - Aliaksandr Barushka
- Science and Research Centre, Faculty of Economics and Administration, University of Pardubice, Studentska 84, 532 10 Pardubice, Czech Republic
| | - Michal Munk
- Science and Research Centre, Faculty of Economics and Administration, University of Pardubice, Studentska 84, 532 10 Pardubice, Czech Republic.,Department of Computer Science, Constantine the Philosopher University in Nitra, 949 74 Nitra, Slovakia
| |
Collapse
|
11
|
Mao Y, Jin J, Xu R, Li S, Miao Y, Cichocki A. The Influence of Visual Attention on The Performance of A Novel Tactile P300 Brain-Computer Interface with Cheeks-Stim Paradigm. Int J Neural Syst 2021; 31:2150004. [PMID: 33438531 DOI: 10.1142/s0129065721500040] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Tactile P300 brain-computer interface (BCI) generally has a worse accuracy and information transfer rate (ITR) than the visual-based BCI. It may be due to the fact that human beings have a relatively poor tactile perception. This study investigated the influence of visual attention on the performance of a tactile P300 BCI. We designed our paradigms based on a novel cheeks-stim paradigm which attached the stimulators on the subject's cheeks. Two paradigms were designed as follows: a paradigm with no visual attention and another paradigm with visual attention to the target position. Eleven subjects were invited to perform the two paradigms. We also recorded and analyzed the eyeball movement data during the paradigm with visual attention to explore whether the eyeball movement would have an effect on the BCI classification. The average online accuracy was 89.09% for the paradigm with visual attention, which was significantly higher than that of the paradigm with no visual attention (70.45%). Significant difference in ITR was also found between the two paradigms ([Formula: see text]). The results demonstrated that visual attention was an effective method to improve the performance of tactile P300 BCI. Our findings suggested that it may be feasible to complete an efficient tactile BCI system by adding visual attention.
Collapse
Affiliation(s)
- Ying Mao
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Jing Jin
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Ren Xu
- Guger Technologies OG, Graz, Austria
| | - Shurui Li
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Yangyang Miao
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Andrzej Cichocki
- Center for Computational and Data-Intensive Science and Engineering Skolkovo Institute of Science and Technology (Skoltech), 121205 Moscow, Russia.,Department of Applied Computer Science, Nicolaus Copernicus University (UMK), 87-100 Torun, Poland
| |
Collapse
|
12
|
González-Redondo Á, Naveros F, Ros E, Garrido JA. A Basal Ganglia Computational Model to Explain the Paradoxical Sensorial Improvement in the Presence of Huntington's Disease. Int J Neural Syst 2020; 30:2050057. [PMID: 32840409 DOI: 10.1142/s0129065720500574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The basal ganglia (BG) represent a critical center of the nervous system for sensorial discrimination. Although it is known that Huntington's disease (HD) affects this brain area, it still remains unclear how HD patients achieve paradoxical improvement in sensorial discrimination tasks. This paper presents a computational model of the BG including the main nuclei and the typical firing properties of their neurons. The BG model has been embedded within an auditory signal detection task. We have emulated the effect that the altered levels of dopamine and the degree of HD affectation have in information processing at different layers of the BG, and how these aspects shape transient and steady states differently throughout the selection task. By extracting the independent components of the BG activity at different populations, it is evidenced that early and medium stages of HD affectation may enhance transient activity in the striatum and the substantia nigra pars reticulata. These results represent a possible explanation for the paradoxical improvement that HD patients present in discrimination task performance. Thus, this paper provides a novel understanding on how the fast dynamics of the BG network at different layers interact and enable transient states to emerge throughout the successive neuron populations.
Collapse
Affiliation(s)
| | - Francisco Naveros
- Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Eduardo Ros
- Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| | - Jesús A Garrido
- Department of Computer Architecture and Technology, University of Granada, Granada, Spain
| |
Collapse
|
13
|
Sorinas J, Fernandez-Troyano JC, Ferrandez JM, Fernandez E. Cortical Asymmetries and Connectivity Patterns in the Valence Dimension of the Emotional Brain. Int J Neural Syst 2020; 30:2050021. [PMID: 32268816 DOI: 10.1142/s0129065720500215] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Understanding the neurophysiology of emotions, the neuronal structures involved in processing emotional information and the circuits by which they act, is key to designing applications in the field of affective neuroscience, to advance both new treatments and applications of brain-computer interactions. However, efforts have focused on developing computational models capable of emotion classification instead of on studying the neural substrates involved in the emotional process. In this context, we have carried out a study of cortical asymmetries and functional cortical connectivity based on the electroencephalographic signal of 24 subjects stimulated with videos of positive and negative emotional content to bring some light to the neurobiology behind emotional processes. Our results show opposite interhemispheric asymmetry patterns throughout the cortex for both emotional categories and specific connectivity patterns regarding each of the studied emotional categories. However, in general, the same key areas, such as the right hemisphere and more anterior cortical regions, presented higher levels of activity during the processing of both valence emotional categories. These results suggest a common neural pathway for processing positive and negative emotions, but with different activation patterns. These preliminary results are encouraging for elucidating the neuronal circuits of the emotional valence dimension.
Collapse
Affiliation(s)
- Jennifer Sorinas
- Institute of Bioengineering, University Miguel Hernandez and CIBER BBN, Avenida de la Universidad, 03202 Elche, Spain
| | | | - Jose Manuel Ferrandez
- Department of Electronics and Computer Technology, University of Cartagena, Plaza del Hospital, 1, 30202 Cartagena, Spain
| | - Eduardo Fernandez
- Institute of Bioengineering, University Miguel Hernandez and CIBER BBN, Avenida de la Universidad, 03202 Elche, Spain
| |
Collapse
|
14
|
Sorinas J, Ferrández JM, Fernandez E. Brain and Body Emotional Responses: Multimodal Approximation for Valence Classification. SENSORS 2020; 20:s20010313. [PMID: 31935909 PMCID: PMC6982758 DOI: 10.3390/s20010313] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2019] [Revised: 01/02/2020] [Accepted: 01/03/2020] [Indexed: 11/16/2022]
Abstract
In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been used for emotion recognition purposes, however, their operation and the relationship between them remains unknown. In this context, in the present work, we have tried to approach the study of the psychobiology of both systems in order to generate a computational model for the recognition of emotions in the dimension of valence. To this end, the electroencephalography (EEG) signal, electrocardiography (ECG) signal and skin temperature of 24 subjects have been studied. Each methodology has been evaluated individually, finding characteristic patterns of positive and negative emotions in each of them. After feature selection of each methodology, the results of the classification showed that, although the classification of emotions is possible at both central and peripheral levels, the multimodal approach did not improve the results obtained through the EEG alone. In addition, differences have been observed between cerebral and peripheral responses in the processing of emotions by separating the sample by sex; though, the differences between men and women were only notable at the peripheral nervous system level.
Collapse
Affiliation(s)
- Jennifer Sorinas
- The Institute of Bioengineering, University Miguel Hernandez, 03202 Elche, Spain
- Department of Electronics and Computer Technology, University of Cartagena, 30202 Cartagena, Spain;
- Correspondence: (J.S.); (E.F.)
| | - Jose Manuel Ferrández
- Department of Electronics and Computer Technology, University of Cartagena, 30202 Cartagena, Spain;
| | - Eduardo Fernandez
- The Institute of Bioengineering, University Miguel Hernandez, 03202 Elche, Spain
- Correspondence: (J.S.); (E.F.)
| |
Collapse
|
15
|
Aydin S. Deep Learning Classification of Neuro-Emotional Phase Domain Complexity Levels Induced by Affective Video Film Clips. IEEE J Biomed Health Inform 2019; 24:1695-1702. [PMID: 31841425 DOI: 10.1109/jbhi.2019.2959843] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In the present article, a novel emotional complexity marker is proposed for classification of discrete emotions induced by affective video film clips. Principal Component Analysis (PCA) is applied to full-band specific phase space trajectory matrix (PSTM) extracted from short emotional EEG segment of 6 s, then the first principal component is used to measure the level of local neuronal complexity. As well, Phase Locking Value (PLV) between right and left hemispheres is estimated for in order to observe the superiority of local neuronal complexity estimation to regional neuro-cortical connectivity measurements in clustering nine discrete emotions (fear, anger, happiness, sadness, amusement, surprise, excitement, calmness, disgust) by using Long-Short-Term-Memory Networks as deep learning applications. In tests, two groups (healthy females and males aged between 22 and 33 years old) are classified with the accuracy levels of [Formula: see text] and [Formula: see text] through the proposed emotional complexity markers and and connectivity levels in terms of PLV in amusement. The groups are found to be statistically different ( p << 0.5) in amusement with respect to both metrics, even if gender difference does not lead to different neuro-cortical functions in any of the other discrete emotional states. The high deep learning classification accuracy of [Formula: see text] is commonly obtained for discrimination of positive emotions from negative emotions through the proposed new complexity markers. Besides, considerable useful classification performance is obtained in discriminating mixed emotions from each other through full-band connectivity features. The results reveal that emotion formation is mostly influenced by individual experiences rather than gender. In detail, local neuronal complexity is mostly sensitive to the affective valance rating, while regional neuro-cortical connectivity levels are mostly sensitive to the affective arousal ratings.
Collapse
|