1
|
Rahimi Saryazdi A, Ghassemi F, Tabanfar Z, Ansarinasab S, Nazarimehr F, Jafari S. EEG-based deception detection using weighted dual perspective visibility graph analysis. Cogn Neurodyn 2024; 18:3929-3949. [PMID: 39712118 PMCID: PMC11655749 DOI: 10.1007/s11571-024-10163-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Revised: 07/23/2024] [Accepted: 08/15/2024] [Indexed: 12/24/2024] Open
Abstract
Deception detection is a critical aspect across various domains. Integrating advanced signal processing techniques, particularly in neuroscientific studies, has opened new avenues for exploring deception at a deeper level. This study uses electroencephalogram (EEG) signals from a balanced cohort of 22 participants, consisting of both males and females, aged between 22 and 29, engaged in a visual task for instructed deception. We propose a novel approach in the realm of deception detection utilizing the Weighted Dual Perspective Visibility Graph (WDPVG) method to decode instructed deception by converting average epochs from each EEG channel into a complex network. Six graph-based features, including average and deviation of strength, weighted clustering coefficient, weighted clustering coefficient entropy, average weighted shortest path length, and modularity, are extracted, comprehensively representing the underlying brain dynamics associated with deception. Subsequently, these features are employed for classification using three distinct algorithms: K Nearest Neighbors (KNN), Support Vector Machine (SVM), and Decision Tree (DT). Experimental results reveal promising accuracy rates for KNN (66.64%), SVM (86.25%), and DT (82.46%). Furthermore, the features distributions of EEG networks are analyzed across different brain lobes, comparing truth-telling and lying modes. These analyses reveal the frontal and parietal lobes' potential in distinguishing between truth and deception, highlighting their active role during deceptive behavior. The findings demonstrate the WDPVG method's effectiveness in decoding deception from EEG signals, offering insights into the neural basis of deceptive behavior. This research could enhance the understanding of neuroscience and deception detection, providing a framework for future real-world applications.
Collapse
Affiliation(s)
- Ali Rahimi Saryazdi
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Farnaz Ghassemi
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Zahra Tabanfar
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Sheida Ansarinasab
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Fahimeh Nazarimehr
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Sajad Jafari
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
- Health Technology Research Institute, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| |
Collapse
|
2
|
Zhou Y, Bu F. An Overview of Advancements in Lie Detection Technology in Speech. INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGIES AND SYSTEMS APPROACH 2023. [DOI: 10.4018/ijitsa.316935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Lie detection technology in speech is a process of lying psychological state recognition according speech signal analysis. Normally, the emotion of tension if felt when people lie. As a result, this tension leads to some subtle changes of the sound channel structure; for example, the semantic characteristics, prosodic characteristics, resonance peak, and the psychoacoustics parameters all can be different from before. In this paper, the development situation of current lie detection technology is presented. Several public speech databases for lie detection are also introduced. Then, the research situation of feature expression, selection, and extraction for lie detection is described. In addition, the research progress of lie detection algorithm is highlighted. Finally, the future direction and the existing problems of lie detection technology in speech are summarized.
Collapse
Affiliation(s)
- Yan Zhou
- Suzhou Vocational University, China
| | - Feng Bu
- Suzhou Vocational University, China
| |
Collapse
|
3
|
Alaskar H, Sbaï Z, Khan W, Hussain A, Alrawais A. Intelligent techniques for deception detection: a survey and critical study. Soft comput 2022. [DOI: 10.1007/s00500-022-07603-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
4
|
Avola D, Cascio M, Cinque L, Fagioli A, Foresti GL. LieToMe: An Ensemble Approach for Deception Detection from Facial Cues. Int J Neural Syst 2020; 31:2050068. [PMID: 33200620 DOI: 10.1142/s0129065720500689] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Deception detection is a relevant ability in high stakes situations such as police interrogatories or court trials, where the outcome is highly influenced by the interviewed person behavior. With the use of specific devices, e.g. polygraph or magnetic resonance, the subject is aware of being monitored and can change his behavior, thus compromising the interrogation result. For this reason, video analysis-based methods for automatic deception detection are receiving ever increasing interest. In this paper, a deception detection approach based on RGB videos, leveraging both facial features and stacked generalization ensemble, is proposed. First, a face, which is well-known to present several meaningful cues for deception detection, is identified, aligned, and masked to build video signatures. These signatures are constructed starting from five different descriptors, which allow the system to capture both static and dynamic facial characteristics. Then, video signatures are given as input to four base-level algorithms, which are subsequently fused applying the stacked generalization technique, resulting in a more robust meta-level classifier used to predict deception. By exploiting relevant cues via specific features, the proposed system achieves improved performances on a public dataset of famous court trials, with respect to other state-of-the-art methods based on facial features, highlighting the effectiveness of the proposed method.
Collapse
Affiliation(s)
- Danilo Avola
- Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy
| | - Marco Cascio
- Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy
| | - Luigi Cinque
- Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy
| | - Alessio Fagioli
- Department of Computer Science, Sapienza University, Via Salaria 113, 00198 Rome, Italy
| | - Gian Luca Foresti
- Department of Computer Science, Mathematics and Physics, University of Udine, Via delle Scienze, 33100 Udine, Italy
| |
Collapse
|
5
|
Improved semi-supervised autoencoder for deception detection. PLoS One 2019; 14:e0223361. [PMID: 31593570 PMCID: PMC6782094 DOI: 10.1371/journal.pone.0223361] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2019] [Accepted: 09/19/2019] [Indexed: 11/19/2022] Open
Abstract
Existing algorithms of speech-based deception detection are severely restricted by the lack of sufficient number of labelled data. However, a large amount of easily available unlabelled data has not been utilized in reality. To solve this problem, this paper proposes a semi-supervised additive noise autoencoder model for deception detection. This model updates and optimizes the semi-supervised autoencoder and it consists of two layers of encoder and decoder, and a classifier. Firstly, it changes the activation function of the hidden layer in network according to the characteristics of the deception speech. Secondly, in order to prevent over-fitting during training, the specific ratio dropout is added at each layer cautiously. Finally, we directly connected the supervised classification task in the output of encoder to make the network more concise and efficient. Using the feature set specified by the INTERSPEECH 2009 Emotion Challenge, the experimental results on Columbia-SRI-Colorado (CSC) corpus and our own deception corpus show that the proposed model can achieve more advanced performance than other alternative methods with only a small amount of labelled data.
Collapse
|
6
|
Forecasting Crude Oil Prices Using Ensemble Empirical Mode Decomposition and Sparse Bayesian Learning. ENERGIES 2018. [DOI: 10.3390/en11071882] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Crude oil is one of the most important types of energy and its prices have a great impact on the global economy. Therefore, forecasting crude oil prices accurately is an essential task for investors, governments, enterprises and even researchers. However, due to the extreme nonlinearity and nonstationarity of crude oil prices, it is a challenging task for the traditional methodologies of time series forecasting to handle it. To address this issue, in this paper, we propose a novel approach that incorporates ensemble empirical mode decomposition (EEMD), sparse Bayesian learning (SBL), and addition, namely EEMD-SBL-ADD, for forecasting crude oil prices, following the “decomposition and ensemble” framework that is widely used in time series analysis. Specifically, EEMD is first used to decompose the raw crude oil price data into components, including several intrinsic mode functions (IMFs) and one residue. Then, we apply SBL to build an individual forecasting model for each component. Finally, the individual forecasting results are aggregated as the final forecasting price by simple addition. To validate the performance of the proposed EEMD-SBL-ADD, we use the publicly-available West Texas Intermediate (WTI) and Brent crude oil spot prices as experimental data. The experimental results demonstrate that the EEMD-SBL-ADD outperforms some state-of-the-art forecasting methodologies in terms of several evaluation criteria such as the mean absolute percent error (MAPE), the root mean squared error (RMSE), the directional statistic (Dstat), the Diebold–Mariano (DM) test, the model confidence set (MCS) test and running time, indicating that the proposed EEMD-SBL-ADD is promising for forecasting crude oil prices.
Collapse
|
7
|
Liu Z, Guo W, Tang Z, Chen Y. Multi-Sensor Data Fusion Using a Relevance Vector Machine Based on an Ant Colony for Gearbox Fault Detection. SENSORS (BASEL, SWITZERLAND) 2015; 15:21857-75. [PMID: 26334280 PMCID: PMC4610522 DOI: 10.3390/s150921857] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/07/2015] [Revised: 08/21/2015] [Accepted: 08/24/2015] [Indexed: 11/29/2022]
Abstract
Sensors play an important role in the modern manufacturing and industrial processes. Their reliability is vital to ensure reliable and accurate information for condition based maintenance. For the gearbox, the critical machine component in the rotating machinery, the vibration signals collected by sensors are usually noisy. At the same time, the fault detection results based on the vibration signals from a single sensor may be unreliable and unstable. To solve this problem, this paper proposes an intelligent multi-sensor data fusion method using the relevance vector machine (RVM) based on an ant colony optimization algorithm (ACO-RVM) for gearboxes' fault detection. RVM is a sparse probability model based on support vector machine (SVM). RVM not only has higher detection accuracy, but also better real-time accuracy compared with SVM. The ACO algorithm is used to determine kernel parameters of RVM. Moreover, the ensemble empirical mode decomposition (EEMD) is applied to preprocess the raw vibration signals to eliminate the influence caused by noise and other unrelated signals. The distance evaluation technique (DET) is employed to select dominant features as input of the ACO-RVM, so that the redundancy and inference in a large amount of features can be removed. Two gearboxes are used to demonstrate the performance of the proposed method. The experimental results show that the ACO-RVM has higher fault detection accuracy than the RVM with normal the cross-validation (CV).
Collapse
Affiliation(s)
- Zhiwen Liu
- School of Mechatronics Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
| | - Wei Guo
- School of Mechatronics Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
| | - Zhangchun Tang
- School of Mechatronics Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
| | - Yongqiang Chen
- School of Mechatronics Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
| |
Collapse
|