Reading between the lies: identifying concealed and falsified emotions in universal facial expressions

An On-Chip Processor for Chronic Neurological Disorders Assistance Using Negative Affectivity Classification

Chronic neurological disorders (CND's) are lifelong diseases and cannot be eradicated, but their severe effects can be alleviated by early preemptive measures. CND's, such as Alzheimer's, Autism Spectrum Disorder (ASD), and Amyotrophic Lateral Sclerosis (ALS), are the chronic ailment of the central nervous system that causes the degradation of emotional and cognitive abilities. Long term continuous monitoring with neuro-feedback of human emotions for patients with CND's is crucial in mitigating its harmful effect. This paper presents hardware efficient and dedicated human emotion classification processor for CND's. Scalp EEG is used for the emotion's classification using the valence and arousal scales. A linear support vector machine classifier is used with power spectral density, logarithmic interhemispheric power spectral ratio, and the interhemispheric power spectral difference of eight EEG channel locations suitable for a wearable non-invasive classification system. A look-up-table based logarithmic division unit (LDU) is to represent the division features in machine learning (ML) applications. The implemented LDU minimizes the cost of integer division by 34% for ML applications. The implemented emotion's classification processor achieved an accuracy of 72.96% and 73.14%, respectively, for the valence and arousal classification on multiple publicly available datasets. The 2 x 3mm² processor is fabricated using a 0.18 μm 1P6M CMOS process with power and energy utilization of 2.04 mW and 16 μJ/classification, respectively, for 8-channel operation.

Spatiotemporal Convolutional Neural Network with Convolutional Block Attention Module for Micro-Expression Recognition

A micro-expression is defined as an uncontrollable muscular movement shown on the face of humans when one is trying to conceal or repress his true emotions. Many researchers have applied the deep learning framework to micro-expression recognition in recent years. However, few have introduced the human visual attention mechanism to micro-expression recognition. In this study, we propose a three-dimensional (3D) spatiotemporal convolutional neural network with the convolutional block attention module (CBAM) for micro-expression recognition. First image sequences were input to a medium-sized convolutional neural network (CNN) to extract visual features. Afterwards, it learned to allocate the feature weights in an adaptive manner with the help of a convolutional block attention module. The method was testified in spontaneous micro-expression databases (Chinese Academy of Sciences Micro-expression II (CASME II), Spontaneous Micro-expression Database (SMIC)). The experimental results show that the 3D CNN with convolutional block attention module outperformed other algorithms in micro-expression recognition.

The Damaging Effects of Perceived Crocodile Tears for a Crier's Image

Emotional tears are uniquely human and play an essential role in the communication of distress in adults. Several studies have shown that individuals are more willing to offer emotional support and help a person in tears. Preliminary evidence suggests that this greater willingness to provide support is mediated via perceived warmth and helplessness. Moreover, tearful individuals are regarded as more reliable and honest. In the current study, we examined whether people can reliably distinguish genuine and fake crying, and what the consequences for the further evaluation of the crier are. A total of 202 participants (73 men, 129 women) were exposed to brief movie clips of genuine and fake crying adults and were asked to assess the criers. Results show that women were slightly better at identifying fake and genuine crying. How the crying was perceived subsequently seemed to have a strong influence on the further evaluation of the "crier." Criers qualified as pretenders were perceived as significantly more manipulative, less reliable, less warm, and less competent. Further, the respondents felt less connected with the perceived pretenders, who also were less welcomed as friends, colleagues, neighbors, and babysitter. They were additionally qualified as significantly less fit for "reliable" professions (judge, teacher, police officer, scientist, and physician). In contrast, the ratings of their fitness for "unreliable" professions (banker, CEO, journalist, real estate salesman, and politician) yielded a significant difference in only one video clip (and contrary to expectations). Our findings thus indicate that the subjective labeling of crying as fake is associated with a significantly less positive perception of the "crying" person, regardless of whether the crying is actually fake or genuine. The qualification of tears as crocodile tears thus seems to affect the crier's image strongly negatively.

Relevance Is Socially Rewarded, But Not at the Price of Accuracy

Selecting good sources of information is a critical skill to navigate our highly social world. To evaluate the epistemic reputation of potential sources, the main criterion should be the relevance of the information they provide us. In two online experiments (N = 801), we found that receivers are more thankful toward, deem more competent, and are more likely to request information in the future from sources of more relevant messages-if they know the message to be accurate or deem it plausible. To prevent sources from presenting information as more relevant than it is in order to improve their reputation, receivers lower the reputation of sources sending messages that are more relevant-if-true, if they know the message to be inaccurate. Our research sheds light on the reputational trade-offs involved in choosing what information to communicate and helps explain transmission patterns such as rumors diffusion.

Science or pseudoscience? A distinction that matters for police officers, lawyers and judges

Scientific knowledge has been a significant contributor to the development of better practices within law enforcement agencies. However, some alleged 'experts' have been shown to have disseminated information to police officers, lawyers and judges that is neither empirically tested nor supported by scientific theory. The aim of this article is to provide organisations within the justice system with an overview of a) what science is and is not; b) what constitutes an empirically driven, theoretically founded, peer-reviewed approach; and c) how to distinguish science from pseudoscience. Using examples in relation to non-verbal communication, this article aims to demonstrate that not all information which is presented as comprehensively evaluated is methodologically reliable for use in the justice system.

A comparison of the effectiveness of two types of deceit detection training methods in older adults

Background

In general, people are poor at detecting deception. Older adults are even worse than young adults at detecting deceit, which might make them uniquely vulnerable to certain types of financial fraud. One reason for poor deceit detection abilities is that lay theories of cues to deception are not valid. This study compared the effectiveness of two training methods to improve deceit detection among older adults: valid facial cues versus valid verbal cues to deception. Approximately 150 older adults were randomly assigned to facial training, verbal training, or a control condition. Participants completed a pre-test deceit detection task, their assigned training, and a post-test deceit detection task.

Results

Both training groups significantly improved at recognizing their respectively trained cues after training. However, the facial cue training group were less accurate at detecting deception post-test compared to pre-test and the control group exhibited improved accuracy of deceit detection from pre-test to post-test.

Conclusions

These results are consistent with the body of literature on deception suggesting people hover around chance accuracy, even after training. Older adults’ facial and verbal cue recognition can be improved with training, but these improvements did not translate into more accurate deceit detection, and actually hampered performance in the facial condition. Older adults showed the most benefit from sheer practice at detecting deception (in the control condition), perhaps because this condition encouraged implicit rather than explicit judgments of deception.

The Role of Low-Spatial Frequency Components in the Processing of Deceptive Faces: A Study Using Artificial Face Models

Interpreting another's true emotion is important for social communication, even in the face of deceptive facial cues. Because spatial frequency components provide important clues for recognizing facial expressions, we investigated how we use spatial frequency information from deceptive faces to interpret true emotion. We conducted two different tasks: a face-generating experiment in which participants were asked to generate deceptive and genuine faces by tuning the intensity of happy and angry expressions (Experiment 1) and a face-classification task in which participants had to classify presented faces as either deceptive or genuine (Experiment 2). Low- and high-spatial frequency (LSF and HSF) components were varied independently. The results showed that deceptive happiness (i.e., anger is the hidden expression) involved different intensities for LSF and HSF. These results suggest that we can identify hidden anger by perceiving unbalanced intensities of emotional expression between LSF and HSF information contained in deceptive faces.

Reading Lies: Nonverbal Communication and Deception

The relationship between nonverbal communication and deception continues to attract much interest, but there are many misconceptions about it. In this review, we present a scientific view on this relationship. We describe theories explaining why liars would behave differently from truth tellers, followed by research on how liars actually behave and individuals' ability to detect lies. We show that the nonverbal cues to deceit discovered to date are faint and unreliable and that people are mediocre lie catchers when they pay attention to behavior. We also discuss why individuals hold misbeliefs about the relationship between nonverbal behavior and deception-beliefs that appear very hard to debunk. We further discuss the ways in which researchers could improve the state of affairs by examining nonverbal behaviors in different ways and in different settings than they currently do.

I May Not Agree With You, but I Trust You: Caring About Social Issues Signals Integrity

What characteristics of an individual signal trustworthiness to other people? I propose that individuals who care about contentious social issues signal to observers that they have integrity and thus can be trusted. Critically, this signal conveys trustworthiness whether or not the target and the observer hold the same view on the issue. Five studies (N = 3,817) demonstrated the predicted effect of caring on integrity-based trust (Studies 1, 2, 3a, 3b, and 4)-even in cases of strong disagreement-across a variety of issues (Study 1) and when behavioral outcomes with real stakes were used (Studies 3a and 3b). This effect largely results from a perception of low-caring targets as particularly untrustworthy (Study 2). Additionally, participants trusted targets with staunchly opposing views about an issue even though they simultaneously disliked them (Study 4). These findings have important implications for how people form impressions of others and speak to potential interventions to help mitigate the growing ideological divide.

Microexpressions Differentiate Truths From Lies About Future Malicious Intent

The few previous studies testing whether or not microexpressions are indicators of deception have produced equivocal findings, which may have resulted from restrictive operationalizations of microexpression duration. In this study, facial expressions of emotion produced by community participants in an initial screening interview in a mock crime experiment were coded for occurrence and duration. Various expression durations were tested concerning whether they differentiated between truthtellers and liars concerning their intent to commit a malicious act in the future. We operationalized microexpressions as expressions occurring less than the duration of spontaneously occurring, non-concealed, non-repressed facial expressions of emotion based on empirically documented findings, that is ≤0.50 s, and then more systematically ≤0.40, ≤0.30, and ≤0.20 s. We also compared expressions occurring between 0.50 and 6.00 s and all expressions ≤6.00 s. Microexpressions of negative emotions occurring ≤0.40 and ≤0.50 s differentiated truthtellers and liars. Expressions of negative emotions occurring ≤6.00 s also differentiated truthtellers from liars but this finding did not survive when expressions ≤1.00 s were filtered from the data. These findings provided the first systematic evidence for the existence of microexpressions at various durations and their possible ability to differentiate truthtellers from liars about their intent to commit an act of malfeasance in the future.

The same with age: Evidence for age-related similarities in interpersonal accuracy

Interpersonal accuracy refers to the ability to make accurate perceptions about others' social and emotional qualities. Despite this broad definition, the measurement of interpersonal accuracy remains narrow, as most studies focus on the accurate perception of others' emotional states. Moreover, previous research has relied primarily upon traditional tasks consisting of posed, prototypic expressions and behaviors as stimuli. These methodological limitations may constrain our understanding of how different interpersonal perception skills change in adulthood. The present study investigated the extent to which various interpersonal perception skills are worse, better, or remain the same with age using both traditional and nontraditional interpersonal accuracy tasks. One hundred fifty-one adults from 3 age groups (young, middle age, and older) completed a battery of interpersonal accuracy tasks that assessed eight different emotion perception skills and six different social perception skills. Analyses revealed age-related differences in accuracy for five interpersonal perception skills; differences were typically observed between younger and older adults on emotion perception accuracy and between younger and middle-age adults on social perception accuracy. In contrast, almost all remaining interpersonal perception skills-both emotional and social-revealed greater evidence for age-related similarities than differences in Bayesian analyses. Additional exploratory analyses indicated that the observed age differences in interpersonal accuracy may be attributable to individual differences in cognitive ability rather than age. Results provide a nuanced picture of how interpersonal perception skills change in adulthood and provide new methodological tools for a more complete and comprehensive assessment of interpersonal accuracy. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

A False Trail to Follow: Differential Effects of the Facial Feedback Signals From the Upper and Lower Face on the Recognition of Micro-Expressions

Micro-expressions, as fleeting facial expressions, are very important for judging people’s true emotions, thus can provide an essential behavioral clue for lie and dangerous demeanor detection. From embodied accounts of cognition, we derived a novel hypothesis that facial feedback from upper and lower facial regions has differential effects on micro-expression recognition. This hypothesis was tested and supported across three studies. Specifically, the results of Study 1 showed that people became better judges of intense micro-expressions with a duration of 450 ms when the facial feedback from upper face was enhanced via a restricting gel. Additional results of Study 2 showed that the recognition accuracy of subtle micro-expressions was significantly impaired under all duration conditions (50, 150, 333, and 450 ms) when facial feedback from lower face was enhanced. In addition, the results of Study 3 also revealed that blocking the facial feedback of lower face, significantly boosted the recognition accuracy of subtle and intense micro-expressions under all duration conditions (150 and 450 ms). Together, these results highlight the role of facial feedback in judging the subtle movements of micro-expressions.

The effect of mouth opening in emotional faces on subjective experience and the early posterior negativity amplitude

Previous studies have examined the role of the eye region in emotional expressions, but the mouth region is understudied. The main goal of this study was to examine how mouth opening in emotional faces affects subjective experience and early automatic attentional capture, as measured by the early posterior negativity (EPN) amplitude. Participants in two studies viewed angry, happy, and neutral faces with mouths open and closed while their electroencephalogram was recorded. Afterwards, participants indicated how unpleasant-pleasant (i.e., valence) and calming-arousing (i.e., arousal) each face made them feel. Angry and happy faces (and neutral faces to a lesser extent) with an open vs. closed mouth made observers feel more extreme valence and arousal. In addition, there generally was an EPN for angry and happy faces (and neutral faces to a lesser extent) with open vs. closed mouths, which suggests that emotional expressions with an open mouth capture early automatic attention more than expressions with a closed mouth. Finally, the effects of mouth opening were somewhat modulated by face gender, but not by observer gender. The current findings contribute to our knowledge of facial expressions and social interaction, but also have relevance for the growing fields of social robotics and digital animation.

Face Value and Cheap Talk: How Smiles Can Increase or Decrease the Credibility of Our Words

How do our facial expressions affect the credibility of our words? We test whether smiles, either uninhibited or inhibited, affect the credibility of a written statement. Participants viewed a confederate partner displaying a neutral expression, non-Duchenne smile, Duchenne smile, or controlled smile, paired with a written statement. Participants then made a behavioral decision based on how credible they perceived the confederate's statement to be. Compared to a neutral expression, Experiment 1 found that participants were more likely to believe the confederate's statement when it was paired with a deliberate Duchenne smile and less likely to believe the confederate's statement when it was paired with a deliberate controlled smile. Experiment 2 replicated these findings with spontaneously emitted expressions. These findings provide evidence that uninhibited facial expressions can increase the credibility accompanying statements, while inhibited ones can decrease credibility.

The blenderFace method: video-based measurement of raw movement data during facial expressions of emotion using open-source software

This article proposes an optical measurement of movement applied to data from video recordings of facial expressions of emotion. The approach offers a way to capture motion adapted from the film industry in which markers placed on the skin of the face can be tracked with a pattern-matching algorithm. The method records and postprocesses raw facial movement data (coordinates per frame) of distinctly placed markers and is intended for use in facial expression research (e.g., microexpressions) in laboratory settings. Due to the explicit use of specifically placed, artificial markers, the procedure offers the simultaneous measurement of several emotionally relevant markers in a (psychometrically) objective and artifact-free way, even for facial regions without natural landmarks (e.g., the cheeks). In addition, the proposed procedure is fully based on open-source software and is transparent at every step of data processing. Two worked examples demonstrate the practicability of the proposed procedure: In Study 1(N= 39), the participants were instructed to show the emotions happiness, sadness, disgust, and anger, and in Study 2 (N= 113), they were asked to present both a neutral face and the emotions happiness, disgust, and fear. Study 2 involved the simultaneous tracking of 14 markers for approximately 12 min per participant with a time resolution of 33 ms. The measured facial movements corresponded closely to the assumptions of established measurement instruments (EMFACS, FACSAID, Friesen & Ekman, 1983; Ekman & Hager, 2002). In addition, the measurement was found to be very precise with sub-second, sub-pixel, and sub-millimeter accuracy.

A Survey of Automatic Facial Micro-Expression Analysis: Databases, Methods, and Challenges

Over the last few years, automatic facial micro-expression analysis has garnered increasing attention from experts across different disciplines because of its potential applications in various fields such as clinical diagnosis, forensic investigation and security systems. Advances in computer algorithms and video acquisition technology have rendered machine analysis of facial micro-expressions possible today, in contrast to decades ago when it was primarily the domain of psychiatrists where analysis was largely manual. Indeed, although the study of facial micro-expressions is a well-established field in psychology, it is still relatively new from the computational perspective with many interesting problems. In this survey, we present a comprehensive review of state-of-the-art databases and methods for micro-expressions spotting and recognition. Individual stages involved in the automation of these tasks are also described and reviewed at length. In addition, we also deliberate on the challenges and future directions in this growing field of automatic facial micro-expression analysis.

High-Speed Video System for Micro-Expression Detection and Recognition

Micro-expressions play an essential part in understanding non-verbal communication and deceit detection. They are involuntary, brief facial movements that are shown when a person is trying to conceal something. Automatic analysis of micro-expression is challenging due to their low amplitude and to their short duration (they occur as fast as 1/15 to 1/25 of a second). We propose a fully micro-expression analysis system consisting of a high-speed image acquisition setup and a software framework which can detect the frames when the micro-expressions occurred as well as determine the type of the emerged expression. The detection and classification methods use fast and simple motion descriptors based on absolute image differences. The recognition module it only involves the computation of several 2D Gaussian probabilities. The software framework was tested on two publicly available high speed micro-expression databases and the whole system was used to acquire new data. The experiments we performed show that our solution outperforms state of the art works which use more complex and computationally intensive descriptors.

Dual Temporal Scale Convolutional Neural Network for Micro-Expression Recognition

Facial micro-expression is a brief involuntary facial movement and can reveal the genuine emotion that people try to conceal. Traditional methods of spontaneous micro-expression recognition rely excessively on sophisticated hand-crafted feature design and the recognition rate is not high enough for its practical application. In this paper, we proposed a Dual Temporal Scale Convolutional Neural Network (DTSCNN) for spontaneous micro-expressions recognition. The DTSCNN is a two-stream network. Different of stream of DTSCNN is used to adapt to different frame rate of micro-expression video clips. Each stream of DSTCNN consists of independent shallow network for avoiding the overfitting problem. Meanwhile, we fed the networks with optical-flow sequences to ensure that the shallow networks can further acquire higher-level features. Experimental results on spontaneous micro-expression databases (CASME I/II) showed that our method can achieve a recognition rate almost 10% higher than what some state-of-the-art method can achieve.

Psychological Perspectives on Interrogation

Proponents of “enhanced interrogation techniques” in the United States have claimed that such methods are necessary for obtaining information from uncooperative terrorism subjects. In the present article, we offer an informed, academic perspective on such claims. Psychological theory and research shows that harsh interrogation methods are ineffective. First, they are likely to increase resistance by the subject rather than facilitate cooperation. Second, the threatening and adversarial nature of harsh interrogation is often inimical to the goal of facilitating the retrieval of information from memory and therefore reduces the likelihood that a subject will provide reports that are extensive, detailed, and accurate. Third, harsh interrogation methods make lie detection difficult. Analyzing speech content and eliciting verifiable details are the most reliable cues to assessing credibility; however, to elicit such cues subjects must be encouraged to provide extensive narratives, something that does not occur in harsh interrogations. Evidence is accumulating for the effectiveness of rapport-based information-gathering approaches as an alternative to harsh interrogations. Such approaches promote cooperation, enhance recall of relevant and reliable information, and facilitate assessments of credibility. Given the available evidence that torture is ineffective, why might some laypersons, policymakers, and interrogation personnel support the use of torture? We conclude our review by offering a psychological perspective on this important question.

"You Should Have Seen the Look on Your Face…": Self-awareness of Facial Expressions

The awareness of facial expressions allows one to better understand, predict, and regulate his/her states to adapt to different social situations. The present research investigated individuals' awareness of their own facial expressions and the influence of the duration and intensity of expressions in two self-reference modalities, a real-time condition and a video-review condition. The participants were instructed to respond as soon as they became aware of any facial movements. The results revealed that awareness rates were 57.79% in the real-time condition and 75.92% in the video-review condition. The awareness rate was influenced by the intensity and (or) the duration. The intensity thresholds for individuals to become aware of their own facial expressions were calculated using logistic regression models. The results of Generalized Estimating Equations (GEE) revealed that video-review awareness was a significant predictor of real-time awareness. These findings extend understandings of human facial expression self-awareness in two modalities.

Alexithymia and automatic processing of emotional stimuli: a systematic review

Alexithymia is a personality trait characterized by difficulties in recognizing and verbalizing emotions and the utilization of a cognitive style that is oriented toward external events, rather than intrapsychic experiences. Alexithymia is considered a vulnerability factor influencing onset and course of many psychiatric disorders. Even though emotions are, in general, elicited involuntarily and emerge without conscious effort, it is surprising that little attention in etiological considerations concerning alexithymia has been given to deficits in automatic emotion processing and their neurobiological bases. In this article, results from studies using behavioral or neurobiological research methods were systematically reviewed in which automatic processing of external emotional information was investigated as a function of alexithymia in healthy individuals. Twenty-two studies were identified through a literature search of Psycinfo, PubMed, and Web of Science databases from 1990 to 2016. The review reveals deficits in the automatic processing of emotional stimuli in alexithymia at a behavioral and neurobiological level. The vast majority of the reviewed studies examined visual processing. The alexithymia facets externally oriented thinking and difficulties identifying feelings were found to be related to impairments in the automatic processing of threat-related facial expressions. Alexithymic individuals manifest low reactivity to barely visible negative emotional stimuli in brain regions responsible for appraisal, encoding, and affective response, e.g. amygdala, occipitotemporal areas, and insula. Against this background, it appears plausible to assume that deficits in automatic emotion processing could be factors contributing to alexithymic personality characteristics. Directions for future research on alexithymia and automatic emotion perception are suggested.

Inferring Perspective Versus Getting Perspective: Underestimating the Value of Being in Another Person’s Shoes

People use at least two strategies to solve the challenge of understanding another person’s mind: inferring that person’s perspective by reading his or her behavior (theorization) and getting that person’s perspective by experiencing his or her situation (simulation). The five experiments reported here demonstrate a strong tendency for people to underestimate the value of simulation. Predictors estimated a stranger’s emotional reactions toward 50 pictures. They could either infer the stranger’s perspective by reading his or her facial expressions or simulate the stranger’s perspective by watching the pictures he or she viewed. Predictors were substantially more accurate when they got perspective through simulation, but overestimated the accuracy they had achieved by inferring perspective. Predictors’ miscalibrated confidence stemmed from overestimating the information revealed through facial expressions and underestimating the similarity in people’s reactions to a given situation. People seem to underappreciate a useful strategy for understanding the minds of others, even after they gain firsthand experience with both strategies.

Comparing a Perceptual and an Automated Vision-Based Method for Lie Detection in Younger Children

The present study investigates how easily it can be detected whether a child is being truthful or not in a game situation, and it explores the cue validity of bodily movements for such type of classification. To achieve this, we introduce an innovative methodology – the combination of perception studies (in which eye-tracking technology is being used) and automated movement analysis. Film fragments from truthful and deceptive children were shown to human judges who were given the task to decide whether the recorded child was being truthful or not. Results reveal that judges are able to accurately distinguish truthful clips from lying clips in both perception studies. Even though the automated movement analysis for overall and specific body regions did not yield significant results between the experimental conditions, we did find a positive correlation between the amount of movement in a child and the perception of lies, i.e., the more movement the children exhibited during a clip, the higher the chance that the clip was perceived as a lie. The eye-tracking study revealed that, even when there is movement happening in different body regions, judges tend to focus their attention mainly on the face region. This is the first study that compares a perceptual and an automated method for the detection of deceptive behavior in children whose data have been elicited through an ecologically valid paradigm.

Electrophysiological Evidence Reveals Differences between the Recognition of Microexpressions and Macroexpressions

Microexpressions are fleeting facial expressions that are important for judging people's true emotions. Little is known about the neural mechanisms underlying the recognition of microexpressions (with duration of less than 200 ms) and macroexpressions (with duration of greater than 200 ms). We used an affective priming paradigm in which a picture of a facial expression is the prime and an emotional word is the target, and electroencephalogram (EEG) and event-related potentials (ERPs) to examine neural activities associated with recognizing microexpressions and macroexpressions. The results showed that there were significant main effects of duration and valence for N170/vertex positive potential. The main effect of congruence for N400 is also significant. Further, sLORETA showed that the brain regions responsible for these significant differences included the inferior temporal gyrus and widespread regions of the frontal lobe. Furthermore, the results suggested that the left hemisphere was more involved than the right hemisphere in processing a microexpression. The main effect of duration for the event-related spectral perturbation (ERSP) was significant, and the theta oscillations (4 to 8 Hz) increased in recognizing expressions with a duration of 40 ms compared with 300 ms. Thus, there are different EEG/ERPs neural mechanisms for recognizing microexpressions compared to recognizing macroexpressions.

What a Smile Means: Contextual Beliefs and Facial Emotion Expressions in a Non-verbal Zero-Sum Game

Research into the authenticity of facial emotion expressions often focuses on the physical properties of the face while paying little attention to the role of beliefs in emotion perception. Further, the literature most often investigates how people express a pre-determined emotion rather than what facial emotion expressions people strategically choose to express. To fill these gaps, this paper proposes a non-verbal zero-sum game - the Face X Game - to assess the role of contextual beliefs and strategic displays of facial emotion expression in interpersonal interactions. This new research paradigm was used in a series of three studies, where two participants are asked to play the role of the sender (individual expressing emotional information on his/her face) or the observer (individual interpreting the meaning of that expression). Study 1 examines the outcome of the game with reference to the sex of the pair, where senders won more frequently when the pair was comprised of at least one female. Study 2 examines the strategic display of facial emotion expressions. The outcome of the game was again contingent upon the sex of the pair. Among female pairs, senders won the game more frequently, replicating the pattern of results from study 1. We also demonstrate that senders who strategically express an emotion incongruent with the valence of the event (e.g., smile after seeing a negative event) are able to mislead observers, who tend to hold a congruent belief about the meaning of the emotion expression. If sending an incongruent signal helps to explain why female senders win more frequently, it logically follows that female observers were more prone to hold a congruent, and therefore inaccurate, belief. This prospect implies that while female senders are willing and/or capable of displaying fake smiles, paired-female observers are not taking this into account. Study 3 investigates the role of contextual factors by manipulating female observers' beliefs. When prompted to think in an incongruent manner, these observers significantly improve their performance in the game. These findings emphasize the role that contextual factors play in emotion perception-observers' beliefs do indeed affect their judgments of facial emotion expressions.

Hiding true emotions: micro-expressions in eyes retrospectively concealed by mouth movements

When we encounter someone we dislike, we may momentarily display a reflexive disgust expression, only to follow-up with a forced smile and greeting. Our daily lives are replete with a mixture of true and fake expressions. Nevertheless, are these fake expressions really effective at hiding our true emotions? Here we show that brief emotional changes in the eyes (micro-expressions, thought to reflect true emotions) can be successfully concealed by follow-up mouth movements (e.g. a smile). In the same manner as backward masking, mouth movements of a face inhibited conscious detection of all types of micro-expressions in that face, even when viewers paid full attention to the eye region. This masking works only in a backward direction, however, because no disrupting effect was observed when the mouth change preceded the eye change. These results provide scientific evidence for everyday behaviours like smiling to dissemble, and further clarify a major reason for the difficulty we face in discriminating genuine from fake emotional expressions.

Quantitative analysis of Euclidean distance to complement qualitative analysis of facial expression during deception

BACKGROUND

Accurate evaluation of an individuals' veracity is a fundamental aspect of social functioning that allows individuals to act in adaptive ways. The domain of deception detection ability is still young, and many components in this field are yet to be touched which demands more research in this field.

AIMS

The present study aims at deciphering the structural composition of face during felt, posed, and deceived emotions in facial expression unique to Indian culture, using Facial Action Coding System (FACS). Quantitative analysis of Euclidean distance has been done to complement qualitative FACS analysis.

METHODS

In this study, thirty female, young adults with age range of 23-27 years were chosen randomly for portraying their (felt, posed, and deceived) facial expression. All facial expressions were captured through instruction, and videos were converted into static images. The static images were coded on the basis of FACS to decipher the felt, posed, and deceived expressions. Quantitative analysis of the data has been done using MATLAB to meet the objectives of the study and to complement the qualitative analysis.

RESULTS

Felt and posed emotions differ in terms of intensity of the expression and subjective experience. Posed emotional and deceived expressions differ in intent. Facial asymmetry is an important indicator for detecting deception.

Micro-Expression Recognition Using Color Spaces

Micro-expressions are brief involuntary facial expressions that reveal genuine emotions and, thus, help detect lies. Because of their many promising applications, they have attracted the attention of researchers from various fields. Recent research reveals that two perceptual color spaces (CIELab and CIELuv) provide useful information for expression recognition. This paper is an extended version of our International Conference on Pattern Recognition paper, in which we propose a novel color space model, tensor independent color space (TICS), to help recognize micro-expressions. In this paper, we further show that CIELab and CIELuv are also helpful in recognizing micro-expressions, and we indicate why these three color spaces achieve better performance. A micro-expression color video clip is treated as a fourth-order tensor, i.e., a four-dimension array. The first two dimensions are the spatial information, the third is the temporal information, and the fourth is the color information. We transform the fourth dimension from RGB into TICS, in which the color components are as independent as possible. The combination of dynamic texture and independent color components achieves a higher accuracy than does that of RGB. In addition, we define a set of regions of interests (ROIs) based on the facial action coding system and calculated the dynamic texture histograms for each ROI. Experiments are conducted on two micro-expression databases, CASME and CASME 2, and the results show that the performances for TICS, CIELab, and CIELuv are better than those for RGB or gray.

The effects of alcohol on the recognition of facial expressions and microexpressions of emotion: enhanced recognition of disgust and contempt

OBJECTIVE

The study compared alcohol's effects on the recognition of briefly displayed facial expressions of emotion (so-called microexpressions) with expressions presented for a longer period.

METHOD

Using a repeated-measures design, we tested 18 participants three times (counterbalanced), after (i) a placebo drink, (ii) a low-to-moderate dose of alcohol (0.17 g/kg women; 0.20 g/kg men) and (iii) a moderate-to-high dose of alcohol (0.52 g/kg women; 0.60 g/kg men). On each session, participants were presented with stimuli representing six emotions (happiness, sadness, anger, fear, disgust and contempt) overlaid on a generic avatar in a six-alternative forced-choice paradigm. A neutral expression (1 s) preceded and followed a target expression presented for 200 ms (microexpressions) or 400 ms. Participants mouse clicked the correct answer.

RESULTS

The recognition of disgust was significantly better after the high dose of alcohol than after the low dose or placebo drinks at both durations of stimulus presentation. A similar profile of effects was found for the recognition of contempt. There were no effects on response latencies.

CONCLUSION

Alcohol can increase sensitivity to expressions of disgust and contempt. Such effects are not dependent on stimulus duration up to 400 ms and may reflect contextual modulation of alcohol's effects on emotion recognition.

Human-Android Interaction in the Near and Distant Future

In this article, a psychologist and an artificial-intelligence (AI) researcher speculate on the future of social interaction between humans and androids (robots designed to look and act exactly like people). We review the trajectory of currently developing robotics technologies and assess the level of android sophistication likely to be achieved in 50 years time. On the basis of psychological research, we consider obstacles to creating an android indistinguishable from humans. Finally, we discuss the implications of human-android social interaction from the standpoint of current psychological and AI research and speculate on the novel psychological issues likely to arise from such interaction. The science of psychology will face a remarkable new set of challenges in grappling with human-android interaction.

Cognitive-load approaches to detect deception: searching for cognitive mechanisms

A current focus in deception research is on developing cognitive-load approaches (CLAs) to detect deception. The aim is to improve lie detection with evidence-based and ecologically valid procedures. Although these approaches show great potential, research on cognitive processes or mechanisms explaining how they operate is lacking. Potential mechanisms underlying the most popular techniques advocated for field application are highlighted. Cognitive scientists are encouraged to conduct basic research that qualifies the 'cognitive' in these new approaches.