Facial expressions of emotion: a cognitive neuroscience perspective

A Model for Emotional Intelligence in Biology Education Research

Informed by social science fields including psychology and public health, we propose a Model for Emotional Intelligence to advance biology education research in affective learning. The model offers a shared discourse for biology education researchers to develop and assess evidence-based strategies to perceive, use, understand, and manage emotions for students and instructors in life sciences classrooms. We begin by reviewing the connection between stress, emotional invalidation, Sense of Belonging, and Science Identity as it relates to emotions in undergraduate life sciences classrooms. Next, we highlight the impact that emotionally invalidating classroom environments have on science students' development of psychological distress, maladaptive coping, and high-risk behaviors. Assuming Emotional Intelligence can be taught and learned (i.e., the ability model of Emotional Intelligence), we develop a Model for Emotional Intelligence to advance biology education research in this arena. This essay aims to inform assessments of current and future interventions designed to counteract emotional invalidation and encourage the development of emotional management among students and instructors. In alignment with our collective effort to support student well-being in the life sciences, the study of Emotional Intelligence in undergraduate biology education has the potential to support student mental health as future scientists and health care practitioners.

Neurobiology and Anatomy of Facial Expressions in Great Apes: Application of the AnimalFACS and Its Possible Association with the Animal's Affective State

The Facial Action Coding System (FACS) is an anatomically based system to study facial expression in humans. Currently, it is recognized that nonhuman animals, particularly nonhuman primates, have an extensive facial ethogram that changes according to the context and affective state. The facial expression of great apes, the closest species to humans, has been studied using the ChimpFACS and OrangFACS as reliable tools to code facial expressions. However, although the FACS does not infer animal emotions, making additional evaluations and associating the facial changes with other parameters could contribute to understanding the facial expressions of nonhuman primates during positive or negative emotions. The present review aims to discuss the neural correlates and anatomical components of emotional facial expression in great apes. It will focus on the use of Facial Action Coding Systems (FACSs) and the movements of the facial muscles (AUs) of chimpanzees, orangutans, and gorillas and their possible association with the affective state of great apes.

Full and Partial Facial Affect Recognition in Pediatric Brain Tumour Survivors and Typically Developing Children Following COVID-19 Pandemic

Affect recognition has emerged as a potential mechanism underlying the social competence challenges experienced by pediatric brain tumour survivors (PBTSs). However, many social interactions were altered during the pandemic, with the widespread use of masking potentially impacting affect recognition abilities. Here, we examine affect recognition in PBTSs and typically developing youth (TD) after the onset of the global pandemic. Twenty-three PBTSs and 24 TD between 8 and 16 years old were recruited and completed two performance-based affect recognition tasks (full and partial facial features) and a self-reported questionnaire on mask exposure in their social interactions. Their parents completed parent proxy questionnaires on their child's social adjustment and sociodemographics. The scores between the PBTSs and TD did not differ significantly in full (t(45) = 1.33, p = 0.19, d = 0.39, 95% CI [-0.69, 3.40]) or partial (t(37.36) = 1.56, p = 0.13, d = 0.46, 95% CI [-0.47, 3.60]) affect recognition, suggesting similar affect recognition between the two groups. These skills were also not significantly correlated with social adjustment or mask exposure (p > 0.05). However, the combined sample had significantly better scores in affect recognition when exposed to partial facial cues versus full. Additionally, participants obtained lower scores on a measure of full facial affect recognition and higher scores on a measure of partial affect recognition compared to pre-pandemic data. The pandemic may have influenced affect recognition across youth, underscoring the importance of further research into its lasting impact on the social competence of youth.

Stepping into emotions: investigating the effect of angry and fearful faces on forward stepping and quiet stance

Introduction

Facial expressions conveying an emotion may affect social interactions, such as approach- or avoidance-related behaviors. A specific facial feature is the gaze direction. An emotional facial expression such as anger will elicit distinct behavioral tendencies, depending on whether the angry gaze is directed toward the onlooker, or in a different direction. We tested whether facial expressions of anger and fear, combined with direct or averted gaze, elicit approach- or avoidance tendencies, using a go/no-go variant of the whole-body stepping task.

Method

Healthy adults stood on a force plate, recording the center of pressure (COP). Participants were presented with angry or fearful faces; either with direct or averted gaze. Participants had to identify the emotion, and "depending on instructions- either make a single step forward, or remain in a quiet stance. From the COP of the forward steps, we derived parameters such as reaction time and step size. From the quiet standing trials we derived parameters of postural sway, indicative of postural "freeze." We used analysis of variance to analyze the outcomes.

Results and discussion

First, we found that steps were initiated faster with angry faces than with fearful faces, in line with existing literature. Second, we did not observe a significant effect of gaze direction. Forward steps with direct and averted gaze had similar COP characteristics. Finally, we had expected to find freeze (postural immobility) with fearful faces, but this was also not observed. We discuss various explanations for the finding, and implications for research into the motoric grounding of social interactions.

Recognizing and Looking at Masked Emotional Faces in Alexithymia

Alexithymia is a clinically relevant personality construct characterized by difficulties identifying and communicating one's emotions and externally oriented thinking. Alexithymia has been found to be related to poor emotion decoding and diminished attention to the eyes. The present eye tracking study investigated whether high levels of alexithymia are related to impairments in recognizing emotions in masked faces and reduced attentional preference for the eyes. An emotion recognition task with happy, fearful, disgusted, and neutral faces with face masks was administered to high-alexithymic and non-alexithymic individuals. Hit rates, latencies of correct responses, and fixation duration on eyes and face mask were analyzed as a function of group and sex. Alexithymia had no effects on accuracy and speed of emotion recognition. However, alexithymic men showed less attentional preference for the eyes relative to the mask than non-alexithymic men, which was due to their increased attention to face masks. No fixation duration differences were observed between alexithymic and non-alexithymic women. Our data indicate that high levels of alexithymia might not have adverse effects on the efficiency of emotion recognition from faces wearing masks. Future research on gaze behavior during facial emotion recognition in high alexithymia should consider sex as a moderating variable.

The Story behind the Mask: A Narrative Review on Hypomimia in Parkinson's Disease

Facial movements are crucial for social and emotional interaction and well-being. Reduced facial expressions (i.e., hypomimia) is a common feature in patients with Parkinson's disease (PD) and previous studies linked this manifestation to both motor symptoms of the disease and altered emotion recognition and processing. Nevertheless, research on facial motor impairment in PD has been rather scarce and only a limited number of clinical evaluation tools are available, often suffering from poor validation processes and high inter- and intra-rater variability. In recent years, the availability of technology-enhanced quantification methods of facial movements, such as automated video analysis and machine learning application, led to increasing interest in studying hypomimia in PD. In this narrative review, we summarize the current knowledge on pathophysiological hypotheses at the basis of hypomimia in PD, with particular focus on the association between reduced facial expressions and emotional processing and analyze the current evaluation tools and management strategies for this symptom, as well as future research perspectives.

Trait anger and negative interpretation bias in neutral face perception

Introduction

Anger is a basic emotion helping people to achieve goals by preparing the body for action and prompting others to change their behavior but is also associated with health issues and risks. Trait anger, the disposition to experience angry feelings, goes along with an attribution of hostile traits to others. Negative distortions in the interpretation of social information have also been observed in anxiety and depression. The present study examined the associations between components of anger and negative interpretation tendencies in the perception of ambiguous and neutral schematic faces controlling for anxiety, depressed mood, and other variables.

Methods

A sample of 150 young adults performed a computer-based perception of facial expressions task and completed the State-Trait Anger Expression Inventory (STAXI-2) along with other self-report measures and tests.

Results

Trait anger and anger expression correlated with the perception of negative affects in neutral but not in ambiguous faces. More specifically, trait anger was linked to the attribution of anger, sadness, and anxiety to neutral faces. Trait anger predicted perceived negative affects in neutral faces when adjusting for anxiety, depression, and state anger.

Discussion

For neutral schematic faces, the present data support an association between trait anger and negatively biased interpretation of facial expression, which is independent of anxiety and depressed mood. The negative interpretation of neutral schematic faces in trait angry individuals seems not only to comprise the attribution of anger but also of negative emotions signaling weakness. Neutral schematic facial expressions might be useful stimuli in the future study of anger-related interpretation biases.

Reduced Fusiform Gyrus Activation During Face Processing in Pediatric Brain Tumor Survivors

OBJECTIVE

The neural mechanisms contributing to the social problems of pediatric brain tumor survivors (PBTS) are unknown. Face processing is important to social communication, social behavior, and peer acceptance. Research with other populations with social difficulties, namely autism spectrum disorder, suggests atypical brain activation in areas important for face processing. This case-controlled functional magnetic resonance imaging (fMRI) study compared brain activation during face processing in PBTS and typically developing (TD) youth.

METHODS

Participants included 36 age-, gender-, and IQ-matched youth (N = 18 per group). PBTS were at least 5 years from diagnosis and 2 years from the completion of tumor therapy. fMRI data were acquired during a face identity task and a control condition. Groups were compared on activation magnitude within the fusiform gyrus for the faces condition compared to the control condition. Correlational analyses evaluated associations between neuroimaging metrics and indices of social behavior for PBTS participants.

RESULTS

Both groups demonstrated face-specific activation within the social brain for the faces condition compared to the control condition. PBTS showed significantly decreased activation for faces in the medial portions of the fusiform gyrus bilaterally compared to TD youth, ps ≤ .004. Higher peak activity in the left fusiform gyrus was associated with better socialization (r = .53, p < .05).

CONCLUSIONS

This study offers initial evidence of atypical activation in a key face processing area in PBTS. Such atypical activation may underlie some of the social difficulties of PBTS. Social cognitive neuroscience methodologies may elucidate the neurobiological bases for PBTS social behavior.

The neurobiology of pain and facial movements in rodents: Clinical applications and current research

One of the most controversial aspects of the use of animals in science is the production of pain. Pain is a central ethical concern. The activation of neural pathways involved in the pain response has physiological, endocrine, and behavioral consequences, that can affect both the health and welfare of the animals, as well as the validity of research. The strategy to prevent these consequences requires understanding of the nociception process, pain itself, and how assessment can be performed using validated, non-invasive methods. The study of facial expressions related to pain has undergone considerable study with the finding that certain movements of the facial muscles (called facial action units) are associated with the presence and intensity of pain. This review, focused on rodents, discusses the neurobiology of facial expressions, clinical applications, and current research designed to better understand pain and the nociceptive pathway as a strategy for implementing refinement in biomedical research.

The impact of face masks on emotion recognition performance and perception of threat

Facial emotion recognition is crucial for social interaction. However, in times of a global pandemic, where wearing a face mask covering mouth and nose is widely encouraged to prevent the spread of disease, successful emotion recognition may be challenging. In the current study, we investigated whether emotion recognition, assessed by a validated emotion recognition task, is impaired for faces wearing a mask compared to uncovered faces, in a sample of 790 participants between 18 and 89 years (condition mask vs. original). In two more samples of 395 and 388 participants between 18 and 70 years, we assessed emotion recognition performance for faces that are occluded by something other than a mask, i.e., a bubble as well as only showing the upper part of the faces (condition half vs. bubble). Additionally, perception of threat for faces with and without occlusion was assessed. We found impaired emotion recognition for faces wearing a mask compared to faces without mask, for all emotions tested (anger, fear, happiness, sadness, disgust, neutral). Further, we observed that perception of threat was altered for faces wearing a mask. Upon comparison of the different types of occlusion, we found that, for most emotions and especially for disgust, there seems to be an effect that can be ascribed to the face mask specifically, both for emotion recognition performance and perception of threat. Methodological constraints as well as the importance of wearing a mask despite temporarily compromised social interaction are discussed.

Eye Size Affects Cuteness in Different Facial Expressions and Ages

Researchers have suggested that infants exhibiting baby schema are considered cute. These similar studies have mainly focused on changes in overall baby schema facial features. However, whether a change in only eye size affects the perception of cuteness across different facial expressions and ages has not been explicitly evaluated until now. In the present study, a paired comparison method and 7-point scale were used to investigate the effects of eye size on perceived cuteness across facial expressions (positive, neutral, and negative) and ages (adults and infants). The results show that stimuli with large eyes were perceived to be cuter than both unmanipulated eyes and small eyes across all facial expressions and age groups. This suggests not only that the effect of baby schema on cuteness is based on changes in a set of features but also that eye size as an individual feature can affect the perception of cuteness.

Beyond Face and Voice: A Review of Alexithymia and Emotion Perception in Music, Odor, Taste, and Touch

Alexithymia is a clinically relevant personality trait characterized by deficits in recognizing and verbalizing one's emotions. It has been shown that alexithymia is related to an impaired perception of external emotional stimuli, but previous research focused on emotion perception from faces and voices. Since sensory modalities represent rather distinct input channels it is important to know whether alexithymia also affects emotion perception in other modalities and expressive domains. The objective of our review was to summarize and systematically assess the literature on the impact of alexithymia on the perception of emotional (or hedonic) stimuli in music, odor, taste, and touch. Eleven relevant studies were identified. On the basis of the reviewed research, it can be preliminary concluded that alexithymia might be associated with deficits in the perception of primarily negative but also positive emotions in music and a reduced perception of aversive taste. The data available on olfaction and touch are inconsistent or ambiguous and do not allow to draw conclusions. Future investigations would benefit from a multimethod assessment of alexithymia and control of negative affect. Multimodal research seems necessary to advance our understanding of emotion perception deficits in alexithymia and clarify the contribution of modality-specific and supramodal processing impairments.

Face Processing and Social Functioning in Pediatric Brain Tumor Survivors

OBJECTIVE

Pediatric brain tumor survivors (PBTS) experience deficits in social functioning. Facial expression and identity recognition are key components of social information processing and are widely studied as an index of social difficulties in youth with autism spectrum disorder (ASD) and other neurodevelopmental conditions. This study evaluated facial expression and identity recognition among PBTS, youth with ASD, and typically developing (TD) youth, and the associations between these face processing skills and social impairments.

METHODS

PBTS (N = 54; ages 7-16) who completed treatment at least 2 years prior were matched with TD (N = 43) youth and youth with ASD (N = 55) based on sex and IQ. Parents completed a measure of social impairments and youth completed a measure of facial expression and identity recognition.

RESULTS

Groups significantly differed on social impairments (p < .001), with youth with ASD scoring highest followed by PBTS and lastly TD youth. Youth with ASD performed significantly worse on the two measures of facial processing, while TD youth and PBTS were not statistically different. The association of facial expression recognition and social impairments was moderated by group, such that PBTS with higher levels of social impairment performed worse on the expression task compared to TD and ASD groups (p < .01, η2 = 0.07).

CONCLUSIONS

Variability in face processing may be uniquely important to the social challenges of PBTS compared to other neurodevelopmental populations. Future directions include prospectively examining associations between facial expression recognition and social difficulties in PBTS and face processing training as an intervention for PBTS.

Alexithymia Is Associated With Deficits in Visual Search for Emotional Faces in Clinical Depression

Background: The concept of alexithymia is characterized by difficulties identifying and describing one's emotions. Alexithymic individuals are impaired in the recognition of others' emotional facial expressions. Alexithymia is quite common in patients suffering from major depressive disorder. The face-in-the-crowd task is a visual search paradigm that assesses processing of multiple facial emotions. In the present eye-tracking study, the relationship between alexithymia and visual processing of facial emotions was examined in clinical depression. Materials and Methods: Gaze behavior and manual response times of 20 alexithymic and 19 non-alexithymic depressed patients were compared in a face-in-the-crowd task. Alexithymia was empirically measured via the 20-item Toronto Alexithymia-Scale. Angry, happy, and neutral facial expressions of different individuals were shown as target and distractor stimuli. Our analyses of gaze behavior focused on latency to the target face, number of distractor faces fixated before fixating the target, number of target fixations, and number of distractor faces fixated after fixating the target. Results: Alexithymic patients exhibited in general slower decision latencies compared to non-alexithymic patients in the face-in-the-crowd task. Patient groups did not differ in latency to target, number of target fixations, and number of distractors fixated prior to target fixation. However, after having looked at the target, alexithymic patients fixated more distractors than non-alexithymic patients, regardless of expression condition. Discussion: According to our results, alexithymia goes along with impairments in visual processing of multiple facial emotions in clinical depression. Alexithymia appears to be associated with delayed manual reaction times and prolonged scanning after the first target fixation in depression, but it might have no impact on the early search phase. The observed deficits could indicate difficulties in target identification and/or decision-making when processing multiple emotional facial expressions. Impairments of alexithymic depressed patients in processing emotions in crowds of faces seem not limited to a specific affective valence. In group situations, alexithymic depressed patients might be slowed in processing interindividual differences in emotional expressions compared with non-alexithymic depressed patients. This could represent a disadvantage in understanding non-verbal communication in groups.

Emotion regulation in pediatric bipolar disorder: A meta-analysis of published studies

BACKGROUND

Emotion regulation is a relatively recent topic in psychiatry, and has only recently begun to be tested across Pediatric Bipolar Disorder (PBD). To date, no meta-analysis has investigated the presence of emotion regulation deficits in PBD patients.

OBJECTIVES

The aim of this study is to understand where the literature stands on this topic, as well as how different researchers are measuring and grasping the concept of emotion regulation in pediatric bipolar disorders.

METHODS

A systematic search of trials using the terms ("Pediatric Bipolar Disorder") AND ("Emotion Regulation" OR "Affect Regulation" OR "Mood Lability" OR "Mood Instability" OR "Irritability") was conducted using PubMed, Google Scholar, ResearchGate, Web of Science and Psych Info databases. Of the initial 366 articles identified, 8 met eligibility criteria for the meta-analysis and were included in this study.

RESULTS

There is a statistically significant difference in Accuracy in Emotion Regulation tasks, with a tendency for lower accuracy in PBD patients; however, both groups did not differ statistically regarding Response Time.

CONCLUSION

Our data suggests that PBD patients do present emotion regulation deficits, particularly regarding facial emotion recognition and affective language interference tasks mediated by cognitive assignments. These results have important implications in developing novel psychotherapeutic interventions for this population.

Where Do We Stand in the Domestic Dog ( Canis familiaris ) Positive-Emotion Assessment: A State-of-the-Art Review and Future Directions

Although there have been a growing number of studies focusing on dog welfare, the research field concerning dog positive-emotion assessment remains mostly unexplored. This paper aims to provide a state-of-the-art review and summary of the scattered and disperse research on dog positive-emotion assessment. The review notably details the current advancement in dog positive-emotion research, what approaches, measures, methods, and techniques have been implemented so far in emotion perception, processing, and response assessment. Moreover, we propose possible future research directions for short-term emotion as well as longer-term emotional states assessment in dogs. The review ends by identifying and addressing some methodological limitations and by pointing out further methodological research needs.

Alexithymia and automatic processing of facial emotions: behavioral and neural findings

BACKGROUND

Alexithymia is a personality trait characterized by difficulties identifying and describing feelings, an externally oriented style of thinking, and a reduced inclination to imagination. Previous research has shown deficits in the recognition of emotional facial expressions in alexithymia and reductions of brain responsivity to emotional stimuli. Using an affective priming paradigm, we investigated automatic perception of facial emotions as a function of alexithymia at the behavioral and neural level. In addition to self-report scales, we applied an interview to assess alexithymic tendencies.

RESULTS

During 3 T fMRI scanning, 49 healthy individuals judged valence of neutral faces preceded by briefly shown happy, angry, fearful, and neutral facial expressions. Alexithymia was assessed using the 20-Item Toronto Alexithymia Scale (TAS-20), the Bermond-Vorst Alexithymia Questionnaire (BVAQ) and the Toronto Structured Interview for Alexithymia (TSIA). As expected, only negative correlations were found between alexithymic features and affective priming. The global level of self-reported alexithymia (as assessed by the TAS-20 and the BVAQ) was found to be related to less affective priming owing to angry faces. At the facet level, difficulties identifying feelings, difficulties analyzing feelings, and impoverished fantasy (as measured by the BVAQ) were correlated with reduced affective priming due to angry faces. Difficulties identifying feelings (BVAQ) correlated also with reduced affective priming due to fearful faces and reduced imagination (TSIA) was related to decreased affective priming due to happy faces. There was only one significant correlation between alexithymia dimensions and automatic brain response to masked facial emotions: TAS-20 alexithymia correlated with heightened brain response to masked happy faces in superior and medial frontal areas.

CONCLUSIONS

Our behavioral results provide evidence that alexithymic features are related in particular to less sensitivity for covert facial expressions of anger. The perceptual alterations could reflect impaired automatic recognition or integration of social anger signals into judgemental processes and might contribute to the problems in interpersonal relationships associated with alexithymia. Our findings suggest that self-report measures of alexithymia may have an advantage over interview-based tests as research tools in the field of emotion perception at least in samples of healthy individuals characterized by rather low levels of alexithymia.

The State of Automated Facial Expression Analysis (AFEA) in Evaluating Consumer Packaged Beverages

In the late 1970s, analysis of facial expressions to unveil emotional states began to grow and flourish along with new technologies and software advances. Researchers have always been able to document what consumers do, but understanding how consumers feel at a specific moment in time is an important part of the product development puzzle. Because of this, biometric testing methods have been used in numerous studies, as researchers have worked to develop a more comprehensive understanding of consumers. Despite the many articles on automated facial expression analysis (AFEA), literature is limited in regard to food and beverage studies. There are no standards to guide researchers in setting up materials, processing data, or conducting a study, and there are few, if any, compilations of the studies that have been performed to determine whether any methodologies work better than others or what trends have been found. Through a systematic Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) review, 38 articles were found that were relevant to the research goals. The authors identified AFEA study methods that have worked and those that have not been as successful and noted any trends of particular importance. Key takeaways include a listing of commercial AFEA software, experimental methods used within the PRISMA analysis, and a comprehensive explanation of the critical methods and practices of the studies analyzed. Key information was analyzed and compared to determine effects on the study outcomes. Through analyzing the various studies, suggestions and guidance for conducting and analyzing data from AFEA experiments are discussed.

Testing the magnocellular-pathway advantage in facial expressions processing for consistency over time

The ability to identify facial expressions rapidly and accurately is central to human evolution. Previous studies have demonstrated that this ability relies to a large extent on the magnocellular, rather than parvocellular, visual pathway, which is biased toward processing low spatial frequencies. Despite the generally consistent finding, no study to date has investigated the reliability of this effect over time. In the present study, 40 participants completed a facial emotion identification task (fearful, happy, or neutral faces) using facial images presented at three different spatial frequencies (low, high, or broad spatial frequency), at two time points separated by one year. Bayesian statistics revealed an advantage for the magnocellular pathway in processing facial expressions; however, no effect for time was found. Furthermore, participants' RT patterns of results were highly stable over time. Our replication, together with the consistency of our measurements within subjects, underscores the robustness of this effect. This capacity, therefore, may be considered in a trait-like manner, suggesting that individuals may possess various ability levels for processing facial expressions that can be captured in behavioral measurements.

Multimodal Affective State Assessment Using fNIRS + EEG and Spontaneous Facial Expression

Human facial expressions are regarded as a vital indicator of one's emotion and intention, and even reveal the state of health and wellbeing. Emotional states have been associated with information processing within and between subcortical and cortical areas of the brain, including the amygdala and prefrontal cortex. In this study, we evaluated the relationship between spontaneous human facial affective expressions and multi-modal brain activity measured via non-invasive and wearable sensors: functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) signals. The affective states of twelve male participants detected via fNIRS, EEG, and spontaneous facial expressions were investigated in response to both image-content stimuli and video-content stimuli. We propose a method to jointly evaluate fNIRS and EEG signals for affective state detection (emotional valence as positive or negative). Experimental results reveal a strong correlation between spontaneous facial affective expressions and the perceived emotional valence. Moreover, the affective states were estimated by the fNIRS, EEG, and fNIRS + EEG brain activity measurements. We show that the proposed EEG + fNIRS hybrid method outperforms fNIRS-only and EEG-only approaches. Our findings indicate that the dynamic (video-content based) stimuli triggers a larger affective response than the static (image-content based) stimuli. These findings also suggest joint utilization of facial expression and wearable neuroimaging, fNIRS, and EEG, for improved emotional analysis and affective brain-computer interface applications.

Ruminative response style is associated with a negative bias in the perception of emotional facial expressions in healthy women without a history of clinical depression

BACKGROUND AND OBJECTIVES

Rumination has been shown to be an important cognitive vulnerability factor affecting development and maintenance of depression. Ruminative thinking can be divided into a self-focused component referring to persistent reflection about causes and consequences of depressed mood and a symptom-focused component characterized by repetitive thinking about depressive symptoms. Previous research on clinical depression has shown that rumination is associated with the perception of negative emotions in others' facial expressions. The present study was conducted to investigate the relation between habitual rumination and negative bias in face perception in healthy individuals.

METHODS

100 healthy young women without a history of clinical depression completed the Response Styles Questionnaire along with measures of depressive symptoms, dysfunctional attitudes, and anxiety. A computer-based version of the perception of facial expressions questionnaire using line drawings (schematic faces) was administered to assess perceived emotions in faces with ambiguous and unambiguous emotional expressions.

RESULTS

According to hierarchical regression analyses, symptom-based (but not self-focused) rumination predicted perceived negative emotions in ambiguous as well as in unambiguous negative faces after controlling for current depressive symptoms, state and trait anxiety, intelligence, and dysfunctional attitudes.

LIMITATIONS

Generalization of the present findings is limited by the fact that only women were included as study participants.

CONCLUSIONS

Habitual ruminating about depressive symptoms in healthy, never clinically depressed individuals goes along with a negative bias in the perception of others' facial expressions. Negatively biasing social perception might be one mechanism by which symptom-focused rumination might increase vulnerability for depression.

Sex differences in facial emotion recognition in health and psychotic disorders

BACKGROUND

Previous studies examining sex-differences in facial emotion recognition (FER) in psychosis yielded inconsistent results. Although females are considered to be superior in FER in health, it remains unclear whether the specific sex-difference is present in psychosis. We aimed to examine whether women and men differ in FER ability in health and in psychosis, and to explore potential sex differences in the illness' effects on FER.

METHODS

Remitted psychotic patients and controls were assessed using the CANTAB Emotion Recognition Task (ERT) examining accuracies/response latencies in identifying basic emotional expressions. General linear model was performed to assess the effects of group, sex and their interactions on ERT performance.

RESULTS

Healthy females showed FER advantage in comparison to healthy males, while the aforementioned sex-difference was not observed in remitted psychotic patients. Our results also demonstrated the existence of overall FER deficit in psychosis in comparison to healthy controls, as well as the differential illness' effects on the recognition accuracy of facial expression of anger in males and females-suggesting that females with psychotic disorders undergo more profound deterioration of FER ability than their male counterparts.

CONCLUSION

The assessment of sex-differences in FER and other important features of psychosis is important for better understanding of its neurobiological basis and for the development of targeted treatments for improved functioning.

Using computer-vision and machine learning to automate facial coding of positive and negative affect intensity

Facial expressions are fundamental to interpersonal communication, including social interaction, and allow people of different ages, cultures, and languages to quickly and reliably convey emotional information. Historically, facial expression research has followed from discrete emotion theories, which posit a limited number of distinct affective states that are represented with specific patterns of facial action. Much less work has focused on dimensional features of emotion, particularly positive and negative affect intensity. This is likely, in part, because achieving inter-rater reliability for facial action and affect intensity ratings is painstaking and labor-intensive. We use computer-vision and machine learning (CVML) to identify patterns of facial actions in 4,648 video recordings of 125 human participants, which show strong correspondences to positive and negative affect intensity ratings obtained from highly trained coders. Our results show that CVML can both (1) determine the importance of different facial actions that human coders use to derive positive and negative affective ratings when combined with interpretable machine learning methods, and (2) efficiently automate positive and negative affect intensity coding on large facial expression databases. Further, we show that CVML can be applied to individual human judges to infer which facial actions they use to generate perceptual emotion ratings from facial expressions.

An event-related potential comparison of facial expression processing between cartoon and real faces

Faces play important roles in the social lives of humans. Besides real faces, people also encounter numerous cartoon faces in daily life which convey basic emotional states through facial expressions. Using event-related potentials (ERPs), we conducted a facial expression recognition experiment with 17 university students to compare the processing of cartoon faces with that of real faces. This study used face type (real vs. cartoon), emotion valence (happy vs. angry) and participant gender (male vs. female) as independent variables. Reaction time, recognition accuracy, and the amplitudes and latencies of emotion processing-related ERP components such as N170, VPP (vertex positive potential), and LPP (late positive potential) were used as dependent variables. The ERP results revealed that cartoon faces caused larger N170 and VPP amplitudes as well as a briefer N170 latency than did real faces; that real faces induced larger LPP amplitudes than did cartoon faces. In addition, the results showed a significant difference in the brain regions as reflected in a right hemispheric advantage. The behavioral results showed that the reaction times for happy faces were shorter than those for angry faces; that females showed a higher accuracy than did males; and that males showed a higher recognition accuracy for angry faces than happy faces. Due to the sample size, these results may suggestively but not rigorously demonstrate differences in facial expression recognition and neurological processing between cartoon faces and real faces. Cartoon faces showed a higher processing intensity and speed than real faces during the early processing stage. However, more attentional resources were allocated for real faces during the late processing stage.

Recognizing Frustration of Drivers From Face Video Recordings and Brain Activation Measurements With Functional Near-Infrared Spectroscopy

Experiencing frustration while driving can harm cognitive processing, result in aggressive behavior and hence negatively influence driving performance and traffic safety. Being able to automatically detect frustration would allow adaptive driver assistance and automation systems to adequately react to a driver's frustration and mitigate potential negative consequences. To identify reliable and valid indicators of driver's frustration, we conducted two driving simulator experiments. In the first experiment, we aimed to reveal facial expressions that indicate frustration in continuous video recordings of the driver's face taken while driving highly realistic simulator scenarios in which frustrated or non-frustrated emotional states were experienced. An automated analysis of facial expressions combined with multivariate logistic regression classification revealed that frustrated time intervals can be discriminated from non-frustrated ones with accuracy of 62.0% (mean over 30 participants). A further analysis of the facial expressions revealed that frustrated drivers tend to activate muscles in the mouth region (chin raiser, lip pucker, lip pressor). In the second experiment, we measured cortical activation with almost whole-head functional near-infrared spectroscopy (fNIRS) while participants experienced frustrating and non-frustrating driving simulator scenarios. Multivariate logistic regression applied to the fNIRS measurements allowed us to discriminate between frustrated and non-frustrated driving intervals with higher accuracy of 78.1% (mean over 12 participants). Frustrated driving intervals were indicated by increased activation in the inferior frontal, putative premotor and occipito-temporal cortices. Our results show that facial and cortical markers of frustration can be informative for time resolved driver state identification in complex realistic driving situations. The markers derived here can potentially be used as an input for future adaptive driver assistance and automation systems that detect driver frustration and adaptively react to mitigate it.

Automatic processing of emotional facial expressions as a function of social anhedonia

Anhedonia is an important feature of major depression and schizophrenia-spectrum disorders. Few neuroimaging studies have investigated neural alterations in high anhedonia, isolated from other psychopathological variables, by including only participants without clinical diagnoses. The present study examined healthy individuals scoring high (N = 18) vs. low (N = 19) in social anhedonia, who were carefully selected from a sample of N = 282 participants. To examine differences in automatic brain responses to social-affective stimuli between high vs. low social anhedonia participants, we used functional magnetic resonance imaging. To assess early, automatic stages of emotion processing, we administered a paradigm presenting brief (33ms), backward-masked happy, sad, and neutral facial expressions. Individuals high in social anhedonia demonstrated increased activation in the bilateral thalamus and left red nucleus in response to masked sad faces relative to individuals low in social anhedonia. No significant group differences in brain activation emerged in other regions known to be involved in emotion and reward processing, including the amygdala and nucleus accumbens. Our results suggest that high social anhedonia in otherwise healthy individuals is associated with exaggerated automatic reactivity in the thalamus, which is a brain structure that has been implicated in the mediation of attentional processes.

Facial emotion perception in schizophrenia: Does sex matter?

AIM: To review the literature on sex differences in facial emotion perception (FEP) across the schizophrenia spectrum.

METHODS: We conducted a systematic review of empirical articles that were included in five separate meta-analyses of FEP across the schizophrenia spectrum, including meta-analyses that predominantly examined adults with chronic schizophrenia, people with early (onset prior to age 18) or recent-onset (experiencing their first or second psychotic episode or illness duration less than 2 years) schizophrenia, and unaffected first-degree relatives of people with schizophrenia. We also examined articles written in English (from November 2011 through June 2015) that were not included in the aforementioned meta-analyses through a literature search in the PubMed database. All relevant articles were accessed in full text. We examined all studies to determine the sample sizes, diagnostic characteristics, demographic information, methodologies, results, and whether each individual study reported on sex differences. The results from the meta-analyses themselves as well as the individual studies are reported in tables and text.

RESULTS: We retrieved 134 articles included in five separate meta-analyses and the PubMed database that examined FEP across the schizophrenia spectrum. Of these articles, 38 examined sex differences in FEP. Thirty of these studies did not find sex differences in FEP in either chronically ill adults with schizophrenia, early-onset or recently diagnosed people with schizophrenia, or first-degree relatives of people with schizophrenia. Of the eight studies that found sex differences in FEP, three found that chronically ill women outperformed men, one study found that girls with early-onset schizophrenia outperformed boys, and two studies found that women (including first-degree relatives, adults with schizophrenia, and the healthy control group) outperformed men on FEP tasks. In total, six of the eight studies that examined sex differences in FEP found that women outperformed men across the schizophrenia spectrum.

CONCLUSION: Evidence to date suggests few sex differences in FEP in schizophrenia; both men and women across the schizophrenia spectrum have deficits in FEP.

Automatic processing of facial affects in patients with borderline personality disorder: associations with symptomatology and comorbid disorders

BACKGROUND

Instability of affects and interpersonal relations are important features of borderline personality disorder (BPD). Interpersonal problems of individuals suffering from BPD might develop based on abnormalities in the processing of facial affects and high sensitivity to negative affective expressions. The aims of the present study were to examine automatic evaluative shifts and latencies as a function of masked facial affects in patients with BPD compared to healthy individuals. As BPD comorbidity rates for mental and personality disorders are high, we investigated also the relationships of affective processing characteristics with specific borderline symptoms and comorbidity.

METHODS

Twenty-nine women with BPD and 38 healthy women participated in the study. The majority of patients suffered from additional Axis I disorders and/or additional personality disorders. In the priming experiment, angry, happy, neutral, or no facial expression was briefly presented (for 33 ms) and masked by neutral faces that had to be evaluated. Evaluative decisions and response latencies were registered. Borderline-typical symptomatology was assessed with the Borderline Symptom List.

RESULTS

In the total sample, valence-congruent evaluative shifts and delays of evaluative decision due to facial affect were observed. No between-group differences were obtained for evaluative decisions and latencies. The presence of comorbid anxiety disorders was found to be positively correlated with evaluative shifting owing to masked happy primes, regardless of baseline-neutral or no facial expression condition. The presence of comorbid depressive disorder, paranoid personality disorder, and symptoms of social isolation and self-aggression were significantly correlated with response delay due to masked angry faces, regardless of baseline.

CONCLUSIONS

In the present affective priming study, no abnormalities in the automatic recognition and processing of facial affects were observed in BPD patients compared to healthy individuals. The presence of comorbid anxiety disorders could make patients more susceptible to the influence of a happy expression on judgment processes at an automatic processing level. Comorbid depressive disorder, paranoid personality disorder, and symptoms of social isolation and self-aggression may enhance automatic attention allocation to threatening facial expressions in BPD. Increased automatic vigilance for social threat stimuli might contribute to affective instability and interpersonal problems in specific patients with BPD.

Facial reanimation surgery restores affect display

OBJECTIVE

Assess the ability of facial reanimation surgery to restore affect display in patients with severe facial paralysis.

STUDY DESIGN

Survey of healthy observers' perception of change in facial visage from preoperative to postoperative state.

SETTING

Academic tertiary referral center.

MAIN OUTCOME MEASURES

Observer graded affect display.

METHODS

Ninety naive observers completed a survey with pictures of paralyzed faces, smiling and in repose, before and after surgery, as well as normal comparison faces. Observers characterized affect display of each face coded in primary affects from the Derogatis Affects Balance Scale. Results were analyzed with latent class analysis and regression using a three-class model.

RESULTS

Preoperatively, paralyzed faces in repose were most likely to be considered negative (56.0%), then neutral (41.3%) and positive (2.7%). In this same cohort of patients in repose, reanimation surgery restored affect display to normal levels: decreasing negative classification (18.9%) and increasing neutral (53.4%) and positive (27.7%) classification. Hypothesis testing revealed no statistically significant differences in the mean classification probabilities for postoperative faces in repose versus normal faces in repose. The same analysis was performed for smiling faces, which showed marked improvement with reanimation surgery: decreasing negative (45.6%-11.7%) and increasing positive (26.2%-60.0%) classification. Despite this improvement, there were statistically significant differences in classification of postoperative smiling faces versus normal smiling faces.

CONCLUSION

Facial reanimation surgery was associated with normalized affect display for faces in repose and improved affect display for smiling faces. These results provide evidence that facial reanimation improves the facial expression of emotion. Further assessment in additional contexts will help better characterize the ability of facial reanimation to mitigate the psychosocial burden associated with facial paralysis.

[Validation of emotional stress stimuli in 50-to-80-year-old French-Quebecers]

Few batteries of prosodic stimuli testing have been validated for Quebec-French people. Such validation is necessary to develop auditory-verbal tasks in this population. The objective of this study was to validate a battery of emotional prosodic stimuli for French-Québec aging subjects. The battery of 195 stimuli, which was elaborated by Maurage et al. (2007), is composed of 195 prosodic stimuli and was administrated to 50 healthy Quebecers aged 50-to-80 years. The percentages of good responses were calculated for each stimulus. For each emotion, Cronbach's alphas were calculated to evaluate the internal consistency of the stimuli. Results showed that among the 195 stimuli, 40 were correctly recognized by at least 80 per cent of the subjects. Anger was the emotion that was most correctly identified by the participants, while recognition of disgust was the least recognised. Overall, this study provides data that will guide the selection of prosodic stimuli in evaluating French-Québécois.

Continuities in emotion lateralization in human and non-human primates

Where hemispheric lateralization was once considered an exclusively human trait, it is increasingly recognized that hemispheric asymmetries are evident throughout the animal kingdom. Emotion is a prime example of a lateralized function: given its vital role in promoting adaptive behavior and hence survival, a growing body of research in affective neuroscience is working to illuminate the cortical bases of emotion processing. Presuming that human and non-human primates evolved from a shared ancestor, one would anticipate evidence of organizational continuity in the neural substrate supporting emotion processing. This paper thus reviews research examining the patterns of lateralization for the expression and perception of facial emotion in non-human primates, aiming to determine whether the patterns of hemispheric asymmetry that characterize the human brain are similarly evident in other primate species. As such, this review seeks to enhance understanding of the evolution of hemispheric specialization for emotion, using emotion lateralization in non-human primates as a window through which to view emotion lateralization in humans.

Assessing temporal processing of facial emotion perception with transcranial magnetic stimulation

The ability to process facial expressions can be modified by altering the spatial frequency of the stimuli, an effect that has been attributed to differential properties of visual pathways that convey different types of information to distinct brain regions at different speeds. While this effect suggests a potential influence of spatial frequency on the processing speed of facial emotion, this hypothesis has not been examined directly. We addressed this question using a facial emotion identification task with photographs containing either high spatial frequency (HSF), low spatial frequency (LSF), or broadband spatial frequency (BSF). Temporal processing of emotion perception was manipulated by suppressing visual perception with a single-pulse transcranial magnetic stimulation (TMS), delivered to the visual cortex at six intervals prior to (forward masking) or following (backward masking) stimulus presentation. Participants performed best in the BSF, followed by LSF, and finally HSF condition. A spatial frequency by forward/backward masking interaction effect demonstrated reduced performance in the forward masking component in the BSF condition and a reversed performance pattern in the HSF condition, with no significant differences between forward and backward masking in the LSF condition. Results indicate that LSF information may play a greater role than HSF information in emotional processing, but may not be sufficient for fast conscious perception of emotion. As both LSF and HSF filtering reduced the speed of extracting emotional information from faces, it is possible that intact BSF faces have an inherent perceptual advantage and hence benefit from faster temporal processing.

Shortened night sleep impairs facial responsiveness to emotional stimuli

Sleep deprivation deteriorates mood, impairs the recognition of facial expressions, and affects the ability to regulate emotions. The present study investigated the effect of partial sleep deprivation on facial responses to emotional stimuli. Thirty-three healthy undergraduates were tested twice: after a night with (i) 8h and (ii) 4h sleep. Self-reported sleepiness and sustained attention (Psychomotor Vigilance Task) were assessed. Emotional reactivity was measured with facial Electromyogram (EMG) while participants were asked to respond with either compatible or incompatible facial muscles to emotional stimuli in order to study whether partial sleep deprivation caused slower reactions mainly in response to incompatible stimuli (due to an additional effort to suppress the compatible reaction caused by decreased inhibitory control) or in response to both compatible and incompatible stimuli. Self-reported sleepiness and reaction times in a sustained attention task significantly increased after one night of partial sleep deprivation. Facial reactions to emotional stimuli were decelerated. No significant interaction between sleep restriction and compatibility of the muscle to the picture valence could be observed. Hence, volitional facial reactions in response to emotional stimuli were slower after one night of reduced sleep, but affective inhibitory control was not significantly impaired. However, slowed facial responding to emotional stimuli may affect social interaction after sleep restriction.

Working memory and the identification of facial expression in patients with left frontal glioma

Patients with brain tumors may have cognitive dysfunctions including memory deterioration, such as working memory, that affect quality of life. This study was to explore the presence of defects in working memory and the identification of facial expressions in patients with left frontal glioma. This case-control study recruited 11 matched pairs of patients and healthy control subjects (mean age ± standard deviation, 37.00 ± 10.96 years vs 36.73 ± 11.20 years; 7 male and 4 female) from March through December 2011. The psychological tests contained tests that estimate verbal/visual-spatial working memory, executive function, and the identification of facial expressions. According to the paired samples analysis, there were no differences in the anxiety and depression scores or in the intelligence quotients between the 2 groups (P > .05). All indices of the Digit Span Test were significantly worse in patients than in control subjects (P < .05), but the Tapping Test scores did not differ between patient and control groups. Of all 7 Wisconsin Card Sorting Test (WCST) indexes, only the Preservative Response was significantly different between patients and control subjects (P < .05). Patients were significantly less accurate in detecting angry facial expressions than were control subjects (30.3% vs 57.6%; P < .05) but showed no deficits in the identification of other expressions. The backward indexes of the Digit Span Test were associated with emotion scores and tumor size and grade (P < .05). Patients with left frontal glioma had deficits in verbal working memory and the ability to identify anger. These may have resulted from damage to functional frontal cortex regions, in which roles in these 2 capabilities have not been confirmed. However, verbal working memory performance might be affected by emotional and tumor-related factors.

Tonic pain grabs attention, but leaves the processing of facial expressions intact-evidence from event-related brain potentials

Emotion and attention are key players in the modulation of pain perception. However, much less is known about the reverse influence of pain on attentional and especially emotional processes. To this end, we employed painful vs. non-painful pressure stimulation to examine effects on the processing of simultaneously presented facial expressions (fearful, neutral, happy). Continuous EEG was recorded and participants had to rate each facial expression with regard to valence and arousal. Painful stimulation attenuated visual processing in general, as reduced P100 and late positive potential (LPP) amplitudes revealed, but did not interfere with structural encoding of faces (N170). In addition, early perceptual discrimination and sustained preferential processing of emotional facial expressions as well as affective ratings were not influenced by pain. Thus, tonic pain demonstrates strong attention-demanding properties, but this does not interfere with concurrently ongoing emotion discrimination processes. These effects point at partially independent effects of pain on emotion and attention, respectively.