Tracking the recognition of static and dynamic facial expressions of emotion across the life span

Recognition of Dynamic Emotional Expressions in Children and Adults and Its Associations with Empathy

This present study investigates emotion recognition in children and adults and its association with EQ and motor empathy. Overall, 58 children (33 5-6-year-olds, 25 7-9-year-olds) and 61 adults (24 young adults, 37 parents) participated in this study. Each participant received an EQ questionnaire and completed the dynamic emotion expression recognition task, where participants were asked to identify four basic emotions (happy, sad, fearful, and angry) from neutral to fully expressed states, and the motor empathy task, where participants' facial muscle activity was recorded. The results showed that "happy" was the easiest expression for all ages; 5- to 6-year-old children performed equally well as adults. The accuracies for "fearful," "angry," and "sad" expressions were significantly lower in children than in adults. For motor empathy, 7- to 9-year-old children exhibited the highest level of facial muscle activity, while the young adults showed the lowest engagement. Importantly, individual EQ scores positively correlated with the motor empathy index in adults but not in children. In sum, our study echoes the previous literature, showing that the identification of negative emotions is still difficult for children aged 5-9 but that this improves in late childhood. Our results also suggest that stronger facial mimicry responses are positively related to a higher level of empathy in adults.

Computational analysis of value learning and value-driven detection of neutral faces by young and older adults

The rapid detection of neutral faces with emotional value plays an important role in social relationships for both young and older adults. Recent psychological studies have indicated that young adults show efficient value learning for neutral faces and the detection of "value-associated faces," while older adults show slightly different patterns of value learning and value-based detection of neutral faces. However, the mechanisms underlying these processes remain unknown. To investigate this, we applied hierarchical reinforcement learning and diffusion models to a value learning task and value-driven detection task that involved neutral faces; the tasks were completed by young and older adults. The results for the learning task suggested that the sensitivity of learning feedback might decrease with age. In the detection task, the younger adults accumulated information more efficiently than the older adults, and the perceptual time leading to motion onset was shorter in the younger adults. In younger adults only, the reward sensitivity during associative learning might enhance the accumulation of information during a visual search for neutral faces in a rewarded task. These results provide insight into the processing linked to efficient detection of faces associated with emotional values, and the age-related changes therein.

Single point motion kinematics convey emotional signals in children and adults

This study investigates whether humans recognize different emotions conveyed only by the kinematics of a single moving geometrical shape and how this competence unfolds during development, from childhood to adulthood. To this aim, animations in which a shape moved according to happy, fearful, or neutral cartoons were shown, in a forced-choice paradigm, to 7- and 10-year-old children and adults. Accuracy and response times were recorded, and the movement of the mouse while the participants selected a response was tracked. Results showed that 10-year-old children and adults recognize happiness and fear when conveyed solely by different kinematics, with an advantage for fearful stimuli. Fearful stimuli were also accurately identified at 7-year-olds, together with neutral stimuli, while, at this age, the accuracy for happiness was not significantly different than chance. Overall, results demonstrates that emotions can be identified by a single point motion alone during both childhood and adulthood. Moreover, motion contributes in various measures to the comprehension of emotions, with fear recognized earlier in development and more readily even later on, when all emotions are accurately labeled.

Recognizing facial expressions of emotion amid noise: A dynamic advantage

Humans communicate internal states through complex facial movements shaped by biological and evolutionary constraints. Although real-life social interactions are flooded with dynamic signals, current knowledge on facial expression recognition mainly arises from studies using static face images. This experimental bias might stem from previous studies consistently reporting that young adults minimally benefit from the richer dynamic over static information, whereas children, the elderly, and clinical populations very strongly do (Richoz, Jack, Garrod, Schyns, & Caldara, 2015, Richoz, Jack, Garrod, Schyns, & Caldara, 2018b). These observations point to a near-optimal facial expression decoding system in young adults, almost insensitive to the advantage of dynamic over static cues. Surprisingly, no study has yet tested the idea that such evidence might be rooted in a ceiling effect. To this aim, we asked 70 healthy young adults to perform static and dynamic facial expression recognition of the six basic expressions while parametrically and randomly varying the low-level normalized phase and contrast signal (0%-100%) of the faces. As predicted, when 100% face signals were presented, static and dynamic expressions were recognized with equal efficiency with the exception of those with the most informative dynamics (i.e., happiness and surprise). However, when less signal was available, dynamic expressions were all better recognized than their static counterpart (peaking at ∼20%). Our data show that facial movements increase our ability to efficiently identify emotional states of others under the suboptimal visual conditions that can occur in everyday life. Dynamic signals are more effective and sensitive than static ones for decoding all facial expressions of emotion for all human observers.

Absence of age differences in emotion perception and gaze patterns using a contextually rich film-based assessment

Age differences in emotion perception are now well documented. However, a key limitation of many studies in this literature is the reliance on highly artificial tasks that lack context and consequently have poor ecological validity. This study reports two separate experiments that investigated age differences in emotion perception abilities using a highly contextualised film-based assessment along with a traditional emotion perception task. Experiment 2 additionally included a middle-aged sample and an assessment of eye-gaze patterns to the emotional films. The inclusion of eye-tracking in Experiment 2 was motivated by the fact that older adults consistently show visual biases to static emotion stimuli, yet it remains unclear whether biases also emerge in response to dynamic contextualised emotion stimuli. Experiment 1 identified age effects recognising displays of anger in the traditional emotion perception task but no age differences emerged on the film-based task. This finding was replicated in Experiment 2 with significant group differences on the traditional emotion perception task but no age differences on the film-based task. Experiment 2 also showed that there were no age differences in gaze patterns to these stimuli, showing for the first time that age-related visual biases to emotion stimuli may be task dependent. These findings highlight the fact that task-related features play a key role in the evaluation of age effects in emotion perception.

Effects of positive and negative social feedback on motivation, evaluative learning, and socio-emotional processing

Social rewards and punishments are strong motivators. Since experimental work has focused on young adults using simplistic feedback, the effects of more naturalistic stimuli on motivation, evaluative learning, and socio-emotional processing with advanced age remain unclear. Therefore, we compared the effects of static (photos) vs dynamic (videos) social feedback in a social incentive delay (SID) task in young (18-35 years) and older adults (50-84 years) with neutral, positive, and negative feedback, on response times (RTs), and assessed the emotional valence of feedback cues and feedback videos. We found that anticipating positive and negative social feedback accelerated RTs regardless of age and without additional effects of video feedback. Furthermore, the results suggest a valence transfer from positive feedback videos to predictive cues in both groups (i.e., evaluative learning). Finally, older adults reported less pronounced negative affect for negative feedback videos, indicating age differences in socio-emotional processing. As such, our findings foster our understanding of the underlying cognitive and emotional aspects involved in the processing of social rewards and punishments.

Moving beyond the lab: investigating empathy through the Empirical 5E approach

Empathy is a complex and multifaceted phenomenon that plays a crucial role in human social interactions. Recent developments in social neuroscience have provided valuable insights into the neural underpinnings and bodily mechanisms underlying empathy. This methodology often prioritizes precision, replicability, internal validity, and confound control. However, fully understanding the complexity of empathy seems unattainable by solely relying on artificial and controlled laboratory settings, while overlooking a comprehensive view of empathy through an ecological experimental approach. In this article, we propose articulating an integrative theoretical and methodological framework based on the 5E approach (the "E"s stand for embodied, embedded, enacted, emotional, and extended perspectives of empathy), highlighting the relevance of studying empathy as an active interaction between embodied agents, embedded in a shared real-world environment. In addition, we illustrate how a novel multimodal approach including mobile brain and body imaging (MoBi) combined with phenomenological methods, and the implementation of interactive paradigms in a natural context, are adequate procedures to study empathy from the 5E approach. In doing so, we present the Empirical 5E approach (E5E) as an integrative scientific framework to bridge brain/body and phenomenological attributes in an interbody interactive setting. Progressing toward an E5E approach can be crucial to understanding empathy in accordance with the complexity of how it is experienced in the real world.

Developmental eye movement strategies for decoding facial expressions of emotion

In our daily lives, we routinely look at the faces of others to try to understand how they are feeling. Few studies have examined the perceptual strategies that are used to recognize facial expressions of emotion, and none have attempted to isolate visual information use with eye movements throughout development. Therefore, we recorded the eye movements of children from 5 years of age up to adulthood during recognition of the six "basic emotions" to investigate when perceptual strategies for emotion recognition become mature (i.e., most adult-like). Using iMap4, we identified the eye movement fixation patterns for recognition of the six emotions across age groups in natural viewing and gaze-contingent (i.e., expanding spotlight) conditions. While univariate analyses failed to reveal significant differences in fixation patterns, more sensitive multivariate distance analyses revealed a U-shaped developmental trajectory with the eye movement strategies of the 17- to 18-year-old group most similar to adults for all expressions. A developmental dip in strategy similarity was found for each emotional expression revealing which age group had the most distinct eye movement strategy from the adult group: the 13- to 14-year-olds for sadness recognition; the 11- to 12-year-olds for fear, anger, surprise, and disgust; and the 7- to 8-year-olds for happiness. Recognition performance for happy, angry, and sad expressions did not differ significantly across age groups, but the eye movement strategies for these expressions diverged for each group. Therefore, a unique strategy was not a prerequisite for optimal recognition performance for these expressions. Our data provide novel insights into the developmental trajectories underlying facial expression recognition, a critical ability for adaptive social relations.

Callous-unemotional Traits and Emotion Recognition Difficulties: Do Stimulus Characteristics Play a role?

Emotion recognition difficulties are linked to callous-unemotional (CU) traits, which predict risk for severe antisocial behavior. However, few studies have investigated how stimulus characteristics influence emotion recognition performance, which could give insight into the mechanisms underpinning CU traits. To address this knowledge gap, children aged 7-10 years old (N = 45; 53% female, 47% male; 46.3% Black/African-American, 25.9% White, 16.7% Mixed race or Other, 9.3% Asian) completed an emotion recognition task featuring static facial stimuli from child and adult models and facial and full-body dynamic stimuli from adult models. Parents reported on CU traits of children in the sample. Children showed better emotion recognition for dynamic than static faces. Higher CU traits were associated with worse emotion recognition, particularly for sad and neutral expressions. Stimulus characteristics did not impact associations between CU traits and emotion recognition.

Recognition of facial emotions across the lifespan: 8-year-olds resemble older adults

On standard emotion recognition tasks with relatively long or unlimited stimuli durations, recognition improves as children grow older, whereas older adults are worse than young adults. Crucially, it was unknown (a) how older adults compare to age groups below young adulthood and (b) whether children can recognize emotions at shorter durations, with short durations likely common in real life. We compared emotion recognition in 5-year-olds, 8-year-olds, young adults and older adults at very brief durations (50 ms, 250 ms) as well as standard unlimited durations. Eight-year-olds were better than 5-year-olds, young adults than all groups, and there was a striking similarity between 8-year-olds and older adults, providing the first clear indication that older adults' recognition abilities are equivalent to that of an 8-year-old at all durations. Emotion recognition was above chance on all emotions and durations among the three older age groups and on most stimuli for 5-year-olds.

Emotional face recognition when a colored mask is worn: a cross-sectional study

Studies of the impact of face masks on emotional facial expression recognition are sparse in children. Moreover, to our knowledge no study has so far considered mask color (in adults and in children), even though this esthetic property is thought to have an impact on information processing. In order to explore these issues, the present study looked at whether first- and fifth-graders and young adults were influenced by the absence or presence (and color: pink, green, red, black, or white) of a face mask when asked to judge emotional facial expressions of fear, anger, sadness, or neutrality. Analysis of results suggested that the presence of a mask did affect the recognition of sad or fearful faces but did not influence significantly the perception of angry and neutral faces. Mask color slightly modulated the recognition of facial emotional expressions, without a systematic pattern that would allow a clear conclusion to be drawn. Moreover, none of these findings varied according to age group. The contribution of different facial areas to efficient emotion recognition is discussed with reference to methodological and theoretical considerations, and in the light of recent studies.

Facial mask disturbs ocular exploration but not pupil reactivity

Introduction

The COVID-19 pandemic has imposed to wear a face mask that may have negative consequences for social interactions despite its health benefits. A lot of recent studies focused on emotion recognition of masked faces, as the mouth is, with the eyes, essential to convey emotional content. However, none have studied neurobehavioral and neurophysiological markers of masked faces perception, such as ocular exploration and pupil reactivity. The purpose of this eye tracking study was to quantify how wearing a facial accessory, and in particular a face mask, affected the ocular and pupillary response to a face, emotional or not.

Methods

We used videos of actors wearing a facial accessory to characterize the visual exploration and pupillary response in several occlusion (no accessory, sunglasses, scarf, and mask) and emotional conditions (neutral, happy, and sad) in a population of 44 adults.

Results

We showed that ocular exploration differed for face covered with an accessory, and in particular a mask, compared to the classical visual scanning pattern of a non-covered face. The covered areas of the face were less explored. Pupil reactivity seemed only slightly affected by the mask, while its sensitivity to emotions was observed even in the presence of a facial accessory.

Discussion

These results suggest a mixed impact of the mask on attentional capture and physiological adjustment, which does not seem to be reconcilable with its strong effect on behavioral emotional recognition previously described.

Aging Is Associated With Multidirectional Changes in Social Cognition: Findings From an Adult Life-Span Sample Ranging From 18 to 101 Years

OBJECTIVES

Normal adult aging is associated with changes in social cognition. Although 4 social cognitive domains have been identified (social perception, theory of mind [ToM], affective empathy, and social behavior), no study has tested all 4 domains concurrently in a life-span sample, limiting understanding of the relative magnitude of age-related changes across domains. This study addresses this gap by providing the first assessment of all 4 social cognitive domains in an adult life-span sample.

METHODS

Three hundred and seventy-two participants ranging from 18 to 101 years of age took part in this study. Participants completed a testing battery that assessed social perception, ToM, affective empathy, and social behavior, as well as broader cognitive function and well-being.

RESULTS

The results showed that adult aging is associated with multidirectional changes in social cognitive abilities, with ToM and social perception showing nonlinear decline across much of the life-span, and affective empathy and social behavior showing improvement. Age remained a significant predictor of all 4 social cognitive domains, even after accounting for broader cognitive function. Weak associations emerged between some of the social cognitive abilities and and indices of broader well-being.

DISCUSSION

These findings provide novel and important evidence that normative aging is associated with both gains and losses in social cognition that occur at distinct points of the adult life-span, and that are at least partially independent of general age-related cognitive decline.

Morphing Task: The Emotion Recognition Process in Children with Attention Deficit Hyperactivity Disorder and Autism Spectrum Disorder

Recognizing a person’s identity is a fundamental social ability; facial expressions, in particular, are extremely important in social cognition. Individuals affected by autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) display impairment in the recognition of emotions and, consequently, in recognizing expressions related to emotions, and even their identity. The aim of our study was to compare the performance of participants with ADHD, ASD, and typical development (TD) with regard to both accuracy and speed in the morphing task and to determine whether the use of pictures of digitized cartoon faces could significantly facilitate the process of emotion recognition in ASD patients (particularly for disgust). This study investigated the emotion recognition process through the use of dynamic pictures (human faces vs. cartoon faces) created with the morphing technique in three pediatric populations (7–12 years old): ADHD patients, ASD patients, and an age-matched control sample (TD). The Chi-square test was used to compare response latency and accuracy between the three groups in order to determine if there were statistically significant differences (p < 0.05) in the recognition of basic emotions. The results demonstrated a faster response time in neurotypical children compared to ASD and ADHD children, with ADHD participants performing better than ASD participants on the same task. The overall accuracy parameter between the ADHD and ASD groups did not significantly differ.

Sensorimotor Activity and Network Connectivity to Dynamic and Static Emotional Faces in 7-Month-Old Infants

The present study investigated whether, as in adults, 7-month-old infants’ sensorimotor brain areas are recruited in response to the observation of emotional facial expressions. Activity of the sensorimotor cortex, as indexed by µ rhythm suppression, was recorded using electroencephalography (EEG) while infants observed neutral, angry, and happy facial expressions either in a static (N = 19) or dynamic (N = 19) condition. Graph theory analysis was used to investigate to which extent neural activity was functionally localized in specific cortical areas. Happy facial expressions elicited greater sensorimotor activation compared to angry faces in the dynamic experimental condition, while no difference was found between the three expressions in the static condition. Results also revealed that happy but not angry nor neutral expressions elicited a significant right-lateralized activation in the dynamic condition. Furthermore, dynamic emotional faces generated more efficient processing as they elicited higher global efficiency and lower networks’ diameter compared to static faces. Overall, current results suggest that, contrarily to neutral and angry faces, happy expressions elicit sensorimotor activity at 7 months and dynamic emotional faces are more efficiently processed by functional brain networks. Finally, current data provide evidence of the existence of a right-lateralized activity for the processing of happy facial expressions.

Infants show pupil dilatory responses to happy and angry facial expressions

Facial expressions are one way in which infants and adults communicate emotion. Infants scan expressions similarly to adults, yet it remains unclear whether they are receptive to the affective information they convey. The current study investigates 6-, 9- and 12-month infants' (N = 146) pupillary responses to the six "basic" emotional expressions (happy, sad, surprise, fear, anger, and disgust). To do this we use dynamic stimuli and gaze-contingent eye-tracking to simulate brief interactive exchanges, alongside a static control condition. Infants' arousal responses were stronger for dynamic compared to static stimuli. And for dynamic stimuli we found that, compared to neutral, infants showed dilatory responses for happy and angry expressions only. Although previous work has shown infants can discriminate perceptually between facial expressions, our data suggest that sensitivity to the affective content of all six basic emotional expressions may not fully emerge until later in ontogeny.

Levels of naturalism in social neuroscience research

In order to understand ecologically meaningful social behaviors and their neural substrates in humans and other animals, researchers have been using a variety of social stimuli in the laboratory with a goal of extracting specific processes in real-life scenarios. However, certain stimuli may not be sufficiently effective at evoking typical social behaviors and neural responses. Here, we review empirical research employing different types of social stimuli by classifying them into five levels of naturalism. We describe the advantages and limitations while providing selected example studies for each level. We emphasize the important trade-off between experimental control and ecological validity across the five levels of naturalism. Taking advantage of newly emerging tools, such as real-time videos, virtual avatars, and wireless neural sampling techniques, researchers are now more than ever able to adopt social stimuli at a higher level of naturalism to better capture the dynamics and contingency of real-life social interaction.

Infants scan static and dynamic facial expressions differently

Despite being inherently dynamic phenomena, much of our understanding of how infants attend and scan facial expressions is based on static face stimuli. Here we investigate how six-, nine-, and twelve-month infants allocate their visual attention toward dynamic-interactive videos of the six basic emotional expressions, and compare their responses with static images of the same stimuli. We find infants show clear differences in how they attend and scan dynamic and static expressions, looking longer toward the dynamic-face and lower-face regions. Infants across all age groups show differential interest in expressions, and show precise scanning of regions "diagnostic" for emotion recognition. These data also indicate that infants' attention toward dynamic expressions develops over the first year of life, including relative increases in interest and scanning precision toward some negative facial expressions (e.g., anger, fear, and disgust).

Emotion induction in young and old persons on watching movie segments: Facial expressions reflect subjective ratings

Film clips are established to induce or intensify mood states in young persons. Fewer studies address induction of mood states in old persons. Analysis of facial expression provides an opportunity to substantiate subjective mood states with a psychophysiological variable. We investigated healthy young (YA; n = 29; age 24.4 ± 2.3) and old (OA; n = 28; age 69.2 ± 7.4) participants. Subjects were exposed to film segments validated in young adults to induce four basic emotions (anger, disgust, happiness, sadness). We analyzed subjective mood states with a 7-step Likert scale and facial expressions with an automated system for analysis of facial expressions (FaceReader^™ 7.0, Noldus Information Technology b.v.) for both the four target emotions as well as concomitant emotions. Mood expressivity was analysed with the Berkeley Expressivity Questionnaire (BEQ) and the Short Suggestibility Scale (SSS). Subjective mood intensified in all target emotions in the whole group and both YA and OA subgroups. Facial expressions of mood intensified in the whole group for all target emotions except sadness. Induction of happiness was associated with a decrease of sadness in both subjective and objective assessment. Induction of sadness was observed with subjective assessment and accompanied by a decrease of happiness in both subjective and objective assessment. Regression analysis demonstrated pre-exposure facial expressions and personality factors (BEQ, SSS) to be associated with the intensity of facial expression on mood induction. We conclude that mood induction is successful regardless of age. Analysis of facial expressions complement self-assessment of mood and may serve as a means of objectification of mood change. The concordance between self-assessment of mood change and facial expression is modulated by personality factors.

The recognition of facial expressions of emotion in deaf and hearing individuals

During real-life interactions, facial expressions of emotion are perceived dynamically with multimodal sensory information. In the absence of auditory sensory channel inputs, it is unclear how facial expressions are recognised and internally represented by deaf individuals. Few studies have investigated facial expression recognition in deaf signers using dynamic stimuli, and none have included all six basic facial expressions of emotion (anger, disgust, fear, happiness, sadness, and surprise) with stimuli fully controlled for their low-level visual properties, leaving the question of whether or not a dynamic advantage for deaf observers exists unresolved. We hypothesised, in line with the enhancement hypothesis, that the absence of auditory sensory information might have forced the visual system to better process visual (unimodal) signals, and predicted that this greater sensitivity to visual stimuli would result in better recognition performance for dynamic compared to static stimuli, and for deaf-signers compared to hearing non-signers in the dynamic condition. To this end, we performed a series of psychophysical studies with deaf signers with early-onset severe-to-profound deafness (dB loss >70) and hearing controls to estimate their ability to recognize the six basic facial expressions of emotion. Using static, dynamic, and shuffled (randomly permuted video frames of an expression) stimuli, we found that deaf observers showed similar categorization profiles and confusions across expressions compared to hearing controls (e.g., confusing surprise with fear). In contrast to our hypothesis, we found no recognition advantage for dynamic compared to static facial expressions for deaf observers. This observation shows that the decoding of dynamic facial expression emotional signals is not superior even in the deaf expert visual system, suggesting the existence of optimal signals in static facial expressions of emotion at the apex. Deaf individuals match hearing individuals in the recognition of facial expressions of emotion.

Recognition of children's emotional facial expressions among mothers reporting a history of childhood maltreatment

Several studies have shown that child maltreatment is associated with both positive and negative effects on the recognition of facial emotions. Research has provided little evidence of a relation between maltreatment during childhood and young adults' ability to recognize facial displays of emotion in children, an essential skill for a sensitive parental response. In this study, we examined the consequences of different forms of maltreatment experienced in childhood on emotion recognition during parenthood. Participants included sixty-three mothers of children aged 2 to 5 years. Retrospective self-reports of childhood maltreatment were assessed using the short form of the Childhood Trauma Questionnaire (CTQ). Emotion recognition was measured using a morphed facial emotion identification task of all six basic emotions (anger, disgust, fear, happiness, sadness, and surprise). A Path Analysis via Structural Equation Model revealed that a history of physical abuse is related to a decreased ability to recognize both fear and sadness in children, whereas emotional abuse and sexual abuse are related to a decreased ability to recognize anger in children. In addition, emotional neglect is associated with an increased ability to recognize anger, whereas physical neglect is associated with less accuracy in recognizing happiness in children's facial emotional expressions. These findings have important clinical implications and expand current understanding of the consequences of childhood maltreatment on parents' ability to detect children's needs.

Age-related changes in gaze behaviour during social interaction: An eye-tracking study with an embodied conversational agent

Previous research has highlighted age-related differences in social perception, in particular emotional expression processing. To date, such studies have largely focused on approaches that use static emotional stimuli that the participant has to identify passively without the possibility of any interaction. In this study, we propose an interactive virtual environment to better address age-related variations in social and emotional perception. A group of 22 young (18-30 years) and 20 older (60-80 years) adults were engaged in a face-to-face conversation with an embodied conversational agent. Participants were invited to interact naturally with the agent and to identify his facial expression. Their gaze behaviour was captured by an eye-tracking device throughout the interaction. We also explored whether the Big Five personality traits (particularly extraversion) and anxiety modulated gaze during the social interaction. Findings suggested that age-related differences in gaze behaviour were only apparent when decoding social signals (i.e., listening to a partner's question, identifying facial expressions) and not when communicating social information (i.e., when speaking). Furthermore, higher extraversion levels consistently led to a shorter amount of time gazing towards the eyes, whereas higher anxiety levels led to slight modulations of gaze only when participants were listening to questions. Face-to-face conversation with virtual agents can provide a more naturalistic framework for the assessment of online socio-emotional interaction in older adults, which is not easily observable in classical offline paradigms. This study provides novel and important insights into the specific circumstances in which older adults may experience difficulties in social interactions.

"Grumpy" or "furious"? arousal of emotion labels influences judgments of facial expressions

Whether language information influences recognition of emotion from facial expressions remains the subject of debate. The current studies investigate how variations in emotion labels that are paired with expressions influences participants' judgments of the emotion displayed. Static (Study 1) and dynamic (Study 2) facial expressions depicting eight emotion categories were paired with emotion labels that systematically varied in arousal (low and high). Participants rated the arousal, valence, and dominance of expressions paired with labels. Isolated faces and isolated labels were also rated. As predicted, the label presented influenced participants' judgments of the expressions. Across both studies, higher arousal labels were associated with: 1) higher ratings of arousal for sad, angry, and scared expressions, and 2) higher ratings of dominance for angry, proud, and disgust expressions. These results indicate that emotion labels influence judgments of facial expressions.

Perception of “Live” Facial Expressions

The article provides a review of experimental studies of interpersonal perception on the material of static and dynamic facial expressions as a unique source of information about the person’s inner world. The focus is on the patterns of perception of a moving face, included in the processes of communication and joint activities (an alternative to the most commonly studied perception of static images of a person outside of a behavioral context). The review includes four interrelated topics: face statics and dynamics in the recognition of emotional expressions; specificity of perception of moving face expressions; multimodal integration of emotional cues; generation and perception of facial expressions in communication processes. The analysis identifies the most promising areas of research of face in motion. We show that the static and dynamic modes of facial perception complement each other, and describe the role of qualitative features of the facial expression dynamics in assessing the emotional state of a person. Facial expression is considered as part of a holistic multimodal manifestation of emotions. The importance of facial movements as an instrument of social interaction is emphasized.

Quantifying Facial Expression Intensity and Signal Use in Deaf Signers

We live in a world of rich dynamic multisensory signals. Hearing individuals rapidly and effectively integrate multimodal signals to decode biologically relevant facial expressions of emotion. Yet, it remains unclear how facial expressions are decoded by deaf adults in the absence of an auditory sensory channel. We thus compared early and profoundly deaf signers (n = 46) with hearing nonsigners (n = 48) on a psychophysical task designed to quantify their recognition performance for the six basic facial expressions of emotion. Using neutral-to-expression image morphs and noise-to-full signal images, we quantified the intensity and signal levels required by observers to achieve expression recognition. Using Bayesian modeling, we found that deaf observers require more signal and intensity to recognize disgust, while reaching comparable performance for the remaining expressions. Our results provide a robust benchmark for the intensity and signal use in deafness and novel insights into the differential coding of facial expressions of emotion between hearing and deaf individuals.

Strategy Shift Toward Lower Spatial Frequencies in the Recognition of Dynamic Facial Expressions of Basic Emotions: When It Moves It Is Different

Facial expressions of emotion play a key role in social interactions. While in everyday life, their dynamic and transient nature calls for a fast processing of the visual information they contain, a majority of studies investigating the visual processes underlying their recognition have focused on their static display. The present study aimed to gain a better understanding of these processes while using more ecological dynamic facial expressions. In two experiments, we directly compared the spatial frequency (SF) tuning during the recognition of static and dynamic facial expressions. Experiment 1 revealed a shift toward lower SFs for dynamic expressions in comparison to static ones. Experiment 2 was designed to verify if changes in SF tuning curves were specific to the presence of emotional information in motion by comparing the SF tuning profiles for static, dynamic, and shuffled dynamic expressions. Results showed a similar shift toward lower SFs for shuffled expressions, suggesting that the difference found between dynamic and static expressions might not be linked to informative motion per se but to the presence of motion regardless its nature.