Facial mimicry is not necessary to recognize emotion: Facial expression recognition by people with Moebius syndrome

Facial mimicry interference reduces working memory accuracy for facial emotion expressions

Facial mimicry, the tendency to imitate facial expressions of other individuals, has been shown to play a critical role in the processing of emotion expressions. At the same time, there is evidence suggesting that its role might change when the cognitive demands of the situation increase. In such situations, understanding another person is dependent on working memory. However, whether facial mimicry influences working memory representations for facial emotion expressions is not fully understood. In the present study, we experimentally interfered with facial mimicry by using established behavioral procedures, and investigated how this interference influenced working memory recall for facial emotion expressions. Healthy, young adults (N = 36) performed an emotion expression n-back paradigm with two levels of working memory load, low (1-back) and high (2-back), and three levels of mimicry interference: high, low, and no interference. Results showed that, after controlling for block order and individual differences in the perceived valence and arousal of the stimuli, the high level of mimicry interference impaired accuracy when working memory load was low (1-back) but, unexpectedly, not when load was high (2-back). Working memory load had a detrimental effect on performance in all three mimicry conditions. We conclude that facial mimicry might support working memory for emotion expressions when task load is low, but that the supporting effect possibly is reduced when the task becomes more cognitively challenging.

Application of facial neuromuscular electrical stimulation (fNMES) in psychophysiological research: Practical recommendations based on a systematic review of the literature

Facial neuromuscular electrical stimulation (fNMES), which allows for the non-invasive and physiologically sound activation of facial muscles, has great potential for investigating fundamental questions in psychology and neuroscience, such as the role of proprioceptive facial feedback in emotion induction and emotion recognition, and may serve for clinical applications, such as alleviating symptoms of depression. However, despite illustrious origins in the 19th-century work of Duchenne de Boulogne, the practical application of fNMES remains largely unknown to today's researchers in psychology. In addition, published studies vary dramatically in the stimulation parameters used, such as stimulation frequency, amplitude, duration, and electrode size, and in the way they reported them. Because fNMES parameters impact the comfort and safety of volunteers, as well as its physiological (and psychological) effects, it is of paramount importance to establish recommendations of good practice and to ensure studies can be better compared and integrated. Here, we provide an introduction to fNMES, systematically review the existing literature focusing on the stimulation parameters used, and offer recommendations on how to safely and reliably deliver fNMES and on how to report the fNMES parameters to allow better cross-study comparison. In addition, we provide a free webpage, to easily visualise fNMES parameters and verify their safety based on current density. As an example of a potential application, we focus on the use of fNMES for the investigation of the facial feedback hypothesis.

Inability to move one's face dampens facial expression perception

Humans rely heavily on facial expressions for social communication to convey their thoughts and emotions and to understand them in others. One prominent but controversial view is that humans learn to recognize the significance of facial expressions by mimicking the expressions of others. This view predicts that an inability to make facial expressions (e.g., facial paralysis) would result in reduced perceptual sensitivity to others' facial expressions. To test this hypothesis, we developed a diverse battery of sensitive emotion recognition tasks to characterize expression perception in individuals with Moebius Syndrome (MBS), a congenital neurological disorder that causes facial palsy. Using computer-based detection tasks we systematically assessed expression perception thresholds for static and dynamic face and body expressions. We found that while MBS individuals were able to perform challenging perceptual control tasks and body expression tasks, they were less efficient at extracting emotion from facial expressions, compared to matched controls. Exploratory analyses of fMRI data from a small group of MBS participants suggested potentially reduced engagement of the amygdala in MBS participants during expression processing relative to matched controls. Collectively, these results suggest a role for facial mimicry and consequent facial feedback and motor experience in the perception of others' facial expressions.

Facial mimicry and metacognitive judgments in emotion recognition are distinctly modulated by social anxiety and autistic traits

Facial mimicry as well as the accurate assessment of one's performance when judging others' emotional expressions have been suggested to inform successful emotion recognition. Differences in the integration of these two information sources might explain alterations in the perception of others' emotions in individuals with Social Anxiety Disorder and individuals on the autism spectrum. Using a non-clinical sample (N = 57), we examined the role of social anxiety and autistic traits in the link between facial mimicry, or confidence in one's performance, and emotion recognition. While participants were presented with videos of spontaneous emotional facial expressions, we measured their facial muscle activity, asked them to label the expressions and indicate their confidence in accurately labelling the expressions. Our results showed that confidence in emotion recognition was lower with higher social anxiety traits even though actual recognition was not related to social anxiety traits. Higher autistic traits, in contrast, were associated with worse recognition, and a weakened link between facial mimicry and performance. Consequently, high social anxiety traits might not affect emotion recognition itself, but the top-down evaluation of own abilities in emotion recognition contexts. High autistic traits, in contrast, may be related to lower integration of sensorimotor simulations, which promote emotion recognition.

Testing EEG functional connectivity between sensorimotor and face processing visual regions in individuals with congenital facial palsy

Moebius syndrome (MBS) is characterized by the congenital absence or underdevelopment of cranial nerves VII and VI, leading to facial palsy and impaired lateral eye movements. As a result, MBS individuals cannot produce facial expressions and did not develop motor programs for facial expressions. In the latest model of sensorimotor simulation, an iterative communication between somatosensory, motor/premotor cortices, and visual regions has been proposed, which should allow more efficient discriminations among subtle facial expressions. Accordingly, individuals with congenital facial motor disability, specifically with MBS, should exhibit atypical communication within this network. Here, we aimed to test this facet of the sensorimotor simulation models. We estimated the functional connectivity between the visual cortices for face processing and the sensorimotor cortices in healthy and MBS individuals. To this aim, we studied the strength of beta band functional connectivity between these two systems using high-density EEG, combined with a change detection task with facial expressions (and a control condition involving non-face stimuli). The results supported our hypothesis such that when discriminating subtle facial expressions, participants affected by congenital facial palsy (compared to healthy controls) showed reduced connectivity strength between sensorimotor regions and visual regions for face processing. This effect was absent for the condition with non-face stimuli. These findings support sensorimotor simulation models and the communication between sensorimotor and visual areas during subtle facial expression processing.

A Utilização da Imitação Facial em Tarefas de Reconhecimento de Expressões Emocionais

Resumo A imitação facial é um comportamento involuntário capaz de facilitar a transmissão de informações não verbais relevantes em diferentes contextos sociais. Este estudo teve por objetivo analisar a capacidade de reconhecimento de expressões emocionais enquanto o observador tensiona a própria face ou imita a face-alvo. A hipótese utilizada foi a de que indivíduos que tensionam a própria face terão menor probabilidade de acertos na execução das tarefas de reconhecimento de expressões emocionais e aqueles que imitam a expressão terão uma maior probabilidade de acertos na execução das mesmas tarefas. A amostra foi composta por 30 participantes, divididos em dois grupos experimentais: o Grupo Imitação (GI) e o Grupo Ruído (GR), ambos com 18 participantes do sexo feminino e 12 do sexo masculino. O experimento consistiu em apresentar fotos de atores expressando facialmente uma emoção básica por 10 segundos. Neste período, os participantes deveriam, então, observar ou intervir facialmente, imitando ou tensionando a própria face (de acordo com o grupo alocado, Imitação ou Ruído). Após os 10 segundos executando a instrução (observar, imitar ou interferir), o participante deveria responder - entre as opções alegria, tristeza, nojo, raiva, surpresa e medo - a emoção correspondente à imagem. Os resultados apresentaram diferenças significativas quando comparadas as tarefas de tensionar ou imitar a face-alvo, sugerindo que a alteração da própria face do observador pode influenciar durante o desempenho de uma tarefa de reconhecimento de emoções em faces.

Degenerate pathway for processing smile and other emotional expressions in congenital facial palsy: an hdEEG investigation

Influential theoretical models argue that an internal simulation mechanism (motor or sensorimotor simulation) supports the recognition of facial expressions. However, despite numerous converging sources of evidence, recent studies testing patients with congenital facial palsy (i.e. Moebius syndrome) seem to refute these theoretical models. However, these results do not consider the principles of neuroplasticity and degeneracy that could support the involvement of an alternative neural processing pathway in these patients. In the present study, we tested healthy participants and participants with Moebius syndrome in a highly sensitive facial expression discrimination task and concomitant high-density electroencephalographic recording. The results, both at the scalp and source levels, indicate the activation of two different pathways of facial expression processing in healthy participants and participants with Moebius syndrome, compatible, respectively, with a dorsal pathway that includes premotor areas and a ventral pathway. Therefore, these results support the reactivation of sensorimotor representations of facial expressions (i.e. simulation) in healthy subjects, in the place of an alternative processing pathway in subjects with congenital facial palsy.

This article is part of the theme issue ‘Cracking the laugh code: laughter through the lens of biology, psychology and neuroscience’.

Feminist Social Vision: Seeing Through the Lens of Marginalized Perceivers

Social vision research, which examines, in part, how humans visually perceive social stimuli, is well-positioned to improve understandings of social inequality. However, social vision research has rarely prioritized the perspectives of marginalized group members. We offer a theoretical argument for diversifying understandings of social perceptual processes by centering marginalized perspectives. We examine (a) how social vision researchers frame their research questions and who these framings prioritize and (b) how perceptual processes (person perception; people perception; perception of social objects) are linked to group membership and thus comprehensively understanding these processes necessitates attention to marginalized perceivers. We discuss how social vision research translates into theoretical advances and to action for reducing negative intergroup consequences (e.g., prejudice). The purpose of this article is to delineate how prioritizing marginalized perspectives in social vision research could develop novel questions, bridge theoretical gaps, and elevate social vision's translational impact to improve outcomes for marginalized groups.

Emotional mimicry as social regulator: theoretical considerations

The goal of this article is to discuss theoretical arguments concerning the idea that emotional mimicry is an intrinsic part of our social being and thus can be considered a social act. For this, we will first present the theoretical assumptions underlying the Emotional Mimicry as Social Regulator view. We then provide a brief overview of recent developments in emotional mimicry research and specifically discuss new developments regarding the role of emotional mimicry in actual interactions and relationships, and individual differences in emotional mimicry. We conclude with open questions for future research.

Is There a Difference in Facial Emotion Recognition after Stroke with vs. without Central Facial Paresis?

The Facial Feedback Hypothesis (FFH) states that facial emotion recognition is based on the imitation of facial emotional expressions and the processing of physiological feedback. In the light of limited and contradictory evidence, this hypothesis is still being debated. Therefore, in the present study, emotion recognition was tested in patients with central facial paresis after stroke. Performance in facial vs. auditory emotion recognition was assessed in patients with vs. without facial paresis. The accuracy of objective facial emotion recognition was significantly lower in patients with vs. without facial paresis and also in comparison to healthy controls. Moreover, for patients with facial paresis, the accuracy measure for facial emotion recognition was significantly worse than that for auditory emotion recognition. Finally, in patients with facial paresis, the subjective judgements of their own facial emotion recognition abilities differed strongly from their objective performances. This pattern of results demonstrates a specific deficit in facial emotion recognition in central facial paresis and thus provides support for the FFH and points out certain effects of stroke.

MODULATION EFFECT OF MOTOR ACTIVITY ON LIMBIC AREAS: AN FMRI STUDY

Neural activation of the motor cortex has been consistently reported to be evoked in the emotion processing of facial expressions, but it is poorly understood whether and how the motor system influences the activity of limbic areas during participants’ perceived emotional expressions. In this study, we proposed that motor activations evoked by emotional processing influence the activations in limbic areas such as amygdala during the perception of facial expressions. To examine this issue, a masked priming paradigm was adopted in our fMRI experiment, which could modulate the activation within the motor cortex when healthy participants perceived sad or happy facial expressions. We found that the first presented stimulus (masked prime) in each trial reduced the activations in the premotor cortex and inferior frontal gyrus when the movement of facial muscles implied by the arrows on the prime stimulus was consistent with that implied by the target face expressions (compatible condition), but increased the activations in these two areas when the movements implied by the arrows and the target face expressions were inconsistent (incompatible condition). The superior temporal gyrus, middle cingulate gyrus and amygdala also showed similar response tendency to that in motor cortex. Moreover, psychophysiological interaction (PPI) analysis showed that both right middle cingulate gyrus and bilateral superior temporal gyrus were closely linked to the premotor cortex with inferior frontal gyrus during the incompatible trials compared with the compatible trials. Together with this result and the significant activation correlations between the motor cortex and the limbic areas, this work revealed the modulation effect of motor cortex on brain regions related to emotion perception, suggesting that motor representation of facial movements can affect emotion experience. Our results provide new evidence for the functional role of motor system in the perception of facial emotions, and could contribute to the understanding of the deficit in social interaction for patients with autism or schizophrenia.

Altering Facial Movements Abolishes Neural Mirroring of Facial Expressions

People tend to automatically imitate others' facial expressions of emotion. That reaction, termed "facial mimicry" has been linked to sensorimotor simulation-a process in which the observer's brain recreates and mirrors the emotional experience of the other person, potentially enabling empathy and deep, motivated processing of social signals. However, the neural mechanisms that underlie sensorimotor simulation remain unclear. This study tests how interfering with facial mimicry by asking participants to hold a pen in their mouth influences the activity of the human mirror neuron system, indexed by the desynchronization of the EEG mu rhythm. This response arises from sensorimotor brain areas during observed and executed movements and has been linked with empathy. We recorded EEG during passive viewing of dynamic facial expressions of anger, fear, and happiness, as well as nonbiological moving objects. We examine mu desynchronization under conditions of free versus altered facial mimicry and show that desynchronization is present when adult participants can freely move but not when their facial movements are inhibited. Our findings highlight the importance of motor activity and facial expression in emotion communication. They also have important implications for behaviors that involve occupying or hiding the lower part of the face.

Facial emotion detection in Vestibular Schwannoma patients with and without facial paresis

This study investigates whether there exist differences in facial emotion detection accuracy in patients suffering from Vestibular Schwannoma (VS) due to their facial paresis. Forty-four VS patients, half of them with, and half of them without a facial paresis, had to classify pictures of facial expressions as being emotional or non-emotional. The visual information of images was systematically manipulated by adding different levels of visual noise. The study had a mixed design with emotional expression (happy vs. angry) and visual noise level (10% to 80%) as repeated measures and facial paresis (present vs. absent) and degree of facial dysfunction as between subjects' factors. Emotion detection accuracy declined when visual information declined, an effect that was stronger for anger than for happy expressions. Overall, emotion detection accuracy for happy and angry faces did not differ between VS patients with or without a facial paresis, although exploratory analyses suggest that the ability to recognize emotions in angry facial expressions was slightly more impaired in patients with facial paresis. The findings are discussed in the context of the effects of facial paresis on emotion detection, and the role of facial mimicry, in particular, as an important mechanism for facial emotion processing and understanding.

Typically Efficient Lipreading without Motor Simulation

All it takes is a face-to-face conversation in a noisy environment to realize that viewing a speaker's lip movements contributes to speech comprehension. What are the processes underlying the perception and interpretation of visual speech? Brain areas that control speech production are also recruited during lipreading. This finding raises the possibility that lipreading may be supported, at least to some extent, by a covert unconscious imitation of the observed speech movements in the observer's own speech motor system-a motor simulation. However, whether, and if so to what extent, motor simulation contributes to visual speech interpretation remains unclear. In two experiments, we found that several participants with congenital facial paralysis were as good at lipreading as the control population and performed these tasks in a way that is qualitatively similar to the controls despite severely reduced or even completely absent lip motor representations. Although it remains an open question whether this conclusion generalizes to other experimental conditions and to typically developed participants, these findings considerably narrow the space of hypothesis for a role of motor simulation in lipreading. Beyond its theoretical significance in the field of speech perception, this finding also calls for a re-examination of the more general hypothesis that motor simulation underlies action perception and interpretation developed in the frameworks of motor simulation and mirror neuron hypotheses.

Efficient recognition of facial expressions does not require motor simulation

What mechanisms underlie facial expression recognition? A popular hypothesis holds that efficient facial expression recognition cannot be achieved by visual analysis alone but additionally requires a mechanism of motor simulation — an unconscious, covert imitation of the observed facial postures and movements. Here, we first discuss why this hypothesis does not necessarily follow from extant empirical evidence. Next, we report experimental evidence against the central premise of this view: we demonstrate that individuals can achieve normotypical efficient facial expression recognition despite a congenital absence of relevant facial motor representations and, therefore, unaided by motor simulation. This underscores the need to reconsider the role of motor simulation in facial expression recognition.

The Pacified Face: Early Embodiment Processes and the Use of Dummies

Few things affect us as much as facial expressions, as they inform us about others' feelings and intentions, thereby influencing our own emotions and behaviors. A substantial body of literature links the critical abilities of recognizing and understanding emotion displays with facial mimicry, a sensorimotor process involving rapid imitation of perceived expressions. For example, blocking or altering facial mimicry in adults leads to disruptions in judgments in emotion recognition or emotional language processing. The present review focuses on pacifier use in infancy, a common practice that has the potential to interfere with infants' facial movements in ways identical to laboratory paradigms designed to block facial mimicry. Despite this similarity and the widespread use of infant soothers, little is known about their long-term effects. Here we review studies exploring the psychological correlates and implications of pacifier use. In particular, we discuss how soothers may interfere with the development of social skills in infants and present evidence linking pacifier use with disrupted adults' mimicry of facial expressions displayed by infants. Other preliminary findings reveal negative correlations between the use of soothers and children's spontaneous facial mimicry as well as emotional competence of young adults. Such studies, although correlational, suggest that this widespread parenting practice may affect the development of social skills by influencing emotional coordination. We discuss the implications of these findings and propose avenues for future research that can provide insights into the role of embodied processes in the development of emotional competence and adult functioning.

Abnormal Emotional Processing and Emotional Experience in Patients with Peripheral Facial Nerve Paralysis: An MEG Study

Abnormal emotional reactions of the brain in patients with facial nerve paralysis have not yet been reported. This study aims to investigate this issue by applying a machine-learning algorithm that discriminates brain emotional activities that belong either to patients with facial nerve paralysis or to healthy controls. Beyond this, we assess an emotion rating task to determine whether there are differences in their experience of emotions. MEG signals of 17 healthy controls and 16 patients with facial nerve paralysis were recorded in response to picture stimuli in three different emotional categories (pleasant, unpleasant, and neutral). The selected machine learning technique in this study was the logistic regression with LASSO regularization. We demonstrated significant classification performances in all three emotional categories. The best classification performance was achieved considering features based on event-related fields in response to the pleasant category, with an accuracy of 0.79 (95% CI (0.70, 0.82)). We also found that patients with facial nerve paralysis rated pleasant stimuli significantly more positively than healthy controls. Our results indicate that the inability to express facial expressions due to peripheral motor paralysis of the face might cause abnormal brain emotional processing and experience of particular emotions.

The Mimicry Among Us: Intra- and Inter-Personal Mechanisms of Spontaneous Mimicry

This review explores spontaneous mimicry in the context of three questions. The first question concerns the role of spontaneous mimicry in processing conceptual information. The second question concerns the debate whether spontaneous mimicry is driven by simple associative processes or reflects higher-order processes such as goals, intentions, and social context. The third question addresses the implications of these debates for understanding atypical individuals and states. We review relevant literature and argue for a dynamic, context-sensitive role of spontaneous mimicry in social cognition and behavior. We highlight how the modulation of mimicry is often adaptive but also point out some cases of maladaptive modulations that impair an individuals’ engagement in social life.

The effects of Botulinum toxin on the detection of gradual changes in facial emotion

When we feel sad or depressed, our face invariably “drops”. Conversely, when we try to cheer someone up, we might tell them “keep your smile up”, so presupposing that modifying the configuration of their facial muscles will enhance their mood. A crucial assumption that underpins this hypothesis is that mental states are shaped by information originating from the peripheral neuromotor system — a view operationalised as the Facial Feedback Hypothesis. We used botulinum toxin (BoNT-A) injected over the frown area to temporarily paralyse muscles necessary to express anger. Using a pre-post treatment design, we presented participants with gradually changing videos of a face morphing from neutral to full-blown expressions of either anger or happiness and asked them to press a button as soon as they had detected any change in the display. Results indicate that while all participants (control and BoNT-A) improved their reaction times from pre-test to post-test, the BoNT-A group did not when detecting anger in the post-test. We surmise that frown paralysis disadvantaged participants in their ability to improve the detection of anger. Our finding suggests that facial feedback causally affects perceptual awareness of changes in emotion, as well as people’s ability to use perceptual information to learn.

Children with facial paralysis due to Moebius syndrome exhibit reduced autonomic modulation during emotion processing

BACKGROUND

Facial mimicry is crucial in the recognition of others' emotional state. Thus, the observation of others' facial expressions activates the same neural representation of that affective state in the observer, along with related autonomic and somatic responses. What happens, therefore, when someone cannot mimic others' facial expressions?

METHODS

We investigated whether psychophysiological emotional responses to others' facial expressions were impaired in 13 children (9 years) with Moebius syndrome (MBS), an extremely rare neurological disorder (1/250,000 live births) characterized by congenital facial paralysis. We inspected autonomic responses and vagal regulation through facial cutaneous thermal variations and by the computation of respiratory sinus arrhythmia (RSA). These parameters provide measures of emotional arousal and show the autonomic adaptation to others' social cues. Physiological responses in children with MBS were recorded during dynamic facial expression observation and were compared to those of a control group (16 non-affected children, 9 years).

RESULTS

There were significant group effects on thermal patterns and RSA, with lower values in children with MBS. We also observed a mild deficit in emotion recognition in these patients.

CONCLUSION

Results support "embodied" theory, whereby the congenital inability to produce facial expressions induces alterations in the processing of facial expression of emotions. Such alterations may constitute a risk for emotion dysregulation.

Autonomic Responses to Emotional Stimuli in Children Affected by Facial Palsy: The Case of Moebius Syndrome

According to embodied simulation theories, others' emotions are recognized by the unconscious mimicking of observed facial expressions, which requires the implicit activation of the motor programs that produce a specific expression. Motor responses performed during the expression of a given emotion are hypothesized to be directly linked to autonomic responses associated with that emotional behavior. We tested this hypothesis in 9 children (M_age = 5.66) affected by Moebius syndrome (MBS) and 15 control children (M_age = 6.6). MBS is a neurological congenital disorder characterized by underdevelopment of the VI and VII cranial nerves, which results in paralysis of the face. Moebius patients' inability to produce facial expressions impairs their capacity to communicate emotions through the face. We therefore assessed Moebius children's autonomic response to emotional stimuli (video cartoons) by means of functional infrared thermal (fIRT) imaging. Patients showed weaker temperature changes compared to controls, suggesting impaired autonomic activity. They also showed difficulties in recognizing facial emotions from static illustrations. These findings reveal that the impairment of facial movement attenuates the intensity of emotional experience, probably through the diminished activation of autonomic responses associated with emotional stimuli. The current study is the first to investigate emotional responses in MBS children, providing important insights into the role of facial expressions in emotional processing during early development.

Congenital facial palsy and emotion processing: The case of Moebius syndrome

According to the Darwinian perspective, facial expressions of emotions evolved to quickly communicate emotional states and would serve adaptive functions that promote social interactions. Embodied cognition theories suggest that we understand others' emotions by reproducing the perceived expression in our own facial musculature (facial mimicry) and the mere observation of a facial expression can evoke the corresponding emotion in the perceivers. Consequently, the inability to form facial expressions would affect the experience of emotional understanding. In this review, we aimed at providing account on the link between the lack of emotion production and the mechanisms of emotion processing. We address this issue by taking into account Moebius syndrome, a rare neurological disorder that primarily affects the muscles controlling facial expressions. Individuals with Moebius syndrome are born with facial paralysis and inability to form facial expressions. This makes them the ideal population to study whether facial mimicry is necessary for emotion understanding. Here, we discuss behavioral ambiguous/mixed results on emotion recognition deficits in Moebius syndrome suggesting the need to investigate further aspects of emotional processing such as the physiological responses associated with the emotional experience during developmental age.

Suppression of Facial Mimicry of Negative Facial Expressions in an Incongruent Context

Abstract. People react with Rapid Facial Reactions (RFRs) when presented with human facial emotional expressions. Recent studies show that RFRs are not always congruent with emotional cues. The processes underlying RFRs are still being debated. In our study described herein, we manipulate the context of perception and its influence on RFRs. We use a subliminal affective priming task with emotional labels. Facial electromyography (EMG) (frontalis, corrugator, zygomaticus, and depressor) was recorded while participants observed static facial expressions (joy, fear, anger, sadness, and neutral expression) preceded/not preceded by a subliminal word (JOY, FEAR, ANGER, SADNESS, or NEUTRAL). For the negative facial expressions, when the priming word was congruent with the facial expression, participants displayed congruent RFRs (mimicry). When the priming word was incongruent, we observed a suppression of mimicry. Happiness was not affected by the priming word. RFRs thus appear to be modulated by the context and type of emotion that is presented via facial expressions.

Diminished facial EMG responses to disgusting scenes and happy and fearful faces in Huntington's disease

Huntington's disease (HD) is a neurodegenerative disorder associated with impaired facial emotion recognition and altered subjective experience of emotion. These impairments likely result from the effects of the disease on underlying neurobiological mechanisms. Studies using self-report to examine emotional experiences have been ambiguous regarding whether experiences are diminished or exaggerated, possibly due to cognitive impairment and lack of insight in HD. To infer affective states more objectively and overcome the limitations of self-report, we used facial EMG to measure muscle responses to emotionally-evocative scenes. Further, we examined muscle responses to emotionally-expressive faces, because facial mimicry is thought to facilitate emotion recognition and social affiliation. Twenty-three HD participants (late pre-manifest and early symptomatic) were compared to twenty-five healthy controls in a scene condition and a face condition. EMG activity was measured from facial muscles associated with expressing particular emotions: 1) corrugator supercilii for anger, 2) frontalis for fear, 3) levator labii for disgust, and 4) both zygomaticus major and orbicularis oculi for happiness. Compared to controls, HD participants showed diminished responses to disgusting scenes, and to happy and fearful faces. Our findings provide evidence for a loss of disgust experience in HD. Further, consistent with the alleged affiliative function of facial mimicry, diminished mimicry responses may be relevant to social-emotional changes in HD. Our findings help understand the neural mechanisms underlying emotion processing impairments in HD.

Incongruence Between Observers' and Observed Facial Muscle Activation Reduces Recognition of Emotional Facial Expressions From Video Stimuli

According to embodied cognition accounts, viewing others' facial emotion can elicit the respective emotion representation in observers which entails simulations of sensory, motor, and contextual experiences. In line with that, published research found viewing others' facial emotion to elicit automatic matched facial muscle activation, which was further found to facilitate emotion recognition. Perhaps making congruent facial muscle activity explicit produces an even greater recognition advantage. If there is conflicting sensory information, i.e., incongruent facial muscle activity, this might impede recognition. The effects of actively manipulating facial muscle activity on facial emotion recognition from videos were investigated across three experimental conditions: (a) explicit imitation of viewed facial emotional expressions (stimulus-congruent condition), (b) pen-holding with the lips (stimulus-incongruent condition), and (c) passive viewing (control condition). It was hypothesised that (1) experimental condition (a) and (b) result in greater facial muscle activity than (c), (2) experimental condition (a) increases emotion recognition accuracy from others' faces compared to (c), (3) experimental condition (b) lowers recognition accuracy for expressions with a salient facial feature in the lower, but not the upper face area, compared to (c). Participants (42 males, 42 females) underwent a facial emotion recognition experiment (ADFES-BIV) while electromyography (EMG) was recorded from five facial muscle sites. The experimental conditions' order was counter-balanced. Pen-holding caused stimulus-incongruent facial muscle activity for expressions with facial feature saliency in the lower face region, which reduced recognition of lower face region emotions. Explicit imitation caused stimulus-congruent facial muscle activity without modulating recognition. Methodological implications are discussed.

A proposal for new neurorehabilitative intervention on Moebius Syndrome patients after 'smile surgery'. Proof of concept based on mirror neuron system properties and hand-mouth synergistic activity

Studies of the last twenty years on the motor and premotor cortices of primates demonstrated that the motor system is involved in the control and initiation of movements, and in higher cognitive processes, such as action understanding, imitation, and empathy. Mirror neurons are only one example of such theoretical shift. Their properties demonstrate that motor and sensory processing are coupled in the brain. Such knowledge has been also central for designing new neurorehabilitative therapies for patients suffering from brain injuries and consequent motor deficits. Moebius Syndrome patients, for example, are incapable of moving their facial muscles, which are fundamental for affective communication. These patients face an important challenge after having undergone a corrective surgery: reanimating the transplanted muscles to achieve a voluntarily control of smiling. We propose two new complementary rehabilitative approaches on MBS patients based on observation/imitation therapy (Facial Imitation Therapy, FIT) and on hand-mouth motor synergies (Synergistic Activity Therapy, SAT). Preliminary results show that our intervention protocol is a promising approach for neurorehabilitation of patients with facial palsy.

Facial emotion recognition, theory of mind and the role of facial mimicry in depression

BACKGROUND

This study examined whether acutely (aMDD) and remitted depressed patients (rMDD) show deficits in the two aspects of social cognition - facial emotion recognition (FER) and reasoning - when using ecologically valid material. Furthermore, we examined whether reduced facial mimicry mediates the association between depressive symptoms and FER, and whether FER deficits and reasoning deficits are associated.

METHOD

In 42 aMDD, 43 rMDD, and 39 healthy controls (HC) FER was assessed using stimuli from the Amsterdam Dynamic Facial Expression Set, reasoning by the Movie for the Assessment of Social Cognition. Furthermore, the activity of Zygomaticus Major and Corrugator supercilii were recorded.

RESULTS

aMDD recognized happy faces less accurately, were less confident recognizing happiness and anger and found it more difficult to recognize happiness, anger and fear than HC. rMDD were less confident recognizing anger and found it more difficult to recognize happiness, anger and fear than HC. Reduced mimicry did not explain FER deficits. aMDD but not rMDD showed impaired reasoning.

LIMITATIONS

The stimulus material was comparably easy to decode. Therefore, it is possible that the FER deficits of aMDD and rMDD patients are more pronounced than demonstrated in this study.

CONCLUSIONS

aMDD show deficits in FER and reasoning, whereas rMDD only show mild impairments in the recognition of emotional expressions. There must be other processes - besides mimicry - that serve the accurate recognition of emotional facial expressions.

Facial Emotion Recognition and Expression in Parkinson's Disease: An Emotional Mirror Mechanism?

Background and aim

Parkinson’s disease (PD) patients have impairment of facial expressivity (hypomimia) and difficulties in interpreting the emotional facial expressions produced by others, especially for aversive emotions. We aimed to evaluate the ability to produce facial emotional expressions and to recognize facial emotional expressions produced by others in a group of PD patients and a group of healthy participants in order to explore the relationship between these two abilities and any differences between the two groups of participants.

Methods

Twenty non-demented, non-depressed PD patients and twenty healthy participants (HC) matched for demographic characteristics were studied. The ability of recognizing emotional facial expressions was assessed with the Ekman 60-faces test (Emotion recognition task). Participants were video-recorded while posing facial expressions of 6 primary emotions (happiness, sadness, surprise, disgust, fear and anger). The most expressive pictures for each emotion were derived from the videos. Ten healthy raters were asked to look at the pictures displayed on a computer-screen in pseudo-random fashion and to identify the emotional label in a six-forced-choice response format (Emotion expressivity task). Reaction time (RT) and accuracy of responses were recorded. At the end of each trial the participant was asked to rate his/her confidence in his/her perceived accuracy of response.

Results

For emotion recognition, PD reported lower score than HC for Ekman total score (p<0.001), and for single emotions sub-scores happiness, fear, anger, sadness (p<0.01) and surprise (p = 0.02). In the facial emotion expressivity task, PD and HC significantly differed in the total score (p = 0.05) and in the sub-scores for happiness, sadness, anger (all p<0.001). RT and the level of confidence showed significant differences between PD and HC for the same emotions. There was a significant positive correlation between the emotion facial recognition and expressivity in both groups; the correlation was even stronger when ranking emotions from the best recognized to the worst (R = 0.75, p = 0.004).

Conclusions

PD patients showed difficulties in recognizing emotional facial expressions produced by others and in posing facial emotional expressions compared to healthy subjects. The linear correlation between recognition and expression in both experimental groups suggests that the two mechanisms share a common system, which could be deteriorated in patients with PD. These results open new clinical and rehabilitation perspectives.

Does Facial Amimia Impact the Recognition of Facial Emotions? An EMG Study in Parkinson's Disease

According to embodied simulation theory, understanding other people’s emotions is fostered by facial mimicry. However, studies assessing the effect of facial mimicry on the recognition of emotion are still controversial. In Parkinson’s disease (PD), one of the most distinctive clinical features is facial amimia, a reduction in facial expressiveness, but patients also show emotional disturbances. The present study used the pathological model of PD to examine the role of facial mimicry on emotion recognition by investigating EMG responses in PD patients during a facial emotion recognition task (anger, joy, neutral). Our results evidenced a significant decrease in facial mimicry for joy in PD, essentially linked to the absence of reaction of the zygomaticus major and the orbicularis oculi muscles in response to happy avatars, whereas facial mimicry for expressions of anger was relatively preserved. We also confirmed that PD patients were less accurate in recognizing positive and neutral facial expressions and highlighted a beneficial effect of facial mimicry on the recognition of emotion. We thus provide additional arguments for embodied simulation theory suggesting that facial mimicry is a potential lever for therapeutic actions in PD even if it seems not to be necessarily required in recognizing emotion as such.

Facial expression to emotional stimuli in non-psychotic disorders: A systematic review and meta-analysis

Facial expression of emotion is crucial to social interaction and emotion regulation; therefore, altered facial expressivity can be a contributing factor in social isolation, difficulties with emotion regulation and a target for therapy. This article provides a systematic review and meta-analysis of the literature on automatic emotional facial expression in people with non-psychotic disorders compared to healthy comparison groups. Studies in the review used an emotionally salient visual induction method, and reported on automatic facial expression in response to congruent stimuli. A total of 39 studies show alterations in emotional facial expression across all included disorders, except anxiety disorders. In depression, decreases in facial expression are mainly evident for positive affect. In eating disorders, a meta-analysis showed decreased facial expressivity in response to positive and negative stimuli. Studies in autism partially support generally decreased facial expressivity in this group. The data included in this review point towards decreased facial emotional expressivity in individuals with different non-psychotic disorders. This is the first review to synthesise facial expression studies across clinical disorders.

Inducing a concurrent motor load reduces categorization precision for facial expressions

Motor theories of expression perception posit that observers simulate facial expressions within their own motor system, aiding perception and interpretation. Consistent with this view, reports have suggested that blocking facial mimicry induces expression labeling errors and alters patterns of ratings. Crucially, however, it is unclear whether changes in labeling and rating behavior reflect genuine perceptual phenomena (e.g., greater internal noise associated with expression perception or interpretation) or are products of response bias. In an effort to advance this literature, the present study introduces a new psychophysical paradigm for investigating motor contributions to expression perception that overcomes some of the limitations inherent in simple labeling and rating tasks. Observers were asked to judge whether smiles drawn from a morph continuum were sincere or insincere, in the presence or absence of a motor load induced by the concurrent production of vowel sounds. Having confirmed that smile sincerity judgments depend on cues from both eye and mouth regions (Experiment 1), we demonstrated that vowel production reduces the precision with which smiles are categorized (Experiment 2). In Experiment 3, we replicated this effect when observers were required to produce vowels, but not when they passively listened to the same vowel sounds. In Experiments 4 and 5, we found that gender categorizations, equated for difficulty, were unaffected by vowel production, irrespective of the presence of a smiling expression. These findings greatly advance our understanding of motor contributions to expression perception and represent a timely contribution in light of recent high-profile challenges to the existing evidence base.

Training in Compensatory Strategies Enhances Rapport in Interactions Involving People with Möbius Syndrome

In the exploratory study reported here, we tested the efficacy of an intervention designed to train teenagers with Möbius syndrome (MS) to increase the use of alternative communication strategies (e.g., gestures) to compensate for their lack of facial expressivity. Specifically, we expected the intervention to increase the level of rapport experienced in social interactions by our participants. In addition, we aimed to identify the mechanisms responsible for any such increase in rapport. In the study, five teenagers with MS interacted with three naïve participants without MS before the intervention, and with three different naïve participants without MS after the intervention. Rapport was assessed by self-report and by behavioral coders who rated videos of the interactions. Individual non-verbal behavior was assessed via behavioral coders, whereas verbal behavior was automatically extracted from the sound files. Alignment was assessed using cross recurrence quantification analysis and mixed-effects models. The results showed that observer-coded rapport was greater after the intervention, whereas self-reported rapport did not change significantly. Observer-coded gesture and expressivity increased in participants with and without MS, whereas overall linguistic alignment decreased. Fidgeting and repetitiveness of verbal behavior also decreased in both groups. In sum, the intervention may impact non-verbal and verbal behavior in participants with and without MS, increasing rapport as well as overall gesturing, while decreasing alignment.

Facial Feedback Affects Perceived Intensity but Not Quality of Emotional Expressions

Motivated by conflicting evidence in the literature, we re-assessed the role of facial feedback when detecting quantitative or qualitative changes in others’ emotional expressions. Fifty-three healthy adults observed self-paced morph sequences where the emotional facial expression either changed quantitatively (i.e., sad-to-neutral, neutral-to-sad, happy-to-neutral, neutral-to-happy) or qualitatively (i.e. from sad to happy, or from happy to sad). Observers held a pen in their own mouth to induce smiling or frowning during the detection task. When morph sequences started or ended with neutral expressions we replicated a congruency effect: Happiness was perceived longer and sooner while smiling; sadness was perceived longer and sooner while frowning. Interestingly, no such congruency effects occurred for transitions between emotional expressions. These results suggest that facial feedback is especially useful when evaluating the intensity of a facial expression, but less so when we have to recognize which emotion our counterpart is expressing.

Gender differences in the neural network of facial mimicry of smiles--An rTMS study

Under theories of embodied emotion, exposure to a facial expression triggers facial mimicry. Facial feedback is then used to recognize and judge the perceived expression. However, the neural bases of facial mimicry and of the use of facial feedback remain poorly understood. Furthermore, gender differences in facial mimicry and emotion recognition suggest that different neural substrates might accompany the production of facial mimicry, and the processing of facial feedback, in men and women. Here, repetitive transcranial magnetic stimulation (rTMS) was applied to the right primary motor cortex (M1), the right primary somatosensory cortex (S1), or, in a control condition, the vertex (VTX). Facial mimicry of smiles and emotion judgments were recorded in response to video clips depicting changes from neutral or angry to happy facial expressions. While in females rTMS over M1 and S1 compared to VTX led to reduced mimicry and, in the case of M1, delayed detection of smiles, there was no effect of TMS condition for males. We conclude that in female participants M1 and S1 play a role in the mimicry and in the use of facial feedback for accurate processing of smiles.

Empathy, but not mimicry restriction, influences the recognition of change in emotional facial expressions

The current study addressed the hypothesis that empathy and the restriction of facial muscles of observers can influence recognition of emotional facial expressions. A sample of 74 participants recognized the subjective onset of emotional facial expressions (anger, disgust, fear, happiness, sadness, surprise, and neutral) in a series of morphed face photographs showing a gradual change (frame by frame) from one expression to another. The high-empathy (as measured by the Empathy Quotient) participants recognized emotional facial expressions at earlier photographs from the series than did low-empathy ones, but there was no difference in the exploration time. Restriction of facial muscles of observers (with plasters and a stick in mouth) did not influence the responses. We discuss these findings in the context of the embodied simulation theory and previous data on empathy.

An emotion-differentiated perspective on empathy with the emotion specific empathy questionnaire

Empathy refers to the thoughts and feelings of one individual in response to the observed (emotional) experiences of another individual. Empathy, however, can occur toward persons experiencing a variety of emotions, raising the question of whether or not empathy can be emotion specific. This paper discusses theoretical and empirical support for the emotion specificity of empathy. We present a new measure, the Emotion Specific Empathy questionnaire, which assesses affective and cognitive empathy for the six basic emotions. This paper presents the measure's psychometric qualities and demonstrates, through a series of models, the discriminant validity between emotion specific empathies suggesting empathy is emotion specific. Results and implications are discussed.

Annual research review: Towards a developmental neuroscience of atypical social cognition

As a starting point for our review we use a developmental timeline, starting from birth and divided into major developmental epochs defined by key milestones of social cognition in typical development. For each epoch, we highlight those developmental disorders that diverge from the normal developmental pattern, what is known about these key milestones in the major disorders affecting social cognition, and any available research on the neural basis of these differences. We relate behavioural observations to four major networks of the social brain, that is, Amygdala, Mentalizing, Emotion and Mirror networks. We focus on those developmental disorders that are characterized primarily by social atypicality, such as autism spectrum disorder, social anxiety and a variety of genetically defined syndromes. The processes and aspects of social cognition we highlight are sketched in a putative network diagram, and include: agent identification, emotion processing and empathy, mental state attribution, self-processing and social hierarchy mapping involving social ‘policing’ and in-group/out-group categorization. Developmental disorders reveal some dissociable deficits in different components of this map of social cognition. This broad review across disorders, ages and aspects of social cognition leads us to some key questions: How can we best distinguish primary from secondary social disorders? Is social cognition especially vulnerable to developmental disorder, or surprisingly robust? Are cascading notions of social development, in which early functions are essential stepping stones or building bricks for later abilities, necessarily correct?

Thin-slice judgments in the clinical context

Clinicians make a variety of assessments about their clients, from judging personality traits to making diagnoses, and a variety of methods are available to do so, ranging from observations to structured interviews. A large body of work demonstrates that from a brief glimpse of another's nonverbal behavior, a variety of traits and inner states can be accurately perceived. Additionally, from these "thin slices" of behavior, even future outcomes can be predicted with some accuracy. Certain clinical disorders such as Parkinson's disease and facial paralysis disrupt nonverbal behavior and may impair clinicians' ability to make accurate judgments. In certain contexts, personality disorders, anxiety, depression, and suicide attempts and outcomes can be detected from others' nonverbal behavior. Additionally, thin slices can predict psychological adjustment to divorce, bereavement, sexual abuse, and well-being throughout life. Thus, for certain traits and disorders, judgments from a thin slice could provide a complementary tool for the clinician's toolbox.

How interpersonal power affects empathic accuracy: differential roles of mentalizing vs. mirroring?

Empathic accuracy (EA)—the correct assessment of the affective states and thoughts of a social partner—affects social behavior and the outcome of interpersonal interactions. Growing evidence has shown that interpersonal power of a perceiver affects EA when assessing a target. This picture, however, is not obvious; there is evidence supporting both the idea that power can improve EA or impair it. Moreover, the mechanisms through which high power individuals are more (or less) accurate at reading others' minds are unknown. The present article provides a new perspective on the power-EA link by investigating how two core abilities involved in EA, mentalizing and mirroring, can explain when and how power is related to EA. The inclusion of findings from neuroimaging studies on mentalizing and mirroring adds a cognitive neuroscience perspective to the power-EA research that has traditionally been conducted in a social psychological framework. The extent to which a given EA-test requires mentalizing or mirroring and the way power affects both of them could explain the contrasting findings. In addition, the analysis of the neural substrates of mentalizing and mirroring may provide new insight into the relationship between power and EA.

First report of generalized face processing difficulties in möbius sequence

Reverse simulation models of facial expression recognition suggest that we recognize the emotions of others by running implicit motor programmes responsible for the production of that expression. Previous work has tested this theory by examining facial expression recognition in participants with Möbius sequence, a condition characterized by congenital bilateral facial paralysis. However, a mixed pattern of findings has emerged, and it has not yet been tested whether these individuals can imagine facial expressions, a process also hypothesized to be underpinned by proprioceptive feedback from the face. We investigated this issue by examining expression recognition and imagery in six participants with Möbius sequence, and also carried out tests assessing facial identity and object recognition, as well as basic visual processing. While five of the six participants presented with expression recognition impairments, only one was impaired at the imagery of facial expressions. Further, five participants presented with other difficulties in the recognition of facial identity or objects, or in lower-level visual processing. We discuss the implications of our findings for the reverse simulation model, and suggest that facial identity recognition impairments may be more severe in the condition than has previously been noted.

Emotional mimicry as social regulation

Emotional mimicry is the imitation of the emotional expressions of others. According to the classic view on emotional mimicry (the Matched Motor Hypothesis), people mimic the specific facial movements that comprise a discrete emotional expression. However, little evidence exists for the mimicry of discrete emotions; rather, the extant evidence supports only valence-based mimicry. We propose an alternative Emotion Mimicry in Context view according to which emotional mimicry is not based on mere perception but rather on the interpretation of signals as emotional intentions in a specific context. We present evidence for the idea that people mimic contextualized emotions rather than simply expressive muscle movements. Our model postulates that (implicit or explicit) contextual information is needed for emotional mimicry to take place. It takes into account the relationship between observer and expresser, and suggests that emotional mimicry depends on this relationship and functions as a social regulator.

Emotional mimicry in social context: the case of disgust and pride

A recent review on facial mimicry concludes that emotional mimicry is less ubiquitous than has been suggested, and only occurs in interactions that are potentially affiliative (see Hess and Fischer, in revision). We hypothesize that individuals do not mimic facial expressions that can be perceived as offensive, such as disgust, and mimic positive emotion displays, but only when the context is affiliative (i.e., with intimates). Second, we expect that in spontaneous interactions not mimicry, but empathic feelings with the other predict the accurateness of emotion recognition. Data were collected in a pseudo-experimental setting, during an event organized for subscribers of a large Dutch women's magazine. One woman (expresser) was exposed to two emotional stimuli (i.e., a vile smell, a compliment) in order to evoke disgust and pride respectively. Another woman (observer: intimate or stranger) was sitting opposite of her. We collected self-report measures on emotions and empathy, and coded facial expressions of disgust and smiling on the basis of FACS. The results show that participants do not mimic disgust. In contrast, smiles displayed after the vile smell and the compliment were mimicked, but only among intimates. We also found that self-reported empathy and not mimicry is related to the recognition of disgust. These findings are discussed in the light of a Social Contextual view on emotional mimicry.

Gestural coupling and social cognition: Möbius Syndrome as a case study

Social cognition researchers have become increasingly interested in the ways that behavioral, physiological, and neural coupling facilitate social interaction and interpersonal understanding. We distinguish two ways of conceptualizing the role of such coupling processes in social cognition: strong and moderate interactionism. According to strong interactionism (SI), low-level coupling processes are alternatives to higher-level individual cognitive processes; the former at least sometimes render the latter superfluous. Moderate interactionism (MI) on the other hand, is an integrative approach. Its guiding assumption is that higher-level cognitive processes are likely to have been shaped by the need to coordinate, modulate, and extract information from low-level coupling processes. In this paper, we present a case study on Möbius Syndrome (MS) in order to contrast SI and MI. We show how MS-a form of congenital bilateral facial paralysis-can be a fruitful source of insight for research exploring the relation between high-level cognition and low-level coupling. Lacking a capacity for facial expression, individuals with MS are deprived of a primary channel for gestural coupling. According to SI, they lack an essential enabling feature for social interaction and interpersonal understanding more generally and thus ought to exhibit severe deficits in these areas. We challenge SI's prediction and show how MS cases offer compelling reasons for instead adopting MI's pluralistic model of social interaction and interpersonal understanding. We conclude that investigations of coupling processes within social interaction should inform rather than marginalize or eliminate investigation of higher-level individual cognition.