Spontaneous Facial Mimicry Is Enhanced by the Goal of Inferring Emotional States: Evidence for Moderation of "Automatic" Mimicry by Higher Cognitive Processes

Facial icons as indexes of emotions and intentions

Various objects and artifacts incorporate representations of faces, encompassing artworks like portraits, as well as ethnographic or industrial artifacts such as masks or humanoid robots. These representations exhibit diverse degrees of human-likeness, serving different functions and objectives. Despite these variations, they share common features, particularly facial attributes that serve as building blocks for facial expressions-an effective means of communicating emotions. To provide a unified conceptualization for this broad spectrum of face representations, we propose the term "facial icons" drawing upon Peirce's semiotic concepts. Additionally, based on these semiotic principles, we posit that facial icons function as indexes of emotions and intentions, and introduce a significant anthropological theory aligning with our proposition. Subsequently, we support our assertions by examining processes related to face and facial expression perception, as well as sensorimotor simulation processes involved in discerning others' mental states, including emotions. Our argumentation integrates cognitive and experimental evidence, reinforcing the pivotal role of facial icons in conveying mental states.

Putting a label on someone: impact of schizophrenia stigma on emotional mimicry, liking, and interpersonal closeness

Affiliation is both an antecedent and a consequence of emotional mimicry (i.e. imitating a counterpart's emotional expression). Thus, interacting with a disliked partner can decrease emotional mimicry, which in turn can further decrease liking. This perpetuating circle has not been investigated in the context of mental health stigma yet. The present study tested the influence of the label "schizophrenia" on liking, interpersonal closeness, and emotional mimicry. In an online experiment (n = 201), participants recruited from the general population saw several videos of actors displaying emotional expressions. Actors were described with one of four labels: "schizophrenia", "healthy", "diabetes", and a negative adjective (e.g. "hot-tempered"). Emotional mimicry was measured using OpenFace 2.2. Liking and interpersonal closeness were assessed with questionnaires. Overall, compared to other labels, participants reported less liking and interpersonal closeness to the actor with the schizophrenia label. However, no effect on emotional mimicry was found. The decreased liking of the schizophrenia actors was explained by a lack of knowledge about schizophrenia and the explicit stigma of schizophrenia. Our study contributes to the literature by highlighting the need to reduce the stigma of schizophrenia.

The Neural Mechanisms of Group Membership Effect on Emotional Mimicry: A Multimodal Study Combining Electromyography and Electroencephalography

Emotional mimicry plays a vital role in understanding others' emotions and has been found to be modulated by social contexts, especially group membership. However, the neural mechanisms underlying this modulation remain unclear. We explored whether and how group membership modulated emotional mimicry using a multimodal method combining facial electromyography (fEMG) and electroencephalography (EEG). We instructed participants to passively view dynamic emotional faces (happy vs. angry) of others (in-group vs. out-group) and simultaneously recorded their fEMG and EEG responses. Then, we conducted combined analyses of fEMG-EEG by splitting the EEG trials into two mimicry intensity categories (high-intensity mimicry vs. low-intensity mimicry) according to fEMG activity. The fEMG results confirmed the occurrence of emotional mimicry in the present study but failed to find a group membership effect. However, the EEG results showed that participants mimicked in-group happiness and anger more than out-group. Importantly, this in-group preference involved different neural mechanisms in happiness and anger mimicry. In-group preference for happiness mimicry occurred at multiple neural mechanisms such as N1 (at P7, Pz, and P8), P2 (at Pz and P8), N2 (at P8), and P3 (at P7, Pz, and P8); in-group preference for anger mimicry occurred at P1 (at P7) and P2 (at Pz). Our findings provide new neural evidence for the effect of group membership on emotional mimicry by uncovering the temporal dynamics of this effect.

Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding

Although electromyography (EMG) remains the standard, researchers have begun using automated facial action coding system (FACS) software to evaluate spontaneous facial mimicry despite the lack of evidence of its validity. Using the facial EMG of the zygomaticus major (ZM) as a standard, we confirmed the detection of spontaneous facial mimicry in action unit 12 (AU12, lip corner puller) via an automated FACS. Participants were alternately presented with real-time model performance and prerecorded videos of dynamic facial expressions, while simultaneous ZM signal and frontal facial videos were acquired. Facial videos were estimated for AU12 using FaceReader, Py-Feat, and OpenFace. The automated FACS is less sensitive and less accurate than facial EMG, but AU12 mimicking responses were significantly correlated with ZM responses. All three software programs detected enhanced facial mimicry by live performances. The AU12 time series showed a roughly 100 to 300 ms latency relative to the ZM. Our results suggested that while the automated FACS could not replace facial EMG in mimicry detection, it could serve a purpose for large effect sizes. Researchers should be cautious with the automated FACS outputs, especially when studying clinical populations. In addition, developers should consider the EMG validation of AU estimation as a benchmark.

Exploring the Influence of Context on Emotional Mimicry and Intention: An Affirmation of the Correction Hypothesis

BACKGROUND

Emotional mimicry, a phenomenon frequently observed in our everyday interactions, is the act of replicating another individual's facial expression. The Emotion Mimicry in Context View and the Correction Hypothesis underscore the critical role of context and intention within emotional mimicry.

METHODS

In two distinct studies, participants were presented with facial expressions of models (happiness and anger) within various contexts (affiliative, distancing, and neutral). Concurrently, we recorded electromyography (EMG) to index emotional mimicry, while participants explicitly rated the models' intentions.

RESULTS

We observed context swiftly influences emotional mimicry within 500 ms, notably when the intentions of contexts are opposing to the intentions of facial expressions, leading to weakened muscle responses and diminished perceived intention. Furthermore, a notable correlation was discovered in the mimicry of angry faces; the more distancing the context, the stronger the corrugator supercilii (CS) muscle activity after context processing.

CONCLUSIONS

First, emotional mimicry should not be simply viewed as an output corresponding to the expresser's facial expressions but the dynamic process involving the active participation of the observer. Second, intention serves as a pivotal anchor, effectively integrating facial and contextual information. As such, we provided empirical support for the Correction Hypothesis.

Examining the relationship of personality traits with online teaching using emotive responses and physiological signals

In the education sector, there is a rapid increase in using online teaching and learning scenarios. Making these scenarios more effective is the main purpose of this study. Though there are a lot of factors that affect it, however, the primary focus is to find out the relationship between a teacher's personality and their liking for online teaching. To conduct the study, a framework has been proposed which is a mixed design of self-reported (emotions and personality) data and physiological responses of a teacher. In self-reported data, along with teachers, learners' perception of a teacher's personality is also considered which explores their relationship with online teaching. The final results reveal that teachers with a high level of agreeableness, conscientiousness, and openness personality traits are more comfortable with online teaching as compared to extraversion and neuroticism traits. To validate the self-reported data analysis, the physiological responses of teachers were recorded that ensure the authenticity of the collected data. It also ensures that the physiological responses along with emotions are also good indicators of personality recognition.

Experiential, expressive, and physiological effects of positive and negative emotion regulation goals while reappraising amusing stimuli

We examined whether positive and negative emotion regulation (ER) goals while cognitively reappraising amusing stimuli differentially engage positive (PA) and negative affect (NA) systems. Forty-eight women watched 20-30s amusing film clips. They were instructed to either respond naturally (no ER goal) or emphasize the film clips' positive (positive ER goal) or negative (negative ER goal) aspects in their interpretation. We measured PA and NA system activity on experiential, expressive, and physiological response channels through self-reported amusement and disgust, electromyography of zygomaticus major and corrugator supercilii, and autonomic nervous system reactivity from respiratory sinus arrhythmia (RSA) and pre-ejection period (PEP). Natural viewing (no ER goal) of amusing clips increased self-reported amusement (and to a lesser degree disgust), zygomaticus reactivity, and RSA. Compared to no and negative ER goals, reappraising the amusing clips with a positive ER goal decreased corrugator reactivity, decreasing negative emotional expression. Compared to no and positive ER goals, reappraising the amusing clips with a negative ER goal decreased self-reported amusement and zygomaticus reactivity and increased self-reported disgust and corrugator reactivity, decreasing positive and increasing negative emotional experience and expression. We conclude that positive and negative ER goals while reappraising amusing stimuli differentially engaged PA and NA systems: The positive ER goal engaged withdrawal of the expressive NA system, whereas the negative ER goal engaged reciprocal NA-PA system activation on experiential and expressive response channels.

Bridging the empathy gap: or not? Reactions to ingroup and outgroup facial expressions

Prior research suggests that group membership impacts behavioral and self-reported responses to others’ facial expressions of emotion. In this paper, we examine how the mere labelling of a face as an ingroup or outgroup member affects facial mimicry (Study 1) and judgments of genuineness (Study 2). In addition, we test whether the effects of group membership on facial mimicry and perceived genuineness are moderated by the presence of tears (Study 1) and the motivation to cooperate (Study 2). Results from both studies revealed group-specific biases in facial mimicry and judgments of genuineness. However, introducing cooperative goals abolished differences in judgments of genuineness of facial expressions displayed by ingroup and outgroup members. Together, the findings provide insights into how intergroup biases in emotion perception operate and how they can be reduced by introducing cooperative goals.

The Effect of Facial Self-Resemblance on Emotional Mimicry

Social resemblance, like group membership or similar attitudes, increases the mimicry of the observed emotional facial display. In this study, we investigate whether facial self-resemblance (manipulated by computer morphing) modulates emotional mimicry in a similar manner. Participants watched dynamic expressions of faces that either did or did not resemble their own, while their facial muscle activity was measured using EMG. Additionally, after each presentation, respondents completed social evaluations of the faces they saw. The results show that self-resemblance evokes convergent facial reactions. More specifically, participants mimicked the happiness and, to a lesser extent, the anger of self-resembling faces. In turn, the happiness of non-resembling faces was less likely mimicked than in the case of self-resembling faces, while anger evoked a more divergent, smile-like response. Finally, we found that social evaluations were in general increased by happiness displays, but not influenced by resemblance. Overall, the study demonstrates an interesting and novel phenomenon, particularly that mimicry can be modified by relatively subtle cues of physical resemblance.

Creation and validation of the Picture-Set of Young Children's Affective Facial Expressions (PSYCAFE)

The immediate detection and correct processing of affective facial expressions are one of the most important competences in social interaction and thus a main subject in emotion and affect research. Generally, studies in these research domains, use pictures of adults who display affective facial expressions as experimental stimuli. However, for studies investigating developmental psychology and attachment behaviour it is necessary to use age-matched stimuli, where it is children that display affective expressions. PSYCAFE represents a newly developed picture-set of children’s faces. It includes reference portraits of girls and boys aged 4 to 6 years averaged digitally from different individual pictures, that were categorized to six basic affects (fear, disgust, happiness, sadness, anger and surprise) plus a neutral facial expression by cluster analysis. This procedure led to deindividualized and affect prototypical portraits. Individual affect expressive portraits of adults from an already validated picture-set (KDEF) were used in a similar way to create affect prototypical images also of adults. The stimulus set has been validated on human observers and entail emotion recognition accuracy rates and scores for intensity, authenticity and likeability ratings of the specific affect displayed. Moreover, the stimuli have also been characterized by the iMotions Facial Expression Analysis Module, providing additional data on probability values representing the likelihood that the stimuli depict the expected affect. Finally, the validation data from human observers and iMotions are compared to data on facial mimicry of healthy adults in response to these portraits, measured by facial EMG (m. zygomaticus major and m. corrugator supercilii).

Interpersonal physiological synchrony is associated with first person and third person subjective assessments of excitement during cooperative joint tasks

Interpersonal physiological synchrony has been shown to play important roles in social activities. While most studies have shed light on the effects of physiological synchrony on recognition of the group state, such as cohesion or togetherness, the effect of physiological synchrony on the recognition of emotional experience has not been adequately researched. In this study, we examined how physiological synchrony is associated with first- and third-person emotion recognition during a joint task. Two participants played a cooperative block-stacking game (Jenga), alternating their roles as player and adviser, while their heart rates were recorded. The participants evaluated their own emotional experience for each turn. Bystanders watched the game to evaluate the players' emotions. Results showed that the players' subjective excitement increased not only with their own heart rate, but also with increased heart rate synchrony with their adviser. Heart rate synchrony between player and adviser also related to increased intensity in perceived excitement from the bystanders. Given that both first- and third-person emotion recognition can have cumulative impacts on a group, the relationship between physiological synchrony and emotion recognition observed in the present study will help deepen understanding of the psychophysiological mechanisms underlying larger group phenomena such as crowd excitement.

Facial expression in humans as a measure of empathy towards farm animals in pain

People often express concern for the welfare of farm animals, but research on this topic has relied upon self-report. Facial expressions provide a quantifiable measure of emotional response that may be less susceptible to social desirability bias and other issues associated with self-report. Viewing other humans in pain elicits facial expressions indicative of empathy. Here we provide the first evidence that this measure can also be used to assess human empathetic responses towards farm animals, showing that facial expressions respond reliably when participants view videos of farm animals undergoing painful procedures. Participants (n = 30) were asked to watch publicly sourced video clips of cows and pigs undergoing common management procedures (e.g. disbudding, castration, tail docking) and control videos (e.g. being lightly restrained, standing). Participants provided their subjective rating of the intensity of 5 negative emotions (pain, sadness, anger, fear, disgust) on an 11-point Likert scale. Videos of the participants (watching the animals) were scored for intensity of unpleasantness of the participants' facial expression (also on an 11-point Likert scale) by a trained observer who was blind to treatment. Participants showed more intense facial expressions while viewing painful procedures versus control procedures (mean ± SE Likert; 2.4 ± 0.08 versus 0.6 ± 0.17). Participants who reported more intense negative responses also showed stronger facial expressions (slope ± SE = 0.4 ± 0.04). Both the self-reported and facial measures varied with species and procedure witnessed. These results indicate that facial expressions can be used to assess human-animal empathy.

The effect of eye gaze direction on emotional mimicry: A multimodal study with electromyography and electroencephalography

Emotional mimicry plays an important role in social interaction and is influenced by social context, especially eye gaze direction. However, the neural mechanism underlying the effect of eye gaze direction on emotional mimicry is unclear. Here, we explored how eye gaze direction influenced emotional mimicry with a combination of electromyography (EMG) and electroencephalography (EEG) techniques, which may provide a more comprehensive measure. To do this, we recorded facial EMG and scalp EEG signals simultaneously while participants observed emotional faces (happy vs. angry) with direct or averted gaze. Then, we split the EEG trials into two mimicry intensity categories (high mimicry intensity, HMI vs. low mimicry intensity, LMI) according to EMG activity. The ERP difference between HMI and LMI EEG trials revealed four ERP components (P50, P150, N200 and P300), and the effect of eye gaze direction on emotional mimicry was prominent on P300 at P7 and P8. Moreover, we also observed differences in the effect of eye gaze direction on mimicry of happy faces and angry faces, which were found on P300 at P7, as well as P150 at P7 and N200 at P7 and Pz. In short, the present study isolated the neural signals of emotional mimicry with a new multimodal method, and provided empirical neural evidence that eye gaze direction affected emotional mimicry.

Predicting affective appraisals from facial expressions and physiology using machine learning

The present study explored the interrelations between a broad set of appraisal ratings and five physiological signals, including facial EMG, electrodermal activity, and heart rate variability, that were assessed in 157 participants watching 10 emotionally charged videos. A total of 134 features were extracted from the physiological data, and a benchmark comparing different kinds of machine learning algorithms was conducted to test how well the appraisal dimensions can be predicted from these features. For 13 out of 21 appraisals, a robust positive R² was attained, indicating that the dimensions are actually related to the considered physiological channels. The highest R² (.407) was reached for the appraisal dimension intrinsic pleasantness. Moreover, the comparison of linear and nonlinear algorithms and the inspection of the links between the appraisals and single physiological features using accumulated local effects plots indicates that the relationship between physiology and appraisals is nonlinear. By constructing different importance measures for the assessed physiological channels, we showed that for the 13 predictable appraisals, the five channels explained different amounts of variance and that only a few blocks incrementally explained variance beyond the other physiological channels.

Explicit and Implicit Responses of Seeing Own vs. Others' Emotions: An Electromyographic Study on the Neurophysiological and Cognitive Basis of the Self-Mirroring Technique

Facial mimicry is described by embodied cognition theories as a human mirror system-based neural mechanism underpinning emotion recognition. This could play a critical role in the Self-Mirroring Technique (SMT), a method used in psychotherapy to foster patients’ emotion recognition by showing them a video of their own face recorded during an emotionally salient moment. However, dissociation in facial mimicry during the perception of own and others’ emotions has not been investigated so far. In the present study, we measured electromyographic (EMG) activity from three facial muscles, namely, the zygomaticus major (ZM), the corrugator supercilii (CS), and the levator labii superioris (LLS) while participants were presented with video clips depicting their own face or other unknown faces expressing anger, happiness, sadness, disgust, fear, or a neutral emotion. The results showed that processing self vs. other expressions differently modulated emotion perception at the explicit and implicit muscular levels. Participants were significantly less accurate in recognizing their own vs. others’ neutral expressions and rated fearful, disgusted, and neutral expressions as more arousing in the self condition than in the other condition. Even facial EMG evidenced different activations for self vs. other facial expressions. Increased activation of the ZM muscle was found in the self condition compared to the other condition for anger and disgust. Activation of the CS muscle was lower for self than for others’ expressions during processing a happy, sad, fearful, or neutral emotion. Finally, the LLS muscle showed increased activation in the self condition compared to the other condition for sad and fearful expressions but increased activation in the other condition compared to the self condition for happy and neutral expressions. Taken together, our complex pattern of results suggests a dissociation at both the explicit and implicit levels in emotional processing of self vs. other emotions that, in the light of the Emotion in Context view, suggests that STM effectiveness is primarily due to a contextual–interpretative process that occurs before that facial mimicry takes place.

The unique social sense of puerperium: Increased empathy and Schadenfreude in parents of newborns

Pregnancy and puerperium are typified by marked biobehavioral changes. These changes, which are traceable in both mothers and fathers, play an important role in parenthood and may modulate social cognition abilities. However, the latter effects remain notably unexplored in parents of newborns (PNs). To bridge this gap, we assessed empathy and social emotions (envy and Schadenfreude) in 55 PNs and 60 controls (childless healthy participants without a romantic relationship or sexual intercourse in the previous 48 hours). We used facial electromyography to detect physiological signatures of social emotion processing. Results revealed higher levels of affective empathy and Schadenfreude in PNs, the latter pattern being accompanied by increased activity of the corrugator suppercilii region. These effects were not explained by potential confounding variables (educational level, executive functioning, depression, stress levels, hours of sleep). Our novel findings suggest that PNs might show social cognition changes crucial for parental bonding and newborn care.

Perception of Discrete Emotions in Others: Evidence for Distinct Facial Mimicry Patterns

Covert facial mimicry involves subtle facial muscle activation in observers when they perceive the facial emotional expressions of others. It remains uncertain whether prototypical facial features in emotional expressions are being covertly mimicked and also whether covert facial mimicry involves distinct facial muscle activation patterns across muscles per emotion category, or simply distinguishes positive versus negative valence in observed facial emotions. To test whether covert facial mimicry is emotion-specific, we measured facial electromyography (EMG) from five muscle sites (corrugator supercilii, levator labii, frontalis lateralis, depressor anguli oris, zygomaticus major) whilst participants watched videos of people expressing 9 different basic and complex emotions and a neutral expression. This study builds upon previous research by including a greater number of facial muscle measures and emotional expressions. It is the first study to investigate activation patterns across muscles during facial mimicry and to provide evidence for distinct patterns of facial muscle activation when viewing individual emotion categories, suggesting that facial mimicry is emotion-specific, rather than just valence-based.

The interactive effect of empathy and motor cortex stimulation on hand gesture comprehension

Previous research has demonstrated that the Action-Observation Network (AON) is involved in both emotional-embodiment (empathy) and action-embodiment mechanisms. In the current study, we hypothesized that interfering with the AON will impair action recognition and that this impairment will be modulated by empathy levels. Fifty-two participants conducted a semantic decision task of hand gesture recognition, while we interfered with the AON by applying active (n = 26) or sham (n = 26) transcranial Direct Current Stimulation (tDCS) to the hand area of the primary motor cortex. We found that interfering with the AON impaired the performance of participants with high empathy levels and enhanced the performance of participants with low empathy. This finding suggests that the embodiment module may be flexible, and that it can be enhanced in individuals with low empathy by simple manipulation of motor activation.

Convergence of physiological responses to pain during face-to-face interaction

Empathy with another’s pain is an important social glue for maintaining interpersonal relationships. In most previous studies investigating the sharing of pain, a signal conveying a painful experience is presented by a target (“sender”) as a stimulus to a participant (“receiver”), and the emotional/physiological responses of the participant are measured. However, this unilateral “sender-receiver” paradigm does not adequately address the possible bidirectional experience of shared pain accruing from interaction. Our aim was therefore to investigate the bidirectional effects of sharing pain in social settings. Thirty-six unfamiliar pairs were simultaneously and repeatedly exposed to the same pain-provoking (thermal) stimuli, either in a face-to-face or a “shielded” condition where a partition prevented the partner’s responses from being fully observed. We recorded the blood volume pulse of each participant to measure the acute sympathetic response while a pair of participants experienced the stimuli simultaneously. The results revealed that participants with weaker reactions elevated their physiological reactivity to the stimulus in accordance with their partner’s reactions in the face-to-face condition. The pair-level physiological similarity was also higher compared to the shielded condition. Such a low-to-high physiological convergence may underlie the collective elevation of pain expressions, which is often observed in interactive settings.

Human perception and biosignal-based identification of posed and spontaneous smiles

Facial expressions are behavioural cues that represent an affective state. Because of this, they are an unobtrusive alternative to affective self-report. The perceptual identification of facial expressions can be performed automatically with technological assistance. Once the facial expressions have been identified, the interpretation is usually left to a field expert. However, facial expressions do not always represent the felt affect; they can also be a communication tool. Therefore, facial expression measurements are prone to the same biases as self-report. Hence, the automatic measurement of human affect should also make inferences on the nature of the facial expressions instead of describing facial movements only. We present two experiments designed to assess whether such automated inferential judgment could be advantageous. In particular, we investigated the differences between posed and spontaneous smiles. The aim of the first experiment was to elicit both types of expressions. In contrast to other studies, the temporal dynamics of the elicited posed expression were not constrained by the eliciting instruction. Electromyography (EMG) was used to automatically discriminate between them. Spontaneous smiles were found to differ from posed smiles in magnitude, onset time, and onset and offset speed independently of the producer's ethnicity. Agreement between the expression type and EMG-based automatic detection reached 94% accuracy. Finally, measurements of the agreement between human video coders showed that although agreement on perceptual labels is fairly good, the agreement worsens with inferential labels. A second experiment confirmed that a layperson's accuracy as regards distinguishing posed from spontaneous smiles is poor. Therefore, the automatic identification of inferential labels would be beneficial in terms of affective assessments and further research on this topic.

A case of V180I genetic Creutzfeldt-Jakob disease presenting with conspicuous facial mimicry

Although there have been no reports of facial mimicry in patients with Creutzfeldt-Jakob disease (CJD), we encountered a patient with genetic CJD with prion protein gene codon 180 mutation (V180I gCJD) who apparently showed this interesting clinical finding. The patient was an 87-year-old Japanese woman, and the first observed CJD symptom was poor spontaneity. She gradually showed cognitive dysfunction and subsequently gait disturbance. A prion protein gene analysis revealed a V180I mutation with methionine homozygosity at codon 129. Facial mimicry was observed 7 months after disease onset and continued for approximately 9 months. Pathological laughing and startle reaction were also observed during approximately the same period, whereas myoclonus was observed at a later stage, 12 months after disease onset, and was very mild in degree. Electroencephalography studies showed a diffuse slow basic pattern without periodic sharp wave complexes. Diffusion-weighted magnetic resonance imaging showed extensive hyperintensity in the cerebral cortex, and there was also hyperintensity with edematous swelling in the same regions on T2-weighted and fluid-attenuated inversion recovery images. On the basis of the magnetic resonance imaging findings and the findings of previous case reports of V180I gCJD, we speculate that the characteristic extensive cerebrocortical involvement observed in V180I gCJD was implicated in the pathogenesis of the facial mimicry observed in this case.

Empathy in Facial Mimicry of Fear and Disgust: Simultaneous EMG-fMRI Recordings During Observation of Static and Dynamic Facial Expressions

Real-life faces are dynamic by nature, particularly when expressing emotion. Increasing evidence suggests that the perception of dynamic displays enhances facial mimicry and induces activation in widespread brain structures considered to be part of the mirror neuron system, a neuronal network linked to empathy. The present study is the first to investigate the relations among facial muscle responses, brain activity, and empathy traits while participants observed static and dynamic (videos) facial expressions of fear and disgust. During display presentation, blood-oxygen level-dependent (BOLD) signal as well as muscle reactions of the corrugator supercilii and levator labii were recorded simultaneously from 46 healthy individuals (21 females). It was shown that both fear and disgust faces caused activity in the corrugator supercilii muscle, while perception of disgust produced facial activity additionally in the levator labii muscle, supporting a specific pattern of facial mimicry for these emotions. Moreover, individuals with higher, compared to individuals with lower, empathy traits showed greater activity in the corrugator supercilii and levator labii muscles; however, these responses were not differentiable between static and dynamic mode. Conversely, neuroimaging data revealed motion and emotional-related brain structures in response to dynamic rather than static stimuli among high empathy individuals. In line with this, there was a correlation between electromyography (EMG) responses and brain activity suggesting that the Mirror Neuron System, the anterior insula and the amygdala might constitute the neural correlates of automatic facial mimicry for fear and disgust. These results revealed that the dynamic property of (emotional) stimuli facilitates the emotional-related processing of facial expressions, especially among whose with high trait empathy.

A role for affectivity in rapid facial mimicry: An electromyographic study

Emotional expressions evoke rapid facial reactions in the perceiver that are consistent with the valence of the observed expression. We aimed to investigate whether this robust facial reaction is purely a motor matching response or instead represents underlying affective processes. Participants' (N = 60) corrugator supercilii and zygomaticus major muscle activity was quantified using facial electromyography (EMG) while they viewed three sets of images; (i) upright happy and angry facial expressions, (ii) inverted happy and angry facial expressions, and (iii) sad and happy eyes and mouth expressions. Participants displayed patterns of EMG responding that were consistent with the affective valence of the emotional expression, as opposed to merely matching the observed stimuli (i.e. a motor matching response). Using a novel methodological approach, these findings provide evidence for the contention that affective processing underlies rapid facial mimicry reactions.

The interaction between embodiment and empathy in facial expression recognition

Previous research has demonstrated that the Action-Observation Network (AON) is involved in both emotional-embodiment (empathy) and action-embodiment mechanisms. In this study, we hypothesized that interfering with the AON will impair action recognition and that this impairment will be modulated by empathy levels. In Experiment 1 (n = 90), participants were asked to recognize facial expressions while their facial motion was restricted. In Experiment 2 (n = 50), we interfered with the AON by applying transcranial Direct Current Stimulation to the motor cortex. In both experiments, we found that interfering with the AON impaired the performance of participants with high empathy levels; however, for the first time, we demonstrated that the interference enhanced the performance of participants with low empathy. This novel finding suggests that the embodiment module may be flexible, and that it can be enhanced in individuals with low empathy by simple manipulation of motor activation.

Integrating Tinbergen's inquiries: Mimicry and play in humans and other social mammals

Visual signals convey emotions and intentions between individuals. Darwin underlined that human facial expressions represent a shared heritage between our species and many other social mammals. Social play is a fertile field to examine the role and the potential communicative function of facial expressions. The relaxed open-mouth (or play face) is a context-specific playful expression, which is widespread in human and non-human mammals. Here, we focus on playful communication by applying Tinbergen's four areas of inquiry: proximate causation, ontogeny, function, and evolution. First of all we explore mimicry by focusing on its neural substrates and factors of modulation within playful and non-playful context (proximate causation). Play face is one of the earliest facial expressions to appear and be mimicked in neonates. The motor resonance between infants and their caregivers is essential later in life when individuals begin to engage in increasingly complex social interactions, including play (ontogeny). The success of a playful session can be evaluated by its duration in time. Mirroring facial expressions prolongs the session by favoring individuals to fine-tune their own motor sequences accordingly (function). Finally, through a comparative approach we also demonstrate that the elements constituting play communication and mimicry are sensitive to the quality of interindividual relationships of a species, thus reflecting the nature of its social network and style (evolution). In conclusion, our goal is to integrate Tinbergen's four areas of ethological inquiry to provide a broader framework regarding the importance of communication and mimicry in the play domain of humans and other social mammals.

Neural Correlates of Facial Mimicry: Simultaneous Measurements of EMG and BOLD Responses during Perception of Dynamic Compared to Static Facial Expressions

Facial mimicry (FM) is an automatic response to imitate the facial expressions of others. However, neural correlates of the phenomenon are as yet not well established. We investigated this issue using simultaneously recorded EMG and BOLD signals during perception of dynamic and static emotional facial expressions of happiness and anger. During display presentations, BOLD signals and zygomaticus major (ZM), corrugator supercilii (CS) and orbicularis oculi (OO) EMG responses were recorded simultaneously from 46 healthy individuals. Subjects reacted spontaneously to happy facial expressions with increased EMG activity in ZM and OO muscles and decreased CS activity, which was interpreted as FM. Facial muscle responses correlated with BOLD activity in regions associated with motor simulation of facial expressions [i.e., inferior frontal gyrus, a classical Mirror Neuron System (MNS)]. Further, we also found correlations for regions associated with emotional processing (i.e., insula, part of the extended MNS). It is concluded that FM involves both motor and emotional brain structures, especially during perception of natural emotional expressions.

Spontaneous Facial Actions Map onto Emotional Experiences in a Non-social Context: Toward a Component-Based Approach

While numerous studies have examined the relationships between facial actions and emotions, they have yet to account for the ways that specific spontaneous facial expressions map onto emotional experiences induced without expressive intent. Moreover, previous studies emphasized that a fine-grained investigation of facial components could establish the coherence of facial actions with actual internal states. Therefore, this study aimed to accumulate evidence for the correspondence between spontaneous facial components and emotional experiences. We reinvestigated data from previous research which secretly recorded spontaneous facial expressions of Japanese participants as they watched film clips designed to evoke four different target emotions: surprise, amusement, disgust, and sadness. The participants rated their emotional experiences via a self-reported questionnaire of 16 emotions. These spontaneous facial expressions were coded using the Facial Action Coding System, the gold standard for classifying visible facial movements. We corroborated each facial action that was present in the emotional experiences by applying stepwise regression models. The results found that spontaneous facial components occurred in ways that cohere to their evolutionary functions based on the rating values of emotional experiences (e.g., the inner brow raiser might be involved in the evaluation of novelty). This study provided new empirical evidence for the correspondence between each spontaneous facial component and first-person internal states of emotion as reported by the expresser.

The Role of Embodiment and Individual Empathy Levels in Gesture Comprehension

Research suggests that the action-observation network is involved in both emotional-embodiment (empathy) and action-embodiment (imitation) mechanisms. Here we tested whether empathy modulates action-embodiment, hypothesizing that restricting imitation abilities will impair performance in a hand gesture comprehension task. Moreover, we hypothesized that empathy levels will modulate the imitation restriction effect. One hundred twenty participants with a range of empathy scores performed gesture comprehension under restricted and unrestricted hand conditions. Empathetic participants performed better under the unrestricted compared to the restricted condition, and compared to the low empathy participants. Remarkably however, the latter showed the exactly opposite pattern and performed better under the restricted condition. This pattern was not found in a facial expression recognition task. The selective interaction of embodiment restriction and empathy suggests that empathy modulates the way people employ embodiment in gesture comprehension. We discuss the potential of embodiment-induced therapy to improve empathetic abilities in individuals with low empathy.

Emotional Empathy and Facial Mimicry for Static and Dynamic Facial Expressions of Fear and Disgust

Facial mimicry is the tendency to imitate the emotional facial expressions of others. Increasing evidence suggests that the perception of dynamic displays leads to enhanced facial mimicry, especially for happiness and anger. However, little is known about the impact of dynamic stimuli on facial mimicry for fear and disgust. To investigate this issue, facial EMG responses were recorded in the corrugator supercilii, levator labii, and lateral frontalis muscles, while participants viewed static (photos) and dynamic (videos) facial emotional expressions. Moreover, we tested whether emotional empathy modulated facial mimicry for emotional facial expressions. In accordance with our predictions, the highly empathic group responded with larger activity in the corrugator supercilii and levator labii muscles. Moreover, dynamic compared to static facial expressions of fear revealed enhanced mimicry in the high-empathic group in the frontalis and corrugator supercilii muscles. In the low-empathic group the facial reactions were not differentiated between fear and disgust for both dynamic and static facial expressions. We conclude that highly empathic subjects are more sensitive in their facial reactions to the facial expressions of fear and disgust compared to low empathetic counterparts. Our data confirms that personal characteristics, i.e., empathy traits as well as modality of the presented stimuli, modulate the strength of facial mimicry. In addition, measures of EMG activity of the levator labii and frontalis muscles may be a useful index of empathic responses of fear and disgust.