1
|
Holmer E, Rönnberg J, Asutay E, Tirado C, Ekberg M. Facial mimicry interference reduces working memory accuracy for facial emotion expressions. PLoS One 2024; 19:e0306113. [PMID: 38924006 PMCID: PMC11207140 DOI: 10.1371/journal.pone.0306113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 06/11/2024] [Indexed: 06/28/2024] Open
Abstract
Facial mimicry, the tendency to imitate facial expressions of other individuals, has been shown to play a critical role in the processing of emotion expressions. At the same time, there is evidence suggesting that its role might change when the cognitive demands of the situation increase. In such situations, understanding another person is dependent on working memory. However, whether facial mimicry influences working memory representations for facial emotion expressions is not fully understood. In the present study, we experimentally interfered with facial mimicry by using established behavioral procedures, and investigated how this interference influenced working memory recall for facial emotion expressions. Healthy, young adults (N = 36) performed an emotion expression n-back paradigm with two levels of working memory load, low (1-back) and high (2-back), and three levels of mimicry interference: high, low, and no interference. Results showed that, after controlling for block order and individual differences in the perceived valence and arousal of the stimuli, the high level of mimicry interference impaired accuracy when working memory load was low (1-back) but, unexpectedly, not when load was high (2-back). Working memory load had a detrimental effect on performance in all three mimicry conditions. We conclude that facial mimicry might support working memory for emotion expressions when task load is low, but that the supporting effect possibly is reduced when the task becomes more cognitively challenging.
Collapse
Affiliation(s)
- Emil Holmer
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- Linnaeus Centre HEAD, Linköping University, Linköping, Sweden
| | - Jerker Rönnberg
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- Linnaeus Centre HEAD, Linköping University, Linköping, Sweden
| | - Erkin Asutay
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- JEDI Lab, Linköping University, Linköping, Sweden
| | - Carlos Tirado
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| | - Mattias Ekberg
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| |
Collapse
|
2
|
Rutkowska JM, Ghilardi T, Vacaru SV, van Schaik JE, Meyer M, Hunnius S, Oostenveld R. Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach. Behav Res Methods 2024:10.3758/s13428-024-02421-4. [PMID: 38773029 DOI: 10.3758/s13428-024-02421-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/07/2024] [Indexed: 05/23/2024]
Abstract
Surface facial electromyography (EMG) is commonly used to detect emotions from subtle facial expressions. Although there are established procedures for collecting EMG data and some aspects of their processing, there is little agreement among researchers about the optimal way to process the EMG signal, so that the study-unrelated variability (noise) is removed, and the emotion-related variability is best detected. The aim of the current paper was to establish an optimal processing pipeline for EMG data for identifying emotional expressions in facial muscles. We identified the most common processing steps from existing literature and created 72 processing pipelines that represented all the different processing choices. We applied these pipelines to a previously published dataset from a facial mimicry experiment, where 100 adult participants observed happy and sad facial expressions, whilst the activity of their facial muscles, zygomaticus major and corrugator supercilii, was recorded with EMG. We used a resampling approach and subsets of the original data to investigate the effect and robustness of different processing choices on the performance of a logistic regression model that predicted the mimicked emotion (happy/sad) from the EMG signal. In addition, we used a random forest model to identify the most important processing steps for the sensitivity of the logistic regression model. Three processing steps were found to be most impactful: baseline correction, standardisation within muscles, and standardisation within subjects. The chosen feature of interest and the signal averaging had little influence on the sensitivity to the effect. We recommend an optimal processing pipeline, share our code and data, and provide a step-by-step walkthrough for researchers.
Collapse
Affiliation(s)
- J M Rutkowska
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Department of Psychology, University of Zurich, Zurich, Switzerland
- Jacobs Center for Productive Youth Development, University of Zurich, Zurich, Switzerland
| | - T Ghilardi
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Centre for Brain and Cognitive Development, Department of Psychological Sciences, Birkbeck, University of London, London, UK
| | - S V Vacaru
- Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- Department of Psychology, New York University - Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - J E van Schaik
- Behavioral Science Institute, Radboud University, Nijmegen, The Netherlands
| | - M Meyer
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - S Hunnius
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - R Oostenveld
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
- NatMEG, Karolinska Institutet, Stockholm, Sweden.
| |
Collapse
|
3
|
Roßkopf S, Wechsler TF, Tucha S, Mühlberger A. Effects of facial biofeedback on hypomimia, emotion recognition, and affect in Parkinson's disease. J Int Neuropsychol Soc 2024; 30:360-369. [PMID: 38017615 DOI: 10.1017/s1355617723000747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
OBJECTIVES Facial expressions are a core component of emotions and nonverbal social communication. Therefore, hypomimia as secondary symptom of Parkinson's disease (PD) has adverse effects like social impairment, stigmatization, under-diagnosis and under-treatment of depression, and a generally lower quality of life. Beside unspecific dopaminergic treatment, specific treatment options for hypomimia in PD are rarely investigated. This quasi-randomized controlled trial evaluated the short-term effects of facial electromyogram (EMG) based biofeedback to enhance facial expression and emotion recognition as nonverbal social communication skills in PD patients. Furthermore effects on affect are examined. METHOD A sample of 34 in-patients with PD were allocated either to facial EMG-biofeedback as experimental group or non-facial exercises as control group. Facial expression during posing of emotions (measured via EMG), facial emotion recognition, and positive and negative affect were assessed before and after treatment. Stronger improvements were expected in the EMG-biofeedback in comparison to the control group. RESULTS The facial EMG-biofeedback group showed significantly greater improvements in overall facial expression, and especially for happiness and disgust. Also, overall facial emotion recognition abilities improved significantly stronger in the experimental group. Positive affect was significantly increased in both groups with no significant differences between them, while negative affect did not change within both groups. CONCLUSIONS The study provides promising evidence for facial EMG-biofeedback as a tool to improve facial expression and emotion recognition in PD. Embodiment theories are discussed as working mechanism.
Collapse
Affiliation(s)
- Sarah Roßkopf
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, University of Regensburg, Regensburg, Germany
| | - Theresa Friederike Wechsler
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, University of Regensburg, Regensburg, Germany
| | - Stefanie Tucha
- Schön Klinik München Schwabing - Neurologie München, München, Germany
- Schön Klinik MVZ, München, Germany
| | - Andreas Mühlberger
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology, University of Regensburg, Regensburg, Germany
| |
Collapse
|
4
|
Fino E, Menegatti M, Avenanti A, Rubini M. Reading of ingroup politicians' smiles triggers smiling in the corner of one's eyes. PLoS One 2024; 19:e0290590. [PMID: 38635525 PMCID: PMC11025833 DOI: 10.1371/journal.pone.0290590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 01/19/2024] [Indexed: 04/20/2024] Open
Abstract
Spontaneous smiles in response to politicians can serve as an implicit barometer for gauging electorate preferences. However, it is unclear whether a subtle Duchenne smile-an authentic expression involving the coactivation of the zygomaticus major (ZM) and orbicularis oculi (OO) muscles-would be elicited while reading about a favored politician smiling, indicating a more positive disposition and political endorsement. From an embodied simulation perspective, we investigated whether written descriptions of a politician's smile would trigger morphologically different smiles in readers depending on shared or opposing political orientation. In a controlled reading task in the laboratory, participants were presented with subject-verb phrases describing left and right-wing politicians smiling or frowning. Concurrently, their facial muscular reactions were measured via electromyography (EMG) recording at three facial muscles: the ZM and OO, coactive during Duchenne smiles, and the corrugator supercilii (CS) involved in frowning. We found that participants responded with a Duchenne smile detected at the ZM and OO facial muscles when exposed to portrayals of smiling politicians of same political orientation and reported more positive emotions towards these latter. In contrast, when reading about outgroup politicians smiling, there was a weaker activation of the ZM muscle and no activation of the OO muscle, suggesting a weak non-Duchenne smile, while emotions reported towards outgroup politicians were significantly more negative. Also, a more enhanced frown response in the CS was found for ingroup compared to outgroup politicians' frown expressions. Present findings suggest that a politician's smile may go a long way to influence electorates through both non-verbal and verbal pathways. They add another layer to our understanding of how language and social information shape embodied effects in a highly nuanced manner. Implications for verbal communication in the political context are discussed.
Collapse
Affiliation(s)
- Edita Fino
- Department of Psychology “Renzo Canestrari”, Alma Mater Studiorum Università di Bologna, Bologna, Italy
| | - Michela Menegatti
- Department of Psychology “Renzo Canestrari”, Alma Mater Studiorum Università di Bologna, Bologna, Italy
| | - Alessio Avenanti
- Department of Psychology “Renzo Canestrari”, Alma Mater Studiorum Università di Bologna, Bologna, Italy
- Centro Studi e Ricerche in Neuroscienze Cognitive, Department of Psychology “Renzo Canestrari”, Alma Mater Studiorum Università di Bologna, Campus di Cesena, Cesena, Italy
- Centro de Investigación en Neuropsicología y Neurociencias Cognitivas, Universidad Católica del Maule, Talca, Chile
| | - Monica Rubini
- Department of Psychology “Renzo Canestrari”, Alma Mater Studiorum Università di Bologna, Bologna, Italy
| |
Collapse
|
5
|
Hsu CT, Sato W, Yoshikawa S. An investigation of the modulatory effects of empathic and autistic traits on emotional and facial motor responses during live social interactions. PLoS One 2024; 19:e0290765. [PMID: 38194416 PMCID: PMC10775989 DOI: 10.1371/journal.pone.0290765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Accepted: 08/15/2023] [Indexed: 01/11/2024] Open
Abstract
A close relationship between emotional contagion and spontaneous facial mimicry has been theoretically proposed and is supported by empirical data. Facial expressions are essential in terms of both emotional and motor synchrony. Previous studies have demonstrated that trait emotional empathy enhanced spontaneous facial mimicry, but the relationship between autistic traits and spontaneous mimicry remained controversial. Moreover, previous studies presented faces that were static or videotaped, which may lack the "liveliness" of real-life social interactions. We addressed this limitation by using an image relay system to present live performances and pre-recorded videos of smiling or frowning dynamic facial expressions to 94 healthy female participants. We assessed their subjective experiential valence and arousal ratings to infer the amplitude of emotional contagion. We measured the electromyographic activities of the zygomaticus major and corrugator supercilii muscles to estimate spontaneous facial mimicry. Individual differences measures included trait emotional empathy (empathic concern) and the autism-spectrum quotient. We did not find that live performances enhanced the modulatory effect of trait differences on emotional contagion or spontaneous facial mimicry. However, we found that a high trait empathic concern was associated with stronger emotional contagion and corrugator mimicry. We found no two-way interaction between the autism spectrum quotient and emotional condition, suggesting that autistic traits did not modulate emotional contagion or spontaneous facial mimicry. Our findings imply that previous findings regarding the relationship between emotional empathy and emotional contagion/spontaneous facial mimicry using videos and photos could be generalized to real-life interactions.
Collapse
Affiliation(s)
- Chun-Ting Hsu
- Psychological Process Research Team, Guardian Robot Project, RIKEN, Soraku-gun, Kyoto, Japan
| | - Wataru Sato
- Psychological Process Research Team, Guardian Robot Project, RIKEN, Soraku-gun, Kyoto, Japan
| | - Sakiko Yoshikawa
- Institute of Philosophy and Human Values, Kyoto University of the Arts, Kyoto, Kyoto, Japan
| |
Collapse
|
6
|
Westermann JF, Schäfer R, Nordmann M, Richter P, Müller T, Franz M. Measuring facial mimicry: Affdex vs. EMG. PLoS One 2024; 19:e0290569. [PMID: 38165847 PMCID: PMC10760767 DOI: 10.1371/journal.pone.0290569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 08/09/2023] [Indexed: 01/04/2024] Open
Abstract
Facial mimicry is the automatic imitation of the facial affect expressions of others. It serves as an important component of interpersonal communication and affective co-experience. Facial mimicry has so far been measured by Electromyography (EMG), which requires a complex measuring apparatus. Recently, software for measuring facial expressions have become available, but it is still unclear how well it is suited for measuring facial mimicry. This study investigates the comparability of the automated facial coding software Affdex with EMG for measuring facial mimicry. For this purpose, facial mimicry was induced in 33 subjects by presenting naturalistic affect-expressive video sequences (anger, joy). The response of the subjects is measured simultaneously by facial EMG (corrugator supercilii muscle, zygomaticus major muscle) and by Affdex (action units lip corner puller and brow lowerer and affects joy and anger). Subsequently, the correlations between the measurement results of EMG and Affdex were calculated. After the presentation of the joy stimulus, there was an increase in zygomaticus muscle activity (EMG) about 400 ms after stimulus onset and an increase in joy and lip corner puller activity (Affdex) about 1200 ms after stimulus onset. The joy and the lip corner puller activity detected by Affdex correlate significantly with the EMG activity. After presentation of the anger stimulus, corrugator muscle activity (EMG) also increased approximately 400 ms after stimulus onset, whereas anger and brow lowerer activity (Affdex) showed no response. During the entire measurement interval, anger activity and brow lowerer activity (Affdex) did not correlate with corrugator muscle activity (EMG). Using Affdex, the facial mimicry response to a joy stimulus can be measured, but it is detected approximately 800 ms later compared to the EMG. Thus, electromyography remains the tool of choice for studying subtle mimic processes like facial mimicry.
Collapse
Affiliation(s)
- Jan-Frederik Westermann
- Medical Faculty, Clinical Institute for Psychosomatic Medicine and Psychotherapy, University Hospital of the Heinrich-Heine-University, Düsseldorf, Germany
| | - Ralf Schäfer
- Medical Faculty, Clinical Institute for Psychosomatic Medicine and Psychotherapy, University Hospital of the Heinrich-Heine-University, Düsseldorf, Germany
| | - Marc Nordmann
- Medical Faculty, Clinical Institute for Psychosomatic Medicine and Psychotherapy, University Hospital of the Heinrich-Heine-University, Düsseldorf, Germany
| | - Peter Richter
- Medical Faculty, Clinical Institute for Psychosomatic Medicine and Psychotherapy, University Hospital of the Heinrich-Heine-University, Düsseldorf, Germany
| | - Tobias Müller
- Medical Faculty, Clinical Institute for Psychosomatic Medicine and Psychotherapy, University Hospital of the Heinrich-Heine-University, Düsseldorf, Germany
| | - Matthias Franz
- Medical Faculty, Clinical Institute for Psychosomatic Medicine and Psychotherapy, University Hospital of the Heinrich-Heine-University, Düsseldorf, Germany
| |
Collapse
|
7
|
Kuang B, Peng S, Wu Y, Chen Y, Hu P. The Neural Mechanisms of Group Membership Effect on Emotional Mimicry: A Multimodal Study Combining Electromyography and Electroencephalography. Brain Sci 2023; 14:25. [PMID: 38248240 PMCID: PMC10812954 DOI: 10.3390/brainsci14010025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 12/16/2023] [Accepted: 12/20/2023] [Indexed: 01/23/2024] Open
Abstract
Emotional mimicry plays a vital role in understanding others' emotions and has been found to be modulated by social contexts, especially group membership. However, the neural mechanisms underlying this modulation remain unclear. We explored whether and how group membership modulated emotional mimicry using a multimodal method combining facial electromyography (fEMG) and electroencephalography (EEG). We instructed participants to passively view dynamic emotional faces (happy vs. angry) of others (in-group vs. out-group) and simultaneously recorded their fEMG and EEG responses. Then, we conducted combined analyses of fEMG-EEG by splitting the EEG trials into two mimicry intensity categories (high-intensity mimicry vs. low-intensity mimicry) according to fEMG activity. The fEMG results confirmed the occurrence of emotional mimicry in the present study but failed to find a group membership effect. However, the EEG results showed that participants mimicked in-group happiness and anger more than out-group. Importantly, this in-group preference involved different neural mechanisms in happiness and anger mimicry. In-group preference for happiness mimicry occurred at multiple neural mechanisms such as N1 (at P7, Pz, and P8), P2 (at Pz and P8), N2 (at P8), and P3 (at P7, Pz, and P8); in-group preference for anger mimicry occurred at P1 (at P7) and P2 (at Pz). Our findings provide new neural evidence for the effect of group membership on emotional mimicry by uncovering the temporal dynamics of this effect.
Collapse
Affiliation(s)
- Beibei Kuang
- College of International Relations, National University of Defense Technology, Nanjing 210039, China
- Department of Psychology, Renmin University of China, Beijing 100872, China; (Y.W.); (Y.C.)
| | - Shenli Peng
- College of Education, Hunan Agricultural University, Changsha 410128, China;
| | - Yuhang Wu
- Department of Psychology, Renmin University of China, Beijing 100872, China; (Y.W.); (Y.C.)
| | - Ying Chen
- Department of Psychology, Renmin University of China, Beijing 100872, China; (Y.W.); (Y.C.)
| | - Ping Hu
- Department of Psychology, Renmin University of China, Beijing 100872, China; (Y.W.); (Y.C.)
| |
Collapse
|
8
|
Korb S, Clarke A, Massaccesi C, Willeit M, Silani G. Facial mimicry is not modulated by dopamine D2/3 and opioid receptor antagonism. Psychopharmacology (Berl) 2023; 240:2081-2091. [PMID: 37477676 PMCID: PMC10506945 DOI: 10.1007/s00213-023-06426-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 07/13/2023] [Indexed: 07/22/2023]
Abstract
RATIONALE According to theories of embodied cognition, facial mimicry - the spontaneous, low-intensity imitation of a perceived emotional facial expression - is first an automatic motor response, whose accompanying proprioceptive feedback contributes to emotion recognition. Alternative theoretical accounts, however, view facial mimicry as an emotional response to a rewarding stimulus, and/or an affiliative signal, and thus reject the view of an automatic motor copy. OBJECTIVES To contribute to this debate and further investigate the neural basis of facial mimicry, as well as its relation to reward processing, we measured facial reactions to dynamic happy and angry faces after pharmacologically manipulating the opioid and dopamine systems - respectively, thought to subserve 'liking' and 'wanting' of rewards. METHODS In a placebo-controlled, double-blind experiment, 130 volunteers received in a between-subjects design 50 mg of the opioidergic antagonist naltrexone, 400 mg of the dopaminergic antagonist amisulpride, or placebo. RESULTS Clear occurrence of facial mimicry, measured 4 h after drug intake with electromyography (EMG) of the zygomaticus major and corrugator supercilii muscles, was found. However, facial mimicry was not affected by either compound, as shown with both frequentist statistics, and a Bayesian asymptotic regression model. CONCLUSIONS This null finding does not support the hypothesis that facial mimicry (of happiness) reflects an emotional response to a rewarding stimulus, leaving open the possibility of facial mimicry being an automatic motor copy. The results are relevant to the discussion about the psychological nature and the neural basis of facial mimicry, although they should be considered preliminary, given the challenges of interpreting null findings when targeting a novel effect of unknown size.
Collapse
Affiliation(s)
- Sebastian Korb
- Department of Psychology, University of Essex, Essex, UK.
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria.
| | | | - Claudia Massaccesi
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna, Austria
| | - Matthäus Willeit
- Department of Psychiatry and Psychotherapy, Medical University of Vienna, Vienna, Austria
| | - Giorgia Silani
- Department of Clinical and Health Psychology, University of Vienna, Vienna, Austria
| |
Collapse
|
9
|
Xu X, Hu P. Exploring the Influence of Context on Emotional Mimicry and Intention: An Affirmation of the Correction Hypothesis. Behav Sci (Basel) 2023; 13:677. [PMID: 37622817 PMCID: PMC10451474 DOI: 10.3390/bs13080677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 08/02/2023] [Accepted: 08/09/2023] [Indexed: 08/26/2023] Open
Abstract
BACKGROUND Emotional mimicry, a phenomenon frequently observed in our everyday interactions, is the act of replicating another individual's facial expression. The Emotion Mimicry in Context View and the Correction Hypothesis underscore the critical role of context and intention within emotional mimicry. METHODS In two distinct studies, participants were presented with facial expressions of models (happiness and anger) within various contexts (affiliative, distancing, and neutral). Concurrently, we recorded electromyography (EMG) to index emotional mimicry, while participants explicitly rated the models' intentions. RESULTS We observed context swiftly influences emotional mimicry within 500 ms, notably when the intentions of contexts are opposing to the intentions of facial expressions, leading to weakened muscle responses and diminished perceived intention. Furthermore, a notable correlation was discovered in the mimicry of angry faces; the more distancing the context, the stronger the corrugator supercilii (CS) muscle activity after context processing. CONCLUSIONS First, emotional mimicry should not be simply viewed as an output corresponding to the expresser's facial expressions but the dynamic process involving the active participation of the observer. Second, intention serves as a pivotal anchor, effectively integrating facial and contextual information. As such, we provided empirical support for the Correction Hypothesis.
Collapse
Affiliation(s)
| | - Ping Hu
- Department of psychology, Renmin University of China, Beijing 100872, China;
| |
Collapse
|
10
|
Sexton CL, Buckley C, Lieberfarb J, Subiaul F, Hecht EE, Bradley BJ. What Is Written on a Dog's Face? Evaluating the Impact of Facial Phenotypes on Communication between Humans and Canines. Animals (Basel) 2023; 13:2385. [PMID: 37508162 PMCID: PMC10376741 DOI: 10.3390/ani13142385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Revised: 07/15/2023] [Accepted: 07/20/2023] [Indexed: 07/30/2023] Open
Abstract
Facial phenotypes are significant in communication with conspecifics among social primates. Less is understood about the impact of such markers in heterospecific encounters. Through behavioral and physical phenotype analyses of domesticated dogs living in human households, this study aims to evaluate the potential impact of superficial facial markings on dogs' production of human-directed facial expressions. That is, this study explores how facial markings, such as eyebrows, patches, and widow's peaks, are related to expressivity toward humans. We used the Dog Facial Action Coding System (DogFACS) as an objective measure of expressivity, and we developed an original schematic for a standardized coding of facial patterns and coloration on a sample of more than 100 male and female dogs (N = 103), aged from 6 months to 12 years, representing eight breed groups. The present study found a statistically significant, though weak, correlation between expression rate and facial complexity, with dogs with plainer faces tending to be more expressive (r = -0.326, p ≤ 0.001). Interestingly, for adult dogs, human companions characterized dogs' rates of facial expressivity with more accuracy for dogs with plainer faces. Especially relevant to interspecies communication and cooperation, within-subject analyses revealed that dogs' muscle movements were distributed more evenly across their facial regions in a highly social test condition compared to conditions in which they received ambiguous cues from their owners. On the whole, this study provides an original evaluation of how facial features may impact communication in human-dog interactions.
Collapse
Affiliation(s)
- Courtney L Sexton
- Department of Population Health Sciences, Virginia-Maryland College of Veterinary Medicine, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA
- Center for the Advanced Study of Human Paleobiology, Department of Anthropology, The George Washington University, Washington, DC 20052, USA
| | - Colleen Buckley
- Center for the Advanced Study of Human Paleobiology, Department of Anthropology, The George Washington University, Washington, DC 20052, USA
| | | | - Francys Subiaul
- Center for the Advanced Study of Human Paleobiology, Department of Anthropology, The George Washington University, Washington, DC 20052, USA
- Department of Speech, Language and Hearing Sciences, The George Washington University, Washington, DC 20052, USA
| | - Erin E Hecht
- Department of Human Evolutionary Biology, Harvard University, Cambridge, MA 02138, USA
| | - Brenda J Bradley
- Center for the Advanced Study of Human Paleobiology, Department of Anthropology, The George Washington University, Washington, DC 20052, USA
| |
Collapse
|
11
|
Xu Q, Sommer W, Recio G. Control over emotional facial expressions: Evidence from facial EMG and ERPs in a Stroop-like task. Biol Psychol 2023; 181:108611. [PMID: 37302517 DOI: 10.1016/j.biopsycho.2023.108611] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 05/04/2023] [Accepted: 06/06/2023] [Indexed: 06/13/2023]
Abstract
Facial expressions carry important social signals that must be precisely regulated despite potentially conflicting demands on veridicality, communicative intent, and the social situation. In a sample of 19 participants we investigated the challenges of deliberately controlling two facial expressions (smiles and frowns) by the emotional congruency with the expressions of adult and infant counterparts. In a Stroop-like task requiring participants' deliberate expressions of anger or happiness, we investigated the impact of task-irrelevant background pictures of adults and infants showing negative, neutral, or positive facial expressions. Participants' deliberate expressions were measured with electromyogram (EMG) of the M. zygomaticus major and M. corrugator supercilii. The latencies of EMG onsets revealed similar congruency effects for smiles and frowns with significant facilitation and inhibition components relative to the neutral condition. Interestingly, the facilitation effect for frown responses by negative facial expressions was significantly smaller vis a vis infant as compared to adult background faces. This diminished facilitation of frowns by infant's expressions of distress may relate to the activation of caregiver behavior or empathy. We investigated the neural correlates of the observed performance effects by recording event-related-potentials (ERPs). Increased amplitudes in ERP components were observed in incongruent relative to neutral conditions, revealing interference effects on both types of deliberate facial expressions, at different processing stages, namely, structural facial encoding (N170), conflict monitoring (N2), to semantic analysis (N400).
Collapse
Affiliation(s)
- Qiang Xu
- Department of Psychology, Ningbo University, Ningbo, China.
| | - Werner Sommer
- Department of Psychology, Humboldt Universität zu Berlin, Berlin, Germany.
| | - Guillermo Recio
- Departament de Psicologia Clínica i Psicobiologia, Universitat de Barcelona, Barcelona, Spain; Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain
| |
Collapse
|
12
|
Zhao W, Liu Q, Zhang X, Song X, Zhang Z, Qing P, Liu X, Zhu S, Yang W, Kendrick KM. Differential responses in the mirror neuron system during imitation of individual emotional facial expressions and association with autistic traits. Neuroimage 2023; 277:120263. [PMID: 37399932 DOI: 10.1016/j.neuroimage.2023.120263] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 06/15/2023] [Accepted: 06/30/2023] [Indexed: 07/05/2023] Open
Abstract
The mirror neuron system (MNS), including the inferior frontal gyrus (IFG), inferior parietal lobule (IPL) and superior temporal sulcus (STS) plays an important role in action representation and imitation and may be dysfunctional in autism spectrum disorder (ASD). However, it's not clear how these three regions respond and interact during the imitation of different basic facial expressions and whether the pattern of responses is influenced by autistic traits. Thus, we conducted a natural facial expression (happiness, angry, sadness and fear) imitation task in 100 healthy male subjects where expression intensity was measured using facial emotion recognition software (FaceReader) and MNS responses were recorded using functional near-infrared spectroscopy (fNIRS). Autistic traits were measured using the Autism Spectrum Quotient questionnaire. Results showed that imitation of happy expressions produced the highest expression intensity but a small deactivation in MNS responses, suggesting a lower processing requirement compared to other expressions. A cosine similarity analysis indicated a distinct pattern of MNS responses during imitation of each facial expression with functional intra-hemispheric connectivity between the left IPL and left STS being significantly higher during happy compared to other expressions, while inter-hemispheric connectivity between the left and right IPL differed between imitation of fearful and sad expressions. Furthermore, functional connectivity changes during imitation of each different expression could reliably predict autistic trait scores. Overall, the results provide evidence for distinct patterns of functional connectivity changes between MNS regions during imitation of different emotions which are also associated with autistic traits.
Collapse
Affiliation(s)
- Weihua Zhao
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China; Institute of Electronic and Information Engineering of UESTC in Guangdong, Dongguan, 523808, China
| | - Qi Liu
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Xiaolu Zhang
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Xinwei Song
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Zhao Zhang
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Peng Qing
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Xiaolong Liu
- Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu, 610066, China
| | - Siyu Zhu
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Wenxu Yang
- Chengdu Women's and Children's Central Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Keith M Kendrick
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, 611731, China.
| |
Collapse
|
13
|
Zhang L, Chen Y, Wei Y, Leng J, Kong C, Hu P. Kick Cat Effect: Social Context Shapes the Form and Extent of Emotional Contagion. Behav Sci (Basel) 2023; 13:531. [PMID: 37503978 PMCID: PMC10376848 DOI: 10.3390/bs13070531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 06/08/2023] [Accepted: 06/20/2023] [Indexed: 07/29/2023] Open
Abstract
Emotional contagion refers to the transmission and interaction of emotions among people. Researchers have mainly focused on its process and mechanism, often simplifying its social background due to its complexity. Therefore, in this study, we attempt to explore whether the presence and clarity of social context affect emotional contagion and the related neural mechanisms. In Experiment 1, participants were asked to report their subjective experiences after being exposed to the facial expressions of emotional expressers, with or without the corresponding social context being presented. The results revealed that positive or negative expressions from the expressers elicited corresponding emotional experiences in the receivers, regardless of the presence of social context. However, when the social context was absent, the degree of emotional contagion was greater. In Experiment 2, we further investigated the effect of the clarity of social contexts on emotional contagion and its neural mechanisms. The results showed an effect consistent with those in Experiment 1 and highlighted the special role of N1, N2, P3, and LPP components in this process. According to the emotions as social information theory, individuals may rely more on social appraisal when they lack sufficient contextual information. By referencing the expressions of others and maintaining emotional convergence with them, individuals can adapt more appropriately to their current environment.
Collapse
Affiliation(s)
- Ling Zhang
- Department of Psychology, Renmin University of China, No. 59 of Zhongguancun Street, Haidian District, Beijing 100872, China
| | - Ying Chen
- Department of Psychology, Renmin University of China, No. 59 of Zhongguancun Street, Haidian District, Beijing 100872, China
| | - Yanqiu Wei
- Department of Psychology, Renmin University of China, No. 59 of Zhongguancun Street, Haidian District, Beijing 100872, China
| | - Jie Leng
- Department of Psychology, Renmin University of China, No. 59 of Zhongguancun Street, Haidian District, Beijing 100872, China
| | - Chao Kong
- Department of Psychology, Renmin University of China, No. 59 of Zhongguancun Street, Haidian District, Beijing 100872, China
| | - Ping Hu
- Department of Psychology, Renmin University of China, No. 59 of Zhongguancun Street, Haidian District, Beijing 100872, China
| |
Collapse
|
14
|
Benuzzi F, Ballotta D, Casadio C, Zanelli V, Porro CA, Nichelli PF, Lui F. "When You're Smiling": How Posed Facial Expressions Affect Visual Recognition of Emotions. Brain Sci 2023; 13:brainsci13040668. [PMID: 37190633 DOI: 10.3390/brainsci13040668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Revised: 04/06/2023] [Accepted: 04/14/2023] [Indexed: 05/17/2023] Open
Abstract
Facial imitation occurs automatically during the perception of an emotional facial expression, and preventing it may interfere with the accuracy of emotion recognition. In the present fMRI study, we evaluated the effect of posing a facial expression on the recognition of ambiguous facial expressions. Since facial activity is affected by various factors, such as empathic aptitudes, the Interpersonal Reactivity Index (IRI) questionnaire was administered and scores were correlated with brain activity. Twenty-six healthy female subjects took part in the experiment. The volunteers were asked to pose a facial expression (happy, disgusted, neutral), then to watch an ambiguous emotional face, finally to indicate whether the emotion perceived was happiness or disgust. As stimuli, blends of happy and disgusted faces were used. Behavioral results showed that posing an emotional face increased the percentage of congruence with the perceived emotion. When participants posed a facial expression and perceived a non-congruent emotion, a neural network comprising bilateral anterior insula was activated. Brain activity was also correlated with empathic traits, particularly with empathic concern, fantasy and personal distress. Our findings support the idea that facial mimicry plays a crucial role in identifying emotions, and that empathic emotional abilities can modulate the brain circuits involved in this process.
Collapse
Affiliation(s)
- Francesca Benuzzi
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| | - Daniela Ballotta
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| | - Claudia Casadio
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| | - Vanessa Zanelli
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| | - Carlo Adolfo Porro
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| | - Paolo Frigio Nichelli
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| | - Fausta Lui
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, 41125 Modena, Italy
| |
Collapse
|
15
|
Stein JP. Smile Back at Me, But Only Once: Social Norms of Appropriate Nonverbal Intensity and Reciprocity Apply to Emoji Use. JOURNAL OF NONVERBAL BEHAVIOR 2023. [DOI: 10.1007/s10919-023-00424-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023]
Abstract
AbstractIn computer-mediated communication, small graphical icons (emojis) can be used to compensate for the lack of nonverbal cues such as facial expressions or hand gestures. Accordingly, literature suggests that the use of emojis may also be subject to social norms—similar to nonverbal behavior in face-to-face interactions. However, actual empirical investigations into this assumption remain lacking. To remedy this research gap, I explored whether traditional norms of appropriate emotional intensity and reciprocity also apply to emoji usage. A first online experiment (N = 188) revealed that excessive emoji use in a first-contact scenario leads to diminished interpersonal outcomes, corresponding to the drawbacks of overly intense nonverbal displays in natural interactions. Proceeding to a different communicative stage, Experiment 2 (N = 242) explored nonverbal reciprocity with acquainted interaction partners. Inviting participants to reply to fictitious text messages (at varying levels of interpersonal intimacy), it was observed that stimulus messages containing more emojis also evoke stronger emoji use in return—indicating that principles of nonverbal attunement are in full effect during text-based online interactions.
Collapse
|
16
|
Salazar Kämpf M, Kanske P. Mimicry and affective disorders. Front Psychiatry 2023; 13:1105503. [PMID: 36762295 PMCID: PMC9905714 DOI: 10.3389/fpsyt.2022.1105503] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 12/28/2022] [Indexed: 01/26/2023] Open
Abstract
Mimicry, the spontaneous imitation of an interaction partner, is an important part of everyday communication, as it has been shown to foster relationships and increase closeness. People with affective disorders often have problems in their interpersonal lives. In this review, we pursue the question if these problems are linked to differences in mimicry behavior. First, we summarize existing evidence on mimicry, depression and mood. Then, based on five theories differing in their core assumptions regarding mechanisms and functionality of mimicry, we derive suggestions on how mimicry might affect people suffering from bipolar disorders, dysthymia or depression. Depending on each theory, a different understanding of affective disorders and mimicry arises, and we show how the evidence fit in with the suggested theories. Previous studies on affective disorders have focused on mimicry behavior of participants watching photos, computer-generated images, or short video sequences. This review sheds light on the fact that evidence on mimicry needs to be broadened systematically for people with affective disorders in interactional settings. Mimicry represents a novel and important yet underestimated source for diagnostic, intervention and evaluation processes in affective disorders.
Collapse
Affiliation(s)
- Maike Salazar Kämpf
- Clinical Psychology and Behavioral Neuroscience, Institute of Clinical Psychology and Psychotherapy, Technische Universität Dresden, Dresden, Germany
| | | |
Collapse
|
17
|
West T, Mendes WB. Affect contagion: Physiologic covariation and linkage offer insight into socially shared thoughts, emotions, and experiences. ADVANCES IN EXPERIMENTAL SOCIAL PSYCHOLOGY 2023. [DOI: 10.1016/bs.aesp.2022.11.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
|
18
|
Kraft-Feil TL, Ingram RE, Gorey C, Luu JH, Cross MP, Pressman SD. The association of negative mood with automatic and effortful facial expression mimicry. Front Psychol 2023; 14:1056535. [PMID: 37168433 PMCID: PMC10165095 DOI: 10.3389/fpsyg.2023.1056535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Accepted: 03/31/2023] [Indexed: 05/13/2023] Open
Abstract
The natural process of mimicking the facial expressions of others is well established, as are the deficits in this reflexive behavior for individuals with clinical disorders such as depression. This study examines the extent of this deficit in non-clinical individuals with high transient negative mood, and whether it extends to both automatic and effortful emotion expression behavior. One hundred and thirty-six participants were shown happy, sad, and neutral faces, while electromyography (EMG) recorded facial muscle responses. Automatic (reflexive) mimicry was assessed while participants simply viewed facially expressive photographs, while effortful mimicry was monitored when individuals were told to intentionally copy the expressions in the photographs. Results indicated that high levels of negative mood were primarily associated with deficits in effortful mimicry of happy expressions, although some similar evidence was found in automatic mimicry of happy faces. Surprisingly, there were also ties between negative moods and inaccuracies in effortful mimicry of sad expressions (but not automatic mimicry). Inaccurate automatic and effortful mimicry were also tied with lower self-reported social support and greater loneliness. These results indicate that even in healthy individuals, transient and minor changes in negative mood are tied to deficiencies in facial mimicry at both the automatic and effortful level.
Collapse
Affiliation(s)
- Tara L. Kraft-Feil
- CHI St. Alexius Health, Bismarck, ND, United States
- *Correspondence: Tara L. Kraft-Feil,
| | - Rick E. Ingram
- Department of Psychology, University of Kansas, Lawrence, KS, United States
| | - Claire Gorey
- Department of Psychology, University of South Florida, Tampa, FL, United States
| | - Jazlyn H. Luu
- Department of Psychological Science, University of California, Irvine, Irvine, CA, United States
| | - Marie P. Cross
- Department of Biobehavioral Health, Pennsylvania State University, University Park, PA, United States
| | - Sarah D. Pressman
- Department of Psychological Science, University of California, Irvine, Irvine, CA, United States
| |
Collapse
|
19
|
Kaiser J, Gentsch A, Rodriguez-Manrique D, Schütz-Bosbach S. Function without feeling: neural reactivity and intercommunication during flexible motor adjustments evoked by emotional and neutral stimuli. Cereb Cortex 2022; 33:6000-6012. [PMID: 36513350 DOI: 10.1093/cercor/bhac478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 11/11/2022] [Accepted: 11/17/2022] [Indexed: 12/15/2022] Open
Abstract
Motor conflicts arise when we need to quickly overwrite prepotent behavior. It has been proposed that affective stimuli modulate the neural processing of motor conflicts. However, previous studies have come to inconsistent conclusions regarding the neural impact of affective information on conflict processing. We employed functional magnetic resonance imaging during a Go/Change-Go task, where motor conflicts were either evoked by neutral or emotionally negative stimuli. Dynamic causal modeling was used to investigate how motor conflicts modulate the intercommunication between the anterior cingulate cortex (ACC) and the anterior insula (AI) as 2 central regions for cognitive control. Conflicts compared to standard actions were associated with increased BOLD activation in several brain areas, including the dorsal ACC and anterior insula. There were no differences in neural activity between emotional and non-emotional conflict stimuli. Conflicts compared to standard actions lowered neural self-inhibition of the ACC and AI and led to increased effective connectivity from the ACC to AI contralateral to the acting hand. Thus, our study indicates that neural conflict processing is primarily driven by the functional relevance of action-related stimuli, not their inherent affective meaning. Furthermore, it sheds light on the role of interconnectivity between ACC and AI for the implementation of flexible behavioral change.
Collapse
Affiliation(s)
- Jakob Kaiser
- LMU Munich, Department of Psychology, General and Experimental Psychology, Leopoldstr. 13, D-80802 Munich, Germany
| | - Antje Gentsch
- LMU Munich, Department of Psychology, General and Experimental Psychology, Leopoldstr. 13, D-80802 Munich, Germany
| | | | - Simone Schütz-Bosbach
- LMU Munich, Department of Psychology, General and Experimental Psychology, Leopoldstr. 13, D-80802 Munich, Germany
| |
Collapse
|
20
|
Davis JD, Coulson S, Blaison C, Hess U, Winkielman P. Mimicry of partially occluded emotional faces: do we mimic what we see or what we know? Cogn Emot 2022; 36:1555-1575. [PMID: 36300446 DOI: 10.1080/02699931.2022.2135490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Facial electromyography (EMG) was used to investigate patterns of facial mimicry in response to partial facial expressions in two contexts that differ in how naturalistic and socially significant the faces are. Experiment 1 presented participants with either the upper- or lower-half of facial expressions and used a forced-choice emotion categorisation task. This task emphasises cognition at the expense of ecological and social validity. Experiment 2 presented whole heads and expressions were occluded by clothing. Additionally, the emotion recognition task is more open-ended. This context has greater social validity. We found mimicry in both experiments, however mimicry differed in terms of which emotions were mimicked and the extent to which the mimicry involved muscle sites that were not observed. In the more cognitive context, there was relatively more motor matching (i.e. mimicking only what was seen). In the more socially valid context, participants were less likely to mimic only what they saw - and instead mimicked what they knew. Additionally, participants mimicked anger in the cognitive context but not the social context. These findings suggest that mimicry involves multiple mechanisms and that the more social the context, the more likely it is to reflect a mechanism of social regulation.
Collapse
Affiliation(s)
- Joshua D Davis
- Cognitive Science Department, University of California, San Diego, San Diego, USA
- Social and Behavioral Sciences Department, Southwestern College, Chula Vista, CA, USA
| | - Seana Coulson
- Cognitive Science Department, University of California, San Diego, San Diego, USA
| | | | - Ursula Hess
- Psychology Department, Humboldt University, Berlin, Germany
| | - Piotr Winkielman
- Psychology Department, University of California, San Diego, San Diego, USA
- Psychology Department, SWPS University of Social Sciences and Humanities, Warsaw, Poland
| |
Collapse
|
21
|
Mauersberger H, Kastendieck T, Hess U. I looked at you, you looked at me, I smiled at you, you smiled at me—The impact of eye contact on emotional mimicry. Front Psychol 2022; 13:970954. [PMID: 36248540 PMCID: PMC9556997 DOI: 10.3389/fpsyg.2022.970954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 09/05/2022] [Indexed: 11/13/2022] Open
Abstract
Eye contact is an essential element of human interaction and direct eye gaze has been shown to have effects on a range of attentional and cognitive processes. Specifically, direct eye contact evokes a positive affective reaction. As such, it has been proposed that obstructed eye contact reduces emotional mimicry (i.e., the imitation of our counterpart’s emotions). So far, emotional mimicry research has used averted-gaze faces or unnaturally covered eyes (with black censor bars) to analyze the effect of eye contact on emotional mimicry. However, averted gaze can also signal disinterest/ disengagement and censor bars obscure eye-adjacent areas as well and hence impede emotion recognition. In the present study (N = 44), we used a more ecological valid approach by showing photos of actors who expressed either happiness, sadness, anger, or disgust while either wearing mirroring sunglasses that obstruct eye contact or clear glasses. The glasses covered only the direct eye region but not the brows, nose ridge, and cheeks. Our results confirm that participants were equally accurate in recognizing the emotions of their counterparts in both conditions (sunglasses vs. glasses). Further, in line with our hypotheses, participants felt closer to the targets and mimicked affiliative emotions more intensely when their counterparts wore glasses instead of sunglasses. For antagonistic emotions, we found the opposite pattern: Disgust mimicry, which was interpreted as an affective reaction rather than genuine mimicry, could be only found in the sunglasses condition. It may be that obstructed eye contact increased the negative impression of disgusted facial expressions and hence the negative feelings disgust faces evoked. The present study provides further evidence for the notion that eye contact is an important prerequisite for emotional mimicry and hence for smooth and satisfying social interactions.
Collapse
|
22
|
Hsu CT, Sato W, Kochiyama T, Nakai R, Asano K, Abe N, Yoshikawa S. Enhanced Mirror Neuron Network Activity and Effective Connectivity during Live Interaction Among Female Subjects. Neuroimage 2022; 263:119655. [PMID: 36182055 DOI: 10.1016/j.neuroimage.2022.119655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 09/26/2022] [Accepted: 09/27/2022] [Indexed: 11/24/2022] Open
Abstract
Facial expressions are indispensable in daily human communication. Previous neuroimaging studies investigating facial expression processing have presented pre-recorded stimuli and lacked live face-to-face interaction. Our paradigm alternated between presentations of real-time model performance and pre-recorded videos of dynamic facial expressions to participants. Simultaneous functional magnetic resonance imaging (fMRI) and facial electromyography activity recordings, as well as post-scan valence and arousal ratings were acquired from 44 female participants. Live facial expressions enhanced the subjective valence and arousal ratings as well as facial muscular responses. Live performances showed greater engagement of the right posterior superior temporal sulcus (pSTS), right inferior frontal gyrus (IFG), right amygdala and right fusiform gyrus, and modulated the effective connectivity within the right mirror neuron system (IFG, pSTS, and right inferior parietal lobule). A support vector machine algorithm could classify multivoxel activation patterns in brain regions involved in dynamic facial expression processing in the mentalizing networks (anterior and posterior cingulate cortex). These results indicate that live social interaction modulates the activity and connectivity of the right mirror neuron system and enhances spontaneous mimicry, further facilitating emotional contagion.
Collapse
Affiliation(s)
- Chun-Ting Hsu
- Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan..
| | - Wataru Sato
- Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan..
| | - Takanori Kochiyama
- Brain Activity Imaging Center, ATR- Promotions, Inc., 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan
| | - Ryusuke Nakai
- Institute for the Future of Human Society, Kyoto University, 46 Yoshidashimoadachi-cho, Sakyo-ku, Kyoto, 606-8501 Japan
| | - Kohei Asano
- Institute for the Future of Human Society, Kyoto University, 46 Yoshidashimoadachi-cho, Sakyo-ku, Kyoto, 606-8501 Japan; Department of Children Education, Osaka University of Comprehensive Children Education, 6-chome-4-26 Yuzato, Higashisumiyoshi Ward, Osaka, 546-0013, Japan
| | - Nobuhito Abe
- Institute for the Future of Human Society, Kyoto University, 46 Yoshidashimoadachi-cho, Sakyo-ku, Kyoto, 606-8501 Japan
| | - Sakiko Yoshikawa
- Institute of Philosophy and Human Values, Kyoto University of the Arts, 2-116 Uryuyama Kitashirakawa, Sakyo, Kyoto, Kyoto 606-8271, Japan
| |
Collapse
|
23
|
Scherer KR. The mystery of emotional mimicry: multiple functions and processing levels in expression imitation. Cogn Emot 2022; 36:781-784. [PMID: 36070180 DOI: 10.1080/02699931.2022.2115614] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Mimicry of appearance or of facial, vocal, or gestural expressions emerges frequently among members of different species. When such mimicry directly relates to affective aspects of an interaction, researchers talk about "emotional mimicry". Emotional mimicry has been amply documented but its functionality is still debated. Why and when do people mimic the expressions of others, who benefits, the mimicker or the mimicked, and how do they benefit? Which processes underlie emotional mimicry? Is it completely automatic and unconscious or can it be deliberate and conscious? The current Theory Section addresses these questions from different theoretical perspectives. The invited article by Hess and Fischer focused on the role of mimicry in social regulation and social bonding. The invited comment by Krets and Akyüz highlights information gathering and prediction in social interaction. The invited comment by Bernhold and Giles emphasizes vocal communication and its role in interpersonal accommodation. In this editorial, I propose the different theoretical perspectives may be integrated by assuming a multilevel appraisal and response generation mechanism. I also suggest that emotional mimicry research may be broadened by including social learning, vocal imitation, interspecies comparisons, and affective computing approaches.
Collapse
|
24
|
Deming P, Eisenbarth H, Rodrik O, Weaver SS, Kiehl KA, Koenigs M. An examination of autonomic and facial responses to prototypical facial emotion expressions in psychopathy. PLoS One 2022; 17:e0270713. [PMID: 35776725 PMCID: PMC9249219 DOI: 10.1371/journal.pone.0270713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 06/15/2022] [Indexed: 11/19/2022] Open
Abstract
Meta-analyses have found that people high in psychopathy categorize (or “recognize”) others’ prototypical facial emotion expressions with reduced accuracy. However, these have been contested with remaining questions regarding the strength, specificity, and mechanisms of this ability in psychopathy. In addition, few studies have tested holistically whether psychopathy is related to reduced facial mimicry or autonomic arousal in response to others’ dynamic facial expressions. Therefore, the current study presented 6 s videos of a target person making prototypical emotion expressions (anger, fear, disgust, sadness, joy, and neutral) to N = 88 incarcerated adult males while recording facial electromyography, skin conductance response (SCR), and heart rate. Participants identified the emotion category and rated the valence and intensity of the target person’s emotion. Psychopathy was assessed via the Psychopathy Checklist-Revised (PCL-R). We predicted that overall PCL-R scores and scores for the interpersonal/affective traits, in particular, would be related to reduced emotion categorization accuracy, valence ratings, intensity ratings, facial mimicry, SCR amplitude, and cardiac deceleration in response to the prototypical facial emotion expressions. In contrast to our hypotheses, PCL-R scores were unrelated to emotion categorization accuracy, valence ratings, and intensity ratings. Stimuli failed to elicit facial mimicry from the full sample, which does not allow drawing conclusions about the relationship between psychopathy and facial mimicry. However, participants displayed general autonomic arousal responses, but not to prototypical emotion expressions per se. PCL-R scores were also unrelated to SCR and cardiac deceleration. These findings failed to identify aberrant behavioral and physiological responses to prototypical facial emotion expressions in relation to psychopathy.
Collapse
Affiliation(s)
- Philip Deming
- Department of Psychology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Psychiatry, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- * E-mail:
| | - Hedwig Eisenbarth
- School of Psychology, Victoria University of Wellington, Wellington, New Zealand
| | - Odile Rodrik
- Department of Psychology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Psychiatry, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
| | - Shelby S. Weaver
- Department of Psychology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Psychiatry, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
| | - Kent A. Kiehl
- The Mind Research Network and Lovelace Biomedical, Albuquerque, New Mexico, United States of America
- Department of Psychology, University of New Mexico, Albuquerque, New Mexico, United States of America
| | - Michael Koenigs
- Department of Psychology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Psychiatry, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
| |
Collapse
|
25
|
Kim HN. The frequency of facial muscles engaged in expressing emotions in people with visual disabilities via cloud-based video communication. THEORETICAL ISSUES IN ERGONOMICS SCIENCE 2022. [DOI: 10.1080/1463922x.2022.2081374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Hyung Nam Kim
- Department of Industrial and Systems Engineering, North Carolina A&T State University, Greensboro, NC, USA
| |
Collapse
|
26
|
Namba S, Sato W, Nakamura K, Watanabe K. Computational Process of Sharing Emotion: An Authentic Information Perspective. Front Psychol 2022; 13:849499. [PMID: 35645906 PMCID: PMC9134197 DOI: 10.3389/fpsyg.2022.849499] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Accepted: 04/26/2022] [Indexed: 11/28/2022] Open
Abstract
Although results of many psychology studies have shown that sharing emotion achieves dyadic interaction, no report has explained a study of the transmission of authentic information from emotional expressions that can strengthen perceivers. For this study, we used computational modeling, which is a multinomial processing tree, for formal quantification of the process of sharing emotion that emphasizes the perception of authentic information for expressers’ feeling states from facial expressions. Results indicated that the ability to perceive authentic information of feeling states from a happy expression has a higher probability than the probability of judging authentic information from anger expressions. Next, happy facial expressions can activate both emotional elicitation and sharing emotion in perceivers, where emotional elicitation alone is working rather than sharing emotion for angry facial expressions. Third, parameters to detect anger experiences were found to be correlated positively with those of happiness. No robust correlation was found between the parameters extracted from this experiment task and questionnaire-measured emotional contagion, empathy, and social anxiety. Results of this study revealed the possibility that a new computational approach contributes to description of emotion sharing processes.
Collapse
Affiliation(s)
- Shushi Namba
- Psychological Process Research Team, Guardian Robot Project, RIKEN, Kyoto, Japan
- *Correspondence: Shushi Namba,
| | - Wataru Sato
- Psychological Process Research Team, Guardian Robot Project, RIKEN, Kyoto, Japan
| | - Koyo Nakamura
- Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria
- Japan Society for the Promotion of Science, Tokyo, Japan
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan
- Faculty of Arts, Design and Architecture, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
27
|
Bertini M, Annicchiarico G, Bresciani C, Cordoni G, Palagi E. Playful interactions and facial mimicry in infant bonobos ( Pan paniscus). ETHOL ECOL EVOL 2022. [DOI: 10.1080/03949370.2021.1988723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Marta Bertini
- Natural History Museum, University of Pisa, Via Roma 79, Calci 56011 (Pisa) Italy
| | - Giulia Annicchiarico
- Natural History Museum, University of Pisa, Via Roma 79, Calci 56011 (Pisa) Italy
| | - Chiara Bresciani
- Natural History Museum, University of Pisa, Via Roma 79, Calci 56011 (Pisa) Italy
| | - Giada Cordoni
- Natural History Museum, University of Pisa, Via Roma 79, Calci 56011 (Pisa) Italy
| | - Elisabetta Palagi
- Natural History Museum, University of Pisa, Via Roma 79, Calci 56011 (Pisa) Italy
- Department of Biology, Unit of Ethology, University of Pisa, Via A. Volta 6, Pisa 56126, Italy
| |
Collapse
|
28
|
Katembu S, Xu Q, Rostami HN, Recio G, Sommer W. Effects of Social Context on Deliberate Facial Expressions: Evidence from a Stroop-like Task. JOURNAL OF NONVERBAL BEHAVIOR 2022. [DOI: 10.1007/s10919-022-00400-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractFacial expressions contribute to nonverbal communication, social coordination, and interaction. Facial expressions may reflect the emotional state of the expressor, but they may be modulated by the presence of others, for example, by facial mimicry or through social display rules. We examined how deliberate facial expressions of happiness and anger (smiles and frowns), prompted by written commands, are modulated by the congruency with the facial expression of background faces and how this effect depends on the age of the background face (infants vs. adults). Our main interest was whether the quality of the required expression could be influenced by a task-irrelevant background face and its emotional display. Background faces from adults and infants displayed happy, angry, or neutral expressions. To assess the activation pattern of different action units, we used a machine classifier software; the same classifier was used to assess the chronometry of the expression responses. Results indicated slower and less correct performance when an incongruent facial expression was in the background, especially when distractor stimuli showed adult faces. Interestingly, smile responses were more intense in congruent than incongruent conditions. Depending on stimulus age, frown responses were affected in their quality by incongruent (smile) expressions in terms of the additional activation or deactivation of the outer brow raiser (AU2), resulting in a blended expression, somewhat different from the prototypical expression for anger. Together, the present results show qualitative effects on deliberate facial expressions, beyond typical chronometric effects, confirming machine classification of facial expressions as a promising tool for emotion research.
Collapse
|
29
|
Imagining is Not Observing: The Role of Simulation Processes Within the Mimicry-Liking Expressway. JOURNAL OF NONVERBAL BEHAVIOR 2022. [DOI: 10.1007/s10919-022-00399-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractIndividuals automatically mimic a wide range of different behaviors, and such mimicking behavior has several social benefits. One of the landmark findings in the literature is that being mimicked increases liking for the mimicker. Research in cognitive neuroscience demonstrated that mentally simulating motor actions is neurophysiologically similar to engaging in these actions. Such research would predict that merely imagining being mimicked produces the same results as actually experiencing mimicry. To test this prediction, we conducted two experiments. In Experiment 1, being mimicked increased liking for the mimicker only when mimicry was directly experienced, but not when it was merely imagined. Experiment 2 replicated this finding within a high-powered online sample: merely imagining being mimicked does not produce the same effects as being actually mimicked. Theoretical and practical implications of these experiments are discussed.
Collapse
|
30
|
Bresciani C, Cordoni G, Palagi E. Playing together, laughing together: rapid facial mimicry and social sensitivity in lowland gorillas. Curr Zool 2021; 68:560-569. [PMID: 36324534 PMCID: PMC9616060 DOI: 10.1093/cz/zoab092] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Accepted: 11/01/2021] [Indexed: 11/12/2022] Open
Abstract
In nonhuman animals, the phenomenon of rapid facial mimicry (RFM)—the automatic, involuntary, and rapid (<1 s) replication of others’ facial expressions—has been mainly investigated in the playful domain. In immature lowland gorillas Gorilla gorilla gorilla both play face (PF) and full PF (FPF) are rapidly mimicked between the players. This makes the species suitable to test hypotheses on the factors influencing RFM during play. The observations on 3 captive groups of lowland gorillas (N = 27) revealed that contrary to expectations, the closeness of social bond negatively influenced the occurrence of RFM but it did not affect either RFM latency or its overlapping index (OVERLAP). RFM was affected by the degree of symmetry of play fighting: the more balanced the session, the higher the occurrence of RFM. Players of the same sex class responded faster than players of different sex. These findings suggest that RFM may help synchronizing behaviors of playmates matching in size (same-sex) and promote symmetric playful interactions. “Laughing together” (measured by the RFM OVERLAP) lasted longer when the responder perfectly mirrored the partner expression (PF→PF; FPF→FPF). If PF and FPF convey information on the different play roughness degree, through “laughing together” the players could coordinate their actions and share positive moods and playful intensity. If the perfect congruency in the motor resonance, also known as social sensitivity, can foster a possible emotional dialogue between gorillas remains to be investigated.
Collapse
Affiliation(s)
- Chiara Bresciani
- Natural History Museum, University of Pisa, Via Roma 79, Calci (Pisa) 56011, Italia
| | - Giada Cordoni
- Natural History Museum, University of Pisa, Via Roma 79, Calci (Pisa) 56011, Italia
| | - Elisabetta Palagi
- Natural History Museum, University of Pisa, Via Roma 79, Calci (Pisa) 56011, Italia
- Department of Biology, Unit of Ethology, University of Pisa, Via A. Volta 6, Pisa 56126, Italia
| |
Collapse
|
31
|
Rohr MK, Salazar Kämpf M, Kunzmann U. Love and Imitation: Facial Mimicry and Relationship Satisfaction in Younger and Older Couples. J Gerontol B Psychol Sci Soc Sci 2021; 77:1210-1218. [PMID: 34655217 DOI: 10.1093/geronb/gbab193] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Indexed: 11/12/2022] Open
Abstract
OBJECTIVE Social mimicry, the imitation of one's conversation partner, is associated with empathy, liking, and affiliation. Because previous research has mainly focused on young adulthood and zero acquaintances, little is known about age differences in mimicry and its role for romantic relationships. METHODS In this study, 37 younger and 41 older couples talked about an ongoing problem faced by one of the partners while being video-recorded. Three independent observers assessed partners' facial mimicry. After the conversation, couples evaluated the quality of their relationship. RESULTS Younger couples imitated each other more than older couples. The link between mimicry and relationship quality was mixed. While facial mimicry was not linked to subjective closeness in either younger or older couples, there was a significant positive association between mimicry and relationship satisfaction in young, but not older, couples. DISCUSSION Overall, the results suggest that facial mimicry is a social process that becomes less prevalent and might differ in their function as individuals age.
Collapse
Affiliation(s)
| | | | - Ute Kunzmann
- Institute of Psychology, University of Leipzig, Leipzig, Germany
| |
Collapse
|
32
|
Altering Facial Movements Abolishes Neural Mirroring of Facial Expressions. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 22:316-327. [PMID: 34642896 PMCID: PMC8983526 DOI: 10.3758/s13415-021-00956-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 09/14/2021] [Indexed: 11/08/2022]
Abstract
People tend to automatically imitate others' facial expressions of emotion. That reaction, termed "facial mimicry" has been linked to sensorimotor simulation-a process in which the observer's brain recreates and mirrors the emotional experience of the other person, potentially enabling empathy and deep, motivated processing of social signals. However, the neural mechanisms that underlie sensorimotor simulation remain unclear. This study tests how interfering with facial mimicry by asking participants to hold a pen in their mouth influences the activity of the human mirror neuron system, indexed by the desynchronization of the EEG mu rhythm. This response arises from sensorimotor brain areas during observed and executed movements and has been linked with empathy. We recorded EEG during passive viewing of dynamic facial expressions of anger, fear, and happiness, as well as nonbiological moving objects. We examine mu desynchronization under conditions of free versus altered facial mimicry and show that desynchronization is present when adult participants can freely move but not when their facial movements are inhibited. Our findings highlight the importance of motor activity and facial expression in emotion communication. They also have important implications for behaviors that involve occupying or hiding the lower part of the face.
Collapse
|
33
|
Berry M, Brown S. The dynamic mask: Facial correlates of character portrayal in professional actors. Q J Exp Psychol (Hove) 2021; 75:936-953. [PMID: 34499014 PMCID: PMC8958566 DOI: 10.1177/17470218211047935] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Actors make modifications to their face, voice, and body to match standard gestural conceptions of the fictional characters they are portraying during stage performances. However, the gestural manifestations of acting have not been quantified experimentally, least of all in group-level analyses. To quantify the facial correlates of character portrayal in professional actors for the first time, we had 24 actors portray a contrastive series of nine stock characters (e.g., king, bully, lover) that were organised according to a predictive scheme based on the two statistically independent personality dimensions of assertiveness (i.e., the tendency to satisfy personal concerns) and cooperativeness (i.e., the tendency to satisfy others’ concerns). We used three-dimensional motion capture to examine changes in facial dimensions, with an emphasis on the relative expansion/contraction of four facial segments related to the brow, eyebrows, lips, and jaw, respectively. The results demonstrated that expansions in both upper- and lower-facial segments were related to increases in the levels of character cooperativeness, but not assertiveness. These findings demonstrate that actors reliably manipulate their facial features in a contrastive manner to differentiate characters based on their underlying personality traits.
Collapse
Affiliation(s)
- Matthew Berry
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Steven Brown
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
34
|
Bos PA, Lesemann FHP, Spencer H, Stein DJ, van Honk J, Montoya ER. Preliminary data on increased reactivity towards children in distress after testosterone administration in women: A matter of protection? Biol Psychol 2021; 165:108176. [PMID: 34474128 DOI: 10.1016/j.biopsycho.2021.108176] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Revised: 08/26/2021] [Accepted: 08/26/2021] [Indexed: 11/25/2022]
Abstract
Emotional reactivity to others' distress is a vital prerequisite for a caring response. Testosterone, in contrast, is mostly associated with protection of personal dominance and decreased responsiveness to others' needs. However, experimental work also indicates that rising testosterone levels in response to infant distress can potentially facilitate protection. We assessed the impact of testosterone administration on participants' emotional reactivity to infants in distress, measuring their facial responses on the corrugator supercilii forehead muscle ('frowning') and the zygomaticus major ('smiling') as an index of emotional responses towards children. Moreover, we probed whether the effect of testosterone is moderated by participants' self-reported nurturance and protective tendencies. Our preliminary results showed that testosterone not only increased emotional reactivity to empathy eliciting images of children, but that this increase was strongest in participants with strong protective tendencies. Our administration study is the first to link testosterone to infant protection.
Collapse
Affiliation(s)
- Peter A Bos
- Institute of Education and Child Studies, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, the Netherlands; Department of Experimental Psychology, Utrecht University, Heidelberglaan 1, 3584 CS, Utrecht, the Netherlands.
| | - Franca H Parianen Lesemann
- Department of Experimental Psychology, Utrecht University, Heidelberglaan 1, 3584 CS, Utrecht, the Netherlands
| | - Hannah Spencer
- Research Institute of Child Development and Education, University of Amsterdam, PO Box 15780, 1001 NG, Amsterdam, the Netherlands
| | - Dan J Stein
- SA MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry and Mental Health, University of Cape Town, J-Block Groote Schuur Hospital Observatory, Cape Town, South Africa
| | - Jack van Honk
- Department of Experimental Psychology, Utrecht University, Heidelberglaan 1, 3584 CS, Utrecht, the Netherlands; SA MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry and Mental Health, University of Cape Town, J-Block Groote Schuur Hospital Observatory, Cape Town, South Africa
| | - Estrella R Montoya
- Department of Experimental Psychology, Utrecht University, Heidelberglaan 1, 3584 CS, Utrecht, the Netherlands
| |
Collapse
|
35
|
Kroczek LOH, Lingnau A, Schwind V, Wolff C, Mühlberger A. Angry facial expressions bias towards aversive actions. PLoS One 2021; 16:e0256912. [PMID: 34469494 PMCID: PMC8409676 DOI: 10.1371/journal.pone.0256912] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 08/19/2021] [Indexed: 11/19/2022] Open
Abstract
Social interaction requires fast and efficient processing of another person's intentions. In face-to-face interactions, aversive or appetitive actions typically co-occur with emotional expressions, allowing an observer to anticipate action intentions. In the present study, we investigated the influence of facial emotions on the processing of action intentions. Thirty-two participants were presented with video clips showing virtual agents displaying a facial emotion (angry vs. happy) while performing an action (punch vs. fist-bump) directed towards the observer. During each trial, video clips stopped at varying durations of the unfolding action, and participants had to recognize the presented action. Naturally, participants' recognition accuracy improved with increasing duration of the unfolding actions. Interestingly, while facial emotions did not influence accuracy, there was a significant influence on participants' action judgements. Participants were more likely to judge a presented action as a punch when agents showed an angry compared to a happy facial emotion. This effect was more pronounced in short video clips, showing only the beginning of an unfolding action, than in long video clips, showing near-complete actions. These results suggest that facial emotions influence anticipatory processing of action intentions allowing for fast and adaptive responses in social interactions.
Collapse
Affiliation(s)
- Leon O. H. Kroczek
- Department of Psychology, Clinical Psychology and Psychotherapy, University of Regensburg, Regensburg, Germany
- * E-mail:
| | - Angelika Lingnau
- Department of Psychology, Cognitive Neuroscience, University of Regensburg, Regensburg, Germany
| | - Valentin Schwind
- Human Computer Interaction, University of Applied Sciences in Frankfurt a. M, Frankfurt a. M., Germany
- Department of Media Informatics, University of Regensburg, Regensburg, Germany
| | - Christian Wolff
- Department of Media Informatics, University of Regensburg, Regensburg, Germany
| | - Andreas Mühlberger
- Department of Psychology, Clinical Psychology and Psychotherapy, University of Regensburg, Regensburg, Germany
| |
Collapse
|
36
|
Cohen D, Landau DH, Friedman D, Hasler BS, Levit-Binnun N, Golland Y. Exposure to social suffering in virtual reality boosts compassion and facial synchrony. COMPUTERS IN HUMAN BEHAVIOR 2021. [DOI: 10.1016/j.chb.2021.106781] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
37
|
Wróbel M, Piórkowska M, Rzeczkowska M, Troszczyńska A, Tołopiło A, Olszanowski M. The “Big Two” and socially induced emotions: Agency and communion jointly influence emotional contagion and emotional mimicry. MOTIVATION AND EMOTION 2021. [DOI: 10.1007/s11031-021-09897-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
AbstractThree studies investigated the effects of two fundamental dimensions of social perception on emotional contagion (i.e., the transfer of emotions between people). Rooting our hypotheses in the Dual Perspective Model of Agency and Communion (Abele and Wojciszke in Adv Exp Soc Psychol 50:198–255, 10.1016/B978-0-12-800284-1.00004-7, 2014), we predicted that agency would strengthen the effects of communion on emotional contagion and emotional mimicry (a process often considered a key mechanism behind emotional contagion). To test this hypothesis, we exposed participants to happy, sad, and angry senders characterized by low vs. high communion and agency. Our results demonstrated that, as expected, the effects of the two dimensions on socially induced emotions were interactive. The strength and direction of these effects, however, were consistent with our predictions only when the senders expressed happiness. When the senders expressed sadness, we found no effects of agency or communion on participants’ emotional responses, whereas for anger a mixed pattern emerged. Overall, our results align with the notion that emotional contagion and mimicry are modulated not only by the senders’ traits but also by the social meaning of the expressed emotion.
Collapse
|
38
|
Abstract
Humans tend to show congruent facial expressions automatically in reaction to their partners which is defined as emotional mimicry. Although occurring unconsciously, this tendency has been proven to be modulated by social contextual factors such as group membership. Ingroup bias in emotional mimicryhas been well-documented in previous research; however, few studies have investigated the underlying mechanism. Based on the mimicry-as-social-regulator model, this study explored whether the ingroup bias in emotional mimicry arises from the greater self-ingroup overlap. By recording participants' facial electromyographic responses while passively viewing dynamic emotional clips performed by either racial ingroup or outgroup actors, Study 1 validated the presence of ingroup bias in the mimicry of happiness, but not anger. Using asimilar procedure in Study 2, anew sample was employed (N = 37), and a measurement of self-other overlaps via the Inclusion of the Other in the Self Scale was added. The results of Study 2 reproduced the ingroup bias in happy mimicry, and further demonstrated that the effect of group membership on emotional mimicry was mediated by the self-other overlap. In summary, this study provides evidence that the level of interpersonal closeness predicts emotional mimicry.
Collapse
Affiliation(s)
- Shenli Peng
- College of Education, Hunan Agricultural University, Changsha, P.R. China
| | - Ling Zhang
- Department of Psychology, Renmin University of China, Beijing, P.R. China
| | - Ping Hu
- Department of Psychology, Renmin University of China, Beijing, P.R. China
| |
Collapse
|
39
|
Blom SSAH, Aarts H, Kunst HPM, Wever CC, Semin GR. Facial emotion detection in Vestibular Schwannoma patients with and without facial paresis. Soc Neurosci 2021; 16:317-326. [PMID: 33781177 DOI: 10.1080/17470919.2021.1909127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
This study investigates whether there exist differences in facial emotion detection accuracy in patients suffering from Vestibular Schwannoma (VS) due to their facial paresis. Forty-four VS patients, half of them with, and half of them without a facial paresis, had to classify pictures of facial expressions as being emotional or non-emotional. The visual information of images was systematically manipulated by adding different levels of visual noise. The study had a mixed design with emotional expression (happy vs. angry) and visual noise level (10% to 80%) as repeated measures and facial paresis (present vs. absent) and degree of facial dysfunction as between subjects' factors. Emotion detection accuracy declined when visual information declined, an effect that was stronger for anger than for happy expressions. Overall, emotion detection accuracy for happy and angry faces did not differ between VS patients with or without a facial paresis, although exploratory analyses suggest that the ability to recognize emotions in angry facial expressions was slightly more impaired in patients with facial paresis. The findings are discussed in the context of the effects of facial paresis on emotion detection, and the role of facial mimicry, in particular, as an important mechanism for facial emotion processing and understanding.
Collapse
Affiliation(s)
- Stephanie S A H Blom
- Department of Psychology, Utrecht University & at the William James Center for Research, ISPA, Utrecht, The Netherlands
| | | | - H P M Kunst
- Department of Otolaryngology, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands.,Department of Otolaryngology, Maastricht UMC+, Maastricht, The Netherlands
| | - Capi C Wever
- Department of Otolaryngology - Head & Neck Surgery, Leiden University Medical Center, Leiden, The Netherlands
| | - Gün R Semin
- Department of Psychology, Utrecht University & at the William James Center for Research, ISPA, Instituto Universitário, Lisbon, Portugal.,The Netherlands & William James Center for Research, ISPA - Instituto Universitário, Utrecht, Lisbon, Portugal
| |
Collapse
|
40
|
Van der Donck S, Vettori S, Dzhelyova M, Mahdi SS, Claes P, Steyaert J, Boets B. Investigating automatic emotion processing in boys with autism via eye tracking and facial mimicry recordings. Autism Res 2021; 14:1404-1420. [PMID: 33704930 DOI: 10.1002/aur.2490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Accepted: 02/08/2021] [Indexed: 11/08/2022]
Abstract
Difficulties in automatic emotion processing in individuals with autism spectrum disorder (ASD) might remain concealed in behavioral studies due to compensatory strategies. To gain more insight in the mechanisms underlying facial emotion recognition, we recorded eye tracking and facial mimicry data of 20 school-aged boys with ASD and 20 matched typically developing controls while performing an explicit emotion recognition task. Proportional looking times to specific face regions (eyes, nose, and mouth) and face exploration dynamics were analyzed. In addition, facial mimicry was assessed. Boys with ASD and controls were equally capable to recognize expressions and did not differ in proportional looking times, and number and duration of fixations. Yet, specific facial expressions elicited particular gaze patterns, especially within the control group. Both groups showed similar face scanning dynamics, although boys with ASD demonstrated smaller saccadic amplitudes. Regarding the facial mimicry, we found no emotion specific facial responses and no group differences in the responses to the displayed facial expressions. Our results indicate that boys with and without ASD employ similar eye gaze strategies to recognize facial expressions. Smaller saccadic amplitudes in boys with ASD might indicate a less exploratory face processing strategy. Yet, this slightly more persistent visual scanning behavior in boys with ASD does not imply less efficient emotion information processing, given the similar behavioral performance. Results on the facial mimicry data indicate similar facial responses to emotional faces in boys with and without ASD. LAY SUMMARY: We investigated (i) whether boys with and without autism apply different face exploration strategies when recognizing facial expressions and (ii) whether they mimic the displayed facial expression to a similar extent. We found that boys with and without ASD recognize facial expressions equally well, and that both groups show similar facial reactions to the displayed facial emotions. Yet, boys with ASD visually explored the faces slightly less than the boys without ASD.
Collapse
Affiliation(s)
- Stephanie Van der Donck
- Center for Developmental Psychiatry, Department of Neurosciences, KU Leuven, Leuven, Belgium.,Leuven Autism Research (LAuRes), KU Leuven, Leuven, Belgium
| | - Sofie Vettori
- Center for Developmental Psychiatry, Department of Neurosciences, KU Leuven, Leuven, Belgium.,Leuven Autism Research (LAuRes), KU Leuven, Leuven, Belgium
| | - Milena Dzhelyova
- Institute of Research in Psychological Sciences, Institute of Neuroscience, Université de Louvain, Louvain-La-Neuve, Belgium
| | - Soha Sadat Mahdi
- Medical Imaging Research Center, MIRC, Leuven, Belgium.,Department of Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Peter Claes
- Medical Imaging Research Center, MIRC, Leuven, Belgium.,Department of Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium.,Department of Human Genetics, KU Leuven, Leuven, Belgium
| | - Jean Steyaert
- Center for Developmental Psychiatry, Department of Neurosciences, KU Leuven, Leuven, Belgium.,Leuven Autism Research (LAuRes), KU Leuven, Leuven, Belgium
| | - Bart Boets
- Center for Developmental Psychiatry, Department of Neurosciences, KU Leuven, Leuven, Belgium.,Leuven Autism Research (LAuRes), KU Leuven, Leuven, Belgium
| |
Collapse
|
41
|
Salvadori EA, Colonnesi C, Vonk HS, Oort FJ, Aktar E. Infant Emotional Mimicry of Strangers: Associations with Parent Emotional Mimicry, Parent-Infant Mutual Attention, and Parent Dispositional Affective Empathy. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18020654. [PMID: 33466629 PMCID: PMC7828673 DOI: 10.3390/ijerph18020654] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Revised: 12/30/2020] [Accepted: 01/12/2021] [Indexed: 11/16/2022]
Abstract
Emotional mimicry, the tendency to automatically and spontaneously reproduce others’ facial expressions, characterizes human social interactions from infancy onwards. Yet, little is known about the factors modulating its development in the first year of life. This study investigated infant emotional mimicry and its association with parent emotional mimicry, parent-infant mutual attention, and parent dispositional affective empathy. One hundred and seventeen parent-infant dyads (51 six-month-olds, 66 twelve-month-olds) were observed during video presentation of strangers’ happy, sad, angry, and fearful faces. Infant and parent emotional mimicry (i.e., facial expressions valence-congruent to the video) and their mutual attention (i.e., simultaneous gaze at one another) were systematically coded second-by-second. Parent empathy was assessed via self-report. Path models indicated that infant mimicry of happy stimuli was positively and independently associated with parent mimicry and affective empathy, while infant mimicry of sad stimuli was related to longer parent-infant mutual attention. Findings provide new insights into infants’ and parents’ coordination of mimicry and attention during triadic contexts of interactions, endorsing the social-affiliative function of mimicry already present in infancy: emotional mimicry occurs as an automatic parent-infant shared behavior and early manifestation of empathy only when strangers’ emotional displays are positive, and thus perceived as affiliative.
Collapse
Affiliation(s)
- Eliala A. Salvadori
- Research Institute of Child Development and Education, University of Amsterdam, 1018 WS Amsterdam, The Netherlands; (C.C.); (H.S.V.); (F.J.O.); (E.A.)
- Research Priority Area Yield, University of Amsterdam, 1018 WS Amsterdam, The Netherlands
- Correspondence: ; Tel.: +31-633-853-534
| | - Cristina Colonnesi
- Research Institute of Child Development and Education, University of Amsterdam, 1018 WS Amsterdam, The Netherlands; (C.C.); (H.S.V.); (F.J.O.); (E.A.)
- Research Priority Area Yield, University of Amsterdam, 1018 WS Amsterdam, The Netherlands
| | - Heleen S. Vonk
- Research Institute of Child Development and Education, University of Amsterdam, 1018 WS Amsterdam, The Netherlands; (C.C.); (H.S.V.); (F.J.O.); (E.A.)
| | - Frans J. Oort
- Research Institute of Child Development and Education, University of Amsterdam, 1018 WS Amsterdam, The Netherlands; (C.C.); (H.S.V.); (F.J.O.); (E.A.)
- Research Priority Area Yield, University of Amsterdam, 1018 WS Amsterdam, The Netherlands
| | - Evin Aktar
- Research Institute of Child Development and Education, University of Amsterdam, 1018 WS Amsterdam, The Netherlands; (C.C.); (H.S.V.); (F.J.O.); (E.A.)
- Department of Clinical Psychology, Leiden University, 2333 AK Leiden, The Netherlands
| |
Collapse
|
42
|
Farmer H, Mahmood R, Gregory SEA, Tishina P, Hamilton AFDC. Dynamic emotional expressions do not modulate responses to gestures. Acta Psychol (Amst) 2021; 212:103226. [PMID: 33310344 PMCID: PMC7755647 DOI: 10.1016/j.actpsy.2020.103226] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2020] [Revised: 10/08/2020] [Accepted: 10/22/2020] [Indexed: 11/22/2022] Open
Abstract
The tendency to imitate the actions of others appears to be a fundamental aspect of human social interaction. Emotional expressions are a particularly salient form of social stimuli (Vuilleumier & Schwartz, 2001) but their relationship to imitative behaviour is currently unclear. In this paper we report the results of five studies which investigated the effect of a target's dynamic emotional stimuli on participants' tendency to respond compatibly to the target's actions. Experiment one examined the effect of dynamic emotional expressions on the automatic imitation of opening and closing hand movements. Experiment two used the same basic paradigm but added gaze direction as an additional factor. Experiment three investigated the effect of dynamic emotional expressions on compatibility responses to handshakes. Experiment four investigated whether dynamic emotional expressions modulated response to valenced social gestures. Finally, experiment five compared the effects of dynamic and static emotional expressions on participants' automatic imitation of finger lifting. Across all five studies we reliably elicited a compatibility effect however, none of the studies found a significant modulating effect of emotional expression. This null effect was also supported by a random effects meta-analysis and a series of Bayesian t-tests. Nevertheless, these results must be caveated by the fact that our studies had limited power to detect effect sizes below d = 0.4. We conclude by situating our findings within the literature, suggesting that the effect of emotional expressions on automatic imitation is, at best, minimal.
Collapse
Affiliation(s)
- Harry Farmer
- School of Human Sciences, University of Greenwich, United Kingdom; Institute of Lifecourse Development, University of Greenwich, United Kingdom; Institute of Cognitive Neuroscience, University College London, United Kingdom.
| | - Raqeeb Mahmood
- Department of Psychology, University of Bath, United Kingdom
| | | | - Polina Tishina
- Institute of Cognitive Neuroscience, University College London, United Kingdom
| | | |
Collapse
|
43
|
Kuang B, Li X, Li X, Lin M, Liu S, Hu P. The effect of eye gaze direction on emotional mimicry: A multimodal study with electromyography and electroencephalography. Neuroimage 2020; 226:117604. [PMID: 33278584 DOI: 10.1016/j.neuroimage.2020.117604] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2020] [Revised: 11/21/2020] [Accepted: 11/24/2020] [Indexed: 11/15/2022] Open
Abstract
Emotional mimicry plays an important role in social interaction and is influenced by social context, especially eye gaze direction. However, the neural mechanism underlying the effect of eye gaze direction on emotional mimicry is unclear. Here, we explored how eye gaze direction influenced emotional mimicry with a combination of electromyography (EMG) and electroencephalography (EEG) techniques, which may provide a more comprehensive measure. To do this, we recorded facial EMG and scalp EEG signals simultaneously while participants observed emotional faces (happy vs. angry) with direct or averted gaze. Then, we split the EEG trials into two mimicry intensity categories (high mimicry intensity, HMI vs. low mimicry intensity, LMI) according to EMG activity. The ERP difference between HMI and LMI EEG trials revealed four ERP components (P50, P150, N200 and P300), and the effect of eye gaze direction on emotional mimicry was prominent on P300 at P7 and P8. Moreover, we also observed differences in the effect of eye gaze direction on mimicry of happy faces and angry faces, which were found on P300 at P7, as well as P150 at P7 and N200 at P7 and Pz. In short, the present study isolated the neural signals of emotional mimicry with a new multimodal method, and provided empirical neural evidence that eye gaze direction affected emotional mimicry.
Collapse
Affiliation(s)
- Beibei Kuang
- International Studies College, National University of Defense Technology, Nanjing, China; Department of Psychology, Renmin University of China, Room 1005, D Block, Huixian Building, 59 Zhongguancun St., Haidian Dist., Beijing, 100872, China
| | - Xueting Li
- Department of Psychology, Renmin University of China, Room 1005, D Block, Huixian Building, 59 Zhongguancun St., Haidian Dist., Beijing, 100872, China
| | - Xintong Li
- Department of Psychology, Renmin University of China, Room 1005, D Block, Huixian Building, 59 Zhongguancun St., Haidian Dist., Beijing, 100872, China
| | - Mingxiao Lin
- Department of Psychology, Renmin University of China, Room 1005, D Block, Huixian Building, 59 Zhongguancun St., Haidian Dist., Beijing, 100872, China
| | - Shanrou Liu
- Department of Psychology, Renmin University of China, Room 1005, D Block, Huixian Building, 59 Zhongguancun St., Haidian Dist., Beijing, 100872, China
| | - Ping Hu
- Department of Psychology, Renmin University of China, Room 1005, D Block, Huixian Building, 59 Zhongguancun St., Haidian Dist., Beijing, 100872, China.
| |
Collapse
|
44
|
Imafuku M, Fukushima H, Nakamura Y, Myowa M, Koike S. Interoception is associated with the impact of eye contact on spontaneous facial mimicry. Sci Rep 2020; 10:19866. [PMID: 33199748 PMCID: PMC7670470 DOI: 10.1038/s41598-020-76393-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Accepted: 10/27/2020] [Indexed: 12/11/2022] Open
Abstract
Interoception (perception of one’s own physiological state) has been suggested to underpin social cognition, although the mechanisms underlying this association remain unclear. The current study aimed to elucidate the relationship between interoception and two factors underlying social cognition: self-other boundary and sensitivity to social cues. We measured performance in a heartbeat perception task as an index of interoceptive accuracy (IAc), the frequency of spontaneous facial mimicry (SFM) as an index of self-other boundary, and the degree of the effect of eye contact on SFM (difference in SFM between conditions in which models’ eyes were directed to and averted from participants) as an index of social-cue sensitivity, and tested correlations among these measures. The results revealed that IAc and SFM were positively correlated only in the direct gaze condition. The extent of the effect of eye contact on SFM (difference in frequency between direct vs. averted conditions) was positively correlated with IAc. These overall findings were also observed in separate analyses of male and female participant groups, supporting the robustness of the findings. The results suggest that interoception is related to sensitivity to social cues, and may also be related to the self-other boundary with modulation by social context.
Collapse
Affiliation(s)
- Masahiro Imafuku
- Faculty of Education, Musashino University, 1-1-20 Shin-machi, Nishitokyo-shi, Tokyo, 202-8585, Japan.
| | - Hirokata Fukushima
- Faculty of Sociology, Kansai University, 3-3-35 Yamate-cho, Suita, Osaka, 564-8680, Japan.
| | - Yuko Nakamura
- Center for Evolutionary Cognitive Sciences, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan.,Center for Integrative Science of Human Behavior, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan
| | - Masako Myowa
- Graduate School of Education, Kyoto University, Kyoto, Japan
| | - Shinsuke Koike
- Center for Evolutionary Cognitive Sciences, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan.,Center for Integrative Science of Human Behavior, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan.,University of Tokyo Institute for Diversity & Adaptation of Human Mind (UTIDAHM), 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan.,The International Research Center for Neurointelligence (WPI-IRCN) at The University of Tokyo Institutes for Advanced Study (UTIAS), 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8654, Japan
| |
Collapse
|
45
|
Shinotoh H. Oxytocin and mimicry enhance brain activity during social cognition in frontotemporal dementia. Neurology 2020; 95:849-850. [PMID: 32963104 DOI: 10.1212/wnl.0000000000010930] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023] Open
Affiliation(s)
- Hitoshi Shinotoh
- From the Department of Functional Brain Imaging, National Institute of Radiological Sciences, National Institutes for Quantum and Radiological Science and Technology; and Neurology Clinic Chiba, Japan
| |
Collapse
|
46
|
Mirror replication of sexual facial expressions increases the success of sexual contacts in bonobos. Sci Rep 2020; 10:18979. [PMID: 33149226 PMCID: PMC7643078 DOI: 10.1038/s41598-020-75790-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2020] [Accepted: 10/05/2020] [Indexed: 01/05/2023] Open
Abstract
Rapid Facial Mimicry (RFM), one of the possible predictors of emotional contagion, is defined as the rapid, involuntary and automatic replication of a facial expression. Up to now, RFM has been demonstrated in nonhuman animals exclusively during play. Since in bonobos, as in humans, socio-sexuality is a powerful tool for assessing/strengthening inter-individual relationships, we investigated RFM in this domain. Bonobos displayed silent bared-teeth (sbt, the most common facial expression during sexual contacts) more frequently after the detection of an sbt emitted by the trigger than in the no-detection condition. This is the first demonstration of the presence of RFM during sex. The occurrence of RFM was positively affected by the sex of the partners with female homo-sexual contacts being punctuated by a higher presence of RFM. At an immediate level, RFM increased the duration of homo- and hetero-sexual contacts. This finding suggests that RFM can increase individuals’ potential fitness benefits. By prolonging their sexual contacts, females can strengthen their social relationships thus increasing the probability to obtain priority over resources (RFM indirect fitness benefits). Via longer copulations, males can increase the probability to make females pregnant (RFM direct fitness benefits). In conclusion, in bonobos the access to the partner’s face during sexual contacts (face-to-face, proximate factor) and the role of socio-sexuality in increasing the individual direct and indirect fitness (ultimate factor) could have favoured the evolution of specific sexual facial expressions and their rapid mirror replication. Our findings on bonobos expand the role of RFM well beyond the animal play domain thus opening new scenarios for future comparative studies exploring the evolution of socio-sexuality in humans.
Collapse
|
47
|
Peng S, Kuang B, Hu P. Right Temporoparietal Junction Modulates In-Group Bias in Facial Emotional Mimicry: A tDCS Study. Front Behav Neurosci 2020; 14:143. [PMID: 33061895 PMCID: PMC7488597 DOI: 10.3389/fnbeh.2020.00143] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2020] [Accepted: 07/24/2020] [Indexed: 01/09/2023] Open
Abstract
The present study employs transcranial direct current stimulation (tDCS), a non-invasive brain stimulation technique, to explore the possible role of the right temporoparietal junction (rTPJ) in regulating in-group bias in facial emotional mimicry. Participants received either anodal or cathodal stimulation, or they were assigned to a sham condition. After that, they passively viewed a series of video clips depicting different emotions (happiness and anger) that were performed either by ethnic in-group or out-group models. The emotion-specific muscle activities, zygomatic major (ZM) and corrugator supercilii (CS) were recorded simultaneously as the index of facial emotional mimicry. The results first confirm the in-group bias in facial emotional mimicry in the sham condition, as shown in prior studies, though it only occurs in happy mimicry. Moreover, the in-group bias in facial emotional mimicry is modulated by the cortical excitability over the rTPJ, which may be attributed to the accompanied change of overlap of the mental representations of in-group and out-group. This study provides a close look at the neural underpinning of the modulation of facial emotional mimicry by group membership and highlights the role of rTPJ in on-line control of co-activated self and other representations in social cognition.
Collapse
Affiliation(s)
- Shenli Peng
- College of Education, Hunan Agricultural University, Changsha, China
| | - BeiBei Kuang
- The Institute for Mental Crisis Prevention and Intervention of College Students in Jiangsu Province, Nanjing Audit University, Nanjing, China
| | - Ping Hu
- Department of Psychology, Renmin University of China, Beijing, China
| |
Collapse
|
48
|
Zampella CJ, Bennetto L, Herrington JD. Computer Vision Analysis of Reduced Interpersonal Affect Coordination in Youth With Autism Spectrum Disorder. Autism Res 2020; 13:2133-2142. [PMID: 32666690 DOI: 10.1002/aur.2334] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2020] [Revised: 05/01/2020] [Accepted: 05/24/2020] [Indexed: 11/09/2022]
Abstract
Atypical social-emotional reciprocity is a core feature of autism spectrum disorder (ASD) but can be difficult to operationalize. One measurable manifestation of reciprocity may be interpersonal coordination, the tendency to align the form and timing of one's behaviors (including facial affect) with others. Interpersonal affect coordination facilitates sharing and understanding of emotional cues, and there is evidence that it is reduced in ASD. However, most research has not measured this process in true social contexts, due in part to a lack of tools for measuring dynamic facial expressions over the course of an interaction. Automated facial analysis via computer vision provides an efficient, granular, objective method for measuring naturally occurring facial affect and coordination. Youth with ASD and matched typically developing youth participated in cooperative conversations with their mothers and unfamiliar adults. Time-synchronized videos were analyzed with an open-source computer vision toolkit for automated facial analysis, for the presence and intensity of facial movements associated with positive affect. Both youth and adult conversation partners exhibited less positive affect during conversations when the youth partner had ASD. Youth with ASD also engaged in less affect coordination over the course of conversations. When considered dimensionally across youth with and without ASD, affect coordination significantly predicted scores on rating scales of autism-related social atypicality, adaptive social skills, and empathy. Findings suggest that affect coordination is an important interpersonal process with implications for broader social-emotional functioning. This preliminary study introduces a promising novel method for quantifying moment-to-moment facial expression and emotional reciprocity during natural interactions. LAY SUMMARY: This study introduces a novel, automated method for measuring social-emotional reciprocity during natural conversations, which may improve assessment of this core autism diagnostic behavior. We used computerized methods to measure facial affect and the degree of affect coordination between conversation partners. Youth with autism displayed reduced affect coordination, and reduced affect coordination predicted lower scores on measures of broader social-emotional skills.
Collapse
Affiliation(s)
- Casey J Zampella
- Center for Autism Research, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Loisa Bennetto
- Department of Psychology, University of Rochester, Rochester, New York, USA
| | - John D Herrington
- Center for Autism Research, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA.,Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| |
Collapse
|
49
|
Nestor MS, Fischer DL, Arnold D. "Masking" our emotions: Botulinum toxin, facial expression, and well-being in the age of COVID-19. J Cosmet Dermatol 2020; 19:2154-2160. [PMID: 32592268 PMCID: PMC7361553 DOI: 10.1111/jocd.13569] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Accepted: 06/18/2020] [Indexed: 12/22/2022]
Abstract
Background The globally devastating effects of COVID‐19 breach not only the realm of public health, but of psychosocial interaction and communication as well, particularly with the advent of mask‐wearing. Methods A review of the literature and understanding of facial anatomy and expressions as well as the effect of botulinum toxin on emotions and nonverbal communication. Results Today, the mask has become a semi‐permanent accessory to the face, blocking our ability to express and perceive each other’s facial expressions by dividing it into a visible top half and invisible bottom half. This significantly restricts our ability to accurately interpret emotions based on facial expressions and strengthens our perceptions of negative emotions produced by frowning. The addition of botulinum toxin (BTX)–induced facial muscle paralysis to target the muscles of the top (visible) half of the face, especially the corrugator and procerus muscles, may act as a therapeutic solution by its suppression of glabellar lines and our ability to frown. The treatment of the glabella complex not only has been shown to inhibit the negative emotions of the treated individual but also can reduce the negative emotions in those who come in contact with the treated individual. Conclusions Mask‐wearing in the wake of COVID‐19 brings new challenges to our ability to communicate and perceive emotion through full facial expression, our most effective and universally shared form of communication, and BTX may offer a positive solution to decrease negative emotions and promote well‐being for both the mask‐wearer and all who come in contact with that individual.
Collapse
Affiliation(s)
- Mark S Nestor
- Center for Clinical and Cosmetic Research, Aventura, FL, USA.,Department of Dermatology and Cutaneous Surgery, University of Miami, Miller School of Medicine, Miami, FL, USA.,Department of Surgery, Division of Plastic Surgery, University of Miami, Miller School of Medicine, Miami, FL, USA
| | | | - David Arnold
- Center for Clinical and Cosmetic Research, Aventura, FL, USA
| |
Collapse
|
50
|
Trilla I, Drimalla H, Bajbouj M, Dziobek I. The Influence of Reward on Facial Mimicry: No Evidence for a Significant Effect of Oxytocin. Front Behav Neurosci 2020; 14:88. [PMID: 32595461 PMCID: PMC7304412 DOI: 10.3389/fnbeh.2020.00088] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2020] [Accepted: 05/08/2020] [Indexed: 11/13/2022] Open
Abstract
Recent findings suggest a role of oxytocin on the tendency to spontaneously mimic the emotional facial expressions of others. Oxytocin-related increases of facial mimicry, however, seem to be dependent on contextual factors. Given previous literature showing that people preferentially mimic emotional expressions of individuals associated with high (vs. low) rewards, we examined whether the reward value of the mimicked agent is one factor influencing the oxytocin effects on facial mimicry. To test this hypothesis, 60 male adults received 24 IU of either intranasal oxytocin or placebo in a double-blind, between-subject experiment. Next, the value of male neutral faces was manipulated using an associative learning task with monetary rewards. After the reward associations were learned, participants watched videos of the same faces displaying happy and angry expressions. Facial reactions to the emotional expressions were measured with electromyography. We found that participants judged as more pleasant the face identities associated with high reward values than with low reward values. However, happy expressions by low rewarding faces were more spontaneously mimicked than high rewarding faces. Contrary to our expectations, we did not find a significant direct effect of intranasal oxytocin on facial mimicry, nor on the reward-driven modulation of mimicry. Our results support the notion that mimicry is a complex process that depends on contextual factors, but failed to provide conclusive evidence of a role of oxytocin on the modulation of facial mimicry.
Collapse
Affiliation(s)
- Irene Trilla
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany.,Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Hanna Drimalla
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany.,Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany.,Digital Health Center, Hasso Plattner Institute, University of Potsdam, Potsdam, Germany
| | - Malek Bajbouj
- Center for Affective Neuroscience, Department of Psychiatry, Charité-Universitätsmedizin, Campus Benjamin Franklin, Berlin, Germany
| | - Isabel Dziobek
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany.,Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|