1
|
Folz J, Fiacchino D, Nikolić M, van Steenbergen H, Kret ME. Reading Your Emotions in My Physiology? Reliable Emotion Interpretations in Absence of a Robust Physiological Resonance. AFFECTIVE SCIENCE 2022; 3:480-497. [PMID: 35282156 PMCID: PMC8901434 DOI: 10.1007/s42761-021-00083-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Accepted: 09/12/2021] [Indexed: 11/26/2022]
Abstract
Affective states are expressed in an individual’s physical appearance, ranging from facial expressions and body postures, to indicators of physiological arousal (e.g., a blush). Confirming the claimed communicative function of these markers, humans are capable of distinguishing between a variety of discrete emotion displays. In an attempt to explain the underlying mechanism, characteristic bodily changes within the observer, including physiological arousal and mimicry, have been suggested to facilitate the interpretation of an expression. The current study aims to create a holistic picture of emotion perception by (1) using three different sources of emotional information (prototypical facial expressions, bodily expressions, and subtle facial cues) and (2) measuring changes in multiple physiological signals (facial electromyography, skin conductance level, skin temperature, and pupil size). While participants clearly discriminated between perceived emotional expressions, there was no overall 1–1 correspondence with their physiological responses. Some specific but robust effects were observed. Angry facial expressions were consistently responded to with a peak in skin conductance level. Furthermore, sad body expressions were associated with a drop in skin temperature. In addition to being the best recognized expression, viewing happy faces elicited congruent facial muscle responses, which supports the potential role of embodied simulation in emotion recognition. Lastly, tears were not only rated as highly emotional intense but also evoked a peak in skin conductance level in the observer. The absence of distinct physiological responses to other expressions could be explained by the lacking functionality of affect sharing in a non-interactive experimental context. Consequentially, emotional alignment in body and mind might especially take place in real social situations, which should be considered in future research.
Collapse
Affiliation(s)
- Julia Folz
- Department of Cognitive Psychology, Institute of Psychology, Leiden University, Leiden, 2333 AK The Netherlands
- Leiden Institute for Brain and Cognition (LIBC), Leiden University, Leiden, 2300 RC The Netherlands
| | - Donatella Fiacchino
- Department of Cognitive Psychology, Institute of Psychology, Leiden University, Leiden, 2333 AK The Netherlands
| | - Milica Nikolić
- Department of Cognitive Psychology, Institute of Psychology, Leiden University, Leiden, 2333 AK The Netherlands
- Leiden Institute for Brain and Cognition (LIBC), Leiden University, Leiden, 2300 RC The Netherlands
- Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, 1018 WS The Netherlands
| | - Henk van Steenbergen
- Department of Cognitive Psychology, Institute of Psychology, Leiden University, Leiden, 2333 AK The Netherlands
- Leiden Institute for Brain and Cognition (LIBC), Leiden University, Leiden, 2300 RC The Netherlands
| | - Mariska E. Kret
- Department of Cognitive Psychology, Institute of Psychology, Leiden University, Leiden, 2333 AK The Netherlands
- Leiden Institute for Brain and Cognition (LIBC), Leiden University, Leiden, 2300 RC The Netherlands
| |
Collapse
|
2
|
Lombardi G, Zenzeri J, Belgiovine G, Vannucci F, Rea F, Sciutti A, Di Cesare G. The influence of vitality forms on action perception and motor response. Sci Rep 2021; 11:22576. [PMID: 34799623 PMCID: PMC8605011 DOI: 10.1038/s41598-021-01924-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 11/08/2021] [Indexed: 11/09/2022] Open
Abstract
During the interaction with others, action, speech, and touches can communicate positive, neutral, or negative attitudes. Offering an apple can be gentle or rude, a caress can be kind or rushed. These subtle aspects of social communication have been named vitality forms by Daniel Stern. Although they characterize all human interactions, to date it is not clear whether vitality forms expressed by an agent may affect the action perception and the motor response of the receiver. To this purpose, we carried out a psychophysics study aiming to investigate how perceiving different vitality forms can influence cognitive and motor tasks performed by participants. In particular, participants were stimulated with requests made through a physical contact or vocally and conveying rude or gentle vitality forms, and then they were asked to estimate the end of a passing action observed in a monitor (action estimation task) or to perform an action in front of it (action execution task) with the intention to pass an object to the other person presented in the video. Results of the action estimation task indicated that the perception of a gentle request increased the duration of a rude action subsequently observed, while the perception of a rude request decreased the duration of the same action performed gently. Additionally, during the action execution task, accordingly with the perceived vitality form, participants modulated their motor response.
Collapse
Affiliation(s)
- G Lombardi
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy.,Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, Italy
| | - J Zenzeri
- Robotics Brain and Cognitive Sciences Unit, Italian Institute of Technology, Genoa, Italy
| | - G Belgiovine
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy.,Robotics Brain and Cognitive Sciences Unit, Italian Institute of Technology, Genoa, Italy
| | - F Vannucci
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, Italy
| | - F Rea
- Robotics Brain and Cognitive Sciences Unit, Italian Institute of Technology, Genoa, Italy
| | - A Sciutti
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, Italy
| | - G Di Cesare
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genoa, Italy.
| |
Collapse
|
3
|
Di Cesare G, Pelosi A, Aresta SM, Lombardi G, Sciutti A. Affective Contagion: How Attitudes Expressed by Others Influence Our Perception of Actions. Front Hum Neurosci 2021; 15:712550. [PMID: 34526886 PMCID: PMC8435862 DOI: 10.3389/fnhum.2021.712550] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 07/28/2021] [Indexed: 11/28/2022] Open
Abstract
Vitality forms represent a fundamental aspect of social interactions by characterizing how actions are performed and how words are pronounced on the basis of the attitude of the agent. Same action, such as a handshake, may have a different impact on the receiver when it is performed kindly or vigorously, and similarly, a gentle or rude tone of voice may have a different impact on the listener. In the present study, we carried out two experiments that aimed to investigate whether and how vocal requests conveying different vitality forms can influence the perception of goal-directed actions and to measure the duration of this effect over time. More specifically, participants were asked to listen to the voice of an actor pronouncing "give me" in a rude or gentle way. Then, they were asked to observe the initial part of a rude or a gentle passing action, continue it mentally, and estimate the time of its completion. Results showed that the perception of different vitality forms expressed by vocal requests influenced the estimation of action duration. Moreover, we found that this effect was limited to a certain time interval (800 ms), after which it started to decay.
Collapse
Affiliation(s)
- Giuseppe Di Cesare
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genova, Italy
| | - Annalisa Pelosi
- Department of Medicine and Surgery, Neuroscience Unit, University of Parma, Parma, Italy
| | - Silvia Maria Aresta
- Department of Medicine and Surgery, Neuroscience Unit, University of Parma, Parma, Italy
| | - Giada Lombardi
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genova, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genova, Genoa, Italy
| | - Alessandra Sciutti
- Cognitive Architecture for Collaborative Technologies Unit, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
4
|
Blocking facial mimicry affects recognition of facial and body expressions. PLoS One 2020; 15:e0229364. [PMID: 32078668 PMCID: PMC7032686 DOI: 10.1371/journal.pone.0229364] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2019] [Accepted: 02/04/2020] [Indexed: 11/20/2022] Open
Abstract
Facial mimicry is commonly defined as the tendency to imitate-at a sub-threshold level-facial expressions of other individuals. Numerous studies support a role of facial mimicry in recognizing others' emotions. However, the underlying functional mechanism is unclear. A prominent hypothesis considers facial mimicry as based on an action-perception loop, leading to the prediction that facial mimicry should be observed only when processing others' facial expressions. Nevertheless, previous studies have also detected facial mimicry during observation of emotional bodily expressions. An emergent alternative hypothesis is that facial mimicry overtly reflects the simulation of an "emotion", rather than the reproduction of a specific observed motor pattern. In the present study, we tested whether blocking mimicry ("Bite") on the lower face disrupted recognition of happy expressions conveyed by either facial or body expressions. In Experiment 1, we tested participants' ability to identify happy, fearful and neutral expressions in the Bite condition and in two control conditions. In Experiment 2, to ensure that such a manipulation selectively affects emotion recognition, we tested participants' ability to recognize emotional expressions, as well as the actors' gender, under the Bite condition and a control condition. Finally, we investigated the relationship between dispositional empathy and emotion recognition under the condition of blocked mimicry. Our findings demonstrated that blocking mimicry on the lower face hindered recognition of happy facial and body expressions, while the recognition of neutral and fearful expressions was not affected by the mimicry manipulation. The mimicry manipulation did not affect the gender discrimination task. Furthermore, the impairment of happy expression recognition correlated with empathic traits. These results support the role of facial mimicry in emotion recognition and suggest that facial mimicry reflects a global sensorimotor simulation of others' emotions rather than a muscle-specific reproduction of an observed motor expression.
Collapse
|
5
|
Pinilla A, Tamayo RM, Neira J. How Do Induced Affective States Bias Emotional Contagion to Faces? A Three-Dimensional Model. Front Psychol 2020; 11:97. [PMID: 32082229 PMCID: PMC7006022 DOI: 10.3389/fpsyg.2020.00097] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Accepted: 01/14/2020] [Indexed: 11/13/2022] Open
Abstract
Affective states can propagate in a group of people and influence their ability to judge others’ affective states. In the present paper, we present a simple mathematical model to describe this process in a three-dimensional affective space. We obtained data from 67 participants randomly assigned to two experimental groups. Participants watched either an upsetting or uplifting video previously calibrated for this goal. Immediately, participants reported their baseline subjective affect in three dimensions: (1) positivity, (2) negativity, and (3) arousal. In a second phase, participants rated the affect they subjectively judged from 10 target angry faces and ten target happy faces in the same three-dimensional scales. These judgments were used as an index of participant’s affective state after observing the faces. Participants’ affective responses were subsequently mapped onto a simple three-dimensional model of emotional contagion, in which the shortest distance between the baseline self-reported affect and the target judgment was calculated. The results display a double dissociation: negatively induced participants show more emotional contagion to angry than happy faces, while positively induced participants show more emotional contagion to happy than angry faces. In sum, emotional contagion exerted by the videos selectively affected judgments of the affective state of others’ faces. We discuss the directionality of emotional contagion to faces, considering whether negative emotions are more easily propagated than positive ones. Additionally, we comment on the lack of significant correlations between our model and standardized tests of empathy and emotional contagion.
Collapse
Affiliation(s)
- Andrés Pinilla
- Quality and Usability Lab, Institute of Software Engineering and Theoretical Computer Science, Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, Germany
| | - Ricardo M Tamayo
- Laboratorio de Cognición Implícita, Departamento de Psicología, Universidad Nacional de Colombia, Bogotá, Colombia
| | - Jorge Neira
- Laboratorio de Cognición Implícita, Departamento de Psicología, Universidad Nacional de Colombia, Bogotá, Colombia
| |
Collapse
|