1
|
Chiang YC, Chien SHL, Lyu JL, Chang CK. Recognition of Dynamic Emotional Expressions in Children and Adults and Its Associations with Empathy. SENSORS (BASEL, SWITZERLAND) 2024; 24:4674. [PMID: 39066071 PMCID: PMC11281223 DOI: 10.3390/s24144674] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Revised: 07/12/2024] [Accepted: 07/17/2024] [Indexed: 07/28/2024]
Abstract
This present study investigates emotion recognition in children and adults and its association with EQ and motor empathy. Overall, 58 children (33 5-6-year-olds, 25 7-9-year-olds) and 61 adults (24 young adults, 37 parents) participated in this study. Each participant received an EQ questionnaire and completed the dynamic emotion expression recognition task, where participants were asked to identify four basic emotions (happy, sad, fearful, and angry) from neutral to fully expressed states, and the motor empathy task, where participants' facial muscle activity was recorded. The results showed that "happy" was the easiest expression for all ages; 5- to 6-year-old children performed equally well as adults. The accuracies for "fearful," "angry," and "sad" expressions were significantly lower in children than in adults. For motor empathy, 7- to 9-year-old children exhibited the highest level of facial muscle activity, while the young adults showed the lowest engagement. Importantly, individual EQ scores positively correlated with the motor empathy index in adults but not in children. In sum, our study echoes the previous literature, showing that the identification of negative emotions is still difficult for children aged 5-9 but that this improves in late childhood. Our results also suggest that stronger facial mimicry responses are positively related to a higher level of empathy in adults.
Collapse
Affiliation(s)
- Yu-Chen Chiang
- School of Medicine, China Medical University, Taichung 404, Taiwan;
| | - Sarina Hui-Lin Chien
- Graduate Institute of Biomedical Sciences, China Medical University, Taichung 404, Taiwan; (J.-L.L.)
- Center for Neuroscience and Brain Disease, China Medical University, Taichung 404, Taiwan
| | - Jia-Ling Lyu
- Graduate Institute of Biomedical Sciences, China Medical University, Taichung 404, Taiwan; (J.-L.L.)
| | - Chien-Kai Chang
- Graduate Institute of Biomedical Sciences, China Medical University, Taichung 404, Taiwan; (J.-L.L.)
| |
Collapse
|
2
|
Namba S, Saito A, Sato W. Computational analysis of value learning and value-driven detection of neutral faces by young and older adults. Front Psychol 2024; 15:1281857. [PMID: 38845772 PMCID: PMC11153859 DOI: 10.3389/fpsyg.2024.1281857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 05/07/2024] [Indexed: 06/09/2024] Open
Abstract
The rapid detection of neutral faces with emotional value plays an important role in social relationships for both young and older adults. Recent psychological studies have indicated that young adults show efficient value learning for neutral faces and the detection of "value-associated faces," while older adults show slightly different patterns of value learning and value-based detection of neutral faces. However, the mechanisms underlying these processes remain unknown. To investigate this, we applied hierarchical reinforcement learning and diffusion models to a value learning task and value-driven detection task that involved neutral faces; the tasks were completed by young and older adults. The results for the learning task suggested that the sensitivity of learning feedback might decrease with age. In the detection task, the younger adults accumulated information more efficiently than the older adults, and the perceptual time leading to motion onset was shorter in the younger adults. In younger adults only, the reward sensitivity during associative learning might enhance the accumulation of information during a visual search for neutral faces in a rewarded task. These results provide insight into the processing linked to efficient detection of faces associated with emotional values, and the age-related changes therein.
Collapse
Affiliation(s)
- Shushi Namba
- Psychological Process Team, Guardian Robot Project, RIKEN, Kyoto, Japan
- Department of Psychology, Hiroshima University, Hiroshima, Japan
| | - Akie Saito
- Psychological Process Team, Guardian Robot Project, RIKEN, Kyoto, Japan
| | - Wataru Sato
- Psychological Process Team, Guardian Robot Project, RIKEN, Kyoto, Japan
| |
Collapse
|
3
|
Roberti E, Turati C, Actis-Grosso R. Single point motion kinematics convey emotional signals in children and adults. PLoS One 2024; 19:e0301896. [PMID: 38598520 PMCID: PMC11006184 DOI: 10.1371/journal.pone.0301896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 03/25/2024] [Indexed: 04/12/2024] Open
Abstract
This study investigates whether humans recognize different emotions conveyed only by the kinematics of a single moving geometrical shape and how this competence unfolds during development, from childhood to adulthood. To this aim, animations in which a shape moved according to happy, fearful, or neutral cartoons were shown, in a forced-choice paradigm, to 7- and 10-year-old children and adults. Accuracy and response times were recorded, and the movement of the mouse while the participants selected a response was tracked. Results showed that 10-year-old children and adults recognize happiness and fear when conveyed solely by different kinematics, with an advantage for fearful stimuli. Fearful stimuli were also accurately identified at 7-year-olds, together with neutral stimuli, while, at this age, the accuracy for happiness was not significantly different than chance. Overall, results demonstrates that emotions can be identified by a single point motion alone during both childhood and adulthood. Moreover, motion contributes in various measures to the comprehension of emotions, with fear recognized earlier in development and more readily even later on, when all emotions are accurately labeled.
Collapse
Affiliation(s)
- Elisa Roberti
- Psychology Department, University of Milano–Bicocca, Milan, Italy
- Neuromi, Milan Center for Neuroscience, Milan, Italy
| | - Chiara Turati
- Psychology Department, University of Milano–Bicocca, Milan, Italy
- Neuromi, Milan Center for Neuroscience, Milan, Italy
| | - Rossana Actis-Grosso
- Psychology Department, University of Milano–Bicocca, Milan, Italy
- Neuromi, Milan Center for Neuroscience, Milan, Italy
| |
Collapse
|
4
|
Richoz AR, Stacchi L, Schaller P, Lao J, Papinutto M, Ticcinelli V, Caldara R. Recognizing facial expressions of emotion amid noise: A dynamic advantage. J Vis 2024; 24:7. [PMID: 38197738 PMCID: PMC10790674 DOI: 10.1167/jov.24.1.7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 11/12/2023] [Indexed: 01/11/2024] Open
Abstract
Humans communicate internal states through complex facial movements shaped by biological and evolutionary constraints. Although real-life social interactions are flooded with dynamic signals, current knowledge on facial expression recognition mainly arises from studies using static face images. This experimental bias might stem from previous studies consistently reporting that young adults minimally benefit from the richer dynamic over static information, whereas children, the elderly, and clinical populations very strongly do (Richoz, Jack, Garrod, Schyns, & Caldara, 2015, Richoz, Jack, Garrod, Schyns, & Caldara, 2018b). These observations point to a near-optimal facial expression decoding system in young adults, almost insensitive to the advantage of dynamic over static cues. Surprisingly, no study has yet tested the idea that such evidence might be rooted in a ceiling effect. To this aim, we asked 70 healthy young adults to perform static and dynamic facial expression recognition of the six basic expressions while parametrically and randomly varying the low-level normalized phase and contrast signal (0%-100%) of the faces. As predicted, when 100% face signals were presented, static and dynamic expressions were recognized with equal efficiency with the exception of those with the most informative dynamics (i.e., happiness and surprise). However, when less signal was available, dynamic expressions were all better recognized than their static counterpart (peaking at ∼20%). Our data show that facial movements increase our ability to efficiently identify emotional states of others under the suboptimal visual conditions that can occur in everyday life. Dynamic signals are more effective and sensitive than static ones for decoding all facial expressions of emotion for all human observers.
Collapse
Affiliation(s)
- Anne-Raphaëlle Richoz
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Lisa Stacchi
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Pauline Schaller
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Junpeng Lao
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Michael Papinutto
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Valentina Ticcinelli
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| |
Collapse
|
5
|
Grainger SA, Henry JD. Absence of age differences in emotion perception and gaze patterns using a contextually rich film-based assessment. Q J Exp Psychol (Hove) 2023; 76:2017-2027. [PMID: 36376992 DOI: 10.1177/17470218221141644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Age differences in emotion perception are now well documented. However, a key limitation of many studies in this literature is the reliance on highly artificial tasks that lack context and consequently have poor ecological validity. This study reports two separate experiments that investigated age differences in emotion perception abilities using a highly contextualised film-based assessment along with a traditional emotion perception task. Experiment 2 additionally included a middle-aged sample and an assessment of eye-gaze patterns to the emotional films. The inclusion of eye-tracking in Experiment 2 was motivated by the fact that older adults consistently show visual biases to static emotion stimuli, yet it remains unclear whether biases also emerge in response to dynamic contextualised emotion stimuli. Experiment 1 identified age effects recognising displays of anger in the traditional emotion perception task but no age differences emerged on the film-based task. This finding was replicated in Experiment 2 with significant group differences on the traditional emotion perception task but no age differences on the film-based task. Experiment 2 also showed that there were no age differences in gaze patterns to these stimuli, showing for the first time that age-related visual biases to emotion stimuli may be task dependent. These findings highlight the fact that task-related features play a key role in the evaluation of age effects in emotion perception.
Collapse
Affiliation(s)
- Sarah A Grainger
- School of Psychology, The University of Queensland, St Lucia, QLD, Australia
| | - Julie D Henry
- School of Psychology, The University of Queensland, St Lucia, QLD, Australia
| |
Collapse
|
6
|
Sobczak A, Bunzeck N. Effects of positive and negative social feedback on motivation, evaluative learning, and socio-emotional processing. NPJ SCIENCE OF LEARNING 2023; 8:28. [PMID: 37587116 PMCID: PMC10432544 DOI: 10.1038/s41539-023-00178-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 07/12/2023] [Indexed: 08/18/2023]
Abstract
Social rewards and punishments are strong motivators. Since experimental work has focused on young adults using simplistic feedback, the effects of more naturalistic stimuli on motivation, evaluative learning, and socio-emotional processing with advanced age remain unclear. Therefore, we compared the effects of static (photos) vs dynamic (videos) social feedback in a social incentive delay (SID) task in young (18-35 years) and older adults (50-84 years) with neutral, positive, and negative feedback, on response times (RTs), and assessed the emotional valence of feedback cues and feedback videos. We found that anticipating positive and negative social feedback accelerated RTs regardless of age and without additional effects of video feedback. Furthermore, the results suggest a valence transfer from positive feedback videos to predictive cues in both groups (i.e., evaluative learning). Finally, older adults reported less pronounced negative affect for negative feedback videos, indicating age differences in socio-emotional processing. As such, our findings foster our understanding of the underlying cognitive and emotional aspects involved in the processing of social rewards and punishments.
Collapse
Affiliation(s)
- Alexandra Sobczak
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany.
| | - Nico Bunzeck
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany.
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany.
| |
Collapse
|
7
|
Troncoso A, Soto V, Gomila A, Martínez-Pernía D. Moving beyond the lab: investigating empathy through the Empirical 5E approach. Front Psychol 2023; 14:1119469. [PMID: 37519389 PMCID: PMC10374225 DOI: 10.3389/fpsyg.2023.1119469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Accepted: 06/05/2023] [Indexed: 08/01/2023] Open
Abstract
Empathy is a complex and multifaceted phenomenon that plays a crucial role in human social interactions. Recent developments in social neuroscience have provided valuable insights into the neural underpinnings and bodily mechanisms underlying empathy. This methodology often prioritizes precision, replicability, internal validity, and confound control. However, fully understanding the complexity of empathy seems unattainable by solely relying on artificial and controlled laboratory settings, while overlooking a comprehensive view of empathy through an ecological experimental approach. In this article, we propose articulating an integrative theoretical and methodological framework based on the 5E approach (the "E"s stand for embodied, embedded, enacted, emotional, and extended perspectives of empathy), highlighting the relevance of studying empathy as an active interaction between embodied agents, embedded in a shared real-world environment. In addition, we illustrate how a novel multimodal approach including mobile brain and body imaging (MoBi) combined with phenomenological methods, and the implementation of interactive paradigms in a natural context, are adequate procedures to study empathy from the 5E approach. In doing so, we present the Empirical 5E approach (E5E) as an integrative scientific framework to bridge brain/body and phenomenological attributes in an interbody interactive setting. Progressing toward an E5E approach can be crucial to understanding empathy in accordance with the complexity of how it is experienced in the real world.
Collapse
Affiliation(s)
- Alejandro Troncoso
- Center for Social and Cognitive Neuroscience, School of Psychology, Adolfo Ibáñez University, Santiago, Chile
| | - Vicente Soto
- Center for Social and Cognitive Neuroscience, School of Psychology, Adolfo Ibáñez University, Santiago, Chile
| | - Antoni Gomila
- Department of Psychology, University of the Balearic Islands, Palma de Mallorca, Spain
| | - David Martínez-Pernía
- Center for Social and Cognitive Neuroscience, School of Psychology, Adolfo Ibáñez University, Santiago, Chile
| |
Collapse
|
8
|
Rodger H, Sokhn N, Lao J, Liu Y, Caldara R. Developmental eye movement strategies for decoding facial expressions of emotion. J Exp Child Psychol 2023; 229:105622. [PMID: 36641829 DOI: 10.1016/j.jecp.2022.105622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Revised: 12/21/2022] [Accepted: 12/23/2022] [Indexed: 01/15/2023]
Abstract
In our daily lives, we routinely look at the faces of others to try to understand how they are feeling. Few studies have examined the perceptual strategies that are used to recognize facial expressions of emotion, and none have attempted to isolate visual information use with eye movements throughout development. Therefore, we recorded the eye movements of children from 5 years of age up to adulthood during recognition of the six "basic emotions" to investigate when perceptual strategies for emotion recognition become mature (i.e., most adult-like). Using iMap4, we identified the eye movement fixation patterns for recognition of the six emotions across age groups in natural viewing and gaze-contingent (i.e., expanding spotlight) conditions. While univariate analyses failed to reveal significant differences in fixation patterns, more sensitive multivariate distance analyses revealed a U-shaped developmental trajectory with the eye movement strategies of the 17- to 18-year-old group most similar to adults for all expressions. A developmental dip in strategy similarity was found for each emotional expression revealing which age group had the most distinct eye movement strategy from the adult group: the 13- to 14-year-olds for sadness recognition; the 11- to 12-year-olds for fear, anger, surprise, and disgust; and the 7- to 8-year-olds for happiness. Recognition performance for happy, angry, and sad expressions did not differ significantly across age groups, but the eye movement strategies for these expressions diverged for each group. Therefore, a unique strategy was not a prerequisite for optimal recognition performance for these expressions. Our data provide novel insights into the developmental trajectories underlying facial expression recognition, a critical ability for adaptive social relations.
Collapse
Affiliation(s)
- Helen Rodger
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, 1700 Fribourg, Switzerland.
| | - Nayla Sokhn
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, 1700 Fribourg, Switzerland
| | - Junpeng Lao
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, 1700 Fribourg, Switzerland
| | - Yingdi Liu
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, 1700 Fribourg, Switzerland
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, 1700 Fribourg, Switzerland.
| |
Collapse
|
9
|
Powell T, Plate RC, Miron CD, Wagner NJ, Waller R. Callous-unemotional Traits and Emotion Recognition Difficulties: Do Stimulus Characteristics Play a role? Child Psychiatry Hum Dev 2023:10.1007/s10578-023-01510-3. [PMID: 36811753 PMCID: PMC11229013 DOI: 10.1007/s10578-023-01510-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/12/2023] [Indexed: 02/24/2023]
Abstract
Emotion recognition difficulties are linked to callous-unemotional (CU) traits, which predict risk for severe antisocial behavior. However, few studies have investigated how stimulus characteristics influence emotion recognition performance, which could give insight into the mechanisms underpinning CU traits. To address this knowledge gap, children aged 7-10 years old (N = 45; 53% female, 47% male; 46.3% Black/African-American, 25.9% White, 16.7% Mixed race or Other, 9.3% Asian) completed an emotion recognition task featuring static facial stimuli from child and adult models and facial and full-body dynamic stimuli from adult models. Parents reported on CU traits of children in the sample. Children showed better emotion recognition for dynamic than static faces. Higher CU traits were associated with worse emotion recognition, particularly for sad and neutral expressions. Stimulus characteristics did not impact associations between CU traits and emotion recognition.
Collapse
Affiliation(s)
- Tralucia Powell
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA, 02215, USA
- Institute of Child Development, University of Minnesota, Minneapolis, MN, USA
| | - Rista C Plate
- Department of Psychology, University of Pennsylvania, Stephen A. Levin Building, 425 South University Avenue, Philadelphia, PA, 19104, USA
| | - Carly D Miron
- Department of Psychology, University of Pennsylvania, Stephen A. Levin Building, 425 South University Avenue, Philadelphia, PA, 19104, USA
- The Graduate Center, City University of New York, New York, NY, USA
| | - Nicholas J Wagner
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA, 02215, USA.
| | - Rebecca Waller
- Department of Psychology, University of Pennsylvania, Stephen A. Levin Building, 425 South University Avenue, Philadelphia, PA, 19104, USA.
| |
Collapse
|
10
|
Ruffman T, Kong Q, Lim HM, Du K, Tiainen E. Recognition of facial emotions across the lifespan: 8-year-olds resemble older adults. BRITISH JOURNAL OF DEVELOPMENTAL PSYCHOLOGY 2023; 41:128-139. [PMID: 36773033 DOI: 10.1111/bjdp.12442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 01/21/2023] [Accepted: 01/27/2023] [Indexed: 02/12/2023]
Abstract
On standard emotion recognition tasks with relatively long or unlimited stimuli durations, recognition improves as children grow older, whereas older adults are worse than young adults. Crucially, it was unknown (a) how older adults compare to age groups below young adulthood and (b) whether children can recognize emotions at shorter durations, with short durations likely common in real life. We compared emotion recognition in 5-year-olds, 8-year-olds, young adults and older adults at very brief durations (50 ms, 250 ms) as well as standard unlimited durations. Eight-year-olds were better than 5-year-olds, young adults than all groups, and there was a striking similarity between 8-year-olds and older adults, providing the first clear indication that older adults' recognition abilities are equivalent to that of an 8-year-old at all durations. Emotion recognition was above chance on all emotions and durations among the three older age groups and on most stimuli for 5-year-olds.
Collapse
Affiliation(s)
- Ted Ruffman
- Department of Psychology, University of Otago, Dunedin, New Zealand
| | - Qiuyi Kong
- Department of Psychology, University of Otago, Dunedin, New Zealand
| | - Hui Mei Lim
- Department of Psychology, University of Otago, Dunedin, New Zealand
| | - Kangning Du
- Department of Psychology, University of Otago, Dunedin, New Zealand
| | - Emilia Tiainen
- Department of Psychology, University of Otago, Dunedin, New Zealand
| |
Collapse
|
11
|
Emotional face recognition when a colored mask is worn: a cross-sectional study. Sci Rep 2023; 13:174. [PMID: 36599964 PMCID: PMC9812539 DOI: 10.1038/s41598-022-27049-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 12/23/2022] [Indexed: 01/05/2023] Open
Abstract
Studies of the impact of face masks on emotional facial expression recognition are sparse in children. Moreover, to our knowledge no study has so far considered mask color (in adults and in children), even though this esthetic property is thought to have an impact on information processing. In order to explore these issues, the present study looked at whether first- and fifth-graders and young adults were influenced by the absence or presence (and color: pink, green, red, black, or white) of a face mask when asked to judge emotional facial expressions of fear, anger, sadness, or neutrality. Analysis of results suggested that the presence of a mask did affect the recognition of sad or fearful faces but did not influence significantly the perception of angry and neutral faces. Mask color slightly modulated the recognition of facial emotional expressions, without a systematic pattern that would allow a clear conclusion to be drawn. Moreover, none of these findings varied according to age group. The contribution of different facial areas to efficient emotion recognition is discussed with reference to methodological and theoretical considerations, and in the light of recent studies.
Collapse
|
12
|
Rabadan V, Ricou C, Latinus M, Aguillon-Hernandez N, Wardak C. Facial mask disturbs ocular exploration but not pupil reactivity. Front Neurosci 2022; 16:1033243. [DOI: 10.3389/fnins.2022.1033243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Accepted: 10/28/2022] [Indexed: 11/22/2022] Open
Abstract
IntroductionThe COVID-19 pandemic has imposed to wear a face mask that may have negative consequences for social interactions despite its health benefits. A lot of recent studies focused on emotion recognition of masked faces, as the mouth is, with the eyes, essential to convey emotional content. However, none have studied neurobehavioral and neurophysiological markers of masked faces perception, such as ocular exploration and pupil reactivity. The purpose of this eye tracking study was to quantify how wearing a facial accessory, and in particular a face mask, affected the ocular and pupillary response to a face, emotional or not.MethodsWe used videos of actors wearing a facial accessory to characterize the visual exploration and pupillary response in several occlusion (no accessory, sunglasses, scarf, and mask) and emotional conditions (neutral, happy, and sad) in a population of 44 adults.ResultsWe showed that ocular exploration differed for face covered with an accessory, and in particular a mask, compared to the classical visual scanning pattern of a non-covered face. The covered areas of the face were less explored. Pupil reactivity seemed only slightly affected by the mask, while its sensitivity to emotions was observed even in the presence of a facial accessory.DiscussionThese results suggest a mixed impact of the mask on attentional capture and physiological adjustment, which does not seem to be reconcilable with its strong effect on behavioral emotional recognition previously described.
Collapse
|
13
|
Grainger SA, Crawford JD, Riches JC, Kochan NA, Chander RJ, Mather KA, Sachdev PS, Henry JD. Aging Is Associated With Multidirectional Changes in Social Cognition: Findings From an Adult Life-Span Sample Ranging From 18 to 101 Years. J Gerontol B Psychol Sci Soc Sci 2022; 78:62-72. [PMID: 35985278 PMCID: PMC9890910 DOI: 10.1093/geronb/gbac110] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Indexed: 02/04/2023] Open
Abstract
OBJECTIVES Normal adult aging is associated with changes in social cognition. Although 4 social cognitive domains have been identified (social perception, theory of mind [ToM], affective empathy, and social behavior), no study has tested all 4 domains concurrently in a life-span sample, limiting understanding of the relative magnitude of age-related changes across domains. This study addresses this gap by providing the first assessment of all 4 social cognitive domains in an adult life-span sample. METHODS Three hundred and seventy-two participants ranging from 18 to 101 years of age took part in this study. Participants completed a testing battery that assessed social perception, ToM, affective empathy, and social behavior, as well as broader cognitive function and well-being. RESULTS The results showed that adult aging is associated with multidirectional changes in social cognitive abilities, with ToM and social perception showing nonlinear decline across much of the life-span, and affective empathy and social behavior showing improvement. Age remained a significant predictor of all 4 social cognitive domains, even after accounting for broader cognitive function. Weak associations emerged between some of the social cognitive abilities and and indices of broader well-being. DISCUSSION These findings provide novel and important evidence that normative aging is associated with both gains and losses in social cognition that occur at distinct points of the adult life-span, and that are at least partially independent of general age-related cognitive decline.
Collapse
Affiliation(s)
- Sarah A Grainger
- Address correspondence to: Sarah A. Grainger, PhD, School of Psychology, The University of Queensland, St Lucia, QLD 4072, Australia. E-mail:
| | - John D Crawford
- Centre for Healthy Brain Ageing (CHeBA), School of Psychiatry, The University of New South Wales, Sydney, Australia
| | | | - Nicole A Kochan
- Centre for Healthy Brain Ageing (CHeBA), School of Psychiatry, The University of New South Wales, Sydney, Australia
| | - Russell J Chander
- Centre for Healthy Brain Ageing (CHeBA), School of Psychiatry, The University of New South Wales, Sydney, Australia
| | - Karen A Mather
- Centre for Healthy Brain Ageing (CHeBA), School of Psychiatry, The University of New South Wales, Sydney, Australia,Neuroscience Research Australia (NeuRA), Sydney, Australia
| | - Perminder S Sachdev
- Centre for Healthy Brain Ageing (CHeBA), School of Psychiatry, The University of New South Wales, Sydney, Australia,Neuropsychiatric Institute, Princes of Wales Hospital, Sydney, Australia
| | - Julie D Henry
- School of Psychology, The University of Queensland, Queensland, Australia
| |
Collapse
|
14
|
Song Q, Smiley PA, Doan SN. The moderating effect of facial emotion recognition in maternal emotion socialization and child socioemotional adjustment. SOCIAL DEVELOPMENT 2022. [DOI: 10.1111/sode.12593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
- Qingfang Song
- Western Kentucky University Bowling Green Kentucky USA
| | | | | |
Collapse
|
15
|
Morphing Task: The Emotion Recognition Process in Children with Attention Deficit Hyperactivity Disorder and Autism Spectrum Disorder. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph182413273. [PMID: 34948881 PMCID: PMC8702190 DOI: 10.3390/ijerph182413273] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Revised: 11/24/2021] [Accepted: 12/06/2021] [Indexed: 12/01/2022]
Abstract
Recognizing a person’s identity is a fundamental social ability; facial expressions, in particular, are extremely important in social cognition. Individuals affected by autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) display impairment in the recognition of emotions and, consequently, in recognizing expressions related to emotions, and even their identity. The aim of our study was to compare the performance of participants with ADHD, ASD, and typical development (TD) with regard to both accuracy and speed in the morphing task and to determine whether the use of pictures of digitized cartoon faces could significantly facilitate the process of emotion recognition in ASD patients (particularly for disgust). This study investigated the emotion recognition process through the use of dynamic pictures (human faces vs. cartoon faces) created with the morphing technique in three pediatric populations (7–12 years old): ADHD patients, ASD patients, and an age-matched control sample (TD). The Chi-square test was used to compare response latency and accuracy between the three groups in order to determine if there were statistically significant differences (p < 0.05) in the recognition of basic emotions. The results demonstrated a faster response time in neurotypical children compared to ASD and ADHD children, with ADHD participants performing better than ASD participants on the same task. The overall accuracy parameter between the ADHD and ASD groups did not significantly differ.
Collapse
|
16
|
Quadrelli E, Roberti E, Polver S, Bulf H, Turati C. Sensorimotor Activity and Network Connectivity to Dynamic and Static Emotional Faces in 7-Month-Old Infants. Brain Sci 2021; 11:brainsci11111396. [PMID: 34827394 PMCID: PMC8615901 DOI: 10.3390/brainsci11111396] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 10/20/2021] [Accepted: 10/22/2021] [Indexed: 11/16/2022] Open
Abstract
The present study investigated whether, as in adults, 7-month-old infants’ sensorimotor brain areas are recruited in response to the observation of emotional facial expressions. Activity of the sensorimotor cortex, as indexed by µ rhythm suppression, was recorded using electroencephalography (EEG) while infants observed neutral, angry, and happy facial expressions either in a static (N = 19) or dynamic (N = 19) condition. Graph theory analysis was used to investigate to which extent neural activity was functionally localized in specific cortical areas. Happy facial expressions elicited greater sensorimotor activation compared to angry faces in the dynamic experimental condition, while no difference was found between the three expressions in the static condition. Results also revealed that happy but not angry nor neutral expressions elicited a significant right-lateralized activation in the dynamic condition. Furthermore, dynamic emotional faces generated more efficient processing as they elicited higher global efficiency and lower networks’ diameter compared to static faces. Overall, current results suggest that, contrarily to neutral and angry faces, happy expressions elicit sensorimotor activity at 7 months and dynamic emotional faces are more efficiently processed by functional brain networks. Finally, current data provide evidence of the existence of a right-lateralized activity for the processing of happy facial expressions.
Collapse
Affiliation(s)
- Ermanno Quadrelli
- Department of Psychology, University of Milano-Bicocca, Edificio U6, Piazza dell’Ateneo Nuovo 1, 20126 Milano, Italy; (E.R.); (S.P.); (H.B.); (C.T.)
- NeuroMI, Milan Center for Neuroscience, 20126 Milano, Italy
- Correspondence: ; Tel.: +39-026-448-3775
| | - Elisa Roberti
- Department of Psychology, University of Milano-Bicocca, Edificio U6, Piazza dell’Ateneo Nuovo 1, 20126 Milano, Italy; (E.R.); (S.P.); (H.B.); (C.T.)
- NeuroMI, Milan Center for Neuroscience, 20126 Milano, Italy
| | - Silvia Polver
- Department of Psychology, University of Milano-Bicocca, Edificio U6, Piazza dell’Ateneo Nuovo 1, 20126 Milano, Italy; (E.R.); (S.P.); (H.B.); (C.T.)
| | - Hermann Bulf
- Department of Psychology, University of Milano-Bicocca, Edificio U6, Piazza dell’Ateneo Nuovo 1, 20126 Milano, Italy; (E.R.); (S.P.); (H.B.); (C.T.)
- NeuroMI, Milan Center for Neuroscience, 20126 Milano, Italy
| | - Chiara Turati
- Department of Psychology, University of Milano-Bicocca, Edificio U6, Piazza dell’Ateneo Nuovo 1, 20126 Milano, Italy; (E.R.); (S.P.); (H.B.); (C.T.)
- NeuroMI, Milan Center for Neuroscience, 20126 Milano, Italy
| |
Collapse
|
17
|
Prunty JE, Keemink JR, Kelly DJ. Infants show pupil dilatory responses to happy and angry facial expressions. Dev Sci 2021; 25:e13182. [PMID: 34633123 DOI: 10.1111/desc.13182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 08/31/2021] [Accepted: 09/22/2021] [Indexed: 11/29/2022]
Abstract
Facial expressions are one way in which infants and adults communicate emotion. Infants scan expressions similarly to adults, yet it remains unclear whether they are receptive to the affective information they convey. The current study investigates 6-, 9- and 12-month infants' (N = 146) pupillary responses to the six "basic" emotional expressions (happy, sad, surprise, fear, anger, and disgust). To do this we use dynamic stimuli and gaze-contingent eye-tracking to simulate brief interactive exchanges, alongside a static control condition. Infants' arousal responses were stronger for dynamic compared to static stimuli. And for dynamic stimuli we found that, compared to neutral, infants showed dilatory responses for happy and angry expressions only. Although previous work has shown infants can discriminate perceptually between facial expressions, our data suggest that sensitivity to the affective content of all six basic emotional expressions may not fully emerge until later in ontogeny.
Collapse
Affiliation(s)
| | | | - David J Kelly
- School of Psychology, University of Kent, Canterbury, UK
| |
Collapse
|
18
|
Abstract
In order to understand ecologically meaningful social behaviors and their neural substrates in humans and other animals, researchers have been using a variety of social stimuli in the laboratory with a goal of extracting specific processes in real-life scenarios. However, certain stimuli may not be sufficiently effective at evoking typical social behaviors and neural responses. Here, we review empirical research employing different types of social stimuli by classifying them into five levels of naturalism. We describe the advantages and limitations while providing selected example studies for each level. We emphasize the important trade-off between experimental control and ecological validity across the five levels of naturalism. Taking advantage of newly emerging tools, such as real-time videos, virtual avatars, and wireless neural sampling techniques, researchers are now more than ever able to adopt social stimuli at a higher level of naturalism to better capture the dynamics and contingency of real-life social interaction.
Collapse
Affiliation(s)
- Siqi Fan
- Department of Psychology, Yale University, New Haven, CT 06520, USA
| | - Olga Dal Monte
- Department of Psychology, Yale University, New Haven, CT 06520, USA
- Department of Psychology, University of Turin, Torino, Italy
| | - Steve W.C. Chang
- Department of Psychology, Yale University, New Haven, CT 06520, USA
- Department of Neuroscience, Yale University School of Medicine, New Haven, CT 06510, USA
- Kavli Institute for Neuroscience, Yale University School of Medicine, New Haven, CT 06510, USA
- Wu Tsai Institute, Yale University, New Haven, CT 06510, USA
| |
Collapse
|
19
|
Prunty JE, Keemink JR, Kelly DJ. Infants scan static and dynamic facial expressions differently. INFANCY 2021; 26:831-856. [PMID: 34288344 DOI: 10.1111/infa.12426] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 07/02/2021] [Accepted: 07/08/2021] [Indexed: 11/30/2022]
Abstract
Despite being inherently dynamic phenomena, much of our understanding of how infants attend and scan facial expressions is based on static face stimuli. Here we investigate how six-, nine-, and twelve-month infants allocate their visual attention toward dynamic-interactive videos of the six basic emotional expressions, and compare their responses with static images of the same stimuli. We find infants show clear differences in how they attend and scan dynamic and static expressions, looking longer toward the dynamic-face and lower-face regions. Infants across all age groups show differential interest in expressions, and show precise scanning of regions "diagnostic" for emotion recognition. These data also indicate that infants' attention toward dynamic expressions develops over the first year of life, including relative increases in interest and scanning precision toward some negative facial expressions (e.g., anger, fear, and disgust).
Collapse
Affiliation(s)
| | | | - David J Kelly
- School of Psychology, University of Kent, Canterbury, UK
| |
Collapse
|
20
|
Emotion induction in young and old persons on watching movie segments: Facial expressions reflect subjective ratings. PLoS One 2021; 16:e0253378. [PMID: 34143827 PMCID: PMC8213152 DOI: 10.1371/journal.pone.0253378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 06/03/2021] [Indexed: 11/22/2022] Open
Abstract
Film clips are established to induce or intensify mood states in young persons. Fewer studies address induction of mood states in old persons. Analysis of facial expression provides an opportunity to substantiate subjective mood states with a psychophysiological variable. We investigated healthy young (YA; n = 29; age 24.4 ± 2.3) and old (OA; n = 28; age 69.2 ± 7.4) participants. Subjects were exposed to film segments validated in young adults to induce four basic emotions (anger, disgust, happiness, sadness). We analyzed subjective mood states with a 7-step Likert scale and facial expressions with an automated system for analysis of facial expressions (FaceReader™ 7.0, Noldus Information Technology b.v.) for both the four target emotions as well as concomitant emotions. Mood expressivity was analysed with the Berkeley Expressivity Questionnaire (BEQ) and the Short Suggestibility Scale (SSS). Subjective mood intensified in all target emotions in the whole group and both YA and OA subgroups. Facial expressions of mood intensified in the whole group for all target emotions except sadness. Induction of happiness was associated with a decrease of sadness in both subjective and objective assessment. Induction of sadness was observed with subjective assessment and accompanied by a decrease of happiness in both subjective and objective assessment. Regression analysis demonstrated pre-exposure facial expressions and personality factors (BEQ, SSS) to be associated with the intensity of facial expression on mood induction. We conclude that mood induction is successful regardless of age. Analysis of facial expressions complement self-assessment of mood and may serve as a means of objectification of mood change. The concordance between self-assessment of mood change and facial expression is modulated by personality factors.
Collapse
|
21
|
Rodger H, Lao J, Stoll C, Richoz AR, Pascalis O, Dye M, Caldara R. The recognition of facial expressions of emotion in deaf and hearing individuals. Heliyon 2021; 7:e07018. [PMID: 34041389 PMCID: PMC8141778 DOI: 10.1016/j.heliyon.2021.e07018] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Revised: 03/25/2021] [Accepted: 05/04/2021] [Indexed: 11/25/2022] Open
Abstract
During real-life interactions, facial expressions of emotion are perceived dynamically with multimodal sensory information. In the absence of auditory sensory channel inputs, it is unclear how facial expressions are recognised and internally represented by deaf individuals. Few studies have investigated facial expression recognition in deaf signers using dynamic stimuli, and none have included all six basic facial expressions of emotion (anger, disgust, fear, happiness, sadness, and surprise) with stimuli fully controlled for their low-level visual properties, leaving the question of whether or not a dynamic advantage for deaf observers exists unresolved. We hypothesised, in line with the enhancement hypothesis, that the absence of auditory sensory information might have forced the visual system to better process visual (unimodal) signals, and predicted that this greater sensitivity to visual stimuli would result in better recognition performance for dynamic compared to static stimuli, and for deaf-signers compared to hearing non-signers in the dynamic condition. To this end, we performed a series of psychophysical studies with deaf signers with early-onset severe-to-profound deafness (dB loss >70) and hearing controls to estimate their ability to recognize the six basic facial expressions of emotion. Using static, dynamic, and shuffled (randomly permuted video frames of an expression) stimuli, we found that deaf observers showed similar categorization profiles and confusions across expressions compared to hearing controls (e.g., confusing surprise with fear). In contrast to our hypothesis, we found no recognition advantage for dynamic compared to static facial expressions for deaf observers. This observation shows that the decoding of dynamic facial expression emotional signals is not superior even in the deaf expert visual system, suggesting the existence of optimal signals in static facial expressions of emotion at the apex. Deaf individuals match hearing individuals in the recognition of facial expressions of emotion.
Collapse
Affiliation(s)
- Helen Rodger
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Junpeng Lao
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Chloé Stoll
- Laboratoire de Psychologie et de Neurocognition (CNRS-UMR5105), Université Grenoble-Alpes, France
| | | | - Olivier Pascalis
- Laboratoire de Psychologie et de Neurocognition (CNRS-UMR5105), Université Grenoble-Alpes, France
| | - Matthew Dye
- National Technical Institute for Deaf/Rochester Institute of Technology, Rochester, New York, USA
| | - Roberto Caldara
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| |
Collapse
|
22
|
Turgeon J, Bérubé A, Blais C, Lemieux A, Fournier A. Recognition of children's emotional facial expressions among mothers reporting a history of childhood maltreatment. PLoS One 2020; 15:e0243083. [PMID: 33373377 PMCID: PMC7771866 DOI: 10.1371/journal.pone.0243083] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Accepted: 11/14/2020] [Indexed: 11/18/2022] Open
Abstract
Several studies have shown that child maltreatment is associated with both positive and negative effects on the recognition of facial emotions. Research has provided little evidence of a relation between maltreatment during childhood and young adults' ability to recognize facial displays of emotion in children, an essential skill for a sensitive parental response. In this study, we examined the consequences of different forms of maltreatment experienced in childhood on emotion recognition during parenthood. Participants included sixty-three mothers of children aged 2 to 5 years. Retrospective self-reports of childhood maltreatment were assessed using the short form of the Childhood Trauma Questionnaire (CTQ). Emotion recognition was measured using a morphed facial emotion identification task of all six basic emotions (anger, disgust, fear, happiness, sadness, and surprise). A Path Analysis via Structural Equation Model revealed that a history of physical abuse is related to a decreased ability to recognize both fear and sadness in children, whereas emotional abuse and sexual abuse are related to a decreased ability to recognize anger in children. In addition, emotional neglect is associated with an increased ability to recognize anger, whereas physical neglect is associated with less accuracy in recognizing happiness in children's facial emotional expressions. These findings have important clinical implications and expand current understanding of the consequences of childhood maltreatment on parents' ability to detect children's needs.
Collapse
Affiliation(s)
- Jessica Turgeon
- Department of Psychology, University of Québec at Trois-Rivières, Trois-Rivières, Québec, Canada
- * E-mail:
| | - Annie Bérubé
- Department of Psychoeducation and Psychology, University of Québec in Outaouais, Gatineau, Québec, Canada
| | - Caroline Blais
- Department of Psychoeducation and Psychology, University of Québec in Outaouais, Gatineau, Québec, Canada
| | - Annie Lemieux
- Department of Psychoeducation and Psychology, University of Québec in Outaouais, Gatineau, Québec, Canada
| | - Amélie Fournier
- Department of Psychology, University of Québec at Trois-Rivières, Trois-Rivières, Québec, Canada
| |
Collapse
|
23
|
Pavic K, Oker A, Chetouani M, Chaby L. Age-related changes in gaze behaviour during social interaction: An eye-tracking study with an embodied conversational agent. Q J Exp Psychol (Hove) 2020; 74:1128-1139. [PMID: 33283649 DOI: 10.1177/1747021820982165] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Previous research has highlighted age-related differences in social perception, in particular emotional expression processing. To date, such studies have largely focused on approaches that use static emotional stimuli that the participant has to identify passively without the possibility of any interaction. In this study, we propose an interactive virtual environment to better address age-related variations in social and emotional perception. A group of 22 young (18-30 years) and 20 older (60-80 years) adults were engaged in a face-to-face conversation with an embodied conversational agent. Participants were invited to interact naturally with the agent and to identify his facial expression. Their gaze behaviour was captured by an eye-tracking device throughout the interaction. We also explored whether the Big Five personality traits (particularly extraversion) and anxiety modulated gaze during the social interaction. Findings suggested that age-related differences in gaze behaviour were only apparent when decoding social signals (i.e., listening to a partner's question, identifying facial expressions) and not when communicating social information (i.e., when speaking). Furthermore, higher extraversion levels consistently led to a shorter amount of time gazing towards the eyes, whereas higher anxiety levels led to slight modulations of gaze only when participants were listening to questions. Face-to-face conversation with virtual agents can provide a more naturalistic framework for the assessment of online socio-emotional interaction in older adults, which is not easily observable in classical offline paradigms. This study provides novel and important insights into the specific circumstances in which older adults may experience difficulties in social interactions.
Collapse
Affiliation(s)
- Katarina Pavic
- Institut de psychologie, Université de Paris, Boulogne-Billancourt, France.,Université de Paris, VAC, Boulogne-Billancourt, France
| | - Ali Oker
- Laboratoire Cognition Santé Société (EA 6291), Université de Reims Champagne-Ardenne, Reims, France
| | - Mohamed Chetouani
- Institut des systèmes intelligents et de robotique (ISIR), Sorbonne Université, CNRS UMR7222, Paris, France
| | - Laurence Chaby
- Institut de psychologie, Université de Paris, Boulogne-Billancourt, France.,Institut des systèmes intelligents et de robotique (ISIR), Sorbonne Université, CNRS UMR7222, Paris, France
| |
Collapse
|
24
|
Barker MS, Bidstrup EM, Robinson GA, Nelson NL. "Grumpy" or "furious"? arousal of emotion labels influences judgments of facial expressions. PLoS One 2020; 15:e0235390. [PMID: 32609780 PMCID: PMC7329125 DOI: 10.1371/journal.pone.0235390] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Accepted: 06/15/2020] [Indexed: 12/21/2022] Open
Abstract
Whether language information influences recognition of emotion from facial expressions remains the subject of debate. The current studies investigate how variations in emotion labels that are paired with expressions influences participants' judgments of the emotion displayed. Static (Study 1) and dynamic (Study 2) facial expressions depicting eight emotion categories were paired with emotion labels that systematically varied in arousal (low and high). Participants rated the arousal, valence, and dominance of expressions paired with labels. Isolated faces and isolated labels were also rated. As predicted, the label presented influenced participants' judgments of the expressions. Across both studies, higher arousal labels were associated with: 1) higher ratings of arousal for sad, angry, and scared expressions, and 2) higher ratings of dominance for angry, proud, and disgust expressions. These results indicate that emotion labels influence judgments of facial expressions.
Collapse
Affiliation(s)
- Megan S. Barker
- School of Psychology, The University of Queensland, St Lucia, Brisbane, QLD, Australia
- Department of Neurology, Taub Institute for Research on Alzheimer’s Disease and the Aging Brain, Gertrude H. Sergievsky Center, Columbia University Medical Center, New York, NY, United States of America
| | - Emma M. Bidstrup
- School of Psychology, The University of Queensland, St Lucia, Brisbane, QLD, Australia
| | - Gail A. Robinson
- School of Psychology, The University of Queensland, St Lucia, Brisbane, QLD, Australia
- Queensland Brain Institute, The University of Queensland, St Lucia, Brisbane, QLD, Australia
| | - Nicole L. Nelson
- School of Psychology, The University of Queensland, St Lucia, Brisbane, QLD, Australia
| |
Collapse
|
25
|
Barabanschikov V, Korolkova O. Perception of “Live” Facial Expressions. EXPERIMENTAL PSYCHOLOGY (RUSSIA) 2020. [DOI: 10.17759/exppsy.2020130305] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The article provides a review of experimental studies of interpersonal perception on the material of static and dynamic facial expressions as a unique source of information about the person’s inner world. The focus is on the patterns of perception of a moving face, included in the processes of communication and joint activities (an alternative to the most commonly studied perception of static images of a person outside of a behavioral context). The review includes four interrelated topics: face statics and dynamics in the recognition of emotional expressions; specificity of perception of moving face expressions; multimodal integration of emotional cues; generation and perception of facial expressions in communication processes. The analysis identifies the most promising areas of research of face in motion. We show that the static and dynamic modes of facial perception complement each other, and describe the role of qualitative features of the facial expression dynamics in assessing the emotional state of a person. Facial expression is considered as part of a holistic multimodal manifestation of emotions. The importance of facial movements as an instrument of social interaction is emphasized.
Collapse
|
26
|
Stoll C, Rodger H, Lao J, Richoz AR, Pascalis O, Dye M, Caldara R. Quantifying Facial Expression Intensity and Signal Use in Deaf Signers. JOURNAL OF DEAF STUDIES AND DEAF EDUCATION 2019; 24:346-355. [PMID: 31271428 DOI: 10.1093/deafed/enz023] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Revised: 04/30/2019] [Accepted: 05/03/2019] [Indexed: 06/09/2023]
Abstract
We live in a world of rich dynamic multisensory signals. Hearing individuals rapidly and effectively integrate multimodal signals to decode biologically relevant facial expressions of emotion. Yet, it remains unclear how facial expressions are decoded by deaf adults in the absence of an auditory sensory channel. We thus compared early and profoundly deaf signers (n = 46) with hearing nonsigners (n = 48) on a psychophysical task designed to quantify their recognition performance for the six basic facial expressions of emotion. Using neutral-to-expression image morphs and noise-to-full signal images, we quantified the intensity and signal levels required by observers to achieve expression recognition. Using Bayesian modeling, we found that deaf observers require more signal and intensity to recognize disgust, while reaching comparable performance for the remaining expressions. Our results provide a robust benchmark for the intensity and signal use in deafness and novel insights into the differential coding of facial expressions of emotion between hearing and deaf individuals.
Collapse
Affiliation(s)
- Chloé Stoll
- Laboratoire de Psychologie et de Neurocognition (CNRS-UMR5105), Université Grenoble-Alpes
- Laboratory for Investigative Neurophysiology, Centre Hospitalier Universitaire Vaudois and University of Lausanne
| | - Helen Rodger
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg
| | - Junpeng Lao
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg
| | - Anne-Raphaëlle Richoz
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg
| | - Olivier Pascalis
- Laboratoire de Psychologie et de Neurocognition (CNRS-UMR5105), Université Grenoble-Alpes
| | - Matthew Dye
- National Technical Institute for Deaf/Rochester Institute of Technology
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg
| |
Collapse
|
27
|
Plouffe-Demers MP, Fiset D, Saumure C, Duncan J, Blais C. Strategy Shift Toward Lower Spatial Frequencies in the Recognition of Dynamic Facial Expressions of Basic Emotions: When It Moves It Is Different. Front Psychol 2019; 10:1563. [PMID: 31379648 PMCID: PMC6650765 DOI: 10.3389/fpsyg.2019.01563] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Accepted: 06/20/2019] [Indexed: 11/15/2022] Open
Abstract
Facial expressions of emotion play a key role in social interactions. While in everyday life, their dynamic and transient nature calls for a fast processing of the visual information they contain, a majority of studies investigating the visual processes underlying their recognition have focused on their static display. The present study aimed to gain a better understanding of these processes while using more ecological dynamic facial expressions. In two experiments, we directly compared the spatial frequency (SF) tuning during the recognition of static and dynamic facial expressions. Experiment 1 revealed a shift toward lower SFs for dynamic expressions in comparison to static ones. Experiment 2 was designed to verify if changes in SF tuning curves were specific to the presence of emotional information in motion by comparing the SF tuning profiles for static, dynamic, and shuffled dynamic expressions. Results showed a similar shift toward lower SFs for shuffled expressions, suggesting that the difference found between dynamic and static expressions might not be linked to informative motion per se but to the presence of motion regardless its nature.
Collapse
Affiliation(s)
- Marie-Pier Plouffe-Demers
- Département de Psychologie, Universtité du Québec en Outaouais, Gatineau, QC, Canada
- Département de Psychologie, Université du Québec à Montréal, Montreal, QC, Canada
| | - Daniel Fiset
- Département de Psychologie, Universtité du Québec en Outaouais, Gatineau, QC, Canada
| | - Camille Saumure
- Département de Psychologie, Universtité du Québec en Outaouais, Gatineau, QC, Canada
| | - Justin Duncan
- Département de Psychologie, Universtité du Québec en Outaouais, Gatineau, QC, Canada
- Département de Psychologie, Université du Québec à Montréal, Montreal, QC, Canada
| | - Caroline Blais
- Département de Psychologie, Universtité du Québec en Outaouais, Gatineau, QC, Canada
| |
Collapse
|
28
|
Quadrelli E, Conte S, Macchi Cassia V, Turati C. Emotion in motion: Facial dynamics affect infants' neural processing of emotions. Dev Psychobiol 2019; 61:843-858. [DOI: 10.1002/dev.21860] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Revised: 02/27/2019] [Accepted: 03/17/2019] [Indexed: 01/14/2023]
Affiliation(s)
- Ermanno Quadrelli
- Department of Psychology University of Milano‐Bicocca Milano Italy
- NeuroMI, Milan Center for Neuroscience Milan Italy
| | - Stefania Conte
- Department of Psychology University of Milano‐Bicocca Milano Italy
- NeuroMI, Milan Center for Neuroscience Milan Italy
| | - Viola Macchi Cassia
- Department of Psychology University of Milano‐Bicocca Milano Italy
- NeuroMI, Milan Center for Neuroscience Milan Italy
| | - Chiara Turati
- Department of Psychology University of Milano‐Bicocca Milano Italy
- NeuroMI, Milan Center for Neuroscience Milan Italy
| |
Collapse
|