1
|
Tessier MH, Mazet JP, Gagner E, Marcoux A, Jackson PL. Facial representations of complex affective states combining pain and a negative emotion. Sci Rep 2024; 14:11686. [PMID: 38777852 PMCID: PMC11111784 DOI: 10.1038/s41598-024-62423-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 05/16/2024] [Indexed: 05/25/2024] Open
Abstract
Pain is rarely communicated alone, as it is often accompanied by emotions such as anger or sadness. Communicating these affective states involves shared representations. However, how an individual conceptually represents these combined states must first be tested. The objective of this study was to measure the interaction between pain and negative emotions on two types of facial representations of these states, namely visual (i.e., interactive virtual agents; VAs) and sensorimotor (i.e., one's production of facial configurations). Twenty-eight participants (15 women) read short written scenarios involving only pain or a combined experience of pain and a negative emotion (anger, disgust, fear, or sadness). They produced facial configurations representing these experiences on the faces of the VAs and on their face (own production or imitation of VAs). The results suggest that affective states related to a direct threat to the body (i.e., anger, disgust, and pain) share a similar facial representation, while those that present no immediate danger (i.e., fear and sadness) differ. Although visual and sensorimotor representations of these states provide congruent affective information, they are differently influenced by factors associated with the communication cycle. These findings contribute to our understanding of pain communication in different affective contexts.
Collapse
Affiliation(s)
- Marie-Hélène Tessier
- School of Psychology, Université Laval, Québec City, Canada
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (Cirris), Québec City, Canada
- CERVO Brain Research Centre, Québec City, Canada
| | - Jean-Philippe Mazet
- Department of Computer Science and Software Engineering, Université Laval, Québec City, Canada
| | - Elliot Gagner
- School of Psychology, Université Laval, Québec City, Canada
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (Cirris), Québec City, Canada
- CERVO Brain Research Centre, Québec City, Canada
| | - Audrey Marcoux
- School of Psychology, Université Laval, Québec City, Canada
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (Cirris), Québec City, Canada
- CERVO Brain Research Centre, Québec City, Canada
| | - Philip L Jackson
- School of Psychology, Université Laval, Québec City, Canada.
- Centre for Interdisciplinary Research in Rehabilitation and Social Integration (Cirris), Québec City, Canada.
- CERVO Brain Research Centre, Québec City, Canada.
| |
Collapse
|
2
|
Koenig-Robert R, Quek GL, Grootswagers T, Varlet M. Movement trajectories as a window into the dynamics of emerging neural representations. Sci Rep 2024; 14:11499. [PMID: 38769313 PMCID: PMC11106280 DOI: 10.1038/s41598-024-62135-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 05/14/2024] [Indexed: 05/22/2024] Open
Abstract
The rapid transformation of sensory inputs into meaningful neural representations is critical to adaptive human behaviour. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive. Here we show that movement trajectories can be used to measure emerging neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging data via representational similarity analysis (RSA), we show that movement trajectories track the unfolding of stimulus- and category-wise neural representations along key dimensions of the human visual system. We demonstrate that time-resolved representational structures derived from movement trajectories overlap with those derived from M/EEG (albeit delayed) and those derived from fMRI in functionally-relevant brain areas. Our findings highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.
Collapse
Affiliation(s)
- Roger Koenig-Robert
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
| | - Genevieve L Quek
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
| | - Tijl Grootswagers
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, NSW, 2751, Australia
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia.
- School of Psychology, Western Sydney University, Sydney, NSW, 2751, Australia.
| |
Collapse
|
3
|
Nanni-Zepeda M, DeGutis J, Wu C, Rothlein D, Fan Y, Grimm S, Walter M, Esterman M, Zuberer A. Neural signatures of shared subjective affective engagement and disengagement during movie viewing. Hum Brain Mapp 2024; 45:e26622. [PMID: 38488450 DOI: 10.1002/hbm.26622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 01/10/2024] [Accepted: 01/26/2024] [Indexed: 03/19/2024] Open
Abstract
When watching a negative emotional movie, we differ from person to person in the ease with which we engage and the difficulty with which we disengage throughout a temporally evolving narrative. We investigated neural responses of emotional processing, by considering inter-individual synchronization in subjective emotional engagement and disengagement. The neural underpinnings of these shared responses are ideally studied in naturalistic scenarios like movie viewing, wherein individuals emotionally engage and disengage at their own time and pace throughout the course of a narrative. Despite the rich data that naturalistic designs can bring to the study, there is a challenge in determining time-resolved behavioral markers of subjective engagement and disengagement and their underlying neural responses. We used a within-subject cross-over design instructing 22 subjects to watch clips of either neutral or sad content while undergoing functional magnetic resonance imaging (fMRI). Participants watched the same movies a second time while continuously annotating the perceived emotional intensity, thus enabling the mapping of brain activity and emotional experience. Our analyses revealed that between-participant similarity in waxing (engagement) and waning (disengagement) of emotional intensity was directly related to the between-participant similarity in spatiotemporal patterns of brain activation during the movie(s). Similar patterns of engagement reflected common activation in the bilateral ventromedial prefrontal cortex, regions often involved in self-referenced evaluation and generation of negative emotions. Similar patterns of disengagement reflected common activation in central executive and default mode network regions often involved in top-down emotion regulation. Together this work helps to better understand cognitive and neural mechanisms underpinning engagement and disengagement from emotionally evocative narratives.
Collapse
Affiliation(s)
- Melanni Nanni-Zepeda
- Department of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
| | - Joseph DeGutis
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, Massachusetts, USA
- Department of Psychiatry, Harvard Medical School, Boston, Massachusetts, USA
| | - Charley Wu
- Human and Machine Cognition Lab, University of Tübingen, Tübingen, Germany
| | - David Rothlein
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, Massachusetts, USA
- Department of Psychiatry, Boston University School of Medicine, Boston, Massachusetts, USA
| | - Yan Fan
- Department Psychology and Neurosciences, Leibniz Research Centre for Working Environment and Human Factors at the TU Dortmund (IfADo), Dortmund, Germany
| | - Simone Grimm
- Berlin Institute of Health, Campus Benjamin Franklin, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
- Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zurich, Zurich, Switzerland
- Department of Psychology, MSB Medical School Berlin, Berlin, Germany
| | - Martin Walter
- Department of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
- Clinical Affective Neuroimaging Laboratory, Otto-von-Guericke-University, Magdeburg, Germany
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Magdeburg, Germany
| | - Michael Esterman
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, Massachusetts, USA
- Department of Psychiatry, Boston University School of Medicine, Boston, Massachusetts, USA
- National Center for PTSD, VA Boston Healthcare System, Boston, Massachusetts, USA
| | - Agnieszka Zuberer
- Department of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, Massachusetts, USA
| |
Collapse
|
4
|
Leshin J, Carter MJ, Doyle CM, Lindquist KA. Language access differentially alters functional connectivity during emotion perception across cultures. Front Psychol 2024; 14:1084059. [PMID: 38425348 PMCID: PMC10901990 DOI: 10.3389/fpsyg.2023.1084059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 12/15/2023] [Indexed: 03/02/2024] Open
Abstract
Introduction It is often assumed that the ability to recognize the emotions of others is reflexive and automatic, driven only by observable facial muscle configurations. However, research suggests that accumulated emotion concept knowledge shapes the way people perceive the emotional meaning of others' facial muscle movements. Cultural upbringing can shape an individual's concept knowledge, such as expectations about which facial muscle configurations convey anger, disgust, or sadness. Additionally, growing evidence suggests that access to emotion category words, such as "anger," facilitates access to such emotion concept knowledge and in turn facilitates emotion perception. Methods To investigate the impact of cultural influence and emotion concept accessibility on emotion perception, participants from two cultural groups (Chinese and White Americans) completed a functional magnetic resonance imaging scanning session to assess functional connectivity between brain regions during emotion perception. Across four blocks, participants were primed with either English emotion category words ("anger," "disgust") or control text (XXXXXX) before viewing images of White American actors posing facial muscle configurations that are stereotypical of anger and disgust in the United States. Results We found that when primed with "disgust" versus control text prior to seeing disgusted facial expressions, Chinese participants showed a significant decrease in functional connectivity between a region associated with semantic retrieval (the inferior frontal gyrus) and regions associated with semantic processing, visual perception, and social cognition. Priming the word "anger" did not impact functional connectivity for Chinese participants relative to control text, and priming neither "disgust" nor "anger" impacted functional connectivity for White American participants. Discussion These findings provide preliminary evidence that emotion concept accessibility differentially impacts perception based on participants' cultural background.
Collapse
Affiliation(s)
- Joseph Leshin
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Maleah J. Carter
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Cameron M. Doyle
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Kristen A. Lindquist
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
- Biomedical Research Imaging Center, School of Medicine, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| |
Collapse
|
5
|
Feldman MJ, MacCormack JK, Bonar AS, Lindquist KA. Interoceptive ability moderates the effect of physiological reactivity on social judgment. Emotion 2023; 23:2231-2242. [PMID: 36951718 PMCID: PMC10517073 DOI: 10.1037/emo0001210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2023]
Abstract
Social judgments-that others are kind or cruel, well intentioned, or conniving-can ease or disrupt social interactions. And yet a person's internal state can alter these judgments-a phenomenon known as affective realism. We examined the factors that contribute to, and mitigate, affective realism during a stressful interview. Using data collected between 2015 and 2019, we hypothesized and found that individuals' ability (N = 161; 57.6% female; 57.6% European American, 13.6% African American, 13.6% Asian American, 6.4% Latinx, 6.0% biracial, and 2.8% that identified with none or 1 + of the races presented; Mage = 19.20 years) to accurately perceive their own internal sensations (i.e., heartbeats) influenced whether they attributed their own heightened stress reactions (i.e., sympathetic nervous system reactivity) to the behavior of two impassive interviewers. Participants who were poor heartbeat detectors perceived their interviewers as less helpful, polite, or professional, and more apathetic, judgmental, and aggressive when experiencing heightened levels of cardiovascular sympathetic nervous system reactivity during their interview. Being aware of one's internal state may be one pathway to reducing bias in social perceptions in circumstances where such biases may lead us astray. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
- Mallory J Feldman
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill
| | | | - Adrienne S Bonar
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill
| | - Kristen A Lindquist
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill
| |
Collapse
|
6
|
Dai J, Jorgensen NA, Duell N, Capella J, Maza MT, Kwon SJ, Prinstein MJ, Lindquist KA, Telzer EH. Neural tracking of social hierarchies in adolescents' real-world social networks. Soc Cogn Affect Neurosci 2023; 18:nsad064. [PMID: 37978845 PMCID: PMC10656574 DOI: 10.1093/scan/nsad064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 08/01/2023] [Accepted: 11/06/2023] [Indexed: 11/19/2023] Open
Abstract
In the current study, we combined sociometric nominations and neuroimaging techniques to examine adolescents' neural tracking of peers from their real-world social network that varied in social preferences and popularity. Adolescent participants from an entire school district (N = 873) completed peer sociometric nominations of their grade at school, and a subset of participants (N = 117, Mage = 13.59 years) completed a neuroimaging task in which they viewed peer faces from their social networks. We revealed two neural processes by which adolescents track social preference: (1) the fusiform face area, an important region for early visual perception and social categorization, simultaneously represented both peers high in social preference and low in social preference; (2) the dorsolateral prefrontal cortex (DLPFC), which was differentially engaged in tracking peers high and low in social preference. No regions specifically tracked peers high in popularity and only the inferior parietal lobe, temporoparietal junction, midcingulate cortex and insula were involved in tracking unpopular peers. This is the first study to examine the neural circuits that support adolescents' perception of peer-based social networks. These findings identify the neural processes that allow youths to spontaneously keep track of peers' social value within their social network.
Collapse
Affiliation(s)
- Junqiang Dai
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Nathan A Jorgensen
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Natasha Duell
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Jimmy Capella
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Maria T Maza
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Seh-Joo Kwon
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Mitchell J Prinstein
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Kristen A Lindquist
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| | - Eva H Telzer
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, 235 E. Cameron Avenue, Chapel Hill, NC 27599-3270, USA
| |
Collapse
|
7
|
Tsikandilakis M, Bali P. Learning emotional dialects: A British population study of cross-cultural communication. Perception 2023; 52:812-843. [PMID: 37796849 PMCID: PMC10634218 DOI: 10.1177/03010066231204180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 09/12/2023] [Indexed: 10/07/2023]
Abstract
The aim of the current research was to explore whether we can improve the recognition of cross-cultural freely-expressed emotional faces in British participants. We tested several methods for improving the recognition of freely-expressed emotional faces, such as different methods for presenting other-culture expressions of emotion from individuals from Chile, New Zealand and Singapore in two experimental stages. In the first experimental stage, in phase one, participants were asked to identify the emotion of cross-cultural freely-expressed faces. In the second phase, different cohorts were presented with interactive side-by-side, back-to-back and dynamic morphing of cross-cultural freely-expressed emotional faces, and control conditions. In the final phase, we repeated phase one using novel stimuli. We found that all non-control conditions led to recognition improvements. Morphing was the most effective condition for improving the recognition of cross-cultural emotional faces. In the second experimental stage, we presented morphing to different cohorts including own-to-other and other-to-own freely-expressed cross-cultural emotional faces and neutral-to-emotional and emotional-to-neutral other-culture freely-expressed emotional faces. All conditions led to recognition improvements and the presentation of freely-expressed own-to-other cultural-emotional faces provided the most effective learning. These findings suggest that training can improve the recognition of cross-cultural freely-expressed emotional expressions.
Collapse
|
8
|
Lee Y, Seo Y, Lee Y, Lee D. Dimensional emotions are represented by distinct topographical brain networks. Int J Clin Health Psychol 2023; 23:100408. [PMID: 37663040 PMCID: PMC10472247 DOI: 10.1016/j.ijchp.2023.100408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 08/21/2023] [Indexed: 09/05/2023] Open
Abstract
The ability to recognize others' facial emotions has become increasingly important after the COVID-19 pandemic, which causes stressful situations in emotion regulation. Considering the importance of emotion in maintaining a social life, emotion knowledge to perceive and label emotions of oneself and others requires an understanding of affective dimensions, such as emotional valence and emotional arousal. However, limited information is available about whether the behavioral representation of affective dimensions is similar to their neural representation. To explore the relationship between the brain and behavior in the representational geometries of affective dimensions, we constructed a behavioral paradigm in which emotional faces were categorized into geometric spaces along the valence, arousal, and valence and arousal dimensions. Moreover, we compared such representations to neural representations of the faces acquired by functional magnetic resonance imaging. We found that affective dimensions were similarly represented in the behavior and brain. Specifically, behavioral and neural representations of valence were less similar to those of arousal. We also found that valence was represented in the dorsolateral prefrontal cortex, frontal eye fields, precuneus, and early visual cortex, whereas arousal was represented in the cingulate gyrus, middle frontal gyrus, orbitofrontal cortex, fusiform gyrus, and early visual cortex. In conclusion, the current study suggests that dimensional emotions are similarly represented in the behavior and brain and are presented with differential topographical organizations in the brain.
Collapse
Affiliation(s)
| | | | - Youngju Lee
- Cognitive Science Research Group, Korea Brain Research Institute, 61 Cheomdan-ro, Dong-gu, Daegu 41062, Republic of Korea
| | - Dongha Lee
- Cognitive Science Research Group, Korea Brain Research Institute, 61 Cheomdan-ro, Dong-gu, Daegu 41062, Republic of Korea
| |
Collapse
|
9
|
Hoemann K. Beyond Linguistic Relativity, Emotion Concepts Illustrate How Meaning is Contextually and Individually Variable. Top Cogn Sci 2023; 15:668-675. [PMID: 37145872 DOI: 10.1111/tops.12659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 04/18/2023] [Accepted: 04/18/2023] [Indexed: 05/06/2023]
Abstract
Kemmerer describes grounded accounts of cognition and, using crosslinguistic diversity across conceptual domains, argues that these accounts entail linguistic relativity. In this comment, I extend Kemmerer's position to the domain of emotion. Emotion concepts exemplify characteristics highlighted by grounded accounts of cognition and differ by culture and language. Recent research further demonstrates considerable situation- and person-specific differences. Based on this evidence, I argue that emotion concepts carry unique implications for variation in meaning and experience, entailing a relativity that is contextual and individual in addition to linguistic. I conclude by considering what such pervasive relativity means for interpersonal understanding.
Collapse
|
10
|
Abstract
OBJECTIVE Disorders of social cognition, such as difficulties with emotion perception, alexithymia, Theory of Mind (ToM), empathy and disorders of emotion regulation, are prevalent and pervasive problems across many neurological, neurodevelopmental and neuropsychiatric conditions. Clinicians are familiar with how these difficulties present but assessment and treatment has lagged behind other traditional cognitive domains, such as memory, language and executive functioning. METHOD In this paper, we review the prevalence and degree of impairment associated with disorders of social cognition and emotion regulation across a range of clinical conditions, with particular emphasis on their relationship to cognitive deficits and also real-world functioning. We reported effects sizes from published meta-analyses for a range of clinical disorders and also review test usage and available tests. RESULTS In general, many clinical conditions are associated with impairments in social cognition and emotion regulation. Effect sizes range from small to very large and are comparable to effect sizes for impairments in nonsocial cognition. Socio-emotional impairments are also associated with social and adaptive functioning. In reviewing prior research, it is apparent that the standardized assessment of social cognition, in particular, is not routine in clinical practice. This is despite the fact that there are a range of tools available and accruing evidence for the efficacy of interventions for social cognitive impairments. CONCLUSION We are using this information to urge and call for clinicians to factor social cognition into their clinical assessments and treatment planning, as to provide rigorous, holistic and comprehensive person-centred care.
Collapse
Affiliation(s)
- Skye McDonald
- School of Psychology, University of New South Wales, Sydney, Australia
| | - Travis Wearne
- School of Psychology, University of Western Sydney, Penrith South, Australia
| | - Michelle Kelly
- School of Psychological Sciences, University of Newcastle, Callaghan, Australia
| |
Collapse
|
11
|
Snoek L, Jack RE, Schyns PG, Garrod OG, Mittenbühler M, Chen C, Oosterwijk S, Scholte HS. Testing, explaining, and exploring models of facial expressions of emotions. SCIENCE ADVANCES 2023; 9:eabq8421. [PMID: 36763663 PMCID: PMC9916981 DOI: 10.1126/sciadv.abq8421] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Accepted: 01/09/2023] [Indexed: 06/18/2023]
Abstract
Models are the hallmark of mature scientific inquiry. In psychology, this maturity has been reached in a pervasive question-what models best represent facial expressions of emotion? Several hypotheses propose different combinations of facial movements [action units (AUs)] as best representing the six basic emotions and four conversational signals across cultures. We developed a new framework to formalize such hypotheses as predictive models, compare their ability to predict human emotion categorizations in Western and East Asian cultures, explain the causal role of individual AUs, and explore updated, culture-accented models that improve performance by reducing a prevalent Western bias. Our predictive models also provide a noise ceiling to inform the explanatory power and limitations of different factors (e.g., AUs and individual differences). Thus, our framework provides a new approach to test models of social signals, explain their predictive power, and explore their optimization, with direct implications for theory development.
Collapse
Affiliation(s)
- Lukas Snoek
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Rachael E. Jack
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Philippe G. Schyns
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | | | - Maximilian Mittenbühler
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
- Department of Computer Science, University of Tübingen, Tübingen, Germany
| | - Chaona Chen
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Suzanne Oosterwijk
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
| | - H. Steven Scholte
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
12
|
Association between fractional amplitude of low-frequency fluctuation (fALFF) and facial emotion recognition ability in first-episode schizophrenia patients: a fMRI study. Sci Rep 2022; 12:19561. [PMID: 36380188 PMCID: PMC9666540 DOI: 10.1038/s41598-022-24258-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 11/14/2022] [Indexed: 11/16/2022] Open
Abstract
It was still unclear that the correlation between the resting-state intrinsic activity in brain regions and facial emotion recognition (FER) ability in patients with first-episode schizophrenia (FSZ). Our aim was to analyse the correlation between the fractional amplitude of low-frequency fluctuation (fALFF) and FER ability in FSZ patients. A total of 28 patients with FSZ and 33 healthy controls (HCs) completed visual search tasks for FER ability. Regions of interest (ROIs) related to facial emotion were obtained from a previous meta-analysis. Pearson correlation analysis was performed to understand the correlation between fALFF and FER ability. Our results indicated that the patients performed worse than the HCs in the accuracy performances of happy FER and fearful FER. The previous meta-analysis results showed that the brain regions related to FER included the bilateral amygdala (AMY)/hippocampus (HIP), right fusiform gyrus (FFG), and right supplementary motor area (SMA). Partial correlation analysis showed that the fALFF of the right FFG was associated with high-load fearful FER accuracy (r = - 0.60, p = 0.004). Our study indicated that FER ability is correlated with resting-state intrinsic activity in brain regions related to facial emotion, which may provide a reference for the study of FER deficiency in schizophrenia.
Collapse
|
13
|
Luo S, Li LMW, Espina E, Bond MH, Lun VM, Huang L, Duan Q, Liu JH. Individual uniqueness in trust profiles and well‐being: Understanding the role of cultural tightness–looseness from a representation similarity perspective. BRITISH JOURNAL OF SOCIAL PSYCHOLOGY 2022; 62:825-844. [PMID: 36357990 DOI: 10.1111/bjso.12599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 10/25/2022] [Indexed: 11/12/2022]
Abstract
This paper provides a unique perspective for understanding cultural differences: representation similarity-a computational technique that uses pairwise comparisons of units to reveal their representation in higher-order space. By combining individual-level measures of trust across domains and well-being from 13,823 participants across 15 nations with a measure of society-level tightness-looseness, we found that any two countries with more similar tightness-looseness tendencies exhibit higher degrees of representation similarity in national interpersonal trust profiles. Although each individual's trust profile is generally similar to their nation's trust profile, the greater similarity between an individual's and their society's trust profile predicted a higher level of individual life satisfaction only in loose cultures but not in tight cultures. Using the framework of representation similarity to explore cross-cultural differences from a multidimensional, multi-national perspective provide a comprehensive picture of how culture is related to the human activities.
Collapse
Affiliation(s)
- Siyang Luo
- Department of Psychology, Guangdong Key Laboratory of Social Cognitive Neuroscience and Mental Health, Guangdong Provincial Key Laboratory of Brain Function and Disease Sun Yat‐Sen University Guangzhou China
| | - Liman Man Wai Li
- Department of Psychology and Centre for Psychosocial Health The Education University of Hong Kong Hong Kong China
| | - Ervina Espina
- Divisont of Social Sciences UP Visayas Tacloban College Tacloban City Leyte Philippines
| | - Michael Harris Bond
- Department of Management and Marketing, Faculty of Business Hong Kong Polytechnic University Hong Kong China
| | | | - Liqin Huang
- Department of Psychology, Guangdong Key Laboratory of Social Cognitive Neuroscience and Mental Health, Guangdong Provincial Key Laboratory of Brain Function and Disease Sun Yat‐Sen University Guangzhou China
| | - Qin Duan
- Department of Psychology, Guangdong Key Laboratory of Social Cognitive Neuroscience and Mental Health, Guangdong Provincial Key Laboratory of Brain Function and Disease Sun Yat‐Sen University Guangzhou China
| | - James H. Liu
- School of Psychology Massey University Auckland New Zealand
| |
Collapse
|
14
|
Quesque F, Coutrot A, Cox S, de Souza Leonardo C, Baez S, Cardona JF, Mulet-Perreault H, Flanagan E, Neely-Prado A, Clarens MF, Cassimiro L, Musa G, Kemp J, Botzung A, Philippi N, Cosseddu M, Trujillo C, Grisales JS, Fittipaldi S, Magrath Guimet N, Calandri IL, Crivelli L, Sedeno L, Garcia AM, Moreno F, Indakoetxea B, Benussi A, Brandão Moura MV, Santamaria-Garcia H, Matallana D, Prianishnikova G, Morozova A, Iakovleva O, Veryugina N, Levin O, Zhao L, Liang J, Duning T, Lebouvier T, Pasquier F, Huepe D, Barandiaran M, Johnen A, Lyashenko E, Allegri RF, Borroni B, Blanc F, Wang F, Yassuda MS, Lillo P, Teixeira AL, Caramelli P, Hudon C, Slachevsky A, Ibáñez A, Hornberger M, Bertoux M. Does culture shape our understanding of others' thoughts and emotions? An investigation across 12 countries. Neuropsychology 2022; 36:664-682. [PMID: 35834208 PMCID: PMC11186050 DOI: 10.1037/neu0000817] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Measures of social cognition have now become central in neuropsychology, being essential for early and differential diagnoses, follow-up, and rehabilitation in a wide range of conditions. With the scientific world becoming increasingly interconnected, international neuropsychological and medical collaborations are burgeoning to tackle the global challenges that are mental health conditions. These initiatives commonly merge data across a diversity of populations and countries, while ignoring their specificity. OBJECTIVE In this context, we aimed to estimate the influence of participants' nationality on social cognition evaluation. This issue is of particular importance as most cognitive tasks are developed in highly specific contexts, not representative of that encountered by the world's population. METHOD Through a large international study across 18 sites, neuropsychologists assessed core aspects of social cognition in 587 participants from 12 countries using traditional and widely used tasks. RESULTS Age, gender, and education were found to impact measures of mentalizing and emotion recognition. After controlling for these factors, differences between countries accounted for more than 20% of the variance on both measures. Importantly, it was possible to isolate participants' nationality from potential translation issues, which classically constitute a major limitation. CONCLUSIONS Overall, these findings highlight the need for important methodological shifts to better represent social cognition in both fundamental research and clinical practice, especially within emerging international networks and consortia. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
- François Quesque
- Univ. Lille, Inserm, CHU Lille, U1172 - LilNCog - Lille Neuroscience & Cognition, LiCEND, F-59000 Lille, France
| | | | - Sharon Cox
- Department of Behavioural Science and Health, Institute of Epidemiology and Healthcare, University College London, London, UK
| | | | | | | | | | - Emma Flanagan
- Norwich Medical School, University of East Anglia, UK
- Department of Clinical Neurosciences, University of Cambridge, UK
| | - Alejandra Neely-Prado
- Center for Social and Cognitive Neuroscience, School of Psychology, Adolfo Ibáñez University, Santiago, Chile
| | | | - Luciana Cassimiro
- School of Arts, Sciences and Humanities, University of São Paulo, Department of Neurology, São Paulo, Brazil
| | - Gada Musa
- Universidad de Chile, Santiago, Chile
| | | | | | | | | | | | | | - Sol Fittipaldi
- Universidad de San Andrés, Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), Argentina
| | | | | | - Lucia Crivelli
- FLENI Fondation, Department of Neurology, Buenos Aires, Argentina
| | - Lucas Sedeno
- National Scientific and Technical Research Council (CONICET), Argentina
| | - Adolfo M Garcia
- Universidad de San Andrés, Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), Argentina
- Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, Santiago, Chile
- Global Brain Health Institute (GBHI), University of California-San Francisco (UCSF), San Francisco, California, United States
| | - Fermin Moreno
- Department of Neurology, Unit of Cognitive Disorders, Hospital Universitario Donostia, San Sebastian, Spain
| | - Begoña Indakoetxea
- Department of Neurology, Unit of Cognitive Disorders, Hospital Universitario Donostia, San Sebastian, Spain
| | - Alberto Benussi
- Centre for Neurodegenerative Disorders, Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy
| | | | - Hernando Santamaria-Garcia
- School of Medicine, Neuroscience Doctorate. Aging Institute, Physiology and Psychiatry Department. Pontificia Universidad Javeriana, Bogotá, Colombia
| | - Diana Matallana
- School of Medicine, Neuroscience Doctorate. Aging Institute, Physiology and Psychiatry Department. Pontificia Universidad Javeriana, Bogotá, Colombia
| | | | - Anna Morozova
- Central Clinic No 1 of the Ministry of Internal Affairs, Moskva, Russia
| | - Olga Iakovleva
- Central Clinic No 1 of the Ministry of Internal Affairs, Moskva, Russia
| | - Nadezda Veryugina
- Central Clinic No 1 of the Ministry of Internal Affairs, Moskva, Russia
| | - Oleg Levin
- Central Clinic No 1 of the Ministry of Internal Affairs, Moskva, Russia
| | - Lina Zhao
- Innovation center for neurological disorders, Department of Neurology, Xuan Wu Hospital, Capital Medical University, 45 Changchun Street, Beijing
| | - Junhua Liang
- Innovation center for neurological disorders, Department of Neurology, Xuan Wu Hospital, Capital Medical University, 45 Changchun Street, Beijing
| | - Thomas Duning
- Clinic of Neurology with Institute for Translational Neurology, University Hospital Münster, Münster, Germany
| | - Thibaud Lebouvier
- Univ. Lille, Inserm, CHU Lille, U1172 - LilNCog - Lille Neuroscience & Cognition, LiCEND, F-59000 Lille, France
| | - Florence Pasquier
- Univ. Lille, Inserm, CHU Lille, U1172 - LilNCog - Lille Neuroscience & Cognition, LiCEND, F-59000 Lille, France
| | - David Huepe
- Center for Social and Cognitive Neuroscience, School of Psychology, Adolfo Ibáñez University, Santiago, Chile
| | - Myriam Barandiaran
- Department of Neurology, Unit of Cognitive Disorders, Hospital Universitario Donostia, San Sebastian, Spain
| | - Andreas Johnen
- Clinic of Neurology with Institute for Translational Neurology, University Hospital Münster, Münster, Germany
| | - Elena Lyashenko
- Central Clinic No 1 of the Ministry of Internal Affairs, Moskva, Russia
| | | | - Barbara Borroni
- Centre for Neurodegenerative Disorders, Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy
| | | | - Fen Wang
- Innovation center for neurological disorders, Department of Neurology, Xuan Wu Hospital, Capital Medical University, 45 Changchun Street, Beijing
| | - Monica Sanches Yassuda
- School of Arts, Sciences and Humanities, University of São Paulo, Department of Neurology, São Paulo, Brazil
| | | | | | | | - Carol Hudon
- Université Laval and CERVO Brain Research Centre, Québec, Canada
| | - Andrea Slachevsky
- Geroscience Center for Brain Health and Metabolism (GERO), Faculty of Medicine, University of Chile, Santiago, Chile
- Neuropsychology and Clinical Neuroscience Laboratory (LANNEC), Physiopathology Department - ICBM, Neurocience and East Neuroscience Departments, Faculty of Medicine, University of Chile, Santiago, Chile
- Memory and Neuropsychiatric Clinic (CMYN) Neurology Department, Hospital del Salvador and Faculty of Medicine, University of Chile, Santiago, Chile
- Servicio de Neurología, Departamento de Medicina, Clínica Alemana-Universidad del Desarrollo, Santiago, Chile
| | - Agustin Ibáñez
- Center for Social and Cognitive Neuroscience, School of Psychology, Adolfo Ibáñez University, Santiago, Chile
- Universidad de San Andrés, Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), Argentina
- Global Brain Health Institute (GBHI), University of California-San Francisco (UCSF), San Francisco, California, United States
- Universidad Autónoma del Caribe, Barranquilla, Colombia
| | - Michael Hornberger
- Norwich Medical School, University of East Anglia, UK
- Department of Clinical Neurosciences, University of Cambridge, UK
| | - Maxime Bertoux
- Univ. Lille, Inserm, CHU Lille, U1172 - LilNCog - Lille Neuroscience & Cognition, LiCEND, F-59000 Lille, France
- Department of Clinical Neurosciences, University of Cambridge, UK
| |
Collapse
|
15
|
Jacques C, Courchesne V, Mineau S, Dawson M, Mottron L. Positive, negative, neutral-or unknown? The perceived valence of emotions expressed by young autistic children in a novel context suited to autism. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2022; 26:1833-1848. [PMID: 35168392 PMCID: PMC9483191 DOI: 10.1177/13623613211068221] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Starting early in life, autistics are characterized as having atypical facial expressions, as well as decreased positive and increased negative affect. The literature on autistic facial expressions remains small, however, with disparate methods and results suggesting limited understanding of common autistic emotions. Furthermore, unlike non-autistics’ emotions, autistics’ emotions have been assessed without considering this population’s characteristics. In this study, the valence of young children’s facial expressions was thus rated as positive, negative, neutral, or “unknown”—a term for perceived emotions observers do not understand. Facial expressions were assessed using the Montreal Stimulating Play Situation, a context incorporating potential autistic interests. Comparing 37 autistic and 39 typical young (27–56 months) age-matched children, we found no group differences in expressed positive, negative, and neutral emotions. We did find differences in unknown emotions, which were unique to the autistic group. Preliminary data also showed that autistic children’s repetitive behaviors co-occurred with positive, neutral, and unknown emotions, but not with negative emotions. In a novel context that considers their characteristics, we did not find decreased positive or increased negative emotions in young autistic children. Instead, they uniquely expressed emotions perceived as unknown, showing the need to improve our understanding of their full emotional repertoire.
Collapse
Affiliation(s)
- Claudine Jacques
- Université du Québec en Outaouais, Canada.,CIUSSS du Nord-de-l'Île-de-Montréal, Canada
| | | | | | | | - Laurent Mottron
- CIUSSS du Nord-de-l'Île-de-Montréal, Canada.,Université de Montréal, Canada
| |
Collapse
|
16
|
Topography of Emotions in Cerebellum as Appraised by Functional Imaging. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2022; 1378:77-86. [DOI: 10.1007/978-3-030-99550-8_6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
17
|
Benedetti A, Molent C, Barcik W, Papaleo F. Social behavior in 16p11.2 and 22q11.2 copy number variations: Insights from mice and humans. GENES, BRAIN, AND BEHAVIOR 2021; 21:e12787. [PMID: 34889032 PMCID: PMC9744525 DOI: 10.1111/gbb.12787] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 11/24/2021] [Accepted: 11/24/2021] [Indexed: 11/30/2022]
Abstract
Genetic 16p11.2 and 22q11.2 deletions and duplications in humans may alter behavioral developmental trajectories increasing the risk of autism and schizophrenia spectrum disorders, and of attention-deficit/hyperactivity disorder. In this review, we will concentrate on 16p11.2 and 22q11.2 deletions' effects on social functioning, beyond diagnostic categorization. We highlight diagnostic and social sub-constructs discrepancies. Notably, we contrast evidence from human studies with social profiling performed in several mouse models mimicking 16p11.2 and 22q11.2 deletion syndromes. Given the complexity of social behavior, there is a need to assess distinct social processes. This will be important to better understand the biology underlying such genetic-dependent dysfunctions, as well as to give perspective on how therapeutic strategies can be improved. Bridges and divergent points between human and mouse studies are highlighted. Overall, we give challenges and future perspectives to sort the genetics of social heterogeneity.
Collapse
Affiliation(s)
- Arianna Benedetti
- Genetics of Cognition laboratory, Neuroscience areaIstituto Italiano di TecnologiaGenoaItaly,CNRS, GREDEGUniversité Côte d'AzurNiceFrance
| | - Cinzia Molent
- Genetics of Cognition laboratory, Neuroscience areaIstituto Italiano di TecnologiaGenoaItaly,Dipartimento di Medicina Sperimentale(Di. Mes) Università degli Studi di GenovaGenoaItaly
| | - Weronika Barcik
- Genetics of Cognition laboratory, Neuroscience areaIstituto Italiano di TecnologiaGenoaItaly
| | - Francesco Papaleo
- Genetics of Cognition laboratory, Neuroscience areaIstituto Italiano di TecnologiaGenoaItaly,Department of Neurosciences and Mental HealthFondazione IRCCS Ca' Granda Ospedale Maggiore PoliclinicoMilanItaly
| |
Collapse
|
18
|
Hoemann K, Nielson C, Yuen A, Gurera JW, Quigley KS, Barrett LF. Expertise in emotion: A scoping review and unifying framework for individual differences in the mental representation of emotional experience. Psychol Bull 2021; 147:1159-1183. [PMID: 35238584 PMCID: PMC9393910 DOI: 10.1037/bul0000327] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Expertise refers to outstanding skill or ability in a particular domain. In the domain of emotion, expertise refers to the observation that some people are better at a range of competencies related to understanding and experiencing emotions, and these competencies may help them lead healthier lives. These individual differences are represented by multiple constructs including emotional awareness, emotional clarity, emotional complexity, emotional granularity, and emotional intelligence. These constructs derive from different theoretical perspectives, highlight different competencies, and are operationalized and measured in different ways. The full set of relationships between these constructs has not yet been considered, hindering scientific progress and the translation of findings to aid mental and physical well-being. In this article, we use a scoping review procedure to integrate these constructs within a shared conceptual space. Scoping reviews provide a principled means of synthesizing large and diverse literature in a transparent fashion, enabling the identification of similarities as well as gaps and inconsistencies across constructs. Using domain-general accounts of expertise as a guide, we build a unifying framework for expertise in emotion and apply this to constructs that describe how people understand and experience their own emotions. Our approach offers opportunities to identify potential mechanisms of expertise in emotion, encouraging future research on those mechanisms and on educational or clinical interventions. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
Affiliation(s)
| | | | - Ashley Yuen
- School of Arts and Sciences, Massachusetts College of Pharmacy and Health Sciences
| | - J. W. Gurera
- Department of Psychology, Northeastern University
| | - Karen S. Quigley
- Department of Psychology, Northeastern University,Center for Healthcare Organization and Implementation Research (CHOIR), Edith Nourse Rogers Memorial Veterans Hospital, Bedford, Massachusetts, United States
| | - Lisa Feldman Barrett
- Department of Psychology, Northeastern University,Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School,Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, United States
| |
Collapse
|
19
|
Murray T, O'Brien J, Sagiv N, Garrido L. The role of stimulus-based cues and conceptual information in processing facial expressions of emotion. Cortex 2021; 144:109-132. [PMID: 34666297 DOI: 10.1016/j.cortex.2021.08.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Revised: 07/16/2021] [Accepted: 08/09/2021] [Indexed: 01/07/2023]
Abstract
Face shape and surface textures are two important cues that aid in the perception of facial expressions of emotion. Additionally, this perception is also influenced by high-level emotion concepts. Across two studies, we use representational similarity analysis to investigate the relative roles of shape, surface, and conceptual information in the perception, categorisation, and neural representation of facial expressions. In Study 1, 50 participants completed a perceptual task designed to measure the perceptual similarity of expression pairs, and a categorical task designed to measure the confusability between expression pairs when assigning emotion labels to a face. We used representational similarity analysis and constructed three models of the similarities between emotions using distinct information. Two models were based on stimulus-based cues (face shapes and surface textures) and one model was based on emotion concepts. Using multiple linear regression, we found that behaviour during both tasks was related with the similarity of emotion concepts. The model based on face shapes was more related with behaviour in the perceptual task than in the categorical, and the model based on surface textures was more related with behaviour in the categorical than the perceptual task. In Study 2, 30 participants viewed facial expressions while undergoing fMRI, allowing for the measurement of brain representational geometries of facial expressions of emotion in three core face-responsive regions (the Fusiform Face Area, Occipital Face Area, and Superior Temporal Sulcus), and a region involved in theory of mind (Medial Prefrontal Cortex). Across all four regions, the representational distances between facial expression pairs were related to the similarities of emotion concepts, but not to either of the stimulus-based cues. Together, these results highlight the important top-down influence of high-level emotion concepts both in behavioural tasks and in the neural representation of facial expressions.
Collapse
Affiliation(s)
- Thomas Murray
- Psychology Department, School of Biological and Behavioural Sciences, Queen Mary University London, United Kingdom.
| | - Justin O'Brien
- Centre for Cognitive Neuroscience, Department of Life Sciences, Brunel University London, United Kingdom
| | - Noam Sagiv
- Centre for Cognitive Neuroscience, Department of Life Sciences, Brunel University London, United Kingdom
| | - Lúcia Garrido
- Department of Psychology, City, University of London, United Kingdom
| |
Collapse
|
20
|
Oh D, Walker M, Freeman JB. Person knowledge shapes face identity perception. Cognition 2021; 217:104889. [PMID: 34464913 DOI: 10.1016/j.cognition.2021.104889] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 07/15/2021] [Accepted: 08/20/2021] [Indexed: 11/26/2022]
Abstract
Recognition of others' identity through facial features is essential in life. Using both correlational and experimental approaches, we examined how person knowledge biases the perception of others' facial identity. When a participant believed any two individuals were more similar in personality, their faces were perceived to be correspondingly more similar (assessed via mousetracking, Study 1). Further, participants' facial representations of target individuals that were believed to have a more similar personality were found to have a greater physical resemblance (assessed via reverse-correlation, Studies 2 and 3). Finally, when participants learned about novel individuals who had a more similar personality, their faces were visually represented more similarly (Study 4). Together, the findings show that the perception of facial identity is driven not only by facial features but also the person knowledge we have learned about others, biasing it toward alternate identities despite the fact that those identities lack any physical resemblance.
Collapse
|
21
|
Lin C, Keles U, Adolphs R. Four dimensions characterize attributions from faces using a representative set of English trait words. Nat Commun 2021; 12:5168. [PMID: 34453054 PMCID: PMC8397784 DOI: 10.1038/s41467-021-25500-y] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2020] [Accepted: 08/12/2021] [Indexed: 11/16/2022] Open
Abstract
People readily (but often inaccurately) attribute traits to others based on faces. While the details of attributions depend on the language available to describe social traits, psychological theories argue that two or three dimensions (such as valence and dominance) summarize social trait attributions from faces. However, prior work has used only a small number of trait words (12 to 18), limiting conclusions to date. In two large-scale, preregistered studies we ask participants to rate 100 faces (obtained from existing face stimuli sets), using a list of 100 English trait words that we derived using deep neural network analysis of words that have been used by other participants in prior studies to describe faces. In study 1 we find that these attributions are best described by four psychological dimensions, which we interpret as “warmth”, “competence”, “femininity”, and “youth”. In study 2 we partially reproduce these four dimensions using the same stimuli among additional participant raters from multiple regions around the world, in both aggregated and individual-level data. These results provide a comprehensive characterization of trait attributions from faces, although we note our conclusions are limited by the scope of our study (in particular we note only white faces and English trait words were included). People form impressions about others from seeing their faces, and use many words to describe those impressions. Here, using ratings of 100 representatively sampled white adult faces on a large set of traits, the authors show that trait impressions from faces can be summarized by four psychological dimensions.
Collapse
Affiliation(s)
- Chujun Lin
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA.
| | - Umit Keles
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Ralph Adolphs
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA.,Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| |
Collapse
|
22
|
Brooks JA, Stolier RM, Freeman JB. Computational approaches to the neuroscience of social perception. Soc Cogn Affect Neurosci 2021; 16:827-837. [PMID: 32986115 PMCID: PMC8343569 DOI: 10.1093/scan/nsaa127] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2019] [Revised: 07/23/2020] [Accepted: 09/09/2020] [Indexed: 11/14/2022] Open
Abstract
Across multiple domains of social perception-including social categorization, emotion perception, impression formation and mentalizing-multivariate pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data has permitted a more detailed understanding of how social information is processed and represented in the brain. As in other neuroimaging fields, the neuroscientific study of social perception initially relied on broad structure-function associations derived from univariate fMRI analysis to map neural regions involved in these processes. In this review, we trace the ways that social neuroscience studies using MVPA have built on these neuroanatomical associations to better characterize the computational relevance of different brain regions, and discuss how MVPA allows explicit tests of the correspondence between psychological models and the neural representation of social information. We also describe current and future advances in methodological approaches to multivariate fMRI data and their theoretical value for the neuroscience of social perception.
Collapse
Affiliation(s)
- Jeffrey A Brooks
- Department of Psychology, New York University, New York, NY, USA
| | - Ryan M Stolier
- Columbia University, 1190 Amsterdam Ave., New York, NY 10027, USA
| | | |
Collapse
|
23
|
Takahashi Y, Murata S, Idei H, Tomita H, Yamashita Y. Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework. Sci Rep 2021; 11:14684. [PMID: 34312400 PMCID: PMC8313712 DOI: 10.1038/s41598-021-94067-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Accepted: 07/06/2021] [Indexed: 11/20/2022] Open
Abstract
The mechanism underlying the emergence of emotional categories from visual facial expression information during the developmental process is largely unknown. Therefore, this study proposes a system-level explanation for understanding the facial emotion recognition process and its alteration in autism spectrum disorder (ASD) from the perspective of predictive processing theory. Predictive processing for facial emotion recognition was implemented as a hierarchical recurrent neural network (RNN). The RNNs were trained to predict the dynamic changes of facial expression movies for six basic emotions without explicit emotion labels as a developmental learning process, and were evaluated by the performance of recognizing unseen facial expressions for the test phase. In addition, the causal relationship between the network characteristics assumed in ASD and ASD-like cognition was investigated. After the developmental learning process, emotional clusters emerged in the natural course of self-organization in higher-level neurons, even though emotional labels were not explicitly instructed. In addition, the network successfully recognized unseen test facial sequences by adjusting higher-level activity through the process of minimizing precision-weighted prediction error. In contrast, the network simulating altered intrinsic neural excitability demonstrated reduced generalization capability and impaired emotional clustering in higher-level neurons. Consistent with previous findings from human behavioral studies, an excessive precision estimation of noisy details underlies this ASD-like cognition. These results support the idea that impaired facial emotion recognition in ASD can be explained by altered predictive processing, and provide possible insight for investigating the neurophysiological basis of affective contact.
Collapse
Affiliation(s)
- Yuta Takahashi
- Department of Psychiatry, Tohoku University Hospital, Sendai, Japan
- Department of Information Medicine, National Center of Neurology and Psychiatry, 4-1-1 Ogawa-Higashi, Kodaira, Tokyo, 187-8502, Japan
| | - Shingo Murata
- Department of Electronics and Electrical Engineering, Faculty of Science and Technology, Keio University, Tokyo, Japan
| | - Hayato Idei
- Department of Intermedia Studies, Waseda University, Tokyo, Japan
| | - Hiroaki Tomita
- Department of Psychiatry, Tohoku University Hospital, Sendai, Japan
| | - Yuichi Yamashita
- Department of Information Medicine, National Center of Neurology and Psychiatry, 4-1-1 Ogawa-Higashi, Kodaira, Tokyo, 187-8502, Japan.
| |
Collapse
|
24
|
Barnett BO, Brooks JA, Freeman JB. Stereotypes bias face perception via orbitofrontal-fusiform cortical interaction. Soc Cogn Affect Neurosci 2021; 16:302-314. [PMID: 33270131 PMCID: PMC7943359 DOI: 10.1093/scan/nsaa165] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 11/11/2020] [Accepted: 12/02/2020] [Indexed: 11/13/2022] Open
Abstract
Previous research has shown that social-conceptual associations, such as stereotypes, can influence the visual representation of faces and neural pattern responses in ventral temporal cortex (VTC) regions, such as the fusiform gyrus (FG). Current models suggest that this social-conceptual impact requires medial orbitofrontal cortex (mOFC) feedback signals during perception. Backward masking can disrupt such signals, as it is a technique known to reduce functional connectivity between VTC regions and regions outside VTC. During functional magnetic resonance imaging (fMRI), subjects passively viewed masked and unmasked faces, and following the scan, perceptual biases and stereotypical associations were assessed. Multi-voxel representations of faces across the VTC, and in the FG and mOFC, reflected stereotypically biased perceptions when faces were unmasked, but this effect was abolished when faces were masked. However, the VTC still retained the ability to process masked faces and was sensitive to their categorical distinctions. Functional connectivity analyses confirmed that masking disrupted mOFC-FG connectivity, which predicted a reduced impact of stereotypical associations in the FG. Taken together, our findings suggest that the biasing of face representations in line with stereotypical associations does not arise from intrinsic processing within the VTC and FG alone, but instead it depends in part on top-down feedback from the mOFC during perception.
Collapse
Affiliation(s)
- Benjamin O Barnett
- Division of Psychology and Language Sciences, University College London, London WC1E 6BT, UK
| | - Jeffrey A Brooks
- Department of Psychology, New York University, New York, NY 10003, USA
| | - Jonathan B Freeman
- Department of Psychology, New York University, New York, NY 10003, USA
- Center for Neural Science, New York University, New York, NY 10003, USA
| |
Collapse
|
25
|
Abstract
Although many simulations draw upon only one level of abstraction, the process for generating rich simulations requires a dynamic interplay between abstract and concrete knowledge. A complete model of simulation must account for a mind and brain that can bridge the perceptual with the conceptual, the episodic with the semantic, and the concrete with the abstract.
Collapse
|
26
|
Wu C, Zhang J, Yuan Z. Affective picture processing is modulated by emotion word type in masked priming paradigm: an event-related potential study. JOURNAL OF COGNITIVE PSYCHOLOGY 2020. [DOI: 10.1080/20445911.2020.1745816] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Affiliation(s)
- Chenggang Wu
- Faculty of Education, University of Macau, Macau, People's Republic of China
- Centre for Cognitive and Brain Sciences, University of Macau, Macau, People's Republic of China
| | - Juan Zhang
- Faculty of Education, University of Macau, Macau, People's Republic of China
- Centre for Cognitive and Brain Sciences, University of Macau, Macau, People's Republic of China
| | - Zhen Yuan
- Centre for Cognitive and Brain Sciences, University of Macau, Macau, People's Republic of China
- Faculty of Health Sciences, University of Macau, Macau, People's Republic of China
| |
Collapse
|
27
|
Investigating Emotional Similarity: A Comment on Riberto, Pobric, and Talmi (2019). Brain Topogr 2020; 33:285-287. [PMID: 32253572 DOI: 10.1007/s10548-020-00766-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2020] [Accepted: 04/01/2020] [Indexed: 10/24/2022]
Abstract
A recent review of the neuroimaging literature on emotional similarity brought to light some of the drawbacks of the latest studies. The authors discussed important methodological considerations for future work in this field, which predominantly involved stimulus selection. In general, we feel that their suggestions are valuable, but we hold that, depending on the specific scientific question(s) under investigation (e.g., individual differences), some of the suggestions may not meaningfully contribute to the scope of the study and might even introduce artificial constraints that could reduce the researchers' ability to discover effects of interest. Here we indicate one way to potentially circumvent such stimulus-related issues in neuroimaging studies and furthermore present a few scenarios in which additional controlling of the stimulus set may not be necessary or possible when investigating individual differences. This commentary serves to supplement the important methodological points raised by the authors by providing a caveat in potentially applying such points to all future experiments investigating emotional similarity.
Collapse
|
28
|
Zhao K, Liu M, Gu J, Mo F, Fu X, Hong Liu C. The Preponderant Role of Fusiform Face Area for the Facial Expression Confusion Effect: An MEG Study. Neuroscience 2020; 433:42-52. [PMID: 32169552 DOI: 10.1016/j.neuroscience.2020.03.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2019] [Revised: 02/24/2020] [Accepted: 03/02/2020] [Indexed: 01/21/2023]
Abstract
Although the recognition of facial expressions seems automatic and effortless, discrimination of expressions can still be error prone. Common errors are often due to visual similarities between some expressions (e.g., fear and surprise). However, little is known about the neural mechanisms underlying such a confusion effect. To address this question, we recorded the magnetoencephalography (MEG) while participants judged facial expressions that were either easily confused with or easily distinguished from other expressions. The results showed that the fusiform face area (FFA), rather than the posterior superior temporal sulcus (pSTS), played a preponderant role in discriminating confusable facial expressions. No difference between high confusion and low confusion conditions was observed on the M170 component in either the FFA or the pSTS, whilst a difference between two conditions started to emerge in the late positive potential (LPP), with the low confusion condition eliciting a larger LPP amplitude in the FFA. In addition, the power of delta was stronger in the time window of LPP component. This confusion effect was reflected in the FFA, which might be associated with the perceptual-to-conceptual shift.
Collapse
Affiliation(s)
- Ke Zhao
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
| | - Mingtong Liu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
| | - Jingjin Gu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
| | - Fan Mo
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
| | - Xiaolan Fu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.
| | - Chang Hong Liu
- Department of Psychology, Bournemouth University, Dorset, United Kingdom
| |
Collapse
|
29
|
Liu P, Li Q, Zhang A, Liu Z, Sun N, Yang C, Wang Y, Zhang K. Similar and Different Regional Homogeneity Changes Between Bipolar Disorder and Unipolar Depression: A Resting-State fMRI Study. Neuropsychiatr Dis Treat 2020; 16:1087-1093. [PMID: 32425537 PMCID: PMC7196208 DOI: 10.2147/ndt.s249489] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Accepted: 04/09/2020] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVE To investigate the regional homogeneity (ReHo) between unipolar depression (UD) and bipolar disorder (BD), and to search for brain imaging markers for distinguishing UD and BD. METHODS A total of 58 patients who met the diagnosis criteria of UD in DSM-Ⅳ, 40 patients who met the diagnosis criteria of BD in DSM-Ⅳ and 54 healthy controls (HC) completed the resting-state functional magnetic resonance (rs-fMRI) scans. The ReHo of the three groups was compared and Pearson correlation analysis was performed between the ReHo values and the clinical symptoms. RESULTS (1) Significant differences were found in the right hippocampus, right parahippocampal gyrus, right Inferior orbitofrontal gyrus, right superior temporal gyrus, right inferior temporal gyrus, and right middle occipital gyrus across the three groups. (2) Compared to HC, the ReHo in the right parahippocampal gyrus in UD significantly increased. (3) When compared to HC, the ReHo in the right hippocampus in BD significantly increased. The ReHo in the right middle occipital gyrus decreased. (4) Compared to UD, BD exhibited significantly decreased ReHo in the right inferior temporal gyrus. No correlations were observed between the scores of 24-item Hamilton Depression Rating Scale (HDMD-24), Hamilton Anxiety Scale (HAMA), Young Mania Rating Scale (YMRS), and the ReHo values of altered brain regions between BD and UD. CONCLUSION The results suggest that there was a considerable difference in the ReHo of brain among UD, BD, and HCs. ReHo in the right inferior temporal gyrus showed significant differences between BD and UD that might serve as neuroimaging markers to identify BD and UD.
Collapse
Affiliation(s)
- Penghong Liu
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China.,Department of Psychiatry, Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Qi Li
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China.,Department of Psychiatry, Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Aixia Zhang
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Zhifen Liu
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Ning Sun
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Chunxia Yang
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Yanfang Wang
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China
| | - Kerang Zhang
- Department of Psychiatry, First Hospital of Shanxi Medical University, Taiyuan 030001, People's Republic of China
| |
Collapse
|
30
|
Freeman JB, Stolier RM, Brooks JA. Dynamic interactive theory as a domain-general account of social perception. ADVANCES IN EXPERIMENTAL SOCIAL PSYCHOLOGY 2019; 61:237-287. [PMID: 34326560 PMCID: PMC8317542 DOI: 10.1016/bs.aesp.2019.09.005] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
The perception of social categories, emotions, and personality traits from others' faces each have been studied extensively but in relative isolation. We synthesize emerging findings suggesting that, in each of these domains of social perception, both a variety of bottom-up facial features and top-down social cognitive processes play a part in driving initial perceptions. Among such top-down processes, social-conceptual knowledge in particular can have a fundamental structuring role in how we perceive others' faces. Extending the Dynamic Interactive framework (Freeman & Ambady, 2011), we outline a perspective whereby the perception of social categories, emotions, and traits from faces can all be conceived as emerging from an integrated system relying on domain-general cognitive properties. Such an account of social perception would envision perceptions to be a rapid, but gradual, process of negotiation between the variety of visual cues inherent to a person and the social cognitive knowledge an individual perceiver brings to the perceptual process. We describe growing evidence in support of this perspective as well as its theoretical implications for social psychology.
Collapse
|
31
|
The neural representation of facial-emotion categories reflects conceptual structure. Proc Natl Acad Sci U S A 2019; 116:15861-15870. [PMID: 31332015 DOI: 10.1073/pnas.1816408116] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023] Open
Abstract
Humans reliably categorize configurations of facial actions into specific emotion categories, leading some to argue that this process is invariant between individuals and cultures. However, growing behavioral evidence suggests that factors such as emotion-concept knowledge may shape the way emotions are visually perceived, leading to variability-rather than universality-in facial-emotion perception. Understanding variability in emotion perception is only emerging, and the neural basis of any impact from the structure of emotion-concept knowledge remains unknown. In a neuroimaging study, we used a representational similarity analysis (RSA) approach to measure the correspondence between the conceptual, perceptual, and neural representational structures of the six emotion categories Anger, Disgust, Fear, Happiness, Sadness, and Surprise. We found that subjects exhibited individual differences in their conceptual structure of emotions, which predicted their own unique perceptual structure. When viewing faces, the representational structure of multivoxel patterns in the right fusiform gyrus was significantly predicted by a subject's unique conceptual structure, even when controlling for potential physical similarity in the faces themselves. Finally, cross-cultural differences in emotion perception were also observed, which could be explained by individual differences in conceptual structure. Our results suggest that the representational structure of emotion expressions in visual face-processing regions may be shaped by idiosyncratic conceptual understanding of emotion categories.
Collapse
|