1
|
El Zein M, Mennella R, Sequestro M, Meaux E, Wyart V, Grèzes J. Prioritized neural processing of social threats during perceptual decision-making. iScience 2024; 27:109951. [PMID: 38832023 PMCID: PMC11145357 DOI: 10.1016/j.isci.2024.109951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 04/24/2024] [Accepted: 05/07/2024] [Indexed: 06/05/2024] Open
Abstract
Emotional signals, notably those signaling threat, benefit from prioritized processing in the human brain. Yet, it remains unclear whether perceptual decisions about the emotional, threat-related aspects of stimuli involve specific or similar neural computations compared to decisions about their non-threatening/non-emotional components. We developed a novel behavioral paradigm in which participants performed two different detection tasks (emotion vs. color) on the same, two-dimensional visual stimuli. First, electroencephalographic (EEG) activity in a cluster of central electrodes reflected the amount of perceptual evidence around 100 ms following stimulus onset, when the decision concerned emotion, not color. Second, participants' choice could be predicted earlier for emotion (240 ms) than for color (380 ms) by the mu (10 Hz) rhythm, which reflects motor preparation. Taken together, these findings indicate that perceptual decisions about threat-signaling dimensions of facial displays are associated with prioritized neural coding in action-related brain regions, supporting the motivational value of socially relevant signals.
Collapse
Affiliation(s)
- M. El Zein
- Cognitive and Computational Neuroscience Laboratory (LNC), INSERM U960, DEC, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Center for Adaptive Rationality, Max-Planck for Human Development, Berlin, Germany
- Centre for Political Research (CEVIPOF), Sciences Po, Paris, France
- Humans Matter, Paris, France
| | - R. Mennella
- Cognitive and Computational Neuroscience Laboratory (LNC), INSERM U960, DEC, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Laboratory of the Interactions Between Cognition Action and Emotion (LICAÉ, EA2931), UFR STAPS, Université Paris Nanterre, Nanterre, France
| | - M. Sequestro
- Cognitive and Computational Neuroscience Laboratory (LNC), INSERM U960, DEC, Ecole Normale Supérieure, PSL University, 75005 Paris, France
| | - E. Meaux
- Cognitive and Computational Neuroscience Laboratory (LNC), INSERM U960, DEC, Ecole Normale Supérieure, PSL University, 75005 Paris, France
| | - V. Wyart
- Cognitive and Computational Neuroscience Laboratory (LNC), INSERM U960, DEC, Ecole Normale Supérieure, PSL University, 75005 Paris, France
- Institut du Psychotraumatisme de l’Enfant et de l’Adolescent, Conseil Départemental Yvelines et Hauts-de-Seine, Versailles, France
| | - J. Grèzes
- Cognitive and Computational Neuroscience Laboratory (LNC), INSERM U960, DEC, Ecole Normale Supérieure, PSL University, 75005 Paris, France
| |
Collapse
|
2
|
Metzler H, Vilarem E, Petschen A, Grèzes J. Power pose effects on approach and avoidance decisions in response to social threat. PLoS One 2023; 18:e0286904. [PMID: 37594940 PMCID: PMC10437884 DOI: 10.1371/journal.pone.0286904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Accepted: 05/24/2023] [Indexed: 08/20/2023] Open
Abstract
Individuals' opportunities for action in threatening social contexts largely depend on their social power. While powerful individuals can afford to confront aggressors and dangers, powerless individuals need others' support and better avoid direct challenges. Here, we investigated if adopting expansive or contracted poses, which signal dominance and submission, impacts individuals' approach and avoidance decisions in response to social threat signals using a within-subject design. Overall, participants more often chose to avoid rather than to approach angry individuals, but showed no clear approach or avoidance preference for fearful individuals. Crucially, contracted poses considerably increased the tendency to avoid angry individuals, whereas expansive poses induced no substantial changes. This suggests that adopting power-related poses may impact action decisions in response to social threat signals. The present results emphasize the social function of power poses, but should be replicated before drawing strong conclusions.
Collapse
Affiliation(s)
- Hannah Metzler
- Cognitive and Computational Neuroscience Laboratory, (LNC2), INSERM Unit 960, Department of Cognitive Studies, Ecole Normale Supérieure, PSL University, Paris, France
- Sorbonne Universités, UPMC University Paris 06, Paris, France
- Institute for Globally Distributed Open Research and Education
| | - Emma Vilarem
- Cognitive and Computational Neuroscience Laboratory, (LNC2), INSERM Unit 960, Department of Cognitive Studies, Ecole Normale Supérieure, PSL University, Paris, France
| | - Adrian Petschen
- Cognitive and Computational Neuroscience Laboratory, (LNC2), INSERM Unit 960, Department of Cognitive Studies, Ecole Normale Supérieure, PSL University, Paris, France
- Institut de la Communication et de la Cognition, Université de Neuchâtel, Neuchâtel, Switzerland
| | - Julie Grèzes
- Cognitive and Computational Neuroscience Laboratory, (LNC2), INSERM Unit 960, Department of Cognitive Studies, Ecole Normale Supérieure, PSL University, Paris, France
| |
Collapse
|
3
|
Abstract
Sharing responsibility in social decision-making helps individuals use the flexibility of the collective context to benefit themselves by claiming credit for good outcomes or avoiding the blame for bad outcomes. Using magnetoencephalography, we examined the neuronal basis of the impact that social context has on this flexible sense of responsibility. Participants performed a gambling task in various social contexts and reported feeling less responsibility when playing as a member of a team. A reduced magnetoencephalography outcome processing effect was observed as a function of decreasing responsibility at 200 msec post outcome onset and was centered over parietal, central, and frontal brain regions. Before outcome revelation in socially made decisions, an attenuated motor preparation signature at 500 msec after stimulus onset was found. A boost in reported responsibility for positive outcomes in social contexts was associated with increased activity in regions related to social and reward processing. Together, these results show that sharing responsibility with others reduces agency, influencing pre-outcome motor preparation and post-outcome processing, and provides opportunities to flexibly claim credit for positive outcomes.
Collapse
Affiliation(s)
- Marwa El Zein
- Max Planck Center for Human Development, Berlin, Germany
- University College London, United Kingdom
| | | | - Bahador Bahrami
- University College London, United Kingdom
- Ludwig Maximilian University, Munich, Germany
| |
Collapse
|
4
|
Guex R, Meaux E, Mégevand P, Domínguez-Borràs J, Seeck M, Vuilleumier P. Frequency-specific gaze modulation of emotional face processing in the human amygdala. Cereb Cortex 2022; 33:4859-4869. [PMID: 36155769 PMCID: PMC10110432 DOI: 10.1093/cercor/bhac385] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 09/02/2022] [Accepted: 09/03/2022] [Indexed: 11/13/2022] Open
Abstract
Determining the social significance of emotional face expression is of major importance for adaptive behavior, and gaze direction provides critical information in this process. The amygdala is implicated in both emotion and gaze processing, but how and when it integrates expression and gaze cues remains unresolved. We tackled this question using intracranial electroencephalography in epileptic patients to assess both amygdala (n = 12) and orbitofrontal cortex (OFC; n = 11) time-frequency evoked responses to faces with different emotional expressions and different gaze directions. As predicted, self-relevant threat signals (averted fearful and directed angry faces) elicited stronger amygdala activity than self-irrelevant threat (directed fearful and averted angry faces). Fear effects started at early latencies in both amygdala and OFC (~110 and 160 ms, respectively), while gaze direction effects and their interaction with emotion occurred at later latencies. Critically, the amygdala showed differential gamma band increases to fearful averted gaze (starting ~550 ms) and to angry directed gaze (~470 ms). Moreover, when comparing the 2 self-relevant threat conditions among them, we found higher gamma amygdala activity for averted fearful faces and higher beta OFC activity for angry directed faces. Together, these results reveal for the first time frequency-specific effects of emotion and gaze on amygdala and OFC neural activity.
Collapse
Affiliation(s)
- Raphael Guex
- Department of Fundamental Neuroscience, University of Geneva-Campus Biotech, HUG, Chem. des Mines 9, 1202 Geneva, Switzerland.,Department of Clinical Neuroscience, University of Geneva-HUG, Rue Gabrielle-Perret-Gentil 4, 1205 Geneva, Switzerland.,Swiss Center for Affective Sciences, University of Geneva, Chem. des Mines 9, 1202 Geneva, Switzerland
| | - Emilie Meaux
- Department of Fundamental Neuroscience, University of Geneva-Campus Biotech, HUG, Chem. des Mines 9, 1202 Geneva, Switzerland
| | - Pierre Mégevand
- Department of Fundamental Neuroscience, University of Geneva-Campus Biotech, HUG, Chem. des Mines 9, 1202 Geneva, Switzerland.,Department of Clinical Neuroscience, University of Geneva-HUG, Rue Gabrielle-Perret-Gentil 4, 1205 Geneva, Switzerland
| | - Judith Domínguez-Borràs
- Department of Fundamental Neuroscience, University of Geneva-Campus Biotech, HUG, Chem. des Mines 9, 1202 Geneva, Switzerland.,Swiss Center for Affective Sciences, University of Geneva, Chem. des Mines 9, 1202 Geneva, Switzerland.,Department of Clinical Psychology and Psychobiology, University of Barcelona: Passeig de laVall d'Hebron, 171 08035 Barcelona
| | - Margitta Seeck
- Department of Clinical Neuroscience, University of Geneva-HUG, Rue Gabrielle-Perret-Gentil 4, 1205 Geneva, Switzerland
| | - Patrik Vuilleumier
- Department of Fundamental Neuroscience, University of Geneva-Campus Biotech, HUG, Chem. des Mines 9, 1202 Geneva, Switzerland.,Swiss Center for Affective Sciences, University of Geneva, Chem. des Mines 9, 1202 Geneva, Switzerland
| |
Collapse
|
5
|
Thomas L, von Castell C, Hecht H. How facial masks alter the interaction of gaze direction, head orientation, and emotion recognition. Front Neurosci 2022; 16:937939. [PMID: 36213742 PMCID: PMC9533556 DOI: 10.3389/fnins.2022.937939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Accepted: 09/01/2022] [Indexed: 11/22/2022] Open
Abstract
The COVID-19 pandemic has altered the way we interact with each other: mandatory mask-wearing obscures facial information that is crucial for emotion recognition. Whereas the influence of wearing a mask on emotion recognition has been repeatedly investigated, little is known about the impact on interaction effects among emotional signals and other social signals. Therefore, the current study sought to explore how gaze direction, head orientation, and emotional expression interact with respect to emotion perception, and how these interactions are altered by wearing a face mask. In two online experiments, we presented face stimuli from the Radboud Faces Database displaying different facial expressions (anger, fear, happiness, neutral, and sadness), gaze directions (−13°, 0°, and 13°), and head orientations (−45°, 0°, and 45°) – either without (Experiment 1) or with mask (Experiment 2). Participants categorized the displayed emotional expressions. Not surprisingly, masks impaired emotion recognition. Surprisingly, without the mask, emotion recognition was unaffected by averted head orientations and only slightly affected by gaze direction. The mask strongly interfered with this ability. The mask increased the influence of head orientation and gaze direction, in particular for the emotions that were poorly recognized with mask. The results suggest that in case of uncertainty due to ambiguity or absence of signals, we seem to unconsciously factor in extraneous information.
Collapse
|
6
|
Grèzes J, Erblang M, Vilarem E, Quiquempoix M, Van Beers P, Guillard M, Sauvet F, Mennella R, Rabat A. Impact of total sleep deprivation and related mood changes on approach-avoidance decisions to threat-related facial displays. Sleep 2021; 44:zsab186. [PMID: 34313789 PMCID: PMC8664577 DOI: 10.1093/sleep/zsab186] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 06/14/2021] [Indexed: 11/26/2022] Open
Abstract
STUDY OBJECTIVES Total sleep deprivation is known to have significant detrimental effects on cognitive and socio-emotional functioning. Nonetheless, the mechanisms by which total sleep loss disturbs decision-making in social contexts are poorly understood. Here, we investigated the impact of total sleep deprivation on approach/avoidance decisions when faced with threatening individuals, as well as the potential moderating role of sleep-related mood changes. METHODS Participants (n = 34) made spontaneous approach/avoidance decisions in the presence of task-irrelevant angry or fearful individuals, while rested or totally sleep deprived (27 h of continuous wakefulness). Sleep-related changes in mood and sustained attention were assessed using the Positive and Negative Affective Scale and the psychomotor vigilance task, respectively. RESULTS Rested participants avoided both fearful and angry individuals, with stronger avoidance for angry individuals, in line with previous results. On the contrary, totally sleep deprived participants favored neither approach nor avoidance of fearful individuals, while they still comparably avoided angry individuals. Drift-diffusion models showed that this effect was accounted for by the fact that total sleep deprivation reduced value-based evidence accumulation toward avoidance during decision making. Finally, the reduction of positive mood after total sleep deprivation positively correlated with the reduction of fearful display avoidance. Importantly, this correlation was not mediated by a sleep-related reduction in sustained attention. CONCLUSIONS All together, these findings support the underestimated role of positive mood-state alterations caused by total sleep loss on approach/avoidance decisions when facing ambiguous socio-emotional displays, such as fear.
Collapse
Affiliation(s)
- Julie Grèzes
- Cognitive and Computational Neuroscience Laboratory (LNC Inserm U960), Department of Cognitive Studies, École Normale Supérieure, PSL University, Paris, France
| | - Mégane Erblang
- Laboratoire de Biologie de l’Exercice pour la Performance et la Santé (LBEPS), Université d’Evry, IRBA, Université de Paris Saclay, Evry-Courcouronnes, France
| | - Emma Vilarem
- Cognitive and Computational Neuroscience Laboratory (LNC Inserm U960), Department of Cognitive Studies, École Normale Supérieure, PSL University, Paris, France
| | - Michael Quiquempoix
- Unité Fatigue et Vigilance, Département Environnements Opérationnels, Institut de recherche biomédicale des armées (IRBA), Brétigny sur Orge cedex, France
- Equipe d’accueil VIgilance FAtigue SOMmeil (VIFASOM), EA 7330, Hôtel Dieu, Université de Paris, France
| | - Pascal Van Beers
- Unité Fatigue et Vigilance, Département Environnements Opérationnels, Institut de recherche biomédicale des armées (IRBA), Brétigny sur Orge cedex, France
- Equipe d’accueil VIgilance FAtigue SOMmeil (VIFASOM), EA 7330, Hôtel Dieu, Université de Paris, France
| | - Mathias Guillard
- Unité Fatigue et Vigilance, Département Environnements Opérationnels, Institut de recherche biomédicale des armées (IRBA), Brétigny sur Orge cedex, France
- Equipe d’accueil VIgilance FAtigue SOMmeil (VIFASOM), EA 7330, Hôtel Dieu, Université de Paris, France
| | - Fabien Sauvet
- Unité Fatigue et Vigilance, Département Environnements Opérationnels, Institut de recherche biomédicale des armées (IRBA), Brétigny sur Orge cedex, France
- Equipe d’accueil VIgilance FAtigue SOMmeil (VIFASOM), EA 7330, Hôtel Dieu, Université de Paris, France
| | - Rocco Mennella
- Cognitive and Computational Neuroscience Laboratory (LNC Inserm U960), Department of Cognitive Studies, École Normale Supérieure, PSL University, Paris, France
- Laboratory on the Interactions between Cognition, Action, and Emotion (LICAE) – Paris Nanterre University, Nanterre, France
| | - Arnaud Rabat
- Unité Fatigue et Vigilance, Département Environnements Opérationnels, Institut de recherche biomédicale des armées (IRBA), Brétigny sur Orge cedex, France
- Equipe d’accueil VIgilance FAtigue SOMmeil (VIFASOM), EA 7330, Hôtel Dieu, Université de Paris, France
| |
Collapse
|
7
|
Tunçgenç B, El Zein M, Sulik J, Newson M, Zhao Y, Dezecache G, Deroy O. Social influence matters: We follow pandemic guidelines most when our close circle does. Br J Psychol 2021; 112:763-780. [PMID: 33474747 PMCID: PMC8014579 DOI: 10.1111/bjop.12491] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 12/23/2020] [Indexed: 12/26/2022]
Abstract
Why do we adopt new rules, such as social distancing? Although human sciences research stresses the key role of social influence in behaviour change, most COVID-19 campaigns emphasize the disease's medical threat. In a global data set (n = 6,675), we investigated how social influences predict people's adherence to distancing rules during the pandemic. Bayesian regression analyses controlling for stringency of local measures showed that people distanced most when they thought their close social circle did. Such social influence mattered more than people thinking distancing was the right thing to do. People's adherence also aligned with their fellow citizens, but only if they felt deeply bonded with their country. Self-vulnerability to the disease predicted distancing more for people with larger social circles. Collective efficacy and collectivism also significantly predicted distancing. To achieve behavioural change during crises, policymakers must emphasize shared values and harness the social influence of close friends and family.
Collapse
Affiliation(s)
- Bahar Tunçgenç
- School of PsychologyUniversity of NottinghamUK
- Institute of Cognitive & Evolutionary AnthropologyUniversity of OxfordUK
| | - Marwa El Zein
- Institute of Cognitive NeuroscienceUniversity College LondonUK
- Adaptive Rationality CenterMax‐Planck Institute for Human DevelopmentBerlinGermany
| | - Justin Sulik
- Cognition, Values and Behaviour LabLudwig Maximilian UniversityMunichGermany
| | - Martha Newson
- Institute of Cognitive & Evolutionary AnthropologyUniversity of OxfordUK
- School of Anthropology and ConservationUniversity of KentUK
| | - Yi Zhao
- School of MedicineIndiana UniversityBloomingtonIndianaUSA
| | | | - Ophelia Deroy
- Cognition, Values and Behaviour LabLudwig Maximilian UniversityMunichGermany
- Munich Center for NeuroscienceLudwig Maximilian UniversityMunichGermany
- School of Advanced StudyInstitute of PhilosophyUniversity of LondonUK
| |
Collapse
|
8
|
Caruana N, Seymour K. Bottom-up processing of fearful and angry facial expressions is intact in schizophrenia. Cogn Neuropsychiatry 2021; 26:183-198. [PMID: 33752551 DOI: 10.1080/13546805.2021.1902794] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
INTRODUCTION Judgments of emotion from faces are reportedly impaired in schizophrenia. However, it is unclear whether this is due to a top-down cognitive deficit in evaluating sensory information or a fundamental bottom-up perturbation in the early stages of face encoding. This study examined whether deficits in emotion processing reflect imprecision in the initial preconscious registration of emotional face expressions within the visual system. METHODS Using continuous flash suppression (CFS), we presented participants (18 patients with schizophrenia, 8M/10F; 20 healthy controls, 13M/7F) with fearful and angry faces. Previous CFS research on healthy participants reveals that fearful facial expressions gain privileged access to awareness over angry faces-demonstrating the visual system's ability to discriminate these emotions at a preconscious level. We used this same approach to probe the integrity of early emotion encoding whilst minimising the potential contribution of any top-down cognitive biases on perceptual judgments. RESULTS In both groups, fearful faces were perceived faster than angry faces, with no differences observed between patients and controls. CONCLUSIONS Emotion processing difficulties in schizophrenia are unlikely to reflect an early sensory deficit, but rather a deficit in social cognition that has a top-down impact on the conscious evaluation of facial expressions.
Collapse
Affiliation(s)
- Nathan Caruana
- Department of Cognitive Science, Macquarie University, Sydney, Australia.,Perception in Action Research Centre, Macquarie University, Sydney, Australia
| | - Kiley Seymour
- School of Psychology, Western Sydney University, Sydney, Australia.,The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia.,Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| |
Collapse
|
9
|
Mennella R, Vilarem E, Grèzes J. Rapid approach-avoidance responses to emotional displays reflect value-based decisions: Neural evidence from an EEG study. Neuroimage 2020; 222:117253. [DOI: 10.1016/j.neuroimage.2020.117253] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2020] [Revised: 07/03/2020] [Accepted: 08/09/2020] [Indexed: 11/16/2022] Open
|
10
|
Caruana N, Inkley C, El Zein M. Gaze direction biases emotion categorisation in schizophrenia. Schizophr Res Cogn 2020; 21:100181. [PMID: 32477892 PMCID: PMC7248285 DOI: 10.1016/j.scog.2020.100181] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 05/04/2020] [Accepted: 05/13/2020] [Indexed: 12/13/2022]
Abstract
The successful integration of eye gaze direction and emotion cues from faces is important not only for co-ordinated interactions, but also for the detection of social signals alerting us to threat posed by a conspecific, or elsewhere in our immediate environment. It is now well-established that people with schizophrenia experience aberrant eye gaze and facial emotion processing. These social-cognitive differences might contribute to the maintenance of socially-themed delusions which are characterised by the hyper-attribution of threatening intentions to others. However, no study has directly examined whether the mechanisms which govern the integration of eye gaze and emotion information diverge in schizophrenia, and more importantly, whether this reflects a fundamental 'bottom-up' perceptual deficit or a 'top-down' cognitive bias. Fifteen outpatients diagnosed with schizophrenia and 21 healthy age- and IQ-matched controls performed an emotion categorisation task (anger/fear) on morphed facial expressions of anger or fear, displaying either direct or averted gaze. Results in both controls and patients replicated the previous finding that combinations of anger with direct gaze, and fear with averted gaze - which signal a relevant threat to the observer - benefited from more accurate emotion recognition than alternate gaze-emotion combinations. Bayesian model selection revealed that for patients this effect was mediated by a shift in decision bias towards emotions which signal self-relevant threat, rather than a change in sensitivity as observed in controls. These results critically highlight a different cognitive mechanism governing gaze and face-cued emotion integration in schizophrenia, which has a top-down influence on the evaluation of perceptual input.
Collapse
Affiliation(s)
- Nathan Caruana
- Perception in Action Research Centre, Macquarie University, Sydney, Australia
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Christine Inkley
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Marwa El Zein
- Institute of Cognitive Neuroscience, University College London, United Kingdom
| |
Collapse
|
11
|
Emotional learning promotes perceptual predictions by remodeling stimulus representation in visual cortex. Sci Rep 2019; 9:16867. [PMID: 31727912 PMCID: PMC6856165 DOI: 10.1038/s41598-019-52615-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2018] [Accepted: 06/13/2019] [Indexed: 12/13/2022] Open
Abstract
Emotions exert powerful effects on perception and memory, notably by modulating activity in sensory cortices so as to capture attention. Here, we examine whether emotional significance acquired by a visual stimulus can also change its cortical representation by linking neuronal populations coding for different memorized versions of the same stimulus, a mechanism that would facilitate recognition across different appearances. Using fMRI, we show that after pairing a given face with threat through conditioning, viewing this face activates the representation of another viewpoint of the same person, which itself was never conditioned, leading to robust repetition-priming across viewpoints in the ventral visual stream (including medial fusiform, lateral occipital, and anterior temporal cortex). We also observed a functional-anatomical segregation for coding view-invariant and view-specific identity information. These results indicate emotional signals may induce plasticity of stimulus representations in visual cortex, serving to generate new sensory predictions about different appearances of threat-associated stimuli.
Collapse
|
12
|
Caruana N, Inkley C, Zein ME, Seymour K. No influence of eye gaze on emotional face processing in the absence of conscious awareness. Sci Rep 2019; 9:16198. [PMID: 31700080 PMCID: PMC6838103 DOI: 10.1038/s41598-019-52728-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 10/22/2019] [Indexed: 11/30/2022] Open
Abstract
The human brain has evolved specialised mechanisms to enable the rapid detection of threat cues, including emotional face expressions (e.g., fear and anger). However, contextual cues - such as gaze direction - influence the ability to recognise emotional expressions. For instance, anger paired with direct gaze, and fear paired with averted gaze are more accurately recognised compared to alternate conjunctions of these features. It is argued that this is because gaze direction conveys the relevance and locus of the threat to the observer. Here, we used continuous flash suppression (CFS) to assess whether the modulatory effect of gaze direction on emotional face processing occurs outside of conscious awareness. Previous research using CFS has demonstrated that fearful facial expressions are prioritised by the visual system and gain privileged access to awareness over other expressed emotions. We hypothesised that if the modulatory effects of gaze on emotional face processing occur also at this level, then the gaze-emotion conjunctions signalling self-relevant threat will reach awareness faster than those that do not. We report that fearful faces gain privileged access to awareness over angry faces, but that gaze direction does not modulate this effect. Thus, our findings suggest that previously reported effects of gaze direction on emotional face processing are likely to occur once the face is detected, where the self-relevance and locus of the threat can be consciously appraised.
Collapse
Affiliation(s)
- Nathan Caruana
- Perception in Action Research Centre, Macquarie University, Sydney, Australia.
- Department of Cognitive Science, Macquarie University, Sydney, Australia.
| | - Christine Inkley
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Marwa El Zein
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Kiley Seymour
- School of Psychology, Western Sydney University, Sydney, Australia
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia
| |
Collapse
|
13
|
Kätsyri J, de Gelder B, de Borst AW. Amygdala responds to direct gaze in real but not in computer-generated faces. Neuroimage 2019; 204:116216. [PMID: 31553928 DOI: 10.1016/j.neuroimage.2019.116216] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 08/22/2019] [Accepted: 09/19/2019] [Indexed: 10/25/2022] Open
Abstract
Computer-generated (CG) faces are an important visual interface for human-computer interaction in social contexts. Here we investigated whether the human brain processes emotion and gaze similarly in real and carefully matched CG faces. Real faces evoked greater responses in the fusiform face area than CG faces, particularly for fearful expressions. Emotional (angry and fearful) facial expressions evoked similar activations in the amygdala in real and CG faces. Direct as compared with averted gaze elicited greater fMRI responses in the amygdala regardless of facial expression but only for real and not for CG faces. We observed an interaction effect between gaze and emotion (i.e., the shared signal effect) in the right posterior temporal sulcus and other regions, but not in the amygdala, and we found no evidence for different shared signal effects in real and CG faces. Taken together, the present findings highlight similarities (emotional processing in the amygdala) and differences (overall processing in the fusiform face area, gaze processing in the amygdala) in the neural processing of real and CG faces.
Collapse
Affiliation(s)
- Jari Kätsyri
- Brain and Emotion Laboratory, Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands; Department of Computer Science, Aalto University, Espoo, Finland.
| | - Beatrice de Gelder
- Brain and Emotion Laboratory, Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands; Department of Computer Science, University College London, London, United Kingdom
| | - Aline W de Borst
- UCL Interaction Centre, University College London, London, United Kingdom
| |
Collapse
|
14
|
Bode S, Feuerriegel D, Bennett D, Alday PM. The Decision Decoding ToolBOX (DDTBOX) - A Multivariate Pattern Analysis Toolbox for Event-Related Potentials. Neuroinformatics 2019; 17:27-42. [PMID: 29721680 PMCID: PMC6394452 DOI: 10.1007/s12021-018-9375-z] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
In recent years, neuroimaging research in cognitive neuroscience has increasingly used multivariate pattern analysis (MVPA) to investigate higher cognitive functions. Here we present DDTBOX, an open-source MVPA toolbox for electroencephalography (EEG) data. DDTBOX runs under MATLAB and is well integrated with the EEGLAB/ERPLAB and Fieldtrip toolboxes (Delorme and Makeig 2004; Lopez-Calderon and Luck 2014; Oostenveld et al. 2011). It trains support vector machines (SVMs) on patterns of event-related potential (ERP) amplitude data, following or preceding an event of interest, for classification or regression of experimental variables. These amplitude patterns can be extracted across space/electrodes (spatial decoding), time (temporal decoding), or both (spatiotemporal decoding). DDTBOX can also extract SVM feature weights, generate empirical chance distributions based on shuffled-labels decoding for group-level statistical testing, provide estimates of the prevalence of decodable information in the population, and perform a variety of corrections for multiple comparisons. It also includes plotting functions for single subject and group results. DDTBOX complements conventional analyses of ERP components, as subtle multivariate patterns can be detected that would be overlooked in standard analyses. It further allows for a more explorative search for information when no ERP component is known to be specifically linked to a cognitive process of interest. In summary, DDTBOX is an easy-to-use and open-source toolbox that allows for characterising the time-course of information related to various perceptual and cognitive processes. It can be applied to data from a large number of experimental paradigms and could therefore be a valuable tool for the neuroimaging community.
Collapse
Affiliation(s)
- Stefan Bode
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
- School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, Australia.
| | - Daniel Bennett
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, USA
| | - Phillip M Alday
- School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, Australia
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| |
Collapse
|
15
|
Patron E, Mennella R, Messerotti Benvenuti S, Thayer JF. The frontal cortex is a heart-brake: Reduction in delta oscillations is associated with heart rate deceleration. Neuroimage 2019; 188:403-410. [DOI: 10.1016/j.neuroimage.2018.12.035] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2018] [Revised: 12/01/2018] [Accepted: 12/16/2018] [Indexed: 12/30/2022] Open
|
16
|
Chadwick M, Metzler H, Tijus C, Armony JL, Grèzes J. Stimulus and observer characteristics jointly determine the relevance of threatening facial expressions and their interaction with attention. MOTIVATION AND EMOTION 2018. [DOI: 10.1007/s11031-018-9730-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
17
|
El Zein M, Wyart V, Grèzes J. Pervasive influence of idiosyncratic associative biases during facial emotion recognition. Sci Rep 2018; 8:8804. [PMID: 29891849 PMCID: PMC5996038 DOI: 10.1038/s41598-018-27102-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2017] [Accepted: 05/29/2018] [Indexed: 11/09/2022] Open
Abstract
Facial morphology has been shown to influence perceptual judgments of emotion in a way that is shared across human observers. Here we demonstrate that these shared associations between facial morphology and emotion coexist with strong variations unique to each human observer. Interestingly, a large part of these idiosyncratic associations does not vary on short time scales, emerging from stable inter-individual differences in the way facial morphological features influence emotion recognition. Computational modelling of decision-making and neural recordings of electrical brain activity revealed that both shared and idiosyncratic face-emotion associations operate through a common biasing mechanism rather than an increased sensitivity to face-associated emotions. Together, these findings emphasize the underestimated influence of idiosyncrasies on core social judgments and identify their neuro-computational signatures.
Collapse
Affiliation(s)
- Marwa El Zein
- Laboratoire de Neurosciences Cognitives (Inserm unit 960), Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, 75005, Paris, France. .,Institute of Cognitive Neuroscience, University College London (UCL), WC1N 3AR, London, United Kingdom.
| | - Valentin Wyart
- Laboratoire de Neurosciences Cognitives (Inserm unit 960), Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, 75005, Paris, France
| | - Julie Grèzes
- Laboratoire de Neurosciences Cognitives (Inserm unit 960), Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, 75005, Paris, France
| |
Collapse
|
18
|
Dhabhar FS. The short-term stress response - Mother nature's mechanism for enhancing protection and performance under conditions of threat, challenge, and opportunity. Front Neuroendocrinol 2018; 49:175-192. [PMID: 29596867 PMCID: PMC5964013 DOI: 10.1016/j.yfrne.2018.03.004] [Citation(s) in RCA: 134] [Impact Index Per Article: 22.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/04/2017] [Revised: 03/23/2018] [Accepted: 03/23/2018] [Indexed: 02/07/2023]
Abstract
Our group has proposed that in contrast to chronic stress that can have harmful effects, the short-term (fight-or-flight) stress response (lasting for minutes to hours) is nature's fundamental survival mechanism that enhances protection and performance under conditions involving threat/challenge/opportunity. Short-term stress enhances innate/primary, adaptive/secondary, vaccine-induced, and anti-tumor immune responses, and post-surgical recovery. Mechanisms and mediators include stress hormones, dendritic cell, neutrophil, macrophage, and lymphocyte trafficking/function and local/systemic chemokine and cytokine production. Short-term stress may also enhance mental/cognitive and physical performance through effects on brain, musculo-skeletal, and cardiovascular function, reappraisal of threat/anxiety, and training-induced stress-optimization. Therefore, short-term stress psychology/physiology could be harnessed to enhance immuno-protection, as well as mental and physical performance. This review aims to provide a conceptual framework and targets for further investigation of mechanisms and conditions under which the protective/adaptive aspects of short-term stress/exercise can be optimized/harnessed, and for developing pharmacological/biobehavioral interventions to enhance health/healing, and mental/cognitive/physical performance.
Collapse
Affiliation(s)
- Firdaus S Dhabhar
- Department of Psychiatry & Behavioral Sciences, Sylvester Comprehensive Cancer Center, Miller School of Medicine, University of Miami, Mail Stop M877, 1550 NW 10th Avenue, Miami, FL 33136-1000, United States.
| |
Collapse
|
19
|
Ioannou C, Zein ME, Wyart V, Scheid I, Amsellem F, Delorme R, Chevallier C, Grèzes J. Shared mechanism for emotion processing in adolescents with and without autism. Sci Rep 2017; 7:42696. [PMID: 28218248 PMCID: PMC5317002 DOI: 10.1038/srep42696] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2016] [Accepted: 01/05/2017] [Indexed: 12/28/2022] Open
Abstract
Although, the quest to understand emotional processing in individuals with Autism Spectrum Disorders (ASD) has led to an impressive number of studies, the picture that emerges from this research remains inconsistent. Some studies find that Typically Developing (TD) individuals outperform those with ASD in emotion recognition tasks, others find no such difference. In this paper, we move beyond focusing on potential group differences in behaviour to answer what we believe is a more pressing question: do individuals with ASD use the same mechanisms to process emotional cues? To this end, we rely on model-based analyses of participants’ accuracy during an emotion categorisation task in which displays of anger and fear are paired with direct vs. averted gaze. Behavioural data of 20 ASD and 20 TD adolescents revealed that the ASD group displayed lower overall performance. Yet, gaze direction had a similar impact on emotion categorisation in both groups, i.e. improved accuracy for salient combinations (anger-direct, fear-averted). Critically, computational modelling of participants’ behaviour reveals that the same mechanism, i.e. increased perceptual sensitivity, underlies the contextual impact of gaze in both groups. We discuss the specific experimental conditions that may favour emotion processing and the automatic integration of contextual information in ASD.
Collapse
Affiliation(s)
- Christina Ioannou
- Laboratoire de Neurosciences Cognitives, Inserm unit 960, Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, Paris, 75005, France
| | - Marwa El Zein
- Laboratoire de Neurosciences Cognitives, Inserm unit 960, Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, Paris, 75005, France
| | - Valentin Wyart
- Laboratoire de Neurosciences Cognitives, Inserm unit 960, Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, Paris, 75005, France
| | - Isabelle Scheid
- Centre Expert Asperger, Fondation Fondamental, Paris, 75019, France.,Service de Psychiatrie de l'Enfant et de l'Adolescent, Hôpital Universitaire Robert Debré, Paris, 75019, France
| | - Frédérique Amsellem
- Service de Psychiatrie de l'Enfant et de l'Adolescent, Hôpital Universitaire Robert Debré, Paris, 75019, France.,Génétique Humaine et Fonction Cognitive, Institut Pasteur, Paris, 75015, France
| | - Richard Delorme
- Service de Psychiatrie de l'Enfant et de l'Adolescent, Hôpital Universitaire Robert Debré, Paris, 75019, France.,Génétique Humaine et Fonction Cognitive, Institut Pasteur, Paris, 75015, France
| | - Coralie Chevallier
- Laboratoire de Neurosciences Cognitives, Inserm unit 960, Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, Paris, 75005, France
| | - Julie Grèzes
- Laboratoire de Neurosciences Cognitives, Inserm unit 960, Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL Research University, Paris, 75005, France
| |
Collapse
|