1
|
Stavropoulos A, Crone DL, Grossmann I. Shadows of wisdom: Classifying meta-cognitive and morally grounded narrative content via large language models. Behav Res Methods 2024; 56:7632-7646. [PMID: 38811519 DOI: 10.3758/s13428-024-02441-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/14/2024] [Indexed: 05/31/2024]
Abstract
We investigated large language models' (LLMs) efficacy in classifying complex psychological constructs like intellectual humility, perspective-taking, open-mindedness, and search for a compromise in narratives of 347 Canadian and American adults reflecting on a workplace conflict. Using state-of-the-art models like GPT-4 across few-shot and zero-shot paradigms and RoB-ELoC (RoBERTa -fine-tuned-on-Emotion-with-Logistic-Regression-Classifier), we compared their performance with expert human coders. Results showed robust classification by LLMs, with over 80% agreement and F1 scores above 0.85, and high human-model reliability (Cohen's κ Md across top models = .80). RoB-ELoC and few-shot GPT-4 were standout classifiers, although somewhat less effective in categorizing intellectual humility. We offer example workflows for easy integration into research. Our proof-of-concept findings indicate the viability of both open-source and commercial LLMs in automating the coding of complex constructs, potentially transforming social science research.
Collapse
Affiliation(s)
| | | | - Igor Grossmann
- Department of Psychology, University of Waterloo, Waterloo, N2L 3G1, Canada.
| |
Collapse
|
2
|
Rudnev M, Barrett HC, Buckwalter W, Machery E, Stich S, Barr K, Bencherifa A, Clancy RF, Crone DL, Deguchi Y, Fabiano E, Fodeman AD, Guennoun B, Halamová J, Hashimoto T, Homan J, Kanovský M, Karasawa K, Kim H, Kiper J, Lee M, Liu X, Mitova V, Nair RB, Pantovic L, Porter B, Quintanilla P, Reijer J, Romero PP, Singh P, Tber S, Wilkenfeld DA, Yi L, Grossmann I. Dimensions of wisdom perception across twelve countries on five continents. Nat Commun 2024; 15:6375. [PMID: 39143069 PMCID: PMC11324649 DOI: 10.1038/s41467-024-50294-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 07/08/2024] [Indexed: 08/16/2024] Open
Abstract
Wisdom is the hallmark of social judgment, but how people across cultures recognize wisdom remains unclear-distinct philosophical traditions suggest different views of wisdom's cardinal features. We explore perception of wise minds across 16 socio-economically and culturally diverse convenience samples from 12 countries. Participants assessed wisdom exemplars, non-exemplars, and themselves on 19 socio-cognitive characteristics, subsequently rating targets' wisdom, knowledge, and understanding. Analyses reveal two positively related dimensions-Reflective Orientation and Socio-Emotional Awareness. These dimensions are consistent across the studied cultural regions and interact when informing wisdom ratings: wisest targets-as perceived by participants-score high on both dimensions, whereas the least wise are not reflective but moderately socio-emotional. Additionally, individuals view themselves as less reflective but more socio-emotionally aware than most wisdom exemplars. Our findings expand folk psychology and social judgment research beyond the Global North, showing how individuals perceive desirable cognitive and socio-emotional qualities, and contribute to an understanding of mind perception.
Collapse
Affiliation(s)
- M Rudnev
- University of Waterloo, Waterloo, ON, Canada.
| | | | | | - E Machery
- University of Pittsburgh, Pittsburgh, PA, USA
- University of Johannesburg, Johannesburg, South Africa
| | - S Stich
- Rutgers University, New Brunswick, NJ, USA
| | - K Barr
- University of Pittsburgh, Pittsburgh, PA, USA
| | - A Bencherifa
- University of Johannesburg, Johannesburg, South Africa
- Université Internationale de Rabat, Rabat, Morocco
| | | | - D L Crone
- Northeastern University, Boston, MA, USA
| | | | - E Fabiano
- University of Coimbra, Coimbra, Portugal
- Pontificia Universidad Catolica del Peru, San Miguel, Peru
| | - A D Fodeman
- Centers for Disease Control and Prevention (CDC), Atlanta, GA, USA
| | | | - J Halamová
- Comenius University in Bratislava, Bratislava, Slovakia
| | | | - J Homan
- University of Kansas, Lawrence, KS, USA
| | - M Kanovský
- Comenius University in Bratislava, Bratislava, Slovakia
| | | | - H Kim
- Korea University, Seoul, South Korea
| | - J Kiper
- University of Alabama at Birmingham, Birmingham, AL, USA
| | - M Lee
- Seoul National University, Seoul, South Korea
| | - X Liu
- Wuhan University, Wuhan, China
| | - V Mitova
- University of Johannesburg, Johannesburg, South Africa
| | - R B Nair
- University of Johannesburg, Johannesburg, South Africa
- Indian Institute of Technology, Delhi, India
| | - L Pantovic
- University of Belgrade, Belgrade, Serbia
| | - B Porter
- University of Pittsburgh, Pittsburgh, PA, USA
| | - P Quintanilla
- University of Johannesburg, Johannesburg, South Africa
- Universidad San Francisco de Quito, Quito, Ecuador
| | - J Reijer
- University of Johannesburg, Johannesburg, South Africa
| | - P P Romero
- Universidad San Francisco de Quito, Quito, Ecuador
| | - P Singh
- Indian Institute of Technology, Delhi, India
| | - S Tber
- Université Internationale de Rabat, Rabat, Morocco
| | | | - L Yi
- University of Pittsburgh, Pittsburgh, PA, USA
| | - I Grossmann
- University of Waterloo, Waterloo, ON, Canada.
- University of Johannesburg, Johannesburg, South Africa.
| |
Collapse
|
3
|
Behnke M, Lakens D, Petrova K, Chwiłkowska P, Białek SJ, Kłoskowski M, Krzyżaniak W, Maciejewski P, Kaczmarek LD, Szymański K, Jamieson JP, Gross JJ. Applying a synergistic mindsets intervention to an esports context. ROYAL SOCIETY OPEN SCIENCE 2024; 11:240691. [PMID: 39157427 PMCID: PMC11328966 DOI: 10.1098/rsos.240691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 04/29/2024] [Accepted: 05/01/2024] [Indexed: 08/20/2024]
Abstract
Affective responses during stressful, high-stakes situations can play an important role in shaping performance. For example, feeling shaky and nervous at a job interview can undermine performance, whereas feeling excited during that same interview can optimize performance. Thus, affect regulation-the way people influence their affective responses-might play a key role in determining high-stakes outcomes. To test this idea, we adapted a synergistic mindsets intervention (SMI) (Yeager et al. 2022 Nature 607, 512-520 (doi:10.1038/s41586-022-04907-7)) to a high-stakes esports context. Our approach was motivated by the idea that (i) mindsets both about situations and one's stress responses to situations can be shaped to help optimize stress responses, and (ii) challenge versus threat stress responses will be associated with improved outcomes. After a baseline performance task, we randomly assigned gamers (n = 300) either to SMI or a control condition in which they learned brain facts. After two weeks of daily gaming, gamers competed in a cash-prize tournament. We measured affective experiences before the matches and cardiovascular responses before and throughout the matches. Contrary to predictions, gamers did not experience negative affect (including feeling stressed), thus limiting the capacity for the intervention to regulate physiological responses and optimize performance. Compared with the control participants, synergistic mindsets participants did not show greater challenge responses or improved performance outcomes. Though our adaptation of Yeager et al.'s SMI did not optimize esports performance, our findings point to important considerations regarding the suitability of an intervention such as this to different performance contexts of varying degrees of stressfulness.
Collapse
Affiliation(s)
- Maciej Behnke
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
- Cognitive Neuroscience Center, Adam Mickiewicz University, Poznan, Poland
| | - Daniel Lakens
- Human-Technology Interaction Group, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Kate Petrova
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Patrycja Chwiłkowska
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | - Szymon Jęśko Białek
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | - Maciej Kłoskowski
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | - Wadim Krzyżaniak
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | - Patryk Maciejewski
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | - Lukasz D. Kaczmarek
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | - Kacper Szymański
- Faculty of Psychology and Cognitive Science, Adam Mickiewicz University, Poznan, Poland
| | | | - James J. Gross
- Department of Psychology, Stanford University, Stanford, CA, USA
| |
Collapse
|
4
|
Mobayed T. A concept in flux and starved of the metaphysical: desecularizing emotion. Front Psychol 2024; 15:1373443. [PMID: 38803832 PMCID: PMC11128679 DOI: 10.3389/fpsyg.2024.1373443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 03/21/2024] [Indexed: 05/29/2024] Open
Abstract
Despite being of undisputed importance, there is no consensus on what emotions are, with the majority of research that constructs ideas about them being colored by a particular worldview. This conceptual article examines the case for conducting an Islamic analysis of emotion. It might seem a peculiar area to examine; what would be the need to analyze such a universal psychological concept through the lens of a particular religion? Three points are used to argue for this endeavor. To begin with, this article highlights the relative instability of the term; there is yet no universally agreed upon definition of what emotions are, and which human processes they contribute to. As the concept is still being defined, there is merit in engaging with the discussion, particularly given the relative absence of metaphysics from the debate. Secondly, specificities relating to emotions and how they have conceptualized are considered. This section delves into the way in which variable factors, such as culture, language, and worldview, influence how emotions manifest. The overarching point argued for here is that how emotions are experienced, and even which emotions are experienced, are shaped by factors that are not consistent across time and space. Accordingly, different worldviews will formulate different "emotional palates" and "emotional ideologies"; different groups of people will understand and engage with emotions differently. Thirdly, a broader discussion ensues pertaining to the nature of science, psychology, and their relationship with secularity. This discussion includes critique of the idea that forces such as secularism and scientific materialism have been "discovered" and are therefore value-neutral. Accordingly, understandings of emotions to have emerged from the Academy, and contemporary psychology, are value-laden. This section also looks at the origins of science in order to determine whether it is inherently atheistic or areligious, and therefore antagonistic to a religious worldview. The section also challenges the apparent secularity of psychology and key psychologists. A range of other facets pertaining to how the emotions have been conceptualized, such as their relational core, their interaction with moral faculties, and their enmeshment with what is important to individuals and groups, are also considered.
Collapse
Affiliation(s)
- Tamim Mobayed
- Wolfson College, The University of Oxford, Oxford, United Kingdom
| |
Collapse
|
5
|
Goel S, Jara-Ettinger J, Ong DC, Gendron M. Face and context integration in emotion inference is limited and variable across categories and individuals. Nat Commun 2024; 15:2443. [PMID: 38499519 PMCID: PMC10948792 DOI: 10.1038/s41467-024-46670-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 03/05/2024] [Indexed: 03/20/2024] Open
Abstract
The ability to make nuanced inferences about other people's emotional states is central to social functioning. While emotion inferences can be sensitive to both facial movements and the situational context that they occur in, relatively little is understood about when these two sources of information are integrated across emotion categories and individuals. In a series of studies, we use one archival and five empirical datasets to demonstrate that people could be integrating, but that emotion inferences are just as well (and sometimes better) captured by knowledge of the situation alone, while isolated facial cues are insufficient. Further, people integrate facial cues more for categories for which they most frequently encounter facial expressions in everyday life (e.g., happiness). People are also moderately stable over time in their reliance on situational cues and integration of cues and those who reliably utilize situation cues more also have better situated emotion knowledge. These findings underscore the importance of studying variability in reliance on and integration of cues.
Collapse
Affiliation(s)
- Srishti Goel
- Department of Psychology, Yale University, 100 College St, New Haven, CT, USA.
| | - Julian Jara-Ettinger
- Department of Psychology, Yale University, 100 College St, New Haven, CT, USA
- Wu Tsai Institute, Yale University, 100 College St, New Haven, CT, USA
| | - Desmond C Ong
- Department of Psychology, The University of Texas at Austin, 108 E Dean Keeton St, Austin, TX, USA
| | - Maria Gendron
- Department of Psychology, Yale University, 100 College St, New Haven, CT, USA.
| |
Collapse
|
6
|
McVeigh K, Kleckner IR, Quigley KS, Satpute AB. Fear-related psychophysiological patterns are situation and individual dependent: A Bayesian model comparison approach. Emotion 2024; 24:506-521. [PMID: 37603002 PMCID: PMC10882564 DOI: 10.1037/emo0001265] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/22/2023]
Abstract
Is there a universal mapping of physiology to emotion, or do these mappings vary substantially by person or situation? Psychologists, philosophers, and neuroscientists have debated this question for decades. Most previous studies have focused on differentiating emotions on the basis of accompanying autonomic responses using analytical approaches that often assume within-category homogeneity. In the present study, we took an alternative approach to this question. We determined the extent to which the relationship between subjective experience and autonomic reactivity generalizes across, or depends upon, the individual and situation for instances of a single emotion category, specifically, fear. Electrodermal activity and cardiac activity-two autonomic measures that are often assumed to show robust relationships with instances of fear-were recorded while participants reported fear experience in response to dozens of fear-evoking videos related to three distinct situations: spiders, heights, and social encounters. We formally translated assumptions from diverse theoretical models into a common framework for model comparison analyses. Results exceedingly favored a model that assumed situation-dependency in the relationship between fear experience and autonomic reactivity, with subject variance also significant but constrained by situation. Models that assumed generalization across situations and/or individuals performed much worse by comparison. These results call into question the assumption of generalizability of autonomic-subjective mappings across instances of fear, as required in translational research from nonhuman animals to humans, and advance a situated approach to understanding the autonomic correlates of fear experience. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
- Kieran McVeigh
- Department of Psychology, Northeastern University, 360 Huntington Ave, 125 NI, Boston, MA 02115
| | | | - Karen S. Quigley
- Department of Psychology, Northeastern University, 360 Huntington Ave, 125 NI, Boston, MA 02115
| | - Ajay B. Satpute
- Department of Psychology, Northeastern University, 360 Huntington Ave, 125 NI, Boston, MA 02115
| |
Collapse
|
7
|
Leshin J, Carter MJ, Doyle CM, Lindquist KA. Language access differentially alters functional connectivity during emotion perception across cultures. Front Psychol 2024; 14:1084059. [PMID: 38425348 PMCID: PMC10901990 DOI: 10.3389/fpsyg.2023.1084059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 12/15/2023] [Indexed: 03/02/2024] Open
Abstract
Introduction It is often assumed that the ability to recognize the emotions of others is reflexive and automatic, driven only by observable facial muscle configurations. However, research suggests that accumulated emotion concept knowledge shapes the way people perceive the emotional meaning of others' facial muscle movements. Cultural upbringing can shape an individual's concept knowledge, such as expectations about which facial muscle configurations convey anger, disgust, or sadness. Additionally, growing evidence suggests that access to emotion category words, such as "anger," facilitates access to such emotion concept knowledge and in turn facilitates emotion perception. Methods To investigate the impact of cultural influence and emotion concept accessibility on emotion perception, participants from two cultural groups (Chinese and White Americans) completed a functional magnetic resonance imaging scanning session to assess functional connectivity between brain regions during emotion perception. Across four blocks, participants were primed with either English emotion category words ("anger," "disgust") or control text (XXXXXX) before viewing images of White American actors posing facial muscle configurations that are stereotypical of anger and disgust in the United States. Results We found that when primed with "disgust" versus control text prior to seeing disgusted facial expressions, Chinese participants showed a significant decrease in functional connectivity between a region associated with semantic retrieval (the inferior frontal gyrus) and regions associated with semantic processing, visual perception, and social cognition. Priming the word "anger" did not impact functional connectivity for Chinese participants relative to control text, and priming neither "disgust" nor "anger" impacted functional connectivity for White American participants. Discussion These findings provide preliminary evidence that emotion concept accessibility differentially impacts perception based on participants' cultural background.
Collapse
Affiliation(s)
- Joseph Leshin
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Maleah J. Carter
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Cameron M. Doyle
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Kristen A. Lindquist
- Department of Psychology and Neuroscience, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
- Biomedical Research Imaging Center, School of Medicine, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| |
Collapse
|
8
|
Takada A, Dan-Glauser E. Decoding the complexities of emotion socialization: cultures, individual features and shared information. Sci Rep 2024; 14:3536. [PMID: 38346987 PMCID: PMC10861512 DOI: 10.1038/s41598-024-52885-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/15/2024] Open
Affiliation(s)
- Akira Takada
- Division of African Area Studies, Graduate School of Asian and African Area Studies (ASAFAS), Kyoto University, 46 Yoshida-Shimoadachi-cho, Sakyo Ward, Kyoto, 606-8304, Japan
| | - Elise Dan-Glauser
- Institute of Psychology, Faculty of Social and Political Sciences, Unil-Mouline, University of Lausanne, 1015, Lausanne, Switzerland.
| |
Collapse
|
9
|
Del Popolo Cristaldi F, Buodo G, Gambarota F, Oosterwijk S, Mento G. How previous experience shapes future affective subjective ratings: A follow-up study investigating implicit learning and cue ambiguity. PLoS One 2024; 19:e0297954. [PMID: 38335190 PMCID: PMC10857730 DOI: 10.1371/journal.pone.0297954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 01/11/2024] [Indexed: 02/12/2024] Open
Abstract
People use their previous experience to predict future affective events. Since we live in ever-changing environments, affective predictions must generalize from past contexts (from which they may be implicitly learned) to new, potentially ambiguous contexts. This study investigated how past (un)certain relationships influence subjective experience following new ambiguous cues, and whether past relationships can be learned implicitly. Two S1-S2 paradigms were employed as learning and test phases in two experiments. S1s were colored circles, S2s negative or neutral affective pictures. Participants (Experiment 1 N = 121, Experiment 2 N = 116) were assigned to the certain (CG) or uncertain group (UG), and they were presented with 100% (CG) or 50% (UG) S1-S2 congruency during an uninstructed (Experiment 1) or implicit (Experiment 2) learning phase. During the test phase both groups were presented with a new 75% S1-S2 paradigm, and ambiguous (Experiment 1) or unambiguous (Experiment 2) S1s. Participants were asked to rate the expected valence of upcoming S2s (expectancy ratings), or their experienced valence and arousal (valence and arousal ratings). In Experiment 1 ambiguous cues elicited less negative expectancy ratings, and less unpleasant valence ratings, independently of prior experience. In Experiment 2, both groups showed similar expectancies, predicting upcoming pictures' valence according to the 75% contingencies of the test phase. Overall, we found that in the presence of ambiguous cues subjective affective experience is dampened, and that implicit previous experience does not emerge at the subjective level by significantly shaping reported affective experience.
Collapse
Affiliation(s)
| | - Giulia Buodo
- Department of General Psychology, University of Padua, Padua, Italy
| | - Filippo Gambarota
- Department of Developmental Psychology and Socialization, University of Padua, Padua, Italy
| | - Suzanne Oosterwijk
- Department of Social Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Brain and Cognition Centre (ABC), Amsterdam, The Netherlands
| | - Giovanni Mento
- Department of General Psychology, University of Padua, Padua, Italy
- Scientific Institute, IRCCS E. Medea, Conegliano, Treviso, Italy
| |
Collapse
|
10
|
Aranberri Ruiz A. Transcutaneous Auricular Vagus Nerve Stimulation to Improve Emotional State. Biomedicines 2024; 12:407. [PMID: 38398009 PMCID: PMC10886536 DOI: 10.3390/biomedicines12020407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Revised: 01/19/2024] [Accepted: 01/30/2024] [Indexed: 02/25/2024] Open
Abstract
Emotional experiences are a part of our lives. The maladaptive functioning of an individual's emotional field can lead to emotional disturbances of various kinds, such as anxiety and depression. Currently, there is an increasing prevalence of emotional disorders that cause great human suffering and high socioeconomic costs. Emotional processing has a biological basis. The major neuroscientific theories of emotion are based on biological functioning, and all of them take into account the anatomy and function of the tenth cranial nerve: the vagus nerve. The vagus nerve connects the subdiaphragmatic and supradiaphragmatic areas and modulates emotional processing as the basis of interoceptive functioning. Auricular vagus nerve stimulation is a new and innovative neuromodulation technique based on the function of the vagus nerve. Several interventions have shown that this new neurostimulation technique is a very promising resource for treating emotional disorders. In this paper, we summarise three neuroscientific theories of emotion, explain what transcutaneous auricular nerve stimulation is, and present arguments for its use and continued research.
Collapse
Affiliation(s)
- Ainara Aranberri Ruiz
- Department of Basic Psychological Process and Development, University of the Basque Country, 20018 San Sebastian, Spain
| |
Collapse
|
11
|
Theriault JE. "I Should" Versus "I Want To": Can Heyes's Cultural Cognitive-Evolutionary Account Explain the Phenomenology of Normativity? PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2024; 19:72-74. [PMID: 37530653 PMCID: PMC10834841 DOI: 10.1177/17456916231187412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/03/2023]
Affiliation(s)
- Jordan E. Theriault
- Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston MA, 02114, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA 02129 USA
| |
Collapse
|
12
|
Bian Y, Küster D, Liu H, Krumhuber EG. Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models. SENSORS (BASEL, SWITZERLAND) 2023; 24:126. [PMID: 38202988 PMCID: PMC10781259 DOI: 10.3390/s24010126] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 11/30/2023] [Accepted: 12/21/2023] [Indexed: 01/12/2024]
Abstract
This paper provides a comprehensive overview of affective computing systems for facial expression recognition (FER) research in naturalistic contexts. The first section presents an updated account of user-friendly FER toolboxes incorporating state-of-the-art deep learning models and elaborates on their neural architectures, datasets, and performances across domains. These sophisticated FER toolboxes can robustly address a variety of challenges encountered in the wild such as variations in illumination and head pose, which may otherwise impact recognition accuracy. The second section of this paper discusses multimodal large language models (MLLMs) and their potential applications in affective science. MLLMs exhibit human-level capabilities for FER and enable the quantification of various contextual variables to provide context-aware emotion inferences. These advancements have the potential to revolutionize current methodological approaches for studying the contextual influences on emotions, leading to the development of contextualized emotion models.
Collapse
Affiliation(s)
- Yifan Bian
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK;
| | - Dennis Küster
- Department of Mathematics and Computer Science, University of Bremen, 28359 Bremen, Germany; (D.K.); (H.L.)
| | - Hui Liu
- Department of Mathematics and Computer Science, University of Bremen, 28359 Bremen, Germany; (D.K.); (H.L.)
| | - Eva G. Krumhuber
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK;
| |
Collapse
|
13
|
van Heijst K, Kret ME, Ploeger A. Basic Emotions or Constructed Emotions: Insights From Taking an Evolutionary Perspective. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2023:17456916231205186. [PMID: 37916982 DOI: 10.1177/17456916231205186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023]
Abstract
The ongoing debate between basic emotion theories (BETs) and the theory of constructed emotion (TCE) hampers progress in the field of emotion research. Providing a new perspective, here we aim to bring the theories closer together by dissecting them according to Tinbergen's four questions to clarify a focus on their evolutionary basis. On the basis of our review of the literature, we conclude that whereas BETs focus on the evolution question of Tinbergen, the TCE is more concerned with the causation of emotion. On the survival value of emotions both theories largely agree: to provide the best reaction in specific situations. Evidence is converging on the evolutionary history of emotions but is still limited for both theories-research within both frameworks focuses heavily on the causation. We conclude that BETs and the TCE explain two different phenomena: emotion and feeling. Therefore, they seem irreconcilable but possibly supplementary for explaining and investigating the evolution of emotion-especially considering their similar answer to the question of survival value. Last, this article further highlights the importance of carefully describing what aspect of emotion is being discussed or studied. Only then can evidence be interpreted to converge toward explaining emotion.
Collapse
Affiliation(s)
| | - Mariska E Kret
- Cognitive Psychology Unit, Faculty of Social and Behavioral Sciences, Leiden University
- Comparative Psychology and Affective Neuroscience Lab, Cognitive Psychology Department, Leiden University
- Leiden Institute for Brain and Cognition (LIBC), Leiden University
| | | |
Collapse
|
14
|
Hoemann K. Beyond Linguistic Relativity, Emotion Concepts Illustrate How Meaning is Contextually and Individually Variable. Top Cogn Sci 2023; 15:668-675. [PMID: 37145872 DOI: 10.1111/tops.12659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 04/18/2023] [Accepted: 04/18/2023] [Indexed: 05/06/2023]
Abstract
Kemmerer describes grounded accounts of cognition and, using crosslinguistic diversity across conceptual domains, argues that these accounts entail linguistic relativity. In this comment, I extend Kemmerer's position to the domain of emotion. Emotion concepts exemplify characteristics highlighted by grounded accounts of cognition and differ by culture and language. Recent research further demonstrates considerable situation- and person-specific differences. Based on this evidence, I argue that emotion concepts carry unique implications for variation in meaning and experience, entailing a relativity that is contextual and individual in addition to linguistic. I conclude by considering what such pervasive relativity means for interpersonal understanding.
Collapse
|
15
|
Wilson-Mendenhall CD, Holmes KJ. Lab Meets World: the Case for Use-Inspired Basic Research in Affective Science. AFFECTIVE SCIENCE 2023; 4:591-599. [PMID: 37744977 PMCID: PMC10514004 DOI: 10.1007/s42761-023-00200-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 06/27/2023] [Indexed: 09/26/2023]
Abstract
We join others in envisioning a future for affective science that addresses society's most pressing needs. To move toward this vision, we consider a research paradigm that emerged in other disciplines: use-inspired basic research. This paradigm transcends the traditional basic-applied dichotomy, which pits the basic goal of fundamental scientific understanding against the applied goal of use in solving social problems. In reality, these goals are complementary, and use-inspired basic research advances them simultaneously. Here, we build a case for use-inspired basic research-how it differs from traditional basic science and why affective scientists should engage in it. We first examine how use-inspired basic research challenges problematic assumptions of a strict basic-applied dichotomy. We then discuss how it is consistent with advances in affective science that recognize context specificity as the norm and consider ethical issues of use being a complementary goal. Following this theoretical discussion, we differentiate the implementation of use-inspired basic research from that of traditional basic science. We draw on examples from recent research to illustrate differences: social problems as a starting point, stakeholder and community engagement, and integration of research and service. In conclusion, we invite affective scientists to embrace the "lab meets world" perspective of use-inspired basic research as a promising pathway to real-world impact.
Collapse
|
16
|
Hoemann K, Wormwood JB, Barrett LF, Quigley KS. Multimodal, Idiographic Ambulatory Sensing Will Transform our Understanding of Emotion. AFFECTIVE SCIENCE 2023; 4:480-486. [PMID: 37744967 PMCID: PMC10513989 DOI: 10.1007/s42761-023-00206-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Accepted: 07/17/2023] [Indexed: 09/26/2023]
Abstract
Emotions are inherently complex - situated inside the brain while being influenced by conditions inside the body and outside in the world - resulting in substantial variation in experience. Most studies, however, are not designed to sufficiently sample this variation. In this paper, we discuss what could be discovered if emotion were systematically studied within persons 'in the wild', using biologically-triggered experience sampling: a multimodal and deeply idiographic approach to ambulatory sensing that links body and mind across contexts and over time. We outline the rationale for this approach, discuss challenges to its implementation and widespread adoption, and set out opportunities for innovation afforded by emerging technologies. Implementing these innovations will enrich method and theory at the frontier of affective science, propelling the contextually situated study of emotion into the future.
Collapse
Affiliation(s)
- Katie Hoemann
- Department of Psychology, KU Leuven, Tiensestraat 102, Box 3727, 3000 Leuven, BE Belgium
| | - Jolie B. Wormwood
- Department of Psychology, University of New Hampshire, Durham, NH USA
| | - Lisa Feldman Barrett
- Department of Psychology, Northeastern University, Boston, MA USA
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Cambridge, MA USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA USA
| | - Karen S. Quigley
- Department of Psychology, Northeastern University, Boston, MA USA
| |
Collapse
|
17
|
Zelazo PD, Carlson SM. Reconciling the Context-Dependency and Domain-Generality of Executive Function Skills from a Developmental Systems Perspective. JOURNAL OF COGNITION AND DEVELOPMENT 2022. [DOI: 10.1080/15248372.2022.2156515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
18
|
Grossmann I. Transparency and Inclusion in Psychological Inquiry: Reflecting on the Past, Embracing the Present, and Building an Inclusive Future. PSYCHOLOGICAL INQUIRY 2022. [DOI: 10.1080/1047840x.2023.2172277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
|