1
|
Hall NT, Hallquist MN, Martin EA, Lian W, Jonas KG, Kotov R. Automating the analysis of facial emotion expression dynamics: A computational framework and application in psychotic disorders. Proc Natl Acad Sci U S A 2024; 121:e2313665121. [PMID: 38530896 PMCID: PMC10998559 DOI: 10.1073/pnas.2313665121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 01/18/2024] [Indexed: 03/28/2024] Open
Abstract
Facial emotion expressions play a central role in interpersonal interactions; these displays are used to predict and influence the behavior of others. Despite their importance, quantifying and analyzing the dynamics of brief facial emotion expressions remains an understudied methodological challenge. Here, we present a method that leverages machine learning and network modeling to assess the dynamics of facial expressions. Using video recordings of clinical interviews, we demonstrate the utility of this approach in a sample of 96 people diagnosed with psychotic disorders and 116 never-psychotic adults. Participants diagnosed with schizophrenia tended to move from neutral expressions to uncommon expressions (e.g., fear, surprise), whereas participants diagnosed with other psychoses (e.g., mood disorders with psychosis) moved toward expressions of sadness. This method has broad applications to the study of normal and altered expressions of emotion and can be integrated with telemedicine to improve psychiatric assessment and treatment.
Collapse
Affiliation(s)
- Nathan T. Hall
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC27599
| | - Michael N. Hallquist
- Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC27599
| | - Elizabeth A. Martin
- Department of Psychological Science, University of California, Irvine, CA92697
| | - Wenxuan Lian
- Department of Psychiatry, Stony Brook University, Stoney Brook, NY11794
| | | | - Roman Kotov
- Department of Psychiatry, Stony Brook University, Stoney Brook, NY11794
| |
Collapse
|
2
|
Zedan SA, Zahid A, Best MW. Examining the effects of diagnostic awareness, positive symptoms, and negative symptoms on stigmatizing attitudes and social exclusion towards schizophrenia. Schizophr Res 2024; 264:482-490. [PMID: 38277738 DOI: 10.1016/j.schres.2024.01.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 01/04/2024] [Accepted: 01/08/2024] [Indexed: 01/28/2024]
Abstract
BACKGROUND Social exclusion towards schizophrenia can occur as a response to symptom presentations and/or diagnostic knowledge. The present study examined stigma towards schizophrenia as a function of diagnostic awareness, positive symptoms, and negative symptoms. METHODS 559 participants were presented with one of eight vignettes depicting an individual in a social situation based on a 2 (label: present, absent) x 2 (positive symptoms: present, absent) x 2 (negative symptoms: present, absent) design. Participants then completed various measures of social exclusion and stigmatizing attitudes. RESULTS A significant three-way interaction between positive symptoms, negative symptoms, and a diagnostic label was found for stigmatizing attitudes such that knowledge of diagnosis was associated with less stigma when symptoms were present but resulted in more stigma when symptoms were absent. A significant interaction between diagnostic label and negative symptoms was found on social distance such that knowledge of diagnosis increased desire for social distance when negative symptoms were present. CONCLUSION Diagnostic awareness increases stigmatizing attitudes and social distance when symptoms are not present. However, when contextualized with the presence of symptoms, diagnostic awareness may reduce exclusion by providing an explanation for those symptoms. Determining when and to whom to disclose one's diagnosis may be helpful to improve social functioning in schizophrenia.
Collapse
Affiliation(s)
- Saleena A Zedan
- Department of Psychology, University of Toronto Scarborough, Scarborough, Ontario, Canada
| | - Aqsa Zahid
- Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Scarborough, Ontario, Canada
| | - Michael W Best
- Department of Psychology, University of Toronto Scarborough, Scarborough, Ontario, Canada; Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Scarborough, Ontario, Canada; Ontario Shores Centre for Mental Health Sciences, Whitby, Ontario, Canada.
| |
Collapse
|
3
|
Zouraraki C, Karamaouna P, Giakoumaki SG. Facial emotion recognition and schizotypal traits: A systematic review of behavioural studies. Early Interv Psychiatry 2023; 17:121-140. [PMID: 35840128 DOI: 10.1111/eip.13328] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 03/19/2022] [Accepted: 05/29/2022] [Indexed: 11/27/2022]
Abstract
AIM Previous research has indicated that individuals expressing high schizotypal traits and patients with Schizotypal Personality Disorder (SPD), show deficits in facial emotion recognition, compared to low schizotypal or control groups. On the other hand, non-significant findings also exist and the association of facial emotion recognition deficits with the different schizotypal dimensions is not well defined, thus limiting any conclusive outcomes. Therefore, the aim of this systematic review was to further clarify this relationship. METHODS PsychInfo, Web of Science, Scopus and PubMed were systematically searched, and 23 papers with a cross-sectional design were selected. Nineteen studies examined individuals with high schizotypal traits and four studies evaluated SPD individuals with behavioural facial emotion recognition paradigms and self-report measures or clinical interviews for schizotypal traits. All selected studies were published between 1994 and August 2020. RESULTS According to the evidence of studies, high schizotypal individuals and SPD patients have poorer performance in facial emotion recognition tasks. Negative schizotypy was related to lower accuracy for positive and negative emotions and faster emotion labeling while positive schizotypy was associated with worse accuracy for positive, negative and neutral emotions and more biases. Disorganized schizotypy was associated with poorer accuracy for negative emotions and suspiciousness with higher accuracy for disgust faces but lower total accuracy. CONCLUSIONS These findings are consistent with the vulnerability for schizophrenia spectrum disorders and support the idea that emotion recognition deficits are trait markers for these conditions. Thus, the effectiveness of early-intervention programmes could increase by also targeting this class of deficits.
Collapse
Affiliation(s)
- Chrysoula Zouraraki
- Laboratory of Neuropsychology, Department of Psychology, Faculty of Social Sciences, University of Crete, Rethymno, Greece
- University of Crete Research Center for the Humanities, The Social and Educational Sciences (UCRC), University of Crete, Rethymno, Greece
| | - Penny Karamaouna
- Laboratory of Neuropsychology, Department of Psychology, Faculty of Social Sciences, University of Crete, Rethymno, Greece
- University of Crete Research Center for the Humanities, The Social and Educational Sciences (UCRC), University of Crete, Rethymno, Greece
| | - Stella G Giakoumaki
- Laboratory of Neuropsychology, Department of Psychology, Faculty of Social Sciences, University of Crete, Rethymno, Greece
- University of Crete Research Center for the Humanities, The Social and Educational Sciences (UCRC), University of Crete, Rethymno, Greece
| |
Collapse
|
4
|
Best MW, Bowie CR. Social exclusion in psychotic disorders: An interactional processing model. Schizophr Res 2022; 244:91-100. [PMID: 35640357 DOI: 10.1016/j.schres.2022.05.016] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 01/11/2022] [Accepted: 05/18/2022] [Indexed: 11/28/2022]
Abstract
Psychotic disorders are among the most highly stigmatized mental disorders, and individuals with psychosis experience significant exclusion from the community. Stigma reduction programs have done little to reduce social exclusion of individuals with psychosis, and there are significant limitations to the traditional stigma model as it applies to social exclusion. Herein, we present the Interactional Processing Model (IPM) of social exclusion towards individuals with psychosis. The IPM considers social exclusion to be the result of two interacting pathways with additional consideration for a feedback loop through which social exclusion sets in motion natural behavioural responses of individuals with psychosis that inadvertently perpetuates exclusion. The IPM considers initial social exclusion to be the result of an interaction between these two pathways. The first path aligns with the traditional stigma model and consists of the community becoming aware that an individual is diagnosed with a psychotic disorder and then excluding the individual based on pre-existing, generalized knowledge about the disorder. The second path to exclusion involves the observation of atypical behaviours from the individual, and generation of an individualized exclusion response. We provide initial empirical support for the IPM of social exclusion, outline testable hypotheses stemming from the model, and discuss implications for novel ways to consider both societal stigma reduction and personalized intervention.
Collapse
Affiliation(s)
- Michael W Best
- Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada.
| | | |
Collapse
|
5
|
Jaya ES, Pillny M, Lincoln TM, Riehle M. Does social defeat cause negative symptoms? A prospective study in a multi-national community sample. Compr Psychiatry 2022; 113:152289. [PMID: 34942483 DOI: 10.1016/j.comppsych.2021.152289] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Revised: 11/19/2021] [Accepted: 11/30/2021] [Indexed: 12/13/2022] Open
Abstract
Psychological models of the consequences of ostracism (i.e. being socially excluded and ignored) and negative symptoms in schizophrenia suggest that repeatedly experiencing ostracism can lead to elevated levels of amotivation, anhedonia, and asociality (i.e. negative symptoms). We tested this assumption in a prospective study, following up a large multi-national community sample from Germany, Indonesia, and the United States (N = 962) every four months over one year. At each of the four assessment points (T0 - T3), participants rated their recent ostracism experiences and negative symptoms. Using cross-lagged panel analyses we found a) that negative symptoms and experiences of ostracism were significantly associated in each of the four assessment points, b) that ostracism predicted negative symptoms over time (T2 to T3), and c) that negative symptoms increased ostracism (T0 to T1). The results are in line with the social defeat model of negative symptoms and suggest a bi-directional longitudinal relationship between ostracism and negative symptoms. Moving forward, it will therefore be important to gain an understanding of potential moderators involved in the mechanism.
Collapse
Affiliation(s)
- Edo S Jaya
- Faculty of Psychology, Universitas Indonesia, Depok, Indonesia; Clinical Psychology and Psychotherapy, Universität Hamburg, Hamburg, Germany.
| | - Matthias Pillny
- Clinical Psychology and Psychotherapy, Universität Hamburg, Hamburg, Germany
| | - Tania M Lincoln
- Clinical Psychology and Psychotherapy, Universität Hamburg, Hamburg, Germany
| | - Marcel Riehle
- Clinical Psychology and Psychotherapy, Universität Hamburg, Hamburg, Germany
| |
Collapse
|
6
|
Lai J, Snyder ME, Vijayakumar KSM, Bailey DH, Martin EA. Shared and unique affective abnormalities in schizotypy dimensions. Psych J 2022; 11:149-162. [PMID: 35001544 DOI: 10.1002/pchj.506] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 10/05/2021] [Accepted: 11/01/2021] [Indexed: 11/10/2022]
Abstract
Attention to affect is theoretically a precursor to one's ideal affect (i.e., preference for feeling low- and high-arousal positive and negative affect) and emotion regulation (ER). In schizotypy, there have been mixed findings regarding abnormalities in attention to affect. At the same time, little is known about ideal affect in schizotypy or whether differences in ideal affect or ER difficulties in schizotypy are driven by attention to affect. Thus, this study aimed to identify shared and unique abnormalities in attention to affect, ideal affect, and ER difficulties in schizotypy, and to test whether attention to affect underlies differences in ideal affect and ER difficulties. Using groups of individuals with either extreme levels of social anhedonia (SocAnh; n = 181), extreme levels of perceptual aberrations/magical ideation (PerMag; n = 105), or individuals low on both (i.e., controls; n = 531), we tested group differences in attention to affect, ideal affect, and ER difficulties. Our findings suggest both shared and unique affective abnormalities; compared to controls, the SocAnh group paid the least attention to positive affect. Only PerMag had heightened attention to negative affect compared to controls. Additionally, we found unique abnormalities relating to ideal affect but mostly shared difficulties in ER in schizotypy. Abnormalities in ideal affect and ER remain largely consistent after accounting for attention to affect for PerMag, suggesting that attention to affect is not the primary mechanism driving these abnormalities. However, we found evidence that attention to affect underlies some SocAnh-control group differences in ideal affect and ER difficulties. Our work helps to clarify prior work and contributes to the understanding of shared and unique affective abnormalities in schizotypy. Future research may consider longitudinal approaches to test causal mechanisms of affective abnormalities in schizotypy.
Collapse
Affiliation(s)
- Jocelyn Lai
- Department of Psychological Science, University of California, Irvine, California, USA
| | - Madeline E Snyder
- Department of Psychological Science, University of California, Irvine, California, USA
| | | | - Drew H Bailey
- School of Education, University of California, Irvine, California, USA
| | - Elizabeth A Martin
- Department of Psychological Science, University of California, Irvine, California, USA
| |
Collapse
|
7
|
Reciprocal Social Behavior and Related Social Outcomes in Individuals at Clinical High Risk for Psychosis. Psychiatry Res 2021; 306:114224. [PMID: 34610542 PMCID: PMC8643304 DOI: 10.1016/j.psychres.2021.114224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/25/2021] [Revised: 09/19/2021] [Accepted: 09/21/2021] [Indexed: 11/20/2022]
Abstract
Reciprocal social behavior (RSB) deficits have been noted in formal psychotic disorders and may play a role in the clinical high-risk for psychosis (CHR) syndrome. The present study examined RSB deficits and clinical and social functioning correlates in 45 individuals meeting criteria for a CHR syndrome and 47 healthy comparisons (HC). Further, this study examined associations with number of friends, problematic social Internet use, and perceived social support. Compared to the HC group, the CHR group exhibited greater deficits in total RSB and in all RSB subdomains. Total RSB deficits were associated with greater negative but not positive symptom severity in the CHR group, and greater social functional impairment. RSB deficits also may have related to fewer friendships, more problematic social Internet use, and less perceived belonging and tangible social support, although relationships with Internet use and perceived social support did not survive FDR-correction. These findings provide further evidence that RSB is impaired in the CHR syndrome and suggest specific social outcomes that may be affected. Further investigations with larger, diverse samples and repeated measures can confirm these findings.
Collapse
|
8
|
Dean DJ, Scott J, Park S. Interpersonal Coordination in Schizophrenia: A Scoping Review of the Literature. Schizophr Bull 2021; 47:1544-1556. [PMID: 34132344 PMCID: PMC8530389 DOI: 10.1093/schbul/sbab072] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Interpersonal coordination forms the natural bridge between the self and others. It arises from the dynamic and complex set of embodied processes that involve nonverbal behaviors, perceptions, movement, and emotions that support adaptive interactions. Disembodiment has been implicated in a myriad of core clinical phenomena that manifest in a "praecox feeling" in persons with schizophrenia during interpersonal interactions. To further understand mechanisms underlying aberrant interpersonal interactions in schizophrenia, recent research has focused on mimicry, imitation, and interactional synchrony. In this study, we conducted a Pubmed, Web of Science, and PsycInfo database review of the literature on interpersonal coordination in schizophrenia to evaluate the body of work in mimicry, imitation, and interactional synchrony in relation to schizophrenia-spectrum conditions. The results of the review suggest that the sensory-motor processes underlying interpersonal coordination may result in impaired abilities to mimic and synchronize nonverbal behavior during interactions. Opportunities for future progress lie in studies of interpersonal coordination at different developmental stages of psychosis, potential use of interpersonal coordination to improve treatment adherence and reduce stigma, as well as interventions to improve social functioning in people with a serious mental illness.
Collapse
Affiliation(s)
- Derek J Dean
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| | - Jason Scott
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| | - Sohee Park
- Department of Psychology, Vanderbilt University, Nashville, TN, USA,To whom correspondence should be addressed; tel: 615-322-3435, e-mail:
| |
Collapse
|
9
|
Minio-Paluello I, Porciello G, Gandolfo M, Boukarras S, Aglioti SM. The enfacement illusion boosts facial mimicry. Cortex 2020; 123:113-123. [DOI: 10.1016/j.cortex.2019.10.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Revised: 08/19/2019] [Accepted: 10/01/2019] [Indexed: 12/19/2022]
|
10
|
Varcin KJ, Nangle MR, Henry JD, Bailey PE, Richmond JL. Intact spontaneous emotional expressivity to non-facial but not facial stimuli in schizophrenia: An electromyographic study. Schizophr Res 2019; 206:37-42. [PMID: 30577992 DOI: 10.1016/j.schres.2018.12.019] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/25/2018] [Revised: 09/12/2018] [Accepted: 12/10/2018] [Indexed: 10/27/2022]
Abstract
Emotional stimuli, such as facial expressions, reliably evoke rapid, spontaneous and covert facial reactions in the perceiver that reflect the affective valence of the observed stimulus. These physiological reactions have been linked to a variety of social cognitive processes known to be disrupted in schizophrenia, such as emotion recognition and affective empathy. Moreover, individuals with schizophrenia exhibit atypical rapid facial reactions when observing emotional expressions. The current study aimed to determine if the disruption in schizophrenia is specific to facial expressions, or instead reflects more generalised emotional or motor impairments in the elicitation of this rapid facial response. Here we quantified activity in the corrugator supercilii and zygomaticus major muscle regions using electromyography while individuals with schizophrenia (n = 24) and controls (n = 21) viewed images of facial and non-facial emotional stimuli. The results indicate that schizophrenia is marked by a disruption in rapid facial responding to facial expressions, but intact responding to non-facial emotional stimuli. This dissociation between the processing of facial and non-facial emotional stimuli points to the need for a greater understanding of the degree to which facial emotion processing impairments contribute to disruptions in mimetic responding in this population.
Collapse
Affiliation(s)
- Kandice J Varcin
- Telethon Kids Institute, Nedlands, Western Australia, Australia.
| | - Matthew R Nangle
- School of Dentistry, University of Queensland, Brisbane, Australia
| | - Julie D Henry
- School of Psychology, University of Queensland, Brisbane, Australia
| | - Phoebe E Bailey
- School of Social Sciences and Psychology, Western Sydney University, Sydney, Australia
| | - Jenny L Richmond
- School of Psychology, University of New South Wales, Sydney, Australia
| |
Collapse
|
11
|
Riehle M, Mehl S, Lincoln TM. The specific social costs of expressive negative symptoms in schizophrenia: reduced smiling predicts interactional outcome. Acta Psychiatr Scand 2018; 138:133-144. [PMID: 29667181 DOI: 10.1111/acps.12892] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/26/2018] [Indexed: 12/21/2022]
Abstract
OBJECTIVE We tested whether people with schizophrenia and prominent expressive negative symptoms (ENS) show reduced facial expressions in face-to-face social interactions and whether this expressive reduction explains negative social evaluations of these persons. METHOD We compared participants with schizophrenia with high ENS (n = 18) with participants with schizophrenia with low ENS (n = 30) and with healthy controls (n = 39). Participants engaged in an affiliative role-play that was coded for the frequency of positive and negative facial expression and rated for social performance skills and willingness for future interactions with the respective role-play partner. RESULTS Participants with schizophrenia with high ENS showed significantly fewer positive facial expressions than those with low ENS and controls and were also rated significantly lower on social performance skills and willingness for future interactions. Participants with schizophrenia with low ENS did not differ from controls on these measures. The group difference in willingness for future interactions was significantly and independently mediated by the reduced positive facial expressions and social performance skills. CONCLUSION Reduced facial expressiveness in schizophrenia is specifically related to ENS and has negative social consequences. These findings highlight the need to develop aetiological models and targeted interventions for ENS and its social consequences.
Collapse
Affiliation(s)
- M Riehle
- Institute of Psychology, Clinical Psychology & Psychotherapy, University of Hamburg, Hamburg, Germany
| | - S Mehl
- Department of Psychiatry and Psychotherapy & Marburg Center for Mind, Brain and Behavior (MCMBB), University of Marburg, Marburg, Germany.,Department of Health & Social Work, University of Applied Sciences, Frankfurt, Germany
| | - T M Lincoln
- Institute of Psychology, Clinical Psychology & Psychotherapy, University of Hamburg, Hamburg, Germany
| |
Collapse
|