1
|
Abo Foul Y, Arkadir D, Demikhovskaya A, Noyman Y, Linetsky E, Abu Snineh M, Aviezer H, Eitan R. Perception of emotionally incongruent cues: evidence for overreliance on body vs. face expressions in Parkinson's disease. Front Psychol 2024; 15:1287952. [PMID: 38770252 PMCID: PMC11103677 DOI: 10.3389/fpsyg.2024.1287952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Accepted: 04/08/2024] [Indexed: 05/22/2024] Open
Abstract
Individuals with Parkinson's disease (PD) may exhibit impaired emotion perception. However, research demonstrating this decline has been based almost entirely on the recognition of isolated emotional cues. In real life, emotional cues such as expressive faces are typically encountered alongside expressive bodies. The current study investigated emotion perception in individuals with PD (n = 37) using emotionally incongruent composite displays of facial and body expressions, as well as isolated face and body expressions, and congruent composite displays as a baseline. In addition to a group of healthy controls (HC) (n = 50), we also included control individuals with schizophrenia (SZ) (n = 30), who display, as in PD, similar motor symptomology and decreased emotion perception abilities. The results show that individuals with PD showed an increased tendency to categorize incongruent face-body combinations in line with the body emotion, whereas those with HC showed a tendency to classify them in line with the facial emotion. No consistent pattern for prioritizing the face or body was found in individuals with SZ. These results were not explained by the emotional recognition of the isolated cues, cognitive status, depression, or motor symptoms of individuals with PD and SZ. As real-life expressions may include inconsistent cues in the body and face, these findings may have implications for the way individuals with PD and SZ interpret the emotions of others.
Collapse
Affiliation(s)
- Yasmin Abo Foul
- Department of Psychology, Hebrew University of Jerusalem, Jerusalem, Israel
- Brain Division, Hadassah-Hebrew University Medical Center, Jerusalem, Israel
| | - David Arkadir
- Brain Division, Hadassah-Hebrew University Medical Center, Jerusalem, Israel
| | - Anastasia Demikhovskaya
- Neuropsychiatry Unit, Jerusalem Mental Health Center, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Yehuda Noyman
- Neuropsychiatry Unit, Jerusalem Mental Health Center, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Eduard Linetsky
- Brain Division, Hadassah-Hebrew University Medical Center, Jerusalem, Israel
| | - Muneer Abu Snineh
- Brain Division, Hadassah-Hebrew University Medical Center, Jerusalem, Israel
| | - Hillel Aviezer
- Department of Psychology, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Renana Eitan
- Brain Division, Hadassah-Hebrew University Medical Center, Jerusalem, Israel
- Neuropsychiatry Unit, Jerusalem Mental Health Center, Hebrew University of Jerusalem, Jerusalem, Israel
- Department of Medical Neurobiology (Physiology), Institute for Medical Research Israel-Canada, Hebrew University-Hadassah Medical School, Jerusalem, Israel
- Department of Psychiatry, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
2
|
Lin Y, Li C, Hu R, Zhou L, Ding H, Fan Q, Zhang Y. Impaired emotion perception in schizophrenia shows sex differences with channel- and category-specific effects: A pilot study. J Psychiatr Res 2023; 161:150-157. [PMID: 36924569 DOI: 10.1016/j.jpsychires.2023.03.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Revised: 02/28/2023] [Accepted: 03/02/2023] [Indexed: 03/18/2023]
Abstract
Individuals with schizophrenia reportedly demonstrate deficits in emotion perception. Relevant studies on the effects of decoder's sex, communication channels and emotion categories have produced mixed findings and seldom explored the interactions among these three key factors. The present pilot study examined how male and female individuals with schizophrenia and healthy controls perceived emotional (e.g., angry, happy, and sad) and neutral expressions from verbal semantic and nonverbal prosodic and facial channels. Twenty-eight (11 females) individuals with schizophrenia and 30 healthy controls (13 females) were asked to recognize emotional facial expressions, emotional prosody, and emotional semantics. Both accuracy and response time showed subpar performance for all communication channels and emotional categories in the schizophrenia group. More severe emotion perception deficits were found with the nonverbal (not the verbal) materials. There was also a reduced level of impairment with anger perception, especially in the female individuals with schizophrenia while biased perception towards emotional semantics was more pronounced in male individuals with schizophrenia. These findings, although preliminary, indicate the channel- and category-specific nature of emotion perception with potential sex differences among people with schizophrenia, which has important theoretical and practical implications.
Collapse
Affiliation(s)
- Yi Lin
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, 800 Dong Chuan Rd., Minhang District, Shanghai, 200240, China.
| | - Chuoran Li
- Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Ruozhen Hu
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, 800 Dong Chuan Rd., Minhang District, Shanghai, 200240, China
| | - Leqi Zhou
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, 800 Dong Chuan Rd., Minhang District, Shanghai, 200240, China
| | - Hongwei Ding
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, 800 Dong Chuan Rd., Minhang District, Shanghai, 200240, China.
| | - Qing Fan
- Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China; Shanghai Key Laboratory of Psychotic Disorders, Shanghai, China.
| | - Yang Zhang
- Department of Speech-Language-Hearing Science & Masonic Institute for the Developing Brain, University of Minnesota, USA.
| |
Collapse
|
3
|
Arias Sarah P, Hall L, Saitovitch A, Aucouturier JJ, Zilbovicius M, Johansson P. Pupil dilation reflects the dynamic integration of audiovisual emotional speech. Sci Rep 2023; 13:5507. [PMID: 37016041 PMCID: PMC10073148 DOI: 10.1038/s41598-023-32133-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 03/22/2023] [Indexed: 04/06/2023] Open
Abstract
Emotional speech perception is a multisensory process. When speaking with an individual we concurrently integrate the information from their voice and face to decode e.g., their feelings, moods, and emotions. However, the physiological reactions-such as the reflexive dilation of the pupil-associated to these processes remain mostly unknown. That is the aim of the current article, to investigate whether pupillary reactions can index the processes underlying the audiovisual integration of emotional signals. To investigate this question, we used an algorithm able to increase or decrease the smiles seen in a person's face or heard in their voice, while preserving the temporal synchrony between visual and auditory channels. Using this algorithm, we created congruent and incongruent audiovisual smiles, and investigated participants' gaze and pupillary reactions to manipulated stimuli. We found that pupil reactions can reflect emotional information mismatch in audiovisual speech. In our data, when participants were explicitly asked to extract emotional information from stimuli, the first fixation within emotionally mismatching areas (i.e., the mouth) triggered pupil dilation. These results reveal that pupil dilation can reflect the dynamic integration of audiovisual emotional speech and provide insights on how these reactions are triggered during stimulus perception.
Collapse
Affiliation(s)
- Pablo Arias Sarah
- Lund University Cognitive Science, Lund University, Lund, Sweden.
- STMS Lab, UMR 9912 (IRCAM/CNRS/SU), Paris, France.
- School of Neuroscience and Psychology, Glasgow University, Glasgow, UK.
| | - Lars Hall
- STMS Lab, UMR 9912 (IRCAM/CNRS/SU), Paris, France
| | - Ana Saitovitch
- U1000 Brain Imaging in Psychiatry, INSERM-CEA, Pediatric Radiology Service, Necker Enfants Malades Hospital, Paris V René Descartes University, Paris, France
| | - Jean-Julien Aucouturier
- Department of Robotics and Automation FEMTO-ST Institute (CNRS/Université de Bourgogne Franche Comté), Besançon, France
| | - Monica Zilbovicius
- U1000 Brain Imaging in Psychiatry, INSERM-CEA, Pediatric Radiology Service, Necker Enfants Malades Hospital, Paris V René Descartes University, Paris, France
| | | |
Collapse
|
4
|
Lado-Codesido M, Rey Varela RM, Larios Quiñones M, Martínez Agulleiro L, Ossa Basanes J, Martínez Querol M, Mateos R, Spuch C, García-Caballero A. Voices 2: Improving Prosodic Recognition in Schizophrenia With an Online Rehabilitation Program. Front Psychol 2022; 12:739252. [PMID: 35002838 PMCID: PMC8739759 DOI: 10.3389/fpsyg.2021.739252] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Accepted: 11/22/2021] [Indexed: 11/13/2022] Open
Abstract
Introduction: Emotion recognition of voices may play an important role in interpersonal communication and patients with schizophrenia present alterations in this regard. Several on-line rehabilitation tools have been developed for treatment in this area. Voices is an on-line prosodic recognition program consisting of identifying different emotional tones in neutral phrases, in different sessions of gradually increasing difficulty. This training tool has previously reported benefits, and a new version has been created called Voices 2. The main aim of this study is to test the capacity of the Voices 2 program to improve emotion recognition through prosody for adults with schizophrenia. Secondly, it seeks to observe durability effects 1 month after intervention. Method: A randomized, single-blind, multicenter clinical trial was conducted with 44 outpatients diagnosed with schizophrenia or schizoaffective disorder. The intervention group (also called Voices) was treated with Voices 2, whereas the control group was treated with auditory training that was not related to emotions. Sociodemographic and clinical data, clinical state (PANSS), Intelligence Quotient and prosodic recognition (RMV-SV) were measured at baseline. After intervention, RMV-SV and PANSS were assessed. One month later, the RMV-SV measure was repeated. Results: The control group (n = 19) and the Voices group (n = 22) did not differ on χ2, t or U tests in sociodemographic, clinical and psychometric variables at baseline or post-intervention (all p-values > 0.05). In the Voices group, statistically significant differences were observed in the RMV-SV scale applied post-intervention vs. that applied pre-intervention (Z = 2.47, p = 0.013). Similar results were observed in the 1-month follow-up RMV-SV vs. the pre-intervention RMV-SV (Z = 1.97, p = 0.049). PANSS scale was also assessed with no significant differences between pre vs. post measures in both groups. Lastly, Voices 2 was rated relatively higher, based on its ease of understanding, entertainment value, usefulness and the appropriateness of use of its emotional glossary. Discussion: Improvements were observed in prosodic recognition following intervention with Voices 2 in the Voices group. Although these results are similar to other clinical trial rehabilitation programs, specific research on the matter remains scarce. Certain aspects, such as the durability of effects or adherence should be thoroughly studied and clarified. Clinical Trial Registration: [https://doi.org/10.17605/OSF.IO/G95C4].
Collapse
Affiliation(s)
- María Lado-Codesido
- University of Santiago de Compostela, Santiago de Compostela, Spain.,Department of Psychiatry, Donostia University Hospital, San Sebastián, Spain
| | | | - Marina Larios Quiñones
- Centro de Rehabilitación Laboral "Nueva Vida," Red Pública de Atención Social a Personas con Enfermedad Mental Grave y Duradera, Consejería de Políticas Sociales, Familias, Igualdad y Natalidad, Asociación Psiquiatría y Vida, Madrid, Spain
| | | | | | | | - Raimundo Mateos
- Department of Psychiatry, University of Santiago de Compostela, Santiago de Compostela, Spain
| | - Carlos Spuch
- Translational Neuroscience Research Group, Galicia Sur Health Research Institute, University of Vigo, CIBERSAM, Vigo, Spain
| | - Alejandro García-Caballero
- Translational Neuroscience Research Group, Galicia Sur Health Research Institute, University of Vigo, CIBERSAM, Vigo, Spain.,Department of Psychiatry, University Hospital Complex of Ourense, Ourense, Spain
| |
Collapse
|
5
|
Lin Y, Ding H, Zhang Y. Gender Differences in Identifying Facial, Prosodic, and Semantic Emotions Show Category- and Channel-Specific Effects Mediated by Encoder's Gender. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2021; 64:2941-2955. [PMID: 34310173 DOI: 10.1044/2021_jslhr-20-00553] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Purpose The nature of gender differences in emotion processing has remained unclear due to the discrepancies in existing literature. This study examined the modulatory effects of emotion categories and communication channels on gender differences in verbal and nonverbal emotion perception. Method Eighty-eight participants (43 females and 45 males) were asked to identify three basic emotions (i.e., happiness, sadness, and anger) and neutrality encoded by female or male actors from verbal (i.e., semantic) or nonverbal (i.e., facial and prosodic) channels. Results While women showed an overall advantage in performance, their superiority was dependent on specific types of emotion and channel. Specifically, women outperformed men in regard to two basic emotions (happiness and sadness) in the nonverbal channels and only the anger category with verbal content. Conversely, men did better for the anger category in the nonverbal channels and for the other two emotions (happiness and sadness) in verbal content. There was an emotion- and channel-specific interaction effect between the two types of gender differences, with male subjects showing higher sensitivity to sad faces and prosody portrayed by the female encoders. Conclusion These findings reveal explicit emotion processing as a highly dynamic complex process with significant gender differences tied to specific emotion categories and communication channels. Supplemental Material https://doi.org/10.23641/asha.15032583.
Collapse
Affiliation(s)
- Yi Lin
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, Shanghai, China
| | - Hongwei Ding
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, Shanghai, China
| | - Yang Zhang
- Department of Speech-Language-Hearing Sciences & Center for Neurobehavioral Development, University of Minnesota Twin Cities, Minneapolis
| |
Collapse
|
6
|
Portnova GV, Maslennikova AV, Zakharova NV, Martynova OV. The Deficit of Multimodal Perception of Congruent and Non-Congruent Fearful Expressions in Patients with Schizophrenia: The ERP Study. Brain Sci 2021; 11:96. [PMID: 33451054 PMCID: PMC7828540 DOI: 10.3390/brainsci11010096] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 01/06/2021] [Accepted: 01/07/2021] [Indexed: 11/16/2022] Open
Abstract
Emotional dysfunction, including flat affect and emotional perception deficits, is a specific symptom of schizophrenia disorder. We used a modified multimodal odd-ball paradigm with fearful facial expressions accompanied by congruent and non-congruent emotional vocalizations (sounds of women screaming and laughing) to investigate the impairment of emotional perception and reactions to other people's emotions in schizophrenia. We compared subjective ratings of emotional state and event-related potentials (EPPs) in response to congruent and non-congruent stimuli in patients with schizophrenia and healthy controls. The results showed the altered multimodal perception of fearful stimuli in patients with schizophrenia. The amplitude of N50 was significantly higher for non-congruent stimuli than congruent ones in the control group and did not differ in patients. The P100 and N200 amplitudes were higher in response to non-congruent stimuli in patients than in controls, implying impaired sensory gating in schizophrenia. The observed decrease of P3a and P3b amplitudes in patients could be associated with less attention, less emotional arousal, or incorrect interpretation of emotional valence, as patients differed from healthy controls in the emotion scores of non-congruent stimuli. The difficulties in identifying the incoherence of facial and audial components of emotional expression could be significant in understanding the psychopathology of schizophrenia.
Collapse
Affiliation(s)
- Galina V. Portnova
- Institute of Higher Nervous Activity and Neurophysiology of RAS, 117485 Moscow, Russia; (A.V.M.); (O.V.M.)
- The Pushkin State Russian Language Institute, 117485 Moscow, Russia
| | - Aleksandra V. Maslennikova
- Institute of Higher Nervous Activity and Neurophysiology of RAS, 117485 Moscow, Russia; (A.V.M.); (O.V.M.)
- Psychiatric Clinical Hospital No. 1 Named after ON. Alekseeva of the Moscow City Health Department, 117152 Moscow, Russia;
| | - Natalya V. Zakharova
- Psychiatric Clinical Hospital No. 1 Named after ON. Alekseeva of the Moscow City Health Department, 117152 Moscow, Russia;
| | - Olga V. Martynova
- Institute of Higher Nervous Activity and Neurophysiology of RAS, 117485 Moscow, Russia; (A.V.M.); (O.V.M.)
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 109548 Moscow, Russia
| |
Collapse
|
7
|
Jeong JW, Kim HT, Lee SH, Lee H. Effects of an Audiovisual Emotion Perception Training for Schizophrenia: A Preliminary Study. Front Psychiatry 2021; 12:522094. [PMID: 34025462 PMCID: PMC8131526 DOI: 10.3389/fpsyt.2021.522094] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2019] [Accepted: 03/18/2021] [Indexed: 11/13/2022] Open
Abstract
Individuals with schizophrenia show a reduced ability to integrate facial and vocal information in emotion perception. Although emotion perception has been a target for treatment, no study has yet examined the effect of multimodal training on emotion perception in schizophrenia. In the present study, we developed an audiovisual emotion perception training and test in which a voice and a face were simultaneously presented, and subjects were asked to judge whether the emotions of the voice and the face matched. The voices were either angry or happy, and the faces were morphed on a continuum ranging from angry to happy. Sixteen patients with schizophrenia participated in six training sessions and three test sessions (i.e., pre-training, post-training, and generalization). Eighteen healthy controls participated only in pre-training test session. Prior to training, the patients with schizophrenia performed significantly worse than did the controls in the recognition of anger; however, following the training, the patients showed a significant improvement in recognizing anger, which was maintained and generalized to a new set of stimuli. The patients also improved the recognition of happiness following the training, but this effect was not maintained or generalized. These results provide preliminary evidence that a multimodal, audiovisual training may yield improvements in anger perception for patients with schizophrenia.
Collapse
Affiliation(s)
- Ji Woon Jeong
- Department of Psychology, Korea University, Seoul, South Korea
| | - Hyun Taek Kim
- Department of Psychology, Korea University, Seoul, South Korea
| | - Seung-Hwan Lee
- Department of Psychiatry, Ilsan-Paik Hospital, Inje University, Goyang, South Korea
| | - Hyejeen Lee
- Department of Psychology, Chonnam National University, Gwangju, South Korea
| |
Collapse
|