Specificity of facial emotion recognition impairments in patients with multi-episode schizophrenia

Development and Validation of the Emotion Laden Sentences Toolbox for Emotion Recognition (ELSTER)

Introduction

Emotion recognition plays a crucial role in our social interactions and overall well-being. The present cross-sectional study aimed to develop and validate Emotion Laden Sentences Toolbox for Emotion Recognition (ELSTER), that utilizes emotion-laden sentences as stimuli to assess individuals' ability to perceive and identify emotions conveyed through written language.

Methods

In Phase I, a comprehensive set of emotion-laden sentences in English language were validated by 25 (eight males and 17 females) qualified mental health professionals (MHPs). In Phase II, the sentences that received high interrater agreement in Phase I were selected and then a Hindi version of the same sentences was also developed. The English and Hindi database was then validated among 50 healthy individuals (30 males and 20 females).

Results

The percentage hit rate for all the emotions after exclusion of contempt was 84.3% with a mean kappa for emotional expression being 0.67 among MHPs. The percentage hit rate of all emotion-laden sentences across the database was 81.43% among healthy lay individuals. The mean hit rate percentage for English sentences was similar to Hindi sentences with a mean kappa for emotional expression being 0.63 for the combined English and Hindi sentences.

Conclusion

The ELSTER database would be useful in the Indian context for researching textual emotion recognition. It has been validated among a group of experts as well as healthy lay individuals and was found to have high inter-rater reliability.

Facial emotion-recognition deficits in patients with schizophrenia and unaffected first-degree relatives

Introduction

This study aimed to determine trait- and state-dependent markers of schizophrenia by investigating facial emotion-recognition (FER) deficits in remitted patients with schizophrenia and their first-degree relatives (FR).

Methods

Three groups were included: the Schizophrenia group (n=66), their unaffected FR group (n=40), and healthy controls (n=50) who were matched for age, sex, and years of education. A facial-labeling task was used to examine FER deficits using the following eight standardized expressions: happy, fearful, disgusted, angry, sad, contemptuous, surprised, and neutral.

Results

There was a poorer accuracy in the recognition of sadness and anger in the Schizophrenia group as well as in contempt in both the Schizophrenia and FR groups compared with healthy controls. The response times for the recognition of contempt, sadness, and neutral emotion were delayed in the Schizophrenia group and those for fear were delayed in the Schizophrenia and FR groups compared with healthy controls.

Conclusion

Concerning the accuracy in FER, sadness and anger can be considered state-dependent markers of remitted schizophrenia, and contempt is a trait-dependent marker of schizophrenia. Similarly, for response times in FER, contempt, sadness, and neutral emotion can be considered state-dependent markers of remitted schizophrenia, while fear is considered a trait-dependent marker of schizophrenia. These findings may contribute to the early diagnosis of schizophrenia and the development of relevant therapeutic interventions.

Humanoid facial expressions as a tool to study human behaviour

Besides action vitality forms, facial expressions represent another fundamental social cue which enables to infer the affective state of others. In the present study, we proposed the iCub robot as an interactive and controllable agent to investigate whether and how different facial expressions, associated to different action vitality forms, could modulate the motor behaviour of participants. To this purpose, we carried out a kinematic experiment in which 18 healthy participants observed video-clips of the iCub robot performing a rude or gentle request with a happy or angry facial expression. After this request, they were asked to grasp an object and pass it towards the iCub robot. Results showed that the iCub facial expressions significantly modulated participants motor response. Particularly, the observation of a happy facial expression, associated to a rude action, decreased specific kinematic parameters such as velocity, acceleration and maximum height of movement. In contrast, the observation of an angry facial expression, associated to a gentle action, increased the same kinematic parameters. Moreover, a behavioural study corroborated these findings, showing that the perception of the same action vitality form was modified when associated to a positive or negative facial expression.

Specific facial emotion recognition deficits across the course of psychosis: A comparison of individuals with low-risk, high-risk, first-episode psychosis and multi-episode schizophrenia-spectrum disorders

Our study aimed to explore the recognition of specific emotions across the course of psychosis. A visual task representing the six basic emotions was used to assess facial emotion recognition (FER) in 204 healthy controls classified into 152 low-risk (LR) and 52 high-risk for psychosis (HR), following a psychometric risk approach; and 100 patients: 44 with first-episode psychosis (FEP) and 56 with multi-episode schizophrenia-spectrum disorders (MES). First, we performed a MANCOVA to compare the four conditions. Next, we conducted a logistic regression to explore whether specific FER deficits predicted the presence of psychosis. Finally, we investigated the relationships of FER with psychosis-like experiences (PLEs) and psychotic symptoms. Global FER, anger and fear recognition were impaired in HR, FEP and MES. No differences between HR and FEP appeared. Moreover, fear and anger correctly classified 83% of individuals into LR or psychosis. FER was associated with PLEs and psychotic symptoms. Concluding, FER is early impaired in HR individuals and increases along the psychosis continuum. However, fear recognition is similarly impaired throughout the illness, suggesting a possible vulnerability marker. Furthermore, deficits in anger and fear recognition predicted the presence of psychosis. Therefore, we suggest that FER may be essential in detecting psychosis risk.

Real-time facial emotion recognition deficits across the psychosis spectrum: A B-SNIP Study

Affective and non-affective psychotic disorders are associated with variable levels of impairment in affective processing, but this domain typically has been examined via presentation of static facial images. We compared performance on a dynamic facial expression identification task across six emotions (sad, fear, surprise, disgust, anger, happy) in individuals with psychotic disorders (bipolar with psychotic features [PBD] = 113, schizoaffective [SAD] = 163, schizophrenia [SZ] = 181) and healthy controls (HC; n = 236) derived from the Bipolar-Schizophrenia Network on Intermediate Phenotypes (B-SNIP). These same individuals with psychotic disorders were also grouped by B-SNIP-derived Biotype (Biotype 1 [B1] = 115, Biotype 2 [B2] = 132, Biotype 3 [B3] = 158), derived from a cluster analysis applied to a large biomarker panel that did not include the current data. Irrespective of the depicted emotion, groups differed in accuracy of emotion identification (P < 0.0001). The SZ group demonstrated lower accuracy versus HC and PBD groups; the SAD group was less accurate than the HC group (Ps < 0.02). Similar overall group differences were evident in speed of identifying emotional expressions. Controlling for general cognitive ability did not eliminate most group differences on accuracy but eliminated almost all group differences on reaction time for emotion identification. Results from the Biotype groups indicated that B1 and B2 had more severe deficits in emotion recognition than HC and B3, meanwhile B3 did not show significant deficits. In sum, this characterization of facial emotion recognition deficits adds to our emerging understanding of social/emotional deficits across the psychosis spectrum.

Socioemotional mechanisms of loneliness in subclinical psychosis

Loneliness is an important predictor of physical and mental health in the general population and in individuals across the psychosis spectrum, including those experiencing subclinical psychotic-like experiences (PLEs). However, the mechanisms underlying loneliness in the psychosis spectrum are not well understood. Emotion processing deficits are well described across the psychosis spectrum, and socioemotional processing biases are critical for the development and maintenance of loneliness through altered social appraisal, including judgements of rejection. Therefore, we propose that PLEs are associated with increased loneliness, and the relationship is mediated by alterations in socioemotional processing. We also explored how this pathway may be affected by mood and anxiety symptoms, which have been associated with loneliness across the psychosis spectrum. As part of the Human Connectome Project, generally healthy adults (n = 1180) reported symptomatology and social functioning and completed the Penn Emotion Recognition Task to assess efficiency in identifying emotions. We found that higher reported PLEs were associated with elevated levels of loneliness and perceived rejection and that these factors were linked by multiple independent pathways. First, anxiety/depression and emotion processing efficiency independently mediated the PLE-loneliness relationship. Second, we found that the association between PLEs and loneliness was serially mediated through inefficient emotion recognition then higher levels of perceived rejection. These separable mechanisms of increased loneliness in subclinical psychosis have implications for treatment and continued study of social functioning in the psychosis spectrum.

Dynamics of facial actions for assessing smile genuineness

Applying computer vision techniques to distinguish between spontaneous and posed smiles is an active research topic of affective computing. Although there have been many works published addressing this problem and a couple of excellent benchmark databases created, the existing state-of-the-art approaches do not exploit the action units defined within the Facial Action Coding System that has become a standard in facial expression analysis. In this work, we explore the possibilities of extracting discriminative features directly from the dynamics of facial action units to differentiate between genuine and posed smiles. We report the results of our experimental study which shows that the proposed features offer competitive performance to those based on facial landmark analysis and on textural descriptors extracted from spatial-temporal blocks. We make these features publicly available for the UvA-NEMO and BBC databases, which will allow other researchers to further improve the classification scores, while preserving the interpretation capabilities attributed to the use of facial action units. Moreover, we have developed a new technique for identifying the smile phases, which is robust against the noise and allows for continuous analysis of facial videos.

Facial Emotion Recognition in Schizophrenia

Deficits in facial emotion recognition are one of the most common cognitive impairments, and they have been extensively studied in various psychiatric disorders, especially in schizophrenia. However, there is still a lack of conclusive evidence about the factors associated with schizophrenia and impairment at each stage of the disease, which poses a challenge to the clinical management of patients. Based on this, we summarize facial emotion cognition among patients with schizophrenia, introduce the internationally recognized Bruce-Young face recognition model, and review the behavioral and event-related potential studies on the recognition of emotions at each stage of the face recognition process, including suggestions for the future direction of clinical research to explore the underlying mechanisms of schizophrenia.

Multisensory Integration of Emotion in Schizophrenic Patients

Multisensory integration (MSI) of emotion has been increasingly recognized as an essential element of schizophrenic patients' impairments, leading to the breakdown of their interpersonal functioning. The present review provides an updated synopsis of schizophrenics' MSI abilities in emotion processing by examining relevant behavioral and neurological research. Existing behavioral studies have adopted well-established experimental paradigms to investigate how participants understand multisensory emotion stimuli, and interpret their reciprocal interactions. Yet it remains controversial with regard to congruence-induced facilitation effects, modality dominance effects, and generalized vs specific impairment hypotheses. Such inconsistencies are likely due to differences and variations in experimental manipulations, participants' clinical symptomatology, and cognitive abilities. Recent electrophysiological and neuroimaging research has revealed aberrant indices in event-related potential (ERP) and brain activation patterns, further suggesting impaired temporal processing and dysfunctional brain regions, connectivity and circuities at different stages of MSI in emotion processing. The limitations of existing studies and implications for future MSI work are discussed in light of research designs and techniques, study samples and stimuli, and clinical applications.

A new measure of authentic auditory emotion recognition: Application to patients with schizophrenia

BACKGROUND

Many social processes such as emotion recognition are severely impaired in patients with schizophrenia. While basic auditory processing seems to play a key role in identifying emotions, research in this field is limited due to the lack of proper assessment batteries. Many of the widely accepted tests utilize actors to portray certain emotions-these batteries are less ecologically and face valid.

METHODS

This study utilized a newly developed auditory emotion recognition test that contained natural stimuli from spontaneous displays of emotions to assess 28 patients with schizophrenia and 16 healthy controls.

RESULTS

The results indicate that the newly developed test, referred to as the INTONATION Test, is more sensitive to the emotion recognition deficits in patients with schizophrenia than previously used measures. The correlations of the INTONATION Test measures with basic auditory processes were similar to established tests of auditory emotion. Particular emotion sub scores from the INTONTATION test, such as happiness, demonstrated the strongest correlations with specific auditory processing skills, such as formant discrimination and sinusoidal amplitude modulation detection (SAM60).

CONCLUSIONS

The results from this study indicate that auditory emotion recognition impairments are more pronounced in patients with schizophrenia when perceiving authentic displays of emotion. Understanding these deficits could help specify the nature of auditory emotion recognition deficits in patients with schizophrenia and those at risk.

Negative and Neutral Valences of Affective Theory of Mind are More Impaired than Positive Valence in Clinically Stable Schizophrenia Patients

OBJECTIVE

People with schizophrenia show impairment in social cognition, such as emotion recognition and theory of mind. The current study aims to compare the ability of clinically stable schizophrenia patients to decode the positive, negative and neutral affective mental state of others with educational match-paired normal control.

METHODS

50 people with schizophrenia and 50 matched controls were compared on the positive, negative and neutral emotional valence of affective theory of mind using the Reading the Mind in the Eyes Tests.

RESULTS

The results showed that people with schizophrenia performed worse in negative and neutral emotional valence than normal controls; however, no significant differences in decoding positive valence were found.

CONCLUSION

Our data suggest that there is variability in the performance of affective theory of mind according to emotion valence; the impairments seem to be specific to only negative and neutral emotions, but not positive ones.

A Short Empathy Paradigm to Assess Empathic Deficits in Schizophrenia

Empathy is important for successful social interaction and maintaining relationships. Several studies detected impairments in empathic abilities in schizophrenia, with some even indicating a broader deficit in several components, including emotion recognition, perspective taking, and affective responsiveness. The aim of our study was to validate a short version of the previous empathy paradigm as a reliable and easily applicable method to assess empathic deficits in patients with schizophrenia potentially within clinical routine. To do so, we applied the short version to 30 patients (14 females) diagnosed with schizophrenia meeting the DSM-5 criteria and 30 well-matched healthy controls (14 females). The data analysis indicates a significant empathic deficit in patients due to worse performance in all three domains. We managed to replicate most of the findings of our previous study. In contrary to the previous study, significant correlations between performance in the empathy tasks and psychopathology occurred: the severity of negative symptoms was negatively associated with performance in the emotion recognition task and the affective responsiveness task. Gender did not significantly affect performance in the empathy tasks. Regarding the results, our short empathy paradigm appears to be a valid method in assessing empathic impairments in schizophrenia that may be useful in clinical routine.

The Longitudinal Association Between Preadolescent Facial Emotion Identification and Family Factors, and Psychotic Experiences in Adolescence (The TRAILS Study)

The current study examines whether facial emotion identification and family factors at preadolescence (age 11) predict psychotic experiences 5 years later during adolescence (age 16) and whether family factors may mediate the association between facial emotion identification and psychotic experiences. Data was obtained from the epidemiological cohort TRAILS (N = 2059). At preadolescence, a facial emotion identification test and three questionnaires to assess family functioning, perceived parenting styles and parenting stress, were administered. At adolescence, a questionnaire on psychotic experiences was administered. Facial emotion identification at preadolescence was not associated with psychotic experiences at adolescence, and the mediational role of family functioning was not further explored. However, increased overprotective parenting at preadolescence was associated with a higher frequency of psychotic experiences and delusions at adolescence. Future research may examine the mechanism behind the role of overprotective parenting on psychotic experiences during adolescence.

The Attenuated Psychosis Syndrome and Facial Affect Processing in Adolescents With and Without Autism

BACKGROUND

Autism and schizophrenia spectrum disorders both represent severely disabling neurodevelopmental disorders with marked impairments in social functioning. Despite an increased incidence of psychosis in autism, and substantial overlap in symptoms and cognitive markers, it is unclear whether such phenotypes are specifically related to risk for psychosis or perhaps reflect more general, idiosyncratic autism traits. The attenuated psychosis syndrome (APS) is primarily defined by the presence of attenuated psychotic symptoms, which currently constitute the best and most-replicated clinical predictors of psychosis, and are common in clinical youth with and without autism. The aims of this study were to test the hypothesis that facial affect processing is impaired in adolescents with APS and to explore whether such deficits are more indicative of psychotic or autistic phenotypes on a categorical and dimensional level.

MATERIALS AND METHOD

Fifty-three adolescents with APS and 81 typically developing controls (aged 12-18) were included. The APS group consisted of adolescents with (n = 21) and without (n = 32) a diagnosis of autism spectrum disorder. Facial affect recognition was assessed with the Amsterdam Neuropsychological Tasks using a cascade model of cognitive processing, in which disturbances in "lower-level" cognitive abilities (pattern recognition), affect "higher-level" cognitive processes (face recognition and facial affect recognition). For associations with schizotypal and autistic-like traits the Schizotypal Personality Questionnaire and Social Communication Questionnaire were used in a confirmatory item factor analysis framework.

RESULTS

Contrary to expectation, APS in adolescents was not associated with impairments in pattern, face, or facial affect recognition. However, the APS group with autism spectrum disorder showed a general latency in response time to social and non-social stimuli. Dimensionally assessed schizotypal and autistic-like traits did not predict the accuracy or the speed of face or facial affect recognition.

CONCLUSION

Facial affect processing performance was not associated with APS in adolescence and represents an unlikely early vulnerability marker for psychosis. APS individuals with a more autistic-like profile were characterized by slower responses to social- and non-social stimuli, suggesting that the combined effect of APS and autism spectrum disorder on cognition is larger than for APS alone.

Facial Emotion Recognition: Virtual Reality Program for Facial Emotion Recognition—A Trial Program Targeted at Individuals With Schizophrenia

People with severe mental illness (SMI), schizophrenia in particular, show considerable functional impairment in emotional recognition and social perception, which negatively affects interpersonal relationships and social functioning. Owing to its ecological validity, virtual reality (VR) has been observed to improve both assessment and training of emotional recognition skills of people with SMI. This article includes two studies: (a) a descriptive study on the Virtual Reality program for Facial Emotion Recognition (VR-FER) and (b) an empirical study that presents the results of the application of the VR-FER’s first module. For the second study, data were collected using two samples: a group of 12 people with schizophrenia and a reference group of 12 people who were mentally healthy. Data analysis comprised descriptive (mean, standard deviation) and inferential statistics (Mann–Whitney U test). Results showed that the first group presented a lower number of correct answers and a higher number of incorrect answers compared with the second group regarding facial emotion recognition (FER), thereby confirming the need to develop strategies to improve emotional recognition and social perception in people with schizophrenia. VR-FER is regarded a strategic training program for FER, using latest technology and following rehabilitation guidelines for SMI.

Effects of acute alcohol consumption on emotion recognition in social alcohol drinkers

BACKGROUND

Research suggests that acute alcohol consumption alters recognition of emotional expressions. Extending this work, we investigated the effects of alcohol on recognition of six primary expressions of emotion.

METHODS

We conducted two studies using a 2 × 6 experimental design with a between-subjects factor of drink (alcohol, placebo) and a within-subjects factor of emotion (anger, disgust, sadness, surprise, happiness, fear). Study one ( n = 110) was followed by a direct replication study ( n = 192). Participants completed a six alternative forced choice emotion recognition task following consumption of 0.4 g/kg alcohol or placebo. Dependent variables were recognition accuracy (i.e. hits) and false alarms.

RESULTS

There was no clear evidence of differences in recognition accuracy between groups ( ps > .58). In study one, there were more false alarms for anger in the alcohol compared to placebo group ( n = 52 and 56, respectively; t(94.6) = 2.26, p = .024, d = .44) and fewer false alarms for happiness ( t(106) = -2.42, p = .017, d = -.47). However, no clear evidence for these effects was found in study two (alcohol group n = 96, placebo group n = 93, ps > .22). When the data were combined we observed weak evidence of an effect of alcohol on false alarms of anger ( t(295) = 2.25, p = .025, d = .26).

CONCLUSIONS

These studies find weak support for biased anger perception following acute alcohol consumption in social consumers, which could have implications for alcohol-related aggression. Future research should investigate the robustness of this effect, particularly in individuals high in trait aggression.

Differences in Facial Emotional Recognition Between Patients With the First-Episode Psychosis, Multi-episode Schizophrenia, and Healthy Controls

OBJECTIVES

The aim of our study was to assess the differences in facial emotional recognition (FER) between patients with first-episode psychosis (FEP), patients with multi-episode schizophrenia (SCH), and healthy controls (HC) and to find possible correlations of FER with psychopathology in the two patient groups.

METHODS

We performed a cross-sectional study enrolling 160 patients from two psychiatric hospitals in Croatia (80 FEP and 80 SCH) and 80 HC during the period from October 2015 until October 2017. Patients were assessed once during their hospital treatment, using the Penn Emotion Recognition Task for assessment of FER, rating scales for psychopathology and depression and self-reporting questionnaires for impulsiveness, aggression, and quality of life.

RESULTS

The number of correctly identified emotions significantly decreased from HC to FEP [Δ -7%; 95% confidence interval (CI) [-12% to -3%], effect size r = 0.30] and more markedly in SCH (Δ -15%; 95% CI [-25% to -10%], effect size r = 0.59) after the adjustment for age and gender and correction for multiple testing. Correct FER for negative emotions, but not for happiness and neutral emotions, had a statistically significant negative correlation with some features on the scales of psychopathology, impulsivity and aggression in both patient groups.

CONCLUSIONS

Impairment of FER is present from the first episode of schizophrenia and increases further with multiple psychotic episodes, but it may depend on or contribute to clinical symptoms. Therefore, assessment of FER should be included in the clinical assessment and integrated in the plan of treatment from the beginning of the illness. (JINS, 2019, 25, 165-173).

Impairments of emotional face processing in schizophrenia patients: Evidence from P100, N170 and P300 ERP components in a sample of auditory hallucinators

Patients with schizophrenia show impaired face and emotional expression processing that may be due to early perceptual deficits or late impairments in higher-order emotional facial recognition. This study examined event-related potentials (ERPs) in 23 patients with schizophrenia who experience auditory hallucinations and 19 healthy controls. EEG activity was recorded from 32 scalp sites positioned according to the 10-10 placement system. Linked left and right electrodes at the mastoids served as the reference. The P100, N170 and P300 were measured during an emotional facial identification task, which included neutral, joyful, sad, angry and fearful facial expressions and non-face stimuli (chairs). P100 was measured at O_1/2 and P_7/8. N170 was measured at P_7/8. P300 was measured at P_z. Patients with schizophrenia were slower at identifying all facial expressions, including neutral ones. They also showed less positive P100 amplitude to sad, angry and fearful facial expressions. N170 amplitudes were smaller in patients in response to neutral, joyful, sad, angry, and fearful facial expression. Patients showed less positive P300 mean amplitudes to all facial expressions, including neutral ones. Within-group comparisons showed that patients exhibited a different pattern of ERP modulation across facial expressions than controls for P100 and N170, but not for P300. Our findings are compatible with the idea that behavioural and electrophysiological face-processing deficits in schizophrenia arise from early-stage deficits in visual processing.

The feasibility and clinical benefits of improving facial affect recognition impairments in schizophrenia: Systematic review and meta-analysis

BACKGROUND

People diagnosed with schizophrenia have significant difficulty accurately recognising emotions expressed by others. This may generate anomalous experiences which, if misinterpreted, could contribute to experiences of social defeat, psychotic symptoms and reduced social functioning. It remains unclear whether this impairment is responsive to non-pharmacological intervention, or what the effect of modifying it is.

METHODS

We did a systematic review and meta-analysis to examine whether and to what extent facial affect recognition impairments can be improved by psychological intervention and, if so, whether this leads to improvements in psychotic symptoms and social functioning.

RESULTS

A total of 8 randomised controlled trials (RCTs) consisting of 300 participants were included. Focused yet brief psychological interventions led to very large improvements in facial affect recognition ability in psychosis [k=8, N=300, g=1.26, 95% Confidence Interval (CI) 0.92, 1.60, I² 41%]. Early evidence suggests this may cause large improvements in social functioning (k=3, N=109, g=0.98, 95% CI 0.37, 1.36, I² 38%), but not psychotic symptoms.

CONCLUSIONS

Facial affect recognition difficulties in schizophrenia are highly responsive to psychological interventions designed to improve them, and there is early evidence that this may lead to large gains in social functioning for this group - but not symptoms. A large-scale high-quality RCT with longer-term follow-up period is now required to overcome the limitations of the existing evidence.