Impaired Facial Emotion Recognition in Individuals at Ultra-High Risk for Psychosis and Associations With Schizotypy and Paranoia Level

Emotional anticipation for dynamic emotional faces is not modulated by schizotypal traits: A Representational Momentum study

Schizotypy, a personality structure that resembles schizophrenia symptoms, is often associated with abnormal facial emotion perception. Based on the prevailing sense of threat in psychotic experiences, and the immediate perceptual history of seeing others' facial expressions, individuals with high schizotypal traits may exhibit a heightened tendency to anticipate anger. To test this, we used insights from Representational Momentum (RM), a perceptual phenomenon in which the endpoint of a dynamic event is systematically displaced forward, into the immediate future. Angry-to-ambiguous and happy-to-ambiguous avatar faces were presented, each followed by a probe with the same (ambiguous) expression as the endpoint, or one slightly changed to express greater happiness/anger. Participants judged if the probe was "equal" to the endpoint and rated how confident they were. The sample was divided into high (N = 46) and low (N = 49) schizotypal traits using the Schizotypal Personality Questionnaire (SPQ). First, a forward bias was found in happy-to-ambiguous faces, suggesting emotional anticipation solely for dynamic faces changing towards a potential threat (anger). This may reflect an adaptative mechanism, as it is safer to anticipate any hostility from a conspecific than the opposite. Second, contrary to our hypothesis, high schizotypal traits did not heighten RM for happy-to-ambiguous faces, nor did they lead to overconfidence in biased judgements. This may suggest a typical pattern of emotional anticipation in non-clinical schizotypy, but caution is needed due to the use of self-report questionnaires, university students, and a modest sample size. Future studies should also investigate if the same holds for clinical manifestations of schizophrenia.

An exploratory study of the effect of age and gender on face scanning during affect recognition in immersive virtual reality

A person with impaired emotion recognition is not able to correctly identify facial expressions represented by other individuals. The aim of the present study is to assess eyes gaze and facial emotion recognition in a healthy population using dynamic avatars in immersive virtual reality (IVR). For the first time, the viewing of each area of interest of the face in IVR is studied by gender and age. This work in healthy people is conducted to assess the future usefulness of IVR in patients with deficits in the recognition of facial expressions. Seventy-four healthy volunteers participated in the study. The materials used were a laptop computer, a game controller, and a head-mounted display. Dynamic virtual faces randomly representing the six basic emotions plus neutral expression were used as stimuli. After the virtual human represented an emotion, a response panel was displayed with the seven possible options. Besides storing the hits and misses, the software program internally divided the faces into different areas of interest (AOIs) and recorded how long participants looked at each AOI. As regards the overall accuracy of the participants' responses, hits decreased from the youngest to the middle-aged and older adults. Also, all three groups spent the highest percentage of time looking at the eyes, but younger adults had the highest percentage. It is also noteworthy that attention to the face compared to the background decreased with age. Moreover, the hits between women and men were remarkably similar and, in fact, there were no statistically significant differences between them. In general, men paid more attention to the eyes than women, but women paid more attention to the forehead and mouth. In contrast to previous work, our study indicates that there are no differences between men and women in facial emotion recognition. Moreover, in line with previous work, the percentage of face viewing time for younger adults is higher than for older adults. However, contrary to earlier studies, older adults look more at the eyes than at the mouth.Consistent with other studies, the eyes are the AOI with the highest percentage of viewing time. For men the most viewed AOI is the eyes for all emotions in both hits and misses. Women look more at the eyes for all emotions, except for joy, fear, and anger on hits. On misses, they look more into the eyes for almost all emotions except surprise and fear.

Emotional Context Effects on the Rating of Ambiguous Facial Expressions in Depression and Schizophrenia Spectrum Disorders

ObjectiveTo investigate the influence of visual contextual information on emotion recognition of ambiguous facial expressions in depression and schizophrenia spectrum disorders. Method: Ambiguous facial expressions and emotional contexts representing anger, disgust, fear, joy, sadness and surprise were validated in a pre-test with healthy independent raters. Afterwards, 20 healthy participants (8 women, 12 men; mean age 24.35 ± 2.85 years), 20 participants with schizophrenia spectrum disorders (9 women, 11 men; mean age 40.25 ± 11.68 years) and 19 participants with depression (11 women, 8 men; mean age 43.74 ± 12.65 years) rated the emotional content of nine different faces in seven different emotion-suggesting contexts. The proportions of context-congruent answers and differences between emotion ratings in each context were analysed using non-parametric Kruskal-Wallis and explorative, paired Wilcoxon tests. Correlational analyses explored the influence of clinical symptoms assessed by clinician-administered scales. Results: The overall proportion of context-congruent answers did not differ between participants with depression and schizophrenia spectrum disorders compared to healthy participants. Participants with schizophrenia spectrum disorders were more susceptible to anger-suggesting contexts and participants with depression were more susceptible to fear-suggesting contexts. Differences in emotion recognition were associated with the severity of depressive, but not psychotic, symptoms. Conclusion: Despite increased susceptibility to anger-suggesting cues in schizophrenia and to fear-suggesting cues in depression, visual contextual influence remains largely consistent with healthy participants. Preserved emotional responsiveness suggests an efficacy of emotion training but emphasizes the need for additional research focusing on other factors contributing to social interaction deficits.

Attentional biases in facial emotion processing in individuals at clinical high risk for psychosis

Individuals at clinical high risk (CHR) for psychosis exhibit altered facial emotion processing (FEP) and poor social functioning. It is unclear whether FEP deficits result from attentional biases, and further, how these abnormalities are linked to symptomatology (e.g., negative symptoms) and highly comorbid disorders that are also tied to abnormal FEP (e.g., depression). In the present study, we employed an eye-tracking paradigm to assess attentional biases and clinical interviews to examine differences between CHR (N = 34) individuals and healthy controls (HC; N = 46), as well as how such biases relate to symptoms and functioning in CHR individuals. Although no CHR-HC differences emerged in attentional biases, within the CHR group, symptoms and functioning were related to biases. Depressive symptoms were related to some free-view attention switching biases (e.g., to and from fearful faces, r = .50). Negative symptoms were related to more slowly disengaging from happy faces (r = .44), spending less time looking at neutral faces (r =  - .42), and more time looking at no face (Avolition, r = .44). In addition, global social functioning was related to processes that overlapped with both depression and negative symptoms, including time looking at no face (r =  - .68) and free-view attention switching with fearful faces (r =  - .40). These findings are consistent with previous research, indicating that negative symptoms play a prominent role in the CHR syndrome, with distinct mechanisms relative to depression. Furthermore, the results suggest that attentional bias indices from eye-tracking paradigms may be predictive of social functioning.

Pathways from threat exposure to psychotic symptoms in youth: The role of emotion recognition bias and brain structure

BACKGROUND

Research supports an association between threatening experiences in childhood and psychosis. It is possible that early threat exposure disrupts the development of emotion recognition (specifically, producing a bias for facial expressions relating to threat) and the brain structures subserving it, contributing to psychosis development.

METHODS

Using data from the Philadelphia Neurodevelopmental Cohort, we examined associations between threat exposure and both the misattribution of facial expressions to fear/anger in an emotion recognition task, and gray matter volumes in key emotion processing regions. Our sample comprised youth with psychosis spectrum symptoms (N = 304), control youth (N = 787), and to evaluate specificity, youth with internalizing symptoms (N = 92). The moderating effects of group and sex were examined.

RESULTS

Both the psychosis spectrum and internalizing groups had higher levels of threat exposure than controls. In the total sample, threat exposure was associated with lower left medial prefrontal cortex (mPFC) volume but not misattributions to fear/anger. The effects of threat exposure did not significantly differ by group or sex.

CONCLUSIONS

The findings of this study provide evidence for an effect of threat exposure on mPFC morphology, but do not support an association between threat exposure and a recognition bias for threat-related expressions, that is particularly pronounced in psychosis. Future research should investigate factors linking transdiagnostic alterations related to threat exposure with psychotic symptoms, and attempt to clarify the mechanisms underpinning emotion recognition misattributions in threat-exposed youth.

The relevance of social anxiety for understanding social functioning and facial emotion recognition in individuals at clinical high-risk for psychosis

AIM

Individuals at clinical high risk (CHR) for psychosis often experience poor social functioning and impaired facial emotion recognition (FER); however, the impact of frequently comorbid symptoms upon these processes is underexplored. In particular, social anxiety is characteristic of this population and also related to poor social functioning and FER biases, such as misinterpreting neutral faces as negative or threatening; however, little is known about how social anxiety relates to these processes in CHR individuals. The present study examined the overlap of social anxiety, social functioning, and FER accuracy and bias.

METHOD

Participants (CHR N = 62, healthy controls N = 52) completed the self-report Social Interaction Anxiety Scale (SIAS), Penn Emotion Recognition-40 (ER-40) behavioural task, and interviewer-rated Global Functioning Scale-Social (GFS-S). The ER-40 was used to assess both FER accuracy (e.g., overall number of correct responses) and bias (e.g., mislabelling neutral faces as angry).

RESULTS

Consistent with previous research, relative to controls, CHR participants had more social anxiety (d = -1.07), poorer social functioning (d = -1.62), and performed more poorly on the FER task (e.g., d = -.37). Within CHR participants, social anxiety was related to an anger detection bias (r = .28), above and beyond positive symptom severity, which in turn was related to FER accuracy (r = .26) and social functioning (r = -.28).

CONCLUSION

These findings suggest that ongoing work examining social processes within CHR individuals needs to account for social anxiety and that social anxiety may be a useful preventive intervention target.

Impact of facemasks on psychotherapy: Clinician's confidence and emotion recognition

OBJECTIVES

Facial emotion recognition is a key component of human interactions, and in clinical relationships contributes to building and maintaining the therapeutic alliance with patients. The introduction of facemasks has reduced the availability of facial information in private and professional relationships. This study aimed to assess the impact of facemasks on clinicians' perception of clinical interactions as well as their ability to read facial expressions.

METHODS

In this cross-sectional study, a purposive sample of 342 clinical psychologists or psychotherapists completed an online survey including the assessment of burnout, alexithymia, emotion dysregulation, and self-perceived ability to build effective relationships and communication with patients with/without facemasks. Participants were randomly assigned to the standardized facial emotion recognition task Diagnostic Analysis of Nonverbal Accuracy FACES 2-Adult Faces including 24 faces representing anger, fear, sadness, and happiness.

RESULTS

Facemasks impaired the self-perceived ability of clinicians to build effective relationships and communicate with patients and reduced satisfaction in clinical encounters. The ability of clinicians to recognize facial emotions is significantly reduced for masked happy and angry faces, but not for sad and afraid ones. The perceived difficulty in building good relationships and communication with patients had a positive correlation with alexithymia and emotion dysregulation; higher levels of discomfort when wearing facemasks had a positive correlation with burnout and emotion dysregulation.

CONCLUSION

Facemasks reduced clinicians' self-confidence in clinical encounters with patients wearing facemasks, but their facial emotion recognition performance was only partially impaired.

Facial emotion recognition and schizotypal traits: A systematic review of behavioural studies

AIM

Previous research has indicated that individuals expressing high schizotypal traits and patients with Schizotypal Personality Disorder (SPD), show deficits in facial emotion recognition, compared to low schizotypal or control groups. On the other hand, non-significant findings also exist and the association of facial emotion recognition deficits with the different schizotypal dimensions is not well defined, thus limiting any conclusive outcomes. Therefore, the aim of this systematic review was to further clarify this relationship.

METHODS

PsychInfo, Web of Science, Scopus and PubMed were systematically searched, and 23 papers with a cross-sectional design were selected. Nineteen studies examined individuals with high schizotypal traits and four studies evaluated SPD individuals with behavioural facial emotion recognition paradigms and self-report measures or clinical interviews for schizotypal traits. All selected studies were published between 1994 and August 2020.

RESULTS

According to the evidence of studies, high schizotypal individuals and SPD patients have poorer performance in facial emotion recognition tasks. Negative schizotypy was related to lower accuracy for positive and negative emotions and faster emotion labeling while positive schizotypy was associated with worse accuracy for positive, negative and neutral emotions and more biases. Disorganized schizotypy was associated with poorer accuracy for negative emotions and suspiciousness with higher accuracy for disgust faces but lower total accuracy.

CONCLUSIONS

These findings are consistent with the vulnerability for schizophrenia spectrum disorders and support the idea that emotion recognition deficits are trait markers for these conditions. Thus, the effectiveness of early-intervention programmes could increase by also targeting this class of deficits.

The impact of briefly observing faces in opaque facial masks on emotion recognition and empathic concern

Since the outbreak of SARS-CoV-2 in 2019, there have been global public health initiatives that have advocated for the community use of face masks to reduce spread of the virus. Although the community use of facial coverings has been deemed essential for public health, there have been calls for enquiries to ascertain how face masks may impact non-verbal methods of communication. This study aimed to ascertain how the brief observations of faces in opaque facial coverings could impact facial emotion recognition. It was also an aim to ascertain if there was an association between the levels of empathic concern and facial emotion recognition when viewing masked faces. An opportunity sample of 199 participants, who resided in the United Kingdom, were randomly assigned to briefly observe either masked (n = 102) or unmasked (n = 97) faces. Participants in both conditions were required to view a series of facial expressions, from the Radboud Faces Database, with models conveying the emotional states of anger, disgust, fear, happiness, sadness, and surprised. Each face was presented to participants for a period of 250 ms in the masked and unmasked conditions. A 6 (emotion type) x 2 (masked/unmasked condition) mixed ANOVA revealed that viewing masked faces significantly reduced facial emotion recognition of disgust, fear, happiness, sadness, and surprised. However, there were no differences in the success rate of recognising the emotional state of anger between the masked and unmasked conditions. Furthermore, higher levels of empathic concern were associated with greater success in facially recognising the emotional state of disgust. The results of this study suggest that significant reductions in emotion recognition, when viewing faces in opaque masks, can still be observed when people are exposed to facial stimuli for a brief period of time.

Specific facial emotion recognition deficits across the course of psychosis: A comparison of individuals with low-risk, high-risk, first-episode psychosis and multi-episode schizophrenia-spectrum disorders

Our study aimed to explore the recognition of specific emotions across the course of psychosis. A visual task representing the six basic emotions was used to assess facial emotion recognition (FER) in 204 healthy controls classified into 152 low-risk (LR) and 52 high-risk for psychosis (HR), following a psychometric risk approach; and 100 patients: 44 with first-episode psychosis (FEP) and 56 with multi-episode schizophrenia-spectrum disorders (MES). First, we performed a MANCOVA to compare the four conditions. Next, we conducted a logistic regression to explore whether specific FER deficits predicted the presence of psychosis. Finally, we investigated the relationships of FER with psychosis-like experiences (PLEs) and psychotic symptoms. Global FER, anger and fear recognition were impaired in HR, FEP and MES. No differences between HR and FEP appeared. Moreover, fear and anger correctly classified 83% of individuals into LR or psychosis. FER was associated with PLEs and psychotic symptoms. Concluding, FER is early impaired in HR individuals and increases along the psychosis continuum. However, fear recognition is similarly impaired throughout the illness, suggesting a possible vulnerability marker. Furthermore, deficits in anger and fear recognition predicted the presence of psychosis. Therefore, we suggest that FER may be essential in detecting psychosis risk.

Interpersonal problems and recognition of facial emotions in healthy individuals

Background

Recognition of emotions in faces is important for successful social interaction. Results from previous research based on clinical samples suggest that difficulties in identifying threat-related or negative emotions can go along with interpersonal problems. The present study examined whether associations between interpersonal difficulties and emotion decoding ability can be found in healthy individuals. Our analysis was focused on two main dimensions of interpersonal problems: agency (social dominance) and communion (social closeness).

Materials and methods

We constructed an emotion recognition task with facial expressions depicting six basic emotions (happiness, surprise, anger, disgust, sadness, and fear) in frontal and profile view, which was administered to 190 healthy adults (95 women) with a mean age of 23.9 years (SD = 3.8) along with the Inventory of Interpersonal Problems, measures of negative affect and verbal intelligence. The majority of participants were university students (80%). Emotion recognition accuracy was assessed using unbiased hit rates.

Results

Negative correlations were observed between interpersonal agency and recognition of facial anger and disgust that were independent of participants' gender and negative affect. Interpersonal communion was not related to recognition of facial emotions.

Discussion

Poor identification of other people's facial signals of anger and disgust might be a factor contributing to interpersonal problems with social dominance and intrusiveness. Anger expressions signal goal obstruction and proneness to engage in conflict whereas facial disgust indicates a request to increase social distance. The interpersonal problem dimension of communion appears not to be linked to the ability to recognize emotions from facial expressions.

Comparison of Subjective Facial Emotion Recognition and "Facial Emotion Recognition Based on Multi-Task Cascaded Convolutional Network Face Detection" between Patients with Schizophrenia and Healthy Participants

Patients with schizophrenia may exhibit a flat affect and poor facial expressions. This study aimed to compare subjective facial emotion recognition (FER) and FER based on multi-task cascaded convolutional network (MTCNN) face detection in 31 patients with schizophrenia (patient group) and 40 healthy participants (healthy participant group). A Pepper Robot was used to converse with the 71 aforementioned participants; these conversations were recorded on video. Subjective FER (assigned by medical experts based on video recordings) and FER based on MTCNN face detection was used to understand facial expressions during conversations. This study confirmed the discriminant accuracy of the FER based on MTCNN face detection. The analysis of the smiles of healthy participants revealed that the kappa coefficients of subjective FER (by six examiners) and FER based on MTCNN face detection concurred (κ = 0.63). The perfect agreement rate between the subjective FER (by three medical experts) and FER based on MTCNN face detection in the patient, and healthy participant groups were analyzed using Fisher's exact probability test where no significant difference was observed (p = 0.72). The validity and reliability were assessed by comparing the subjective FER and FER based on MTCNN face detection. The reliability coefficient of FER based on MTCNN face detection was low for both the patient and healthy participant groups.

Inefficient integration during multiple facial processing in pre-morbid and early phases of psychosis

OBJECTIVES

We used eye-tracking to evaluate multiple facial context processing and event-related potential (ERP) to evaluate multiple facial recognition in individuals at clinical high risk (CHR) for psychosis.

METHODS

In total, 173 subjects (83 CHRs and 90 healthy controls [HCs]) were included and their emotion perception performances were accessed. A total of 40 CHRs and 40 well-matched HCs completed an eye-tracking task where they viewed pictures depicting a person in the foreground, presented as context-free, context-compatible, and context-incompatible. During the two-year follow-up, 26 CHRs developed psychosis, including 17 individuals who developed first-episode schizophrenia (FES). Eighteen well-matched HCs were made to complete the face number detection ERP task with image stimuli of one, two, or three faces.

RESULTS

Compared to the HC group, the CHR group showed reduced visual attention to contextual processing when viewing multiple faces. With the increasing complexity of contextual faces, the differences in eye-tracking characteristics also increased. In the ERP task, the N170 amplitude decreased with a higher face number in FES patients, while it increased with a higher face number in HCs.

CONCLUSIONS

Individuals in the very early phase of psychosis showed facial processing deficits with supporting evidence of different scan paths during context processing and disruption of N170 during multiple facial recognition.

Multilabel convolution neural network for facial expression recognition and ordinal intensity estimation

Facial Expression Recognition (FER) has gained considerable attention in affective computing due to its vast area of applications. Diverse approaches and methods have been considered for a robust FER in the field, but only a few works considered the intensity of emotion embedded in the expression. Even the available studies on expression intensity estimation successfully assigned a nominal/regression value or classified emotion in a range of intervals. Most of the available works on facial expression intensity estimation successfully present only the emotion intensity estimation. At the same time, others proposed methods that predict emotion and its intensity in different channels. These multiclass approaches and extensions do not conform to man heuristic manner of recognising emotion and its intensity estimation. This work presents a Multilabel Convolution Neural Network (ML-CNN)-based model, which could simultaneously recognise emotion and provide ordinal metrics as the intensity estimation of the emotion. The proposed ML-CNN is enhanced with the aggregation of Binary Cross-Entropy (BCE) loss and Island Loss (IL) functions to minimise intraclass and interclass variations. Also, ML-CNN model is pre-trained with Visual Geometric Group (VGG-16) to control overfitting. In the experiments conducted on Binghampton University 3D Facial Expression (BU-3DFE) and Cohn Kanade extension (CK+) datasets, we evaluate ML-CNN's performance based on accuracy and loss. We also carried out a comparative study of our model with some popularly used multilabel algorithms using standard multilabel metrics. ML-CNN model simultaneously predicts emotion and intensity estimation using ordinal metrics. The model also shows appreciable and superior performance over four standard multilabel algorithms: Chain Classifier (CC), distinct Random K label set (RAKEL), Multilabel K Nearest Neighbour (MLKNN) and Multilabel ARAM (MLARAM).

Social cognition and self-reported ASD traits in young adults who have reported psychotic experiences: A population-based, longitudinal study

OBJECTIVE

Social cognition is considered a trait marker of psychosis, and has rarely been investigated in young adults who have reported psychotic experiences (PE). The aim of the present study was to explore whether social cognition, self-reported Autism Spectrum Disorder (ASD) traits and functioning were associated with PE.

METHODS

Participants were invited to take part in a 10-year follow-up study (mean age 20.9 years), of whom 103 participants returned, including 41 who had reported PE either past or current. Social cognition (theory of mind, social perception and locus of control) was assessed and a self-report measure of ASD traits was administered. Psychopathology and global functioning were assessed using the SCID-5. Analyses investigated group differences between PE and controls, and the association between social cognition and functioning in the PE group. A mediation analysis investigated if the association between PE and social cognition was explained by ASD traits.

RESULTS

The PE group had poorer theory of mind scores (F = 4.22, p = .043), specifically for neutral and negative stimuli, and an external locus of control (F = 5.73, p = .019) in young adulthood. The PE group had a significantly greater number of self-reported ASD traits than the controls (χ²(2) = 10.65). External locus of control had a significant negative correlation with current role functioning in the PE group. The association between PE and social cognition abilities was not mediated by ASD traits.

CONCLUSION

Psychotic experiences are associated with poorer theory of mind and an external locus of control, as well as proportionally more self-reported ASD traits, in young adulthood.