Facial emotion recognition in neurological disorders: a narrative review

The Emotion Authenticity Recognition (EAR) test: normative data of an innovative test using dynamic emotional stimuli to evaluate the ability to recognize the authenticity of emotions expressed by faces

Despite research has massively focused on how emotions conveyed by faces are perceived, the perception of emotions' authenticity is a topic that has been surprisingly overlooked. Here, we present the Emotion Authenticity Recognition (EAR) test, a test specifically developed using dynamic stimuli depicting authentic and posed emotions to evaluate the ability of individuals to correctly identify an emotion (emotion recognition index, ER Index) and classify its authenticity (authenticity recognition index (EA Index). The EAR test has been validated on 522 healthy participants and normative values are provided. Correlations with demographic characteristics, empathy and general cognitive status have been obtained revealing that both indices are negatively correlated with age, and positively with education, cognitive status and different facets of empathy. The EAR test offers a new ecological test to assess the ability to detect emotion authenticity that allow to explore the eventual social cognitive deficit even in patients otherwise cognitively intact.

Can the Ability to Recognize Facial Emotions in Individuals With Neurodegenerative Disease be Improved? A Systematic Review and Meta-analysis

BACKGROUND

Facial emotion recognition (FER) is commonly impaired in individuals with neurodegenerative disease (NDD). This impairment has been linked to an increase in behavioral disorders and caregiver burden.

OBJECTIVE

To identify interventions targeting the improvement of FER ability in individuals with NDD and investigate the magnitude of the efficacy of the interventions. We also wanted to explore the duration of the effects of the intervention and their possible impacts on behavioral and psychological symptoms of dementia and caregiver burden.

METHOD

We included 15 studies with 604 individuals who had been diagnosed with NDD. The identified interventions were categorized into three types of approach (cognitive, neurostimulation, and pharmacological) as well as a combined approach (neurostimulation with pharmacological).

RESULTS

The three types of approaches pooled together had a significant large effect size for FER ability improvement (standard mean difference: 1.21, 95% CI = 0.11, 2.31, z = 2.15, P = 0.03). The improvement lasted post intervention, in tandem with a decrease in behavioral disorders and caregiver burden.

CONCLUSION

A combination of different approaches for FER ability improvement may be beneficial for individuals with NDD and their caregivers.

Seeing emotions in the eyes: a validated test to study individual differences in the perception of basic emotions

People are able to perceive emotions in the eyes of others and can therefore see emotions when individuals wear face masks. Research has been hampered by the lack of a good test to measure basic emotions in the eyes. In two studies respectively with 358 and 200 participants, we developed a test to see anger, disgust, fear, happiness, sadness and surprise in images of eyes. Each emotion is measured with 8 stimuli (4 male actors and 4 female actors), matched in terms of difficulty and item discrimination. Participants reliably differed in their performance on the Seeing Emotions in the Eyes test (SEE-48). The test correlated well not only with Reading the Mind in the Eyes Test (RMET) but also with the Situational Test of Emotion Understanding (STEU), indicating that the SEE-48 not only measures low-level perceptual skills but also broader skills of emotion perception and emotional intelligence. The test is freely available for research and clinical purposes.

La expresión de emociones en la narrativa de los adultos mayores con deterioro cognitivo leve o moderado: Análisis e intervención metalingüística

Las emociones constituyen una parte esencial del ser humano a lo largo de todas las etapas de su vida. En este trabajo estudiamos la expresión de emociones en el discurso oral de 23 adultos mayores (16 mujeres y 7 hombres) de entre 75 y 95 años, diagnosticados con algún deterioro cognitivo por diversas enfermedades, tomados del corpus “Metalenguaje y envejecimiento” (Mendizábal, González, Jimeno y Sánchez, 2022). El objetivo es describir y analizar las estrategias de expresión de emociones positivas y negativas ilustradas con ejemplos y establecer la proporción de emociones expresadas según el sexo y la edad. Para la clasificación de emociones se ha partido de estudios previos (Rusell, 2009; Sander, 2013; Lazarus, 2001) pero adaptados al tipo de entrevista semiestructurada para la extracción de datos. El análisis de expresión de emociones en los informantes que constituyen el corpus pone de manifiesto carencias de tipo léxico y gramatical que les impiden expresar de manera más eficaz sus emociones, especialmente las negativas. Los resultados obtenidos del análisis nos conducen a la elaboración de una intervención logopédica específica para que la población mayor con deterioro cognitivo leve tenga una competencia comunicativa que le sirva para manifestar de forma óptima sus sentimientos y emociones.

Emotional prosody recognition is impaired in Alzheimer’s disease

Background

The ability to understand emotions is often disturbed in patients with cognitive impairments. Right temporal lobe structures play a crucial role in emotional processing, especially the amygdala, temporal pole (TP), superior temporal sulcus (STS), and anterior cingulate (AC). Those regions are affected in early stages of Alzheimer´s disease (AD). The aim of our study was to evaluate emotional prosody recognition (EPR) in participants with amnestic mild cognitive impairment (aMCI) due to AD, AD dementia patients, and cognitively healthy controls and to measure volumes or thickness of the brain structures involved in this process. In addition, we correlated EPR score to cognitive impairment as measured by MMSE. The receiver operating characteristic (ROC) analysis was used to assess the ability of EPR tests to differentiate the control group from the aMCI and dementia groups.

Methods

Eighty-nine participants from the Czech Brain Aging Study: 43 aMCI due to AD, 36 AD dementia, and 23 controls, underwent Prosody Emotional Recognition Test. This experimental test included the playback of 25 sentences with neutral meaning each recorded with different emotional prosody (happiness, sadness, fear, disgust, anger). Volume of the amygdala and thickness of the TP, STS, and rostral and caudal parts of AC (RAC and CAC) were measured using FreeSurfer algorithm software. ANCOVA was used to evaluate EPR score differences. ROC analysis was used to assess the ability of EPR test to differentiate the control group from the aMCI and dementia groups. The Pearson’s correlation coefficients were calculated to explore relationships between EPR scores, structural brain measures, and MMSE.

Results

EPR was lower in the dementia and aMCI groups compared with controls. EPR total score had high sensitivity in distinguishing between not only controls and patients, but also controls and aMCI, controls and dementia, and aMCI and dementia. EPR decreased with disease severity as it correlated with MMSE. There was a significant positive correlation of EPR and thickness of the right TP, STS, and bilateral RAC.

Conclusions

EPR is impaired in AD dementia and aMCI due to AD. These data suggest that the broad range of AD symptoms may include specific deficits in the emotional sphere which further complicate the patient’s quality of life.

Emotion Recognition in a Health Continuum: Comparison of Healthy Adults of Advancing Age, Community Dwelling Adults Bearing Vascular Risk Factors and People Diagnosed with Mild Cognitive Impairment

The identification of basic emotions plays an important role in social relationships and behaviors linked to survival. In neurodegenerative conditions such as Alzheimer's disease (AD), the ability to recognize emotions may already be impaired at early stages of the disease, such as the stage of Mild Cognitive Impairment (MCI). However, as regards vascular pathologies related to cognitive impairment, very little is known about emotion recognition in people bearing vascular risk factors (VRF). Therefore, the aim of the present study was to examine emotion recognition ability in the health continuum "healthy advancing age-advancing age with VRF-MCI". The sample consisted of 106 adults divided in three diagnostic groups; 43 adults with MCI, 41 adults bearing one or more VRF, and 22 healthy controls of advancing age (HC). Since HC were more educated and younger than the other two groups, the age-group and level of educational were taken into account in the statistical analyses. A dynamic visual test was administered to examine recognition of basic emotions and emotionally neutral conditions. The results showed only a significant diagnostic group x educational level interaction as regards total emotion recognition ability, F (4, 28.910) = 4.117 p = 0.004 η² = 0.166. High educational level seems to contribute to a high-level-emotion-recognition-performance both in healthy adults of advancing age and in adults bearing vascular risk factors. Medium educational level appears to play the same role only in healthy adults. Neither educational level can help MCI people to enhance their significantly lower emotion recognition ability.

Facial emotion perception abilities are related to grey matter volume in the culmen of cerebellum anterior lobe in drug-naïve patients with first-episode schizophrenia

Impaired capability for understanding and interpreting the expressions on other people's faces manifests itself as a core feature of schizophrenia, contributing to social dysfunction. With the purpose of better understanding of the neurobiological basis of facial emotion perception deficits in schizophrenia, we investigated facial emotion perception abilities and regional structural brain abnormalities in drug-naïve patients with first-episode schizophrenia, and then examined the correlation between them. Fifty-two drug-naive patients with first-episode schizophrenia and 29 group-matched healthy controls were examined for facial emotion perception abilities assessed with the Facial Emotion Categorization and performed magnetic resonance imaging. The Facial Emotion Categorization data were inserted into a logistic function model so as to calculate shift point and slope as outcome measurements. Voxel-based morphometry was applied to investigate regional grey matter volume (GMV) alterations. The relationship between facial emotion perception and GMV was explored in patients using voxel-wise correlation analysis within brain regions that showed a significant GMV alterations in patients compared with controls. The schizophrenic patients performed differently on Facial Emotion Categorization tasks from the controls and presented a higher shift point and a steeper slope. Relative to the controls, patients showed GMV reductions in the superior temporal gyrus, middle occipital gyrus, parahippocampa gyrus, posterior cingulate, the culmen of cerebellum anterior lobe, cerebellar tonsil, and the declive of cerebellum posterior lobe. Importantly, abnormal performance on Facial Emotion Categorization was found correlated with GMV alterations in the culmen of cerebellum anterior lobe in schizophrenia. This study suggests that reduced GMV in the culmen of cerebellum anterior lobe occurs in first-episode schizophrenia, constituting a potential neuropathological basis for the impaired facial emotion perception in schizophrenia.

Recognition of emotional face expressions in patients with restless legs syndrome

OBJECTIVE

Restless legs syndrome (RLS) is one of the commonest neurologic diseases. Along with sensory and motor symptoms, cognitive impairment and psychiatric features can be seen with RLS. The present study, was planned to look for evidence of cognitive impairment by evaluating facial emotion recognition (FER) in patients with RLS.

METHODS

In this study, 80 patients with RLS and 50 healthy controls (HCs) were included. Demographic data were recorded. All patients with RLS and HCs were tested with Beck anxiety inventory (BAI), Beck depression inventory (BDI) and with Ekman's test for recognition of facial emotions.

RESULTS

Sixty-three of the patients with RLS and 37 of the HCs were female. The mean age of the patients was 45.41 ± 8.24, and the mean age of HCs was 43.12 ± 10.35. The patients and HCs were similar regarding sex, age, educational status, and marital status. Patients with RLS had FER difficulties comparing HCs. There was a negative correlation between Ekman's test scores and BDI (r = -0.311, p < 0.001) and BAI scores (r = -0.379, p < 0.001).

CONCLUSION

FER is an invaluable research topic regarding cognitive function in RLS, which may help us develop different perspectives in terms of revealing the pathophysiology and is very important for the well-being of the patients' social interactions.

Emotional Processing and Experience in Amyotrophic Lateral Sclerosis: A Systematic and Critical Review

Even though increasing literature describes changes in emotional processing in Amyotrophic Lateral Sclerosis (ALS), efforts to summarize relevant findings are lacking in the field. A systematic literature review was performed to provide a critical and up-to-date account of emotional abilities in ALS. References were identified by searches of PubMed, Web of Science and Scopus (1980–2021, English literature), with the following key terms: (“Amyotrophic Lateral Sclerosis” or “Primary Lateral Sclerosis” or “Motor Neuron”) and “Emotion*” and (“Processing” or “Attribution” or “Elaboration” or “Perception” or “Recognition”). Studies concerning only caregivers, pseudobulbar affect, and social cognition were excluded. Forty-one articles were included, all concerning ALS, and seven topics were identified: Emotion recognition, Emotional responsiveness, Emotional reactivity, Faces approachability rating, Valence rating, Memory for emotional materials and Alexithymia. The majority of these aspects have only been sparsely addressed. The evidence confirms altered emotional processing in ALS. The most consistent findings regard the recognition of facial expressions for negative emotions, but also alterations in the subjective responsiveness to emotional stimuli (arousal, valence and approachability), in psychophysiological and cerebral reactivity and in emotional memory, together with alexithymia traits, were reported. According to this evidence, emotional abilities should be included in the clinical assessment and therapeutic interventions.

Impaired social perception from eyes and face visual cues: evidence from prefrontal cortex damage

Despite the key role that decoding of social-perceptual cues from faces plays in interpersonal communication, it is only recently that the potential of prefrontal cortex damage to disrupt this ability has been recognized. In fact, few studies to date had assessed whether the ability to identify the state of mind of others from the whole or part of the face is disrupted after prefrontal cortex damage and whether these two abilities are associated and share overlapped neural systems. In the present study, 30 patients with focal prefrontal lesions and 30 matched control subjects were assessed on their ability to recognize six basic emotions from facial expressions of the whole face and to identify states of mind of others from photographs of only the eyes using the "Reading the Mind in the Eyes Task". Results showed that frontal patients were significantly impaired compared with control subjects on both tasks. Moreover, regression analyses showed that these two abilities are associated and reciprocally predictive of one another. Finally, using voxel-based lesion analysis; we identified a partially common bilaterally distributed prefrontal network in the decoding of both emotional cues from both the whole face and eyes centered within the dorsomedial and ventral regions with extension to the lateral frontal pole.

A Novel User Emotional Interaction Design Model Using Long and Short-Term Memory Networks and Deep Learning

Emotional design is an important development trend of interaction design. Emotional design in products plays a key role in enhancing user experience and inducing user emotional resonance. In recent years, based on the user's emotional experience, the design concept of strengthening product emotional design has become a new direction for most designers to improve their design thinking. In the emotional interaction design, the machine needs to capture the user's key information in real time, recognize the user's emotional state, and use a variety of clues to finally determine the appropriate user model. Based on this background, this research uses a deep learning mechanism for more accurate and effective emotion recognition, thereby optimizing the design of the interactive system and improving the user experience. First of all, this research discusses how to use user characteristics such as speech, facial expression, video, heartbeat, etc., to make machines more accurately recognize human emotions. Through the analysis of various characteristics, the speech is selected as the experimental material. Second, a speech-based emotion recognition method is proposed. The mel-Frequency cepstral coefficient (MFCC) of the speech signal is used as the input of the improved long and short-term memory network (ILSTM). To ensure the integrity of the information and the accuracy of the output at the next moment, ILSTM makes peephole connections in the forget gate and input gate of LSTM, and adds the unit state as input data to the threshold layer. The emotional features obtained by ILSTM are input into the attention layer, and the self-attention mechanism is used to calculate the weight of each frame of speech signal. The speech features with higher weights are used to distinguish different emotions and complete the emotion recognition of the speech signal. Experiments on the EMO-DB and CASIA datasets verify the effectiveness of the model for emotion recognition. Finally, the feasibility of emotional interaction system design is discussed.