The Nature of Facial Emotion Recognition Impairments in Children on the Autism Spectrum

The differential outcomes procedure for improving the recognition of dynamic facial expressions of emotion in people with autism spectrum disorders and first-degree relatives

Previous research highlights impairments in the recognition of facial expression of emotion in individuals diagnosed with Autism Spectrum Disorder (ASD). Relatives of people with ASD may exhibit similar, albeit subtler, impairments, referred to as the Broad Autism Phenotype (BAP). Recently, the Differential outcomes procedure (DOP) has been shown to enhance this ability in young adults using dynamic stimuli, with fewer intensity levels required to identify fear and surprise. The present study aimed to extend these findings to adults diagnosed with ASD (ASD group), and relatives of people diagnosed with ASD (BAP group). A Bayesian Generalized Linear Model was employed for statistical inference. The results indicated that the ASD DOP group performed worse than the BAP DOP group in fear trials. The social dimension of autism negatively impacted performance in some conditions, while positive relationships were found between the repetitive behavior dimension and performance for the ASD group. The opposite pattern was observed in the BAP group. These results suggest the importance of considering different dimensions of autism when conducting research on its relationship with other variables. Finally, participants in both ASD and BAP groups required less intensity to identify certain emotions when the DOP was applied, highlighting its potential utility for improving dynamic facial emotion recognition.

The effect of cognitive reappraisal on emotion recognition in mothers of children with special needs

Intrinsic family dynamics are an important factor in the development of children with special needs, and mothers' emotion regulation ability influences children's development to some extent. This study examined the intrinsic mechanism of cognitive reappraisal of emotion regulation strategies affecting the emotion recognition ability of mothers of children with special needs. Results indicated that mothers of children with special needs recognized negative emotions significantly faster than typically developing child mothers. After receiving cognitive reappraisal emotion regulation strategies, they significantly improved emotional recognition of surprise and reduced attention bias towards anger. Overall, mothers of children with special needs may have obvious attention bias towards negative emotions, and cognitive reappraisal can target negative emotions to help them to better improve emotional resilience.

A Randomized Trial Utilizing EEG Brain Computer Interface to Improve Facial Emotion Recognition in Autistic Adults

PURPOSE

Many individuals with autism spectrum disorder (ASD) experience challenges with facial emotion recognition (FER), which may exacerbate social difficulties in ASD. Few studies have examined whether FER can be experimentally manipulated and improved for autistic people. This study utilized a randomized controlled trial design to examine acceptability and preliminary clinical impact of a novel mixed reality-based neurofeedback program, FER Assistant, using EEG brain computer interface (BCI)-assisted technology to improve FER for autistic adolescents and adults.

METHODS

Twenty-seven autistic male participants (M age: 21.12 years; M IQ: 105.78; 85% white) were randomized to the active condition to receive FER Assistant (n = 17) or waitlist control (n = 10). FER Assistant participants received ten sessions utilizing BCI-assisted neurofeedback training in FER. All participants, regardless of randomization, completed a computerized FER task at baseline and endpoint.

RESULTS

Results partially indicated that FER Assistant was acceptable to participants. Regression analyses demonstrated that participation in FER Assistant led to group differences in FER at endpoint, compared to a waitlist control. However, analyses examining reliable change in FER indicated no reliable improvement or decline for FER Assistant participants, whereas two waitlist participants demonstrated reliable decline.

CONCLUSION

Given the preliminary nature of this work, results collectively suggest that FER Assistant may be an acceptable intervention. Results also suggest that FER may be a potential mechanism that is amenable to intervention for autistic individuals, although additional trials using larger sample sizes are warranted.

A multimodal interface for speech perception: the role of the left superior temporal sulcus in social cognition and autism

Multimodal integration is crucial for human interaction, in particular for social communication, which relies on integrating information from various sensory modalities. Recently a third visual pathway specialized in social perception was proposed, which includes the right superior temporal sulcus (STS) playing a key role in processing socially relevant cues and high-level social perception. Importantly, it has also recently been proposed that the left STS contributes to audiovisual integration of speech processing. In this article, we propose that brain areas along the right STS that support multimodal integration for social perception and cognition can be considered homologs to those in the left, language-dominant hemisphere, sustaining multimodal integration of speech and semantic concepts fundamental for social communication. Emphasizing the significance of the left STS in multimodal integration and associated processes such as multimodal attention to socially relevant stimuli, we underscore its potential relevance in comprehending neurodevelopmental conditions characterized by challenges in social communication such as autism spectrum disorder (ASD). Further research into this left lateral processing stream holds the promise of enhancing our understanding of social communication in both typical development and ASD, which may lead to more effective interventions that could improve the quality of life for individuals with atypical neurodevelopment.

A Study on the Screening of Children at Risk for Developmental Disabilities Using Facial Landmarks Derived From a Mobile-Based Application

OBJECTIVE

Early detection and intervention of developmental disabilities (DDs) are critical to improving the long-term outcomes of afflicted children. In this study, our objective was to utilize facial landmark features from mobile application to distinguish between children with DDs and typically developing (TD) children.

METHODS

The present study recruited 89 children, including 33 diagnosed with DD, and 56 TD children. The aim was to examine the effectiveness of a deep learning classification model using facial video collected from children through mobile-based application. The study participants underwent comprehensive developmental assessments, which included the child completion of the Korean Psychoeducational Profile-Revised and caregiver completing the Korean versions of Vineland Adaptive Behavior Scale, Korean version of the Childhood Autism Rating Scale, Social Responsiveness Scale, and Child Behavior Checklist. We extracted facial landmarks from recorded videos using mobile application and performed DDs classification using long short-term memory with stratified 5-fold cross-validation.

RESULTS

The classification model shows an average accuracy of 0.88 (range: 0.78-1.00), an average precision of 0.91 (range: 0.75-1.00), and an average F1-score of 0.80 (range: 0.60-1.00). Upon interpreting prediction results using SHapley Additive exPlanations (SHAP), we verified that the most crucial variable was the nodding head angle variable, with a median SHAP score of 2.6. All the top 10 contributing variables exhibited significant differences in distribution between children with DD and TD (p<0.05).

CONCLUSION

The results of this study provide evidence that facial landmarks, utilizing readily available mobile-based video data, can be used to detect DD at an early stage.

Multi-source transfer learning for facial emotion recognition using multivariate correlation analysis

Deep learning techniques have proven to be effective in solving the facial emotion recognition (FER) problem. However, it demands a significant amount of supervision data which is often unavailable due to privacy and ethical concerns. In this paper, we present a novel approach for addressing the FER problem using multi-source transfer learning. The proposed method leverages the knowledge from multiple data sources of similar domains to inform the model on a related task. The approach involves the optimization of aggregate multivariate correlation among the source tasks trained on the source dataset, thus controlling the transfer of information to the target task. The hypothesis is validated on benchmark datasets for facial emotion recognition and image classification tasks, and the results demonstrate the effectiveness of the proposed method in capturing the group correlation among features, as well as being robust to negative transfer and performing well in few-shot multi-source adaptation. With respect to the state-of-the-art methods MCW and DECISION, our approach shows an improvement of 7% and [Formula: see text]15% respectively.

Own-Age Effects in a Face-Emotion Recognition Intervention for Children With ASD--Evidence From Eye Movements

Background

The own-age effect is the phenomenon in which individuals perceive and recognize faces of their own age better than others in terms of cognitive processing. Previous eye movement studies on children with autism spectrum disorders (ASD) have reported that children with ASD have an attentional bias toward own-age faces and own-age scenes.

Methods

The present study used own-age faces as the intervention material and examined the application of the own-age effect in the emotional recognition of faces in ASD. The length of the intervention was 12 weeks, and 2 sessions were conducted each week.

Results

The results revealed that the own-age face intervention group gazed at children's faces significantly more often than before the intervention, gazed at children's angry faces significantly longer than before the intervention, and gazed at adults' happy faces significantly longer and more often than before the intervention; the other-age faces intervention group did not differ significantly from the preintervention in gazing at children's and adults' faces after the intervention.

Conclusion

The results suggest that own-age faces as teaching materials can better promote the emotion recognition ability of children with ASD than other-age faces.

Clinically elevated depression scores do not produce negative attentional biases in caregivers of autistic children

Objective

Depression scores in caregivers of autistic children often fall in the clinical range. The attention of clinically depressed individuals tends to be biased toward negatively toned information. Whether caring for an autistic child might also be characterized by a negative attentional bias was explored here.

Methods

A sample of N = 98 (57 caregivers and 41 controls) completed questionnaires assessing depressive symptoms. Orienting attention to (i.e., vigilance), and shifting attention away from (i.e., disengagement), negative information was assessed via an online version of the emotional face dot probe task.

Results

Mean depression scores in caregivers, falling in the borderline clinical range, were significantly higher compared with controls. Groups, however, were indistinguishable with respect to vigilance and disengagement, and these attentional indices were unrelated to depression scores.

Conclusion

Caring for an autistic child, while associated with borderline clinical depression scores, was not characterized by a negative attentional bias. Findings are discussed in the context of methodological shortcomings and recommendations for future research.

The role of affective touch in modulating emotion processing among preschool children

Recognizing emotional expressions is a prerequisite for understanding others' feelings and intentions, a key component of social interactions that develops throughout childhood. In multisensory social environments, touch may be crucial for emotion processing, linking external sensory information with internal affective states. The current study investigated whether affective touch facilitates recognition of emotional expressions throughout childhood. Preschool children (N = 121 3- to 6-year-olds) were presented with different tactile stimulations followed by an emotion-matching task. Results revealed that affective touch fosters the recognition of negative emotions and increases the speed of association of positive emotions, highlighting the centrality of tactile experiences for socioemotional understanding. The current research opens new perspectives on how to support emotional recognition with potential consequences for the development of social functioning.

The effects of face masks on emotional appraisal ability of students with autism spectrum disorder

The impact of the COVID-19 pandemic has drastically altered the ways in which people are able to communicate effectively. The addition of the face mask as a distracting stimulus interrupts the holistic process that people use to interpret facial expressions. The present study seeks to investigate the impact of face masking and gaze direction on emotion recognition in students with autism. We predicted that students with autism (n = 14), who characteristically experience difficulties when appraising emotions, would struggle to assess the emotions of people wearing face masks. We did not find a significant three-way interaction of emotion, mask, and gaze on classification accuracy. We did, however, find that face masks reduced participants' ability to emotionally appraise sad faces. Further, participants showed better accuracy appraising faces with a direct gaze. Exploring how face masks impact autistic individuals' emotion recognition will benefit special educators as they adapt to teaching during the pandemic, as well as the general population that seeks to improve communication with neurodiverse persons. Future studies should examine emotional appraisal ability and additional emotions as well as different kinds of emotional stimuli.

Cognitive and Developmental Functions in Autistic and Non-Autistic Children and Adolescents: Evidence from the Intelligence and Development Scales-2

Autistic individuals often show impairments in cognitive and developmental domains beyond the core symptoms of lower social communication skills and restricted repetitive behaviors. Consequently, the assessment of cognitive and developmental functions constitutes an essential part of the diagnostic evaluation. Yet, evidence on differential validity from intelligence and developmental tests, which are commonly used with autistic individuals, varies widely. In the current study, we investigated the cognitive (i.e., intelligence, executive functions) and developmental (i.e., psychomotor skills, social-emotional skills, basic skills, motivation and attitude, participation during testing) functions of autistic and non-autistic children and adolescents using the Intelligence and Development Scales-2 (IDS-2). We compared 43 autistic (M_age = 12.30 years) with 43 non-autistic (M_age = 12.51 years) participants who were matched for age, sex, and maternal education. Autistic participants showed significantly lower mean values in psychomotor skills, language skills, and the evaluation of participation during testing of the developmental functions compared to the control sample. Our findings highlight that autistic individuals show impairments particularly in motor and language skills using the IDS-2, which therefore merit consideration in autism treatment in addition to the core symptoms and the individuals' intellectual functioning. Moreover, our findings indicate that particularly motor skills might be rather neglected in autism diagnosis and may be worthy of receiving more attention. Nonsignificant group differences in social-emotional skills could have been due to compensatory effects of average cognitive abilities in our autistic sample.

Toward feeling, understanding, and caring: The development of empathy in young autistic children

LAY ABSTRACT

Empathy is a highly valued human capacity. Yet, autistic people are often portrayed as lacking in empathy. Recent research, which views empathy as a complex construct emerging from multiple interrelated emotional and cognitive processes, argues that, although many autistic people do have difficulty understanding others' emotions, and this may hinder them from responding to others in a prosocial manner, they are not indifferent to other people's feelings. Hoping to contribute to a better understanding of the unique challenges that autistic children face in their empathy development, we followed the development of four empathy abilities: emotion contagion, attention to others, emotion acknowledgment, and prosocial actions, in 1- to 6-year-old autistic children, in comparison with non-autistic children. Once a year, for 4 consecutive years, children's empathy abilities were evaluated by experimenters who acted out emotional episodes to provoke empathy in children, and by parents who filled out empathy questionnaires. We found that autistic children experienced indeed more difficulty attending to others, acknowledging others' emotions, and initiating prosocial actions toward others. However, according to parents, they did not differ from their non-autistic peers in feeling along with others' negative emotions. This indicates that it might not be the case that autistic children did not want to act empathetically toward others. Rather, they might not know how to do so. Notably, despite these difficulties, when looking at children's developmental trajectories, autistic children showed similar improvements over time as non-autistic children. This provides evidence that autistic children have the potential to learn and to improve their empathy skills.

Recognition of Emotions from Situational Contexts and the Impact of a Mind Reading Intervention in Children with Autism Spectrum Disorder

The present research examined recognition of basic (happy, fear, sad) and self-conscious (pride, embarrassment, guilt) emotions from situational contexts in children with Autism Spectrum Disorder (ASD) and neurotypical children (Study 1). Results showed that children with ASD were less accurate in recognizing fear, embarrassment, and guilt situations than neurotypical children. Additionally, the research explored whether recognition of these emotions from situational contexts could be improved in children with ASD after a 4-week computerized emotion intervention (Study 2). Following the intervention, children showed better recognition of embarrassment and guilt, but no improvement in recognizing fear. In children with ASD, significant negative relations were found between ASD symptomatology and recognition of guilt (Study 1), although ASD symptomatology did not impact the intervention's efficacy (Study 2). Additional explanations for these findings are provided.

Neural Mechanisms of Facial Emotion Recognition in Autism: Distinct Roles for Anterior Cingulate and dlPFC

OBJECTIVE

The present study sought to measure and internally validate neural markers of facial emotion recognition (FER) in adolescents and young adults with ASD to inform targeted intervention.

METHOD

We utilized fMRI to measure patterns of brain activity among individuals with ASD (N = 21) and matched controls (CON; N = 20) 2 s prior to judgments about the identity of six distinct facial emotions (happy, sad, angry, surprised, fearful, disgust).

RESULTS

Predictive modeling of fMRI data (support vector classification; SVC) identified mechanistic roles for brain regions that forecasted correct and incorrect identification of facial emotion as well as sources of errors over these decisions. BOLD signal activation in bilateral insula, anterior cingulate (ACC) and right dorsolateral prefrontal cortex (dlPFC) preceded accurate FER in both controls and ASD. Predictive modeling utilizing SVC confirmed the utility of ACC in forecasting correct decisions in controls but not ASD, and further indicated that a region within the right dlPFC was the source of a type 1 error signal in ASD (i.e. neural marker reflecting an impending correct judgment followed by an incorrect behavioral response) approximately two seconds prior to emotion judgments during fMRI.

CONCLUSIONS

ACC forecasted correct decisions only among control participants. Right dlPFC was the source of a false-positive signal immediately prior to an error about the nature of a facial emotion in adolescents and young adults with ASD, potentially consistent with prior work indicating that dlPFC may play a role in attention to and regulation of emotional experience.

An exploration of the impact of contextual information on the emotion recognition ability of autistic adults

Studies of non‐autistic individuals and people with an intellectual disability show that contextual information impacts positively on emotion recognition ability, however, this area is not well researched with autistic adults. We investigated this using a static emotion recognition task. Participants completed an emotion recognition task in person or online. In total, 46 autistic participants and 379 non‐autistic participants completed the task. A linear mixed model showed that autistic adults had significantly lower accuracy when identifying emotions across all contexts, compared to control participants, even when contextual information was present. No significant effect of context was found in either group, nor was gender shown to be an influential variable. A supplementary analysis showed that higher scores on the Autism‐Spectrum Quotient led to lower scores on the emotion recognition task; no effect of context was found here either. This research adds to the limited work investigating the influence of contextual factors in emotion recognition in autistic adults. Overall, it shows that context may not aid emotion recognition in this group in the same way as it does for non‐autistic individuals.

Differential beta desynchronisation responses to dynamic emotional facial expressions are attenuated in higher trait anxiety and autism

Daily life demands that we differentiate between a multitude of emotional facial expressions (EFEs). The mirror neuron system (MNS) is becoming increasingly implicated as a neural network involved with understanding emotional body expressions. However, the specificity of the MNS's involvement in emotion recognition has remained largely unexplored. This study investigated whether six basic dynamic EFEs (anger, disgust, fear, happiness, sadness, and surprise) would be differentiated through event-related desynchronisation (ERD) of sensorimotor alpha and beta oscillatory activity, which indexes sensorimotor MNS activity. We found that beta ERD differentiated happy, fearful, and sad dynamic EFEs at the central region of interest, but not at occipital regions. Happy EFEs elicited significantly greater central beta ERD relative to fearful and sad EFEs within 800 - 2,000 ms after EFE onset. These differences were source-localised to the primary somatosensory cortex, which suggests they are likely to reflect differential sensorimotor simulation rather than differential attentional engagement. Furthermore, individuals with higher trait anxiety showed less beta ERD differentiation between happy and sad faces. Similarly, individuals with higher trait autism showed less beta ERD differentiation between happy and fearful faces. These findings suggest that the differential simulation of specific affective states is attenuated in individuals with higher trait anxiety and autism. In summary, the MNS appears to support the skills needed for emotion processing in daily life, which may be influenced by certain individual differences. This provides novel evidence for the notion that simulation-based emotional skills may underlie the emotional difficulties that accompany affective disorders, such as anxiety.

Measuring change in facial emotion recognition in individuals with autism spectrum disorder: A systematic review

LAY ABSTRACT

Children and adults with autism spectrum disorder show difficulty recognizing facial emotions in others, which makes social interaction challenging. While there are many treatments developed to improve facial emotion recognition, there is no agreement on the best way to measure such abilities in individuals with autism spectrum disorder. The purpose of this review is to examine studies that were published between January 1998 and November 2019 and have measured change in facial emotion recognition to evaluate the effectiveness of different treatments. Our search yielded 65 studies, and within these studies, 36 different measures were used to evaluate facial emotion recognition in individuals with autism spectrum disorder. Only six of these measures, however, were used in different studies and by different investigators. In this review, we summarize the different measures and outcomes of the studies, in order to identify promising assessment tools and inform future research.

"Reading the Mind in the Eyes" in Autistic Adults is Modulated by Valence and Difficulty: An InFoR Study

Autism spectrum disorders (ASD) are heterogeneous and complex neurodevelopmental conditions that urgently need reliable and sensitive measures to inform diagnosis properly. The Reading the Mind in the Eyes Task (or Eyes Test from now on) is widely used for this purpose. A recent study showed that subcategories of items of the children version of the Eyes Test could be especially discriminative to distinguish ASD and control children. Here, we analyzed the performance on the Eyes Test of 30 high functioning (IQ > 70) adults with ASD and 29 controls from the InFoR cohort multicentric study, using a Generalized Linear Mixed Model. We found that valence and difficulty modulate the performance on the Eyes Test, with easy and positive items being the most discriminative to distinguish ASD and controls. In particular, we suggest this result might be actionable to discriminate ASD patients from controls in subgroups where their overall scores show less difference with controls. We propose for future research the computation of two additional indexes when using the Eyes Test: the first focusing on the easy and positive items (applying a threshold of 70% of correct responses for these items, above which people are at very low risk of having ASD) and the second focusing on the performance gain from difficult to easy items (with a progression of less than 15% showing high risk of having ASD). Our findings open the possibility for a major change in how the Eyes Test is used to inform diagnosis in ASD.

Lay Summary

The Eyes Test is used worldwide to inform autism spectrum disorders (ASD) diagnosis. We show here that ASD and neurotypical adults show the most difference in performance on subgroups of items: ASD adults do not improve as expected when comparing easy and difficult items, and they do not show an improvement for items displaying a positive feeling. We advise clinicians to focus on these comparisons to increase the property of the test to distinguish people with ASD from neurotypical adults.

Emotional face recognition in autism and in cerebral visual impairments: In search for specificity

Autism spectrum disorder (ASD) is characterized by difficulties in the social domain, but also by hyper- and hypo-reactivity. Atypical visual behaviours and processing have often been observed. Nevertheless, several similar signs are also identified in other clinical conditions including cerebral visual impairments (CVI). In the present study, we investigated emotional face categorization in groups of children with ASD and CVI by comparing each group to typically developing individuals (TD) in two tasks. Stimuli were either non-filtered or filtered by low- and high-spatial frequencies (LSF and HSF). All participants completed the autism spectrum quotient score (AQ) and a complete neurovisual evaluation. The results show that while both clinical groups presented difficulties in the emotional face recognition tasks and atypical processing of filtered stimuli, they did not differ from one another. Additionally, autistic traits were observed in the CVI group and symmetrically, some visual disturbances were present in the ASD group as measured via the AQ score and a neurovisual evaluation, respectively. The present study suggests the relevance of comparing ASD to CVI by showing that emotional face categorization difficulties should not be solely considered as autism-specific but merit investigation for potential dysfunction of the visual processing neural network. These results are of interest in both clinical and research perspectives, indicating that systematic visual examination is warranted for individuals with ASD.

Facial Emotion Recognition in Children and Adolescents with Specific Learning Disorder

BACKGROUND

Some recent studies suggest that children and adolescents with different neurodevelopmental disorders perform worse in emotions recognition through facial expressions (ER) compared with typically developing peers. This impairment is also described in children with Specific Learning Disorders (SLD), compromising their scholastic achievement, social functioning, and quality of life. The purpose of our study is to evaluate ER skills in children and adolescents with SLD compared to a control group without learning disorders, and correlate them with intelligence and executive functions.

MATERIALS AND METHODS

Our work is a cross-sectional observational study. Sixty-three children and adolescents aged between 8 and 16 years, diagnosed with SLD, and 32 sex/age-matched controls without learning disorders were recruited. All participants were administered standardized neuropsychological tests, evaluating facial emotion recognition (NEPSY-II), executive functions (EpiTrack Junior), and intelligence profile (WISC-IV).

RESULTS

Emotion recognition mean score was significantly lower in the SLD group than in the controls group on the Mann-Whitney U test for unpaired samples (p < 0.001). The SLD group performed significantly lower than the control group in their abilities to identify neutral expressions, happiness, sadness, anger, and fear compared to controls (p < 0.001). ER scores were positively correlated to the executive functions scores. There was no correlation with the Total Intelligence Quotient scores but there is a significant positive correlation with Working Memory Index and Processing Speed Index measured by WISC.IV.

CONCLUSION

Our study showed that children and adolescents with Specific Learning Disorders have facial emotion recognition impairment when compared with a group of peers without learning disorders. ER abilities were independent of their global intelligence but potentially related to executive functions.

Facial emotion recognition in autistic adult females correlates with alexithymia, not autism

Research on predominantly male autistic samples has indicated that impairments in facial emotion recognition typically associated with autism spectrum conditions are instead due to co-occurring alexithymia. However, whether this could be demonstrated using more realistic facial emotion recognition stimuli and applied to autistic females was unclear. In all, 83 females diagnosed with autism spectrum condition completed online self-report measures of autism spectrum condition severity and alexithymia, and afacial emotion recognition deficit that assessed their ability to identify multimodal displays of complex emotions. Higher levels of alexithymia, but not autism spectrum condition severity, were associated with less accurate facial emotion recognition. Difficulty identifying one’s own feelings and externally oriented thinking were the components of alexithymia that were specifically related to facial emotion recognition accuracy. However, alexithymia (and autism spectrum condition severity) was not associated with speed of emotion processing. The findings are primarily discussed with the theoretical view that perceiving and experiencing emotions share the same neural networks, thus being able to recognise one’s own emotions may facilitate the ability to recognise others’. This study is in line with previous similar research on autistic males and suggests impairments in facial emotion recognition in autistic females should be attributed to co-occurring alexithymia.