Review: Posed vs. Genuine Facial Emotion Recognition and Expression in Autism and Implications for Intervention

Temporal dynamics and neural variabilities underlying the interplay between emotion and inhibition in Chinese autistic children

This study investigated the neural dynamics underlying the interplay between emotion and inhibition in Chinese autistic children. Electroencephalography (EEG) signals were recorded from 50 autistic and 46 non-autistic children during an emotional Go/Nogo task. Based on single-trial ERP analyses, autistic children, compared to their non-autistic peers, showed a larger Nogo-N170 for angry faces and an increased Nogo-N170 amplitude variation for happy faces during early visual perception. They also displayed a smaller N200 for all faces and a diminished Nogo-N200 amplitude variation for happy and neutral faces during inhibition monitoring and preparation. During the late stage, autistic children showed a larger posterior-Go-P300 for angry faces and an augmented posterior-Nogo-P300 for happy and neutral faces. These findings clarify the differences in neural processing of emotional stimuli and inhibition between Chinese autistic and non-autistic children, highlighting the importance of considering these dynamics when designing intervention to improve emotion regulation in autistic children.

Atypical neural encoding of faces in individuals with autism spectrum disorder

Individuals with autism spectrum disorder (ASD) experience pervasive difficulties in processing social information from faces. However, the behavioral and neural mechanisms underlying social trait judgments of faces in ASD remain largely unclear. Here, we comprehensively addressed this question by employing functional neuroimaging and parametrically generated faces that vary in facial trustworthiness and dominance. Behaviorally, participants with ASD exhibited reduced specificity but increased inter-rater variability in social trait judgments. Neurally, participants with ASD showed hypo-activation across broad face-processing areas. Multivariate analysis based on trial-by-trial face responses could discriminate participant groups in the majority of the face-processing areas. Encoding social traits in ASD engaged vastly different face-processing areas compared to controls, and encoding different social traits engaged different brain areas. Interestingly, the idiosyncratic brain areas encoding social traits in ASD were still flexible and context-dependent, similar to neurotypicals. Additionally, participants with ASD also showed an altered encoding of facial saliency features in the eyes and mouth. Together, our results provide a comprehensive understanding of the neural mechanisms underlying social trait judgments in ASD.

Multimodal investigations of emotional face processing and social trait judgment of faces

Faces are among the most important visual stimuli that humans perceive in everyday life. While extensive literature has examined emotional processing and social evaluations of faces, most studies have examined either topic using unimodal approaches. In this review, we promote the use of multimodal cognitive neuroscience approaches to study these processes, using two lines of research as examples: ambiguity in facial expressions of emotion and social trait judgment of faces. In the first set of studies, we identified an event-related potential that signals emotion ambiguity using electroencephalography and we found convergent neural responses to emotion ambiguity using functional neuroimaging and single-neuron recordings. In the second set of studies, we discuss how different neuroimaging and personality-dimensional approaches together provide new insights into social trait judgments of faces. In both sets of studies, we provide an in-depth comparison between neurotypicals and people with autism spectrum disorder. We offer a computational account for the behavioral and neural markers of the different facial processing between the two groups. Finally, we suggest new practices for studying the emotional processing and social evaluations of faces. All data discussed in the case studies of this review are publicly available.

A uniform human multimodal dataset for emotion perception and judgment

Face perception is a fundamental aspect of human social interaction, yet most research on this topic has focused on single modalities and specific aspects of face perception. Here, we present a comprehensive multimodal dataset for examining facial emotion perception and judgment. This dataset includes EEG data from 97 unique neurotypical participants across 8 experiments, fMRI data from 19 neurotypical participants, single-neuron data from 16 neurosurgical patients (22 sessions), eye tracking data from 24 neurotypical participants, behavioral and eye tracking data from 18 participants with ASD and 15 matched controls, and behavioral data from 3 rare patients with focal bilateral amygdala lesions. Notably, participants from all modalities performed the same task. Overall, this multimodal dataset provides a comprehensive exploration of facial emotion perception, emphasizing the importance of integrating multiple modalities to gain a holistic understanding of this complex cognitive process. This dataset serves as a key missing link between human neuroimaging and neurophysiology literature, and facilitates the study of neuropsychiatric populations.

Autism-associated gene shank3 is necessary for social contagion in zebrafish

BACKGROUND

Animal models enable targeting autism-associated genes, such as the shank3 gene, to assess their impact on behavioural phenotypes. However, this is often limited to simple behaviours relevant for social interaction. Social contagion is a complex phenotype forming the basis of human empathic behaviour and involves attention to the behaviour of others for recognizing and sharing their emotional or affective state. Thus, it is a form of social communication, which constitutes the most common developmental impairment across autism spectrum disorders (ASD).

METHODS

Here we describe the development of a zebrafish model that identifies the neurocognitive mechanisms by which shank3 mutation drives deficits in social contagion. We used a CRISPR-Cas9 technique to generate mutations to the shank3a gene, a zebrafish paralogue found to present greater orthology and functional conservation relative to the human gene. Mutants were first compared to wild types during a two-phase protocol that involves the observation of two conflicting states, distress and neutral, and the later recall and discrimination of others when no longer presenting such differences. Then, the whole-brain expression of different neuroplasticity markers was compared between genotypes and their contribution to cluster-specific phenotypic variation was assessed.

RESULTS

The shank3 mutation markedly reduced social contagion via deficits in attention contributing to difficulties in recognising affective states. Also, the mutation changed the expression of neuronal plasticity genes. However, only downregulated neuroligins clustered with shank3a expression under a combined synaptogenesis component that contributed specifically to variation in attention.

LIMITATIONS

While zebrafish are extremely useful in identifying the role of shank3 mutations to composite social behaviour, they are unlikely to represent the full complexity of socio-cognitive and communication deficits presented by human ASD pathology. Moreover, zebrafish cannot represent the scaling up of these deficits to higher-order empathic and prosocial phenotypes seen in humans.

CONCLUSIONS

We demonstrate a causal link between the zebrafish orthologue of an ASD-associated gene and the attentional control of affect recognition and consequent social contagion. This models autistic affect-communication pathology in zebrafish and reveals a genetic attention-deficit mechanism, addressing the ongoing debate for such mechanisms accounting for emotion recognition difficulties in autistic individuals.

Distinct neurocognitive bases for social trait judgments of faces in autism spectrum disorder

Autism spectrum disorder (ASD) is characterized by difficulties in social processes, interactions, and communication. Yet, the neurocognitive bases underlying these difficulties are unclear. Here, we triangulated the 'trans-diagnostic' approach to personality, social trait judgments of faces, and neurophysiology to investigate (1) the relative position of autistic traits in a comprehensive social-affective personality space, and (2) the distinct associations between the social-affective personality dimensions and social trait judgment from faces in individuals with ASD and neurotypical individuals. We collected personality and facial judgment data from a large sample of online participants (N = 89 self-identified ASD; N = 307 neurotypical controls). Factor analysis with 33 subscales of 10 social-affective personality questionnaires identified a 4-dimensional personality space. This analysis revealed that ASD and control participants did not differ significantly along the personality dimensions of empathy and prosociality, antisociality, or social agreeableness. However, the ASD participants exhibited a weaker association between prosocial personality dimensions and judgments of facial trustworthiness and warmth than the control participants. Neurophysiological data also indicated that ASD participants had a weaker association with neuronal representations for trustworthiness and warmth from faces. These results suggest that the atypical association between social-affective personality and social trait judgment from faces may contribute to the social and affective difficulties associated with ASD.

Effects of an intensive slow cortical potentials neurofeedback training in female and male adolescents with autism spectrum disorder : Are there sex differences?

Background

This study aims to compare the effects of neurofeedback training on male and female adolescents with autism spectrum disorder (ASD). Furthermore, it examines sex differences regarding improvements in co-occurring psychopathological symptoms, cognitive flexibility and emotion recognition abilities. The study might provide first hints whether there is an influence of sex on treatment outcomes.

Methods

Six female and six male adolescents with ASD were matched according to age, IQ and symptom severity. All participants received 24 sessions of electroencephalography-based neurofeedback training. Before and after the intervention, psychological data for measuring co-occurring psychopathological symptoms as well as behavioral data for measuring cognitive flexibility and emotion recognition abilities were recorded.

Results

Caregivers rated statistically significant higher psychopathological problems in female than in male adolescents with ASD at baseline. Apart from that, no statistically significant sex-related differences were revealed in this sample; however, male adolescents tended to report greater improvements of externalizing, internalizing and total symptoms, whereas females experienced smaller improvements of externalizing and total problems, but no improvements of internalizing problems. Regarding caregivers’ assessments, more improvement of total problems was reported for females. For males, only improvements of internalizing and total problems were described.

Conclusion

This study reveals preliminary results that sex-related differences might play a role when evaluating treatment outcomes after neurofeedback training regarding comorbid psychopathological symptoms. Adolescents’ self-report and parental assessments, especially concerning psychopathological symptoms, should be combined and considered in future studies to help prevent sex bias in adolescents with ASD.

Augmented Reality for Autistic Children to Enhance Their Understanding of Facial Expressions

Difficulty in understanding the feelings and behavior of other people is considered one of the main symptoms of autism. Computer technology has increasingly been used in interventions with Autism Spectrum Disorder (ASD), especially augmented reality, to either treat or alleviate ASD symptomatology. Augmented reality is an engaging type of technology that helps children interact easily and understand and remember information, and it is not limited to one age group or level of education. This study utilized AR to display faces with six different basic facial expressions—happiness, sadness, surprise, fear, disgust, and anger—to help children to recognize facial features and associate facial expressions with a simultaneous human condition. The most important point of this system is that children can interact with the system in a friendly and safe way. Additionally, our results showed the system enhanced social interactions, talking, and facial expressions for both autistic and typical children. Therefore, AR might have a significant upcoming role in talking about the therapeutic necessities of children with ASD. This paper presents evidence for the feasibility of one of the specialized AR systems.