Specific Patterns of Emotion Recognition from Faces in Children with ASD: Results of a Cross-Modal Matching Paradigm

Social competence in autism: A structural equation modeling approach

Autistic individuals present with difficulties in social competence (e.g., navigating social interactions and fostering relationships). Clinical interventions widely target social cognition and social behavior, but there is inconsistent understanding of the underlying components of social competence. The present study used structural equation modeling to examine social cognition and social behavior and explore the relationship between these latent constructs. Autistic youth (ages 10-17; n = 219) and their caregivers participated in this study. Constructs of social cognition and social behavior were captured using caregiver-report and self-report rating scales, as well as observational measures and direct clinical assessments (e.g., NEPSY-II). Measurement models of social cognition and social behavior demonstrated adequate to good fit. Correlational models demonstrated adequate to poor fit, indicating latent constructs of social cognition and social behavior are not closely related in autistic youth. Exploratory examination of a subsample of male youth (n = 157) evidenced improved model fit of social behavior, specifically. Findings tease apart social cognition and social behavior as cohesive and separable constructs; results do not support a structural relationship between social cognition and social behavior. Noted treatment implications include consideration of how targeting social cognition and social behavior together or separately may support autistic youth's progress toward reaching their identified therapeutic goals and supporting their self-directed social development.

Comparative analysis of emotional facial expression recognition and empathy in children with prader-willi syndrome and autism spectrum disorder

BACKGROUND

Prader-Willi Syndrome (PWS) is a rare neurodevelopmental disorder that is often comorbid with Autism Spectrum Disorder (ASD). Due to the close association between these two conditions, and recognizing that Theory of Mind (ToM) is related to social behaviors in ASD, there is a growing interest in studying the reciprocity of social communication between these two groups.

METHOD

The primary objective of this study was to compare how children (n = 45) with PWS (n = 15), ASD (n = 15), and a control group (n = 15) respond to emotion recognition of facial expressions and empathy, which are both concepts related to ToM. The study utilized two tools named FEEL and Deusto-e-Motion 1.0. We also evaluated the Working Memory index of the WISC-IV scale, the Social Perception domain of the NEPSY-II battery, and the SCQ in both clinical groups.

RESULTS

Our findings suggest that individuals with PWS exhibit lower accuracy in recognizing facial expressions and empathy compared to the control group. Both clinical groups exhibited a delayed reaction time compared to the control group. Children with PWS display difficulties in recognizing emotions of disgust and surprise. In terms of cognitive empathy, children with PWS showed a greater inclination to respond to disgust as compared to children with ASD.

CONCLUSIONS

This study represents the initial stage in comprehending the emotional and empathetic abilities of children with PWS and ASD. The findings can provide valuable insights for developing future interventions.

Autism Spectrum Disorder and auditory sensory alterations: a systematic review on the integrity of cognitive and neuronal functions related to auditory processing

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition with a wide spectrum of symptoms, mainly characterized by social, communication, and cognitive impairments. Latest diagnostic criteria according to DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, 2013) now include sensory issues among the four restricted/repetitive behavior features defined as "hyper- or hypo-reactivity to sensory input or unusual interest in sensory aspects of environment". Here, we review auditory sensory alterations in patients with ASD. Considering the updated diagnostic criteria for ASD, we examined research evidence (2015-2022) of the integrity of the cognitive function in auditory-related tasks, the integrity of the peripheral auditory system, and the integrity of the central nervous system in patients diagnosed with ASD. Taking into account the different approaches and experimental study designs, we reappraise the knowledge on auditory sensory alterations and reflect on how these might be linked with behavior symptomatology in ASD.

Multichannel Perception of Emotion in Speech, Voice, Facial Expression, and Gesture in Individuals With Autism: A Scoping Review

PURPOSE

Numerous studies have identified individuals with autism spectrum disorder (ASD) with deficits in unichannel emotion perception and multisensory integration. However, only limited research is available on multichannel emotion perception in ASD. The purpose of this review was to seek conceptual clarification, identify knowledge gaps, and suggest directions for future research.

METHOD

We conducted a scoping review of the literature published between 1989 and 2021, following the 2005 framework of Arksey and O'Malley. Data relating to study characteristics, task characteristics, participant information, and key findings on multichannel processing of emotion in ASD were extracted for the review.

RESULTS

Discrepancies were identified regarding multichannel emotion perception deficits, which are related to participant age, developmental level, and task demand. Findings are largely consistent regarding the facilitation and compensation of congruent multichannel emotional cues and the interference and disruption of incongruent signals. Unlike controls, ASD individuals demonstrate an overreliance on semantics rather than prosody to decode multichannel emotion.

CONCLUSIONS

The existing literature on multichannel emotion perception in ASD is limited, dispersed, and disassociated, focusing on a variety of topics with a wide range of methodologies. Further research is necessary to quantitatively examine the impact of methodological choice on performance outcomes. An integrated framework of emotion, language, and cognition is needed to examine the mutual influences between emotion and language as well as the cross-linguistic and cross-cultural differences.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19386176.

Exploring social emotion processing in autism: evaluating the reading the mind in the eyes test using network analysis

BACKGROUND

Features of autism spectrum disorder (ASD) include difficulties in processing and interpreting socioemotional information. The "Reading the Mind in the Eyes" test (RMET) is a validated measurement for processing socioemotional ability. However, previous RMET studies did not explore patterns of incorrect answers and the emotional valence of the test items. This study used the Taiwanese version of the RMET and the network analysis methods to examine the differences in underlying mechanisms of socioemotional processes between 30 males with autism spectrum disorder (ASD) (mean age = 18 years) and 30 healthy control males (mean age = 17 years). For each test item, a picture of a person's eyes and partial face was shown with four words describing the emotional status on picture corners. Participants were instructed to choose one of the four words that best matched the person's thinking or feeling. We further classified the words into three valences of emotional categories to examine socioemotional processes.

RESULTS

Our results showed that ASD males performed poorer on the RMET than the controls. ASD males had higher network density and in-degree scores, especially in negative words, than control males.

CONCLUSIONS

The findings suggest that males with ASD might have deficits in mapping the best emotional concept words to the target item, especially for processing negative emotion.

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review

The automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities are used in the analyzed studies, including facial expressions, prosody of speech, and physiological signals. Regarding representation models, the basic emotions are the most frequently recognized, especially happiness, fear, and sadness. Both single-channel and multichannel approaches are applied, with a preference for the first one. For multimodal recognition, early fusion was the most frequently applied. SVM and neural networks were the most popular for building classifiers. Qualitative analysis revealed important clues on participant group construction and the most common combinations of modalities and methods. All channels are reported to be prone to some disturbance, and as a result, information on a specific symptoms of emotions might be temporarily or permanently unavailable. The challenges of proper stimuli, labelling methods, and the creation of open datasets were also identified.

Attention for Emotion-How Young Adults With Neurodevelopmental Disorders Look at Facial Expressions of Affect

While Autism Spectrum Disorder (ASD), Attention-Deficit/Hyperactivity Disorder (ADHD) and Schizophrenia (SCZ) differ in many clinically relevant features such as symptomatology and course, they may also share genetic underpinnings, affective problems, deviancies in social interactions, and are all characterized by some kind of cognitive impairment. This situation calls for a joint investigation of the specifics of cognitive (dys-)functions of the three disorders. Such endeavor should focus, among other domains, on the inter-section of processing cognitive, affective and social information that is crucial in effective real-life interactions and can be accomplished when attentional preferences for human facial expressions of emotions is studied. To that end, attention to facial expressions of basic emotions was examined in young adults with ASD, ADHD, or SCZ in the present study. The three clinical groups were compared with an age-matched group of typically-developing participants (TD) during the free contemplation of five different facial emotions presented simultaneously, by varying identities, through the registration of eye movements. We showed, that dwell times and fixation counts differed for the different emotions in TD and in a highly similar way in ADHD. Patients with ASD differed from TD by showing a stronger differentiation between emotions and partially different attentional preferences. In contrast, the SCZ group showed an overall more restricted scanning behavior and a lack of differentiation between emotions. The ADHD group, showed an emotion-specific gazing pattern that was highly similar to that of controls. Thus, by analyzing eye movements, we were able to differentiate three different viewing patterns that allowed us to distinguish between the three clinical groups. This outcome suggests that attention for emotion may not tap into common pathophysiological processes and argues for a multi-dimensional approach to the grouping of disorders with neurodevelopmental etiology.

Morphing Task: The Emotion Recognition Process in Children with Attention Deficit Hyperactivity Disorder and Autism Spectrum Disorder

Recognizing a person’s identity is a fundamental social ability; facial expressions, in particular, are extremely important in social cognition. Individuals affected by autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) display impairment in the recognition of emotions and, consequently, in recognizing expressions related to emotions, and even their identity. The aim of our study was to compare the performance of participants with ADHD, ASD, and typical development (TD) with regard to both accuracy and speed in the morphing task and to determine whether the use of pictures of digitized cartoon faces could significantly facilitate the process of emotion recognition in ASD patients (particularly for disgust). This study investigated the emotion recognition process through the use of dynamic pictures (human faces vs. cartoon faces) created with the morphing technique in three pediatric populations (7–12 years old): ADHD patients, ASD patients, and an age-matched control sample (TD). The Chi-square test was used to compare response latency and accuracy between the three groups in order to determine if there were statistically significant differences (p < 0.05) in the recognition of basic emotions. The results demonstrated a faster response time in neurotypical children compared to ASD and ADHD children, with ADHD participants performing better than ASD participants on the same task. The overall accuracy parameter between the ADHD and ASD groups did not significantly differ.

Emotion Processing in Children with Conduct Problems and Callous-Unemotional Traits: An Investigation of Speed, Accuracy, and Attention

This study aimed to assess whether callous-unemotional traits (CU) are associated with deficits in emotion recognition independent of externalizing behavior and whether such deficits can be explained by aberrant attention. As previous studies have produced inconsistent results, the current study included two different emotion recognition paradigms and assessed the potential influence of factors such as processing speed and attention. The study included N = 94 children (eight to 14 years) with an oversampling of children with conduct problems (CP) and varying levels of CU-traits. Independent of externalizing behavior, CU-traits were associated with slower recognition of angry, sad and fearful facial expressions but not with higher error rates. There was no evidence that the association between CU-traits and emotion processing could be explained by misguided attention. Our results implicate that in children with high levels of CU-traits emotion recognition deficits depend on deficits in processing speed.

Changing Faces: Dynamic Emotional Face Processing in Autism Spectrum Disorder Across Childhood and Adulthood

BACKGROUND

Autism spectrum disorder (ASD) is classically associated with poor emotional face processing. Few studies, however, have used more ecological dynamic stimuli. We contrasted functional magnetic resonance imaging measures of dynamic emotional face processing in ASD and typically developing (TD) cohorts across a wide age range to determine if the processing and age-related trajectories differed between participants with and without ASD.

METHODS

Functional magnetic resonance imaging data collected from 200 participants (5-42 years old; 107 in ASD cohort, 93 in TD cohort) during the presentation of dynamic emotional faces (neutral-to-happy, neutral-to-angry) and dynamic flowers (closed-to-open) were analyzed. Group differences and group-by-age interactions in the faces versus flowers and between emotion contrasts were investigated.

RESULTS

Differences in activation between dynamic faces and flowers in occipital regions, including the fusiform gyri, were reduced in the ASD group. Contrasting the two emotions, ASD compared with TD participants showed increased engagement of the precentral, postcentral, and superior temporal gyri to happy faces and increased activation to angry faces occipitally. Emotion processing regions, such as insula, temporal pole, and frontal regions, showed increased recruitment with age to happy faces compared with both angry faces and flowers in the TD group, but decreased recruitment with age in the ASD group.

CONCLUSIONS

Using dynamic stimuli, we demonstrated that participants with ASD processed faces similarly to nonface stimuli, and age-related atypicalities were more pronounced to happy faces in participants with ASD. We demonstrated emotion-specific atypicalities in a large group of participants with ASD that underscore persistent difficulties from childhood into mid-adulthood.

Developing the Multidimensional Visual Scale Assessing Affect, Anxiety, Pride, and Energy Through a Research Partnership with Autistic Scholars

Autism research studies have traditionally failed to represent the full diversity of the autism spectrum due to the lack of measures available for use with participants who prefer to express themselves visually. A multidimensional measure of emotions, which can include both picture- and text-based prompts, may improve accessibility of emotion rating measures and broaden participation in research and educational evaluations to include those who communicate in diverse ways. Picture-based measures designed to assess participants' emotions may be useful for research concerning autistic identity and service evaluation, two areas where representation of diverse perspectives is needed. Our participatory group of autistic and nonautistic researchers developed a Multidimensional Visual Scale Assessing Affect, Anxiety, Pride, and Energy (AAPE) by adapting and expanding upon an existing emotion rating scale. When testing the AAPE with autistic college students (n = 72), their open-ended responses indicated that the AAPE's dimensions of affect (97.2% correct), anxiety (79.2% correct), and energy (84.7% correct) were well comprehended without text-based labels with potential for improvement in how pride (52.8% correct) was represented. When provided with the labels that each dimension was intended to represent, participants generally agreed that each emotional dimension was well represented. When tested in an informal educational summer camp with autistic children and adolescents (n = 50), the AAPE was well received and revealed insights about the students' emotional responses to different instructional strategies that can guide curricular improvements. The AAPE has utility as a tool to help diverse autistic individuals self-advocate and improve research and services.

Lay summary

Why was this study done?: There are very few tools that autistic people can use to share how they feel. We wanted to develop a tool to help autistic people express their emotions using pictures. Pictures can help autistic people share how they feel.What was the purpose of this study?: We wanted to make an easy-to-understand tool that autistic people can use to share how they feel.What did the researchers do?: Our research group is participatory, meaning that autistic and nonautistic researchers worked together to make our tool. An autistic artist drew the tool. We called it the AAPE, which stands for the emotions it assesses: Affect, Anxiety, Pride, and Energy. We worked together to see how well the AAPE worked. We used a survey to see if autistic high school and college students understood our first try at the AAPE and we learned how to make the AAPE better from these students. We worked together to make the AAPE better. Then, we did another survey with autistic college students to see if our second try at the AAPE worked better. Then, we asked autistic kids and teenagers to use the AAPE to share how they felt about different ways of teaching.What were the results of the study?: In our final test, we asked 72 autistic college students to tell us what emotions they thought the AAPE was showing. College students thought that affect (97.2%), anxiety (79.2%), and energy (84.7%) showed the emotions we aimed to show with room for improvement in how pride (52.8%) was shown. After we told participants which emotion each scale was showing, they agreed that affect (average score 4.28 of 5) and anxiety (4.29 of 5) showed the emotions best, followed by energy (4.08 of 5) and pride (3.5 of 5) on a scale from 1 to 5 (strongly agree).Students preferred using the AAPE compared with text-based surveys we used in the past. Results showed that the AAPE does a good job at measuring emotions. Edits may still be needed to better show "pride." Work is needed with nonspeaking people to make sure our measure works well for people who communicate in different ways.What are potential weaknesses in the study?: The autistic adolescents and adults we have tested the AAPE with so far have not been very diverse. We did not include participants who communicate without speaking in these first tests of the AAPE. We plan to use the AAPE with more diverse groups in future studies.How will these findings help autistic adults now or in the future?: In a future study, we will use the AAPE to rate pictures that show experiences of being autistic, like feeling outside a social group, having sensory difficulties, and making patterns. We would like to do this because some studies talk about negative experiences of autism, like feeling the need to hide autistic traits, but other studies describe strengths of autism, like strong memories and advanced knowledge in particular subjects. However, these studies do not talk about the emotions that come with these experiences and if these experiences are shared with autistic people who do not use speech to communicate. The AAPE is a tool that might help us understand how diverse autistic people feel about autism.

Cross-Modal Coordination of Face-Directed Gaze and Emotional Speech Production in School-Aged Children and Adolescents with ASD

Autism spectrum disorder involves persistent difficulties in social communication. Although these difficulties affect both verbal and nonverbal communication, there are no quantitative behavioral studies to date investigating the cross-modal coordination of verbal and nonverbal communication in autism. The objective of the present study was to characterize the dynamic relation between speech production and facial expression in children with autism and to establish how face-directed gaze modulates this cross-modal coordination. In a dynamic mimicry task, experiment participants watched and repeated neutral and emotional spoken sentences with accompanying facial expressions. Analysis of audio and motion capture data quantified cross-modal coordination between simultaneous speech production and facial expression. Whereas neurotypical children produced emotional sentences with strong cross-modal coordination and produced neutral sentences with weak cross-modal coordination, autistic children produced similar levels of cross-modal coordination for both neutral and emotional sentences. An eyetracking analysis revealed that cross-modal coordination of speech production and facial expression was greater when the neurotypical child spent more time looking at the face, but weaker when the autistic child spent more time looking at the face. In sum, social communication difficulties in autism spectrum disorder may involve deficits in cross-modal coordination. This finding may inform how autistic individuals are perceived in their daily conversations.

Cross-modal emotion recognition and autism-like traits in typically developing children

The ability to explicitly recognize emotions develops gradually throughout childhood, and children usually have greater difficulty in recognizing emotions from the voice than from the face. However, little is known about how children integrate vocal and facial cues to recognize an emotion, particularly during mid to late childhood. Furthermore, children with an autism spectrum disorder often show a reduced ability to recognize emotions, especially when integrating emotion from multiple modalities. The current preliminary study explored the ability of typically developing children aged 7-9 years to match emotional tones of voice to facial expressions and whether this ability varies according to the level of autism-like traits. Overall, children were the least accurate when matching happy and fearful voices to faces, commonly pairing happy voices with angry faces and fearful voices with sad faces. However, the level of autism-like traits was not associated with matching accuracy. These results suggest that 7- to 9-year-old children have difficulty in integrating vocal and facial emotional expressions but that differences in cross-modal emotion matching in relation to the broader autism phenotype are not evident in this task for this age group with the current sample.

Considering equifinality in treatment planning for social impairment: Divergent paths in neurodevelopmental disorders

Youth with autism spectrum disorder (ASD) present with deficits in both social cognition and executive functioning (EF), which contribute to social impairment. Autistic youth are also frequently diagnosed with comorbid attention-deficit/hyperactivity disorder (ADHD), a disorder that, like ASD, includes impaired EF and social functioning. The comorbidity of ASD and ADHD may result in compounded social impairment, but prior research has not sufficiently evaluated the extent to which this comorbidity profile responds to evidence-based intervention targeting social deficits. It is conceivable that dually targeting EF and social cognition impairment will be more impactful than direct social skills training alone. The authors present an integrative model for intervention programming that examines pathways to social impairment in order to more effectively improve social skills and thereby impact both proximal (e.g., emotion expression, current peer relationships) and more distal outcomes (e.g., depression, self-esteem) in youth with ASD and other neurodevelopmental disorders.

The Characteristics of Intelligence Profile and Eye Gaze in Facial Emotion Recognition in Mild and Moderate Preschoolers With Autism Spectrum Disorder

Childhood autism spectrum disorder (ASD) can easily be misdiagnosed, due to the nonspecific social and communicational deficits associated with the disorder. The present study attempted to profile the mental development and visual attention toward emotion among preschool children with mild or moderate ASD who were attending mainstream kindergartens. A total of 21 children (17 boys and 4 girls) diagnosed with mild or moderate ASD selected from 5,178 kindergarteners from the Xi'an city were recruited. Another group of 21 typically developing (TD) children who were matched with age, gender, and class served as controls. All children were assessed using the Griffiths Mental Development Scales-Chinese (GDS-C), and their social visual attention was assessed during watching 20 ecologically valid film scenes by using eye tracking technique. The results showed that ASD children had lower mental development scores in the Locomotor, Personal-Social, Language, Performance, and Practical Reasoning subscales than the TD peers. Moreover, deficits in recognizing emotions from facial expressions based on naturalistic scene stimuli with voice were found for ASD children. The deficits were significantly correlated with their ability in social interaction and development quotient in ASD group. ASD children showed atypical eye-gaze pattern when compared to TD children during facial emotion expression task. Children with ASD had reduced visual attention to facial emotion expression, especially for the eye region. The findings confirmed the deficits of ASD children in real life multimodal of emotion recognition, and their atypical eye-gaze pattern for emotion recognition. Parents and teachers of children with mild or moderate ASD should make informed educational decisions according to their level of mental development. In addition, eye tracking technique might clinically help provide evidence diagnosing children with mild or moderate ASD.