Impaired perception of facial motion in autism spectrum disorder

Investigating the Influence of Autism Spectrum Traits on Face Processing Mechanisms in Developmental Prosopagnosia

Autism traits are common exclusionary criteria in developmental prosopagnosia (DP) studies. We investigated whether autism traits produce qualitatively different face processing in 43 DPs with high vs. low autism quotient (AQ) scores. Compared to controls (n = 27), face memory and perception were similarly deficient in the high- and low-AQ DPs, with the high-AQ DP group additionally showing deficient face emotion recognition. Task-based fMRI revealed reduced occipito-temporal face selectivity in both groups, with high-AQ DPs additionally demonstrating decreased posterior superior temporal sulcus selectivity. Resting-state fMRI showed similar reduced face-selective network connectivity in both DP groups compared with controls. Together, this demonstrates that high- and low-AQ DP groups have very similar face processing deficits, with additional facial emotion deficits in high-AQ DPs.

Neural sensitivity to facial identity and facial expression discrimination in adults with autism

The fluent processing of faces can be challenging for autistic individuals. Here, we assessed the neural sensitivity to rapid changes in subtle facial cues in 23 autistic men and 23 age and IQ matched non-autistic (NA) controls using frequency-tagging electroencephalography (EEG). In oddball paradigms examining the automatic and implicit discrimination of facial identity and facial expression, base rate images were presented at 6 Hz, periodically interleaved every fifth image with an oddball image (i.e. 1.2 Hz oddball frequency). These distinctive frequency tags for base rate and oddball stimuli allowed direct and objective quantification of the neural discrimination responses. We found no large differences in the neural sensitivity of participants in both groups, not for facial identity discrimination, nor for facial expression discrimination. Both groups also showed a clear face-inversion effect, with reduced brain responses for inverted versus upright faces. Furthermore, sad faces generally elicited significantly lower neural amplitudes than angry, fearful and happy faces. The only minor group difference is the larger involvement of high-level right-hemisphere visual areas in NA men for facial expression processing. These findings are discussed from a developmental perspective, as they strikingly contrast with robust face processing deficits observed in autistic children using identical EEG paradigms.

Investigating the Face Inversion Effect in Autism Across Behavioral and Neural Measures of Face Processing: A Systematic Review and Bayesian Meta-Analysis

Importance

Face processing is foundational to human social cognition, is central to the hallmark features of autism spectrum disorder (ASD), and shapes neural systems and social behavior. Highly efficient and specialized, the face processing system is sensitive to inversion, demonstrated by reduced accuracy in recognition and altered neural response to inverted faces. Understanding at which mechanistic level the autistic face processing system may be particularly different, as measured by the face inversion effect, will improve overall understanding of brain functioning in autism.

Objective

To synthesize data from the extant literature to determine differences of the face processing system in ASD, as measured by the face inversion effect, across multiple mechanistic levels.

Data Sources

Systematic searches were conducted in the MEDLINE, Embase, Web of Science, and PubMed databases from inception to August 11, 2022.

Study Selection

Original research that reported performance-based measures of face recognition to upright and inverted faces in ASD and neurotypical samples were included for quantitative synthesis. All studies were screened by at least 2 reviewers.

Data Extraction and Synthesis

This systematic review and meta-analysis was conducted according to the 2020 Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline. Multiple effect sizes were extracted from studies to maximize information gain and statistical precision and used a random-effects, multilevel modeling framework to account for statistical dependencies within study samples.

Main Outcomes and Measures

Effect sizes were calculated as a standardized mean change score between ASD and neurotypical samples (ie, Hedges g). The primary outcome measure was performance difference between upright and inverted faces during face recognition tasks. Measurement modality, psychological construct, recognition demand, sample age, sample sex distribution, and study quality assessment scores were assessed as moderators.

Results

Of 1768 screened articles, 122 effect sizes from 38 empirical articles representing data from 1764 individual participants (899 ASD individuals and 865 neurotypical individuals) were included in the meta-analysis. Overall, face recognition performance differences between upright and inverted faces were reduced in autistic individuals compared with neurotypical individuals (g = -0.41; SE = 0.11; 95% credible interval [CrI], -0.63 to -0.18). However, there was considerable heterogeneity among effect sizes, which were explored with moderator analysis. The attenuated face inversion effect in autistic individuals was more prominent in emotion compared with identity recognition (b = 0.46; SE = 0.26; 95% CrI, -0.08 to 0.95) and in behavioral compared with electrophysiological measures (b = 0.23; SE = 0.24; 95% CrI, -0.25 to 0.70).

Conclusions and Relevance

This study found that on average, face recognition in autism is less impacted by inversion. These findings suggest less specialization or expertise of the face processing system in autism, particularly in recognizing emotion from faces as measured in behavioral paradigms.

A quantitative meta-analysis of face recognition deficits in autism: 40 years of research

The ability to recognize an individual face is essential to human social interaction. Even subtle errors in this process can have huge implications for the way we relate to social partners. Because autism spectrum disorder (ASD) is characterized by deficits in social interaction, researchers have theorized about the potential role of atypical face identity processing to the symptom profile of ASD for more than 40 years. We conducted an empirical meta-analysis of this large literature to determine whether and to what extent face identity processing is atypical in ASD compared to typically developing (TD) individuals. We also tested the hypotheses that the deficit is selective to face identity recognition, not perception, and that methodological variation across studies moderates the magnitude of the estimated deficit. We identified 112 studies (5,390 participants) that generated 172 effect sizes from both recognition (k = 119) and discrimination (k = 53) paradigms. We used state-of-the-art approaches for assessing the validity and robustness of the analyses. We found comparable and large deficits in ASD for both face identity recognition (Hedge's g = -0.86) and discrimination (Hedge's g = -0.82). This means that the score of an average ASD individual is nearly 1 SD below the average TD individual on tasks assessing both aspects of face identity processing. These deficits generalize across age groups, sex, IQ scores, and task paradigms. These findings suggest that deficits in face identity processing may represent a core deficit in ASD. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Dorsal-movement and ventral-form regions are functionally connected during visual-speech recognition

Faces convey social information such as emotion and speech. Facial emotion processing is supported via interactions between dorsal-movement and ventral-form visual cortex regions. Here, we explored, for the first time, whether similar dorsal-ventral interactions (assessed via functional connectivity), might also exist for visual-speech processing. We then examined whether altered dorsal-ventral connectivity is observed in adults with high-functioning autism spectrum disorder (ASD), a disorder associated with impaired visual-speech recognition. We acquired functional magnetic resonance imaging (fMRI) data with concurrent eye tracking in pairwise matched control and ASD participants. In both groups, dorsal-movement regions in the visual motion area 5 (V5/MT) and the temporal visual speech area (TVSA) were functionally connected to ventral-form regions (i.e., the occipital face area [OFA] and the fusiform face area [FFA]) during the recognition of visual speech, in contrast to the recognition of face identity. Notably, parts of this functional connectivity were decreased in the ASD group compared to the controls (i.e., right V5/MT-right OFA, left TVSA-left FFA). The results confirmed our hypothesis that functional connectivity between dorsal-movement and ventral-form regions exists during visual-speech processing. Its partial dysfunction in ASD might contribute to difficulties in the recognition of dynamic face information relevant for successful face-to-face communication.

Requirements for Robotic Interpretation of Social Signals “in the Wild”: Insights from Diagnostic Criteria of Autism Spectrum Disorder

The last few decades have seen widespread advances in technological means to characterise observable aspects of human behaviour such as gaze or posture. Among others, these developments have also led to significant advances in social robotics. At the same time, however, social robots are still largely evaluated in idealised or laboratory conditions, and it remains unclear whether the technological progress is sufficient to let such robots move “into the wild”. In this paper, we characterise the problems that a social robot in the real world may face, and review the technological state of the art in terms of addressing these. We do this by considering what it would entail to automate the diagnosis of Autism Spectrum Disorder (ASD). Just as for social robotics, ASD diagnosis fundamentally requires the ability to characterise human behaviour from observable aspects. However, therapists provide clear criteria regarding what to look for. As such, ASD diagnosis is a situation that is both relevant to real-world social robotics and comes with clear metrics. Overall, we demonstrate that even with relatively clear therapist-provided criteria and current technological progress, the need to interpret covert behaviour cannot yet be fully addressed. Our discussions have clear implications for ASD diagnosis, but also for social robotics more generally. For ASD diagnosis, we provide a classification of criteria based on whether or not they depend on covert information and highlight present-day possibilities for supporting therapists in diagnosis through technological means. For social robotics, we highlight the fundamental role of covert behaviour, show that the current state-of-the-art is unable to characterise this, and emphasise that future research should tackle this explicitly in realistic settings.

Face perception in autism spectrum disorder: Modulation of holistic processing by facial emotion

Individuals with Autism Spectrum Disorder (ASD; autistic individuals) may exhibit atypical face perception because they fail to process faces holistically. In the context of this hypothesis, it is critical to determine whether autistic individuals exhibit diminished susceptibility to the composite face illusion, widely regarded as a key marker of holistic face processing. To date, however, previous studies have yielded inconsistent findings. In light of recent evidence suggesting that facial emotion cues increase the strength of the composite face illusion in typical individuals, the present study sought to determine whether the presence of facial emotion also modulates the strength of the composite face illusion in autistic individuals, many of whom experience difficulties recognizing facial expressions. We therefore measured composite face effects in a sample of autistic individuals (N = 20) and matched typical controls (N = 29) using an incidental emotion procedure in which distractor regions varied systematically in their emotion strength. As expected, the presence of facial emotion in the distractor regions of composite face arrangements increased the strength of the illusory distortion induced. The extent of the modulation by facial emotion was similar in the two groups. The composite effects seen in the ASD group were qualitatively and quantitatively similar to those seen in the typical group, suggestive of intact holistic processing in this population.

Empathy and face processing in adults with and without autism spectrum disorder

Many factors contribute to social difficulties in individuals with autism spectrum disorder (ASD). The goal of the present work was to determine whether atypicalities in how individuals with ASD process static, socially engaging faces persist when nonrigid facial motion cues are present. We also sought to explore the relationships between various face processing abilities and individual differences in autism symptom severity and traits such as empathy. Participants included 16 adults with ASD without intellectual impairment and 16 sex- and age-matched controls. Mean Verbal IQ was comparable across groups [t(30) = 0.70, P = 0.49]. The two groups responded similarly to many of the experimental manipulations; however, relative to controls, participants with ASD responded more slowly to dynamic expressive faces, even when no judgment was required; were less accurate at identity matching with static and dynamic faces; and needed more time to make identity and expression judgments [F(1, 30) ≥ 6.37, P ≤ 0.017, η_p²  ≥ 0.175 in all cases], particularly when the faces were moving [F(1, 30) = 3.40, P = 0.072, η_p²  = 0.104]. In the full sample, as social autistic traits increased and empathic skills declined, participants needed more time to judge static identity, and static or dynamic expressions [0.43 < |r_s | < 0.56]. The results suggest that adults with ASD show general impairments in face and motion processing and support the view that an examination of individual variation in particular personality traits and abilities is important for advancing our understanding of face perception. Autism Res 2018, 11: 942-955. © 2018 International Society for Autism Research, Wiley Periodicals, Inc.

LAY SUMMARY

Our findings suggest that people with ASD have problems processing expressive faces, especially when seen in motion. It is important to learn who is most at risk for face processing problems, given that in the general population such problems appear to be linked to impaired social skills and empathy. By studying relationships between different abilities and traits, we may be able to find better ways to diagnose and support all people on the autism spectrum.

The impact of atypical sensory processing on social impairments in autism spectrum disorder

Altered sensory processing has been an important feature of the clinical descriptions of autism spectrum disorder (ASD). There is evidence that sensory dysregulation arises early in the progression of ASD and impacts social functioning. This paper reviews behavioral and neurobiological evidence that describes how sensory deficits across multiple modalities (vision, hearing, touch, olfaction, gustation, and multisensory integration) could impact social functions in ASD. Theoretical models of ASD and their implications for the relationship between sensory and social functioning are discussed. Furthermore, neural differences in anatomy, function, and connectivity of different regions underlying sensory and social processing are also discussed. We conclude that there are multiple mechanisms through which early sensory dysregulation in ASD could cascade into social deficits across development. Future research is needed to clarify these mechanisms, and specific focus should be given to distinguish between deficits in primary sensory processing and altered top-down attentional and cognitive processes.

Face processing in autism: Reduced integration of cross-feature dynamics

Characteristic problems with social interaction have prompted considerable interest in the face processing of individuals with Autism Spectrum Disorder (ASD). Studies suggest that reduced integration of information from disparate facial regions likely contributes to difficulties recognizing static faces in this population. Recent work also indicates that observers with ASD have problems using patterns of facial motion to judge identity and gender, and may be less able to derive global motion percepts. These findings raise the possibility that feature integration deficits also impact the perception of moving faces. To test this hypothesis, we examined whether observers with ASD exhibit susceptibility to a new dynamic face illusion, thought to index integration of moving facial features. When typical observers view eye-opening and -closing in the presence of asynchronous mouth-opening and -closing, the concurrent mouth movements induce a strong illusory slowing of the eye transitions. However, we find that observers with ASD are not susceptible to this illusion, suggestive of weaker integration of cross-feature dynamics. Nevertheless, observers with ASD and typical controls were equally able to detect the physical differences between comparison eye transitions. Importantly, this confirms that observers with ASD were able to fixate the eye-region, indicating that the striking group difference has a perceptual, not attentional origin. The clarity of the present results contrasts starkly with the modest effect sizes and equivocal findings seen throughout the literature on static face perception in ASD. We speculate that differences in the perception of facial motion may be a more reliable feature of this condition.

Categorizing identity from facial motion

Advances in marker-less motion capture technology now allow the accurate replication of facial motion and deformation in computer-generated imagery (CGI). A forced-choice discrimination paradigm using such CGI facial animations showed that human observers can categorize identity solely from facial motion cues. Animations were generated from motion captures acquired during natural speech, thus eliciting both rigid (head rotations and translations) and nonrigid (expressional changes) motion. To limit interferences from individual differences in facial form, all animations shared the same appearance. Observers were required to discriminate between different videos of facial motion and between the facial motions of different people. Performance was compared to the control condition of orientation-inverted facial motion. The results show that observers are able to make accurate discriminations of identity in the absence of all cues except facial motion. A clear inversion effect in both tasks provided consistency with previous studies, supporting the configural view of human face perception. The accuracy of this motion capture technology thus allowed stimuli to be generated that closely resembled real moving faces. Future studies may wish to implement such methodology when studying human face perception.

Temporal processing as a source of altered visual perception in high autistic tendency

Superior local at the expense of global perception characterises vision in autism spectrum disorders (ASD). However, progress towards discovering a neural mechanism has been slow. Here we used known differences in magnocellular and parvocellular receptive field properties to assess the temporal encoding of information, via flicker fusion paradigms, in those high and low in self-reported autistic tendency (Autism Spectrum Quotient - AQ). A Low AQ group (AQ≤13, n=22), and a High AQ group (AQ≥18, n=17) undertook a 4AFC luminance flicker fusion (FF) with 5 temporal contrasts from 5% to 100%, and a 2AFC isoluminant red-green colour fusion task. Both groups showed an increase in fusion thresholds with temporal achromatic contrast. The High AQ group displayed diminished flicker fusion thresholds compared to the Low AQ at the lowest contrasts. For the red-green colour fusion task, the High AQ group displayed mean fusion frequency slightly greater than the Low AQ group. A significant interaction between 5% luminance contrast and the red-green fusion frequencies demonstrated that the differences in thresholds were not simply due to variations in overall attentional capacity between groups. These differences in flicker fusion thresholds are in accordance with reported differences in cortical visual evoked potential nonlinearities, particularly relating to the neural efficiency of the magnocellular pathway.