Abnormality in face scanning by children with autism spectrum disorder is limited to the eye region: evidence from multi-method analyses of eye tracking data

Spatiotemporal Eye Movement Dynamics Reveal Altered Face Prioritization in Early Visual Processing Among Autistic Children

BACKGROUND

Reduced social attention - looking at faces - is one of the most common manifestations of social difficulty in autism central to social development. Although reduced social attention is well-characterized in autism, qualitative differences in how social attention unfolds across time remains unknown.

METHODS

We used a computational modeling (i.e., hidden Markov modeling) approach to assess and compare the spatiotemporal dynamics of social attention in a large, well-characterized sample of autistic (n = 280) and neurotypical (n = 120) children (ages 6-11) that completed three social eye-tracking assays across three longitudinal time points (Baseline, 6 weeks, 24 weeks).

RESULTS

Our analysis supported the existence of two common eye movement patterns that emerged across three ET assays. A focused pattern was characterized by small face regions of interest, which had high probability of capturing fixations early in visual processing. In contrast, an exploratory pattern was characterized by larger face regions of interest, with lower initial probability of fixation, and more non-social regions of interest. In the context of social perception, autistic children showed significantly more exploratory eye movement patterns than neurotypical children across all social perception assays and all three longitudinal time points. Eye movement patterns were associated with clinical features of autism, including adaptive function, face recognition, and autism symptom severity.

CONCLUSIONS

Decreased likelihood of precisely looking to faces early in social visual processing may be an important feature of autism that was associated with autism-related symptomology and may reflect less visual sensitivity to face information.

A comprehensive analysis towards exploring the promises of AI-related approaches in autism research

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition that presents challenges in communication, social interaction, repetitive behaviour, and limited interests. Detecting ASD at an early stage is crucial for timely interventions and an improved quality of life. In recent times, Artificial Intelligence (AI) has been increasingly used in ASD research. The rise in ASD diagnoses is due to the growing number of ASD cases and the recognition of the importance of early detection, which leads to better symptom management. This study explores the potential of AI in identifying early indicators of autism, aligning with the United Nations Sustainable Development Goals (SDGs) of Good Health and Well-being (Goal 3) and Peace, Justice, and Strong Institutions (Goal 16). The paper aims to provide a comprehensive overview of the current state-of-the-art AI-based autism classification by reviewing recent publications from the last decade. It covers various modalities such as Eye gaze, Facial Expression, Motor skill, MRI/fMRI, and EEG, and multi-modal approaches primarily grouped into behavioural and biological markers. The paper presents a timeline spanning from the history of ASD to recent developments in the field of AI. Additionally, the paper provides a category-wise detailed analysis of the AI-based application in ASD with a diagrammatic summarization to convey a holistic summary of different modalities. It also reports on the successes and challenges of applying AI for ASD detection while providing publicly available datasets. The paper paves the way for future scope and directions, providing a complete and systematic overview for researchers in the field of ASD.

Repetitive transcranial magnetic stimulation can improve the fixation of eyes rather than the fixation preference in children with autism spectrum disorder

Background

Transcranial magnetic stimulation (TMS) has been introduced into the intervention of autism spectrum disorders (ASD) as a possible new therapeutic option for modifying pathological neuroplasticity. However, the stimulating protocols of rTMS for ASD have not been approved unanimously, which affects the clinical popularization and application of rTMS. In addition, there is little research on the improvement of social processing of autistic children by rTMS.

Methods

We explored the clinical efficacy of rTMS and improvement of face processing with the protocol of left high-frequency and right low-frequency on bilateral dorsolateral prefrontal cortex (DLPFC), with a sample of 45 ASD participants aged 2-18.

Results

Our results showed that both the score on the Childhood Autism Rating Scale (CARS) and the fixations on the eyes of the human faces improved by two-session rTMS intervention, except for the percentage of eyes fixation. The mediation analysis indicated the item of "Adaptation to Change" of CARS mediated dominantly the improvement of eye-gaze behavior of ASD participants by rTMS.

Conclusion

Our study revealed the mechanism of rTMS in improving the eye-gaze behavior of the autism population, deepened the understanding of the function of rTMS in treating autistic social disorders, and provided a reference for combined treatment for ASD.

Where on the face do we look during phonemic restoration: An eye-tracking study

Face to face communication typically involves audio and visual components to the speech signal. To examine the effect of task demands on gaze patterns in response to a speaking face, adults participated in two eye-tracking experiments with an audiovisual (articulatory information from the mouth was visible) and a pixelated condition (articulatory information was not visible). Further, task demands were manipulated by having listeners respond in a passive (no response) or an active (button press response) context. The active experiment required participants to discriminate between speech stimuli and was designed to mimic environmental situations which require one to use visual information to disambiguate the speaker's message, simulating different listening conditions in real-world settings. Stimuli included a clear exemplar of the syllable /ba/ and a second exemplar in which the formant initial consonant was reduced creating an /a/-like consonant. Consistent with our hypothesis, results revealed that the greatest fixations to the mouth were present in the audiovisual active experiment and visual articulatory information led to a phonemic restoration effect for the /a/ speech token. In the pixelated condition, participants fixated on the eyes, and discrimination of the deviant token within the active experiment was significantly greater than the audiovisual condition. These results suggest that when required to disambiguate changes in speech, adults may look to the mouth for additional cues to support processing when it is available.

Why do children with autism spectrum disorder have abnormal visual perception?

Autism spectrum disorder (ASD) is associated with severe impairment in social functioning. Visual information processing provides nonverbal cues that support social interactions. ASD children exhibit abnormalities in visual orientation, continuous visual exploration, and visual-spatial perception, causing social dysfunction, and mechanisms underlying these abnormalities remain unclear. Transmission of visual information depends on the retina-lateral geniculate nucleus-visual cortex pathway. In ASD, developmental abnormalities occur in rapid expansion of the visual cortex surface area with constant thickness during early life, causing abnormal transmission of the peak of the visual evoked potential (P100). We hypothesized that abnormal visual perception in ASD are related to the abnormal visual information transmission and abnormal development of visual cortex in early life, what's more, explored the mechanisms of abnormal visual symptoms to provide suggestions for future research.

Eye-tracking correlates of response to joint attention in preschool children with autism spectrum disorder

BACKGROUND

A number of differences in joint attention behaviour between children with autism spectrum disorder (ASD) and typically developing (TD) individuals have previously been documented.

METHOD

We use eye-tracking technology to assess response to joint attention (RJA) behaviours in 77 children aged 31 to 73 months. We conducted a repeated-measures analysis of variance to identify differences between groups. In addition, we analysed correlations between eye-tracking and clinical measures using Spearman's correlation.

RESULTS

The children diagnosed with ASD were less likely to follow gaze compared to TD children. Children with ASD were less accurate at gaze following when only eye gaze information was available, compared to when eye gaze with head movement was observed. Higher accuracy gaze-following profiles were associated with better early cognition and more adaptive behaviours in children with ASD. Less accurate gaze-following profiles were associated with more severe ASD symptomatology.

CONCLUSION

There are differences in RJA behaviours between ASD and TD preschool children. Several eye-tracking measures of RJA behaviours in preschool children were found to be associated with clinical measures for ASD diagnosis. This study also highlights the construct validity of using eye-tracking measures as potential biomarkers in the assessment and diagnosis of ASD in preschool children.

Vigilance or avoidance: How do autistic traits and social anxiety modulate attention to the eyes?

Introduction

Social anxiety disorder (SAD) and autism spectrum disorder (ASD) are highly overlapping in symptoms and have a high rate of comorbidity, posing challenges in diagnosis and intervention for both disorders. Both disorders are linked to abnormal attention to the eyes, yet how they interactively modulate the attentional process to the eyes remains unclear.

Methods

In this study, we explored how autistic traits and social anxiety in college students separately and together affected different temporal stages of attention to the eyes. Participants were instructed to view virtual faces for 10 s and make an emotional judgment, while their eye movements were recorded.

Results

We found that social anxiety and autistic traits affected different temporal stages of eye-looking. Social anxiety only affected the first fixation duration on the eyes, while autistic traits were associated with eye avoidance at several time points in the later stage. More importantly, we found an interactive effect of autistic traits and social anxiety on the initial attention to the eyes: Among people scoring high on autistic traits, social anxiety was related to an early avoidance of the eyes as well as attention maintenance once fixated on the eyes.

Discussion

Our study suggests the separate and interactive roles of social anxiety and autistic traits in attention to the eyes. It contributes to a deeper understanding of the mechanisms of social attention in both SAD and ASD and highlights the application of psychiatric diagnoses using eye-tracking techniques.

Eye-movement analysis on facial expression for identifying children and adults with neurodevelopmental disorders

Experienced psychiatrists identify people with autism spectrum disorder (ASD) and schizophrenia (Sz) through interviews based on diagnostic criteria, their responses, and various neuropsychological tests. To improve the clinical diagnosis of neurodevelopmental disorders such as ASD and Sz, the discovery of disorder-specific biomarkers and behavioral indicators with sufficient sensitivity is important. In recent years, studies have been conducted using machine learning to make more accurate predictions. Among various indicators, eye movement, which can be easily obtained, has attracted much attention and various studies have been conducted for ASD and Sz. Eye movement specificity during facial expression recognition has been studied extensively in the past, but modeling taking into account differences in specificity among facial expressions has not been conducted. In this paper, we propose a method to detect ASD or Sz from eye movement during the Facial Emotion Identification Test (FEIT) while considering differences in eye movement due to the facial expressions presented. We also confirm that weighting using the differences improves classification accuracy. Our data set sample consisted of 15 adults with ASD and Sz, 16 controls, and 15 children with ASD and 17 controls. Random forest was used to weight each test and classify the participants as control, ASD, or Sz. The most successful approach used heat maps and convolutional neural networks (CNN) for eye retention. This method classified Sz in adults with 64.5% accuracy, ASD in adults with up to 71.0% accuracy, and ASD in children with 66.7% accuracy. Classifying of ASD result was significantly different (p<.05) by the binomial test with chance rate. The results show a 10% and 16.7% improvement in accuracy, respectively, compared to a model that does not take facial expressions into account. In ASD, this indicates that modeling is effective, which weights the output of each image.

Promoting gaze toward the eyes of emotional faces in individuals with high autistic traits using group cognitive behavioral therapy: An eye-tracking study

BACKGROUND

Individuals with subclinical autistic traits exhibit a pattern of eye avoidance similar to that of typical autism. Our study aimed to test the efficacy of group cognitive behavioral therapy (G-CBT) in promoting gaze toward the eye area of facial expressions, specifically orienting to emotional faces, in individuals with high autistic traits (high AT).

METHODS

Twenty-six high AT individuals and 30 low AT individuals participated. High AT individuals were assigned to eight sessions of G-CBT intervention. Eye-tracking measurements were acquired before and after treatment.

RESULTS

We observed the following: (a) the eye avoidance in high AT individuals was prominent for all facial expressions in relative to low AT individuals; (b) G-CBT primarily improved gaze toward the eyes of happy and fearful faces but not for neutral face expressions in high AT individuals; (c) after 8 sessions of G-CBT, the fixation time on the eyes of emotional faces improved significantly. For happy faces, the fixation time on the eyes of faces was markedly increased in epochs between 500 ms and 1000 ms after the face onset; for fearful faces, the improvement in participants existed between about 1000 ms and 1500 ms after the face appeared.

LIMITATION

Our results may not be generalized to other patients with ASD.

CONCLUSIONS

Our findings demonstrate that G-CBT significantly promotes gaze toward the eyes of emotional faces in high AT individuals. These results are encouraging, and suggest that the emotional face processing in autism spectrum disorder (ASD) might stand to benefit from similar psychotherapeutic treatment.

Using Video Modeling to Teach Abduction-Prevention Skills to Children with Autism Spectrum Disorder

Video modeling was used to teach children with autism spectrum disorder how to respond to taped stranger lure scenarios and in-situ stranger lures. A multiple baseline design across participants was used to assess treatment effects. Measures consisted of reported verbal and motor responses to three abduction scenarios and actual responses to stranger lures planted near the children's therapy program and within the children's communities. Each child displayed increases in appropriate responses to taped abduction scenarios and in-situ stranger lures post-treatment. One year following the intervention 90% of the participants maintained and generalized the skills. This study indicated that children with ASD could learn to respond to taped stranger lure scenarios and correspondingly demonstrate these skills in situ and maintain these skills for at least one year following treatment.

Atypical gaze patterns to facial feature areas in autism spectrum disorders reveal age and culture effects: A meta-analysis of eye-tracking studies

Children and adults with autism spectrum disorder (ASD) often present with atypical gaze patterns to others' faces, a finding substantiated throughout the literature. Yet, a quantification of atypical gaze patterns to different facial regions (e.g., eyes versus mouth) in ASD remains controversial. Also few study has investigated how age and culture impacted the pattern of gaze abnormalities in ASD. This research therefore conducted a meta-analysis of eye-tracking studies to evaluate age and culture effect on atypical gaze patterns of face processing in ASD. A total of 75 articles (91 studies) and 4209 individuals (ASD: 2027; controls: 2182) across all age ranges (i.e., childhood through to adulthood) from both Eastern and Western cultures were included in this meta-analysis. Individuals with ASD yielded shorter fixation durations to the eyes than individuals without ASD. Group differences in the time spent fixating on the eyes were not modulated by age, but affected by culture. Effect size in the eastern culture was larger than that in the western culture. In contrast, group differences on time spent looking at the mouth were not significant, but changed with age and modulated by culture. Relative to the neurotypical controls, Western individuals with ASD spent more time looking at the mouth from school age, whereas Eastern individuals with ASD did not gaze longer on mouth until adulthood. These results add to the body of evidence supporting atypical gaze behaviors to eyes in ASD and provide new insights into a potential mouth compensation strategy that develops with age in ASD. LAY SUMMARY: Individuals with autism spectrum disorder (ASD) often show atypical gaze patterns when looking at others' faces compared to neurotypical individuals. This paper examines the role of age and culture on pattern of gaze abnormalities in individuals with ASD. Results show that reduction of gaze on eyes in ASD is stable across all ages and cultures, while increase of gaze on mouth emerges as individuals with ASD get older. The findings provide a developmental insight to the gaze patterns on the autism spectrum across culture.

Ketamine disrupts gaze patterns during face viewing in the common marmoset

Faces are stimuli of critical importance for primates. The common marmoset (Callithrix jacchus) is a promising model for investigations of face processing, as this species possesses oculomotor and face-processing networks resembling those of macaques and humans. Face processing is often disrupted in neuropsychiatric conditions such as schizophrenia (SZ), and thus, it is important to recapitulate underlying circuitry dysfunction preclinically. The N-methyl-d-aspartate (NMDA) noncompetitive antagonist ketamine has been used extensively to model the cognitive symptoms of SZ. Here, we investigated the effects of a subanesthetic dose of ketamine on oculomotor behavior in marmosets during face viewing. Four marmosets received systemic ketamine or saline injections while viewing phase-scrambled or intact videos of conspecifics' faces. To evaluate effects of ketamine on scan paths during face viewing, we identified regions of interest in each face video and classified locations of saccade onsets and landing positions within these areas. A preference for the snout over eye regions was observed following ketamine administration. In addition, regions in which saccades landed could be significantly predicted by saccade onset region in the saline but not the ketamine condition. Effects on saccade control were limited to an increase in saccade peak velocity in all conditions and a reduction in saccade amplitudes during viewing of scrambled videos. Thus, ketamine induced a significant disruption of scan paths during viewing of conspecific faces but limited effects on saccade motor control. These findings support the use of ketamine in marmosets for investigating changes in neural circuits underlying social cognition in neuropsychiatric disorders.NEW & NOTEWORTHY Face processing, an important social cognitive ability, is impaired in neuropsychiatric conditions such as schizophrenia. The highly social common marmoset model presents an opportunity to investigate these impairments. We administered subanesthetic doses of ketamine to marmosets to model the cognitive symptoms of schizophrenia. We observed a disruption of scan paths during viewing of conspecifics' faces. These findings support the use of ketamine in marmosets as a model for investigating social cognition in neuropsychiatric disorders.

Social synchronization during joint attention in children with autism spectrum disorder

We explored the social synchronization of gaze-shift behaviors when responding to joint attention in children with autism spectrum disorder (ASD). Forty-one children aged 5 to 8 with ASD and 43 typically developing (TD) children watched a video to complete the response to joint attention (RJA) tasks, during which their gaze data were collected. The synchronization of gaze-shift behaviors between children and the female model in the video was measured with the cross-recurrence quantification analysis (CRQA). Ultimately, we discovered that children with ASD had the ability to synchronize their gaze shifts with the female model in the video during RJA tasks. Compared to the TD children, they displayed lower levels of synchronization and longer latency in this synchronized behavior. These findings provide a new avenue to deepen our understanding of the impairments of social interaction in children with ASD. Notably, the analytic method can be further applied to explore the social synchronization of numerous other social interactive behaviors in ASD. LAY SUMMARY: This study explored how autistic children synchronized their gazed shifts with others' gaze cues during joint attention. We found that compared to typical children, autistic children synchronized their gazed shifts less and needed more time to follow others' gaze. These findings provide a new avenue to deepen our understanding of the impairments of social interaction in children with ASD.

Gauging facial feature viewing preference as a stable individual trait in autism spectrum disorder

Eye tracking provides insights into social processing deficits in autism spectrum disorder (ASD), especially in conjunction with dynamic, naturalistic free-viewing stimuli. However, the question remains whether gaze characteristics, such as preference for specific facial features, can be considered a stable individual trait, particularly in those with ASD. If so, how much data are needed for consistent estimations? To address these questions, we assessed the stability and robustness of gaze preference for facial features as incremental amounts of movie data were introduced for analysis. We trained an artificial neural network to create an object-based segmentation of naturalistic movie clips (14 s each, 7410 frames total). Thirty-three high-functioning individuals with ASD and 36 age- and IQ-equated typically developing individuals (age range: 12-30 years) viewed 22 Hollywood movie clips, each depicting a social interaction. As we evaluated combinations of one, three, five, eight, and 11 movie clips, gaze dwell times on core facial features became increasingly stable at within-subject, within-group, and between-group levels. Using a number of movie clips deemed sufficient by our analysis, we found that individuals with ASD displayed significantly less face-centered gaze (centralized on the nose; p < 0.001) but did not significantly differ from typically developing participants in eye or mouth looking times. Our findings validate gaze preference for specific facial features as a stable individual trait and highlight the possibility of misinterpretation with insufficient data. Additionally, we propose the use of a machine learning approach to stimuli segmentation to quickly and flexibly prepare dynamic stimuli for analysis. LAY SUMMARY: Using a data-driven approach to segmenting movie stimuli, we examined varying amounts of data to assess the stability of social gaze in individuals with autism spectrum disorder (ASD). We found a reduction in social fixations in participants with ASD, driven by decreased attention to the center of the face. Our findings further support the validity of gaze preference for face features as a stable individual trait when sufficient data are used.

A quantitative meta-analysis of face recognition deficits in autism: 40 years of research

The ability to recognize an individual face is essential to human social interaction. Even subtle errors in this process can have huge implications for the way we relate to social partners. Because autism spectrum disorder (ASD) is characterized by deficits in social interaction, researchers have theorized about the potential role of atypical face identity processing to the symptom profile of ASD for more than 40 years. We conducted an empirical meta-analysis of this large literature to determine whether and to what extent face identity processing is atypical in ASD compared to typically developing (TD) individuals. We also tested the hypotheses that the deficit is selective to face identity recognition, not perception, and that methodological variation across studies moderates the magnitude of the estimated deficit. We identified 112 studies (5,390 participants) that generated 172 effect sizes from both recognition (k = 119) and discrimination (k = 53) paradigms. We used state-of-the-art approaches for assessing the validity and robustness of the analyses. We found comparable and large deficits in ASD for both face identity recognition (Hedge's g = -0.86) and discrimination (Hedge's g = -0.82). This means that the score of an average ASD individual is nearly 1 SD below the average TD individual on tasks assessing both aspects of face identity processing. These deficits generalize across age groups, sex, IQ scores, and task paradigms. These findings suggest that deficits in face identity processing may represent a core deficit in ASD. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

New Technologies as Promising Tools for Assessing Facial Emotion Expressions Impairments in ASD: A Systematic Review

The ability to recognize and express emotions from facial expressions are essential for successful social interactions. Facial Emotion Recognition (FER) and Facial Emotion Expressions (FEEs), both of which seem to be impaired in Autism Spectrum Disorders (ASD) and contribute to socio-communicative difficulties, participate in the diagnostic criteria for ASD. Only a few studies have focused on FEEs processing and the rare behavioral studies of FEEs in ASD have yielded mixed results. Here, we review studies comparing the production of FEEs between participants with ASD and non-ASD control subjects, with a particular focus on the use of automatic facial expression analysis software. A systematic literature search in accordance with the PRISMA statement identified 20 reports published up to August 2020 concerning the use of new technologies to evaluate both spontaneous and voluntary FEEs in participants with ASD. Overall, the results highlight the importance of considering socio-demographic factors and psychiatric co-morbidities which may explain the previous inconsistent findings, particularly regarding quantitative data on spontaneous facial expressions. There is also reported evidence for an inadequacy of FEEs in individuals with ASD in relation to expected emotion, with a lower quality and coordination of facial muscular movements. Spatial and kinematic approaches to characterizing the synchrony, symmetry and complexity of facial muscle movements thus offer clues to identifying and exploring promising new diagnostic targets. These findings have allowed hypothesizing that there may be mismatches between mental representations and the production of FEEs themselves in ASD. Such considerations are in line with the Facial Feedback Hypothesis deficit in ASD as part of the Broken Mirror Theory, with the results suggesting impairments of neural sensory-motor systems involved in processing emotional information and ensuring embodied representations of emotions, which are the basis of human empathy. In conclusion, new technologies are promising tools for evaluating the production of FEEs in individuals with ASD, and controlled studies involving larger samples of patients and where possible confounding factors are considered, should be conducted in order to better understand and counter the difficulties in global emotional processing in ASD.

Circumscribed Interest Modulates Attention to Eyes in Boys With and Without Autism Spectrum Disorder

Children with autism spectrum disorder (ASD) exhibit abnormal visual attention, such as diminished attention to eyes and enhanced attention to high-autism-interest objects. We tested whether high-autism-interest objects would modulate the attention to eyes in boys with ASD and typically developing (TD) boys. Twenty-two ASD and 22 TD children were presented simultaneously with human eyes and high/low-autism-interest objects (HAI/LAI) while their eye movements were recorded. We found that visual preference for eyes was influenced by competing objects in children with and without ASD. Specifically, both children with and without ASD showed reduced overall and first looking preference when eyes were paired with HAI objects relative to LAI objects. Children with ASD also showed reduced sustained viewing preference to the eyes after first looking at the eyes and late looking preference to the eyes after first looking at the objects in the HAI condition than the LAI condition, but these effects were absent in the TD group. Our study not only helps us understand some factors that impact attention to eyes, but also has implications for interventions aiming at improving eye contact in children with ASD.

Computer vision in autism spectrum disorder research: a systematic review of published studies from 2009 to 2019

The current state of computer vision methods applied to autism spectrum disorder (ASD) research has not been well established. Increasing evidence suggests that computer vision techniques have a strong impact on autism research. The primary objective of this systematic review is to examine how computer vision analysis has been useful in ASD diagnosis, therapy and autism research in general. A systematic review of publications indexed on PubMed, IEEE Xplore and ACM Digital Library was conducted from 2009 to 2019. Search terms included ['autis*' AND ('computer vision' OR 'behavio* imaging' OR 'behavio* analysis' OR 'affective computing')]. Results are reported according to PRISMA statement. A total of 94 studies are included in the analysis. Eligible papers are categorised based on the potential biological/behavioural markers quantified in each study. Then, different computer vision approaches that were employed in the included papers are described. Different publicly available datasets are also reviewed in order to rapidly familiarise researchers with datasets applicable to their field and to accelerate both new behavioural and technological work on autism research. Finally, future research directions are outlined. The findings in this review suggest that computer vision analysis is useful for the quantification of behavioural/biological markers which can further lead to a more objective analysis in autism research.

Oxytocin biases eye-gaze to dynamic and static social images and the eyes of fearful faces: associations with trait autism

A key functional effect of intranasal oxytocin with potential therapeutic relevance for autism-spectrum disorder is its reported facilitation of attention towards social stimuli, notably the eye region of faces. In the current randomized placebo-controlled within-subject experiment on 40 healthy males, we investigated the robustness of this facilitation of attention by intranasal oxytocin (24IU) towards social cues. Eye-tracking measures of preference for dynamic and static social vs. non-social stimuli were taken in four different paradigms where autistic individuals tend to exhibit reduced interest in social stimuli. Additionally, we investigated whether oxytocin increases attention towards the eyes relative to other salient face regions in an emotional face paradigm. Results showed that the time spent viewing both dynamic and static social vs. non-social stimuli was negatively associated with trait autism and significantly increased following intranasal oxytocin. For face stimuli, oxytocin primarily increased gaze towards the eyes of fearful expression faces but not for other face emotions. Overall, our findings demonstrate that oxytocin significantly shifts gaze preference towards social vs. non-social stimuli and to the eyes of fearful faces. Importantly, oxytocin appears generally to shift attention more towards salient social stimuli of particular relevance in the context of autism providing further support for its potential therapeutic use in autism-spectrum disorder.

Comparison of eye movements in schizophrenia and autism spectrum disorder

Aim

Eye movement abnormalities are often associated with psychiatric illness. Subjects with either schizophrenia or autism spectrum disorder (ASD) have been reported to show eye movement abnormalities. However, it is still unclear whether eye movement abnormalities in schizophrenia and in ASD have common features. This study aimed to understand the similarities/differences in eye movement abnormalities of subjects with schizophrenia and those with ASD.

Methods

We analyzed 75 eye movement characteristics of 83 subjects with schizophrenia, 17 subjects with ASD and 255 healthy controls that were collected during fixation, smooth pursuit and free viewing tasks using analysis of covariance with the covariates age and sex.

Results

We found significant effects across groups on 21 eye movement characteristics, of which 4 characteristics had large effect sizes. Post hoc multiple comparisons indicated significant differences between the subjects with schizophrenia and healthy controls across all 21 characteristics. On the other hand, no significant difference between the ASD group and healthy control group was found. Instead, the subjects with ASD showed significant differences from the subjects with schizophrenia in 5 eye movement characteristics during the free viewing and smooth pursuit eye movements.

Conclusions

The present results suggest that eye movement abnormalities in the subjects with ASD are different from those with schizophrenia and that the tasks in this study are suitable to detect eye movement abnormality in schizophrenia. Thus, the eye movement examinations used here may distinguish subjects with schizophrenia from those with ASD.

This study aimed to understand the similarities/differences in eye movement abnormalities of subjects with schizophrenia and those with ASD. The subjects with ASD showed significant differences from the subjects with schizophrenia in five characteristics during the free viewing and smooth pursuit eye movements. The results suggest that eye movement abnormalities in the subjects with ASD are different from those with schizophrenia.

What Can Eye Movements Tell Us about Subtle Cognitive Processing Differences in Autism?

Autism spectrum disorder (ASD) is neurodevelopmental condition principally characterised by impairments in social interaction and communication, and repetitive behaviours and interests. This article reviews the eye movement studies designed to investigate the underlying sampling or processing differences that might account for the principal characteristics of autism. Following a brief summary of a previous review chapter by one of the authors of the current paper, a detailed review of eye movement studies investigating various aspects of processing in autism over the last decade will be presented. The literature will be organised into sections covering different cognitive components, including language and social communication and interaction studies. The aim of the review will be to show how eye movement studies provide a very useful on-line processing measure, allowing us to account for observed differences in behavioural data (accuracy and reaction times). The subtle processing differences that eye movement data reveal in both language and social processing have the potential to impact in the everyday communication domain in autism.

A Novel Eye Movement Data Transformation Technique that Preserves Temporal Information: A Demonstration in a Face Processing Task

Existing research has shown that human eye-movement data conveys rich information about underlying mental processes, and that the latter may be inferred from the former. However, most related studies rely on spatial information about which different areas of visual stimuli were looked at, without considering the order in which this occurred. Although powerful algorithms for making pairwise comparisons between eye-movement sequences (scanpaths) exist, the problem is how to compare two groups of scanpaths, e.g., those registered with vs. without an experimental manipulation in place, rather than individual scanpaths. Here, we propose that the problem might be solved by projecting a scanpath similarity matrix, obtained via a pairwise comparison algorithm, to a lower-dimensional space (the comparison and dimensionality-reduction techniques we use are ScanMatch and t-SNE). The resulting distributions of low-dimensional vectors representing individual scanpaths can be statistically compared. To assess if the differences result from temporal scanpath features, we propose to statistically compare the cross-validated accuracies of two classifiers predicting group membership: (1) based exclusively on spatial metrics; (2) based additionally on the obtained scanpath representation vectors. To illustrate, we compare autistic vs. typically-developing individuals looking at human faces during a lab experiment and find significant differences in temporal scanpath features.

A novel machine learning analysis of eye-tracking data reveals suboptimal visual information extraction from facial stimuli in individuals with autism

We propose a new method of quantifying the utility of visual information extracted from facial stimuli for emotion recognition. The stimuli are convolved with a Gaussian fixation distribution estimate, revealing more information in those facial regions the participant fixated on. Feeding this convolution to a machine-learning emotion recognition algorithm yields an error measure (between actual and predicted emotions) reflecting the quality of extracted information. We recorded the eye-movements of 21 participants with autism and 23 age-, sex- and IQ-matched typically developing participants performing three facial analysis tasks: free-viewing, emotion recognition, and brow-mouth width comparison. In the emotion recognition task, fixations of participants with autism were positioned on lower areas of the faces and were less focused on the eyes compared to the typically developing group. Additionally, the utility of information extracted by them in the emotion recognition task was lower. Thus, the emotion recognition deficit typical in autism can be at least partly traced to the earliest stage of face processing, i.e. to the extraction of visual information via eye-fixations.

Emotion recognition from the eye region in children with and without Autism Spectrum Disorder in Arab and Scandinavian countries

BACKGROUND

Difficulties in facial emotion recognition (ER) skills are linked to autism spectrum disorder (ASD) in studies performed in Western and Eastern Asian countries. However, there is a paucity of research examining ER skills in Arab countries, where face-covering veils are more common than in Western countries.

OBJECTIVE

Our aim was to examine basic ER and ER error patterns in Egyptian and Finnish children with and without ASD.

METHOD

We employed the eye-submodule of the Frankfurt Test and Training of Facial Affect Recognition (FEFA) and the Autism Spectrum Screening Questionnaire (ASSQ).

RESULTS

Arab children with ASD (n = 34, M age = 8.6 years, FSIQ = 96.7) recognized correctly fewer emotions than did Scandinavian children with ASD (n = 32, M age = 12.5 years, FSIQ = 102.8) and Arab typically developing (TD) children (n = 34, M age = 10.3 years, FSIQ = 123.4) in general and specifically on surprise, disgust and neutral scales as well as on a blended emotion scale. Scandinavian children with ASD demonstrated a lower ability to recognize emotions in general and specifically happiness than did Scandinavian TD children. There were no differences between Arab and Scandinavian (n = 28, M age = 13.9 years) TD children in ER accuracy. We found country specific differences in ER error patterns in happiness, sadness and anger: Arab children interpreted these emotions more often as another emotion (happiness = sadness, sadness = anger, anger = sadness and surprise), whereas Scandinavian children interpreted happiness and sadness as neutral expression and anger as disgust. Arab children with ASD labeled sadness and anger in their ER error patterns more negatively than did Arab TD children, but there were no differences between Scandinavian children with ASD and TD in ER error patterns.

CONCLUSIONS

The differences between the Arab and Scandinavian children may reflect cultural differences in ER and ER error patterns.

The Characteristics of Intelligence Profile and Eye Gaze in Facial Emotion Recognition in Mild and Moderate Preschoolers With Autism Spectrum Disorder

Childhood autism spectrum disorder (ASD) can easily be misdiagnosed, due to the nonspecific social and communicational deficits associated with the disorder. The present study attempted to profile the mental development and visual attention toward emotion among preschool children with mild or moderate ASD who were attending mainstream kindergartens. A total of 21 children (17 boys and 4 girls) diagnosed with mild or moderate ASD selected from 5,178 kindergarteners from the Xi'an city were recruited. Another group of 21 typically developing (TD) children who were matched with age, gender, and class served as controls. All children were assessed using the Griffiths Mental Development Scales-Chinese (GDS-C), and their social visual attention was assessed during watching 20 ecologically valid film scenes by using eye tracking technique. The results showed that ASD children had lower mental development scores in the Locomotor, Personal-Social, Language, Performance, and Practical Reasoning subscales than the TD peers. Moreover, deficits in recognizing emotions from facial expressions based on naturalistic scene stimuli with voice were found for ASD children. The deficits were significantly correlated with their ability in social interaction and development quotient in ASD group. ASD children showed atypical eye-gaze pattern when compared to TD children during facial emotion expression task. Children with ASD had reduced visual attention to facial emotion expression, especially for the eye region. The findings confirmed the deficits of ASD children in real life multimodal of emotion recognition, and their atypical eye-gaze pattern for emotion recognition. Parents and teachers of children with mild or moderate ASD should make informed educational decisions according to their level of mental development. In addition, eye tracking technique might clinically help provide evidence diagnosing children with mild or moderate ASD.

The uncanny valley effect in typically developing children and its absence in children with autism spectrum disorders

Robots and virtual reality are gaining popularity in the intervention of children with autism spectrum disorder (ASD). To shed light on children’s attitudes towards robots and characters in virtual reality, this study aims to examine whether children with ASD show the uncanny valley effect. We varied the realism of facial appearance by morphing a cartoon face into a human face, and induced perceptual mismatch by enlarging the eyes, which has previously been shown as an effective method to induce the uncanny valley effect in adults. Children with ASD and typically developing (TD) children participated in a two-alternative forced choice task that asked them to choose one they liked more from the two images presented on the screen. We found that TD children showed the effect, i.e., the enlargement of eye size and the approaching realism reduced their preference. In contrast, children with ASD did not show the uncanny valley effect. Our findings in TD children help resolve the controversy in the literature about the existence of the uncanny valley effect among young children. Meanwhile, the absence of the uncanny valley effect in children with ASD might be attributed to their reduced sensitivity to subtle changes of face features and their limited visual experience to faces caused by diminished social motivation. Last, our findings provide practical implications for designing robots and virtual characters for the intervention of children with ASD.

Analogical Reasoning in Children With Autism Spectrum Disorder: Evidence From an Eye-Tracking Approach

The present study examined analogical reasoning in children with autism spectrum disorder (ASD) and its relationship with cognitive and executive functioning and processing strategies. Our findings showed that although children with ASD were less competent in solving analogical problems than typically developing children, this inferior performance was attributable to general cognitive impairments. Eye-movement analyses revealed that children with ASD paid less attention to relational items and showed fewer gaze shifts between relational locations. Nevertheless, these eye-movement patterns did not predict autistic children’s behavioral performance. Together, our findings suggest that ASD per se does not entail impairments in analogical reasoning. The inferior performance of autistic children on analogical reasoning tasks is attributable to deficits in general cognitive and executive functioning.

Patterns of fixation during face recognition: Differences in autism across age

Difficulties with face recognition increase from adolescence to adulthood in autism, reflecting a lack of typical late development. We examined whether this reflects differences in the development of patterns of fixation to eyes and mouths during face recognition. Children, adolescents, and adults (aged 7-30) with and without autism completed the Cambridge Face Memory Test while gaze was recorded. Average duration and number of fixations were calculated for eyes and mouth regions of interest, defined individually for each face image in the task. All groups and age groups made more and longer fixations to eyes than mouths. However, during face memorization, typically developing children and adults, but not adolescents, made more fixations to eyes than did their peers with autism. During face recognition, typically developing children and adults made shorter fixations on mouths than did their peers with autism; this pattern was reversed in adolescence, with adolescents with autism making more fixations to mouths than typically developing adolescents. Results suggest that group differences in patterns of fixations to faces change with age. Furthermore, different relationships between patterns of fixations and face recognition performance in typical development and autism suggest that these differences contribute, at least in part, to difficulties in autism.

Are you looking my way? Ostracism widens the cone of gaze

Ostracized individuals demonstrate an increased need for belonging. To satisfy this need, they search for signals of inclusion, one of which may be another person's gaze directed at oneself. We tested if ostracized, compared to included, individuals judge a greater degree of averted gaze as still being direct. This range of gaze angles still viewed as direct has been dubbed “the cone of (direct) gaze”. In the current research, ostracized and included participants viewed friendly-looking face stimuli with direct or slightly averted gaze (0°, 2°, 4°, 6°, and 8° to the left and to the right) and judged whether stimulus persons were looking at them or not. Ostracized individuals demonstrated a wider gaze cone than included individuals.

Spatiotemporal characteristics of gaze of children with autism spectrum disorders while looking at classroom scenes

Children with autism spectrum disorders (ASD) who have neurodevelopmental impairments in social communication often refuse to go to school because of difficulties in learning in class. The exact cause of maladaptation to school in such children is unknown. We hypothesized that these children have difficulty in paying attention to objects at which teachers are pointing. We performed gaze behavior analysis of children with ASD to understand their difficulties in the classroom. The subjects were 26 children with ASD (19 boys and 7 girls; mean age, 8.6 years) and 27 age-matched children with typical development (TD) (14 boys and 13 girls; mean age, 8.2 years). We measured eye movements of the children while they performed free viewing of two movies depicting actual classes: a Japanese class in which a teacher pointed at cartoon characters and an arithmetic class in which the teacher pointed at geometric figures. In the analysis, we defined the regions of interest (ROIs) as the teacher's face and finger, the cartoon characters and geometric figures at which the teacher pointed, and the classroom wall that contained no objects. We then compared total gaze time for each ROI between the children with ASD and TD by two-way ANOVA. Children with ASD spent less gaze time on the cartoon characters pointed at by the teacher; they spent more gaze time on the wall in both classroom scenes. We could differentiate children with ASD from those with TD almost perfectly by the proportion of total gaze time that children with ASD spent looking at the wall. These results suggest that children with ASD do not follow the teacher's instructions in class and persist in gazing at inappropriate visual areas such as walls. Thus, they may have difficulties in understanding content in class, leading to maladaptation to school.

The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli

A problem in eyetracking research is choosing areas of interest (AOIs): Researchers in the same field often use widely varying AOIs for similar stimuli, making cross-study comparisons difficult or even impossible. Subjective choices while choosing AOIs cause differences in AOI shape, size, and location. On the other hand, not many guidelines for constructing AOIs, or comparisons between AOI-production methods, are available. In the present study, we addressed this gap by comparing AOI-production methods in face stimuli, using data collected with infants and adults (with autism spectrum disorder [ASD] and matched controls). Specifically, we report that the attention-attracting and attention-maintaining capacities of AOIs differ between AOI-production methods, and that this matters for statistical comparisons in one of three groups investigated (the ASD group). In addition, we investigated the relation between AOI size and an AOI's attention-attracting and attention-maintaining capacities, as well as the consequences for statistical analyses, and report that adopting large AOIs solves the problem of statistical differences between the AOI methods. Finally, we tested AOI-production methods for their robustness to noise, and report that large AOIs-using the Voronoi tessellation method or the limited-radius Voronoi tessellation method with large radii-are most robust to noise. We conclude that large AOIs are a noise-robust solution in face stimuli and, when implemented using the Voronoi method, are the most objective of the researcher-defined AOIs. Adopting Voronoi AOIs in face-scanning research should allow better between-group and cross-study comparisons.

Differences in Looking at Own- and Other-Race Faces Are Subtle and Analysis-Dependent: An Account of Discrepant Reports

The Other-Race Effect (ORE) is the robust and well-established finding that people are generally poorer at facial recognition of individuals of another race than of their own race. Over the past four decades, much research has focused on the ORE because understanding this phenomenon is expected to elucidate fundamental face processing mechanisms and the influence of experience on such mechanisms. Several recent studies of the ORE in which the eye-movements of participants viewing own- and other-race faces were tracked have, however, reported highly conflicting results regarding the presence or absence of differential patterns of eye-movements to own- versus other-race faces. This discrepancy, of course, leads to conflicting theoretical interpretations of the perceptual basis for the ORE. Here we investigate fixation patterns to own- versus other-race (African and Chinese) faces for Caucasian participants using different analysis methods. While we detect statistically significant, though subtle, differences in fixation pattern using an Area of Interest (AOI) approach, we fail to detect significant differences when applying a spatial density map approach. Though there were no significant differences in the spatial density maps, the qualitative patterns matched the results from the AOI analyses reflecting how, in certain contexts, Area of Interest (AOI) analyses can be more sensitive in detecting the differential fixation patterns than spatial density analyses, due to spatial pooling of data with AOIs. AOI analyses, however, also come with the limitation of requiring a priori specification. These findings provide evidence that the conflicting reports in the prior literature may be at least partially accounted for by the differences in the statistical sensitivity associated with the different analysis methods employed across studies. Overall, our results suggest that detection of differences in eye-movement patterns can be analysis-dependent and rests on the assumptions inherent in the given analysis.

The Importance of Networking in Autism Gaze Analysis

Visual scanning of faces in individuals with Autism Spectrum Disorder (ASD) has been intensively studied using eye-tracking technology. However, most of studies have relied on the same analytic approach based on the quantification of fixation time, which may have failed to reveal some important features of the scanning strategies employed by individuals with ASD. In the present study, we examined the scanning of faces in a group of 20 preschoolers with ASD and their typically developing (TD) peers, using both classical fixation time approach and a new developed approach based on transition matrices and network analysis. We found between group differences in the eye region in terms of fixation time, with increased right eye fixation time for the ASD group and increased left eye fixation time for the TD group. Our complementary network approach revealed that the left eye might play the role of an anchor in the scanning strategies of TD children but not in that of children with ASD. In ASD, fixation time on the different facial parts was almost exclusively dependent on exploratory activity. Our study highlights the importance of developing innovative measures that bear the potential of revealing new properties of the scanning strategies employed by individuals with ASD.

Developmental changes in face visual scanning in autism spectrum disorder as assessed by data-based analysis

Individuals with autism spectrum disorder (ASD) present reduced visual attention to faces. However, contradictory conclusions have been drawn about the strategies involved in visual face scanning due to the various methodologies implemented in the study of facial screening. Here, we used a data-driven approach to compare children and adults with ASD subjected to the same free viewing task and to address developmental aspects of face scanning, including its temporal patterning, in healthy children, and adults. Four groups (54 subjects) were included in the study: typical adults, typically developing children, and adults and children with ASD. Eye tracking was performed on subjects viewing unfamiliar faces. Fixations were analyzed using a data-driven approach that employed spatial statistics to provide an objective, unbiased definition of the areas of interest. Typical adults expressed a spatial and temporal strategy for visual scanning that differed from the three other groups, involving a sequential fixation of the right eye (RE), left eye (LE), and mouth. Typically developing children, adults and children with autism exhibited similar fixation patterns and they always started by looking at the RE. Children (typical or with ASD) subsequently looked at the LE or the mouth. Based on the present results, the patterns of fixation for static faces that mature from childhood to adulthood in typical subjects are not found in adults with ASD. The atypical patterns found after developmental progression and experience in ASD groups appear to remain blocked in an immature state that cannot be differentiated from typical developmental child patterns of fixation.

Do individuals with autism spectrum disorder process own- and other-race faces differently?

Individuals with autism spectrum disorder (ASD) process human faces in atypical ways according to previous literature. We investigated whether individuals with ASD can process face race information and respond to own- and other-race faces differentially. Chinese individuals with ASD (n=24), typically developing (TD) individuals (n=28), and individuals with intellectual disabilities (ID, n=26) were asked to recognize Chinese and Caucasian faces in an old-new face paradigm using eye tracking. In terms of recognition, the ASD and ID groups did not perform differently and displayed superior own-race recognition compared with other-race faces; TD participants displayed similar recognition of the two types of faces. In terms of eye tracking, the TD, ASD, and ID groups displayed more looking on the eyes and less looking on the nose and mouth of Caucasian faces relative to Chinese faces. Overall, individuals with ASD manifested a behavioral other-race effect and displayed the same type of cross-racial differentiation in face scanning observed in TD individuals. The findings suggest that as is the case with TD individuals, face processing of individuals with ASD is influenced by differences in visual experience with different face categories.