Limited activity monitoring in toddlers with autism spectrum disorder

Evaluating the validity of eye-tracking tasks and stimuli in detecting high-risk infants later diagnosed with autism: A meta-analysis

Gaze abnormalities are well documented in infants at elevated risk for autism spectrum disorder (ASD). However, variations in experimental design and stimuli across studies have led to mixed results. The current meta-analysis aimed to identify which type of eye tracking task and stimulus are most effective at differentiating high-risk infants (siblings of children with ASD) who later meet diagnosis criteria from low-risk infants without familial autism. We synthesized 35 studies that used eye tracking to investigate gaze behavior in infants at high genetic risk for autism before 2 years of age. We found that stimulus features, regions of interest (ROIs) and study quality moderated effect sizes across studies. Overall, dynamic stimuli and socially-relevant regions in the social stimuli (i.e. the target and activity of characters' shared focus) reliably detected high-risk infants who later develop ASD. Attention disengagement task and stimuli depicting interactions between human and nonhuman characters could identify high-risk infants who later develop ASD and those who have autism-related symptoms but do not meet the diagnostic criteria as well. These findings provide sensitive and reliable early markers of ASD, which is helpful to develop objective and quantitative early autism screening and intervention tools.

Atypical and variable attention patterns reveal reduced contextual priors in children with autism spectrum disorder

Accumulating evidence suggests that individuals with autism spectrum disorder (ASD) show impairments in using contextual priors to predict others' actions and make intention inference. Yet less is known about whether and how children with ASD acquire contextual priors during action observation and how contextual priors relate to their action prediction and intention inference. To form proper contextual priors, individuals need to observe the social scenes in a reliable manner and focus on socially relevant information. By employing a data-driven scan path method and areas of interest (AOI)-based analysis, the current study investigated how contextual priors would relate to action prediction and intention understanding in 4-to-9-year-old children with ASD (N = 56) and typically developing (TD) children (N = 50) during free viewing of dynamic social scenes with different intentions. Results showed that children with ASD exhibited higher intra-subject variability when scanning social scenes and reduced attention to socially relevant areas. Moreover, children with high-level action prediction and intention understanding showed lower intra-subject variability and increased attention to socially relevant areas. These findings suggest that altered fixation patterns might restrain children with ASD from acquiring proper contextual priors, which has cascading downstream effects on their action prediction and intention understanding.

Oculomotor randomness is higher in autistic children and increases with the severity of symptoms

A variety of studies have suggested that at least some children with autism spectrum disorder (ASD) view the world differently. Differences in gaze patterns as measured by eye tracking have been demonstrated during visual exploration of images and natural viewing of movies with social content. Here we analyzed the temporal randomness of saccades and blinks during natural viewing of movies, inspired by a recent measure of "randomness" applied to micro-movements of the hand and head in ASD (Torres et al., 2013; Torres & Denisova, 2016). We analyzed a large eye-tracking dataset of 189 ASD and 41 typically developing (TD) children (1-11 years old) who watched three movie clips with social content, each repeated twice. We found that oculomotor measures of randomness, obtained from gamma parameters of inter-saccade intervals (ISI) and blink duration distributions, were significantly higher in the ASD group compared with the TD group and were correlated with the ADOS comparison score, reflecting increased "randomness" in more severe cases. Moreover, these measures of randomness decreased with age, as well as with higher cognitive scores in both groups and were consistent across repeated viewing of each movie clip. Highly "random" eye movements in ASD children could be associated with high "neural variability" or noise, poor sensory-motor control, or weak engagement with the movies. These findings could contribute to the future development of oculomotor biomarkers as part of an integrative diagnostic tool for ASD.

Identifying interindividual variability of social perception and associated brain anatomical correlations in children with autism spectrum disorder using eye-tracking and diffusion tensor imaging MRI (DTI-MRI)

Even though deficits in social cognition constitute a core characteristic of autism spectrum disorders, a large heterogeneity exists regarding individual social performances and its neural basis remains poorly investigated. Here, we used eye-tracking to objectively measure interindividual variability in social perception and its correlation with white matter microstructure, measured with diffusion tensor imaging MRI, in 25 children with autism spectrum disorder (8.5 ± 3.8 years). Beyond confirming deficits in social perception in participants with autism spectrum disorder compared 24 typically developing controls (10.5 ± 2.9 years), results revealed a large interindividual variability of such behavior among individuals with autism spectrum disorder. Whole-brain analysis showed in both autism spectrum disorder and typically developing groups a positive correlation between number of fixations to the eyes and fractional anisotropy values mainly in right and left superior longitudinal tracts. In children with autism spectrum disorder a correlation was also observed in right and left inferior longitudinal tracts. Importantly, a significant interaction between group and number of fixations to the eyes was observed within the anterior portion of the right inferior longitudinal fasciculus, mainly in the right anterior temporal region. This additional correlation in a supplementary region suggests the existence of a compensatory brain mechanism, which may support enhanced performance in social perception among children with autism spectrum disorder.

The Selective Social Attention task in children with autism spectrum disorder: Results from the Autism Biomarkers Consortium for Clinical Trials (ABC-CT) feasibility study

The Selective Social Attention (SSA) task is a brief eye-tracking task involving experimental conditions varying along socio-communicative axes. Traditionally the SSA has been used to probe socially-specific attentional patterns in infants and toddlers who develop autism spectrum disorder (ASD). This current work extends these findings to preschool and school-age children. Children 4- to 12-years-old with ASD (N = 23) and a typically-developing comparison group (TD; N = 25) completed the SSA task as well as standardized clinical assessments. Linear mixed models examined group and condition effects on two outcome variables: percent of time spent looking at the scene relative to scene presentation time (%Valid), and percent of time looking at the face relative to time spent looking at the scene (%Face). Age and IQ were included as covariates. Outcome variables' relationships to clinical data were assessed via correlation analysis. The ASD group, compared to the TD group, looked less at the scene and focused less on the actress' face during the most socially-engaging experimental conditions. Additionally, within the ASD group, %Face negatively correlated with SRS total T-scores with a particularly strong negative correlation with the Autistic Mannerism subscale T-score. These results highlight the extensibility of the SSA to older children with ASD, including replication of between-group differences previously seen in infants and toddlers, as well as its ability to capture meaningful clinical variation within the autism spectrum across a wide developmental span inclusive of preschool and school-aged children. The properties suggest that the SSA may have broad potential as a biomarker for ASD.

Autism symptoms, functional impairments, and gaze fixation measured using an eye-tracker in 6-year-old children

Introduction

Autism spectrum disorder (ASD) is a neurodevelopmental disorder clinically characterized by abnormalities in eye contact during social exchanges. We aimed to clarify whether the amount of gaze fixation, measured at the age of 6 years using Gazefinder, which is an established eye-tracking device, is associated with ASD symptoms and functioning.

Methods

The current study included 742 participants from the Hamamatsu Birth Cohort Study. Autistic symptoms were evaluated according to the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2), and the functioning of the participating children in real life was assessed using the Japanese version of the Vineland Adaptive Behavior Scales, Second Edition (VABS-II). The Gazefinder system was used for gaze fixation rates; two areas of interest (eyes and mouth) were defined in a talking movie clip, and eye gaze positions were calculated through corneal reflection techniques.

Results

The participants had an average age of 6.06 ± 0.14 years (males: 384; 52%). According to ADOS, 617 (83%) children were assessed as having none/mild ASD and 51 (7%) as severe. The average VABS-II scores were approximately 100 (standard deviation = 12). A higher gaze fixation rate on the eyes was associated with a significantly lower likelihood of the child being assigned to the severe ADOS group after controlling for covariates (odds ratio [OR], 0.02; 95% confidence interval [CI], 0.002-0.38). The gaze fixation rate on the mouth was not associated with ASD symptoms. A higher gaze fixation rate on the mouth was associated with a significantly lower likelihood of the child being assigned to the low score group in VABS-II socialization after controlling for covariates (OR, 0.18; 95% CI, 0.04-0.85). The gaze fixation rate on the eyes was not associated with functioning.

Conclusion

We found that children with low gaze fixation rates on the eyes were likely to have more ASD symptoms, and children with low gaze fixation rates on the mouth were likely to demonstrate poorer functioning in socialization. Hence, preschool children could be independently assessed in the general population for clinically relevant endophenotypes predictive of ASD symptoms and functional impairments.

Diminished emotion recognition with reduced face gaze in complex situation in individuals with broad autism phenotype

Background/objective

Individuals with broad autism phenotype (BAP) showed a diminished ability to recognize emotion. This study aims to examine whether their decline in emotion recognition ability could be more clearly identified as task complexity increased and whether their decline could be influenced by their eye-gaze patterns.

Method

41 individuals with BAP and 40 healthy controls performed two types of emotion recognition tasks. After confirming conditions wherein the BAP group did not perform well compared to the control group, we compared gaze proportion on faces and context between groups when performing the conditions.

Results

The more difficult the task, the clearer the significant relationships between the level of autistic traits and emotion recognition ability. The BAP group showed lower accuracy compared to the control group when a face with mild emotional intensity was presented with context. In terms of gaze proportion, the BAP group looked less at faces when recognizing emotions compared to the control group.

Conclusion

These findings indicate that diminished emotion recognition ability in individuals with BAP may be influenced by face gaze.

How 18-month-olds with Later Autism Look at Other Children Interacting: The Timing of Gaze Allocation

When observing other people during naturally paced and dynamic interactions, it is essential to look at specific locations at the right time to extract a maximum of socially informative content. In this study, we aimed to investigate the looking behavior of typically developing toddlers and toddlers later diagnosed with autism when observing other children interact. The sample consisted of 98 toddlers; 22 in a low-likelihood of autism group, 60 in an elevated likelihood of autism group who did not receive a subsequent diagnosis, and 16 in an elevated likelihood group who did receive an autism diagnosis. Participants performed an eye tracking task at 18 months of age and were assessed for diagnostic outcome at 36 months. The video stimuli consisted of two children interacting, where a boy reaches out for a toy and a girl refuses to give it to him. The low likelihood group showed an expected increase in ratio of looking at the girl's face after the boy requested the toy, as compared to before (t(21) = -3.337, p = .003). Toddlers with later autism showed a significantly lower ratio of looking at the girl's face during this time window, as compared to the other groups (F(2,91) = 3.698, p = .029). These findings provide new leads on how social gaze may be different in children with autism in everyday life (e.g., kindergarten), and highlight the need of studying the dynamics of gaze on short time scales.

Repetitive transcranial magnetic stimulation can improve the fixation of eyes rather than the fixation preference in children with autism spectrum disorder

Background

Transcranial magnetic stimulation (TMS) has been introduced into the intervention of autism spectrum disorders (ASD) as a possible new therapeutic option for modifying pathological neuroplasticity. However, the stimulating protocols of rTMS for ASD have not been approved unanimously, which affects the clinical popularization and application of rTMS. In addition, there is little research on the improvement of social processing of autistic children by rTMS.

Methods

We explored the clinical efficacy of rTMS and improvement of face processing with the protocol of left high-frequency and right low-frequency on bilateral dorsolateral prefrontal cortex (DLPFC), with a sample of 45 ASD participants aged 2-18.

Results

Our results showed that both the score on the Childhood Autism Rating Scale (CARS) and the fixations on the eyes of the human faces improved by two-session rTMS intervention, except for the percentage of eyes fixation. The mediation analysis indicated the item of "Adaptation to Change" of CARS mediated dominantly the improvement of eye-gaze behavior of ASD participants by rTMS.

Conclusion

Our study revealed the mechanism of rTMS in improving the eye-gaze behavior of the autism population, deepened the understanding of the function of rTMS in treating autistic social disorders, and provided a reference for combined treatment for ASD.

Gaze Following as an Early Diagnostic Marker of Autism in a New Word Learning Task in Toddlers

The aim was to test the use of eye-tracking methodology for the early detection of ASD in a task of association between unfamiliar objects and pseudowords. Significant differences were found between ASD (n = 57) and TD (n = 57) Spanish speaking toddlers in the number and time of fixation. The TD children showed more and longer fixations on eyes and mouth while the ASD children attended almost exclusively to objects, making it difficult to integrate lexical and phonological information. Moreover, the TD toddlers looked at the mouth when the pseudoword was produced while the ASD toddlers did not. Gaze fixation on eyes and mouth during word learning recorded by eye-tracking may be used as a biomarker for the early diagnosis of ASD.

Level of Attention to Motherese Speech as an Early Marker of Autism Spectrum Disorder

Importance

Caregivers have long captured the attention of their infants by speaking in motherese, a playful speech style characterized by heightened affect. Reduced attention to motherese in toddlers with autism spectrum disorder (ASD) may be a contributor to downstream language and social challenges and could be diagnostically revealing.

Objective

To investigate whether attention toward motherese speech can be used as a diagnostic classifier of ASD and is associated with language and social ability.

Design, Setting, and Participants

This diagnostic study included toddlers aged 12 to 48 months, spanning ASD and non-ASD diagnostic groups, at a research center. Data were collected from February 2018 to April 2021 and analyzed from April 2021 to March 2022.

Exposures

Gaze-contingent eye-tracking test.

Main Outcomes and Measures

Using gaze-contingent eye tracking wherein the location of a toddler's fixation triggered a specific movie file, toddlers participated in 1 or more 1-minute eye-tracking tests designed to quantify attention to motherese speech, including motherese vs traffic (ie, noisy vehicles on a highway) and motherese vs techno (ie, abstract shapes with music). Toddlers were also diagnostically and psychometrically evaluated by psychologists. Levels of fixation within motherese and nonmotherese movies and mean number of saccades per second were calculated. Receiver operating characteristic (ROC) curves were used to evaluate optimal fixation cutoff values and associated sensitivity, specificity, positive predictive value (PPV), and negative predictive value. Within the ASD group, toddlers were stratified based on low, middle, or high levels of interest in motherese speech, and associations with social and language abilities were examined.

Results

A total of 653 toddlers were included (mean [SD] age, 26.45 [8.37] months; 480 males [73.51%]). Unlike toddlers without ASD, who almost uniformly attended to motherese speech with a median level of 82.25% and 80.75% across the 2 tests, among toddlers with ASD, there was a wide range, spanning 0% to 100%. Both the traffic and techno paradigms were effective diagnostic classifiers, with large between-group effect sizes (eg, ASD vs typical development: Cohen d, 1.0 in the techno paradigm). Across both paradigms, a cutoff value of 30% or less fixation on motherese resulted in an area under the ROC curve (AUC) of 0.733 (95% CI, 0.693-0.773) and 0.761 (95% CI, 0.717-0.804), respectively; specificity of 98% (95% CI, 95%-99%) and 96% (95% CI, 92%-98%), respectively; and PPV of 94% (95% CI, 86%-98%). Reflective of heterogeneity and expected subtypes in ASD, sensitivity was lower at 18% (95% CI, 14%-22%) and 29% (95% CI, 24%-34%), respectively. Combining metrics increased the AUC to 0.841 (95% CI, 0.805-0.877). Toddlers with ASD who showed the lowest levels of attention to motherese speech had weaker social and language abilities.

Conclusions and Relevance

In this diagnostic study, a subset of toddlers showed low levels of attention toward motherese speech. When a cutoff level of 30% or less fixation on motherese speech was used, toddlers in this range were diagnostically classified as having ASD with high accuracy. Insight into which toddlers show unusually low levels of attention to motherese may be beneficial not only for early ASD diagnosis and prognosis but also as a possible therapeutic target.

Understanding the role of eye movement consistency in face recognition and autism through integrating deep neural networks and hidden Markov models

Greater eyes-focused eye movement pattern during face recognition is associated with better performance in adults but not in children. We test the hypothesis that higher eye movement consistency across trials, instead of a greater eyes-focused pattern, predicts better performance in children since it reflects capacity in developing visual routines. We first simulated visual routine development through combining deep neural network and hidden Markov model that jointly learn perceptual representations and eye movement strategies for face recognition. The model accounted for the advantage of eyes-focused pattern in adults, and predicted that in children (partially trained models) consistency but not pattern of eye movements predicted recognition performance. This result was then verified with data from typically developing children. In addition, lower eye movement consistency in children was associated with autism diagnosis, particularly autistic traits in social skills. Thus, children's face recognition involves visual routine development through social exposure, indexed by eye movement consistency.

Social Attention: Developmental Foundations and Relevance for Autism Spectrum Disorder

The use of the term "social attention" (SA) in the cognitive neuroscience and developmental psychopathology literature has increased exponentially in recent years, in part motivated by the aim to understand the early development of autism spectrum disorder (ASD). Unfortunately, theoretical discussions around the term have lagged behind its various uses. Here, we evaluate SA through a review of key candidate SA phenotypes emerging early in life, from newborn gaze cueing and preference for face-like configurations to later emerging skills such as joint attention. We argue that most of the considered SA phenotypes are unlikely to represent unique socioattentional processes and instead have to be understood in the broader context of bottom-up and emerging top-down (domain-general) attention. Some types of SA behaviors (e.g., initiation of joint attention) are linked to the early development of ASD, but this may reflect differences in social motivation rather than attention per se. Several SA candidates are not linked to ASD early in life, including the ones that may represent uniquely socioattentional processes (e.g., orienting to faces, predicting others' manual action goals). Although SA may be a useful superordinate category under which one can organize certain research questions, the widespread use of the term without proper definition is problematic. Characterizing gaze patterns and visual attention in social contexts in infants at elevated likelihood of ASD may facilitate early detection, but conceptual clarity regarding the underlying processes at play is needed to sharpen research questions and identify potential targets for early intervention.

Identifying Visual Attention Features Accurately Discerning Between Autism and Typically Developing: a Deep Learning Framework

Atypical visual attention is a hallmark of autism spectrum disorder (ASD). Identifying the attention features accurately discerning between people with ASD and typically developing (TD) at the individual level remains a challenge. In this study, we developed a new systematic framework combining high accuracy deep learning classification, deep learning segmentation, image ablation and a direct measurement of classification ability to identify the discriminative features for autism identification. Our two-stream model achieved the state-of-the-art performance with a classification accuracy of 0.95. Using this framework, two new categories of features, Food & drink and Outdoor-objects, were identified as discriminative attention features, in addition to the previously reported features including Center-object and Human-faces, etc. Altered attention to the new categories helps to understand related atypical behaviors in ASD. Importantly, the area under curve (AUC) based on the combined top-9 features identified in this study was 0.92, allowing an accurate classification at the individual level. We also obtained a small but informative dataset of 12 images with an AUC of 0.86, suggesting a potentially efficient approach for the clinical diagnosis of ASD. Together, our deep learning framework based on VGG-16 provides a novel and powerful tool to recognize and understand abnormal visual attention in ASD, which will, in turn, facilitate the identification of biomarkers for ASD.

The Quality of Everyday Eye Contact in Williams Syndrome: Insights From Cross-Syndrome Comparisons

Past research shows that individuals with Williams syndrome (WS) have heightened and prolonged eye contact. Using parent report measures, we examined not only the presence of eye contact but also its qualitative features. Study 1 included individuals with WS (n = 22, ages 6.0-36.3). Study 2 included children with different neurodevelopmental (ND) conditions (WS, autism spectrum condition, fragile X syndrome, attention-deficit/hyperactivity disorder) and children with neurotypical development (NT; n = 262, ages 4.0-17.11). Unusual eye contact features, including staring, were found in approximately half of the WS samples. However, other features such as brief glances were frequently found in WS and in all ND conditions, but not NT. Future research in ND conditions should focus on qualitative as well as quantitative features of eye contact.

Gaze and social functioning associations in autism spectrum disorder: A systematic review and meta-analysis

Autism spectrum disorder (ASD) is characterized by significant social functioning impairments, including (but not limited to) emotion recognition, mentalizing, and joint attention. Despite extensive investigation into the correlates of social functioning in ASD, only recently has there been focus on the role of low‐level sensory input, particularly visual processing. Extensive gaze deficits have been described in ASD, from basic saccadic function through to social attention and the processing of complex biological motion. Given that social functioning often relies on accurately processing visual information, inefficient visual processing may contribute to the emergence and sustainment of social functioning difficulties in ASD. To explore the association between measures of gaze and social functioning in ASD, a systematic review and meta‐analysis was conducted. A total of 95 studies were identified from a search of CINAHL Plus, Embase, OVID Medline, and psycINFO databases in July 2021. Findings support associations between increased gaze to the face/head and eye regions with improved social functioning and reduced autism symptom severity. However, gaze allocation to the mouth appears dependent on social and emotional content of scenes and the cognitive profile of participants. This review supports the investigation of gaze variables as potential biomarkers of ASD, although future longitudinal studies are required to investigate the developmental progression of this relationship and to explore the influence of heterogeneity in ASD clinical characteristics.

A constellation of eye-tracking measures reveals social attention differences in ASD and the broad autism phenotype

Background

Social attention differences, expressed through gaze patterns, have been documented in autism spectrum disorder (ASD), with subtle differences also reported among first-degree relatives, suggesting a shared genetic link. Findings have mostly been derived from standard eye-tracking methods (total fixation count or total fixation duration). Given the dynamics of visual attention, these standard methods may obscure subtle, yet core, differences in visual attention mechanisms, particularly those presenting sub-clinically. This study applied a constellation of eye-tracking analyses to gaze data from individuals with ASD and their parents.

Methods

This study included n = 156 participants across groups, including ASD (n = 24) and control (n = 32) groups, and parents of individuals with ASD (n = 61) and control parents (n = 39). A complex scene with social/non-social elements was displayed and gaze tracked via an eye tracker. Eleven analytic methods from the following categories were analyzed: (1) standard variables, (2) temporal dynamics (e.g., gaze over time), (3) fixation patterns (e.g., perseverative or regressive fixations), (4) first fixations, and (5) distribution patterns. MANOVAs, growth curve analyses, and Chi-squared tests were applied to examine group differences. Finally, group differences were examined on component scores derived from a principal component analysis (PCA) that reduced variables to distinct dimensions.

Results

No group differences emerged among standard, first fixation, and distribution pattern variables. Both the ASD and ASD parent groups demonstrated on average reduced social attention over time and atypical perseverative fixations. Lower social attention factor scores derived from PCA strongly differentiated the ASD and ASD parent groups from controls, with parent findings driven by the subset of parents demonstrating the broad autism phenotype.

Limitations

To generalize these findings, larger sample sizes, extended viewing contexts (e.g., dynamic stimuli), and even more eye-tracking analytical methods are needed.

Conclusions

Fixations over time and perseverative fixations differentiated ASD and the ASD parent groups from controls, with the PCA most robustly capturing social attention differences. Findings highlight their methodological utility in studies of the (broad) autism spectrum to capture nuanced visual attention differences that may relate to clinical symptoms in ASD, and reflect genetic liability in clinically unaffected relatives. This proof-of-concept study may inform future studies using eye tracking across populations where social attention is impacted.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13229-022-00490-w.

Cortical activation during cooperative joint actions and competition in children with and without an autism spectrum condition (ASC): an fNIRS study

Children with an Autism Spectrum Condition (ASC) have social communication and perceptuomotor difficulties that affect their ability to engage in dyadic play. In this study, we compared spatio-temporal errors and fNIRS-related cortical activation between children with and without an ASC during a Lincoln Log dyadic game requiring them to play leader or follower roles, move in synchrony or while taking turns, and move cooperatively or competitively with an adult partner. Children with an ASC had greater motor, planning, and spatial errors and took longer to complete the building tasks compared to typically developing (TD) children. Children with an ASC had lower superior temporal sulcus (STS) activation during Turn-take and Compete, and greater Inferior Parietal Lobe (IPL) activation during Lead and Turn-take compared to TD children. As dyadic play demands increased, TD children showed greater STS activation during Turn-take (vs. Synchrony) and Compete (vs. Cooperate) whereas children with an ASC showed greater IPL activation during Lead and Compete (vs. Cooperate). Our findings suggest that children with an ASC rely on self-generated action plans (i.e., increased IPL activation) more than relying on their partner’s action cues (i.e., reduced STS activation) when engaging in dyadic play including joint actions and competition.

The autism biomarkers consortium for clinical trials: evaluation of a battery of candidate eye-tracking biomarkers for use in autism clinical trials

BACKGROUND

Eye tracking (ET) is a powerful methodology for studying attentional processes through quantification of eye movements. The precision, usability, and cost-effectiveness of ET render it a promising platform for developing biomarkers for use in clinical trials for autism spectrum disorder (ASD).

METHODS

The autism biomarkers consortium for clinical trials conducted a multisite, observational study of 6-11-year-old children with ASD (n = 280) and typical development (TD, n = 119). The ET battery included: Activity Monitoring, Social Interactive, Static Social Scenes, Biological Motion Preference, and Pupillary Light Reflex tasks. A priori, gaze to faces in Activity Monitoring, Social Interactive, and Static Social Scenes tasks were aggregated into an Oculomotor Index of Gaze to Human Faces (OMI) as the primary outcome measure. This work reports on fundamental biomarker properties (data acquisition rates, construct validity, six-week stability, group discrimination, and clinical relationships) derived from these assays that serve as a base for subsequent development of clinical trial biomarker applications.

RESULTS

All tasks exhibited excellent acquisition rates, met expectations for construct validity, had moderate or high six-week stabilities, and highlighted subsets of the ASD group with distinct biomarker performance. Within ASD, higher OMI was associated with increased memory for faces, decreased autism symptom severity, and higher verbal IQ and pragmatic communication skills.

LIMITATIONS

No specific interventions were administered in this study, limiting information about how ET biomarkers track or predict outcomes in response to treatment. This study did not consider co-occurrence of psychiatric conditions nor specificity in comparison with non-ASD special populations, therefore limiting our understanding of the applicability of outcomes to specific clinical contexts-of-use. Research-grade protocols and equipment were used; further studies are needed to explore deployment in less standardized contexts.

CONCLUSIONS

All ET tasks met expectations regarding biomarker properties, with strongest performance for tasks associated with attention to human faces and weakest performance associated with biological motion preference. Based on these data, the OMI has been accepted to the FDA's Biomarker Qualification program, providing a path for advancing efforts to develop biomarkers for use in clinical trials.

Large scale validation of an early-age eye-tracking biomarker of an autism spectrum disorder subtype

Few clinically validated biomarkers of ASD exist which can rapidly, accurately, and objectively identify autism during the first years of life and be used to support optimized treatment outcomes and advances in precision medicine. As such, the goal of the present study was to leverage both simple and computationally-advanced approaches to validate an eye-tracking measure of social attention preference, the GeoPref Test, among 1,863 ASD, delayed, or typical toddlers (12-48 months) referred from the community or general population via a primary care universal screening program. Toddlers participated in diagnostic and psychometric evaluations and the GeoPref Test: a 1-min movie containing side-by-side dynamic social and geometric images. Following testing, diagnosis was denoted as ASD, ASD features, LD, GDD, Other, typical sibling of ASD proband, or typical. Relative to other diagnostic groups, ASD toddlers exhibited the highest levels of visual attention towards geometric images and those with especially high fixation levels exhibited poor clinical profiles. Using the 69% fixation threshold, the GeoPref Test had 98% specificity, 17% sensitivity, 81% PPV, and 65% NPV. Sensitivity increased to 33% when saccades were included, with comparable validity across sex, ethnicity, or race. The GeoPref Test was also highly reliable up to 24 months following the initial test. Finally, fixation levels among twins concordant for ASD were significantly correlated, indicating that GeoPref Test performance may be genetically driven. As the GeoPref Test yields few false positives (~ 2%) and is equally valid across demographic categories, the current findings highlight the ability of the GeoPref Test to rapidly and accurately detect autism before the 2nd birthday in a subset of children and serve as a biomarker for a unique ASD subtype in clinical trials.

Language development, reading and word learning in Autism Spectrum Disorder (ASD): a review on eye tracking studies

Objectives: The purpose of this article is to review research that has been conducted over the past five years on language development, reading skills and word learning with the use of the eye tracking machine as regards the population with autism spectrum disorder (ASD) in comparison to typically developed population. Materials and methods: A combination of relevant terms from Google Scholar, Research Gate and PsychINFO databases was used and as a result 24 studies emerged. The total number of studies that met the inclusion criteria was 21. Results: Studies focusing on the language development of people with ASD have presented significant findings regarding vocabulary processing and the preferential focus on specific stimuli (images, audio) over a wide range of ages that in some cases have not been investigated until then. Furthermore, studies on reading have found that adults with ASD showed a strong preference for images and symbols over texts, longer reading time and performances similar to the typical population in vocabulary processing. Studies on word learning demonstrated that adults with ASD are able to rely on gaze cues in order to learn a new word and they have the ability to use syntactic bootstrapping. For preschool and early school-aged children with ASD the results showed that they are capable of cross-situational learning. Conclusions: This review provides information on the effectiveness of the eye tracking method as a tool that can contribute to the identification of deficits in language processing on the part of individuals with ASD from early childhood to adulthood, and more specifically as regards the domains of language development, reading and word learning.

Development of a visual attention based decision support system for autism spectrum disorder screening

Visual attention of young children with autism spectrum disorder (ASD) has been well documented in the literature for the past 20 years. In this study, we developed a Decision Support System (DSS) that uses machine learning (ML) techniques to identify young children with ASD from typically developing (TD) children. Study participants included 26 to 36 months old young children with ASD (n = 61) and TD children (n = 72). The results showed that the proposed DSS achieved up to 87.5% success rate in the early assessment of ASD in young children. Findings suggested that visual attention is a unique, promising biomarker for early assessment of ASD. Study results were discussed, and suggestions for future research were provided.

Selective Changes in Complexity of Visual Scanning for Social Stimuli in Infancy

In the 1st year of life, infants gradually gain the ability to control their eye movements and explore visual scenes, which support their learning and emerging cognitive skills. These gains include domain-general skills such as rapid orienting or attention disengagement as well as domain-specific ones such as increased sensitivity to social stimuli. However, it remains unknown whether these developmental changes in what infants fixate and for how long in naturalistic scenes lead to the emergence of more complex, repeated sequences of fixations, especially when viewing human figures and faces, and whether these changes are related to improvements in domain-general attentional skills. Here we tested longitudinally the developmental changes in the complexity of fixation sequences at 5.5 and 11 months of age using Recurrence Quantification Analysis. We measured changes in how fixations recur in the same location and changes in the patterns (repeated sequences) of fixations in social and non-social scenes that were either static or dynamic. We found more complex patterns (i.e., repeated and longer sequences) of fixations in social than non-social scenes, both static and dynamic. There was also an age-related increase in the length of repeated fixation sequences only for social static scenes, which was independent of individual differences in orienting and attention disengagement. Our results can be interpreted as evidence for fine-tuning of infants' visual scanning skills. They selectively produce longer and more complex sequences of fixations on faces and bodies before reaching the end of the 1st year of life.

Distance from Typical Scan Path When Viewing Complex Stimuli in Children with Autism Spectrum Disorder and its Association with Behavior

Eye-tracking is often used to study attention in children with autism spectrum disorder (ASD). Previous research has identified multiple atypical patterns of attention in children with ASD based on areas-of-interest analysis. Fewer studies have investigated gaze path, a measure which is dependent on the dynamic content of the stimulus presented. Here, rather than looking at proportions of looking time to areas of interest, we calculated mean fixations frame-by-frame in a group of typically developing children (36 to 72 months) and determined the distance from those typical fixations for 155 children with ASD (27-95 months). Findings revealed that distance from the typical scan path among the children with ASD was associated with lower communication abilities and greater ASD symptomatology.

Basic oculomotor function is similar in young children with ASD and typically developing controls

A variety of eye tracking studies have demonstrated that young children with ASD gaze at images and movies of social interactions differently than typically developing children. These findings have supported the hypothesis that gaze behavior differences are generated by a weaker preference for social stimuli in ASD children. The hypothesis assumes that gaze differences are not caused by abnormalities in oculomotor function including saccade frequency and kinematics. Previous studies of oculomotor function have mostly been performed with school-age children, adolescents, and adults using visual search, anti-saccade, and gap saccade tasks that are less suitable for young pre-school children. Here, we examined oculomotor function in 144 children (90 with ASD and 54 controls), 1-10-years-old, as they watched two animated movies interleaved with the presentation of multiple salient stimuli that elicited saccades-to-targets. The results revealed that the number of fixations, fixation duration, number of saccades, saccade duration, saccade accuracy, and saccade latency did not differ significantly across groups. Minor initial differences in saccade peak velocity were not supported by analysis with a linear mixed model. These findings suggest that most children with ASD exhibit similar oculomotor function to that of controls, when performing saccades-to-targets or freely viewing child-friendly movies. This suggests that previously reported gaze abnormalities in children with ASD are not due to underlying oculomotor deficiencies. LAY SUMMARY: This study demonstrates that children with ASD perform similar eye movements to those of controls when freely observing movies or making eye movements to targets. Similar results were apparent across groups in the number of eye movements, their accuracy, duration, and other measures that assess eye movement control. These findings are important for interpreting previously reported differences in gaze behavior of children with ASD, which are likely due to atypical social preferences rather than impaired control of eye movements.

Autistic differences in the temporal dynamics of social attention

LAY ABSTRACT

One behaviour often observed in individuals with autism is that they tend to look less towards social stimuli relative to neurotypical individuals. For instance, many eye-tracking studies have shown that individuals with autism will look less towards people and more towards objects in scenes. However, we currently know very little about how these behaviours change over time. Tracking these moment-to-moment changes in looking behaviour in individuals with autism can more clearly illustrate how they respond to social stimuli. In this study, adults with and without autism were presented with displays of social and non-social stimuli, while looking behaviours were measured by eye-tracking. We found large differences in how the two groups looked towards social stimuli over time. Neurotypical individuals initially showed a high probability of looking towards social stimuli, then a decline in probability, and a subsequent increase in probability after prolonged viewing. By contrast, individuals with autism showed an initial increase in probability, followed by a continuous decline in probability that did not recover. This pattern of results may indicate that individuals with autism exhibit reduced responsivity to the reward value of social stimuli. Moreover, our data suggest that exploring the temporal nature of gaze behaviours can lead to more precise explanatory theories of attention in autism.

Comparing visual preferences between autism spectrum disorder (ASD) and normal children to explore the characteristics of visual preference of ASD children by improved visual preference paradigm: a case-control study

BACKGROUND

One of features of Visual preference in autism spectrum disorder (ASD) is that they tend to social stimuli to nonsocial stimuli. Though it has been studied widely, until now the results are still not consistent. One of the most important reasons may be that the stimuli of the past visual preference paradigm have different movement patterns. Therefore, the present study aimed to improve the visual preference paradigm to reduce the bias caused by different movement of stimuli and explore the features of visual preference of ASD further.

METHODS

Two hundred and seven children who met DSM-5 criteria for ASD and 125 typically developmental (TD) children were enrolled. They were matched in age and gender. Visual preference was measured by eye tracking technology. The subjects presented simultaneously with dynamic object images (DOI) and dynamic social images (DSI) with the same type and same speed of repetitive movement. Social interaction deficits of ASD were assessed by parents with Aberrant Behavior Checklist (ABC).

RESULTS

Compared with TD children, the following findings were noted: (I) children with ASD paid less attention to social stimuli and more attention to nonsocial stimuli (t=6.417, P<0.001). (II) Increased preference to DSI was positively correlated with age (R=0.23, P=0.001). (III) No association was noted between visual preference and IQ in children with ASD (R=0.081, P=0.435). (IV) Reduced preference to DSI was negatively correlated with the severity of social interaction impairment rated by parents with ABC in children with ASD (R=0.237, P=0.010).

CONCLUSIONS

Children with ASD exhibited abnormal visual preference for social and nonsocial stimuli.

A Scalable Off-the-Shelf Framework for Measuring Patterns of Attention in Young Children and its Application in Autism Spectrum Disorder

Autism spectrum disorder (ASD) is associated with deficits in the processing of social information and difficulties in social interaction, and individuals with ASD exhibit atypical attention and gaze. Traditionally, gaze studies have relied upon precise and constrained means of monitoring attention using expensive equipment in laboratories. In this work we develop a low-cost off-the-shelf alternative for measuring attention that can be used in natural settings. The head and iris positions of 104 16-31 months children, an age range appropriate for ASD screening and diagnosis, 22 of them diagnosed with ASD, were recorded using the front facing camera in an iPad while they watched on the device screen a movie displaying dynamic stimuli, social stimuli on the left and nonsocial stimuli on the right. The head and iris position were then automatically analyzed via computer vision algorithms to detect the direction of attention. Children in the ASD group paid less attention to the movie, showed less attention to the social as compared to the nonsocial stimuli, and often fixated their attention to one side of the screen. The proposed method provides a low-cost means of monitoring attention to properly designed stimuli, demonstrating that the integration of stimuli design and automatic response analysis results in the opportunity to use off-the-shelf cameras to assess behavioral biomarkers.

Visual Traces of Language Acquisition in Toddlers with Autism Spectrum Disorder During the Second Year of Life

Infants show shifting patterns of visual engagement to faces over the first years of life. To explore the adaptive implications of this engagement, we collected eye-tracking measures on cross-sectional samples of 10-25-month-old typically developing toddlers (TD;N = 28) and those with autism spectrum disorder (ASD;N = 54). Concurrent language assessments were conducted and relationships between visual engagement and expressive and receptive language were analyzed between groups, and within ASD subgroups. TD and ASD toddlers exhibited greater mouth- than eye-looking, with TD exhibiting higher levels of mouth-looking than ASD. Mouth-looking was positively associated with expressive language in TD toddlers, and in ASD toddlers who had acquired first words. Mouth-looking was unrelated to expressive language in ASD toddlers who had not yet acquired first words.

Dynamic Eye Tracking as a Predictor and Outcome Measure of Social Skills Intervention in Adolescents and Adults with Autism Spectrum Disorder

To evaluate an eye tracking task as a predictor and outcome measure of treatment response for autism spectrum disorder (ASD) social skills interventions, adolescents and young adults with ASD completed the eye tracking task before, immediately after, and two months after completing Social Cognition and Interaction Training for Autism (SCIT-A). The study compared SCIT-A participants (n = 20) to participants with ASD who received treatment as usual (TAU; n = 21). Overall, increased visual attention to faces and background objects and decreased attention to hands playing with toys at baseline were associated with improved social functioning immediately following intervention, suggesting this eye tracking task may reliably predict ASD social intervention outcomes.

The impact of social complexity on the visual exploration of others' actions in preschoolers with autism spectrum disorder

BACKGROUND

Typical development of socio-communicative skills relies on keen observation of others. It thus follows that decreased social attention negatively impacts the subsequent development of socio-communicative abilities in children with autism spectrum disorders (ASD). In addition, studies indicate that social attention is modulated by context and that greater social difficulties are observed in more socially demanding situations. Our study aims to investigate the effect of social complexity on visual exploration of others' actions in preschoolers.

METHODS

To investigate the impact of social complexity, we used an eye-tracking paradigm with 26 typically developing preschoolers (TD, age = 3.60 ± 1.55) and 37 preschoolers with ASD (age = 3.55 ± 1.21). Participants were shown videos of two children engaging in socially simple play (parallel) versus socially complex play (interactive). We subsequently quantified the time spent and fixation duration on faces, objects, bodies, as well as the background and the number of spontaneous gaze shifts between socially relevant areas of interest.

RESULTS

In the ASD group, we observed decreased time spent on faces. Social complexity (interactive play) elicited changes in visual exploration patterns in both groups. From the parallel to the interactive condition, we observed a shift towards socially relevant parts of the scene, a decrease in fixation duration, as well as an increase in spontaneous gaze shifts between faces and objects though there were fewer in the ASD group.

LIMITATIONS

Our results need to be interpreted cautiously due to relatively small sample sizes and may be relevant to male preschoolers, given our male-only sample and reported phenotypic differences between males and females.

CONCLUSION

Our results suggest that similar to TD children, though to a lesser extent, visual exploration patterns in ASD are modulated by context. Children with ASD that were less sensitive to context modulation showed decreased socio-communicative skills or higher levels of symptoms. Our findings support using naturalistic designs to capture socio-communicative deficits in ASD.

Investigating Gaze Behaviour of Children Diagnosed with Autism Spectrum Disorders in a Classroom Setting

A defining feature of ASD is atypical gaze behaviour, however, eye-tracking studies in ‘real-world’ settings are limited, and the possibility of improving gaze behaviour for ASD children is largely unexplored. This study investigated gaze behaviour of ASD and typically developing (TD) children in their classroom setting. Eye-tracking technology was used to develop and pilot an operant training tool to positively reinforce typical gaze behaviour towards faces. Visual and statistical analyses of eye-tracking data revealed different gaze behaviour patterns during live interactions for ASD and TD children depending on the interaction type. All children responded to operant training with longer looking times observed on face stimuli post training. The promising application of operant gaze training in ecologically valid settings is discussed.

A Unique Visual Attention Profile Associated With the FMR1 Premutation

Atypical visual attention patterns have been observed among carriers of the fragile X mental retardation gene (FMR1) premutation (PM), with some similarities to visual attention patterns observed in autism spectrum disorder (ASD) and among clinically unaffected relatives of individuals with ASD. Patterns of visual attention could constitute biomarkers that can help to inform the neurocognitive profile of the PM, and that potentially span diagnostic boundaries. This study examined patterns of eye movement across an array of fixation measurements from three distinct eye-tracking tasks in order to investigate potentially overlapping profiles of visual attention among PM carriers, ASD parents, and parent controls. Logistic regression analyses were conducted to examine whether variables constituting a PM-specific looking profile were able to effectively predict group membership. Participants included 65PM female carriers, 188 ASD parents, and 84 parent controls. Analyses of fixations across the eye-tracking tasks, and their corresponding areas of interest, revealed a distinct visual attention pattern in carriers of the FMR1 PM, characterized by increased fixations on the mouth when viewing faces, more intense focus on bodies in socially complex scenes, and decreased fixations on salient characters and faces while narrating a wordless picture book. This set of variables was able to successfully differentiate individuals with the PM from controls (Sensitivity = 0.76, Specificity = 0.85, Accuracy = 0.77) as well as from ASD parents (Sensitivity = 0.70, Specificity = 0.80, Accuracy = 0.72), but did not show a strong distinction between ASD parents and controls (Accuracy = 0.62), indicating that this set of variables comprises a profile that is unique to PM carriers. Regarding predictive power, fixations toward the mouth when viewing faces was able to differentiate PM carriers from both ASD parents and controls, whereas fixations toward other social stimuli did not differentiate PM carriers from ASD parents, highlighting some overlap in visual attention patterns that could point toward shared neurobiological mechanisms. Results demonstrate a profile of visual attention that appears strongly associated with the FMR1 PM in women, and may constitute a meaningful biomarker.

Exploring Social Biomarkers in High-Functioning Adults with Autism and Asperger's Versus Healthy Controls: A Cross-Sectional Analysis

Biomarkers for autism spectrum disorder (ASD) are lacking but would facilitate drug development for the core deficits of the disorder. We evaluated markers proposed for characterization of differences in social communication and interaction in adults with ASD versus healthy controls (HC) for utility as biomarkers. Data pooled from an observational study and baseline data from a placebo-controlled study were analyzed. Between-group differences were observed in eye-tracking tasks for activity monitoring, biomotion, human activity preference, composite score (p = 0.0001-0.037) and pupillometry (various tasks, p = 0.017-0.05). Impaired olfaction was more common in the ASD sample versus HC (p = 0.018). Our preliminary results suggest the potential use for stratification and response sub-analyses outcome-prediction of specific eye-tracking tasks, pupillometry and olfaction tests in ASD trials.

Eye gaze differences in school scenes between preschool children and adolescents with high-functioning autism spectrum disorder and those with typical development

BACKGROUND

Children with autism spectrum disorder (ASD) may experience difficulty adapting to daily life in a preschool or school settings and are likely to develop psychosomatic symptoms. For a better understanding of the difficulties experienced daily by preschool children and adolescents with ASD, this study investigated differences in eye gaze behavior in the classroom environment between children with ASD and those with typical development (TD).

METHODS

The study evaluated 30 children with ASD and 49 children with TD. Participants were presented with images of a human face and a classroom scene. While they gazed at specific regions of visual stimuli, eye tracking with an iView X system was used to evaluate and compare the duration of gaze time between the two groups.

RESULTS

Compared with preschool children with TD, preschool children with ASD spent less time gazing at the eyes of the human face and the object at which the teacher pointed in the classroom image. Preschool children with TD who had no classroom experience tended to look at the object the teacher pointed at in the classroom image.

CONCLUSION

Children with ASD did not look at the human eyes in the facial image or the object pointed at in the classroom image, which may indicate their inability to analyze situations, understand instruction in a classroom, or act appropriately in a group. This suggests that this gaze behavior of children with ASD causes social maladaptation and psychosomatic symptoms. A therapeutic approach that focuses on joint attention is desirable for improving the ability of children with ASD to adapt to their social environment.

Visual Preference for Biological Motion in Children and Adults with Autism Spectrum Disorder: An Eye-Tracking Study

Participants with autism spectrum disorder (ASD) (n = 121, mean [SD] age: 14.6 [8.0] years) and typically developing (TD) controls (n = 40, 16.4 [13.3] years) were presented with a series of videos representing biological motion on one side of a computer monitor screen and non-biological motion on the other, while their eye movements were recorded. As predicted, participants with ASD spent less overall time looking at presented stimuli than TD participants (P < 10^-3) and showed less preference for biological motion (P < 10^-5). Participants with ASD also had greater average latencies than TD participants of the first fixation on both biological (P < 0.01) and non-biological motion (P < 0.02). Findings suggest that individuals with ASD differ from TD individuals on multiple properties of eye movements and biological motion preference.

Social Attention Deficits in Children With Autism Spectrum Disorder: Task Dependence of Objects vs. Faces Observation Bias

Social attention deficits represent a central impairment of patients suffering from autism spectrum disorder (ASD), but the nature of such deficits remains controversial. We compared visual attention regarding social (faces) vs. non-social stimuli (objects), in an ecological diagnostic context, in 46 children and adolescents divided in two groups: ASD (N = 23) and typical neurodevelopment (TD) (N = 23), matched for chronological age and intellectual performance. Eye-tracking measures of visual scanning, while exploring and describing scenes from three different tasks from the Autism Diagnostic Observation Schedule (ADOS), were analyzed: "Description of a Picture," "Cartoons," and "Telling a Story from a Book." Our analyses revealed a three-way interaction between Group, Task, and Social vs. Object Stimuli. We found a striking main effect of group and a task dependence of attentional allocation: while the TD attended first and longer to faces, ASD participants became similar to TD when they were asked to look at pictures while telling a story. Our results suggest that social attention allocation is task dependent, raising the question whether spontaneous attention deficits can be rescued by guiding goal-directed actions.

Social attention to activities in children and adults with autism spectrum disorder: effects of context and age

Background

Diminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator (“biomarker”) of ASD. We investigated differences in visual attention during activity monitoring in children and adult participants with autism compared to a control group of participants without autism.

Methods

Eye movements of participants with autism (n = 122; mean age [SD] = 14.5 [8.0] years) and typically developing (TD) controls (n = 40, age = 16.4 [13.3] years) were recorded while they viewed a series of videos depicting two female actors conversing while interacting with their hands over a shared task. Actors either continuously focused their gaze on each other’s face (mutual gaze) or on the shared activity area (shared focus). Mean percentage looking time was computed for the activity area, actors’ heads, and their bodies.

Results

Compared to TD participants, participants with ASD looked longer at the activity area (mean % looking time: 58.5% vs. 53.8%, p < 0.005) but less at the heads (15.2% vs. 23.7%, p < 0.0001). Additionally, within-group differences in looking time were observed between the mutual gaze and shared focus conditions in both participants without ASD (activity: Δ = − 6.4%, p < 0.004; heads: Δ = + 3.5%, p < 0.02) and participants with ASD (bodies: Δ = + 1.6%, p < 0.002).

Limitations

The TD participants were not as well characterized as the participants with ASD. Inclusion criteria regarding the cognitive ability [intelligence quotient (IQ) > 60] limited the ability to include individuals with substantial intellectual disability.

Conclusions

Differences in attention to faces could constitute a feature discriminative between individuals with and without ASD across the lifespan, whereas between-group differences in looking at activities may shift with development. These findings may have applications in the search for underlying biological indicators specific to ASD.

Trial registration ClinicalTrials.gov identifier NCT02668991.

Affording autism an early brain development re-definition

The national priority to advance early detection and intervention for children with autism spectrum disorder (ASD) has not reduced the late age of ASD diagnosis in the US over several consecutive Centers for Disease Control and Prevention (CDC) surveillance cohorts, with traditionally under-served populations accessing diagnosis later still. In this review, we explore a potential perceptual barrier to this enterprise which views ASD in terms that are contradicted by current science, and which may have its origins in the current definition of the condition and in its historical associations. To address this perceptual barrier, we propose a re-definition of ASD in early brain development terms, with a view to revisit the world of opportunities afforded by current science to optimize children's outcomes despite the risks that they are born with. This view is presented here to counter outdated notions that potentially devastating disability is determined the moment a child is born, and that these burdens are inevitable, with opportunities for improvement being constrained to only alleviation of symptoms or limited improvements in adaptive skills. The impetus for this piece is the concern that such views of complex neurodevelopmental conditions, such as ASD, can become self-fulfilling science and policy, in ways that are diametrically opposed to what we currently know, and are learning every day, of how genetic risk becomes, or not, instantiated as lifetime disabilities.

Computer vision in autism spectrum disorder research: a systematic review of published studies from 2009 to 2019

The current state of computer vision methods applied to autism spectrum disorder (ASD) research has not been well established. Increasing evidence suggests that computer vision techniques have a strong impact on autism research. The primary objective of this systematic review is to examine how computer vision analysis has been useful in ASD diagnosis, therapy and autism research in general. A systematic review of publications indexed on PubMed, IEEE Xplore and ACM Digital Library was conducted from 2009 to 2019. Search terms included ['autis*' AND ('computer vision' OR 'behavio* imaging' OR 'behavio* analysis' OR 'affective computing')]. Results are reported according to PRISMA statement. A total of 94 studies are included in the analysis. Eligible papers are categorised based on the potential biological/behavioural markers quantified in each study. Then, different computer vision approaches that were employed in the included papers are described. Different publicly available datasets are also reviewed in order to rapidly familiarise researchers with datasets applicable to their field and to accelerate both new behavioural and technological work on autism research. Finally, future research directions are outlined. The findings in this review suggest that computer vision analysis is useful for the quantification of behavioural/biological markers which can further lead to a more objective analysis in autism research.

Deep Neural Network Reveals the World of Autism From a First-Person Perspective

People with autism spectrum disorder (ASD) show atypical attention to social stimuli and aberrant gaze when viewing images of the physical world. However, it is unknown how they perceive the world from a first-person perspective. In this study, we used machine learning to classify photos taken in three different categories (people, indoors, and outdoors) as either having been taken by individuals with ASD or by peers without ASD. Our classifier effectively discriminated photos from all three categories, but was particularly successful at classifying photos of people with >80% accuracy. Importantly, visualization of our model revealed critical features that led to successful discrimination and showed that our model adopted a strategy similar to that of ASD experts. Furthermore, for the first time we showed that photos taken by individuals with ASD contained less salient objects, especially in the central visual field. Notably, our model outperformed classification of these photos by ASD experts. Together, we demonstrate an effective and novel method that is capable of discerning photos taken by individuals with ASD and revealing aberrant visual attention in ASD from a unique first-person perspective. Our method may in turn provide an objective measure for evaluations of individuals with ASD. LAY SUMMARY: People with autism spectrum disorder (ASD) demonstrate atypical visual attention to social stimuli. However, it remains largely unclear how they perceive the world from a first-person perspective. In this study, we employed a deep learning approach to analyze a unique dataset of photos taken by people with and without ASD. Our computer modeling was not only able to discern which photos were taken by individuals with ASD, outperforming ASD experts, but importantly, it revealed critical features that led to successful discrimination, revealing aspects of atypical visual attention in ASD from their first-person perspective.

Dysfunctional perceptual antecedent can justify the social orienting deficit in autism spectrum disorder: an eye-tracking study

Purpose

Children with Autism Spectrum Disorder (ASD) show reduced attention to social stimuli. The reasons for these impairments are still being debated by researchers. The aim of this study is to analyse if reduced attention towards social stimuli is determined by initial underlying difficulties in the control of visual attention. Among the variables that could produce these difficulties, the authors considered geometric complexity and typology of geometric figures.

Design/methodology/approach

To test this hypothesis, in this paper, an eye-tracker paradigm was used for assessing visual exploration and recognition memory towards geometric figures (curved vs rectilinear) with two levels of geometric complexity (low and high) in 17 children with ASD matched with 17 children with typical development (TD).

Findings

The results showed that the ASD group seemed indifferent to both the geometric complexity and the typology of figures (curved and rectilinear), whereas the TD group showed higher performances with highly complex and curved geometric figures than with low complex and rectilinear geometric figures.

Research limitations/implications

Because of the chosen research approach, the research results may lack generalizability. Therefore, researchers are encouraged to test the proposed hypotheses further.

Practical implications

This paper includes implications upon the presence of an unspecified visual attention deficit that is present from the early stages of the processing of stimuli.

Social implications

The understanding of this deficit from the early stages of the processing of stimuli can help educators to intervene at an early stage when disturbances in social relationships are starting.

Originality/value

This study contributes to understanding the presence of dysfunctional perceptual antecedents that could determine general difficulties in paying attention to social stimuli in ASD subjects.

Atypical Value-Driven Selective Attention in Young Children With Autism Spectrum Disorder

Importance

Enhanced selective attention toward nonsocial objects and impaired attention to social stimuli constitute key clinical features of autism spectrum disorder (ASD). Yet, the mechanisms associated with atypical selective attention in ASD are poorly understood, which limits the development of more effective interventions. In typically developing individuals, selective attention to social and nonsocial stimuli is associated with the informational value of the stimuli, which is typically learned over the course of repeated interactions with the stimuli.

Objective

To examine value learning (VL) of social and nonsocial stimuli and its association with selective attention in preschoolers with and without ASD.

Design, Setting, and Participants

This case-control study compared children with ASD vs children with developmental delay (DD) and children with typical development (TD) recruited between March 3, 2017, and June 13, 2018, at a university-based research laboratory. Participants were preschoolers with ASD, DD, or TD.

Main Outcomes and Measures

Procedure consisted of an eye-tracking gaze-contingent VL task involving social (faces) and nonsocial (fractals) stimuli and consisting of baseline, training, and choice test phases. Outcome measures were preferential attention to stimuli reinforced (high value) vs not reinforced (low value) during training. The hypotheses were stated before data collection.

Results

Included were 115 preschoolers with ASD (n = 48; mean [SD] age, 38.30 [15.55] months; 37 [77%] boys), DD (n = 31; mean [SD] age, 45.73 [19.49] months; 19 [61%] boys), or TD (n = 36; mean [SD] age, 36.53 [12.39] months; 22 [61%] boys). The groups did not differ in sex distribution; participants with ASD or TD had similar chronological age; and participants with ASD or DD had similar verbal IQ and nonverbal IQ. After training, the ASD group showed preference for the high-value nonsocial stimuli (mean proportion, 0.61 [95% CI, 0.56-0.65]; P < .001) but not for the high-value social stimuli (mean proportion, 0.51 [95% CI, 0.46-0.56]; P = .58). In contrast, the DD and TD groups demonstrated preference for the high-value social stimuli (DD mean proportion, 0.59 [95% CI, 0.54-0.64]; P = .001 and TD mean proportion, 0.57 [95% CI, 0.53-0.61]; P = .002) but not for the high-value nonsocial stimuli (DD mean proportion, 0.52 [95% CI, 0.44-0.59]; P = .64 and TD mean proportion, 0.50 [95% CI, 0.44-0.57]; P = .91). Controlling for age and nonverbal IQ, autism severity was positively correlated with enhanced learning in the nonsocial domain (r = 0.22; P = .03) and with poorer learning in the social domain (r = -0.26; P = .01).

Conclusions and Relevance

Increased attention to objects in preschoolers with ASD may be associated with enhanced VL in the nonsocial domain. When paired with poor VL in the social domain, enhanced value-driven attention to objects may play a formative role in the emergence of autism symptoms by altering attentional priorities and thus learning opportunities in affected children.

The Autism Biomarkers Consortium for Clinical Trials (ABC-CT): Scientific Context, Study Design, and Progress Toward Biomarker Qualification

Clinical research in neurodevelopmental disorders remains reliant upon clinician and caregiver measures. Limitations of these approaches indicate a need for objective, quantitative, and reliable biomarkers to advance clinical research. Extant research suggests the potential utility of multiple candidate biomarkers; however, effective application of these markers in trials requires additional understanding of replicability, individual differences, and intra-individual stability over time. The Autism Biomarkers Consortium for Clinical Trials (ABC-CT) is a multi-site study designed to investigate a battery of electrophysiological (EEG) and eye-tracking (ET) indices as candidate biomarkers for autism spectrum disorder (ASD). The study complements published biomarker research through: inclusion of large, deeply phenotyped cohorts of children with ASD and typical development; a longitudinal design; a focus on well-evidenced candidate biomarkers harmonized with an independent sample; high levels of clinical, regulatory, technical, and statistical rigor; adoption of a governance structure incorporating diverse expertise in the ASD biomarker discovery and qualification process; prioritization of open science, including creation of a repository containing biomarker, clinical, and genetic data; and use of economical and scalable technologies that are applicable in developmental populations and those with special needs. The ABC-CT approach has yielded encouraging results, with one measure accepted into the FDA’s Biomarker Qualification Program to date. Through these advances, the ABC-CT and other biomarker studies in progress hold promise to deliver novel tools to improve clinical trials research in ASD.

Developmental changes in attention to social information from childhood to adolescence in autism spectrum disorders: a comparative study

BACKGROUND

Elucidating developmental changes in the symptoms of autism spectrum disorder (ASD) is important to support individuals with ASD. However, no report has clarified the developmental changes in attention to social information for a broad age range. The aim of this study was to investigate the developmental changes in attention to social information from early childhood to adolescence in individuals with ASD and typically developed (TD) children.

METHODS

We recruited children with ASD (n = 83) and TD participants (n = 307) between 2 and 18 years of age. Using the all-in-one-eye-tracking system, Gazefinder, we measured the percentage fixation time allocated to areas of interest (AoIs) depicted in movies (the eyes and mouth in movies of a human face with/without mouth motion, upright and inverted biological motion in movies showing these stimuli simultaneously, people and geometry in preference paradigm movies showing these stimuli simultaneously, and objects with/without finger-pointing in a movie showing a woman pointing toward an object). We conducted a three-way analysis of variance, 2 (diagnosis: ASD and TD) by 2 (sex: male and female) by 3 (age group: 0-5, 6-11, and 12-18 years) and locally weighted the scatterplot smoothing (LOESS) regression curve on each AoI.

RESULTS

In the face stimuli, the percentage fixation time to the eye region for the TD group increased with age, whereas the one for the ASD group did not. In the ASD group, the LOESS curves of the gaze ratios at the eye region increased up to approximately 10 years of age and thereafter tended to decrease. For the percentage fixation time to the people region in the preference paradigm, the ASD group gazed more briefly at people than did the TD group.

LIMITATIONS

It is possible that due to the cross-sectional design, the degree of severity and of social interest might have differed according to the subjects' age.

CONCLUSIONS

There may be qualitative differences in abnormal eye contact in ASD between individuals in early childhood and those older than 10 years.

The role of limited salience of speech in selective attention to faces in toddlers with autism spectrum disorders

BACKGROUND

Impaired attention to faces of interactive partners is a marker for autism spectrum disorder (ASD) in early childhood. However, it is unclear whether children with ASD avoid faces or find them less salient and whether the phenomenon is linked with the presence of eye contact or speech.

METHODS

We investigated the impacts of speech (SP) and direct gaze (DG) on attention to faces in 22-month-old toddlers with ASD (n = 50) and typically developing controls (TD, n = 47) using the Selective Social Attention 2.0 (SSA 2.0) task. The task consisted of four conditions where the presence (+) and absence (-) of DG and SP were systematically manipulated. The severity of autism symptoms, and verbal and nonverbal skills were characterized concurrently with eye tracking at 22.4 (SD = 3.2) months and prospectively at 39.8 (SD = 4.3) months.

RESULTS

Toddlers with ASD looked less than TD toddlers at face and mouth regions only when the actress was speaking (direct gaze absence with speech, DG-SP+: d = 0.99, p < .001 for face, d = 0.98, p < .001 for mouth regions; direct gaze present with speech, DG+SP+, d = 1.47, p < .001 for face, d = 1.01, p < .001 for mouth regions). Toddlers with ASD looked less at the eye region only when both gaze and speech cues were present (d = 0.46, p = .03). Salience of the combined DG and SP cues was associated concurrently and prospectively with the severity of autism symptoms, and the association remained significant after controlling for verbal and nonverbal levels.

CONCLUSIONS

The study links poor attention to faces with limited salience of audiovisual speech and provides no support for the face avoidance hypothesis in the early stages of ASD. These results are consequential for research on early discriminant and predictive biomarkers as well as identification of novel treatment targets.

Biomarker Acquisition and Quality Control for Multi-Site Studies: The Autism Biomarkers Consortium for Clinical Trials

The objective of the Autism Biomarkers Consortium for Clinical Trials (ABC-CT) is to evaluate a set of lab-based behavioral video tracking (VT), electroencephalography (EEG), and eye tracking (ET) measures for use in clinical trials with children with autism spectrum disorder (ASD). Within the larger organizational structure of the ABC-CT, the Data Acquisition and Analytic Core (DAAC) oversees the standardization of VT, EEG, and ET data acquisition, data processing, and data analysis. This includes designing and documenting data acquisition and analytic protocols and manuals; facilitating site training in acquisition; data acquisition quality control (QC); derivation and validation of dependent variables (DVs); and analytic deliverables including preparation of data for submission to the National Database for Autism Research (NDAR). To oversee consistent application of scientific standards and methodological rigor for data acquisition, processing, and analytics, we developed standard operating procedures that reflect the logistical needs of multi-site research, and the need for well-articulated, transparent processes that can be implemented in future clinical trials. This report details the methodology of the ABC-CT related to acquisition and QC in our Feasibility and Main Study phases. Based on our acquisition metrics from a preplanned interim analysis, we report high levels of acquisition success utilizing VT, EEG, and ET experiments in a relatively large sample of children with ASD and typical development (TD), with data acquired across multiple sites and use of a manualized training and acquisition protocol.

Relative Average Look Duration and its Association with Neurophysiological Activity in Young Children with Autism Spectrum Disorder

Autism Spectrum Disorder (ASD) is characterized by early attentional differences that often precede the hallmark symptoms of social communication impairments. Development of novel measures of attentional behaviors may lead to earlier identification of children at risk for ASD. In this work, we first introduce a behavioral measure, Relative Average Look Duration (RALD), indicating attentional preference to different stimuli, such as social versus nonsocial stimuli; and then study its association with neurophysiological activity. We show that (1) ASD and typically developing (TD) children differ in both (absolute) Average Look Duration (ALD) and RALD to stimuli during an EEG experiment, with the most pronounced differences in looking at social stimuli; and (2) associations between looking behaviors and neurophysiological activity, as measured by EEG, are different for children with ASD versus TD. Even when ASD children show attentional engagement to social content, our results suggest that their underlying brain activity is different than TD children. This study therefore introduces a new measure of social/nonsocial attentional preference in ASD and demonstrates the value of incorporating attentional variables measured simultaneously with EEG into the analysis pipeline.

Comparing Automatic Eye Tracking and Manual Gaze Coding Methods in Young Children with Autism Spectrum Disorder

Eye-gaze methods offer numerous advantages for studying cognitive processes in children with autism spectrum disorder (ASD), but data loss may threaten the validity and generalizability of results. Some eye-gaze systems may be more vulnerable to data loss than others, but to our knowledge, this issue has not been empirically investigated. In the current study, we asked whether automatic eye-tracking and manual gaze coding produce different rates of data loss or different results in a group of 51 toddlers with ASD. Data from both systems were gathered (from the same children) simultaneously, during the same experimental sessions. As predicted, manual gaze coding produced significantly less data loss than automatic eye tracking, as indicated by the number of usable trials and the proportion of looks to the images per trial. In addition, automatic eye-tracking and manual gaze coding produced different patterns of results, suggesting that the eye-gaze system used to address a particular research question could alter a study's findings and the scientific conclusions that follow. It is our hope that the information from this and future methodological studies will help researchers to select the eye-gaze measurement system that best fits their research questions and target population, as well as help consumers of autism research to interpret the findings from studies that utilize eye-gaze methods with children with ASD. Autism Res 2020, 13: 271-283. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: The current study found that automatic eye-tracking and manual gaze coding produced different rates of data loss and different overall patterns of results in young children with ASD. These findings show that the choice of eye-gaze system may impact the findings of a study-important information for both researchers and consumers of autism research.