Parsing heterogeneity in autism spectrum disorders: visual scanning of dynamic social scenes in school-aged children

Visual social attention in SYNGAP1-related intellectual disability

SYNGAP1-ID is a neurodevelopmental disorder caused by a mutation of the SYNGAP1 gene. Characterized by moderate to severe developmental delay, it is associated with several physical and behavioral issues as well as additional diagnoses, including autism. However, it is not known whether social cognitive differences seen in SYNGAP1-ID are similar to those previously identified in idiopathic or other forms of autism. This study therefore investigated visual social attention in SYNGAP1-ID. Eye movements were recorded across three passive viewing tasks (face scanning, pop-out, and social preference) of differing social complexity in 24 individuals with SYNGAP1-ID and 12 typically developing controls. We found that SYNGAP1-ID participants looked at faces less than the controls, and when they did look at faces, they had less time looking at and fewer fixations to the eyes. For the pop-out task, where social and nonsocial objects (Phone, car, face, bird, and face-noise) were presented in an array, those with SYNGAP1-ID spent significantly less time looking at the phone stimulus as well as fewer fixations to the face compared with the typically developing controls. When looking at two naturalistic scenes side by side, one social in nature (e.g., with children present) and the other not, there were no differences between the SYNGAP1-ID group and typically developing controls on any of the examined eye tracking measures. This study provides novel findings on the social attention of those with SYNGAP1-ID and helps to provide further evidence for using eye tracking as an objective measure of the social phenotype in this population in future clinical trials.

Social and joint attention during shared book reading in young autistic children: a potential marker for social development

BACKGROUND

Atypical patterns of social engagement and joint attention behaviors are diagnostic criteria for people with autism spectrum disorder. Experimental tasks using eye-tracking methodologies have, however, shown inconsistent results. The development of tasks with greater ecological validity and relevance for developmentally appropriate social milestones has been identified as important for the field.

METHODS

We developed a novel, dynamic eye-tracking task emulating a shared book reading (SBR) scenario. Four SBR videos of an adult reader engaging with the viewer while reading a children's picture book and including sequenced bids for joint attention were developed. Participants included 90 children (N = 56 autistic children, N = 34 neurotypical children; aged 3-12). Social attention was also measured in a live free play task between participants and an experimenter.

RESULTS

Compared to neurotypical children, autistic children displayed reduced attention to socially salient stimuli including the reader's face and picture book across SBR videos and during joint attention bids specifically. In contrast, they showed increased attention to nonsalient background stimuli compared to their neurotypical peers. These attention patterns in autistic children were associated with reduced verbal and nonverbal cognitive skills and increased symptoms associated with autism. Interestingly, positive correlations in the frequency of eye gaze between SBR and free play suggested a potential predictive value for social attention in live social interactions.

CONCLUSIONS

Findings highlight the utility of SBR eye-tracking tasks in understanding underlying divergences in social engagement and joint attention between autistic and neurotypical children. This commonly practiced early childhood activity may provide insights into the relationship between social engagement and learning to reveal how such attentional patterns might influence broader developmental and educational outcomes.

Correlation Between Gaze Behaviors and Social Communication Skills of Young Autistic Children: A Meta-Analysis of Eye-Tracking Studies

This meta-analysis examined correlations between eye-tracking measures of gaze behaviors manifested during dynamic salient social stimuli and behavioral assessment measures of social communication skills of young autistic children. We employed a multilevel model with random effects to perform three separate meta-analyses for correlation between social communication skills and (a) all gaze behaviors, (b) gaze duration, and (c) gaze transition. Subsequently, we performed meta-regression to assess the role of four moderators, including age, continuum of naturalness of stimuli, gaze metric, and area of interest, on correlation effect sizes that were heterogeneous at the population level. A total of 111 correlation coefficients from 17 studies for 1132 young autistic children or children with high-likelihood for autism (Mage range = 6-95 months) were included in this meta-analysis. The correlation effect sizes for all three meta-analyses were significant, supporting the relation between improved gaze behaviors and better social communication skills. In addition, age, gaze metric, and area of interest were significant moderators. This suggests the importance of identifying meaningful gaze behaviors related to social communication skills and the increasingly influential role of gaze behaviors in shaping social communication skills as young autistic children progress through the early childhood stage. The continuum of naturalness of stimuli, however, was revealed to trend towards having a significant moderating effect. Lastly, it is important to note the evidence of potential publication bias. Our findings are discussed in the context of early identification and intervention and unraveling the complex nature of autism.

Oculomotor randomness is higher in autistic children and increases with the severity of symptoms

A variety of studies have suggested that at least some children with autism spectrum disorder (ASD) view the world differently. Differences in gaze patterns as measured by eye tracking have been demonstrated during visual exploration of images and natural viewing of movies with social content. Here we analyzed the temporal randomness of saccades and blinks during natural viewing of movies, inspired by a recent measure of "randomness" applied to micro-movements of the hand and head in ASD (Torres et al., 2013; Torres & Denisova, 2016). We analyzed a large eye-tracking dataset of 189 ASD and 41 typically developing (TD) children (1-11 years old) who watched three movie clips with social content, each repeated twice. We found that oculomotor measures of randomness, obtained from gamma parameters of inter-saccade intervals (ISI) and blink duration distributions, were significantly higher in the ASD group compared with the TD group and were correlated with the ADOS comparison score, reflecting increased "randomness" in more severe cases. Moreover, these measures of randomness decreased with age, as well as with higher cognitive scores in both groups and were consistent across repeated viewing of each movie clip. Highly "random" eye movements in ASD children could be associated with high "neural variability" or noise, poor sensory-motor control, or weak engagement with the movies. These findings could contribute to the future development of oculomotor biomarkers as part of an integrative diagnostic tool for ASD.

Identifying interindividual variability of social perception and associated brain anatomical correlations in children with autism spectrum disorder using eye-tracking and diffusion tensor imaging MRI (DTI-MRI)

Even though deficits in social cognition constitute a core characteristic of autism spectrum disorders, a large heterogeneity exists regarding individual social performances and its neural basis remains poorly investigated. Here, we used eye-tracking to objectively measure interindividual variability in social perception and its correlation with white matter microstructure, measured with diffusion tensor imaging MRI, in 25 children with autism spectrum disorder (8.5 ± 3.8 years). Beyond confirming deficits in social perception in participants with autism spectrum disorder compared 24 typically developing controls (10.5 ± 2.9 years), results revealed a large interindividual variability of such behavior among individuals with autism spectrum disorder. Whole-brain analysis showed in both autism spectrum disorder and typically developing groups a positive correlation between number of fixations to the eyes and fractional anisotropy values mainly in right and left superior longitudinal tracts. In children with autism spectrum disorder a correlation was also observed in right and left inferior longitudinal tracts. Importantly, a significant interaction between group and number of fixations to the eyes was observed within the anterior portion of the right inferior longitudinal fasciculus, mainly in the right anterior temporal region. This additional correlation in a supplementary region suggests the existence of a compensatory brain mechanism, which may support enhanced performance in social perception among children with autism spectrum disorder.

Intact or impaired? The understanding of give-and-take interactions in children with autism spectrum disorder

BACKGROUND

Understanding and predicting others' behavior in a dynamic and rapidly changing world is a fundamental aspect of social interactions. However, it remains unclear as to whether children with autism spectrum disorder (ASD) could understand and predict goal-directed social actions.

AIMS

To investigate the understanding of give-and-take interactions in children with ASD with the use of eye tracking.

METHODS AND PROCEDURES

Experiment 1 and 2 investigated the understanding of giving and taking respectively in 5-to 8-year-old Chinese children with ASD and typically developing children by using the eye-tracking technology.

OUTCOMES AND RESULTS

We found that children with ASD could predict actions, but they were less proficient in processing give-and-take interactions. Moreover, children with ASD showed impaired understanding of giving but not taking.

CONCLUSIONS

These results indicate that the basic mechanisms of action prediction are intact in children with ASD whereas there may be deficits in the top-down social processing of the giving gesture.

Development and validation of an Arabic language eye-tracking paradigm for the early screening and diagnosis of autism spectrum disorders in Qatar

Abnormal eye gaze is a hallmark characteristic of autism spectrum disorder (ASD). The primary aim of the present research was to develop an Arabic version of an objective measure of ASD, the "autism index" (AI), based on eye gaze tracking to social and nonsocial stimuli validated initially in the United States. The initial phase of this study included the translation of English language eye-tracking stimuli into stimuli appropriate for an Arabic-speaking culture. During the second phase, we tested it on a total of 144 children with ASD, and 96 controls. The AI had excellent internal consistency and test-retest reliability. Moreover, the AI showed good differentiation of ASD from control cases (AUC = 0.730, SE = 0.035). The AI was significantly positively correlated with SCQ total raw scores (r = 0.46, p < 0.001). ADOS-2 scores were only available in the ASD group and did not show a significant relationship with AI scores (r = 0.10, p = 0.348), likely due to the restricted range. The AI, when implemented using Arabic-translated stimuli in a Qatari sample, showed good diagnostic differentiation and a strong correlation with parent-reported ASD symptoms. Thus, the AI appears to have cross-cultural validity and may be useful as a diagnostic aide to inform clinical judgment and track ASD symptom levels as part of the evaluation process.

Imitation Performance in Children with Autism and the Role of Visual Attention in Imitation

In this study, we examined imitation performance, visual attention, and the relationship between imitation and visual attention of children with autism, developmental delay (DD), and typically developing (TD) children. The study findings revealed that children with autism and DD imitated less than TD children in all imitation tasks. Results also showed that children with autism spent less time looking at the model's face and movement area and more time looking at the external area. Lastly, the relationship between imitation and visual attention separated the study groups. The findings of the study provided new evidence that visual attention to movement area in children with autism was positively related to imitation performance in non-meaningful gestures.

Autism symptoms, functional impairments, and gaze fixation measured using an eye-tracker in 6-year-old children

Introduction

Autism spectrum disorder (ASD) is a neurodevelopmental disorder clinically characterized by abnormalities in eye contact during social exchanges. We aimed to clarify whether the amount of gaze fixation, measured at the age of 6 years using Gazefinder, which is an established eye-tracking device, is associated with ASD symptoms and functioning.

Methods

The current study included 742 participants from the Hamamatsu Birth Cohort Study. Autistic symptoms were evaluated according to the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2), and the functioning of the participating children in real life was assessed using the Japanese version of the Vineland Adaptive Behavior Scales, Second Edition (VABS-II). The Gazefinder system was used for gaze fixation rates; two areas of interest (eyes and mouth) were defined in a talking movie clip, and eye gaze positions were calculated through corneal reflection techniques.

Results

The participants had an average age of 6.06 ± 0.14 years (males: 384; 52%). According to ADOS, 617 (83%) children were assessed as having none/mild ASD and 51 (7%) as severe. The average VABS-II scores were approximately 100 (standard deviation = 12). A higher gaze fixation rate on the eyes was associated with a significantly lower likelihood of the child being assigned to the severe ADOS group after controlling for covariates (odds ratio [OR], 0.02; 95% confidence interval [CI], 0.002-0.38). The gaze fixation rate on the mouth was not associated with ASD symptoms. A higher gaze fixation rate on the mouth was associated with a significantly lower likelihood of the child being assigned to the low score group in VABS-II socialization after controlling for covariates (OR, 0.18; 95% CI, 0.04-0.85). The gaze fixation rate on the eyes was not associated with functioning.

Conclusion

We found that children with low gaze fixation rates on the eyes were likely to have more ASD symptoms, and children with low gaze fixation rates on the mouth were likely to demonstrate poorer functioning in socialization. Hence, preschool children could be independently assessed in the general population for clinically relevant endophenotypes predictive of ASD symptoms and functional impairments.

Evidence of a reduced role for circumscribed interests in the social attention patterns of children with Autism Spectrum Disorder

Reduced social attention is characteristic of Autism Spectrum Disorder (ASD). It has been suggested to result from an early onset and excessive influence of circumscribed interests (CIs) on gaze behaviour, compared to typically developing (TYP) individuals. To date, these findings have been mixed. The current eye-tracking study utilised a visual preference paradigm to investigate the influence of CI versus non-CI objects on attention patterns in children with ASD (aged 3-12 years, n = 37) and their age-matched TYP peers (n = 30). Compared to TYP, social and object attention was reduced in the ASD group irrespective of the presence of CIs. Results suggest a reduced role for CIs and extend recent evidence of atypical attention patterns across social and non-social domains in ASD.

A Review of and Roadmap for Data Science and Machine Learning for the Neuropsychiatric Phenotype of Autism

Autism spectrum disorder (autism) is a neurodevelopmental delay that affects at least 1 in 44 children. Like many neurological disorder phenotypes, the diagnostic features are observable, can be tracked over time, and can be managed or even eliminated through proper therapy and treatments. However, there are major bottlenecks in the diagnostic, therapeutic, and longitudinal tracking pipelines for autism and related neurodevelopmental delays, creating an opportunity for novel data science solutions to augment and transform existing workflows and provide increased access to services for affected families. Several efforts previously conducted by a multitude of research labs have spawned great progress toward improved digital diagnostics and digital therapies for children with autism. We review the literature on digital health methods for autism behavior quantification and beneficial therapies using data science. We describe both case-control studies and classification systems for digital phenotyping. We then discuss digital diagnostics and therapeutics that integrate machine learning models of autism-related behaviors, including the factors that must be addressed for translational use. Finally, we describe ongoing challenges and potential opportunities for the field of autism data science. Given the heterogeneous nature of autism and the complexities of the relevant behaviors, this review contains insights that are relevant to neurological behavior analysis and digital psychiatry more broadly.

Active Viewing Facilitates Gaze to the Eye Region in Young Children with Autism Spectrum Disorder

Previous studies have shown reduced attention to the eyes in individuals with autism spectrum disorder (ASD). However, most eye-tracking evidence regarding this impairment has been derived from passive viewing tasks. Here, we compared the passive viewing of faces with an active task involving face identification with morphing faces. While typical controls prioritized the eyes over other facial features regardless of viewing condition, autistic children exhibited reduced eye-looking in passive viewing, but displayed increased attention allocation to the eyes when instructed to identify faces. The proportional eye-looking in ASD during facial recognition was negatively related to the autism symptoms severity. These findings provide evidence regarding the specific situations in which diminished eye-looking may rise in young ASD children.

Perception of audio-visual synchrony in infants at elevated likelihood of developing autism spectrum disorder

The inability to perceive audio-visual speech as a unified event may contribute to social impairments and language deficits in children with autism spectrum disorder (ASD). In this study, we examined and compared two groups of infants on their sensitivity to audio-visual asynchrony for a social (speaking face) and non-social event (bouncing ball) and assessed the relations between multisensory integration and language production. Infants at elevated likelihood of developing ASD were less sensitive to audio-visual synchrony for the social event than infants without elevated likelihood. Among infants without elevated likelihood, greater sensitivity to audio-visual synchrony for the social event was associated with a larger productive vocabulary.

CONCLUSION

Findings suggest that early deficits in multisensory integration may impair language development among infants with elevated likelihood of developing ASD.

WHAT IS KNOWN

•Perceptual integration of auditory and visual cues within speech is important for language development. •Prior work suggests that children with ASD are less sensitive to the temporal synchrony within audio-visual speech.

WHAT IS NEW

•In this study, infants at elevated likelihood of developing ASD showed a larger temporal binding window for adynamic social event (Speaking Face) than TD infants, suggesting less efficient multisensory integration.

Eye tracking: empirical foundations for a minimal reporting guideline

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").

Social attention in anorexia nervosa and autism spectrum disorder: Role of social motivation

LAY ABSTRACT

Research suggests a relationship between autism and anorexia nervosa. For example, rigid and inflexible behaviour, a preference for routine and social difficulties are seen in both conditions. In this study, we examined whether people with anorexia and people with autism show similarities in social attention (where they look while engaging in social interactions or watching a scene with people interacting). This could help us understand why people with anorexia and autism experience difficulties in social situations. Participants with either anorexia or autism, as well as participants with no mental health problems watched a video of a social scene while we recorded which parts of the scene they looked at with an eye-tracker. Participants also completed questionnaires to assess characteristics of autism. We found that autistic participants looked at faces less than typically developing participants. However, participants with anorexia did not show a similar reduction in attention to faces, contrary to our predictions. Autistic features were not related to attention in either group. The results suggest that autistic people may miss important social cues (like facial expressions), potentially contributing to social difficulties. However, this mechanism does not appear explain social difficulties in people with anorexia.

Eye Tracking Study of Social Intensity on Social Orientation of Autistic Children

Some previous studies indicate that impaired social attention mainly results in social disorders in autistic children. In the social attention mode of autistic children, social orientation and joint attention are particularly important. The influence of different social intensity and ecological validity on them are worthy of further study. This study used realistic paintings with moderate ecological validity as experimental materials, to design isolated individual scene and social interaction scene, and to explore the impact of social interaction on the social orientation of autistic children. It found that in the scenes without social interaction, the attention patterns of autistic children and typical developing children were the same, while the attention patterns of autistic children were abnormal in the scenes with social interaction. From the eye tracking data, it was shown that the gaze processing process of autistic children was not as smooth as that of typical developing children. Compared with cartoons and other social scenes with low ecological validity, realistic painting could better restore the proportion of real scenes. Moreover, it could reduce the complexity of information which could not be done in real scenes. The findings of this study provide support for training and education of autistic children. Intervention with realistic paintings is conducive to the migration of autistic children.

Identifying Visual Attention Features Accurately Discerning Between Autism and Typically Developing: a Deep Learning Framework

Atypical visual attention is a hallmark of autism spectrum disorder (ASD). Identifying the attention features accurately discerning between people with ASD and typically developing (TD) at the individual level remains a challenge. In this study, we developed a new systematic framework combining high accuracy deep learning classification, deep learning segmentation, image ablation and a direct measurement of classification ability to identify the discriminative features for autism identification. Our two-stream model achieved the state-of-the-art performance with a classification accuracy of 0.95. Using this framework, two new categories of features, Food & drink and Outdoor-objects, were identified as discriminative attention features, in addition to the previously reported features including Center-object and Human-faces, etc. Altered attention to the new categories helps to understand related atypical behaviors in ASD. Importantly, the area under curve (AUC) based on the combined top-9 features identified in this study was 0.92, allowing an accurate classification at the individual level. We also obtained a small but informative dataset of 12 images with an AUC of 0.86, suggesting a potentially efficient approach for the clinical diagnosis of ASD. Together, our deep learning framework based on VGG-16 provides a novel and powerful tool to recognize and understand abnormal visual attention in ASD, which will, in turn, facilitate the identification of biomarkers for ASD.

Examining the impact of social stressor stimuli in eliciting physiological reactivity in children and adolescents with autism spectrum disorder: a systematic review and meta-analysis protocol

INTRODUCTION

Stress is not experienced the same by everyone. Some individuals, such as individuals with autism spectrum disorder (ASD), are at risk of heightened sensitivity to stress responses. ASD is a neurodevelopmental disorder commonly characterised by deficits in social communication and social interaction. Among different stressor stimuli, social stressors are particularly worth our attention due to the social and communication challenges inherent in ASD. This study aims to systematically evaluate different social stressor stimuli in eliciting physiological reactivity in ASD, focusing on the children and adolescent population.

METHODS AND ANALYSIS

We designed a study protocol for this study and submitted it to PROSPERO for systematic review registration. Any studies with children and adolescents with ASD between the ages of 0 and 18 in clinical and community settings will be included. All types of social stressor interventions will be included. The outcome of interest will include studies with physiological activity of the participants being measured, for example, measures related to autonomic functioning, electrodermal functioning and cortisol level. The primary literature sources will be across four electronic databases: MEDLINE, Embase, PsycInfo and CINAHL in August 2021. The second source of literature will be across grey literature, including ProQuest Dissertations & Theses Global and across clinical trial registries in August 2021. Hand searching of references will be performed on the reference lists of all included studies. Two volunteers pursuing postgraduate-level studies will independently search and screen potential studies for eligibility. Finally, all references considered by hand searching will be reviewed by two researchers. The methodological quality of the research will be assessed by adopting the quality assessment used by a previous study. The assessment consists of four primary categories: descriptive validity, internal validity, external validity and statistical conclusion validity.

ETHICS AND DISSEMINATION

No ethical approval is required for this study. Results will be disseminated through conferences and publications in relevant peer-reviewed journals.

PROSPERO REGISTRATION NUMBER

CRD42021244039.

Gaze and social functioning associations in autism spectrum disorder: A systematic review and meta-analysis

Autism spectrum disorder (ASD) is characterized by significant social functioning impairments, including (but not limited to) emotion recognition, mentalizing, and joint attention. Despite extensive investigation into the correlates of social functioning in ASD, only recently has there been focus on the role of low‐level sensory input, particularly visual processing. Extensive gaze deficits have been described in ASD, from basic saccadic function through to social attention and the processing of complex biological motion. Given that social functioning often relies on accurately processing visual information, inefficient visual processing may contribute to the emergence and sustainment of social functioning difficulties in ASD. To explore the association between measures of gaze and social functioning in ASD, a systematic review and meta‐analysis was conducted. A total of 95 studies were identified from a search of CINAHL Plus, Embase, OVID Medline, and psycINFO databases in July 2021. Findings support associations between increased gaze to the face/head and eye regions with improved social functioning and reduced autism symptom severity. However, gaze allocation to the mouth appears dependent on social and emotional content of scenes and the cognitive profile of participants. This review supports the investigation of gaze variables as potential biomarkers of ASD, although future longitudinal studies are required to investigate the developmental progression of this relationship and to explore the influence of heterogeneity in ASD clinical characteristics.

Weak central coherence in adults with ASD: Evidence from eye-tracking and thematic content analysis of social scenes

Central Coherence Weakness has been defined as a tendency for local rather than global processing that may underlie core deficits in Autism Spectrum Disorder (ASD). In social contexts it may be expressed in difficulties to integrate social cues arising from the recognition of emotions in faces or from the environment in order to understand people's interactions. A sample of 28 adults diagnosed with ASD Level 1 and 25 controls was submitted to a cartoon-like task with the instruction to describe social scenes and to Navon letter stimuli. Both quantitative measures and qualitative (thematic content analysis) procedures were used to assess performance. Heatmap and fixation preferences according to the stimuli quadrants were used to investigate eye-tracking patterns. A tendency to local processing, independently of the stimuli type, in the ASD participants was observed. Data from visual tracking by quadrants and from verbal reports suggest loss of social cues important for understanding context. Their reaction time and response duration were increased in relation to controls. The findings corroborate the idea that weak central coherence may be part of the cognitive phenotype in ASD.

An Electrocortical Measure Associated with Metarepresentation Mediates the Relationship between Autism Symptoms and Theory of Mind

Impairments in theory of mind (ToM) - long considered common among individuals with autism spectrum disorder (ASD) - are in fact highly heterogeneous across this population. While such heterogeneity should be reflected in differential recruitment of neural mechanisms during ToM reasoning, no research has yet uncovered a mechanism that explains these individual differences. In this study, 78 (48 ASD) adolescents viewed ToM vignettes and made mental state inferences about characters' behavior while participant electrophysiology was concurrently recorded. Two candidate event-related potentials (ERPs) - the Late Positive Complex (LPC) and the Late Slow Wave (LSW) - were successfully elicited. LPC scores correlated positively with ToM accuracy and negatively with ASD symptom severity. Notably, the LPC partially mediated the relationship between ASD symptoms and ToM accuracy, suggesting this ERP component, thought to represent cognitive metarepresentation, may help explain differences in ToM performance in some individuals with ASD.

Comparing internal representations of facial expression kinematics between autistic and non-autistic adults

Recent developments suggest that autistic individuals require dynamic angry expressions to have a higher speed in order for them to be successfully identified. Therefore, it is plausible that autistic individuals do not have a 'deficit' in angry expression recognition, but rather their internal representation of these expressions is characterised by very high-speed movement. In this study, matched groups of autistic and non-autistic adults completed a novel emotion-based task which employed dynamic displays of happy, angry and sad point light facial (PLF) expressions. On each trial, participants moved a slider to manipulate the speed of a PLF stimulus until it moved at a speed that, in their 'mind's eye', was typical of happy, angry or sad expressions. Participants were shown three different types of PLFs-those showing the full-face, only the eye region, and only the mouth region, wherein the latter two were included to test whether differences in facial information sampling underpinned any dissimilarities in speed attributions. Across both groups, participants attributed the highest speeds to angry, then happy, then sad, facial motion. Participants increased the speed of angry and happy expressions by 41% and 27% respectively and decreased the speed of sad expressions by 18%. This suggests that participants have 'caricatured' internal representations of emotion, wherein emotion-related kinematic cues are over-emphasised. There were no differences between autistic and non-autistic individuals in the speeds attributed to full-face and partial-face angry, happy and sad expressions respectively. Consequently, we find no evidence that autistic adults possess atypically fast internal representations of anger.

Using social media to be 'social': Perceptions of social media benefits and risk by autistic young people, and parents

Autistic individuals are reported to struggle with aspects of social interaction. Past research has shown that social media use can help to facilitate social functioning, however, the perceptions of risks and benefits when engaging on social media platforms remains unclear. The current study aimed to explore perceptions of social media participation in terms of online risk and online relationships in both autistic young people and parents. Eight autistic young people and six parents of autistic young people took part in semi-structured interviews, with the resultant data being transcribed and analysed using Braun and Clarke's (2006) inductive thematic analysis. Two themes were identified in relation to the impact social media has on autistic young people's relationships (Socialisation; Communication) and two themes were identified in relation to the perceived barriers and risks to engaging online (Abusive interactions; Talking to strangers). These findings show that social interaction is of particular value to young autistic people, in terms of affording them easier social interactions than there would be in 'real life'. The findings also show that the autistic young people were aware of risks online, and considered ways in which they try to manage this risk. Future research is needed to understand if similar interactions and risk take place across all platforms and whether online communication is successful between matched or mixed autistic and non-autistic groups.

Distance from Typical Scan Path When Viewing Complex Stimuli in Children with Autism Spectrum Disorder and its Association with Behavior

Eye-tracking is often used to study attention in children with autism spectrum disorder (ASD). Previous research has identified multiple atypical patterns of attention in children with ASD based on areas-of-interest analysis. Fewer studies have investigated gaze path, a measure which is dependent on the dynamic content of the stimulus presented. Here, rather than looking at proportions of looking time to areas of interest, we calculated mean fixations frame-by-frame in a group of typically developing children (36 to 72 months) and determined the distance from those typical fixations for 155 children with ASD (27-95 months). Findings revealed that distance from the typical scan path among the children with ASD was associated with lower communication abilities and greater ASD symptomatology.

Basic oculomotor function is similar in young children with ASD and typically developing controls

A variety of eye tracking studies have demonstrated that young children with ASD gaze at images and movies of social interactions differently than typically developing children. These findings have supported the hypothesis that gaze behavior differences are generated by a weaker preference for social stimuli in ASD children. The hypothesis assumes that gaze differences are not caused by abnormalities in oculomotor function including saccade frequency and kinematics. Previous studies of oculomotor function have mostly been performed with school-age children, adolescents, and adults using visual search, anti-saccade, and gap saccade tasks that are less suitable for young pre-school children. Here, we examined oculomotor function in 144 children (90 with ASD and 54 controls), 1-10-years-old, as they watched two animated movies interleaved with the presentation of multiple salient stimuli that elicited saccades-to-targets. The results revealed that the number of fixations, fixation duration, number of saccades, saccade duration, saccade accuracy, and saccade latency did not differ significantly across groups. Minor initial differences in saccade peak velocity were not supported by analysis with a linear mixed model. These findings suggest that most children with ASD exhibit similar oculomotor function to that of controls, when performing saccades-to-targets or freely viewing child-friendly movies. This suggests that previously reported gaze abnormalities in children with ASD are not due to underlying oculomotor deficiencies. LAY SUMMARY: This study demonstrates that children with ASD perform similar eye movements to those of controls when freely observing movies or making eye movements to targets. Similar results were apparent across groups in the number of eye movements, their accuracy, duration, and other measures that assess eye movement control. These findings are important for interpreting previously reported differences in gaze behavior of children with ASD, which are likely due to atypical social preferences rather than impaired control of eye movements.

Visual Traces of Language Acquisition in Toddlers with Autism Spectrum Disorder During the Second Year of Life

Infants show shifting patterns of visual engagement to faces over the first years of life. To explore the adaptive implications of this engagement, we collected eye-tracking measures on cross-sectional samples of 10-25-month-old typically developing toddlers (TD;N = 28) and those with autism spectrum disorder (ASD;N = 54). Concurrent language assessments were conducted and relationships between visual engagement and expressive and receptive language were analyzed between groups, and within ASD subgroups. TD and ASD toddlers exhibited greater mouth- than eye-looking, with TD exhibiting higher levels of mouth-looking than ASD. Mouth-looking was positively associated with expressive language in TD toddlers, and in ASD toddlers who had acquired first words. Mouth-looking was unrelated to expressive language in ASD toddlers who had not yet acquired first words.

Personality in Autism Spectrum Disorder: Associations With Face Memory Deficit and Theory of Mind

OBJECTIVE

To examine the personality profiles of adults with autism spectrum disorder (ASD) using a standard personality assessment and to investigate the association between personality, ASD-related face memory deficit (FMD), and theory of mind (ToM). In a broader context, to examine whether there are distinct clinical phenotypes in the ASD population that have implications for personality development and treatment.

METHOD

Fifty-five adults with ASD and 22 neurotypical (NT) adults underwent a battery of neuropsychological tests, including measures of personality, face memory, and ToM. We compared ASD and NT groups in terms of their Personality Assessment Inventory (PAI) profiles. Additional analyses focused on the association between specific PAI scales and FMD. Performance on the Eyes Test was compared across groups and was examined in relation to FMD.

RESULTS

Adults with ASD demonstrated significant elevations on several PAI scales compared with NT adults. The presence of FMD was associated with differing PAI profiles among the ASD adults. The ASD adults with FMD scored significantly higher on scales that are sensitive to positive impression management and treatment rejection and significantly lower on scales that are sensitive to borderline personality, anxiety, depression, schizophrenia, and stress. There was a significant association between performance on the Eyes Test and FMD in the ASD group.

CONCLUSION

Adults with ASD have a unique personality profile. Further, ASD adults with FMD have reduced insight into their difficulties with emotional processing and may not be as sensitive as ASD adults without FMD to the emotions of others.

Gauging facial feature viewing preference as a stable individual trait in autism spectrum disorder

Eye tracking provides insights into social processing deficits in autism spectrum disorder (ASD), especially in conjunction with dynamic, naturalistic free-viewing stimuli. However, the question remains whether gaze characteristics, such as preference for specific facial features, can be considered a stable individual trait, particularly in those with ASD. If so, how much data are needed for consistent estimations? To address these questions, we assessed the stability and robustness of gaze preference for facial features as incremental amounts of movie data were introduced for analysis. We trained an artificial neural network to create an object-based segmentation of naturalistic movie clips (14 s each, 7410 frames total). Thirty-three high-functioning individuals with ASD and 36 age- and IQ-equated typically developing individuals (age range: 12-30 years) viewed 22 Hollywood movie clips, each depicting a social interaction. As we evaluated combinations of one, three, five, eight, and 11 movie clips, gaze dwell times on core facial features became increasingly stable at within-subject, within-group, and between-group levels. Using a number of movie clips deemed sufficient by our analysis, we found that individuals with ASD displayed significantly less face-centered gaze (centralized on the nose; p < 0.001) but did not significantly differ from typically developing participants in eye or mouth looking times. Our findings validate gaze preference for specific facial features as a stable individual trait and highlight the possibility of misinterpretation with insufficient data. Additionally, we propose the use of a machine learning approach to stimuli segmentation to quickly and flexibly prepare dynamic stimuli for analysis. LAY SUMMARY: Using a data-driven approach to segmenting movie stimuli, we examined varying amounts of data to assess the stability of social gaze in individuals with autism spectrum disorder (ASD). We found a reduction in social fixations in participants with ASD, driven by decreased attention to the center of the face. Our findings further support the validity of gaze preference for face features as a stable individual trait when sufficient data are used.

Investigating Gaze Behaviour of Children Diagnosed with Autism Spectrum Disorders in a Classroom Setting

A defining feature of ASD is atypical gaze behaviour, however, eye-tracking studies in ‘real-world’ settings are limited, and the possibility of improving gaze behaviour for ASD children is largely unexplored. This study investigated gaze behaviour of ASD and typically developing (TD) children in their classroom setting. Eye-tracking technology was used to develop and pilot an operant training tool to positively reinforce typical gaze behaviour towards faces. Visual and statistical analyses of eye-tracking data revealed different gaze behaviour patterns during live interactions for ASD and TD children depending on the interaction type. All children responded to operant training with longer looking times observed on face stimuli post training. The promising application of operant gaze training in ecologically valid settings is discussed.

The Gestures in 2-4-Year-Old Children With Autism Spectrum Disorder

Deficits in gestures act as early signs of impairment in social interaction (SI) and communication in children with autism spectrum disorder (ASD). However, the pieces of literature on atypical gesture patterns in ASD children are contradictory. This investigation aimed to explore the atypical gesture pattern of ASD children from the dimensions of quantity, communicative function, and integration ability; and its relationship with social ability and adaptive behavior. We used a semi-structured interactive play to evaluate gestures of 33 ASD children (24–48 months old) and 24 typically developing (TD) children (12–36 months old). And we evaluated the social ability, adaptive behavior, and productive language of ASD and TD children by using the Adaptive Behavior Assessment System version II (ABAS-II) and Chinese Communication Development Inventory (CCDI). No matter the total score of CCDI was corrected or not, the relative frequency of total gestures, behavior regulation (BR) gestures, SI gestures, and joint attention (JA) gestures of ASD children were lower than that of TD children, as well as the proportion of JA gestures. However, there was no significant group difference in the proportion of BR and SI gestures. Before adjusting for the total score of CCDI, the relative frequency of gestures without vocalization/verbalization integration and vocalization/verbalization-integrated gestures in ASD children was lower than that in TD children. However, after matching the total score of CCDI, only the relative frequency of gestures without vocalization/verbalization integration was lower. Regardless of the fact that the total score of CCDI was corrected or not, the relative frequency and the proportion of eye-gaze-integrated gestures in ASD children were lower than that in TD children. And the proportion of gestures without eye-gaze integration in ASD children was higher than that in TD children. For ASD children, the social skills score in ABAS-II was positively correlated with the relative frequency of SI gesture and eye-gaze-integrated gestures; the total score of ABAS-II was positively correlated with the relative frequency of total gestures and eye-gaze-integrated gestures. In conclusion, ASD children produce fewer gestures and have deficits in JA gestures. The deficiency of integrating eye gaze and gesture is the core deficit of ASD children’s gesture communication. Relatively, ASD children might be capable of integrating vocalization/verbalization into gestures. SI gestures and the ability to integrate gesture and eye gaze are related to social ability. The quantity of gestures and the ability to integrate gesture with eye gaze are related to adaptive behavior.

Clinical Trial Registration:www.ClinicalTrials.gov, identifier ChiCTR1800019679.

Read my lips! Perception of speech in noise by preschool children with autism and the impact of watching the speaker's face

Background

Adults and adolescents with autism spectrum disorders show greater difficulties comprehending speech in the presence of noise. Moreover, while neurotypical adults use visual cues on the mouth to help them understand speech in background noise, differences in attention to human faces in autism may affect use of these visual cues. No work has yet examined these skills in toddlers with ASD, despite the fact that they are frequently faced with noisy, multitalker environments.

Methods

Children aged 2-5 years, both with and without autism spectrum disorder (ASD), saw pairs of images in a preferential looking study and were instructed to look at one of the two objects. Sentences were presented in the presence of quiet or another background talker (noise). On half of the trials, the face of the target person speaking was presented, while half had no face present. Growth-curve modeling was used to examine the time course of children’s looking to the appropriate vs. opposite image.

Results

Noise impaired performance for both children with ASD and their age- and language-matched peers. When there was no face present on the screen, the effect of noise was generally similar across groups with and without ASD. But when the face was present, the noise had a more detrimental effect on children with ASD than their language-matched peers, suggesting neurotypical children were better able to use visual cues on the speaker’s face to aid performance. Moreover, those children with ASD who attended more to the speaker’s face showed better listening performance in the presence of noise.

Conclusions

Young children both with and without ASD show poorer performance comprehending speech in the presence of another talker than in quiet. However, results suggest that neurotypical children may be better able to make use of face cues to partially counteract the effects of noise. Children with ASD varied in their use of face cues, but those children who spent more time attending to the face of the target speaker appeared less disadvantaged by the presence of background noise, indicating a potential path for future interventions.

Social Attention Deficits in Children With Autism Spectrum Disorder: Task Dependence of Objects vs. Faces Observation Bias

Social attention deficits represent a central impairment of patients suffering from autism spectrum disorder (ASD), but the nature of such deficits remains controversial. We compared visual attention regarding social (faces) vs. non-social stimuli (objects), in an ecological diagnostic context, in 46 children and adolescents divided in two groups: ASD (N = 23) and typical neurodevelopment (TD) (N = 23), matched for chronological age and intellectual performance. Eye-tracking measures of visual scanning, while exploring and describing scenes from three different tasks from the Autism Diagnostic Observation Schedule (ADOS), were analyzed: "Description of a Picture," "Cartoons," and "Telling a Story from a Book." Our analyses revealed a three-way interaction between Group, Task, and Social vs. Object Stimuli. We found a striking main effect of group and a task dependence of attentional allocation: while the TD attended first and longer to faces, ASD participants became similar to TD when they were asked to look at pictures while telling a story. Our results suggest that social attention allocation is task dependent, raising the question whether spontaneous attention deficits can be rescued by guiding goal-directed actions.

Measuring sensitivity to eye gaze cues in naturalistic scenes: Presenting the eye gaze FoCuS database

OBJECTIVES

The ability to process information about eye gaze and its use for nonverbal communication is foundational to human social interactions. We developed and validated a database of stimuli that are optimized to investigate the perception and referential understanding of shifts in eye gaze.

METHODS

The 245 Gaze Perception stimuli are digital photographs that test the ability to estimate and interpret eye gaze trajectory. The 82 Gaze Following stimuli are digital videos that measure the ability to follow and interpret eye gaze shifts online. Both stimuli were designed for a 4-alternative forced choice paradigm (4AFC) in which the participant identifies the gazed-at object.

RESULTS

Each stimulus was validated by independent raters and only included if the endorsement of the correct item was ≥75%. Finally, we provided timestamps for 19 40-second video segments from adolescent-oriented entertainment movies that are matched on several factors. These segments involve social interactions with eye gaze shifts and can be used to measure visual social attention.

CONCLUSIONS

This database will be an excellent resource for researchers interested in studying the developmental, behavioral, and/or neural mechanisms supporting the perception and interpretation of eye gaze cues.

Classification of evoked responses to inverted faces reveals both spatial and temporal cortical response abnormalities in Autism spectrum disorder

The neurophysiology of face processing has been studied extensively in the context of social impairments associated with autism spectrum disorder (ASD), but the existing studies have concentrated mainly on univariate analyses of responses to upright faces, and, less frequently, inverted faces. The small number of existing studies on neurophysiological responses to inverted face in ASD have used univariate approaches, with divergent results. Here, we used a data-driven, classification-based, multivariate machine learning decoding approach to investigate the temporal and spatial properties of the neurophysiological evoked response for upright and inverted faces, relative to the neurophysiological evoked response for houses, a neutral stimulus. 21 (2 females) ASD and 29 (4 females) TD participants ages 7 to 19 took part in this study. Group level classification accuracies were obtained for each condition, using first the temporal domain of the evoked responses, and then the spatial distribution of the evoked responses on the cortical surface, each separately. We found that classification of responses to inverted neutral faces vs. houses was less accurate in ASD compared to TD, in both the temporal and spatial domains. In contrast, there were no group differences in the classification of evoked responses to upright neutral faces relative to houses. Using the classification in the temporal domain, lower decoding accuracies in ASD were found around 120 ms and 170 ms, corresponding the known components of the evoked responses to faces. Using the classification in the spatial domain, lower decoding accuracies in ASD were found in the right superior marginal gyrus (SMG), intra-parietal sulcus (IPS) and posterior superior temporal sulcus (pSTS), but not in core face processing areas. Importantly, individual classification accuracies from both the temporal and spatial classifiers correlated with ASD severity, confirming the relevance of the results to the ASD phenotype.

A Pilot Study of Responses to Interparental Conflict in Children with Autism Spectrum Disorder

Research supports that parents of children with ASD experience higher rates of marital conflict compared to parents of neurotypically developing (NT) children; however, no known research examining reactions to interparental conflict in children with ASD exists. This study compared emotional, behavioral, and physiological responses to interparental conflict in ASD (n = 21) and NT children (n = 29). Children were presented with videotaped interactions (constructive vs. destructive conflict) of actors and their reactions were measured. Children with ASD reported higher levels of negative emotions following constructive conflict compared to NT children. Parents of children with ASD rated their child's emotional and behavioral responses to interparental conflict more negatively than parents of NT children. Comparable levels of physiological reactivity were found across both groups.

A map of assistive technology educative instruments in neurodevelopmental disorders

PURPOSE

The use of assistive technology in mental health has gained an increased interest over the last decades. A growing number of studies have investigated diverse applications of technological interventions for rehabilitation of children with neurodevelopmental disorders. This article presents a map of the technological devises applied as therapeutic instruments.

METHODS

The research question of this review was which technological applications could be referred as an educational instrument for the management of children with autism spectrum disorders (ASDs), intellectual disability and attention deficit disorder. The articles included in this review were collected after a structured literature search in electronic databases using keywords such as "Assistive Technology", "technology devices", "robots", "Autism Disorder", "Intellectual Disabilities" and "Mental Retardation".

RESULTS

Assistive technology with the most up-to-date devices and applications helps children with intellectual disability and ASDs enhance cognitive skills and improve challenging behaviour, social communication and academic performance. Different technological tools are used to foster attention span and improve time management skills in children with attention deficit syndrome.

CONCLUSION

It is important that therapists choose the instrument that will offer the best approach towards the goal that is set. Future research could provide evidence based data, evaluating each specific methodology and tailoring each therapeutic approach specifically to a case.IMPLICATIONS FOR REHABILITATIONTechnology creates environments in which children could practice and learn in a safer, more predictable and pleasant manner.Assistive Technologies provide the opportunity for better acquisition of selfhelp skills and the power of social interaction for individuals with disabilities.By mapping out the wide array of Assistive Technology that is available today, future applications for rehabilitation of children with neurodevelopmental disorders could help extend therapeutic strategies out of the clinical and school settings and into the home, thereby incorporating the family and emphasizing personalization.Future studies could develop a model for the choice and use of each tool, tailoring each therapeutic approach specifically to each case.

Social attention to activities in children and adults with autism spectrum disorder: effects of context and age

Background

Diminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator (“biomarker”) of ASD. We investigated differences in visual attention during activity monitoring in children and adult participants with autism compared to a control group of participants without autism.

Methods

Eye movements of participants with autism (n = 122; mean age [SD] = 14.5 [8.0] years) and typically developing (TD) controls (n = 40, age = 16.4 [13.3] years) were recorded while they viewed a series of videos depicting two female actors conversing while interacting with their hands over a shared task. Actors either continuously focused their gaze on each other’s face (mutual gaze) or on the shared activity area (shared focus). Mean percentage looking time was computed for the activity area, actors’ heads, and their bodies.

Results

Compared to TD participants, participants with ASD looked longer at the activity area (mean % looking time: 58.5% vs. 53.8%, p < 0.005) but less at the heads (15.2% vs. 23.7%, p < 0.0001). Additionally, within-group differences in looking time were observed between the mutual gaze and shared focus conditions in both participants without ASD (activity: Δ = − 6.4%, p < 0.004; heads: Δ = + 3.5%, p < 0.02) and participants with ASD (bodies: Δ = + 1.6%, p < 0.002).

Limitations

The TD participants were not as well characterized as the participants with ASD. Inclusion criteria regarding the cognitive ability [intelligence quotient (IQ) > 60] limited the ability to include individuals with substantial intellectual disability.

Conclusions

Differences in attention to faces could constitute a feature discriminative between individuals with and without ASD across the lifespan, whereas between-group differences in looking at activities may shift with development. These findings may have applications in the search for underlying biological indicators specific to ASD.

Trial registration ClinicalTrials.gov identifier NCT02668991.

Social orienting and social seeking behaviors in ASD. A meta analytic investigation

Social motivation accounts of autism spectrum disorder (ASD) posit that individuals with ASD find social stimuli less rewarding than neurotypical (NT) individuals. Behaviorally, this is proposed to manifest in reduced social orienting (individuals with ASD direct less attention towards social stimuli) and reduced social seeking (individuals with ASD invest less effort to receive social stimuli). In two meta-analyses, involving data from over 6000 participants, we review the available behavioral studies that assess social orienting and social seeking behaviors in ASD. We found robust evidence for reduced social orienting in ASD, across a range of paradigms, demographic variables and stimulus contexts. The most robust predictor of this effect was interactive content - effects were larger when the stimulus involved an interaction between people. By contrast, the evidence for reduced social seeking indicated weaker evidence for group differences, observed only under specific experimental conditions. The insights gained from this meta-analysis can inform design of relevant task measures for social reward responsivity and promote directions for further study on the ASD phenotype.

The role of early social motivation in explaining variability in functional language in toddlers with autism spectrum disorder

LAY ABSTRACT

About one-third of children with autism spectrum disorder never develop the language that they need in different day-to-day situations. Identifying potential factors that can predict later language development is crucial to understanding why some children with autism spectrum disorder successfully develop language while others do not. This study sought to investigate one of the understudied predictors of language development, social motivation, and to test theories for why this association may occur. Testing the theories requires that we measure children's ability to deliberately and directly communicate with others (i.e. intentional communication) and children's language understanding between the measures of social motivation and later expressive language. We tested 87 children with autism spectrum disorder, aged 14-31 months, at four times over 24 months. We found that children with relatively stronger social motivation had relatively better language use 2 years later. This positive link was partly due to a child's ability to produce intentional communication and to understand language. Although we did not measure parents' talking to their children, a theory that inspired this study suggests that children who use frequent intentional communication probably motivate others to talk with them frequently, which facilitates children's language understanding which leads to the development of expressive language. This theory, if confirmed to be true, can provide guidance for parents who want to help their children learn to talk. Parents could look for intentional communication from their children and respond by talking to their children. Effective intervention on both parent and child targets will likely enhance treatment efficacy. Future work is needed to test these ideas.

Deep Neural Network Reveals the World of Autism From a First-Person Perspective

People with autism spectrum disorder (ASD) show atypical attention to social stimuli and aberrant gaze when viewing images of the physical world. However, it is unknown how they perceive the world from a first-person perspective. In this study, we used machine learning to classify photos taken in three different categories (people, indoors, and outdoors) as either having been taken by individuals with ASD or by peers without ASD. Our classifier effectively discriminated photos from all three categories, but was particularly successful at classifying photos of people with >80% accuracy. Importantly, visualization of our model revealed critical features that led to successful discrimination and showed that our model adopted a strategy similar to that of ASD experts. Furthermore, for the first time we showed that photos taken by individuals with ASD contained less salient objects, especially in the central visual field. Notably, our model outperformed classification of these photos by ASD experts. Together, we demonstrate an effective and novel method that is capable of discerning photos taken by individuals with ASD and revealing aberrant visual attention in ASD from a unique first-person perspective. Our method may in turn provide an objective measure for evaluations of individuals with ASD. LAY SUMMARY: People with autism spectrum disorder (ASD) demonstrate atypical visual attention to social stimuli. However, it remains largely unclear how they perceive the world from a first-person perspective. In this study, we employed a deep learning approach to analyze a unique dataset of photos taken by people with and without ASD. Our computer modeling was not only able to discern which photos were taken by individuals with ASD, outperforming ASD experts, but importantly, it revealed critical features that led to successful discrimination, revealing aspects of atypical visual attention in ASD from their first-person perspective.

Data-Driven Diagnostics and the Potential of Mobile Artificial Intelligence for Digital Therapeutic Phenotyping in Computational Psychiatry

Data science and digital technologies have the potential to transform diagnostic classification. Digital technologies enable the collection of big data, and advances in machine learning and artificial intelligence enable scalable, rapid, and automated classification of medical conditions. In this review, we summarize and categorize various data-driven methods for diagnostic classification. In particular, we focus on autism as an example of a challenging disorder due to its highly heterogeneous nature. We begin by describing the frontier of data science methods for the neuropsychiatry of autism. We discuss early signs of autism as defined by existing pen-and-paper-based diagnostic instruments and describe data-driven feature selection techniques for determining the behaviors that are most salient for distinguishing children with autism from neurologically typical children. We then describe data-driven detection techniques, particularly computer vision and eye tracking, that provide a means of quantifying behavioral differences between cases and controls. We also describe methods of preserving the privacy of collected videos and prior efforts of incorporating humans in the diagnostic loop. Finally, we summarize existing digital therapeutic interventions that allow for data capture and longitudinal outcome tracking as the diagnosis moves along a positive trajectory. Digital phenotyping of autism is paving the way for quantitative psychiatry more broadly and will set the stage for more scalable, accessible, and precise diagnostic techniques in the field.

Do Animals Engage Greater Social Attention in Autism? An Eye Tracking Analysis

BACKGROUND

Visual atypicalities in autism spectrum disorder (ASD) are a well documented phenomenon, beginning as early as 2-6 months of age and manifesting in a significantly decreased attention to the eyes, direct gaze and socially salient information. Early emerging neurobiological deficits in perceiving social stimuli as rewarding or its active avoidance due to the anxiety it entails have been widely purported as potential reasons for this atypicality. Parallel research evidence also points to the significant benefits of animal presence for reducing social anxiety and enhancing social interaction in children with autism. While atypicality in social attention in ASD has been widely substantiated, whether this atypicality persists equally across species types or is confined to humans has not been a key focus of research insofar.

METHODS

We attempted a comprehensive examination of the differences in visual attention to static images of human and animal faces (40 images; 20 human faces and 20 animal faces) among children with ASD using an eye tracking paradigm. 44 children (ASD n = 21; TD n = 23) participated in the study (10,362 valid observations) across five regions of interest (left eye, right eye, eye region, face and screen).

RESULTS

Results obtained revealed significantly greater social attention across human and animal stimuli in typical controls when compared to children with ASD. However in children with ASD, a significantly greater attention allocation was seen to animal faces and eye region and lesser attention to the animal mouth when compared to human faces, indicative of a clear attentional preference to socially salient regions of animal stimuli. The positive attentional bias toward animals was also seen in terms of a significantly greater visual attention to direct gaze in animal images.

CONCLUSION

Our results suggest the possibility that atypicalities in social attention in ASD may not be uniform across species. It adds to the current neural and biomarker evidence base of the potentially greater social reward processing and lesser social anxiety underlying animal stimuli as compared to human stimuli in children with ASD.

Social attention: What is it, how can we measure it, and what can it tell us about autism and ADHD?

Neurodevelopmental disorders like autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) affect 2-10% of children worldwide but are still poorly understood. Prospective studies of infants with an elevated familial likelihood of ASD or ADHD can provide insight into early mechanisms that canalize development down a typical or atypical course. Such work holds potential for earlier identification and intervention to support optimal outcomes in individuals with neurodevelopmental disorders. Disrupted attention may be involved in developmental trajectories to ASD and ADHD. Specifically, altered attention to social stimuli has been suggested as a possible endophenotype of ASD, lying between genetic factors impacting brain development and later symptoms. Similarly, changes in domain-general aspects of attention are commonly seen in ADHD and emerging evidence suggests these may begin in infancy. Could these patterns point to a common risk factor for both disorders? Or does social attention reflect the activity of a particular network of brain systems that is distinct to those underpinning general attention skills? One challenge to addressing such questions is our lack of understanding of the relation between social and general attention. In this chapter we review evidence from infants with later ASD and ADHD that illuminates this question.

Blink Rate Patterns Provide a Reliable Measure of Individual Engagement with Scene Content

Eye-blinking has emerged as a promising means of measuring viewer engagement with visual content. This method capitalizes on the fact that although we remain largely unaware of our eye-blinking in everyday situations, eye-blinks are inhibited at precise moments in time so as to minimize the loss of visual information that occurs during a blink. Probabilistically, the more important the visual information is to the viewer, the more likely he or she will be to inhibit blinking. In the present study, viewer engagement was experimentally manipulated in order to: (1) replicate past studies suggesting that a group of viewers will blink less often when watching content that they perceive as more important or relevant; (2) test the reliability of the measure by investigating constraints on the timescale over which blink rate patterns can be used to accurately quantify viewer engagement; and (3) examine whether blink rate patterns can be used to quantify what an individual - as opposed to a group of viewers-perceives as engaging. Results demonstrate that blink rate patterns can be used to measure changes in individual and group engagement that unfold over relatively short (1 second) and long (60 second) timescales. However, for individuals with lower blink rates, blink rate patterns may provide less optimal measures when engagement shifts rapidly (at intervals of 1 second or less). Findings support the use of eye-blink measures in future studies investigating a person's subjective perception of how engaging a stimulus is.

Developmental changes in attention to social information from childhood to adolescence in autism spectrum disorders: a comparative study

BACKGROUND

Elucidating developmental changes in the symptoms of autism spectrum disorder (ASD) is important to support individuals with ASD. However, no report has clarified the developmental changes in attention to social information for a broad age range. The aim of this study was to investigate the developmental changes in attention to social information from early childhood to adolescence in individuals with ASD and typically developed (TD) children.

METHODS

We recruited children with ASD (n = 83) and TD participants (n = 307) between 2 and 18 years of age. Using the all-in-one-eye-tracking system, Gazefinder, we measured the percentage fixation time allocated to areas of interest (AoIs) depicted in movies (the eyes and mouth in movies of a human face with/without mouth motion, upright and inverted biological motion in movies showing these stimuli simultaneously, people and geometry in preference paradigm movies showing these stimuli simultaneously, and objects with/without finger-pointing in a movie showing a woman pointing toward an object). We conducted a three-way analysis of variance, 2 (diagnosis: ASD and TD) by 2 (sex: male and female) by 3 (age group: 0-5, 6-11, and 12-18 years) and locally weighted the scatterplot smoothing (LOESS) regression curve on each AoI.

RESULTS

In the face stimuli, the percentage fixation time to the eye region for the TD group increased with age, whereas the one for the ASD group did not. In the ASD group, the LOESS curves of the gaze ratios at the eye region increased up to approximately 10 years of age and thereafter tended to decrease. For the percentage fixation time to the people region in the preference paradigm, the ASD group gazed more briefly at people than did the TD group.

LIMITATIONS

It is possible that due to the cross-sectional design, the degree of severity and of social interest might have differed according to the subjects' age.

CONCLUSIONS

There may be qualitative differences in abnormal eye contact in ASD between individuals in early childhood and those older than 10 years.

Atypical Social Attention and Emotional Face Processing in Autism Spectrum Disorder: Insights From Face Scanning and Pupillometry

Social attention deficits are a hallmark characteristic within autism spectrum disorder (ASD) and have been hypothesized to have cascading effects on emotion recognition. Eye-tracking methodology has emerged as a potentially reliable, feasible, and sensitive biomarker for examining core phenotypic features of ASD; however, these findings are mixed with regards to measuring treatment change in clinical trials. The present study aimed to assess the utility of an eye-tracking paradigm to discriminate between clinical groups in social attention and emotion recognition through face scanning and pupillometry. The present study also assessed the reliability of this paradigm within the ASD sample to further our understanding of the utility of eye-tracking for future clinical trials. Participants included 42 individuals with ASD, 29 developmental disability (DD) controls, and 62 typically developing (TD) controls between 3 and 25 years of age. An emotional faces eye-tracking paradigm was administered to all participants, with the ASD group completing the paradigm a second time approximately 2 months later. Participants' average proportion of looking and number of fixations to specific areas of interest (AOI) were examined along with changes in pupil reactivity while viewing different emotional faces. Results suggest atypical face-scanning through a reduced proportion of looking and the number of fixations toward the eyes in the ASD group regardless of the emotion that was presented. Further, pupillometry measures were able to detect increases in pupil dilation to happy faces in the ASD group. Lastly, test-retest reliability coefficients varied between the poor and excellent range based on the mechanism assessed, with the proportion of looking demonstrating the highest reliability coefficients. These findings build on the promise of eye-tracking as a feasible and reliable biomarker for identifying social attention and emotion recognition deficits in ASD. Detecting differences in emotion recognition explicitly through facial scanning was not as clear. Specific mechanisms within the eye-tracking paradigm may be viable options for assessing treatment-specific outcomes.

Biomarker Acquisition and Quality Control for Multi-Site Studies: The Autism Biomarkers Consortium for Clinical Trials

The objective of the Autism Biomarkers Consortium for Clinical Trials (ABC-CT) is to evaluate a set of lab-based behavioral video tracking (VT), electroencephalography (EEG), and eye tracking (ET) measures for use in clinical trials with children with autism spectrum disorder (ASD). Within the larger organizational structure of the ABC-CT, the Data Acquisition and Analytic Core (DAAC) oversees the standardization of VT, EEG, and ET data acquisition, data processing, and data analysis. This includes designing and documenting data acquisition and analytic protocols and manuals; facilitating site training in acquisition; data acquisition quality control (QC); derivation and validation of dependent variables (DVs); and analytic deliverables including preparation of data for submission to the National Database for Autism Research (NDAR). To oversee consistent application of scientific standards and methodological rigor for data acquisition, processing, and analytics, we developed standard operating procedures that reflect the logistical needs of multi-site research, and the need for well-articulated, transparent processes that can be implemented in future clinical trials. This report details the methodology of the ABC-CT related to acquisition and QC in our Feasibility and Main Study phases. Based on our acquisition metrics from a preplanned interim analysis, we report high levels of acquisition success utilizing VT, EEG, and ET experiments in a relatively large sample of children with ASD and typical development (TD), with data acquired across multiple sites and use of a manualized training and acquisition protocol.

Comorbidity Matters: Social Visual Attention in a Comparative Study of Autism Spectrum Disorder, Attention-Deficit/Hyperactivity Disorder and Their Comorbidity

Autism Spectrum Disorder (ASD) and Attention-Deficit/Hyperactivity Disorder (ADHD) represent two common neurodevelopmental disorders with considerable co-occurrence. Their comorbidity (ASD + ADHD) has been included in the latest diagnostic guidelines (DSM-V, 2013). The present study focuses on social visual attention that i) is a main aspect of social attention reflecting social cognition and ii) its atypicalities have been suggested as a potential biomarker for ASD. Considering the possible shared background of both disorders and their comorbidity, it is important to compare such traits directly. Here, 73 children and adolescents paired for age and IQ diagnosed with ASD (N = 12), ADHD (N = 21), comorbid ASD + ADHD (N = 15), and "typically developing" (TD) controls (N = 25), were shown static real-life social scenes while their gaze movements were recorded with eye-tracking. Scenes with two levels of social complexity were presented: low complexity (one person depicted) and high (four interacting individuals). Gaze fixation variables were investigated. Fixation duration on faces was significantly reduced only in ASD + ADHD which also required longer time to fixate all faces at least once. Fixation duration on faces in ASD was reduced, compared to TD, only when looking at scenes with high versus low social complexity. ADHD individuals did not differ from TD. Concluding, the observed alterations of social visual attention support the existence of possible dysfunctional particularities differentiating ASD, ADHD, and ASD + ADHD, which can be revealed with the new method of eye-tracking technique. The objective gaze measurements provided contribute to the development of biomarkers enabling early diagnosis, amelioration of care and further interventions specified for each group.