Computer-aided autism diagnosis based on visual attention models using eye tracking

Quantifying attention in children with intellectual and developmental disabilities through multicenter electrooculogram signal analysis

In a multicenter case-control investigation, we assessed the efficacy of the Electrooculogram Signal Analysis (EOG-SA) method, which integrates attention-related visual evocation, electrooculography, and nonlinear analysis, for distinguishing between intellectual and developmental disabilities (IDD) and typical development (TD) in children. Analyzing 127 participants (63 IDD, 64 TD), we applied nonlinear dynamics for feature extraction. Results indicated EOG-SA's capability to distinguish IDD, with higher template thresholds and Correlation Dimension values correlating with clinical severity. The template threshold proved a robust indicator, with higher values denoting severe IDD. Discriminative metrics showed areas under the curve of 0.91 (template threshold) and 0.85/0.91 (D2), with sensitivities and specificities of 77.6%/95.9% and 93.5%/71.0%, respectively. EOG-SA emerges as a promising tool, offering interpretable neural biomarkers for early and nuanced diagnosis of IDD.

Using visual attention estimation on videos for automated prediction of autism spectrum disorder and symptom severity in preschool children

Atypical visual attention in individuals with autism spectrum disorders (ASD) has been utilised as a unique diagnosis criterion in previous research. This paper presents a novel approach to the automatic and quantitative screening of ASD as well as symptom severity prediction in preschool children. We develop a novel computational pipeline that extracts learned features from a dynamic visual stimulus to classify ASD children and predict the level of ASD-related symptoms. Experimental results demonstrate promising performance that is superior to using handcrafted features and machine learning algorithms, in terms of evaluation metrics used in diagnostic tests. Using a leave-one-out cross-validation approach, we obtained an accuracy of 94.59%, a sensitivity of 100%, a specificity of 76.47% and an area under the receiver operating characteristic curve (AUC) of 96% for ASD classification. In addition, we obtained an accuracy of 94.74%, a sensitivity of 87.50%, a specificity of 100% and an AUC of 99% for ASD symptom severity prediction.

Modified Meta Heuristic BAT with ML Classifiers for Detection of Autism Spectrum Disorder

ASD (autism spectrum disorder) is a complex developmental and neurological disorder that impacts the social life of the affected person by disturbing their capability for interaction and communication. As it is a behavioural disorder, early treatment will improve the quality of life of ASD patients. Traditional screening is carried out with behavioural assessment through trained physicians, which is expensive and time-consuming. To resolve the issue, several conventional methods strive to achieve an effective ASD identification system, but are limited by handling large data sets, accuracy, and speed. Therefore, the proposed identification system employed the MBA (modified bat) algorithm based on ANN (artificial neural networks), modified ANN (modified artificial neural networks), DT (decision tree), and KNN (k-nearest neighbours) for the classification of ASD in children and adolescents. A BA (bat algorithm) is utilised for the automatic zooming capability, which improves the system's efficacy by excellently finding the solutions in the identification system. Conversely, BA is effective in the identification, it still has certain drawbacks like speed, accuracy, and falls into local extremum. Therefore, the proposed identification system modifies the BA optimisation with random perturbation of trends and optimal orientation. The dataset utilised in the respective model is the Q-chat-10 dataset. This dataset contains data of four stages of age groups such as toddlers, children, adolescents, and adults. To analyse the quality of the dataset, dataset evaluation mechanism, such as the Chi-Squared Statistic and p-value, are used in the respective research. The evaluation signifies the relation of the dataset with respect to the proposed model. Further, the performance of the proposed detection system is examined with certain performance metrics to calculate its efficiency. The outcome revealed that the modified ANN classifier model attained an accuracy of 1.00, ensuring improved performance when compared with other state-of-the-art methods. Thus, the proposed model was intended to assist physicians and researchers in enhancing the diagnosis of ASD to improve the standard of life of ASD patients.

Computer-aided autism diagnosis using visual attention models and eye-tracking: replication and improvement proposal

BACKGROUND

Autism Spectrum Disorder (ASD) diagnosis can be aided by approaches based on eye-tracking signals. Recently, the feasibility of building Visual Attention Models (VAMs) from features extracted from visual stimuli and their use for classifying cases and controls has been demonstrated using Neural Networks and Support Vector Machines. The present work has three aims: 1) to evaluate whether the trained classifier from the previous study was generalist enough to classify new samples with a new stimulus; 2) to replicate the previously approach to train a new classifier with a new dataset; 3) to evaluate the performance of classifiers obtained by a new classification algorithm (Random Forest) using the previous and the current datasets.

METHODS

The previously approach was replicated with a new stimulus and new sample, 44 from the Typical Development group and 33 from the ASD group. After the replication, Random Forest classifier was tested to substitute Neural Networks algorithm.

RESULTS

The test with the trained classifier reached an AUC of 0.56, suggesting that the trained classifier requires retraining of the VAMs when changing the stimulus. The replication results reached an AUC of 0.71, indicating the potential of generalization of the approach for aiding ASD diagnosis, as long as the stimulus is similar to the originally proposed. The results achieved with Random Forest were superior to those achieved with the original approach, with an average AUC of 0.95 for the previous dataset and 0.74 for the new dataset.

CONCLUSION

In summary, the results of the replication experiment were satisfactory, which suggests the robustness of the approach and the VAM-based approaches feasibility to aid in ASD diagnosis. The proposed method change improved the classification performance. Some limitations are discussed and additional studies are encouraged to test other conditions and scenarios.

Pediatricians' focus of sight at pain assessment during a neonatal heel puncture

OBJECTIVE

To evaluate the focus of pediatricians' gaze during the heel prick of neonates.

METHODS

Prospective study in which pediatricians wearing eye tracker glasses evaluated neonatal pain before/after a heel prtick. Pediatricians scored the pain they perceived in the neonate in a verbal analogue numerical scale (0=no pain; 10=maximum pain). The outcomes measured were number and time of visual fixations in upper face, lower face, and hands, in two 10-second periods, before (pre) and after the puncture (post). These outcomes were compared between the periods, and according to pediatricians' pain perception: absent/mild (score: 0-5) and moderate/intense (score: 6-10).

RESULTS

24 pediatricians (31 years old, 92% female) evaluated 24 neonates. The median score attributed to neonatal pain during the heel prick was 7.0 (Interquartile range: 5-8). Compared to pre-, in the post-periods, more pediatricians fixed their gaze on the lower face (63 vs. 92%; p=0.036) and the number of visual fixations was greater on the lower face (2.0 vs. 5.0; p=0.018). There was no difference in the number and time of visual fixations according to the intensity of pain.

CONCLUSIONS

At bedside, pediatricians change their focus of attention on the neonatal face after a painful procedure, focusing mainly on the lower part of the face.

A Review of and Roadmap for Data Science and Machine Learning for the Neuropsychiatric Phenotype of Autism

Autism spectrum disorder (autism) is a neurodevelopmental delay that affects at least 1 in 44 children. Like many neurological disorder phenotypes, the diagnostic features are observable, can be tracked over time, and can be managed or even eliminated through proper therapy and treatments. However, there are major bottlenecks in the diagnostic, therapeutic, and longitudinal tracking pipelines for autism and related neurodevelopmental delays, creating an opportunity for novel data science solutions to augment and transform existing workflows and provide increased access to services for affected families. Several efforts previously conducted by a multitude of research labs have spawned great progress toward improved digital diagnostics and digital therapies for children with autism. We review the literature on digital health methods for autism behavior quantification and beneficial therapies using data science. We describe both case-control studies and classification systems for digital phenotyping. We then discuss digital diagnostics and therapeutics that integrate machine learning models of autism-related behaviors, including the factors that must be addressed for translational use. Finally, we describe ongoing challenges and potential opportunities for the field of autism data science. Given the heterogeneous nature of autism and the complexities of the relevant behaviors, this review contains insights that are relevant to neurological behavior analysis and digital psychiatry more broadly.

Global trends and hotspots in the digital therapeutics of autism spectrum disorders: a bibliometric analysis from 2002 to 2022

Introduction

Autism spectrum disorder (ASD) is a severe neurodevelopmental disorder that has become a major cause of disability in children. Digital therapeutics (DTx) delivers evidence-based therapeutic interventions to patients that are driven by software to prevent, manage, or treat a medical disorder or disease. This study objectively analyzed the current research status of global DTx in ASD from 2002 to 2022, aiming to explore the current global research status and trends in the field.

Methods

The Web of Science database was searched for articles about DTx in ASD from January 2002 to October 2022. CiteSpace was used to analyze the co-occurrence of keywords in literature, partnerships between authors, institutions, and countries, the sudden occurrence of keywords, clustering of keywords over time, and analysis of references, cited authors, and cited journals.

Results

A total of 509 articles were included. The most productive country and institution were the United States and Vanderbilt University. The largest contributing authors were Warren, Zachary, and Sarkar, Nilanjan. The most-cited journal was the Journal of Autism and Developmental Disorders. The most-cited and co-cited articles were Brian Scarselati (Robots for Use in Autism Research, 2012) and Ralph Adolphs (Abnormal processing of social information from faces in autism, 2001). "Artificial Intelligence," "machine learning," "Virtual Reality," and "eye tracking" were common new and cutting-edge trends in research on DTx in ASD.

Discussion

The use of DTx in ASD is developing rapidly and gaining the attention of researchers worldwide. The publications in this field have increased year by year, mainly concentrated in the developed countries, especially in the United States. Both Vanderbilt University and Yale University are very important institutions in the field. The researcher from Vanderbilt University, Warren and Zachary, his dynamics or achievements in the field is also more worth our attention. The application of new technologies such as virtual reality, machine learning, and eye-tracking in this field has driven the development of DTx on ASD and is currently a popular research topic. More cross-regional and cross-disciplinary collaborations are recommended to advance the development and availability of DTx.

Rendimiento de los estímulos visuales en el diagnóstico del TEA por Eye Tracking: Revisión Sistemática

El eye-tracking es una herramienta diagnóstica que tiene como   fin el estudio del comportamiento de la mirada a través del escaneo de ojos para observar el seguimiento ocular, cómo se distribuye la mirada y la precisión de los movimientos oculares. Este sistema se ha utilizado con niños/as del Trastorno del Espectro Autista. El objetivo de esta revisión sistemática ha sido analizar el rendimiento de los estímulos visuales en el diagnóstico del TEA por método eye tracking. Para ello, se siguió la metodología PRISMA, realizando una búsqueda en las bases de datos PubMed, Science Direct y Scopus, así como, Reseach Gate. Se seleccionaron 22 artículos que cumplían los criterios de inclusión con experimentos unifactoriales, experimentales factoriales y cuasiexperimentales. Todos los experimentos han tenido un grupo control compuesto de muestra con participantes con desarrollo normotípico y de un grupo de caso compuesto de muestra con participantes TEA. Esta revisión sintetiza en tres categorías en base a las características del estímulo usado en el diagnóstico (estímulos sociales, no sociales y por confrontación), el análisis del rendimiento de los estímulos visuales, de manera que los estímulos sociales y los estímulos por confrontación van a ser eficaces para establecer un diagnóstico preciso de TEA puesto que permiten realizar un cribado de ambos grupos y establecer un riesgo temprano del trastorno.

Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review

In recent years, there has been a great interest in utilizing technology in mental health research. The rapid technological development has encouraged researchers to apply technology as a part of a diagnostic process or treatment of Neurodevelopmental Disorders (NDDs). With the large number of studies being published comes an urgent need to inform clinicians and researchers about the latest advances in this field. Here, we methodically explore and summarize findings from studies published between August 2019 and February 2022. A search strategy led to the identification of 4108 records from PubMed and APA PsycInfo databases. 221 quantitative studies were included, covering a wide range of technologies used for diagnosis and/or treatment of NDDs, with the biggest focus on Autism Spectrum Disorder (ASD). The most popular technologies included machine learning, functional magnetic resonance imaging, electroencephalogram, magnetic resonance imaging, and neurofeedback. The results of the review indicate that technology-based diagnosis and intervention for NDD population is promising. However, given a high risk of bias of many studies, more high-quality research is needed.

Investigation of Eye-Tracking Scan Path as a Biomarker for Autism Screening Using Machine Learning Algorithms

Autism spectrum disorder is a group of disorders marked by difficulties with social skills, repetitive activities, speech, and nonverbal communication. Deficits in paying attention to, and processing, social stimuli are common for children with autism spectrum disorders. It is uncertain whether eye-tracking technologies can assist in establishing an early biomarker of autism based on the children's atypical visual preference patterns. In this study, we used machine learning methods to test the applicability of eye-tracking data in children to aid in the early screening of autism. We looked into the effectiveness of various machine learning techniques to discover the best model for predicting autism using visualized eye-tracking scan path images. We adopted three traditional machine learning models and a deep neural network classifier to run experimental trials. This study employed a publicly available dataset of 547 graphical eye-tracking scan paths from 328 typically developing and 219 autistic children. We used image augmentation to populate the dataset to prevent the model from overfitting. The deep neural network model outperformed typical machine learning approaches on the populated dataset, with 97% AUC, 93.28% sensitivity, 91.38% specificity, 94.46% NPV, and 90.06% PPV (fivefold cross-validated). The findings strongly suggest that eye-tracking data help clinicians for a quick and reliable autism screening.

Eye Tracking-Based Diagnosis and Early Detection of Autism Spectrum Disorder Using Machine Learning and Deep Learning Techniques

Eye tracking is a useful technique for detecting autism spectrum disorder (ASD). One of the most important aspects of good learning is the ability to have atypical visual attention. The eye-tracking technique provides useful information about children’s visual behaviour for early and accurate diagnosis. It works by scanning the paths of the eyes to extract a sequence of eye projection points on the image to analyse the behaviour of children with autism. In this study, three artificial-intelligence techniques were developed, namely, machine learning, deep learning, and a hybrid technique between them, for early diagnosis of autism. The first technique, neural networks [feedforward neural networks (FFNNs) and artificial neural networks (ANNs)], is based on feature classification extracted by a hybrid method between local binary pattern (LBP) and grey level co-occurrence matrix (GLCM) algorithms. This technique achieved a high accuracy of 99.8% for FFNNs and ANNs. The second technique used a pre-trained convolutional neural network (CNN) model, such as GoogleNet and ResNet-18, on the basis of deep feature map extraction. The GoogleNet and ResNet-18 models achieved high performances of 93.6% and 97.6%, respectively. The third technique used the hybrid method between deep learning (GoogleNet and ResNet-18) and machine learning (SVM), called GoogleNet + SVM and ResNet-18 + SVM. This technique depends on two blocks. The first block used CNN to extract deep feature maps, whilst the second block used SVM to classify the features extracted from the first block. This technique proved its high diagnostic ability, achieving accuracies of 95.5% and 94.5% for GoogleNet + SVM and ResNet-18 + SVM, respectively.

Zebrafish Modeling of Autism Spectrum Disorders, Current Status and Future Prospective

Autism spectrum disorder (ASD) refers to a complicated range of childhood neurodevelopmental disorders which can occur via genetic or non-genetic factors. Clinically, ASD is associated with problems in relationships, social interactions, and behaviors that pose many challenges for children with ASD and their families. Due to the complexity, heterogeneity, and association of symptoms with some neuropsychiatric disorders such as ADHD, anxiety, and sleep disorders, clinical trials have not yielded reliable results and there still remain challenges in drug discovery and development pipeline for ASD patients. One of the main steps in promoting lead compounds to the suitable drug for commercialization is preclinical animal testing, in which the efficacy and toxicity of candidate drugs are examined in vivo. In recent years, zebrafish have been able to attract the attention of many researchers in the field of neurological disorders such as ASD due to their outstanding features. The presence of orthologous genes for ASD modeling, the anatomical similarities of parts of the brain, and similar neurotransmitter systems between zebrafish and humans are some of the main reasons why scientists draw attention to zebrafish as a prominent animal model in preclinical studies to discover highly effective treatment approaches for the ASD through genetic and non-genetic modeling methods.

A bibliometric analysis of research trends of artificial intelligence in the treatment of autistic spectrum disorders

OBJECTIVE

Autism Spectrum Disorder (ASD) is a serious neurodevelopmental disorder that has become the leading cause of disability in children. Artificial intelligence (AI) is a potential solution to this issue. This study objectively analyzes the global research situation of AI in the treatment of ASD from 1995 to 2022, aiming to explore the global research status and frontier trends in this field.

METHODS

Web of Science (WoS) and PubMed databese were searched for Literature related to AI on ASD from 1995 to April 2022. CiteSpace, VOSviewer, Pajek and Scimago Graphica were used to analyze the collaboration between countries/institutions/authors, clusters and bursts of keywords, as well as analyses on references.

RESULTS

A total of 448 literature were included, the total number of literature has shown an increasing trend. The most productive country and institution were the USA, and Vanderbilt University. The authors with the greatest contributions were Warren, Zachary, Sakar, Nilanjan and Swanson, Amy. the most prolific and cited journal is Journal of Autism and Developmental Disorders, the highest cited and co-cited articles were Dautenhahn (Socially intelligent robots: dimensions of human-robot interaction 2007) and Scassellati B (Robots for Use in Autism Research 2012). "Artificial Intelligence", "Brain Computer Interface" and "Humanoid Robot" were the hotspots and frontier trends of AI on ASD.

CONCLUSION

The application of AI in the treatment of ASD has attracted the attention of researchers all over the world. The education, social function and joint attention of children with ASD are the most concerned issues for global researchers. Robots shows gratifying advantages in these issues and have become the most commonly used technology. Wearable devices and brain-computer interface (BCI) were emerging AI technologies in recent years, which is the direction of further exploration. Restoring social function in individuals with ASD is the ultimate aim and driving force of research in the future.

Combining Implicit and Explicit Feature Extraction for Eye Tracking: Attention Classification Using a Heterogeneous Input

Statistical measurements of eye movement-specific properties, such as fixations, saccades, blinks, or pupil dilation, are frequently utilized as input features for machine learning algorithms applied to eye tracking recordings. These characteristics are intended to be interpretable aspects of eye gazing behavior. However, prior research has demonstrated that when trained on implicit representations of raw eye tracking data, neural networks outperform these traditional techniques. To leverage the strengths and information of both feature sets, we integrated implicit and explicit eye tracking features in one classification approach in this work. A neural network was adapted to process the heterogeneous input and predict the internally and externally directed attention of 154 participants. We compared the accuracies reached by the implicit and combined features for different window lengths and evaluated the approaches in terms of person- and task-independence. The results indicate that combining implicit and explicit feature extraction techniques for eye tracking data improves classification results for attentional state detection significantly. The attentional state was correctly classified during new tasks with an accuracy better than chance, and person-independent classification even outperformed person-dependently trained classifiers for some settings. For future experiments and applications that require eye tracking data classification, we suggest to consider implicit data representation in addition to interpretable explicit features.

Application of Eye Tracking Technology in Medicine: A Bibliometric Analysis

Eye tracking provides a quantitative measure of eye movements during different activities. We report the results from a bibliometric analysis to investigate trends in eye tracking research applied to the study of different medical conditions. We conducted a search on the Web of Science Core Collection (WoS) database and analyzed the dataset of 2456 retrieved articles using VOSviewer and the Bibliometrix R package. The most represented area was psychiatry (503, 20.5%) followed by neuroscience (465, 18.9%) and psychology developmental (337, 13.7%). The annual scientific production growth was 11.14% and showed exponential growth with three main peaks in 2011, 2015 and 2017. Extensive collaboration networks were identified between the three countries with the highest scientific production, the USA (35.3%), the UK (9.5%) and Germany (7.3%). Based on term co-occurrence maps and analyses of sources of articles, we identified autism spectrum disorders as the most investigated condition and conducted specific analyses on 638 articles related to this topic which showed an annual scientific production growth of 16.52%. The majority of studies focused on autism used eye tracking to investigate gaze patterns with regards to stimuli related to social interaction. Our analysis highlights the widespread and increasing use of eye tracking in the study of different neurological and psychiatric conditions.

Classification of Children With Autism and Typical Development Using Eye-Tracking Data From Face-to-Face Conversations: Machine Learning Model Development and Performance Evaluation

BACKGROUND

Previous studies have shown promising results in identifying individuals with autism spectrum disorder (ASD) by applying machine learning (ML) to eye-tracking data collected while participants viewed varying images (ie, pictures, videos, and web pages). Although gaze behavior is known to differ between face-to-face interaction and image-viewing tasks, no study has investigated whether eye-tracking data from face-to-face conversations can also accurately identify individuals with ASD.

OBJECTIVE

The objective of this study was to examine whether eye-tracking data from face-to-face conversations could classify children with ASD and typical development (TD). We further investigated whether combining features on visual fixation and length of conversation would achieve better classification performance.

METHODS

Eye tracking was performed on children with ASD and TD while they were engaged in face-to-face conversations (including 4 conversational sessions) with an interviewer. By implementing forward feature selection, four ML classifiers were used to determine the maximum classification accuracy and the corresponding features: support vector machine (SVM), linear discriminant analysis, decision tree, and random forest.

RESULTS

A maximum classification accuracy of 92.31% was achieved with the SVM classifier by combining features on both visual fixation and session length. The classification accuracy of combined features was higher than that obtained using visual fixation features (maximum classification accuracy 84.62%) or session length (maximum classification accuracy 84.62%) alone.

CONCLUSIONS

Eye-tracking data from face-to-face conversations could accurately classify children with ASD and TD, suggesting that ASD might be objectively screened in everyday social interactions. However, these results will need to be validated with a larger sample of individuals with ASD (varying in severity and balanced sex ratio) using data collected from different modalities (eg, eye tracking, kinematic, electroencephalogram, and neuroimaging). In addition, individuals with other clinical conditions (eg, developmental delay and attention deficit hyperactivity disorder) should be included in similar ML studies for detecting ASD.