A scalable computational approach to assessing response to name in toddlers with autism

Autism Caregiver Coaching in Africa (ACACIA): Protocol for a type 1-hybrid effectiveness-implementation trial

BACKGROUND

While early autism intervention can significantly improve outcomes, gaps in implementation exist globally. These gaps are clearest in Africa, where forty percent of the world's children will live by 2050. Task-sharing early intervention to non-specialists is a key implementation strategy, given the lack of specialists in Africa. Naturalistic Developmental Behavioral Interventions (NDBI) are a class of early autism intervention that can be delivered by caregivers. As a foundational step to address the early autism intervention gap, we adapted a non-specialist delivered caregiver coaching NDBI for the South African context, and pre-piloted this cascaded task-sharing approach in an existing system of care.

OBJECTIVES

First, we will test the effectiveness of the caregiver coaching NDBI compared to usual care. Second, we will describe coaching implementation factors within the Western Cape Department of Education in South Africa.

METHODS

This is a type 1 effectiveness-implementation hybrid design; assessor-blinded, group randomized controlled trial. Participants include 150 autistic children (18-72 months) and their caregivers who live in Cape Town, South Africa, and those involved in intervention implementation. Early Childhood Development practitioners, employed by the Department of Education, will deliver 12, one hour, coaching sessions to the intervention group. The control group will receive usual care. Distal co-primary outcomes include the Communication Domain Standard Score (Vineland Adaptive Behavior Scales, Third Edition) and the Language and Communication Developmental Quotient (Griffiths Scales of Child Development, Third Edition). Proximal secondary outcome include caregiver strategies measured by the sum of five items from the Joint Engagement Rating Inventory. We will describe key implementation determinants.

RESULTS

Participant enrolment started in April 2023. Estimated primary completion date is March 2027.

CONCLUSION

The ACACIA trial will determine whether a cascaded task-sharing intervention delivered in an educational setting leads to meaningful improvements in communication abilities of autistic children, and identify implementation barriers and facilitators.

TRIAL REGISTRATION

NCT05551728 in Clinical Trial Registry (https://clinicaltrials.gov).

The ChAMP App: A Scalable mHealth Technology for Detecting Digital Phenotypes of Early Childhood Mental Health

Childhood mental health problems are common, impairing, and can become chronic if left untreated. Children are not reliable reporters of their emotional and behavioral health, and caregivers often unintentionally under- or over-report child symptoms, making assessment challenging. Objective physiological and behavioral measures of emotional and behavioral health are emerging. However, these methods typically require specialized equipment and expertise in data and sensor engineering to administer and analyze. To address this challenge, we have developed the ChAMP (Childhood Assessment and Management of digital Phenotypes) System, which includes a mobile application for collecting movement and audio data during a battery of mood induction tasks and an open-source platform for extracting digital biomarkers. As proof of principle, we present ChAMP System data from 101 children 4-8 years old, with and without diagnosed mental health disorders. Machine learning models trained on these data detect the presence of specific disorders with 70-73% balanced accuracy, with similar results to clinical thresholds on established parent-report measures (63-82% balanced accuracy). Features favored in model architectures are described using Shapley Additive Explanations (SHAP). Canonical Correlation Analysis reveals moderate to strong associations between predictors of each disorder and associated symptom severity (r = .51-.83). The open-source ChAMP System provides clinically-relevant digital biomarkers that may later complement parent-report measures of emotional and behavioral health for detecting kids with underlying mental health conditions and lowers the barrier to entry for researchers interested in exploring digital phenotyping of childhood mental health.

The ChAMP App: A Scalable mHealth Technology for Detecting Digital Phenotypes of Early Childhood Mental Health

Childhood mental health problems are common, impairing, and can become chronic if left untreated. Children are not reliable reporters of their emotional and behavioral health, and caregivers often unintentionally under- or over-report child symptoms, making assessment challenging. Objective physiological and behavioral measures of emotional and behavioral health are emerging. However, these methods typically require specialized equipment and expertise in data and sensor engineering to administer and analyze. To address this challenge, we have developed the ChAMP (Childhood Assessment and Management of digital Phenotypes) System, which includes a mobile application for collecting movement and audio data during a battery of mood induction tasks and an open-source platform for extracting digital biomarkers. As proof of principle, we present ChAMP System data from 101 children 4-8 years old, with and without diagnosed mental health disorders. Machine learning models trained on these data detect the presence of specific disorders with 70-73% balanced accuracy, with similar results to clinical thresholds on established parent-report measures (63-82% balanced accuracy). Features favored in model architectures are described using Shapley Additive Explanations (SHAP). Canonical Correlation Analysis reveals moderate to strong associations between predictors of each disorder and associated symptom severity (r = .51-.83). The open-source ChAMP System provides clinically-relevant digital biomarkers that may later complement parent-report measures of emotional and behavioral health for detecting kids with underlying mental health conditions and lowers the barrier to entry for researchers interested in exploring digital phenotyping of childhood mental health.

Early detection of autism using digital behavioral phenotyping

Early detection of autism, a neurodevelopmental condition associated with challenges in social communication, ensures timely access to intervention. Autism screening questionnaires have been shown to have lower accuracy when used in real-world settings, such as primary care, as compared to research studies, particularly for children of color and girls. Here we report findings from a multiclinic, prospective study assessing the accuracy of an autism screening digital application (app) administered during a pediatric well-child visit to 475 (17-36 months old) children (269 boys and 206 girls), of which 49 were diagnosed with autism and 98 were diagnosed with developmental delay without autism. The app displayed stimuli that elicited behavioral signs of autism, quantified using computer vision and machine learning. An algorithm combining multiple digital phenotypes showed high diagnostic accuracy with the area under the receiver operating characteristic curve = 0.90, sensitivity = 87.8%, specificity = 80.8%, negative predictive value = 97.8% and positive predictive value = 40.6%. The algorithm had similar sensitivity performance across subgroups as defined by sex, race and ethnicity. These results demonstrate the potential for digital phenotyping to provide an objective, scalable approach to autism screening in real-world settings. Moreover, combining results from digital phenotyping and caregiver questionnaires may increase autism screening accuracy and help reduce disparities in access to diagnosis and intervention.

Autism Caregiver Coaching in Africa (ACACIA): Protocol for a type 1-hybrid effectiveness-implementation trial

Background

While early autism intervention can significantly improve outcomes, gaps in implementation exist globally. These gaps are clearest in Africa, where forty percent of the world's children will live by 2050. Task-sharing early intervention to non-specialists is a key implementation strategy, given the lack of specialists in Africa. Naturalistic Developmental Behavioral Interventions (NDBI) are a class of early autism intervention that can be delivered by caregivers. As a foundational step to address the early autism intervention gap, we adapted a non-specialist delivered caregiver coaching NDBI for the South African context, and pre-piloted this cascaded task-sharing approach in an existing system of care.

Objectives

First, we will test the effectiveness of the caregiver coaching NDBI compared to usual care. Second, we will describe coaching implementation factors within the Western Cape Department of Education in South Africa.

Methods

This is a type 1 effectiveness-implementation hybrid design; assessor-blinded, group randomized controlled trial. Participants include 150 autistic children (18-72 months) and their caregivers who live in Cape Town, South Africa, and those involved in intervention implementation. Early Childhood Development practitioners, employed by the Department of Education, will deliver 12, one hour, coaching sessions to the intervention group. The control group will receive usual care. Distal co-primary outcomes include the Communication Domain Standard Score (Vineland Adaptive Behavior Scales, Third Edition) and the Language and Communication Developmental Quotient (Griffiths Scales of Child Development, Third Edition). Proximal secondary outcome include caregiver strategies measured by the sum of five items from the Joint Engagement Rating Inventory. We will describe key implementation determinants.

Results

Participant enrolment started in April 2023. Estimated primary completion date is March 2027.

Conclusion

The ACACIA trial will determine whether a cascaded task-sharing intervention delivered in an educational setting leads to meaningful improvements in communication abilities of autistic children, and identify implementation barriers and facilitators.

Early detection of neurodevelopmental disorders in paediatric primary care: A scoping review

BACKGROUND

Earlier detection of children at risk for neurodevelopmental disorders is critical and has longstanding repercussions if not addressed early enough.

OBJECTIVES

To explore the supporting or facilitating characteristics of paediatric primary care models of care for early detection in infants and toddlers at risk for neurodevelopmental disorders, identify practitioners involved, and describe how they align with occupational therapy's scope of practice.

METHODS

A scoping review following the Joanna Briggs Institute framework was used. PubMed Central, Cumulative Index to Nursing & Allied Health Literature, and Scopus databases were searched. The search was conducted between January and February 2022. Inclusion criteria were: children aged 0-3 years old; neurodevelopmental disorders including cerebral palsy (CP) and autism spectrum disorder (ASD); models of care used in the paediatric primary care setting and addressing concepts of timing and plasticity; peer-reviewed literature written in English; published between 2010 and 2022. Study protocol registered at https://doi.org/10.17605/OSF.IO/MD4K5.

RESULTS

We identified 1,434 publications, yielding 22 studies that met inclusion criteria. Models of care characteristics included the use of technology, education to parents and staff, funding to utilize innovative models of care, assessment variability, organizational management changes, increased visit length, earlier timeline for neurodevelopmental screening, and collaboration with current office staff or nonphysician practitioners. The top 4 providers were paediatricians, general or family practitioners, nurse/nurse practitioners, and office staff. All studies aligned with occupational therapy health promotion scope of practice and intervention approach yet did not include occupational therapy within the paediatric primary care setting.

CONCLUSIONS

No studies included occupational therapy as a healthcare provider that could be used within the paediatric primary care setting. However, all studies demonstrated models of care facilitating characteristics aligning with occupational therapy practice. Models of care facilitating characteristics identified interdisciplinary staff as a major contributor, which can include occupational therapy, to improve early detection within paediatric primary care.

Relationship between quantitative digital behavioral features and clinical profiles in young autistic children

Early behavioral markers for autism include differences in social attention and orienting in response to one's name when called, and differences in body movements and motor abilities. More efficient, scalable, objective, and reliable measures of these behaviors could improve early screening for autism. This study evaluated whether objective and quantitative measures of autism-related behaviors elicited from an app (SenseToKnow) administered on a smartphone or tablet and measured via computer vision analysis (CVA) are correlated with standardized caregiver-report and clinician administered measures of autism-related behaviors and cognitive, language, and motor abilities. This is an essential step in establishing the concurrent validity of a digital phenotyping approach. In a sample of 485 toddlers, 43 of whom were diagnosed with autism, we found that CVA-based gaze variables related to social attention were associated with the level of autism-related behaviors. Two language-related behaviors measured via the app, attention to people during a conversation and responding to one's name being called, were associated with children's language skills. Finally, performance during a bubble popping game was associated with fine motor skills. These findings provide initial support for the concurrent validity of the SenseToKnow app and its potential utility in identifying clinical profiles associated with autism. Future research is needed to determine whether the app can be used as an autism screening tool, can reliably stratify autism-related behaviors, and measure changes in autism-related behaviors over time.

Blink rate and facial orientation reveal distinctive patterns of attentional engagement in autistic toddlers: a digital phenotyping approach

Differences in social attention are well-documented in autistic individuals, representing one of the earliest signs of autism. Spontaneous blink rate has been used to index attentional engagement, with lower blink rates reflecting increased engagement. We evaluated novel methods using computer vision analysis (CVA) for automatically quantifying patterns of attentional engagement in young autistic children, based on facial orientation and blink rate, which were captured via mobile devices. Participants were 474 children (17-36 months old), 43 of whom were diagnosed with autism. Movies containing social or nonsocial content were presented via an iPad app, and simultaneously, the device's camera recorded the children's behavior while they watched the movies. CVA was used to extract the duration of time the child oriented towards the screen and their blink rate as indices of attentional engagement. Overall, autistic children spent less time facing the screen and had a higher mean blink rate compared to neurotypical children. Neurotypical children faced the screen more often and blinked at a lower rate during the social movies compared to the nonsocial movies. In contrast, autistic children faced the screen less often during social movies than during nonsocial movies and showed no differential blink rate to social versus nonsocial movies.

Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder

Atypical facial expression is one of the early symptoms of autism spectrum disorder (ASD) characterized by reduced regularity and lack of coordination of facial movements. Automatic quantification of these behaviors can offer novel biomarkers for screening, diagnosis, and treatment monitoring of ASD. In this work, 40 toddlers with ASD and 396 typically developing toddlers were shown developmentally-appropriate and engaging movies presented on a smart tablet during a well-child pediatric visit. The movies consisted of social and non-social dynamic scenes designed to evoke certain behavioral and affective responses. The front-facing camera of the tablet was used to capture the toddlers' face. Facial landmarks' dynamics were then automatically computed using computer vision algorithms. Subsequently, the complexity of the landmarks' dynamics was estimated for the eyebrows and mouth regions using multiscale entropy. Compared to typically developing toddlers, toddlers with ASD showed higher complexity (i.e., less predictability) in these landmarks' dynamics. This complexity in facial dynamics contained novel information not captured by traditional facial affect analyses. These results suggest that computer vision analysis of facial landmark movements is a promising approach for detecting and quantifying early behavioral symptoms associated with ASD.

Prediction of autism in infants: progress and challenges

Autism spectrum disorder (henceforth autism) is a neurodevelopmental condition that can be reliably diagnosed in children by age 18-24 months. Prospective longitudinal studies of infants aged 1 year and younger who are later diagnosed with autism are elucidating the early developmental course of autism and identifying ways of predicting autism before diagnosis is possible. Studies that use MRI, EEG, and near-infrared spectroscopy have identified differences in brain development in infants later diagnosed with autism compared with infants without autism. Retrospective studies of infants younger than 1 year who received a later diagnosis of autism have also showed an increased prevalence of health conditions, such as sleep disorders, gastrointestinal disorders, and vision problems. Behavioural features of infants later diagnosed with autism include differences in attention, vocalisations, gestures, affect, temperament, social engagement, sensory processing, and motor abilities. Although research findings offer insight on promising screening approaches for predicting autism in infants, individual-level predictions remain a future goal. Multiple scientific challenges and ethical questions remain to be addressed to translate research on early brain-based and behavioural predictors of autism into feasible and reliable screening tools for clinical practice.

A tablet-based game for the assessment of visual motor skills in autistic children

Increasing evidence suggests that early motor impairments are a common feature of autism. Thus, scalable, quantitative methods for measuring motor behavior in young autistic children are needed. This work presents an engaging and scalable assessment of visual-motor abilities based on a bubble-popping game administered on a tablet. Participants are 233 children ranging from 1.5 to 10 years of age (147 neurotypical children and 86 children diagnosed with autism spectrum disorder [autistic], of which 32 are also diagnosed with co-occurring attention-deficit/hyperactivity disorder [autistic+ADHD]). Computer vision analyses are used to extract several game-based touch features, which are compared across autistic, autistic+ADHD, and neurotypical participants. Results show that younger (1.5-3 years) autistic children pop the bubbles at a lower rate, and their ability to touch the bubble's center is less accurate compared to neurotypical children. When they pop a bubble, their finger lingers for a longer period, and they show more variability in their performance. In older children (3-10-years), consistent with previous research, the presence of co-occurring ADHD is associated with greater motor impairment, reflected in lower accuracy and more variable performance. Several motor features are correlated with standardized assessments of fine motor and cognitive abilities, as evaluated by an independent clinical assessment. These results highlight the potential of touch-based games as an efficient and scalable approach for assessing children's visual-motor skills, which can be part of a broader screening tool for identifying early signs associated with autism.

Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review

In recent years, there has been a great interest in utilizing technology in mental health research. The rapid technological development has encouraged researchers to apply technology as a part of a diagnostic process or treatment of Neurodevelopmental Disorders (NDDs). With the large number of studies being published comes an urgent need to inform clinicians and researchers about the latest advances in this field. Here, we methodically explore and summarize findings from studies published between August 2019 and February 2022. A search strategy led to the identification of 4108 records from PubMed and APA PsycInfo databases. 221 quantitative studies were included, covering a wide range of technologies used for diagnosis and/or treatment of NDDs, with the biggest focus on Autism Spectrum Disorder (ASD). The most popular technologies included machine learning, functional magnetic resonance imaging, electroencephalogram, magnetic resonance imaging, and neurofeedback. The results of the review indicate that technology-based diagnosis and intervention for NDD population is promising. However, given a high risk of bias of many studies, more high-quality research is needed.

Complexity analysis of head movements in autistic toddlers

BACKGROUND

Early differences in sensorimotor functioning have been documented in young autistic children and infants who are later diagnosed with autism. Previous research has demonstrated that autistic toddlers exhibit more frequent head movement when viewing dynamic audiovisual stimuli, compared to neurotypical toddlers. To further explore this behavioral characteristic, in this study, computer vision (CV) analysis was used to measure several aspects of head movement dynamics of autistic and neurotypical toddlers while they watched a set of brief movies with social and nonsocial content presented on a tablet.

METHODS

Data were collected from 457 toddlers, 17-36 months old, during their well-child visit to four pediatric primary care clinics. Forty-one toddlers were subsequently diagnosed with autism. An application (app) displayed several brief movies on a tablet, and the toddlers watched these movies while sitting on their caregiver's lap. The front-facing camera in the tablet recorded the toddlers' behavioral responses. CV was used to measure the participants' head movement rate, movement acceleration, and complexity using multiscale entropy.

RESULTS

Autistic toddlers exhibited significantly higher rate, acceleration, and complexity in their head movements while watching the movies compared to neurotypical toddlers, regardless of the type of movie content (social vs. nonsocial). The combined features of head movement acceleration and complexity reliably distinguished the autistic and neurotypical toddlers.

CONCLUSIONS

Autistic toddlers exhibit differences in their head movement dynamics when viewing audiovisual stimuli. Higher complexity of their head movements suggests that their movements were less predictable and less stable compared to neurotypical toddlers. CV offers a scalable means of detecting subtle differences in head movement dynamics, which may be helpful in identifying early behaviors associated with autism and providing insight into the nature of sensorimotor differences associated with autism.

A multimodal machine learning system in early screening for toddlers with autism spectrum disorders based on the response to name

BACKGROUND

Reduced or absence of the response to name (RTN) has been widely reported as an early specific indicator for autism spectrum disorder (ASD), while few studies have quantified the RTN of toddlers with ASD in an automatic way. The present study aims to apply a multimodal machine learning system (MMLS) in early screening for toddlers with ASD based on the RTN.

METHODS

A total of 125 toddlers were recruited, including ASD (n = 61), developmental delay (DD, n = 31), and typical developmental (TD, n = 33). Procedures of RTN were, respectively, performed by the evaluator and caregiver. Behavioral data were collected by eight-definition tripod-mounted cameras and coded by the MMLS. Response score, response time, and response duration time were accurately calculated to evaluate RTN.

RESULTS

Total accuracy of RTN scores rated by computers was 0.92. In both evaluator and caregiver procedures, toddlers with ASD had significant differences in response score, response time, and response duration time, compared to toddlers with DD and TD (all P-values < 0.05). The area under the curve (AUC) was 0.81 for the computer-rated results, and the AUC was 0.91 for the human-rated results. The accuracy in the identification of ASD based on the computer- and human-rated results was, respectively, 74.8 and 82.9%. There was a significant difference between the AUC of the human-rated results and computer-rated results (Z = 2.71, P-value = 0.007).

CONCLUSION

The multimodal machine learning system can accurately quantify behaviors in RTN procedures and may effectively distinguish toddlers with ASD from the non-ASD group. This novel system may provide a low-cost approach to early screening and identifying toddlers with ASD. However, machine learning is not as accurate as a human observer, and the detection of a single symptom like RTN is not sufficient enough to detect ASD.

A systematic review of telehealth screening, assessment, and diagnosis of autism spectrum disorder

There is a significant delay between parents having concerns and receiving a formal assessment and Autism Spectrum Disorder (ASD) diagnosis. Telemedicine could be an effective alternative that shortens the waiting time for parents and primary health providers in ASD screening and diagnosis. We conducted a systematic review examining the uses of telemedicine technology for ASD screening, assessment, or diagnostic purposes and to what extent sample characteristics and psychometric properties were reported. This study searched four databases from 2000 to 2022 and obtained 26 studies that met the inclusion criteria. The 17 applications used in these 26 studies were divided into three categories based on their purpose: screening, diagnostic, and assessment. The results described the data extracted, including study characteristics, applied methods, indicators seen, and psychometric properties. Among the 15 applications with psychometric properties reported, the sensitivity ranged from 0.70 to 1, and the specificity ranged from 0.38 to 1. The present study highlights the strengths and weaknesses of current telemedicine approaches and provides a basis for future research. More rigorous empirical studies with larger sample sizes are needed to understand the feasibility, strengths, and limitations of telehealth technologies for screening, assessing, and diagnosing ASD.

Motor Skill Differences in Autism Spectrum Disorder: a Clinically Focused Review

PURPOSE OF REVIEW

This review synthesizes recent, clinically relevant findings on the scope, significance, and centrality of motor skill differences in autism spectrum disorder (ASD).

RECENT FINDINGS

Motor challenges in ASD are pervasive, clinically meaningful, and highly underrecognized, with up to 87% of the autistic population affected but only a small percentage receiving motor-focused clinical care. Across development, motor differences are associated with both core autism symptoms and broader functioning, though the precise nature of those associations and the specificity of motor profiles to ASD remain unestablished. Findings suggest that motor difficulties in ASD are quantifiable and treatable, and that detection and intervention efforts targeting motor function may also positively influence social communication. Recent evidence supports a need for explicit recognition of motor impairment within the diagnostic framework of ASD as a clinical specifier. Motor differences in ASD warrant greater clinical attention and routine incorporation into screening, evaluation, and treatment planning.

Computational Methods to Measure Patterns of Gaze in Toddlers With Autism Spectrum Disorder

Importance

Atypical eye gaze is an early-emerging symptom of autism spectrum disorder (ASD) and holds promise for autism screening. Current eye-tracking methods are expensive and require special equipment and calibration. There is a need for scalable, feasible methods for measuring eye gaze.

Objective

Using computational methods based on computer vision analysis, we evaluated whether an app deployed on an iPhone or iPad that displayed strategically designed brief movies could elicit and quantify differences in eye-gaze patterns of toddlers with ASD vs typical development.

Design, Setting, and Participants

A prospective study in pediatric primary care clinics was conducted from December 2018 to March 2020, comparing toddlers with and without ASD. Caregivers of 1564 toddlers were invited to participate during a well-child visit. A total of 993 toddlers (63%) completed study measures. Enrollment criteria were aged 16 to 38 months, healthy, English- or Spanish-speaking caregiver, and toddler able to sit and view the app. Participants were screened with the Modified Checklist for Autism in Toddlers-Revised With Follow-up during routine care. Children were referred by their pediatrician for diagnostic evaluation based on results of the checklist or if the caregiver or pediatrician was concerned. Forty toddlers subsequently were diagnosed with ASD.

Exposures

A mobile app displayed on a smartphone or tablet.

Main Outcomes and Measures

Computer vision analysis quantified eye-gaze patterns elicited by the app, which were compared between toddlers with ASD vs typical development.

Results

Mean age of the sample was 21.1 months (range, 17.1-36.9 months), and 50.6% were boys, 59.8% White individuals, 16.5% Black individuals, 23.7% other race, and 16.9% Hispanic/Latino individuals. Distinctive eye-gaze patterns were detected in toddlers with ASD, characterized by reduced gaze to social stimuli and to salient social moments during the movies, and previously unknown deficits in coordination of gaze with speech sounds. The area under the receiver operating characteristic curve discriminating ASD vs non-ASD using multiple gaze features was 0.90 (95% CI, 0.82-0.97).

Conclusions and Relevance

The app reliably measured both known and new gaze biomarkers that distinguished toddlers with ASD vs typical development. These novel results may have potential for developing scalable autism screening tools, exportable to natural settings, and enabling data sets amenable to machine learning.

Identifying Autism with Head Movement Features by Implementing Machine Learning Algorithms

Our study investigated the feasibility of using head movement features to identify individuals with autism spectrum disorder (ASD). Children with ASD and typical development (TD) were required to answer ten yes-no questions, and they were encouraged to nod/shake head while doing so. The head rotation range (RR) and the amount of rotation per minute (ARPM) in the pitch (head nodding direction), yaw (head shaking direction) and roll (lateral head inclination) directions were computed, and further fed into machine learning classifiers as the input features. The maximum classification accuracy of 92.11% was achieved with the decision tree classifier with two features (i.e., RR_Pitch and ARPM_Yaw). Our study suggests that head movement dynamics contain objective biomarkers that could identify ASD.