1
|
Perochon S, Di Martino JM, Carpenter KLH, Compton S, Davis N, Eichner B, Espinosa S, Franz L, Krishnappa Babu PR, Sapiro G, Dawson G. Early detection of autism using digital behavioral phenotyping. Nat Med 2023; 29:2489-2497. [PMID: 37783967 PMCID: PMC10579093 DOI: 10.1038/s41591-023-02574-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 08/25/2023] [Indexed: 10/04/2023]
Abstract
Early detection of autism, a neurodevelopmental condition associated with challenges in social communication, ensures timely access to intervention. Autism screening questionnaires have been shown to have lower accuracy when used in real-world settings, such as primary care, as compared to research studies, particularly for children of color and girls. Here we report findings from a multiclinic, prospective study assessing the accuracy of an autism screening digital application (app) administered during a pediatric well-child visit to 475 (17-36 months old) children (269 boys and 206 girls), of which 49 were diagnosed with autism and 98 were diagnosed with developmental delay without autism. The app displayed stimuli that elicited behavioral signs of autism, quantified using computer vision and machine learning. An algorithm combining multiple digital phenotypes showed high diagnostic accuracy with the area under the receiver operating characteristic curve = 0.90, sensitivity = 87.8%, specificity = 80.8%, negative predictive value = 97.8% and positive predictive value = 40.6%. The algorithm had similar sensitivity performance across subgroups as defined by sex, race and ethnicity. These results demonstrate the potential for digital phenotyping to provide an objective, scalable approach to autism screening in real-world settings. Moreover, combining results from digital phenotyping and caregiver questionnaires may increase autism screening accuracy and help reduce disparities in access to diagnosis and intervention.
Collapse
Affiliation(s)
- Sam Perochon
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
- Ecole Normale Supérieure Paris-Saclay, Gif-sur-Yvette, France
| | - J Matias Di Martino
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Kimberly L H Carpenter
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Scott Compton
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Naomi Davis
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
| | - Brian Eichner
- Department of Pediatrics, Duke University, Durham, NC, USA
| | - Steven Espinosa
- Office of Information Technology, Duke University, Durham, NC, USA
| | - Lauren Franz
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
- Duke Global Health Institute, Duke University, Durham, NC, USA
| | | | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
- Departments of Biomedical Engineering, Mathematics, and Computer Science, Duke University, Durham, NC, USA
| | - Geraldine Dawson
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA.
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA.
| |
Collapse
|
2
|
Krishnappa Babu PR, Aikat V, Di Martino JM, Chang Z, Perochon S, Espinosa S, Aiello R, L H Carpenter K, Compton S, Davis N, Eichner B, Flowers J, Franz L, Dawson G, Sapiro G. Blink rate and facial orientation reveal distinctive patterns of attentional engagement in autistic toddlers: a digital phenotyping approach. Sci Rep 2023; 13:7158. [PMID: 37137954 PMCID: PMC10156751 DOI: 10.1038/s41598-023-34293-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 04/27/2023] [Indexed: 05/05/2023] Open
Abstract
Differences in social attention are well-documented in autistic individuals, representing one of the earliest signs of autism. Spontaneous blink rate has been used to index attentional engagement, with lower blink rates reflecting increased engagement. We evaluated novel methods using computer vision analysis (CVA) for automatically quantifying patterns of attentional engagement in young autistic children, based on facial orientation and blink rate, which were captured via mobile devices. Participants were 474 children (17-36 months old), 43 of whom were diagnosed with autism. Movies containing social or nonsocial content were presented via an iPad app, and simultaneously, the device's camera recorded the children's behavior while they watched the movies. CVA was used to extract the duration of time the child oriented towards the screen and their blink rate as indices of attentional engagement. Overall, autistic children spent less time facing the screen and had a higher mean blink rate compared to neurotypical children. Neurotypical children faced the screen more often and blinked at a lower rate during the social movies compared to the nonsocial movies. In contrast, autistic children faced the screen less often during social movies than during nonsocial movies and showed no differential blink rate to social versus nonsocial movies.
Collapse
Affiliation(s)
| | - Vikram Aikat
- Department of Computer Science, Duke University, Durham, NC, USA
| | - J Matias Di Martino
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Zhuoqing Chang
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Sam Perochon
- Ecole Normale Supérieure Paris-Saclay, Gif-Sur-Yvette, France
| | - Steven Espinosa
- Office of Information Technology, Duke University, Durham, NC, USA
| | - Rachel Aiello
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Kimberly L H Carpenter
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Scott Compton
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Naomi Davis
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Brian Eichner
- Department of Pediatrics, Duke University, Durham, NC, USA
| | - Jacqueline Flowers
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Lauren Franz
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
- Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Geraldine Dawson
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA.
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA.
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA.
- Departments of Biomedical Engineering, Mathematics, and Computer Science, Duke University, Durham, NC, USA.
| |
Collapse
|
3
|
Dawson G, Rieder AD, Johnson MH. Prediction of autism in infants: progress and challenges. Lancet Neurol 2023; 22:244-254. [PMID: 36427512 PMCID: PMC10100853 DOI: 10.1016/s1474-4422(22)00407-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 09/17/2022] [Accepted: 09/27/2022] [Indexed: 11/24/2022]
Abstract
Autism spectrum disorder (henceforth autism) is a neurodevelopmental condition that can be reliably diagnosed in children by age 18-24 months. Prospective longitudinal studies of infants aged 1 year and younger who are later diagnosed with autism are elucidating the early developmental course of autism and identifying ways of predicting autism before diagnosis is possible. Studies that use MRI, EEG, and near-infrared spectroscopy have identified differences in brain development in infants later diagnosed with autism compared with infants without autism. Retrospective studies of infants younger than 1 year who received a later diagnosis of autism have also showed an increased prevalence of health conditions, such as sleep disorders, gastrointestinal disorders, and vision problems. Behavioural features of infants later diagnosed with autism include differences in attention, vocalisations, gestures, affect, temperament, social engagement, sensory processing, and motor abilities. Although research findings offer insight on promising screening approaches for predicting autism in infants, individual-level predictions remain a future goal. Multiple scientific challenges and ethical questions remain to be addressed to translate research on early brain-based and behavioural predictors of autism into feasible and reliable screening tools for clinical practice.
Collapse
Affiliation(s)
- Geraldine Dawson
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA.
| | - Amber D Rieder
- Duke Center for Autism and Brain Development, Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, USA; Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Mark H Johnson
- Department of Psychology, University of Cambridge, Cambridge, UK; Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| |
Collapse
|
4
|
Perochon S, Matias Di Martino J, Carpenter KLH, Compton S, Davis N, Espinosa S, Franz L, Rieder AD, Sullivan C, Sapiro G, Dawson G. A tablet-based game for the assessment of visual motor skills in autistic children. NPJ Digit Med 2023; 6:17. [PMID: 36737475 PMCID: PMC9898502 DOI: 10.1038/s41746-023-00762-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Accepted: 01/21/2023] [Indexed: 02/05/2023] Open
Abstract
Increasing evidence suggests that early motor impairments are a common feature of autism. Thus, scalable, quantitative methods for measuring motor behavior in young autistic children are needed. This work presents an engaging and scalable assessment of visual-motor abilities based on a bubble-popping game administered on a tablet. Participants are 233 children ranging from 1.5 to 10 years of age (147 neurotypical children and 86 children diagnosed with autism spectrum disorder [autistic], of which 32 are also diagnosed with co-occurring attention-deficit/hyperactivity disorder [autistic+ADHD]). Computer vision analyses are used to extract several game-based touch features, which are compared across autistic, autistic+ADHD, and neurotypical participants. Results show that younger (1.5-3 years) autistic children pop the bubbles at a lower rate, and their ability to touch the bubble's center is less accurate compared to neurotypical children. When they pop a bubble, their finger lingers for a longer period, and they show more variability in their performance. In older children (3-10-years), consistent with previous research, the presence of co-occurring ADHD is associated with greater motor impairment, reflected in lower accuracy and more variable performance. Several motor features are correlated with standardized assessments of fine motor and cognitive abilities, as evaluated by an independent clinical assessment. These results highlight the potential of touch-based games as an efficient and scalable approach for assessing children's visual-motor skills, which can be part of a broader screening tool for identifying early signs associated with autism.
Collapse
Affiliation(s)
- Sam Perochon
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
- Ecole Normale Supérieure Paris-Saclay, Gif-Sur-Yvette, France
| | - J Matias Di Martino
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Kimberly L H Carpenter
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Scott Compton
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Naomi Davis
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
| | - Steven Espinosa
- Office of Information Technology, Duke University, Durham, NC, USA
| | - Lauren Franz
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
- Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Amber D Rieder
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Connor Sullivan
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA.
| | - Geraldine Dawson
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA.
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA.
| |
Collapse
|
5
|
Babu PRK, Di Martino JM, Chang Z, Perochon S, Aiello R, Carpenter KL, Compton S, Davis N, Franz L, Espinosa S, Flowers J, Dawson G, Sapiro G. Complexity analysis of head movements in autistic toddlers. J Child Psychol Psychiatry 2023; 64:156-166. [PMID: 35965431 PMCID: PMC9771883 DOI: 10.1111/jcpp.13681] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/05/2022] [Indexed: 12/24/2022]
Abstract
BACKGROUND Early differences in sensorimotor functioning have been documented in young autistic children and infants who are later diagnosed with autism. Previous research has demonstrated that autistic toddlers exhibit more frequent head movement when viewing dynamic audiovisual stimuli, compared to neurotypical toddlers. To further explore this behavioral characteristic, in this study, computer vision (CV) analysis was used to measure several aspects of head movement dynamics of autistic and neurotypical toddlers while they watched a set of brief movies with social and nonsocial content presented on a tablet. METHODS Data were collected from 457 toddlers, 17-36 months old, during their well-child visit to four pediatric primary care clinics. Forty-one toddlers were subsequently diagnosed with autism. An application (app) displayed several brief movies on a tablet, and the toddlers watched these movies while sitting on their caregiver's lap. The front-facing camera in the tablet recorded the toddlers' behavioral responses. CV was used to measure the participants' head movement rate, movement acceleration, and complexity using multiscale entropy. RESULTS Autistic toddlers exhibited significantly higher rate, acceleration, and complexity in their head movements while watching the movies compared to neurotypical toddlers, regardless of the type of movie content (social vs. nonsocial). The combined features of head movement acceleration and complexity reliably distinguished the autistic and neurotypical toddlers. CONCLUSIONS Autistic toddlers exhibit differences in their head movement dynamics when viewing audiovisual stimuli. Higher complexity of their head movements suggests that their movements were less predictable and less stable compared to neurotypical toddlers. CV offers a scalable means of detecting subtle differences in head movement dynamics, which may be helpful in identifying early behaviors associated with autism and providing insight into the nature of sensorimotor differences associated with autism.
Collapse
Affiliation(s)
| | - J. Matias Di Martino
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Zhuoqing Chang
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
| | - Sam Perochon
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
- Ecole Normale Supérieure Paris-Saclay, Gif-Sur-Yvette, France
| | - Rachel Aiello
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Kimberly L.H. Carpenter
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Scott Compton
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
| | - Naomi Davis
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
| | - Lauren Franz
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
- Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Steven Espinosa
- Office of Information Technology, Duke University, Durham, NC, USA
| | - Jacqueline Flowers
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Geraldine Dawson
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
- Duke Center for Autism and Brain Development, Duke University, Durham, NC, USA
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, USA
- Department of Biomedical Engineering, Mathematics, and Computer Sciences, Duke University, Durham, NC, USA
| |
Collapse
|