Comparison of Autism Screening in Younger and Older Toddlers

Developmental Milestone Attainment in US Children Before and During the COVID-19 Pandemic

Importance

Restrictions related to the COVID-19 pandemic disrupted the lives of young children, but the association between the pandemic and any changes in early childhood developmental milestone achievement in the US remains unclear.

Objectives

To determine the association between the COVID-19 pandemic and changes in developmental screening scores among US children aged 0 to 5 years and to investigate whether caregivers self-reported more worries about their children or concerns about children's behavior during the pandemic, regardless of milestone achievement.

Design, Setting, and Participants

This was a cohort study using an interrupted time series analysis comparing prepandemic (March 1, 2018, to February 29, 2020), interruption (March 1 to May 31, 2020), and intrapandemic (June 1, 2020, to May 30, 2022) periods among 50 205 children (randomly sampled from a population of 502 052 children) aged 0 to 5 years whose parents or caregivers completed developmental screening at pediatric visits at US pediatric primary care practices participating in a web-based clinical process support system.

Exposure

COVID-19 pandemic period.

Main Outcomes and Measures

Age-standardized Ages and Stages Questionnaire, Third Edition (ASQ) domain scores (communication, personal-social, problem-solving, gross motor, fine motor), and rate of caregivers' concerns about the child's behavior or worries about the child as measured on the ASQ.

Results

A total of 50 205 children (25 852 [51.5%] male; mean [SD] age, 18.6 [16.0] months) and 134 342 ASQ observations were included. In adjusted models, significant age-specific mean score decreases from prepandemic to intrapandemic were observed in communication (-0.029; 95% CI, -0.041 to -0.017), problem-solving (-0.018; 95% CI, -0.030 to -0.006), and personal-social (-0.016; 95% CI, -0.028 to -0.004) domains. There were no changes in fine or gross motor domains prepandemic to intrapandemic. For infants aged 0 to 12 months, similar effect sizes were observed but only for communication (-0.027; 95% CI, -0.044 to -0.011) and problem-solving (-0.018; 95% CI, -0.035 to -0.001). After accounting for age-standardized ASQ scores, caregiver worries about the child increased slightly in the intrapandemic period compared with the prepandemic period (rate ratio, 1.088; 95% CI, 1.036-1.143), but there were no changes in caregiver concerns about the child's behavior. While changes in developmental screening scores were modest (2%-3%), nationwide, this could translate to more than 1500 additional recommended developmental referrals over baseline each month.

Conclusions and Relevance

Modest changes in developmental screening scores are reassuring in the short term but may tax an already overburdened developmental behavioral pediatrics infrastructure. Continued attention to developmental surveillance is critical since the long-term population- and individual-level implications of these changes are unclear.

Brief Report: Single and Repeat Screening with the Modified Checklist for Autism in Toddlers-Revised in Young Children at Higher Likelihood for Autism Spectrum Disorder

PURPOSE

To compare the utility of single versus repeated autism screening in a sample at higher likelihood (HL) for ASD, following both screen positives and all screen negatives to diagnostic outcome.

METHODS

Using a prospective infant sibling design, the current study followed 135 toddlers at HL for ASD and conducted diagnostic evaluations on the full sample at 18, 24, and 36 months. The psychometric properties of the M-CHAT-R using both concurrent and predictive diagnostic evaluations were compared in a group screened once (at 18 months only, n = 60) or twice (at both 18 and 24 months, n = 75). The study also examined consistency in reporting of ASD symptoms across the M-CHAT-R and a developmental concerns interview, comparing the HL group to a group with lower likelihood (LL) for ASD (n = 88).

RESULTS

Sensitivity and specificity of the M-CHAT-R were high (75 - 95%), consistent with previous research. Positive predictive value (43 - 76%) was higher in this HL group than in previous community samples. Repeat screening improved sensitivity with little cost to specificity. At both 18 and 24 months, HL parents were more consistent in their reporting on the M-CHAT-R and a concerns interview than LL parents.

CONCLUSION

The M-CHAT-R has strong psychometric properties when used with groups at HL for ASD, suggesting that scores over the screening cutoff of 3 should lead to prompt diagnostic evaluation referrals in children with older siblings on the spectrum.

Enhancing early autism prediction based on electronic records using clinical narratives

Recent work has shown that predictive models can be applied to structured electronic health record (EHR) data to stratify autism likelihood from an early age (<1 year). Integrating clinical narratives (or notes) with structured data has been shown to improve prediction performance in other clinical applications, but the added predictive value of this information in early autism prediction has not yet been explored. In this study, we aimed to enhance the performance of early autism prediction by using both structured EHR data and clinical narratives. We built models based on structured data and clinical narratives separately, and then an ensemble model that integrated both sources of data. We assessed the predictive value of these models from Duke University Health System over a 14-year span to evaluate ensemble models predicting later autism diagnosis (by age 4 years) from data collected from ages 30 to 360 days. Our sample included 11,750 children above by age 3 years (385 meeting autism diagnostic criteria). The ensemble model for autism prediction showed superior performance and at age 30 days achieved 46.8% sensitivity (95% confidence interval, CI: 22.0%, 52.9%), 28.0% positive predictive value (PPV) at high (90%) specificity (CI: 2.0%, 33.1%), and AUC4 (with at least 4-year follow-up for controls) reaching 0.769 (CI: 0.715, 0.811). Prediction by 360 days achieved 44.5% sensitivity (CI: 23.6%, 62.9%), and 13.7% PPV at high (90%) specificity (CI: 9.6%, 18.9%), and AUC4 reaching 0.797 (CI: 0.746, 0.840). Results show that incorporating clinical narratives in early autism prediction achieved promising accuracy by age 30 days, outperforming models based on structured data only. Furthermore, findings suggest that additional features learned from clinician narratives might be hypothesis generating for understanding early development in autism.

Tools for early screening of autism spectrum disorders in primary health care – a scoping review

Background

Autism spectrum disorder (ASD) is a neurodevelopmental disorder that manifests itself in early childhood. Early diagnosis of these disorders allows for the initiation of early therapy, which is crucial for the child's further functioning in society.

Objectives

This review aims to gather and present the existing ASD screening tools that can be used in primary care and adapted to different countries conditions linguistically and culturally.

Eligibility criteria

We searched for English-language publications on ASD screening tools for children aged 0–3 years suitable for use in primary care (i.e. free, requiring no additional training or qualifications).

Sources of evidence

Four databases were explored to find English studies on ASD screening tools intended for the rapid assessment of children aged 0–3.

Charting methods

The information sought (specific features of the questionnaires relevant to primary health care workers, psychometric and diagnostic values of a given cultural adaptation of screening tools, and the linguistic and cultural changes made) were extracted and collected to create profiles of these tools.

Results

We found 81 studies which met inclusion criteria and underwent full data extraction. Three additional data sources were included. These allowed to create 75 profiles of adaptations for 26 different screening tools and collect data on their psychometric values and characteristic features.

Conclusions

The results of our study indicate the availability of several diagnostic tools for early ASD screening in primary care setting concordant culturally and linguistically with a given population. They could be an effective method of accelerating the diagnostic process and starting personalized therapy faster. However, most tools have significant limitations – some are only available for research purposes, while others do not have scientific evidence to prove their effectiveness.

Reducing Barriers to Autism Screening in Community Primary Care: A Pragmatic Trial Using Web-Based Screening

OBJECTIVE

To determine whether an intervention addressing both logistical and knowledge barriers to early screening for autism spectrum disorder (ASD) increases evidence-based screening during 18-month well-child visits and primary care providers' (PCPs') perceived self-efficacy in caring for children with ASD.

METHODS

Forty-six PCPs from 10 diverse practices across four counties in Washington State participated. PCPs attended a 2-hour training workshop on early recognition and care for toddlers with ASD and use of a REDCap-based version of the Modified Checklist for Autism in Toddlers-Revised with Follow-up (webM-CHAT-R/F) that provided automated presentation and scoring of follow-up questions. Data were collected at baseline and 6 months following each county's training window. PCPs' screening methods and rates and perceived self-efficacy regarding ASD care were measured by self-report and webM-CHAT-R/F use was measured via REDCap records.

RESULTS

At follow-up, 8 of the 10 practices were using the webM-CHAT-R/F routinely at 18-month visits. The proportion of PCPs reporting routine M-CHAT screening increased from 82% at baseline to 98% at follow-up (16% increase, 95% confidence interval [CI] 3%-28%; McNemar exact P = .02). The proportion using the M-CHAT-R/F follow-up interview questions increased from 33% to 82% (49% increase, 95% CI 30%-68%, exact McNemar test, P < .001). Significant increases in self-efficacy were found for all seven areas assessed (Ps ≤ .008).

CONCLUSIONS

This brief intervention increased PCPs' self-reported valid use of the M-CHAT-R/F at 18 months and their self-efficacy regarding ASD care. Combining educational information with a web-based ASD screen incorporating the M-CHAT-R/F follow-up questions may increase universal ASD screening with improved fidelity.

What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT

The present study objectives were to examine the performance of the new M-CHAT-R algorithm to the original M-CHAT algorithm. The main purpose was to examine if the algorithmic changes increase identification of children later diagnosed with ASD, and to examine if there is a trade-off when changing algorithms. We included 54,463 screened cases from the Norwegian Mother and Child Cohort Study. Children were screened using the 23 items of the M-CHAT at 18 months. Further, the performance of the M-CHAT-R algorithm was compared to the M-CHAT algorithm on the 23-items. In total, 337 individuals were later diagnosed with ASD. Using M-CHAT-R algorithm decreased the number of correctly identified ASD children by 12 compared to M-CHAT, with no children with ASD screening negative on the M-CHAT criteria subsequently screening positive utilizing the M-CHAT-R algorithm. A nonparametric McNemar's test determined a statistically significant difference in identifying ASD utilizing the M-CHAT-R algorithm. The present study examined the application of 20-item MCHAT-R scoring criterion to the 23-item MCHAT. We found that this resulted in decreased sensitivity and increased specificity for identifying children with ASD, which is a trade-off that needs further investigation in terms of cost-effectiveness. However, further research is needed to optimize screening for ASD in the early developmental period to increase identification of false negatives.

Autism screening at 18 months of age: a comparison of the Q-CHAT-10 and M-CHAT screeners

Background

Autism screening is recommended at 18- and 24-month pediatric well visits. The Modified Checklist for Autism in Toddlers—Revised (M-CHAT-R) authors recommend a follow-up interview (M-CHAT-R/F) when positive. M-CHAT-R/F may be less accurate for 18-month-olds than 24-month-olds and accuracy for identification prior to two years is not known in samples that include children screening negative. Since autism symptoms may emerge gradually, ordinally scoring items based on the full range of response options, such as in the 10-item version of the Quantitative Checklist for Autism in Toddlers (Q-CHAT-10), might better capture autism signs than the dichotomous (i.e., yes/no) items in M-CHAT-R or the pass/fail scoring of Q-CHAT-10 items. The aims of this study were to determine and compare the accuracy of the M-CHAT-R/F and the Q-CHAT-10 and to describe the accuracy of the ordinally scored Q-CHAT-10 (Q-CHAT-10-O) for predicting autism in a sample of children who were screened at 18 months.

Methods

This is a community pediatrics validation study with screen positive (n = 167) and age- and practice-matched screen negative children (n = 241) recruited for diagnostic evaluations completed prior to 2 years old.

Clinical diagnosis of autism was based on results of in-person diagnostic autism evaluations by research reliable testers blind to screening results and using the Autism Diagnostic Observation Schedule—Second Edition (ADOS-2) Toddler Module and Mullen Scales of Early Learning (MSEL) per standard guidelines.

Results

While the M-CHAT-R/F had higher specificity and PPV compared to M-CHAT-R, Q-CHAT-10-O showed higher sensitivity than M-CHAT-R/F and Q-CHAT-10.

Limitations

Many parents declined participation and the sample is over-represented by higher educated parents. Results cannot be extended to older ages.

Conclusions

Limitations of the currently recommended two-stage M-CHAT-R/F at the 18-month visit include low sensitivity with minimal balancing benefit of improved PPV from the follow-up interview. Ordinal, rather than dichotomous, scoring of autism screening items appears to be beneficial at this age. The Q-CHAT-10-O with ordinal scoring shows advantages to M-CHAT-R/F with half the number of items, no requirement for a follow-up interview, and improved sensitivity. Yet, Q-CHAT-10-O sensitivity is less than M-CHAT-R (without follow-up) and specificity is less than the two-stage procedure. Such limitations are consistent with recognition that screening needs to recur beyond this age.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13229-021-00480-4.

Incremental Utility of 24-Month Autism Spectrum Disorder Screening After Negative 18-Month Screening

The American Academy of Pediatrics recommends Autism Spectrum Disorder (ASD) screening at 18 and 24 months. However, utility of rescreening at 24 months, after a negative 18-month screening, remains unknown. We identified cases of ASD detected at 24 months after a negative 18-month screening (i.e., Catch-24 group; n = 10) and compared them to toddlers detected by 18-month screening (i.e., Early Diagnosis group; n = 203). Repeated ASD-specific screening at 24 months detected children who were missed at their 18-month screening. Thus, our findings support repeated screening for ASD at both 18 and 24 months in order to maximize identification of toddlers with ASD and other neurodevelopmental disorders who require intervention.

Comparison of Parent Questionnaires, Examiner-Led Assessment and Parents' Concerns at 14 Months of Age as Indicators of Later Diagnosis of Autism

Parents participating in a prospective longitudinal study of infants with older siblings with autism completed an autism screening questionnaire and were asked about any concerns relating to their child’s development, and children were administered an interactive assessment conducted by a researcher at 14 months. Scores on the parent questionnaire were highest for children later diagnosed with autism. Parental concerns and scores from the examiner-led assessment distinguished children with later developmental difficulties (both autism and other developmental atypicalities) from those who were developing typically. Children about whom parents expressed concern scored higher on both the questionnaire and the interactive assessment than those without concerns. There were no significant associations between total or individual item scores from the questionnaire and interactive assessment.

General paediatric practice in autism spectrum disorder screening in Ontario, Canada: Opportunities for improvement

Background

Screening is important for early identification of children with autism spectrum disorder (ASD), potentially leading to earlier intervention. Research has identified some barriers to early identification of ASD, however, information about ASD screening in Canadian general paediatric practice is lacking.

Objectives

The aim of the study is to better understand ASD screening practice patterns by examining the use of ASD and general developmental screening tools by general paediatricians.

Methods

The research team conducted a cross-sectional survey of general paediatricians.

Results

Two-hundred and sixty-seven paediatricians responded and 132 were eligible for the study. Ninety-three per cent of the responders used a developmental screening tool. Eighty-five per cent of the responders used an ASD screening tool when there were concerns for ASD, and 15% never used one. The most commonly used ASD screening tool was the M-CHAT. Children suspected of having ASD were referred to specialists not only to confirm the diagnosis but also to facilitate access to resources. General paediatricians were keen to incorporate formal ASD screening tools in their practice but identified the need for clearer guidelines.

Conclusion

Previous studies have shown that children at risk of ASD continue to be missed through developmental surveillance and targeted screening. Paediatricians are interested in implementing an ASD screening tool and cite brevity and forms that can be completed by parents as factors that would support the use of a screening tool. Clearer guidelines and tools to support ASD screening and access to resources are needed.

Clinical Features of Children With Autism Who Passed 18-Month Screening

OBJECTIVES

We compared sex-stratified developmental and temperamental profiles at 18 months in children screening negative for autism spectrum disorder (ASD) on the Modified Checklist for Autism in Toddlers (M-CHAT) but later receiving diagnoses of ASD (false-negative group) versus those without later ASD diagnoses (true-negative group).

METHODS

We included 68 197 screen-negative cases from the Norwegian Mother and Child Cohort Study (49.1% girls). Children were screened by using the 6 critical items of the M-CHAT at 18 months. Groups were compared on domains of the Ages and Stages Questionnaire and the Emotionality Activity Sociability Temperament Survey.

RESULTS

Despite passing M-CHAT screening at 18 months, children in the false-negative group exhibited delays in social, communication, and motor skills compared with the true-negative group. Differences were more pronounced in girls. However, with regard to shyness, boys in the false-negative group were rated as more shy than their true-negative counterparts, but girls in the false-negative group were rated as less shy than their counterparts in the true-negative group.

CONCLUSIONS

This is the first study to reveal that children who pass M-CHAT screening at 18 months and are later diagnosed with ASD exhibit delays in core social and communication areas as well as fine motor skills at 18 months. Differences appeared to be more pronounced in girls. With these findings, we underscore the need to enhance the understanding of early markers of ASD in boys and girls, as well as factors affecting parental report on early delays and abnormalities, to improve the sensitivity of screening instruments.

Critical reappraisal of mechanistic links of copy number variants to dimensional constructs of neuropsychiatric disorders in mouse models

Copy number variants are deletions and duplications of a few thousand to million base pairs and are associated with extraordinarily high levels of autism spectrum disorder, schizophrenia, intellectual disability, or attention-deficit hyperactivity disorder. The unprecedented levels of robust and reproducible penetrance of copy number variants make them one of the most promising and reliable entry points to delve into the mechanistic bases of many mental disorders. However, the precise mechanistic bases of these associations still remain elusive in humans due to the many genes encoded in each copy number variant and the diverse associated phenotypic features. Genetically engineered mice have provided a technical means to ascertain precise genetic mechanisms of association between copy number variants and dimensional aspects of mental illnesses. Molecular, cellular, and neuronal phenotypes can be detected as potential mechanistic substrates for various behavioral constructs of mental illnesses. However, mouse models come with many technical pitfalls. Genetic background is not well controlled in many mouse models, leading to rather obvious interpretative issues. Dose alterations of many copy number variants and single genes within copy number variants result in some molecular, cellular, and neuronal phenotypes without a behavioral phenotype or with a behavioral phenotype opposite to what is seen in humans. In this review, I discuss technical and interpretative pitfalls of mouse models of copy number variants and highlight well-controlled studies to suggest potential neuronal mechanisms of dimensional aspects of mental illnesses. Mouse models of copy number variants represent toeholds to achieve a better understanding of the mechanistic bases of dimensions of neuropsychiatric disorders and thus for development of mechanism-based therapeutic options in humans.

Analysis of Social Communication Questionnaire (SCQ) Screening for Children Less Than Age 4

PURPOSE OF REVIEW

The Social Communication Questionnaire (SCQ) is a screener for Autism spectrum disorder (ASD) validated for age 4.0 +. There is a clinical need for an ASD screener for children beyond the 30-month age limit of the M-CHAT-R/F. We evaluate the literature on the use of the SCQ in children < 4.0 years.

RECENT FINDINGS

Recent studies have used very large samples; included typically developing children, rather than just those with developmental disorders; compared the SCQ Lifetime and Current versions; and increased scrutiny of internal validity.

SUMMARY

The sensitivity-specificity balance in distinguishing between ASD and other developmental disorders is poor, which has led to development of abbreviated versions of the SCQ; however, sensitivity-specificity balance is better in a more general population. The SCQ Lifetime (not Current) version should be used. Future research relating should focus on further validation of the SCQ as a screener for children 30-48 months.

Use of an Online Clinical Process Support System as an Aid to Identification and Management of Developmental and Mental Health Problems

Purpose of review

To describe benefits and problems with screening and addressing developmental and behavioral problems in primary care and using an online clinical process support system as a solution.

Recent findings

Screening has been found to have various implementation barriers including time costs, accuracy, workflow and knowledge of tools. In addition, training of clinicians in dealing with identified issues is lacking. Patients disclose more to and prefer computerized screening. An online clinical process support system (CHADIS) shows promise in addressing these issues.

Summary

Use of a comprehensive panel of online pre-visit screens; linked decision support to provide moment-of-care training; and post-visit activities and resources for patient-specific education, monitoring and care coordination is an efficient way to make the entire process of screening and follow up care feasible in primary care. CHADIS fulfills these requirements and provides Maintenance of Certification credit to physicians as well as added income for screening efforts.