What Drives Detection and Diagnosis of Autism Spectrum Disorder? Looking Under the Hood of a Multi-stage Screening Process in Early Intervention

Medical Home, Developmental Monitoring/Screening, and Early Autism Identification

Developmental monitoring/screening predict early identified autism spectrum disorders (ASD), but studies have not yet robustly controlled for a key health care service impacting early identification: medical home. National Surveys of Children's Health (NSCH; 2016-2020) were used to determine the relationship between medical home, developmental monitoring/screening, and identified ASD. NSCH overall medical home variable had a minimal relationship with ASD (under 5 years of age, under 5 identified in last year, under 5 identified over a year prior). Usual source of care was positively, and care coordination negatively, associated with ASD identified in last year, suggesting the overall medical home variable may mask variance from subscales. Research is needed to determine how medical home relates to identification in applied settings.

Unpacking the prevalence: A warning against overstating the recently narrowed gap for Black autistic youth

Recent findings from the Centers for Disease Control and Prevention's (CDC) Autism and Developmental Disabilities Monitoring (ADDM) Network's 2020 prevalence report indicate that disparities in autism diagnoses between Black and White youth have narrowed, reflecting improved screening, awareness, and access to services (Maenner et al., 2023. Morbidity and Mortality Weekly Report. Surveillance Summaries (Washington, D.C.: 2002), 72, 1-14.). Claims of reducing disparities beyond prevalence rates, however, are not fully supported, as indicated by the reality that Black youth whose screenings indicate autistic traits are still not being referred for full evaluation or early intervention services at the same rate as their White peers (Major et al., 2020. Autism, 24, 1629-1638; Smith et al., 2020. Pediatrics, 145, S35-S46.). Black 8-year-olds identified as autistic still experience disparate educational placements (Waitoller et al., 2010. The Journal of Special Education. 44, 29-49.) where services may not be autism-specific or have Individual Education Plan goals only focused on "behavior problems" (Severini et al., 2018. Journal of Autism and Developmental Disorders, 48, 3261-3272.), are served in the most restrictive environments (Skiba et al., 2006. Exceptional Children, 72, 411-424.) and lack consistent augmentative and alternative communication support (Pope et al., 2022. American Journal of Speech-Language Pathology, 31, 2159-2174.). Additionally, ADMM researchers report consistent disparities in the identification of co-occurring intellectual disability where Black autistic children have significantly more co-occurrences than White autistic children. The purpose of this commentary is to first examine the assertion that the narrowed gap indicates, "…improved…access to services among historically underserved groups," (p. 9) (Maenner et al., 2023. Morbidity and Mortality Weekly Report. Surveillance Summaries (Washington, D.C.: 2002), 72, 1-14.). We will then recommend strategies to address the ongoing disparities.

The influence of loss to follow-up in autism screening research: Taking stock and moving forward

BACKGROUND

How best to improve the early detection of autism spectrum disorder (ASD) is the subject of significant controversy. Some argue that universal ASD screeners are highly accurate, whereas others argue that evidence for this claim is insufficient. Relatedly, there is no clear consensus as to the optimal role of screening for making referral decisions for evaluation and treatment. Published screening research can meaningfully inform these questions-but only through careful consideration of children who do not complete diagnostic follow-up.

METHODS

We developed two simulation models that re-analyze the results of a large-scale validation study of the M-CHAT-R/F by Robins et al. (2014, Pediatrics, 133, 37). Model #1 re-analyzes screener accuracy across six scenarios, each reflecting different assumptions regarding loss to follow-up. Model #2 builds on this by closely examining differential attrition at each point of the multi-step detection process.

RESULTS

Estimates of sensitivity ranged from 40% to 94% across scenarios, demonstrating that estimates of accuracy depend on assumptions regarding the diagnostic status of children who were lost to follow-up. Across a range of plausible assumptions, data also suggest that children with undiagnosed ASD may be more likely to complete follow-up than children without ASD, highlighting the role of clinicians and caregivers in the detection process.

CONCLUSIONS

Using simulation modeling as a quantitative method to examine potential bias in screening studies, analyses suggest that ASD screening tools may be less accurate than is often reported. Models also demonstrate the critical importance of every step in a detection process-including steps that determine whether children should complete an additional evaluation. We conclude that parent and clinician decision-making regarding follow-up may contribute more to detection than is widely assumed.

Reliability and validity of the Autism Screen for Kids and Youth

LAY ABSTRACT

It is important that autistic children be diagnosed as early as possible so their needs can be met and their families can gain important insights into their behavior and interact with them appropriately. However, very few autism screening instruments are appropriate for children who have outgrown early childhood. The Autism Screen for Kids and Youth (ASKY) presents parents of children aged 4-18 years with 30 items that relate to autistic behaviors as defined by the current clinical diagnostic criteria for autism spectrum disorder (DSM-5 ASD). We evaluated the Hebrew instrument's performance on 167 autistic and non-autistic children and adolescents. We found that the ASKY algorithm correctly identified 92% of the autistic individuals as "probable ASD" and correctly identified 72% of the non-autistic individuals as "probable non-ASD," with these classifications showing excellent stability over time. Using total questionnaire score instead of the algorithm improved the ASKY's ability to correctly identify autistic individuals as "probable ASD" and non-autistic individuals as "probable non-ASD" to 93% and 78%, respectively. Overall, the ASKY is a promising instrument for ASD screening of older children.

Initial Evaluation Practices to Identify Young Children with Delays and Disabilities

The value of early intervention is well demonstrated; however, less is known about the processes that initial evaluation teams use to evaluate and determine young children's eligibility for early intervention (EI) and preschool special education. The present study surveyed multidisciplinary early childhood providers (N = 1445) who conduct initial evaluations for young children. Quantitative survey data were analyzed using descriptive analyses to describe the location of initial evaluations, tools used, team membership, and approaches to eligibility determination for children with possible delays and disabilities. Evaluation practices varied greatly, but evaluation teams most often included early childhood special educators and speech and language pathologists, school psychologists or other specialists were less frequently involved. Eligibility approaches were also wide-ranging with percentage delay and standard deviation below the mean most often used; several challenges when determining eligibility were also described. Evaluations for EI and preschool special education were compared to look at variations. Statistically significant differences were found when comparing evaluations focused on eligibility for EI or preschool special education. Implications and future directions are explored.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40688-023-00467-3.

The implementation of the screening tool for autism in toddlers in Part C early intervention programs: An 18-month follow-up

LAY ABSTRACT

The early detection of autism spectrum disorder can lead to access to autism spectrum disorder-specific services that have been shown to have a large impact on a child's overall development. Although a stable diagnosis of autism spectrum disorder can be made by age 2 years, most children are not diagnosed until much later. To address this issue, this study examined the effectiveness of training Part C Early Intervention providers to use an interactive autism spectrum disorder screening tool, the Screening Tool for Autism in Toddlers. Sixty-nine providers attended a 1-day training workshop on the use of the Screening Tool for Autism in Toddlers. After the workshop, providers reported increased knowledge about recognizing the early signs of autism spectrum disorder, and about 45% of the providers reported using the Screening Tool for Autism in Toddlers with families in their caseloads 18 months after the training. These results suggest that the Screening Tool for Autism in Toddlers is feasible for use within Early Intervention settings. In addition, they suggest that specific providers might serve as a screening "point-person," rather than expecting the Screening Tool for Autism in Toddlers to be used by all providers. Future research should aim to identify specific characteristics of agencies or providers that might be best suited for using the Screening Tool for Autism in Toddlers.

Balancing Fidelity and Flexibility: Usual Care for Young Children With an Increased Likelihood of Having Autism Spectrum Disorder Within an Early Intervention System

Naturalistic developmental behavioral interventions (NDBIs) are evidence-based interventions for young children with autism spectrum disorder. There has been growing interest in implementing manualized NDBIs within the early intervention (EI) system without a clear understanding of how these programs and the broader strategies encompassed within them are already used by EI providers. This study examined the use of manualized NDBI programs and broader NDBI strategies within an EI system and factors that impacted their use. Eighty-eight EI providers completed a measure of NDBI program and strategy use. Thirty-three providers participated in a supplemental focus group or interview. Overall, providers described using broader NDBI strategies and the need to adapt manualized NDBI programs. Provider-, intervention-, and organization-level factors impacted their use of NDBI programs and strategies.

Short report: Call to action for autism clinicians in response to anti-Black racism

LAY ABSTRACT

Black autistic people experience anti-Black racism when interacting with service systems and the clinicians in those systems. In this article, we describe the various steps families take to get services and how anti-Black racism makes that process even harder. We discuss research that shows the negative effects of anti-Black racism in autism assessment, treatment, and quality of care. We then provide five recommendations that clinicians should follow to reduce anti-Black racism in the autism field: (1) find Black autistic people and listen to their opinions about your organization, (2) always keep learning about how your profession promotes anti-Black racism, (3) recognize that the process of a clinician learning to be culturally humble takes time and is never "complete," (4) pay attention to all of the steps that families must take to receive autism services and how these steps are even harder for Black individuals, and (5) advocate for your organization to make systems-level changes in their policies and procedures.

Deserving but not entitled: The social construction of autism spectrum disorder in federal policy

Public policies play an influential role in shaping public opinion about health conditions, who is affected by them, and potential pathways for identification and intervention. This study draws upon a social constructionist perspective of policy design and disability to examine how autism spectrum disorder (ASD) has been framed in United States federal legislation. Qualitative content analysis of autism legislation passed between 1973 and 2019 indicates that policies reinforced ASD as a largely medicalized, neurobiological condition of childhood; this was reflected in both the policy aims, sources of knowledge and groups prioritized to address ASD; and the symbolic or material resources committed (or not committed) by enacted federal legislation to specific constituencies. Policy aims of early ASD legislation were symbolic in nature, focusing predominantly on framing children with ASD as a group worthy of public recognition. More recent legislation, in contrast, conferred material resources - albeit in targeted ways. Funding for surveillance and medical research on causation, early detection, treatment, and health professional training were prioritized with little attention to either service delivery needs of individuals with ASD and their families, supports over the lifecourse, or the social factors influencing ASD.

Effectiveness of Screening in Early Intervention Settings to Improve Diagnosis of Autism and Reduce Health Disparities

IMPORTANCE

The American Academy of Pediatrics recommends referring children at elevated risk of autism spectrum disorder (ASD) for Part C early intervention (EI) services, but notes that EI services often fail to provide ASD screening.

OBJECTIVE

To evaluate the hypothesis that a multistage screening protocol for ASD implemented in 3 EI settings will increase autism detection, especially among Spanish-speaking families.

DESIGN, SETTING, AND PARTICIPANTS

Difference-in-differences analyses with propensity score weighting of a quasi-experimental design using administrative data on 3 implementation EI agencies and 9 comparison EI agencies from 2012 to 2018 provided by the Massachusetts Department of Public Health. Eligible children were aged 14 to 36 months, enrolled in EI, had no prior ASD diagnosis or medical condition precluding participation, and had parents who spoke English or Spanish. The final analytic sample included 33 326 unique patients assessed across 150 200 person-quarters.

EXPOSURES

Multistage ASD assessment protocol including ASD screening questionnaires, observational screener, and diagnostic evaluation.

MAIN OUTCOMES AND MEASURES

Increased incidence of ASD diagnoses as documented in Department of Public Health records and reductions in language-associated health care disparities.

RESULTS

Implementation of screening at 3 EI sites was associated with a significant increase in the rate of ASD diagnoses (incidence rate ratios [IRR], 1.6; 95% CI, 1.3-2.1; P < .001), representing an additional 8.1 diagnoses per 1000 children per quarter. Among Spanish-speaking families, screening was also associated with a significant increase in the rate of ASD diagnoses (IRR, 2.6; 95% CI, 1.6-4.3; P < .001), representing 15.4 additional diagnoses per 1000 children per quarter-a larger increase than for non-Spanish-speaking families (interaction IRR, 1.8; 95% CI, 1.0-3.1; P = .005). Exploratory analyses revealed that screening was associated with a larger increase in the rate of ASD diagnoses among boys (IRR, 1.8; 95% CI, 1.4-2.3; P < .001) than among girls (IRR, 1.1; 95% CI, 0.6-1.7; P = .84).

CONCLUSIONS AND RELEVANCE

In this study, associations between increased rates of ASD diagnoses and reductions in disparities for Spanish-speaking households support the effectiveness of multistage screening in EI. This study provides a comprehensive evaluation of ASD screening in EI settings as well as a rigorous evaluation of ASD screening in any setting with a no-screening comparison condition. Given that the intervention included multiple components, mechanisms of action warrant further research, as do disparities by child sex.

Reducing Barriers to Autism Screening in Community Primary Care: A Pragmatic Trial Using Web-Based Screening

OBJECTIVE

To determine whether an intervention addressing both logistical and knowledge barriers to early screening for autism spectrum disorder (ASD) increases evidence-based screening during 18-month well-child visits and primary care providers' (PCPs') perceived self-efficacy in caring for children with ASD.

METHODS

Forty-six PCPs from 10 diverse practices across four counties in Washington State participated. PCPs attended a 2-hour training workshop on early recognition and care for toddlers with ASD and use of a REDCap-based version of the Modified Checklist for Autism in Toddlers-Revised with Follow-up (webM-CHAT-R/F) that provided automated presentation and scoring of follow-up questions. Data were collected at baseline and 6 months following each county's training window. PCPs' screening methods and rates and perceived self-efficacy regarding ASD care were measured by self-report and webM-CHAT-R/F use was measured via REDCap records.

RESULTS

At follow-up, 8 of the 10 practices were using the webM-CHAT-R/F routinely at 18-month visits. The proportion of PCPs reporting routine M-CHAT screening increased from 82% at baseline to 98% at follow-up (16% increase, 95% confidence interval [CI] 3%-28%; McNemar exact P = .02). The proportion using the M-CHAT-R/F follow-up interview questions increased from 33% to 82% (49% increase, 95% CI 30%-68%, exact McNemar test, P < .001). Significant increases in self-efficacy were found for all seven areas assessed (Ps ≤ .008).

CONCLUSIONS

This brief intervention increased PCPs' self-reported valid use of the M-CHAT-R/F at 18 months and their self-efficacy regarding ASD care. Combining educational information with a web-based ASD screen incorporating the M-CHAT-R/F follow-up questions may increase universal ASD screening with improved fidelity.

A Taxonomy of Reported Harms in Pediatric Autism Spectrum Disorder Screening: Provider and Parent Perspectives

The U.S. Preventive Services Task Force (USPSTF) report on screening for Autism Spectrum Disorder (ASD) highlighted the need for research that examines the harms potentially associated with screening so as to assess the overall net benefit of universal screening. In response, this study engages qualitative, semi-structured interviews to generate a taxonomy outlining potential harms reported by parents and providers (pediatricians and Early Intervention providers) with experience in screening young children for ASD. Potential harms emerged including: physical, psychological, social, logistical/financial, opportunity cost, attrition, and exacerbation of non-targeted disparities. Respondents reported harms being experienced by the toddlers, parents, and providers. The harms reported highlight opportunities for providers to offer resources that mitigate the potential for these unintended consequences.

Rapid-cycle systems modeling to support evidence-informed decision-making during system-wide implementation

Background

To “model and simulate change” is an accepted strategy to support implementation at scale. Much like a power analysis can inform decisions about study design, simulation models offer an analytic strategy to synthesize evidence that informs decisions regarding implementation of evidence-based interventions. However, simulation modeling is under-utilized in implementation science. To realize the potential of simulation modeling as an implementation strategy, additional methods are required to assist stakeholders to use models to examine underlying assumptions, consider alternative strategies, and anticipate downstream consequences of implementation. To this end, we propose Rapid-cycle Systems Modeling (RCSM)—a form of group modeling designed to promote engagement with evidence to support implementation. To demonstrate its utility, we provide an illustrative case study with mid-level administrators developing system-wide interventions that aim to identify and treat trauma among children entering foster care.

Methods

RCSM is an iterative method that includes three steps per cycle: (1) identify and prioritize stakeholder questions, (2) develop or refine a simulation model, and (3) engage in dialogue regarding model relevance, insights, and utility for implementation. For the case study, 31 key informants were engaged in step 1, a prior simulation model was adapted for step 2, and six member-checking group interviews (n = 16) were conducted for step 3.

Results

Step 1 engaged qualitative methods to identify and prioritize stakeholder questions, specifically identifying a set of inter-related decisions to promote implementing trauma-informed screening. In step 2, the research team created a presentation to communicate key findings from the simulation model that addressed decisions about programmatic reach, optimal screening thresholds to balance demand for treatment with supply, capacity to start-up and sustain screening, and availability of downstream capacity to provide treatment for those with indicated need. In step 3, member-checking group interviews with stakeholders documented the relevance of the model results to implementation decisions, insight regarding opportunities to improve system performance, and potential to inform conversations regarding anticipated implications of implementation choices.

Conclusions

By embedding simulation modeling in a process of stakeholder engagement, RCSM offers guidance to realize the potential of modeling not only as an analytic strategy, but also as an implementation strategy.

Using latent profile analysis to evaluate the utility of a DSM-5 symptom checklist in screening children for autism spectrum disorder

Objective: Currently available screening measures for Autism Spectrum Disorder (ASD) typically do not reflect DSM-5 diagnostic criteria and generally have weak positive predictive values. These factors result in missed opportunities for early intervention, delays in diagnosis, and contribute to inefficient usage of healthcare resources by inadequately discerning those in need of comprehensive assessment. This study examined a DSM-5 ASD symptom checklist to determine whether parent-report response patterns could accurately identify which children received an ASD diagnosis. Method: Data were examined from 376 ASD evaluations in a three-year period. Latent profile analysis was used to determine if subgroups could be identified according to parent response patterns, and network analysis was implemented to examine the relationship among DSM-5 ASD criteria within each latent profile. Results: A four-profile model was best supported based on fit indices and high probability classifications. The model was largely a product of how parents responded regarding their child's sensory behavior and minimally reflected other symptomatology. Subsequent network analyses by profile indicated weak coherence among DSM-5 symptoms within all profiles. Overall, direct assessment of DSM-5 criteria based on parent report did not add diagnostic value beyond that reflected in base rates. Conclusions: Although continued refinement of ASD screening tools is needed to improve accuracy of referrals for evaluations and reduce wait time for diagnosis, this study continues to support the need for behavioral observation and formal assessment by trained clinicians. Continued development of sensitive and specific screening tools, likely with embedded behavioral and/or objective observation, is needed.

The Effect of Medical Home on Shared Decision-Making for Caregivers of Children with Emotional, Developmental, or Behavioral Health Conditions

INTRODUCTION

Known as the "pinnacle of patient-centered care," shared decision-making (SDM) is the process that enables and encourages the health care provider, the patient, and/or their caregiver (parent or guardian) to participate collaboratively in medical decisions. Prior research indicates that children with emotional, developmental, or behavioral health conditions (EDB) are less likely to attain SDM than children with other special health care needs (SHCNs). This study investigates whether the presence of a medical home reduces disparities in SDM among children with EDB when compared to children with other SHCNs and the general pediatric population.

METHODS

Using the 2016 National Survey of Children's Health, we conducted weighted descriptive statistics to investigate the prevalence of medical home and SDM for children with (1) EDB, (2) other SHCNs, and (3) no SHCNs. We then employed a nested multivariate logistic regression model to examine whether the presence of a medical home reduced the disparity between children with EDB and their counterparts.

RESULTS

Nationally, 21% of children with EDB (n = 647,274), 14.0% of children with other SHCNs (n = 1,086,068), and 13% of children with no SHCNs (n = 883,969) did not attain caregiver-reported SDM in medical care. In each of the health condition groups, the presence of a medical home significantly improved the odds of SDM (p < 0.001). Presence of a medical home also reduced the disparities observed in caregiver-reported SDM among children with EDB as compared to those with other SHCNs and no SHCNs.

DISCUSSION

Ongoing investment in medical homes may reduce disparities in SDM experienced by children with EDB.

Early Intervention Providers' Perspectives About Working with Families of Toddlers with Suspected ASD: A Qualitative Study

Part C early intervention (EI) providers are at the front line of service provision for children under 3 years old with developmental delays or disabilities. As such, they can play a key role in both the early detection of autism spectrum disorder (ASD) and the provision of ASD-specialized treatment. Focus groups were conducted with 25 EI providers from three agencies in a Northwestern U.S. county to understand their role in the identification of ASD and communication about ASD concerns to families. Results revealed the tension that providers experience between maintaining a positive and supportive relationship with families and raising the issue of possible ASD. Cultural influences affecting ASD care and suggestions for desired resources were also discussed.

Are Developmental Monitoring and Screening Better Together for Early Autism Identification Across Race and Ethnic Groups?

National Surveys of Children's Health (NSCH, 2016-2018) data were analyzed to determine if conjoint monitoring and screening showed stronger associations with children under 5 identified with ASD compared to monitoring alone, screening alone or no monitoring or screening; and investigate relationships between monitoring and screening across racial/ethnic subgroups. 86 of 332 children with ASD received their diagnosis in a timeframe suggesting potential monitoring and screening for identification purposes. Analyses showed that conjoint monitoring and screening and monitoring alone, but not screening alone, was associated with early identified ASD cases across race groups. Caution is warranted as interpreting NSCH monitoring and screening items solely for identification purposes is inaccurate in many cases. More research on monitoring with screening is needed.

Understanding How Parents Make Meaning of Their Child's Behaviors During Screening for Autism Spectrum Disorders: A Longitudinal Qualitative Investigation

A family's journey in understanding their child's behaviors in relation to Autism Spectrum Disorders (ASD) frequently begins with screening. This study aimed to characterize the interpretive processes that unfold for parents. We employed longitudinal interviews with 19 families engaged in a community-based multi-stage screening protocol. Parents participated in 1-6 interviews dependent upon children's length of engagement in the screening protocol; data were analyzed through modified grounded theory. Parents who moved towards understanding their child's behaviors as ASD expressed (1) sensitization to ASD symptoms, (2) differentiation from other developmental conditions, and (3) use of the ASD diagnosis to explain the etiology of concerning behaviors. Identifying interpretive processes involved during ASD screening provides new opportunities for shared decision-making.

The Dutch well child language screening protocol for 2-year-old children was valid for detecting current and later language problems

Aim

A little is known about predictive validity of and professionals' adherence to language screening protocols. This study assessed the concurrent and predictive validity of the Dutch well child language screening protocol for 2‐year‐old children and the effects of protocol deviations by professionals.

Methods

A prospective cohort study of 124 children recruited and tested between October 2013 and December 2015. Children were recruited from four well child clinics in urban and rural areas. To validate the screening, we assessed children's language ability with standardised language tests following the 2‐year screening and 1 year later. We assessed the concurrent and predictive validity of the screening and of protocol deviations.

Results

At 2 years, the sensitivity and specificity of the language screening were 0.79 and 0.86, and at 3 years 0.82 and 0.74, respectively. Protocol deviations by professionals were rare (7%) and did not significantly affect the validity of the screening.

Conclusion

The language screening protocol was valid for detecting current and later language problems. Deviations from the protocol by professionals were rare and did not affect the concurrent nor predictive validity of the protocol. The 2‐year language screening supports professionals working in preventive child health care and deserves wider implementation in well child care.

Implications of adverse childhood experiences screening on behavioral health services: A scoping review and systems modeling analysis

Widespread implementation of adverse childhood experiences (ACEs) screening is occurring in the United States in response to policies and practice recommendations. However, limited research has established how these screening efforts impact the health care system and ultimately health outcomes. This article examines the current knowledge base on screening in medical settings. A scoping review of articles reporting on ACEs screening and prevalence in the United States was conducted. Of the 1,643 unique studies across two decades, 12 articles meeting criteria included nine on routine screening in medical settings and three on population-based surveys. A Monte Carlo simulation model was designed to synthesize evidence, identify key areas of uncertainty, and explore service system implications. Results indicated significant heterogeneity in the proportion of respondents who reported ACEs, with 6% to 64% of patients reporting 1+ ACEs and .01% to 40.7% reporting 4+ ACEs. Gaps in the literature were identified regarding cut-scores for referrals and referral completion rates. Three scenarios, modeled based on these data and past research on behavioral health screenings in pediatric primary care, demonstrated how ACEs screening may differentially impact behavioral health care systems. Priorities for future research were highlighted to refine estimates of the likely impact of ACEs screening on health care delivery. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Toward Novel Tools for Autism Identification: Fusing Computational and Clinical Expertise

Barriers to identifying autism spectrum disorder (ASD) in young children in a timely manner have led to calls for novel screening and assessment strategies. Combining computational methods with clinical expertise presents an opportunity for identifying patterns within large clinical datasets that can inform new assessment paradigms. The present study describes an analytic approach used to identify key features predictive of ASD in young children, drawn from large amounts of data from comprehensive diagnostic evaluations. A team of expert clinicians used these predictive features to design a set of assessment activities allowing for observation of these core behaviors. The resulting brief assessment underlies several novel approaches to the identification of ASD that are the focus of ongoing research.

Assessment of Autism Symptoms From 6 to 18 Months of Age Using the Autism Observation Scale for Infants in a Prospective High-Risk Cohort

The objectives were to characterize behavioral signs of autism spectrum disorder (ASD) in younger siblings of diagnosed children (high-risk; HR) and examine classification features of the Autism Observation Scale for Infants (AOSI). Participants (501 HR and 180 low-risk [LR]) were assessed between 6 and 18 months using the AOSI and at age 3 for ASD diagnoses. Total AOSI scores differentiated HR infants later diagnosed with ASD starting at 12 months. ROC analyses identified 12- and 18-month cutoff scores associated with 0.52 sensitivity and 0.74 specificity and 0.73 sensitivity and 0.65 specificity, respectively. Although classification accuracy does not support use as a standalone screen, the AOSI identifies features associated with ASD starting at 6 months and differentiates HR infants with ASD by 12 months.

The Implementation of Screening for Adverse Childhood Experiences in Pediatric Primary Care

OBJECTIVE

To assess the implementation of screening, screening rates, and prevalence of adverse childhood experiences (ACEs) in a large integrated healthcare system.

STUDY DESIGN

Kaiser Permanente Southern California is a large integrated healthcare system with 15 medical centers/hospitals and 233 medical office buildings that serve approximately 1.5 million children. Screening for ACEs began in July 2018 at 1 medical center (Downey, Bellflower medical office) for 3- and 5-year-old well-child visits (yearly physical examination). It quickly expanded to 3 other medical centers (6 clinics in total) and now also includes the 10- and 13-year-old well-child visits.

RESULTS

Since July 2018 we have screened 3241 3-year-olds (53% of the target population), 2761 5-year-olds (53%), 545 10-year-olds (37%), and 509 13-year-olds (13%). Of the 3-year-olds who were screened, 15% had an ACEs score of 1 or higher. Of the 5-year-olds that were screened, 17.5% had an ACEs score of 1 or higher. Of the 10-year-olds, 30.5% had an ACEs score of 1 or higher and of the 13-year-olds, 33.8% had an ACEs score of 1 or higher.

CONCLUSIONS

Although we have encountered some challenges, particularly with follow-up for those screening positive for ACEs, screening was feasible. The data show an increasing trend of ACEs in 3- to 13-year-old children, highlighting the need for early education about ACEs to mitigate the effects of toxic stress.

Comparative Accuracy of Developmental Screening Questionnaires

Importance

Universal developmental screening is widely recommended, yet studies of the accuracy of commonly used questionnaires reveal mixed results, and previous comparisons of these questionnaires are hampered by important methodological differences across studies.

Objective

To compare the accuracy of 3 developmental screening instruments as standardized tests of developmental status.

Design, Setting, and Participants

This cross-sectional diagnostic accuracy study recruited consecutive parents in waiting rooms at 10 pediatric primary care offices in eastern Massachusetts between October 1, 2013, and January 31, 2017. Parents were included if they were sufficiently literate in the English or Spanish language to complete a packet of screening questionnaires and if their child was of eligible age. Parents completed all questionnaires in counterbalanced order. Participants who screened positive on any questionnaire plus 10% of those who screened negative on all questionnaires (chosen at random) were invited to complete developmental testing. Analyses were weighted for sampling and nonresponse and were conducted from October 1, 2013, to January 31, 2017.

Exposures

The 3 screening instruments used were the Ages & Stages Questionnaire, Third Edition (ASQ-3); Parents' Evaluation of Developmental Status (PEDS); and Survey of Well-being of Young Children (SWYC): Milestones.

Main Outcomes and Measures

Reference tests administered were Bayley Scales of Infant and Toddler Development, Third Edition, for children aged 0 to 42 months, and Differential Ability Scales, Second Edition, for older children. Age-standardized scores were used as indicators of mild (80-89), moderate (70-79), or severe (<70) delays.

Results

A total of 1495 families of children aged 9 months to 5.5 years participated. The mean (SD) age of the children at enrollment was 2.6 (1.3) years, and 779 (52.1%) were male. Parent respondents were primarily female (1325 [88.7%]), with a mean (SD) age of 33.4 (6.3) years. Of the 20.5% to 29.0% of children with a positive score on each questionnaire, 35% to 60% also received a positive score on a second questionnaire, demonstrating moderate co-occurrence. Among younger children (<42 months), the specificity of the ASQ-3 (89.4%; 95% CI, 85.9%-92.1%) and SWYC Milestones (89.0%; 95% CI, 86.1%-91.4%) was higher than that of the PEDS (79.6%; 95% CI, 75.7%-83.1%; P < .001 and P = .002, respectively), but differences in sensitivity were not statistically significant. Among older children (43-66 months), specificity of the ASQ-3 (92.1%; 95% CI, 85.1%-95.9%) was higher than that of the SWYC Milestones (70.7%; 95% CI, 60.9%-78.8%) and the PEDS (73.7%; 95% CI, 64.3%-81.3%; P < .001), but sensitivity to mild delays of the SWYC Milestones (54.8%; 95% CI, 38.1%-70.4%) and of the PEDS (61.8%; 95% CI, 43.1%-77.5%) was higher than that of the ASQ-3 (23.5%; 95% CI, 9.0%-48.8%; P = .012 and P = .002, respectively). Sensitivity exceeded 70% only with respect to severe delays, with 73.7% (95% CI, 50.1%-88.6%) for the SWYC Milestones among younger children, 78.9% (95% CI, 55.4%-91.9%) for the PEDS among younger children, and 77.8% (95% CI, 41.8%-94.5%) for the PEDS among older children. Attending to parents' concerns was associated with increased sensitivity of all questionnaires.

Conclusions and Relevance

This study found that 3 frequently used screening questionnaires offer adequate specificity but modest sensitivity for detecting developmental delays among children aged 9 months to 5 years. The results suggest that trade-offs in sensitivity and specificity occurred among the questionnaires, with no one questionnaire emerging superior overall.

Multi-stage Screening in Early Intervention: A Critical Strategy for Improving ASD Identification and Addressing Disparities

Health disparities in ASD detection affect children's access to subsequent interventions. We examined potential disparities in implementation of a multi-stage ASD screening and diagnostic evaluation protocol in Part C Early Intervention with 4943 children ages 14-36 months (mean 22.0 months; 62.9% boys, 73.3% children of color, 34.9% non-English-primary language, 64.5% publicly-insured). Participation and follow-through were high (64.9% and 65.3% at first- and second-stage screening, respectively, 84.6% at diagnostic evaluation). Logistic regressions identified predictors of screening participation and outcomes at each stage; demographic differences (race, language, public insurance) were observed only at first-stage screening and reflected higher participation for children of color and higher positive screens for publicly-insured children. Results suggest the multi-stage screening protocol shows promise in addressing disparities in early diagnosis.

Multi-method process maps: An interdisciplinary approach to investigate ad hoc modifications in protocol-driven interventions

INTRODUCTION

Implementation scientists increasingly recognize that the process of implementation is dynamic, leading to ad hoc modifications that may challenge fidelity in protocol-driven interventions. However, limited attention to ad hoc modifications impairs investigators' ability to develop evidence-based hypotheses about how such modifications may impact intervention effectiveness and cost. We propose a multi-method process map methodology to facilitate the systematic data collection necessary to characterize ad hoc modifications that may impact primary intervention outcomes.

METHODS

We employ process maps (drawn from systems science), as well as focus groups and semi-structured interviews (drawn from social sciences) to investigate ad hoc modifications. Focus groups are conducted with the protocol's developers and/or planners (the implementation team) to characterize the protocol "as envisioned," while interviews conducted with frontline administrators characterize the process "as realized in practice." Process maps with both samples are used to identify when modifications occurred across a protocol-driven intervention. A case study investigating a multistage screening protocol for autism spectrum disorders (ASD) is presented to illustrate application and utility of the multi-method process maps.

RESULTS

In this case study, frontline administrators reported ad hoc modifications that potentially influenced the primary study outcome (e.g., time to ASD diagnosis). Ad hoc modifications occurred to accommodate (1) whether providers and/or parents were concerned about ASD, (2) perceptions of parental readiness to discuss ASD, and (3) perceptions of family service delivery needs and priorities.

CONCLUSION

Investigation of ad hoc modifications on primary outcomes offers new opportunities to develop empirically based adaptive interventions. Routine reporting standards are critical to provide full transparency when studying ad hoc modifications.

Is the Autism Boom Headed for Medicaid? Patterns in the Enrollment of Autistic Adults in Wisconsin Medicaid, 2008-2018

Our primary objective was to describe demographic characteristics and enrollment patterns in a unique 11-year full sample of adult Wisconsin Medicaid beneficiaries with identified autism spectrum disorder (ASD) or intellectual disability (ID). We obtained de-identified Medicaid claims data for adults with a recorded ASD or ID diagnosis aged 21 and older with any Medicaid fee-for-service claims between January 1, 2008 and December 31, 2018. We assessed enrollment, age, number of visits, and paid amount per year using generalized linear models with a random intercept for each beneficiary. We identified claims for 4,775 autistic adults without ID, 2,738 autistic adults with ID, 14,945 adults with ID, and 3,484 adults with Down syndrome. The age distribution of the diagnostic group with ASD diagnoses was right skewed with a majority of beneficiaries less than age 30. The ASD without ID diagnostic group had the least visits and paid amount per person per year compared to other groups. In each age category, the ASD with ID diagnostic group had the most paid amount per person per year compared to other groups. It is urgent that we identify the health and health service needs of autistic adults from young adulthood through old age. Our findings have implications for ensuring adequate health coverage across the lifespan and highlight the importance of a strong and accessible health care system for autistic people. Autism Res 2019, 12: 1541-1550. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Medicaid provides health insurance to disabled people who meet income requirements. We assessed patterns of enrollment and service use among autistic adults and adults with developmental disabilities in Wisconsin Medicaid. We found a consistent influx of new young autistic adults without intellectual disability into the Medicaid system, with fewer visits and lower paid amounts compared to other developmental disability groups. The changing population of autistic people using Medicaid has implications for providing health care to autistic adults in the future.

Stability of Autism Spectrum Disorder in Young Children with Diverse Backgrounds

Determining diagnostic stability of ASD, as well stability of functioning in early childhood, is relevant to prevalence, best practices for communicating early ASD diagnoses to caregivers, families' experiences, and developmental trajectories. Generalizability of findings from prior research has been limited by small and homogenous samples, short follow-up time intervals, and inconsistent diagnostic procedures. This report presents follow-up evaluations of 60 children (86.7% male, mean age: 51.3 months) with diverse backgrounds (79.7% racial/ethnic minorities) who received initial ASD diagnoses before 36 months of age (mean age: 27 months). Fifty-three children (88.3%) met diagnostic criteria for ASD at follow-up, a proportion consistent with previous studies. On average, children demonstrated significant cognitive gains and ASD symptom improvement. Clinical implications of findings are discussed.