National Study of School Psychologists’ Use of Evidence-Based Assessment in Autism Spectrum Disorder

The Intersection of Systemic, Child, and Evaluation Factors in the Prediction of Autism Special Education Eligibility; Examining the Role of Race and Ethnicity

Though there is evidence autism identification has been inequitable for populations who are culturally and linguistically minoritized, there is limited research that explains the issue of disproportionality and factors contributing to its occurrence, especially within an educational setting. To explore contributors to racial/ethnic disparities in autism special education eligibility, the current investigation evaluated child and evaluation characteristics as they relate to the absence of autism eligibility. Data were obtained from the Autism and Developmental Disabilities Monitoring (ADDM) Network Study and included children with behavioral characteristics consistent with autism and educational evaluation records. Despite documented characteristics consistent with autism, only 72% of the sample received educational services under autism eligibility. To characterize children without autism eligibility, hierarchical logistic regression was used to evaluate factors documented in evaluation records predicting the absence of autism eligibility. Factors influencing autism eligibility included behavioral characteristics documented, evaluation components completed, intellectual ability, and clinical diagnoses present. There was no unique contribution of race/ethnicity in predicting the absence of autism eligibility when accounting for these previous predictors, but many of these predictors differed by racial/ethnic group. Disproportionality in autism may be the manifestation of inequitable evaluation experiences, including experiencing less comprehensive evaluations, and not receiving an autism specific assessment. Though race/ethnicity did not uniquely contribute to the absence of autism eligibility above and beyond those combined factors, it is important to evaluate and reduce inequities experienced within the autism identification process for populations who are culturally and linguistically minoritized.

Cognitive Profile in Autism and ADHD: A Meta-Analysis of Performance on the WAIS-IV and WISC-V

OBJECTIVE

Previous research has suggested that neurodevelopmental conditions may be associated with distinctive cognitive profiles on the Wechsler intelligence tests (of which the most recent editions are the WAIS-IV and WISC-V). However, the extent to which a cognitive profile can be reliably identified for individuals meeting criteria for autism or ADHD remains unclear. The present review investigated this issue.

METHOD

A search was conducted in PsycInfo, Embase, and Medline in October 2022 for papers reporting the performance of children or adults diagnosed with autism or ADHD on the WAIS-IV or the WISC-V. Test scores were aggregated using meta-analysis.

RESULTS

Scores were analyzed from over 1,800 neurodivergent people reported across 18 data sources. Autistic children and adults performed in the typical range for verbal and nonverbal reasoning, but scored ~1 SD below the mean for processing speed and had slightly reduced scores on working memory. This provides evidence for a "spiky" cognitive profile in autism. Performance of children and adults with ADHD was mostly at age-expected levels, with slightly reduced scores for working memory.

CONCLUSION

Although the pattern of performance on the Wechsler tests is not sufficiently sensitive or specific to use for diagnostic purposes, autism appears to be associated with a cognitive profile of relative strengths in verbal and nonverbal reasoning and a weakness in processing speed. Attention deficit hyperactivity disorder appears less associated with a particular cognitive profile. Autistic individuals may especially benefit from a cognitive assessment to identify and support with their strengths and difficulties.

Characteristics of students who require elementary school counselors' support owing to developmental disorders

Awareness and support for developmental disorders are increasing in Japan. In the education field, support from school counselors for students with developmental disorders and their roles and responsibilities in elementary schools are on the rise. However, identifying and addressing specific conditions and developmental disorders that require school counselors' attention are not clearly planned. Therefore, this study explored the characteristics of students who require elementary school counselors' support owing to developmental disorders. The participants included 17 school counselors who were experienced in working at elementary schools. Through semi-structured interviews, 30 cases were discussed, examined, and categorized based on "case characteristics," "classification of the main complaint," "basic information on the diagnosis," and "type of support." The analysis included detailed viewpoints of 13 school counselors, a code frequency table, and contrast tables, focusing on the main complaint and diagnosis. Regarding the children whose main complaint was "school refusal," eight out of nine cases were in the fourth grade or above, with several cases of suspected developmental disorders or autism spectrum disorder. The number of children with comorbid attention-deficit hyperactivity disorder, including suspected cases, seemed to be higher, especially in Grades 3-5. The study highlighted the importance of assessing students' developmental characteristics related to the main complaint in the background of a secondary problem. Furthermore, early detection and interventions should be conducted in the first and second grades.

Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children

This paper describes a process to define a comprehensive list of exemplars for seven core Diagnostic and Statistical Manual (DSM) diagnostic criteria for autism spectrum disorder (ASD), and report on interrater reliability in applying these exemplars to determine ASD case classification. Clinicians completed an iterative process to map specific exemplars from the CDC Autism and Developmental Disabilities Monitoring (ADDM) Network criteria for ASD surveillance, DSM-5 text, and diagnostic assessments to each of the core DSM-5 ASD criteria. Clinicians applied the diagnostic exemplars to child behavioral descriptions in existing evaluation records to establish initial reliability standards and then for blinded clinician review in one site (phase 1) and for two ADDM Network surveillance years (phase 2). Interrater reliability for each of the DSM-5 diagnostic categories and overall ASD classification was high (defined as very good .60-.79 to excellent ≥ .80 Kappa values) across sex, race/ethnicity, and cognitive levels for both phases. Classification of DSM-5 ASD by mapping specific exemplars from evaluation records by a diverse group of clinician raters is feasible and reliable. This framework provides confidence in the consistency of prevalence classifications of ASD and may be further applied to improve consistency of ASD diagnoses in clinical settings.

Addressing the Need for Training More School Psychologists to Serve Toddlers and Preschoolers with Autism Spectrum Disorders

The prevalence of autism spectrum disorder (ASD) has risen significantly in the past two decades. Unfortunately, there is a shortage of mental health providers who have specialized training in delivering evidenced-based services to this population. Early intensive behavioral intervention (EIBI) is an evidenced-based treatment recommended for toddlers with ASD, and school psychologists are uniquely positioned to help children with ASD receive it. However, many school psychologists do not receive adequate training in this subspecialty. This paper makes recommendations to school psychology training programs about how to add or improve training in this subspecialty based on the results of an Office of Special Education Programs grant-funded ASD training program which involved collaboration between a NASP-approved and APA-accredited school psychology training program and a community-based early intensive behavioral intervention (EIBI) clinic. The grant supported development of an interdisciplinary didactic and clinical training program to increase the ASD knowledge, skills, and competencies of school psychology graduate students, with the broader goals of developing a replicable training model and increasing the workforce of trained providers for this underserved population. Fifteen graduate students completed the training program. Outcomes related to trainee knowledge, skills, and competencies, trainee satisfaction, and lessons learned over time analyzed within a logic model that guided the project's development and execution can be informative for other school psychology programs undertaking training in this subspecialty.

Comparison of Verbal Performance of Children with Autism Spectrum Disorder on the WISC-V

Children with autism spectrum disorder (ASD) display variable verbal cognitive profiles despite a historical requirement for a language delay in autistic disorder. This study compared the Verbal Comprehension Index (VCI) to the newly created ancillary index score, the Verbal Expanded Crystallized Index (VECI) of the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V) in a group of children with ASD. Using the ASD sample from the standardization data of the WISC-V, results indicated the VCI and VECI were significantly different for the ASD group but not for the matched controls. Follow up analysis of the ASD group revealed the VCI and VECI were significantly different for those with language impairment but not for those without language impairment. Psychologists should consider administering all verbal subtests of the WISC-V to children with ASD given the VECI may better capture the language impairment seen in this population.

Diagnostic Utility of the Gilliam Autism Rating Scales-3rd Edition Parent Report in Clinically Referred Children

There is limited research regarding the Gilliam Autism Rating Scales-3rd Edition (GARS-3) despite its extensive use. A comprehensive diagnostic evaluation, including the Autism Diagnostic Observation Schedule-2nd Edition (ADOS-2) was provided to 186 clinically referred children suspected of autism ([Formula: see text] age = 8.98; Autism [AUT] n = 87; Not Autism [NOT] n = 99). Mean difference analyses, Logistic Regressions, and ROC analyses were non-significant for both Autism Index scores. The author-suggested cutoff score of 70 correctly classified approximately 47% of participants, with false positive rates = 82.83-87.88%. ADOS-2 correlations were significantly lower vis-à-vis the standardization sample. The Social Interaction subscale demonstrated weak, marginal results, and sensitivity/specificity could not be optimized. In its current form, the GARS-3 does not demonstrate adequate criterion validity for use in assessment of complex community samples.

CLEAR Autism Diagnostic Evaluation (CADE): Evaluation of Reliability and Validity

Recent surveillance efforts indicate that 1 in 54 American children meet the criteria for Autism Spectrum Disorder (ASD), making it the fastest growing neurodevelopmental disorder in the U.S. Despite evidence that ASD can be reliably diagnosed as early as 24 months, the median age at ASD diagnosis in 2016 in the U.S. was 51 months. The CLEAR Autism Diagnostic Evaluation (CADE; Willard & Kroncke, 2019), was developed in response to the need to improve, shorten, and standardize the clinical ASD evaluation process. The CADE is a 33-item rating scale designed to be completed by caregivers and clinicians. The current study was conducted to examine the reliability and validity of the CADE using a sample of 191 individuals who received a private evaluation for ASD. Using the client's evaluation records, clinicians completed the CADE items. The coefficient alpha was .94, which indicates that the items form a scale that has high internal consistency. The CADE total scores were highly correlated with ADOS scores, with r values ranging from .52-.86, and discriminated between those participants with a diagnosis of ASD and those without (p < .001). Receiver operator characteristic (ROC) curve analyses indicated excellent diagnostic accuracy of the CADE total score (ROC area under the curve = .998). Results suggest that the CADE can be used as an efficient and accurate means of evaluating ASD. Limitations and implications for use of the CADE are discussed.

Examination of professional biases about autism: how can we do better?

This paper lends a critical eye to six common assumptions/biases about autism that may influence neuropsychologists in their clinical work. These biases are based on research as well as the historical roots of the study of autism. Our goal is to encourage curiosity and reflection on these biases in order to improve neuropsychological service delivery for people on the autism spectrum. Methods: We argue that psychologists should strive to understand the function of behaviours observed with autism in order to offer helpful supports. We explore the assertions that autism is not a dichotomous or linear construct and that the use of high and low functioning descriptors are not useful nor appreciated by the autism community. We discuss the widely held beliefs that individuals on the autism spectrum lack theory of mind, empathy and social motivation. Importantly, people on the autism spectrum are telling us that the dialogue about them around theory of mind and empathy is a human rights issue. Finally, we discuss the role of standardized testing. Conclusions: Through an exploration of research literature, the writings of scholars and advocates on the autism spectrum, and personal, clinical and research experience we encourage our profession to take a leadership role in examining biases and changing the clinical and research landscape so that it better reflects respectful discourse for individuals on the autism spectrum. This is critical to reduce the stigma that continues to be associated with autism and has a negative affect on mental health and quality of life.

Survey of training experiences and clinical practice in assessment for autism spectrum disorder by neuropsychologists

OBJECTIVE

The primary purpose of this study is to better understand current practices in the assessment of autism spectrum disorder (ASD) by neuropsychologists.

METHODS

A 21-item survey regarding ASD assessment beliefs and practices was sent via email through neuropsychology listservs. The survey was accessed by 445 licensed psychologists who identified as neuropsychologists. A total of 367 surveys were deemed usable for data analysis. Descriptive statistics were used to characterize the full sample. Exploratory analyses were conducted between groups of interest, including primary population served (pediatric, adult, or lifespan), primary practice setting (medical center vs. private practice) and years in practice (< 5 years, 5 to 14 years, or 15+ years).

RESULTS

Respondents were well-distributed across age range, years in practice, primary practice setting, and primary practice location. Almost all respondents (most of whom self-identified as pediatric-focused clinicians) believe that neuropsychologists should be able to competently rule in or out ASD and most received training in ASD assessment. Approximately 40% of respondents endorsed wanting more training in ASD assessment to increase their competence and confidence in making this differential diagnosis. Minimal differences in ASD beliefs and assessment practices were seen across years of practice or primary practice setting. Pediatric and lifespan clinicians had similar experience with ASD assessment practices, and both generally differed from adult clinicians.

CONCLUSIONS

Our findings suggest many respondents desire further specialty ASD training for neuropsychologists. Additionally, the large majority of respondents indicated that future neuropsychologists should receive training in ASD assessment during graduate school, internship and/or post-doctoral fellowship.

Wechsler Intelligence Scale for Children, Fifth Edition Profiles of Children With Autism Spectrum Disorder Using a Classification and Regression Trees Analysis

The Wechsler Intelligence Scales for Children (WISC) are the most widely used instrument in assessing cognitive ability, especially with children with autism spectrum disorder (ASD). Previous literature on the WISC has demonstrated a divergent pattern of performance on the WISC for children ASD compared to their typically developing peers; however, there is a lack of research concerning the most recent iteration, the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V). Due to the distinctive changes made to the WISC-V, we sought to identify the pattern of performance of children with ASD on the WISC-V using a classification and regression (CART) analysis. The current study used the standardization sample data of the WISC-V obtained from NCS Pearson, Inc. Sixty-two children diagnosed with ASD, along with their demographically matched controls, comprised the sample. Results revealed the Comprehension and Letter-Number Sequencing subtests were the most important factors in predicting group membership for children with ASD with an accompanying language impairment. Children with ASD without an accompanying language impairment, however, were difficult to distinguish from matched controls through the CART analysis. Results suggest school psychologists and other clinicians should administer all primary and supplemental subtests of the WISC-V as part of a comprehensive assessment of ASD.

Educational and Diagnostic Classification of Autism Spectrum Disorder and Associated Characteristics

Research continues to highlight discrepancies between clinical diagnoses of Autism Spectrum Disorder (ASD) and determination of special education eligibility for services within school settings. However, limited research has been conducted on the impact of those discrepancies for the identification of appropriate services within schools. The aim of the current study is to examine students' characteristics (e.g., language, social emotional) associated with educational eligibility and clinical diagnoses. More specifically, the study examines characteristics differentially associated with ASD diagnoses to inform targeted evidence-based interventions. The study accessed data from a four-year cluster-randomized trial of 283 students with and without reported ASD diagnosis. The results of the study demonstrate that the educational eligibility of Autism did not differentiate between students with and without autism on any of the measured characteristics including language, peer and social competence, academics, and aggressive behaviors. However, the Autism Diagnostic Observation Schedule, second edition (ADOS-2; Lord et al. in Autism diagnostic observation schedule. Western Psychological Services, Torrance, CA, 2012) classification was a more sensitive diagnostic measure for characteristics associated with autism. Implications for research, practitioners, and schools are discussed.

School-Based Autism Rates by State: An Analysis of Demographics, Political Leanings, and Differential Identification

We reviewed federal special education data to determine school-identified prevalence of Autism Spectrum Disorder (ASD) and other disability categories by U.S. state. We also examined whether state-level policies, demographic factors, and rates of other eligibility categories are predictive of these state ASD rates. Results indicate that overall, 1 of 81 school-aged children are served under an ASD special education eligibility. State-level demographic factors, such as socioeconomic status and political leanings were highly predictive of rates of ASD. States with higher rates of ASD had lower rates of intellectual and learning disabilities, but higher rates of Other Health Impairment (OHI).

DAS-II Cognitive Profiles Are Not Diagnostically Meaningful For Autism: A ROC Analysis

Intelligence assessment is an integral part of a comprehensive autism evaluation. Many past studies have described a cognitive profile of autistic individuals characterized by higher nonverbal than verbal IQ scores. The diagnostic utility of this profile, however, remains unknown. We leveraged receiver operating characteristic methods to determine the sensitivity, specificity, and area under the curve (AUC) of three different IQ profiles in a large sample of children who have an autism spectrum disorder diagnosis (N = 1,228, Simons Simplex Collection) who completed the Differential Ability Scales-Second Edition (DAS-II), School Age compared to the normative sample provided by the DAS-II publisher (N = 2,200). The frequently discussed nonverbal > verbal IQ profile performed near chance at distinguishing ASD from normative individuals (AUC: 0.54, 95% CI [0.52-0.56]), and performed significantly worse for females than males (AUC: females: 0.46 [0.41-0.52]; males: 0.55 [0.53-0.58]). All cognitive profiles showed AUC < 0.56. We conclude that while significant differences between verbal and nonverbal IQ scores exist at the group level, these differences are small in an absolute sense and not meaningful at an individual level. We do not recommend using cognitive profiles to aid in autism diagnostic decision-making. LAY SUMMARY: Some researchers and clinicians have reported an "autistic cognitive profile" of higher nonverbal intelligence than verbal intelligence. In an analysis of over 1,000 autistic children, we found that the group's average nonverbal intelligence is usually higher than their verbal intelligence. However, this pattern should not be used by clinicians to make an individual diagnosis of autism because our results show it is not helpful nor accurate.

Concordance between a U.S. Educational Autism Classification and the Autism Diagnostic Observation Schedule

States in the United States differ in how they determine special education eligibility for autism services. Few states include an autism-specific diagnostic tool in their evaluation. In research, the Autism Diagnostic Observation Schedule (ADOS for first edition, ADOS-2 for second edition) is considered the gold-standard autism assessment. The purpose of this study was to estimate the proportion of children with an educational classification of autism who exceed the ADOS/ADOS-2 threshold for autism spectrum (concordance rate). Data were drawn from 4 school-based studies across 2 sites (Philadelphia, Pennsylvania, and San Diego, California). Participants comprised 627 children (2-12 years of age; 83% male) with an autism educational classification. Analyses included (a) calculating the concordance rate between educational and ADOS/ADOS-2 classifications and (b) estimating the associations between concordance and child's cognitive ability, study site, and ADOS/ADOS-2 administration year using logistic regression. More San Diego participants (97.5%, all assessed with the ADOS-2) met ADOS/ADOS-2 classification than did Philadelphia participants assessed with the ADOS-2 (92.2%) or ADOS (82.9%). Children assessed more recently were assessed with the ADOS-2; this group was more likely to meet ADOS/ADOS-2 classification than the group assessed longer ago with the ADOS. Children with higher IQ were less likely to meet ADOS/ADOS-2 classification. Most children with an educational classification of autism meet ADOS/ADOS-2 criteria, but results differ by site and by ADOS version and/or recency of assessment. Educational classification may be a reasonable but imperfect measure to include children in community-based trials.

Are school psychologists' special education eligibility decisions reliable and unbiased?: A multi-study experimental investigation

Nearly 50 years of research show persistent racial disproportionality in the identification of special education disabilities, but the underlying mechanisms for these disparities remain largely unexplored. Because ambiguous regulations defining disabilities may allow subjectivity and unlawful differential treatment (i.e., racial bias or discrimination) in the special education eligibility process, an important target of study is disparate treatment of students by race in evaluations required to determine eligibility. School psychologists have long been recognized as highly influential in this process and in schools' resultant decisions. We used a 3 × 2 mixed factorial experimental design in three studies with simulated case report data to measure the influence of race and assessment data on school psychologists' perceptions of students' eligibility for special education in cases centering on emotional disturbance, intellectual disability, or autism, respectively. Participants included 302 practicing school psychologists in three states across the three experiments. There was little evidence of racial disparity, but participants tended to render decisions unsupported by, and even contrary to, evaluation data. Implications for research, practice, and professional development are discussed.

Evaluation of the Autism Spectrum Rating Scales in a Diverse, Nonclinical Sample

Despite the changing racial/ethnic demographics in the United States, few studies exist that evaluate autism spectrum disorder (ASD) screening and diagnostic assessment measures for their cultural and linguistic responsiveness. The purpose of this study was to evaluate the structure of the Autism Spectrum Rating Scales (ASRS) in a diverse sample of parents with children (nonclinical sample) between the ages of 6 and 18 years ( N = 405). Confirmatory factor analyses, factor correlations, and the evaluation of item loadings were used to examine the structure of the ASRS across cultural groups. Results yielded cross-cultural differences. Implications and directions for future research are discussed.