Measuring Change During Intervention Using Norm-Referenced, Standardized Measures: A Comparison of Raw Scores, Standard Scores, Age Equivalents, and Growth Scale Values From the Preschool Language Scales-Fifth Edition

Unsupervised Screen Exposure and Poor Language Development: A Scoping Review to Assess Current Evidence and Suggest Priorities for Research

Screen exposure has both negative and positive effects on the level of language skills a child acquires. The purpose of this review is to address current literature on the possible relationship between unsupervised screen exposure and language development in children and to provide recommendations to caregivers regarding screen exposure of children, taking into consideration the possible effects. A scoping review was conducted using the PubMed/MEDLINE (Medical Literature Analysis and Retrieval System Online) database. A total of 590 articles were retrieved and considered for inclusion. Twenty-one articles were finally included and reviewed with an emphasis on language, communication, and executive skills as well as cognitive development. The negative effects of screen exposure for children outweigh the positive effects. The largest number of studies demonstrate that unsupervised screen exposure may negatively impact a child's language usage and cognitive and executive skills, disrupt playtime, and affect the quality of sleep. On the other hand, supervised screen use is associated with improved language skills. More evidence is needed on unsupervised exposure in children to new types of screens. As technology could play a significant role in schools in the future, additional research is required to create educational media for schoolchildren with specific guidelines.

Ability change across multiple domains in mucopolysaccharidosis (Sanfilippo syndrome) type IIIA

The objective of this paper is 1) to expand the scope of the domains previously published in a natural history study of Mucopolysaccharidosis IIIA (Sanfilippo syndrome type A) (MPS IIIA) and 2) to present evidence regarding the capacity of a new metric, Growth Scale Values (GSVs), in comparison with traditional metrics, to show changes in skills as assessed by the Bayley Scales of Infant Development -III (BSID-III) and the Vineland Adaptive Behavior Scales, Second Edition (VABS-II). We re-analyzed a cohort of 25 children, 20 with rapid progressing disease and 5 with slow progression, who had been followed over two years using the BSID-III, and the VABS-II. Previously findings were reported using age equivalent scores; now we are also presenting findings with GSVs. For the re-analysis, Language and Motor scores were added to the Cognitive scale on the BSID-III, and Domain- and Subdomain-level scores added to the Total VABS-II score (i.e., ABC Composite). We evaluated raw scores, age equivalent scores, and GSVs (and standard scores for the VABS-II only). Individual patient data can be found in the appendices to this publication. Results indicate that 1) Cognition as measured by GSVs was the most sensitive to decline; 2) GSVs showed significant decline in the range of 4 to 6 years of age; 3) For children under 4 years of age, positive growth occurs on most scales and most metrics, with the exception of language which slows somewhat earlier; 4) Other than the Cognitive scale, Receptive Language on the BSID-III and Receptive Communication on the VABS-II showed the most sensitivity to change; 5) Gross Motor skills showed the least decline over time and appeared to lack sensitivity to MPS IIIA motor concerns; and 6) No evidence for sensitivity to change for any metric was found in time intervals less than one year. We conclude that GSVs are a precise measurement of change to detect decline in function, and they are a valuable method for future clinical trials in MPS IIIA. Evidence continues to support cognition as a primary endpoint. Additional work is needed to identify sensitive measures of meaningful endpoints to families.

The Use of Telepractice to Administer Norm-Referenced Communication and Cognition Assessments in Children With Hearing Loss: A Rapid Review

PURPOSE

Telepractice administration of norm-referenced assessments of communication and cognition is relatively new, and evidence to support this practice for children with hearing loss is limited. This rapid review examines the validity, reliability, feasibility, and common features of telepractice-administered norm-referenced assessments of communication and cognition for children with hearing loss to determine whether results via telepractice-administration are usable.

METHOD

This rapid review was conducted in accordance with the Cochrane Collaboration Rapid Reviews Methods Group recommendations. Rayyan software was used for initial and full-text screening, and the Quality Assessment of Diagnostic Accuracy Studies was used to measure study quality.

RESULTS

Electronic databases searches identified two studies that met the eligibility criteria. The findings of this rapid review provide some evidence to indicate that results of norm-referenced assessments do not differ depending on test administration conditions or hearing group status. Although both studies were of sufficient quality, replicability of these studies is uncertain due to the limited description of telepractice administration procedures. Participants indicated that sound levels provided by inbuilt computer speakers were adequate for them to be able to participate in telepractice assessment.

CONCLUSION

Telepractice administration of the norm-referenced assessments in the included studies may be valid, reliable, and feasible; however, the generalizability of these findings to other norm-referenced assessments is uncertain due to the limited amount of research.

Understanding Internalizing and Externalizing Behaviors in Autistic Toddlers

PURPOSE

The majority of autistic toddlers present with clinically significant levels of internalizing or externalizing behaviors. Despite the prevalence of internalizing and externalizing behaviors in caseloads, the overwhelming majority of speech-language pathologists (SLPs) have not received specialized instruction in how to support children with these behaviors. The purpose of this study was to identify which child and caregiver characteristics are most associated with internalizing and externalizing behaviors in autistic toddlers in order to consider how SLPs may tailor their treatment to better support the individual needs of autistic children.

METHOD

Participants included 109 mothers and their autistic children between 18 and 48 months of age. This study was a secondary analysis of data from a randomized clinical trial. Participants' baseline data included a variety of child (i.e., expressive language, receptive language, restricted and repetitive behavior [RRB], and nonverbal cognition) and caregiver (i.e., self-efficacy and responsiveness) characteristics. Seemingly unrelated regressions were conducted to determine which characteristics were associated with internalizing and externalizing behaviors in autistic toddlers.

RESULTS

Higher RRB scores were associated with both higher internalizing and externalizing behavior scores. A lower nonverbal cognition score was also associated with higher internalizing behavior scores but to a lesser extent than RRB.

CONCLUSION

These findings suggest that SLPs may support internalizing and externalizing behaviors in autistic children by taking RRBs and nonverbal cognition into consideration.

Adaptive Skills of Individuals with Angelman Syndrome Assessed Using the Vineland Adaptive Behavior Scales, 2nd Edition

In the current study, we examined adaptive skills and trajectories over time in 257 individuals with Angelman syndrome (AS) using the Vineland Adaptive Behavior Scales, 2nd Edition. Multilevel linear models were used to examine differences between molecular subtypes over time, from one year to 13 years of age, in the adaptive domains of communication, daily living skills, socialization and motor skills. Individuals with non-deletion subtypes typically demonstrated a higher level of adaptive skills compared to those with deletion subtypes. Statistically significant growth was observed in all adaptive domains through at least early adolescence. Individuals with AS should continue to receive developmental services and educational supports through adolescence and into adulthood given the slow rates of growth being observed across adaptive domains.

Parent Certainty and Consistency When Completing Vocabulary Checklists in Young Autistic Children

PURPOSE

Using a novel parent report measure, this study investigated whether asking parents to rate their certainty when reporting on child vocabulary skills provided additional insight into parent report and emerging language abilities in young autistic children. Specifically, we investigated whether parent certainty varied based on whether the child was reported to understand, understand and say, or neither understand nor say the word and whether standardized measures of expressive and receptive language abilities and/or autistic traits predicted parent certainty. Lastly, we investigated whether certainty was associated with inconsistency in parent report of child word knowledge.

METHOD

Twenty-one parents and their autistic children ages 2-5 years participated. One parent per child completed the MacArthur-Bates Communicative Development Inventories (MCDI) Words and Gestures form and a custom vocabulary checklist including 24 object nouns from the MCDI. Within the custom form, parents indicated whether their child understood, understood and said, or neither understood nor said 24 target nouns and reported how certain they were about their responses using a 5-point scale. Expressive language, receptive language, and autistic traits were measured via direct assessment using standardized measures.

RESULTS

Parent certainty varied widely and was higher for words the parents reported the children understood and said compared to that for words children either understood or neither understood nor said. Certainty ratings were higher when a child had higher standardized receptive and expressive language scores. Lastly, parent certainty was associated with reporting consistency, clarifying previous findings of inconsistencies in parent report of child vocabulary.

CONCLUSION

Findings from this study indicate that measuring parent certainty provides critical information when assessing early vocabulary skills in autistic children.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.23671497.

Comparing ability and norm-referenced scores as clinical trial outcomes for neurodevelopmental disabilities: a simulation study

BACKGROUND

For genetic conditions associated with neurodevelopmental disorder (GCAND), developmental domains such as motor ability, thinking and learning, social abilities, and communication are potential intervention targets. Performance on measures of developmental concepts can be expressed using several types of scores. Norm-referenced scores are intended for the diagnostic context, allowing for the identification of impairment relative to age-based expectations, and can exhibit dramatic floor effects when used in individuals with more significant limitations. Person ability scores, which are derived via Rasch analysis or item response theory, are available on many standardized tests and are intended to measure within-person change. However, they have not been used or evaluated as primary endpoints in GCAND clinical trials. In this study, we simulated a series of parallel-arm clinical trials under several chronological age and impairment conditions, to compare empirically the power and type I error rate of operationalizing test performance using ability scores rather than norm-referenced scores.

RESULTS

Using the Vineland Adaptive Behavior Scales as the example, we demonstrated an advantage in statistical power of ability scores over norm-referenced scores at extreme levels of impairment. This advantage was at least partially driven by floor effects in norm-referenced scores. For simulated conditions where impairment was less severe, ability scores outperformed norm-referenced scores, but they were more similar. The type I error rate closely approximated the nominal type I error rate of 5% for both scores.

CONCLUSION

The results of this simulation demonstrate a substantial power and interpretative advantage of ability scores over norm-referenced scores for studies of GCAND that will enroll participants with high levels of impairment. These results are expected to generalize to studies of developmental concepts, regardless of the etiology or specific test. However, the relative advantage of ability scores is expected to be even greater for tests with a higher floor than the Vineland.