Investigation of the language tasks to include in a short-language measure for children in the early school years

Systematic Review and Meta-Analysis of Screening Tools for Language Disorder

Language disorder is one of the most prevalent developmental disorders and is associated with long-term sequelae. However, routine screening is still controversial and is not universally part of early childhood health surveillance. Evidence concerning the detection accuracy, benefits, and harms of screening for language disorders remains inadequate, as shown in a previous review. In October 2020, a systematic review was conducted to investigate the accuracy of available screening tools and the potential sources of variability. A literature search was conducted using CINAHL Plus, ComDisCome, PsycInfo, PsycArticles, ERIC, PubMed, Web of Science, and Scopus. Studies describing, developing, or validating screening tools for language disorder under the age of 6 were included. QUADAS-2 was used to evaluate risk of bias in individual studies. Meta-analyses were performed on the reported accuracy of the screening tools examined. The performance of the screening tools was explored by plotting hierarchical summary receiver operating characteristic (HSROC) curves. The effects of the proxy used in defining language disorders, the test administrators, the screening-diagnosis interval and age of screening on screening accuracy were investigated by meta-regression. Of the 2,366 articles located, 47 studies involving 67 screening tools were included. About one-third of the tests (35.4%) achieved at least fair accuracy, while only a small proportion (13.8%) achieved good accuracy. HSROC curves revealed a remarkable variation in sensitivity and specificity for the three major types of screening, which used the child's actual language ability, clinical markers, and both as the proxy, respectively. None of these three types of screening tools achieved good accuracy. Meta-regression showed that tools using the child's actual language as the proxy demonstrated better sensitivity than that of clinical markers. Tools using long screening-diagnosis intervals had a lower sensitivity than those using short screening-diagnosis intervals. Parent report showed a level of accuracy comparable to that of those administered by trained examiners. Screening tools used under and above 4yo appeared to have similar sensitivity and specificity. In conclusion, there are still gaps between the available screening tools for language disorders and the adoption of these tools in population screening. Future tool development can focus on maximizing accuracy and identifying metrics that are sensitive to the dynamic nature of language development.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=210505, PROSPERO: CRD42020210505.

Sentence Repetition Tasks to Detect and Prevent Language Difficulties: A Scoping Review

Sentence repetition tasks (SRTs) have been widely used in language development research for decades. In recent years, there has been increasing interest in studying performance in SRTs as a clinical marker for language impairment. What are the characteristics of SRTs? For what purposes have SRTs been used? To what extent have they been used with young children, in different languages, and with different clinical populations? In order to answer these and other questions, we conducted a scoping review. Peer reviewed studies published in indexed scientific journals (2010–2021) were analyzed. A search in different databases yielded 258 studies. Research published in languages other than English or Spanish, adult samples, dissertations, case studies, artificial models, and theoretical publications were excluded. After this exclusion, 203 studies were analyzed. Our results show that most research using SRT were conducted with English monolingual speakers older than 5 years of age; studies with bilingual participants have mostly been published since 2016; and SRTs have been used with several non-typical populations. Research suggests that they are a reliable tool for identifying language difficulties and are specifically suitable for detecting developmental language disorder.

The development and validation of the Short Language Measure (SLaM): A brief measure of general language ability for children in their first year at school

BACKGROUND

There is no sufficiently accurate short-language measure that could be used by speech-language pathologists, teachers or paraprofessionals to screen young school-aged children to identify those requiring in-depth language evaluations. This may be due to poor development of the available measures, which have omitted crucial test development steps. Applying more stringent development procedures could result in a measure with sufficient accuracy.

AIMS

To create and validate a short-language measure that has acceptable accuracy, validity and reliability, and which can be used to identify children who require further assessment and/or referral to speech-language services.

METHODS & PROCEDURES

The study consisted of two phases. In Phase 1 (measure creation), 56 children were assessed with 160 direction-following and sentence-recall test items and a reference measure, the Clinical Evaluation of Language Fundamentals-Fourth Edition (CELF-4). Items were then examined for their individual characteristics (validity, reliability, difficulty and discrimination) via item analysis and the highest quality items were selected to form the Short Language Measure (SLaM). In Phase 2 (measure validation), 126 children were assessed with the SLaM and the reference measure (CELF-4) to determine SLaM's accuracy, validity and reliability.

OUTCOMES & RESULTS

A total of 40 test items were selected to form SLaM in Phase 1. Findings from Phase 2 indicated that SLaM had an accuracy of 94% (sensitivity = 94%, specificity = 93%), validity of 0.89 and reliability of 0.93. These values remained relatively consistent across both phases.

CONCLUSIONS & IMPLICATIONS

The results indicated that SLaM has excellent psychometric properties. It can be used to identify children who need further evaluation by a speech-language pathologist. What this paper adds What is already known on this subject Prior research suggests that combining a direction-following and a sentence-recall task has sufficient discrimination accuracy and agreement with an omnibus language measure. Trialling a large set of direction-following and sentence-recall test items to select those with the highest individual characteristics could result in an effective short-language measure. What this paper adds to existing knowledge A short-language measure (SLaM) was created and validated on two independent samples of children. Items with the highest validities, reliabilities and discrimination capacities were selected to form SLaM. This procedure resulted in a measure with high validity and reliability that exceeded the criterion for adequate discrimination accuracy. What are the potential or actual clinical implications of this work? SLaM is an effective measure that can accurately identify children who require detailed evaluations by speech-language pathologists.