Sensitivity and specificity of a low-cost screening protocol for identifying children at risk for language disorders

A Study on the Screening of Children at Risk for Developmental Disabilities Using Facial Landmarks Derived From a Mobile-Based Application

OBJECTIVE

Early detection and intervention of developmental disabilities (DDs) are critical to improving the long-term outcomes of afflicted children. In this study, our objective was to utilize facial landmark features from mobile application to distinguish between children with DDs and typically developing (TD) children.

METHODS

The present study recruited 89 children, including 33 diagnosed with DD, and 56 TD children. The aim was to examine the effectiveness of a deep learning classification model using facial video collected from children through mobile-based application. The study participants underwent comprehensive developmental assessments, which included the child completion of the Korean Psychoeducational Profile-Revised and caregiver completing the Korean versions of Vineland Adaptive Behavior Scale, Korean version of the Childhood Autism Rating Scale, Social Responsiveness Scale, and Child Behavior Checklist. We extracted facial landmarks from recorded videos using mobile application and performed DDs classification using long short-term memory with stratified 5-fold cross-validation.

RESULTS

The classification model shows an average accuracy of 0.88 (range: 0.78-1.00), an average precision of 0.91 (range: 0.75-1.00), and an average F1-score of 0.80 (range: 0.60-1.00). Upon interpreting prediction results using SHapley Additive exPlanations (SHAP), we verified that the most crucial variable was the nodding head angle variable, with a median SHAP score of 2.6. All the top 10 contributing variables exhibited significant differences in distribution between children with DD and TD (p<0.05).

CONCLUSION

The results of this study provide evidence that facial landmarks, utilizing readily available mobile-based video data, can be used to detect DD at an early stage.

The home language environment in rural China: variations across family characteristics

BACKGROUND

A rich language environment is an important element of a nurturing home environment. Despite their proven importance, vocabulary and conversation have been shown to vary widely across households-even within the same socio-economic class. One significant gap in the existing literature is its nearly exclusive geographic focus on Western and developed settings, with little attention given to poorer communities in lower/middle income countries. The purpose of this study was to empirically illustrate the characteristics of the home language environment in the low SES, non-Western cultural setting of rural China.

METHODS

Using Language Environment Analysis (LENA) automated language-analysis system, this study measured the home language environment of 38 children aged 20-27 months in Northwest rural China. Our primary measures of the home language environment were Adult Word Count (AWC), Conversational Turn Count (CTC) and Child Vocalization Count (CVC). Multivariate linear regression models were used to examine the association between home language environment and family/child characteristics, and language skills (Measured by MacArthur-Bates Communicative Developmental Inventory score).

RESULTS

In this paper, by comparison, we found that the home language environment of our rural sample fell far behind that of urban households. We also identify significant, positive correlations between language skills and both AWC and CTC. Our analysis finds no significant correlations between home language environment and family/child characteristics.

CONCLUSION

In this paper, we present the first ever findings using the LENA system to measure the home language environment of young children from poor rural communities in China. We found that the home language environment of lower-SES household was significantly worse than high-SES households, and demonstrated the importance of the home language environment to language skills, pointing to a need for more high-quality studies of the home language environment in rural China to better understand possible mechanisms behind low levels of parent-child language engagement and ways to improve the home language environment.

Systematic Review and Meta-Analysis of Screening Tools for Language Disorder

Language disorder is one of the most prevalent developmental disorders and is associated with long-term sequelae. However, routine screening is still controversial and is not universally part of early childhood health surveillance. Evidence concerning the detection accuracy, benefits, and harms of screening for language disorders remains inadequate, as shown in a previous review. In October 2020, a systematic review was conducted to investigate the accuracy of available screening tools and the potential sources of variability. A literature search was conducted using CINAHL Plus, ComDisCome, PsycInfo, PsycArticles, ERIC, PubMed, Web of Science, and Scopus. Studies describing, developing, or validating screening tools for language disorder under the age of 6 were included. QUADAS-2 was used to evaluate risk of bias in individual studies. Meta-analyses were performed on the reported accuracy of the screening tools examined. The performance of the screening tools was explored by plotting hierarchical summary receiver operating characteristic (HSROC) curves. The effects of the proxy used in defining language disorders, the test administrators, the screening-diagnosis interval and age of screening on screening accuracy were investigated by meta-regression. Of the 2,366 articles located, 47 studies involving 67 screening tools were included. About one-third of the tests (35.4%) achieved at least fair accuracy, while only a small proportion (13.8%) achieved good accuracy. HSROC curves revealed a remarkable variation in sensitivity and specificity for the three major types of screening, which used the child's actual language ability, clinical markers, and both as the proxy, respectively. None of these three types of screening tools achieved good accuracy. Meta-regression showed that tools using the child's actual language as the proxy demonstrated better sensitivity than that of clinical markers. Tools using long screening-diagnosis intervals had a lower sensitivity than those using short screening-diagnosis intervals. Parent report showed a level of accuracy comparable to that of those administered by trained examiners. Screening tools used under and above 4yo appeared to have similar sensitivity and specificity. In conclusion, there are still gaps between the available screening tools for language disorders and the adoption of these tools in population screening. Future tool development can focus on maximizing accuracy and identifying metrics that are sensitive to the dynamic nature of language development.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=210505, PROSPERO: CRD42020210505.

Agreement and Reliability of Parental Reports and Direct Screening of Developmental Outcomes in Toddlers at Risk

Developmental screening is a practice that directly benefits vulnerable and low-income families and children when it is regular and frequently applied. A developmental screening tool administered by parents called CARE is tested. CARE contains a compilation of activities to report and enhance development at home. Hundred and fifty-seven families in Bogotá (Colombia) initially responded to a call to participate in developmental screening tools' validation and reliability study. All children (Average: 42.7 months old; SD: 9.4; Min: 24, Max: 58) were screened directly by trained applicants using a Spanish version of the Denver Developmental Screening test [i.e., the Haizea-Llevant (HLL) screening table]. After a first screening, 61 dyads were positive for follow-up and received a second HLL screening. Fifty-two out of 61 dyads use and returned CARE booklet after 1-month screening at home. The comparative analysis for parent reports using CARE and direct screening observation included (a) the effects of demographic variables on overall and agreement, (b) agreement and congruence between the CARE report classification and direct screening classification ("At risk" or "Not at risk"), (c) receiver operating characteristic analysis, (d) item-Level agreement for specific developmental domains, and (e) acceptability and feasibility analysis. Results and conclusions show the parental report using the CARE booklet as a reliable screening tool that has the potential to activate alerts for an early cognitive delay that reassure clinicians and families to further specialized and controlled developmental evaluations and act as a screen for the presence of such delay in four developmental dimensions.

Screening tools for early identification of children with developmental delay in low- and middle-income countries: a systematic review

OBJECTIVE

To systematically review, identify and report the screening tools used for early identification of developmental delay in low- and middle-income countries.

DESIGN

Systematic review.

DATA SOURCES

Four bibliographic databases: Medline (1946 to 13 July 2020), Embase (1974 to 13 July 2020), Scopus (1823 to 11 July 2020) and PsycINFO (1987 to July week 1 2020).

ELIGIBILITY CRITERIA

Peer-reviewed original articles published in English addressing validated culturally sensitive developmental screening tools among children aged <5 years were included in this review.

DATA EXTRACTION AND SYNTHESIS

One author (CK, medical librarian) developed the search strategy. Three authors conducted the database search (phase I: CK; phase II: IJ and MKI). Three authors (TF, IJ and MKI) independently screened the title and abstracts. TF, MKI and GK independently performed the full-text review of the screened articles. During each step of the study selection process, disagreements were resolved through discussion. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement was used to guide the systematic review. Data extraction and analysis were performed using MS Excel. Meta-analysis was not possible due to heterogeneity of the study findings.

RESULTS

We identified 3349 articles, of which 18 studies from 10 countries, reporting 16 screening tools, were selected for qualitative synthesis. Six cultural contexts were explored. Twelve general, two motor and two speech-language tools were identified. Seven of them found to be parent-completed ones. Five screening tools (American Speech-Language and Hearing Association, Guide for Monitoring Child Development, Infant Neurological International Battery, New Delhi-Development Screening Questionnaire and Woodside Screening Technique) reported relatively higher sensitivity (82.5%-100%) and specificity (83%-98.93%).

CONCLUSIONS

Limited number of culturally sensitive developmental screening tools were validated for children aged <5 years in low- and middle-income countries. Revising existing screening tools in different ethnic and cultural settings and subsequent validation with normative value should be a research priority.