The thorny nature of predictive validity studies on screening tests for developmental-behavioral problems

Neurodevelopment at age 5.5 years according to Ages & Stages Questionnaire at 2 years' corrected age in children born preterm: the EPIPAGE-2 cohort study

OBJECTIVE

To report neurodevelopment at age 5.5 years according to developmental delay screening with the Ages & Stages Questionnaire (ASQ) in late infancy in preterm-born children.

DESIGN

Population-based cohort study, EPIPAGE-2.

SETTING

France, 2011-2017.

PARTICIPANTS

2504 children born at 24-26, 27-31 and 32-34 weeks, free of cerebral palsy, deafness or blindness at 2 years' corrected age.

MAIN OUTCOME MEASURES

Moderate/severe, mild or no disability at age 5.5 years using gross and fine motor, sensory, cognitive and behavioural evaluations. Results of the ASQ completed between 22 and 26 months' corrected age described as positive screening or not.

RESULTS

Among 2504 participants, 38.3% had ASQ positive screening. The probability of having moderate/severe or mild disability was higher for children with ASQ positive versus negative screening: 14.2% vs 7.0%, adjusted OR 2.5 (95% CI 1.8 to 3.4), and 37.6% vs 29.7%, adjusted OR 1.5 (1.2 to 1.9). For children with ASQ positive screening, the probability of having neurodevelopmental disabilities at age 5.5 years was associated with the number of domain scores below threshold, very low gestational age and severe neonatal morbidities. For children with ASQ negative screening, this probability was increased for boys and children born small-for-gestational age. For both groups, maternal level of education was strongly associated with outcomes.

CONCLUSION

In preterm-born children, ASQ screening at 2 years' corrected age was associated with neurodevelopmental disabilities at age 5.5 years. However, other factors should be considered when interpreting the ASQ data to draw further follow-up.

TRIAL REGISTRATION NUMBER

2016-A00333-48.

Comparison of parent or caregiver-completed development screening tools with Bayley Scales of Infant Development: a systematic review and meta-analysis

BACKGROUND

Parent/caregiver-completed developmental testing (PCDT) is integral to developmental care in children; however, there is limited information on its accuracy. In this systematic review, we compared the diagnostic accuracy of PCDT with concurrently administered Bayley Scales of Infant Development for detection of developmental delay (DD) in children below 4 years of age.

METHODS

We searched databases PubMed, Embase, CINAHL, PsycINFO and Google Scholar until November 2023. Bivariate and multiple thresholds summary receiver operating characteristics were used to obtain the summary sensitivity and specificity with 95% CIs. The Quality Assessment of Diagnostic Accuracy Studies-2 tool was used for risk of bias assessment.

RESULTS

A total of 38 studies (31 in the meta-analysis) were included. Ages and Stages Questionnaire (ASQ) and Parent Report of Children's Abilities-Revised (PARCA-R) were the most commonly evaluated PCDTs. ASQ score >2 SD below the mean had an overall sensitivity of 0.72 (0.6, 0.82) and 0.63 (0.50, 0.75) at a median specificity of 0.89 (0.82, 0.94) and 0.81 (0.76, 0.86) for diagnosing moderate to severe DD and severe DD, respectively. PARCA- R had an overall sensitivity of 0.69 (0.51, 0.83) at median specificity of 0.75 (0.64, 0.83) for predicting severe DD. Participant selection bias and partial verification bias were found in over 50% of the studies. The certainty of evidence was low for the studied outcomes.

CONCLUSIONS

The most commonly studied parental tools, ASQ and PARCA-R, have moderate to low sensitivity and moderate specificity for detecting DD in young children. High risk of bias and heterogeneity in the available data can potentially impact the interpretation of our results.

PROSPERO REGISTRATION NUMBER

CRD42021268629.

ASQ-3 and BSID-III's concurrent validity and predictive ability of cognitive outcome at 5 years

BACKGROUND

Early detection of cognitive disability is challenging. We assessed the domain-specific, concurrent validity of the ages and stages questionnaire (ASQ-3) and the Bayley Scales of Infant and Toddler Development (BSID-III), and their ability to predict cognitive delay at school age.

METHODS

Within a longitudinal birth cohort study, a nested cohort of children was assessed using ASQ-3 and BSID-III at 24 months, and at 5 years using the Kaufmann brief IQ test (KBIT).

RESULTS

278 children were assessed using BSID-III and ASQ-3 at 24-months; mean(SD) BW = 3445(506) grams, M:F ratio=52:48. ASQ-3 had reasonable predictive ability (AUROC, p value, sensitivity:specificity) of same domain delay for motor (0.630, p = 0.008, 50%:76.1%) and language (0.623, p = 0.010, 25%:99.5%) at 2 years, but poor ability to detect cognitive delay compared to BSID-III (0.587, p = 0.124, 20.7%/96.8%;). 204/278 children were assessed at 5 years. BSID-III language and cognition domains showed better correlation with verbal and nonverbal IQ (R = 0.435, p < 0.001 and 0.388, p < 0.001 respectively). Both assessments showed high specificity and low sensitivity for predicting delay at 5 years.

CONCLUSIONS

The ASQ-3 cognitive domain showed poor concurrent validity with BSID-III cognitive score. Both ASQ-3 and BSID-III at 2 years poorly predict cognitive delay at 5 years.

IMPACT

The ASQ-3 does not adequately detect cognitive delay or predict cognitive delay at 5 years, particularly for children with mild to moderate delay. The ASQ-3 shows reasonable concurrent validity with the motor and language subscales of the BSID-III. Neither early screening nor formal developmental testing demonstrated significant predictive validity to screen for cognitive delay at school age. This article highlights the need to analyse our existing model of using the ASQ-3 to screen for cognitive delay in children aged 2 years.

Predictive Validity of the Infant Toddler Checklist in Primary Care at the 18-month Visit and School Readiness at 4 to 6 Years

OBJECTIVE

The American Academy of Pediatrics recommends developmental surveillance and screening in early childhood in primary care. The 18-month visit may be an ideal time for identification of children with delays in language and communication, or symptoms of autism spectrum disorder (ASD). Little is known about the predictive validity of developmental screening tools administered at 18 months. Our objective was to examine the predictive validity of the Infant Toddler Checklist (ITC) at the 18-month health supervision visit, using school readiness at kindergarten age as the criterion measure.

METHODS

We designed a prospective cohort study, recruiting in primary care in Toronto, Canada. Parents completed the ITC at the 18-month visit. Teachers completed the Early Development Instrument (EDI) when the children were in Kindergarten, age 4-6 years. We calculated screening test properties with 95% confidence intervals (CIs). We used multivariable logistic and linear regression analyses adjusted for important covariates.

RESULTS

Of 293 children (mean age 18 months), 30 (10.2%) had a positive ITC including: concern for speech delay (n = 11, 3.8%), concern for other communication delay (n = 13, 4.4%), and concern for both (n = 6, 2.0%). At follow-up (mean age 5 years), 54 (18.4%) had overall EDI vulnerability, 19 (6.5%) had vulnerability on the 2 EDI communication domains. The ITC sensitivity ranged from 11% to 32%, specificity from 91% to 96%, false positive rates from 4% to 9%, PPV from 16% to 35%, NPV from 83% to 95%. A positive ITC screen and ITC concern for speech delay were associated with lower scores in EDI communication skills and general knowledge (β = -1.08; 95% CI: -2.10, -0.17; β = -2.35; 95% CI: -3.63, -1.32) and EDI language and cognitive development (β = -0.62; 95% CI: -1.25, -0.18; β = -1.22; 95% CI: -2.11, -0.58).

CONCLUSIONS

The ITC demonstrated high specificity suggesting that most children with a negative ITC screen will demonstrate school readiness at 4-6 years, and low false positive rates, minimizing over-diagnosis. The ITC had low sensitivity highlighting the importance of ongoing developmental surveillance and screening.

Predictive validity of the Infant Toddler Checklist in primary care at the 18-month visit and developmental diagnosis at 3-5 years: a prospective cohort study

OBJECTIVE

There is international variation in recommendations regarding developmental screening and growing recognition of the low sensitivity of commonly used developmental screening tools. Our objective was to examine the predictive validity of the Infant Toddler Checklist (ITC) at 18 months to predict a developmental diagnosis at 3-5 years, in a primary care setting.

METHODS

We designed a prospective cohort study, recruiting in primary care in Toronto, Canada. Parents completed the ITC at the 18-month visit and reported developmental diagnosis at 3-5 years (developmental delay, autism spectrum disorder (ASD), attention deficit hyperactivity disorder (ADHD), learning problem). We calculated screening test properties with 95% CIs. We used multivariable logistic regression analyses adjusted for important covariates.

RESULTS

In the final sample (n=488), mean age at screening was 18.5 (SD 1.1) months, and at follow-up was 46.6 (SD 10.0) months. At screening, 46 (9.4%) had a positive ITC. At follow-up, 26 (5.3%) had a developmental diagnosis, including: developmental delay (n=22), ASD (n=4), ADHD (n=1), learning problem (n=1); parents of two children each reported two diagnoses (total of 28 diagnoses). Of four children with a diagnosis of ASD at follow-up, three had a positive ITC at 18 months. The ITC specificity (92%, 95% CI: 89% to 94%) and negative predictive value (96%, 95% CI: 95% to 97%) were high; false positive rate was low (8%, 95% CI: 6% to 11%); sensitivity was low (31%, 95% CI: 14% to 52%). There was a strong association between a positive ITC at 18 months and later developmental diagnosis (adjusted OR 4.48, 95% CI: 1.72 to 11.64; p=0.002).

CONCLUSION

The ITC had high specificity, high negative predictive value, low false positive rate, and identified children with later developmental delay and ASD. The ITC had low sensitivity, similar to other screening tools underscoring the importance of continuous developmental surveillance at all health supervision visits.

Combined association of early exposure to long-chain n-3 polyunsaturated fatty acids, mercury and selenium with cognitive performance in 1-year-old infants

BACKGROUND

Previous studies on long-chain n-3 polyunsaturated fatty acids (LCn3PUFAs) and infant neurodevelopment did not consider effect modifications of mercury (Hg) and selenium (Se).

OBJECTIVES

To examine the joint association of prenatal LCn3PUFAs, Hg and Se with infant cognitive performance, and to explore whether DNA methylation may explain this potential association.

METHODS

A total of 484 newborns were enrolled from the Shanghai Birth Cohort with available data on cord blood LCn3PUFA, nail Hg and Se during 2015-2016. Cord blood LCn3PUFA concentrations were assessed by gas chromatography, and nail Hg and Se concentrations were measured using clippings collected within 6 months of birth by inductively coupled plasma mass spectrometry. Five aspects of infant neurodevelopment (communication, gross motor, fine motor, problem-solving, and personal-social skills) were assessed using the Age and Stage Questionnaire (ASQ) at ages 6 and 12 months. Multivariable-adjusted generalized estimating equations models were performed to examine the associations between cord blood LCn3PUFA concentrations and ASQ test scores, and these associations were stratified by nail Hg and Se levels. Epigenome-wide DNA methylation in cord blood was compared in a random subgroup consisting of 19 infants from the highest and 21 from the lowest decile of LCn3PUFA concentrations.

RESULTS

LCn3PUFAs were not significantly associated with any ASQ test scores. However, in the subgroup with lower Hg (<median 0.13 ppm) and higher Se (≥median 0.87 ppm) levels, infants with higher LCn3PUFA concentrations had higher ASQ scores indicating better performance in gross motor skills [quartile 4 vs. 1: mean difference = 7.78; 95% confidence interval=(3.47, 12.09); P_trend<0.01; P_interaction = 0.03]. Additionally, twenty CpG sites were differentially methylated when comparing high to low LCn3PUFA groups.

CONCLUSION

The association of prenatal LCn3PUFA concentrations with infant neurodevelopment, particularly gross motor skills, may be observed among infants with high Se and low Hg levels.

Hyperglycemia in pregnancy and developmental outcomes in children at 18–60 months of age: the PANDORA Wave 1 study

This study aimed to explore the association between hyperglycemia in pregnancy (type 2 diabetes (T2D) and gestational diabetes mellitus (GDM)) and child developmental risk in Europid and Aboriginal women.

PANDORA is a longitudinal birth cohort recruited from a hyperglycemia in pregnancy register, and from normoglycemic women in antenatal clinics. The Wave 1 substudy included 308 children who completed developmental and behavioral screening between age 18 and 60 months. Developmental risk was assessed using the Ages and Stages Questionnaire (ASQ) or equivalent modified ASQ for use with Aboriginal children. Emotional and behavioral risk was assessed using the Strengths and Difficulties Questionnaire. Multivariable logistic regression was used to assess the association between developmental scores and explanatory variables, including maternal T2D in pregnancy or GDM.

After adjustment for ethnicity, maternal and child variables, and socioeconomic measures, maternal hyperglycemia was associated with increased developmental “concern” (defined as score ≥1 SD below mean) in the fine motor (T2D odds ratio (OR) 5.30, 95% CI 1.77–15.80; GDM OR 3.96, 95% CI 1.55–10.11) and problem-solving (T2D OR 2.71, 95% CI 1.05–6.98; GDM OR 2.54, 95% CI 1.17–5.54) domains, as well as increased “risk” (score ≥2 SD below mean) in at least one domain (T2D OR 5.33, 95% CI 1.85–15.39; GDM OR 4.86, 95% CI 1.95–12.10). Higher maternal education was associated with reduced concern in the problem-solving domain (OR 0.27, 95% CI 0.11–0.69) after adjustment for maternal hyperglycemia.

Maternal hyperglycemia is associated with increased developmental concern and may be a potential target for intervention so as to optimize developmental trajectories.

Predictive Validity of Developmental Screening Questionnaires for Identifying Children With Later Cognitive or Educational Difficulties: A Systematic Review

Context: Parent/caregiver completing developmental screening questionnaires (DSQs) for children before 5 years of age is currently recommended. The DSQs recommended by the American Academy of Pediatrics (AAP) are the Ages and Stages Questionnaires (ASQ), Parents' Evaluation of Developmental Status (PEDS), and the Survey of Well-being of Young Children (SWYC). Nevertheless, their predictive validity has not been well-established. Objective: To assess in the current literature, the value of AAP-recommended DSQs (ASQ, PEDS, SWYC) administered between 0 and 5 years of age, for predicting long-term cognitive achievement and/or school performance (CA/SP), after 1 year or more of evaluation and at/or after age 5 years, in the general population. Data Sources: Cochrane, MEDLINE PubMed, CINAHL, EMBASE, Web of Science, Scielo, and Scopus databases (until March 2021). Study Selection: Two authors selected the studies. Forward and backward citation follow-up was done; authors of DSQ were contacted to identify additional studies. Data Extraction: Cohorts were identified, and authors of selected studies were contacted to corroborate and complete extracted data. Results: Thirty-two publications, corresponding to 10 cohorts, were included. All cohorts used ASQ. Only cohort using PEDS was identified but did not meet the inclusion criteria. No cohorts conducted with SWYC were identified. Associations between ASQ and CA/SP were extracted for eight cohorts. The odds ratios were >3, and the area under the curve was 0.66-0.87. A trade-off between sensitivity and specificity was observed. Limitations: Heterogeneity in population characteristics and in DSQ adaptations. Conclusions: A positive association between ASQ and later CA/SP was found in different social, cultural, and economic settings. Additional studies are necessary to determine the impact factors in the predictive capacity of DSQs. Systematic Review Registration: PROSPERO, identifier: CRD42020183883.

Validation of the Modified Checklist for Autism in Toddlers, Revised with Follow-up in a Population Sample of 30-Month-Old Children in Iceland: A Prospective Approach

The Modified Checklist for Autism in Toddlers, Revised with Follow-up was validated on a population sample in Reykjavik, Iceland. The participants (N = 1585) were screened in well-child care at age 30 months and followed up for at least 2 years to identify autism cases. The sensitivity, specificity, positive and negative predictive values were 0.62, 0.99, 0.72, and 0.99, respectively. True-positive children were diagnosed 10 months earlier than false-negative children. Autism symptom severity and the proportions of children with verbal and performance IQs/DQs < 70 were similar between groups. Although the sensitivity was suboptimal, the screening contributed to lowering the age at diagnosis for many children. Adding autism-specific screening to the well-child care program should be considered.

Early-life exposure to aluminum and fine motor performance in infants: a longitudinal study

BACKGROUND

Aluminum (Al) is a well-established neurotoxicant. However, little is known about its effects on the neurodevelopment of infants.

OBJECTIVES

To examine early-life exposure to Al in relation to neurodevelopment in healthy infants.

METHODS

Nail Al concentrations were measured among 747 newborn babies within 6 months of delivery in the Shanghai Birth Cohort. Neurodevelopment was assessed using Ages and stages questionnaire (third edition, ASQ-3) at ages 6 and 12 months. General linear regression models were performed to estimate the associations between Al concentrations and ASQ-3 scores.

RESULTS

After adjustment for potential confounders, early-life exposure to Al was not associated with any neurodevelopmental performance at age 6 months. However, Al level was associated with an increased risk of having a low fine motor score (quartile 4 vs. quartile 1, mean difference (MD): -1.63; 95% confidence interval (CI): -3.22, -0.05; P-trend < 0.01) at 12 months. No association was found for communication, gross motor, problem-solving, or personal-social score at 12 months.

SIGNIFICANCE

Early-life exposure to Al may be associated with poor fine motor skills in a dose-response manner among apparently healthy infants at age 12 months.

Validation of short instruments assessing parental and caregivers' perceptions on child health and development for personalized prevention

Systematically exploring parental as well as other caregivers' concerns is a main component in preventive child health care (PCHC) for family-centred practice and personalized health care. To facilitate communication and early identification of emerging mental health problems, a PCHC toolkit based on short instruments was developed. This article investigates the reliability and validity of (1) two visual analogue scales (VAS) to assess parent-reported 'parenting' and 'child behaviour', (2) a professional caregiver-reported VAS to assess 'child competence' and (3) the parents' evaluation of developmental status (PEDS) in Dutch PCHC. Parents as well as child care, kindergarten and preschool teachers completed instruments in a community-based sample of children (N = 346) aged 3 years at baseline. The three VAS and PEDS were associated with standardized questionnaires assessing the same constructs. Overall predictive accuracy showed: good to excellent for 'parenting' VAS, fair to good for 'child behaviour' VAS and poor for 'child competence' VAS. The PEDS, 'parenting' VAS and 'child behaviour' VAS, demonstrated high sensitivity at various cut-off points of index test and reference standard. At follow-up, approximately 1 year later, results were similar. Although the 'child competence' VAS scored lower on one aspect of validity, the PEDS and the different VAS are reliable, valid and useful as brief monitoring tools in daily Dutch PCHC practice.

Validation of the International Guide for Monitoring Child Development demonstrates good sensitivity and specificity in four diverse countries

AIM

It is of critical importance to have internationally constructed tools to address early childhood development. The aim of this second phase of a two-phase study was to examine the sensitivity and specificity of the Guide for Monitoring Child Development (GMCD) in identifying developmental delay in four diverse countries.

METHODS

The first phase of this 2011-2015 back-to-back study included 4949 children up to 42 months of age from primary healthcare centres in Argentina, India, South Africa and Turkey. Distribution curves were generated to show the ages when the children attained GMCD milestones and those that could be used across sexes and countries were placed in age ranges corresponding to the 85th and 97th percentile point estimates. Phase two examined a separately recruited sample of children in those countries to determine sensitivity and specificity of the GMCD.

RESULTS

The validation phase of the 85 milestones in the GMCD identified delayed development in 30% of the 1731 children in the four countries. The sensitivity and specificity ranged from 0.71-0.94 and 0.69-0.82, respectively, for the total sample and the different age groups.

CONCLUSION

The GMCD standardised in four diverse countries has appropriate accuracy for identification of children with developmental delay.

Diagnostic accuracy of the Molteno Adapted Scale for developmental delay in South African toddlers

Background: There is currently a great need in South Africa for culturally appropriate neurodevelopmental screening measures in order to facilitate early identification of neurodevelopmental problems in children. Neurodevelopmental screening has the potential to decrease the burden at health-care facilities as it is time, resource and cost effective. Aim: To assess the use of the Molteno Adapted Scale (MAS), a locally developed screening measure, to suggest an optimal cut-off score and investigate its accuracy in detecting developmental delays. Method: The MAS was assessed by evaluating three components: accuracy, efficacy and usefulness. For each of 136 participants, MAS scores were compared with dichotomised scores from the Griffiths Mental Development Scales (GMDS). Receiver operating characteristic (ROC) curves were generated to determine the accuracy of the MAS in identifying developmental delay defined by the GMDS. Sensitivity, specificity and predictive values were calculated for potential MAS cut-off scores. Results: The MAS had an excellent area under the ROC curve, indicating good test accuracy. A developmental quotient of 83 was identified as optimal for screening purposes, with acceptable sensitivity (71.4%) and specificity (90.7%) as well as predictive values (29.4% positive predictive value and 98.3% negative predictive value) for developmental delay on the GMDS. Conclusion: The present study provides preliminary evidence supporting the use of the MAS for screening.

Predictive validity of developmental milestones for detecting limited intellectual functioning

Developmental milestones are commonly used in child health care, although from many milestones the predictive validity has not been adequately assessed. We aimed to determine the predictive validity of 75 developmental milestones for detecting limited intellectual functioning that can be obtained before the age of 4 years. We performed a case-control study with 148 children aged 5–10 years with limited intellectual functioning (IQ 50–69), who were in special education (cases) and a random sample of 300 children aged 5–10 years who were in regular elementary education (controls). Developmental milestones scores were retrieved from Child Healthcare files. We calculated sensitivity, specificity, positive likelihood ratios (LR+) and diagnostic odds ratios (DOR) for limited intellectual functioning. The LR+ determines whether a test result changes the probability that a condition exists. Given the prevalence of intellectual disability (1–3%), we considered that an LR+ > 10 would be clinically useful, as it increases the a priori probability of limited intellectual functioning from 2% to a posteriori probability of at least 17%. Out of 75 assessed milestones, 50 were included in the analysis. We found nine milestones to have a significant adjusted (for socio-economic status and prematurity) DOR > 1 and a significant LR+ > 10 (assessment age in months between brackets): ‘says "dada-baba‴ (9), ‘balances head well while sitting’ (9), ‘sits on buttocks while legs stretched’ (9), ‘babbles while playing’ (12), ‘sits in stable position without support’ (12), ‘walks well alone’ (24), ‘says "sentences" of 3 or more words’ (36), ‘places 3 forms in form-box’ (36) and ‘copies circle’ (48). Sensitivities of these 9 milestones varied from 8–54%, specificities of these 9 milestones varied from 95–100%. Combining these milestones at 9, 12, and 36 months respectively resulted in sensitivities of 27–60% and specificities of 94–99%. These nine developmental milestones have substantial predictive validity for limited intellectual functioning.

Effect of Maternal Vitamin B12 Supplementation on Cognitive Outcomes in South Indian Children: A Randomized Controlled Clinical Trial

Objectives To examine the effects of oral maternal vitamin B12 supplementation during pregnancy and early lactation on cognitive development in children. Method We studied 218 children born to mothers enrolled in a placebo-controlled, randomized trial of vitamin B12 supplementation during pregnancy through 6 weeks post-partum. Cognitive functions were assessed at 30 months using the Bayley Scales of Infant Development- 3rd edition (BSID III). The association of maternal sociodemographic characteristics, maternal biochemical status during pregnancy, birth weight and home environment with each sub-domain of BSID-III was examined using linear regression analysis. Separate multiple linear regression analyses for each of the BSID-III sub-domains with maternal trimester specific nutritional biomarker status was conducted. Results Children of mothers who received oral vitamin B12 supplementation had significantly higher scores on expressive language compared to children of mothers who received placebo (β = 0.14, P = 0.03). Children of mothers with elevated serum total homocysteine (tHcy) in the second and third trimesters of pregnancy had significantly lower scores on expressive language (β = - 0.18, P = 0.03 and β = - 0.19, P = 0.02, respectively) and gross motor domains (β = - 0.23, P = 0.008 and β = - 0.30, P = 0.001, respectively) of BSID-III adjusted for treatment arm and multiple confounders, compared with children whose mothers did not have elevated tHcy. Conclusions for practice Maternal B12 supplementation during pregnancy was associated with higher expressive language scores in children at 30 months. Elevated maternal tHcy levels during pregnancy had negative associations with expressive language and gross motor domains of BSID-III. Larger trials of maternal B12 supplementation are needed to confirm these findings.

Effects of maternal B12 supplementation on neurophysiological outcomes in children: a study protocol for an extended follow-up from a placebo randomised control trial in Bangalore, India

INTRODUCTION

Vitamin B12 deficiency is highly prevalent in pregnant Indian women. Neuropsychological tests have shown an association between low maternal vitamin B12 status and poorer cognitive performances in the offspring, although findings from these studies have been inconsistent. Vitamin B12 has an important role in the formation of myelin which is important for the transmission speed of neural impulses and myelination in the central nervous system has been linked to cognition. Assessing neurophysiological measures using event-related potentials (ERPs) in children may provide additional information on the effect of maternal vitamin B12 supplementation on offspring brain function. The study examines the effects of oral vitamin B12 daily supplements (50 µg) to pregnant Indian women on child neurophysiological function at 72 months.

METHODS AND ANALYSIS

We previously conducted a double-blind, placebo-controlled study to examine the effects of maternal vitamin B12 supplementation on cognitive outcomes in their offspring using the Bayley scales of infant development, third edition. In this extended follow-up of the same cohort of mother-child dyad, we propose to use ERP to study the long-term impact of maternal B12 supplementation on brain function in children at 72 months of age. We intend to use P300 and mismatch negativity (MMN) as measures of neurophysiological outcomes. The primary outcome of this study will be child neurophysiological measures (as measured by amplitude and latency of P300 and MMN) assessed at 72 months of age in children whose mothers received vitamin B12 compared with neurophysiological status of children whose mothers received placebo.

ETHICS AND DISSEMINATION

The study was approved by the Institutional Ethical Board of St. John's Medical College and the Harvard School of Public Health Human Subjects Committee. Results obtained will be presented at national and international research meetings and published in peer-reviewed scientific journals.

TRIAL REGISTRATION NUMBER

NCT00641862.

Better together: Developmental screening and monitoring best identify children who need early intervention

BACKGROUND

Widely recommended developmental surveillance methods include developmental monitoring (DM) and development screening (DS). Much research has been done on DS, but very little research has compared the effectiveness of DM and DS together.

OBJECTIVES

To investigate the relationship between DM and DS in Part C early intervention (EI) service receipt.

METHODS

Authors used data from the 2007/2008 and 2011/2012 National Survey of Children's Health (NSCH). Authors report the prevalence of children aged 10 months to 3 years who received (a) DM only, (b) DS only, (c) both DM and DS, and (c) no DM or DS across survey years. Authors compare the odds of EI receipt across these groups.

RESULTS

During both periods, estimated EI receipt prevalence was higher for children receiving both DM and DS (8.38% in 2007/2008; 6.47% in 2011/2012) compared to children receiving no DM or DS (1.31% in 2007/2008; 1.92% in 2011/2012), DM alone (2.74% in 2007/2008; 2.70% in 2011/2012), or DS alone (3.59% in 2007/2008; 3.09% in 2011/2012) (for both time frames, p < .05). From 2007/2008 to 2011/2012, the proportion of children receiving DS only and both DM and DS increased, while children receiving DM only and no DM or DS decreased.

CONCLUSIONS

Children receiving DM and DS together were more likely to receive EI compared to children receiving DM alone, DS alone, or neither DM nor DS. These findings support the AAP recommendations indicating that DM and DS are complementary strategies for improving early identification and linkage to EI for young children.

Association between maternal nutritional status in pregnancy and offspring cognitive function during childhood and adolescence; a systematic review

Background

The mother is the only source of nutrition for fetal growth including brain development. Maternal nutritional status (anthropometry, macro- and micro-nutrients) before and/or during pregnancy is therefore a potential predictor of offspring cognitive function. The relationship of maternal nutrition to offspring cognitive function is unclear. This review aims to assess existing evidence linking maternal nutritional status with offspring cognitive function.

Methods

Exposures considered were maternal BMI, height and weight, micronutrient status (vitamins D, B12, folate and iron) and macronutrient intakes (carbohydrate, protein and fat). The outcome was any measure of cognitive function in children aged <18 years. We considered observational studies and trials with allocation groups that differed by single nutrients. We searched Medline/PubMed and the Cochrane Library databases and reference lists of retrieved literature. Two reviewers independently extracted data from relevant articles. We used methods recommended by the Centre for Reviews and Dissemination, University of York and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.

Results

Of 16,143 articles identified, 38 met inclusion criteria. Most studies were observational, and from high-income settings. There were few randomized controlled trials. There was consistent evidence linking maternal obesity with lower cognitive function in children; low maternal BMI has been inadequately studied. Among three studies of maternal vitamin D status, two showed lower cognitive function in children of deficient mothers. One trial of folic acid supplementation showed no effects on the children’s cognitive function and evidence from 13 observational studies was mixed. Among seven studies of maternal vitamin B12 status, most showed no association, though two studies in highly deficient populations suggested a possible effect. Four out of six observational studies and two trials (including one in an Iron deficient population) found no association of maternal iron status with offspring cognitive function. One trial of maternal carbohydrate/protein supplementation showed no effects on offspring cognitive function.

Conclusions

Current evidence that maternal nutritional status during pregnancy as defined by BMI, single micronutrient studies, or macronutrient intakes influences offspring cognitive function is inconclusive. There is a need for more trials especially in populations with high rates of maternal undernutrition.

Systematic review registration

Registered in PROSPERO CRD42013005702.

Electronic supplementary material

The online version of this article (doi:10.1186/s12884-016-1011-z) contains supplementary material, which is available to authorized users.

Effects of maternal vitamin B12 supplementation on early infant neurocognitive outcomes: a randomized controlled clinical trial

Maternal nutritional status during pregnancy impacts fetal brain development. Vitamin B12 plays a vital role in neuronal development. However, findings from studies on the association between maternal B12 status and child cognitive functions have been inconsistent. We performed a randomized, placebo-controlled clinical trial of oral B12 supplementation (50 µg) beginning at <14 weeks of gestation through a 6-week post-partum. In the present study, we report the effects of maternal B12 supplementation on cognitive development in infants at 9 months of age on Bayley Scales of Infant Development-III (BSID-III). One hundred eighty-three pregnant women received vitamin B12, and 183 received placebo. Nine-month BSID-III development score was available in 178 infants. There were no significant differences in maternal sociodemographic characteristics and baseline biochemical measures between infants who underwent BSID-III evaluation and infants who were not evaluated. There were no significant differences in any of the subscales of BSID-III between infants born to mothers who received B12 supplementation (n = 78) vs. placebo (n = 100). On multiple regression analysis, elevated maternal total homocysteine (tHcy) levels adjusted for treatment group, birthweight, parity, income and home environment at second trimester of pregnancy were significantly negatively associated with expressive language (β = 3.13 points, P < 0.001), and in third trimester of pregnancy with expressive language (β = -2.29 points, P < 0.001) and fine motor (β = -1.41 points, P = 0.005) domains of BSID-III. While no significant effects of maternal B12 supplementation were seen on cognitive development in infants at 9 months of age, elevated maternal tHcy levels were associated with poorer cognitive performance in some of the subdomains of BSID-III. In pregnant women with elevated tHcy levels and or B12 deficiencies, it may be worthwhile to study the impact of longer term maternal supplementation on infant cognitive outcomes.

Predictive validity of the Italian parental questionnaire for developmental evaluation at age 4 (QS4-G)

AIM

To examine whether the results at 4 years of age of the developmental questionnaire QS4-G can predict the outcome of cognitive, neuropsychological and academic abilities 4-6 years later. The QS4-G is a validated parental questionnaire designed for the screening and surveillance of the neuropsychological and behavioural developmental status of 4-year-olds (93 questions).

METHODS

Longitudinal prospective study on a subsample of the QS4-G validation original sample was conducted. According to previous results, the sample was divided into two groups: 'at risk' and 'not at risk'. Sensitivity, specificity, accuracy and likelihood ratios were assessed and referred to outcomes.

RESULTS

Thirty-five children were classified as 'not at risk' and 16 as 'at risk'. There were significant associations between past QS4-G score and cognitive, neuropsychological and academic abilities 4-6 years later. With the same cut-off identified at the first cross-sectional study, sensitivity and specificity for difficulties in cognitive development were 90% and 83% while in the neuropsychological abilities 62% and 90%, respectively. A lower predictive validity was found for difficulties in academic abilities (sensitivity 43%, specificity 86%). QS4-G specific area scores showed significant correlations with related academic tests at follow-up (rho range: 0.404-0.565, P < 0.005).

CONCLUSIONS

QS4-G shows good predictive validity for cognitive development and neuropsychological abilities. The risk of false negatives for academic abilities can be reduced by analysing the specific area results of QS4-G, which show good correlations with related tests at follow-up.

Fish intake during pregnancy and foetal neurodevelopment--a systematic review of the evidence

Fish is a source of several nutrients that are important for healthy foetal development. Guidelines from Australia, Europe and the USA encourage fish consumption during pregnancy. The potential for contamination by heavy metals, as well as risk of listeriosis requires careful consideration of the shaping of dietary messages related to fish intake during pregnancy. This review critically evaluates literature on fish intake in pregnant women, with a focus on the association between neurodevelopmental outcomes in the offspring and maternal fish intake during pregnancy. Peer-reviewed journal articles published between January 2000 and March 2014 were included. Eligible studies included those of healthy pregnant women who had experienced full term births and those that had measured fish or seafood intake and assessed neurodevelopmental outcomes in offspring. Medline, Scopus, Web of Science, ScienceDirect and the Cochrane Library were searched using the search terms: pregnant, neurodevelopment, cognition, fish and seafood. Of 279 papers sourced, eight were included in the final review. Due to heterogeneity in methodology and measured outcomes, a qualitative comparison of study findings was conducted. This review indicates that the benefits of diets providing moderate amounts of fish during pregnancy outweigh potential detrimental effects in regards to offspring neurodevelopment. It is important that the type of fish consumed is low in mercury.

Concurrent validity of the Ages And Stages Questionnaires and Bayley Developmental Scales in a general population sample

OBJECTIVE

Developmental delay is relatively common and produces serious impairment. Efforts to screen for delay often include parent-completed instruments. We evaluated the agreement between the most popular such instrument, the Ages and Stages Questionnaires (ASQ) and the third edition of the Bayley Scales of Infant Development (BSID-III).

METHODS

We analyzed a community sample of 587 children aged 1 month to 36 months who received both the ASQ and the BSID-III. We calculate sensitivity, specificity, and positive and negative predictive values. Because published BSID-III norms produced unexpectedly low prevalences, we also derived a set of distribution-based thresholds using quantile regression, and we repeated the validation analysis using these results.

RESULTS

BSID-III prevalence was 2.9% (95% confidence interval [CI] 1.7-4.6) with published norms and 7.7% (95% CI 5.6-10.1) with distribution-based thresholds, while 18.2% (95% CI 15.2-21.6) of children were positive on the ASQ. For published BSID-III norms, sensitivity was 41% (95% CI 18-67) and specificity 82% (95% CI 79-85). Results with distribution-based thresholds were essentially identical. Performance was somewhat better among children over 1 year (sensitivity 50%, specificity 87%). For subscales, sensitivities were generally lower (range 0-50%) and specificities higher (range 92-96%).

CONCLUSIONS

Agreement between the ASQ and BSID-III was relatively poor. Previous studies have reported somewhat better agreement. There are numerous possible explanations for differences, including the age ranges used, the risk profile of children, and differences in the ASQ administration. Results raise concerns about the performance of this instrument in primary care and community settings.

Assessment and evaluation of the high risk neonate: the NICU Network Neurobehavioral Scale

There has been a long-standing interest in the assessment of the neurobehavioral integrity of the newborn infant. The NICU Network Neurobehavioral Scale (NNNS) was developed as an assessment for the at-risk infant. These are infants who are at increased risk for poor developmental outcome because of insults during prenatal development, such as substance exposure or prematurity or factors such as poverty, poor nutrition or lack of prenatal care that can have adverse effects on the intrauterine environment and affect the developing fetus. The NNNS assesses the full range of infant neurobehavioral performance including neurological integrity, behavioral functioning, and signs of stress/abstinence. The NNNS is a noninvasive neonatal assessment tool with demonstrated validity as a predictor, not only of medical outcomes such as cerebral palsy diagnosis, neurological abnormalities, and diseases with risks to the brain, but also of developmental outcomes such as mental and motor functioning, behavior problems, school readiness, and IQ. The NNNS can identify infants at high risk for abnormal developmental outcome and is an important clinical tool that enables medical researchers and health practitioners to identify these infants and develop intervention programs to optimize the development of these infants as early as possible. The video shows the NNNS procedures, shows examples of normal and abnormal performance and the various clinical populations in which the exam can be used.

Who gets help for pre-school communication problems? Data from a prospective community study

OBJECTIVE

Pre-school communication problems are common, with implications for school readiness and educational achievement. Help is available from a variety of community healthcare providers. This study examined the extent to which help is received, and the predictors of service receipt.

DESIGN AND SETTING

Prospective community study, in Melbourne, Victoria.

PARTICIPANTS AND METHOD

At age 4 years, we assessed the speech, receptive and expressive language and fluency of 1607 children and gave feedback to their parents. At age 5 years, 983 families provided data on service use for communication problems between and 4 and 5 years. We compared service use between participants with and without impairment, and used logistic regression to estimate the strength of association between potential predictors (gender, socio-economic status, maternal education, English-speaking background status, family history of speech and language problems and parent concern) and service use (binary outcome).

RESULTS

Data were available for both communication status and service use for 753 children. Only 44.9% of the 196 children with communication impairment received help from a professional. Furthermore, 7% of the 557 that did not meet criteria for communication impairment nevertheless received help from a professional. Parent concern was the strongest predictor of service use (adjusted odds ratio = 9.0; 95% CI: 5.6-14.8).

CONCLUSIONS

Both over- and under-servicing for communication problems were evident. This study shows that accessing help for communication problems requires more than simply informing parents about the problem and having services available; there is a need for systematic support to get the right children to services.

Validation of the modified checklist for Autism in toddlers, revised with follow-up (M-CHAT-R/F)

OBJECTIVE

This study validates the Modified Checklist for Autism in Toddlers, Revised with Follow-up (M-CHAT-R/F), a screening tool for low-risk toddlers, and demonstrates improved utility compared with the original M-CHAT.

METHODS

Toddlers (N = 16,071) were screened during 18- and 24-month well-child care visits in metropolitan Atlanta and Connecticut. Parents of toddlers at risk on M-CHAT-R completed follow-up; those who continued to show risk were evaluated.

RESULTS

The reliability and validity of the M-CHAT-R/F were demonstrated, and optimal scoring was determined by using receiver operating characteristic curves. Children whose total score was ≥ 3 initially and ≥ 2 after follow-up had a 47.5% risk of being diagnosed with autism spectrum disorder (ASD; confidence interval [95% CI]: 0.41-0.54) and a 94.6% risk of any developmental delay or concern (95% CI: 0.92-0.98). Total score was more effective than alternative scores. An algorithm based on 3 risk levels is recommended to maximize clinical utility and to reduce age of diagnosis and onset of early intervention. The M-CHAT-R detects ASD at a higher rate compared with the M-CHAT while also reducing the number of children needing the follow-up. Children in the current study were diagnosed 2 years younger than the national median age of diagnosis.

CONCLUSIONS

The M-CHAT-R/F detects many cases of ASD in toddlers; physicians using the 2-stage screener can be confident that most screen-positive cases warrant evaluation and referral for early intervention. Widespread implementation of universal screening can lower the age of ASD diagnosis by 2 years compared with recent surveillance findings, increasing time available for early intervention.

Associations between maternal prepregnancy body mass index and child neurodevelopment at 2 years of age

OBJECTIVE

Both underweight and obese mothers have an increased risk for adverse offspring outcomes. Few studies have examined the association between prepregnancy body mass index (BMI) and children's neurodevelopment.

SUBJECTS

We used data from the nationally representative Early Childhood Longitudinal Study-Birth Cohort (ECLS-B; n=6850). Children were classified according to their mother's prepregnancy BMI (kg m(-2)) status: underweight (BMI <18.5), normal weight (BMI 18.5-24.9), overweight (BMI 25.0-29.9), obese class I (BMI 30.0-34.9), and obese class II and III (BMI ≥35.0). Children's age-adjusted mental development index (MDI) and psychomotor development index (PDI) T-scores (mean 50, s.d. 10) were obtained using a validated shortened version of the Bayley Scales of Infant Development-II at approximately 2 years of age. While adjusting for sociodemographics, we estimated the average MDI and PDI scores or the risk of delayed (<-1 s.d. vs >1 s.d.) mental or motor development, relative to children of normal weight mothers.

RESULTS

Compared with children of normal weight mothers, MDI scores were lower among children of mothers of all other prepregnancy BMI categories, with the greatest adjusted difference among children of class II and III obese mothers (-2.13 (95% CI -3.32, -0.93)). The adjusted risk of delayed mental development was increased among children of underweight (risk ratio (RR) 1.36 (95% CI 1.04, 1.78)) and class II and III obese (RR 1.38 (95% CI 1.03, 1.84)) mothers. Children's PDI scores or motor delay did not differ by maternal prepregnancy BMI.

CONCLUSION

In this nationally representative sample of 2-year-old US children, low and very-high maternal prepregnancy BMI were associated with increased risk of delayed mental development but not motor development.

Predicting later language outcomes from the Language Use Inventory

PURPOSE

To examine the predictive validity of the Language Use Inventory (LUI), a parent report of language use by children 18-47 months old (O'Neill, 2009).

METHOD

348 children whose parents had completed the LUI were reassessed at 5-6 years old with standardized, norm-referenced language measures and parent report of developmental history. The relationship between scores on the LUI and later measures was examined through correlation, binary classification, and receiver operating characteristic curve analysis.

RESULTS

For children aged 24-47 months at the time of LUI completion, LUI scores correlated significantly with language measure scores. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were also calculated for 4 cutoff scores on the LUI, including -1.64 SD, a score that maximized sensitivity to 81% and specificity to 93%. For children aged 18-23 months at the time of LUI completion, specificity and NPV were high, but sensitivity and PPV were lower than desirable.

CONCLUSIONS

The results provide initial support for the LUI's predictive validity, particularly for children 24-47 months, and suggest the LUI can serve as an indicator of later language outcomes in referred populations. The results compare favorably to findings for other early child-language measures.

Comparison of the ASQ and PEDS in screening for developmental delay in children presenting for primary care

OBJECTIVES

This study investigated the sensitivity and specificity of two brief, parent-completed developmental screening measures-the Ages and Stages Questionnaire (ASQ) and the Parents' Evaluation of Developmental Status (PEDS)-in children presenting to their primary care providers.

METHOD

A sample of 334 children aged 12 to 60 months was recruited. Parents completed the PEDS and the ASQ in their home or the primary care clinic of one of the investigators. The presence of ≥ 1 predictive concerns or abnormal domains was considered a positive screen. All children underwent evaluation (administered by a psychologist) with the following criterion measures: the Bayley Scales of Infant Development-Third Edition or the Wechsler Preschool and Primary Scale of Intelligence-Third Edition, the Preschool Language Scale-Fourth Edition, and the Vineland Adaptive Behavior Scales-Second Edition.

RESULTS

The mean age of children was 32.3 months. Developmental delay was identified in 34 children (10%). The PEDS had moderate sensitivity (74%) but low specificity (64%); comparatively, the ASQ had significantly higher sensitivity (82%) and specificity (78%). The ASQ had moderate sensitivity and specificity across age subgroups, whereas the PEDS had either low sensitivity or specificity in each of the age subgroups, except for the ≤ 30 month group, where there was moderate sensitivity (78%) and specificity (75%). Using ≥ 2 predictive concerns on the PEDS or ≥ 2 abnormal domains on the ASQ significantly improved specificity of both tests (89% and 94%, respectively) but resulted in very low sensitivity (41% and 47%, respectively).

CONCLUSIONS

These findings support the guidelines of the American Academy of Pediatrics, demonstrating that both the ASQ and, to a lesser extent, the PEDS have reasonable test characteristics for developmental screening in primary care settings. Although the ASQ seems to have higher sensitivity and specificity across a variety of age groups, the choice of which measure to use should be determined by the practice setting, population served, and preference of the physician.

Comparative predictive validity of the Harris Infant Neuromotor Test and the Alberta Infant Motor Scale

AIM

We compared abilities of the Alberta Infant Motor Scale (AIMS) and the Harris Infant Neuromotor Test (HINT), during the infant's first year, in predicting scores on the Bayley Scales of Infant Development (BSID) at age 2 and 3 years.

METHOD

This prospective study involved 144 infants (71 females, 73 males), assessed with the HINT and AIMS at 4 to 6.5 and 10 to 12.5 months and with the BSID at 2 and 3 years. Inclusion criteria for typical infants (n=58) were the following: 38 to 42 weeks' gestation, birthweight at least 2500g, and no congenital anomaly, postnatal health concern, nor major prenatal or perinatal maternal risk factor. For at-risk infants (n=86), inclusion criteria were any of the following: less than 38 weeks' gestation, birthweight less than 2500g, maternal age older than 35 years or younger than 19 years at infant birth, maternal psychiatric/mental health concerns, prenatal drug/alcohol exposure, multiple births, or use of reproductive technology.

RESULTS

For the overall sample, the early (4-6.5mo) HINT had higher predictive correlations than the AIMS for 2-year BSID-II motor outcomes (r=-0.36 vs 0.26), and 3-year BSID-III gross motor outcomes (r=-0.45 vs 0.31), as did the 10- to 12.5-month HINT (r=-0.55 vs 0.47). Correlations were identical for 10- to 12.5-month HINT and AIMS scores and 3-year BSID-III gross motor (r=-0.58 and 0.58) and fine motor (r=-0.35 and 0.35) subscales. When the sample was divided into typical and at-risk groups, predictive correlations were consistently stronger for the at-risk infants. Categorical predictive analyses were reasonably similar across both tests.

INTERPRETATION

Results suggest that the HINT has comparable predictive validity to the AIMS and should be considered for use in clinical and research settings.

Neonatal neurobehavior predicts medical and behavioral outcome

OBJECTIVE

This study examined the NICU Network Neurobehavioral Scale (NNNS) as a predictor of negative medical and behavioral findings at 1 month to 4.5 years of age.

METHODS

The sample included 1248 mother-infant dyads (42% born at <37 weeks' gestational age [GA]) who were participating in a longitudinal study of the effects of prenatal substance exposure on child development. Mothers were recruited at 4 urban university-based centers and were mostly black and on public assistance. At 1 month of age, infants were tested with the NNNS. Latent profile analysis was conducted on NNNS summary scales to identify discrete behavioral profiles. The validity of the NNNS was examined by using logistic regression to predict prenatal drug exposure and medical and developmental outcomes through 4.5 years of age including adjustment for GA and socioeconomic status.

RESULTS

Five discrete behavioral profiles were reliably identified; the most extreme negative profile was found in 5.8% of the infants. The profiles showed statistically significant associations with prenatal drug exposure; GA and birth weight; head ultrasound; neurologic and brain disease findings; and abnormal scores on measures of behavior problems, school readiness, and IQ through 4.5 years of age.

CONCLUSIONS

The NNNS may be useful to identify infant behavioral needs to be targeted in well-infant pediatric care, as well as for referrals to community-based early intervention services.