Test-Retest Reliability and Measurement Invariance of Executive Function Tasks in Young Children With and Without ADHD

Norms, convergent validity, test-retest reliability, and practice effects for verbal fluency overall performance, clustering, and switching in Spanish-speaking children

OBJECTIVE

We conducted two empirical studies (in a cross-sectional and a longitudinal design) with the aim at establishing normative data (including norms for strategy use [i.e., clustering and switching strategies] and performance over time), and examining the convergent validity, the test-retest reliability (3-4 wks interval) and the changes in performance with practice (1 year interval) of the different verbal fluency (VF) quantitative and qualitative scores in Spanish-speaking children and adolescents.

METHOD

In S1 (n = 620 6- to 15-year-old Spanish-speaking children and adolescents), MANCOVA and Pearson's correlations were employed. In S2 (n = 148 6- to 12-year-old Spanish-speaking children), intraclass correlation coefficient (ICC), paired t-tests, and Confirmatory Factor Analysis (CFA) were used.

RESULTS

S1 results showed an age effect on all VF measures (quantitative and qualitative). The number of switches/clusters was more related to total word productivity and to executive functions (EF) than the mean cluster size. In S2, a significant increase in phonological VF performance was observed on number of switches and word productivity scores from baseline (Time 1) to repeat testing at Time 2. Practice effects were observed at Time 3 on all measures except for semantic and phonological mean cluster size. Test-retest reliability coefficients at Time 2 for number of clusters and switches, but not for mean cluster size, fell in the moderate range, ranging from ICCs .61 to ICCs .81. Test-retest reliability coefficients for total word productivity were higher (ICCs above .80) and stronger when testing as a unity with CFA methods (ϕ=.94, p < .001).

CONCLUSIONS

These data may be relevant for informing the neuropsychological assessment of spontaneous cognitive flexibility in children with typical development (TD) and those with developmental or acquired disorders.

Dynamic transient brain states in preschoolers mirror parental report of behavior and emotion regulation

The temporal dynamics of resting-state networks may represent an intrinsic functional repertoire supporting cognitive control performance across the lifespan. However, little is known about brain dynamics during the preschool period, which is a sensitive time window for cognitive control development. The fast timescale of synchronization and switching characterizing cortical network functional organization gives rise to quasi-stable patterns (i.e., brain states) that recur over time. These can be inferred at the whole-brain level using hidden Markov models (HMMs), an unsupervised machine learning technique that allows the identification of rapid oscillatory patterns at the macroscale of cortical networks. The present study used an HMM technique to investigate dynamic neural reconfigurations and their associations with behavioral (i.e., parental questionnaires) and cognitive (i.e., neuropsychological tests) measures in typically developing preschoolers (4-6 years old). We used high-density EEG to better capture the fast reconfiguration patterns of the HMM-derived metrics (i.e., switching rates, entropy rates, transition probabilities and fractional occupancies). Our results revealed that the HMM-derived metrics were reliable indices of individual neural variability and differed between boys and girls. However, only brain state transition patterns toward prefrontal and default-mode brain states, predicted differences on parental-report questionnaire scores. Overall, these findings support the importance of resting-state brain dynamics as functional scaffolds for behavior and cognition. Brain state transitions may be crucial markers of individual differences in cognitive control development in preschoolers.

A challenge to the expected: Lack of longitudinal associations between the early caregiving environment, executive functions in toddlerhood, and self-regulation at 6 years

Previous research and theory indicate an importance of the quality of the early caregiving environment in the development of self-regulation. However, it is unclear how attachment security and maternal sensitivity, two related but distinct aspects of the early caregiving environment, may differentially predict self-regulation at school start and whether a distinction between hot and cool executive function is informative in characterizing such predictions through mediation. In a 5-year longitudinal study (n = 108), we examined these associations using measures of maternal sensitivity and attachment security at 10-12 months, executive function at 4 years, and self-regulation at 6 years. Surprisingly, and despite methodological rigor, we found few significant bivariate associations between the study variables. We found no credible evidence of a longitudinal association between maternal sensitivity or attachment security in infancy and self-regulation at 6 years, or between executive function at 4 years and self-regulation at 6 years. The lack of bivariate longitudinal associations precluded us from building mediation models as intended. We discuss our null findings in terms of their potential theoretical implications, as well as how measurement type, reliability, and validity, may play a key role in determining longitudinal associations between early caregiving factors and later self-regulation and related abilities. RESEARCH HIGHLIGHTS: The early caregiving environment has been implicated in the development of later self-regulation, which includes more basic skills, such as hot and cool executive functions (EF). In a 5-year longitudinal study, with a sample of 108 children, we rigorously measured aspects of early caregiving, EF, and self-regulation. We found no significant longitudinal associations between early caregiving and self-regulation at 6 years, nor between EF at 4 years and self-regulation at 6 years. These null results highlight the complexity of modeling self-regulation development and raise critical questions about general methodological conventions within self-regulation development research.

Effects of Cumulative Head Impact Exposure in Adolescent Male Contact and Collision Sport Student Athletes

OBJECTIVE

This prospective cohort study aimed to investigate the association between head impact exposure (HIE) and neuropsychological sequelae in high school football and ice hockey players over 1 year.

SETTING

Community sample.

PARTICIPANTS

A cohort of 52 adolescent American football and ice hockey players were enrolled in the study, with a final study sample of 35 included in analyses.

DESIGN

The study followed a prospective cohort design, with participants undergoing neuropsychological screening and accelerometer-based measurement of HIE over 1 season.

MAIN MEASURES

Changes in cognition, emotions, behavior, and reported symptoms were assessed using standardized neuropsychological tests and self-reported questionnaires.

RESULTS

Cumulative HIE was not consistently associated with changes in cognition, emotions, behavior, or reported symptoms. However, it was linked to an isolated measure of processing speed, showing inconsistent results based on the type of HIE. History of previous concussion was associated with worsened verbal memory recognition (ImPACT Verbal Memory) but not on a more robust measure of verbal memory (California Verbal Learning Test [CVLT]). Reported attention-deficit/hyperactivity disorder history predicted improved neurocognitive change scores. No associations were found between reported history of anxiety/depression or headaches/migraines and neuropsychological change scores.

CONCLUSION

Overall, our findings do not support the hypothesis that greater HIE is associated with an increase in neuropsychological sequelae over time in adolescent football and ice hockey players. The results align with the existing literature, indicating that HIE over 1 season of youth sports is not consistently associated with significant neuropsychological changes. However, the study is limited by a small sample size, attrition over time, and the absence of performance validity testing for neurocognitive measures. Future studies with larger and more diverse samples, longer follow-up, and integration of advanced imaging and biomarkers are needed to comprehensively understand the relationship between HIE and neurobehavioral outcomes. Findings can inform guidelines for safe youth participation in contact sports while promoting the associated health and psychosocial benefits.

Parent Training for ADHD: No Generalization of Effects From Clinical to Neuropsychological Outcomes in a Randomized Controlled Trial

OBJECTIVE

We examined whether neuropsychological function in ADHD can be improved by the New Forest Parenting Programme (NFPP), that combines standard parenting strategies with self-regulatory skills training, or predict ADHD and quality of life (QoL) treatment effects.

METHOD

Participants were 93 medication-naive preschool children with ADHD (3-7 years) randomized to either NFPP (n = 49) or treatment as usual (TAU; n = 44) in a recent randomized trial. Laboratory measures of executive function, reaction time variability, and delay of gratification were collected along with parent ratings of ADHD and QoL at baseline and post treatment. Ratings were collected again at 3-month follow-up.

RESULTS

NFPP did not improve neuropsychological function (compared to TAU), and baseline neuropsychological function did not predict treatment-related ADHD or QoL effects.

CONCLUSION

Although NFPP includes a neuropsychological training element and has been shown to improve several clinical outcomes, it did not improve the neuropsychological functions it targets.

A Machine Learning Approach to Assess Differential Item Functioning of the KINDL Quality of Life Questionnaire Across Children with and Without ADHD

This study aimed to investigate differential item functioning (DIF) of the child and parent reports of the KINDL measure across children with and without Attention-deficit/hyperactivity disorder (ADHD). The sample included 122 children with ADHD and 1086 healthy peers, alongside 127 and 1061 of their parents, respectively. The generalized partial credit model with lasso penalization, as a machine learning method, was used to assess DIF of the KINDL across the two groups. The findings showed that three out of 24 items of the child reports and seven out of 24 items of the parent reports of the KINDL exhibited DIF between children with and without ADHD. Accordingly, Iranian children with and without ADHD along with their parents perceive almost all items in the KINDL similarly. Hence, the observed difference in quality of life scores between children with and without ADHD is a real difference and not a reflection of measurement bias.

Ahead of the (ROC) Curve: A Statistical Approach to Utilizing Ex-Gaussian Parameters of Reaction Time in Diagnosing ADHD Across Three Developmental Periods

INTRODUCTION

Performance on executive function (EF) tasks is only modestly predictive of a diagnosis of Attention Deficit Hyperactivity Disorder (ADHD), despite the common assumption that EF deficits are ubiquitous to the disorder. The current study sought to determine whether ex-Gaussian parameters of simple reaction time are better able to discriminate between children and adults with and without ADHD, compared with traditional measures of inhibitory control.

METHODS

Receiver Operating Characteristic (ROC) analyses and the area under the curve (AUC) were used to examine the ability of performance on two commonly used tasks of inhibitory control (i.e. stop signal reaction time (SSRT) and go-no-go tasks) to predict ADHD status in preschool (N = 108), middle childhood (N = 309), and young adulthood (N = 133).

RESULTS

Across all samples, SSRT, go-no-go percentage of failed inhibits, and standard deviation of reaction (SDRT) time to "go" trials, all successfully discriminated between individuals with and without ADHD. Ex-Gaussian decomposition of the RT distribution indicated that both larger tau and larger sigma drove findings for SDRT. Contrary to predictions, traditional measures of inhibitory control were equal if not better predictors of ADHD status than ex-Gaussian parameters.

CONCLUSIONS

Findings support ongoing work to quantify the separate contributions of cognitive subprocesses that drive task performance, which in turn is critical to developing and improving process-based approaches in clinical assessment.

Dimensional label learning contributes to the development of executive functions

A key to understanding how the brain develops is to understand how learning can change brain function. One index of learning that takes place in early childhood involves the comprehension and production of labels describing the shape and color features of objects, a process known as dimensional label learning (DLL). DLL requires integrating auditory and visual stimuli to form a system of mappings that link label representations (e.g. "red" and "color") and visual feature representations (e.g. "red" and the hue red). Children gain expertise with these labels between the ages of 2 and 5 years, and at the same time they begin to demonstrate skills in using labels to guide cognitive function in other domains. For example, one of the hallmark measures of executive function development requires children to use verbally instructed rules to guide attention to visual dimensions. The broader impact of DLL, however, has not yet been explored. Here, we examine how the neural processes associated with the comprehension and production of labels for visual features predicts later performance on executive function tasks. Specifically, we show that left frontal cortex is activated during comprehension and production tasks at 33 months of age. Moreover, we find that neural activation in this region during label production at 33 months is associated with dimensional attention, but not spatial selective attention, at 45 months. These results shed new light on the role of label learning in developmental changes in brain and behavior. Moreover, these data suggest that dimensional label learning generalizes beyond the learned information to influence other aspects of cognition. We anticipate that these results may serve as a starting point for future work to implement label training as an intervention to influence later cognition.

Electroencephalogram aperiodic power spectral slope can be reliably measured and predicts ADHD risk in early development

The aperiodic exponent of the electroencephalogram (EEG) power spectrum has received growing attention as a physiological marker of neurodevelopmental psychopathology, including attention-deficit/hyperactivity disorder (ADHD). However, its use as a marker of ADHD risk across development, and particularly in very young children, is limited by unknown reliability, difficulty in aligning canonical band-based measures across development periods, and unclear effects of treatment in later development. Here, we investigate the internal consistency of the aperiodic EEG power spectrum slope and its association with ADHD risk in both infants (n = 69, 1-month-old) and adolescents (n = 262, ages 11-17 years). Results confirm good to excellent internal consistency in infancy and adolescence. In infancy, a larger aperiodic exponent was associated with greater family history of ADHD. In contrast, in adolescence, ADHD diagnosis was associated with a smaller aperiodic exponent, but only in children with ADHD who had not received stimulant medication treatment. Results suggest that disruptions in cortical development associated with ADHD risk may be detectable shortly after birth via this approach. Together, findings imply a dynamic developmental shift in which the developmentally normative flattening of the EEG power spectrum is exaggerated in ADHD, potentially reflecting imbalances in cortical excitation and inhibition that could contribute to long-lasting differences in brain connectivity.

Evaluating the Impact of a Targeted Approach Designed to Build Executive Function Skills: A Randomized Trial of Brain Games

This paper reports results from an impact study of Brain Games (BGs), a classroom-based intervention designed to build preschool and school-aged children’s executive functions (EFs) and related self-regulation skills. The study employed a classroom-randomized, experimental design with 626 students in 36 pre-K through fourth grade classrooms in charter schools in a mid-sized urban district. In one set of models with child covariates, children in intervention classrooms showed marginal positive impacts on regulation-related behaviors, attention control and impulsivity, and negative effects on global EF and marginal increases in discipline problems. A second set of models with a smaller sample and both child and classroom covariates included indicate positive impacts of BGs on global EFs, prosocial behavior, and attention control and impulsivity. There were no significant impacts on the teacher–student relationship as reported by the teacher or on direct assessments of inhibitory control, short term and working memory, or another measure of global EF in either set of models. These promising findings offer a signal that implementation of targeted, easy to implement intervention approaches in classroom contexts can influence children’s regulation-related and prosocial outcomes, but this signal should be investigated further with larger and more tightly controlled designs.

The Impact of Bilingualism on Executive Functions in Children and Adolescents: A Systematic Review Based on the PRISMA Method

Approximately half of the world's population is bilingual or multilingual. The bilingual advantage theory claims that the constant need to control both known languages, that are always active in the brain, to use the one suitable for each specific context improves cognitive functions and specifically executive functions. However, some authors do not agree on the bilingual effect, given the controversial results of studies on this topic. This systematic review aims to summarize the results of studies on the relationship between bilingualism and executive functions. The review was conducted according to PRISMA-statement through searches in the scientific database PsychINFO, PsycARTICLES, MEDLINE, and PUBMED. Studies included in this review had at least one bilingual and monolingual group, participants aged between 5 and 17 years, and at least one executive function measure. Studies on second language learners, multilingual people, and the clinical population were excluded. Fifty-three studies were included in the systematic review. Evidence supporting the bilingual effect seems to appear when assessing inhibition and cognitive flexibility, but to disappear when working memory is considered. The inconsistent results of the studies do not allow drawing definite conclusions on the bilingual effect. Further studies are needed; they should consider the role of some modulators (e.g., language history and context, methodological differences) on the observed results.

Reliability and Validity of the Utrecht Tasks for Attention in Toddlers Using Eye Tracking (UTATE)

Attention problems hinder many children in their cognitive and social emotional development. Children at risk for developmental problems, like preterm born infants, are specifically known for attention difficulties. Early identification of attention difficulties is important for application of appropriate stimulation in trying to reduce further problems. Specifically designed instruments with good psychometric characteristics are needed to show difficulties in attention, that may contribute to early identification. The Utrecht Tasks of Attention in Toddlers using Eye tracking (UTATE) is an instrument to measure orienting, alerting and executive attention capacities in young children. Reliability and validity of the UTATE are specifically addressed in three studies, reported in this paper. A sample of 95 term born children assessed at 18 months of age was used that provided data for both the second and third study reported here. In addition, three other small samples were used, of which the first consisted of 12 children at 18 months with test-retest data available that are reported in the first study. Two other samples that were used in the third study, consisted of 14 children measured at 12 months, and 15 children examined at 24 months. The UTATE resulted in reliable information on eye movements and some first support for construct and predictive validity was found. Low scores on the UTATE at 18 months were found to be related to slower cognitive development as measured with the Bayley-III-NL at 24 months. Furthermore, a first indication that the UTATE is able to detect some age differences in attention was found. It is concluded that the UTATE can be used to study attention capacities in toddlers that underlie cognitive functioning and development, but further research is necessary.

Single nucleotide polymorphism heritability and differential patterns of genetic overlap between inattention and four neurocognitive factors in youth

Theoretical models of attention-deficit/hyperactivity disorder implicate neurocognitive dysfunction, yet neurocognitive functioning covers a range of abilities that may not all be linked with inattention. This study (a) investigated the single nucleotide polymorphism (SNP) heritability (h2SNP) of inattention and aspects of neurocognitive efficiency (memory, social cognition, executive function, and complex cognition) based on additive genome-wide effects; (b) examined if there were shared genetic effects among inattention and each aspect of neurocognitive efficiency; and (c) conducted an exploratory genome-wide association study to identify genetic regions associated with inattention. The sample included 3,563 participants of the Philadelphia Neurodevelopmental Cohort, a general population sample aged 8-21 years who completed the Penn Neurocognitive Battery. Data on inattention was obtained with the Kiddie Schedule of Affective Disorders (adapted). Genomic relatedness matrix restricted maximum likelihood was implemented in genome-wide complex trait analysis. Analyses revealed significant h2SNP for inattention (20%, SE = 0.08), social cognition (13%, SE = 0.08), memory (17%, SE = 0.08), executive function (25%, SE = 0.08), and complex cognition (24%, SE = 0.08). There was a positive genetic correlation (0.67, SE = 0.37) and a negative residual covariance (-0.23, SE = 0.06) between inattention and social cognition. No SNPs reached genome-wide significance for inattention. Results suggest specificity in genetic overlap among inattention and different aspects of neurocognitive efficiency.

Heterogeneity in development of aspects of working memory predicts longitudinal attention deficit hyperactivity disorder symptom change

The role of cognitive mechanisms in the clinical course of neurodevelopmental disorders is poorly understood. Attention Deficit Hyperactivity Disorder (ADHD) is emblematic in that numerous alterations in cognitive development are apparent, yet how they relate to changes in symptom expression with age is unclear. To resolve the role of cognitive mechanisms in ADHD, a developmental perspective that takes into account expected within-group heterogeneity is needed.

METHOD

The current study uses an accelerated longitudinal design and latent trajectory growth mixture models in a sample of children ages 7-13 years carefully characterized as with (n = 437) and without (n = 297) ADHD to (a) identify heterogeneous developmental trajectories for response inhibition, visual spatial working memory maintenance, and delayed reward discounting and (b) to assess the relationships between these cognitive trajectories and ADHD symptom change.

RESULTS

Best-fitting models indicated multiple trajectory classes in both the ADHD and typically developing samples, as well as distinct relationships between each cognitive process and ADHD symptom change. Developmental change in response inhibition and delayed reward discounting were unrelated to ADHD symptom change, while individual differences in the rate of visual spatial working memory maintenance improvement predicted symptom remission in ADHD.

CONCLUSION

Characterizing heterogeneity in cognitive development will be crucial for clarifying mechanisms of symptom persistence and recovery. Results here suggest working memory maintenance may be uniquely related to ADHD symptom improvement. (PsycINFO Database Record