The test-retest reliability of the latent construct of executive function depends on whether tasks are represented as formative or reflective indicators

Norms, convergent validity, test-retest reliability, and practice effects for verbal fluency overall performance, clustering, and switching in Spanish-speaking children

OBJECTIVE

We conducted two empirical studies (in a cross-sectional and a longitudinal design) with the aim at establishing normative data (including norms for strategy use [i.e., clustering and switching strategies] and performance over time), and examining the convergent validity, the test-retest reliability (3-4 wks interval) and the changes in performance with practice (1 year interval) of the different verbal fluency (VF) quantitative and qualitative scores in Spanish-speaking children and adolescents.

METHOD

In S1 (n = 620 6- to 15-year-old Spanish-speaking children and adolescents), MANCOVA and Pearson's correlations were employed. In S2 (n = 148 6- to 12-year-old Spanish-speaking children), intraclass correlation coefficient (ICC), paired t-tests, and Confirmatory Factor Analysis (CFA) were used.

RESULTS

S1 results showed an age effect on all VF measures (quantitative and qualitative). The number of switches/clusters was more related to total word productivity and to executive functions (EF) than the mean cluster size. In S2, a significant increase in phonological VF performance was observed on number of switches and word productivity scores from baseline (Time 1) to repeat testing at Time 2. Practice effects were observed at Time 3 on all measures except for semantic and phonological mean cluster size. Test-retest reliability coefficients at Time 2 for number of clusters and switches, but not for mean cluster size, fell in the moderate range, ranging from ICCs .61 to ICCs .81. Test-retest reliability coefficients for total word productivity were higher (ICCs above .80) and stronger when testing as a unity with CFA methods (ϕ=.94, p < .001).

CONCLUSIONS

These data may be relevant for informing the neuropsychological assessment of spontaneous cognitive flexibility in children with typical development (TD) and those with developmental or acquired disorders.

Sensitive caregiving and reward responsivity: A novel mechanism linking parenting and executive functions development in early childhood

Sensitive caregiving is an essential aspect of positive parenting that influences executive functions development, but the mechanisms underlying this association are less clear. Using data from the Family Life Project, a large prospective longitudinal sample of 1292 families residing in rural, predominately low-income communities, the current study examined whether sensitive caregiving impacts executive functions development by shaping behavioral reward processing systems in early postnatal life. Results indicated that higher levels of sensitive caregiving during infancy were associated with heightened reward responsivity at age 4, which in turn predicted superior executive functions ability at age 5. Notably, children's reward responsivity partially mediated the relationship between sensitive caregiving in infancy and executive functions ability at school entry. These findings add to prior work on early experience and children's executive functions and highlight caregiver scaffolding of developing reward processing systems as a potential foundational mechanism for supporting adaptive behavior and self-regulation across the lifespan.

Studying children's growth in self-regulation using changing measures to account for heterotypic continuity: A Bayesian approach to developmental scaling

Self-regulation is thought to show heterotypic continuity-its individual differences endure but its behavioral manifestations change across development. Thus, different measures across time may be necessary to account for heterotypic continuity of self-regulation. This longitudinal study examined children's (N = 108) self-regulation development using 17 measures, including 15 performance-based measures, two questionnaires, and three raters across seven time points. It is the first to use different measures of self-regulation over time to account for heterotypic continuity while using developmental scaling to link the measures onto the same scale for more accurate growth estimates. Assessed facets included inhibitory control, delayed gratification, sustained attention, and executive functions. Some measures differed across ages to retain construct validity and account for heterotypic continuity. A Bayesian longitudinal mixed model for developmental scaling was developed to link the differing measures onto the same scale. This allowed charting children's self-regulation growth across ages 3-7 years and relating it to both predictors and outcomes. Rapid growth occurred from ages 3-6. As a validation of the developmental scaling approach, greater self-regulation was associated with better school readiness (math and reading skills) and fewer externalizing problems. Our multi-wave, multi-facet, multi-method, multi-measure, multi-rater, developmental scaling approach is the most comprehensive to date for assessing the development of self-regulation. This approach demonstrates that developmental scaling may enable studying development of self-regulation across the lifespan.

Explaining the Prospective Association of Positive and Negative Parenting Behaviors and Child ADHD Symptoms: Pathways Through Child Executive Function and Reward Responsivity

Objective: Parenting behavior is a well-established correlate of offspring ADHD. However, little is known about how parenting exerts its effects on offspring ADHD symptomatology. We examined whether prospective associations between positive and negative parenting behaviors and child ADHD symptoms are mediated by deficits in child executive function (EF) and reward responsivity (RR). Method: One hundred and thirty-five children with and without ADHD were assessed across two Waves, when children were mean ages 6 and 8 respectively. Children completed tasks on EF, and parents completed questionnaires about their parenting behaviors and their children's RR and ADHD symptoms. Results: Negative parenting behavior at Wave 1 was indirectly associated with offspring ADHD symptoms at Wave 2 via offspring EF. Conclusion: Individual differences in EF, but not RR, during early childhood may constitute a potential pathway by which negative parenting behaviors exerts its effects on subsequent offspring ADHD symptomatology. Treatment implications are discussed.

Heterotypic continuity of inhibitory control in early childhood: Evidence from four widely used measures

Inhibitory control has been widely studied in association with social and academic adjustment. However, prior studies have generally overlooked the potential heterotypic continuity of inhibitory control and how this could affect assessment and understanding of its development. In the present study, we systematically considered heterotypic continuity in four well-established measures of inhibitory control, testing two competing hypotheses: (a) the manifestation of inhibitory control coheres within and across time in consistent, relatively simple ways, consistent with homotypic continuity. Alternatively, (b) with developmental growth, inhibitory control manifests in more complex ways with changes across development, consistent with heterotypic continuity. We also explored differences in inhibitory control as a function of the child's sex, language ability, and the family's socioeconomic status. Children (N = 513) were studied longitudinally at 30, 36, and 42 months of age. Changes in the patterns of associations within and among inhibitory control measures across ages suggest that the measures' meanings change with age, the construct manifests differently across development, and, therefore, that the construct shows heterotypic continuity. We argue that the heterotypic continuity of inhibitory control motivates the use of different combinations of inhibitory control indexes at different points in development in future research to improve validity. Confirmatory factors and growth curves also suggest that individual differences in inhibitory control endure, with convergence among inhibitory control measures by 36 months of age. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Neurodevelopmental outcomes in preterm infants with retinopathy of prematurity

Over the past decade there has been a paradigm shift in the treatment of retinopathy of prematurity (ROP) with the introduction of antivascular endothelial growth factor (anti-VEGF) treatments. Anti-VEGF agents have the advantages of being easier to administer, requiring less anesthesia, having the potential for improved peripheral vision, and producing less refractive error than laser treatment. On the other hand, it is known that intravitreal administration of anti-VEGF agents lowers VEGF levels in the blood and raises the theoretical concern of intraocular anti-VEGF causing deleterious effects in other organ systems, including the brain. As a result, there has been increased attention recently on neurodevelopmental outcomes in infants treated with anti-VEGF agents. These studies should be put into context with what is known about systemic comorbidities, socioeconomic influences, and the effects of extreme prematurity itself on neurodevelopmental outcomes. We summarize what is known about neurodevelopmental outcomes in extremely preterm infants with ROP, discuss the implications for determining the neurodevelopmental status using neurodevelopmental testing as well as other indicators, and review the existing literature relating to neurodevelopmental outcomes in babies treated for ROP.

Testing the Efficacy of the Red-Light Purple-Light Games in Preprimary Classrooms in Kenya

This study adapted and tested the efficacy of the Red-Light Purple-Light (RLPL) games for improving executive function (EF) skills in preprimary classrooms in Nairobi, Kenya. A cluster randomized controlled trial was used to evaluate the efficacy of the adapted RLPL intervention. Specifically, 24 centers (including 48 classrooms) were randomized to the RLPL or a wait-list control condition. Consistent with previous studies, participating classrooms delivered 16 lessons across an 8-week intervention period. A total of 479 children were recruited into the study. After exclusions based on child age and data quality, 451 and 404 children (90% retention) had completed computerized assessments of EF skills at pre- and posttest assessments, respectively. Children in the RLPL centers did not demonstrate any improvements in EF skills relative to their peers in the wait-list control condition (Cohen's ds = -0.14 to 0.03, all ps > 0.20). Exploratory tests of moderators (language of assessment, grade, school type, baseline ability) were also all null. Results are discussed with respect to measurement limitations and contextual factors that may explain the null results of RLPL on EF skills in young children in Kenya.

Pieces of evidences of reliability of the Brazilian version of the Child Executive Functions Battery (CEF-B)

Executive dysfunctions are central symptoms in different neurological, developmental, and context-related conditions. The assessment of these functions is then essential in neuropsychological pediatric clinical practice. Given the need for reliable and valid evaluation batteries for clinical practice in Brazil, this study aimed to present the pieces of evidences of reliability of the Child Executive Functions Battery (CEF-B). A total of 230 Brazilian children with typical development aged between 7 and 12 years participated in the study. Internal consistency was determined by the split-half method, Cronbach’s α, and Ω. In addition, measurements of test-retest reliability and intraclass coefficient were also performed. Retest indicators were mostly weak and moderate (between .43 and .75). Overvall, coefficients show a satisfactory internal consistency reliability for planning and inhibition measures (between .72 and .92). Considering the measures of WM, results were also satisfactory for both α and Ω indexes. This study revealed that the CEF-B has satisfactory internal consistency reliability coefficients. However, several tests have shown low reliability assessed through the test-retest method. In general, findings reveal interesting pieces of initial evidence of reliability of the Brazilian version. The methodological approach could be improved in future studies by including children with executive disorders.

Do Working Memory Deficits Underlie Reading Problems in Attention-Deficit/Hyperactivity Disorder (ADHD)?

Reading problems are common in children with ADHD and show strong covariation with these children's underdeveloped working memory abilities. In contrast, working memory training does not appear to improve reading performance for children with ADHD or neurotypical children. The current study bridges the gap between these conflicting findings, and combines dual-task methodology with Bayesian modeling to examine the role of working memory for explaining ADHD-related reading problems. Children ages 8-13 (M = 10.50, SD = 1.59) with and without ADHD (N = 78; 29 girls; 63% Caucasian/Non-Hispanic) completed a counterbalanced series of reading tasks that systematically manipulated concurrent working memory demands. Adding working memory demands produced disproportionate decrements in reading comprehension for children with ADHD (d = -0.67) relative to Non-ADHD children (d = -0.18); comprehension was significantly reduced in both groups when working memory demands were increased. These effects were robust to controls for foundational reading skills (decoding, sight word vocabulary) and comorbid reading disability. Concurrent working memory demands did not slow reading speed for either group. The ADHD group showed lower comprehension (d = 1.02) and speed (d = 0.69) even before adding working memory demands beyond those inherently required for reading. Exploratory conditional effects analyses indicated that underdeveloped working memory overlapped with 41% (comprehension) and 85% (speed) of these between-group differences. Reading problems in ADHD appear attributable, at least in part, to their underdeveloped working memory abilities. Combined with prior cross-sectional and longitudinal findings, the current experimental evidence positions working memory as a potential causal mechanism that is necessary but not sufficient for effectively understanding written language.

Using Repeated-Measures Data to Make Stronger Tests of the Association between Executive Function Skills and Attention Deficit/Hyperactivity Disorder Symptomatology in Early Childhood

Theoretical models of Attention deficit/hyperactivity disorder (ADHD) have long implicated executive function (EF) skills as contributing to the etiology, maintenance, and changes in ADHD symptomatology over time. Although there is interest making within-person inferences (i.e., deficits in EF skills give rise to ADHD behaviors), most of the evidence has been derived from studies that conflated between- and within-person sources of variance. Here, we use repeated-measures data to test within-person association between EF skills and ADHD behaviors. Participants included 1160 children from the Family Life Project, an ongoing prospective longitudinal study of child development in low-income, nonmetropolitan communities. We tested the magnitude of the association between EF skills and ADHD behaviors when children were 3, 4, and 5 years old. Consistent with meta-analyses, unadjusted bivariate associations between EF and ADHD (which reflect combined between- and within-person variation) were of moderate magnitude (rs = -0.20 to -0.30). However, after controlling for all time-invariant, between-person sources of variation, the within-person associations between EF skills and ADHD behaviors were weak (βs - 0.04 to -0.05, ps = 0.01). These results suggest that EF skills may contribute less prominently to ADHD behaviors in early childhood than is commonly assumed and provoke broader questions about developmental models of ADHD.

Theoretical and Methodological Implications of Associations between Executive Function and Mathematics in Early Childhood

Despite agreement about the importance of executive function (EF) for children's early math achievement, its treatment in correlational studies reflects a lack of agreement about the theoretical connection between the two. It remains unclear whether the association between EF and math operates through a latent EF construct or specific EF components. Specifying the correct measurement model has important theoretical implications for the predicted effects of EF interventions on children's math achievement. In the current study, we tested whether associations between EF and math operate via a latent EF factor, or via specific EF components using data from a large, nationally representative sample. We then replicated these same analyses with a meta-analytic database drawn from ten studies that collected measures of children's EF and math achievement. Our results lend support to explanations that a single EF factor accounts for most of the EF component-specific associations with math achievement. We discuss theoretical and methodological implications of these findings for future work.

Examining an Executive Function Battery for Use with Preschool Children with Disabilities

Performance-based assessments of EF for use with young children who have or are at risk for disabilities are lacking. The current study investigates the use of a computerized battery for children with subclinical behaviors (N = 846) across a variety of developmental disabilities and evaluates practical information about feasibility of task administration. Results reveal that children with disabilities performed similarly to their typically developing peers across a variety of metrics for evaluating the battery, ranging from percent correct scores to administrator quality ratings. Thus, the battery may be considered an easy-to-administer, performance-based assessment tool in which children with disabilities do not perform systemically worse than typically developing peers.

COMMENTARY ON THE CHANGING NATURE OF EXECUTIVE CONTROL IN PRESCHOOL

In this commentary, I provide a critical evaluation of Espy and colleagues' proposal to use a bifactor modeling approach to characterize children's performance on executive control tasks. I draw attention to an old idea regarding treating items as causal or effect indicators of their latent constructs. I remind readers that factor analytic approaches, including the bifactor model that is proposed here, assume that executive control tasks are effect indicators of the latent construct of executive control. I suggest that executive control tasks may be better conceptualized as causal indicators. I further suggest that these different modeling approaches will result in markedly different conclusions about the nature of executive control-including predictors and outcomes of executive control that were the focus of this monograph.

The Childhood Executive Functioning Inventory (CHEXI): Factor structure, measurement invariance, and correlates in US preschoolers

This study tests the factor structure, measurement invariance, and correlates of the Childhood Executive Functioning Inventory (CHEXI) with a large and diverse sample of 3- to 5-year-olds (n = 844). Consistent with previous studies, a two-factor model that distinguishes working memory from inhibition provides the best fit to the observed data. This two-factor model has been shown to demonstrate strong measurement invariance for different subgroups of children (boys vs. girls, high vs. low income). Whereas boys tend to have greater working memory and inhibition difficulties (Cohen's d = 0.15 and 0.20, respectively), children from low-income households tend to have more working memory problems than their peers from high-income households (Cohen's d = 0.25). Finally, correlations between CHEXI scores, examiner reports of child behavior, and child performance on a battery of executive function (EF) tasks were investigated. CHEXI scores were found to be more consistently related to examiner reports of child behavior than child performance on EF tasks. Tthe strengths and weaknesses of the CHEXI as a questionnaire measure of EF are discussed, and directions for future research are suggested.