Calibrating temper loss severity in the transition to toddlerhood: Implications for developmental science

Leveraging mixed-effects location scale models to assess the ERP mismatch negativity's psychometric properties and trial-by-trial neural variability in toddler-mother dyads

Trial-by-trial neural variability, a measure of neural response stability, has been examined in relation to behavioral indicators using summary measures, but these methods do not characterize meaningful processes underlying variability. Mixed-effects location scale models (MELSMs) overcome these limitations by accounting for predictors and covariates of variability but have been rarely used in developmental studies. Here, we applied MELSMs to the ERP auditory mismatch negativity (MMN), a neural measure often related to language and psychopathology. 84 toddlers and 76 mothers completed a speech-syllable MMN paradigm. We extracted early and late MMN mean amplitudes from trial-level waveforms. We first characterized our sample's psychometric properties using MELSMs and found a wide range of subject-level internal consistency. Next, we examined the relation between toddler MMNs with theoretically relevant child behavioral and maternal variables. MELSMs offered better model fit than analyses that assumed constant variability. We found significant individual differences in trial-by-trial variability but no significant associations between toddler variability and their language, irritability, or mother variability indices. Overall, we illustrate how MELSMs can characterize psychometric properties and answer questions about individual differences in variability. We provide recommendations and resources as well as example code for analyzing trial-by-trial neural variability in future studies.

Capturing the complexity of child behavior and caregiver-child interactions in the HEALthy Brain and Child Development (HBCD) Study using a rigorous and equitable approach

The HEALthy Brain and Child Development (HBCD) Study, a multi-site prospective longitudinal cohort study, will examine human brain, cognitive, behavioral, social, and emotional development beginning prenatally and planned through early childhood. This article outlines methodological considerations and the decision-making process for measurement selection for child behavior, parenting/caregiver-child interactions, and the family/home environment for HBCD. The decision-making process is detailed, including formation of a national workgroup (WG-BEH) that focused on developmentally appropriate measures that take a rigorous and equitable approach and aligned with HBCD objectives. Multi-level-observational and caregiver-report measures were deemed necessary for capturing the desired constructs across multiple contexts while balancing the nuance of observational data with pragmatic considerations. WG-BEH prioritized developmentally sensitive, validated assessments with psychometrics supporting use in diverse populations and focused on mechanistic linkages and prediction of desired constructs. Other considerations included participant burden and retention, staff training needs, and cultural sensitivity. Innovation was permitted when it was grounded in evidence and filled key gaps. Finally, this article describes the rationale for the selected constructs (e.g., temperament, social-emotional development, parenting behaviors, family organization) and corresponding measures chosen for HBCD visits from early infancy through 17 months of age.

A network approach to the investigation of childhood irritability: probing frustration using social stimuli

BACKGROUND

Self-regulation in early childhood develops within a social context. Variations in such development can be attributed to inter-individual behavioral differences, which can be captured both as facets of temperament and across a normal:abnormal dimensional spectrum. With increasing emphasis on irritability as a robust early-life transdiagnostic indicator of broad psychopathological risk, linkage to neural mechanisms is imperative. Currently, there is inconsistency in the identification of neural circuits that underlie irritability in children, especially in social contexts. This study aimed to address this gap by utilizing a functional magnetic resonance imaging (fMRI) paradigm to investigate pediatric anger/frustration using social stimuli.

METHODS

Seventy-three children (M = 6 years, SD = 0.565) were recruited from a larger longitudinal study on irritability development. Caregivers completed questionnaires assessing irritable temperament and clinical symptoms of irritability. Children participated in a frustration task during fMRI scanning that was designed to induce frustration through loss of a desired prize to an animated character. Data were analyzed using both general linear modeling (GLM) and independent components analysis (ICA) and examined from the temperament and clinical perspectives.

RESULTS

ICA results uncovered an overarching network structure above and beyond what was revealed by traditional GLM analyses. Results showed that greater temperamental irritability was associated with significantly diminished spatial extent of activation and low-frequency power in a network comprised of the posterior superior temporal sulcus (pSTS) and the precuneus (p < .05, FDR-corrected). However, greater severity along the spectrum of clinical expression of irritability was associated with significantly increased extent and intensity of spatial activation as well as low- and high-frequency neural signal power in the right caudate (p < .05, FDR-corrected).

CONCLUSIONS

Our findings point to specific neural circuitry underlying pediatric irritability in the context of frustration using social stimuli. Results suggest that a deliberate focus on the construction of network-based neurodevelopmental profiles and social interaction along the normal:abnormal irritability spectrum is warranted to further identify comprehensive transdiagnostic substrates of the irritability.

Validity of the multidimensional assessment profile of disruptive behavior in autistic toddlers

Objective

Early measurement of atypical disruptive behavior within autistic children is critical for later referrals to behavioral screenings, diagnoses, and services. Disruptive behavior in autistic toddlers is often measured using a categorical approach and identifies the presence or absence of behavior. In contrast, dimensional approaches evaluate behavior on a spectrum of typical to atypical by measuring the clinical salience of disruptive behavior. We sought to assess the validity of the Infant/Toddler version of the multidimensional assessment profile of disruptive behavior (MAP-DB-IT), a dimensional approach measurement tool, in a sample of autistic toddlers.

Methods

Autistic toddlers (n = 82, M age = 33.2 months, SD = 6.28 months) and their mothers received 8 weeks of caregiver-mediated social communication intervention. Mothers completed the MAP-DB-IT and the Infant Toddler Social Emotional Assessment (ITSEA) across three timepoints: before intervention, immediately after intervention, and at 3 months post-intervention follow-up. The MAP-DB-IT provided scores for three subdomains: temper loss, noncompliance, and aggression (generically or specifically with siblings). Ratings on the MAP-DB-IT were compared to the ITSEA using several analytic strategies such as evaluating (a) the internal consistency of the MAP-DB-IT domain scores; (b) the convergent validity between the two measures; and (c) its convergent change due to intervention and if this varied by child characteristics.

Results

The MAP-DB-IT demonstrated excellent internal consistency across all four subdomains. We evaluated convergent validity and found positive correlations between the (a) ITSEA externalizing and MAP-DB-IT aggression domain, (b) ITSEA externalizing and MAP-DB-IT aggression with siblings domain, and (c) ITSEA dysregulation and MAP-DB-IT temper loss domain.

Conclusion

The MAP-DB-IT is a valid measurement tool for disruptive behavior in autistic toddlers. Clinicians should consider the use of the MAP-DB-IT for young autistic clients presenting with disruptive behavior to (a) discriminate between early developmentally appropriate tantrums from clinically salient dysregulation, and (b) refer to additional behavioral evaluations and services.

Irritability in Youths: A Critical Integrative Review

Irritability, defined as proneness to anger that may impair an individual's functioning, is common in youths. There has been a recent upsurge in relevant research. The authors combine systematic and narrative review approaches to integrate the latest clinical and translational findings and provide suggestions for addressing research gaps. Clinicians and researchers should assess irritability routinely, and specific assessment tools are now available. Informant effects are prominent, are stable, and vary by age and gender. The prevalence of irritability is particularly high among individuals with attention deficit hyperactivity disorder, autism spectrum disorder, and mood and anxiety disorders. Irritability is associated with impairment and suicidality risk independent of co-occurring diagnoses. Developmental trajectories of irritability (which may begin early in life) have been identified and are differentially associated with clinical outcomes. Youth irritability is associated with increased risk of anxiety, depression, behavioral problems, and suicidality later in life. Irritability is moderately heritable, and genetic associations differ based on age and comorbid illnesses. Parent management training is effective for treating psychological problems related to irritability, but its efficacy in treating irritability should be tested rigorously, as should novel mechanism-informed interventions (e.g., those targeting exposure to frustration). Associations between irritability and suicidality and the impact of cultural context are important, underresearched topics. Analyses of large, diverse longitudinal samples that extend into adulthood are needed. Data from both animal and human research indicate that aberrant responses to frustration and threat are central to the pathophysiology of irritability, revealing important translational opportunities.

Modeling the normal:abnormal spectrum of early childhood internalizing behaviors: A clinical-developmental approach for the Multidimensional Assessment Profiles Internalizing Dimensions

BACKGROUND

We expanded the Multidimensional Assessment Profiles (MAPS) Scales developmental specification model to characterize the normal:abnormal spectrum of internalizing (anxious and depressive) behaviors in early childhood via the MAPS-Internalizing (MAPS-INT) scale.

METHODS

The MAPS-INT item pool was generated based on clinical expertise and prior research. Analyses were conducted on a sub-sample of families (n = 183) from the diverse When to Worry early childhood sample.

RESULTS

Normal:abnormal descriptive patterns for both anxious and depressive behaviors were consistent with prior work: (1) extremes of normative variation are abnormal when very frequent; and (2) pathognomonic indicators that most children do not engage in and are abnormal, even if infrequent. Factor analysis revealed a two-factor MAPS-INT Anxious Behaviors structure (Fearful-Worried and Separation Distress) and a unidimensional MAPS-INT Depressive Behaviors factor with good fit and good-to-excellent test-retest reliability and validity.

CONCLUSIONS

We characterized the normal:abnormal spectrum of internalizing behaviors in early childhood via the MAPS-INT. Future research in larger representative samples can replicate and extend findings, including clinical thresholds and predictive utility. The MAPS-INT helps lay the groundwork for dimensional characterization of the internalizing spectrum to advance neurodevelopmental approaches to emergent psychopathology and its earlier identification.

A pragmatic, clinically optimized approach to characterizing adolescent irritability: Validation of parent- and adolescent reports on the Multidimensional Assessment Profile Scales-Temper Loss Scale

OBJECTIVES

Heightened irritability in adolescence is an impairing symptom that can lead to negative outcomes in adulthood, but effective screening tools are lacking. This study aimed to derive clinically-optimized cutoff scores using the Multidimensional Assessment Profile Scales-Temper Loss (MAPS-TL) to pragmatically identify adolescents with impairing irritability.

METHODS

A diverse sample of 79 adolescents and their parents completed the MAPS-TL-Youth version. Stepwise logistic regression analyses were used to determine the items associated with impairment, and receiver operator characteristic (ROC) analyses were conducted to derive optimal cutoff scores.

RESULTS

Three parent-report items (become frustrated easily, angry/irritable/grouchy throughout the day, difficulty calming down when angry) and two youth-report items (hit/shove/kick when lost temper, difficulty calming down when angry) were strongly associated with impairment. Optimal cutoff scores garnered very good sensitivity (91%, 73%) and specificity (77%, 75%) for the parent- and youth-report versions respectively. Scores above these cutoffs were associated with increased internalizing and externalizing problems and lower overall quality of life.

CONCLUSIONS

The MAPS-TL clinically optimized irritability scores show preliminary validity for implementation in practical settings to efficiently identify adolescents who need additional evaluation and/or intervention. Further research is important to validate these cutoff scores with larger population-based samples and real-world settings.

What is typical: Atypical in young children's attention regulation?: Characterizing the developmental spectrum with the Multidimensional Assessment Profiles-Attention Regulation Infant-Toddler (MAPS-AR-IT) Scale

While attention dysregulation is a promising early indicator of neurodevelopmental risk, in particular attention-deficit/hyperactivity disorder (ADHD), it is difficult to characterize clinical concern due to its developmental expectability at the transition to toddlerhood. Thus, explicating the typical:atypical continuum of risk indicators is among the key future directions for research to promote early identification and intervention, and prevent decrements in the attainment of developmental milestones into early childhood. In this paper, we present the Multidimensional Assessment Profiles-Attention Regulation Infant-Toddler (MAPS-AR-IT) Scale, a novel parent-report survey of dimensional, developmentally specified indicators of attention (dys)regulation. Item Response Theory was employed to characterize the typical:atypical spectrum of both normative and more concerning dysregulation (including the contexts in which behavior occurs). We provide evidence of the validity of this measure in capturing the full typical:atypical spectrum via a longitudinal sample of typically developing children at 12-18 months of age (baseline) via concurrent scores on well-validated temperament and clinical measures. We also examine longitudinal stability and predictive validity if the MAPS-AR-IT via a clinical interview of ADHD symptoms at 24-30 months (follow-up). While not diagnostic, we present evidence of the utility of the MAPS-AR-IT in explicating individual neurodevelopmental risk and elucidating the broader typicality of behaviors related to attention (dys)regulation.

Characterizing the spectrum of irritability in preadolescence: Dimensional and pragmatic applications

OBJECTIVES

Characterize the dimensional spectrum of preadolescent (PA) irritability, a robust transdiagnostic vulnerability marker, using the youth version of the Multidimensional Assessment Profiles Temper Loss (MAPS-TL-Youth) scale including common and with developmentally specific items. Based on this, derive and validate a clinically optimized irritability screener to flag psychopathology risk in preadolescents.

METHODS

The normal:abnormal irritability spectrum was modeled using MAPS-TL-Youth data from the Multidimensional Assessment of Preschoolers Study (MAPS) Study PA wave (n = 340) via item response theory. Both cross-cutting core items from the MAPS scales and developmentally specific items were used to generate this dimension. Stepwise logistic regression was then used to optimize MAPS-TL-Youth irritability items in relation to Kiddie Schedule of Affective Disorders and Schizophrenia impairment to generate a clinically optimized irritability screener. Receiver operator characteristic analysis identified the irritability threshold for the screener. For the first time, youth self-report of their own irritability on the MAPS-TL was also modeled via the MAPS-TL-Youth-Self-Report (MAPS-TL-Youth-SR).

RESULTS

Irritability was unidimensional and ranged from mild and common to severe and rare behaviors. Developmentally specific items allowed detection of more severe irritability. Items for the screener were identified in relation to concurrent impairment. These included low frustration tolerance and pathognomonic severe behaviors. The clinically optimized screener demonstrated very good sensitively (87%) and specificity (81%) in regard to concurrent irritability-related DSM disorders. Modeling of the MAPS-TL-Youth-SR yielded similar results.

CONCLUSION

Characterizing the normal: abnormal spectrum of irritability in preadolescence advances application of Research Domain Criteria methods to this developmental period. This foundational work yielded two developmentally specified tools for irritability characterization in preadolescence: a nuanced dimensional scale to precisely characterize the full normal-abnormal irritability spectrum, and a pragmatic, clinically optimized screener suitable for real world use. Future application in mechanistic and clinical studies will be important for establishing validity and incremental utility.

Developmentally specified characterization of the irritability spectrum at early school age: Implications for pragmatic mental health screening

OBJECTIVES

Developmentally specified measures that identify clinically salient irritability are needed for early school-age youth to meaningfully capture this transdiagnostic risk factor for psychopathology. Thus, the current study modeled the normal:abnormal irritability spectrum and generated a clinically optimized screening tool for this population.

METHODS

The irritability spectrum was modeled via the youth version of the Multidimensional Assessment Profile Scales-Temper Loss Scale (MAPS-TL-Youth) in children (n = 474; 6.0-8.9 years) using item response theory (IRT). Both cross-cutting core irritability items from the early childhood version and new developmentally specific items were included. Items uniquely associated with impairment were identified and used to derive a brief, clinically optimized irritability screener. Longitudinal data were then utilized to test the predictive utility of this clinically optimized screener in preadolescence (n = 348; 8.0-12.9 years).

RESULTS

Most children exhibit irritability regularly, but daily occurrence was rare. Of the top 10 most severe items from the IRT analyses, 9 were from the developmentally specific items added for the MAPS-TL Youth version. Two items associated with concurrent impairment were identified for the clinically optimized irritability screener ("Become frustrated easily" and "Act irritable"). The MAPS-TL-Youth clinically optimized screener demonstrated good sensitivity (69%) and specificity (84%) in relation to concurrent DSM 5 irritability-related diagnoses. Youth with elevated scores on the screener at early school age (ESA) had more than 7x greater odds of irritability-related psychopathology at pre-adolescence.

CONCLUSIONS

The MAPS-TL-Youth characterized the developmental spectrum of irritability at ESA and a clinically optimized screener showed promise at predicting psychopathology risk. Rigorous testing of clinical applications is a critical next step.

Joint Consideration of Inhibitory Control and Irritability in Young Children: Contributions to Emergent Psychopathology

Deficits in self-regulation capacity have been linked to subsequent impairment and clinical symptomology across the lifespan. Prior work has identified difficulty regulating angry emotions (i.e., irritability) as a powerful transdiagnostic indicator of current and future clinical concerns. Less is known regarding how irritability intersects with cognitive features of self-regulation, in particular inhibitory control, despite its mental health relevance. A promising avenue for improving specificity of clinical predictions in early childhood is multi-method, joint consideration of irritability and inhibitory control capacities. To advance early identification of impairment and psychopathology risk, we contrast group- and variable-based models of neurodevelopmental vulnerability at the interface of irritability and inhibitory control in contexts of varied motivational and emotional salience. This work was conducted in a longitudinal study of children recruited at well-child visits in Midwestern pediatric clinics at preschool age (N = 223, age range = 3-7 years). Group-based models (clustering and regression of clusters on clinical outcomes) indicated significant heterogeneity of self-regulation capacity in this sample. Meanwhile, variable-based models (continuous multiple regression) evidenced associations with concurrent clinical presentation, future symptoms, and impairment across the broad spectrum of psychopathology. Irritability transdiagnostically indicated internalizing and externalizing problems, concurrently and longitudinally. In contrast, inhibitory control was uniquely associated with attention-deficit/hyperactivity symptoms. We present these findings to advance a joint consideration approach to two promising indicators of neurodevelopmental vulnerability and mental health risk. Models suggest that both emotional and cognitive self-regulation capacities can address challenges in characterizing the developmental unfolding of psychopathology from preschool to early childhood age.

Measuring PROMIS® Emotional Distress in Early Childhood

OBJECTIVE

Create and validate developmentally sensitive parent-report measures of emotional distress for children ages 1-5 years that conceptually align with the Patient-Reported Outcome Measurement Information System (PROMIS®) pediatric measures.

METHODS

Initial items were generated based on expert and parent input regarding core components of emotional distress in early childhood and review of theoretical and empirical work in this domain. Items were psychometrically tested using data from two waves of panel surveys. Item response theory (IRT) was applied to develop item calibration parameters (Wave 1), and scores were centered on a general U.S. population sample (Wave 2). Final PROMIS early childhood (EC) instruments were compared with existing measures of related constructs to establish construct validity.

RESULTS

Experts and parents confirmed the content validity of the existing PROMIS Pediatric emotional distress domains (i.e., anger, anxiety, and depressive symptoms) as developmentally salient for young children. Existing items were adapted and expanded for early childhood by employing best practices from developmental measurement science. Item banks as well as 4- and 8-item short forms, free from differential item functioning across sex and age, were constructed for the three domains based on rigorous IRT analyses. Correlations with subscales from previously validated measures provided further evidence of construct validity.

CONCLUSIONS

The PROMIS EC Anger/Irritability, Anxiety, and Depressive Symptoms measures demonstrated good reliability and initial evidence of validity for use in early childhood. This is an important contribution to advancing brief, efficient measurement of emotional distress in young children, closing a developmental gap in PROMIS pediatric emotional distress assessment.

Don't Get Lost in Translation: Integrating Developmental and Implementation Sciences to Accelerate Real-World Impact on Children's Development, Health, and Wellbeing

Translation of developmental science discoveries is impeded by numerous barriers at different stages of the research-to-practice pipeline. Actualization of the vast potential of the developmental sciences to improve children's health and development in the real world is imperative but has not yet been fully realized. In this commentary, we argue that an integrated developmental-implementation sciences framework will result in a translational mindset essential for accelerating real world impact. We delineate key principles and methods of implementation science of salience to the developmental science audience, lay out a potential synthesis between implementation and developmental sciences, provide an illustration of the Mental Health, Earlier Partnership (MHE-P), and set actionable steps for realization. Blending these approaches along with wide-spread adoption of the translational mindset has transformative potential for population-level impact of developmental science discovery.