Evaluating working memory outcome measures for children with Down syndrome

Preliminary psychometric properties of an inhibition task in young children with Down syndrome

Background: Executive function (EF) skills are important treatment targets for people with Down syndrome (DS); however, few EF measures have been evaluated for use with young children in this population. Methods: The present study evaluated preliminary psychometric properties of a measure of the EF component of inhibition. Participants were 73 children with DS between 2.5 and 8.67 years old who completed an adapted ability to delay task using a desirable toy. Results: Across two separate trials, latencies to touch the toys were significantly correlated. Latencies increased overall with chronological and mental age, with caveats for the youngest and oldest participants. Conclusion: Findings suggest that an adapted prohibition task is an appropriate method of measuring inhibition for children with DS between 4 and 7 years old, though many children in this chronological age range are at early stages of acquiring this skill set.

Psychometric properties of inhibitory control measures among youth with Down syndrome

BACKGROUND

Inhibitory control measures have been commonly used when assessing individuals with Down syndrome. However, minimal attention has been devoted to evaluating the appropriateness of specific assessments for use in this population, potentially leading to erroneous conclusions. This study aimed to examine the psychometric properties of measures of inhibitory control among youth with Down syndrome. We sought to examine the feasibility, presence of floor or practice effects, test-retest reliability, convergent validity and correlations with broader developmental domains of a set of inhibitory control tasks.

METHODS

A sample of 97 youth with Down syndrome aged 6 to 17 years old participated in verbal and visuospatial tasks of inhibitory control including the Cat/dog Stroop, Neuropsychological Assessment Second Edition (NEPSY-II) Statue, National Institutes of Health (NIH) Toolbox Cognition Battery (TCB) Flanker, Leiter-3 Attention Sustained, and the Test of Attentional Performance for Children (KiTAP) Go/No-go and Distractibility subtests. Youth also completed standardised assessments of cognition and language, and caregivers completed rating scales. Psychometric properties on the tasks of inhibitory control were evaluated against a priori criteria.

RESULTS

Apart from demonstrating negligible practice effects, adequate psychometric properties were not observed for any inhibitory control measure within the current sample's age range. One task with low working memory demands (NEPSY-II Statue) generally had better psychometric properties than the other tasks assessed. Subgroups of participants with an IQ greater than 30 and age more than 8 years were shown to be more likely to be able to complete the inhibition tasks.

CONCLUSIONS

Findings suggest better feasibility for analogue tasks rather than computerised assessments of inhibitory control. Given the weak psychometrics of several common measures, future studies are required to evaluate other inhibitory control measures, specifically those with reduced working memory demands for youth with Down syndrome. Recommendations for use of the inhibitory control tasks among youth with Down syndrome are provided.

Psychometric evaluation of a working memory assessment measure in young children with Down syndrome

BACKGROUND

Working memory involves the temporary storage and manipulation of information and is frequently an area of challenge for individuals with Down syndrome (DS). Despite the potential benefits of intervention, laboratory assessments of working memory that could capture intervention effects have not undergone rigorous evaluation for use with young children with DS. It is critical to evaluate assessments of working memory in young children with DS to ensure the reliable and accurate measurement of performance.

AIM

This study evaluated an adapted laboratory measure of working memory for young children with DS 2-8 years old.

METHOD

A self-ordered pointing task, the Garage Game, was administered to 78 children with DS (mean = 5.17 years; SD = 1.49). Adaptations were made to the task to minimize potential DS phenotype-related language and motor confounds.

RESULTS

Results indicate that the measure is feasible, scalable, and developmentally sensitive, with minimal floor and practice effects for this population within this chronological and developmental age range.

CONCLUSION

These findings demonstrate that the Garage Game is promising for use in studies of early working memory and treatment trials that aim to support the development of this critical dimension of executive functioning for children with DS.

Evaluating an adapted reverse categorisation task to assess cognitive flexibility in young children with Down syndrome

BACKGROUND

Accurate measurement of cognitive skills is necessary to advance both developmental and intervention science for individuals with Down syndrome (DS). This study evaluated the feasibility, developmental sensitivity and preliminary reliability of a reverse categorisation measure designed to assess cognitive flexibility in young children with DS.

METHODS

Seventy-two children with DS ages 2.5-8 years completed an adapted version of a reverse categorisation task. Twenty-eight of the participants were assessed again 2 weeks later for retest reliability.

RESULTS

This adapted measure demonstrated adequate feasibility and developmental sensitivity, and preliminary evidence for test-retest reliability when administered to children with DS in this age range.

CONCLUSIONS

This adapted reverse categorisation measure may be useful for future developmental and treatment studies that target early foundations of cognitive flexibility in young children with DS. Additional recommendations for use of this measure are discussed.

Evaluating Processing Speed and Reaction Time Outcome Measures in Children and Adolescents with Down Syndrome

Reliable and valid cognitive outcome measures, including examiner-administered and computer-facilitated assessments of processing speed and reaction time, are necessary for future clinical trials that include individuals with Down syndrome (DS). The current study evaluated the score distributions and psychometric properties of four examiner-administered and three computerized processing speed and reaction time measures. Participants included 97 individuals with DS, aged 6 to 17 (M = 12.6, SD = 3.3). Two examiner-administered measures (Differential Ability Scales-II Rapid Naming and Cat/dog Stroop Congruent) met most predetermined psychometric criteria. Other assessments demonstrated good test-retest reliability and had negligible practice effects but lacked adequate feasibility. Recommendations for using processing speed and reaction time assessments in research and suggestions for modifications of measures are discussed.

Cognitive flexibility assessment in youth with Down syndrome: Reliability, practice effects, and validity

BACKGROUND

Cognitive flexibility refers to the ability to switch between different mental sets, tasks, or strategies and is challenging for some individuals with Down syndrome (DS). The lack of reliable and valid cognitive flexibility measures for individuals with DS is a major barrier to clinical trials and intervention studies designed to address cognitive challenges specific to DS. To avoid measurement limitations that could confound interpretations of performance in clinical trials in children with DS, it is critical to use phenotype-sensitive and psychometrically sound measures of cognitive flexibility.

AIM

This study aimed to evaluate the psychometric properties of three measures of cognitive flexibility including Rule-Shift, Weigl Sorting, and KiTAP Flexibility in a sample of 97 youth with DS aged 6-17 years old.

METHOD

Data were collected at two time points with a two-week interval. Parents also completed adaptive behavior and cognitive flexibility questionnaires. Child cognitive and language abilities were also assessed.

RESULTS

The Weigl Sorting met the most psychometric criteria, with adequate feasibility (≥ 80 %) and significant correlations with most of the broader developmental domains; however, the levels of test-retest reliability, practice effects, and convergent validity did not meet a priori criteria. Rule-Shift and KiTAP Flexibility measures did not have acceptable feasibility; although sensitivity and specificity analyses revealed that Rule-Shift may be appropriate for a subgroup of the participants.

CONCLUSION

No evaluated measures met all psychometric study criteria and, therefore, additional evaluation of cognitive flexibility measures is needed for use among individuals with DS.

Executive functioning and verbal fluency performance in youth with Down syndrome

BACKGROUND

Executive functioning (EF) is an area of challenge for individuals with Down syndrome (DS) associated with a variety of downstream difficulties. Verbal fluency performance is one potential downstream effect that is commonly assessed in individuals with DS due to the measure's utility as a predictor of dementia. Verbal fluency requires individuals to inhibit irrelevant responses, shift between groupings of related words, and monitor to prevent repetition, all skills related to EF.

AIMS

This study aimed to determine the association between semantic verbal fluency performance and three EF subdomains (inhibition, shifting, and working memory) in youth with DS after taking into account vocabulary and cognitive ability.

METHODS AND PROCEDURES

Neuropsychological assessments (verbal and visuospatial), and parent reports of EF, were completed at one time point by 69 youth with DS 6-17 years old and their caregivers. Expressive and receptive vocabulary skills and cognitive ability were also assessed.

OUTCOMES AND RESULTS

The results revealed that verbal fluency performance was significantly associated with neuropsychological assessments of EF and parent report of inhibition even after controlling for the effects of vocabulary and cognitive ability.

CONCLUSIONS AND IMPLICATIONS

The findings highlight the underlying importance of EF in verbal fluency tasks in youth with DS.

Considerations for measuring individual outcomes across contexts in Down syndrome: Implications for research and clinical trials

Individuals with Down syndrome (DS) are increasingly involved in clinical trials that target developmental outcomes, like cognition and behavior. The increased focus on treatment in DS has led to ongoing discussions regarding the selection of outcome measures using syndrome-informed criteria. This discourse is warranted as clinical trials can fail if the outcome measures selected are inappropriate for individuals with DS or do not take into account the behavioral phenotype commonly associated with DS. This review focuses on the challenges present in the measurement of outcomes in DS, with a specific focus on considerations made in evaluating cognitive, language, and behavioral/psychopathology outcomes. This review also provides a summary of recommendations for assessment of outcomes in these domains as well as recommendations for future research. The impact of physical health and assessment psychometrics on the measurement of outcomes is also reviewed.

Evaluating Verbal Fluency Outcome Measures in Children With Down Syndrome

This study evaluates the psychometric properties of a verbal fluency task for potential use as an outcome measure in future clinical trials involving children with Down syndrome. Eighty-five participants attempted a modified version of the Neuropsychological Assessment of Children, Second Edition Word Generation Task at two time points. In the full sample, the measure fell below a priori reliability and feasibility criteria, though feasibility of the semantic trials were higher than feasibility of the phonemic trials. Performance on the measure correlated with chronological age and IQ scores, and no sex-related effects were found. Additional analyses suggested that the semantic verbal fluency trials might be appropriate for children with Down syndrome 10 years of age and older.

Associations among co-occurring medical conditions and cognition, language, and behavior in Down syndrome

BACKGROUND

Specific medical conditions are more prevalent in Down syndrome (DS) compared to the general population. Medical heterogeneity has also been hypothesized to contribute to variability in outcomes in DS.

AIMS

This project aimed to examine the association between medical conditions (i.e., gastrointestinal issues, hearing loss, vision problems, and congenital heart defects) and cognition, language, and behavior in children and adolescents with DS.

METHODS AND PROCEDURES

Participants were 73 children and adolescents with DS, ages 6-17 years (M = 12.67, SD = 3.16). Caregivers reported on participants' medical conditions, social behaviors, maladaptive behaviors, and executive function. Child cognitive abilities were also assessed.

OUTCOMES AND RESULTS

Of the 73 participants, 34.2% had gastrointestinal issues, 12.3% had uncorrected hearing loss, 26.0% had uncorrected vision problems, and 31.5% had congenital heart defects. Participants with gastrointestinal issues had significantly more challenges with social behaviors, maladaptive behaviors, and executive function compared to those without gastrointestinal issues.

CONCLUSIONS AND IMPLICATIONS

The associations identified between gastrointestinal issues and caregiver-reported behavioral characteristics in youth with DS contributes to our understanding of the interrelation between co-occurring medical conditions and child outcomes and has implications for approaches to care for individuals with DS.

Short-term memory outcome measures: Psychometric evaluation and performance in youth with Down syndrome

BACKGROUND

Improving short-term memory (STM) performance for individuals with Down syndrome (DS) has been a target of recent clinical trials. Validation of STM outcome measures is essential for research rigor in trials among children and adolescents with DS.

AIMS

The current study investigated the psychometric properties of four direct STM assessments and one everyday memory parent form.

METHODS AND PROCEDURES

Measures were administered to a sample of 74 youth with DS at two visits, two weeks apart. Overall cognitive abilities were also assessed.

OUTCOMES AND RESULTS

The OMQ-PF had good feasibility and distribution of scores, but floor effects were prominent for direct measures. Test-retest reliability was poor to moderate for all measures and practice effects were problematic for the NEPSY-II List Memory and DAS-II Recall of Objects subtests. Commonalities in responses were observed, including primacy/recency effects, and some STM scores were correlated with overall cognitive abilities.

CONCLUSIONS AND IMPLICATIONS

The OMQ-PF met most study criteria, but no direct measure met sufficient criteria to be strongly recommended for future clinical trials. Because higher cognitive abilities were related to assessment completion, STM measures may require adaptation for use in broader samples of youth with DS across all levels of cognitive ability.

Executive function and intellectual disability: innovations, methods and treatment

This editorial presents an introduction to and an overview of the current JIDR special issue on "Executive Function in Intellectual Disability." The articles included in this special issue provide a contemporary, in depth exploration of questions regarding the nature of EF in individuals with ID. Topics include the emergence of EF during early childhood in ID-related conditions, the influence of EF on other domains of development, and the relationship between EF and adaptation throughout the lifespan. This editorial synthesizes the findings presented in this special issue and identifies methodological challenges that researchers will continue to face in future investigations of this important area.

[Formula: see text] The role of distinct executive functions on adaptive behavior in children and adolescents with Down syndrome

Difficulties in executive function are a relatively well-characterized feature of the neuropsychological profile in Down syndrome (DS), yet the impact of these challenges on aspects of daily functioning remain poorly understood. We examined the role of specific executive functions on domains of adaptive behavior in children and adolescents with DS. Participants included 68 children and adolescents with DS between 6-17 years old (mean chronological age = 12.56 years; SD = 3.22) and their caregivers. Parent reported executive function skills were measured using the BRIEF-2 and adaptive behavior was measured using the Vineland Adaptive Behavior Scales-III. Results identified working memory as a significant predictor of Communication, Daily Living, and Socialization skills, and Shifting significantly predicted Daily Living and Socialization. Findings demonstrate the relation between executive functions and adaptive behavior and highlight the effects of working memory on aspects of daily functioning for individuals with DS.

Psychometric Evaluation of Social Cognition and Behavior Measures in Children and Adolescents with Down Syndrome

Individuals with Down syndrome (DS) are often described as socially engaged; however, challenges with social cognition, expressive language, and social interaction are also common in DS and are prospective outcomes of interest for clinical trials. The current study evaluates the psychometric properties of standardized measurements of social cognition and social behavior for potential use as outcome measures for children and adolescents with DS. Seventy-three youth ages 6 to 17 years old (M = 12.67, SD = 3.16) with DS were assessed on social cognition subtests of a neuropsychological assessment at two time points. Caregivers also completed a parent-report measure of social behavior. Measures were evaluated for feasibility, test-retest reliability, practice effects, convergent validity, and associations with broader developmental domains (i.e., age, cognition, and language). All social cognition and behavior measures met criteria for a portion of the psychometric indices evaluated, yet feasibility limitations were identified for the Developmental Neuropsychological Assessment, Second Edition (NEPSY-II) Affect Recognition subtest, and the NEPSY-II Theory of Mind subtest had problematic floor effects for percentile ranks. The Social Responsiveness Scale, Second Edition (SRS-2; T-scores) had high feasibility, moderate to excellent test-retest reliability, and no practice effects, suggesting this measure could be appropriate for use in clinical trials involving youth with DS.