Factor structure of the NIH Toolbox Cognition Battery in individuals with acquired brain injury

Assessment of cross-cultural measurement invariance of the NIH toolbox fluid cognition measures between Jamaicans and African-Americans

The NIH Toolbox Cognitive Battery (NIHTB-CB) was developed as a common-metric, computerized cognitive screener for research. Although extensively normed and validated in Americans of different ethnicities, there is little data on how generalizable such results would be when used outside of the United States. The objective of this study was to assess measurement invariance (MI) of the NIHTB-CB across Jamaican and African-American samples and determine appropriateness of comparisons across groups. Multi-group confirmatory factor analyses using a single-factor model were conducted using five tests of fluid cognitive abilities from the NIHTB-CB, which assess working memory, episodic memory, processing speed, and executive function. MI was tested sequentially for configural, metric and scalar invariance. 125 Jamaican and 154 American adults of African descent were included. The Jamaican mean age was 31.6 ± 8.6 years (57% males) compared to 43.5 ± 15.5 years (25% males) for the African-American group. The Jamaicans had on average 11.3 ± 2.7 years of education compared to 13.9 ± 2.6 years for the African-Americans. We found metric and configural invariance across both samples but not scalar invariance. These findings suggest that the single factor emerging from the NIHTB-CB measures the same construct, i.e. fluid cognitive ability, in both groups and hence the battery is appropriate for assessments within cultures. However, lack of scalar invariance indicates that direct cross-cultural comparisons of performance levels should be interpreted with caution, also suggesting that U.S. normative standards are not generalizable to the Jamaican population.

Validity of the NIH toolbox cognitive battery in a healthy oldest-old 85+ sample

OBJECTIVE

To evaluate the construct validity of the NIH Toolbox Cognitive Battery (NIH TB-CB) in the healthy oldest-old (85+ years old).

METHOD

Our sample from the McKnight Brain Aging Registry consists of 179 individuals, 85 to 99 years of age, screened for memory, neurological, and psychiatric disorders. Using previous research methods on a sample of 85 + y/o adults, we conducted confirmatory factor analyses on models of NIH TB-CB and same domain standard neuropsychological measures. We hypothesized the five-factor model (Reading, Vocabulary, Memory, Working Memory, and Executive/Speed) would have the best fit, consistent with younger populations. We assessed confirmatory and discriminant validity. We also evaluated demographic and computer use predictors of NIH TB-CB composite scores.

RESULTS

Findings suggest the six-factor model (Vocabulary, Reading, Memory, Working Memory, Executive, and Speed) had a better fit than alternative models. NIH TB-CB tests had good convergent and discriminant validity, though tests in the executive functioning domain had high inter-correlations with other cognitive domains. Computer use was strongly associated with higher NIH TB-CB overall and fluid cognition composite scores.

CONCLUSION

The NIH TB-CB is a valid assessment for the oldest-old samples, with relatively weak validity in the domain of executive functioning. Computer use's impact on composite scores could be due to the executive demands of learning to use a tablet. Strong relationships of executive function with other cognitive domains could be due to cognitive dedifferentiation. Overall, the NIH TB-CB could be useful for testing cognition in the oldest-old and the impact of aging on cognition in older populations.

Graph-matching distance between individuals' functional connectomes varies with relatedness, age, and cognitive score

Functional connectomes (FCs), represented by networks or graphs that summarize coactivation patterns between pairs of brain regions, have been related at a population level to age, sex, cognitive/behavioral scores, life experience, genetics, and disease/disorders. However, quantifying FC differences between individuals also provides a rich source of information with which to map to differences in those individuals' biology, experience, genetics or behavior. In this study, graph matching is used to create a novel inter-individual FC metric, called swap distance, that quantifies the distance between pairs of individuals' partial FCs, with a smaller swap distance indicating the individuals have more similar FC. We apply graph matching to align FCs between individuals from the the Human Connectome ProjectN = 997 and find that swap distance (i) increases with increasing familial distance, (ii) increases with subjects' ages, (iii) is smaller for pairs of females compared to pairs of males, and (iv) is larger for females with lower cognitive scores compared to females with larger cognitive scores. Regions that contributed most to individuals' swap distances were in higher-order networks, that is, default-mode and fronto-parietal, that underlie executive function and memory. These higher-order networks' regions also had swap frequencies that varied monotonically with familial relatedness of the individuals in question. We posit that the proposed graph matching technique provides a novel way to study inter-subject differences in FC and enables quantification of how FC may vary with age, relatedness, sex, and behavior.

Can we trust computers to assess the cognition of stroke patients? A systematic review

Purpose

To summarize the classification of computerized cognitive assessment (CCA) tools for assessing stroke patients, to clarify their benefits and limitations, and to reveal strategies for future studies on CCA tools.

Methods

A literature review was performed using PubMed, Embase, Scopus, JAMA Network, Cochrane Library and PsycINFO databases from January 1st, 2010, to August 1st, 2022. Two authors independently screened the literature following the same criteria, evaluated the study quality, and collected data from the articles.

Results

A total of 8,697 papers were acquired from the six databases. A total of 74 potentially eligible articles were selected for review. Of these, 29 articles were not relevant to this research, 3 were reviews, 2 were not written in English, and 1 was on an ongoing trial. By screening the references of the reviews, 3 additional articles were included in this study. Thus, a total of 42 articles met the criteria for the review. In terms of the CCA tools analyzed in these studies, they included five types: virtual reality (VR)-based, robot-based, telephone-based, smartphone-based, and computer-based cognitive assessments. Patients' stages of the disease ranged from the subacute phase and rehabilitation phase to the community phase. A total of 27 studies supported the effectiveness of CCA tools, while 22 out of 42 articles mentioned their benefits and 32 revealed areas for future improvement of CCA tools.

Conclusions

Although the use of CCA tools for assessing the cognition of post-stroke patients is becoming popular, there are still some limitations and challenges of using such tools in stroke survivors. More evidence is thus needed to verify the value and specific role of these tools in assessing the cognitive impairment of stroke patients.

Neuropsychological assessment of adults with phenylketonuria using the NIH toolbox

Among researchers and clinicians, there is a call for the development and validation of new measures to better assess and characterize neurocognitive difficulties associated with early-treated phenylketonuria (ETPKU) and other metabolic disorders. The NIH Toolbox represents a relatively new computer-administered assessment tool and provides a sampling of performance across multiple cognitive domains, several of which (e.g., executive function, processing speed) are at risk for disruption in ETPKU. The goal of the present study was to provide an initial evaluation of the value and sensitivity of the NIH Toolbox for use with individuals with ETPKU. To this end, a sample of adults with ETPKU and a demographically-matched comparison group without PKU completed the cognitive and motor batteries of the Toolbox. Results indicate that overall performance (as reflected by the Fluid Cognition Composite) was sensitive to both group differences (ETPKU vs non-PKU) as well as blood Phe levels (a marker of metabolic control). The present findings offer preliminary support for the utility of the NIH Toolbox as a measure of neurocognitive functioning in individuals with ETPKU. Future research including a larger sample size and broader age range is needed to fully validate the Toolbox for clinical and research use with individuals with ETPKU.

Dissociable language and executive control deficits and recovery in post-stroke aphasia: An exploratory observational and case series study

A growing body of evidence indicates many, but not all, individuals with post-stroke aphasia experience executive dysfunction. Relationships between language and executive function skills are often reported in the literature, but the degree of interdependence between these abilities remains largely unanswered. Therefore, in this study, we investigated the extent to which language and executive control deficits dissociated in 1) acute stroke and 2) longitudinal aphasia recovery. Twenty-three individuals admitted to Johns Hopkins Hospital with a new left hemisphere stroke completed the Western Aphasia Battery-Revised (WAB-R), several additional language measures (of naming, semantics, spontaneous speech, and oral reading), and three non-linguistic cognitive tasks from the NIH Toolbox (i.e., Pattern Comparison Processing Speed Test, Flanker Inhibitory Control and Attention Test, and Dimensional Change Card Sort Test). Two participants with aphasia (PWA) with temporoparietal lesions, one of whom (PWA1) had greater temporal but less frontal and superior parietal damage than the other (PWA2), also completed testing at subacute (three months post-onset) and early chronic (six months post-onset) time points. In aim 1, principal component analysis on the acute test data (excluding the WAB-R) revealed language and non-linguistic executive control tasks largely loaded onto separate components. Both components were significant predictors of acute aphasia severity per the WAB-R Aphasia Quotient (AQ). Crucially, executive dysfunction explained an additional 17% of the variance in AQ beyond the explanatory power of language impairments alone. In aim 2, both case patients exhibited language and executive control deficits at the acute post-stroke stage. A dissociation was observed in longitudinal recovery of these patients. By the early chronic time point, PWA1 exhibited improved (but persistent) deficits in several language domains and recovered executive control. In contrast, PWA2 demonstrated mostly recovered language but persistent executive dysfunction. Greater damage to language and attention networks in these respective patients may explain the observed behavioral patterns. These results demonstrate that language and executive control can dissociate (at least to a degree), but both contribute to early post-stroke presentation of aphasia and likely influence longitudinal aphasia recovery.

Executive control deficits and lesion correlates in acute left hemisphere stroke survivors with and without aphasia

In contrast to the traditional definition of the disorder, many individuals with aphasia exhibit non-linguistic cognitive impairments, including executive control deficits. Classic lesion studies cite frontal lobe damage in executive dysfunction, but more recent lesion symptom-mapping studies in chronic aphasia present mixed results. In this study, we compared executive control abilities of acute stroke survivors with and without aphasia and investigated lesion correlates of linguistic and non-linguistic cognitive tasks. Twenty-nine participants with acute left hemisphere stroke resulting in aphasia (n = 14) or no aphasia (n = 15) completed clinical MRI and testing, including three NIH Toolbox Cognition Batteries (Pattern Comparison Processing Speed, Flanker Inhibitory Control and Attention, and Dimensional Change Card Sort Tests) and the Boston Naming Test. We compared performance between groups using Wilcoxon rank sum tests. We used Least Absolute Shrinkage and Selection Operator Regression to identify neural markers (percent regional damage, hypoperfusion within vascular territories, and total lesion volume) of executive control deficits and anomia. Group performance was comparable on the Pattern Comparison Processing Speed Test, but people with aphasia had poorer standard scores, lower accuracy, and slower response times on the Dimensional Change Card Sort Test than people without aphasia. Damage to extrasylvian regions (dorsolateral prefrontal cortex, intraparietal sulcus) was related to executive control deficits, whereas language network damage (to inferior frontal and superior and posterior middle temporal gyri) was linked to naming impairments. These results suggest people with aphasia can exhibit comorbid executive control impairments linked to damage outside classic language network areas.

Shared functional connections within and between cortical networks predict cognitive abilities in adult males and females

A thorough understanding of sex-independent and sex-specific neurobiological features that underlie cognitive abilities in healthy individuals is essential for the study of neurological illnesses in which males and females differentially experience and exhibit cognitive impairment. Here, we evaluate sex-independent and sex-specific relationships between functional connectivity and individual cognitive abilities in 392 healthy young adults (196 males) from the Human Connectome Project. First, we establish that sex-independent models comparably predict crystallised abilities in males and females, but only successfully predict fluid abilities in males. Second, we demonstrate sex-specific models comparably predict crystallised abilities within and between sexes, and generally fail to predict fluid abilities in either sex. Third, we reveal that largely overlapping connections between visual, dorsal attention, ventral attention, and temporal parietal networks are associated with better performance on crystallised and fluid cognitive tests in males and females, while connections within visual, somatomotor, and temporal parietal networks are associated with poorer performance. Together, our findings suggest that shared neurobiological features of the functional connectome underlie crystallised and fluid abilities across the sexes.

Fluid Cognition Relates to Locomotor Switching in Neurotypical Adults, Not Individuals After Stroke

BACKGROUND AND PURPOSE

The ability to switch between walking patterns (ie, locomotor switching) is vital for successful community navigation and may be impacted by poststroke impairments. Thus, the purpose of this work was to examine locomotor switching and the relationship between locomotor switching and fluid cognition in individuals after stroke compared with neurotypical adults.

METHODS

Twenty-nine individuals more than 6 months after stroke and 18 neurotypical adults participated in a 2-day study. On day 1, participants were taught a new walking pattern on the treadmill and then locomotor switching was assessed by instructing participants to switch between the new walking pattern and their usual walking pattern. The change between these 2 patterns was calculated as the switching index. On day 2, the NIH Toolbox Cognition Battery was administered to obtain the Fluid Cognition Composite Score (FCCS), which reflected fluid cognition. The switching index was compared between groups using an analysis of covariance, and the relationship between locomotor switching and fluid cognition was assessed with regression.

RESULTS

Individuals after stroke had significantly lower switching indexes compared with neurotypical adults (P = 0.03). The regression showed a significant interaction between group and FCCS (P = 0.002), with the FCCS predicting the switching index in neurotypical adults but not in individuals after stroke.

DISCUSSION AND CONCLUSIONS

Individuals after stroke appear to have deficits in locomotor switching compared with neurotypical adults. The relationship between fluid cognition and locomotor switching was significant in neurotypical adults but not in individuals after stroke. Future work to understand the relationship between specific cognitive domains and locomotor switching is needed (see the Video, Supplemental Digital Content 1, available at: http://links.lww.com/JNPT/A361).

Advances in neuroimaging to improve care in sickle cell disease

Sickle cell disease is associated with progressive and increased neurological morbidity throughout the lifespan. In people with sickle cell anaemia (the most common and severe type of sickle cell disease), silent cerebral infarcts are found in more than a third of adolescents by age 18 years and roughly half of young adults by age 30 years, many of whom have cognitive impairment despite having few or no conventional stroke risk factors. Common anatomical neuroimaging in individuals with sickle disease can assess structural brain injury, such as stroke and silent cerebral infarcts; however, emerging advanced neuroimaging methods can provide novel insights into the pathophysiology of sickle cell disease, including insights into the cerebral haemodynamic and metabolic contributors of neurological injury. Advanced neuroimaging methods, particularly methods that report on aberrant cerebral blood flow and oxygen delivery, have potential for triaging patients for appropriate disease-modifying or curative therapies before they have irreversible neurological injury, and for confirming the benefit of new therapies on brain health in clinical trials.

Latent Factor Structure and Measurement Invariance of the NIH Toolbox Cognition Battery in an Alzheimer's Disease Research Sample

OBJECTIVE

This study investigated the latent factor structure of the NIH Toolbox Cognition Battery (NIHTB-CB) and its measurement invariance across clinical diagnosis and key demographic variables including sex, race/ethnicity, age, and education for a typical Alzheimer's disease (AD) research sample.

METHOD

The NIHTB-CB iPad English version, consisting of 7 tests, was administered to 411 participants aged 45-94 with clinical diagnosis of cognitively unimpaired, dementia, mild cognitive impairment (MCI), or impaired not MCI. The factor structure of the whole sample was first examined with exploratory factor analysis (EFA) and further refined using confirmatory factor analysis (CFA). Two groups were classified for each variable (diagnosis or demographic factors). The confirmed factor model was next tested for each group with CFA. If the factor structure was the same between the groups, measurement invariance was then tested using a hierarchical series of nested two-group CFA models.

RESULTS

A two-factor model capturing fluid cognition (executive function, processing speed, and memory) versus crystalized cognition (language) fit well for the whole sample and each group except for those with age < 65. This model generally had measurement invariance across sex, race/ethnicity, and education, and partial invariance across diagnosis. For individuals with age < 65, the language factor remained intact while the fluid cognition was separated into two factors: (1) executive function/processing speed and (2) memory.

CONCLUSIONS

The findings mostly supported the utility of the battery in AD research, yet revealed challenges in measuring memory for AD participants and longitudinal change in fluid cognition.

Distinct functional and structural connections predict crystallised and fluid cognition in healthy adults

White matter pathways between neurons facilitate neuronal coactivation patterns in the brain. Insight into how these structural and functional connections underlie complex cognitive functions provides an important foundation with which to delineate disease‐related changes in cognitive functioning. Here, we integrate neuroimaging, connectomics, and machine learning approaches to explore how functional and structural brain connectivity relate to cognition. Specifically, we evaluate the extent to which functional and structural connectivity predict individual crystallised and fluid cognitive abilities in 415 unrelated healthy young adults (202 females) from the Human Connectome Project. We report three main findings. First, we demonstrate functional connectivity is more predictive of cognitive scores than structural connectivity, and, furthermore, integrating the two modalities does not increase explained variance. Second, we show the quality of cognitive prediction from connectome measures is influenced by the choice of grey matter parcellation, and, possibly, how that parcellation is derived. Third, we find that distinct functional and structural connections predict crystallised and fluid abilities. Taken together, our results suggest that functional and structural connectivity have unique relationships with crystallised and fluid cognition and, furthermore, studying both modalities provides a more comprehensive insight into the neural correlates of cognition.

Fluid Cognitive Abilities Are Important for Learning and Retention of a New, Explicitly Learned Walking Pattern in Individuals After Stroke

BACKGROUND

There is significant variability in poststroke locomotor learning that is poorly understood and affects individual responses to rehabilitation interventions. Cognitive abilities relate to upper extremity motor learning in neurologically intact adults, but have not been studied in poststroke locomotor learning.

OBJECTIVE

To understand the relationship between locomotor learning and retention and cognition after stroke.

METHODS

Participants with chronic (>6 months) stroke participated in 3 testing sessions. During the first session, participants walked on a treadmill and learned a new walking pattern through visual feedback about their step length. During the second session, participants walked on a treadmill and 24-hour retention was assessed. Physical and cognitive tests, including the Fugl-Meyer-Lower Extremity (FM-LE), Fluid Cognition Composite Score (FCCS) from the NIH Toolbox -Cognition Battery, and Spatial Addition from the Wechsler Memory Scale-IV, were completed in the third session. Two sequential regression models were completed: one with learning and one with retention as the dependent variables. Age, physical impairment (ie, FM-LE), and cognitive measures (ie, FCCS and Spatial Addition) were the independent variables.

RESULTS

Forty-nine and 34 participants were included in the learning and retention models, respectively. After accounting for age and FM-LE, cognitive measures explained a significant portion of variability in learning (R² = 0.17, P = .008; overall model R² = 0.31, P = .002) and retention (ΔR² = 0.17, P = .023; overall model R² = 0.44, P = .002).

CONCLUSIONS

Cognitive abilities appear to be an important factor for understanding locomotor learning and retention after stroke. This has significant implications for incorporating locomotor learning principles into the development of personalized rehabilitation interventions after stroke.

Post-stroke cognitive impairments and responsiveness to motor rehabilitation: A review

PURPOSE OF REVIEW

a)This review discusses the prevalence of cognitive deficits following stroke and their impact on responsiveness to therapeutic intervention within a motor learning context.

RECENT FINDINGS

b)Clinical and experimental studies have established that post-stroke cognitive and motor deficits may impede ambulation, augment fall risk, and influence the efficacy of interventions. Recent research suggests the presence of cognitive deficits may play a larger role in motor recovery than previously understood.

SUMMARY

c)Considering that cognitive impairments affect motor relearning, post-stroke motor rehabilitation therapies may benefit from formal neuropsychological testing. For example, early work suggests that in neurotypical adults, cognitive function may be predictive of responsiveness to motor rehabilitation and cognitive training may improve mobility. This sets the stage for investigations probing these topics in people post-stroke. Moreover, the neural basis for and extent to which these cognitive impairments influence functional outcome remains largely unexplored and require additional investigation.

Preliminary examination of the validity of the NIH toolbox cognition battery in treatment-resistant psychosis

Objective: Prior research has suggested that treatment-resistant psychosis (TRP) may be a categorically distinct subtype from treatment-responsive psychotic disorders. However, relatively few studies have investigated the cognitive profile of individuals with TRP. Moreover, no prior studies have investigated the effectiveness of using the NIH Toolbox Cognition Battery (NTCB) for assessing cognition among psychiatric inpatients despite its promising efficiency and practicality in such settings. The current study aimed to investigate the validity of the NTCB and the associated cognitive profile of inpatients with TRP.Methods: Participants (N = 38) were administered the NTCB and a neuropsychological test battery. The Positive and Negative Syndrome Scale and the Routine Assessment of Patient Progress measured psychosis symptomatology and daily functioning, respectively.Results: Results showed deficits relative to normative values in fluid cognitive abilities using the NTCB, as predicted. There was strong convergent validity and adequate divergent validity between the NTCB subtests and corresponding neuropsychological measures, though no NTCB subtest correlated with performance on the Wisconsin Card Sorting Task. NTCB performance correlated with positive and disorganized symptoms of psychosis as well as daily functioning.Conclusions: Taken together, the NTCB appears to be a relatively strong tool for cognitive screening among psychiatric inpatients and may be used to identify which patients might benefit from further neuropsychological evaluation.

Comparability of iPad and Web-Based NIH Toolbox Cognitive Battery Administration in Veterans

OBJECTIVE

The purpose of this study was to evaluate the comparability of National Institutes of Health Toolbox Cognitive Battery test scores across iPad application and web-based personal computer administration platforms. Original test norms were developed using a personal computer-based administration and no previous studies assessing platform comparability have been published.

METHOD

Participants (N = 62; final analyzed sample n = 49) were combat-exposed post-deployment veterans without neurologic disorder, severe mental illness, current substance use disorder, or a history of moderate or severe traumatic brain injury. All participants completed both iPad and web-based versions of tests on the same day in an experimental within-subjects crossover design. Standalone validity measures were incorporated to exclude invalid performance. Outcome measures included the Dimensional Change Card Sort Test, Flanker Inhibitory Control and Attention Test, List Sorting Working Memory Test, and Pattern Comparison Processing Speed Test.

RESULTS

Score differences between platforms were found on the Flanker Inhibitory Control and Attention Test. Scores were moderately correlated across tests, with the exception of low correlations for the Pattern Comparison Processing Speed Test. Most participants preferred iPad to web administration, regardless of administration order.

CONCLUSIONS

Results suggest caution when interpreting iPad-acquired scores, particularly for the Flanker Inhibitory Control and Attention Test. iPad-based testing offers valuable improvements; however, the development of iPad-specific norms may be necessary to ensure valid interpretation of acquired data.

The clinical utility and construct validity of the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with disabilities

A State-of-the-Science conference on measurement with disability populations recommended "...the development of cognitive and psychosocial outcome measures, using computer-adaptive testing...that are low in respondent burden and valid across patient populations," (Clohan et al., 2007, p. 1537). Following this recommendation, the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) prioritized the development of measures of cognitive functioning for individuals with disabilities, noting that measures of cognitive functioning "have not been developed for systemic application in the field of medical rehabilitation. Cognition is both a rehabilitation outcome and a factor related to broader functional and community outcomes for individuals with a wide variety of disabling conditions" (Office of Special Education & Rehabilitation Services, 2009, p. 37193). From this came the NIH Toolbox for the Assessment of Neurological and Behavioral Function project (NIH Toolbox) which provides a comprehensive set of cognitive, motor, sensory, and emotional health and function measures for use in clinical, longitudinal, and epidemiological research. The nine papers comprising this special section of Rehabilitation Psychology reflect the sustained collaborative efforts of more than two dozen investigators working at six sites over the past 8 years. They are an initial attempt to validate the NIHTB-CB in disability samples, and they provide initial evidence that the NIHTB-CB can be used with individuals who have TBI, SCI, or stroke. The articles published here reflect the fulfillment of recommendations made during a state-of-the-science conference in 2007. (PsycINFO Database Record