Construct validity of the NIH Toolbox Cognition Battery in individuals with stroke

The protocol for an observational Australian cohort study of CADASIL: The AusCADASIL study

Introduction

Cerebral Autosomal Dominant Arteriopathy with Subcortical Infarcts and Leukoencephalopathy (CADASIL) is a rare genetic condition with a broad phenotypic presentation. This study aims to establish the first Australian cohort of individuals affected by CADASIL (AusCADASIL) and examine its clinical features and longitudinal course, and to investigate neuroimaging and blood biomarkers to assist in early diagnosis and identify disease progression.

Methods

Participants will be recruited from six study centres across Australia for an observational study of CADASIL. We aim to recruit 150 participants with diagnosed CADASIL, family history of CADASIL or suspected CADASIL symptoms, and 150 cognitively normal NOTCH3 negative individuals as controls. Participants will complete: 1) online questionnaires on medical and family history, mental health, and wellbeing; 2) neuropsychological evaluation; 3) neurological examination and brain MRI; 4) ocular examination and 5) blood sample donation. Participants will have annual follow-up for 4 years to assess their progression and will be asked to invite a study partner to corroborate their self-reported cognitive and functional abilities.Primary outcomes include cognitive function and neuroimaging abnormalities. Secondary outcomes include investigation of genetics and blood and ocular biomarkers. Data from the cohort will contribute to an international consortium, and cohort participants will be invited to access future treatment/health intervention trials.

Discussion

AusCADASIL will be the first study of an Australian cohort of individuals with CADASIL. The study will identify common pathogenic variants in this cohort, and characterise the pattern of clinical presentation and longitudinal progression, including imaging features, blood and ocular biomarkers and cognitive profile.

Utility of the NIH Toolbox Cognition Battery in middle to older aged adults with longstanding type 1 diabetes: The DCCT/EDIC study

Objective: Adults with type 1 diabetes (T1D) face an increased risk for cognitive decline and dementia. Diabetes-related and vascular risk factors have been linked to cognitive decline using detailed neuropsychological testing; however, it is unclear if cognitive screening batteries can detect cognitive changes associated with aging in T1D. Method: 1,049 participants with T1D (median age 59 years; range 43-74) from the Diabetes Control and Complications Trial (DCCT), and the follow-up Epidemiology of Diabetes Interventions and Complications (EDIC) study, completed the NIH Toolbox Cognition Battery (NIHTB-C) and Montreal Cognitive Assessment (MoCA). Neuropsychological assessments, depression, glycated hemoglobin levels (HbA1c), severe hypoglycemia, T1D complications, and vascular risk factors were assessed repeatedly over 32 years to determine associations with current NIHTB-C performance. Available cognitive data was clinically adjudicated to determine cognitive impairment status. Results: NIHTB-C scores had moderate associations (r = 0.36-0.53) with concurrently administered neuropsychological tests. In multivariate models, prior severe hypoglycemic episodes, depression symptoms, nephropathy, lower BMI, and higher HbA1c and LDL cholesterol were associated with poorer NIHTB-C Fluid Cognition Composite scores. The NIHTB-C adequately detected adjudicated cognitive impairment (Area Under the Curve = 0.86; optimal cut score ≤90). The MoCA performed similarly (Area Under the Curve = 0.83; optimal cut score ≤25). Conclusions: The NIHTB-C is sensitive to the cognitive effects of diabetes-related and vascular risk factors, correlated with neuropsychological testing, and accurately detects adjudicated cognitive impairment. These data support its use as a screening test in middle to older aged adults with T1D to determine if referral for detailed neuropsychological assessment is needed.

Study design features that improve effect sizes in cross-sectional and longitudinal brain-wide association studies

Brain-wide association studies (BWAS) are a fundamental tool in discovering brain-behavior associations. Several recent studies showed that thousands of study participants are required to improve the replicability of BWAS because actual effect sizes are much smaller than those reported in smaller studies. Here, we perform analyses and meta-analyses of a robust effect size index (RESI) using 63 longitudinal and cross-sectional magnetic resonance imaging studies from the Lifespan Brain Chart Consortium (77,695 total scans) to demonstrate that optimizing study design is critical for improving standardized effect sizes and replicability in BWAS. A meta-analysis of brain volume associations with age indicates that BWAS with larger covariate variance have larger effect size estimates and that the longitudinal studies we examined have systematically larger standardized effect sizes than cross-sectional studies. We propose a cross-sectional RESI to adjust for the systematic difference in effect sizes between cross-sectional and longitudinal studies that allows investigators to quantify the benefit of conducting their study longitudinally. Analyzing age effects on global and regional brain measures from the United Kingdom Biobank and the Alzheimer's Disease Neuroimaging Initiative, we show that modifying longitudinal study design through sampling schemes to increase between-subject variability and adding a single additional longitudinal measurement per subject can improve effect sizes. However, evaluating these longitudinal sampling schemes on cognitive, psychopathology, and demographic associations with structural and functional brain outcome measures in the Adolescent Brain and Cognitive Development dataset shows that commonly used longitudinal models can, counterintuitively, reduce effect sizes. We demonstrate that the benefit of conducting longitudinal studies depends on the strengths of the between- and within-subject associations of the brain and non-brain measures. Explicitly modeling between- and within-subject effects avoids conflating the effects and allows optimizing effect sizes for them separately. These findings underscore the importance of considering study design features to improve the replicability of BWAS.

Addressing Participation in Adults With Postconcussive Symptoms Using Cognitive Strategy Training: A Feasibility Trial

IMPORTANCE

Some people experience persistent symptoms after a concussion that greatly affect occupational performance.

OBJECTIVE

To evaluate the feasibility and preliminary effect of metacognitive strategy training in a sample of adults with postconcussive symptoms.

DESIGN

Single-group, prospective design.

SETTING

University research laboratory.

PARTICIPANTS

Adults with persistent concussive symptoms affecting function (N = 14).

INTERVENTION

Ten 45-min sessions of a metacognitive strategy training intervention, Cognitive Orientation to daily Occupational Performance (CO-OP).

OUTCOMES AND MEASURES

Assessed feasibility outcomes included recruitment, retention, and adherence rates, and intervention acceptability was evaluated with the Client Satisfaction Questionnaire-8. The preliminary effect was measured on occupational performance (Canadian Occupational Performance Measure), concussive symptoms (Neurobehavioral Symptom Inventory), sleep (Pittsburgh Sleep Quality Inventory), vision (College of Optometrists in Vision Development-Quality of Life Outcomes Assessment), and cognition outcomes (Dysexecutive Questionnaire, Weekly Calendar Planning Activity, and National Institutes of Health Toolbox Cognition Battery).

RESULTS

Acceptable recruitment (32%), retention (93%), and adherence rates (100%) were observed, along with a high level of acceptability to participants. Large intervention effects were present for occupational performance, general concussive symptoms, and cognitive functioning.

CONCLUSIONS AND RELEVANCE

Findings suggest that the CO-OP is feasible to administer for adults with postconcussive symptoms and perceived as suitable for the needs of this population. Feasibility findings, coupled with improvements in occupational performance outcomes, provide the foundation for a future larger scale trial. Plain-Language Summary: The Cognitive Orientation to daily Occupational Performance intervention is practical to use to address the functional impact of persistent concussive symptoms in adults. Further research is needed to evaluate the efficacy of the CO-OP intervention with this population.

Three-month Practice Effect of the National Institutes of Health Toolbox Cognition Battery in Young Healthy Adults

The National Institutes of Health Toolbox-Cognition Battery (NIHTB-CB) is a tablet-based cognitive assessment intended for individuals with neurological diseases of all ages. NIHTB-CB practice effects (PEs), however, need clarification if this measure is used to track longitudinal change. We explored the test-retest PEs on NIHTB-CB performance at 3 months in young healthy adults (n = 22). We examined corrected T-scores normalized for demographic factors and calculated PEs using Cohen's d. There were significant PEs for all NIHTB-CB composite scores and on 4/7 subtests. This work suggests the need to further assess NIHTB-CB PEs as this may affect the interpretation of study results incorporating this battery.

Neurologic Manifestations of Long COVID Differ Based on Acute COVID-19 Severity

OBJECTIVE

To characterize neurologic manifestations in post-hospitalization Neuro-PASC (PNP) and non-hospitalized Neuro-PASC (NNP) patients.

METHODS

Prospective study of the first 100 consecutive PNP and 500 NNP patients evaluated at a Neuro-COVID-19 clinic between 5/2020 and 8/2021.

RESULTS

PNP were older than NNP patients (mean 53.9 vs 44.9 y; p < 0.0001) with a higher prevalence of pre-existing comorbidities. An average 6.8 months from onset, the main neurologic symptoms were "brain fog" (81.2%), headache (70.3%), and dizziness (49.5%) with only anosmia, dysgeusia and myalgias being more frequent in the NNP compared to the PNP group (59 vs 39%, 57.6 vs 39% and 50.4 vs 33%, all p < 0.003). Moreover, 85.8% of patients experienced fatigue. PNP more frequently had an abnormal neurologic exam than NNP patients (62.2 vs 37%, p < 0.0001). Both groups had impaired quality of life in cognitive, fatigue, sleep, anxiety, and depression domains. PNP patients performed worse on processing speed, attention, and working memory tasks than NNP patients (T-score 41.5 vs 55, 42.5 vs 47 and 45.5 vs 49, all p < 0.001) and a US normative population. NNP patients had lower results in attention task only. Subjective impression of cognitive ability correlated with cognitive test results in NNP but not in PNP patients.

INTERPRETATION

PNP and NNP patients both experience persistent neurologic symptoms affecting their quality of life. However, they harbor significant differences in demographics, comorbidities, neurologic symptoms and findings, as well as pattern of cognitive dysfunction. Such differences suggest distinct etiologies of Neuro-PASC in these populations warranting targeted interventions. ANN NEUROL 2023;94:146-159.

Validity of the NIH toolbox cognitive battery in a healthy oldest-old 85+ sample

OBJECTIVE

To evaluate the construct validity of the NIH Toolbox Cognitive Battery (NIH TB-CB) in the healthy oldest-old (85+ years old).

METHOD

Our sample from the McKnight Brain Aging Registry consists of 179 individuals, 85 to 99 years of age, screened for memory, neurological, and psychiatric disorders. Using previous research methods on a sample of 85 + y/o adults, we conducted confirmatory factor analyses on models of NIH TB-CB and same domain standard neuropsychological measures. We hypothesized the five-factor model (Reading, Vocabulary, Memory, Working Memory, and Executive/Speed) would have the best fit, consistent with younger populations. We assessed confirmatory and discriminant validity. We also evaluated demographic and computer use predictors of NIH TB-CB composite scores.

RESULTS

Findings suggest the six-factor model (Vocabulary, Reading, Memory, Working Memory, Executive, and Speed) had a better fit than alternative models. NIH TB-CB tests had good convergent and discriminant validity, though tests in the executive functioning domain had high inter-correlations with other cognitive domains. Computer use was strongly associated with higher NIH TB-CB overall and fluid cognition composite scores.

CONCLUSION

The NIH TB-CB is a valid assessment for the oldest-old samples, with relatively weak validity in the domain of executive functioning. Computer use's impact on composite scores could be due to the executive demands of learning to use a tablet. Strong relationships of executive function with other cognitive domains could be due to cognitive dedifferentiation. Overall, the NIH TB-CB could be useful for testing cognition in the oldest-old and the impact of aging on cognition in older populations.

Graph-matching distance between individuals' functional connectomes varies with relatedness, age, and cognitive score

Functional connectomes (FCs), represented by networks or graphs that summarize coactivation patterns between pairs of brain regions, have been related at a population level to age, sex, cognitive/behavioral scores, life experience, genetics, and disease/disorders. However, quantifying FC differences between individuals also provides a rich source of information with which to map to differences in those individuals' biology, experience, genetics or behavior. In this study, graph matching is used to create a novel inter-individual FC metric, called swap distance, that quantifies the distance between pairs of individuals' partial FCs, with a smaller swap distance indicating the individuals have more similar FC. We apply graph matching to align FCs between individuals from the the Human Connectome ProjectN = 997 and find that swap distance (i) increases with increasing familial distance, (ii) increases with subjects' ages, (iii) is smaller for pairs of females compared to pairs of males, and (iv) is larger for females with lower cognitive scores compared to females with larger cognitive scores. Regions that contributed most to individuals' swap distances were in higher-order networks, that is, default-mode and fronto-parietal, that underlie executive function and memory. These higher-order networks' regions also had swap frequencies that varied monotonically with familial relatedness of the individuals in question. We posit that the proposed graph matching technique provides a novel way to study inter-subject differences in FC and enables quantification of how FC may vary with age, relatedness, sex, and behavior.

Can we trust computers to assess the cognition of stroke patients? A systematic review

Purpose

To summarize the classification of computerized cognitive assessment (CCA) tools for assessing stroke patients, to clarify their benefits and limitations, and to reveal strategies for future studies on CCA tools.

Methods

A literature review was performed using PubMed, Embase, Scopus, JAMA Network, Cochrane Library and PsycINFO databases from January 1st, 2010, to August 1st, 2022. Two authors independently screened the literature following the same criteria, evaluated the study quality, and collected data from the articles.

Results

A total of 8,697 papers were acquired from the six databases. A total of 74 potentially eligible articles were selected for review. Of these, 29 articles were not relevant to this research, 3 were reviews, 2 were not written in English, and 1 was on an ongoing trial. By screening the references of the reviews, 3 additional articles were included in this study. Thus, a total of 42 articles met the criteria for the review. In terms of the CCA tools analyzed in these studies, they included five types: virtual reality (VR)-based, robot-based, telephone-based, smartphone-based, and computer-based cognitive assessments. Patients' stages of the disease ranged from the subacute phase and rehabilitation phase to the community phase. A total of 27 studies supported the effectiveness of CCA tools, while 22 out of 42 articles mentioned their benefits and 32 revealed areas for future improvement of CCA tools.

Conclusions

Although the use of CCA tools for assessing the cognition of post-stroke patients is becoming popular, there are still some limitations and challenges of using such tools in stroke survivors. More evidence is thus needed to verify the value and specific role of these tools in assessing the cognitive impairment of stroke patients.

One Size Does Not Fit All: Methodological Considerations for Brain-Based Predictive Modeling in Psychiatry

Psychiatric illnesses are heterogeneous in nature. No illness manifests in the same way across individuals, and no two patients with a shared diagnosis exhibit identical symptom profiles. Over the last several decades, group-level analyses of in vivo neuroimaging data have led to fundamental advances in our understanding of the neurobiology of psychiatric illnesses. More recently, access to computational resources and large, publicly available datasets alongside the rise of predictive modeling and precision medicine approaches have facilitated the study of psychiatric illnesses at an individual level. Data-driven machine learning analyses can be applied to identify disease-relevant biological subtypes, predict individual symptom profiles, and recommend personalized therapeutic interventions. However, when developing these predictive models, methodological choices must be carefully considered to ensure accurate, robust, and interpretable results. Choices pertaining to algorithms, neuroimaging modalities and states, data transformation, phenotypes, parcellations, sample sizes, and populations we are specifically studying can influence model performance. Here, we review applications of neuroimaging-based machine learning models to study psychiatric illnesses and discuss the effects of different methodological choices on model performance. An understanding of these effects is crucial for the proper implementation of predictive models in psychiatry and will facilitate more accurate diagnoses, prognoses, and therapeutics.

Consensus-Based Evaluation of Outcome Measures in Pediatric Stroke Care: A Toolkit

Following a pediatric stroke, outcome measures selected for monitoring functional recovery and development vary widely. We sought to develop a toolkit of outcome measures that are currently available to clinicians, possess strong psychometric properties, and are feasible for use within clinical settings. A multidisciplinary group of clinicians and scientists from the International Pediatric Stroke Organization comprehensively reviewed the quality of measures in multiple domains described in pediatric stroke populations including global performance, motor and cognitive function, language, quality of life, and behavior and adaptive functioning. The quality of each measure was evaluated using guidelines focused on responsiveness and sensitivity, reliability, validity, feasibility, and predictive utility. A total of 48 outcome measures were included and were rated by experts based on the available evidence within the literature supporting the strengths of their psychometric properties and practical use. Only three measures were found to be validated for use in pediatric stroke: the Pediatric Stroke Outcome Measure, the Pediatric Stroke Recurrence and Recovery Questionnaire, and the Pediatric Stroke Quality of Life Measure. However, multiple additional measures were deemed to have good psychometric properties and acceptable utility for assessing pediatric stroke outcomes. Strengths and weaknesses of commonly used measures including feasibility are highlighted to guide evidence-based and practicable outcome measure selection. Improving the coherence of outcome assessment will facilitate comparison of studies and enhance research and clinical care in children with stroke. Further work is urgently needed to close the gap and validate measures across all clinically significant domains in the pediatric stroke population.

Proportional intracranial volume correction differentially biases behavioral predictions across neuroanatomical features, sexes, and development

Individual differences in brain anatomy can be used to predict variations in cognitive ability. Most studies to date have focused on broad population-level trends, but the extent to which the observed predictive features are shared across sexes and age groups remains to be established. While it is standard practice to account for intracranial volume (ICV) using proportion correction in both regional and whole-brain morphometric analyses, in the context of brain-behavior predictions the possible differential impact of ICV correction on anatomical features and subgroups within the population has yet to be systematically investigated. In this work, we evaluate the effect of proportional ICV correction on sex-independent and sex-specific predictive models of individual cognitive abilities across multiple anatomical properties (surface area, gray matter volume, and cortical thickness) in healthy young adults (Human Connectome Project; n = 1013, 548 females) and typically developing children (Adolescent Brain Cognitive Development study; n = 1823, 979 females). We demonstrate that ICV correction generally reduces predictive accuracies derived from surface area and gray matter volume, while increasing predictive accuracies based on cortical thickness in both adults and children. Furthermore, the extent to which predictive models generalize across sexes and age groups depends on ICV correction: models based on surface area and gray matter volume are more generalizable without ICV correction, while models based on cortical thickness are more generalizable with ICV correction. Finally, the observed neuroanatomical features predictive of cognitive abilities are unique across age groups regardless of ICV correction, but whether they are shared or unique across sexes (within age groups) depends on ICV correction. These findings highlight the importance of considering individual differences in ICV, and show that proportional ICV correction does not remove the effects of cranial volume from anatomical measurements and can introduce ICV bias where previously there was none. ICV correction choices affect not just the strength of the relationships captured, but also the conclusions drawn regarding the neuroanatomical features that underlie those relationships.

A comprehensive assessment of neurocognitive and psychological functioning in adults with early-treated phenylketonuria

OBJECTIVE

Relative to youth with early-treated phenylketonuria (ETPKU), much less is known regarding the cognitive profile of adults with ETPKU. The present study aimed to address this gap by providing a comprehensive assessment of neuropsychological functioning among adults with ETPKU.

METHOD

A sample of 40 adults with ETPKU (ages 18 - 36) and a demographically matched group of 32 healthy individuals without PKU participated. Participants completed a comprehensive neuropsychological battery including the NIH Toolbox, Wechsler Abbreviated Scale of Intelligence - Second Edition (WASI-II), Conners' Continuous Performance Test (CPT-3), select subtests from the Weschler Adult Intelligence Scale - Fourth Edition (WAIS-IV) as well as several self-report measures of cognitive and psychoemotional functioning. Scores from these tests were combined to create cognitive composites reflecting overall task performance in the areas of verbal ability, visuospatial skills, executive functioning, motor skills, and processing speed.

RESULTS

No group differences were observed for full scale IQ or verbal ability. However, individuals with ETPKU demonstrated poorer performance on measures of executive functioning, processing speed, motor skills, and visuospatial skills as compared to the non-PKU group. Within the ETPKU group, recent blood phenylalanine levels (an indicator of metabolic control) were significantly correlated with performance across most cognitive domains and aspects of psychological functioning.

CONCLUSIONS

Present findings suggest that the neuropsychological profile of adult ETPKU is characterized by circumscribed impairments in select cognitive domains. In addition, the results underscore the importance of maintaining metabolic control across the lifespan in individuals with ETPKU.

Validation of the NIH Toolbox-Cognition Battery against legacy neurocognitive measures in adults with cognitive impairments: An exploratory analysis

OBJECTIVE

The purpose of this exploratory study was to describe associations between NIH Toolbox-Cognition Battery subtests and legacy measures of neurocognitive function in two samples with neurological conditions (stroke and sickle cell disease (SCD)).

METHOD

This exploratory secondary analysis uses data from two studies that assessed cognition at one time point using the NIH Toolbox-Cognition Battery, the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), and subtests from the Delis-Kaplan Executive Functions System (DKEFS). People with stroke (n = 26) and SCD (n = 64) were included. Associations between the NIH Toolbox-Cognition Battery subtests and corresponding legacy measures were examined using linear correlations, Bland-Altman analysis, and Lin's Concordance Correlation Coefficient.

RESULTS

Linear correlations and Lin's Concordance Correlation Coefficient were poor to strong in both samples on NIH Toolbox-CB subtests: Flanker Inhibitory Control and Attention (r = .35 to .48, Lin CCC = .27 to .37), Pattern Comparison Processing Speed (r = .40 to .65, Lin CCC = .37 to .62), Picture Sequence Memory (r = .19 to .55, Lin CCC = .18 to .48), Dimensional Change Card Sort (r = .39 to .77, Lin CCC = .38 to .63), Fluid Cognition Composite (r = .88 to .90, Lin CCC = .60 to .79), and Total Cognition Composite (r = .64 to .83, Lin CCC = .60 to .78). Bland-Altman analyses demonstrated wide limits of agreement across all subtests (-3.17 to 3.78).

CONCLUSIONS

The NIH Toolbox-Cognition Battery subtests may behave similarly to legacy measures as an overall assessment of cognition across samples at risk for neurological impairment. Findings should be replicated across additional clinical samples.

Neurocognitive monitoring in congenital central hypoventilation syndrome with the NIH Toolbox®

Congenital central hypoventilation syndrome (CCHS) is a rare neurocristopathy, caused by mutations in the paired-like homeobox gene PHOX2B, which alters control of breathing and autonomic nervous system regulation, necessitating artificial ventilation as life-support. A broad range of neurocognitive performance has been reported in CCHS, including an array of cognitive deficits. We administered the NIH Toolbox® Cognition Battery (NTCB), a novel technology comprised of seven tasks presented via an interactive computer tablet application, to a CCHS cohort and studied its convergent and divergent validity relative to traditional clinical neurocognitive measures. The NTCB was administered to 51 CCHS participants, including a subcohort of 24 who also received traditional clinical neurocognitive testing (Wechsler Intelligence Scales). Age-corrected NTCB scores from the overall sample and subcohort were compared to population norms. Associations between NTCB indices and Wechsler Intelligence scores were studied to determine the convergent and divergent validity of the NTCB. NTCB test results indicated reduced Fluid Cognition, which measures new learning and speeded information processing (p < 0.001), but intact Crystallized Cognition, which measures past learning, in CCHS relative to population norms. Moderate to strong associations (r > 0.60) were found between age-corrected NTCB Fluid and Crystallized indices and comparable Wechsler indices, supporting the convergent and discriminant validity of the NTCB. Results reveal deficits of Fluid Cognition in individuals with CCHS and indicate that the NTCB is a valid and sensitive measure of cognitive outcomes in this population. Our findings suggest that the NTCB may play a useful role in tracking neurocognition in CCHS.

Construct validity of the NIH toolbox cognitive domains: A comparison with conventional neuropsychological assessments

OBJECTIVE

Previous studies have assessed the construct validity of individual subtests in the National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB), though none have examined the construct validity of the cognitive domains. Importantly, the original NIHTB-CB validation studies were administered on a desktop computer, though the NIHTB-CB is now solely administered via an iPad. We examined the construct validity of each cognitive domain assessed in the NIHTB-CB, including a motor dexterity domain using the iPad application compared to a neuropsychological battery in a sample of healthy adults.

METHOD

Eighty-three adults aged 20-66 years (M = 44.35 ± 13.41 years) completed the NIHTB-CB and a comprehensive neuropsychological assessment. Domain scores for each of six cognitive domains (attention and executive function, episodic memory, working memory, processing speed, language, and motor dexterity) and the fluid composite were computed for both batteries. We then assessed the construct validity using Pearson correlations and intraclass correlation coefficients (ICCs) for both demographically corrected and uncorrected domains.

RESULTS

We found the attention and executive function, episodic memory, and processing speed domains had poor-to-adequate construct validity (ICCConsistency = -0.029 to 0.517), the working memory and motor dexterity domains and the fluid composite had poor-to-good construct validity (ICCConsistency = 0.215-0.801), and the language domain had adequate-to-good construct validity (ICCConsistency = 0.408-0.829).

CONCLUSION

The NIHTB-CB cognitive domains have poor-to-good construct validity, thus researchers should be aware that some tests representing cognitive constructs may not fully reflect the cognitive domain of interest. Future investigation of the construct validity and reliability of the NIHTB-CB administered using the iPad is recommended. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Assessment of Neurological Status in Patients with Cerebrovascular Diseases through the Nursing Outcome Classification: A Methodological Study

Nurses play an important role in healthcare, and the Nursing Outcomes Classification is a key tool for the standardization of care. This study aims to validate the nursing outcome “Neurological Status” for patients with cerebrovascular diseases. A methodological study was performed in four phases. In Phase 1, the relevance of the indicators was evaluated by seven specialists and the modified kappa coefficient and content validity index were calculated. In Phase 2, conceptual and operational definitions were formulated. In addition, their content was validated with a focus group in Phase 3. In Phase 4, the results were applied in clinical practice and convergence with the National Institute of Health Stroke Scale was verified. The reliability was measured by Cronbach’s alpha. Of the 22 initial indicators, 6 were excluded. The focus group suggested changes in the definitions and the exclusion of two indicators. In Phase 4, only 13 indicators were validated due to the impossibility of measuring intracranial pressure. A strong correlation between the two scales and agreement among all the indicators were observed. Following the specialists’ review, the nursing outcome was reliable and clinically validated with 13 indicators: consciousness, orientation, language, central motor control, cranial sensory and motor function, spinal sensory and motor function, body temperature, blood pressure, heart rate, eye movement pattern, pupil size, pupil reactivity, and breathing pattern.

Shared functional connections within and between cortical networks predict cognitive abilities in adult males and females

A thorough understanding of sex-independent and sex-specific neurobiological features that underlie cognitive abilities in healthy individuals is essential for the study of neurological illnesses in which males and females differentially experience and exhibit cognitive impairment. Here, we evaluate sex-independent and sex-specific relationships between functional connectivity and individual cognitive abilities in 392 healthy young adults (196 males) from the Human Connectome Project. First, we establish that sex-independent models comparably predict crystallised abilities in males and females, but only successfully predict fluid abilities in males. Second, we demonstrate sex-specific models comparably predict crystallised abilities within and between sexes, and generally fail to predict fluid abilities in either sex. Third, we reveal that largely overlapping connections between visual, dorsal attention, ventral attention, and temporal parietal networks are associated with better performance on crystallised and fluid cognitive tests in males and females, while connections within visual, somatomotor, and temporal parietal networks are associated with poorer performance. Together, our findings suggest that shared neurobiological features of the functional connectome underlie crystallised and fluid abilities across the sexes.

A Pilot Study of Cognition Among Hypoparathyroid Adults

Purpose

Hypoparathyroid patients describe cognitive deficits, yet data regarding objective assessment of cognitive function are limited. We assessed cognition in a pilot study of hypoparathyroid patients using the NIH Toolbox® Adult Cognitive Battery (NIHTB-CB). We also sought to determine whether cognition relates to emotion, quality of life (QoL) and hypoparathyroidism-related biochemistries.

Methods

Nineteen hypoparathyroid patients were studied. Objective cognition was assessed with NIHTB-CB. Impairment was defined as fully demographically adjusted T-score &lt; 1.5 SD in at least 1 cognitive domain or &lt; 1 SD in 2 or more domains.

Results

Of the 19 participants (17 women; median age 49; 18 postsurgical), impaired demographically adjusted NIHTB-CB cognition scores were observed in 13 subjects (68%). Cognition scores correlated with self-reported perception of general health. Processing speed was the most commonly impaired cognitive domain, with T-scores that were ≤ 2 SD in 6 subjects (32%). Processing speed correlated with serum calcium (r=0.53, p=0.023) and inversely with serum phosphate (r=-0.48, p=0.042) levels.

Conclusions

Impaired cognition using the NIHTB-CB was common in this small pilot cohort of hypoparathyroid patients. Slower processing speed was present and associated with lower serum calcium and higher serum phosphate levels. Larger controlled studies with additional neuropsychological testing are needed to investigate cognitive function in hypoparathyroidism.

Fluid Cognition Relates to Locomotor Switching in Neurotypical Adults, Not Individuals After Stroke

BACKGROUND AND PURPOSE

The ability to switch between walking patterns (ie, locomotor switching) is vital for successful community navigation and may be impacted by poststroke impairments. Thus, the purpose of this work was to examine locomotor switching and the relationship between locomotor switching and fluid cognition in individuals after stroke compared with neurotypical adults.

METHODS

Twenty-nine individuals more than 6 months after stroke and 18 neurotypical adults participated in a 2-day study. On day 1, participants were taught a new walking pattern on the treadmill and then locomotor switching was assessed by instructing participants to switch between the new walking pattern and their usual walking pattern. The change between these 2 patterns was calculated as the switching index. On day 2, the NIH Toolbox Cognition Battery was administered to obtain the Fluid Cognition Composite Score (FCCS), which reflected fluid cognition. The switching index was compared between groups using an analysis of covariance, and the relationship between locomotor switching and fluid cognition was assessed with regression.

RESULTS

Individuals after stroke had significantly lower switching indexes compared with neurotypical adults (P = 0.03). The regression showed a significant interaction between group and FCCS (P = 0.002), with the FCCS predicting the switching index in neurotypical adults but not in individuals after stroke.

DISCUSSION AND CONCLUSIONS

Individuals after stroke appear to have deficits in locomotor switching compared with neurotypical adults. The relationship between fluid cognition and locomotor switching was significant in neurotypical adults but not in individuals after stroke. Future work to understand the relationship between specific cognitive domains and locomotor switching is needed (see the Video, Supplemental Digital Content 1, available at: http://links.lww.com/JNPT/A361).

Latent Factor Structure and Measurement Invariance of the NIH Toolbox Cognition Battery in an Alzheimer's Disease Research Sample

OBJECTIVE

This study investigated the latent factor structure of the NIH Toolbox Cognition Battery (NIHTB-CB) and its measurement invariance across clinical diagnosis and key demographic variables including sex, race/ethnicity, age, and education for a typical Alzheimer's disease (AD) research sample.

METHOD

The NIHTB-CB iPad English version, consisting of 7 tests, was administered to 411 participants aged 45-94 with clinical diagnosis of cognitively unimpaired, dementia, mild cognitive impairment (MCI), or impaired not MCI. The factor structure of the whole sample was first examined with exploratory factor analysis (EFA) and further refined using confirmatory factor analysis (CFA). Two groups were classified for each variable (diagnosis or demographic factors). The confirmed factor model was next tested for each group with CFA. If the factor structure was the same between the groups, measurement invariance was then tested using a hierarchical series of nested two-group CFA models.

RESULTS

A two-factor model capturing fluid cognition (executive function, processing speed, and memory) versus crystalized cognition (language) fit well for the whole sample and each group except for those with age < 65. This model generally had measurement invariance across sex, race/ethnicity, and education, and partial invariance across diagnosis. For individuals with age < 65, the language factor remained intact while the fluid cognition was separated into two factors: (1) executive function/processing speed and (2) memory.

CONCLUSIONS

The findings mostly supported the utility of the battery in AD research, yet revealed challenges in measuring memory for AD participants and longitudinal change in fluid cognition.

Distinct functional and structural connections predict crystallised and fluid cognition in healthy adults

White matter pathways between neurons facilitate neuronal coactivation patterns in the brain. Insight into how these structural and functional connections underlie complex cognitive functions provides an important foundation with which to delineate disease‐related changes in cognitive functioning. Here, we integrate neuroimaging, connectomics, and machine learning approaches to explore how functional and structural brain connectivity relate to cognition. Specifically, we evaluate the extent to which functional and structural connectivity predict individual crystallised and fluid cognitive abilities in 415 unrelated healthy young adults (202 females) from the Human Connectome Project. We report three main findings. First, we demonstrate functional connectivity is more predictive of cognitive scores than structural connectivity, and, furthermore, integrating the two modalities does not increase explained variance. Second, we show the quality of cognitive prediction from connectome measures is influenced by the choice of grey matter parcellation, and, possibly, how that parcellation is derived. Third, we find that distinct functional and structural connections predict crystallised and fluid abilities. Taken together, our results suggest that functional and structural connectivity have unique relationships with crystallised and fluid cognition and, furthermore, studying both modalities provides a more comprehensive insight into the neural correlates of cognition.

Fluid Cognitive Abilities Are Important for Learning and Retention of a New, Explicitly Learned Walking Pattern in Individuals After Stroke

BACKGROUND

There is significant variability in poststroke locomotor learning that is poorly understood and affects individual responses to rehabilitation interventions. Cognitive abilities relate to upper extremity motor learning in neurologically intact adults, but have not been studied in poststroke locomotor learning.

OBJECTIVE

To understand the relationship between locomotor learning and retention and cognition after stroke.

METHODS

Participants with chronic (>6 months) stroke participated in 3 testing sessions. During the first session, participants walked on a treadmill and learned a new walking pattern through visual feedback about their step length. During the second session, participants walked on a treadmill and 24-hour retention was assessed. Physical and cognitive tests, including the Fugl-Meyer-Lower Extremity (FM-LE), Fluid Cognition Composite Score (FCCS) from the NIH Toolbox -Cognition Battery, and Spatial Addition from the Wechsler Memory Scale-IV, were completed in the third session. Two sequential regression models were completed: one with learning and one with retention as the dependent variables. Age, physical impairment (ie, FM-LE), and cognitive measures (ie, FCCS and Spatial Addition) were the independent variables.

RESULTS

Forty-nine and 34 participants were included in the learning and retention models, respectively. After accounting for age and FM-LE, cognitive measures explained a significant portion of variability in learning (R² = 0.17, P = .008; overall model R² = 0.31, P = .002) and retention (ΔR² = 0.17, P = .023; overall model R² = 0.44, P = .002).

CONCLUSIONS

Cognitive abilities appear to be an important factor for understanding locomotor learning and retention after stroke. This has significant implications for incorporating locomotor learning principles into the development of personalized rehabilitation interventions after stroke.

Brief report: Evaluation of working memory deficits in children with ADHD using the NIH list sorting working memory task

Variability in working memory (WM) task selection likely contributes to heterogeneity in effect size estimates of deficiencies in youth with attention-deficit/hyperactivity disorder (ADHD). This has resulted in the development of brief, easy to administer assessments such as the NIH List Sorting Working Memory (LSWM) task from the NIH Cognitive Toolbox in hopes of standardizing measurement of this construct. Unfortunately, substantial questions persist regarding the specific constructs being evaluated by this task (e.g., visuospatial [VS] or phonological [PH] WM) as well as the ability of this task to detect WM deficits in previously identified impaired groups (e.g., ADHD). The current study examines the extent to which the LSWM task is associated with VS and PHWM performance as well as symptoms of ADHD. Additionally, we examined the magnitude of differences between ADHD and Typically Developing (TD) youth on this task relative to empirically derived WM tasks utilized in the past. Forty-six children (25 ADHD, 21 TD) completed multiple WM tasks. The LSWM task was moderately associated with PHWM and demonstrated relatively weaker associations with VSWM. Symptoms of inattention and hyperactivity/impulsivity were unrelated to the LSWM task; whereas tasks assessing PH and VSWM were moderately associated with inattention and weakly associated with hyperactivity (VSWM only). No significant between-group differences in performance emerged on the LSWM task; however, significant large-magnitude group differences were observed on both the PH and VSWM tasks. These findings suggest that the LSWM task may lack the ability to detect WM difficulties in youth with ADHD.

Neural and Genetic Bases for Human Ability Traits

The judgement of human ability is ubiquitous, from school admissions to job performance reviews. The exact make-up of ability traits, however, is often narrowly defined and lacks a comprehensive basis. We attempt to simplify the spectrum of human ability, similar to how five personality traits are widely believed to describe most personalities. Finding such a basis for human ability would be invaluable since neuropsychiatric disease diagnoses and symptom severity are commonly related to such differences in performance. Here, we identified four underlying ability traits within the National Institutes of Health Toolbox normative data (n = 1, 369): (1) Motor-endurance, (2) Emotional processing, (3) Executive and cognitive function, and (4) Social interaction. We used the Human Connectome Project young adult dataset (n = 778) to show that Motor-endurance and Executive and cognitive function were reliably associated with specific brain functional networks (r ² = 0.305 ± 0.021), and the biological nature of these ability traits was also shown by calculating their heritability (31 and 49%, respectively) from twin data.

Executive function in children with sickle cell anemia on transfusion: NIH toolbox utility in the clinical context

OBJECTIVE

The aim of this study was to establish the utility of the NIH Toolbox as a cognitive screener of executive functions in the clinical context. Additionally, we aimed to investigate whether age and time on transfusion were related to executive function performance. Method: Twenty-eight children and adolescents with sickle cell anemia (SCA) between 8 and 18 years (M = 13.28, SD = 3.05) on transfusion treatment were included. Participants completed five NIH Toolbox tasks (three executive function tasks and two non-executive function control tasks). Results: Mean scores on one of the three executive function measures (inhibitory control) fell below the average range (M = 81.36, SD = 14.01) with approximately 70% of children from both groups below the average range. Scores for processing speed (M = 86.82, SD = 22.01) and cognitive flexibility (M = 85.75, SD = 12.67) were low averages. As expected, scores on non-executive measures (language and memory) fell within the average range. No significant differences were observed between children with silent stroke and no stroke on executive function measures. Older age (p < .01) and length of time on transfusion (p < .05) predicted lower inhibitory control scores. Conclusions: Findings provide evidence for poor development of inhibitory control with age in this patient population. As the NIH Toolbox successfully highlighted expected deficits in this patient population, this study supports the use of this tool as a brief screening measure for children with SCD. The clinical and theoretical implications of the findings are discussed.

Assessment of Prorated Scoring of an Abbreviated Protocol for the National Institutes of Health Toolbox Cognition Battery

OBJECTIVE

To evaluate an abbreviated NIH Toolbox Cognition Battery (NIHTB-CB) protocol that can be administered remotely without any in-person assessments, and explore the agreement between prorated scores from the abbreviated protocol and standard scores from the full protocol.

METHODS

Participant-level age-corrected NIHTB-CB data were extracted from six studies in individuals with a history of stroke, mild traumatic brain injury (mTBI), treatment-resistant psychosis, and healthy controls, with testing administered under standard conditions. Prorated fluid and total cognition scores were estimated using regression equations that excluded the three fluid cognition NIHTB-CB instruments which cannot be administered remotely. Paired t tests and intraclass correlations (ICCs) were used to compare the standard and prorated scores.

RESULTS

Data were available for 245 participants. For fluid cognition, overall prorated scores were higher than standard scores (mean difference = +4.5, SD = 14.3; p < 0.001; ICC = 0.86). For total cognition, overall prorated scores were higher than standard scores (mean difference = +2.7, SD = 8.3; p < 0.001; ICC = 0.88). These differences were significant in the stroke and mTBI groups, but not in the healthy control or psychosis groups.

CONCLUSIONS

Prorated scores from an abbreviated NIHTB-CB protocol are not a valid replacement for the scores from the standard protocol. Alternative approaches to administering the full protocol, or corrections to scoring of the abbreviated protocol, require further study and validation.

Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

OBJECTIVE

Few independent studies have examined the psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) in older adults, despite growing interest in its use for clinical purposes. In this paper we report the test-retest reliability and construct validity of the NIHTB-CB, as well as its agreement or concordance with traditional neuropsychological tests of the same construct to determine whether tests could be used interchangeably.

METHODS

Sixty-one cognitively healthy adults ages 60-80 completed "gold standard" (GS) neuropsychological tests, NIHTB-CB, and brain MRI. Test-retest reliability, convergent/discriminant validity, and agreement statistics were calculated using Pearson's correlations, concordance correlation coefficients (CCC), and root mean square deviations.

RESULTS

Test-retest reliability was acceptable (CCC = .73 Fluid; CCC = .85 Crystallized). The NIHTB-CB Fluid Composite correlated significantly with cerebral volumes (r's = |.35-.41|), and both composites correlated highly with their respective GS composites (r's = .58-.84), although this was more variable for individual tests. Absolute agreement was generally lower (CCC = .55 Fluid; CCC = .70 Crystallized) due to lower precision in fluid scores and systematic overestimation of crystallized composite scores on the NIHTB-CB.

CONCLUSIONS

These results support the reliability and validity of the NIHTB-CB in healthy older adults and suggest that the fluid composite tests are at least as sensitive as standard neuropsychological tests to medial temporal atrophy and ventricular expansion. However, the NIHTB-CB may generate different estimates of performance and should not be treated as interchangeable with established neuropsychological tests.

Comparability of iPad and Web-Based NIH Toolbox Cognitive Battery Administration in Veterans

OBJECTIVE

The purpose of this study was to evaluate the comparability of National Institutes of Health Toolbox Cognitive Battery test scores across iPad application and web-based personal computer administration platforms. Original test norms were developed using a personal computer-based administration and no previous studies assessing platform comparability have been published.

METHOD

Participants (N = 62; final analyzed sample n = 49) were combat-exposed post-deployment veterans without neurologic disorder, severe mental illness, current substance use disorder, or a history of moderate or severe traumatic brain injury. All participants completed both iPad and web-based versions of tests on the same day in an experimental within-subjects crossover design. Standalone validity measures were incorporated to exclude invalid performance. Outcome measures included the Dimensional Change Card Sort Test, Flanker Inhibitory Control and Attention Test, List Sorting Working Memory Test, and Pattern Comparison Processing Speed Test.

RESULTS

Score differences between platforms were found on the Flanker Inhibitory Control and Attention Test. Scores were moderately correlated across tests, with the exception of low correlations for the Pattern Comparison Processing Speed Test. Most participants preferred iPad to web administration, regardless of administration order.

CONCLUSIONS

Results suggest caution when interpreting iPad-acquired scores, particularly for the Flanker Inhibitory Control and Attention Test. iPad-based testing offers valuable improvements; however, the development of iPad-specific norms may be necessary to ensure valid interpretation of acquired data.

National Institutes of Health Toolbox Emotion Battery: Application of Summary Scores to Adults With Spinal Cord Injury, Traumatic Brain Injury, and Stroke

OBJECTIVE

To examine the validity of factor analytically based summary scores that were developed using the National Institutes of Health Toolbox Emotion Battery (NIHTB-EB); (ie, psychological well-being, social satisfaction, negative affect) normative sample in individuals with neurologic conditions.

DESIGN

Cross-sectional, observational cohort.

SETTING

Community.

PARTICIPANTS

A total of 1036 English-speaking adults from the National Institutes of Health Toolbox (NIHTB) normative project and 604 community-dwelling adults with neurologic conditions including spinal cord injury (SCI n=209), traumatic brain injury (TBI n=184), and stroke (cerebrovascular accident [CVA] n=211) (N=1640).

INTERVENTION

Not applicable.

MAIN OUTCOME MEASURES

The NIHTB-EB.

RESULTS

A series of univariate analyses comparing summary scores across the 4 groups (SCI, TBI, CVA, normative group) were conducted to identify group differences. Base rates (defined as >1 SD toward the problematic direction) were also identified. The normative group demonstrated better emotional functioning characterized by greater social satisfaction and psychological well-being (normative group > SCI, TBI, CVA; P's <.0001), and less negative affect (normative group < SCI, P=.016; normative group < TBI, P<.001; normative group < CVA; P=.034) compared with each neurologic group. Using base rates to identify problematic emotions for the 3 summary scores, there were higher rates of problematic emotions on all 3 summary scores for the neurologic groups compared with the normative group.

CONCLUSIONS

The NIHTB-EB summary scores demonstrate an increased prevalence of problematic emotions among individuals with 3 neurologic conditions, and might be useful for identifying individuals with similar conditions and potentially in need of psychological support.

Utility of the NIH Toolbox for assessment of prodromal Alzheimer's disease and dementia

Introduction

The NIH Toolbox Cognition Battery (NIHTB-CB) is a computer-based protocol not yet validated for clinical assessment.

Methods

We administered the NIHTB-CB and traditional neuropsychological tests to 247 Memory Disorders and Alzheimer's Prevention Clinic patients with subjective cognitive decline, mild cognitive impairment, mild dementia due to Alzheimer's disease, and normal cognition. Principal component analysis, partial correlations, and univariate general linear model tests were performed to assess construct validity. Discriminant function analyses compared classification accuracy.

Results

Principal component analysis identified three conceptually coherent factors: memory (MEM_NIH), executive function (EF_NIH), and crystallized intelligence (CI_NIH). These factors were strongly associated with corresponding traditional tests and differed across diagnostic groups as expected. Both NIHTB and traditional batteries yielded strong overall discriminative ability (>80%).

Discussion

The NIHTB-CB is a valid method to assess neurocognitive domains pertinent to aging and dementia and has utility for applications in a memory clinic setting.

Baseline Cognition Assessment Among Patients With Oropharyngeal Cancer Using PROMIS and NIH Toolbox

Importance

Cognitive dysfunction (CD) is recognized by the American Cancer Society as a treatment effect in head and neck cancer, but the extent of this problem at baseline in oropharyngeal cancer (OPC), the most common subsite in current practice, to our knowledge has never been studied.

Objective

To assess the baseline cognition of patients with OPC using National Institutes of Health (NIH)-sponsored instruments of Patient-Reported Outcomes Measurement Information System (PROMIS) and NIH Toolbox Cognitive Battery (NIHTB-CB).

Design, Setting, and Participants

This was a prospective cohort study conducted at a tertiary academic center. Of 83 consecutive patients, newly diagnosed as having OPC from September 2016 to May 2017, 16 were ineligible, 8 refused to participate, and 3 were lost to follow-up after screening, resulting in 56 study participants.

Main Outcomes and Measures

Self-perceived and objective cognition with PROMIS and NIHTB-CB standardized T scores, respectively, were main outcomes. Impairment was defined as (1) T scores less than 0.5 SD for PROMIS; (2) T score less than 1.5 SD in at least 1 cognitive domain or less than 1 SD in 2 or more domains for NIHTB-CB total cognition; and (3) T score per previously published criteria for NIHTB-CB intelligence-stratified cognition.

Results

Of the 56 study participants (52 men, 4 women; median age, 59 years [range, 42-77 years]), 19 (34%) had a college degree, and 20 (36%) had a professional or technical occupation. Thirty (about 53%) were never-smokers, 26 (46%) were never-drinkers, 29 (52%) were obese, 13 (23%) had a moderate to severe comorbidity, 3 (5%) used antidepressants, and 25 (52%) had hearing loss. Impaired self-reported, NIHTB-CB total, and intelligence-stratified cognition scores were observed in 6 (11%), 18 (32%), and 12 (21%), respectively. Among all variables, objective impairment was more common in men (23% vs 0%) and those with p16-negative OPC (33% vs 20%), moderate to severe comorbidity (31% vs 18%), and hearing loss (31% vs 12%).

Conclusions and Relevance

Impaired objective cognition was more common at baseline than self-reported, and was more frequent in men, participants with p16-negative OPC, moderate to severe comorbidity, and hearing loss. NIHTB-CB allowed immediate scoring of demographically adjusted cognitive function. In clinical practice, these scores can be used to identify patients with impaired cognition at baseline who may be susceptible to developing further impairment after treatment. Identification of impairment at baseline will help to institute early cognitive interventions, which may lead to an improved posttreatment quality of life.

Motor-free composites from the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) for people with disabilities

PURPOSE/OBJECTIVE

The National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) includes a group of brief measures (i.e., 30 min) designed to assess language, processing speed, working memory, episodic memory, and executive functioning. These subtests can be combined to create composite scores that reflect fluid and crystallized cognition, as well as overall cognition. The battery is of limited utility with individuals who have impaired upper extremity motor functioning. This manuscript examines the accuracy of the Oral Symbol Digit Modalities Test as a substitute for the Pattern Comparison Processing Speed Test for computing motor-free composite scores. Research Method/Design: Individuals with spinal cord injury (SCI; n = 188), traumatic brain injury (TBI; n = 159), or stroke (n = 180) completed the NIHTB-CB. We used the Oral Symbol Digit Modalities Test to create a Motor-Free Pattern Comparison score; this was used to create revised, Motor-Free Composite scores for Fluid Cognition and Overall Cognition.

RESULTS

Although there were statistically significant overall differences between the two Fluid and Overall Cognition composite scores for some of the clinical groups (scores based on the motor-free approach were significantly higher than the original score), these differences were small and partly because of overclassification of impaired processing speed in participants with motor impairment. There was good to substantial agreement with regard to "impairment" classification between the two sets of Original and Motor-Free composite scores.

CONCLUSIONS/IMPLICATIONS

Although the Motor-Free scores are not a perfect match for the Original Composite scores, they provide a reliable and valid way to examine overall and fluid cognition in individuals with upper extremity motor impairments. (PsycINFO Database Record

Factor structure of the NIH Toolbox Cognition Battery in individuals with acquired brain injury

OBJECTIVE

The National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) measures reading, vocabulary, episodic memory, working memory, executive functioning, and processing speed. While previous research has validated the factor structure in healthy adults, the factor structure has not been examined in adults with neurological impairments. Thus, this study evaluated the NIHTB-CB factor structure in individuals with acquired brain injury.

METHOD

A sample of 392 individuals (ages 18-84) with acquired brain injury (n = 182 TBI, n = 210 stroke) completed the NIHTB-CB along with neuropsychological tests as part of a larger, multisite research project.

RESULTS

Confirmatory factor analyses supported a 5-factor solution that included reading, vocabulary, episodic memory, working memory, and processing speed/executive functioning. This structure generally held in TBI and stroke subsamples as well as in subsamples of those with severe TBI and stroke injuries.

CONCLUSIONS

The factor structure of the NIHTB-CB is similar in adults with acquired brain injury to adults from the general population. We discuss the implications of these findings for clinical practice and clinical research. (PsycINFO Database Record

The clinical utility and construct validity of the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with disabilities

A State-of-the-Science conference on measurement with disability populations recommended "...the development of cognitive and psychosocial outcome measures, using computer-adaptive testing...that are low in respondent burden and valid across patient populations," (Clohan et al., 2007, p. 1537). Following this recommendation, the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) prioritized the development of measures of cognitive functioning for individuals with disabilities, noting that measures of cognitive functioning "have not been developed for systemic application in the field of medical rehabilitation. Cognition is both a rehabilitation outcome and a factor related to broader functional and community outcomes for individuals with a wide variety of disabling conditions" (Office of Special Education & Rehabilitation Services, 2009, p. 37193). From this came the NIH Toolbox for the Assessment of Neurological and Behavioral Function project (NIH Toolbox) which provides a comprehensive set of cognitive, motor, sensory, and emotional health and function measures for use in clinical, longitudinal, and epidemiological research. The nine papers comprising this special section of Rehabilitation Psychology reflect the sustained collaborative efforts of more than two dozen investigators working at six sites over the past 8 years. They are an initial attempt to validate the NIHTB-CB in disability samples, and they provide initial evidence that the NIHTB-CB can be used with individuals who have TBI, SCI, or stroke. The articles published here reflect the fulfillment of recommendations made during a state-of-the-science conference in 2007. (PsycINFO Database Record