Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

Computerized cognitive testing to capture cognitive decline in Alzheimer's disease: Longitudinal findings from the ARMADA study

INTRODUCTION

Timely detection and tracking of Alzheimer's disease (AD) -related cognitive decline has become a public health priority. We investigated whether the NIH Toolbox for Assessment of Neurological and Behavioral Function-Cognition Battery (NIHTB-CB) detects AD-related cognitive decline.

METHODS

N = 171 participants (age 76.5 ± 8; 53% female, 34% Aβ-positive) from the ARMADA study completed the NIHTB-CB at baseline, 12 months, and 24 months. Linear mixed-effect models correcting for demographics were used to examine cross-sectional and longitudinal NIHTB-CB scores in individuals across the clinical AD spectrum.

RESULTS

Compared to Aβ-negative healthy controls, Aβ-positive individuals with amnestic MCI or mild AD performed worse on all NIHTB-CB measures and showed an accelerated decline in processing speed, working memory, and auditory word comprehension tests.

DISCUSSION

These findings support the use of the NIHTB-CB in early AD, but also imply that the optimal NIHTB-CB composite score to detect change over time may differ across clinical stages of AD. Future directions include replication of these findings in larger and more demographically diverse samples.

Highlights

We examined NIH Toolbox-Cognition Battery scores across the clinical AD spectrum.All NIH Toolbox tests detected cross-sectional cognitive impairment in MCI-to-mild AD.Three NIH Toolbox tests captured further decline over time in MCI-to-mild AD.The NIH Toolbox can facilitate timely detection of AD-related cognitive decline.

Retest reliability and reliable change of community-dwelling Black/African American older adults with and without mild cognitive impairment using NIH Toolbox-Cognition Battery and Cogstate Brief Battery for laptop

OBJECTIVE

With the increased use of computer-based tests in clinical and research settings, assessing retest reliability and reliable change of NIH Toolbox-Cognition Battery (NIHTB-CB) and Cogstate Brief Battery (Cogstate) is essential. Previous studies used mostly White samples, but Black/African Americans (B/AAs) must be included in this research to ensure reliability.

METHOD

Participants were B/AA consensus-confirmed healthy controls (HCs) (n = 49) or mild cognitive impairment (MCI) (n = 34) adults 60-85 years that completed NIHTB-CB and Cogstate for laptop at two timepoints within 4 months. Intraclass correlations, the Bland-Altman method, t-tests, and the Pearson correlation coefficient were used. Cut scores indicating reliable change provided.

RESULTS

NIHTB-CB composite reliability ranged from .81 to .93 (95% CIs [.37-.96]). The Fluid Composite demonstrated a significant difference between timepoints and was less consistent than the Crystallized Composite. Subtests were less consistent for MCIs (ICCs = .01-.89, CIs [-1.00-.95]) than for HCs (ICCs = .69-.93, CIs [.46-.92]). A moderate correlation was found for MCIs between timepoints and performance on the Total Composite (r = -.40, p = .03), Fluid Composite (r = -.38, p = .03), and Pattern Comparison Processing Speed (r = -.47, p = .006).On Cogstate, HCs had lower reliability (ICCs = .47-.76, CIs [.05-.86]) than MCIs (ICCs = .65-.89, CIs [.29-.95]). Identification reaction time significantly improved between testing timepoints across samples.

CONCLUSIONS

The NIHTB-CB and Cogstate for laptop show promise for use in research with B/AAs and were reasonably stable up to 4 months. Still, differences were found between those with MCI and HCs. It is recommended that race and cognitive status be considered when using these measures.

Evaluating the factor structure and construct validity of the NIH toolbox in older adults, with a focus on cognitive normalcy and amnestic mild cognitive impairment: considerations for diversity, including insights from persons over 85 years of age and Black older Americans

OBJECTIVE

Validated computerized assessments for cognitive functioning are crucial for older individuals and those at risk of cognitive decline. The National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB) exhibits good construct validity but requires validation in diverse populations and for adults aged 85+. This study uses data from the Assessing Reliable Measurement in Alzheimer's Disease and cognitive Aging study to explore differences in the factor structure of the NIHTB-CB for adults 85 and older, Black participants versus White participants, and those diagnosed as amnestic Mild Cognitive Impairment (aMCI) vs cognitively normal (CN).

METHOD

Subtests from the NACC UDS-3 and NIHTB-CB were administered to 503 community-dwelling Black and White adults ages 55-99 (367 CN; 136 aMCI). Confirmatory factor analyses were used to investigate the original factor structure of NIHTB-CB that forms the basis for NIHTB-CD Index factor scores.

RESULTS

Factor analyses for all participants and some participant subsets (aMCI, White, 85+) substantiated the two anticipated factors (Fluid and Crystallized). However, while Black aMCI participants had the expected two-factor structure, for Black CN participants, the List Sorting Working Memory and Picture Sequence tests loaded on the Crystallized factor.

CONCLUSIONS

Findings provide psychometric support for the NIHTB-CB. Differences in factor structure between Black CN individuals and Black aMCI individuals suggest potential instability across levels of cognitive impairment. Future research should explore changes in NIHTB-CB across diagnoses in different populations.

How measurement noise limits the accuracy of brain-behaviour predictions

Major efforts in human neuroimaging strive to understand individual differences and find biomarkers for clinical applications by predicting behavioural phenotypes from brain imaging data. To identify generalisable and replicable brain-behaviour prediction models, sufficient measurement reliability is essential. However, the selection of prediction targets is predominantly guided by scientific interest or data availability rather than psychometric considerations. Here, we demonstrate the impact of low reliability in behavioural phenotypes on out-of-sample prediction performance. Using simulated and empirical data from four large-scale datasets, we find that reliability levels common across many phenotypes can markedly limit the ability to link brain and behaviour. Next, using 5000 participants from the UK Biobank, we show that only highly reliable data can fully benefit from increasing sample sizes from hundreds to thousands of participants. Our findings highlight the importance of measurement reliability for identifying meaningful brain-behaviour associations from individual differences and underscore the need for greater emphasis on psychometrics in future research.

Effects of age on the relationship between sleep quality and cognitive performance: Findings from the Human Connectome Project-Aging cohort

BACKGROUND

The association between sleep quality and cognition is widely established, but the role of aging in this relationship is largely unknown.

OBJECTIVE

To examine how age impacts the sleep-cognition relationship and determine whether there are sensitive ranges when the relationship between sleep and cognition is modified. This investigation could help identify individuals at risk for sleep-related cognitive impairment.

SUBJECTS

Sample included 711 individuals (ages 36.00-89.83, 59.66 ± 14.91, 55.7 % female) from the Human Connectome Project-Aging (HCP-A).

METHODS

The association between sleep quality (Pittsburgh Sleep Quality Index, PSQI) and cognition (Crystallized Cognition Composite and Fluid Cognition Composite from the NIH Toolbox, the Trail Making Test, TMT, and the Rey Auditory Verbal Learning Test, RAVLT) was measured using linear regression models, with sex, race, use of sleep medication, hypertension, and years of education as covariates. The interaction between sleep and age on cognition was tested using the moderation analysis, with age as both continuous linear and nonlinear (quadratic) terms.

RESULTS

There was a significant interaction term between the PSQI and nonlinear age term (age2) on TMT-B (p = 0.02) and NIH Toolbox crystallized cognition (p = 0.02), indicating that poor sleep quality was associated with worse performance on these measures (sensitive age ranges 50-75 years for TMT-B and 66-70 years for crystallized cognition).

CONCLUSIONS

The sleep-cognition relationship may be modified by age. Individuals in the middle age to early older adulthood age band may be most vulnerable to sleep-related cognitive impairment.

Evidence for the reliability and validity of a Spanish translation of the Medication Management Ability Assessment administered via tele-assessment

We translated the Medication Management Ability Assessment (MMAA) from English to Spanish for use via tele-assessment and examined its reliability and validity. Following International Test Commission Guidelines for Translating and Adapting Tests, we used translation/back-translation and a small focus group (n = 6) to adapt a Spanish version of the MMAA. Eighty-six Spanish-speaking adults completed the adapted MMAA via tele-assessment at baseline and at a two-week follow-up visit. Participants also completed several self-report and performance-based cognitive and functional measures. The internal consistency of the MMAA was excellent (standardized Cronbach's α = 0.90). Performance-based functional assessments (PBFAs) and objective cognition were positively associated with the MMAA at small to medium effect sizes. Self-report measures of daily function and cognition, measures of health literacy, and estimates of premorbid intellectual functioning were not significantly associated with MMAA performance. The test-retest reliability of the MMAA was good (CCC = 0.73, 95% CI [0.62, 0.81]; rs = 0.37, p < 0.001) and demonstrated a small practice effect (Cohen's d = 0.36, p = 0.001). Preliminary evidence for the construct validity of a Spanish-language MMAA administered via tele-assessment further expands the potential clinical utility of PBFAs in culturally diverse, Spanish-speaking populations.

The validity of studying healthy aging with cognitive tests measuring different constructs

A clinically useful characterization of the cognitive aging process requires the development of valid and robust behavioral tests, with an emphasis on explaining and understanding typical inter-individual variability in cognition. Here, using a dataset that includes behavioral scores collected with the National Institute of Health Toolbox Cognition Battery (NIHTB-CB) and other auxiliary tests, we examined (1) the differences between young and old adults across different cognitive domains, (2) the strength of across-subject correlations in behavioral test scores, (3) the consistency of low-dimensional behavioral representations across age using factor analysis, and (4) the accuracy of behavioral scores in predicting participants' age. Our results revealed that (1) elderly females had better verbal episodic memory scores than elderly males, (2) across-subject correlations between behavioral tests varied with age group, (3) although a three-factor model explained the behavioral data in both age groups, some tasks loaded to different factors between the two groups, and (4) age-performance relationship (i.e. a regression model linking age to cognitive scores) in one group cannot be extrapolated to predict age in the other group, indicating an inconsistency in age-performance relationships across groups. These findings suggest that executive function tests might tap into different cognitive processes in different age groups, which might ultimately suggest that a statistically significant between-group difference in test performance might not always reflect differences in the same underlying cognitive processes. Overall, this study calls for more caution when interpreting age-related differences and similarities between age groups with different cognitive abilities even when the same tests are used.

The Cognitive Profile of Older Adults With Treatment-Resistant Depression: An Analysis of the OPTIMUM Randomized Controlled Trial

OBJECTIVE

Major depressive disorder in older adults (late-life depression; LLD) is frequently associated with cognitive impairment, and some deficits (e.g., executive function) have been associated with a higher level of treatment resistance. However, the cognitive profile of treatment-resistant LLD (TR-LLD) has not been characterized. We hypothesized that patients with TR-LLD would show deficits in cognitive function, especially executive function, and that executive function deficits would predict poorer response to pharmacotherapy.

DESIGN

Secondary analysis of baseline cognitive data from OPTIMUM, a multicenter RCT evaluating pharmacotherapy strategies for TR-LLD.

SETTING

Five outpatient academic medical centers (4 US, 1 Canada).

PARTICIPANTS

About 369 participants aged 60 and older from the OPTIMUM study.

MEASUREMENTS

Baseline scores on individual tasks and composite scores from the NIH Toolbox-Cognition Battery were transformed into demographically-adjusted T-scores and compared to published norms. Impairments in the set shifting and inhibitory control tasks were investigated as predictors of depressive symptom change following treatment using ANCOVA models.

RESULTS

Participants had low performance on tasks evaluating inhibitory control, processing speed, verbal/nonverbal memory, and the fluid composite, but normative performance on working memory and set shifting. Participants had high estimated premorbid IQ (superior Performance on oral reading recognition). Age and physical comorbidity negatively associated with processing speed. Impairments in set shifting predicted less improvement in depressive symptoms; impairments in inhibitory control did not.

CONCLUSIONS

Participants with TR-LLD presented with broad cognitive deficits relative to healthy norms. Given poorer outcomes following standard pharmacotherapy associated with impaired set shifting, future research needs to identify alternative treatment strategies.

Development and Validation of a Vocabulary Measure in the Mobile Toolbox

OBJECTIVE

We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies.

METHOD

Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones.

RESULTS

The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001).

CONCLUSION

The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.

Identification of amnestic mild cognitive impairment among Black and White community-dwelling older adults using NIH Toolbox Cognition tablet battery

OBJECTIVES

Identify which NIH Toolbox Cognition Battery (NIHTB-CB) subtest(s) best differentiate healthy controls (HC) from those with amnestic mild cognitive impairment (aMCI) and compare the discriminant accuracy between a model using a priori "Norm Adjusted" scores versus "Unadjusted" standard scores with age, sex, race/ethnicity, and education controlled for within the model. Racial differences were also examined.

METHODS

Participants were Black/African American (B/AA) and White consensus-confirmed (HC = 96; aMCI = 62) adults 60-85 years old that completed the NIHTB-CB for tablet. Discriminant function analysis (DFA) was used in the Total Sample and separately for B/AA (n = 80) and White participants (n = 78).

RESULTS

Picture Sequence Memory (an episodic memory task) was the highest loading coefficient across all DFA models. When stratified by race, differences were noted in the pattern of the highest loading coefficients within the DFAs. However, the overall discriminant accuracy of the DFA models in identifying HCs and those with aMCI did not differ significantly by race (B/AA, White) or model/score type (Norm Adjusted versus Unadjusted).

CONCLUSIONS

Racial differences were noted despite the use of normalized scores or demographic covariates-highlighting the importance of including underrepresented groups in research. While the models were fairly accurate at identifying consensus-confirmed HCs, the models proved less accurate at identifying White participants with an aMCI diagnosis. In clinical settings, further work is needed to optimize computerized batteries and the use of NIHTB-CB norm adjusted scores is recommended. In research settings, demographically corrected scores or within model correction is suggested.

Exploring symptom clusters in mild cognitive impairment and dementia with the NIH Toolbox

OBJECTIVE

Symptom clustering research provides a unique opportunity for understanding complex medical conditions. The objective of this study was to apply a variable-centered analytic approach to understand how symptoms may cluster together, within and across domains of functioning in mild cognitive impairment (MCI) and dementia, to better understand these conditions and potential etiological, prevention, and intervention considerations.

METHOD

Cognitive, motor, sensory, emotional, and social measures from the NIH Toolbox were analyzed using exploratory factor analysis (EFA) from a dataset of 165 individuals with a research diagnosis of either amnestic MCI or dementia of the Alzheimer's type.

RESULTS

The six-factor EFA solution described here primarily replicated the intended structure of the NIH Toolbox with a few deviations, notably sensory and motor scores loading onto factors with measures of cognition, emotional, and social health. These findings suggest the presence of cross-domain symptom clusters in these populations. In particular, negative affect, stress, loneliness, and pain formed one unique symptom cluster that bridged the NIH Toolbox domains of physical, social, and emotional health. Olfaction and dexterity formed a second unique cluster with measures of executive functioning, working memory, episodic memory, and processing speed. A third novel cluster was detected for mobility, strength, and vision, which was considered to reflect a physical functioning factor. Somewhat unexpectedly, the hearing test included did not load strongly onto any factor.

CONCLUSION

This research presents a preliminary effort to detect symptom clusters in amnestic MCI and dementia using an existing dataset of outcome measures from the NIH Toolbox.

Toward Development of a Novel Proprioceptive Trail-Making Test: Comparing Healthy Dancers and Non-Dancers

There is a pressing need for ecologically valid versions of traditional neuropsychological tests indexing executive function (EF), such as the Trail-Making Task (TMT), that incorporate movement and bodily awareness in healthy participants with varying abilities. We designed a proprioceptive version of the TMT (pTMT) that involved coordinated gross motor movement and proprioceptive awareness to investigate whether this measure of visual attention, task switching, and working memory positively correlated with a computerized version of the TMT (the dTMT). We aimed to establish the initial validity of our proprioceptive TMT (pTMT) by comparing performances on the dTMT and pTMT among a cohort of 36 healthy participants (18 dancers, 18 non-dancers; M age = 22, SD = 5.27; 64% female) anticipating that dancers would express higher intrinsic bodily awareness than non-dancers. Results revealed a mild to moderate but statistically significant positive correlation between dTMT and pTMT completion times [part A: r (36) = .33, p = .04; part B: r (36) = .37, p = .03] and numbers of errors [part B: r (36) = .41, p = .01] across both participant groups. These data suggest partial measurement convergence between these two TMT versions. Relative to non-dancers, dancers exhibited a higher level of performance (likely due to their better proprioceptive ability) through their faster completion times on dTMT-B [t (34) = 3.81, p = .006, d = 1.27] and pTMT-B [t (34) = 2.97, p = .005, d = .99], and their fewer errors on dTMT-B [t (34) = 2.93, p = .006, d = 1.0]. By identifying cognitive differences between these different groups of healthy individuals, our data contribute to both a theoretical understanding and the initial development of gross motor movement-based cognitive assessments, providing a path toward the further refinement of an ecologically valid full-body TMT.

Functionality of arousal-regulating brain circuitry at rest predicts human cognitive abilities

Arousal state is regulated by subcortical neuromodulatory nuclei, such as locus coeruleus, which send wide-reaching projections to cortex. Whether higher-order cortical regions have the capacity to recruit neuromodulatory systems to aid cognition is unclear. Here, we hypothesized that select cortical regions activate the arousal system, which, in turn, modulates large-scale brain activity, creating a functional circuit predicting cognitive ability. We utilized the Human Connectome Project 7T functional magnetic resonance imaging dataset (n = 149), acquired at rest with simultaneous eye tracking, along with extensive cognitive assessment for each subject. First, we discovered select frontoparietal cortical regions that drive large-scale spontaneous brain activity specifically via engaging the arousal system. Second, we show that the functionality of the arousal circuit driven by bilateral posterior cingulate cortex (associated with the default mode network) predicts subjects' cognitive abilities. This suggests that a cortical region that is typically associated with self-referential processing supports cognition by regulating the arousal system.

Gray matter and episodic memory associations with olfaction in middle-aged to older adults

BACKGROUND

Age-related declines in olfaction contribute to low quality of life and appear to occur with declines in cognitive function, including diminished episodic memory. We tested the hypothesis that low gray matter volume within cortical regions that support olfaction and episodic memory can explain age-related differences in olfactory and episodic memory functions.

METHODS

T1-weighted images, Sniffin' Sticks olfactory measures, and the NIH Toolbox-Cognition Battery were administered to 131 middle-aged to older adults (50-86 years; 66% female). Correlation was used to examine the associations between these measures. A network-based image processing approach was then used to examine the degree to which spatial patterns of gray matter variance were related to the olfactory and cognitive measures. Structural equation modeling was used to characterize the relative specificity of olfactory, cognitive, gray matter, and aging associations.

RESULTS

Olfactory threshold, discrimination, and identification exhibited small to medium effect size associations with episodic memory performance (rs = 0.27-0.42, ps < 0.002). Gray matter volume within medial temporal and orbitofrontal cortex was also related to olfactory (discrimination and identification) and episodic memory function (rs = 0.21-0.36, ps < 0.019). Age and episodic memory explained the same variance in olfaction that was explained by the medial temporal and orbitofrontal pattern of gray matter volume.

CONCLUSIONS

The results of this cross-sectional study suggest that identifying mechanisms contributing to differences in medial temporal and orbitofrontal cortex will advance our understanding of co-morbid olfactory and cognitive declines.

Clinical Validation of Selected NIH Cognitive Toolbox Tasks in Pediatric Epilepsy

The NIH Toolbox Cognition Battery (NIHTB-CB) is designed to assess cognitive functioning across the lifespan. We aimed to evaluate the clinical validity of two NIHTB-CB tasks as cognitive screening tools in pediatric epilepsy by comparing them to standard neuropsychological measures and their association with epilepsy characteristics. Forty-seven patients with epilepsy ages 5-18, including ten repeat evaluations, were assessed. Correlational analyses and agreement statistics were conducted to validate NIHTB-CB tasks (Flanker Inhibitory Control and Attention test (Flanker) and Pattern Comparison Processing Speed test (Pattern Comparison)) with standard clinical measures. We also examined if performance was related to epilepsy characteristics, including polytherapy, age of seizure onset, seizure type, and history of Electrical Status Epilepticus in Sleep (ESES). The NIHTB-CB tests had moderate to strong correlations with neuropsychological measures of executive functioning, processing speed, and intelligence. Agreement statistics indicated better sensitivity than specificity. Polytherapy and later age of seizure onset were associated with lower performance on Pattern Comparison. ESES patients did not significantly differ in performance on the tests compared to non-ESES patients. Pilot data from a subset of repeated measures indicated a good range of change scores. These two NIHTB tasks are feasible as a screening tool in a clinic given their correlation with clinical measures that assess executive function, processing speed, and IQ. This study supports the use of these tasks as brief, easily accessible screener tools to identify cognitive dysfunction in domains commonly impacted in patients with epilepsy and potential use for monitoring over time.

Functionality of arousal-regulating brain circuitry at rest predicts human cognitive abilities

Arousal state is regulated by subcortical neuromodulatory nuclei, such as locus coeruleus, which send wide-reaching projections to cortex. Whether higher-order cortical regions have the capacity to recruit neuromodulatory systems to aid cognition is unclear. Here, we hypothesized that select cortical regions activate the arousal system, which in turn modulates large-scale brain activity, creating a functional circuit predicting cognitive ability. We utilized the Human Connectome Project 7T functional magnetic resonance imaging dataset (N=149), acquired at rest with simultaneous eye tracking, along with extensive cognitive assessment for each subject. First, we discovered select frontoparietal cortical regions that drive large-scale spontaneous brain activity specifically via engaging the arousal system. Second, we show that the functionality of the arousal circuit driven by bilateral posterior cingulate cortex (associated with the default mode network) predicts subjects' cognitive abilities. This suggests that a cortical region that is typically associated with self-referential processing supports cognition by regulating the arousal system.

Elevated homocysteine levels may moderate and mediate the association between HIV and cognitive impairment among middle-aged and older adults in an underserved population in Baltimore, Maryland

Background: In the antiretroviral therapy (ART) era, HIV-associated neurocognitive disorders (HAND) remain a considerable challenge for people with HIV, yet not all such disorders can be attributed to HIV alone. This study aimed to: (1) identify factors influencing neurocognitive impairment (NCI) utilizing the NIH Toolbox Cognition Battery (NIHTB-CB) as per the revised research criteria for HAND; (2) ascertain the moderating role of high homocysteine levels in the association between NCI and HIV; and (3) assess the mediating effect of elevated homocysteine levels on this association.Methods: We analyzed data from 788 adults (≥45 years) participating in a study on HIV-related comorbidities in underserved Baltimore communities, using NIHTB-CB to gauge neurocognitive performance. Special attention was given to results from the Dimensional Change Card Sort (DCCS) test within the executive function domain during causal mediation analysis.Results: Overall, HIV was not associated with NCI presence. However, HIV was associated with NCI among individuals with homocysteine >14 μmol/L. Furthermore, HIV was both directly and indirectly associated with NCI in DCCS test scores. Notably, the mediating role of elevated homocysteine in DCCS scores was only observable among individuals who had never used cocaine or had used it for ≤ 10 years, suggesting that extended cocaine use may have a substantial influence on cognitive performance.Conclusions: The findings from this study suggest elevated homocysteine levels may moderate and mediate the association between HIV and neurocognitive impairment.

Construct validation of NIH Toolbox Cognition Battery premorbid cognitive functioning scores in Black and White older Americans with and without mild cognitive impairment

OBJECTIVE

Valid estimates of premorbid cognitive functioning (PMIQ) are crucial for the assessment of older adults at risk for Alzheimer's disease. We investigated the relationship between the NIH Toolbox-Cognition Battery's (NIHTB-CB) Oral Reading Recognition (ORR) subtest and Wechsler Test of Adult Reading scores (WTAR, convergent validity). We also compared ORR to NIHTB-CB Flanker scores, where null relationships were expected (discriminant validity).

METHODS

The WTAR and NIHTB-CB were administered to 130 cognitively normal (CN) and 113 participants with mild cognitive impairment (MCI). Participants were community-dwelling, older Black and White adults, ages 55-88 years. Data analysis used uncorrected standard scores and Bayesian bivariate correlations. Supplemental materials include intraclass correlations.

RESULTS

ORR and WTAR scores were strongly positively associated, while ORR and Flanker scores were unrelated. This pattern held when restricting analyses to the two cognitive status groups, the two racial groups, and the four race-by-diagnosis subgroups.

CONCLUSION

The findings demonstrate convergent and discriminant validity and support NIHTB-CB ORR scores as valid estimates of scores on a PMIQ measure in older Black and White adults with and without MCI.

Profiles of Cognitive Functioning at 6 Months After Traumatic Brain Injury Among Patients in Level I Trauma Centers: A TRACK-TBI Study

Importance

Cognitive dysfunction is common after traumatic brain injury (TBI), with a well-established dose-response relationship between TBI severity and likelihood or magnitude of persistent cognitive impairment. However, patterns of cognitive dysfunction in the long-term (eg, 6-month) recovery period are less well known.

Objective

To characterize the prevalence of cognitive dysfunction within and across cognitive domains (processing speed, memory, and executive functioning) 6 months after injury in patients with TBI seen at level I trauma centers.

Design, Setting, and Participants

This prospective longitudinal cohort study used data from Transforming Research and Clinical Knowledge in TBI (TRACK-TBI) and included patients aged 17 years or older presenting at 18 US level I trauma center emergency departments or inpatient units within 24 hours of head injury, control individuals with orthopedic injury recruited from the same centers, and uninjured friend and family controls. Participants were enrolled between March 2, 2014, and July 27, 2018. Data were analyzed from March 5, 2020, through October 3, 2023.

Exposures

Traumatic brain injury (Glasgow Coma Scale score of 3-15) or orthopedic injury.

Main Outcomes and Measures

Performance on standard neuropsychological tests, including premorbid cognitive ability (National Institutes of Health Toolbox Picture Vocabulary Test), verbal memory (Rey Auditory Verbal Learning Test), processing speed (Wechsler Adult Intelligence Scale [4th edition] Processing Speed Index), and executive functioning (Trail Making Test).

Results

The sample included 1057 persons with TBI (mean [SD] age, 39.3 [16.4] years; 705 [67%] male) and 327 controls without TBI (mean [SD] age, 38.4 [15.1] years; 222 [68%] male). Most persons with TBI demonstrated performance within 1.5 SDs or better of the control group (49.3% [95% CI, 39.5%-59.2%] to 67.5% [95% CI, 63.7%-71.2%] showed no evidence of impairment). Similarly, 64.4% (95% CI, 54.5%-73.4%) to 78.8% (95% CI, 75.4%-81.9%) of participants demonstrated no evidence of cognitive decline (defined as performance within 1.5 SDs of estimated premorbid ability). For individuals with evidence of either cognitive impairment or decline, diverse profiles of impairment across memory, speed, and executive functioning domains were observed (ie, the prevalence was >0 in each of the 7 combinations of impairment across these 3 cognitive domains for most TBI subgroups).

Conclusions and Relevance

In this cohort study of patients seen at level I trauma centers 6 months after TBI, many patients with TBI demonstrated no cognitive impairment. Impairment was more prevalent in persons with more severe TBI and manifested in variable ways across individuals. The findings may guide future research and treatment recommendations.

Mild Cognitive Impairment Subtype Performance in Comparison to Healthy Older Controls on the NIH Toolbox and Cogstate

BACKGROUND

Early detection is necessary for the treatment of dementia. Computerized testing has become more widely used in clinical trials; however, it is unclear how sensitive these measures are to early signs of neurodegeneration. We investigated the use of the NIH Toolbox-Cognition (NIHTB-CB) and Cogstate-Brief computerized neuropsychological batteries in the identification of mild cognitive impairment (MCI) versus healthy older adults [healthy control (HC)] and amnestic (aMCI) versus nonamnestic MCI (naMCI). Exploratory analyses include investigating potential racial differences.

METHODS

Two hundred six older adults were diagnosed as aMCI (n = 58), naMCI (n = 15), or cognitively healthy (HC; n = 133).

RESULTS

The NIH Toolbox-CB subtests of Flanker, Picture Sequence Memory, and Picture Vocabulary significantly differentiated MCI from HC. Further, subtests from both computerized batteries differentiated patients with aMCI from those with naMCI. Although the main effect of race differences was noted on tests and in diagnostic groups was significant, there were no significant race-by-test interactions.

CONCLUSIONS

Computer-based subtests vary in their ability to help distinguish MCI subtypes, though these tests provide less expensive and easier-to-administer clinical screeners to help identify patients early who may qualify for more comprehensive evaluations. Further work is needed, however, to refine computerized tests to achieve better precision in distinguishing impairment subtypes.

Three-month Practice Effect of the National Institutes of Health Toolbox Cognition Battery in Young Healthy Adults

The National Institutes of Health Toolbox-Cognition Battery (NIHTB-CB) is a tablet-based cognitive assessment intended for individuals with neurological diseases of all ages. NIHTB-CB practice effects (PEs), however, need clarification if this measure is used to track longitudinal change. We explored the test-retest PEs on NIHTB-CB performance at 3 months in young healthy adults (n = 22). We examined corrected T-scores normalized for demographic factors and calculated PEs using Cohen's d. There were significant PEs for all NIHTB-CB composite scores and on 4/7 subtests. This work suggests the need to further assess NIHTB-CB PEs as this may affect the interpretation of study results incorporating this battery.

Different patterns of intrinsic functional connectivity at the default mode and attentional networks predict crystalized and fluid abilities in childhood

Crystallized abilities are skills used to solve problems based on experience, while fluid abilities are linked to reasoning without evoke prior knowledge. To what extent crystallized and fluid abilities involve dissociated or overlapping neural systems is debatable. Due to often deployed small sample sizes or different study settings in prior work, the neural basis of crystallized and fluid abilities in childhood remains largely unknown. Here we analyzed within and between network connectivity patterns from resting-state functional MRI of 2707 children between 9 and 10 years from the ABCD study. We hypothesized that differences in functional connectivity at the default mode network (DMN), ventral, and dorsal attentional networks (VAN, DAN) explain differences in fluid and crystallized abilities. We found that stronger between-network connectivity of the DMN and VAN, DMN and DAN, and VAN and DAN predicted crystallized abilities. Within-network connectivity of the DAN predicted both crystallized and fluid abilities. Our findings reveal that crystallized abilities rely on the functional coupling between attentional networks and the DMN, whereas fluid abilities are associated with a focal connectivity configuration at the DAN. Our study provides new evidence into the neural basis of child intelligence and calls for future comparative research in adulthood during neuropsychiatric diseases.

Assessing Motor Function in Frail Older Adults in Their Home Settings: Challenges, Strategies and Recommendations

Assessing motor competence is essential for evaluating the effectiveness of physical activity interventions that aim to maintain or improve older adults' function. However, assessing motor competence in older adults who have difficulties walking or standing is challenging, because few instruments or guidelines are appropriate for these frail older adults. This article aims to describe challenges in evaluating motor function among frail older adults, discuss strategies for adapting motor function assessments to their home settings, and provide recommendations for future clinical trials so that older adults with ambulatory difficulties can benefit from motor function assessment and physical activity programs. Data came from the baseline assessment of 116 participants of an ongoing clinical trial, "Promoting Seniors' Health with Home Care Aides (Pro-Home)". Our results demonstrated that the Pro-Home study involved participants who would be typically excluded from clinical trials and that the two instruments selected or developed for Pro-Home (Short Physical Performance Battery, Pro-Home Ankle Range of Motion Measure) captured a wide range of lower extremity motor competence with no or few missing data. Recommendations for future studies include knowing the target population thoroughly, developing trust and rapport with all parties involved, and continuously collaborating with interviewers who conduct assessments.

Normative Reference Values for Crystallized-Fluid Discrepancy Scores for the NIH Toolbox Cognition Battery

INTRODUCTION

The purpose of this study was to translate NIH Toolbox Cognition Battery (NIHTB-CB) Crystallized-Fluid discrepancy scores into research and clinical practice with adults by providing normative data for discrepancy scores for both age-adjusted standard scores (SSs) and demographically adjusted T-scores.

METHOD

We included adult participants from the NIHTB-CB standardization sample who denied having neurodevelopmental, medical, psychiatric, or neurological conditions (n = 730; M = 47.4 years old, SD = 17.6, range: 18-85; 64.4% women; 63.1% White). Descriptive statistics were calculated for the Fluid and Crystallized composite scores and Crystallized-Fluid discrepancy score, along with correlations between the composite scores and reliability estimates of the discrepancy score. Percentiles were calculated for the discrepancy score, with stratifications by the gender, education, and Crystallized composite for the age-adjusted SSs and demographically adjusted T-scores (T).

RESULTS

Crystallized-Fluid discrepancy scores ranged from -40 to 44 (M = -0.63, SD = 14.89, Mdn = -1, interquartile range [IQR]: -11 to 10) for age-adjusted SSs and from -29 to 27 (M = -0.39, SD = 10.49, Mdn = -1, IQR = -8 to 7) for demographically adjusted T-scores. Crystallized-Fluid discrepancy scores of SS = 15 and T = 11 were at the 16th percentile (1 SD below the mean) and discrepancy scores of SS = 21 and T = 15 were at the 7th percentile (1.5 SD below the mean).

CONCLUSIONS

Crystallized-Fluid discrepancy scores may be, with future research, a useful within-person interpretive approach for detecting a decline from pre-injury or pre-disease levels of cognitive functioning. These normative reference values assist clinicians and researchers in determining the frequency at which given Crystallized-Fluid discrepancy scores occurred among healthy adults in the normative sample.

Cocaine Use May Moderate the Associations of HIV and Female Sex with Neurocognitive Impairment in a Predominantly African American Population Disproportionately Impacted by HIV and Substance Use

HIV-associated neurocognitive disorders (HAND) remain a major challenge for people with HIV in the antiretroviral therapy era. Cocaine use may trigger/exacerbate HAND among African American (AA) adults, especially women. Between 2018 and 2019, 922 adults, predominantly AAs, with/without HIV and with/without cocaine use in Baltimore, Maryland, were enrolled in a study investigating the association of HIV and cocaine use with neurocognitive impairment (NCI). Neurocognitive performance was assessed with the NIH Toolbox Cognition Battery (NIHTB-CB). NCI was considered to be present if the fully adjusted standard score for at least two cognitive domains was 1.0 standard deviation below the mean. Although the overall analysis showed HIV and female sex were associated with NCI, the associations were dependent on cocaine use. Neither HIV [adj prevalence ratio (PR): 1.12, confidence interval (95% CI): 0.77-1.64] nor female sex (adj PR: 1.07, 95% CI: 0.71-1.61) was associated with NCI among cocaine nonusers, while both HIV (adj PR: 1.39, 95% CI: 1.06-1.81) and female sex (adj PR: 1.53, 95% CI: 1.18-1.98) were associated with NCI in cocaine users. HIV was associated with two NIHTB-CB measures overall. In addition, HIV was associated with a lower dimensional change card sort score (an executive function measure) in cocaine users and not in nonusers. Cognitive performance was poorer in female than in male cocaine users. The adverse effect of HIV on cognitive performance predominantly affected cocaine users. However, cocaine use may moderate the impact of HIV and female sex on cognitive performance, highlighting the importance of reducing cocaine use in NCI prevention among the AA population.

Primary outcome from the augmenting cognitive training in older adults study (ACT): A tDCS and cognitive training randomized clinical trial

BACKGROUND

There is a need for effective interventions to stave off cognitive decline in older adults. Cognitive training has variably produced gains in untrained tasks and daily functioning. Combining cognitive training with transcranial direct current stimulation (tDCS) may augment cognitive training effects; however, this approach has yet to be tested on a large-scale.

OBJECTIVE

This paper will present the primary findings of the Augmenting Cognitive Training in Older Adults (ACT) clinical trial. We hypothesize that receiving active stimulation with cognitive training will result in greater improvements on an untrained fluid cognition composite compared to sham following intervention.

METHODS

379 older adults were randomized, and 334 were included in intent-to-treat analyses for a 12-week multidomain cognitive training and tDCS intervention. Active or sham tDCS was administered at F3/F4 during cognitive training daily for two weeks then weekly for 10 weeks. To assess the tDCS effect, we fitted regression models for changes in NIH Toolbox Fluid Cognition Composite scores immediately following intervention and one year from baseline controlling for covariates and baseline scores.

RESULTS

Across the entire sample, there were improvements in NIH Toolbox Fluid Cognition Composite scores immediately post-intervention and one year following baseline; however, there were no significant tDCS group effects at either timepoint.

CONCLUSIONS

The ACT study models rigorous, safe administration of a combined tDCS and cognitive training intervention in a large sample of older adults. Despite potential evidence of near-transfer effects, we failed to demonstrate an additive benefit of active stimulation. Future analyses will continue to assess the intervention's efficacy by examining additional measures of cognition, functioning, mood, and neural markers.

Design of A Multi-Institutional Neurocognitive Discovery Study in Adult Congenital Heart Disease (MINDS-ACHD)

BACKGROUND

Neurocognitive dysfunction (NCD) is a common comorbidity among children with congenital heart disease (CHD). However, it is unclear how underlying CHD and its sequelae combine with genetics and acquired cardiovascular and neurological disease to impact NCD and outcomes across the lifespan in adults with CHD.

METHODS

The Multi-Institutional Neurocognitive Discovery Study in Adults with Congenital Heart Disease (MINDS-ACHD) is a partnership between the Pediatric Heart Network (PHN) and the Adult Alliance for Research in Congenital Cardiology (AARCC) that examines objective and subjective neurocognitive function and genetics in young ACHD. This multicenter cross-sectional pilot study is enrolling 500 young adults between 18 and 30 years with moderate or severe complexity CHD at 14 centers in North America. Enrollment includes 4 groups (125 participants each): 1) d-looped Transposition of the Great Arteries (d-TGA); 2) Tetralogy of Fallot (TOF); 3) single ventricle (SV) physiology; and 4) "other moderately or severely complex CHD." Participants complete the standardized tests from the NIH Toolbox Cognitive Battery, the NeuroQoL, the Hospital Anxiety and Depression Scale, and the PROMIS Global QoL measure. Clinical and demographic variables are collected by interview and medical record review, and an optional biospecimen is collected for genetic analysis. Due to the COVID-19 pandemic, participation may be done remotely. Tests are reviewed by a Neurocognitive Core Laboratory.

CONCLUSIONS

MINDS-ACHD is the largest study to date characterizing NCD in young adults with moderate or severely complex CHD in North America. Its results will provide valuable data to inform screening and management strategies for NCD in ACHD and improve lifelong care.

Five-Factor Model Personality Domains and Facets Associated with Markers of Cognitive Health

Using a diverse, age-stratified sample (N=3,478; age range 18-90) this study examines the cross-sectional association between five-factor model personality traits - domains and facets - and three measures of cognitive health - processing speed, visuospatial ability, subjective memory - and whether these associations vary by age, race, and ethnicity. Consistent with the literature on personality and cognitive health, higher openness and conscientiousness were associated with better cognitive performance and subjective memory, whereas higher neuroticism was associated with slower processing speed and worse subjective memory but was unrelated to visuospatial ability. Moderation analyses suggested some associations were stronger in midlife compared to younger and older adulthood but were generally similar across race and ethnicity. The facet-level analyses indicated the components of each domain most strongly associated with cognitive function (e.g., the responsibility facet of conscientiousness) and suggested some differences across facets within the same domain (e.g., depression was associated with worse performance, whereas anxiety was unrelated to performance; sociability was the only facet of extraversion associated with worse performance). The present research is consistent with the larger literature on personality and cognition and extends it by documenting similarities and differences across facets and demographic groups.

NIH Toolbox® Episodic Memory Measure Differentiates Older Adults with Exceptional Memory Capacity from those with Average-for-Age Cognition

OBJECTIVE

Older adults with exceptional memory function, designated "SuperAgers," include individuals over age 80, with episodic memory at least as good as individuals ages 50s-60s. The Northwestern University SuperAging cohort is defined by performance on an established test of verbal memory. The purpose of this study was to determine if superior verbal memory extends to nonverbal memory in SuperAgers by examining differences in the National Institutes of Health Toolbox® (NIHTB) between older adults with exceptional memory and those with average-for-age cognition.

METHOD

SuperAgers (n = 46) and cognitively average-for-age older adults (n = 31) completed a comprehensive neuropsychological battery and the NIHTB Cognition module. Multiple linear regressions were used to examine differences on subtests between groups.

RESULTS

There was a significant effect of group on the Picture Sequence Memory score, (p = .007), such that SuperAgers had higher scores than cognitively average-for-age older adults. There were no other group effects across other non-episodic memory NIHTB Cognition measures.

CONCLUSIONS

Findings from this study demonstrated stronger performance on the memory measure of the NIHTB in SuperAgers compared to cognitively average-for-age older adults demonstrating superior memory in not only verbal but also nonverbal episodic memory in this group. Additionally, this study adds to the literature validating the NIHTB in older adults, particularly in a novel population of adults over age 80 with exceptional memory.

Age differences in the functional architecture of the human brain

The intrinsic functional organization of the brain changes into older adulthood. Age differences are observed at multiple spatial scales, from global reductions in modularity and segregation of distributed brain systems, to network-specific patterns of dedifferentiation. Whether dedifferentiation reflects an inevitable, global shift in brain function with age, circumscribed, experience-dependent changes, or both, is uncertain. We employed a multimethod strategy to interrogate dedifferentiation at multiple spatial scales. Multi-echo (ME) resting-state fMRI was collected in younger (n = 181) and older (n = 120) healthy adults. Cortical parcellation sensitive to individual variation was implemented for precision functional mapping of each participant while preserving group-level parcel and network labels. ME-fMRI processing and gradient mapping identified global and macroscale network differences. Multivariate functional connectivity methods tested for microscale, edge-level differences. Older adults had lower BOLD signal dimensionality, consistent with global network dedifferentiation. Gradients were largely age-invariant. Edge-level analyses revealed discrete, network-specific dedifferentiation patterns in older adults. Visual and somatosensory regions were more integrated within the functional connectome; default and frontoparietal control network regions showed greater connectivity; and the dorsal attention network was more integrated with heteromodal regions. These findings highlight the importance of multiscale, multimethod approaches to characterize the architecture of functional brain aging.

Reliability, Validity, and User-Experience of Remote Unsupervised Computerized Neuropsychological Assessments in Community-Living 55- to 75-Year-Olds

BACKGROUND

Self-administered computerized neuropsychological assessments (CNAs) provide lower cost, more accessible alternatives to traditional in-person assessments but lack critical information on psychometrics and subjective experience of older adults in remote testing environments.

OBJECTIVE

We used an online brief battery of computerized tasks selected from the Cogstate Brief Battery (CBB) and Cambridge Brain Sciences (CBS) to 1) determine test-retest reliability in an unsupervised setting; 2) examine convergent validity with a comprehensive 'gold standard' paper-and-pencil neuropsychological test battery administered in-person; and 3) explore user-experience of remote computerized testing and individual tests.

METHODS

Fifty-two participants (mean age 65.8±5.7 years) completed CBB and CBS tests on their own computer, unsupervised from home, on three occasions, and visited a research center for an in-person paper-and-pencil assessment. They also completed a user-experience questionnaire.

RESULTS

Test-retest reliabilities varied for individual measures (ICCs = 0.20 to 0.83). Global cognition composites showed excellent reliability (ICCs > 0.8 over 1-month follow-up). A strong relationship between a combination of CNA measures and paper-and-pencil battery was found (canonical correlation R = 0.87, p = 0.04). Most tests were rated as enjoyable with easy-to-understand instructions. Ratings of general experience with online testing were mostly favorable; few had difficulty concentrating (17%) or using the computer for tasks (10%), although over one-third experienced performance anxiety (38%).

CONCLUSION

A combined brief online battery selected from two CNAs demonstrated robust psychometric standards for reliability (global composite), and convergent validity with a gold standard battery, and mostly good usability and acceptability in the remote testing environment.

Are Adverse Childhood Experiences Associated with Worse Cognitive Function in Older Adults?

OBJECTIVES

Adverse childhood experiences (ACE) are associated with an increased risk for dementia, but this relationship and modifying factors are poorly understood. This study is the first to our knowledge to comprehensively examine the effect of ACE on specific cognitive functions and measures associated with greater risk and resiliency to cognitive decline in independent community-dwelling older adults.

METHODS

Verbal/nonverbal intelligence, verbal memory, visual memory, and executive attention were assessed. Self-report measures examined depression, self-efficacy, and subjective cognitive concerns (SCC). The ACE questionnaire measured childhood experiences of abuse, neglect, and household dysfunction.

RESULTS

Over 56% of older adults reported an adverse childhood event. ACE scores were negatively associated with income and years of education and positively associated with depressive symptoms and SCC. ACE scores were a significant predictor of intellectual function and executive attention; however, these relationships were no longer significant after adjusting for education. Follow-up analyses using the PROCESS macro revealed that relationships among higher ACE scores with intellectual function and executive attention were mediated by education.

CONCLUSIONS

Greater childhood adversity may increase vulnerability for cognitive impairment by impacting early education, socioeconomic status, and mental health. These findings have clinical implications for enhancing levels of cognitive reserve and addressing modifiable risk factors to prevent or attenuate cognitive decline in older adults.

A promising cognitive screener in multiple sclerosis: The NIH toolbox cognition battery concords with gold standard neuropsychological measures

BACKGROUND

Routine cognitive screening is a priority in MS clinical care. The National Institutes of Health Toolbox (NIHTB) Cognition Battery is a 30-min instrument validated in neurological populations excluding MS.

OBJECTIVES

To assess construct validity of NIHTB tests and compare classification of cognitive impairment with gold-standard tests. To evaluate relationships between fluid cognition and clinical measures.

METHODS

Eighty-seven individuals, aged 30-59 years, completed the NIHTB, Minimal Assessment of Cognitive Function in MS (MACFIMS), Wechsler Adult Intelligence Scale-IV subtests, and measures of disease severity, depression, and fatigue.

RESULTS

The NIHTB showed adequate convergent validity for processing speed, working memory, and episodic memory. Although fluid cognition scores from the NIHTB and MACFIMS classified a similar proportion of participants as cognitively impaired, the two batteries differed in which individuals were classified as impaired versus preserved. NIHTB fluid cognition was inversely correlated with disease severity but not related to depression or fatigue.

CONCLUSIONS

The NIHTB concords with gold-standard measures, and classifies cognitive impairment at similar rates to the MACFIMS. Adjusted NIHTB fluid cognition was negatively associated with disease severity suggesting clinical utility. Psychometric validation of the NIHTB in clinical practice will elucidate its promise as a cognitive screener in MS.

Neurocognitive monitoring in congenital central hypoventilation syndrome with the NIH Toolbox®

Congenital central hypoventilation syndrome (CCHS) is a rare neurocristopathy, caused by mutations in the paired-like homeobox gene PHOX2B, which alters control of breathing and autonomic nervous system regulation, necessitating artificial ventilation as life-support. A broad range of neurocognitive performance has been reported in CCHS, including an array of cognitive deficits. We administered the NIH Toolbox® Cognition Battery (NTCB), a novel technology comprised of seven tasks presented via an interactive computer tablet application, to a CCHS cohort and studied its convergent and divergent validity relative to traditional clinical neurocognitive measures. The NTCB was administered to 51 CCHS participants, including a subcohort of 24 who also received traditional clinical neurocognitive testing (Wechsler Intelligence Scales). Age-corrected NTCB scores from the overall sample and subcohort were compared to population norms. Associations between NTCB indices and Wechsler Intelligence scores were studied to determine the convergent and divergent validity of the NTCB. NTCB test results indicated reduced Fluid Cognition, which measures new learning and speeded information processing (p < 0.001), but intact Crystallized Cognition, which measures past learning, in CCHS relative to population norms. Moderate to strong associations (r > 0.60) were found between age-corrected NTCB Fluid and Crystallized indices and comparable Wechsler indices, supporting the convergent and discriminant validity of the NTCB. Results reveal deficits of Fluid Cognition in individuals with CCHS and indicate that the NTCB is a valid and sensitive measure of cognitive outcomes in this population. Our findings suggest that the NTCB may play a useful role in tracking neurocognition in CCHS.

Evaluating the neuropeptide-social cognition link in ageing: the mediating role of basic cognitive skills

The roles of oxytocin (OT) and arginine-vasopressin (AVP) as crucial modulators of social cognition and related behaviours have been extensively addressed in the literature. The involvement of these neuropeptides in social cognition in ageing, however, and a potential mediating effect of basic cognitive capacities on this link, are not well understood. To fill these research gaps, this study assessed associations of plasma OT and AVP levels with dynamic emotion identification accuracy in generally healthy older men (aged 55-95 years) and probed the underlying roles of crystallized and fluid cognition in these associations. Higher plasma OT levels were associated with lower accuracy in dynamic emotion identification, with this negative relationship fully mediated by cognition. For plasma AVP levels, in contrast, there was no association with dynamic emotion identification accuracy. Integrated within existing theoretical accounts, results from this study advance understanding of the neuropeptide-social cognition link in ageing and support basic cognitive capacities as mediators in this association. This article is part of the theme issue 'Interplays between oxytocin and other neuromodulators in shaping complex social behaviours'.

ARMADA: Assessing reliable measurement in Alzheimer's disease and cognitive aging project methods

INTRODUCTION

Early detection of cognitive decline in older adults is a public health priority. Advancing Reliable Measurement in Alzheimer's Disease and Cognitive Aging (ARMADA), a multisite study, is validating cognition, emotion, motor, and sensory modules of the National Institutes of Health Toolbox for Assessment of Neurological and Behavioral Function (NIHTB) in the aging spectrum from cognitively normal to dementia of the Alzheimer's type (DAT).

METHODS

Participants 65 to 85 years old, in demographic groups racially proportional to the general US population, are recruited in one of three groups to validate the NIHTB: cognitively normal, amnestic mild cognitive impairment (aMCI), or mild DAT. Additional special emphasis cohorts include (1) Blacks in the three clinical groups; (2) Spanish-speakers in the three clinical groups; (3) cognitively normal, population-proportional, over age 85.

DISCUSSION

Longitudinal study will determine whether NIHTB can predict cognitive decline and is associated with Alzheimer's disease biomarkers. Here, we detail the methods for the ARMADA study.

Reliability of the NIH toolbox cognitive battery in children and adolescents: a 3-year longitudinal examination

BACKGROUND

The Cognitive Battery of the National Institutes of Health Toolbox (NIH-TB) is a collection of assessments that have been adapted and normed for administration across the lifespan and is increasingly used in large-scale population-level research. However, despite increasing adoption in longitudinal investigations of neurocognitive development, and growing recommendations that the Toolbox be used in clinical applications, little is known about the long-term temporal stability of the NIH-TB, particularly in youth.

METHODS

The present study examined the long-term temporal reliability of the NIH-TB in a large cohort of youth (9-15 years-old) recruited across two data collection sites. Participants were invited to complete testing annually for 3 years.

RESULTS

Reliability was generally low-to-moderate, with intraclass correlation coefficients ranging between 0.31 and 0.76 for the full sample. There were multiple significant differences between sites, with one site generally exhibiting stronger temporal stability than the other.

CONCLUSIONS

Reliability of the NIH-TB Cognitive Battery was lower than expected given early work examining shorter test-retest intervals. Moreover, there were very few instances of tests meeting stability requirements for use in research; none of the tests exhibited adequate reliability for use in clinical applications. Reliability is paramount to establishing the validity of the tool, thus the constructs assessed by the NIH-TB may vary over time in youth. We recommend further refinement of the NIH-TB Cognitive Battery and its norming procedures for children before further adoption as a neuropsychological assessment. We also urge researchers who have already employed the NIH-TB in their studies to interpret their results with caution.

COMbined Exercise Trial (COMET) to improve cognition in older adults: Rationale and methods

Substantial evidence suggests physical exercise may sustain cognitive function and perhaps prevent Alzheimer's Disease (1, 2). Current public health recommendations call for older adults to do at least 150 min a week of aerobic exercise (e.g. walking) and twice a week resistance exercise (e.g. weight lifting) for physical health. Yet, much remains unknown about how these exercise modalities support brain health independently or in combination. The COMbined Exercise Trial (COMET) is designed to test the combined and independent effects of aerobic and resistance training specifically focusing on exercise-related changes in 1) cognitive performance, 2) regional brain volume, 3) physical function, and 4) blood-based factors. To explore these questions, we will enroll 280 cognitively normal older adults, age 65-80 years, into a 52-week community-based exercise program. Participants will be randomized into one of four arms: 1) flexibility/toning- control 2) 150 min of aerobic exercise only, 3) progressive resistance training only, or 4) combined aerobic and progressive resistance training. Outcomes assessed include a comprehensive cognitive battery, blood biomarkers, brain magnetic resonance imaging, physiological biomarkers, cardiorespiratory fitness, physical function, and battery of psychosocial questionnaires is assessed at baseline, 6 and 12-months. COMET will provide rigorous randomized controlled trial data to understand the effects of the most common exercise modalities, and their combination (i.e., the standard public health recommendation), on brain health.

Construct validity of the NIH toolbox cognitive domains: A comparison with conventional neuropsychological assessments

OBJECTIVE

Previous studies have assessed the construct validity of individual subtests in the National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB), though none have examined the construct validity of the cognitive domains. Importantly, the original NIHTB-CB validation studies were administered on a desktop computer, though the NIHTB-CB is now solely administered via an iPad. We examined the construct validity of each cognitive domain assessed in the NIHTB-CB, including a motor dexterity domain using the iPad application compared to a neuropsychological battery in a sample of healthy adults.

METHOD

Eighty-three adults aged 20-66 years (M = 44.35 ± 13.41 years) completed the NIHTB-CB and a comprehensive neuropsychological assessment. Domain scores for each of six cognitive domains (attention and executive function, episodic memory, working memory, processing speed, language, and motor dexterity) and the fluid composite were computed for both batteries. We then assessed the construct validity using Pearson correlations and intraclass correlation coefficients (ICCs) for both demographically corrected and uncorrected domains.

RESULTS

We found the attention and executive function, episodic memory, and processing speed domains had poor-to-adequate construct validity (ICCConsistency = -0.029 to 0.517), the working memory and motor dexterity domains and the fluid composite had poor-to-good construct validity (ICCConsistency = 0.215-0.801), and the language domain had adequate-to-good construct validity (ICCConsistency = 0.408-0.829).

CONCLUSION

The NIHTB-CB cognitive domains have poor-to-good construct validity, thus researchers should be aware that some tests representing cognitive constructs may not fully reflect the cognitive domain of interest. Future investigation of the construct validity and reliability of the NIHTB-CB administered using the iPad is recommended. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Novel approaches to measuring neurocognitive functions in Alzheimer's disease clinical trials

PURPOSE OF REVIEW

We comprehensively examined recent advancements in developing novel cognitive measures that could significantly enhance detection of outcome changes in Alzheimer's disease clinical trials. Previously established measures were largely limited in their ability to detect subtle cognitive declines in preclinical stages of Alzheimer's disease, particularly due to weak psychometric properties (including practice effects and ceiling effects) and requirement of in-person visits that impacted ascertainment.

RECENT FINDINGS

We present novel cognitive measures that were designed to exhibit reduced practice effects and stronger correlations with Alzheimer's disease biomarkers. In addition, we summarized some recent efforts in developing remote testing measures protocols that are aimed to overcome the limitations and inconvenience of in-person testing, and digital phenotyping, which analyses subtle forms of digital behaviour indicative of cognitive phenotypes. We discuss each measure's prognostic accuracy and potential utility in Alzheimer's disease research while also commenting on their limitations. We also describe our study, the Development of Novel Measures for Alzheimer's Disease Prevention Trials (NoMAD), that employed a parallel group design in which novel measures and established measures are compared in a clinical trials armature.

SUMMARY

Overall, we believe that these recent developments offer promising improvements in accurately detecting clinical and preclinical cognitive changes in the Alzheimer's disease spectrum; however, further validation of their psychometric properties and diagnostic accuracies is warranted before reliably implementing these novel measures in Alzheimer's disease clinical trials.

Laptop-Administered NIH Toolbox and Cogstate Brief Battery in Community-Dwelling Black Adults: Unexpected Pattern of Cognitive Performance between MCI and Healthy Controls

OBJECTIVE

Black adults are approximately twice as likely to develop Alzheimer's disease (AD) than non-Hispanic Whites and access diagnostic services later in their illness. This dictates the need to develop assessments that are cost-effective, easily administered, and sensitive to preclinical stages of AD, such as mild cognitive impairment (MCI). Two computerized cognitive batteries, NIH Toolbox-Cognition and Cogstate Brief Battery, have been developed. However, utility of these measures for clinical characterization remains only partially determined. We sought to determine the convergent validity of these computerized measures in relation to consensus diagnosis in a sample of MCI and healthy controls (HC).

METHOD

Participants were community-dwelling Black adults who completed the neuropsychological battery and other Uniform Data Set (UDS) forms from the AD centers program for consensus diagnosis (HC = 61; MCI = 43) and the NIH Toolbox-Cognition and Cogstate batteries. Discriminant function analysis was used to determine which cognitive tests best differentiated the groups.

RESULTS

NIH Toolbox crystallized measures, Oral Reading and Picture Vocabulary, were the most sensitive in identifying MCI apart from HC. Secondarily, deficits in memory and executive subtests were also predictive. UDS neuropsychological test analyses showed the expected pattern of memory and executive functioning tests differentiating MCI from HC.

CONCLUSIONS

Contrary to expectation, NIH Toolbox crystallized abilities appeared preferentially sensitive to diagnostic group differences. This study highlights the importance of further research into the validity and clinical utility of computerized neuropsychological tests within ethnic minority populations.

A Pilot Study of Cognition Among Hypoparathyroid Adults

Purpose

Hypoparathyroid patients describe cognitive deficits, yet data regarding objective assessment of cognitive function are limited. We assessed cognition in a pilot study of hypoparathyroid patients using the NIH Toolbox® Adult Cognitive Battery (NIHTB-CB). We also sought to determine whether cognition relates to emotion, quality of life (QoL) and hypoparathyroidism-related biochemistries.

Methods

Nineteen hypoparathyroid patients were studied. Objective cognition was assessed with NIHTB-CB. Impairment was defined as fully demographically adjusted T-score &lt; 1.5 SD in at least 1 cognitive domain or &lt; 1 SD in 2 or more domains.

Results

Of the 19 participants (17 women; median age 49; 18 postsurgical), impaired demographically adjusted NIHTB-CB cognition scores were observed in 13 subjects (68%). Cognition scores correlated with self-reported perception of general health. Processing speed was the most commonly impaired cognitive domain, with T-scores that were ≤ 2 SD in 6 subjects (32%). Processing speed correlated with serum calcium (r=0.53, p=0.023) and inversely with serum phosphate (r=-0.48, p=0.042) levels.

Conclusions

Impaired cognition using the NIHTB-CB was common in this small pilot cohort of hypoparathyroid patients. Slower processing speed was present and associated with lower serum calcium and higher serum phosphate levels. Larger controlled studies with additional neuropsychological testing are needed to investigate cognitive function in hypoparathyroidism.

Effects of Vigorous Versus Restorative Yoga Practice on Objective Cognition Functions in Sedentary Breast and Ovarian Cancer Survivors: A Randomized Controlled Pilot Trial

PURPOSE

Many cancer survivors experience cancer-related cognitive impairment (CRCI). We conducted a randomized controlled pilot trial of 2 types of yoga practice and evaluated their effects on participants' objective cognitive function.

METHODS

Sedentary breast or ovarian cancer survivors were randomized to practice either restorative yoga (with more meditative practice and minimal physical exertion) or vigorous yoga (with considerable physical exertion and minimal meditative practice) in 60-minute supervised sessions 3 times a week for 12 weeks, followed by 12 weeks of home practice. We used the NIH Toolbox Cognition Domain to evaluate participants at baseline, week 12, and week 24.

RESULTS

We enrolled 35 participants. For women in the restorative yoga group, overall cognitive function was statistically significantly improved at weeks 12 and 24 compared to baseline (P = .03 and 0.004; Cohen's D = 0.3 and 0.5). Fluid cognitive function also significantly improved at weeks 12 and 24 (P = .02 and 0.0007; Cohen's D = 0.3 and 0.6), whereas improvements in crystallized cognition were not significant. For women in the vigorous yoga group, significant improvement was only seen in tasks of crystallized cognition at week 24 (P = .03; Cohen's D = 0.5). Between-group comparisons showed that at week 24, women in the restorative yoga group had significantly higher scores on fluid cognition tasks.

CONCLUSIONS

Patients who participated in yoga practice demonstrated improvement in objective cognitive function over time. Restorative yoga may be more effective in improving fluid cognitive function at week 24 when compared to vigorous yoga. These promising findings should be confirmed in definitive studies.

TRIAL REGISTRATION

Clinicaltrials.gov; NCT02305498 (Date Registered: December 2, 2014).

Truncal Fat and Frailty Are Important Predictors of Cognitive Performance among Aging Adults with Obesity

OBJECTIVES

To explore associations among cognition, frailty, and obesity in older adults.

DESIGN

Descriptive, secondary analysis of baseline data from two related lifestyle intervention trials.

SETTING

Clinical study open to civilian population through the Center for Translational Research on Inflammatory Diseases at the Veterans Affairs Medical Center in Houston, TX.

PARTICIPANTS

One hundred eight community-dwelling adults with obesity, aged 65 or older, recruited consecutively from two lifestyle intervention trials.

MEASUREMENTS

Cognition was assessed using Composite Age-Adjusted Scale Score from the National Institutes of Health Toolbox Cognition Battery: Obesity was assessed by body mass index (BMI) and also by truncal fat mas via dual energy x-ray absorptiometry. Frailty was assessed using the Physical Performance Test.

RESULTS

A significant linear regression model for cognition revealed frailty as the strongest predictor, followed by sex, and then truncal fat (R2=0.340, p<0.001).

CONCLUSION

Cognition among community-dwelling older adults with obese BMI may worsen with greater truncal fat mass. Frailty appears to be an important predictor of cognitive performance in this population.

Comparing Psychometric Properties of the NIH Toolbox Cognition Battery to Gold-Standard Measures in Socioeconomically Diverse Older Adults

OBJECTIVE

The National Institutes of Health Toolbox-Cognition Battery (NIHTB-CB) is an efficient computerized neuropsychological battery. This study investigated its psychometric properties in terms of sociodemographic characteristics and technology use in adults aged 57-87 (with an average age of 70).

METHODS

Community-based participatory research procedures were used to enhance enrollment of adults with lower education and income backgrounds. Study procedures replicated work that compared the NIHTB-CB Crystallized and Fluid composites to analogous gold-standard (GS) measures and extended it by investigation of socioeconomic status and technology use-related differences in performance.

RESULTS

The high correlations among the NIHTB-CB and GS analogous Crystallized and Fluid composites suggested good convergent validity. There was no evidence of significant education- or economic-related group differences in these associations. However, caution is needed as Cronbach's alpha that indicated the NIHTB-CB Fluid composite had questionable internal item consistency. The NIHTB-CB and GS measures demonstrated poor discriminant validity in the high school but not college-educated groups. Regression analyses found that comfort with technology use, income, education, and age predicted better cognitive test performance on the computerized and paper-pencil measures.

CONCLUSIONS

There is an urgent need to improve the understanding of socioeconomic disparities influence on test scores and brain health. Lack of discriminant validity in the cognitive tests indicates that these measures could result in diagnostic errors within noncollege-educated older adults. These findings reduce confidence in the use of the NIHTB-CB Fluid composite in older adults and support that there is a significant socioeconomic-related digital divide in comfort with technology use.

Sense of purpose in life, cognitive function, and the phenomenology of autobiographical memory

There are individual differences in the phenomenological re-experiencing of autobiographical memories. We examine whether sense of purpose in life and cognitive function are associated with the phenomenology of a recent memory related to the coronavirus pandemic. Participants reported on their sense purpose and completed tasks that measured processing speed and visuospatial ability before the pandemic in January-February 2020 and subsequently retrieved and rated a memory related to the pandemic in July 2020 (N=796; Mage=58.05, SD=14.14, range 19-85). Participants with a greater sense of purpose reported memories that were more phenomenologically rich (e.g., more vivid, coherent, accessible), whereas cognitive function was primarily related to greater perceived accessibility of the memory but not to most other aspects of phenomenology. The pattern of associations was similar when accounting for depressive symptoms, and none of the associations was moderated by age. The present research suggests that individuals with a higher sense of purpose in life have autobiographical memories with richer phenomenology. To the extent that memories function to sustain well-being, social connections, and cognitive health, rich phenomenology may be one pathway through which purpose leads to these better outcomes.

Neuropsychological Tests in Post-operative Cognitive Dysfunction: Methods and Applications

Post-operative cognitive dysfunction (POCD) is a neurological complication that relatively frequently occurs in older people after anesthesia/surgery, with varying durations and significant differences in the severity of cognitive impairment. POCD is mainly characterized by memory loss mostly without consciousness disorders, accompanied by abnormal emotions, behaviors, and language, mostly without consciousness disorder. The clinical performance of POCD lacks specificity but can reflect the severity of cognitive impairment in patients. The diagnosis of POCD cannot be separated from the evaluation of perioperative cognitive function of patients, and the more popular and accepted method is neuropsychological tests (NPTs).

Cognitive Function in Adolescents and Young Adults With Youth-Onset Type 1 Versus Type 2 Diabetes: The SEARCH for Diabetes in Youth Study

OBJECTIVE

Poor cognition has been observed in children and adolescents with youth-onset type 1 (T1D) and type 2 diabetes (T2D) compared with control subjects without diabetes. Differences in cognition between youth-onset T1D and T2D, however, are not known. Thus, using data from SEARCH for Diabetes in Youth, a multicenter, observational cohort study, we tested the association between diabetes type and cognitive function in adolescents and young adults with T1D (n = 1,095) or T2D (n = 285).

RESEARCH DESIGN AND METHODS

Cognition was assessed via the National Institutes of Health Toolbox Cognition Battery, and age-corrected composite Fluid Cognition scores were used as the primary outcome. Confounder-adjusted linear regression models were run. Model 1 included diabetes type and clinical site. Model 2 additionally included sex, race/ethnicity, waist-to-height ratio, diabetes duration, depressive symptoms, glycemic control, any hypoglycemic episode in the past year, parental education, and household income. Model 3 additionally included the Picture Vocabulary score, a measure of receptive language and crystallized cognition.

RESULTS

Having T2D was significantly associated with lower fluid cognitive scores before adjustment for confounders (model 1; P < 0.001). This association was attenuated to nonsignificance with the addition of a priori confounders (model 2; P = 0.06) and Picture Vocabulary scores (model 3; P = 0.49). Receptive language, waist-to-height ratio, and depressive symptoms remained significant in the final model (P < 0.01 for all, respectively).

CONCLUSIONS

These data suggest that while youth with T2D have worse fluid cognition than youth with T1D, these differences are accounted for by differences in crystallized cognition (receptive language), central adiposity, and mental health. These potentially modifiable factors are also independently associated with fluid cognitive health, regardless of diabetes type. Future studies of cognitive health in people with youth-onset diabetes should focus on investigating these significant factors.

Patient and clinician experiences of a computerised cognitive battery for use after concussion: a preliminary qualitative study

Objective:

The Cognition Battery of the National Institute of Health (NIH) Toolbox for Assessment of Neurological and Behavioural Function is a computerised neuropsychological battery recommended for clinical practice, neurological research and clinical trials. We investigated the utility of the NIH Toolbox Cognition Battery (NIHTB-CB) for people with concussion.

Methods:

In this small qualitative study, semi-structured interviews were conducted with five adults with concussion who were participating in a larger study using the NIHTB-CB. Three clinician participants and two cultural advisors familiar with the tool were also interviewed. Interview transcripts were analysed using a general thematic approach and qualitative description.

Results:

Participants described both positive and negative experiences with the NIHTB-CB and using qualitative description, their experiences were organised into three broad themes: (1) using technology for cognitive testing made sense, (2) there were some cultural relevance questions and (3) cognitive testing after concussion could have challenges. They were positive about the computerised format and range of domains assessed for the concussion context but identified the contextual relevance of some content as having potential to impact on performances.

Conclusion:

This was a small study examining the experiences of a select group of participants, but nevertheless does suggest a need for future research validating the NIHTB-CB for use in different cultural and clinical contexts.