Motor-free composites from the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) for people with disabilities

Automated procedure for demographic adjustments on cognitive test scores

Performances of normal people on cognitive tests are known to vary by demographic characteristics, such as age, education, and sex. Thus, cognitive test scores should be corrected for demographic influences when they are used to detect below-expected results due to disease or injury involving the central nervous system (CNS). Normative corrections, if estimated from a large, diverse, and well-characterized cohort of controls, help to remove expected differences in cognitive performance associated with normal demographic characteristics and associated socio-economic disadvantages. In this paper, we (1) describe in detail the process of generating regression-based normative standards, and its advantages and limitations, (2) provide recommendations for applying these normative standards to data from individuals and populations at risk for CNS dysfunction, and (3) introduce an R package, test2norm, that contains functions for producing and applying normative formulas to generate demographically corrected scores for measuring deviations from expected, normal cognitive performances.

Massive body-brain disconnection consequent to spinal cord injuries drives profound changes in higher-order cognitive and emotional functions: A PRISMA scoping review

Spinal cord injury (SCI) leads to a massive disconnection between the brain and the body parts below the lesion level representing a unique opportunity to explore how the body influences a person's mental life. We performed a systematic scoping review of 59 studies on higher-order cognitive and emotional changes after SCI. The results suggest that fluid abilities (e.g. attention, executive functions) and emotional regulation (e.g. emotional reactivity and discrimination) are impaired in people with SCI, with progressive deterioration over time. Although not systematically explored, the factors that are directly (e.g. the severity and level of the lesion) and indirectly associated (e.g. blood pressure, sleeping disorders, medication) with the damage may play a role in these deficits. The inconsistency which was found in the results may derive from the various methods used and the heterogeneity of samples (i.e. the lesion completeness, the time interval since lesion onset). Future studies which are specifically controlled for methods, clinical and socio-cultural dimensions are needed to better understand the role of the body in cognition.

Uses of the NIH Toolbox® in Clinical Samples: A Scoping Review

Background and Objectives

The NIH Toolbox® for the Assessment of Neurologic and Behavioral Function is a compilation of computerized measures designed to assess sensory, motor, emotional, and cognitive functioning of individuals across the life span. The NIH Toolbox was initially developed for use with the general population and was not originally validated in clinical populations. The objective of this scoping review was to assess the extent to which the NIH Toolbox has been used with clinical populations.

Methods

Guided by the Joanna Briggs Methods Manual for Scoping Reviews, records were identified through searches of PubMed MEDLINE, PsycINFO, ClinicalTrials.gov, EMBASE, and ProQuest Dissertations and Theses Global (2008-2020). Database searches yielded 5,693 unique titles of original research that used at least one NIH Toolbox assessment in a sample characterized by any clinical diagnosis. Two reviewers screened titles, abstracts, and full texts for inclusion in duplicate. Conflicts at each stage of the review process were resolved by a group discussion.

Results

Ultimately, 281 publication records were included in this scoping review (nJournal Articles = 104, nConference Abstracts = 84, nClinical Trial Registrations = 86, and nTheses/Dissertations = 7). The NIH Toolbox Cognition Battery was by far the most used of the 4 batteries in the measurement system (nCognition = 225, nEmotion = 49, nMotor = 29, and nSensation = 16). The most represented clinical category was neurologic disorders (n = 111), followed by psychological disorders (n = 39) and cancer (n = 31). Most (96.8%) of the journal articles and conference abstracts reporting the use of NIH Toolbox measures with clinical samples were published in 2015 or later. As of May 2021, these records had been cited a total of nearly 1,000 times.

Discussion

The NIH Toolbox measures have been widely used among individuals with various clinical conditions across the life span. Our results lay the groundwork to support the feasibility and utility of administering the NIH Toolbox measures in research conducted with clinical populations and further suggest that these measures may be of value for implementation in fast-paced clinical settings as part of routine practice.

Motor demands of cognitive testing may artificially reduce executive function scores in individuals with spinal cord injury

Objective: To determine whether the motor demands of cognitive tests contribute to differences in cognitive function scores in participants with and without spinal cord injury (SCI).Design: Cohort study.Setting: Rehabilitation research laboratory.Participants: 68 individuals without SCI ("NON") and 22 individuals with motor complete SCI ("SCI").Interventions: None.Outcome Measures: NIH Toolbox cognitive assessments, including two with motor demands and reaction-time based scoring (Dimensional Change Card Sort (DCCS), Flanker Inhibitory Control and Attention (Flanker) and two without timed scoring (List Sorting Working Memory (List Sorting), Picture Sequence Memory Test (Picture Sequence). Tests were administered with and without the assistance of a proctor on two randomly-determined days (>24 hr interval). For DCCS and Flanker, the motor-task score offset was estimated as the difference between the proctored and non-proctored scores.Results: For demographically-corrected data, proctoring reduced DCCS and Flanker scores (P < 0.001) but mitigated apparent differences between SCI and NON (all P > 0.403). SCI and NON did not differ for List Sorting (P > 0.072) but did differ significantly for Picture Sequence (P < 0.001). Significant practice effects existed for memory-based tests (List Sorting and Picture Sequence); all P < 0.015, effect size>0.645.Conclusions: DCCS and Flanker scores for individuals with SCI may be artificially reduced consequent to secondary motor demands of the tests. Proctoring and computation of a motor-response score offset enables comparisons to be made between individuals with SCI and a Non-SCI control cohort; however, further work is needed to determine whether offset-adjusted scores can be compared to standardized normative values.

Multidimensional review of cognitive impairment after spinal cord injury

Cognitive impairment is highly prevalent in the population with spinal cord injury (SCI) and exerts a significant impact on functional independence and quality of life in this population. A number of neuroscientists have conducted preliminary investigations of cognitive deficits after SCI, but achieved marginally contradictory results due to some limitations such as the heterogeneity in the sample population, sample size, types of tests utilized, study design, and time since SCI. Therefore, this review mainly focuses on the characteristics, assessments, potential causality and treatment of cognitive impairment for better understanding such deficits in the SCI population.

Rey Tangled Line Test: A measure of processing speed in TBI

OBJECTIVE

Neuropsychological assessment plays a key role in characterizing and detecting cognitive impairment after traumatic brain injury (TBI). The Rey Tangled Line Test (RTLT), an understudied neuropsychological assessment thought to be capable of detecting visual processing deficits, was examined to determine which cognitive abilities may contribute to performance on the test in participants with a history of TBI.

METHOD

One-hundred participants with a history of mild to severe TBI were administered a battery of neuropsychological tests assessing attention, executive functioning, memory, visual construction, motor functioning, and processing speed between 30 days and 5 years postinjury. An exploratory principal components analysis (PCA) was performed to determine which cognitive tests the RTLT was most highly associated with.

RESULTS

No difference in RTLT latency was present between mild and moderate/severe TBI. The PCA resulted in 5 factors. RTLT latency had a significant primary factor loading on the "processing speed" factor, and a secondary loading on the "motor" factor. Forty-two percent of participants had an impaired latency score.

CONCLUSIONS

RTLT latency appears to measure processing speed, and likely aspects of motor functioning, in our sample. The RTLT may be useful as a rapid assessment in individuals with a history of TBI to detect cognitive deficit before initiating further cognitive testing or rehabilitation efforts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Test accommodations for individuals with neurological conditions completing the NIH Toolbox-Cognition Battery: An evaluation of frequency and appropriateness

OBJECTIVES

First, to evaluate the frequency with which individuals with neurological conditions require test administration accommodations for the NIH Toolbox-Cognition Battery (NIHTB-CB). Second, to evaluate the appropriateness of accommodations provided by administrators, including adherence to NIHTB-CB Reasonable Accommodations Guidelines.

METHOD

Adults with traumatic brain injury, spinal cord injury, or stroke (n = 604) completed the NIHTB-CB and other assessments as part of a multisite study. We provide a descriptive, secondary analysis of test administrator notes to determine use and appropriateness of accommodations.

RESULTS

Of the 604 participants, 450 (75%) completed the NIHTB-CB using standard administration procedures, but 137 (22.6%) encountered accessibility challenges that required accommodations. Participants with motor function impairments were most likely to receive at least 1 of 3 kinds of accommodations: (a) use of nonstandard methods of entering responses using standard input devices, (b) use of alternate input devices, or (c) help from the test administrator to enter a response. Fatigue and/or impulsivity led to nonstandard administration by 48 (7.9%) individuals. Post hoc audit of test administrator notes revealed that despite careful instructions and supervision, 49 (56.3%) of the accommodated administrations breached standardization and scores could not be interpreted using test norms.

CONCLUSION

Although the NIHTB-CB was developed for individuals without neurological impairment, most individuals with neurological conditions completed the standardized administration without accommodations. When accommodations were needed, administrators did not adhere to the official Reasonable Accommodations Guidelines in more than half of the cases. (PsycINFO Database Record

The clinical utility and construct validity of the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with disabilities

A State-of-the-Science conference on measurement with disability populations recommended "...the development of cognitive and psychosocial outcome measures, using computer-adaptive testing...that are low in respondent burden and valid across patient populations," (Clohan et al., 2007, p. 1537). Following this recommendation, the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) prioritized the development of measures of cognitive functioning for individuals with disabilities, noting that measures of cognitive functioning "have not been developed for systemic application in the field of medical rehabilitation. Cognition is both a rehabilitation outcome and a factor related to broader functional and community outcomes for individuals with a wide variety of disabling conditions" (Office of Special Education & Rehabilitation Services, 2009, p. 37193). From this came the NIH Toolbox for the Assessment of Neurological and Behavioral Function project (NIH Toolbox) which provides a comprehensive set of cognitive, motor, sensory, and emotional health and function measures for use in clinical, longitudinal, and epidemiological research. The nine papers comprising this special section of Rehabilitation Psychology reflect the sustained collaborative efforts of more than two dozen investigators working at six sites over the past 8 years. They are an initial attempt to validate the NIHTB-CB in disability samples, and they provide initial evidence that the NIHTB-CB can be used with individuals who have TBI, SCI, or stroke. The articles published here reflect the fulfillment of recommendations made during a state-of-the-science conference in 2007. (PsycINFO Database Record