Comparability of iPad and Web-Based NIH Toolbox Cognitive Battery Administration in Veterans

eHealth tools to assess the neurological function for research, in absence of the neurologist - a systematic review, part I (software)

BACKGROUND

Neurological disorders remain a worldwide concern due to their increasing prevalence and mortality, combined with the lack of available treatment, in most cases. Exploring protective and risk factors associated with the development of neurological disorders will allow for improving prevention strategies. However, ascertaining neurological outcomes in population-based studies can be both complex and costly. The application of eHealth tools in research may contribute to lowering the costs and increase accessibility. The aim of this systematic review is to map existing eHealth tools assessing neurological signs and/or symptoms for epidemiological research.

METHODS

Four search engines (PubMed, Web of Science, Scopus & EBSCOHost) were used to retrieve articles on the development, validation, or implementation of eHealth tools to assess neurological signs and/or symptoms. The clinical and technical properties of the software tools were summarised. Due to high numbers, only software tools are presented here.

FINDINGS

A total of 42 tools were retrieved. These captured signs and/or symptoms belonging to four neurological domains: cognitive function, motor function, cranial nerves, and gait and coordination. An additional fifth category of composite tools was added. Most of the tools were available in English and were developed for smartphone device, with the remaining tools being available as web-based platforms. Less than half of the captured tools were fully validated, and only approximately half were still active at the time of data collection.

INTERPRETATION

The identified tools often presented limitations either due to language barriers or lack of proper validation. Maintenance and durability of most tools were low. The present mapping exercise offers a detailed guide for epidemiologists to identify the most appropriate eHealth tool for their research.

FUNDING

The current study was funded by a PhD position at the University of Groningen. No additional funding was acquired.

A psychometric evaluation of the NIH Toolbox fluid cognition tests adapted for Swahili and Dholuo languages in Kenyan children and adolescents

OBJECTIVE

Our objective was to evaluate the psychometric properties of the culturally adapted NIH Toolbox African Languages® when used in Swahili and Dholuo-speaking children in western Kenya.

METHOD

Swahili-speaking participants were recruited from Eldoret and Dholuo-speaking participants from Ajigo; all were <14 years of age and enrolled in primary school. Participants completed a demographics questionnaire and five fluid cognition tests of the NIH Toolbox® African Languages program, including Flanker, Dimensional Change Card Sort (DCCS), Picture Sequence Memory, Pattern Comparison, and List Sorting tests. Statistical analyses examined aspects of reliability, including internal consistency (in both languages) and test-retest reliability (in Dholuo only).

RESULTS

Participants included 479 children (n = 239, Swahili-speaking; n = 240, Dholuo-speaking). Generally, the tests had acceptable psychometric properties for research use within Swahili- and Dholuo-speaking populations (mean age = 10.5; SD = 2.3). Issues related to shape identification and accuracy over speed limited the utility of DCCS for many participants, with approximately 25% of children unable to match based on shape. These cultural differences affected outcomes of reliability testing among the Dholuo-speaking cohort, where accuracy improved across all five tests, including speed.

CONCLUSIONS

There is preliminary evidence that the NIH Toolbox ® African Languages potentially offers a valid assessment of development and performance using tests of fluid cognition in Swahili and Dholuo among research settings. With piloting underway across other diverse settings, future research should gather additional evidence on the clinical utility and acceptability of these tests, specifically through the establishment of norming data among Kenyan regions and evaluating these psychometric properties.

Feasibility, reliability, and validity of ambulatory cognitive tests in fibromyalgia and matched controls

OBJECTIVE

This observational study examined the feasibility, reliability, and validity of repeated ambulatory cognitive tests in fibromyalgia (FM).

METHOD

Adults with FM (n = 50) and matched controls (n = 50) completed lab-based neuropsychological tests (NIH Toolbox) followed by eight days of smartphone-based ambulatory testing of processing speed (symbol search) and working memory (dot memory) five times daily. Feasibility was assessed based on response rates. Reliability was evaluated using overall average between-person reliabilities for the full assessment period and by determining the number of assessment days necessary to attain reliabilities of >.80 and >.90. To assess convergent validity, correlations were calculated between ambulatory test scores and NIH Toolbox scores. Test performance was contrasted between the FM and non-FM groups to examine known-groups validity.

RESULTS

Average rates of response to the ambulatory cognitive tests were 89.5% in FM and 90.0% in non-FM. Overall average between-person reliabilities were ≥.96. In FM, between-person reliability exceeded .90 after two days for symbol search and three days for dot memory. Symbol search scores correlated with NIH Toolbox processing speed scores in both groups, though there were no significant group differences in symbol search performance. Dot memory scores correlated with NIH Toolbox working memory scores in both groups. FM participants exhibited worse dot memory performance than did non-FM participants.

CONCLUSIONS

Repeated ambulatory tests of processing speed and working memory demonstrate feasibility and reliability in FM, though evidence for construct validity is mixed. The findings demonstrate promise for future research and clinical applications of this approach to assessing cognition in FM.

The survey for memory, attention, and reaction time (SMART): Preliminary normative online panel data and user attitudes for a brief web-based cognitive performance measure

ObjectiveThe Survey for Memory, Attention, and Reaction Time (SMART) was recently introduced as a brief (<5 min), self-administered, web-based measure of cognitive performance in older adults. The purpose of this study was threefold: (1) to develop preliminary norms on the SMART; (2) to examine the relationship between demographic variables (i.e. age, sex, education), device type used, and SMART performance; and (3) to assess user attitudes of the SMART. Method A sample of 1,050 community-dwelling adults (M age =59.5 (15.2), M education = 16.5 (2.1), 67.1% female, 96% white) was recruited from an ongoing web-based research cohort. Participants completed the SMART, which consists of four face-valid cognitive tasks assessing visual memory, attention/processing speed, and executive functioning. SMART performance outcome metrics were subtest completion time (CT), click count, and total CT. Participants provided demographic information and completed a survey of user attitudes toward the SMART (i.e. usability, acceptability). Results Older age was the only demographic variable associated with slower SMART total CT (r = .60, p <.001). Education was not associated with SMART CT or click counts overall (p > .05). Male sex was generally associated with longer SMART CT (p < .001, partial eta squared = .14) on all sub-tests. Regarding acceptability, 97.3% indicated willingness to take the SMART again, with more than half willing to complete it on a weekly basis. Conclusion The preliminary normative data on the SMART indicates that it is a feasible and well-accepted web-based cognitive assessment tool that can be administered on multiple device platforms.

Construct validity of the NIH toolbox cognitive domains: A comparison with conventional neuropsychological assessments

OBJECTIVE

Previous studies have assessed the construct validity of individual subtests in the National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB), though none have examined the construct validity of the cognitive domains. Importantly, the original NIHTB-CB validation studies were administered on a desktop computer, though the NIHTB-CB is now solely administered via an iPad. We examined the construct validity of each cognitive domain assessed in the NIHTB-CB, including a motor dexterity domain using the iPad application compared to a neuropsychological battery in a sample of healthy adults.

METHOD

Eighty-three adults aged 20-66 years (M = 44.35 ± 13.41 years) completed the NIHTB-CB and a comprehensive neuropsychological assessment. Domain scores for each of six cognitive domains (attention and executive function, episodic memory, working memory, processing speed, language, and motor dexterity) and the fluid composite were computed for both batteries. We then assessed the construct validity using Pearson correlations and intraclass correlation coefficients (ICCs) for both demographically corrected and uncorrected domains.

RESULTS

We found the attention and executive function, episodic memory, and processing speed domains had poor-to-adequate construct validity (ICCConsistency = -0.029 to 0.517), the working memory and motor dexterity domains and the fluid composite had poor-to-good construct validity (ICCConsistency = 0.215-0.801), and the language domain had adequate-to-good construct validity (ICCConsistency = 0.408-0.829).

CONCLUSION

The NIHTB-CB cognitive domains have poor-to-good construct validity, thus researchers should be aware that some tests representing cognitive constructs may not fully reflect the cognitive domain of interest. Future investigation of the construct validity and reliability of the NIHTB-CB administered using the iPad is recommended. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Within-day rhythms of pain and cognitive function in people with and without fibromyalgia: synchronous or syncopated?

ABSTRACT

Cognitive dysfunction is a common fibromyalgia (FM) symptom and can impact on the daily lives of those affected. We investigated whether within-day pain intensity ratings were associated with contemporaneous objective and subjective measures of cognitive function and whether within-day increases in pain intensity preceded increases in cognitive dysfunction or vice versa. Inclusion of a non-FM group allowed us to examine whether effects were specific to FM. Fifty people with FM and 50 non-FM controls provided 7 days of data. Cognitive tests (processing speed and working memory) and ecological momentary assessments (pain intensity and self-reported cognitive functioning) were conducted ×5/day. Three-level multilevel models examined contemporaneous and within-day 1-lag pain intensity-cognitive functioning associations. Interaction terms assessed possible moderating effects of FM status. Momentary increase in pain was associated with increased self-reported cognitive dysfunction, more strongly so for those with FM (B = 0.27, 95% confidence interval 0.22-0.32; non-FM B = 0.17, 95% confidence interval 0.10-0.23). For the FM group, higher pain was associated with longer processing speed; for the non-FM group, higher pain was associated with shorter processing speed. Pain increase did not precede change in subjective or objective cognitive function in the FM group, but reduction in working memory preceded increase in pain intensity. This finding warrants further research attention and, if replicated, could hold prognostic and/or therapeutic potential.

Utility of the iPad NIH Toolbox Cognition Battery in a clinical trial of older adults

BACKGROUND

To demonstrate feasibility and utility of the iPad version of the NIH Toolbox Cognition Battery (NIHTB-CB) in a clinical trial of older adults.

METHODS

Fifty-one adults, aged 55 and older without dementia were tested twice on NIHTB-CB and more traditional paper-and-pencil neuropsychological measures after meal ingestion, with approximately a 4-week interval. We also compared performances at Time 1 and Time 2 for significant change. We also extracted the response times and errors for available NIHTB-CB subtests to determine subtle changes in performance.

RESULTS

Over the interval, improvement in fluid cognitive measures was noted at Time 2 (t = -3.07, p = 0.004), whereas crystallized measures were unchanged. Tests of fluid cognition negatively correlated with age, particularly for the second visit. Analysis of the average speed per item showed that, for two of the tests, speed increased at Time 2. Traditional neuropsychological tests correlated with many of the NIHTB-CB measures. Response times for all five timed tests decreased at Time 2, although only statistically significant for Picture Sequence and Picture Vocabulary.

CONCLUSIONS

The iPad version of the NIH Toolbox Cognition Battery appears to be an adequate measure to assess cognitive functioning in a clinical trial of older adults. Psychometric analyses suggest stability in measures of crystallized functioning, whereas measures of fluid abilities revealed improvements over the short time frame of the study. Response times and errors for individual tests revealed intriguing relationships that should be further evaluated to determine the utility in clinical sample analysis, as this could aid identification of subtle cognitive change over short periods. Additional studies with larger sample sizes will be helpful to understanding the reliability, sensitivity, and specificity of the NIHTB-CB sub-scores in older adults. In addition, further evaluations with clinical populations, including individuals with cognitive impairment, are warranted.

Fibrofog in Daily Life: An Examination of Ambulatory Subjective and Objective Cognitive Function in Fibromyalgia

OBJECTIVE

Perceived cognitive dysfunction in fibromyalgia (FM), "fibrofog," is common. Prior laboratory-based studies have limited our understanding of cognitive function in FM in daily life. The objective of this study was to explore levels of subjective and objective cognitive functioning and the association between subjective and objective aspects of cognition in people with and without FM in the lived environment.

METHODS

Participants (n = 50 adults with FM; n = 50 adults without FM, matched for age, sex, and education) completed baseline measures of subjective and objective cognitive functioning (NIH Toolbox). They also completed ecological momentary assessments of cognitive clarity and speed and tests of processing speed and working memory, via a smart phone app, 5×/day for 8 days.

RESULTS

On baseline objective measures, the FM group demonstrated poorer cognitive functioning across 3 NIH Toolbox tests. There were no strong correlations between subjective and objective cognitive functioning in both the FM and control groups. In the lived environment, the FM group demonstrated poorer subjective cognition and objective working memory; groups did not differ on processing speed. Momentary ratings of subjective cognitive dysfunction were significantly related to changes in objective processing speed but not working memory, with no group differences.

CONCLUSION

Findings indicate worse laboratory-based and ambulatory subjective and objective cognitive function for those individuals with FM compared to those without FM. Similar associations between measures of subjective and objective cognitive functioning for the groups suggest that people with FM are not overstating cognitive difficulties. Future research examining contributors to ambulatory fibrofog is warranted.