A Comparison of Four Computerized Neurocognitive Assessment Tools to a Traditional Neuropsychological Test Battery in Service Members with and without Mild Traumatic Brain Injury

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

Neuropsychological Evaluation in Traumatic Brain Injury

Neuropsychological evaluations can be helpful in the aftermath of traumatic brain injury. Cognitive functioning is assessed using standardized assessment tools and by comparing an individual's scores on testing to normative data. These evaluations examine objective cognitive functioning as well as other factors that have been shown to influence performance on cognitive tests (eg, psychiatric conditions, sleep) in an attempt to answer a specific question from referring providers. Referral questions may focus on the extent of impairment, the trajectory of recovery, or ability to return to work, sport, or the other previous activity.

The reliability and validity of brief cognitive screening tools used in traumatic brain injury: A systematic review

Reliable and valid cognitive screening tools are essential in the assessment of those with traumatic brain injury (TBI). Yet, there is no consensus about which tool should be used in clinical practice. This systematic review assessed psychometric properties of cognitive screening tools for detecting cognitive impairment in TBI. Inclusion criteria were: peer-reviewed validation studies of a cognitive screening tool(s); with a sample of adults aged 18-80 diagnosed with TBI (mild-severe); and with psychometrics consistent with COSMIN guidelines. Published literature was retrieved from MEDLINE, Web of Science Core Collection, EMBASE, CINAHL, and PsycINFO on 27 January 2022. A narrative synthesis was performed. Thirty-four studies evaluated the psychometric properties of a total of 22 cognitive screening tools, in a variety of languages. Properties assessed included structural validity, internal consistency, reliability, criterion validity (or diagnostic test accuracy), convergent/divergent validity, and discriminant validity. The Montreal Cognitive Assessment (MoCA) and the Mini Mental State Examination (MMSE) were the most widely validated cognitive screening tools for use in TBI. The MoCA had the most promising evidence of its psychometric properties, which has implications for clinical practice. Future research should aim to follow standard criteria for psychometric studies to allow meaningful comparisons across the literature.

The California Cognitive Assessment Battery (CCAB)

Introduction

We are developing the California Cognitive Assessment Battery (CCAB) to provide neuropsychological assessments to patients who lack test access due to cost, capacity, mobility, and transportation barriers.

Methods

The CCAB consists of 15 non-verbal and 17 verbal subtests normed for telemedical assessment. The CCAB runs on calibrated tablet computers over cellular or Wi-Fi connections either in a laboratory or in participants' homes. Spoken instructions and verbal stimuli are delivered through headphones using naturalistic text-to-speech voices. Verbal responses are scored in real time and recorded and transcribed offline using consensus automatic speech recognition which combines the transcripts from seven commercial ASR engines to produce timestamped transcripts more accurate than those of any single ASR engine. The CCAB is designed for supervised self-administration using a web-browser application, the Examiner. The Examiner permits examiners to record observations, view subtest performance in real time, initiate video chats, and correct potential error conditions (e.g., training and performance failures, etc.,) for multiple participants concurrently.

Results

Here we describe (1) CCAB usability with older (ages 50 to 89) participants; (2) CCAB psychometric properties based on normative data from 415 older participants; (3) Comparisons of the results of at-home vs. in-lab CCAB testing; (4) We also present preliminary analyses of the effects of COVID-19 infection on performance. Mean z-scores averaged over CCAB subtests showed impaired performance of COVID+ compared to COVID- participants after factoring out the contributions of Age, Education, and Gender (AEG). However, inter-cohort differences were no longer significant when performance was analyzed with a comprehensive model that factored out the influences of additional pre-existing demographic factors that distinguished COVID+ and COVID- cohorts (e.g., vocabulary, depression, race, etc.,). In contrast, unlike AEG scores, comprehensive scores correlated significantly with the severity of COVID infection. (5) Finally, we found that scoring models influenced the classification of individual participants with Mild Cognitive Impairment (MCI, z-scores < -1.50) where the comprehensive model accounted for more than twice as much variance as the AEG model and reduced racial bias in MCI classification.

Discussion

The CCAB holds the promise of providing scalable laboratory-quality neurodiagnostic assessments to underserved urban, exurban, and rural populations.

Assessing blood oxygen level-dependent signal variability as a biomarker of brain injury in sport-related concussion

Mild traumatic brain injury is a complex neurological disorder of significant concern among athletes who play contact sports. Athletes who sustain sport-related concussion typically undergo physical examination and neurocognitive evaluation to determine injury severity and return-to-play status. However, traumatic disruption to neurometabolic processes can occur with minimal detectable anatomic pathology or neurocognitive alteration, increasing the risk that athletes may be cleared for return-to-play during a vulnerable period and receive a repetitive injury. This underscores the need for sensitive functional neuroimaging methods to detect altered cerebral physiology in concussed athletes. The present study compared the efficacy of Immediate Post-concussion Assessment and Cognitive Testing composite scores and whole-brain measures of blood oxygen level-dependent signal variability for classifying concussion status and predicting concussion symptomatology in healthy, concussed and repetitively concussed athletes, assessing blood oxygen level-dependent signal variability as a potential diagnostic tool for characterizing functional alterations to cerebral physiology and assisting in the detection of sport-related concussion. We observed significant differences in regional blood oxygen level-dependent signal variability measures for concussed athletes but did not observe significant differences in Immediate Post-concussion Assessment and Cognitive Testing scores of concussed athletes. We further demonstrate that incorporating measures of functional brain alteration alongside Immediate Post-concussion Assessment and Cognitive Testing scores enhances the sensitivity and specificity of supervised random forest machine learning methods when classifying and predicting concussion status and post-concussion symptoms, suggesting that alterations to cerebrovascular status characterize unique variance that may aid in the detection of sport-related concussion and repetitive mild traumatic brain injury. These results indicate that altered blood oxygen level-dependent variability holds promise as a novel neurobiological marker for detecting alterations in cerebral perfusion and neuronal functioning in sport-related concussion, motivating future research to establish and validate clinical assessment protocols that can incorporate advanced neuroimaging methods to characterize altered cerebral physiology following mild traumatic brain injury.

Correlation analysis between subtest scores of CERAD-K and a newly developed tablet computer-based digital cognitive test (Inbrain CST)

Introduction

The prevalence of Alzheimer's disease (AD) and other dementias is increasing; therefore, identifying individuals at risk for dementia is crucial. Traditional neuropsychological assessments are expensive and time-consuming; however, computerized cognitive testing is becoming popular in clinical and research settings, particularly during the COVID-19 pandemic. This study aimed to investigate the correlation between the computerized cognitive test, Inbrain cognitive screening test (CST), and the traditional neuropsychological battery, the consortium to establish a registry for Alzheimer's disease assessment packet (CERAD-K).

Methods

We enrolled 166 participants from five districts in Republic of Korea, including cognitively unimpaired individuals and those with mild cognitive impairment (MCI) diagnosed by experienced neurologists. We used the Inbrain CST and CERAD-K to evaluate the cognitive function of the participants, and the scores of each subtest of the Inbrain CST and CERAD-K were compared.

Results

A significant correlation was found between the Inbrain CST and CERAD-K subtests. Furthermore, multivariate analysis revealed a significant correlation between the Inbrain CST and the CERAD-K test pairs after adjusting for age, educational level, and sex.

Discussion

In conclusion, this study demonstrates that the Inbrain CST is a reliable tool for detecting cognitive impairment in cognitively unimpaired individuals and patients with MCI, because it has a high correlation and agreement with CERAD-K. Therefore, the Inbrain CST can be a useful, time-efficient, and cost-effective computer-based cognitive test for individuals at risk for cognitive impairment.

Technology and Mental Health: State of the Art for Assessment and Treatment

Technology is ubiquitous in society and is now being extensively used in mental health applications. Both assessment and treatment strategies are being developed and deployed at a rapid pace. The authors review the current domains of technology utilization, describe standards for quality evaluation, and forecast future developments. This review examines technology-based assessments of cognition, emotion, functional capacity and everyday functioning, virtual reality approaches to assessment and treatment, ecological momentary assessment, passive measurement strategies including geolocation, movement, and physiological parameters, and technology-based cognitive and functional skills training. There are many technology-based approaches that are evidence based and are supported through the results of systematic reviews and meta-analyses. Other strategies are less well supported by high-quality evidence at present, but there are evaluation standards that are well articulated at this time. There are some clear challenges in selection of applications for specific conditions, but in several areas, including cognitive training, randomized clinical trials are available to support these interventions. Some of these technology-based interventions have been approved by the U.S. Food and Drug administration, which has clear standards for which types of applications, and which claims about them, need to be reviewed by the agency and which are exempt.

Philips IntelliSpace Cognition digital test battery: Equivalence and measurement invariance compared to traditional analog test versions

Objective: To collect evidence of validity for a selection of digital tests on the Philips IntelliSpace Cognition (ISC) platform.Method: A total of 200 healthy participants (age 50-80) completed both the ISC battery and an analog version of the battery during separate visits. The battery included the following screeners and cognitive tests: Mini-Mental State Examination (2^nd edition), Clock Drawing Test, Trail-Making Test (TMT), Rey Auditory Verbal Learning Test (RAVLT), Rey-Osterrieth Complex Figure Test (ROCFT), Letter Fluency, Star Cancellation Test, and Digit Span Test. The ISC tests were administered on an iPad Pro and were automatically scored using designated algorithms. The analog tests were administered in line with existing guidelines and scored by trained neuropsychologists. Criterion validity was established through relative agreement coefficients and raw score equivalence tests. In addition,measurement invariance analysis was used to compare the factor structures of both versions. Finally, we explored effects of demographics and experience with digital devices on performance.Results: We found fair to excellent relative agreement between test versions. Absolute equivalence was found for RAVLT, Letter Fluency, Star Cancellation Test, and Digit Span Test. Importantly, we demonstrated equal loadings of the digital and analog test versions on the same set of underlying cognitive domains. Demographic effects were mostly comparable between modalities, and people's experience with digital devices was found to only influence performance on TMT B.Conclusions: This study provides several sources of evidence for the validity of the ISC test battery, offering an important step in validating ISC for clinical use.Supplemental data for this article is available online at https://doi.org/10.1080/13854046.2021.1974565.

Severity of Ongoing Post-Concussive Symptoms as a Predictor of Cognitive Performance Following a Pediatric Mild Traumatic Brain Injury

OBJECTIVE

This study aimed to examine the predictors of cognitive performance in patients with pediatric mild traumatic brain injury (pmTBI) and to determine whether group differences in cognitive performance on a computerized test battery could be observed between pmTBI patients and healthy controls (HC) in the sub-acute (SA) and the early chronic (EC) phases of injury.

METHOD

203 pmTBI patients recruited from emergency settings and 159 age- and sex-matched HC aged 8-18 rated their ongoing post-concussive symptoms (PCS) on the Post-Concussion Symptom Inventory and completed the Cogstate brief battery in the SA (1-11 days) phase of injury. A subset (156 pmTBI patients; 144 HC) completed testing in the EC (~4 months) phase.

RESULTS

Within the SA phase, a group difference was only observed for the visual learning task (One-Card Learning), with pmTBI patients being less accurate relative to HC. Follow-up analyses indicated higher ongoing PCS and higher 5P clinical risk scores were significant predictors of lower One-Card Learning accuracy within SA phase, while premorbid variables (estimates of intellectual functioning, parental education, and presence of learning disabilities or attention-deficit/hyperactivity disorder) were not.

CONCLUSIONS

The absence of group differences at EC phase is supportive of cognitive recovery by 4 months post-injury. While the severity of ongoing PCS and the 5P score were better overall predictors of cognitive performance on the Cogstate at SA relative to premorbid variables, the full regression model explained only 4.1% of the variance, highlighting the need for future work on predictors of cognitive outcomes.

Examination of Reaction Time Deficits Following Concussion: A Systematic Review and Meta-analysis

BACKGROUND

Reaction time (RT) deficits are reported following concussion, but it is unknown when these deficits normalize to pre-injury status. It is also unclear how factors such as RT measurement technique and participant characteristics influence post-concussion RT.

OBJECTIVE

The purpose of this systematic review and meta-analysis was to (1) characterize acute post-concussion (0-3 days) RT impairments, (2) examine RT recovery over time, and (3) explore moderating factors related to acute RT impairment following concussion.

METHODS

Database searches (PubMed, CINAHL, EBSCOhost) were conducted according to PRISMA guidelines for articles published in English from January 2002 to March 2019. Studies compared baseline-to-post-injury RT within individuals (within-subject) and/or RT in concussed individuals to non-concussed controls (between-subject). Sixty studies met inclusion criteria, reporting on a total of 9688 participants with 214 discrete RT effects (Hedges' d; between-subject: N = 29, k = 129; within-subject: N = 42, k = 85). Of the 214 effects, 93 occurred in the acute (0-3 days) post-injury timeframe (k = 47 between-subject). Numerous demographic [sex, age, concussion history, population type (athlete, military, and general population), athlete level (high school, college), and sport], and method-based (RT test and measure type, computerized neurocognitive testing platform, concussion definition, and time post-injury) moderators were examined for mean effect influence. Mixed-effects multi-level modeling with restricted-maximum-likelihood estimation was used to account for nested effects and high heterogeneity for the pooled effect size (D+).

RESULTS

Significant medium-magnitude RT deficits were observed acutely for between- (D+ = - 0.7279, 95% CI - 0.9919, - 0.4639, I² = 88.66, p < 0.0001) and within-subject (D+ = - 0.7472, 95% CI - 0.9089, - 0.5855, I² = 89.21, p < 0.0001) effect models. RT deficits were present at the sub-acute and intermediate-term timeframes for between-subject effects (sub-acute: D+ = - 0.5655, 95% CI - 0.6958, - 0.4352, p < 0.0001; intermediate-term: D+ = - 0.3219, 95% CI - 0.5988, - 0.0450, p = 0.0245). No significant RT mean effect was observed for the between-subject model at the long-term timeframe, indicating RT recovery among concussed participants relative to controls (D+ = 0.3505, 95% CI - 0.4787, 1.1797, p = 0.3639). Sex was a significant moderator for between-subject effects, with every 1% male sample size increase demonstrating - 0.0171 (95% CI - 0.0312, - 0.0029, p = 0.0193) larger RT deficits. Within-subject effect models resulted in RT measure type (simple: [D+ = - 0.9826] vs. mixed: [D+ = - 0.6557], p = 0.0438) and computerized neurocognitive testing platforms (ANAM: [D+ = - 0.3735] vs. HeadMinder CRI: [D+ = - 1.4799] vs. ImPACT: [D+ = - 0.6749], p = 0.0004) having significantly different RT-deficit magnitudes. No other moderators produced significantly different RT-deficit magnitudes (between-subject: [p ≥ 0.0763], within-subject: [p ≥ 0.1723]).

CONCLUSIONS

Robust RT deficits were observed acutely following concussion. Minimal magnitude differences were noted when comparing between- and within-subject effects, suggesting that pre-injury baselines may not add clinical value in determining post-injury RT impairment. RT deficits persisted up till the intermediate-term (21-59 days post-injury) timeframe and indicate lingering deficits exist. Mean effect size differences were observed between RT measure types and computerized neurocognitive testing platforms; however, all categories displayed negative effects consistent with impaired RT following concussion. Clinical interpretation suggests that measuring RT post-concussion is more important than considering the RT method employed so long as reliable and valid tools are used. PROSPERO Registration #CRD42019119323.

Neurocognitive Assessment Tools for Military Personnel With Mild Traumatic Brain Injury: Scoping Literature Review

BACKGROUND

Mild traumatic brain injury (mTBI) occurs at a higher frequency among military personnel than among civilians. A common symptom of mTBIs is cognitive dysfunction. Health care professionals use neuropsychological assessments as part of a multidisciplinary and best practice approach for mTBI management. Such assessments support clinical diagnosis, symptom management, rehabilitation, and return-to-duty planning. Military health care organizations currently use computerized neurocognitive assessment tools (NCATs). NCATs and more traditional neuropsychological assessments present unique challenges in both clinical and military settings. Many research gaps remain regarding psychometric properties, usability, acceptance, feasibility, effectiveness, sensitivity, and utility of both types of assessments in military environments.

OBJECTIVE

The aims of this study were to explore evidence regarding the use of NCATs among military personnel who have sustained mTBIs; evaluate the psychometric properties of the most commonly tested NCATs for this population; and synthesize the data to explore the range and extent of NCATs among this population, clinical recommendations for use, and knowledge gaps requiring future research.

METHODS

Studies were identified using MEDLINE, Embase, American Psychological Association PsycINFO, CINAHL Plus with Full Text, Psych Article, Scopus, and Military & Government Collection. Data were analyzed using descriptive analysis, thematic analysis, and the Randolph Criteria. Narrative synthesis and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-analyses extension for Scoping Reviews) guided the reporting of findings. The psychometric properties of NCATs were evaluated with specific criteria and summarized.

RESULTS

Of the 104 papers, 33 met the inclusion criteria for this scoping review. Thematic analysis and NCAT psychometrics were reported and summarized.

CONCLUSIONS

When considering the psychometric properties of the most commonly used NCATs in military populations, these assessments have yet to demonstrate adequate validity, reliability, sensitivity, and clinical utility among military personnel with mTBIs. Additional research is needed to further validate NCATs within military populations, especially for those living outside of the United States and individuals experiencing other conditions known to adversely affect cognitive processing. Knowledge gaps remain, warranting further study of psychometric properties and the utility of baseline and normative testing for NCATs.

An Investigation of the Accuracy of Reaction Time Measurements on ANAM4 TBI-MIL Across Three Computer Platforms

STUDY DESIGN

Using two observational methods and a within-subjects, counterbalanced design, this study aimed to determine if a computer's hardware and software settings significantly affected reaction time (RT) on the Automated Neuropsychological Assessment Metrics (Version 4) Traumatic Brain Injury Military (ANAM4 TBI-MIL).

METHODS

Three computer platforms were investigated: Platform 1-older computers recommended for ANAM4 TBI-MIL administration, Platform 2-newer computers with settings downgraded to run like the older computers, and Platform 3-newer computers with default settings. Two observational methods were used to compare measured RT to observed RT on all three platforms: 1, a high-speed video analysis to compare the timing of stimulus onset and response to the measured RT and 2, comparing a preset RT delivered by a robotic key actuator activated by optic detector to the measured RT. Additionally, healthy active duty service members (n = 169) were administered a brief version of the ANAM4 TBI-MIL battery on each of the three platforms.

RESULTS

RT differences were observed with both the high-speed video and robotic arm analyses across all three computer platforms, with the smallest discrepancies between observed and measured RT on Platform 1, followed by Platform 2, then Platform 3. When simple reaction time (SRT) raw and standardized scores obtained from the participants were compared across platforms, statistically significant and clinically meaningful differences were seen, especially between Platforms 1 and 3.

CONCLUSIONS

A computer's configurations have a meaningful impact on ANAM SRT scores. The difference in an individual's performance across platforms could be misinterpreted as clinically meaningful change.

Using Rates of Low Scores to Assess Agreement between Brief Computerized Neuropsychological Assessment Batteries: A Clinically-based Approach for Psychometric Comparisons

OBJECTIVE

To assess agreement between four brief computerized neurocognitive assessment tools (CNTs), ANAM, CogState, CNS Vital Signs, and ImPACT, by comparing rates of low scores.

METHODS

Four hundred and six US Army service members (SMs) with and without acute mild traumatic brain injury completed two randomly assigned CNTs with order of administration also randomly assigned. We performed a base rate analysis for each CNT to determine the proportions of SMs in the control and mTBI groups who had various numbers of scores that were 1.0+, 1.5+, and 2.0+ standard deviations below the normative mean. We used these results to identify a hierarchy of low score levels ranging from poorest to least poor performance. We then compared the agreement between every low score level from each CNT pair administered to the SMs.

RESULTS

More SMs in the mTBI group had low scores on all CNTs than SMs in the control group. As performance worsened, the association with mTBI became stronger for all CNTs. Most if not all SMs who performed at the worst level on any given CNT also had low scores on the other CNTs they completed but not necessarily at an equally low level.

CONCLUSION

These results suggest that all of the CNTs we examined are broadly similar but still retain some psychometric differences that need to be better understood. Furthermore, the base rates of low scores we present could themselves be useful to clinicians and researchers as a guide for interpreting results from the CNTs.

Neurocognitive Performance of 425 Top-Level Football Players: Sport-specific Norm Values and Implications

OBJECTIVE

Concussion diagnosis and management in sports largely relies on neurocognitive testing. In the absence of baseline assessment, only norm values of the general population are available for comparison with scores of concussed athletes. To evaluate whether (elite) sport specific norm values are needed, cognitive performance was compared between top-level football players and the general population.

METHODS

Cognitive performance of 425 top-level football players was evaluated using the computerized test battery CNS Vital Signs. Players were split into two age groups (15-19 and 20-29 years) and test results were compared with a norm sample (n = 268) by means of age-standardized scores using Cohen's d effect size statistics.

RESULTS

The younger age group outperformed the norm sample in all domains, with small to moderate effects on tests of processing speed (d = 0.58, 95% CI = 0.31,0.85), cognitive flexibility (d = 0.27, 95% CI = 0.01,0.53) and psychomotor speed (d = 0.97, 95% CI = 0.69,1.24). In the older age group, no differences were found on four out of six domains; a moderate positive effect was found for psychomotor speed (d = 0.74, 95% CI = 0.54,0.93), a small negative effect for reaction time (d = -0.47, 95% CI = -0.66,-0.28). Relative to the norm, older football players scored lower than younger football players on all test domains.

CONCLUSION

Cognitive performance of elite football players may be different from the general population. It is recommended to use football-specific norm scores for comparison with test results of concussed players, and to choose an adequate control group when investigating effects of contact sport on cognition. Studies with older/retired football players are needed to further analyze potential sport-specific age effects.

Intraindividual Cognitive Variability: An Examination of ANAM4 TBI-MIL Simple Reaction Time Data from Service Members with and without Mild Traumatic Brain Injury

OBJECTIVES

The Automated Neuropsychological Assessment Metrics 4 TBI-MIL (ANAM4) is a computerized cognitive test often used in post-concussion assessments with U.S. service members (SMs). However, existing evidence remains mixed regarding ANAM4's ability to identify cognitive issues following mild traumatic brain injury (mTBI). Studies typically examine ANAM4 using standardized scores and/ or comparisons to a baseline. A more fine-grained approach involves examining inconsistency within an individual's performance (i.e., intraindividual variability).

METHODS

Data from 237 healthy control SMs and 105 SMs within seven days of mTBI who took the ANAM4 were included in analyses. Using each individual's raw scores on a simple reaction time (RT) subtest (SRT1) that is repeated at the end of the battery (SRT2), we calculated mean raw RT and the intraindividual standard deviation (ISD) of trial-by-trial RT. Analyses investigated differences between groups in mean RT, RT variability (i.e., ISD), and change in ISD from SRT1 and SRT2.

RESULTS

Using regression residuals to control for demographic variables, analysis of variance, and pairwise comparisons revealed the control group had faster mean RT and smaller ISD compared to the mTBI group. Furthermore, the mTBI group had a significant increase in ISD from SRT1 to SRT2, with effect sizes exceeding the minimum practical effect for comparisons of ISD in SRT2 and change in ISD from SRT1 to SRT2.

CONCLUSIONS

While inconsistencies in performance are often viewed as test error, the results suggest intraindividual cognitive variability may be more sensitive than traditional metrics in detecting changes in cognitive function after mTBI. Additionally, the findings highlight the utility of the ANAM4's repeating a RT subtest at two points in the same session for exploring within-subject differences in performance variability. (JINS, 2018, 24, 156-162).