Sandbagging on the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) in a high school athlete population

The prevalence and correlates of scores falling below ImPACT embedded validity indicators among adolescent student athletes

Objective: Valid performance on preseason baseline neurocognitive testing is essential for accurate comparison between preseason and post-concussion test results. Immediate Post-Concussion and Cognitive Testing (ImPACT) is commonly used to measure baseline neurocognitive function in athletes. We examined the prevalence of invalid performance on ImPACT baseline testing and identified correlates of invalid performance. Method: The sample included 66,998 adolescents (ages 14-18, M = 15.51 years, SD = 1.22) who completed ImPACT baseline tests between 2009 and 2019. Invalid performance was determined by the embedded validity indicators (EVI). Associations between invalid performance, demographic characteristics, and health conditions were assessed using chi-square tests and odds ratios (ORs). Results: Overall, 7.2% of adolescents had baseline tests identified as invalid by one or more of the EVIs. Individual validity indicators classified between 0.5% and 3.7% tests as invalid. Higher frequencies of invalid scores were observed among youth with neurodevelopmental, academic, and medical conditions. Youth who reported having learning disabilities (n = 3126), receiving special education (n = 3563), or problems with attention-deficit/hyperactivity disorder (ADHD; n = 5104) obtained invalid baselines at frequencies of 16.4%, 16.0%, and 11.1%, respectively. Moreover, youth who reported receiving treatment for a substance use disorder (n = 311) or epilepsy (n = 718) obtained invalid baselines at frequencies of 17.0% and 11.1%, respectively. Conclusions: The base rate of invalid performance on ImPACT's EVIs was approximately 7%, consistent with prior research. Adolescents self-reporting neurodevelopmental conditions, academic difficulties, or a history of treatment for medical conditions obtained invalid baseline tests at higher frequencies. More research is needed to better understand invalid scores in youth with pre-existing conditions.

Contribution of implicit memory to adaptation of movement extent during reaching against unpredictable spring-like loads: insensitivity to intentional suppression of kinematic performance

We examined the extent to which intentionally underperforming a goal-directed reaching task impacts how memories of recent performance contribute to sensorimotor adaptation. Healthy human subjects performed computerized cognition testing and an assessment of sensorimotor adaptation, wherein they grasped the handle of a horizontal planar robot while making goal-directed out-and-back reaching movements. The robot exerted forces that resisted hand motion with a spring-like load that changed unpredictably between movements. The robotic test assessed how implicit and explicit memories of sensorimotor performance contribute to the compensation for the unpredictable changes in the hand-held load. After each movement, subjects were to recall and report how far the hand moved on the previous trial (peak extent of the out-and-back movement). Subjects performed the tests under two counter-balanced conditions: one where they performed with their best effort, and one where they intentionally sabotaged (i.e., suppressed) kinematic performance. Results from the computerized cognition tests confirmed that subjects understood and complied with task instructions. When suppressing performance during the robotic assessment, subjects demonstrated marked changes in reach precision, time to capture the target, and reaction time. We fit a set of limited memory models to the data to identify how subjects used implicit and explicit memories of recent performance to compensate for the changing loads. In both sessions, subjects used implicit, but not explicit, memories from the most recent trial to adapt reaches to unpredictable spring-like loads. Subjects did not "give up" on large errors, nor did they discount small errors deemed "good enough". Although subjects clearly suppressed kinematic performance (response timing, movement variability, and self-reporting of reach error), the relative contributions of sensorimotor memories to trial-by-trial variations in task performance did not differ significantly between the two testing conditions. We conclude that intentional performance suppression had minimal impact on how implicit sensorimotor memories contribute to adaptation of unpredictable mechanical loads applied to the hand.

Test-retest reliability of the neurotracker compared to the impact test for the management of mild traumatic brain injuries during two consecutive university sport seasons

INTRODUCTION

Neurocognitive assessment tools such as the Neurotracker and ImPACT have been proposed to optimize sports-related mild traumatic brain injury (mTBI) management. Baseline testing is recommended with such assessments to individualize monitoring of athletes' remission. While the ideal timeframe between baseline updates has been studied for the ImPACT, these data are missing for the Neurotracker.

OBJECTIVE

The current study aimed to compare the test-retest reliability of the ImPACT and Neurotracker for two consecutive seasons in university athletes participating in sports at risk for mTBI.

METHODS

At the start of two consecutive seasons, 30 athletes with no recent history of mTBI completed a baseline assessment including the Neurotracker and the ImPACT. The test-retest reliability of the results was analyzed by considering intra-class correlation (ICC), Becker's standardized mean difference (d_B) and Bland-Altman' plot of each outcome.

RESULTS

The Neurotracker and the Visual Motor Speed composite score of the ImPAC were the only outcomes with significative ICCs and acceptable d_B between the two seasons. Neurotracker was the only outcome with a significative bias (+0.179).

CONCLUSION

Our research suggests that the Neurotracker has an acceptable level of test-retest reliability after one year in comparison to the ImPACT.

The Rey Dot Counting Test as a Tool for Detecting Suboptimal Performance in Athlete Baseline Testing

OBJECTIVE

The limitations of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT)'s embedded validity measures (EVMs) are well-documented, as estimates suggest up to 35% of invalid baseline performances go undetected. Few studies have examined standalone performance validity tests (PVT) as a supplement to ImPACT's EVMs.

METHOD

College athletes (n = 1,213) were administered a preseason baseline assessment that included ImPACT and the Rey Dot Counting Test (DCT), a standalone PVT, among other measures.

RESULTS

Sixty-nine athletes (5.69%) met criteria for suboptimal effort on either ImPACT or the DCT. The DCT detected more cases of suboptimal effort (n = 50) than ImPACT (n = 21). A χ2 test of independence detected significant disagreement between the two measures, as only two individuals produced suboptimal effort on both (χ2(2) = 1.568, p = .210). Despite this disagreement, there were significant differences between the suboptimal effort DCT group and the adequate effort DCT group across all four ImPACT neurocognitive domains (U = 19,225.000, p < .001; U = 17,859.000, p < .001; U = 13,854.000, p < .001; U = 17,850.500, p < .001).

CONCLUSIONS

The DCT appears to detect suboptimal effort otherwise undetected by ImPACT's EVMs.

Predictive Value of Subacute Heart Rate Variability for Determining Outcome Following Adolescent Concussion

Objective assessments of concussion recovery are crucial for facilitating effective clinical management. However, predictive tools for determining adolescent concussion outcomes are currently limited. Research suggests that heart rate variability (HRV) represents an indirect and objective marker of central and peripheral nervous system integration. Therefore, it may effectively identify underlying deficits and reliably predict the symptomology following concussion. Thus, the present study sought to evaluate the relationship between HRV and adolescent concussion outcomes. Furthermore, we sought to examine its predictive value for assessing outcomes. Fifty-five concussed adolescents (12–17 years old) recruited from a local sports medicine clinic were assessed during the initial subacute evaluation (within 15 days postinjury) and instructed to follow up for a post-acute evaluation. Self-reported clinical and depressive symptoms, neurobehavioral function, and cognitive performance were collected at each timepoint. Short-term HRV metrics via photoplethysmography were obtained under resting conditions and physiological stress. Regression analyses demonstrated significant associations between HRV metrics, clinical symptoms, neurobehavioral function, and cognitive performance at the subacute evaluation. Importantly, the analyses illustrated that subacute HRV metrics significantly predicted diminished post-acute neurobehavioral function and cognitive performance. These findings indicate that subacute HRV metrics may serve as a viable predictive biomarker for identifying underlying neurological dysfunction following concussion and predict late cognitive outcomes.

Saliva RNA biomarkers predict concussion duration and detect symptom recovery: a comparison with balance and cognitive testing

OBJECTIVE

The goals of this study were to assess the ability of salivary non-coding RNA (ncRNA) levels to predict post-concussion symptoms lasting ≥ 21 days, and to examine the ability of ncRNAs to identify recovery compared to cognition and balance.

METHODS

RNA sequencing was performed on 505 saliva samples obtained longitudinally from 112 individuals (8-24-years-old) with mild traumatic brain injury (mTBI). Initial samples were obtained ≤ 14 days post-injury, and follow-up samples were obtained ≥ 21 days post-injury. Computerized balance and cognitive test performance were assessed at initial and follow-up time-points. Machine learning was used to define: (1) a model employing initial ncRNA levels to predict persistent post-concussion symptoms (PPCS) ≥ 21 days post-injury; and (2) a model employing follow-up ncRNA levels to identify symptom recovery. Performance of the models was compared against a validated clinical prediction rule, and balance/cognitive test performance, respectively.

RESULTS

An algorithm using age and 16 ncRNAs predicted PPCS with greater accuracy than the validated clinical tool and demonstrated additive combined utility (area under the curve (AUC) 0.86; 95% CI 0.84-0.88). Initial balance and cognitive test performance did not differ between PPCS and non-PPCS groups (p > 0.05). Follow-up balance and cognitive test performance identified symptom recovery with similar accuracy to a model using 11 ncRNAs and age. A combined model (ncRNAs, balance, cognition) most accurately identified recovery (AUC 0.86; 95% CI 0.83-0.89).

CONCLUSIONS

ncRNA biomarkers show promise for tracking recovery from mTBI, and for predicting who will have prolonged symptoms. They could provide accurate expectations for recovery, stratify need for intervention, and guide safe return-to-activities.

Relationship between Standalone Performance Validity Test Failure and Emotionality among Youth/student Athletes Experiencing Prolonged Recovery following Sports-related Concussion

This study documented the rate of Performance Validity Testing (PVT) failure in 81 youth athletes, aged 10-21 years, experiencing prolonged recovery following sports-related concussion, and the relationship between PVT and emotional symptoms. Neuropsychological assessments were conducted across three test sessions with a stand-alone PVT at each session. Results showed that 48% (39/81) of individuals failed at least one PVT, with an overall PVT failure rate of 26% (64/243). Those failing at least one PVT scored significantly higher on anxiety but not depression or somatization. Results illustrate the importance of including measures of emotional and behavioral functioning in testing following SRC.

Diagnosing mild traumatic brain injury using saliva RNA compared to cognitive and balance testing

BACKGROUND

Early, accurate diagnosis of mild traumatic brain injury (mTBI) can improve clinical outcomes for patients, but mTBI remains difficult to diagnose because of reliance on subjective symptom reports. An objective biomarker could increase diagnostic accuracy and improve clinical outcomes. The aim of this study was to assess the ability of salivary noncoding RNA (ncRNA) to serve as a diagnostic adjunct to current clinical tools. We hypothesized that saliva ncRNA levels would demonstrate comparable accuracy for identifying mTBI as measures of symptom burden, neurocognition, and balance.

METHODS

This case-control study involved 538 individuals. Participants included 251 individuals with mTBI, enrolled ≤14 days postinjury, from 11 clinical sites. Saliva samples (n = 679) were collected at five time points (≤3, 4-7, 8-14, 15-30, and 31-60 days post-mTBI). Levels of ncRNAs (microRNAs, small nucleolar RNAs, and piwi-interacting RNAs) were quantified within each sample using RNA sequencing. The first sample from each mTBI participant was compared to saliva samples from 287 controls. Samples were divided into testing (n = 430; mTBI = 201 and control = 239) and training sets (n = 108; mTBI = 50 and control = 58). The test set was used to identify ncRNA diagnostic candidates and create a diagnostic model. Model accuracy was assessed in the naïve test set.

RESULTS

A model utilizing seven ncRNA ratios, along with participant age and chronic headache status, differentiated mTBI and control participants with a cross-validated area under the curve (AUC) of .857 in the training set (95% CI, .816-.903) and .823 in the naïve test set. In a subset of participants (n = 321; mTBI = 176 and control = 145) assessed for symptom burden (Post-Concussion Symptom Scale), as well as neurocognition and balance (ClearEdge System), these clinical measures yielded cross-validated AUC of .835 (95% CI, .782-.880) and .853 (95% CI, .803-.899), respectively. A model employing symptom burden and four neurocognitive measures identified mTBI participants with similar AUC (.888; CI, .845-.925) as symptom burden and four ncRNAs (.932; 95% CI, .890-.965).

CONCLUSION

Salivary ncRNA levels represent a noninvasive, biologic measure that can aid objective, accurate diagnosis of mTBI.

Assessment of Long-Term Effects of Sports-Related Concussions: Biological Mechanisms and Exosomal Biomarkers

Concussion or mild traumatic brain injury (mTBI) in athletes can cause persistent symptoms, known as post-concussion syndrome (PCS), and repeated injuries may increase the long-term risk for an athlete to develop neurodegenerative diseases such as chronic traumatic encephalopathy (CTE), and Alzheimer's disease (AD). The Center for Disease Control estimates that up to 3.8 million sport-related mTBI are reported each year in the United States. Despite the magnitude of the phenomenon, there is a current lack of comprehensive prognostic indicators and research has shown that available monitoring tools are moderately sensitive to short-term concussion effects but less sensitive to long-term consequences. The overall aim of this review is to discuss novel, quantitative, and objective measurements that can predict long-term outcomes following repeated sports-related mTBIs. The specific objectives were (1) to provide an overview of the current clinical and biomechanical tools available to health practitioners to ensure recovery after mTBIs, (2) to synthesize potential biological mechanisms in animal models underlying the long-term adverse consequences of mTBIs, (3) to discuss the possible link between repeated mTBI and neurodegenerative diseases, and (4) to discuss the current knowledge about fluid biomarkers for mTBIs with a focus on novel exosomal biomarkers. The conclusions from this review are that current post-concussion clinical tests are not sufficiently sensitive to injury and do not accurately quantify post-concussion alterations associated with repeated mTBIs. In the current review, it is proposed that current practices should be amended to include a repeated symptom inventory, a cognitive assessment of executive function and impulse control, an instrumented assessment of balance, vestibulo-ocular assessments, and an improved panel of blood or exosome biomarkers.

Prevalence of Invalid Performance on Baseline Testing for Sport-Related Concussion by Age and Validity Indicator

Importance

Estimated base rates of invalid performance on baseline testing (base rates of failure) for the management of sport-related concussion range from 6.1% to 40.0%, depending on the validity indicator used. The instability of this key measure represents a challenge in the clinical interpretation of test results that could undermine the utility of baseline testing.

Objectives

To determine the prevalence of invalid performance on baseline testing and to assess whether the prevalence varies as a function of age and validity indicator.

Design, Setting, and Participants

This retrospective, cross-sectional study included data collected between January 1, 2012, and December 31, 2016, from a clinical referral center in the Midwestern United States. Participants included 7897 consecutively tested, equivalently proportioned male and female athletes aged 10 to 21 years, who completed baseline neurocognitive testing for the purpose of concussion management.

Interventions

Baseline assessment was conducted with the Immediate Postconcussion Assessment and Cognitive Testing (ImPACT), a computerized neurocognitive test designed for assessment of concussion.

Main Outcomes and Measures

Base rates of failure on published ImPACT validity indicators were compared within and across age groups. Hypotheses were developed after data collection but prior to analyses.

Results

Of the 7897 study participants, 4086 (51.7%) were male, mean (SD) age was 14.71 (1.78) years, 7820 (99.0%) were primarily English speaking, and the mean (SD) educational level was 8.79 (1.68) years. The base rate of failure ranged from 6.4% to 47.6% across individual indicators. Most of the sample (55.7%) failed at least 1 of 4 validity indicators. The base rate of failure varied considerably across age groups (117 of 140 [83.6%] for those aged 10 years to 14 of 48 [29.2%] for those aged 21 years), representing a risk ratio of 2.86 (95% CI, 2.60-3.16; P < .001).

Conclusions and Relevance

The results for base rate of failure were surprisingly high overall and varied widely depending on the specific validity indicator and the age of the examinee. The strong age association, with 3 of 4 participants aged 10 to 12 years failing validity indicators, suggests that the clinical interpretation and utility of baseline testing in this age group is questionable. These findings underscore the need for close scrutiny of performance validity indicators on baseline testing across age groups.