Prevalence of invalid computerized baseline neurocognitive test results in high school and collegiate athletes

Prevalence of invalid ImPACT baseline test results among high school athletes with invalidity and sandbagging indices

Objective: The comparison of baseline neuropsychological test results with post-concussion neuropsychological test results is a common practice to assess the aftermath of a sport-related concussion. The effectiveness of this approach is compromised when invalid baseline test performances occur. The present study was designed to assess the prevalence of invalid baseline test results of high school athletes, using the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). Method: A large sample of 8938 high school athletes' baseline test data were examined, including the four ImPACT Composite scores and three sets of embedded invalid indices: five ImPACT Invalidity Indicators, four ImPACT sandbagging red flags, and two ImPACT sandbagging subtest flags. Results: There were 8394 (93.91%) Valid scorers, who failed no Invalidity Indicators; 544 (6.09%) Invalid scorers, who failed at least one Invalidity Indicator, 2718 (30.41%) Red Flag scorers, who had at least one Red Flag score; and 4154 (46.47%) Subtest Flag scorers, who had at least one Subtest Flag score. Of the entire sample, 4485 (54.65%) failed at least one of the invalid indices. Conclusions: As in prior studies of high school athletes, the Invalidity Indicators identified a low portion (6.09%) of the athletes with invalid baseline test results, while other invalidity measures found 30.41% to 46.48% of the athletes producing questionable test results. The high rate of invalid test findings suggested in this research calls for greater efforts to improve the accuracy of baseline test results.

Refinement of saliva microRNA biomarkers for sports-related concussion

BACKGROUND

Recognizing sport-related concussion (SRC) is challenging and relies heavily on subjective symptom reports. An objective, biological marker could improve recognition and understanding of SRC. There is emerging evidence that salivary micro-ribonucleic acids (miRNAs) may serve as biomarkers of concussion; however, it remains unclear whether concussion-related miRNAs are impacted by exercise. We sought to determine whether 40 miRNAs previously implicated in concussion pathophysiology were affected by participation in a variety of contact and non-contact sports. Our goal was to refine a miRNA-based tool capable of identifying athletes with SRC without the confounding effects of exercise.

METHODS

This case-control study harmonized data from concussed and non-concussed athletes recruited across 10 sites. Levels of salivary miRNAs within 455 samples from 314 individuals were measured with RNA sequencing. Within-subjects testing was used to identify and exclude miRNAs that changed with either (a) a single episode of exercise (166 samples from 83 individuals) or (b) season-long participation in contact sports (212 samples from 106 individuals). The miRNAs that were not impacted by exercise were interrogated for SRC diagnostic utility using logistic regression (172 samples from 75 concussed and 97 non-concussed individuals).

RESULTS

Two miRNAs (miR-532-5p and miR-182-5p) decreased (adjusted p < 0.05) after a single episode of exercise, and 1 miRNA (miR-4510) increased only after contact sports participation. Twenty-three miRNAs changed at the end of a contact sports season. Two of these miRNAs (miR-26b-3p and miR-29c-3p) were associated (R > 0.50; adjusted p < 0.05) with the number of head impacts sustained in a single football practice. Among the 15 miRNAs not confounded by exercise or season-long contact sports participation, 11 demonstrated a significant difference (adjusted p < 0.05) between concussed and non-concussed participants, and 6 displayed moderate ability (area under curve > 0.70) to identify concussion. A single ratio (miR-27a-5p/miR-30a-3p) displayed the highest accuracy (AUC = 0.810, sensitivity = 82.4%, specificity = 73.3%) for differentiating concussed and non-concussed participants. Accuracy did not differ between participants with SRC and non-SRC (z = 0.5, p = 0.60).

CONCLUSION

Salivary miRNA levels may accurately identify SRC when not confounded by exercise. Refinement of this approach in a large cohort of athletes could eventually lead to a non-invasive, sideline adjunct for SRC assessment.

An updated review of the prevalence of invalid performance on the Immediate Post-Concussion and Cognitive Testing (ImPACT)

Objective: Performance validity assessment is an important component of concussion baseline testing and Immediate Post-Concussion and Cognitive Testing (ImPACT) is the most commonly used test in this setting. A review of invalid performance on ImPACT was published in 2017, focusing largely on the default embedded validity indicator (Default EVI) provided within the test. There has since been a proliferation in research evaluating the classification accuracy of the Default EVI against independently developed, alternative ImPACT-based EVIs, necessitating an updated review. The purpose of this study was to provide an up-to-date review of the prevalence of invalid performance on ImPACT and to examine the relative effectiveness of ImPACT-based EVIs. Method: Literature related to the prevalence of invalid performance on ImPACT and the effectiveness of ImPACT-based EVIs, published between January 2000 and May 2020, was critically reviewed. Results: A total of 23 studies reported prevalence of invalid performance at baseline testing using ImPACT. Six percent of baseline assessments were found to be invalid by the ImPACT's Default EVI, and between 22.31% and 34.99% were flagged by alternative EVIs. Six studies assessed the effectiveness of ImPACT-based EVIs, with the Default EVI correctly identifying experimental malingerers only 60% of the time. Alternative ImPACT-based EVIs identified between 73% and 100% of experimental malingerers. Conclusions: The ImPACT's Default EVI is not sufficiently sensitive, and clinicians should consider alternative indicators when assessing invalid performance. Accordingly, the base rate of invalid performance in athletes at baseline testing is likely well above the 6% previously reported.

REFINEMENT OF SALIVA MI-RNA BIOMARKERS FOR SPORT-RELATED CONCUSSION

ABSTRACT Introduction: The changes in brain structure caused by a sports-related concussion may initially be indistinguishable, however, the irreversible deleterious effects are noted in the long term. An early diagnosis may provide the patient with a better recovery chance and increased survival. For this purpose, this paper studies the feasibility of a diagnosis for concussion by microRNA (mi-RNA) biomarkers contained in the saliva of athletes. Objective: Verify whether salivary miRNAs could be considered good biomarkers for sports concussion. Methodology: Salivary mi-RNA levels were determined from 120 saliva samples of 120 players. There were 43 with a diagnosis of concussion and 77 without a diagnosis of concussion. Samples from players with a concussion were collected 30 minutes prior to activity, samples from individuals who did not engage in physical activity were also compared. Results: On the evaluation of 30 miRNA from individuals with a concussion between contact and non-contact sports there was high detection reliability(P<.05). Both miR-532-5p and miR-182-5p showed reduced amounts of physical activity. The miRNA-532-5p and miRNA-182-5p show significant results among 43 subjects from pre-exercise to post-exercise. The miRNA-4510 showed a significant result (p < 0.05) between contact and non-contact sport types. The amount of miRNA-4510 expanded in 20 individuals in the contact sport at post-exercise but remained normal in the non-contact sports group. Conclusion: The salivary miRNAs are reliable biomarkers for concussion. Evidence Level II; Therapeutic Studies – Investigating the results.

Test-Retest Reliability of Remote ImPACT Administration

OBJECTIVE

To evaluate the performance and test-retest reliability obtained when administering a computerized baseline neurocognitive exam to NCAA Division I student-athletes in a controlled laboratory setting versus an uncontrolled remote location.

METHOD

A sample of 129 (female = 100) Division I student-athletes completed Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) pre-season assessments for two distinct and respective sports seasons in a controlled laboratory environment and an uncontrolled remote environment. Depending on the environment, participants were given verbal (controlled) or written (uncontrolled) guidelines for taking the test.

RESULTS

Multivariate repeated-measures ANOVA's determined that there were no within-subject differences between testing environments on ImPACT composite scores and cognitive efficiency index (CEI). The Chi-square test did not find any significant differences in impulse control or the number of invalid test scores, as determined by ImPACT, between environments. Intraclass correlations found the ImPACT subtest scores to range in test-retest reliability across testing environments, demonstrating moderate (verbal memory composite, r = 0.46; visual memory composite, r = 0.64; reaction time, r = 0.61; impulse control, r = 0.52; and CEI, r = 0.61) and good (visual motor composite, r = 0.77) test-retest reliability.

CONCLUSIONS

Results indicate that ImPACT is reliable between controlled and uncontrolled testing environments. This further suggests that ImPACT can be administered in a remote environment, pending specific adherence to testing instructions, or in the event of social distancing or isolation policies.

A Multivariable Analysis to Evaluate the Presence or Absence of Gender Differences in Baseline ImPACT Composite Scores and Symptom Severity Ratings in Student-Athletes Ages 12-18 Years

INTRODUCTION

Gender differences in neurocognitive function have been reported over the past few decades. However, multiple studies that report gender differences in Immediate Post-Concussion Assessment and Cognitive Tests composite scores ignore potential confounders which may lead to inaccurate results.

METHODS

A total of 4829 male and 2477 female baseline Immediate Post-Concussion Assessment and Cognitive Tests from 2009 to 2019 of subjects ages 12-18 years were used to evaluate gender differences in baseline neurocognitive scores and symptom severity ratings. Regression analyses were used to assess the effects of gender on neurocognitive performance at baseline while controlling for a number of potential confounders including symptom burden at the time of testing.

RESULTS

Differences in 3 of 5 composite scores as well as severity rating scores were maintained in multivariate analysis. Females had increased Post-Concussion Symptom Scale (β = 3.54, 95% confidence interval, 2.91 to 4.16, P < .0001) along with higher verbal memory (β = 1.82, 95% confidence interval, 1.15 to 2.50, P < .0001) and visual motor (β = 1.29, 95% confidence interval, 0.85-1.72, P < .0001) scores.

CONCLUSIONS

Statistically significant gender differences were found in baseline neurocognitive function. This study clarifies for the first time that gender differences in these neurocognitive domains are not simply an artifact of differences in symptom burden. However, the small effect sizes call into question the clinical relevance of these differences.

Concussion Baseline Retesting Is Necessary When Initial Scores Are Low

OBJECTIVE

To determine whether (1) initial baseline scores are significantly better for those who have valid (initial valid) versus invalid scores (initial invalid) on their concussion baseline testing, (2) retesting results in significantly improved baseline scores, and (3) there is a significant difference in scores between those who have valid scores on their initial attempt and those who retook baseline tests (retest valid).

DESIGN

Prospective, repeated-measures.

SETTING

Two years of collegiate preparticipation concussion baseline testing.

PARTICIPANTS

Five hundred forty-seven male and female Division I collegiate athletes (19.02 ± 1.31 years, female = 217).

INDEPENDENT VARIABLES

Participants were divided into initial valid and initial invalid. The retest group was further divided into their initial (initial invalid) and final valid attempt (retest valid).

MAIN OUTCOME MEASURES

Data were analyzed to determine the relationship between the 3 groups and overall initial and final scores on 28 individual items: total symptoms score, coordination, near-point convergence, CNS Vital Signs (CNSVS), Senaptec Sensory Station, and Neurocom Sensory Organization Test (SOT).

RESULTS

The initial valid group scored significantly better than the initial invalid group on 8 CNSVS items and 5 Senaptec items (P < 0.002). The retest valid scores were significantly better compared with the initial invalid scores on 17 items (P < 0.002).

CONCLUSIONS

Retesting is recommended for individuals who score below acceptable ranges. This is important because athletes may experience a learning effect and are highly motivated during postinjury testing, so accurate baseline scores are imperative for athlete safety. Completion time for the coordination test may be a more informative option.

Sports related concussion: an emerging era in digital sports technology

Sports-related concussion (SRC) is defined as a mild traumatic brain injury (mTBI) leading to complex impairment(s) in neurological function with many seemingly hidden or difficult to measure impairments that can deteriorate rapidly without any prior indication. Growing numbers of SRCs in professional and amateur contact sports have prompted closer dialog regarding player safety and welfare. Greater emphasis on awareness and education has improved SRC management, but also highlighted the difficulties of diagnosing SRC in a timely manner, particularly during matches or immediately after competition. Therefore, challenges exist in off-field assessment and return to play (RTP) protocols, with current traditional (subjective) approaches largely based on infrequent snapshot assessments. Low-cost digital technologies may provide more objective, integrated and personalized SRC assessment to better inform RTP protocols whilst also enhancing the efficiency and precision of healthcare assessment. To fully realize the potential of digital technologies in the diagnosis and management of SRC will require a significant paradigm shift in clinical practice and mindset. Here, we provide insights into SRC clinical assessment methods and the translational utility of digital approaches, with a focus on off-field digital techniques to detect key SRC metrics/biomarkers. We also provide insights and recommendations to the common benefits and challenges facing digital approaches as they aim to transition from novel technologies to an efficient, valid, reliable, and integrated clinical assessment tool for SRC. Finally, we highlight future opportunities that digital approaches have in SRC assessment and management including digital twinning and the "digital athlete".

Influence of Special Education, ADHD, Autism, and Learning Disorders on ImPACT Validity Scores in High School Athletes

OBJECTIVE

The Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) is commonly used to assist with post-concussion return-to-play decisions for athletes. Additional investigation is needed to determine whether embedded indicators used to determine the validity of scores are influenced by the presence of neurodevelopmental disorders (NDs).

METHOD

This study examined standard and novel ImPACT validity indicators in a large sample of high school athletes (n = 33,772) with or without self-reported ND.

RESULTS

Overall, 7.1% of athletes' baselines were judged invalid based on standard ImPACT validity criteria. When analyzed by group (healthy, ND), there were significantly more invalid ImPACT baselines for athletes with an ND diagnosis or special education history (between 9.7% and 54.3% for standard and novel embedded validity criteria) when compared to athletes without NDs. ND history was a significant predictor of invalid baseline performance above and beyond other demographic characteristics (i.e., age, sex, and sport), although it accounted for only a small percentage of variance. Multivariate base rates are presented stratified for age, sex, and ND.

CONCLUSIONS

These data provide evidence of higher than normal rates of invalid baselines in athletes who report ND (based on both the standard and novel embedded validity indicators). Although ND accounted for a small percentage of variance in the prediction of invalid performance, negative consequences (e.g., extended time out of sports) of incorrect decision-making should be considered for those with neurodevelopmental conditions. Also, reasons for the overall increase noted here, such as decreased motivation, "sandbagging", or disability-related cognitive deficit, require additional investigation.

Relationship between Standalone Performance Validity Test Failure and Emotionality among Youth/student Athletes Experiencing Prolonged Recovery following Sports-related Concussion

This study documented the rate of Performance Validity Testing (PVT) failure in 81 youth athletes, aged 10-21 years, experiencing prolonged recovery following sports-related concussion, and the relationship between PVT and emotional symptoms. Neuropsychological assessments were conducted across three test sessions with a stand-alone PVT at each session. Results showed that 48% (39/81) of individuals failed at least one PVT, with an overall PVT failure rate of 26% (64/243). Those failing at least one PVT scored significantly higher on anxiety but not depression or somatization. Results illustrate the importance of including measures of emotional and behavioral functioning in testing following SRC.

ImPACT Normative Data of Ethnically Diverse Adolescent Athletes

OBJECTIVE

The aim of this research was to develop preliminary norms for the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) administered to a large sample of adolescent athletes from diverse ethnic backgrounds.

DESIGN

A retrospective records review.

SETTING

Middle and high school athletic departments.

PARTICIPANTS

A total of 5741 male and female adolescent athletes in Hawaii, aged 13 to 18 years, in grades 9 to 12 were included in the study.

INDEPENDENT VARIABLES

Age, sex, ethnicity, and sport.

MAIN OUTCOME MEASURES

ImPACT Composite scores (Verbal Memory, Visual Memory, Visual Motor Speed, Reaction Time, and Impulse Control) and Total Symptom score from baseline testing.

RESULTS

The results indicated statistically significant differences between age and sex groups, as well as between ethnic and sport groups.

CONCLUSIONS

The findings support the continued use of stratified norms for age and sex for ethnically diverse adolescent athletes. Comparisons of ethnic and sport groups deserve further investigation. When baseline scores are not available for postconcussion comparison, present observations tentatively support the cautious use of standard ImPACT norms with ethnically diverse athletes.

Invalid Baseline Testing with ImPACT: Does Sandbagging Occur with High School Athletes?

The aim of this large-scale research was to determine the frequency of valid, invalid, and sandbagging results in ImPACT baseline testing of high school athletes. This retrospective study identified valid, invalid (identified by five embedded Invalidity Indicators), and sandbagging (identified by three "red flags") results in the ImPACT baseline test scores of 6,346 high school athletes. In addition, the ImPACT postconcussion scores of 266 athletes who sustained a concussion during the school year were evaluated to compare the baseline-to-postconcussion changes of valid versus a combined group of invalid and sandbagging scorers. There were 3,299 (51.99%) athletes who had valid baseline scores, 269 (4.24%) had invalid scores, and 3,009 (47.42%) had sandbagging scores. (There were 231 who obtained both invalidity and sandbagging scores.) The overall difference in baseline-to-postconcussion changes between the valid scorers and the combined group of invalid and sandbagging scorers was statistically significant. The high rate of athletes who had invalid and sandbagging scores raised concern that the underperformance of baseline testing occurs more commonly than is probably realized by those who utilize computerized neuropsychological testing with high school athletes. Accordingly, efforts are needed to improve test administration procedures so that maximal attention and effort can be maintained among the test takers. In the meantime, increased caution is called for in employing the baseline-to-postconcussion paradigm when return-to-play decisions are made.

Factors Contributing to Disparities in Baseline Neurocognitive Performance and Concussion Symptom Scores Between Black and White Collegiate Athletes

BACKGROUND

National Collegiate Athletic Association (NCAA) concussion guidelines state that all NCAA athletes must have a concussion baseline test prior to commencing their competitive season. To date, little research has examined potential racial differences on baseline neurocognitive performance among NCAA athletes. The purpose of this study was to investigate differences between Black and White collegiate athletes on baseline neurocognitive performance and self-reported symptoms.

METHODS

A total of 597 collegiate athletes (400 White, 197 Black) participated in this study. Athletes self-reported their race on the demographic section of their pre-participation physical examination and were administered the Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) neurocognitive battery in a supervised, quiet room. Controlling for sex, data were analyzed using separate one-way analyses of covariance (ANCOVAs) on symptom score, verbal and visual memory, visual motor processing speed, and reaction time composite scores.

RESULTS

Results revealed significant differences between White and Black athletes on baseline symptom score (F (1,542) = 5.82, p = .01), visual motor processing speed (F (1,542) = 14.89, p < .001), and reaction time (F (1,542) = 11.50, p < .01). White athletes performed better than Black athletes on baseline visual motor processing speed and reaction time. Black athletes reported higher baseline symptom scores compared to Whites. There was no statistical difference between race on verbal memory (p = .08) and that on visual memory (p = .06).

CONCLUSIONS

Black athletes demonstrated disparities on some neurocognitive measures at baseline. These results suggest capturing an individual baseline on each athlete, as normative data comparisons may be inappropriate for athletes of a racial minority.

Collegiate Student Athletes With History of ADHD or Academic Difficulties Are More Likely to Produce an Invalid Protocol on Baseline ImPACT Testing

OBJECTIVE

Attention deficit hyperactivity disorder (ADHD) and other academically-relevant diagnoses have been suggested as modifiers of neurocognitive testing in sport-related concussion, such as Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). These preexisting conditions may suppress ImPACT scores to the extent that they are indistinguishable from low scores because of poor effort. The present study hypothesized that student athletes with history of ADHD or academic difficulties produce lower ImPACT composite scores and are more likely to produce invalid protocols than those without such conditions.

DESIGN

Cross-sectional study.

SETTING

Midsized public university.

PARTICIPANTS

Nine hundred forty-nine National College Athletic Association athletes (average age = 19.2 years; 6.8% ADHD, 5.6% Academic Difficulties, 2.0% comorbid ADHD/Academic Difficulties).

INDEPENDENT VARIABLES

Three seasons of baseline ImPACT protocols were analyzed. Student athletes were grouped using self-reported histories of ADHD or academic difficulties taken from ImPACT demographic questions.

DEPENDENT VARIABLES

ImPACT composite scores and protocol validity.

RESULTS

Student athletes in the academic difficulties and comorbid groups performed worse on ImPACT composite scores (Pillai's Trace = 0.05), though this pattern did not emerge for those with ADHD. Student athletes with comorbid history were more likely to produce an invalid baseline (10.5% invalid) (χ (2) = 11.08, P = 0.004). Those with ADHD were also more likely to produce an invalid protocol (7.7% invalid, compared with 2.6% in student athletes with no history) (χ (2) = 10.70, P = 0.005).

CONCLUSIONS

These findings suggest that student athletes reporting comorbid histories or histories of academic difficulties alone produce lower ImPACT composite scores, and that those with comorbid histories or histories of ADHD alone produce invalid protocol warnings more frequently than student athletes without such histories. Future studies should further examine invalid score thresholds on the ImPACT, especially in student athletes with conditions that may influence test performance.

CLINICAL RELEVANCE

Student athletes with history of ADHD or academic difficulties may more frequently fall below validity score thresholds, suggesting caution in interpreting test performance.

Valid but Invalid: Suboptimal ImPACT Baseline Performance in University Athletes

PURPOSE

This study aimed to investigate the frequency of valid yet suboptimal Immediate Postconcussion Assessment and Cognitive Test (ImPACT) performance in university athletes and to explore the benefit of subsequent ImPACT administrations.

METHODS

This descriptive laboratory study involved baseline administration of ImPACT to 769 university athletes per the institution's concussion management protocol. Testing was proctored in groups of ≤2 participants. Participants who scored below the 16th percentile according to ImPACT normative data were readministered the ImPACT test up to two additional times because these scores were thought to be potentially indicative of suboptimal effort or poor understanding of instructions. Descriptive analyses were used to examine validity indicators and individual Verbal and Visual Memory, Visual Motor Speed, and Reaction Time ImPACT composite scores in initial and subsequent administrations.

RESULTS

On the basis of ImPACT's validity criteria, 1% (9/769) of administrations were invalid and 14.6% (112/769) had one or more composite score of <16th percentile but were considered valid. After one readministration, 71.4% (80/112) achieved scores of ≥16th percentile and an additional 18 of 32 scored ≥16th percentile after a third administration. Verbal Memory was most commonly <16th percentile on the first administration (43%), Verbal Memory and Visual Motor Speed on the second administration (44% each), and Visual Motor Speed alone on the third administration (50%).

CONCLUSIONS

Approximately 16% of ImPACT records were flagged as invalid or had one or more composite scores of <16th percentile, potentially indicative of suboptimal performance. Upon readministration, 88% of those participants scored >16th percentile. Clinicians must be aware of suboptimal ImPACT performance as it limits the clinical utility of the baseline assessment. Further research is needed to address factors leading to "valid" but invalid baseline performance.

Heart Rate Variability in Healthy Non-Concussed Youth Athletes: Exploring the Effect of Age, Sex, and Concussion-Like Symptoms

BACKGROUND

Heart rate variability (HRV) is a non-invasive neurophysiological measure of autonomic nervous system regulation emerging in concussion research. To date, most concussion studies have focused on the university-aged athlete with no research examining healthy active youths. Corroborating changes in HRV alongside traditional subjective self-report measures (concussion symptoms) in the non-concussed state provides a foundation for interpreting change following concussion. The objectives were to (1) explore the influence of age and sex on HRV and (2) examine the relationship between HRV and baseline/pre-injury concussion symptom domains (physical, cognitive, emotional, and fatigue) in healthy youth athletes.

METHOD

Healthy, youth athletes 13-18 years of age [N = 294, female = 166 (56.5%), male = 128 (43.5%)] participated in this cross-sectional study. Age, sex, and concussion-like symptoms were collected as part of a baseline/pre-injury assessment. The Post-Concussion Symptom Inventory-SR13 (PCSI-SR13) was used to collect domain scores for physical, cognitive, emotional, and fatigue symptoms. HRV was collected for 24 h. HRV measures included time (SDNN, RMSSD, and pNN50) and frequency (HF, HFnu, LF, LFnu, and total power) domain HRV measures. Variables were logarithmically transformed to increase robustness of linear regression models.

RESULTS

Older youth participants displayed significantly higher HRV compared to younger participants (p < 0.05). Females displayed significantly lower HRV compared to males (p < 0.05). A significant interaction effect between concussion-like symptoms and HRV indicated differential patterns as a function of sex (p < 0.05). Youth athletes who reported more cognitive symptoms had lower HRV (p < 0.05).

CONCLUSION

HRV was found to have a significant relationship with a traditional clinical measure (subjective self-report of concussion-like symptoms) utilized in concussion assessment and management. Baseline/pre-concussion trends in HRV were significantly associated with age and sex, highlighting the value in understanding key demographic factors within the context of concussion-like symptoms.

Sports-Related Concussion: Acute Management and Chronic Postconcussive Issues

Sports-related concussion (SRC) is a common problem in youth sports. Concussion may occur after a forceful hit to the body or head, resulting in transient neuropathological changes that spontaneously resolve with relative rest and activity modification in most patients. Most SRCs are effectively managed by primary care physicians and sports medicine specialists. In some cases, symptoms may persist and the child and adolescent psychiatrist may be consulted. This article reviews important background information regarding SRC and highlights a variety of pharmacologic and nonpharmacologic treatment options that consultant psychiatrists should know.

Increased Symptom Reporting in Young Athletes Based on History of Previous Concussions

Research documents increased symptoms in adolescents with a history of two or more concussions. This study examined baseline evaluations of 2,526 younger athletes, ages 10 to 14. Between-groups analyses examined Post Concussion Symptom Scale symptoms by concussion history group (None, One, Two+) and clusters of Physical, Cognitive, Emotional, and Sleep symptoms. Healthy younger athletes with a concussion history reported greater physical, emotional, and sleep-related symptoms than those with no history of concussion, with a greater endorsement in physical/sleep symptom clusters. Findings suggest younger athletes with a history of multiple concussions may experience residual symptoms.

Validity of the Immediate Post Concussion Assessment and Cognitive Testing (ImPACT)

BACKGROUND

The immediate post concussion assessment and cognitive testing (ImPACT) is the most widely used concussion assessment tool. Despite its popularity, it is unclear if validation studies for the ImPACT test covered all aspects of validity to support its widespread use in research and clinical practice.

OBJECTIVE

The purpose of this report is to review literature surrounding the validity and the utility of the ImPACT test.

DATA SOURCES AND APPRAISAL

A systematic review of relevant studies in PubMed, CINAHL, and PsycINFO was carried out. Studies were evaluated using the STROBE (strengthening the reporting of observational studies in epidemiology) or the STARD (standards for reporting of diagnostic accuracy) criteria.

RESULTS

The literature search yielded 5968 studies. Sixty-nine studies met the inclusion criteria and were included in the qualitative review. Although the convergent validity of ImPACT was supported, evidence of discriminant and predictive validity, diagnostic accuracy and responsiveness was inconclusive. The utility of the ImPACT test after acute symptom resolution was sparse. The review found many factors influenced the validity and utility of ImPACT scores.

CONCLUSION

Clinicians must consider the benefit of ImPACT testing for their patients on a case-by-case scenario and must take the psychometric properties of the test into account when interpreting results.

Comparison of baseline and post-concussion ImPACT test scores in young athletes with stimulant-treated and untreated ADHD

OBJECTIVES

Baseline and post-concussion neurocognitive testing is useful in managing concussed athletes. Attention deficit hyperactivity disorder (ADHD) and stimulant medications are recognized as potential modifiers of performance on neurocognitive testing by the Concussion in Sport Group. Our goal was to assess whether individuals with ADHD perform differently on post-concussion testing and if this difference is related to the use of stimulants.

METHODS

Retrospective case-control study in which 4373 athletes underwent baseline and post-concussion testing using the ImPACT battery. 277 athletes self-reported a history of ADHD, of which, 206 reported no stimulant treatment and 69 reported stimulant treatment. Each group was matched with participants reporting no history of ADHD or stimulant use on several biopsychosocial characteristics. Non-parametric tests were used to assess ImPACT composite score differences between groups.

RESULTS

Participants with ADHD had worse verbal memory, visual memory, visual motor speed, and reaction time scores than matched controls at baseline and post-concussion, all with p ≤ .001 and |r|≥ 0.100. Athletes without stimulant treatment had lower verbal memory, visual memory, visual motor speed, and reaction time scores than controls at baseline (p ≤ 0.01, |r|≥ 0.100 [except verbal memory, r = -0.088]) and post-concussion (p = 0.000, |r|> 0.100). Athletes with stimulant treatment had lower verbal memory (Baseline: p = 0.047, r = -0.108; Post-concussion: p = 0.023, r = -0.124) and visual memory scores (Baseline: p = 0.013, r = -0.134; Post-concussion: p = 0.003, r = -0.162) but equivalent visual motor speed and reaction time scores versus controls at baseline and post-concussion.

CONCLUSIONS

ADHD-specific baseline and post-concussion neuropsychological profiles, as well as stimulant medication status, may need to be considered when interpreting ImPACT test results. Further investigation into the effects of ADHD and stimulant use on recovery from sport-related concussion (SRC) is warranted.

Concussion Baseline Testing: Preexisting Factors, Symptoms, and Neurocognitive Performance

CONTEXT

Neurocognitive test scores are often considered an important aspect of concussion management. To best use these data, clinicians must understand potential factors that may influence baseline performance on these tests.

OBJECTIVE

To determine preexisting factors that may influence performance on the Immediate Post-Concussion Assessment and Cognitive Test (ImPACT).

DESIGN

Cross-sectional study.

SETTING

Research laboratory.

PATIENTS OR OTHER PARTICIPANTS

A total of 486 National Collegiate Athletic Association Division I collegiate student-athletes.

MAIN OUTCOME MEASURE(S)

To determine neurocognitive functioning and total symptom score at baseline, ImPACT was administered. Outcomes were verbal memory, visual memory, visual motor speed, reaction time, and total symptom score. A self-report demographic section at the beginning of ImPACT was used to gather information concerning previous treatment for headaches, migraines, and psychiatric conditions; diagnosis of attention-deficit/hyperactivity disorder; and exposure to previous strenuous exercise. We conducted multivariate analyses of variance to determine if the ImPACT composite and total symptom scores differed according to preexisting factors (P < .0083).

RESULTS

Sex showed an effect on verbal memory (P = .001), visual motor speed (P < .001), and reaction time (P = .006), with women performing better than men. A previous diagnosis of attention-deficit/hyperactivity disorder affected visual motor speed (P = .008). Previous treatment for headaches (P < .001), migraines (P = .001), a psychiatric condition (P < .001), or a diagnosis of attention-deficit/hyperactivity disorder (P < .001) all showed effects on the total symptom score. Strenuous exercise did not affect neurocogntive performance or total symptom score.

CONCLUSIONS

Based on our findings and the previous literature, we suggest that many preexisting factors influence baseline neurocognitive data. Baseline testing is an important aspect of concussion management. Sports medicine professionals should be cognizant of these factors when developing concussion-management protocols.

Baseline Neurocognitive Performance and Clearance for Athletes to Return to Contact

CONTEXT

 Computerized neurocognitive assessments are commonly used to manage sport-related concussion. Variations in baseline performance may influence neurocognitive performance after injury as well as the amount of time needed for an athlete to be cleared for return to sport participation.

OBJECTIVE

 To investigate the relationship between mean baseline Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) scores and postconcussion reliable decline as well as the association between postconcussion cognitive decline and days missed after injury.

DESIGN

 Cross-sectional study.

SETTING

 University concussion databank.

PATIENTS OR OTHER PARTICIPANTS

 A total of 84 collegiate athletes who sustained a concussion between 2008 and 2015 were studied. For each ImPACT composite score (verbal memory, visual memory, visual motor speed, reaction time), athletes were grouped based on the presence or absence of reliable decline and on the presence of reliable decline in 0, 1, 2, 3, or 4 cognitive domains.

MAIN OUTCOME MEASURE(S)

 Outcome measures were baseline ImPACT composite scores and days missed due to concussion.

RESULTS

 Athletes with a reliable decline in visual memory scored higher on baseline visual memory than did athletes with no decline or an improvement (t₈₂ = -2.348, P = .021, d = 0.65). When comparing athletes who displayed a reliable decline with those who showed no change or an improvement in any composite score, days missed did not differ. The number of composite scores with a reliable decline demonstrated no main effect on days missed (P = .530).

CONCLUSIONS

 Athletes who exhibited cognitive decline in most or all of the composite scores did not miss more days after injury than athletes with a decline in fewer or none of the composite scores. Athletes should be educated regarding the lack of association between baseline neurocognitive scores and the presence or absence of a reliable decline after concussion, as well as the fact that, on average, individuals with a reliable decline across multiple domains did not miss more time after concussion.

The influence of validity criteria on Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) test-retest reliability among high school athletes

OBJECTIVE

Research findings to date on the stability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) Composite scores have been inconsistent, requiring further investigation. The use of test validity criteria across these studies also has been inconsistent. Using multiple measures of stability, we examined test-retest reliability of repeated ImPACT baseline assessments in high school athletes across various validity criteria reported in previous studies.

METHOD

A total of 1146 high school athletes completed baseline cognitive testing using the online ImPACT test battery at two time periods of approximately two-year intervals. No participant sustained a concussion between assessments. Five forms of validity criteria used in previous test-retest studies were applied to the data, and differences in reliability were compared.

RESULTS

Intraclass correlation coefficients (ICCs) ranged in composite scores from .47 (95% confidence interval, CI [.38, .54]) to .83 (95% CI [.81, .85]) and showed little change across a two-year interval for all five sets of validity criteria. Regression based methods (RBMs) examining the test-retest stability demonstrated a lack of significant change in composite scores across the two-year interval for all forms of validity criteria, with no cases falling outside the expected range of 90% confidence intervals.

CONCLUSION

The application of more stringent validity criteria does not alter test-retest reliability, nor does it account for some of the variation observed across previously performed studies. As such, use of the ImPACT manual validity criteria should be utilized in the determination of test validity and in the individualized approach to concussion management. Potential future efforts to improve test-retest reliability are discussed.

Comparison of baseline-referenced versus norm-referenced analytical approaches for in-theatre assessment of mild traumatic brain injury neurocognitive impairment

PRIMARY OBJECTIVE

To examine differences between the baseline-referenced and norm-referenced approaches for determining decrements in Automated Neuropsychological Assessment Metrics Version 4 TBI-MIL (ANAM) performance following mild traumatic brain injury (mTBI).

RESEARCH DESIGN

ANAM data were reviewed for 616 US Service members, with 528 of this sample having experienced an mTBI and 88 were controls.

METHODS AND PROCEDURES

Post-injury change scores were calculated for each sub-test: (1) normative change score = in-theater score - normative mean and (2) baseline change score = in-theater score - pre-deployment baseline. Reliable change cut-scores were applied to the change and the resulting frequency distributions were compared using McNemar tests. Receiver operator curves (ROC) using both samples (i.e. mTBI and control) were calculated for the change scores for each approach to determine the discriminate ability of the ANAM.

MAIN OUTCOMES AND RESULTS

There were no statistical differences, p < 0.05 (Bonferonni-Holm corrected), between the approaches. When the area under the curve for the ROCs were averaged across sub-tests, there were no significant differences between either the norm-referenced (0.65) or baseline-referenced (0.66) approaches, p > 0.05.

CONCLUSIONS

Overall, the findings suggest there is no clear advantage of using the baseline-referenced approach over norm-referenced approach.

Rates and Predictors of Invalid Baseline Test Performance in High School and Collegiate Athletes for 3 Computerized Neurocognitive Tests: ANAM, Axon Sports, and ImPACT

BACKGROUND

Preseason baseline testing using computerized neurocognitive tests (CNTs) is increasingly performed on athletes. Adequate effort is critical to establish valid estimates of ability, but many users do not evaluate performance validity, and the conditions that affect validity are not well understood across the available CNTs.

PURPOSE

To examine the rates and predictors of invalid baseline performance for 3 popular CNTs: Automated Neuropsychological Assessment Metrics (ANAM), Axon Sports, and Immediate Post-Concussion and Cognitive Testing (ImPACT).

STUDY DESIGN

Controlled laboratory study.

METHODS

High school and collegiate athletes (N = 2063) completed 2 of 3 CNTs each during preseason evaluations. All possible pairings were present across the sample, and the order of administration was randomized. Examiners provided 1-on-1, scripted pretest instructions, emphasizing the importance of good effort. Profile validity was determined by the manufacturers' standard criteria.

RESULTS

The overall percentage of tests flagged as of questionable validity was lowest for ImPACT (2.7%) and higher for ANAM and Axon (10.7% and 11.3%, respectively). The majority of invalid baseline profiles were flagged as such because of failure on only 1 validity criterion. Several athlete and testing factors (eg, attention deficit hyperactivity disorder [ADHD], estimated general intellectual ability, administration order) predicted validity status for 1 or more CNTs. Considering only first CNT administrations and participants without ADHD and/or a learning disability (n = 1835) brought the rates of invalid baseline performances to 2.1%, 8.8%, and 7.0% for ImPACT, ANAM, and Axon, respectively. Invalid profiles on the Medical Symptom Validity Test (MSVT) were rare (1.8% of participants) and demonstrated poor correspondence to CNT validity outcomes.

CONCLUSION

The validity criteria for these CNTs may not identify the same causes of invalidity or be equally sensitive to effort. The validity indicators may not be equally appropriate for some athletes (eg, those with neurodevelopmental disorders).

CLINICAL RELEVANCE

The data suggest that athletes do not put forth widespread low effort or that some validity criteria are more sensitive to invalid performance than others. It is important for examiners to be aware of the conditions that maximize the quality of baseline assessments and to understand what sources of invalid performance are captured by the validity criteria that they obtain.

Supervision and computerized neurocognitive baseline test performance in high school athletes: an initial investigation

CONTEXT

Computerized neuropsychological testing batteries have provided a time-efficient and cost-efficient way to assess and manage the neurocognitive aspects of patients with sport-related concussion. These tests are straightforward and mostly self-guided, reducing the degree of clinician involvement required by traditional clinical neuropsychological paper-and-pencil tests.

OBJECTIVE

To determine if self-reported supervision status affected computerized neurocognitive baseline test performance in high school athletes.

DESIGN

Retrospective cohort study.

SETTINGS

Supervised testing took place in high school computer libraries or sports medicine clinics. Unsupervised testing took place at the participant's home or another location with computer access.

PATIENTS OR OTHER PARTICIPANTS

From 2007 to 2012, high school athletes across middle Tennessee (n = 3771) completed computerized neurocognitive baseline testing (Immediate Post-Concussion Assessment and Cognitive Testing [ImPACT]). They reported taking the test either supervised by a sports medicine professional or unsupervised. These athletes (n = 2140) were subjected to inclusion and exclusion criteria and then matched based on age, sex, and number of prior concussions.

MAIN OUTCOME MEASURE(S)

We extracted demographic and performance-based data from each de-identified baseline testing record. Paired t tests were performed between the self-reported supervised and unsupervised groups, comparing the following ImPACT baseline composite scores: verbal memory, visual memory, visual motor (processing) speed, reaction time, impulse control, and total symptom score. For differences that reached P < .05, the Cohen d was calculated to measure the effect size. Lastly, a χ(2) analysis was conducted to compare the rate of invalid baseline testing between the groups. All statistical tests were performed at the 95% confidence interval level.

RESULTS

Self-reported supervised athletes demonstrated better visual motor (processing) speed (P = .004; 95% confidence interval [0.28, 1.52]; d = 0.12) and faster reaction time (P < .001; 95% confidence interval [-0.026, -0.014]; d = 0.21) composite scores than self-reported unsupervised athletes.

CONCLUSIONS

Speed-based tasks were most affected by self-reported supervision status, although the effect sizes were relatively small. These data lend credence to the hypothesis that supervision status may be a factor in the evaluation of ImPACT baseline test scores.

Baseline SCAT2 Assessment of Healthy Youth Student-Athletes: Preliminary Evidence for the Use of the Child-SCAT3 in Children Younger Than 13 Years

OBJECTIVE

To compare baseline scores of middle and high school students on the Sport Concussion Assessment Tool 2 (SCAT2) by sex and age.

DESIGN

Cross-sectional study.

SETTING

Single private school athletic program.

PARTICIPANTS

Three hundred sixty-one middle and high school student-athletes.

INTERVENTION

Preseason SCAT2 was administered to student-athletes before athletic participation.

MAIN OUTCOME MEASURES

Total SCAT2 score, symptoms, symptom severity, Glasgow coma scale, modified Balance Error Scoring System (BESS), coordination, and Standardized Assessment of Concussion (SAC) with subsections: Orientation, Immediate Memory, Concentration, and Delayed Recall.

RESULTS

No differences were found in total SCAT2 scores between sex (P = 0.463) or age (P = 0.21). Differences were found in subcomponents of the SCAT2. Twelve year olds had significantly lower concentration scores (3.3 ± 1.2) than 15 and 18 year olds (3.9 ± 1.0 and 4.2 ± 1.0, respectively). The 12 year olds also had the lowest percentage of correct responses for the SAC's concentration 5-digit (46%), 6-digit (21%), and months' backward (67%) tasks. Females presented with more symptoms (20.0 ± 2.2 vs. 20.6 ± 2.1 P = 0.007) better immediate memory (14.6 ± 0.9 vs. 14.3 ± 1.0, P = 0.022) and better BESS scores (27.2 ± 2.3 vs. 26.6 ± 2.6, P = 0.043) than their male counterparts.

CONCLUSIONS

Normative values for total SCAT2 and subscale scores show differences in concentration between ages, whereas symptoms, BESS, and immediate memory differed between sexes. We also found that 12 year olds have increased difficultly with the advanced concentration tasks, which lends support to the development of a separate instrument, such as the Child-SCAT3. The presence of developmental differences in the younger age groups suggests the need for annual baseline testing.

CLINICAL RELEVANCE

Subtle differences between age and sex have been identified in many components of the SCAT2 assessment. These differences may support the current evolution of concussion assessment tools to provide the most appropriate test. Baseline testing should be used when available, and clinicians should be aware of potential differences when using normalized values.

Advanced topics in neuropsychological assessment following sport-related concussion

OBJECTIVE

This study examined seven topics relating to neuropsychological assessment following sport-related concussion: (i) traditional vs. computerized tests; (ii) the value of baseline, pre-season testing; (iii) invalid baseline scores and poor effort; (iv) when to assess following injury; (v) the reliability of neuropsychological tests; (vi) reliable change methodology; and (vii) new methods for identifying cognitive impairment.

MAIN RESULTS

Baseline testing can be helpful for quantifying cognitive deficits following injury and for assessing recovery. At present, however, there is insufficient evidence to conclude that having baseline test results is clearly superior to not having baseline test results. Although invalid baseline test performance can be detected in some athletes, validity indicators cannot determine the extent to which the results were due to deliberately poor performance, confusion or misunderstanding regarding some aspect of the test, distractions in group testing environments or some combination of factors. When interpreting baseline and post-injury data, sophisticated psychometric methods (e.g. reliable change, multivariate base rates) are available to assist with more accurate identification of cognitive impairment and the serial monitoring of recovery.

CONCLUSIONS

The value of neuropsychological assessment in the management of sport-related concussion has a strong empirical foundation. Additional research is needed, however, to refine its use.

Utility of repeated assessment after invalid baseline neurocognitive test performance

CONTEXT

Although the prevalence of invalid baseline neurocognitive testing has been documented, and repeated administration after obtaining invalid results is recommended, no empirical data are available on the utility of repeated assessment after obtaining invalid baseline results.

OBJECTIVE

To document the utility of readministering neurocognitive testing after an invalid baseline test.

DESIGN

Case series.

SETTING

Schools, colleges, and universities.

PATIENTS OR OTHER PARTICIPANTS

A total of 156 athletes who obtained invalid results on ImPACT baseline neurocognitive testing and were readministered the ImPACT baseline test within a 2-week period (mean = 4 days).

MAIN OUTCOME MEASURE(S)

Overall prevalence of invalid results on reassessment, specific invalidity indicators at initial and follow-up baseline, dependent-samples analysis of variance, with Bonferroni correction for multiple comparisons.

RESULTS

Reassessment resulted in valid test results for 87.2% of the sample. Poor performance on the design memory and three-letter subscales were the most common reasons for athletes obtaining an invalid baseline result, on both the initial assessment and the reassessment. Significant improvements were noted on all ImPACT composite scores except for reaction time on reassessment. Of note, 40% of athletes showed slower reaction time scores on reassessment, perhaps reflecting a more cautious approach taken the second time. Invalid results were more likely to be obtained by athletes with a self-reported history of attention-deficit disorder or learning disability on reassessments (35%) than on initial baseline assessments (10%).

CONCLUSIONS

Repeat assessment after the initial invalid baseline performance yielded valid results in nearly 90% of cases. Invalid results on a follow-up assessment may be influenced by a history of attention-deficit disorder or learning disability, the skills and abilities of the individual, or a particular test-taking approach; in these cases, a third assessment may not be useful.

Examination of the Test-Retest Reliability of a Computerized Neurocognitive Test Battery

BACKGROUND

Test-retest reliability is a critical issue in the utility of computer-based neurocognitive assessment paradigms employing baseline and postconcussion tests. Researchers have reported low test-retest reliability for the Immediate Post Concussion Assessment and Cognitive Testing (ImPACT) across an interval of 45 and 50 days.

PURPOSE

To re-examine the test-retest reliability of the ImPACT between baseline, 45 days, and 50 days.

STUDY DESIGN

Descriptive laboratory study.

METHODS

Eighty-five physically active college students (51 male, 34 female) volunteered for this study. Participants completed the ImPACT as well as a 15-item memory test at baseline, 45 days, and 50 days. Intraclass correlation coefficients (ICCs) were calculated for ImPACT composite scores, and change scores were calculated using reliable change indices (RCIs) and regression-based methods (RBMs) at 80% and 95% confidence intervals (CIs).

RESULTS

The respective ICCs for baseline to day 45, day 45 to day 50, baseline to day 50, and overall were as follows: verbal memory (0.76, 0.69, 0.65, and 0.78), visual memory (0.72, 0.66, 0.60, and 0.74), visual motor (processing) speed (0.87, 0.88, 0.85, and 0.91), and reaction time (0.67, 0.81, 0.71, and 0.80). All ICCs exceeded the threshold value of 0.60 for acceptable test-retest reliability. All cases fell well within the 80% CI for both the RCI and RBM, while 1% to 5% of cases fell outside the 95% CI for the RCI and 1% for the RBM.

CONCLUSION

Results suggest that the ImPACT is a reliable neurocognitive test battery at 45 and 50 days after the baseline assessment. The current findings agree with those of other reliability studies that have reported acceptable ICCs across 30-day to 1-year testing intervals, and they support the utility of the ImPACT for the multidisciplinary approach to concussion management.

CLINICAL RELEVANCE

This study suggests that the computerized neurocognitive test battery, ImPACT, is a reliable test for postconcussion serial assessments. However, when managing concussed athletes, the ImPACT should not be used as a stand-alone measure.

National Athletic Trainers' Association position statement: management of sport concussion

OBJECTIVE

To provide athletic trainers, physicians, and other health care professionals with best-practice guidelines for the management of sport-related concussions.

BACKGROUND

An estimated 3.8 million concussions occur each year in the United States as a result of sport and physical activity. Athletic trainers are commonly the first medical providers available onsite to identify and evaluate these injuries.

RECOMMENDATIONS

The recommendations for concussion management provided here are based on the most current research and divided into sections on education and prevention, documentation and legal aspects, evaluation and return to play, and other considerations.

Age and test setting affect the prevalence of invalid baseline scores on neurocognitive tests

BACKGROUND

Prevalence rates of invalid baseline scores on computerized neurocognitive assessments for high school, collegiate, and professional athletes have been published in the literature. At present, there is limited research on the prevalence of invalid baseline scores in pre-high school athletes.

HYPOTHESIS

Pre-high school athletes assessed with baseline neurocognitive tests would show higher prevalence rates of invalidity than older youth athletes, and those athletes, regardless of age, who were tested in a large group setting would show a higher prevalence rate of invalidity than athletes tested in a small group setting.

STUDY DESIGN

Cross-sectional study; Level of evidence, 3.

METHODS

A total of 502 athletes between the ages of 10 and 18 years completed preseason baseline neurocognitive tests in "large" or "small" groups. All athletes completed the online version of ImPACT (Immediate Post-Concussion Assessment and Cognitive Testing). Baseline test results that were "flagged" by the computer software as being of suspect validity and labeled with a "++" symbol were identified for analysis. Participants were retrospectively assigned to 2 independent groups: large group or small group. Test administration of the large group occurred off-site in groups of approximately 10 athletes, and test administration of the small group took place at a private-practice neuropsychology center with only 1 to 3 athletes present.

RESULTS

Chi-square analyses identified a significantly greater proportion of participants obtaining invalid baseline results on the basis of age; younger athletes produced significantly more invalid baseline scores (7.0%, 17/244) than older athletes (2.7%, 7/258) (χ2 (1) = 4.99; P = .021). Log-linear analysis revealed a significant age (10-12 years, 13-18 years) × size (small, large) interaction effect (χ2 (4) = 66.1; P < .001) on the prevalence of invalidity, whereby younger athletes tested in larger groups were significantly more likely to provide invalid results (11.9%) than younger athletes tested in smaller groups (5.4%), older athletes tested in larger groups (2.7%), and older athletes tested in smaller groups (2.7%).

CONCLUSION

Younger athletes tend to exhibit a greater prevalence of invalid baseline results on neurocognitive computerized tests than older youth athletes; the prevalence increases when testing is conducted in a large group and nonclinical setting.

Baseline neurocognitive testing in sports-related concussions: the importance of a prior night's sleep

BACKGROUND

The management of sports-related concussions (SRCs) utilizes serial neurocognitive assessments and self-reported symptom inventories to assess recovery and safety for return to play (RTP). Because postconcussive RTP goals include symptom resolution and a return to neurocognitive baseline levels, clinical decisions rest in part on understanding modifiers of this baseline. Several studies have reported age and sex to influence baseline neurocognitive performance, but few have assessed the potential effect of sleep. We chose to investigate the effect of reported sleep duration on baseline Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) performance and the number of patient-reported symptoms.

HYPOTHESIS

We hypothesized that athletes receiving less sleep before baseline testing would perform worse on neurocognitive metrics and report more symptoms.

STUDY DESIGN

Cross-sectional study; Level of evidence, 3.

METHODS

We retrospectively reviewed 3686 nonconcussed athletes (2371 male, 1315 female; 3305 high school, 381 college) with baseline symptom and ImPACT neurocognitive scores. Patients were stratified into 3 groups based on self-reported sleep duration the night before testing: (1) short, <7 hours; (2) intermediate, 7-9 hours; and (3) long, ≥9 hours. A multivariate analysis of covariance (MANCOVA) with an α level of .05 was used to assess the influence of sleep duration on baseline ImPACT performance. A univariate ANCOVA was performed to investigate the influence of sleep on total self-reported symptoms.

RESULTS

When controlling for age and sex as covariates, the MANCOVA revealed significant group differences on ImPACT reaction time, verbal memory, and visual memory scores but not visual-motor (processing) speed scores. An ANCOVA also revealed significant group differences in total reported symptoms. For baseline symptoms and ImPACT scores, subsequent pairwise comparisons revealed these associations to be most significant when comparing the short and intermediate sleep groups.

CONCLUSION

Our results indicate that athletes sleeping fewer than 7 hours before baseline testing perform worse on 3 of 4 ImPACT scores and report more symptoms. Because SRC management and RTP decisions hinge on the comparison with a reliable baseline evaluation, clinicians should consider sleep duration before baseline neurocognitive testing as a potential factor in the assessment of athletes' recovery.

Effect of sex on symptoms and return to baseline in sport-related concussion

OBJECT

Sport-related concussions (SRCs) among youth athletes represent a significant public health concern. Prior research suggests that females fare worse symptomatically after an SRC. The authors aimed to assess sex differences in number, severity, and resolution of postconcussive symptoms using reliable change index (RCI) methodology applied to days to return to symptom baseline.

METHODS

Between 2009 and 2011, 740 youth athletes completed valid neurocognitive and symptom testing before and after an SRC using Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). A total of 122 female and 122 male athletes were matched on number of prior concussions, age, and number of days to first postconcussion test. At baseline and postconcussion, the authors compared each of the individual 22 symptoms on ImPACT to calculate individual symptom severity and aggregate symptom severity, or the Total Symptom Score (TSS). When comparing individual symptoms, the significance level for the comparison of each symptom was set at 0.05/22 = 0.0023. When comparing aggregate symptom severity, or TSS, a single value was compared, requiring an alpha set to 0.05. The number of days to return to baseline TSS was compared using RCI methods set at the 80% confidence interval, equal to a raw score point value of 9.18 on the TSS.

RESULTS

At baseline, females reported a greater severity for the symptom, "sleeping less than usual," compared with males (0.88 ± 1.49 vs 0.31 ± 0.86, p < 0.001). However, no other individual symptom severity differences were noted before or after SRC. At baseline, females exhibited a statistically significant greater aggregate symptom severity than males (7.24 ± 10.22 vs 4.10 ± 6.52, p = 0.005). Greater aggregate symptom severity for females was also found postconcussion (21.38 ± 19.02 vs 16.80 ± 17.07, p = 0.049). Females took longer to return to baseline TSS (9.1 ± 7.1 days vs 7.0 ± 5.1 days, p = 0.013).

CONCLUSIONS

The results of this retrospective study indicate that females endorse a greater severity of symptoms at baseline and postconcussion than males without significantly different symptom profiles. Furthermore, after suffering an SRC, females take longer to return to their baseline symptom level.

Administration and environment considerations in computer-based sports-concussion assessment

Computer-based testing has become a vital tool for the assessment of sport-related concussion (SRC). An increasing number of papers have been published on this topic, focusing on subjects such as the purpose and validity of baseline testing, the performance of special populations on computer-based tests, the psychometric properties of different computerized neurocognitive tools, and considerations for valid and reliable administration of these tools. The current paper describes several considerations regarding computerized test design, input and output devices, and testing environment that should be described explicitly when administering computer-based cognitive testing, regardless of whether the assessment is used for clinical or research purposes. The paper also reviews the conclusions of recent literature (2007-2013) using computer-based testing for the assessment of SRC, with special attention to the methods used in these studies. We also present an appendix checklist for clinicians and researchers that may be helpful in ensuring proper attention to factors that could influence the reliability and validity of computer-based cognitive testing. We believe that explicit attention to these technological factors may lead to the development of standards for the development and implementation of computer-based tests. Such standards have the potential to enhance the accuracy and utility of computer-based tests in SRC.

Baseline neurocognitive scores in athletes with attention deficit-spectrum disorders and/or learning disability

OBJECT

Up to 16% of children in the US between the ages of 3 and 17 years have either attention deficit-spectrum disorder or a learning disability (LD). Sports-related concussions among youth athletes represent a significant public health concern, and neurocognitive testing is a method to evaluate the severity of cognitive impairment and recovery after a sports-related concussion. The goal of this study was to assess baseline neurocognitive differences between athletes with attention deficit hyperactivity disorder (ADHD) and/or LD versus those with neither disorder and to establish normative data for these special populations.

METHODS

Between August 2007 and March 2012, 6636 young athletes underwent baseline neurocognitive testing performed using the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) battery. Of these participants, 90 had self-reported LD only, 262 had self-reported ADHD only, and 55 reported both. Those with ADHD and/or LD were matched with 407 participants with no history of ADHD or LD by age, sex, and number of prior concussions. The mean scores and SDs were calculated for each group to obtain normative values. A pairwise comparison between each diagnostic group was done to assess whether LD and/or ADHD diagnostic status predicted participants' baseline neurocognitive scores.

RESULTS

Participants with ADHD had significantly lower verbal memory, visual memory, and visual motor processing speed scores, along with significantly higher reaction time, impulse control, and symptom scores compared with those without LD or ADHD. Participants with LD had similar results, with significantly lower verbal memory, visual memory, and visual motor processing speed scores, higher reaction time and symptom score, but did not differ in their impulse control score compared with those without LD or ADHD. Participants with both LD and ADHD had a significantly lower visual motor speed score and a significantly higher reaction time and symptom score than those without LD or ADHD, but did not differ with regard to the other composite scores.

CONCLUSIONS

Athletes with ADHD and/or LD have lower baseline ImPACT neurocognitive scores compared with athletes without ADHD and LD. Preliminary normative neurocognitive data for these special populations are provided.

Sensitivity and specificity of the online version of ImPACT in high school and collegiate athletes

BACKGROUND

The utility of postconcussion neurocognitive testing versus symptom data has been debated. The sensitivity of the desktop version of the Immediate Post-concussion assessment and cognitive testing (ImPACT) tool has been documented, but psychometric properties of the recently released online version of ImPACT have yet to be fully established.

PURPOSE

To document the sensitivity of the online ImPACT version in samples of (1) symptomatic concussed (high school and collegiate) athletes, and (2) asymptomatic concussed (high school and collegiate) athletes suspected of hiding their concussions.

STUDY DESIGN

Cohort study; level of evidence, 3.

METHODS

A total of 81 athletes observed to sustain a concussion by a certified athletic trainer or team physician, a finding that was confirmed with reported postconcussion symptoms, completed the ImPACT test within 3 days of injury. Data were compared with an independent sample of 81 athletes who completed preseason baseline cognitive assessments using ImPACT and who were matched (with concussed athletes) on the basis of sex, age, sport, concussion history, and absence of attention deficit hyperactivity disorder and learning disability. An independent group of 37 athletes who were also observed to sustain a concussion completed ImPACT within 3 days of injury. These athletes reported no postconcussion symptoms but were noted for suspected invalid response patterns on ImPACT (impulse control index >30 and verbal memory index <69%). The subscale data from the assessments (excluding those contributing to the aforementioned indices) were compared with a matched sample of 37 athletes who completed preseason baseline cognitive assessments in ImPACT (using the same criteria described above).

RESULTS

Data from the ImPACT online version yielded 91.4% sensitivity and 69.1% specificity. For asymptomatic athletes suspected of hiding their concussion, data from ImPACT yielded 94.6% sensitivity and 97.3% specificity.

CONCLUSION

The online version of the ImPACT tool is a valid measure of neurocognitive performance at the acute stages of concussion, with high levels of sensitivity and specificity, even when athletes appear to be denying postconcussion symptoms.