Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review

Athletic programs are more frequently turning to computerized cognitive tools in order to increase efficiencies in concussion assessment. However, assessment using a traditional neuropsychological test battery may provide a more comprehensive and individualized evaluation. Our goal was to inform sport clinicians of the best practices for concussion assessment through a systematic literature review describing the psychometric properties of standard neuropsychological tests and computerized tools. We conducted our search in relevant databases including Ovid Medline, Web of Science, PsycINFO, and Scopus. Journal articles were included if they evaluated psychometric properties (e.g., reliability, sensitivity) of a cognitive assessment within pure athlete samples (up to 30 days post-injury). Searches yielded 4,758 unique results. Ultimately, 103 articles met inclusion criteria, all of which focused on adolescent or young adult participants. Test-retest reliability estimates ranged from .14 to .93 for computerized tools and .02 to .95 for standard neuropsychological tests, with strongest correlations on processing speed tasks for both modalities, although processing speed tasks were most susceptible to practice effects. Reliability was improved with a 2-factor model (processing speed and memory) and by aggregating multiple baseline exams, yet remained below acceptable limits for some studies. Sensitivity to decreased cognitive performance within 72 h of injury ranged from 45%-93% for computerized tools and 18%-80% for standard neuropsychological test batteries. The method for classifying cognitive decline (normative comparison, reliable change indices, regression-based methods) affected sensitivity estimates. Combining computerized tools and standard neuropsychological tests with the strongest psychometric performance provides the greatest value in clinical assessment. To this end, future studies should evaluate the efficacy of hybrid test batteries comprised of top-performing measures from both modalities.

A multicenter, longitudinal survey of headaches and concussions among youth athletes in the United States from 2009 to 2019

OBJECTIVE/ BACKGROUND

Chronic headaches and sports-related concussions are among the most common neurological morbidities in adolescents and young adults. Given that the two can overlap in presentation, studying the effects of one on another has proven difficult. In this longitudinal study, we sought to assess the relationship between chronic headaches and concussions, analyzing the role of historic concussions on chronic headaches, as well as that of premorbid headaches on future concussion incidence, severity, and recovery.

METHODS

This multi-center, longitudinal cohort study followed 7,453 youth athletes who were administered demographic and clinical surveys as well as a total of 25,815 Immediate Post-concussion Assessment and Cognitive Testing (ImPACT) assessments between 2009 and 2019. ImPACT was administered at baseline. Throughout the season concussions were examined by physicians and athletic trainers, followed by re-administration of ImPACT post-injury (PI), and at follow-up (FU), a median of 7 days post-concussion. Concussion incidence was calculated as the total number of concussions per patient years. Concussion severity and recovery were calculated as standardized deviations from baseline to PI and then FU in Symptom Score and the four neurocognitive composite ImPACT scores: Verbal Memory, Visual Memory, Processing Speed, and Reaction Time. Data were collected prospectively in a well-organized electronic format supervised by a national research-oriented organization with rigorous quality assurance. Analysis was preformed retrospectively.

RESULTS

Of the eligible athletes, 1,147 reported chronic headaches (CH) at the start of the season and 6,306 reported no such history (NH). Median age of the cohort was 15.4 ± 1.6 years, and students were followed for an average of 1.3 ± 0.6 years. A history of concussions (OR 2.31, P < 0.0001) was associated with CH. Specifically, a greater number of past concussions (r2 = 0.95) as well as concussions characterized by a loss of consciousness (P < 0.0001) were associated with more severe headache burden. The CH cohort had a greater future incidence of concussion than the NH cohort (55.6 vs. 43.0 per 100 patient-years, P < 0.0001). However, multivariate analysis controlling for demographic, clinical, academic, and sports-related variables yielded no such effect (OR 0.99, P = 0.85). On multivariable analysis the CH cohort did have greater deviations from baseline to PI and FU in Symptom Score (PI OR per point 1.05, P = 0.01, FU OR per point 1.11, P = 0.04) and Processing Speed (OR per point 1.08, P = 0.04), suggesting greater concussion severity and impaired symptomatic recovery as compared to the NH cohort.

CONCLUSION

A history of concussions was a significant contributor to headache burden among American adolescents and young adults. However, those with chronic headaches were not more likely to be diagnosed with a concussion, despite presenting with more severe concussions that had protracted recovery. Our findings not only suggest the need for conservative management among youth athletes with chronic headaches, they also indicate a potential health care gap in this population, in that those with chronic headaches may be referred for concussion diagnosis and management at lower rates than those with no such comorbidity.

Effects of a history of headache and migraine treatment on baseline neurocognitive function in young athletes

Objective/background

Despite the prevalence of concussions in young athletes, the impact of headaches on neurocognitive function at baseline is poorly understood. We analyze the effects of a history of headache treatment on baseline ImPACT composite scores in young athletes.

Methods

A total of 11,563 baseline ImPACT tests taken by 7,453 student-athletes ages 12-22 between 2009 and 2019 were reviewed. The first baseline test was included. There were 960 subjects who reported a history of treatment for headache and/or migraine (HA) and 5,715 controls (CT). The HA cohort included all subjects who self-reported a history of treatment for migraine or other type of headache on the standardized questionnaire. Chi-squared tests were used to compare demographic differences. Univariate and multivariate regression analyses were used to assess differences in baseline composite scores between cohorts while controlling for demographic differences and symptom burden.

Results

Unadjusted analyses demonstrated that HA was associated with increased symptoms (β=2.30, 95% CI: 2.18-2.41, p<.0001), decreased visual memory (β=-1.35, 95% CI: -2.62 to -0.43, p=.004), and increased visual motor speed (β=0.71, 95% CI: 0.23-1.19, p=.004) composite scores. Baseline scores for verbal memory, reaction time, and impulse control were not significantly different between cohorts. Adjusted analyses demonstrated similar results with HA patients having greater symptom burden (β=1.40, 95% CI: 1.10-1.70, p<.0001), lower visual memory (β=-1.25, 95% CI: -2.22 to -0.27, p=.01), and enhanced visual motor speed (β=0.60, 95% CI: 0.11-1.10, p=.02) scores.

Conclusion

HA affected symptom, visual motor speed, and visual memory ImPACT composite scores. Visual memory scores and symptom burden were significantly worse in the HA group while visual motor speed scores were better, which may have been due to higher stimulant use in the HA group. The effects of HA on visual motor speed and visual memory scores were independent of the effects of the increased symptom burden.

Supplementary Information

The online version contains supplementary material available at 10.1186/s10194-022-01432-w.

Incidence and Severity of Concussions Among Young Soccer Players Based on Age, Sex, and Player Position

Background:

Previously studied risk factors for sports-related concussion in soccer players include sex, age, and player position. However, prior studies were limited in number, they reported conflicting results, and most did not assess initial concussion severity.

Purpose/Hypothesis:

The purpose of this study was to conduct an in-depth analysis of soccer players across key demographic groups (sex, age, position) for both concussion incidence and severity. It was hypothesized that concussion incidence and severity would be higher among male players, players aged ≥17 years, and goalkeepers.

Study Design:

Cohort study; Level of evidence, 3.

Methods:

The authors analyzed baseline and postinjury ImPACT (Immediate Post-Concussion Assessment and Cognitive Testing) scores for athletes aged 12 to 22 years between July 2009 and June 2019. Players were assigned to an age group based on when they had their most recent baseline test. Concussion incidence and concussion severity index were compared using t tests and multivariate logistic regression.

Results:

For 1189 individuals who reported soccer as their primary sport, 1032 contributed 1754 baseline ImPACT tests (some individuals had multiple baseline tests), whereas 445 individuals were suspected of sustaining a concussion and then referred for a postinjury 1 test. Of these players, 254 (24.6%) had both a baseline and a postinjury test and were analyzed for concussion severity. Linear regression showed that forwards had a lower incidence of ImPACT-proxied concussions than goalkeepers had (P = .008). Female players had a significantly higher incidence of ImPACT concussions compared with male players (mean, 0.07 [female] vs 0.04 [male] concussions per person-year; P = .05). Players in the ≥17-year age group had a higher incidence of ImPACT concussions than players in the 15- to 16-year age group (P = .04), although the 15- to 16-year age group had more severe concussions than the ≥17-year age group (mean severity index, 2.91 [age 15-16 years] vs 1.73 [age ≥17 years]; P = .001).

Conclusion:

Female soccer players experienced a higher incidence of concussion than did male players, and goalkeepers experienced a greater incidence of ImPACT concussions than did forwards. Players of both sexes and all positions in the 15- to 16-year age group showed increased initial concussion severity compared with the ≥17-year age group, despite a lower comparative incidence of ImPACT concussions. Further study is needed to understand whether sex and player position affect concussion severity.

Nonsteroidal anti-inflammatory drug use and concussions in adolescent athletes: incidence, severity, and recovery

OBJECTIVE

Given concerns about the potential long-term effects of concussion in young athletes, concussion prevention has become a major focus for amateur sports leagues. Athletes have been known to frequently use anti-inflammatory medications to manage injuries, expedite return to play, and treat concussion symptoms. However, the effects of baseline nonsteroidal anti-inflammatory drug (NSAID) use on the susceptibility to head injury and concussion remain unclear. This study aims to assess the effects of preinjury NSAID use on concussion incidence, severity, and recovery in young athletes.

METHODS

Data from 25,815 ImPACT (Immediate Post-Concussion Assessment and Cognitive Testing) tests were obtained through a research agreement with ImPACT Applications Inc. Subjects ranged in age from 12 to 22 years old. Those who reported NSAID use at baseline were assigned to one (anti-inflammatory [AI]) cohort, whereas all others were assigned to the control (CT) cohort. Differences in head trauma and concussion incidence, severity, and recovery were assessed using chi-square tests, unpaired t-tests, and Kaplan-Meier plots.

RESULTS

The CT cohort comprised a higher percentage (p < 0.0001) of males (66.30%) than the AI cohort (44.16%) and had a significantly greater portion of athletes who played football (p = 0.004). However, no statistically significant differences were found between the two cohorts in terms of the incidence of head trauma (CT = 0.489, AI = 0.500, p = 0.9219), concussion incidence (CT = 0.175, AI = 0.169, p = 0.7201), injury severity, or median concussion recovery time (CT = 8, AI = 8, p = 0.6416). In a multivariable analysis controlling for baseline differences between the cohorts, no association was found between NSAID use and concussion incidence or severity.

CONCLUSIONS

In this analysis, the authors found no evidence that preinjury use of NSAIDs affects concussion risk in adolescent athletes. They also found no indication that preinjury NSAID use affects the severity of initial injury presentation or concussion recovery.

Sex-Related Differences in the Incidence, Severity, and Recovery of Concussion in Adolescent Student-Athletes Between 2009 and 2019

BACKGROUND

The sex of an athlete is thought to modulate concussion incidence; however, the effects of sex on concussion severity and recovery are less clear.

PURPOSE

To evaluate sex differences in concussion severity and recovery using a large, heterogeneous sample of young student-athletes with the goal of understanding how sex affects concussion outcomes in young athletes.

STUDY DESIGN

Cohort study; Level of evidence, 3.

METHODS

The Immediate Post-Concussion Assessment and Cognitive Testing results of 11,563 baseline and 5216 postinjury tests were used to calculate the incidence of concussion of adolescent male and female student-athletes ages 12 to 22 years (median, 15 years). The postinjury tests of 3465 male and 1751 female student-athletes evaluated for concussion or head trauma were used to assess differences in the Severity Index (SI) and recovery. Chi-square tests and t tests were used to compare differences in demographic characteristics, incidence, and SI between the 2 cohorts. Multivariable linear, logistic, and Cox proportional hazards regressions were used to control for differences between cohorts in analyses of incidence, SI, and recovery.

RESULTS

When we controlled for demographic differences, female participants had higher odds of concussion (odds ratio, 1.62; 95% CI, 1.40-1.86; P < .0001) and higher SI after concussion (β = 0.67; 95% CI, 0.02-1.32; P = .04). This discrepancy in SI was a result of differences in Symptom (2.40 vs 2.94; P < .0001) and Processing Speed (0.91 vs 1.06; P = .01) composite scores between male and female participants, respectively. We found no effect of sex on time to recovery when controlling for initial concussion SI (hazard ratio, 0.94; 95% CI, 0.78-1.12; P = .48).

CONCLUSION

Using large, multisport cohorts, this study provides evidence that female athletes are at higher risk for more concussions and these concussions are more severe, but male and female athletes have similar recovery times when the analysis controls for initial concussion SI.

Sport Contact Level Affects Post-Concussion Neurocognitive Performance in Young Athletes

OBJECTIVE

Contact level affects the incidence of sports-related concussion. However, the effects of contact level on injury severity and recovery are less clear and are the focus of this study.

METHOD

Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) for athletes aged 12-22 was performed at baseline (n = 10,907 for 7,058 athletes), after suspected concussion determined by physicians or athletic trainers (n = 5,062 for 4,419 athletes), and during follow-up visits (n = 3,264 for 2,098 athletes). Athletes played contact/collision (CC), limited contact (LC), and noncontact (NC) sports. Injury incidence, severity, and recovery were measured using raw and change from baseline neurocognitive test scores. Comparisons between groups used univariate analysis and multivariable regression controlling for demographic variables.

RESULTS

Compared to CC athletes, LC and NC athletes showed decreased suspected concussion incidence. At initial post-injury testing, all neurocognitive test scores were similar between groups except changes from baseline for processing speed were improved for LC compared to CC athletes. Upon follow-up testing, raw neurocognitive scores were better for NC compared to the contact collision athletes in verbal memory, processing speed, total symptom score, migraine cluster, cognitive cluster, and neuropsychiatric cluster scores. For change from baseline scores, LC athletes exhibited better performance on verbal memory, processing speed, and reaction time but also showed higher neuropsychiatric scores than CC athletes.

CONCLUSION

Neurocognitive scores between contact levels were similar at the first post-injury test. However, follow up showed many improved scores and symptoms for limited and NC sports compared to CC sports, which may indicate faster recovery.

Baseline preseason ImPACT® testing in Mandarin with adolescent student-athletes in the United States

Researchers have examined differences on ImPACT^® in baseline symptom reporting and neurocognitive performances based on the language of administration and racial/ethnic identity. This is the first study to examine differences between student-athletes tested in Mandarin versus English on ImPACT^® during preseason baseline assessments conducted in high schools in the United States. Participants included 252 adolescent student-athletes who completed ImPACT^® testing in the state of Maine in Mandarin and 252 participants who completed testing in English, matched on age, gender, and health and academic history. Participants were compared on neurocognitive composite scores and symptom ratings. Boys tested in Mandarin, but not girls, had modestly better neurocognitive performance on one of four composite scores (i.e., Visual Motor Speed, p < .001, d = .45). Although language groups did not differ in total symptom severity, boys tested in Mandarin endorsed multiple physical symptoms at higher rates than boys tested in English. These results suggest that the current ImPACT^® neurocognitive normative data are reasonably appropriate for use with adolescents evaluated in Mandarin. There were some differences in the reporting of physical symptoms, with greater rates of symptom endorsement by boys tested in Mandarin than boys tested in English; but overall symptom severity ratings were comparable between the language groups.