1
|
Tsushima WT, Lawton DRY, Kimata C, Siu AM. Prevalence of invalid ImPACT baseline test results among high school athletes with invalidity and sandbagging indices. Clin Neuropsychol 2023; 37:1516-1529. [PMID: 36458597 DOI: 10.1080/13854046.2022.2148282] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Accepted: 11/11/2022] [Indexed: 12/03/2022]
Abstract
Objective: The comparison of baseline neuropsychological test results with post-concussion neuropsychological test results is a common practice to assess the aftermath of a sport-related concussion. The effectiveness of this approach is compromised when invalid baseline test performances occur. The present study was designed to assess the prevalence of invalid baseline test results of high school athletes, using the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). Method: A large sample of 8938 high school athletes' baseline test data were examined, including the four ImPACT Composite scores and three sets of embedded invalid indices: five ImPACT Invalidity Indicators, four ImPACT sandbagging red flags, and two ImPACT sandbagging subtest flags. Results: There were 8394 (93.91%) Valid scorers, who failed no Invalidity Indicators; 544 (6.09%) Invalid scorers, who failed at least one Invalidity Indicator, 2718 (30.41%) Red Flag scorers, who had at least one Red Flag score; and 4154 (46.47%) Subtest Flag scorers, who had at least one Subtest Flag score. Of the entire sample, 4485 (54.65%) failed at least one of the invalid indices. Conclusions: As in prior studies of high school athletes, the Invalidity Indicators identified a low portion (6.09%) of the athletes with invalid baseline test results, while other invalidity measures found 30.41% to 46.48% of the athletes producing questionable test results. The high rate of invalid test findings suggested in this research calls for greater efforts to improve the accuracy of baseline test results.
Collapse
Affiliation(s)
- William T Tsushima
- Psychiatry and Psychology Department, Straub Medical Center, Honolulu, HI, USA
| | - Dylan R Y Lawton
- Department of Biology, Santa Clara University, Santa Clara, CA, USA
| | - Chieko Kimata
- Research Institute, Hawaii Pacific Health, Honolulu, HI, USA
| | - Andrea M Siu
- Research Institute, Hawaii Pacific Health, Honolulu, HI, USA
| |
Collapse
|
2
|
Hicks SD, Onks C, Kim RY, Zhen KJ, Loeffert J, Loeffert AC, Olympia RP, Fedorchak G, DeVita S, Gagnon Z, McLoughlin C, Madeira MM, Zuckerman SL, Lee T, Heller M, Monteith C, Campbell TR, Neville C, Fengler E, Dretsch MN. Refinement of saliva microRNA biomarkers for sports-related concussion. JOURNAL OF SPORT AND HEALTH SCIENCE 2023; 12:369-378. [PMID: 34461327 DOI: 10.1016/j.jshs.2021.08.003] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Revised: 05/29/2021] [Accepted: 07/13/2021] [Indexed: 05/17/2023]
Abstract
BACKGROUND Recognizing sport-related concussion (SRC) is challenging and relies heavily on subjective symptom reports. An objective, biological marker could improve recognition and understanding of SRC. There is emerging evidence that salivary micro-ribonucleic acids (miRNAs) may serve as biomarkers of concussion; however, it remains unclear whether concussion-related miRNAs are impacted by exercise. We sought to determine whether 40 miRNAs previously implicated in concussion pathophysiology were affected by participation in a variety of contact and non-contact sports. Our goal was to refine a miRNA-based tool capable of identifying athletes with SRC without the confounding effects of exercise. METHODS This case-control study harmonized data from concussed and non-concussed athletes recruited across 10 sites. Levels of salivary miRNAs within 455 samples from 314 individuals were measured with RNA sequencing. Within-subjects testing was used to identify and exclude miRNAs that changed with either (a) a single episode of exercise (166 samples from 83 individuals) or (b) season-long participation in contact sports (212 samples from 106 individuals). The miRNAs that were not impacted by exercise were interrogated for SRC diagnostic utility using logistic regression (172 samples from 75 concussed and 97 non-concussed individuals). RESULTS Two miRNAs (miR-532-5p and miR-182-5p) decreased (adjusted p < 0.05) after a single episode of exercise, and 1 miRNA (miR-4510) increased only after contact sports participation. Twenty-three miRNAs changed at the end of a contact sports season. Two of these miRNAs (miR-26b-3p and miR-29c-3p) were associated (R > 0.50; adjusted p < 0.05) with the number of head impacts sustained in a single football practice. Among the 15 miRNAs not confounded by exercise or season-long contact sports participation, 11 demonstrated a significant difference (adjusted p < 0.05) between concussed and non-concussed participants, and 6 displayed moderate ability (area under curve > 0.70) to identify concussion. A single ratio (miR-27a-5p/miR-30a-3p) displayed the highest accuracy (AUC = 0.810, sensitivity = 82.4%, specificity = 73.3%) for differentiating concussed and non-concussed participants. Accuracy did not differ between participants with SRC and non-SRC (z = 0.5, p = 0.60). CONCLUSION Salivary miRNA levels may accurately identify SRC when not confounded by exercise. Refinement of this approach in a large cohort of athletes could eventually lead to a non-invasive, sideline adjunct for SRC assessment.
Collapse
Affiliation(s)
- Steven D Hicks
- Department of Pediatrics, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA.
| | - Cayce Onks
- Department of Orthopaedics and Rehabilitation, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA; Department of Family Medicine, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA
| | - Raymond Y Kim
- Department of Orthopaedics and Rehabilitation, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA
| | - Kevin J Zhen
- Department of Pediatrics, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA
| | - Jayson Loeffert
- Department of Orthopaedics and Rehabilitation, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA; Department of Family Medicine, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA
| | - Andrea C Loeffert
- Department of Pediatrics, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA
| | - Robert P Olympia
- Department of Emergency Medicine, College of Medicine, Pennsylvania State University, Hershey, PA 17033, USA
| | - Gregory Fedorchak
- Department of Research and Development, Quadrant Biosciences Inc., Syracuse, NY 13210, USA
| | - Samantha DeVita
- Department of Research and Development, Quadrant Biosciences Inc., Syracuse, NY 13210, USA
| | - Zofia Gagnon
- Department of Biology, Marist College, Poughkeepsie, NY 12601, USA
| | | | - Miguel M Madeira
- Department of Biology, Marist College, Poughkeepsie, NY 12601, USA
| | - Scott L Zuckerman
- Sports Concussion Center, College of Medicine, Vanderbilt University, Nashville, TN 37212, USA
| | - Timothy Lee
- Sports Concussion Center, College of Medicine, Vanderbilt University, Nashville, TN 37212, USA
| | - Matthew Heller
- Department of Family Medicine, College of Osteopathic Medicine, New York Institute of Technology, Old Westbury, NY 11568, USA
| | - Chuck Monteith
- Department of Athletic Training, Colgate University, Hamilton, NY 13346, USA
| | - Thomas R Campbell
- Department of Rehabilitation Sciences, Old Dominion University, Norfolk, VA 23529, USA
| | - Christopher Neville
- Department of Physical Therapy Education, Orthopedics, and Neuroscience, College of Medicine, SUNY Upstate Medical University, Syracuse, NY 13210, USA
| | - Elise Fengler
- Department of Exercise Science, Syracuse University, Syracuse, NY 13210, USA
| | - Michael N Dretsch
- Department of Medical Research-West, Walter Reed Army Institute of Research, US Army Joint Base Lewis-McChord, Hillhurst, WA 98433, USA
| |
Collapse
|
3
|
Messa I, Korcsog K, Abeare C. An updated review of the prevalence of invalid performance on the Immediate Post-Concussion and Cognitive Testing (ImPACT). Clin Neuropsychol 2022; 36:1613-1636. [PMID: 33356881 DOI: 10.1080/13854046.2020.1866676] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Objective: Performance validity assessment is an important component of concussion baseline testing and Immediate Post-Concussion and Cognitive Testing (ImPACT) is the most commonly used test in this setting. A review of invalid performance on ImPACT was published in 2017, focusing largely on the default embedded validity indicator (Default EVI) provided within the test. There has since been a proliferation in research evaluating the classification accuracy of the Default EVI against independently developed, alternative ImPACT-based EVIs, necessitating an updated review. The purpose of this study was to provide an up-to-date review of the prevalence of invalid performance on ImPACT and to examine the relative effectiveness of ImPACT-based EVIs. Method: Literature related to the prevalence of invalid performance on ImPACT and the effectiveness of ImPACT-based EVIs, published between January 2000 and May 2020, was critically reviewed. Results: A total of 23 studies reported prevalence of invalid performance at baseline testing using ImPACT. Six percent of baseline assessments were found to be invalid by the ImPACT's Default EVI, and between 22.31% and 34.99% were flagged by alternative EVIs. Six studies assessed the effectiveness of ImPACT-based EVIs, with the Default EVI correctly identifying experimental malingerers only 60% of the time. Alternative ImPACT-based EVIs identified between 73% and 100% of experimental malingerers. Conclusions: The ImPACT's Default EVI is not sufficiently sensitive, and clinicians should consider alternative indicators when assessing invalid performance. Accordingly, the base rate of invalid performance in athletes at baseline testing is likely well above the 6% previously reported.
Collapse
Affiliation(s)
- Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, Canada
| | | | | |
Collapse
|
4
|
Gu C, He G, Lin C. REFINEMENT OF SALIVA MI-RNA BIOMARKERS FOR SPORT-RELATED CONCUSSION. REV BRAS MED ESPORTE 2022. [DOI: 10.1590/1517-8692202228052022_126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
ABSTRACT Introduction: The changes in brain structure caused by a sports-related concussion may initially be indistinguishable, however, the irreversible deleterious effects are noted in the long term. An early diagnosis may provide the patient with a better recovery chance and increased survival. For this purpose, this paper studies the feasibility of a diagnosis for concussion by microRNA (mi-RNA) biomarkers contained in the saliva of athletes. Objective: Verify whether salivary miRNAs could be considered good biomarkers for sports concussion. Methodology: Salivary mi-RNA levels were determined from 120 saliva samples of 120 players. There were 43 with a diagnosis of concussion and 77 without a diagnosis of concussion. Samples from players with a concussion were collected 30 minutes prior to activity, samples from individuals who did not engage in physical activity were also compared. Results: On the evaluation of 30 miRNA from individuals with a concussion between contact and non-contact sports there was high detection reliability(P<.05). Both miR-532-5p and miR-182-5p showed reduced amounts of physical activity. The miRNA-532-5p and miRNA-182-5p show significant results among 43 subjects from pre-exercise to post-exercise. The miRNA-4510 showed a significant result (p < 0.05) between contact and non-contact sport types. The amount of miRNA-4510 expanded in 20 individuals in the contact sport at post-exercise but remained normal in the non-contact sports group. Conclusion: The salivary miRNAs are reliable biomarkers for concussion. Evidence Level II; Therapeutic Studies – Investigating the results.
Collapse
Affiliation(s)
- Cuifeng Gu
- Hebei University of Economics and Business, China
| | - Guojian He
- Hebei University of Economics and Business, China
| | | |
Collapse
|
5
|
Netzel L, Moran R, Hopfe D, Salvatore AP, Brown W, Murray NG. Test-Retest Reliability of Remote ImPACT Administration. ARCHIVES OF CLINICAL NEUROPSYCHOLOGY : THE OFFICIAL JOURNAL OF THE NATIONAL ACADEMY OF NEUROPSYCHOLOGISTS 2022; 37:449-456. [PMID: 34272867 DOI: 10.1093/arclin/acab055] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Revised: 03/19/2021] [Accepted: 06/22/2021] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To evaluate the performance and test-retest reliability obtained when administering a computerized baseline neurocognitive exam to NCAA Division I student-athletes in a controlled laboratory setting versus an uncontrolled remote location. METHOD A sample of 129 (female = 100) Division I student-athletes completed Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) pre-season assessments for two distinct and respective sports seasons in a controlled laboratory environment and an uncontrolled remote environment. Depending on the environment, participants were given verbal (controlled) or written (uncontrolled) guidelines for taking the test. RESULTS Multivariate repeated-measures ANOVA's determined that there were no within-subject differences between testing environments on ImPACT composite scores and cognitive efficiency index (CEI). The Chi-square test did not find any significant differences in impulse control or the number of invalid test scores, as determined by ImPACT, between environments. Intraclass correlations found the ImPACT subtest scores to range in test-retest reliability across testing environments, demonstrating moderate (verbal memory composite, r = 0.46; visual memory composite, r = 0.64; reaction time, r = 0.61; impulse control, r = 0.52; and CEI, r = 0.61) and good (visual motor composite, r = 0.77) test-retest reliability. CONCLUSIONS Results indicate that ImPACT is reliable between controlled and uncontrolled testing environments. This further suggests that ImPACT can be administered in a remote environment, pending specific adherence to testing instructions, or in the event of social distancing or isolation policies.
Collapse
Affiliation(s)
- Lauren Netzel
- Neuromechanics Laboratory, School of Community Health Sciences, University of Nevada, Reno, Nevada, 89557, USA
| | - Ryan Moran
- Athletic Training Research Laboratory, College of Human Environmental Sciences, The University of Alabama, Tuscaloosa, Alabama, 35487, USA
| | - Dustin Hopfe
- Neuromechanics Laboratory, School of Community Health Sciences, University of Nevada, Reno, Nevada, 89557, USA
| | - Anthony P Salvatore
- Department of Communicative Disorders, The University of Louisiana, Lafayette, Louisiana, 70504, USA
| | - Warren Brown
- Department of Communicative Disorders, The University of Louisiana, Lafayette, Louisiana, 70504, USA
| | - Nicholas G Murray
- Neuromechanics Laboratory, School of Community Health Sciences, University of Nevada, Reno, Nevada, 89557, USA
| |
Collapse
|
6
|
A Multivariable Analysis to Evaluate the Presence or Absence of Gender Differences in Baseline ImPACT Composite Scores and Symptom Severity Ratings in Student-Athletes Ages 12-18 Years. Pediatr Exerc Sci 2022; 34:36-43. [PMID: 34517341 DOI: 10.1123/pes.2021-0010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 06/27/2021] [Accepted: 07/11/2021] [Indexed: 11/18/2022]
Abstract
INTRODUCTION Gender differences in neurocognitive function have been reported over the past few decades. However, multiple studies that report gender differences in Immediate Post-Concussion Assessment and Cognitive Tests composite scores ignore potential confounders which may lead to inaccurate results. METHODS A total of 4829 male and 2477 female baseline Immediate Post-Concussion Assessment and Cognitive Tests from 2009 to 2019 of subjects ages 12-18 years were used to evaluate gender differences in baseline neurocognitive scores and symptom severity ratings. Regression analyses were used to assess the effects of gender on neurocognitive performance at baseline while controlling for a number of potential confounders including symptom burden at the time of testing. RESULTS Differences in 3 of 5 composite scores as well as severity rating scores were maintained in multivariate analysis. Females had increased Post-Concussion Symptom Scale (β = 3.54, 95% confidence interval, 2.91 to 4.16, P < .0001) along with higher verbal memory (β = 1.82, 95% confidence interval, 1.15 to 2.50, P < .0001) and visual motor (β = 1.29, 95% confidence interval, 0.85-1.72, P < .0001) scores. CONCLUSIONS Statistically significant gender differences were found in baseline neurocognitive function. This study clarifies for the first time that gender differences in these neurocognitive domains are not simply an artifact of differences in symptom burden. However, the small effect sizes call into question the clinical relevance of these differences.
Collapse
|
7
|
Concussion Baseline Retesting Is Necessary When Initial Scores Are Low. Clin J Sport Med 2022; 32:e40-e51. [PMID: 33239512 DOI: 10.1097/jsm.0000000000000872] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/05/2020] [Accepted: 05/30/2020] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To determine whether (1) initial baseline scores are significantly better for those who have valid (initial valid) versus invalid scores (initial invalid) on their concussion baseline testing, (2) retesting results in significantly improved baseline scores, and (3) there is a significant difference in scores between those who have valid scores on their initial attempt and those who retook baseline tests (retest valid). DESIGN Prospective, repeated-measures. SETTING Two years of collegiate preparticipation concussion baseline testing. PARTICIPANTS Five hundred forty-seven male and female Division I collegiate athletes (19.02 ± 1.31 years, female = 217). INDEPENDENT VARIABLES Participants were divided into initial valid and initial invalid. The retest group was further divided into their initial (initial invalid) and final valid attempt (retest valid). MAIN OUTCOME MEASURES Data were analyzed to determine the relationship between the 3 groups and overall initial and final scores on 28 individual items: total symptoms score, coordination, near-point convergence, CNS Vital Signs (CNSVS), Senaptec Sensory Station, and Neurocom Sensory Organization Test (SOT). RESULTS The initial valid group scored significantly better than the initial invalid group on 8 CNSVS items and 5 Senaptec items (P < 0.002). The retest valid scores were significantly better compared with the initial invalid scores on 17 items (P < 0.002). CONCLUSIONS Retesting is recommended for individuals who score below acceptable ranges. This is important because athletes may experience a learning effect and are highly motivated during postinjury testing, so accurate baseline scores are imperative for athlete safety. Completion time for the coordination test may be a more informative option.
Collapse
|
8
|
Powell D, Stuart S, Godfrey A. Sports related concussion: an emerging era in digital sports technology. NPJ Digit Med 2021; 4:164. [PMID: 34857868 PMCID: PMC8639973 DOI: 10.1038/s41746-021-00538-w] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Accepted: 10/19/2021] [Indexed: 11/24/2022] Open
Abstract
Sports-related concussion (SRC) is defined as a mild traumatic brain injury (mTBI) leading to complex impairment(s) in neurological function with many seemingly hidden or difficult to measure impairments that can deteriorate rapidly without any prior indication. Growing numbers of SRCs in professional and amateur contact sports have prompted closer dialog regarding player safety and welfare. Greater emphasis on awareness and education has improved SRC management, but also highlighted the difficulties of diagnosing SRC in a timely manner, particularly during matches or immediately after competition. Therefore, challenges exist in off-field assessment and return to play (RTP) protocols, with current traditional (subjective) approaches largely based on infrequent snapshot assessments. Low-cost digital technologies may provide more objective, integrated and personalized SRC assessment to better inform RTP protocols whilst also enhancing the efficiency and precision of healthcare assessment. To fully realize the potential of digital technologies in the diagnosis and management of SRC will require a significant paradigm shift in clinical practice and mindset. Here, we provide insights into SRC clinical assessment methods and the translational utility of digital approaches, with a focus on off-field digital techniques to detect key SRC metrics/biomarkers. We also provide insights and recommendations to the common benefits and challenges facing digital approaches as they aim to transition from novel technologies to an efficient, valid, reliable, and integrated clinical assessment tool for SRC. Finally, we highlight future opportunities that digital approaches have in SRC assessment and management including digital twinning and the "digital athlete".
Collapse
Affiliation(s)
- Dylan Powell
- Department of Computer and Information Sciences, Faculty of Engineering and Environment, Northumbria University, Newcastle upon Tyne, NE1 8ST, UK
| | - Sam Stuart
- Department of Sports, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, UK
| | - Alan Godfrey
- Department of Computer and Information Sciences, Faculty of Engineering and Environment, Northumbria University, Newcastle upon Tyne, NE1 8ST, UK.
| |
Collapse
|
9
|
Influence of Special Education, ADHD, Autism, and Learning Disorders on ImPACT Validity Scores in High School Athletes. J Int Neuropsychol Soc 2021; 27:461-471. [PMID: 33292913 DOI: 10.1017/s1355617720001149] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
OBJECTIVE The Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) is commonly used to assist with post-concussion return-to-play decisions for athletes. Additional investigation is needed to determine whether embedded indicators used to determine the validity of scores are influenced by the presence of neurodevelopmental disorders (NDs). METHOD This study examined standard and novel ImPACT validity indicators in a large sample of high school athletes (n = 33,772) with or without self-reported ND. RESULTS Overall, 7.1% of athletes' baselines were judged invalid based on standard ImPACT validity criteria. When analyzed by group (healthy, ND), there were significantly more invalid ImPACT baselines for athletes with an ND diagnosis or special education history (between 9.7% and 54.3% for standard and novel embedded validity criteria) when compared to athletes without NDs. ND history was a significant predictor of invalid baseline performance above and beyond other demographic characteristics (i.e., age, sex, and sport), although it accounted for only a small percentage of variance. Multivariate base rates are presented stratified for age, sex, and ND. CONCLUSIONS These data provide evidence of higher than normal rates of invalid baselines in athletes who report ND (based on both the standard and novel embedded validity indicators). Although ND accounted for a small percentage of variance in the prediction of invalid performance, negative consequences (e.g., extended time out of sports) of incorrect decision-making should be considered for those with neurodevelopmental conditions. Also, reasons for the overall increase noted here, such as decreased motivation, "sandbagging", or disability-related cognitive deficit, require additional investigation.
Collapse
|
10
|
Chase D, Slicer K, Schatz P. Relationship between Standalone Performance Validity Test Failure and Emotionality among Youth/student Athletes Experiencing Prolonged Recovery following Sports-related Concussion. Dev Neuropsychol 2020; 45:435-445. [PMID: 33269627 DOI: 10.1080/87565641.2020.1852239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
This study documented the rate of Performance Validity Testing (PVT) failure in 81 youth athletes, aged 10-21 years, experiencing prolonged recovery following sports-related concussion, and the relationship between PVT and emotional symptoms. Neuropsychological assessments were conducted across three test sessions with a stand-alone PVT at each session. Results showed that 48% (39/81) of individuals failed at least one PVT, with an overall PVT failure rate of 26% (64/243). Those failing at least one PVT scored significantly higher on anxiety but not depression or somatization. Results illustrate the importance of including measures of emotional and behavioral functioning in testing following SRC.
Collapse
Affiliation(s)
| | - Kayley Slicer
- Department of Psychology, Saint Joseph's University , Philadelphia, PA, USA
| | - Philip Schatz
- Department of Psychology, Saint Joseph's University , Philadelphia, PA, USA
| |
Collapse
|
11
|
Abstract
OBJECTIVE The aim of this research was to develop preliminary norms for the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) administered to a large sample of adolescent athletes from diverse ethnic backgrounds. DESIGN A retrospective records review. SETTING Middle and high school athletic departments. PARTICIPANTS A total of 5741 male and female adolescent athletes in Hawaii, aged 13 to 18 years, in grades 9 to 12 were included in the study. INDEPENDENT VARIABLES Age, sex, ethnicity, and sport. MAIN OUTCOME MEASURES ImPACT Composite scores (Verbal Memory, Visual Memory, Visual Motor Speed, Reaction Time, and Impulse Control) and Total Symptom score from baseline testing. RESULTS The results indicated statistically significant differences between age and sex groups, as well as between ethnic and sport groups. CONCLUSIONS The findings support the continued use of stratified norms for age and sex for ethnically diverse adolescent athletes. Comparisons of ethnic and sport groups deserve further investigation. When baseline scores are not available for postconcussion comparison, present observations tentatively support the cautious use of standard ImPACT norms with ethnically diverse athletes.
Collapse
|
12
|
Lace JW, Merz ZC, Grant AF, Teague CL, Aylward S, Dorflinger J, Gfeller JD. Relationships Between the BRIEF/BRIEF-SR and Performance-Based Neuropsychological Tests in Adolescents with Mild Traumatic Brain Injury. JOURNAL OF PEDIATRIC NEUROPSYCHOLOGY 2019. [DOI: 10.1007/s40817-019-00074-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
13
|
Tsushima WT, Yamamoto MH, Ahn HJ, Siu AM, Choi SY, Murata NM. Invalid Baseline Testing with ImPACT: Does Sandbagging Occur with High School Athletes? APPLIED NEUROPSYCHOLOGY-CHILD 2019; 10:209-218. [PMID: 31407597 DOI: 10.1080/21622965.2019.1642202] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
The aim of this large-scale research was to determine the frequency of valid, invalid, and sandbagging results in ImPACT baseline testing of high school athletes. This retrospective study identified valid, invalid (identified by five embedded Invalidity Indicators), and sandbagging (identified by three "red flags") results in the ImPACT baseline test scores of 6,346 high school athletes. In addition, the ImPACT postconcussion scores of 266 athletes who sustained a concussion during the school year were evaluated to compare the baseline-to-postconcussion changes of valid versus a combined group of invalid and sandbagging scorers. There were 3,299 (51.99%) athletes who had valid baseline scores, 269 (4.24%) had invalid scores, and 3,009 (47.42%) had sandbagging scores. (There were 231 who obtained both invalidity and sandbagging scores.) The overall difference in baseline-to-postconcussion changes between the valid scorers and the combined group of invalid and sandbagging scorers was statistically significant. The high rate of athletes who had invalid and sandbagging scores raised concern that the underperformance of baseline testing occurs more commonly than is probably realized by those who utilize computerized neuropsychological testing with high school athletes. Accordingly, efforts are needed to improve test administration procedures so that maximal attention and effort can be maintained among the test takers. In the meantime, increased caution is called for in employing the baseline-to-postconcussion paradigm when return-to-play decisions are made.
Collapse
Affiliation(s)
- William T Tsushima
- Psychiatry and Psychology Department, Straub Medical Center, Honolulu, Hawaii, USA
| | | | - Hyeong Jun Ahn
- Office of Biostatistics & Quantitative Health Sciences, University of Hawaii John A. Burns School of Medicine, Honolulu, Hawaii, USA
| | - Andrea M Siu
- Research Institute, Hawaii Pacific Health, Honolulu, Hawaii, USA
| | - So Yung Choi
- Department of Complementary and Integrative Medicine, University of Hawai'i John A. Burns School of Medicine, Honolulu, Hawaii, USA
| | - Nathan M Murata
- College of Education, University of Hawaii at Manoa, Honolulu, Hawaii, USA
| |
Collapse
|
14
|
Mrazik M, Naidu D, Borza C, Kobitowich T, Shergill S. King Devick computerized neurocognitive test scores in professional football players with learning and attentional disabilities. J Neurol Sci 2019; 399:140-143. [DOI: 10.1016/j.jns.2019.02.020] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2018] [Revised: 02/08/2019] [Accepted: 02/10/2019] [Indexed: 11/16/2022]
|
15
|
Wallace J, Covassin T, Moran R, Deitrick JM. Factors Contributing to Disparities in Baseline Neurocognitive Performance and Concussion Symptom Scores Between Black and White Collegiate Athletes. J Racial Ethn Health Disparities 2018; 5:894-900. [PMID: 29098599 DOI: 10.1007/s40615-017-0437-y] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2017] [Revised: 08/14/2017] [Accepted: 10/04/2017] [Indexed: 10/18/2022]
Abstract
BACKGROUND National Collegiate Athletic Association (NCAA) concussion guidelines state that all NCAA athletes must have a concussion baseline test prior to commencing their competitive season. To date, little research has examined potential racial differences on baseline neurocognitive performance among NCAA athletes. The purpose of this study was to investigate differences between Black and White collegiate athletes on baseline neurocognitive performance and self-reported symptoms. METHODS A total of 597 collegiate athletes (400 White, 197 Black) participated in this study. Athletes self-reported their race on the demographic section of their pre-participation physical examination and were administered the Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) neurocognitive battery in a supervised, quiet room. Controlling for sex, data were analyzed using separate one-way analyses of covariance (ANCOVAs) on symptom score, verbal and visual memory, visual motor processing speed, and reaction time composite scores. RESULTS Results revealed significant differences between White and Black athletes on baseline symptom score (F (1,542) = 5.82, p = .01), visual motor processing speed (F (1,542) = 14.89, p < .001), and reaction time (F (1,542) = 11.50, p < .01). White athletes performed better than Black athletes on baseline visual motor processing speed and reaction time. Black athletes reported higher baseline symptom scores compared to Whites. There was no statistical difference between race on verbal memory (p = .08) and that on visual memory (p = .06). CONCLUSIONS Black athletes demonstrated disparities on some neurocognitive measures at baseline. These results suggest capturing an individual baseline on each athlete, as normative data comparisons may be inappropriate for athletes of a racial minority.
Collapse
Affiliation(s)
- Jessica Wallace
- Youngstown State University, 1 University Plaza, 307L Beeghly Center, Youngstown, OH, 44555, USA.
| | - Tracey Covassin
- Michigan State University, 105 IM Circle, East Lansing, MI, 48824, USA
| | - Ryan Moran
- University of Alabama, Tuscaloosa, AL, USA
| | | |
Collapse
|
16
|
Collegiate Student Athletes With History of ADHD or Academic Difficulties Are More Likely to Produce an Invalid Protocol on Baseline ImPACT Testing. Clin J Sport Med 2018; 28:111-116. [PMID: 28731886 DOI: 10.1097/jsm.0000000000000433] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
OBJECTIVE Attention deficit hyperactivity disorder (ADHD) and other academically-relevant diagnoses have been suggested as modifiers of neurocognitive testing in sport-related concussion, such as Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). These preexisting conditions may suppress ImPACT scores to the extent that they are indistinguishable from low scores because of poor effort. The present study hypothesized that student athletes with history of ADHD or academic difficulties produce lower ImPACT composite scores and are more likely to produce invalid protocols than those without such conditions. DESIGN Cross-sectional study. SETTING Midsized public university. PARTICIPANTS Nine hundred forty-nine National College Athletic Association athletes (average age = 19.2 years; 6.8% ADHD, 5.6% Academic Difficulties, 2.0% comorbid ADHD/Academic Difficulties). INDEPENDENT VARIABLES Three seasons of baseline ImPACT protocols were analyzed. Student athletes were grouped using self-reported histories of ADHD or academic difficulties taken from ImPACT demographic questions. DEPENDENT VARIABLES ImPACT composite scores and protocol validity. RESULTS Student athletes in the academic difficulties and comorbid groups performed worse on ImPACT composite scores (Pillai's Trace = 0.05), though this pattern did not emerge for those with ADHD. Student athletes with comorbid history were more likely to produce an invalid baseline (10.5% invalid) (χ (2) = 11.08, P = 0.004). Those with ADHD were also more likely to produce an invalid protocol (7.7% invalid, compared with 2.6% in student athletes with no history) (χ (2) = 10.70, P = 0.005). CONCLUSIONS These findings suggest that student athletes reporting comorbid histories or histories of academic difficulties alone produce lower ImPACT composite scores, and that those with comorbid histories or histories of ADHD alone produce invalid protocol warnings more frequently than student athletes without such histories. Future studies should further examine invalid score thresholds on the ImPACT, especially in student athletes with conditions that may influence test performance. CLINICAL RELEVANCE Student athletes with history of ADHD or academic difficulties may more frequently fall below validity score thresholds, suggesting caution in interpreting test performance.
Collapse
|
17
|
WALTON SAMUELR, BROSHEK DONNAK, FREEMAN JASONR, CULLUM CMUNRO, RESCH JACOBE. Valid but Invalid: Suboptimal ImPACT Baseline Performance in University Athletes. Med Sci Sports Exerc 2018; 50:1377-1384. [PMID: 29485429 DOI: 10.1249/mss.0000000000001592] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
PURPOSE This study aimed to investigate the frequency of valid yet suboptimal Immediate Postconcussion Assessment and Cognitive Test (ImPACT) performance in university athletes and to explore the benefit of subsequent ImPACT administrations. METHODS This descriptive laboratory study involved baseline administration of ImPACT to 769 university athletes per the institution's concussion management protocol. Testing was proctored in groups of ≤2 participants. Participants who scored below the 16th percentile according to ImPACT normative data were readministered the ImPACT test up to two additional times because these scores were thought to be potentially indicative of suboptimal effort or poor understanding of instructions. Descriptive analyses were used to examine validity indicators and individual Verbal and Visual Memory, Visual Motor Speed, and Reaction Time ImPACT composite scores in initial and subsequent administrations. RESULTS On the basis of ImPACT's validity criteria, 1% (9/769) of administrations were invalid and 14.6% (112/769) had one or more composite score of <16th percentile but were considered valid. After one readministration, 71.4% (80/112) achieved scores of ≥16th percentile and an additional 18 of 32 scored ≥16th percentile after a third administration. Verbal Memory was most commonly <16th percentile on the first administration (43%), Verbal Memory and Visual Motor Speed on the second administration (44% each), and Visual Motor Speed alone on the third administration (50%). CONCLUSIONS Approximately 16% of ImPACT records were flagged as invalid or had one or more composite scores of <16th percentile, potentially indicative of suboptimal performance. Upon readministration, 88% of those participants scored >16th percentile. Clinicians must be aware of suboptimal ImPACT performance as it limits the clinical utility of the baseline assessment. Further research is needed to address factors leading to "valid" but invalid baseline performance.
Collapse
|
18
|
Chase D, Schatz P, Smyk N, Franks RR. The stability of engagement over comprehensive neuropsychological assessment in student athletes diagnosed with sports related concussion. Dev Neuropsychol 2018; 43:345-355. [DOI: 10.1080/87565641.2018.1428326] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
| | - Philip Schatz
- Department of Psychology, Saint Joseph’s University, Philadelphia, PA, USA
| | - Nathan Smyk
- Department of Psychology, Saint Joseph’s University, Philadelphia, PA, USA
| | - R. Robert Franks
- Rothman Institute, Orthopedics Department, Philadelphia, PA, USA
| |
Collapse
|
19
|
Paniccia M, Verweel L, Thomas S, Taha T, Keightley M, Wilson KE, Reed N. Heart Rate Variability in Healthy Non-Concussed Youth Athletes: Exploring the Effect of Age, Sex, and Concussion-Like Symptoms. Front Neurol 2018; 8:753. [PMID: 29403426 PMCID: PMC5778119 DOI: 10.3389/fneur.2017.00753] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2017] [Accepted: 12/28/2017] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Heart rate variability (HRV) is a non-invasive neurophysiological measure of autonomic nervous system regulation emerging in concussion research. To date, most concussion studies have focused on the university-aged athlete with no research examining healthy active youths. Corroborating changes in HRV alongside traditional subjective self-report measures (concussion symptoms) in the non-concussed state provides a foundation for interpreting change following concussion. The objectives were to (1) explore the influence of age and sex on HRV and (2) examine the relationship between HRV and baseline/pre-injury concussion symptom domains (physical, cognitive, emotional, and fatigue) in healthy youth athletes. METHOD Healthy, youth athletes 13-18 years of age [N = 294, female = 166 (56.5%), male = 128 (43.5%)] participated in this cross-sectional study. Age, sex, and concussion-like symptoms were collected as part of a baseline/pre-injury assessment. The Post-Concussion Symptom Inventory-SR13 (PCSI-SR13) was used to collect domain scores for physical, cognitive, emotional, and fatigue symptoms. HRV was collected for 24 h. HRV measures included time (SDNN, RMSSD, and pNN50) and frequency (HF, HFnu, LF, LFnu, and total power) domain HRV measures. Variables were logarithmically transformed to increase robustness of linear regression models. RESULTS Older youth participants displayed significantly higher HRV compared to younger participants (p < 0.05). Females displayed significantly lower HRV compared to males (p < 0.05). A significant interaction effect between concussion-like symptoms and HRV indicated differential patterns as a function of sex (p < 0.05). Youth athletes who reported more cognitive symptoms had lower HRV (p < 0.05). CONCLUSION HRV was found to have a significant relationship with a traditional clinical measure (subjective self-report of concussion-like symptoms) utilized in concussion assessment and management. Baseline/pre-concussion trends in HRV were significantly associated with age and sex, highlighting the value in understanding key demographic factors within the context of concussion-like symptoms.
Collapse
Affiliation(s)
- Melissa Paniccia
- Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada
- Concussion Centre, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
| | - Lee Verweel
- Concussion Centre, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
| | - Scott Thomas
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
- Faculty of Medicine, Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada
| | - Tim Taha
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON, Canada
| | - Michelle Keightley
- Faculty of Medicine, Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada
- Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
| | - Katherine E. Wilson
- Concussion Centre, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
| | - Nick Reed
- Concussion Centre, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Faculty of Medicine, Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada
- Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
20
|
Abstract
Sports-related concussion (SRC) is a common problem in youth sports. Concussion may occur after a forceful hit to the body or head, resulting in transient neuropathological changes that spontaneously resolve with relative rest and activity modification in most patients. Most SRCs are effectively managed by primary care physicians and sports medicine specialists. In some cases, symptoms may persist and the child and adolescent psychiatrist may be consulted. This article reviews important background information regarding SRC and highlights a variety of pharmacologic and nonpharmacologic treatment options that consultant psychiatrists should know.
Collapse
|
21
|
Manderino LM, Gunstad J. Performance of the Immediate Post-Concussion Assessment and Cognitive Testing Protocol Validity Indices. Arch Clin Neuropsychol 2017; 33:596-605. [DOI: 10.1093/arclin/acx102] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Accepted: 10/04/2017] [Indexed: 11/12/2022] Open
Affiliation(s)
- L M Manderino
- Department of Psychological Sciences, Kent State University, Kent, OH, USA
| | - J Gunstad
- Department of Psychological Sciences, Kent State University, Kent, OH, USA
| |
Collapse
|
22
|
Aggarwal SS, Ott SD, Padhye NS, Meininger JC, Armstrong TS. Clinical and demographic predictors of concussion resolution in adolescents: A retrospective study. APPLIED NEUROPSYCHOLOGY-CHILD 2017; 8:50-60. [DOI: 10.1080/21622965.2017.1381099] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Seema S. Aggarwal
- Acute and Continuing Care, University of Texas Health Sciences Center at Houston School of Nursing, Houston, Texas, USA
| | - Summer D. Ott
- Department of Orthopedic Surgery, University of Texas Health Sciences Center at Houston Medical School, Houston, Texas, USA
| | - Nikhil S. Padhye
- Center for Nursing Research, University of Texas Health Sciences Center at Houston School of Nursing, Houston, Texas, USA
| | - Janet C. Meininger
- Nursing Systems, University of Texas Health Sciences Center at Houston School of Nursing, Houston, Texas, USA
| | - Terri S. Armstrong
- National Institute of Health (NIH), Neuro-Oncology Branch, NCI/CCR, Bethesda, MD, USA
| |
Collapse
|
23
|
Moser RS, Schatz P. Increased Symptom Reporting in Young Athletes Based on History of Previous Concussions. Dev Neuropsychol 2017; 42:276-283. [PMID: 28678608 DOI: 10.1080/87565641.2017.1334785] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
Research documents increased symptoms in adolescents with a history of two or more concussions. This study examined baseline evaluations of 2,526 younger athletes, ages 10 to 14. Between-groups analyses examined Post Concussion Symptom Scale symptoms by concussion history group (None, One, Two+) and clusters of Physical, Cognitive, Emotional, and Sleep symptoms. Healthy younger athletes with a concussion history reported greater physical, emotional, and sleep-related symptoms than those with no history of concussion, with a greater endorsement in physical/sleep symptom clusters. Findings suggest younger athletes with a history of multiple concussions may experience residual symptoms.
Collapse
Affiliation(s)
| | - Philip Schatz
- b Department of Psychology , Saint Joseph's University , Philadelphia , Pennsylvania
| |
Collapse
|
24
|
Brett BL, Solomon GS, Hill J, Schatz P. Two-year Test–Retest Reliability in High School Athletes Using the Four- and Two-Factor ImPACT Composite Structures: The Effects of Learning Disorders and Headache/Migraine Treatment History. Arch Clin Neuropsychol 2017; 33:216-226. [DOI: 10.1093/arclin/acx059] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2016] [Accepted: 06/08/2017] [Indexed: 01/20/2023] Open
Affiliation(s)
- Benjamin L Brett
- Department of Counseling, Educational Psychology and Research, The University of Memphis, Memphis, TN, USA
- Vanderbilt Sports Concussion Center, Nashville, TN, USA
| | - Gary S Solomon
- Vanderbilt Sports Concussion Center, Nashville, TN, USA
- Department of Neurological Surgery, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Jennifer Hill
- Department of Psychology, Saint Joseph’s University, Philadelphia, PA, USA
| | - Philip Schatz
- Department of Psychology, Saint Joseph’s University, Philadelphia, PA, USA
| |
Collapse
|
25
|
Alsalaheen B, Stockdale K, Pechumer D, Broglio SP. Validity of the Immediate Post Concussion Assessment and Cognitive Testing (ImPACT). Sports Med 2017; 46:1487-501. [PMID: 27071989 DOI: 10.1007/s40279-016-0532-y] [Citation(s) in RCA: 66] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
BACKGROUND The immediate post concussion assessment and cognitive testing (ImPACT) is the most widely used concussion assessment tool. Despite its popularity, it is unclear if validation studies for the ImPACT test covered all aspects of validity to support its widespread use in research and clinical practice. OBJECTIVE The purpose of this report is to review literature surrounding the validity and the utility of the ImPACT test. DATA SOURCES AND APPRAISAL A systematic review of relevant studies in PubMed, CINAHL, and PsycINFO was carried out. Studies were evaluated using the STROBE (strengthening the reporting of observational studies in epidemiology) or the STARD (standards for reporting of diagnostic accuracy) criteria. RESULTS The literature search yielded 5968 studies. Sixty-nine studies met the inclusion criteria and were included in the qualitative review. Although the convergent validity of ImPACT was supported, evidence of discriminant and predictive validity, diagnostic accuracy and responsiveness was inconclusive. The utility of the ImPACT test after acute symptom resolution was sparse. The review found many factors influenced the validity and utility of ImPACT scores. CONCLUSION Clinicians must consider the benefit of ImPACT testing for their patients on a case-by-case scenario and must take the psychometric properties of the test into account when interpreting results.
Collapse
Affiliation(s)
- Bara Alsalaheen
- Physical Therapy Department, University of Michigan-Flint, 2157 William S. White Building, 303 E. Kearsley Street, Flint, MI, 48502-1950, USA.
| | - Kayla Stockdale
- Physical Therapy Department, University of Michigan-Flint, 2157 William S. White Building, 303 E. Kearsley Street, Flint, MI, 48502-1950, USA
| | - Dana Pechumer
- Physical Therapy Department, University of Michigan-Flint, 2157 William S. White Building, 303 E. Kearsley Street, Flint, MI, 48502-1950, USA
| | - Steven P Broglio
- Neurotrauma Research Laboratory, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
26
|
Gardner RM, Yengo-Kahn A, Bonfield CM, Solomon GS. Comparison of baseline and post-concussion ImPACT test scores in young athletes with stimulant-treated and untreated ADHD. PHYSICIAN SPORTSMED 2017; 45:1-10. [PMID: 27736285 DOI: 10.1080/00913847.2017.1248221] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
OBJECTIVES Baseline and post-concussion neurocognitive testing is useful in managing concussed athletes. Attention deficit hyperactivity disorder (ADHD) and stimulant medications are recognized as potential modifiers of performance on neurocognitive testing by the Concussion in Sport Group. Our goal was to assess whether individuals with ADHD perform differently on post-concussion testing and if this difference is related to the use of stimulants. METHODS Retrospective case-control study in which 4373 athletes underwent baseline and post-concussion testing using the ImPACT battery. 277 athletes self-reported a history of ADHD, of which, 206 reported no stimulant treatment and 69 reported stimulant treatment. Each group was matched with participants reporting no history of ADHD or stimulant use on several biopsychosocial characteristics. Non-parametric tests were used to assess ImPACT composite score differences between groups. RESULTS Participants with ADHD had worse verbal memory, visual memory, visual motor speed, and reaction time scores than matched controls at baseline and post-concussion, all with p ≤ .001 and |r|≥ 0.100. Athletes without stimulant treatment had lower verbal memory, visual memory, visual motor speed, and reaction time scores than controls at baseline (p ≤ 0.01, |r|≥ 0.100 [except verbal memory, r = -0.088]) and post-concussion (p = 0.000, |r|> 0.100). Athletes with stimulant treatment had lower verbal memory (Baseline: p = 0.047, r = -0.108; Post-concussion: p = 0.023, r = -0.124) and visual memory scores (Baseline: p = 0.013, r = -0.134; Post-concussion: p = 0.003, r = -0.162) but equivalent visual motor speed and reaction time scores versus controls at baseline and post-concussion. CONCLUSIONS ADHD-specific baseline and post-concussion neuropsychological profiles, as well as stimulant medication status, may need to be considered when interpreting ImPACT test results. Further investigation into the effects of ADHD and stimulant use on recovery from sport-related concussion (SRC) is warranted.
Collapse
Affiliation(s)
- Ryan M Gardner
- a Vanderbilt Sports Concussion Center , Vanderbilt University School of Medicine , Nashville , TN , USA
| | - Aaron Yengo-Kahn
- a Vanderbilt Sports Concussion Center , Vanderbilt University School of Medicine , Nashville , TN , USA.,b Department of Neurological Surgery , Vanderbilt University School of Medicine , Nashville , TN , USA
| | - Christopher M Bonfield
- a Vanderbilt Sports Concussion Center , Vanderbilt University School of Medicine , Nashville , TN , USA.,b Department of Neurological Surgery , Vanderbilt University School of Medicine , Nashville , TN , USA
| | - Gary S Solomon
- a Vanderbilt Sports Concussion Center , Vanderbilt University School of Medicine , Nashville , TN , USA.,b Department of Neurological Surgery , Vanderbilt University School of Medicine , Nashville , TN , USA
| |
Collapse
|
27
|
Cottle JE, Hall EE, Patel K, Barnes KP, Ketcham CJ. Concussion Baseline Testing: Preexisting Factors, Symptoms, and Neurocognitive Performance. J Athl Train 2017; 52:77-81. [PMID: 28071936 DOI: 10.4085/1062-6050-51.12.21] [Citation(s) in RCA: 55] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
CONTEXT Neurocognitive test scores are often considered an important aspect of concussion management. To best use these data, clinicians must understand potential factors that may influence baseline performance on these tests. OBJECTIVE To determine preexisting factors that may influence performance on the Immediate Post-Concussion Assessment and Cognitive Test (ImPACT). DESIGN Cross-sectional study. SETTING Research laboratory. PATIENTS OR OTHER PARTICIPANTS A total of 486 National Collegiate Athletic Association Division I collegiate student-athletes. MAIN OUTCOME MEASURE(S) To determine neurocognitive functioning and total symptom score at baseline, ImPACT was administered. Outcomes were verbal memory, visual memory, visual motor speed, reaction time, and total symptom score. A self-report demographic section at the beginning of ImPACT was used to gather information concerning previous treatment for headaches, migraines, and psychiatric conditions; diagnosis of attention-deficit/hyperactivity disorder; and exposure to previous strenuous exercise. We conducted multivariate analyses of variance to determine if the ImPACT composite and total symptom scores differed according to preexisting factors (P < .0083). RESULTS Sex showed an effect on verbal memory (P = .001), visual motor speed (P < .001), and reaction time (P = .006), with women performing better than men. A previous diagnosis of attention-deficit/hyperactivity disorder affected visual motor speed (P = .008). Previous treatment for headaches (P < .001), migraines (P = .001), a psychiatric condition (P < .001), or a diagnosis of attention-deficit/hyperactivity disorder (P < .001) all showed effects on the total symptom score. Strenuous exercise did not affect neurocogntive performance or total symptom score. CONCLUSIONS Based on our findings and the previous literature, we suggest that many preexisting factors influence baseline neurocognitive data. Baseline testing is an important aspect of concussion management. Sports medicine professionals should be cognizant of these factors when developing concussion-management protocols.
Collapse
Affiliation(s)
| | - Eric E Hall
- Department of Exercise Science, Elon University, NC
| | | | | | | |
Collapse
|
28
|
Asken BM, Clugston JR, Snyder AR, Bauer RM. Baseline Neurocognitive Performance and Clearance for Athletes to Return to Contact. J Athl Train 2016; 52:51-57. [PMID: 27905859 DOI: 10.4085/1062-6050-51.12.27] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
CONTEXT Computerized neurocognitive assessments are commonly used to manage sport-related concussion. Variations in baseline performance may influence neurocognitive performance after injury as well as the amount of time needed for an athlete to be cleared for return to sport participation. OBJECTIVE To investigate the relationship between mean baseline Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) scores and postconcussion reliable decline as well as the association between postconcussion cognitive decline and days missed after injury. DESIGN Cross-sectional study. SETTING University concussion databank. PATIENTS OR OTHER PARTICIPANTS A total of 84 collegiate athletes who sustained a concussion between 2008 and 2015 were studied. For each ImPACT composite score (verbal memory, visual memory, visual motor speed, reaction time), athletes were grouped based on the presence or absence of reliable decline and on the presence of reliable decline in 0, 1, 2, 3, or 4 cognitive domains. MAIN OUTCOME MEASURE(S) Outcome measures were baseline ImPACT composite scores and days missed due to concussion. RESULTS Athletes with a reliable decline in visual memory scored higher on baseline visual memory than did athletes with no decline or an improvement (t82 = -2.348, P = .021, d = 0.65). When comparing athletes who displayed a reliable decline with those who showed no change or an improvement in any composite score, days missed did not differ. The number of composite scores with a reliable decline demonstrated no main effect on days missed (P = .530). CONCLUSIONS Athletes who exhibited cognitive decline in most or all of the composite scores did not miss more days after injury than athletes with a decline in fewer or none of the composite scores. Athletes should be educated regarding the lack of association between baseline neurocognitive scores and the presence or absence of a reliable decline after concussion, as well as the fact that, on average, individuals with a reliable decline across multiple domains did not miss more time after concussion.
Collapse
Affiliation(s)
- Breton M Asken
- Department of Clinical and Health Psychology, University of Florida, Gainesville
| | - James R Clugston
- University Athletic Association and Department of Community Health and Family Medicine, University of Florida, Gainesville
| | - Aliyah R Snyder
- Department of Clinical and Health Psychology, University of Florida, Gainesville
| | | |
Collapse
|
29
|
Balasundaram AP, Athens J, Schneiders AG, McCrory P, Sullivan SJ. Day-to-day variability of post-concussion-like symptoms reported over time by a non-concussed cohort. Brain Inj 2016; 30:1599-1604. [DOI: 10.1080/02699052.2016.1199902] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Arun Prasad Balasundaram
- Centre for Health, Activity and Rehabilitation Research, School of Physiotherapy, University of Otago, Dunedin, New Zealand
| | - Josie Athens
- Department of Preventive and Social Medicine, Dunedin School of Medicine, University of Otago, Dunedin, New Zealand
| | - Anthony G. Schneiders
- School of Human, Health & Social Sciences, Central Queensland University, Branyan, Australia
| | - Paul McCrory
- The Florey Institute of Neuroscience and Mental Health – Melbourne Brain Centre, University of Melbourne, Heidelberg, Victoria, Australia
| | - S. John Sullivan
- Centre for Health, Activity and Rehabilitation Research, School of Physiotherapy, University of Otago, Dunedin, New Zealand
| |
Collapse
|
30
|
Brett BL, Solomon GS. The influence of validity criteria on Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) test-retest reliability among high school athletes. J Clin Exp Neuropsychol 2016; 39:286-295. [PMID: 27585635 DOI: 10.1080/13803395.2016.1224322] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
OBJECTIVE Research findings to date on the stability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) Composite scores have been inconsistent, requiring further investigation. The use of test validity criteria across these studies also has been inconsistent. Using multiple measures of stability, we examined test-retest reliability of repeated ImPACT baseline assessments in high school athletes across various validity criteria reported in previous studies. METHOD A total of 1146 high school athletes completed baseline cognitive testing using the online ImPACT test battery at two time periods of approximately two-year intervals. No participant sustained a concussion between assessments. Five forms of validity criteria used in previous test-retest studies were applied to the data, and differences in reliability were compared. RESULTS Intraclass correlation coefficients (ICCs) ranged in composite scores from .47 (95% confidence interval, CI [.38, .54]) to .83 (95% CI [.81, .85]) and showed little change across a two-year interval for all five sets of validity criteria. Regression based methods (RBMs) examining the test-retest stability demonstrated a lack of significant change in composite scores across the two-year interval for all forms of validity criteria, with no cases falling outside the expected range of 90% confidence intervals. CONCLUSION The application of more stringent validity criteria does not alter test-retest reliability, nor does it account for some of the variation observed across previously performed studies. As such, use of the ImPACT manual validity criteria should be utilized in the determination of test validity and in the individualized approach to concussion management. Potential future efforts to improve test-retest reliability are discussed.
Collapse
Affiliation(s)
- Benjamin L Brett
- a Department of Counseling, Educational Psychology and Research , The University of Memphis , Memphis , TN , USA.,b Vanderbilt Sports Concussion Center , Nashville , TN , USA
| | - Gary S Solomon
- b Vanderbilt Sports Concussion Center , Nashville , TN , USA.,c Department of Neurological Surgery , Vanderbilt University School of Medicine , Nashville , TN , USA
| |
Collapse
|
31
|
Gaudet CE, Weyandt LL. Immediate Post-Concussion and Cognitive Testing (ImPACT): a systematic review of the prevalence and assessment of invalid performance. Clin Neuropsychol 2016; 31:43-58. [DOI: 10.1080/13854046.2016.1220622] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Charles E. Gaudet
- Department of Psychology, University of Rhode Island, Kingston, RI, USA
| | | |
Collapse
|
32
|
Haran FJ, Dretsch MN, Slaboda JC, Johnson DE, Adam OR, Tsao JW. Comparison of baseline-referenced versus norm-referenced analytical approaches for in-theatre assessment of mild traumatic brain injury neurocognitive impairment. Brain Inj 2016; 30:280-6. [PMID: 26909463 DOI: 10.3109/02699052.2015.1118766] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
PRIMARY OBJECTIVE To examine differences between the baseline-referenced and norm-referenced approaches for determining decrements in Automated Neuropsychological Assessment Metrics Version 4 TBI-MIL (ANAM) performance following mild traumatic brain injury (mTBI). RESEARCH DESIGN ANAM data were reviewed for 616 US Service members, with 528 of this sample having experienced an mTBI and 88 were controls. METHODS AND PROCEDURES Post-injury change scores were calculated for each sub-test: (1) normative change score = in-theater score - normative mean and (2) baseline change score = in-theater score - pre-deployment baseline. Reliable change cut-scores were applied to the change and the resulting frequency distributions were compared using McNemar tests. Receiver operator curves (ROC) using both samples (i.e. mTBI and control) were calculated for the change scores for each approach to determine the discriminate ability of the ANAM. MAIN OUTCOMES AND RESULTS There were no statistical differences, p < 0.05 (Bonferonni-Holm corrected), between the approaches. When the area under the curve for the ROCs were averaged across sub-tests, there were no significant differences between either the norm-referenced (0.65) or baseline-referenced (0.66) approaches, p > 0.05. CONCLUSIONS Overall, the findings suggest there is no clear advantage of using the baseline-referenced approach over norm-referenced approach.
Collapse
Affiliation(s)
- F Jay Haran
- a Naval Submarine Medical Research Laboratory , Groton , CT , USA
| | - Michael N Dretsch
- b National Intrepid Center of Excellence , Walter Reed National Military Medical Center , Bethesda , MD USA
| | | | | | | | - Jack W Tsao
- f US Navy Bureau of Medicine and Surgery , Arlington , VA USA
| |
Collapse
|
33
|
Nelson LD, Pfaller AY, Rein LE, McCrea MA. Rates and Predictors of Invalid Baseline Test Performance in High School and Collegiate Athletes for 3 Computerized Neurocognitive Tests: ANAM, Axon Sports, and ImPACT. Am J Sports Med 2015; 43:2018-26. [PMID: 26059178 PMCID: PMC4747101 DOI: 10.1177/0363546515587714] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND Preseason baseline testing using computerized neurocognitive tests (CNTs) is increasingly performed on athletes. Adequate effort is critical to establish valid estimates of ability, but many users do not evaluate performance validity, and the conditions that affect validity are not well understood across the available CNTs. PURPOSE To examine the rates and predictors of invalid baseline performance for 3 popular CNTs: Automated Neuropsychological Assessment Metrics (ANAM), Axon Sports, and Immediate Post-Concussion and Cognitive Testing (ImPACT). STUDY DESIGN Controlled laboratory study. METHODS High school and collegiate athletes (N = 2063) completed 2 of 3 CNTs each during preseason evaluations. All possible pairings were present across the sample, and the order of administration was randomized. Examiners provided 1-on-1, scripted pretest instructions, emphasizing the importance of good effort. Profile validity was determined by the manufacturers' standard criteria. RESULTS The overall percentage of tests flagged as of questionable validity was lowest for ImPACT (2.7%) and higher for ANAM and Axon (10.7% and 11.3%, respectively). The majority of invalid baseline profiles were flagged as such because of failure on only 1 validity criterion. Several athlete and testing factors (eg, attention deficit hyperactivity disorder [ADHD], estimated general intellectual ability, administration order) predicted validity status for 1 or more CNTs. Considering only first CNT administrations and participants without ADHD and/or a learning disability (n = 1835) brought the rates of invalid baseline performances to 2.1%, 8.8%, and 7.0% for ImPACT, ANAM, and Axon, respectively. Invalid profiles on the Medical Symptom Validity Test (MSVT) were rare (1.8% of participants) and demonstrated poor correspondence to CNT validity outcomes. CONCLUSION The validity criteria for these CNTs may not identify the same causes of invalidity or be equally sensitive to effort. The validity indicators may not be equally appropriate for some athletes (eg, those with neurodevelopmental disorders). CLINICAL RELEVANCE The data suggest that athletes do not put forth widespread low effort or that some validity criteria are more sensitive to invalid performance than others. It is important for examiners to be aware of the conditions that maximize the quality of baseline assessments and to understand what sources of invalid performance are captured by the validity criteria that they obtain.
Collapse
Affiliation(s)
- Lindsay D. Nelson
- Department of Neurosurgery, Medical College of Wisconsin, Milwaukee, WI
| | - Adam Y. Pfaller
- Department of Neurosurgery, Medical College of Wisconsin, Milwaukee, WI
| | - Lisa E. Rein
- Department of Biostatistics, Medical College of Wisconsin, Milwaukee, WI
| | - Michael A. McCrea
- Department of Neurosurgery, Medical College of Wisconsin, Milwaukee, WI
| |
Collapse
|
34
|
Kuhn AW, Solomon GS. Supervision and computerized neurocognitive baseline test performance in high school athletes: an initial investigation. J Athl Train 2015; 49:800-5. [PMID: 25299577 DOI: 10.4085/1062-6050-49.3.66] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
CONTEXT Computerized neuropsychological testing batteries have provided a time-efficient and cost-efficient way to assess and manage the neurocognitive aspects of patients with sport-related concussion. These tests are straightforward and mostly self-guided, reducing the degree of clinician involvement required by traditional clinical neuropsychological paper-and-pencil tests. OBJECTIVE To determine if self-reported supervision status affected computerized neurocognitive baseline test performance in high school athletes. DESIGN Retrospective cohort study. SETTINGS Supervised testing took place in high school computer libraries or sports medicine clinics. Unsupervised testing took place at the participant's home or another location with computer access. PATIENTS OR OTHER PARTICIPANTS From 2007 to 2012, high school athletes across middle Tennessee (n = 3771) completed computerized neurocognitive baseline testing (Immediate Post-Concussion Assessment and Cognitive Testing [ImPACT]). They reported taking the test either supervised by a sports medicine professional or unsupervised. These athletes (n = 2140) were subjected to inclusion and exclusion criteria and then matched based on age, sex, and number of prior concussions. MAIN OUTCOME MEASURE(S) We extracted demographic and performance-based data from each de-identified baseline testing record. Paired t tests were performed between the self-reported supervised and unsupervised groups, comparing the following ImPACT baseline composite scores: verbal memory, visual memory, visual motor (processing) speed, reaction time, impulse control, and total symptom score. For differences that reached P < .05, the Cohen d was calculated to measure the effect size. Lastly, a χ(2) analysis was conducted to compare the rate of invalid baseline testing between the groups. All statistical tests were performed at the 95% confidence interval level. RESULTS Self-reported supervised athletes demonstrated better visual motor (processing) speed (P = .004; 95% confidence interval [0.28, 1.52]; d = 0.12) and faster reaction time (P < .001; 95% confidence interval [-0.026, -0.014]; d = 0.21) composite scores than self-reported unsupervised athletes. CONCLUSIONS Speed-based tasks were most affected by self-reported supervision status, although the effect sizes were relatively small. These data lend credence to the hypothesis that supervision status may be a factor in the evaluation of ImPACT baseline test scores.
Collapse
|
35
|
Baseline SCAT2 Assessment of Healthy Youth Student-Athletes: Preliminary Evidence for the Use of the Child-SCAT3 in Children Younger Than 13 Years. Clin J Sport Med 2015; 25:373-9. [PMID: 25318531 DOI: 10.1097/jsm.0000000000000154] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To compare baseline scores of middle and high school students on the Sport Concussion Assessment Tool 2 (SCAT2) by sex and age. DESIGN Cross-sectional study. SETTING Single private school athletic program. PARTICIPANTS Three hundred sixty-one middle and high school student-athletes. INTERVENTION Preseason SCAT2 was administered to student-athletes before athletic participation. MAIN OUTCOME MEASURES Total SCAT2 score, symptoms, symptom severity, Glasgow coma scale, modified Balance Error Scoring System (BESS), coordination, and Standardized Assessment of Concussion (SAC) with subsections: Orientation, Immediate Memory, Concentration, and Delayed Recall. RESULTS No differences were found in total SCAT2 scores between sex (P = 0.463) or age (P = 0.21). Differences were found in subcomponents of the SCAT2. Twelve year olds had significantly lower concentration scores (3.3 ± 1.2) than 15 and 18 year olds (3.9 ± 1.0 and 4.2 ± 1.0, respectively). The 12 year olds also had the lowest percentage of correct responses for the SAC's concentration 5-digit (46%), 6-digit (21%), and months' backward (67%) tasks. Females presented with more symptoms (20.0 ± 2.2 vs. 20.6 ± 2.1 P = 0.007) better immediate memory (14.6 ± 0.9 vs. 14.3 ± 1.0, P = 0.022) and better BESS scores (27.2 ± 2.3 vs. 26.6 ± 2.6, P = 0.043) than their male counterparts. CONCLUSIONS Normative values for total SCAT2 and subscale scores show differences in concentration between ages, whereas symptoms, BESS, and immediate memory differed between sexes. We also found that 12 year olds have increased difficultly with the advanced concentration tasks, which lends support to the development of a separate instrument, such as the Child-SCAT3. The presence of developmental differences in the younger age groups suggests the need for annual baseline testing. CLINICAL RELEVANCE Subtle differences between age and sex have been identified in many components of the SCAT2 assessment. These differences may support the current evolution of concussion assessment tools to provide the most appropriate test. Baseline testing should be used when available, and clinicians should be aware of potential differences when using normalized values.
Collapse
|
36
|
Thoma RJ, Cook JA, McGrew C, King JH, Mayer AR, Lewine JD, Yeo RA, Campbell R. The effect of days since last concussion and number of concussions on cognitive functioning in Division I athletes. Brain Inj 2015; 29:633-8. [DOI: 10.3109/02699052.2014.999352] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
37
|
Iverson GL, Schatz P. Advanced topics in neuropsychological assessment following sport-related concussion. Brain Inj 2014; 29:263-75. [PMID: 25313596 DOI: 10.3109/02699052.2014.965214] [Citation(s) in RCA: 58] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
OBJECTIVE This study examined seven topics relating to neuropsychological assessment following sport-related concussion: (i) traditional vs. computerized tests; (ii) the value of baseline, pre-season testing; (iii) invalid baseline scores and poor effort; (iv) when to assess following injury; (v) the reliability of neuropsychological tests; (vi) reliable change methodology; and (vii) new methods for identifying cognitive impairment. MAIN RESULTS Baseline testing can be helpful for quantifying cognitive deficits following injury and for assessing recovery. At present, however, there is insufficient evidence to conclude that having baseline test results is clearly superior to not having baseline test results. Although invalid baseline test performance can be detected in some athletes, validity indicators cannot determine the extent to which the results were due to deliberately poor performance, confusion or misunderstanding regarding some aspect of the test, distractions in group testing environments or some combination of factors. When interpreting baseline and post-injury data, sophisticated psychometric methods (e.g. reliable change, multivariate base rates) are available to assist with more accurate identification of cognitive impairment and the serial monitoring of recovery. CONCLUSIONS The value of neuropsychological assessment in the management of sport-related concussion has a strong empirical foundation. Additional research is needed, however, to refine its use.
Collapse
Affiliation(s)
- Grant L Iverson
- Department of Physical Medicine and Rehabilitation, Harvard Medical School , Boston, MA , USA
| | | |
Collapse
|
38
|
Schatz P, Kelley T, Ott SD, Solomon GS, Elbin RJ, Higgins K, Moser RS. Utility of repeated assessment after invalid baseline neurocognitive test performance. J Athl Train 2014; 49:659-64. [PMID: 25162778 DOI: 10.4085/1062-6050-49.3.37] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
CONTEXT Although the prevalence of invalid baseline neurocognitive testing has been documented, and repeated administration after obtaining invalid results is recommended, no empirical data are available on the utility of repeated assessment after obtaining invalid baseline results. OBJECTIVE To document the utility of readministering neurocognitive testing after an invalid baseline test. DESIGN Case series. SETTING Schools, colleges, and universities. PATIENTS OR OTHER PARTICIPANTS A total of 156 athletes who obtained invalid results on ImPACT baseline neurocognitive testing and were readministered the ImPACT baseline test within a 2-week period (mean = 4 days). MAIN OUTCOME MEASURE(S) Overall prevalence of invalid results on reassessment, specific invalidity indicators at initial and follow-up baseline, dependent-samples analysis of variance, with Bonferroni correction for multiple comparisons. RESULTS Reassessment resulted in valid test results for 87.2% of the sample. Poor performance on the design memory and three-letter subscales were the most common reasons for athletes obtaining an invalid baseline result, on both the initial assessment and the reassessment. Significant improvements were noted on all ImPACT composite scores except for reaction time on reassessment. Of note, 40% of athletes showed slower reaction time scores on reassessment, perhaps reflecting a more cautious approach taken the second time. Invalid results were more likely to be obtained by athletes with a self-reported history of attention-deficit disorder or learning disability on reassessments (35%) than on initial baseline assessments (10%). CONCLUSIONS Repeat assessment after the initial invalid baseline performance yielded valid results in nearly 90% of cases. Invalid results on a follow-up assessment may be influenced by a history of attention-deficit disorder or learning disability, the skills and abilities of the individual, or a particular test-taking approach; in these cases, a third assessment may not be useful.
Collapse
|
39
|
Nakayama Y, Covassin T, Schatz P, Nogle S, Kovan J. Examination of the Test-Retest Reliability of a Computerized Neurocognitive Test Battery. Am J Sports Med 2014; 42:2000-5. [PMID: 24907286 DOI: 10.1177/0363546514535901] [Citation(s) in RCA: 45] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND Test-retest reliability is a critical issue in the utility of computer-based neurocognitive assessment paradigms employing baseline and postconcussion tests. Researchers have reported low test-retest reliability for the Immediate Post Concussion Assessment and Cognitive Testing (ImPACT) across an interval of 45 and 50 days. PURPOSE To re-examine the test-retest reliability of the ImPACT between baseline, 45 days, and 50 days. STUDY DESIGN Descriptive laboratory study. METHODS Eighty-five physically active college students (51 male, 34 female) volunteered for this study. Participants completed the ImPACT as well as a 15-item memory test at baseline, 45 days, and 50 days. Intraclass correlation coefficients (ICCs) were calculated for ImPACT composite scores, and change scores were calculated using reliable change indices (RCIs) and regression-based methods (RBMs) at 80% and 95% confidence intervals (CIs). RESULTS The respective ICCs for baseline to day 45, day 45 to day 50, baseline to day 50, and overall were as follows: verbal memory (0.76, 0.69, 0.65, and 0.78), visual memory (0.72, 0.66, 0.60, and 0.74), visual motor (processing) speed (0.87, 0.88, 0.85, and 0.91), and reaction time (0.67, 0.81, 0.71, and 0.80). All ICCs exceeded the threshold value of 0.60 for acceptable test-retest reliability. All cases fell well within the 80% CI for both the RCI and RBM, while 1% to 5% of cases fell outside the 95% CI for the RCI and 1% for the RBM. CONCLUSION Results suggest that the ImPACT is a reliable neurocognitive test battery at 45 and 50 days after the baseline assessment. The current findings agree with those of other reliability studies that have reported acceptable ICCs across 30-day to 1-year testing intervals, and they support the utility of the ImPACT for the multidisciplinary approach to concussion management. CLINICAL RELEVANCE This study suggests that the computerized neurocognitive test battery, ImPACT, is a reliable test for postconcussion serial assessments. However, when managing concussed athletes, the ImPACT should not be used as a stand-alone measure.
Collapse
Affiliation(s)
- Yusuke Nakayama
- Department of Kinesiology, Michigan State University, East Lansing, Michigan, USA
| | - Tracey Covassin
- Department of Kinesiology, Michigan State University, East Lansing, Michigan, USA
| | - Philip Schatz
- Department of Psychology, Saint Joseph's University, Philadelphia, Pennsylvania, USA
| | - Sally Nogle
- Department of Kinesiology, Michigan State University, East Lansing, Michigan, USA
| | - Jeff Kovan
- Department of Kinesiology, Michigan State University, East Lansing, Michigan, USA
| |
Collapse
|
40
|
Broglio SP, Cantu RC, Gioia GA, Guskiewicz KM, Kutcher J, Palm M, Valovich McLeod TC. National Athletic Trainers' Association position statement: management of sport concussion. J Athl Train 2014; 49:245-65. [PMID: 24601910 DOI: 10.4085/1062-6050-49.1.07] [Citation(s) in RCA: 473] [Impact Index Per Article: 47.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE To provide athletic trainers, physicians, and other health care professionals with best-practice guidelines for the management of sport-related concussions. BACKGROUND An estimated 3.8 million concussions occur each year in the United States as a result of sport and physical activity. Athletic trainers are commonly the first medical providers available onsite to identify and evaluate these injuries. RECOMMENDATIONS The recommendations for concussion management provided here are based on the most current research and divided into sections on education and prevention, documentation and legal aspects, evaluation and return to play, and other considerations.
Collapse
|
41
|
Lichtenstein JD, Moser RS, Schatz P. Age and test setting affect the prevalence of invalid baseline scores on neurocognitive tests. Am J Sports Med 2014; 42:479-84. [PMID: 24243771 DOI: 10.1177/0363546513509225] [Citation(s) in RCA: 45] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND Prevalence rates of invalid baseline scores on computerized neurocognitive assessments for high school, collegiate, and professional athletes have been published in the literature. At present, there is limited research on the prevalence of invalid baseline scores in pre-high school athletes. HYPOTHESIS Pre-high school athletes assessed with baseline neurocognitive tests would show higher prevalence rates of invalidity than older youth athletes, and those athletes, regardless of age, who were tested in a large group setting would show a higher prevalence rate of invalidity than athletes tested in a small group setting. STUDY DESIGN Cross-sectional study; Level of evidence, 3. METHODS A total of 502 athletes between the ages of 10 and 18 years completed preseason baseline neurocognitive tests in "large" or "small" groups. All athletes completed the online version of ImPACT (Immediate Post-Concussion Assessment and Cognitive Testing). Baseline test results that were "flagged" by the computer software as being of suspect validity and labeled with a "++" symbol were identified for analysis. Participants were retrospectively assigned to 2 independent groups: large group or small group. Test administration of the large group occurred off-site in groups of approximately 10 athletes, and test administration of the small group took place at a private-practice neuropsychology center with only 1 to 3 athletes present. RESULTS Chi-square analyses identified a significantly greater proportion of participants obtaining invalid baseline results on the basis of age; younger athletes produced significantly more invalid baseline scores (7.0%, 17/244) than older athletes (2.7%, 7/258) (χ2 (1) = 4.99; P = .021). Log-linear analysis revealed a significant age (10-12 years, 13-18 years) × size (small, large) interaction effect (χ2 (4) = 66.1; P < .001) on the prevalence of invalidity, whereby younger athletes tested in larger groups were significantly more likely to provide invalid results (11.9%) than younger athletes tested in smaller groups (5.4%), older athletes tested in larger groups (2.7%), and older athletes tested in smaller groups (2.7%). CONCLUSION Younger athletes tend to exhibit a greater prevalence of invalid baseline results on neurocognitive computerized tests than older youth athletes; the prevalence increases when testing is conducted in a large group and nonclinical setting.
Collapse
Affiliation(s)
- Jonathan D Lichtenstein
- Jonathan D. Lichtenstein, PsyD, Department of Psychiatry, Dartmouth-Hitchcock Medical Center, 1 Medical Center Drive, Lebanon, NH 03756.
| | | | | |
Collapse
|
42
|
McClure DJ, Zuckerman SL, Kutscher SJ, Gregory AJ, Solomon GS. Baseline neurocognitive testing in sports-related concussions: the importance of a prior night's sleep. Am J Sports Med 2014; 42:472-8. [PMID: 24256713 DOI: 10.1177/0363546513510389] [Citation(s) in RCA: 87] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND The management of sports-related concussions (SRCs) utilizes serial neurocognitive assessments and self-reported symptom inventories to assess recovery and safety for return to play (RTP). Because postconcussive RTP goals include symptom resolution and a return to neurocognitive baseline levels, clinical decisions rest in part on understanding modifiers of this baseline. Several studies have reported age and sex to influence baseline neurocognitive performance, but few have assessed the potential effect of sleep. We chose to investigate the effect of reported sleep duration on baseline Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) performance and the number of patient-reported symptoms. HYPOTHESIS We hypothesized that athletes receiving less sleep before baseline testing would perform worse on neurocognitive metrics and report more symptoms. STUDY DESIGN Cross-sectional study; Level of evidence, 3. METHODS We retrospectively reviewed 3686 nonconcussed athletes (2371 male, 1315 female; 3305 high school, 381 college) with baseline symptom and ImPACT neurocognitive scores. Patients were stratified into 3 groups based on self-reported sleep duration the night before testing: (1) short, <7 hours; (2) intermediate, 7-9 hours; and (3) long, ≥9 hours. A multivariate analysis of covariance (MANCOVA) with an α level of .05 was used to assess the influence of sleep duration on baseline ImPACT performance. A univariate ANCOVA was performed to investigate the influence of sleep on total self-reported symptoms. RESULTS When controlling for age and sex as covariates, the MANCOVA revealed significant group differences on ImPACT reaction time, verbal memory, and visual memory scores but not visual-motor (processing) speed scores. An ANCOVA also revealed significant group differences in total reported symptoms. For baseline symptoms and ImPACT scores, subsequent pairwise comparisons revealed these associations to be most significant when comparing the short and intermediate sleep groups. CONCLUSION Our results indicate that athletes sleeping fewer than 7 hours before baseline testing perform worse on 3 of 4 ImPACT scores and report more symptoms. Because SRC management and RTP decisions hinge on the comparison with a reliable baseline evaluation, clinicians should consider sleep duration before baseline neurocognitive testing as a potential factor in the assessment of athletes' recovery.
Collapse
|
43
|
Zuckerman SL, Apple RP, Odom MJ, Lee YM, Solomon GS, Sills AK. Effect of sex on symptoms and return to baseline in sport-related concussion. J Neurosurg Pediatr 2014; 13:72-81. [PMID: 24206343 DOI: 10.3171/2013.9.peds13257] [Citation(s) in RCA: 79] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECT Sport-related concussions (SRCs) among youth athletes represent a significant public health concern. Prior research suggests that females fare worse symptomatically after an SRC. The authors aimed to assess sex differences in number, severity, and resolution of postconcussive symptoms using reliable change index (RCI) methodology applied to days to return to symptom baseline. METHODS Between 2009 and 2011, 740 youth athletes completed valid neurocognitive and symptom testing before and after an SRC using Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). A total of 122 female and 122 male athletes were matched on number of prior concussions, age, and number of days to first postconcussion test. At baseline and postconcussion, the authors compared each of the individual 22 symptoms on ImPACT to calculate individual symptom severity and aggregate symptom severity, or the Total Symptom Score (TSS). When comparing individual symptoms, the significance level for the comparison of each symptom was set at 0.05/22 = 0.0023. When comparing aggregate symptom severity, or TSS, a single value was compared, requiring an alpha set to 0.05. The number of days to return to baseline TSS was compared using RCI methods set at the 80% confidence interval, equal to a raw score point value of 9.18 on the TSS. RESULTS At baseline, females reported a greater severity for the symptom, "sleeping less than usual," compared with males (0.88 ± 1.49 vs 0.31 ± 0.86, p < 0.001). However, no other individual symptom severity differences were noted before or after SRC. At baseline, females exhibited a statistically significant greater aggregate symptom severity than males (7.24 ± 10.22 vs 4.10 ± 6.52, p = 0.005). Greater aggregate symptom severity for females was also found postconcussion (21.38 ± 19.02 vs 16.80 ± 17.07, p = 0.049). Females took longer to return to baseline TSS (9.1 ± 7.1 days vs 7.0 ± 5.1 days, p = 0.013). CONCLUSIONS The results of this retrospective study indicate that females endorse a greater severity of symptoms at baseline and postconcussion than males without significantly different symptom profiles. Furthermore, after suffering an SRC, females take longer to return to their baseline symptom level.
Collapse
Affiliation(s)
- Scott L Zuckerman
- Department of Neurological Surgery, Vanderbilt Sports Concussion Center
| | | | | | | | | | | |
Collapse
|
44
|
Rahman-Filipiak AAM, Woodard JL. Administration and environment considerations in computer-based sports-concussion assessment. Neuropsychol Rev 2013; 23:314-34. [PMID: 24306286 DOI: 10.1007/s11065-013-9241-6] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2013] [Accepted: 11/07/2013] [Indexed: 11/30/2022]
Abstract
Computer-based testing has become a vital tool for the assessment of sport-related concussion (SRC). An increasing number of papers have been published on this topic, focusing on subjects such as the purpose and validity of baseline testing, the performance of special populations on computer-based tests, the psychometric properties of different computerized neurocognitive tools, and considerations for valid and reliable administration of these tools. The current paper describes several considerations regarding computerized test design, input and output devices, and testing environment that should be described explicitly when administering computer-based cognitive testing, regardless of whether the assessment is used for clinical or research purposes. The paper also reviews the conclusions of recent literature (2007-2013) using computer-based testing for the assessment of SRC, with special attention to the methods used in these studies. We also present an appendix checklist for clinicians and researchers that may be helpful in ensuring proper attention to factors that could influence the reliability and validity of computer-based cognitive testing. We believe that explicit attention to these technological factors may lead to the development of standards for the development and implementation of computer-based tests. Such standards have the potential to enhance the accuracy and utility of computer-based tests in SRC.
Collapse
|
45
|
Resch JE, McCrea MA, Cullum CM. Computerized Neurocognitive Testing in the Management of Sport-Related Concussion: An Update. Neuropsychol Rev 2013; 23:335-49. [PMID: 24306287 DOI: 10.1007/s11065-013-9242-5] [Citation(s) in RCA: 73] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2013] [Accepted: 11/11/2013] [Indexed: 10/26/2022]
|
46
|
Zuckerman SL, Lee YM, Odom MJ, Solomon GS, Sills AK. Baseline neurocognitive scores in athletes with attention deficit-spectrum disorders and/or learning disability. J Neurosurg Pediatr 2013; 12:103-9. [PMID: 23790088 DOI: 10.3171/2013.5.peds12524] [Citation(s) in RCA: 95] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECT Up to 16% of children in the US between the ages of 3 and 17 years have either attention deficit-spectrum disorder or a learning disability (LD). Sports-related concussions among youth athletes represent a significant public health concern, and neurocognitive testing is a method to evaluate the severity of cognitive impairment and recovery after a sports-related concussion. The goal of this study was to assess baseline neurocognitive differences between athletes with attention deficit hyperactivity disorder (ADHD) and/or LD versus those with neither disorder and to establish normative data for these special populations. METHODS Between August 2007 and March 2012, 6636 young athletes underwent baseline neurocognitive testing performed using the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) battery. Of these participants, 90 had self-reported LD only, 262 had self-reported ADHD only, and 55 reported both. Those with ADHD and/or LD were matched with 407 participants with no history of ADHD or LD by age, sex, and number of prior concussions. The mean scores and SDs were calculated for each group to obtain normative values. A pairwise comparison between each diagnostic group was done to assess whether LD and/or ADHD diagnostic status predicted participants' baseline neurocognitive scores. RESULTS Participants with ADHD had significantly lower verbal memory, visual memory, and visual motor processing speed scores, along with significantly higher reaction time, impulse control, and symptom scores compared with those without LD or ADHD. Participants with LD had similar results, with significantly lower verbal memory, visual memory, and visual motor processing speed scores, higher reaction time and symptom score, but did not differ in their impulse control score compared with those without LD or ADHD. Participants with both LD and ADHD had a significantly lower visual motor speed score and a significantly higher reaction time and symptom score than those without LD or ADHD, but did not differ with regard to the other composite scores. CONCLUSIONS Athletes with ADHD and/or LD have lower baseline ImPACT neurocognitive scores compared with athletes without ADHD and LD. Preliminary normative neurocognitive data for these special populations are provided.
Collapse
Affiliation(s)
- Scott L Zuckerman
- Department of Neurological Surgery, Vanderbilt Sports Concussion Center, Nashville, Tennessee 37212, USA.
| | | | | | | | | |
Collapse
|
47
|
Schatz P, Ferris CS. One-Month Test-Retest Reliability of the ImPACT Test Battery. Arch Clin Neuropsychol 2013; 28:499-504. [DOI: 10.1093/arclin/act034] [Citation(s) in RCA: 82] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
48
|
Elbin RJ, Kontos AP, Kegel N, Johnson E, Burkhart S, Schatz P. Individual and Combined Effects of LD and ADHD on Computerized Neurocognitive Concussion Test Performance: Evidence for Separate Norms. Arch Clin Neuropsychol 2013; 28:476-84. [DOI: 10.1093/arclin/act024] [Citation(s) in RCA: 128] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
|
49
|
Schatz P, Glatts C. "Sandbagging" Baseline Test Performance on ImPACT, Without Detection, Is More Difficult than It Appears. Arch Clin Neuropsychol 2013; 28:236-44. [DOI: 10.1093/arclin/act009] [Citation(s) in RCA: 70] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Affiliation(s)
- Philip Schatz
- Department of Psychology, Saint Joseph's University, Philadelphia, PA 19131, USA.
| | | |
Collapse
|
50
|
Schatz P, Sandel N. Sensitivity and specificity of the online version of ImPACT in high school and collegiate athletes. Am J Sports Med 2013; 41:321-6. [PMID: 23144368 DOI: 10.1177/0363546512466038] [Citation(s) in RCA: 102] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND The utility of postconcussion neurocognitive testing versus symptom data has been debated. The sensitivity of the desktop version of the Immediate Post-concussion assessment and cognitive testing (ImPACT) tool has been documented, but psychometric properties of the recently released online version of ImPACT have yet to be fully established. PURPOSE To document the sensitivity of the online ImPACT version in samples of (1) symptomatic concussed (high school and collegiate) athletes, and (2) asymptomatic concussed (high school and collegiate) athletes suspected of hiding their concussions. STUDY DESIGN Cohort study; level of evidence, 3. METHODS A total of 81 athletes observed to sustain a concussion by a certified athletic trainer or team physician, a finding that was confirmed with reported postconcussion symptoms, completed the ImPACT test within 3 days of injury. Data were compared with an independent sample of 81 athletes who completed preseason baseline cognitive assessments using ImPACT and who were matched (with concussed athletes) on the basis of sex, age, sport, concussion history, and absence of attention deficit hyperactivity disorder and learning disability. An independent group of 37 athletes who were also observed to sustain a concussion completed ImPACT within 3 days of injury. These athletes reported no postconcussion symptoms but were noted for suspected invalid response patterns on ImPACT (impulse control index >30 and verbal memory index <69%). The subscale data from the assessments (excluding those contributing to the aforementioned indices) were compared with a matched sample of 37 athletes who completed preseason baseline cognitive assessments in ImPACT (using the same criteria described above). RESULTS Data from the ImPACT online version yielded 91.4% sensitivity and 69.1% specificity. For asymptomatic athletes suspected of hiding their concussion, data from ImPACT yielded 94.6% sensitivity and 97.3% specificity. CONCLUSION The online version of the ImPACT tool is a valid measure of neurocognitive performance at the acute stages of concussion, with high levels of sensitivity and specificity, even when athletes appear to be denying postconcussion symptoms.
Collapse
Affiliation(s)
- Philip Schatz
- Saint Joseph's University, Department of Psychology, 222 Post Hall, Philadelphia, PA 19131, USA.
| | | |
Collapse
|