Establishing Test-Retest Reliability and Reliable Change for the King-Devick Test in High School Athletes

Clinical Utility of Ocular Assessments in Sport-Related Concussion: A Scoping Review

Background/objectives: Ocular tools and technologies may be used in the diagnosis of sport-related concussions (SRCs), but their clinical utility can vary. The following study aimed to review the literature pertaining to the reliability and diagnostic accuracy of such assessments. Methods: The preferred reporting items for systematic reviews and meta-analysis (PRISMA) extension for scoping reviews was adhered to. Reference standard reliability (RSR ≥ 0.75) and diagnostic accuracy (RSDA ≥ 0.80) were implemented to aid interpretation. Results: In total, 5223 articles were screened using the PCC acronym (Population, Concept, Context) with 74 included in the final analysis. Assessments included the King-Devick (KD) (n = 34), vestibular-ocular motor screening (VOMs) and/or near point of convergence (NPC) (n = 25), and various alternative tools and technologies (n = 20). The KD met RSR, but RSDA beyond amateur sport was limited. NPC met RSR but did not have RSDA to identify SRCs. The VOMs had conflicting RSR for total score and did not meet RSR in its individual tests. The VOMs total score did perform well in RSDA for SRCs. No alternative tool or technology met both RSR and RSDA. Conclusion: Ocular tools are useful, rapid screening tools but should remain within a multi-modal assessment for SRCs at this time.

Minimal Detectable Change for the ImPACT Subtests at Baseline

OBJECTIVE

To establish the minimal detectable change (MDC) of the subtests that comprise the composite scores from remotely administered Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) baselines.

METHOD

Remote ImPACT baseline data from 172 (male = 45, female = 127) National Collegiate Athletic Association Division I student-athletes from the 2020 and 2021 athletic preseasons were used to calculate the MDC at the 95%, 90%, and 80% confidence intervals (CIs) for all subtest scores used to generate the four core composite scores and the impulse control composite.

RESULTS

The MDCs for the verbal memory subtests at the 95% CI were 10.31 for word memory percent correct, 4.68 for symbol match total correct hidden, and 18.25 for three letters percentage correct. Visual memory subtest MDCs were 19.03 for design memory total percent correct and 4.90 for XO total correct memory. Visual motor speed subtest MDCs were 18.89 for XO total correct interference and 5.40 for three letters average counted correctly. Reaction time (RT) MDCs were 0.12 for XO average correct, 0.95 for symbol match average correct RT, and 0.28 for color match average correct. Impulse control MDCs were 5.97 for XO total incorrect and 1.15 for color match total commissions. One-way repeated measures MANOVA, repeated measures ANOVAs, and Wilcoxon signed-ranks test all suggested no significant difference between any subtests across two remote ImPACT baselines.

CONCLUSIONS

The ImPACT subtest scores did not significantly change between athletic seasons. Our study suggests the subtests be evaluated in conjunction with the composite scores to provide additional metrics for clinical interpretation.

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Monitoring the acute and subacute recovery of cognitive ocular motor changes after a sports-related concussion

Identifying when recovery from a sports-related concussion (SRC) has occurred remains a challenge in clinical practice. This study investigated the utility of ocular motor (OM) assessment to monitor recovery post-SRC between sexes and compared to common clinical measures. From 139 preseason baseline assessments (i.e. before they sustained an SRC), 18 (12 males, 6 females) consequent SRCs were sustained and the longitudinal follow-ups were collected at 2, 6, and 13 days post-SRC. Participants completed visually guided, antisaccade (AS), and memory-guided saccade tasks requiring a saccade toward, away from, and to a remembered target, respectively. Changes in latency (processing speed), visual–spatial accuracy, and errors were measured. Clinical measures included The Sports Concussion Assessment Tool, King-Devick test, Stroop task, and Digit span. AS latency was significantly longer at 2 days and returned to baseline by 13-days post-SRC in females only (P < 0.001). Symptom numbers recovered from 2 to 6 days and 13 days (P < 0.05). Persistently poorer AS visual–spatial accuracy was identified at 2, 6 and 13 days post-SRC (P < 0.05) in both males and females but with differing trajectories. Clinical measures demonstrated consistent improvement reminiscent of practice effects. OM saccade assessment may have improved utility in tracking recovery compared to conventional measures and between sexes.

An investigation into the measurement properties of the King-Devick Eye Tracking system

Objectives

Eye tracking has been gaining increasing attention as a possible assessment and monitoring tool for concussion. The King-Devick test (K-DT) was expanded to include an infrared video-oculography-based eye tracker (K-D ET). Therefore, the aim was to provide evidence on the reliability of the K-D ET system under an exercise condition.

Methods

Participants (N = 61; 26 male, 35 female; age range 19-25) were allocated to an exercise or sedentary group. Both groups completed a baseline K-D ET measurement and then either two 10-min exercise or sedentary interventions with repeated K-D ET measurements between interventions.

Results

The test-retest reliability of the K-D ET ranged from good to excellent for the different variables measured. The mean ± SD of the differences for the total number of saccades was 1.04 ± 4.01 and there was an observable difference (p = 0.005) in the trial number. There were no observable differences for the intervention (p = 0.768), gender (p = 0.121) and trial (p = 0.777) for average saccade’s velocity. The mean ± SD of the difference of the total fixations before and after intervention across both trials was 1.04 ± 3.63 and there was an observable difference in the trial number (p = 0.025). The mean ± SD of the differences for the Inter-Saccadic Interval and the fixation polyarea before and after intervention across both trials were 1.86 ± 22.99 msec and 0.51 ± 59.11 mm2 and no observable differences for the intervention, gender and trial.

Conclusion

The results provide evidence on the reliability of the K-D ET, and the eye-tracking components and demonstrate the relationship between completion time and other variables of the K-D ET system. This is vital as the use of the K-DT may be increasing and the combination of the K-DT and eye tracking as one single package highlights the need to specifically measure the reliability of this combined unit.