Test–retest reliability of the Vestibular Ocular Motor Screening (VOMS) tool and modified Balance Error Scoring System (mBESS) in US military personnel

Test-Retest Reliability and Reliable Change Estimates for Sensorimotor Concussion Assessments in Healthy Young Adults

CONTEXT

Sensorimotor impairments are common sequela following concussion, but recovery following a concussion is often determined through examiner scored clinical testing. There are emerging technologies that provide objective methods to determine physiological impairment after concussion, but the psychometrics of these tools are lacking and must be established for use in clinical practice.

OBJECTIVE

The purpose of this study was to examine the test-retest reliability and provide reliable change estimates in healthy young adults for outcomes from 3 emerging technologies providing objective assessments of sensorimotor function in healthy young adults.

DESIGN

Test-retest reliability design in a laboratory setting.

METHODS

Healthy, young adults completed testing at 2 time points 4 weeks apart on the Bertec Vision Trainer, the Concussion Balance Test (COBALT), and the Neurolign Dx-100 eye-tracking system. We determined test-retest reliability using intraclass correlation coefficients with a 2-way mixed-effects model absolute agreement. Reliable change estimates were calculated for 70%, 80%, 90%, and 95% CIs.

RESULTS

Participants included 30 healthy young adults (age = 25 [5] y, interquartile range = 20-29; range = 18-38; 17% [57%] women). Test-retest reliability for the Bertec Vision Trainer outcomes ranged from 0.56 to 0.88, with 45% of the outcomes being classified as clinically acceptable (>.70 intraclass correlation coefficients ); for COBALT conditions, sway velocity ranged from 0.50 to 0.95, 95% ellipse area ranged from -0.22 to 0.88, and Sway Score ranged from 0.07 to 0.85, with 50% of COBALT metrics being clinically acceptable; and for the Dx-100, outcomes ranged from -0.20 to 0.89, with 52% being clinically acceptable.

CONCLUSIONS

Overall, test-retest reliability was moderate-to-good for the Bertec Vision Trainer assessment outcomes but were highly variable for outcomes of postural control using the COBALT and eye-tracking metrics using the Dx-100. This study adds clinically relevant test-retest reliability and reliable change estimates in healthy adults for 3 commercially available sensorimotor assessments.

Leg Dominance Effects During Single- and Dual-Task Modified Balance Error Scoring System Assessment in Collegiate and High School Athletes

Background

The modified Balance Error Scoring System (mBESS) incorporates nondominant leg stance for a ceiling effect, but that may not be the worse balancing leg. Updated recommendations call for single- and dual-task tandem gait, but limited research has explored these effects on the mBESS.

Purposes

To compare mBESS performance between dominant and nondominant legs during single and dual tasks and to determine 1-week test-retest reliability.

Study Design

Cross-sectional study; Level of evidence, 3.

Methods

A total of 119 intercollegiate, collegiate club, and high school athletes were administered a baseline mBESS battery consisting of performance on both legs and during single and dual task at 2 time points, 1 week apart. Measures consisted of mBESS errors and sway index during counterbalanced single- and dual-task conditions on dominant and nondominant legs. Wilcoxon signed-rank tests were conducted to determine differences in errors and sway index between dominant and nondominant legs and single- and dual-task performance. Spearman correlations were used to measure reliability at 1 week ± 2 days.

Results

No differences were observed between nondominant and dominant single-leg errors (P = .79) and sway index (P = .98), nor tandem stance errors (P = .95) and sway index (P = .86). Greater errors were committed during dual-task single-leg stance (P = .05) but not on sway index (P = .69). No differences existed between single and dual tasks on tandem errors (P = .63) and sway index (P = .53). Test-retest coefficients were weak to moderate (rs = -0.009 to 0.368) for normal mBESS errors and fair for sway index (rs = 0.389 to 0.442) at a 1-week interval.

Conclusion

Our study demonstrated that leg dominance does not appear to affect mBESS errors or sway index, indicating that either leg may be used, in the absence of lower extremity injury history or instability. Incorporation of a dual task provides little clinical utility and may not be specific enough to elicit postural control changes on the mBESS, further indicating the use of optional foam conditions or single- and dual-task tandem gait. Caution is needed when using mBESS after a 1-week time point.

Comparison of Vestibular/Ocular Motor Screening (VOMS) and Computerized Eye-tracking to Identify Exposure to Repetitive Head Impacts

INTRODUCTION

Military service members (SMs) are exposed to repetitive head impacts (RHIs) in combat and training that are purported to adversely affect brain health, including cognition, behavior, and function. Researchers have reported that RHI from blast-related exposure may affect both vestibular and ocular function, which in turn may be related to symptomology. As such, an examination of the effects of RHI on exposed military SMs should incorporate these domains. To date, researchers have not compared groups of exposed special operations forces (SOF) operators on combined clinical vestibular/ocular and eye-tracker-based outcomes. Therefore, the primary purpose of this study was to compare participant-reported symptoms and performance on the Vestibular/Ocular Motor Screening (VOMS) tool with performance on the computerized RightEye tracking system between SOF operators exposed to blast-related RHI and healthy controls without blast-related exposure. In addition, the study aimed to compare subgroups of snipers and breachers exposed to RHI to controls on the preceding metrics, as well as identify a subset of individual (demographic) factors, participant-reported symptoms, and performance metrics on VOMS and RightEye that best identify SOF operators exposed to RHI from unexposed controls.

MATERIALS AND METHODS

The study involved a cross-sectional design including 25 Canadian SOF SMs comprised of breachers (n = 9), snipers (n = 9), and healthy, unexposed controls (n = 7). The former 2 groups were combined into an RHI group (n = 18) and compared to controls (n = 7). Participants provided demographics and completed a self-reported concussion-related symptom report via the Military Acute Concussion Evaluation 2, the VOMS, and RightEye computerized eye-tracking assessments. Independent samples t-tests and ANOVAs were used to compare the groups on the outcomes, with receiver operating characteristic curve and area under the curve (AUC) analyses to identify predictors of blast exposure. This study was approved by the Defence Research Development Canada Human Research Ethics Committee and the Canadian Forces Surgeon General/Special Forces Command.

RESULTS

The results from t-tests supported group differences for age (P = .012), participant-reported symptoms (P = .006), and all VOMS items (P range = <.001-.02), with the RHI group being higher than healthy controls on all variables. ANOVA results supported group differences among snipers, breachers, and controls for age (P = .01), RightEye saccades (P = .04), participant-reported total symptom severity (P = .03), and VOMS total scores (P = .003). The results of the receiver operating characteristic curve analyses supported age (AUC = 0.81), Military Acute Concussion Evaluation 2 participant-reported total symptom severity (AUC = 0.87), and VOMS total scores (AUC = 0.92) as significant predictors of prior blast exposure.

CONCLUSIONS

Participant-reported concussion symptoms, VOMS scores, and age were useful in identifying SOF operators exposed to RHI from controls. RightEye metrics were not useful in differentiating RHI groups from controls. Differences between snipers and breachers warrant further research. Overall, the findings suggest that VOMS may be a useful tool for screening for the effects of exposure to RHI in SOF operators. Future investigations should be conducted on a larger sample of military SMs, consider additional factors (e.g., RHI exposure levels, medical history, and sex), and include additional assessment domains (e.g., balance, cognitive, and psychological).

Utility of the Vestibular/Ocular Motor Screening in Military Medicine: A Systematic Review

INTRODUCTION

The Vestibular/Ocular Motor Screening (VOMS) was created as a brief clinical screening tool for identifying vestibular and ocular motor symptoms and impairments post-concussion. It was found to have predictive validity in correctly identifying concussed athletes from healthy controls. In 2018, the Military Acute Concussion Evaluation 2 (MACE2) replaced the original Military Acute Concussion Evaluation (MACE); the most prominent change between the MACE and MACE2 was the addition of the VOMS. Despite its adoption into military medicine, it is not known if the addition of the VOMS to the MACE2 is acutely helpful, and if it provides additional information for diagnosis, prognosis, and/or management. The purposes of this systematic review were: (1) to determine the utility of the VOMS in correctly identifying concussed individuals, particularly as it pertains to military medicine; (2) to explore the extent to which the VOMS can inform concussion prognosis; and (3) to establish the value of the VOMS as a measure for monitoring the evolution of symptoms throughout a service member's course of care.

MATERIALS AND METHODS

A comprehensive search of PubMed was performed from January 1, 2014 through August 16, 2023. Articles were included if they researched concussion or a related health condition or healthy controls and administered the VOMS. Articles were excluded if they discussed health conditions other than concussion; did not administer the VOMS; or were written in languages other than English. The tools used to assess methodological quality and risk of bias varied according to study design. Articles were classified into three primary domains: diagnosis, prognosis, and/or rehabilitation/recovery over time.

RESULTS

A total of 231 articles were retrieved and 3 were duplicates, leaving 228 articles for review. Of the 228 articles screened, 100 relevant full-text articles were assessed for eligibility. Fifty-nine articles met our inclusion and exclusion criteria while the other 41 articles were rejected. Thirty-two articles helped to inform diagnosis, 15 prognosis, and 16 rehabilitation/recovery over time.

CONCLUSIONS

The VOMS had excellent internal consistency and moderate to good test-retest reliability; however, a false-positive rate of 21.9% was found. Most studies indicated that a positive VOMS was associated with a delayed recovery. Several studies indicated that VOMS scores improved with targeted, active interventions and/or a symptom-guided progressive return to activity. The greatest limitation was the paucity of published evidence in the military population. More research is needed on the use of the VOMS in service members.

Testing the Validity and Reliability of a Standardized Virtual Examination for Concussion

Background and Objectives

We determined inter-modality (in-person vs telemedicine examination) and inter-rater agreement for telemedicine assessments (2 different examiners) using the Telemedicine Buffalo Concussion Physical Examination (Tele-BCPE), a standardized concussion examination designed for remote use.

Methods

Patients referred for an initial evaluation for concussion were invited to participate. Participants had a brief initial assessment by the treating neurologist. After a patient granted informed consent to participate in the study, the treating neurologist obtained a concussion-related history before leaving the examination room. Using the Tele-BCPE, 2 virtual examinations in no specific sequence were then performed from nearby rooms by the treating neurologist and another neurologist. After the 2 telemedicine examinations, the treating physician returned to the examination room to perform the in-person examination. Intraclass correlation coefficients (ICC) determined inter-modality validity (in-person vs remote examination by the same examiner) and inter-rater reliability (between remote examinations done by 2 examiners) of overall scores of the Tele-BCPE within the comparison datasets. Cohen's kappa, κ, measured levels of agreement of dichotomous ratings (abnormality present vs absent) on individual components of the Tele-BCPE to determine inter-modality and inter-rater agreement.

Results

For total scores of the Tele-BCPE, both inter-modality agreement (ICC = 0.95 [95% CI 0.86-0.98, p < 0.001]) and inter-rater agreement (ICC = 0.88 [95% CI 0.71-0.95, p < 0.001]) were reliable (ICC >0.70). There was at least substantial inter-modality agreement (κ ≥ 0.61) for 25 of 29 examination elements. For inter-rater agreement (2 telemedicine examinations), there was at least substantial agreement for 8 of 29 examination elements.

Discussion

Our study demonstrates that the Tele-BCPE yielded consistent clinical results, whether conducted in-person or virtually by the same examiner, or when performed virtually by 2 different examiners. The Tele-BCPE is a valid indicator of neurologic examination findings as determined by an in-person concussion assessment. The Tele-BCPE may also be performed with excellent levels of reliability by neurologists with different training and backgrounds in the virtual setting. These findings suggest that a combination of in-person and telemedicine modalities, or involvement of 2 telemedicine examiners for the same patient, can provide consistent concussion assessments across the continuum of care.

Long-term test-retest reliability of the vestibular/ocular motor screening for concussion in child athletes: A preliminary study

The Vestibular/Ocular Motor Screening (VOMS) is a sport-related concussion screening tool that assesses vestibular ocular reflex (VOR) and oculomotor symptom provocation. Long-term test-retest reliability of the VOMS over multiple athletic seasons has not yet been established in a pediatric population. Fifty-one child athletes (females = 28, 54.9%) 8-13 years of age, completed a baseline VOMS assessment at two timepoints, 18 months apart. Cronbach's alpha was used to examine the internal consistency at both time points. Two-way mixed intra-class correlation coefficients and Cohen's Kappa statistics were used to evaluate test-retest reliability. High internal consistency existed at both initial (α = 0.91) and follow-up (α = 0.95) for VOMS symptom provocation items. Strong inter-item correlations were noted between vertical VOR (r = ≥0.70) and visual motion sensitivity (VMS) (r = ≥0.70). Fair agreement was produced for convergence (κ = 0.23, vertical VOR (κ = 0.25) and VMS (κ = 0.25), as well as reliability on NPC distance (ICC2,k = 0.31). All other VOMS scores yielded poor agreement between time points. Symptom provocation was the same for 49% of athletes between timepoints, while 31.4% had a decrease in scoring at follow-up. Symptom provocation from VOMS tasks lessened with increasing age and time; therefore, clinicians should consider annual baseline testing to improve accuracy for concussion evaluation and management in pediatrics.

Clinical Utility of Ocular Assessments in Sport-Related Concussion: A Scoping Review

Background/objectives: Ocular tools and technologies may be used in the diagnosis of sport-related concussions (SRCs), but their clinical utility can vary. The following study aimed to review the literature pertaining to the reliability and diagnostic accuracy of such assessments. Methods: The preferred reporting items for systematic reviews and meta-analysis (PRISMA) extension for scoping reviews was adhered to. Reference standard reliability (RSR ≥ 0.75) and diagnostic accuracy (RSDA ≥ 0.80) were implemented to aid interpretation. Results: In total, 5223 articles were screened using the PCC acronym (Population, Concept, Context) with 74 included in the final analysis. Assessments included the King-Devick (KD) (n = 34), vestibular-ocular motor screening (VOMs) and/or near point of convergence (NPC) (n = 25), and various alternative tools and technologies (n = 20). The KD met RSR, but RSDA beyond amateur sport was limited. NPC met RSR but did not have RSDA to identify SRCs. The VOMs had conflicting RSR for total score and did not meet RSR in its individual tests. The VOMs total score did perform well in RSDA for SRCs. No alternative tool or technology met both RSR and RSDA. Conclusion: Ocular tools are useful, rapid screening tools but should remain within a multi-modal assessment for SRCs at this time.

Single-Task and Dual-Task Gait Performance After Sport-Related Concussion: A Machine Learning Statistical Approach

BACKGROUND

This study evaluated 2 different dual-task (DT) conditions during tandem gait (TG) to predict sport-related concussion (SRC) diagnosis.

HYPOTHESIS

The best (fastest) single-task (ST) gait will differ between groups (controls vs SRC; baseline vs SRC), with auditory pure switching task (APST) response rate being the most important behavioral variable to aid prediction of SRC.

STUDY DESIGN

Cohort design.

LEVEL OF EVIDENCE

Level 3.

METHODS

A total of 409 National Collegiate Athletic Association Division I student-athlete controls and 21 team-physician-diagnosed SRC participated. All data were collected at preseason physicals (baseline) and within 7 days of injury for SRC. Each participant completed 3 conditions of TG in a pseudorandomized order: (1) ST, (2) DT with serial-7s (SS) subtractions, and (3) DT with APST. Outcomes of time-to-complete for TG and behavioral (eg, responses per second) for SS and APST were recorded for each trial.

RESULTS

ST Trials 2 (P = 0.03) and 3 (P = 0.01) were significantly different between controls and SRC. ST Trial 3 (P = 0.04) was significantly different between baseline and SRC. Average responses per second for APST were significantly different between- (P < 0.01) and within- (P = 0.01) group.

CONCLUSION

The results suggest that ST is significantly slower after SRC. However, DT (both SS and APST) time-to-complete are also important variables when predicting the SRC diagnosis. It is advised that both ST and DT be administered when making clinical decisions regarding postural instability after SRC.

CLINICAL RELEVANCE

The best ST TG time to complete gait is an important objective marker of concussion while DT paradigms, specifically SS and APST, are highly variable. DT may be more useful for clinical observable signs of SRC. Both SS and APST have unique usefulness, but APST response rate per second can be relied upon numerically for clinical decisions.

Normative Values for Pupillary Light Reflex Metrics Among Healthy Service Academy Cadets

INTRODUCTION

Assessments of the pupil's response to light have long been an integral part of neurologic examinations. More recently, the pupillary light reflex (PLR) has shown promise as a potential biomarker for the diagnosis of mild traumatic brain injury. However, to date, few large-scale normative data are available for comparison and reference, particularly, in military service members. The purpose of this study was to report normative values for eight PLR measurements among healthy service academy cadets based on sex, age, sleep, race, ethnicity, anisocoria, and concussion history.

METHODS

Freshmen entering a U.S. Service Academy completed a quantitative pupillometric assessment in conjunction with baseline concussion testing. PLR measurements were conducted using a Neuroptics PLR-3000 with a 121 µW light stimulus. The device measured maximum and minimum pupil diameter (mm), latency (time to maximum pupil constriction post-light stimulus [s]), peak and average constriction velocity (mm/s), average dilation velocity (mm/s), percentage pupil constriction, and T75 (time for pupil re-dilation from minimum pupil diameter to 75% maximum diameter [s]). During baseline testing, cadets also reported concussion history (yes and no) and hours slept the night before (<5.5 and ≥5.5). Normative values for each PLR measurement were calculated as mean ± SD, percentiles, and interquartile range. Mann-Whitney U tests were used to assess differences based on sex, concussion history, ethnicity, and hours slept for each PLR measurement. Kruskall-Wallis testing was used to assess differences based on age, race, and anisocoria. Alpha was set at .05 and nonparametric effect sizes (r) were calculated for statistically significant results. Effect sizes were interpreted as no effect (r < .1), small (r ≥.1-<.3), medium (r ≥.3-<.5), or large (r ≥ .5). All procedures were reviewed and approved by the local institutional review board and the U.S. Army Human Research Protection Office before the study was conducted. Each subject provided informed consent to participate in the study before data collection.

RESULTS

Of the 1,197 participants baselined, 514 cadets (131 female; 18.91 ± 0.96 years) consented and completed a valid baseline pupillometric assessment. Eighty participants reported at least one previous concussion and participants reported an average of 5.88 ± 1.63 h slept the previous night. Mann-Whitney U results suggest females had larger initial (z = -3.240; P = .001; r = .10) and end pupil diameter (z = -3.080; P = .002; r = .10), slower average dilation velocity (z = 3.254; P = .001; r = .11) and faster T75 values (z = -3.342; P = .001; r = .11). Age, sleep, and race stratified by sex, also displayed a significant impact on specific PLR metrics with effect sizes ranging from small to medium, while ethnicity, anisocoria, and concussion history did not display an impact on PLR metrics.

CONCLUSION

This study provides the largest population-specific normative values for eight PLR measurements. Initial and end pupil diameter, dilation velocity, and the T75 metrics differed by sex; however, these differences may not be clinically significant as small effect size was detected for all metrics. Sex, age, sleep, and race may impact specific PLR metrics and are worth consideration when performing PLR assessments for mild traumatic brain injury management.

False-Positive Rates, Risk Factors, and Interpretations of the Vestibular/Ocular Motor Screening in Collegiate Athletes

CONTEXT

Biological sex and history of motion sickness are known modifiers associated with a false-positive baseline Vestibular/Ocular Motor Screening (VOMS). However, other factors may be associated with a false-positive VOMS in collegiate athletes.

OBJECTIVE

To identify contributing factors to false-positive VOMS assessments using population-specific criteria. We also critically appraised previously reported interpretation criteria.

DESIGN

Descriptive laboratory study.

SETTING

Single-site collegiate athletic training clinic.

PATIENTS OR OTHER PARTICIPANTS

National Collegiate Athletic Association Division I athletes (n = 462 [41% female]) aged 18.8 ± 1.4 years.

MAIN OUTCOME MEASURE(S)

Participants completed the Athlete Sleep Behavior Questionnaire, the 7-Item Generalized Anxiety Index, the Immediate Postconcussion Assessment and Cognitive Testing battery, the Patient Health Questionnaire-9, the Revised Head Injury Scale, the Sensory Organization Test, and the VOMS as part of a multidimensional baseline concussion assessment. Participants were classified into 2 groups based on whether they had a total symptom score of greater than or equal to 8 after VOMS administration, excluding the baseline checklist. We used χ2 and independent t tests to compare group demographics. A binary logistic regression with adjusted odds ratios (ORs) was used to evaluate the influence of sex, corrected vision, attention-deficit/hyperactivity disorder, Immediate Postconcussion Assessment and Cognitive Testing composite scores, concussion history, history of treatment for headache and/or migraine, Generalized Anxiety Index scores, Patient Health Questionnaire-9 scores, Athlete Sleep Behavior Questionnaire scores, and Sensory Organization Test equilibrium scores and somatosensory, visual, and vestibular sensory ratios on false-positive rates.

RESULTS

Approximately 9.1% (42 of 462 [30 females]) met criteria for a false-positive VOMS. A significantly greater proportion of females had false positives (χ21 = 18.37, P < .001). Female sex (OR = 2.79; 95% CI = 1.17, 6.65; P = .02) and history of treatment for headache (OR = 4.99; 95% CI = 1.21, 20.59; P = .026) were the only significant predictors of false-positive VOMS. Depending on cutoff interpretation, false-positive rates using our data ranged from 9.1% to 22.5%.

CONCLUSIONS

Our results support the most recent interpretation guidelines for the VOMS in collegiate athletes due to a low false-positive rate and ease of interpretation. Biological sex and history of headaches should be considered when administering the VOMS in the absence of a baseline.

Reconsidering Vestibular/Ocular Motor Screening Cutoff Scores for Concussion

INTRODUCTION

Vestibular/Ocular Motor Screening (VOMS) is often part of a comprehensive evaluation to identify acute mild traumatic brain injury. Most of the reports describe the use of the VOMS in adolescents/young adults and not in older adults or military service members. The purpose of this study was to describe VOMS findings in healthy civilians and active duty military service members up to the age of 50 years.

MATERIALS AND METHODS

Seventy-seven healthy civilians between 18 and 50 years of age (22 males, age 31.8 [9.0] years) participated across three sites in addition to 40 healthy active duty service members (25 males, age 27.5 [4.9] years) from one site. Demographics, Neurobehavioral Symptom Inventory scores, mean near point convergence (NPC) distance, and Total Symptom Change (TSS) scores from the VOMS were evaluated.

RESULTS

For civilians, the group mean NPC distance was 4.98 (3.8) cm. For military service members, the group mean NPC distance was 6.17 (4.57) cm. For civilians, the mean TSS was 1.2 (2.3) with 53.2% reporting 0 TSS, 27.3% reporting one TSS, and 19.5% reporting two or more TSS. For military service members, the mean TSS was 0.20 (0.72) with 92.5% reporting 0 TSS, 0% reporting one TSS, and 7.5% reporting two or more TSS. Age did not correlate with the mean NPC distance and TSS in healthy civilians and active duty military service members.

CONCLUSIONS

Reconsideration of the Military Acute Concussion Evaluation, Version 2 cutoff value for abnormal mean NPC distance may be warranted to improve diagnostic accuracy in both civilian and military adult populations. Similarly, re-evaluating criteria for interpreting the TSS results of the VOMS, specifically in civilians, may be warranted.

Validity and Reliability of Methods to Assess Movement Deficiencies Following Concussion: A COSMIN Systematic Review

BACKGROUND

There is an increased risk of subsequent concussion and musculoskeletal injury upon return to play following a sports-related concussion. Whilst there are numerous assessments available for clinicians for diagnosis and during return to play following concussion, many may lack the ability to detect these subclinical changes in function. Currently, there is no consensus or collated sources on the reliability, validity and feasibility of these assessments, which makes it difficult for clinicians and practitioners to select the most appropriate assessment for their needs.

OBJECTIVES

This systematic review aims to (1) consolidate the reliability and validity of motor function assessments across the time course of concussion management and (2) summarise their feasibility for clinicians and other end-users.

METHODS

A systematic search of five databases was conducted. Eligible studies were: (1) original research; (2) full-text English language; (3) peer-reviewed with level III evidence or higher; (4) assessed the validity of lower-limb motor assessments used to diagnose or determine readiness for athletes or military personnel who had sustained a concussion or; (5) assessed the test-retest reliability of lower-limb motor assessments used for concussion management amongst healthy athletes. Acceptable lower-limb motor assessments were dichotomised into instrumented and non-instrumented and then classified into static (stable around a fixed point), dynamic (movement around a fixed point), gait, and other categories. Each study was assessed using the COSMIN checklist to establish methodological and measurement quality.

RESULTS

A total of 1270 records were identified, with 637 duplicates removed. Titles and abstracts of 633 records were analysed, with 158 being retained for full-text review. A total of 67 records were included in this review; 37 records assessed reliability, and 35 records assessed the validity of lower-limb motor assessments. There were 42 different assessments included in the review, with 43% being non-instrumented, subjective assessments. Consistent evidence supported the use of instrumented assessments over non-instrumented, with gait-based assessments demonstrating sufficient reliability and validity compared to static or dynamic assessments.

CONCLUSION

These findings suggest that instrumented, gait-based assessments should be prioritised over static or dynamic balance assessments. The use of laboratory equipment (i.e. 3D motion capture, pressure sensitive walkways) on average exhibited sufficient reliability and validity, yet demonstrate poor feasibility. Further high-quality studies evaluating the reliability and validity of more readily available devices (i.e. inertial measurement units) are needed to fill the gap in current concussion management protocols. Practitioners can use this resource to understand the accuracy and precision of the assessments they have at their disposal to make informed decisions regarding the management of concussion.

TRAIL REGISTRATION

This systematic review was registered on PROSPERO (reg no. CRD42021256298).

Association of Multidomain Assessment Outcomes With Referral for Vestibular Therapy After Concussion

CONTEXT

Multiple aspects of a multidomain assessment have been validated for identifying concussion; however, researchers have yet to determine which components are related to referral for vestibular therapy.

OBJECTIVE

To identify which variables from a multidomain assessment were associated with receiving a referral for vestibular therapy after a concussion.

DESIGN

Retrospective chart review, level of evidence 3.

PATIENTS OR OTHER PARTICIPANTS

Participants (n = 331; age = 16.9 ± 7.2 years; 39.3% female) were diagnosed with a concussion per international consensus criteria by a clinical neuropsychologist after presenting to a concussion specialty clinic.

MAIN OUTCOME MEASURE(S)

Medical chart data were extracted from the first clinical visit regarding preinjury medical history, computerized neurocognition, Post-Concussion Symptom Scale, Concussion Clinical Profiles Screen, and Vestibular Ocular Motor Screening within 16.2 ± 46.7 days of injury. We built 5 backwards logistic regression models to associate the outcomes from each of the 5 assessments with referral for vestibular therapy. A final logistic regression model was generated using variables retained in the previous 5 models as potential predictors of referral for vestibular therapy.

RESULTS

The 5 models built from individual components of the multidomain assessment predicted referral for vestibular therapy (R2 = 0.01-0.28) with 1 to 6 statistically significant variables. The final multivariate model (R2 = 0.40) retained 9 significant variables, represented by each of the 5 multidomain assessments except neurocognition. Variables that had the strongest association with vestibular therapy referral were motor vehicle accident mechanism of injury (odds ratio [OR] = 15.45), migraine history (OR = 3.25), increased headache when concentrating (OR = 1.81), and horizontal vestibular ocular reflex (OR = 1.63).

CONCLUSIONS

We demonstrated the utility of a multidomain assessment and identified outcomes associated with a referral for vestibular therapy after a concussion.

The Clinical Utility of the Child SCAT5 for Acute Concussion Assessment

Background

The Child Sport Concussion Assessment Tool 5th Edition (Child SCAT5) was developed to evaluate children between 5 and 12 years of age for a suspected concussion. However, limited empirical evidence exists demonstrating the value of the Child SCAT5 for acute concussion assessment. Therefore, the purpose of our study was to examine differences and assess the diagnostic properties of Child SCAT5 scores among concussed and non-concussed middle school children on the same day as a suspected concussion.

Methods

Our participants included 34 concussed (21 boys, 13 girls; age = 12.8 ± 0.86 years) and 44 non-concussed (31 boys, 13 girls; age = 12.4 ± 0.76 years) middle school children who were administered the Child SCAT5 upon suspicion of a concussion. Child SCAT5 scores were calculated from the symptom evaluation (total symptoms, total severity), child version of the Standardized Assessment of Concussion (SAC-C), and modified Balance Error Scoring System (mBESS). The Child SCAT5 scores were compared between the concussed and non-concussed groups. Non-parametric effect sizes (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r=\frac{Z}{\sqrt{n}}$$\end{document}r=Zn) were calculated to assess the magnitude of difference for each comparison. The diagnostic properties (sensitivity, specificity, diagnostic accuracy, predictive values, likelihood ratios, and diagnostic odds ratio) of each Child SCAT5 score were also calculated.

Results

Concussed children endorsed more symptoms (p < 0.001, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r$$\end{document}r=0.45), higher symptom severity (p < 0.001, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r$$\end{document}r=0.44), and had higher double leg (p = 0.046, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r$$\end{document}r=0.23), single leg (p = 0.035, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r$$\end{document}r=0.24), and total scores (p = 0.022, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r$$\end{document}r=0.26) for the mBESS than the non-concussed children. No significant differences were observed for the SAC-C scores (p’s ≥ 0.542). The quantity and severity of endorsed symptoms had the best diagnostic accuracy (AUC = 0.76–0.77), negative predictive values (NPV = 0.84–0.88), and negative likelihood ratios (-LR = 0.22–0.31) of the Child SCAT5 scores.

Conclusions

Clinicians should prioritize interpretation of the symptom evaluation form of the Child SCAT5 as it was the most effective component for differentiating between concussed and non-concussed middle school children on the same day as a suspected concussion.

Optimizing VOMS for identifying acute concussion in collegiate athletes: Findings from the NCAA-DoD CARE consortium

The Vestibular/Ocular-Motor Screening (VOMS), an important component in acute (<72 h) sport-related concussion (SRC) assessment, is increasingly used alongside the Sport Concussion Assessment Tool (SCAT) and as part of the Military Acute Concussion Evaluation 2 (MACE2). VOMS demonstrates clinically useful diagnostic accuracy for acute SRC and improves the overall utility when added to the SCAT3. However, potential overlap among VOMS's vestibular and oculomotor items suggests the possibility of a more efficient version. VOMS and SCAT3 scores were analyzed for 3,958 preseason (47.8% female) and 496 acute-SRC (37.5% female) NCAA-DoD Concussion Assessment, Research, and Education (CARE) consortium collegiate athlete evaluations. Analyses revealed very large effect sizes (d = 2.39-2.45) and high correlations (rho = 0.95-0.99) among all VOMS items except near point of convergence distance (d = 0.79, rho ≤ 0.341). Receiver operating characteristic (ROC) curve analyses showed clinically useful discriminative utility for VOMS Total (AUC = 0.85) and the VOMS Total change score, where pretest symptoms were incorporated (AUC = 0.81). A modified VOMS (mVOMS) consisting of four items (smooth pursuits, horizontal saccades, horizontal vestibulo-ocular reflex, visual motion sensitivity) yielded identical AUCs to VOMS Total. Integer cutoff analyses suggest a score of ≥4 for VOMS Total and ≥4 for mVOMS Total optimizes concussion identification. Incorporating VOMS or mVOMS into SCAT3 (AUC = 0.79) significantly improved the combined tool's acute utility for acute concussion identification by a maximum of 4% (SCAT3+VOMS AUC = 0.84, SCAT3+mVOMS AUC = 0.83). Future versions of SCAT or MACE may want to consider incorporating a more parsimonious VOMS for the purpose of identifying acute concussion.

Exploring Vestibular Ocular Motor Screening in Adults With Persistent Complaints After Mild Traumatic Brain Injury

OBJECTIVE

The purpose of this study was to (1) explore differences in vestibular ocular motor screening (VOMS) symptoms between healthy adults and adults with persistent symptoms after mild traumatic brain injury (mTBI), and (2) explore the relationships between VOMS symptoms and other measures (self-reported vestibular symptoms, clinical measures of balance and gait, and higher-level motor ability tasks).

SETTING

Research laboratory setting.

PARTICIPANTS

Fifty-three persons with persistent symptoms (>3 weeks) following mTBI and 57 healthy controls were recruited. Eligibility for participation included being 18 to 50 years of age and free of medical conditions that may affect balance, with the exception of recent mTBI for the mTBI group.

DESIGN

Cross-sectional.

MAIN MEASURES

The primary outcomes were the VOMS symptom scores and near point of convergence (NPC) distance. Secondary outcomes included the Dizziness Handicap Inventory (DHI) total and subdomain scores, sway area, Functional Gait Analysis total score, gait speed, and modified Illinois Agility Task completion time, and Revised High-Level Mobility Assessment Tool total score.

RESULTS

The mTBI group reported more VOMS symptoms ( z range, -7.28 to -7.89) and a further NPC ( t = -4.16) than healthy controls (all P s < .001). DHI self-reported symptoms (total and all subdomain scores) were strongly associated with the VOMS symptom scores (rho range, 0.53-0.68; all P s < .001). No significant relationships existed between VOMS symptoms and other measures.

CONCLUSION

Significant group differences support the relevance of the VOMS for mTBI in an age-diverse sample with persistent symptoms. Furthermore, strong association with DHI symptoms supports the ability of the VOMS to capture vestibular complaints in this population.

Vestibulo-ocular dysfunction in mTBI: Utility of the VOMS for evaluation and management – A review

BACKGROUND: Individuals who have suffered a concussion/mild traumatic brain injury (mTBI) frequently report symptoms associated with vestibular and/or oculomotor dysfunction (VOD) like dizziness, nausea, fatigue, brain fog, headache, gait and neurocognitive impairments which are associated with the development of chronic symptoms. The Vestibular/Ocular Motor Screening (VOMS) tool has been established as a reliable and clinically relevant complement to use alongside a battery of post-concussion tests to improve screening and referral for further evaluation and treatment of VOD. OBJECTIVES: This paper will review the pathoanatomy and symptomatology of common vestibular and oculomotor disorders after concussion, as well as the utility of the VOMS to assist in diagnosis, referral, and management. METHODS: Primary articles were identified using a search via PubMed, Google Scholar, OneSearch, and CINAHL. Search key terms were combinations of “mild traumatic brain injury” or “concussion” or “pursuit” or “accommodation” or “vergence” or “convergence insufficiency” or “saccades” or “vestibulo-ocular reflex” or “vestibular ocular motor screen” or “vestibular rehabilitation”, or “vision rehabilitation” including adult and pediatric populations that were published in print or electronically from 1989 to 2021 in English. Classic papers on anatomy of eye movements, vestibular system and pathological changes in mTBI were also included, regardless of publication date. RESULTS: Objective impairments are commonly found during testing of smooth pursuit, saccades, vergence, accommodation, vestibular ocular reflex, and visual motion sensitivity after mTBI. These deficits can be actively treated with vestibular physical therapy and oculomotor/neuro-optometric vision therapy. VOMS is an efficient and reliable tool that can be used by all healthcare and rehabilitation providers to aid in diagnosis of post-concussion VOD, to help facilitate the decision to refer for further evaluation and treatment to expedite symptomatic post-concussion recovery. CONCLUSIONS: VOD is common after concussion in acute, post-acute, and chronic phases. Once areas of impairments are identified through proper assessment, clinicians can maximize recovery by referring to vestibular physical therapy and/or neuro-optometry to design a targeted treatment program to address individual deficits.

False Positive Rates and Associated Risk Factors on the VOMS and mBESS in U.S. Military Personnel

CONTEXT

In 2018, the U.S. military developed the Military Acute Concussion Evaluation-2 (MACE-2) to inform acute evaluation of mTBI. However, researchers have yet to investigate false positive rates for components of the MACE-2 including the Vestibular-Ocular Motor Screen (VOMS) and modified Balance Error Scoring System (mBESS) in military personnel.

OBJECTIVE

To examine factors associated with false positives in VOMS and mBESS in U.S. Army Special Operations Command (USASOC) personnel.

DESIGN

Cross-sectional study.

SETTING

Military medical clinic.

PARTICIPANTS

416 healthy USASOC personnel completed medical history, VOMS, and mBESS evaluations.

MAIN OUTCOME MEASURES

False positive rates for the VOMS (2+ on VOMS symptom item, ≥ 5 cm for near point of convergence [NPC] distance) and mBESS (total score >4) were determined using chi-square analyses and independent samples t-tests. Multivariable logistic regressions (LR) with adjusted odds ratios (aOR) were performed to identify risk factors for false positives on VOMS and mBESS. VOMS items false positive rates ranged from 10.6% (smooth pursuits) to 17.5% (NPC). mBESS total score false positive rate was 36.5%.

RESULTS

The multivariable LR model supported three significant predictors of VOMS false positives including age (OR= 1.07, 95% CI= 1.02-1.12, p=0.007), migraine (OR=2.49, 95% CI= 1.29-4.81, p=0.007), and motion sickness history (OR=2.46, 95% CI= 1.34-4.50, p=0.004). Results of the multivariable LR model supported only motion sickness history as a significant predictor (OR=2.34, 95% CI= 1.34-4.05, p=0.002) of mBESS false positives.

CONCLUSIONS

There were low false positive rates across VOMS items, which were associated with age, history of mTBI, migraine, and motion sickness. False positives for the mBESS total score were higher (36.5%) and were only associated with a history of motion sickness. These risk factors for false positives should be considered when administering and interpreting VOMS and mBESS components of the MACE-2 in this population.

Review of wearable technologies and machine learning methodologies for systematic detection of mild traumatic brain injuries

Mild traumatic brain injuries (mTBIs) are the most common type of brain injury. Timely diagnosis of mTBI is crucial in making 'go/no-go' decision in order to prevent repeated injury, avoid strenuous activities which may prolong recovery, and assure capabilities of high-level performance of the subject. If undiagnosed, mTBI may lead to various short- and long-term abnormalities, which include, but are not limited to impaired cognitive function, fatigue, depression, irritability, and headaches. Existing screening and diagnostic tools to detect acute andearly-stagemTBIs have insufficient sensitivity and specificity. This results in uncertainty in clinical decision-making regarding diagnosis and returning to activity or requiring further medical treatment. Therefore, it is important to identify relevant physiological biomarkers that can be integrated into a mutually complementary set and provide a combination of data modalities for improved on-site diagnostic sensitivity of mTBI. In recent years, the processing power, signal fidelity, and the number of recording channels and modalities of wearable healthcare devices have improved tremendously and generated an enormous amount of data. During the same period, there have been incredible advances in machine learning tools and data processing methodologies. These achievements are enabling clinicians and engineers to develop and implement multiparametric high-precision diagnostic tools for mTBI. In this review, we first assess clinical challenges in the diagnosis of acute mTBI, and then consider recording modalities and hardware implementation of various sensing technologies used to assess physiological biomarkers that may be related to mTBI. Finally, we discuss the state of the art in machine learning-based detection of mTBI and consider how a more diverse list of quantitative physiological biomarker features may improve current data-driven approaches in providing mTBI patients timely diagnosis and treatment.