Sensitivity and Specificity of a Multimodal Approach for Concussion Assessment in Youth Athletes

Validity and Reliability of Methods to Assess Movement Deficiencies Following Concussion: A COSMIN Systematic Review

BACKGROUND

There is an increased risk of subsequent concussion and musculoskeletal injury upon return to play following a sports-related concussion. Whilst there are numerous assessments available for clinicians for diagnosis and during return to play following concussion, many may lack the ability to detect these subclinical changes in function. Currently, there is no consensus or collated sources on the reliability, validity and feasibility of these assessments, which makes it difficult for clinicians and practitioners to select the most appropriate assessment for their needs.

OBJECTIVES

This systematic review aims to (1) consolidate the reliability and validity of motor function assessments across the time course of concussion management and (2) summarise their feasibility for clinicians and other end-users.

METHODS

A systematic search of five databases was conducted. Eligible studies were: (1) original research; (2) full-text English language; (3) peer-reviewed with level III evidence or higher; (4) assessed the validity of lower-limb motor assessments used to diagnose or determine readiness for athletes or military personnel who had sustained a concussion or; (5) assessed the test-retest reliability of lower-limb motor assessments used for concussion management amongst healthy athletes. Acceptable lower-limb motor assessments were dichotomised into instrumented and non-instrumented and then classified into static (stable around a fixed point), dynamic (movement around a fixed point), gait, and other categories. Each study was assessed using the COSMIN checklist to establish methodological and measurement quality.

RESULTS

A total of 1270 records were identified, with 637 duplicates removed. Titles and abstracts of 633 records were analysed, with 158 being retained for full-text review. A total of 67 records were included in this review; 37 records assessed reliability, and 35 records assessed the validity of lower-limb motor assessments. There were 42 different assessments included in the review, with 43% being non-instrumented, subjective assessments. Consistent evidence supported the use of instrumented assessments over non-instrumented, with gait-based assessments demonstrating sufficient reliability and validity compared to static or dynamic assessments.

CONCLUSION

These findings suggest that instrumented, gait-based assessments should be prioritised over static or dynamic balance assessments. The use of laboratory equipment (i.e. 3D motion capture, pressure sensitive walkways) on average exhibited sufficient reliability and validity, yet demonstrate poor feasibility. Further high-quality studies evaluating the reliability and validity of more readily available devices (i.e. inertial measurement units) are needed to fill the gap in current concussion management protocols. Practitioners can use this resource to understand the accuracy and precision of the assessments they have at their disposal to make informed decisions regarding the management of concussion.

TRAIL REGISTRATION

This systematic review was registered on PROSPERO (reg no. CRD42021256298).

Lower-Extremity Neuromuscular Function Following Concussion: A Preliminary Examination

CONTEXT

Neuromuscular function is altered acutely following concussion and theoretically linked to the subsequent postconcussion musculoskeletal injury risk. Existing research has only examined voluntary muscle activation, limiting mechanistic understanding. Therefore, our study aimed to examine voluntary and involuntary muscle activation between college-aged, concussed individuals when symptom-free and healthy matched controls.

DESIGN

Prospective, cross-sectional cohort laboratory study.

METHODS

Concussed and healthy participants (n = 24; 58% male, age: 19.3 [1.1] y, mass: 70.3 [16.4] kg, height: 177.3 [12.7] cm) completed the superimposed burst (SB) neuromuscular assessment on their dominant limb within 72 hours after self-reporting asymptomatic (22.4 [20.2] d postinjury). Unnormalized and bodyweight-normalized quadriceps maximal voluntary isometric contraction torque (in newton meters), unnormalized and bodyweight-normalized electrically stimulated SB torque, pain (numeric 1-10) during SB, and the central activation ratio (in percentage) were assessed via the SB. Parametric and nonparametric analyses, 95% confidence intervals (95% CIs), and Hedges g (parametric) and Spearman ρ (nonparametric) effect sizes were used to examine group differences (α = .05).

RESULTS

The maximal voluntary isometric contraction torque (concussed: 635.60 N·m [300.93] vs control: 556.27 N·m [182.46]; 95% CI, -131.36 to 290.02; P = .443; d = 0.33), SB torque (concussed: 203.22 N·m [97.17], control: 262.85 N·m [159.07]; 95% CI, -171.22 to 51.97; P = .280; d = -0.47), and central activation ratio (concussed: 72.16% [17.16], control: 70.09% [12.63]; 95% CI, -10.68 to 14.83; P = .740; d = 0.14) did not differ between the concussed and control groups regardless of bodyweight normalization (P ≥ .344). Pain during the SB was significantly higher with a medium effect for participants with a concussion versus healthy controls (concussed: median = 7, control: median = 5; P = .046; ρ = -0.42).

DISCUSSION

These findings suggest concussed participants do not have statistically altered voluntary or involuntary quadricep neuromuscular function once asymptomatic compared with controls. Therefore, the elevated postconcussion musculoskeletal injury risk may not be attributed to lower-extremity muscle activation. Concussed participants displayed greater pain perception during the SB, which suggests somatosensory or perception changes requiring further examination.

R2Play development: Fostering user-driven technology that supports return-to-play decision-making following pediatric concussion

Objective

To design a multi-domain return-to-play assessment system (R2Play) for youth athletes with concussion.

Methods

The R2Play system was developed using an overarching user-centered approach, the Design Thinking Framework, and research activities included: 1) structured brainstorming within our research team, 2) interviews with clinician and youth sports coaches, 3) building a testable prototype, and 4) interface testing through cognitive walkthroughs with clinician partners.

Results

Clinician and coach participants provided feedback on the R2Play concept, which was integrated into the design process and provided future directions for research. Examples of feedback-driven design choices included reducing assessment time, increasing ecological validity by adding in background noise, and developing youth-friendly graphical results screens. Following refinement based on stakeholder feedback, the R2Play system was outlined in detail and a testable prototype was developed. It is made up of two parts: a clinician tablet, and a series of tablet "buttons" that display numbers and letters. Youth athletes run between the buttons to connect a "trail" in ascending alphanumeric order, 1-A-2-B, etc. Their performance across a series of levels of increasing difficulty is logged on the clinician tablet. Initial testing with five clinicians showed the system's interface to have excellent usability with a score of 81% (SD = 8.02) on the System Usability Scale.

Conclusion

Through this research, a prototype of the R2Play system was innovated and evaluated by clinician and coach stakeholders. Initial usability was excellent and directions for future iterations were highlighted. Outcomes suggest the potential benefits of using technologies to assist in complex clinical assessment, as well as utilizing a user-centered approach to design.