Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review

Unintended consequences - A qualitative exploration of baseline testing in community rugby concussion management

OBJECTIVES

Understanding key stakeholders' perceptions around the value of baseline testing, as well as barriers or facilitators experienced as part of the process, may assist with the decision-making process of whether to implement baseline testing in community sport. This study explored coaches', players' and physiotherapists' perceptions of the perceived value, barriers and facilitators of baseline testing as part of New Zealand Rugby's (NZR) community concussion initiative.

DESIGN

The study employed a pragmatic, qualitative descriptive design.

METHODS

Semi-structured interviews were used to explore participants' perceptions. In total, 73 individual interviews were conducted. The sample consisted of 36 players, 13 coaches and 24 physiotherapists involved in NZR's concussion management pathway. Interviews were audio-recorded and transcribed verbatim. Data were analysed using thematic analysis.

RESULTS

In terms of perceived value, baseline testing was reported to play a role in i) facilitating a positive concussion culture; ii) positive perceptions of rugby and player safety and iii) enhancing concussion management as part of the pathway. Barriers and facilitators of the baseline testing process included i) stakeholder buy-in as critical driver of the process and ii) contextual and operational factors. Although contextual and operational challenges exist, these participants, as key stakeholders in the process, perceived the value of baseline testing to be more important than the barriers experienced.

CONCLUSIONS

The value of baseline testing extends beyond concussion assessment and management, by enhancing community concussion awareness, attitudes and player safety. The findings of this study may assist in the decision-making process around inclusion of pre-season baseline testing in community rugby.

Navigating uncertainty: exploring parents' knowledge of concussion management and neuropsychological baseline testing

Introduction

Parents play an important role in preventing and managing sport-related concussions among youth sport participants. Research indicates that parents understand the severity and consequences associated with the injury but gaps exist in their knowledge of its management. Neuropsychological baseline testing (NBT) is a modality that has gained interest in youth sport to purportedly better manage concussion injuries. Little is known about parents' perspectives on the use of NBT in the management process.

Methods

The present qualitative study used Protection Motivation Theory as a guiding framework and employed focus groups (N = 2) with parents (N = 11) to gain insight into parents' perceptions and experiences with concussion management, specifically focusing on NBT.

Results

Inductive Content Analysis developed a core theme of navigating uncertainty. Participants expressed uncertainty about the nature of concussion and its management process, where concussion was not always easy to identify, youth were not always reliable reporters, and there was no prescribed or proscribed path for recovery. Personal experience and concussion management policy provided participants with a degree of certainty in managing concussions. Participants gave NBT mixed reviews in potentially promoting greater certainty but also held reservations about its usefulness in concussion management.

Discussion

We discuss findings relative to existing knowledge and theory in youth sport concussion and identify implications for practice.

The California Cognitive Assessment Battery (CCAB)

Introduction

We are developing the California Cognitive Assessment Battery (CCAB) to provide neuropsychological assessments to patients who lack test access due to cost, capacity, mobility, and transportation barriers.

Methods

The CCAB consists of 15 non-verbal and 17 verbal subtests normed for telemedical assessment. The CCAB runs on calibrated tablet computers over cellular or Wi-Fi connections either in a laboratory or in participants' homes. Spoken instructions and verbal stimuli are delivered through headphones using naturalistic text-to-speech voices. Verbal responses are scored in real time and recorded and transcribed offline using consensus automatic speech recognition which combines the transcripts from seven commercial ASR engines to produce timestamped transcripts more accurate than those of any single ASR engine. The CCAB is designed for supervised self-administration using a web-browser application, the Examiner. The Examiner permits examiners to record observations, view subtest performance in real time, initiate video chats, and correct potential error conditions (e.g., training and performance failures, etc.,) for multiple participants concurrently.

Results

Here we describe (1) CCAB usability with older (ages 50 to 89) participants; (2) CCAB psychometric properties based on normative data from 415 older participants; (3) Comparisons of the results of at-home vs. in-lab CCAB testing; (4) We also present preliminary analyses of the effects of COVID-19 infection on performance. Mean z-scores averaged over CCAB subtests showed impaired performance of COVID+ compared to COVID- participants after factoring out the contributions of Age, Education, and Gender (AEG). However, inter-cohort differences were no longer significant when performance was analyzed with a comprehensive model that factored out the influences of additional pre-existing demographic factors that distinguished COVID+ and COVID- cohorts (e.g., vocabulary, depression, race, etc.,). In contrast, unlike AEG scores, comprehensive scores correlated significantly with the severity of COVID infection. (5) Finally, we found that scoring models influenced the classification of individual participants with Mild Cognitive Impairment (MCI, z-scores < -1.50) where the comprehensive model accounted for more than twice as much variance as the AEG model and reduced racial bias in MCI classification.

Discussion

The CCAB holds the promise of providing scalable laboratory-quality neurodiagnostic assessments to underserved urban, exurban, and rural populations.

Initial Validation of a Behavioral Phenotyping Model for Substance Use Disorder

Standard nosological systems, such as DSM-5 or ICD-10, are relied upon as the diagnostic basis when developing treatments for individuals with substance use disorder (SUD). Unfortunately, the vast heterogeneity of individuals within a given SUD diagnosis results in a variable treatment response and/or difficulties ascertaining the efficacy signal in clinical trials of drug development. Emerging precision medicine methods focusing on targeted treatments based on phenotypic subtypes rather than diagnosis are being explored as alternatives. The goal of the present study was to provide initial validation of emergent subtypes identified by an addiction-focused phenotyping battery. Secondary data collected as part of a feasibility study of the NIDA phenotyping battery were utilized. Participants completed self-report measures and behavioral tasks across six neurofunctional domains. Exploratory and confirmatory factor analysis (EFA/CFA) were conducted. A three-factor model consisting of negative emotionality, attention/concentration, and interoception and mindfulness, as well as a four-factor model adding a second negative emotion domain, emerged from the EFA as candidate models. The CFA of these models did not result in a good fit, possibly resulting from small sample sizes that hindered statistical power.

Monitoring the acute and subacute recovery of cognitive ocular motor changes after a sports-related concussion

Identifying when recovery from a sports-related concussion (SRC) has occurred remains a challenge in clinical practice. This study investigated the utility of ocular motor (OM) assessment to monitor recovery post-SRC between sexes and compared to common clinical measures. From 139 preseason baseline assessments (i.e. before they sustained an SRC), 18 (12 males, 6 females) consequent SRCs were sustained and the longitudinal follow-ups were collected at 2, 6, and 13 days post-SRC. Participants completed visually guided, antisaccade (AS), and memory-guided saccade tasks requiring a saccade toward, away from, and to a remembered target, respectively. Changes in latency (processing speed), visual–spatial accuracy, and errors were measured. Clinical measures included The Sports Concussion Assessment Tool, King-Devick test, Stroop task, and Digit span. AS latency was significantly longer at 2 days and returned to baseline by 13-days post-SRC in females only (P &lt; 0.001). Symptom numbers recovered from 2 to 6 days and 13 days (P &lt; 0.05). Persistently poorer AS visual–spatial accuracy was identified at 2, 6 and 13 days post-SRC (P &lt; 0.05) in both males and females but with differing trajectories. Clinical measures demonstrated consistent improvement reminiscent of practice effects. OM saccade assessment may have improved utility in tracking recovery compared to conventional measures and between sexes.