Patterns of Cognitive Test Scores and Symptom Complaints in Persons with TBI Who Failed Performance Validity Testing

Neurobehavioral Symptom Profiles for the Behavioral Assessment Screening Tool in Chronic Traumatic Brain Injury

OBJECTIVE

To identify neurobehavioral symptom profiles among persons with chronic traumatic brain injury (TBI) using the Behavioral Assessment Screening Tool (BAST) and to consider participant characteristics that differ between profile groups.

SETTING

Community.

PARTICIPANTS

Participants (n = 615) were English-speaking adults (≥18) and had a self-reported history of at least one TBI of any severity.

DESIGN

Secondary analysis of cross-sectional data.

MAIN MEASURES

The BAST measures neurobehavioral symptoms in the domains of Negative Affect, Fatigue, Executive Dysfunction, Impulsivity, and Substance Misuse.

RESULTS

Using latent profile analysis (LPA), we identified 3 different neurobehavioral profiles. Overall symptom frequency and differences in the pattern of symptom frequency across domains differentiated the profile groups. Average domain scores differed significantly across the profiles (P < .001) for all domains except Fatigue (P = .076). Those in profile 3 (High-Risk group) reported the most frequent symptoms across all domains (similar Negative Affect frequency as profile 1). Substance Misuse was especially high in this group. Compared to profile 2 (High Negative Affect group), participants in profile 1 (Moderate-Risk group) endorsed significantly more frequent (and more variable) symptoms across all BAST domains, particularly Impulsivity and Substance Misuse. Participants in profile 2 endorsed the least frequent symptoms across all domains. Demographic comparison showed that groups differed based on gender, age, and injury severity (mild vs moderate-severe), with profile 3 composed of the most men and the most persons in early adulthood, and profile 2 composed of the most women and those with mild TBI.

CONCLUSIONS

We differentiated 3 neurobehavioral symptom profiles among persons with chronic TBI and determined differences in sociodemographic factors between the groups. Future research should focus on validating these profiles in another sample of individuals with chronic TBI. Characterizing persons according to multidimensional symptom profiles could allow for more tailored approaches to predict and prevent long-term negative outcomes.

Predictive value of performance validity testing and symptom validity testing in psychoeducational assessment

Using archival data from 2463 psychoeducational assessments of postsecondary students we investigated whether failure on either symptom or performance validity tests (SVTs or PVTs) was associated with score differences on various cognitive, achievement, or executive functioning performance measures or on symptom report measures related to mental health or attention complaints. In total, 14.6% of students failed one or more PVT, 33.6% failed one or more SVT, and 41.6% failed at least one validity test. Individuals who failed SVTs tended to have the highest levels of self-reported symptoms relative to other groups but did not score worse on performance-based psychological tests. Those who failed PVTs scored worse on performance-based tests relative to other groups. Failure on at least one PVT and one SVT resulted in both performance and self-reported symptoms suggestive of greater impairment compared with those who passed all validity measures. Findings also highlight the need for domain-specific SVTs; failing ADHD SVTs was associated only with extreme reports of ADHD and executive functioning symptoms while failing mental health SVTs related only to extreme reports of mental health complaints. Results support using at least one PVT and one SVT in psychoeducational assessments to aid in diagnostic certainty, given the frequency of non-credible presentation in this population of postsecondary students.

Factor structure of the modified Rivermead Post-concussion Symptoms Questionnaire (mRPQ): an exploratory analysis with healthy adult simulators

OBJECTIVE

Persistent postconcussion symptoms (PPCS) are challenging to diagnose. An improved diagnostic process could consider typical and atypical postconcussion symptoms. This study examined the structure of a modified Rivermead Post-concussion Symptoms Questionnaire (mRPQ) with both symptom types.

METHOD

298 adult volunteers were randomized into groups: honest responders, mild traumatic brain injury (mTBI) simulators (MS), and biased mTBI simulators (BMS). Both mTBI simulating groups were coached about mTBI and primed about the simulation context (compensation evaluation). The BMS group was also encouraged to bias (exaggerate) symptoms. The participants completed an online battery of tests, including the mRPQ.

RESULTS

An exploratory factor analysis of the mRPQ (full sample) revealed a three-factor solution, including a separate dimension for atypical symptoms (all item loadings >0.45, ~4% of explained variance). The overall and group analyses of the standard RPQ items (typical symptoms) found a one- or two-factor solution, as did the analyses of atypical symptoms.

CONCLUSIONS

Consistent with prior RPQ research, a unidimensional or bifactor structure was measurable from standard RPQ symptoms. Whilst this study did not find support for domain-level symptom scores for either typical or atypical symptoms, the findings support the use of an overall atypical symptoms score.

What are the predictors of TOMM failure in clinical TBI populations? A retrospective analysis

OBJECTIVES

To determine base rates of invalid performance on the Test of Memory Malingering (TOMM) in patients with traumatic brain injury (TBI) undertaking rehabilitation who were referred for clinical assessment, and the factors contributing to TOMM failure.

METHODS

Retrospective file review of consecutive TBI referrals for neuropsychological assessment over seven years. TOMM failure was conventionally defined as performance <45/50 on Trial 2 or Retention Trial. Demographic, injury, financial compensation, occupational, and medical variables were collected.

RESULTS

Four hundred and ninety one TBI cases (Median age = 40 years [IQR = 26-52], 79% male, 82% severe TBI) were identified. Overall, 48 cases (9.78%) failed the TOMM. Logistic regression analyses revealed that use of an interpreter during the assessment (adjusted odds ratio [aOR] = 8.25, 95%CI = 3.96-17.18), outpatient setting (aOR = 4.80, 95%CI = 1.87-12.31) and post-injury psychological distress (aOR = 2.77, 95%CI = 1.35-5.70) were significant multivariate predictors of TOMM failure. The TOMM failure rate for interpreter cases was 49% (21/43) in the outpatient setting vs. 7% (2/30) in the inpatient setting. By comparison, 9% (21/230) of non-interpreter outpatient cases failed the TOMM vs. 2% (4/188) of inpatient cases.

CONCLUSIONS

TOMM failure very rarely occurs in clinical assessment of TBI patients in the inpatient rehabilitation setting. It is more common in the outpatient setting, particularly in non-English-speaking people requiring an interpreter. The findings reinforce the importance of routinely administering stand-alone performance validity tests in assessments of clinical TBI populations, particularly in outpatient settings, to ensure that neuropsychological test results can be interpreted with a high degree of confidence.

Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity

OBJECTIVE

This study was designed to empirically investigate the signal detection profile of various multivariate models of performance validity tests (MV-PVTs) and explore several contested assumptions underlying validity assessment in general and MV-PVTs specifically.

METHOD

Archival data were collected from 167 patients (52.4%male; MAge = 39.7) clinicially evaluated subsequent to a TBI. Performance validity was psychometrically defined using two free-standing PVTs and five composite measures, each based on five embedded PVTs.

RESULTS

MV-PVTs had superior classification accuracy compared to univariate cutoffs. The similarity between predictor and criterion PVTs influenced signal detection profiles. False positive rates (FPR) in MV-PVTs can be effectively controlled using more stringent multivariate cutoffs. In addition to Pass and Fail, Borderline is a legitimate third outcome of performance validity assessment. Failing memory-based PVTs was associated with elevated self-reported psychiatric symptoms.

CONCLUSIONS

Concerns about elevated FPR in MV-PVTs are unsubstantiated. In fact, MV-PVTs are psychometrically superior to individual components. Instrumentation artifacts are endemic to PVTs, and represent both a threat and an opportunity during the interpretation of a given neurocognitive profile. There is no such thing as too much information in performance validity assessment. Psychometric issues should be evaluated based on empirical, not theoretical models. As the number/severity of embedded PVT failures accumulates, assessors must consider the possibility of non-credible presentation and its clinical implications to neurorehabilitation.