Victoria Symptom Validity Test: Cutoff Scores for Psychometrically Defined Malingering Groups in a Military Sample

The impact of visual memory impairment on Victoria Symptom Validity Test performance: A known-groups analysis

OBJECTIVE

We assessed the effect of visual learning and recall impairment on Victoria Symptom Validity Test (VSVT) accuracy and response latency for Easy, Difficult, and Total Items.

METHOD

A sample of 163 adult patients administered the VSVT and Brief Visuospatial Memory Test-Revised were classified as valid (114/163) or invalid (49/163) groups via independent criterion performance validity tests (PVTs). Classification accuracies for all VSVT indices were examined for the overall sample, and separately for subgroups based on visual memory functioning.

RESULTS

In the overall sample, all indices produced acceptable classification accuracy (areas under the curve [AUCs] ≥ 0.79). When stratified by visual learning/recall impairment, accuracy indices yielded acceptable classification for both the unimpaired (AUCs ≥0.79) and impaired subsamples (AUCs ≥0.75). Latency indices had acceptable classification accuracy for the unimpaired subsample (AUCs ≥0.74), but accuracy and sensitivity dropped for the impaired sample (AUCs ≥0.67).

CONCLUSIONS

VSVT accuracy and response latency yielded acceptable classification accuracies in the overall sample, and this effect was maintained in those with and without visual learning/recall impairment for the accuracy indices. Findings indicate that the VSVT is a psychometrically robust PVT with largely invariant cut-scores, even in the presence of bona fide visual learning/recall impairment.

Base rates of invalidity when patients undergoing routine clinical evaluations have social security disability as an external incentive

Objective: Social Security Disability is a common external incentive in neuropsychological evaluations. This study determined base rates of invalidity when patients referred for routine clinical evaluations have Social Security Disability as an external incentive. Method: Patients (n = 242) were grouped as validly or invalidly performing based on the use of multiple performance validity tests. Frequency analyses were then conducted. Results: As a whole, 46.0% of clinically referred patients with Social Security Disability as an external incentive produced invalid data. When divided by disability pursuit status, 58.6% of individuals already receiving Social Security Disability, 44.6% of individuals actively seeking Social Security Disability, and 39.3% of individuals considering seeking Social Security Disability produced invalid data. By comparison, only 8.5% of clinically referred patients without known external incentives produced invalid data. Conclusions: Beyond establishing base rates, these data indicate that the external incentive, not necessarily the evaluation setting, increases the rate of invalidity, as obtained base rates mirror those observed in independent medical examinations. In addition, this study highlights that even patients who report that they are considering but have not committed themselves to pursuing an external incentive frequently invalidate testing.

Association of military-specific reaction time performance with physical fitness and visual skills

Background

The aim of the present study was to explore whether military-specific reaction time (RT) test performance is affected by individuals' physical and visual skills.

Method

In a single testing session, the military-specific Simple and Go, No-Go RT, aerobic power (20-m Multistage Shuttle Run test), maximal upper- and lower-body mechanical capacities (bench press and squat against different loads), and visual skills (multiple object tracking and dynamic visual acuity) of 30 young men (15 active-duty military personnel and 15 sport science students) were evaluated.

Results

The main findings revealed that the Simple RT and Go, No-Go RT presented (1) with aerobic power non-significant small correlations in military personnel (r = -0.39 and -0.35, respectively) and non-significant negligible correlations in sport science students (r = -0.10 and 0.06, respectively), (2) inconsistent and generally non-significant correlations with the maximal mechanical capacities of the upper- and lower-body muscles (r range = -0.10, 0.67 and -0.27, 0.48, respectively), (3) non-significant correlations with visual skills (r magnitude ≥ 0.58) with the only exception of the Go, No-Go RT that was significantly correlated to all visual variables in the group of students (i.e., students who achieved better results during visual tests had shorter RT; r magnitude ≥ 0.58), and (4) none of the physical and visual variables significantly predicted the Simple RT or Go, No-Go RT.

Conclusion

Altogether, these results indicate that military-specific RT performance is generally independent of physical and visual skills in both military personnel and active university students.

Validation of a Novel Reaction Time Test Specific for Military Personnel

A military-specific reaction time (RT) test was developed to explore its reliability and sensitivity to discriminate between military personnel and sport science students. Fifteen male professional Spanish soldiers and 16 male sport science students completed two RT test modalities: military-specific and nonspecific RT tests. For each RT test modality, both the Simple (i.e., one stimulus, one response) and the Go, No-Go RT (i.e., true, and false stimuli, one response) were tested. The military-specific RT test consisted of a video presented through virtual reality glasses of a forest environment in which soldiers would appear from behind different bushes (stimuli) and the response consisted of pressing the button of a gun-shaped mouse (when they saw a soldier pointing a rifle at them). Both Simple and Go, No-Go RT reached acceptable reliability in both populations (coefficient of variation ≤ 9.64%). Military personnel presented a lower RT than sport science students during the military-specific RT test (p ≤ .001), while no differences were obtained during the nonspecific RT test. RT values were not significantly correlated between the military-specific and nonspecific RT tests (r ≤ .02). These findings collectively suggest that the novel military-specific RT test is an ecologically valid alternative to evaluate the information processing abilities of military personnel.

Nonmemory Composite Embedded Performance Validity Formulas in Patients with Multiple Sclerosis

OBJECTIVE

Research regarding performance validity tests (PVTs) in patients with multiple sclerosis (MS) is scant, with recommended batteries for neuropsychological evaluations in this population lacking suggestions to include PVTs. Moreover, limited work has examined embedded PVTs in this population. As previous investigations indicated that nonmemory-based embedded PVTs provide clinical utility in other populations, this study sought to determine if a logistic regression-derived PVT formula can be identified from selected nonmemory variables in a sample of patients with MS.

METHOD

A total of 184 patients (M age = 48.45; 76.6% female) with MS were referred for neuropsychological assessment at a large, Midwestern academic medical center. Patients were placed into "credible" (n = 146) or "noncredible" (n = 38) groups according to performance on standalone PVT. Missing data were imputed with HOTDECK.

RESULTS

Classification statistics for a variety of embedded PVTs were examined, with none appearing psychometrically appropriate in isolation (areas under the curve [AUCs] = .48-.64). Four exponentiated equations were created via logistic regression. Six, five, and three predictor equations yielded acceptable discriminability (AUC = .71-.74) with modest sensitivity (.34-.39) while maintaining good specificity (≥.90). The two predictor equation appeared unacceptable (AUC = .67).

CONCLUSIONS

Results suggest that multivariate combinations of embedded PVTs may provide some clinical utility while minimizing test burden in determining performance validity in patients with MS. Nonetheless, the authors recommend routine inclusion of several PVTs and utilization of comprehensive clinical judgment to maximize signal detection of noncredible performance and avoid incorrect conclusions. Clinical implications, limitations, and avenues for future research are discussed.

Normal cognitive test scores cannot be interpreted as accurate measures of ability in the context of failed performance validity testing: A symptom- and detection-coached simulation study

Introduction: While use of performance validity tests (PVTs) has become a standard of practice in neuropsychology, there are differing opinions regarding whether to interpret cognitive test data when standard scores fall within normal limits despite PVTs being failed. This study is the first to empirically determine whether normal cognitive test scores underrepresent functioning when PVTs are failed.Method: Participants, randomly assigned to either a simulated malingering group (n = 50) instructed to mildly suppress test performances or a best-effort/control group (n = 50), completed neuropsychological tests which included the North American Adult Reading Test (NAART), California Verbal Learning Test - 2^nd Edition (CVLT-II), and Test of Memory Malingering (TOMM).Results: Groups were not significantly different in age, sex, education, or NAART predicted intellectual ability, but simulators performed significantly worse than controls on the TOMM, CVLT-II Forced Choice Recognition, and CVLT-II Short Delay Free Recall. The groups did not significantly differ on other examined CVLT-II measures. Of simulators who failed validity testing, 36% scored no worse than average and 73% scored no worse than low average on any of the examined CVLT-II indices.Conclusions: Of simulated malingerers who failed validity testing, nearly three-fourths were able to produce cognitive test scores that were within normal limits, which indicates that normal cognitive performances cannot be interpreted as accurately reflecting an individual's capabilities when obtained in the presence of validity test failure. At the same time, only 2 of 50 simulators were successful in passing validity testing while scoring within an impaired range on cognitive testing. This latter finding indicates that successfully feigning cognitive deficits is difficult when PVTs are utilized within the examination.

Response Time Measures as Supplementary Validity Indicators in Forced-Choice Recognition Memory Performance Validity Tests: A Systematic Review

Performance validity tests (PVTs) based on the forced-choice recognition memory (FCRM) paradigm are commonly used for the detection of noncredible performance. Examinees' response times (RTs) are affected by cognitive processes associated with deception and can also be gathered without lengthening the duration of the assessment. Consequently, interest in the utility of these measures as supplementary validity indicators in FCRM-PVTs has grown over the years. The current systematic review summarizes both clinical and simulation (i.e., healthy participants simulating cognitive impairment) studies of RTs in FCRM-PVTs. The findings of 25 peer-reviewed articles (n = 26 empirical studies) indicate that noncredible performance in FCRM-PVTs is associated with longer RTs. Additionally, there are indications that noncredible performance is associated with larger variability in RTs. RT measures, however, have lower discrimination capacity than conventional accuracy measures. Their utility may therefore lie in reaching decisions regarding cases with border zone accuracy scores, as well as aiding in the detection of more sophisticated examinees who are aware of the use of accuracy-based validity indicators in FCRM-PVTs. More research, however, is required before these measures are incorporated in daily practice and clinical decision-making processes.

Mean response latency indices on the Victoria Symptom Validity Test do not contribute meaningful predictive value over accuracy scores for detecting invalid performance

The utility of the Victoria Symptom Validity Test (VSVT) as a performance validity test (PVT) has been primarily established using response accuracy scores. However, the degree to which response latency may contribute to accurate classification of performance invalidity over and above accuracy scores remains understudied. Therefore, this study investigated whether combining VSVT accuracy and response latency scores would increase predictive utility beyond use of accuracy scores alone. Data from a mixed clinical sample of 163 patients, who were administered the VSVT as part of a larger neuropsychological battery, were analyzed. At least four independent criterion PVTs were used to establish validity groups (121 valid/42 invalid). Logistic regression models examining each difficulty level revealed that all VSVT measures were useful in classifying validity groups, both independently and when combined. Individual predictor classification accuracy ranged from 77.9 to 81.6%, indicating acceptable to excellent discriminability across the validity indices. The results of this study support the value of both accuracy and latency scores on the VSVT to identify performance invalidity, although the accuracy scores had superior classification statistics compared to response latency, and mean latency indices provided no unique benefit for classification accuracy beyond dimensional accuracy scores alone.

Victoria Symptom Validity Test: A Systematic Review and Cross-Validation Study

The Victoria Symptom Validity Test (VSVT) is a performance validity test (PVT) with over two decades of empirical backing, although methodological limitations within the extant literature restrict its clinical and research generalizability. Chief among these constraints includes limited consensus on the most accurate index within the VSVT and the most appropriate cut-scores within each VSVT validity index. The current systematic review synthesizes existing VSVT validation studies and provides additional cross-validation in an independent sample using a known-groups design. We completed a systematic search of the literature, identifying 17 peer-reviewed studies for synthesis (7 simulation designs, 7 differential prevalence designs, and 3 known-groups designs). The independent cross-validation sample consisted of 200 mixed clinical neuropsychiatric patients referred for outpatient neuropsychological evaluation. Across all indices, Total item accuracy produced the strongest psychometric properties at an optimal cut-score of ≤ 40 (62% sensitivity/88% specificity). However, ROC curve analyses for all VSVT indices yielded statistically significant areas under the curve (AUCs; .73-81), suggestive of moderate classification accuracy. Cut-scores derived using the independent cross-validation sample converged with some previous findings supporting cut-scores of ≤ 22 for Easy item accuracy and ≤ 40 for Total item accuracy, although divergent findings were noted for Difficult item accuracy. Overall, VSVT validity indicators have adequate diagnostic accuracy across populations, with the current study providing additional support for its use as a psychometrically sound PVT in clinical settings. However, caution is recommended among patients with certain verified clinical conditions (e.g., dementia) and those with pronounced working memory deficits due to concerns for increased risk of false positives.

The impact of PTSD and mTBI on the relationship between subjective and objective cognitive deficits in combat-exposed veterans

OBJECTIVE

Cognitive complaints, such as attentional or memory concerns, are commonly reported by veterans diagnosed with posttraumatic stress disorder (PTSD) or a history of mild traumatic brain injury (mTBI). The degree to which those complaints actually map onto measurable cognitive deficits is unclear and is likely complicated by the severity of trauma-related sequelae. In the present study we sought to characterize the degree to which PTSD symptoms and mTBI accounted for the relationship of subjective cognitive complaints to objective cognitive performance, with the goal of facilitating the accurate assessment of trauma-exposed veterans complaining of cognitive decline.

METHOD

A sample of 203 U.S. military veterans previously deployed to Iraq and/or Afghanistan were assessed for PTSD severity, history of blast and impact mTBI, objective cognitive function, and subjective cognitive complaints. Separate mediation analyses were conducted to explore the degree that PTSD severity, blast mTBI severity, and impact mTBI severity influenced the association between subjective cognitive complaints and objective cognitive performance. Models reflecting significant mediation were followed by post hoc moderated mediation analyses.

RESULTS

Subjective cognitive complaints and objective cognitive performance were significantly associated (β = -6.49, SE = 2.85, p = .03), but this relationship was mediated by PTSD severity (β= -2.95, SE = 2.86, p = .30). PTSD mediation was not moderated by either blast or impact mTBI.

CONCLUSION

The present results delineate the prominent impact of PTSD symptoms, relative to blast and impact mTBI, on cognition following combat. These findings highlight the importance of assessing for trauma-related psychopathology in those seeking neuropsychological assessment or rehabilitative care for cognitive complaints. (PsycINFO Database Record (c) 2019 APA, all rights reserved).