CVLT-II Forced Choice Recognition Trial as an Embedded Validity Indicator: A Systematic Review of the Evidence

The impact of visual memory impairment on Victoria Symptom Validity Test performance: A known-groups analysis

OBJECTIVE

We assessed the effect of visual learning and recall impairment on Victoria Symptom Validity Test (VSVT) accuracy and response latency for Easy, Difficult, and Total Items.

METHOD

A sample of 163 adult patients administered the VSVT and Brief Visuospatial Memory Test-Revised were classified as valid (114/163) or invalid (49/163) groups via independent criterion performance validity tests (PVTs). Classification accuracies for all VSVT indices were examined for the overall sample, and separately for subgroups based on visual memory functioning.

RESULTS

In the overall sample, all indices produced acceptable classification accuracy (areas under the curve [AUCs] ≥ 0.79). When stratified by visual learning/recall impairment, accuracy indices yielded acceptable classification for both the unimpaired (AUCs ≥0.79) and impaired subsamples (AUCs ≥0.75). Latency indices had acceptable classification accuracy for the unimpaired subsample (AUCs ≥0.74), but accuracy and sensitivity dropped for the impaired sample (AUCs ≥0.67).

CONCLUSIONS

VSVT accuracy and response latency yielded acceptable classification accuracies in the overall sample, and this effect was maintained in those with and without visual learning/recall impairment for the accuracy indices. Findings indicate that the VSVT is a psychometrically robust PVT with largely invariant cut-scores, even in the presence of bona fide visual learning/recall impairment.

Importance of validity testing in psychiatric assessment: evidence from a sample of multimorbid post-9/11 veterans

OBJECTIVE

Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures.

METHOD

Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures.

RESULTS

Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's d = .60-.69), processing speed (Cohen's d = .68), working memory (Cohen's d = .98), and visual memory (Cohen's d = .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; β = 0.16; p = .0002), and worse self-reported depression (β = 0.17; p = .0001), anxiety (β = 0.15; p = .0007), sleep (β = 0.10; p = .0233), and functional outcomes (β = 0.15; p = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (p's < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (AUC = 0.83; 95% CI = 0.76, 0.91).

CONCLUSION

PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.

The impact of race and other demographic factors on the false positive rates of five embedded Performance Validity Tests (PVTs) in a Veteran sample

INTRODUCTION

It is common to use normative adjustments based on race to maintain accuracy when interpreting cognitive test results during neuropsychological assessment. However, embedded performance validity tests (PVTs) do not adjust for these racial differences and may result in elevated rates of false positives in African American/Black (AA) samples compared to European American/White (EA) samples.

METHODS

Veterans without Major Neurocognitive Disorder completed an outpatient neuropsychological assessment and were deemed to be performing in a valid manner (e.g., passing both the Test of Memory Malingering Trial 1 (TOMM1) and the Medical Symptom Validity Test (MSVT), (n = 531, EA = 473, AA = 58). Five embedded PVTs were administered to all patients: WAIS-III/IV Processing Speed Index (PSI), Brief Visuospatial Memory Test-Revised: Discrimination Index (BVMT-R), TMT-A (secs), California Verbal Learning Test-II (CVLT-II) Forced Choice, and WAIS-III/IV Digit Span Scaled Score. Individual PVT false positive rates, as well as the rate of failing two or more embedded PVTs, were calculated.

RESULTS

Failure rates of two embedded PVTs (PSI, TMT-A), and the total number of PVTs failed, were higher in the AA sample. The PSI and TMT-A remained significantly impacted by race after accounting for age, education, sex, and presence of Mild Neurocognitive Disorder. There were PVT failure rates greater than 10% (and considered false positives) in both groups (AA: PSI, TMT-A, and BVMT-R, 12-24%; EA: BVMT-R, 17%). Failing 2 or more PVTs (AA = 9%, EA = 4%) was impacted by education and Mild Neurocognitive Disorder but not by race.

CONCLUSIONS

Individual (timed) PVTs showed higher false positive rates in the AA sample even after accounting for demographic factors and diagnosis of Mild Neurocognitive Disorder. Requiring failure on 2 or more embedded PVTs reduced false positive rates to acceptable levels across both groups (10% or less) and was not significantly influenced by race.

Suite test. A virtual reality based neuropsychological assessment tool for memory. A normative study on immediate, short-term and delayed memory tasks

OBJECTIVE

To collect normative data for the Suite test, a virtual reality (VR) tool designed to assess memory processes.

METHOD

The normative sample included 676 subjects (49.7% female), aged from 12 to 85 years. The Suite test comprises a 360-degree VR environment designed as a furniture shop, in which participants must group specific sets of furniture items (ordered by different families of customers) by clicking on the furniture to be packed following instructions from a voice-over.

RESULTS

Core variables provided were grouped into immediate, short-term and long-term delayed recall. Cluster analyses established five age groups (12 years old, 13 to 26, 27 to 44, 45 to 58, and 59 to 85) with gender differentiated norms only deemed necessary for those transitioning from adolescence to adulthood (13 to 26) and from middle age to older adulthood (45 to 58). No statistically significant differences were found for additional gender × age normative groups, or for any group differentiated by educational level. A confirmatory factor analysis raised the existence of two differentiated factors, one associated to encoding processes (immediate memory trials) and the other to retrieval processes (both short term and long-term delayed recall trials grouping into the same factor). Additional results on the test reliability and internal consistency are presented.

CONCLUSIONS

Suite Test can help explore memory deficits across the life span and differentiate between visual and verbal memory strategies. Further research is required to study the test sensitivity and specificity, as well as convergent validity studies with well-established memory assessment tools.

Symptom Attribution and Neuropsychological Outcomes Among Treatment-Seeking Veterans With a History of Traumatic Brain Injury

OBJECTIVE

In this cross-sectional study, the authors aimed to examine relationships between illness perception, measured as symptom attribution, and neurobehavioral and neurocognitive outcomes among veterans with a history of traumatic brain injury (TBI).

METHODS

This study included 55 treatment-seeking veterans (N=43 with adequate performance validity testing) with a remote history of TBI (80% with mild TBI). Veterans completed a clinical interview, self-report questionnaires, and a neuropsychological assessment. A modified version of the Neurobehavioral Symptom Inventory (NSI) was administered to assess neurobehavioral symptom endorsement and symptom attribution. Composite scores were calculated from standardized cognitive tests to assess specific aspects of objective cognitive functioning, including memory, executive functioning, attention and working memory, and processing speed.

RESULTS

The symptoms most frequently attributed to TBI included forgetfulness, poor concentration, slowed thinking, and headaches. There was a significant positive association between symptom attribution and overall symptom endorsement (NSI total score) (r=0.675) and endorsement of specific symptom domains (NSI symptom domain scores) (r=0.506-0.674), indicating that greater attribution of symptoms to TBI was associated with greater symptom endorsement. Furthermore, linear regressions showed that symptom attribution was significantly associated with objective cognitive functioning, whereas symptom endorsement generally did not show this relationship. Specifically, greater attribution of symptoms to TBI was associated with worse executive functioning (β=-0.34), attention and working memory (β=-0.43), and processing speed (β=-0.35).

CONCLUSIONS

These findings suggest that veterans who routinely attribute neurobehavioral symptoms to their TBI are at greater risk of experiencing poor long-term outcomes, including elevated symptom endorsement and worse objective cognition. Although more research is needed to understand how illness perception influences outcomes in this population, these preliminary results highlight the importance of early psychoeducation regarding the anticipated course of recovery following TBI.

An overview of malingering and deception in neuropsychiatric cases

Forensic practitioners must shoulder special responsibilities when evaluating over-stated pathology (e.g., malingering) as well as simulated adjustment. Such determinations may modify or even override other clinical findings. As a result, practitioners must be alert to their own misassumptions that may unintentionally bias their conclusions about response styles. Detection strategies for malingering-based on unlikely or markedly amplified presentations-are highlighted in this article. Given page constraints, assessment methods for feigning are succinctly presented with their applications to administrative, civil, and criminal referrals.

Neuropsychological Functioning in Sexual Offenders With and Without Pedophilic Disorder

This study sought to examine neuropsychological functioning in men with pedophilic disorder (PD), in order to assess whether findings from prior neuropsychological studies are replicated in a diverse sample including men with non-contact sexual offenses. It was hypothesized that when non-contact offenders are included in the study, a slowed processing speed will emerge as the only finding unique to men with PD. A comprehensive neuropsychological battery was administered to 58 men convicted of a sexual offense, 20 of whom were classified as having PD. The sample included men with contact sexual offenses (n = 33), non-contact sexual offenses (n = 5), and child sexual abuse material (CSAM) offenses (n = 20). Test performance was compared by PD status. Participants with PD performed significantly better on verbal memory and visual discrimination than those without PD. Men with PD made more errors on a set-shifting task but no significant differences were seen in domains of attention, intellectual functioning, visual learning and memory, visuospatial ability, or language ability. Effect sizes were generally small, although some medium effects were seen (visual discrimination and verbal learning and memory). Scores in both groups (with and without PD) were generally in the average range across tasks. Within the subgroup of CSAM offenders, minimal differences emerged between those with and without PD, although those with PD were slower on visuomotor set-shifting but made fewer errors (d = - 0.89). CSAM offenders with PD were in the high average range on many tasks of intellectual functioning; however, a potential trend was identified such that CSAM offenders without PD had lower scores on a task of verbal learning and memory, with medium effect sizes observed. As few differences in neuropsychological functioning emerged when comparing offenders with and without PD, differences demonstrated in prior research may be better attributed to contact offending status rather than sexual interest.

Subjective memory complaints are associated with decreased cortical thickness in Veterans with histories of mild traumatic brain injury

Objective: Memory problems are frequently endorsed in Veterans following mild traumatic brain injury (mTBI), but subjective complaints are poorly associated with objective memory performance. Few studies have examined associations between subjective memory complaints and brain morphometry. We investigated whether self-reported memory problems were associated with objective memory performance and cortical thickness in Veterans with a history of mTBI. Methods: 40 Veterans with a history of remote mTBI and 29 Veterans with no history of TBI completed the Prospective-Retrospective Memory Questionnaire (PRMQ), PTSD Checklist (PCL), California Verbal Learning Test-2nd edition (CVLT-II), and 3 T T1 structural magnetic resonance imaging. Cortical thickness was estimated in 14 a priori frontal and temporal regions. Multiple regressions adjusting for age and PCL scores examined associations between PRMQ, CVLT-II scores, and cortical thickness within each Veteran group. Results: Greater subjective memory complaints on the PRMQ were associated with lower cortical thickness in the right middle temporal gyrus (β = 0.64, q = .004), right inferior temporal gyrus (β = 0.56, q = .014), right rostral middle frontal gyrus (β = 0.45, q = .046), and right rostral anterior cingulate gyrus (β = 0.58, q = .014) in the mTBI group but not the control group (q's > .05). These associations remained significant after adjusting for CVLT-II learning. CVLT-II performance was not associated with PRMQ score or cortical thickness in either group. Conclusions: Subjective memory complaints were associated with lower cortical thickness in right frontal and temporal regions, but not with objective memory performance, in Veterans with histories of mTBI. Subjective complaints post-mTBI may indicate underlying brain morphometry independently of objective cognitive testing.

Review of Statistical and Methodological Issues in the Forensic Prediction of Malingering from Validity Tests: Part I: Statistical Issues

Forensic neuropsychological examinations with determination of malingering have tremendous social, legal, and economic consequences. Thousands of studies have been published aimed at developing and validating methods to diagnose malingering in forensic settings, based largely on approximately 50 validity tests, including embedded and stand-alone performance validity tests. This is the first part of a two-part review. Part I explores three statistical issues related to the validation of validity tests as predictors of malingering, including (a) the need to report a complete set of classification accuracy statistics, (b) how to detect and handle collinearity among validity tests, and (c) how to assess the classification accuracy of algorithms for aggregating information from multiple validity tests. In the Part II companion paper, three closely related research methodological issues will be examined. Statistical issues are explored through conceptual analysis, statistical simulations, and through reanalysis of findings from prior validation studies. Findings suggest extant neuropsychological validity tests are collinear and contribute redundant information to the prediction of malingering among forensic examinees. Findings further suggest that existing diagnostic algorithms may miss diagnostic accuracy targets under most realistic conditions. The review makes several recommendations to address these concerns, including (a) reporting of full confusion table statistics with 95% confidence intervals in diagnostic trials, (b) the use of logistic regression, and (c) adoption of the consensus model on the "transparent reporting of multivariate prediction models for individual prognosis or diagnosis" (TRIPOD) in the malingering literature.

Logical memory, visual reproduction, and verbal paired associates are effective embedded validity indicators in patients with traumatic brain injury

OBJECTIVE

This study was design to evaluate the potential of the recognition trials for the Logical Memory (LM), Visual Reproduction (VR), and Verbal Paired Associates (VPA) subtests of the Wechsler Memory Scales-Fourth Edition (WMS-IV) to serve as embedded performance validity tests (PVTs).

METHOD

The classification accuracy of the three WMS-IV subtests was computed against three different criterion PVTs in a sample of 103 adults with traumatic brain injury (TBI).

RESULTS

The optimal cutoffs (LM ≤ 20, VR ≤ 3, VPA ≤ 36) produced good combinations of sensitivity (.33-.87) and specificity (.92-.98). An age-corrected scaled score of ≤5 on either of the free recall trials on the VPA was specific (.91-.92) and relatively sensitive (.48-.57) to psychometrically defined invalid performance. A VR I ≤ 5 or VR II ≤ 4 had comparable specificity, but lower sensitivity (.25-.42). There was no difference in failure rate as a function of TBI severity.

CONCLUSIONS

In addition to LM, VR, and VPA can also function as embedded PVTs. Failing validity cutoffs on these subtests signals an increased risk of non-credible presentation and is robust to genuine neurocognitive impairment. However, they should not be used in isolation to determine the validity of an overall neurocognitive profile.

Low rate of performance validity failures among individuals with bipolar disorder

OBJECTIVE

Assessing performance validity is imperative in both clinical and research contexts as data interpretation presupposes adequate participation from examinees. Performance validity tests (PVTs) are utilized to identify instances in which results cannot be interpreted at face value. This study explored the hit rates for two frequently used PVTs in a research sample of individuals with and without histories of bipolar disorder (BD).

METHOD

As part of an ongoing longitudinal study of individuals with BD, we examined the performance of 736 individuals with BD and 255 individuals with no history of mental health disorder on the Test of Memory Malingering (TOMM) and the California Verbal Learning Test forced choice trial (CVLT-FC) at three time points.

RESULTS

Undiagnosed individuals demonstrated 100% pass rate on PVTs and individuals with BD passed over 98% of the time. A mixed effects model adjusting for relevant demographic variables revealed no significant difference in TOMM scores between the groups, a = .07, SE = .07, p = .31. On the CVLT-FC, no clinically significant differences were observed (ps < .001).

CONCLUSIONS

Perfect PVT scores were obtained by the majority of individuals, with no differences in failure rates between groups. The tests have approximately >98% specificity in BD and 100% specificity among non-diagnosed individuals. Further, nearly 90% of individuals with BD obtained perfect scores on both measures, a trend observed at each time point.

"It's on the tip of my tongue!" exploring confrontation naming difficulties in patients with multiple sclerosis

BACKGROUND

Naming difficulty is commonly reported by patients with multiple sclerosis (pwMS). Though many cognitive batteries recommended for pwMS include fluency tasks, they do not include naming tasks. The aim of this study was to examine the prevalence of naming impairment in pwMS by using a measure of confrontation naming and to identify correlates with neuroimaging.

METHODS

One-hundred-eighty-five pwMS (M_age = 48.75 ± 11.23) completed neuropsychological testing and fifty had brain MRI scans within one year of neuropsychological testing. Controlling for demographic variables, partial correlations and hierarchical regressions with language tests as the outcome variables and neuroimaging variables as predictors were performed.

RESULTS

Performance on language tasks ranged within low average to average, with impairment most frequently found on a measure of confrontation naming (Boston Naming Test [BNT];27.6%), followed by a measure of phonemic fluency (Controlled Oral Word Association Test [COWAT]; 24.3%) and semantic fluency (animals [AF]; 18.3%). In the subset of patients with neuroimaging, thalamic volume had the strongest relationship with language variables, followed by white matter volume and T2 lesion volume. Language variables had no association with fractional gray matter volume. Of the language measures, BNT demonstrated the strongest relationship with MRI variables, followed by AF. There were no significant associations between neuroimaging variables and COWAT. Regression results revealed that fractional thalamic volume significantly contributed to BNT scores after adjusting for demographics, while T2 lesion volume predicted AF and no neuroimaging variables emerged as predictors for COWAT after controlling for demographics.

CONCLUSIONS

Objective naming impairment is common in pwMS and are more strongly associated with neuroimaging of MS brain pathology than verbal fluency tasks that are commonly used in cognitive batteries for pwMS. Continued research on language (especially naming) deficits and neuroimaging correlates (particularly thalamic involvement) in pwMS is needed.

Baseline executive functioning moderates treatment-related changes in quality of life in veterans with posttraumatic stress disorder and comorbid traumatic brain injury

Posttraumatic stress disorder (PTSD) treatment has been associated with improvement in quality of life (QOL); however, little is known about factors that moderate treatment-related changes in QOL, particularly cognitive factors. Executive functioning (EF) is important for success across all aspects of everyday life and predicts better psychological and physical health. EF is important to QOL, but more work is needed to better understand the association between EF and QOL improvements following interventions. We hypothesized that poorer baseline EF would be associated with less improvement in overall life satisfaction and satisfaction with health following PTSD treatment. U.S. veterans who served after the September 11, 2001 terrorist attacks (post 9-11; N = 80) with PTSD and a history of mild-to-moderate traumatic brain injury were randomized to standard cognitive processing therapy (CPT) or CPT combined with cognitive rehabilitation (SMART-CPT). Multilevel modeling was used to examine whether baseline EF performance was associated with changes in QOL scores from pretreatment to follow-up across both groups. Results indicated that poorer baseline performance on EF tests of working memory and inhibition were associated with less treatment-related improvements in general life satisfaction and satisfaction with health, rs = .26-.36. Treatment condition did not moderate any results. Future research should examine whether implementing EF-focused techniques before and/or concurrently with CPT for individuals with poorer baseline working memory and inhibition enhances QOL treatment gains, particularly in terms of general life and health-related satisfaction.

Cognitive Performance and Psychiatric Self-Reports Across Adult Cognitive Disengagement Syndrome and ADHD Diagnostic Groups

OBJECTIVE

Cognitive disengagement syndrome (CDS) is characterized by inattention, under-arousal, and fatigue and frequently co-occurs with attention-deficit/hyperactivity disorder (ADHD). Although CDS is associated with cognitive complaints, its association with objective cognitive performance is less well understood.

METHOD

This study investigated neuropsychological correlates of CDS symptoms among 169 adults (M_age = 29.4) referred for outpatient neuropsychological evaluation following inattention complaints. We evaluated cognitive and self-report differences across four high/low CDS and positive/negative ADHD groups, and cognitive and self-report correlates of CDS symptomology.

RESULTS

There were no differences in cognitive performance, significant differences in self-reported psychiatric symptoms (greater CDS symptomatology, impulsivity among the high CDS groups; greater inattention among the positive ADHD/high CDS groups; greater hyperactivity among the positive ADHD groups), significant intercorrelations within cognitive and self-report measures, nonsignificant correlations between cognitive measures and self-report measures.

CONCLUSION

Findings support prior work demonstrating weak to null associations between ADHD and CDS symptoms and cognitive performance among adults.

Mechanisms through which executive dysfunction influences suicidal ideation in combat-exposed Iraq and Afghanistan veterans

OBJECTIVE

Executive dysfunction has previously been associated with suicidality, but it remains unclear how deficits in executive functioning contribute to increased suicidal thoughts and behaviors. Although it has been proposed that poorer executive functioning leads to difficulty generating and implementing appropriate coping strategies to regulate distress and inhibit suicidal thoughts and behaviors, studies have not systematically examined these relationships. Therefore, the present study examined various hypotheses to elucidate the mechanisms through which executive dysfunction influences suicidal ideation (SI) in combat-exposed Iraq/Afghanistan veterans.

METHOD

Veterans who endorsed SI were compared to those who denied SI on demographic and diagnostic variables and measures of neuropsychological functioning, psychological symptoms, coping styles, and combat experiences. Serial mediation models were tested to examine mechanistic relationships among executive functioning, psychological distress, coping, and SI.

RESULTS

Those who endorsed SI had worse executive functioning, greater psychological distress, and greater avoidant coping relative to those who denied SI. Serial mediation model testing indicated a significant indirect path, such that executive dysfunction increased psychological distress, which in turn increased avoidant coping, leading to SI.

CONCLUSIONS

Findings support and extend previous hypotheses regarding how executive functioning contributes to increased risk of suicidality via increased distress and avoidant coping. Intervention efforts focused on reducing suicidality may benefit from techniques that enhance executive functioning (e.g. computerized training, cognitive rehabilitation) and in turn reduce distress prior to targeting coping strategies.

An alternative approach to TOMM cutoff scores using a large sample of military personnel

The accuracy of neuropsychological assessments relies on participants exhibiting their true abilities during administration. The Test of Memory Malingering (TOMM) is a popular performance validity test used to determine whether an individual is providing honest answers. While the TOMM has proven to be highly sensitive to those who are deliberately exaggerating their symptoms, there is a limited explanation regarding the significance of using 45 as a cutoff score. The present study aims to further investigate this question by examining TOMM scores obtained in a large sample of active-duty military personnel (N = 859, M = 26 years, SD = 6.14, 97.31% males, 72.44% white). Results indicated that no notable discrepancies existed between the frequency of participants who scored a 45 and those who scored slightly below a 45 on the TOMM. The sensitivity and specificity of the TOMM were derived using the forced-choice recognition (FCR) scores obtained by participants on the California Verbal Learning Test, Second Edition (CVLT-II). The sensitivity for each trial of the TOMM was 0.84, 0.55, and 0.63, respectively; the specificity for each trial of the TOMM was 0.69, 0.93, and 0.92, respectively. Because sensitivity and specificity rates are both of importance in this study, balanced accuracy scores were also reported. Results suggested that various alternative cutoff scores produced a more accurate classification compared to the traditional cutoff of 45. Further analyses using Fisher's exact test also indicated that there were no significant performance differences on the FCR of the CVLT-II between individuals who received a 44 and individuals who received a 45 on the TOMM. The current study provides evidence on why the traditional cutoff may not be the most effective score. Future research should consider employing alternative methods which do not rely on a single score.

Neurocognitive Outcome Following Recovery from Severe Acute Respiratory Syndrome - Coronavirus-1 (SARS-CoV-1)

OBJECTIVE

Severe acute respiratory syndrome (SARS) is a highly contagious viral respiratory illness associated with hypoxia and dyspnea. Many of those who contracted and recovered from SARS during the 2002-2003 outbreak reported persistent physical, psychological, and cognitive difficulties. Here, we investigated the residual influences of SARS on cognition for a subset of healthcare professionals who recovered and were referred for neuropsychological evaluation through their workplace insurance.

METHOD

Twenty-eight healthcare professionals were evaluated on neuropsychological and mood functioning approximately 1.5 years post-recovery from a severe respiratory illness. Test scores were compared with age-matched normative data, and correlations were examined between mood, self-report memory scales, subjective complaints (e.g., poor concentration, pain, fatigue), illness severity (i.e., length of hospitalization, oxygen use during hospital stay), and cognitive performance.

RESULTS

Participants performed within age expectations on the majority of cognitive measures including overall memory ability. Although processing speed was generally within normal limits, 43% showed significant speed-accuracy trade-offs favoring accuracy over maintaining speed. Deficits were observed on measures of complex attention, such as working memory and the ability to sustain attention under conditions of distraction. Participants endorsed poorer memory ability than same-age peers on a meta-memory measure and mild to moderate depression and anxiety symptoms. Objective test performance was largely uncorrelated with self-reports, mood, or illness severity, except for moderate correlations between complex attention and participants' subjective ratings of Everyday Task-Oriented Memory.

CONCLUSIONS

These findings demonstrate specific long-term cognitive deficits associated with SARS and provide further evidence of the cognitive effects of hypoxic illnesses.

Disentangling subjective symptom complaints and objective cognitive performance in veterans: Impact of posttraumatic stress disorder and lifetime traumatic brain injury burden

Self-reported histories of mild traumatic brain injury (mTBI) and posttraumatic stress disorder (PTSD) symptoms are prevalent among post-9/11 veterans. Both are associated with subjective and often overlapping symptom complaints, but variably with objective neuropsychological test performances. These outcomes are seldom explored in relation to lifetime mTBI burden. This cross-sectional study examined associations of PTSD and lifetime mTBI with subjective (persistent symptoms after concussion and cognitive complaints) and objective (performances across five cognitive domains) measures among 46 veterans. Within this sample, 20 veterans had Clinician-Administered PTSD Scale for DSM-5 (CAPS-5) confirmed PTSD (PTSD+), whereas 26 demographically-similar participants did not meet criteria (PTSD-). The Boston Assessment of Traumatic Brain Injury-Lifetime (BAT-L) yielded total mTBI scores ranging from 0 to 8. Regressions showed PTSD was associated with increased subjective symptoms/cognitive complaints, along with reduced verbal fluency, visuospatial memory, and processing speed performances. Lifetime mTBI burden was associated with subjective symptoms, but not with objective cognitive test performance, after controlling for PTSD. No significant interactions were observed. Exploratory correlations suggested that all PTSD symptom clusters were generally associated with the subjective and objective measures. However, fewer significant associations emerged within the PTSD+/- groups separately, with each group yielding somewhat different patterns of relationships. PTSD and increasing mTBI burden are consistently associated with negative subjective symptoms, including cognitive complaints. Each condition likely explains some degree of unique variance in symptom reporting. PTSD is associated with poorer objective cognition on some tasks, including processing speed, executive functioning, and learning/memory. Implications are explored.

CVLT-II short form forced choice recognition in a clinical dementia sample: Cautions for performance validity assessment

Performance validity tests are susceptible to false positives from genuine cognitive impairment (e.g., dementia); this has not been explored with the short form of the California Verbal Learning Test II (CVLT-II-SF). In a memory clinic sample, we examined whether CVLT-II-SF Forced Choice Recognition (FCR) scores differed across diagnostic groups, and how the severity of impairment [Clinical Dementia Rating Sum of Boxes (CDR-SOB) or Mini-Mental State Examination (MMSE)] modulated test performance. Three diagnostic groups were identified: subjective cognitive impairment (SCI; n = 85), amnestic mild cognitive impairment (a-MCI; n = 17), and dementia due to Alzheimer's Disease (AD; n = 50). Significant group differences in FCR were observed using one-way ANOVA; post-hoc analysis indicated the AD group performed significantly worse than the other groups. Using multiple regression, FCR performance was modeled as a function of the diagnostic group, severity (MMSE or CDR-SOB), and their interaction. Results yielded significant main effects for MMSE and diagnostic group, with a significant interaction. CDR-SOB analyses were non-significant. Increases in impairment disproportionately impacted FCR performance for persons with AD, adding caution to research-based cutoffs for performance validity in dementia. Caution is warranted when assessing performance validity in dementia populations. Future research should examine whether CVLT-II-SF-FCR is appropriately specific for best-practice testing batteries for dementia.

Failing Performance Validity Cutoffs on the Boston Naming Test (BNT) Is Specific, but Insensitive to Non-Credible Responding

This study was designed to examine alternative validity cutoffs on the Boston Naming Test (BNT).Archival data were collected from 206 adults assessed in a medicolegal setting following a motor vehicle collision. Classification accuracy was evaluated against three criterion PVTs.The first cutoff to achieve minimum specificity (.87-.88) was T ≤ 35, at .33-.45 sensitivity. T ≤ 33 improved specificity (.92-.93) at .24-.34 sensitivity. BNT validity cutoffs correctly classified 67-85% of the sample. Failing the BNT was unrelated to self-reported emotional distress. Although constrained by its low sensitivity, the BNT remains a useful embedded PVT.

The Divergent Roles of Symptom and Performance Validity in the Assessment of ADHD

OBJECTIVE

This study examined concordance between symptom and performance validity among clinically-referred patients undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD).

METHOD

Data from 203 patients who completed the WAIS-IV Working Memory Index, the Clinical Assessment of Attention Deficit-Adult (CAT-A), and ≥4 criterion performance validity tests (PVTs) were analyzed.

RESULTS

Symptom and performance validity were concordant in 76% of cases, with the majority being valid performance. Of the remaining 24% of cases with divergent validity findings, patients were more likely to exhibit symptom invalidity (15%) than performance invalidity (9%). Patients demonstrating symptom invalidity endorsed significantly more ADHD symptoms than those with credible symptom reporting (ηp² = .06-.15), but comparable working memory test performance, whereas patients with performance invalidity had significantly worse working memory performance than those with valid PVT performance (ηp² = .18).

CONCLUSION

Symptom and performance invalidity represent dissociable constructs in patients undergoing neuropsychological evaluation of ADHD and should be evaluated independently.

White matter integrity, suicidal ideation, and cognitive dysfunction in combat-exposed Iraq and Afghanistan Veterans

White matter alterations in frontolimbic circuits and poorer cognitive functioning have been observed in individuals endorsing suicidality across numerous psychiatric conditions. However, relationships between white matter integrity, cognition, and suicidality in Veterans are poorly understood, particularly for those at increased risk for suicide due to mental health conditions (e.g., posttraumatic stress disorder, depression) and traumatic brain injury history. We (1) examined white matter alterations in combat-exposed Iraq/Afghanistan Veterans with and without suicidal ideation (SI) and (2) investigated relationships between white matter integrity and neuropsychological functioning in regions that differed between SI groups. No group differences were found regarding psychiatric diagnoses. Participants with SI had lower fractional anisotropy (FA) in the posterior corona radiata, superior corona radiata, and superior longitudinal fasciculus relative to those without SI. Worse processing speed/attention performance was associated with lower FA in the superior longitudinal fasciculus, while worse executive functioning performance was associated with lower FA in the superior corona radiata and superior longitudinal fasciculus. Memory performance was not associated with FA. These findings suggest that white matter integrity may be involved in cognitive dysfunction and increased risk for SI. Interventions that target cognitive dysfunction may ameliorate SI, and in turn, reduce risk for suicide among Veterans.

Examining the Clinical Utility of Selected Memory-Based Embedded Performance Validity Tests in Neuropsychological Assessment of Patients with Multiple Sclerosis

Within the neuropsychological assessment, clinicians are responsible for ensuring the validity of obtained cognitive data. As such, increased attention is being paid to performance validity in patients with multiple sclerosis (pwMS). Experts have proposed batteries of neuropsychological tests for use in this population, though none contain recommendations for standalone performance validity tests (PVTs). The California Verbal Learning Test, Second Edition (CVLT-II) and Brief Visuospatial Memory Test, Revised (BVMT-R)—both of which are included in the aforementioned recommended neuropsychological batteries—include previously validated embedded PVTs (which offer some advantages, including expedience and reduced costs), with no prior work exploring their utility in pwMS. The purpose of the present study was to determine the potential clinical utility of embedded PVTs to detect the signal of non-credibility as operationally defined by below criterion standalone PVT performance. One hundred thirty-three (133) patients (M age = 48.28; 76.7% women; 85.0% White) with MS were referred for neuropsychological assessment at a large, Midwestern academic medical center. Patients were placed into “credible” (n = 100) or “noncredible” (n = 33) groups based on a standalone PVT criterion. Classification statistics for four CVLT-II and BVMT-R PVTs of interest in isolation were poor (AUCs = 0.58–0.62). Several arithmetic and logistic regression-derived multivariate formulas were calculated, all of which similarly demonstrated poor discriminability (AUCs = 0.61–0.64). Although embedded PVTs may arguably maximize efficiency and minimize test burden in pwMS, common ones in the CVLT-II and BVMT-R may not be psychometrically appropriate, sufficiently sensitive, nor substitutable for standalone PVTs in this population. Clinical neuropsychologists who evaluate such patients are encouraged to include standalone PVTs in their assessment batteries to ensure that clinical care conclusions drawn from neuropsychological data are valid.

Critical Item Analysis Enhances the Classification Accuracy of the Logical Memory Recognition Trial as a Performance Validity Indicator

OBJECTIVE

: Replicate previous research on Logical Memory Recognition (LM_Recog) and perform a critical item analysis.

METHOD

: Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LM_Recog and nine critical items (CR-9) was computed.

RESULTS

: LM_Recog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LM_Recog ≤20; CR-9 ≥6 increased specificity by 6-8% over LM_Recog ≤20; CR-9 ≥7 increased specificity by 8-15%.

CONCLUSIONS

: Critical item analysis enhances the classification accuracy of the optimal LM_Recog cutoff (≤20).

Estimating premorbid intelligence in persons with traumatic brain injury: an examination of the Test of Premorbid Functioning

Knowledge of intelligence is essential for interpreting cognitive performance following traumatic brain injury (TBI). The Test of Premorbid Functioning (ToPF), a word reading test co-normed with the Wechsler Adult Intelligence Scale 4th Edition (WAIS-IV), was examined as a tool for estimating premorbid intelligence in persons with a history of TBI. Fifty-two participants with mild, moderate, or severe TBI were administered the ToPF and WAIS-IV between two weeks and 19 months post-injury. The independent ability of the ToPF/demographic score and the Verbal Comprehension Index (VCI) to predict WAIS-IV Full Scale IQ (FSIQ) was examined, as were discrepancies between ToPF and WAIS-IV scores within and between participants. The ToPF/demographic predicted FSIQ accounted for a significant proportion of variability in actual FSIQ, above and beyond that accounted for by education or time since injury. ToPF and WAIS-IV scores did not differ by injury severity. In our sample, the ToPF/demographic predicted FSIQ underestimated intelligence in a substantial portion of our participants (31%), particularly in those with high average to superior intelligence. Finally, VCI scores were more predictive of actual FSIQ than the ToPF/demographic predicted FSIQ. The ToPF frequently underestimated post-injury intelligence and is therefore not accurately measuring premorbid intelligence in our sample, particularly in those with above average to superior intelligence. Clinicians are encouraged to administer the entire WAIS-IV, or at minimum the VCI subtests, for a more accurate measure of intelligence in those with above average intelligence and history of TBI.

Nonmemory Composite Embedded Performance Validity Formulas in Patients with Multiple Sclerosis

OBJECTIVE

Research regarding performance validity tests (PVTs) in patients with multiple sclerosis (MS) is scant, with recommended batteries for neuropsychological evaluations in this population lacking suggestions to include PVTs. Moreover, limited work has examined embedded PVTs in this population. As previous investigations indicated that nonmemory-based embedded PVTs provide clinical utility in other populations, this study sought to determine if a logistic regression-derived PVT formula can be identified from selected nonmemory variables in a sample of patients with MS.

METHOD

A total of 184 patients (M age = 48.45; 76.6% female) with MS were referred for neuropsychological assessment at a large, Midwestern academic medical center. Patients were placed into "credible" (n = 146) or "noncredible" (n = 38) groups according to performance on standalone PVT. Missing data were imputed with HOTDECK.

RESULTS

Classification statistics for a variety of embedded PVTs were examined, with none appearing psychometrically appropriate in isolation (areas under the curve [AUCs] = .48-.64). Four exponentiated equations were created via logistic regression. Six, five, and three predictor equations yielded acceptable discriminability (AUC = .71-.74) with modest sensitivity (.34-.39) while maintaining good specificity (≥.90). The two predictor equation appeared unacceptable (AUC = .67).

CONCLUSIONS

Results suggest that multivariate combinations of embedded PVTs may provide some clinical utility while minimizing test burden in determining performance validity in patients with MS. Nonetheless, the authors recommend routine inclusion of several PVTs and utilization of comprehensive clinical judgment to maximize signal detection of noncredible performance and avoid incorrect conclusions. Clinical implications, limitations, and avenues for future research are discussed.

Normal cognitive test scores cannot be interpreted as accurate measures of ability in the context of failed performance validity testing: A symptom- and detection-coached simulation study

Introduction: While use of performance validity tests (PVTs) has become a standard of practice in neuropsychology, there are differing opinions regarding whether to interpret cognitive test data when standard scores fall within normal limits despite PVTs being failed. This study is the first to empirically determine whether normal cognitive test scores underrepresent functioning when PVTs are failed.Method: Participants, randomly assigned to either a simulated malingering group (n = 50) instructed to mildly suppress test performances or a best-effort/control group (n = 50), completed neuropsychological tests which included the North American Adult Reading Test (NAART), California Verbal Learning Test - 2^nd Edition (CVLT-II), and Test of Memory Malingering (TOMM).Results: Groups were not significantly different in age, sex, education, or NAART predicted intellectual ability, but simulators performed significantly worse than controls on the TOMM, CVLT-II Forced Choice Recognition, and CVLT-II Short Delay Free Recall. The groups did not significantly differ on other examined CVLT-II measures. Of simulators who failed validity testing, 36% scored no worse than average and 73% scored no worse than low average on any of the examined CVLT-II indices.Conclusions: Of simulated malingerers who failed validity testing, nearly three-fourths were able to produce cognitive test scores that were within normal limits, which indicates that normal cognitive performances cannot be interpreted as accurately reflecting an individual's capabilities when obtained in the presence of validity test failure. At the same time, only 2 of 50 simulators were successful in passing validity testing while scoring within an impaired range on cognitive testing. This latter finding indicates that successfully feigning cognitive deficits is difficult when PVTs are utilized within the examination.

Establishing the base rate of performance invalidity in a clinical electrical injury sample: Implications for neuropsychological test performance

Objective: The base rate of neuropsychological performance invalidity in electrical injury, a clinically-distinct and frequently compensation-seeking population, is not well established. This study determined the base rate of performance invalidity in a large electrical injury sample, and examined patient characteristics, injury parameters, and neuropsychological test performance based on validity status.Method: This cross-sectional study included data from 101 patients with electrical injury consecutively referred for post-acute neuropsychological evaluation. Eighty-five percent of the sample was compensation-seeking. Multiple performance validity tests (PVTs) were administered as part of standard clinical evaluation. For patients with four or more PVTs, valid performance was operationalized as less than or equal to one PVT failure and invalid performance as two or more failures.Results: Frequency analysis revealed 66% (n = 67) had valid performance while 29% (n = 29) demonstrated probable invalid performance; the remaining 5% (n = 5) had indeterminate validity. No significant differences in demographics or injury parameters emerged between validity groups (0 vs. 1 vs. ≥2 PVT failures). In contrast, the electrical injury group with invalid performance performed significantly worse across tests of processing speed and executive abilities than those with valid performance (ps< .05, η_p² = .19-.25).Conclusions: The current study is the first to establish the base rate of neuropsychological performance invalidity in electrical injury survivors using empirical methods and current practice standards. Patient and clinical variables, including compensation-seeking status, did not differ between validity groups; however, neuropsychological test performance did, supporting the need for multi-method, objective performance validity assessment.

Metabolic Syndrome and Physical Performance: The Moderating Role of Cognition among Middle-to-Older-Aged Adults

OBJECTIVE

Mobility limitation and cognitive decline are related. Metabolic syndrome (MetS), the clustering of three or more cardiovascular risk factors, is associated with decline in both mobility and cognition. However, the interrelationship among MetS, mobility, and cognition is unknown. This study investigated a proposed pathway where cognition moderates the relationship between MetS and Mobility.

METHOD

Adults ages 45-90 years were recruited. MetS risk factors and mobility performance (Short Physical Performance Battery (SPPB) and gait speed) were evaluated. Cognition was assessed using a comprehensive neuropsychological battery. A factor analysis of neuropsychological test scores yielded three factors: executive function, explicit memory, and semantic/contextual memory. Multivariable linear regression models were used to examine the relationship among MetS, mobility, and cognition.

RESULTS

Of the 74 participants (average age 61 ± 9 years; 41% female; 69% White), 27 (36%) participants manifested MetS. Mean SPPB score was 10.9 ± 1.2 out of 12 and gait speed was 1.0 ± 0.2 m/s. There were no statistically significant differences in mobility by MetS status. However, increase in any one of the MetS risk factors was associated with decreased mobility performance after adjusting for age and gender (SPPB score: β (SE) -.17 (0.08), p < .05; gait speed: -.03 (.01), p < .01). Further adjusting for cognitive factors (SPPB score: explicit memory .31 (.14), p = .03; executive function 0.45 (0.13), p < .01; gait speed: explicit memory 0.04 (0.02), p = .03; executive function 0.06 (0.02), p < .01) moderated the relationships between number of metabolic risk factors and mobility.

CONCLUSION

The relationship between metabolic risk factors and mobility may be moderated by cognitive performance, specifically through executive function and explicit memory.

Memory in multiple sclerosis: A reappraisal using the item specific deficit approach

OBJECTIVE

As many as 65% of people with multiple sclerosis (MS) have clinically significant memory impairment, but the nature of this deficit is controversial. Some investigations suggest that an inability to retrieve newly learned information from memory is prominent, whereas others imply that compromised acquisition accounts for impairment. Prior research has not simultaneously evaluated acquisition and retrieval processes in MS, and fewer have attempted to account for initial acquisition when studying retrieval. The Item Specific Deficit Approach (ISDA) offers a method of quantifying acquisition, retrieval, and retention processes, with the latter two mechanisms being adjusted for initial acquisition. To simultaneously quantify acquisition and retrieval abilities, the ISDA was applied to list learning performance in two independent samples of people with MS and corresponding healthy comparison groups.

PARTICIPANTS AND METHODS

Study 1 included 85 people with MS and 47 healthy individuals. Study 2 involved a separate sample of 79 people with MS and 22 healthy people. They were administered neuropsychological batteries, and participants with MS were classified as globally impaired or unimpaired. The California Verbal Learning Test-II was administered to assess new-learning in both studies, and responses were scored using the ISDA.

RESULTS

Both studies revealed that cognitively impaired people with MS manifest weaknesses involving acquisition and retrieval. Nearly identical effect sizes emerged across samples, with cognitive impairment achieving a medium effect upon acquisition and a large effect upon retrieval.

CONCLUSIONS

These findings accord well with previous research showing diminished acquisition and retrieval among people with MS. The results may also reconcile contradictory findings in the extant literature by showing that memory impairment in MS is not exclusively attributable to either acquisition or retrieval. Rather, both processes may manifest across people with MS. The replication across samples with nearly identical effect sizes implies that these effects are reliable and possess external validity. These data hold implications for memory rehabilitation interventions involving people with MS, and suggest that acquisition and retrieval processes should be addressed in treatment. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Mean response latency indices on the Victoria Symptom Validity Test do not contribute meaningful predictive value over accuracy scores for detecting invalid performance

The utility of the Victoria Symptom Validity Test (VSVT) as a performance validity test (PVT) has been primarily established using response accuracy scores. However, the degree to which response latency may contribute to accurate classification of performance invalidity over and above accuracy scores remains understudied. Therefore, this study investigated whether combining VSVT accuracy and response latency scores would increase predictive utility beyond use of accuracy scores alone. Data from a mixed clinical sample of 163 patients, who were administered the VSVT as part of a larger neuropsychological battery, were analyzed. At least four independent criterion PVTs were used to establish validity groups (121 valid/42 invalid). Logistic regression models examining each difficulty level revealed that all VSVT measures were useful in classifying validity groups, both independently and when combined. Individual predictor classification accuracy ranged from 77.9 to 81.6%, indicating acceptable to excellent discriminability across the validity indices. The results of this study support the value of both accuracy and latency scores on the VSVT to identify performance invalidity, although the accuracy scores had superior classification statistics compared to response latency, and mean latency indices provided no unique benefit for classification accuracy beyond dimensional accuracy scores alone.

Victoria Symptom Validity Test: A Systematic Review and Cross-Validation Study

The Victoria Symptom Validity Test (VSVT) is a performance validity test (PVT) with over two decades of empirical backing, although methodological limitations within the extant literature restrict its clinical and research generalizability. Chief among these constraints includes limited consensus on the most accurate index within the VSVT and the most appropriate cut-scores within each VSVT validity index. The current systematic review synthesizes existing VSVT validation studies and provides additional cross-validation in an independent sample using a known-groups design. We completed a systematic search of the literature, identifying 17 peer-reviewed studies for synthesis (7 simulation designs, 7 differential prevalence designs, and 3 known-groups designs). The independent cross-validation sample consisted of 200 mixed clinical neuropsychiatric patients referred for outpatient neuropsychological evaluation. Across all indices, Total item accuracy produced the strongest psychometric properties at an optimal cut-score of ≤ 40 (62% sensitivity/88% specificity). However, ROC curve analyses for all VSVT indices yielded statistically significant areas under the curve (AUCs; .73-81), suggestive of moderate classification accuracy. Cut-scores derived using the independent cross-validation sample converged with some previous findings supporting cut-scores of ≤ 22 for Easy item accuracy and ≤ 40 for Total item accuracy, although divergent findings were noted for Difficult item accuracy. Overall, VSVT validity indicators have adequate diagnostic accuracy across populations, with the current study providing additional support for its use as a psychometrically sound PVT in clinical settings. However, caution is recommended among patients with certain verified clinical conditions (e.g., dementia) and those with pronounced working memory deficits due to concerns for increased risk of false positives.

Building research in diet and cognition (BRIDGE): Baseline characteristics of older obese African American adults in a randomized controlled trial to examine the effect of the Mediterranean diet with and without weight loss on cognitive functioning

•

The MedDiet is correlated with slower cognitive decline in longitudinal studies.

•

Self-reported MedDiet adherence positively associated with select cognitive domains.

•

Women outperformed men across verbal tasks, including learning and memory.

•

Younger participants outperformed older participants on cognitive assessments.

In the United States, >5.4 million people age 65 and older are affected by cognitive impairment and dementia, including Alzheimer’s disease. African Americans are more likely than non-Hispanic whites to suffer from these disorders. Obesity is linked to accelerated age-related cognitive decline, and weight loss through caloric restriction is a potential strategy to prevent this cognitive impairment. Adherence to a healthful dietary pattern, such as the Mediterranean Diet (MedDiet), has also shown positive effects on reducing risk for dementia. African Americans are disproportionately affected by obesity and have less healthful diets than non-Hispanic whites. We present baseline characteristics from a three-arm randomized controlled trial that randomized 185 obese (BMI ≥ 30 kg/m² and ≤ 50 kg/m²) healthy older adults (55–85 years of age) to: 1) Typical Diet Control (TDC); 2) MedDiet alone (MedDiet-A) intervention; or 3) MedDiet caloric restricted intervention to promote weight loss (MedDiet-WL). The majority of the sample was African American (91.4%) and female (85.9%). The two active interventions (MedDiet-A and MedDiet-WL) met once weekly for 8 months, and the TDC received weekly general health newsletters. Baseline data were collected between January 2017 and July 2019 in Chicago, IL. In our sample, closer adherence to a MedDiet pattern was associated with higher attention and information processing (AIP) and higher executive functioning (EF). Consistent with the literature, we saw that older participants performed more poorly on the cognitive assessments than younger participants, and women outperformed men across verbally mediated tasks, especially ones related to learning and memory.

Performance Validity Testing in Multiple Sclerosis

OBJECTIVE

Performance validity tests (PVTs) are designed to detect nonvalid responding on neuropsychological testing, but their associations with disease-specific and other factors are not well understood in multiple sclerosis (MS). We examined PVT performance among MS patients and associations with clinical characteristics, cognition, mood, and disability status.

METHOD

Retrospective data analysis was conducted on a sample of patients with definite MS (n = 102) who were seen for a clinical neuropsychological evaluation. Comparison samples included patients with intractable epilepsy seen for presurgical workup (n = 102) and patients with nonacute mild traumatic brain injury (mTBI; n = 50). Patients completed the Victoria Symptom Validity Test (VSVT) and validity cutoffs were defined as <16/24 and <18/24 on the hard items.

RESULTS

In this MS cohort, 14.4% of patients scored <16 on the VSVT hard items and 21.2% scored <18. VSVT hard item scores were associated with disability status and depression, but not with neuropsychological scores, T2 lesion burden, atrophy, disease duration, or MS subtype. Patients applying for disability benefits were 6.75 times more likely to score <18 relative to those who were not seeking disability. Rates of nonvalid scores were similar to the mTBI group and greater than the epilepsy group.

CONCLUSIONS

This study demonstrates that nonvalid VSVT scores are relatively common among MS patients seen for clinical neuropsychological evaluation. VSVT performance in this group relates primarily to disability status and psychological symptoms and does not reflect factors specific to MS (i.e., cognitive impairment, disease severity). Recommendations for future clinical and research practices are provided.

Stronger Together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain Injury

OBJECTIVE

This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV).

METHOD

Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance.

RESULTS

Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91-.95) over univariate cutoffs (.78-.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43-.67) compared to univariate cutoffs (.11-.63) while maintaining consistently high specificity (.93-.95).

CONCLUSIONS

In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment.

BRIEF SUMMARY

Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment.

Response inhibition in Veterans with a history of mild traumatic brain injury: The role of self-reported complaints in objective performance

INTRODUCTION

Although objective deficits in response inhibition (RI) have been detected in civilians with mild traumatic brain injury (mTBI), it remains unclear whether objective RI is worse in military Veterans with mTBI despite the prevalence of self-reported disinhibition. Assessing RI in Veterans is critical due to their unique characteristics, including combat and blast exposure, in addition to the prevalence of psychiatric comorbidity. Therefore, the aims of this study were to (1) examine RI performance in Veterans with mTBI compared to non-mTBI Veterans and (2) compare RI performance in well-defined subgroups of mTBI Veterans with and without self-reported complaints of disinhibition to non-mTBI Veterans.

METHOD

53 mTBI Veterans and 37 non-mTBI Veterans completed a Go/No-Go RI task and measures of self-reported disinhibition (Frontal Systems Behavior Scale) and psychiatric symptoms. ANCOVAs covarying for mood and demographics compared RI performances of the non-mTBI Veterans to (1) the total sample of mTBI Veterans (n= 53) and to (2) mTBI Veterans with elevated (t-score ≥ 60; mTBI-SubjDis; n= 23) and low (t-score < 60; mTBI-NoSubjDis; n= 30) levels of self-reported disinhibition.

RESULTS

There were no significant differences in RI between the mTBI group as a whole and the non-mTBI Veterans group. However, when Veterans with mTBI were divided into groups by clinically-significant concern about their disinhibition, the mTBI-SubjDis group demonstrated significantly worse RI than the mTBI-NoSubjDis and non-mTBI Veteran groups. No significant differences in RI performance were observed between the mTBI-NoSubjDis and non-mTBI Veteran groups.

CONCLUSIONS

Results indicate that mTBI Veterans with elevated levels of self-reported disinhibition show diminished performance on objective measures of RI, independent of mood. Findings highlight the unique contribution of subjective complaints on executive functioning in mTBI, and they underscore the importance of assessing cognitive complaints in order to identify those most at risk for poor-long term outcomes.

Early Cutoff Criteria for Strong Performance on the Test of Memory Malingering

OBJECTIVE

The Test of Memory Malingering (TOMM) is widely used to assess performance validity. To improve efficiency, we investigated whether abbreviated administration (i.e., only the first 25 items of Trial 1 [T1]) is possible when effort is very strong (≥49/50 on T1 or T2).

METHOD

We collected TOMM scores of 501 consecutive adult patients ranging in cognitive status who underwent standard neuropsychological evaluation at Mayo Clinic, Rochester, MN.

RESULTS

Receiver Operating Characteristic (ROC) analysis showed excellent area under the curve (AUC) (0.94; CI95% [0.92, 0.97]) and a cutoff of 25/25 had 100% specificity for identifying strong performance. Of the 224 patients who obtained a perfect score on the first 25 items, 197 (88%) obtained ≥49 on T1 and the remaining patients (n = 27) obtained ≥49 on T2.

CONCLUSION

A perfect score on the first 25 items of the TOMM predicted overall strong performance 100% of the time, supporting abbreviated administration in select cases in a general outpatient clinical setting.

Are Established Embedded Performance Validity Test Cut-Offs Generalizable to Patients With Multiple Sclerosis?

Objective

Data for the use of embedded performance validity tests (ePVTs) with multiple sclerosis (MS) patients are limited. The purpose of the current study was to determine whether ePVTs previously validated in other neurological samples perform similarly in an MS sample.

Methods

In this retrospective study, the prevalence of below-criterion responding at different cut-off scores was calculated for each ePVT of interest among patients with MS who passed a stand-alone PVT.

Results

Previously established PVT cut-offs generally demonstrated acceptable specificity when applied to our sample. However, the overall cognitive burden of the sample was limited relative to that observed in prior large-scale MS studies.

Conclusion

The current study provides initial data regarding the performance of select ePVTs among an MS sample. Results indicate most previously validated cut-offs avoid excessive false positive errors in a predominantly relapsing remitting MS sample. Further validation among MS patients with more advanced disease is warranted.