When 10 is enough: Errors on the first 10 items of the Test of Memory Malingering (TOMMe10) and administration time predict freestanding performance validity tests (PVTs) and underperformance on memory measures

Test of memory Malingering 2nd Edition: Normative data from cognitively intact adults living in Spain

This study evaluated the universality of the TOMM 2 and provided a reference sample of cognitively intact adults living in Spain whose native language was Spanish. A total of 203 adults completed the TOMM 2 from June 2019 to January 2020. When using the original TOMM cutoff scores derived from English speakers, all participants scored in a range that would suggest that they passed the TOMM. When using a cut score less than 40 on Trial 1, only one participant in this study would be mistakenly classified as providing an invalid performance. Spanish-speaking adults in Spain from this study achieved a perfect score on Trial 1 at a rate more than double that of English-speaking individuals on the original TOMM. At the item level, all but one item met the minimum standard for performance validity; this item fell only marginally below the standard at 89%. This study found a very low failure rate for the TOMM 2, suggesting that the second edition has at least as high specificity as the original in Spanish adults.

The minimal effect of depression on cognitive functioning when accounting for TOMM performance in a sample of U.S. veterans

While many studies have demonstrated a relationship between depression and cognitive deficits, most have neglected to include measurements of performance validity. This study examined the relationship between depression and cognition after accounting for noncredible performance. Participants were veterans referred for outpatient clinical evaluation. The first set of regression analyses (N = 187) included age, sex, and education in Model 1, Beck Depression Inventory-2 (BDI-2) added in Model 2, and pass/failure of Test of Memory Malingering (TOMM) added in Model 3 as predictors of 12 neuropsychological test indices. The second set of analyses (N = 559) mirrored the first but with Major Depressive Disorder (MDD) diagnosis in Models 2 and 3. In the first analyses, after including TOMM in the model, only the relationship between BDI-2 and verbal fluency remained significant, but this did not survive a Bonferroni correction. In the second analyses, after including TOMM and Bonferroni correction, MDD diagnosis was a significant predictor only for CVLT-II Short Delay Free Recall. Therefore, the relationship between depression and cognition may not be driven by frank cognitive impairment, but rather by psychological mechanisms, which has implications for addressing depressed individuals' concerns about their cognitive functioning and suggest the value of providing psychoeducation and reassurance.

Examining the cross-cultural validity of the test of memory malingering and the Rey 15-item test

OBJECTIVE

This study was designed to investigate the cross-cultural validity of two freestanding performance validity tests (PVTs), the Test of Memory Malingering - Trial 1 (TOMM-1) and the Rey Fifteen Item Test (Rey-15) in Romanian-speaking patients.

METHODS

The TOMM-1 and Rey-15 free recall (FR) and the combination score incorporating the recognition trial (COMB) were administered to a mixed clinical sample of 61 adults referred for cognitive evaluation, 24 of whom had external incentives to appear impaired. Average scores on PVTs were compared between the two groups. Classification accuracies were computed using one PVT against another.

RESULTS

Patients with identifiable external incentives to appear impaired produced significantly lower scores and more errors on validity indicators. The largest effect sizes emerged on TOMM-1 (Cohen's d = 1.00-1.19). TOMM-1 was a significant predictor of the Rey-15 COMB ≤20 (AUC = .80; .38 sensitivity; .89 specificity at a cutoff of ≤39). Similarly, both Rey-15 indicators were significant predictors of TOMM-1 at ≤39 as the criterion (AUCs = .73-.76; .33 sensitivity; .89-.90 specificity).

CONCLUSION

Results offer a proof of concept for the cross-cultural validity of the TOMM-1 and Rey-15 in a Romanian clinical sample.

A preliminary investigation of the utility of the Word Memory Test Immediate Recognition trial as a screener for noncredible performance

The assessment of performance validity is an important consideration to the interpretation of neuropsychological data. However, commonly used performance validity tests such as the Test of Memory Malingering (TOMM) and Word Memory Test (WMT) have lengthy administration times (20-30 minutes). Alternatively, utilizing a screener of performance validity (e.g., the TOMM T1 or TOMMe10) has proven to be an effective method of assessing performance validity while conserving time. The present study investigates the use of the WMT Immediate Recognition (IR) Trial scores as a screening measure for performance validity using an archival mTBI polytrauma sample (n = 48). Results show that the WMT IR demonstrates a high degree of accuracy in predicting WMT Delayed Recognition (DR) Trial performance across a range of base rates suggesting that the WMT IR is a useful screening measure for noncredible performance. Clinical implications and selection of optimal cutoff are discussed.

Decision rules for an abbreviated administration of the Test of Memory Malingering

The present study investigated abbreviation methods for the Test of Memory Malingering (TOMM) in relation to traditional manual-based test cutoffs and independently derived more stringent cutoffs suggested by recent research (≤48 on Trial 2 or 3). Consecutively referred outpatient U.S. military veterans (n = 260) were seen for neuropsychological evaluation for mild traumatic brain injury or possible attention-deficit/hyperactivity disorder. Performance on TOMM Trial 1 was evaluated, including the total score and errors on the first 10 items (TOMMe10), to determine correspondence and redundancy with Trials 2 and 3. Using the traditional cutoff, valid performance on Trials 2 and 3 was predicted by zero errors on TOMMe10 and by Trial 1 scores greater than 41. Invalid performance was predicted by commission of more than three errors on TOMMe10 and by Trial 1 scores less than 34. For revised TOMM cutoffs, a Trial 1 score above 46 was predictive of a valid score, and a TOMMe10 score of three or more errors or a Trial 1 score below 36 was associated with invalid TOMM performance. Conditional abbreviation of the TOMM is feasible in a vast majority of cases without sacrificing information regarding performance validity. Decision trees are provided to facilitate administration of the three trials.

The impact of race and other demographic factors on the false positive rates of five embedded Performance Validity Tests (PVTs) in a Veteran sample

INTRODUCTION

It is common to use normative adjustments based on race to maintain accuracy when interpreting cognitive test results during neuropsychological assessment. However, embedded performance validity tests (PVTs) do not adjust for these racial differences and may result in elevated rates of false positives in African American/Black (AA) samples compared to European American/White (EA) samples.

METHODS

Veterans without Major Neurocognitive Disorder completed an outpatient neuropsychological assessment and were deemed to be performing in a valid manner (e.g., passing both the Test of Memory Malingering Trial 1 (TOMM1) and the Medical Symptom Validity Test (MSVT), (n = 531, EA = 473, AA = 58). Five embedded PVTs were administered to all patients: WAIS-III/IV Processing Speed Index (PSI), Brief Visuospatial Memory Test-Revised: Discrimination Index (BVMT-R), TMT-A (secs), California Verbal Learning Test-II (CVLT-II) Forced Choice, and WAIS-III/IV Digit Span Scaled Score. Individual PVT false positive rates, as well as the rate of failing two or more embedded PVTs, were calculated.

RESULTS

Failure rates of two embedded PVTs (PSI, TMT-A), and the total number of PVTs failed, were higher in the AA sample. The PSI and TMT-A remained significantly impacted by race after accounting for age, education, sex, and presence of Mild Neurocognitive Disorder. There were PVT failure rates greater than 10% (and considered false positives) in both groups (AA: PSI, TMT-A, and BVMT-R, 12-24%; EA: BVMT-R, 17%). Failing 2 or more PVTs (AA = 9%, EA = 4%) was impacted by education and Mild Neurocognitive Disorder but not by race.

CONCLUSIONS

Individual (timed) PVTs showed higher false positive rates in the AA sample even after accounting for demographic factors and diagnosis of Mild Neurocognitive Disorder. Requiring failure on 2 or more embedded PVTs reduced false positive rates to acceptable levels across both groups (10% or less) and was not significantly influenced by race.

A preliminary examination of the TOMM2 in a sample of Spanish speakers in the United States

BACKGROUND

The Test of Memory Malingering (TOMM) is a widely used performance validity measure that is available in both English and Spanish. The Spanish version, however, has historically lacked normative data from samples that are representative of the U.S. Hispanic/Spanish speaking population.

OBJECTIVE

The aim of the current study was to collect normative data on the update TOMM 2 for Hispanic individuals residing in the U.S.

METHODS

Normative data on the TOMM 2 was collected across 9 sites from different regions of the U.S. The total sample consisted of n = 188 cognitively healthy adults aged 18 and over with no current or prior history of neurological or psychiatric disorder. Descriptive analyses were performed on total raw scores.

RESULTS

Participants obtained a mean score of 48.15 (SD = 2.81) on trial 1 of the TOMM 2, 49.86 (SD = 0.487) on trial 2, and 49.84 (SD = 0.509) on the recognition trial. Scores are provided for traditional cutoff scores as well as some popular cutoffs reported in the literature. Item level analyses were conducted as well as evaluation of performance based on a variety of demographics.

CONCLUSION

When compared to the English-speaking normative sample used for the original TOMM, this sample demonstrated better performance on the TOMM 2 indicating better cultural appropriateness of the items. This is the first study conducted that provides culturally appropriate descriptive norms for use with Spanish speakers living in the U.S.

Self-reported disability-seeking predicts PVT failure in veterans undergoing clinical neuropsychological evaluation

Objective: This study examined disability-related factors as predictors of PVT performance in Veterans who underwent neuropsychological evaluation for clinical purposes, not for determination of disability benefits. Method: Participants were 1,438 Veterans who were seen for clinical evaluation in a VA Medical Center's Neuropsychology Clinic. All were administered the TOMM, MSVT, or both. Predictors of PVT performance included (1) whether Veterans were receiving VA disability benefits ("service connection") for psychiatric or neurological conditions at the time of evaluation, and (2) whether Veterans reported on clinical interview that they were in the process of applying for disability benefits. Data were analyzed using binary logistic regression, with PVT performance as the dependent variable in separate analyses for the TOMM and MSVT. Results: Veterans who were already receiving VA disability benefits for psychiatric or neurological conditions were significantly more likely to fail both the TOMM and the MSVT, compared to Veterans who were not receiving benefits for such conditions. Independently of receiving such benefits, Veterans who reported that they were applying for disability benefits were significantly more likely to fail the TOMM and MSVT than were Veterans who denied applying for benefits at the time of evaluation. Conclusions: These findings demonstrate that simply being in the process of applying for disability benefits increases the likelihood of noncredible performance. The presence of external incentives can predict the validity of neuropsychological performance even in clinical, non-forensic settings.

The Temporal Memory Sequence Test (TMST) in children: Validity test performance in clinically referred children

Validity evaluation is fundamental in neuropsychological assessment in adults, with increasing interest among pediatric neuropsychologists. Although some measures exist, given time constraints placed on clinicians, and children's limited sustained attention, development of less time-consuming measures is beneficial. We explored the use of the Temporal Memory Sequence Test (TMST), a new performance validity test, in clinically referred children. One minor adaptation included reading the instructions and labels to non-fluent readers. Participants were 68 consecutive clinically referred children and adolescents, aged 6-18 years, with neurological (n = 46) or behavioral (n = 22) difficulties. Applying the adult cutoff, 83.8% passed the TMST. Age, gender, and diagnosis did not differ between children passing the TMST cutoff and those who failed it. Classification accuracy calculated against three embedded measures of performance validity (Wechsler scale Digit Span, Coding, and Processing Speed Index) indicated specificity over 90% (Digit Span: 94%, Coding: 96%, Processing Speed Index: 92%) and sensitivity between 30 and 33%. For individuals without Intellectual Disability (ID), 90.9% passed the TMST, and intelligence did not predict success. Thus, the use of the TMST with the adult cutoff was supported in children without ID, offering an additional validity measure for clinically referred children.

Comparing the Independent and Aggregated Accuracy of Trial 1 and the First 10 TOMM Items for Detecting Invalid Neuropsychological Test Performance Across Civilian and Veteran Clinical Samples

Previous studies support using two abbreviated tests of the Test of Memory Malingering (TOMM), including (a) Trial 1 (T1) and (b) the number of errors on the first 10 items of T1 (T1e10), as performance validity tests (PVTs). In this study, we examined the independent and aggregated predictive utility of TOMM T1 and T1e10 for identifying invalid neuropsychological test performance across two clinical samples. We employed cross-sectional research to examine two independent and demographically diverse mixed samples of military veterans and civilians (VA = 108; academic medical center = 234) of patients who underwent neuropsychological evaluations. We determined validity groups by patient performance on four independent criterion PVTs. We established concordances between passing/failing the TOMM T1e10 and T1, followed by logistic regression to determine individual and aggregated accuracy of T1e10 and T1 for predicting validity group membership. Concordance between passing T1e10 and T1 was high, as was overall validity (87-98%) across samples. By contrast, T1e10 failure was more highly concordant with T1 failure (69-77%) than with overall invalidity status (59-60%) per criterion PVTs, whereas T1 failure was more highly concordant with invalidity status (72-88%) per criterion PVTs. Logistic regression analyses demonstrated similar results, with T1 accounting for more variance than T1e10. However, combining T1e10 and T1 accounted for the most variance of any model, with T1e10 and T1 each emerging as significant predictors. TOMM T1 and, to a lesser extent, T1e10 were significant predictors of independent criterion-derived validity status across two distinct clinical samples, but they did not offer improved classification accuracy when aggregated.

This will only take a minute: Time cutoffs are superior to accuracy cutoffs on the forced choice recognition trial of the Hopkins Verbal Learning Test - Revised

OBJECTIVE

This study was designed to evaluate the classification accuracy of the recently introduced forced-choice recognition trial to the Hopkins Verbal Learning Test - Revised (FCR_HVLT-R) as a performance validity test (PVT) in a clinical sample. Time-to-completion (T2C) for FCR_HVLT-R was also examined.

METHOD

Forty-three students were assigned to either the control or the experimental malingering (expMAL) condition. Archival data were collected from 52 adults clinically referred for neuropsychological assessment. Invalid performance was defined using expMAL status, two free-standing PVTs and two validity composites.

RESULTS

Among students, FCR_HVLT-R ≤11 or T2C ≥45 seconds was specific (0.86-0.93) to invalid performance. Among patients, an FCR_HVLT-R ≤11 was specific (0.94-1.00), but relatively insensitive (0.38-0.60) to non-credible responding0. T2C ≥35 s produced notably higher sensitivity (0.71-0.89), but variable specificity (0.83-0.96). The T2C achieved superior overall correct classification (81-86%) compared to the accuracy score (68-77%). The FCR_HVLT-R provided incremental utility in performance validity assessment compared to previously introduced validity cutoffs on Recognition Discrimination.

CONCLUSIONS

Combined with T2C, the FCR_HVLT-R has the potential to function as a quick, inexpensive and effective embedded PVT. The time-cutoff effectively attenuated the low ceiling of the accuracy scores, increasing sensitivity by 19%. Replication in larger and more geographically and demographically diverse samples is needed before the FCR_HVLT-R can be endorsed for routine clinical application.

Clinical utility of the TOMMe10 scoring criteria for detecting suboptimal effort in an mTBI veteran sample

In the context of diminishing reimbursement and patient access demands, researchers continually refine performance validity measures (PVMs) to maximize efficiency while maintaining confidence in obtained data. This is particularly true for high PVM failure populations (e.g., mTBI patients). The TOMMe10 (number of errors on first 10 TOMM items) is one method this study utilized for classifying PVM performance as pass/fail (fail defined as failure on 2 of 6 PVM scores, pass defined as 0/1 failures). The present study hypothesized that the TOMMe10 would have equitable sensitivity/specificity for identifying non-credible cognitive performance among veterans with mTBI compared to previous research findings and commonly used performance validity measures (e.g., TOMM or WMT). Data were analyzed from 54 veterans assigned to a pass and fail group based on their performance across six recognized PVMs. Results revealed pass/fail groups were not significantly different regarding age, educational, or racial background. ROC analyses found the TOMMe10 demonstrated excellent discriminability (AUC = .803 ±.128), indicating that the TOMMe10 could have clinical utility within an mTBI veteran sample, particularly in conjunction with a second PVM. Specific population limitations are discussed. Additional research should elucidate this measure's performance with additional populations, including non-veteran mTBI, dementia, moderate-severe TBI, and inpatient populations.