Official Position of the American Academy of Clinical Neuropsychology Social Security Administration Policy on Validity Testing: Guidance and Recommendations for Change

Examining the cross-cultural validity of the test of memory malingering and the Rey 15-item test

OBJECTIVE

This study was designed to investigate the cross-cultural validity of two freestanding performance validity tests (PVTs), the Test of Memory Malingering - Trial 1 (TOMM-1) and the Rey Fifteen Item Test (Rey-15) in Romanian-speaking patients.

METHODS

The TOMM-1 and Rey-15 free recall (FR) and the combination score incorporating the recognition trial (COMB) were administered to a mixed clinical sample of 61 adults referred for cognitive evaluation, 24 of whom had external incentives to appear impaired. Average scores on PVTs were compared between the two groups. Classification accuracies were computed using one PVT against another.

RESULTS

Patients with identifiable external incentives to appear impaired produced significantly lower scores and more errors on validity indicators. The largest effect sizes emerged on TOMM-1 (Cohen's d = 1.00-1.19). TOMM-1 was a significant predictor of the Rey-15 COMB ≤20 (AUC = .80; .38 sensitivity; .89 specificity at a cutoff of ≤39). Similarly, both Rey-15 indicators were significant predictors of TOMM-1 at ≤39 as the criterion (AUCs = .73-.76; .33 sensitivity; .89-.90 specificity).

CONCLUSION

Results offer a proof of concept for the cross-cultural validity of the TOMM-1 and Rey-15 in a Romanian clinical sample.

Preliminary evidence for digit span performance validity indicators within the neuropsychological assessment battery

The purpose of this study was to evaluate multiple embedded performance validity indicators within the Digits Forward and Digits Backward subtests of the Neuropsychological Assessment Battery (NAB), including Reliable Digit Span (RDS), as no published papers have examined embedded digit span validity indicators within these subtests of the NAB. Retrospective archival chart review was conducted at an outpatient neuropsychology clinic. Participants were 92 adults (ages 19-68) who completed NAB Digits Forward and Digits Backward, and the Word Choice Test (WCT). Receiver operating characteristic (ROC) curves, t-tests, and sensitivity and specificity analyses were conducted. Analyses showed that RDS demonstrated acceptable classification accuracy between those who passed the WCT and those who did not. The area under the curve (AUC) value for RDS was 0.702; however, AUC values for all other digit span indices were unacceptably low. The optimal cutoff for RDS was identified (<8). RDS for the NAB appears to be an adequate indicator of performance validity; however, considering the very small number of participants who were invalid on the WCT (n = 15), as well as the utilization of only one stand-alone PVT to classify validity status, these findings are preliminary and in need of replication.

Symptom coaching and symptom validity tests: An analog study using the structured inventory of malingered symptomatology, Self-Report Symptom Inventory, and Inventory of Problems-29

In this pilot and exploratory study, we tested the robustness of three self-report symptom validity tests (SVTs) to symptom coaching for depression, with and without additional information available on the Internet. Specifically, we divided our sample (N = 193) so that each subject received either the Structured Inventory of Malingered Symptomatology (SIMS; n = 64), the Self-Report Symptom Inventory (SRSI; n = 66), or the Inventory of Problems-29 (IOP-29; n = 63). Within each of the three subgroups, approximately one third of participants were instructed to respond honestly (Genuine Condition, nSIMS = 21; nSRSI = 24; nIOP-29 = 26) and approximately two-thirds were instructed to feign depression. One half of the feigners were presented with a vignette to increase their compliance with instructions and were given information about symptoms of depression (Coached Feigning, nSIMS = 25; nSRSI = 18; nIOP-29 = 21), and the other half were given the same vignette and information about symptoms of depression, plus two Internet links to review before completing the test (Internet-Coached Feigning, nSIMS = 18; nSRSI = 24; nIOP-29 = 16). Overall, the results showed that the genuine conditions yielded the lowest total scores on all three measures, while the two feigning conditions did not significantly differ from each other. Looking at the detection rates for all feigning participants, all three measures showed satisfactory results, with IOP-29 performing slightly better than SIMS and SIMS performing slightly better than SRSI. Internet-Coached Feigners scored slightly lower on all three measures than feigners who were coached without the Internet links. Taken together, the results of this preliminary and exploratory study suggest that all three SVTs examined are sensitive to feigned depression even in the presence of symptom coaching, both with and without additional Internet-based information.

Huntington study group's neuropsychology working group position on best practice recommendations for the clinical neuropsychological evaluation of patients with Huntington disease

Objective: Neuropsychological evaluation is critical to detection and management of cognitive and neuropsychiatric changes associated with Huntington disease (HD). Accurate assessment of non-motor complications of HD is critical given the prominent impact on functional disability, frequently commensurate with or exceeding that of motor symptoms. The increasing emphasis on developing disease-modifying therapies targeting cognitive decline in HD requires consensus on clinical neuropsychological assessment methods. The Neuropsychology Working Group (NPWG) of the Huntington Study Group (HSG) sought to provide evidence and consensus-based, practical guidelines for the evaluation of cognitive and neuropsychiatric symptoms associated with HD. Method: The NPWG recruited a multi-disciplinary group of neuropsychologists, neurologists, and psychiatrists to inform best practices in assessing, diagnosing, and treating the non-motor symptoms in HD. A review was circulated among the NPWG, and in an iterative process informed by reviewed literature, best practices in neuropsychological evaluation of patients with HD were identified. Results: A brief review of the available literature and rational for a clinical consensus battery is offered. Conclusion: Clinical neuropsychologists are uniquely positioned to both detect and characterize the non-motor symptoms in HD, and further, provide neurologists and allied health professions with clinically meaningful information that impacts functional outcomes and quality of life. The NPWG provides guidance on best practices to clinical neuropsychologists in this statement. A companion paper operationalizing clinical application of previous research-based non-motor diagnostic criteria for HD is forthcoming, which also advises on non-motor symptom screening methods for the non-neuropsychologist working with HD.

Use of perceptual memory as a performance validity indicator: initial validation with simulated mild traumatic brain injury

INTRODUCTION

Many commonly employed performance validity tests (PVTs) are several decades old and vulnerable to compromise, leading to a need for novel instruments. Because implicit/non-declarative memory may be robust to brain damage, tasks that rely upon such memory may serve as an effective PVT. Using a simulation design, this experiment evaluated whether novel tasks that rely upon perceptual memory hold promise as PVTs.

METHOD

Sixty healthy participants were provided instructions to simulate symptoms of mild traumatic brain injury (TBI), and they were compared to a group of 20 honest responding individuals. Simulator groups received varying levels of information concerning TBI symptoms, resulting in naïve, sophisticated, and test-coached groups. The Word Memory Test, Test of Memory Malingering, and California Verbal Learning Test-II Forced Choice Recognition Test were administered. To assess perceptual memory, selected images from the Gollin Incomplete Figures and Mooney Closure Test were presented as visual perception tasks. After brief delays, memory for the images was assessed.

RESULTS

No group differences emerged on the perception trials of the Gollin and Mooney figures, but simulators remembered fewer images than the honest responders. Simulator groups differed on the standard PVTs, but they performed equivalently on the Gollin and Mooney figures, implying robustness to coaching. Relying upon a criterion of 90% specificity, the Gollin and Mooney figures achieved at least 90% sensitivity, comparing favorably to the standard PVTs.

CONCLUSIONS

The Gollin and Mooney figures hold promise as novel PVTs. As perceptual memory tests, they may be relatively robust to brain damage, but future research involving clinical samples is necessary to substantiate this assertion.

Validity assessment in Eastern Europe: cross-validation of the Dot Counting Test and MODEMM against the TOMM-1 and Rey-15 in a Romanian mixed clinical sample

OBJECTIVE

This study investigated performance validity in the understudied Romanian clinical population by exploring classification accuracies of the Dot Counting Test (DCT) and the first Romanian performance validity test (PVT) (Memory of Objects and Digits and Evaluation of Memory Malingering/MODEMM) in a heterogeneous clinical sample.

METHODS

We evaluated 54 outpatients (26 females; MAge = 62.02; SDAge = 12.3; MEducation = 2.41, SDEducation = 2.82) with the Test of Memory Malingering 1 (TOMM-1), Rey Fifteen Items Test (Rey-15) (free recall and recognition trials), DCT, MODEMM, and MMSE/MoCA as part of their neuropsychological assessment. Accuracy parameters and base failure rates were computed for the DCT and MODEMM indicators against the TOMM-1 and Rey-15. Two patient groups were constructed according to psychometrically defined credible/noncredible performance (i.e., pass/fail both TOMM-1 and Rey-15).

RESULTS

Similar to other cultures, a cutoff of ≥18 on the DCT E score produced the best combination between sensitivity (0.50-0.57) and specificity (≥0.90). MODEMM indicators based on recognition accuracy, inconsistencies, and inclusion false positives generated 0.75-0.86 sensitivities at ≥0.90 specificities. Multivariable models of MODEMM indicators reached perfect sensitivities at ≥0.90 specificities against two PVTs. Patients who failed the TOMM-1 and Rey-15 were significantly more likely to fail the DCT and MODEMM than patients who passed both PVTs.

CONCLUSIONS

Our results offer proof of concept for the DCT's cross-cultural validity and the applicability of the MODEMM on Romanian clinical examinees, further recommending the use of heterogeneous validity indicators in clinical assessments.

Strategies of feigning mild head injuries related to validity indicators and types of coaching: Results of two experimental studies

OBJECTIVE

In this paper, we analyzed differences between uncoached, symptom-coached, and test-coached simulators regarding strategies of feigning mild head injuries.

METHOD

Healthy undergraduates (n = 67 in the first study; n = 48 in the second study), randomized into three simulator groups, were assessed with four experimental memory tests. In the first study, tests were administered face-to-face, while in the second study, the procedure was adapted for online testing.

RESULTS

Online simulators showed a different approach to testing than face-to-face participants (U tests  < 920, p < .05). Nevertheless, both samples favored strategies like memory loss, error making, concentration difficulties, and slow responding. Except for slow responding and concentration difficulties, the favorite strategies correlated with validity indicators. In the first study, test-coached simulators (m = 4.58-5.68, SD = 2.2-3) used strategies less than uncoached participants (m = 5.25-5.88, SD = 2.26-2.84). In the second study, test-coached participants (m = 3.8-5.6, SD = 1.51-2.2) employed strategies less than uncoached (m = 6.21-7.29, SD = 1.25-1.85) and symptom-coached participants (m = 6.14-6.79, SD = 1.69-2.76).

DISCUSSION

Similarities and differences between online and face-to-face assessments are discussed. Recommendations to associate heterogeneous indicators for detecting feigning strategies are issued.

New Child and Adolescent Memory Profile Embedded Performance Validity Test

OBJECTIVE

It is essential to interpret performance validity tests (PVTs) that are well-established and have strong psychometrics. This study evaluated the Child and Adolescent Memory Profile (ChAMP) Validity Indicator (VI) using a pediatric sample with traumatic brain injury (TBI).

METHOD

A cross-sectional sample of N = 110 youth (mean age = 15.1 years, standard deviation [SD] = 2.4 range = 8-18) on average 32.7 weeks (SD = 40.9) post TBI (71.8% mild/concussion; 3.6% complicated mild; 24.6% moderate-to-severe) were administered the ChAMP and two stand-alone PVTs. Criterion for valid performance was scores above cutoffs on both PVTs; criterion for invalid performance was scores below cutoffs on both PVTs. Classification statistics were used to evaluate the existing ChAMP VI and establish a new VI cutoff score if needed.

RESULTS

There were no significant differences in demographics or time since injury between those deemed valid (n = 96) or invalid (n = 14), but all ChAMP scores were significantly lower in those deemed invalid. The original ChAMP VI cutoff score was highly specific (no false positives) but also highly insensitive (sensitivity [SN] = .07, specificity [SP] = 1.0). Based on area under the curve (AUC) analysis (0.94), a new cutoff score was established using the sum of scaled scores (VI-SS). A ChAMP VI-SS score of 32 or lower achieved strong SN (86%) and SP (92%). Using a 15% base rate, positive predictive value was 64% and negative predictive value was 97%.

CONCLUSIONS

The originally proposed ChAMP VI has insufficient SN in pediatric TBI. However, this study yields a promising new ChAMP VI-SS, with classification metrics that exceed any other current embedded PVT in pediatrics.

Examining the repeatable battery for the assessment of neuropsychological status validity indices in people with schizophrenia spectrum disorders

Objective: We examined the frequency of possible invalid test scores on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) in patients with schizophrenia spectrum disorders, and whether there was an association between scores on the embedded RBANS performance validity tests (PVTs) and self-reported symptoms of apathy as measured by the Initiate Scale of the Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A). Methods: Participants included 250 patients (M = 24.4 years-old, SD = 5.7) with schizophrenia spectrum disorders. Base rates of RBANS Effort Index (EI), Effort Scale (ES), and Performance Validity Index (PVI) test scores were computed. Spearman correlations were used to examine the associations between the RBANS PVTs, the RBANS Index scores, and the BRIEF-A Initiate Scale. Regression analyses were used to investigate how well the RBANS PVTs predicted scores on the BRIEF-A Initiate Scale. Results: The frequency of invalid scores on the EI (>3) and the PVI (<42) in participants with schizophrenia spectrum disorders was 6%. The frequency of invalid ES scores (<12) was 28% in the patients compared to 15% in the U.S. standardization sample. There was a small significant correlation between the EI and the BRIEF-A Initiate Scale (rho=.158, p<.05). Conclusions: The rates of invalid scores were similar to previously published studies. Invalid scores on the BRIEF-A were uncommon. Apathy measured with the BRIEF-A Initiate Scale was not associated with performance on the RBANS validity measures or with measures of cognition.

Specificity of Embedded Performance Validity Tests in Elderly Veterans with Mild and Major Neurocognitive Disorder

OBJECTIVE

This study explored the specificity of four embedded performance validity tests (PVTs) derived from common neuropsychological tasks in a sample of older veterans with verified cognitive decline and whose performance was deemed valid by licensed psychologists.

METHOD

Participants were 180 veterans who underwent comprehensive neuropsychological evaluation, were determined to have valid performance following profile analysis/conceptualization, and were diagnosed with mild neurocognitive disorder (i.e., MCI; n = 64) or major neurocognitive disorder (i.e., Dementia; n = 116). All participants completed at least one of four embedded PVTs: Reliable Digit Span (RDS), California Verbal Learning Test-2nd ed. Short Form (CVLT-II SF) Forced choice, Trails B:A, and Delis-Kaplan Executive Function System (DKEFS) Letter and Category Fluency.

RESULTS

Adequate specificity (i.e., ≥90%) was achieved at modified cut-scores for all embedded PVTs across MCI and Dementia groups. Trails B:A demonstrated near perfect specificity at its traditional cut-score (Trails B:A < 1.5). RDS ≤ 5 and CVLT-II SF Forced Choice ≤7 led to <10% false positive classification errors across MCI and dementia groups. DKEFS Letter and Category Fluency achieved 90% specificity at extremely low normative cut-scores.

CONCLUSIONS

RDS, Trails B:A, and CVLT-II SF Forced Choice reflect promising embedded PVTs in the context of dementia evaluations. DKEFS Letter and Category Fluency appear too sensitive to genuine neurocognitive decline and, therefore, are inappropriate PVTs in adults with MCI or dementia. Additional research into embedded PVT sensitivity (via known-groups or analogue designs) in MCI and dementia is needed.

Identifying Feigned ADHD in College Students: Comparing the Multidimensional ADHD Rating Scale to Established Validity Measures

OBJECTIVE

There is increased concern for malingering in ADHD evaluations due to presence of incentives such as accommodations and medications. Although several validity tests are available to classify malingering in non-ADHD populations, there is no test with proven effectiveness to detect feigned ADHD. This study investigated the ability of the MARS Symptom Validity Index 4 (MARS SV-index 4) and two published validity tests (the Word Memory Test [WMT] and Clinical Assessment of Attention Deficit-Adult [CAT-A] Infrequency scale) to detect malingered ADHD.

METHOD

The participants consisted of 68 young adults, 34 with ADHD. Participants completed the MARS, CAT-A, and WMT validity measures.

RESULTS

The MARS SV index-4 demonstrated higher sensitivity rates for simulated malingering (61.8%) at close to optimal specificity (88.2%) compared to two published tests (which had sensitivity <42% at specificity >90%).

CONCLUSION

The MARS shows good ability to detect feigned ADHD and appears to be useful for adult ADHD assessments.

Profile of Embedded Validity Indicators in Criminal Defendants with Verified Valid Neuropsychological Test Performance

Objective

Few studies have examined the use of embedded validity indicators (EVIs) in criminal-forensic practice settings, where judgements regarding performance validity can carry severe consequences for the individual and society. This study sought to examine how various EVIs perform in criminal defendant populations, and determine relationships between EVI scores and intrapersonal variables thought to influence performance validity.

Method

Performance on 16 empirically established EVI cutoffs were examined in a sample of 164 criminal defendants with valid performance who were referred for forensic neuropsychological evaluation. Subsequent analyses examined the relationship between EVI scores and intrapersonal variables in 83 of these defendants.

Results

Half of the EVIs (within the Wechsler Adult Intelligence Scale Digit Span Total, Conners’ Continuous Performance Test Commissions, Wechsler Memory Scale Logical Memory I and II, Controlled Oral Word Association Test, Trail Making Test Part B, and Stroop Word and Color) performed as intended in this sample. The EVIs that did not perform as intended were significantly influenced by relevant intrapersonal variables, including below-average intellectual functioning and history of moderate–severe traumatic brain injury and neurodevelopmental disorder.

Conclusions

This study identifies multiple EVIs appropriate for use in criminal-forensic settings. However, based on these findings, practitioners may wish to be selective in choosing and interpreting EVIs for forensic evaluations of criminal court defendants.

Cross-Cultural Performance Validity Testing: Managing False Positives in Examinees with Limited English Proficiency

Base rates of failure (BR_Fail) on performance validity tests (PVTs) were examined in university students with limited English proficiency (LEP). BR_Fail was calculated for several free-standing and embedded PVTs. All free-standing PVTs and certain embedded indicators were robust to LEP. However, LEP was associated with unacceptably high BR_Fail (20-50%) on several embedded PVTs with high levels of verbal mediation (even multivariate models of PVT could not contain BR_Fail). In conclusion, failing free-standing/dedicated PVTs cannot be attributed to LEP. However, the elevated BR_Fail on several embedded PVTs in university students suggest an unacceptably high overall risk of false positives associated with LEP.

Take Their Word for It: The Inventory of Problems Provides Valuable Information on Both Symptom and Performance Validity

This study was designed to compare the validity of the Inventory of Problems (IOP-29) and its newly developed memory module (IOP-M) in 150 patients clinically referred for neuropsychological assessment. Criterion groups were psychometrically derived based on established performance and symptom validity tests (PVTs and SVTs). The criterion-related validity of the IOP-29 was compared to that of the Negative Impression Management scale of the Personality Assessment Inventory (NIM_PAI) and the criterion-related validity of the IOP-M was compared to that of Trial-1 on the Test of Memory Malingering (TOMM-1). The IOP-29 correlated significantly more strongly (z = 2.50, p = .01) with criterion PVTs than the NIM_PAI (r_IOP-29 = .34; r_NIM-PAI = .06), generating similar overall correct classification values (OCC_IOP-29: 79-81%; OCC_NIM-PAI: 71-79%). Similarly, the IOP-M correlated significantly more strongly (z = 2.26, p = .02) with criterion PVTs than the TOMM-1 (r_IOP-M = .79; r_TOMM-1 = .59), generating similar overall correct classification values (OCC_IOP-M: 89-91%; OCC_TOMM-1: 84-86%). Findings converge with the cumulative evidence that the IOP-29 and IOP-M are valuable additions to comprehensive neuropsychological batteries. Results also confirm that symptom and performance validity are distinct clinical constructs, and domain specificity should be considered while calibrating instruments.

Considerations for Reliable Digit Span as a performance validity test for long-term survivors of childhood brain tumors

The Reliable Digit Span (RDS) is a performance validity test (PVT) used widely within non-clinical samples, but its utility is in question in clinical groups with cognitive impairment. To investigate, RDS scores were calculated and correlated with the Neurological Predictor Scale, an informant-reported Activities of Daily Living score, and a proxy measure of intelligence (Vocabulary) for 83 adult survivors of childhood brain tumors and 105 healthy controls. Analyses were covaried for age at examination. Participants were divided into passing and failing groups at each RDS cutoff, and ANCOVAs for each of the three variables of interest covaried for age at the examination were run. RDS was correlated with all three variables of interest in survivors but only Vocabulary in controls. At the ≤7 cutoff, passing and failing survivors demonstrated significant differences across all variables of interest, while passing and failing controls differed only on Vocabulary. Differences were also found between passing and failing survivors at lower cutoffs. RDS is related to and likely impacted by various neurological and cognitive challenges faced by brain tumor survivors. Using the standard RDS cutoff of ≤7 may result in inaccurate interpretation of valid performance in this population; therefore, the use of other PVTs is recommended.

Multivariate Models of Performance Validity: The Erdodi Index Captures the Dual Nature of Non-Credible Responding (Continuous and Categorical)

This study was designed to examine the classification accuracy of the Erdodi Index (EI-5), a novel method for aggregating validity indicators that takes into account both the number and extent of performance validity test (PVT) failures. Archival data were collected from a mixed clinical/forensic sample of 452 adults referred for neuropsychological assessment. The classification accuracy of the EI-5 was evaluated against established free-standing PVTs. The EI-5 achieved a good combination of sensitivity (.65) and specificity (.97), correctly classifying 92% of the sample. Its classification accuracy was comparable with that of another free-standing PVT. An indeterminate range between Pass and Fail emerged as a legitimate third outcome of performance validity assessment, indicating that the underlying construct is an inherently continuous variable. Results support the use of the EI model as a practical and psychometrically sound method of aggregating multiple embedded PVTs into a single-number summary of performance validity. Combining free-standing PVTs with the EI-5 resulted in a better separation between credible and non-credible profiles, demonstrating incremental validity. Findings are consistent with recent endorsements of a three-way outcome for PVTs (Pass, Borderline, and Fail).

The BNT-15 provides an accurate measure of English proficiency in cognitively intact bilinguals - a study in cross-cultural assessment

This study was designed to replicate earlier reports of the utility of the Boston Naming Test - Short Form (BNT-15) as an index of limited English proficiency (LEP). Twenty-eight English-Arabic bilingual student volunteers were administered the BNT-15 as part of a brief battery of cognitive tests. The majority (23) were women, and half had LEP. Mean age was 21.1 years. The BNT-15 was an excellent psychometric marker of LEP status (area under the curve: .990-.995). Participants with LEP underperformed on several cognitive measures (verbal comprehension, visuomotor processing speed, single word reading, and performance validity tests). Although no participant with LEP failed the accuracy cutoff on the Word Choice Test, 35.7% of them failed the time cutoff. Overall, LEP was associated with an increased risk of failing performance validity tests. Previously published BNT-15 validity cutoffs had unacceptably low specificity (.33-.52) among participants with LEP. The BNT-15 has the potential to serve as a quick and effective objective measure of LEP. Students with LEP may need academic accommodations to compensate for slower test completion time. Likewise, LEP status should be considered for exemption from failing performance validity tests to protect against false positive errors.

Traits and Distorted Symptom Presentation: a Scoping Review

Are personality traits related to symptom overreporting and/or symptom underreporting? With this question in mind, we evaluated studies from 1979 to 2020 (k = 55), in which personality traits were linked to scores on stand-alone validity tests, including symptom validity tests (SVTs) and measures of socially desirable responding (SDR) and/or supernormality. As to symptom overreporting (k = 14), associations with depression, alexithymia, apathy, dissociation, and fantasy proneness varied widely from weak to strong (rs .27 to .79). For underreporting (k = 41), inconsistent links (rs − .43 to .63) were found with narcissism, whereas alexithymia and dissociation were often associated with lower SDR tendencies, although effect sizes were small. Taken together, the extant literature mainly consists of cross-sectional studies on single traits and contexts, mostly offering weak correlations that do not necessarily reflect causation. What this field lacks is an overarching theory relating traits to symptom reporting. Longitudinal studies involving a broad range of traits, samples, and incentives would be informative. Until such studies have been done, traits are best viewed as modest concomitants of symptom distortion.

Failing Performance Validity Cutoffs on the Boston Naming Test (BNT) Is Specific, but Insensitive to Non-Credible Responding

This study was designed to examine alternative validity cutoffs on the Boston Naming Test (BNT).Archival data were collected from 206 adults assessed in a medicolegal setting following a motor vehicle collision. Classification accuracy was evaluated against three criterion PVTs.The first cutoff to achieve minimum specificity (.87-.88) was T ≤ 35, at .33-.45 sensitivity. T ≤ 33 improved specificity (.92-.93) at .24-.34 sensitivity. BNT validity cutoffs correctly classified 67-85% of the sample. Failing the BNT was unrelated to self-reported emotional distress. Although constrained by its low sensitivity, the BNT remains a useful embedded PVT.

PediaTrac V.3.0 protocol: a prospective, longitudinal study of the development and validation of a web-based tool to measure and track infant and toddler development from birth through 18 months

INTRODUCTION

The need for an efficient, low-cost, comprehensive measure to track infant/toddler development and treatment outcomes is critical, given the importance of early detection and monitoring. This manuscript describes the protocol for the development and testing of a novel measure, PediaTrac, that collects longitudinal, prospective, multidomain data from parents/caregivers to characterise infant/toddler developmental trajectories in term and preterm infants. PediaTrac, a web-based measure, has the potential to become the standard method for monitoring development and detecting risk in infancy and toddlerhood.

METHODS AND ANALYSES

Using a multisite, prospective design, primarcaregivers will complete PediaTrac V.3.0, a survey tool that queries core domains of early development, including feeding/eating/elimination, sleep, sensorimotor, social/sensory information processing, social/communication/cognition and early relational health. Information also will be obtained about demographic, medical and environmental factors and embedded response bias indices are being developed as part of the measure. Using an approach that systematically measures infant/toddler developmental domains during a schedule that corresponds to well-child visits (newborn, 2, 4, 6, 9, 12, 15, 18 months), we will assess 360 caregiver/term infant dyads and 240 caregiver/preterm infant dyads (gestational age <37 weeks). Parameter estimates of our items and latent traits (eg, sensorimotor) will be estimated by theta using item response theory-graded response modelling. Participants also will complete legacy (ie, established) measures of development and caregiver health and functioning, used to provide evidence for construct (discriminant) validity. Predictive validity will be evaluated by examining relationships between the PediaTrac domains and the legacy measures in the total sample and in a subsample of 100 participants who will undergo a neurodevelopmental assessment at 24 months of age.

ETHICS AND DISSEMINATION

This investigation has single Institutional Review Board (IRB) multisite approval from the University of Michigan (IRB HUM00151584). The results will be presented at prominent conferences and published in peer-reviewed scientific journals.

Classification accuracy of the word memory test genuine memory impairment index

OBJECTIVE

The Word Memory Test (WMT) assesses non-credible performance in neuropsychological assessment. To mitigate risk of false positives among patients with severe cognitive dysfunction, the Genuine Memory Impairment Profile was derived. Only a modest number of investigations has evaluated classification accuracy among clinical samples, leaving the GMIP's accuracy largely uncertain. Accordingly, a simulation experiment evaluated the classification accuracy of the GMIP in a group of healthy individuals coached to simulate mild traumatic brain injury (TBI) related memory impairment on the WMT.

PARTICIPANTS AND METHODS

Eighty healthy individuals were randomly assigned to one of the four experimental groups. One group was provided superficial information concerning TBI symptoms (naïve simulators), another was provided extensive information concerning TBI symptoms (sophisticated simulators), and a third group was provided extensive TBI symptom information and tactics to evade detection by performance validity tests (PVT) (test-coached). An honest responding control group was directed to give their best performance. All participants were administered the California Verbal Learning Test-2 (CVLT-2) and the WMT.

RESULTS

Among the TBI simulators, 90% of the test-coached, 95% of the sophisticated simulators, and 100% of the naïve simulators were correctly classified as exaggerating memory impairment on the primary WMT indices. The simulator groups performed worse than the honest responding group on the CVLT-2. Of those who exceeded the WMT cutoffs, 60%, 27%, and 6% of the naïve-, sophisticated-, and test-coached simulators manifested the GMIP profile, respectively.

CONCLUSIONS

The GMIP is apt to misclassify individuals as having genuine memory impairment, especially if a naïve or unsophisticated effort is made to exert non-credible performance. Indeed, individuals who employ the least sophisticated efforts to exaggerate cognitive impairment appear most likely to manifest the GMIP. The GMIP should be used cautiously to discriminate genuine impairment from non-credible performance, especially among people with mild TBI.

Critical Item Analysis Enhances the Classification Accuracy of the Logical Memory Recognition Trial as a Performance Validity Indicator

OBJECTIVE

: Replicate previous research on Logical Memory Recognition (LM_Recog) and perform a critical item analysis.

METHOD

: Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LM_Recog and nine critical items (CR-9) was computed.

RESULTS

: LM_Recog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LM_Recog ≤20; CR-9 ≥6 increased specificity by 6-8% over LM_Recog ≤20; CR-9 ≥7 increased specificity by 8-15%.

CONCLUSIONS

: Critical item analysis enhances the classification accuracy of the optimal LM_Recog cutoff (≤20).

Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity

OBJECTIVE

This study was designed to empirically investigate the signal detection profile of various multivariate models of performance validity tests (MV-PVTs) and explore several contested assumptions underlying validity assessment in general and MV-PVTs specifically.

METHOD

Archival data were collected from 167 patients (52.4%male; MAge = 39.7) clinicially evaluated subsequent to a TBI. Performance validity was psychometrically defined using two free-standing PVTs and five composite measures, each based on five embedded PVTs.

RESULTS

MV-PVTs had superior classification accuracy compared to univariate cutoffs. The similarity between predictor and criterion PVTs influenced signal detection profiles. False positive rates (FPR) in MV-PVTs can be effectively controlled using more stringent multivariate cutoffs. In addition to Pass and Fail, Borderline is a legitimate third outcome of performance validity assessment. Failing memory-based PVTs was associated with elevated self-reported psychiatric symptoms.

CONCLUSIONS

Concerns about elevated FPR in MV-PVTs are unsubstantiated. In fact, MV-PVTs are psychometrically superior to individual components. Instrumentation artifacts are endemic to PVTs, and represent both a threat and an opportunity during the interpretation of a given neurocognitive profile. There is no such thing as too much information in performance validity assessment. Psychometric issues should be evaluated based on empirical, not theoretical models. As the number/severity of embedded PVT failures accumulates, assessors must consider the possibility of non-credible presentation and its clinical implications to neurorehabilitation.

The emotion word fluency test as an embedded performance validity indicator - Alone and in a multivariate validity composite

OBJECTIVE

This project was designed to cross-validate existing performance validity cutoffs embedded within measures of verbal fluency (FAS and animals) and develop new ones for the Emotion Word Fluency Test (EWFT), a novel measure of category fluency.

METHOD

The classification accuracy of the verbal fluency tests was examined in two samples (70 cognitively healthy university students and 52 clinical patients) against psychometrically defined criterion measures.

RESULTS

A demographically adjusted T-score of ≤31 on the FAS was specific (.88-.97) to noncredible responding in both samples. Animals T ≤ 29 achieved high specificity (.90-.93) among students at .27-.38 sensitivity. A more conservative cutoff (T ≤ 27) was needed in the patient sample for a similar combination of sensitivity (.24-.45) and specificity (.87-.93). An EWFT raw score ≤5 was highly specific (.94-.97) but insensitive (.10-.18) to invalid performance. Failing multiple cutoffs improved specificity (.90-1.00) at variable sensitivity (.19-.45).

CONCLUSIONS

Results help resolve the inconsistency in previous reports, and confirm the overall utility of existing verbal fluency tests as embedded validity indicators. Multivariate models of performance validity assessment are superior to single indicators. The clinical utility and limitations of the EWFT as a novel measure are discussed.

Performance validity testing via telehealth and failure rate in veterans with moderate-to-severe traumatic brain injury: A veterans affairs TBI model systems study

BACKGROUND

The COVID-19 pandemic has led to increased utilization of teleneuropsychology (TeleNP) services. Unfortunately, investigations of performance validity tests (PVT) delivered via TeleNP are sparse.

OBJECTIVE

The purpose of this study was to examine the specificity of the Reliable Digit Span (RDS) and 21-item test administered via telephoneMETHOD:Participants were 51 veterans with moderate-to-severe traumatic brain injury (TBI). All participants completed the RDS and 21-item test in the context of a larger TeleNP battery. Specificity rates were examined across multiple cutoffs for both PVTs.

RESULTS

Consistent with research employing traditional face-to-face neuropsychological evaluations, both PVTs maintained adequate specificity (i.e., >  90%) across previously established cutoffs. Specifically, defining performance invalidity as RDS <  7 or 21-item test forced choice total correct <  11 led to <  10%false positive classification errors.

CONCLUSIONS

Findings add to the limited body of research examining and provide preliminary support for the use of the RDS and 21-item test in TeleNP via telephone. Both measures maintained adequate specificity in veterans with moderate-to-severe TBI. Future investigations including clinical or experimental "feigners" in a counter-balanced cross-over design (i.e., face-to-face vs. TeleNP) are recommended.

The Multi-Level Pattern Memory Test (MPMT): Initial Validation of a Novel Performance Validity Test

Performance validity tests (PVTs) are used for the detection of noncredible performance in neuropsychological assessments. The aim of the study was to assess the efficacy (i.e., discrimination capacity) of a novel PVT, the Multi-Level Pattern Memory Test (MPMT). It includes stages that allow profile analysis (i.e., detecting noncredible performance based on an analysis of participants' performance across stages) and minimizes the likelihood that it would be perceived as a PVT by examinees. In addition, it utilizes nonverbal stimuli and is therefore more likely to be cross-culturally valid. In Experiment 1, participants that were instructed to simulate cognitive impairment performed less accurately than honest controls in the MPMT (n = 67). Importantly, the MPMT has shown an adequate discrimination capacity, though somewhat lower than an established PVT (i.e., Test of Memory Malingering-TOMM). Experiment 2 (n = 77) validated the findings of the first experiment while also indicating a dissociation between the simulators' objective performance and their perceived cognitive load while performing the MPMT. The MPMT and the profile analysis based on its outcome measures show initial promise in detecting noncredible performance. It may, therefore, increase the range of available PVTs at the disposal of clinicians, though further validation in clinical settings is mandated. The fact that it is an open-source software will hopefully also encourage the development of research programs aimed at clarifying the cognitive processes involved in noncredible performance and the impact of PVT characteristics on clinical utility.

The Multidimensional ADHD Rating Scale: A measure of symptoms, impairment, and symptom validity

Objective: Two studies examined the psychometric properties of the Multidimensional ADHD Rating Scale (MARS), which assesses ADHD symptoms, related functional impairment, and symptom validity (SV). Method: Study 1 used MARS item responses from college students with and without ADHD (with some of the latter group assigned to feign ADHD) to create an SV-index, and to identify optimal cut scores for the clinical (symptom and impairment) indexes. Study 2 cross-validated the findings on a new sample. Results: In both studies, malingerers reported more symptoms and impairment than participants with ADHD, who reported more symptoms and impairment than controls. Receiver operating characteristic analyses found very good discrimination of genuine ADHD from control cases by the clinical MARS indexes, and very good discrimination of genuine ADHD from malingered ADHD by the SV-index. Conclusion: This research provides initial support for the effectiveness of the MARS to detect simulated cases of malingering, and to differentiate ADHD from non-ADHD cases in college students.

How Plausible Is the Implausible? Students’ Plausibility and Prevalence Ratings of the Self-Report Symptom Inventory

Some self-report symptom validity tests, such as the Self-Report Symptom Inventory (SRSI), rely on a detection strategy that uses bizarre, extreme, or very rare symptoms. Thus, items are constructed to invite respondents with an invalid response style to affirm pseudosymptoms that are usually not experienced by genuine patients. However, these pseudosymptoms should not be easily recognizable, because otherwise sophisticated over-reporters could strategically avoid them and go undetected. Therefore, we tested how well future psychology professionals were able to differentiate between genuine complaints and pseudosymptoms in terms of their plausibility and prevalence.

Psychology students (N = 87) received the items of the SRSI online and were given the task to rate each item as to its plausibility and prevalence in the community.

Students evaluated genuine symptoms as significantly more plausible and more prevalent than pseudosymptoms. However, 56% of students rated pseudosymptoms as moderately plausible, whereas 17% rated them as moderately prevalent in the general public.

Overall, it appears that psychology students are successful in distinguishing bizarre, unusual, or rare symptoms from genuine complaints. Yet, the majority of students still attributed relatively high prima facie plausibility to pseudosymptoms. We contend that if such a trusting attitude is true for psychology students, it may also be the case for young psychology practitioners, which, consequently, may diminish the probability of employing self-report validity measures in psychological assessments.

The Development and Validation of the Embedded Validity Indicator for the Neuropsychological Assessment Battery

OBJECTIVE

The purpose of this study was to develop and validate an embedded measure of performance validity within the Neuropsychological Assessment Battery (NAB).

METHOD

This study involved a retrospective chart review at an outpatient neuropsychology clinic. Participants were 183 adults (ages 18-70) who completed the attention and memory modules of the NAB, as well as the Word Choice Test, Green's Medical Symptom Validity Test (MSVT), and Green's Non-Verbal MSVT, as part of a clinical neuropsychological assessment (n = 147) or as part of a forensic neuropsychological evaluation (n = 36). Replicating methodology utilized by Silverberg et al. (2007) for the development of the Effort Index within the Repeatable Battery for the Assessment of Neuropsychological Status, an Embedded Validity Indictor (EVI) for the NAB was developed in the present study based on Digits Forward and List Learning Long Delayed Forced-Choice Recognition (list recognition) subtests.

RESULTS

Receiver operating characteristic curve analyses indicated the newly developed NAB EVI was able to significantly differentiate between valid and invalid status on stand-alone performance-validity tests, with area under the curve values ranging from 0.797 to 0.977. Optimal cutoffs for medical, forensic, and mixed samples were identified.

CONCLUSIONS

The newly developed NAB EVI shows promise as an embedded performance validity measure; however, due to moderate sensitivity, it should be used in combination with stand-alone performance validity tests to detect invalid performance.

This will only take a minute: Time cutoffs are superior to accuracy cutoffs on the forced choice recognition trial of the Hopkins Verbal Learning Test - Revised

OBJECTIVE

This study was designed to evaluate the classification accuracy of the recently introduced forced-choice recognition trial to the Hopkins Verbal Learning Test - Revised (FCR_HVLT-R) as a performance validity test (PVT) in a clinical sample. Time-to-completion (T2C) for FCR_HVLT-R was also examined.

METHOD

Forty-three students were assigned to either the control or the experimental malingering (expMAL) condition. Archival data were collected from 52 adults clinically referred for neuropsychological assessment. Invalid performance was defined using expMAL status, two free-standing PVTs and two validity composites.

RESULTS

Among students, FCR_HVLT-R ≤11 or T2C ≥45 seconds was specific (0.86-0.93) to invalid performance. Among patients, an FCR_HVLT-R ≤11 was specific (0.94-1.00), but relatively insensitive (0.38-0.60) to non-credible responding0. T2C ≥35 s produced notably higher sensitivity (0.71-0.89), but variable specificity (0.83-0.96). The T2C achieved superior overall correct classification (81-86%) compared to the accuracy score (68-77%). The FCR_HVLT-R provided incremental utility in performance validity assessment compared to previously introduced validity cutoffs on Recognition Discrimination.

CONCLUSIONS

Combined with T2C, the FCR_HVLT-R has the potential to function as a quick, inexpensive and effective embedded PVT. The time-cutoff effectively attenuated the low ceiling of the accuracy scores, increasing sensitivity by 19%. Replication in larger and more geographically and demographically diverse samples is needed before the FCR_HVLT-R can be endorsed for routine clinical application.

Does cognitive training improve attention/working memory in persons with MS? A pilot study using the Cogmed Working Memory Training program

BACKGROUND

Cognitive deficits, especially in attention, are common in persons with MS (PwMS) and are associated with clinically meaningful outcomes, such as work disability and lower quality of life (QOL). In this study, we aimed to determine whether Cogmed Working Memory Training (CWMT) improves attention/working memory in PwMS displaying impairment in these domains.

METHODS

This single blind, randomized controlled, pilot study compared the effects of CWMT, a five-week evidenced-based computer-assisted training program that is supported by weekly meetings with a coach, to standard medical care (treatment as usual). We recruited PwMS from one MS center (London (ON) Canada), aged 18-64, with an Expanded Disability Status Scale (EDSS) score of ≤ 7.0, and a visual acuity (corrected) of at least 20/70. Potential subjects had to demonstrate impaired attention on at least two of three measures (Paced Auditory Serial Addition Test [PASAT], Symbol Digit Modalities Test [SDMT], and/or DKEFS Color-Word Interference Test); these measures also served as the primary study outcomes. Subjects were randomized to either the CWMT or treatment as usual. Secondary cognitive outcomes included other measures of attention, memory, as well as a self-reported cognitive function measure. Self-reported measures of mood (depression and anxiety), pain, and QOL were also included as other secondary outcomes. Subjects received assessments at baseline, post-treatment, and 6-month follow-up, or an equivalent time period for the treatment as usual group. The two groups were compared at baseline on background measures using independent samples t-tests, Chi-Square tests, and Mann-Whitney U tests. To analyze primary and secondary outcomes, a non-parametric approach was used due the small sample size and that many of our outcomes did not meet assumptions for parametric analyses. Friedman's test was conducted followed by post hoc pairwise comparisons within each group using Wilcoxon Signed-Rank tests with Bonferroni corrected post hoc contrasts, which allowed us to examine for differences between time points.

RESULTS

Of 30 subjects, 15 were assigned to CWMT. Significant training effects were noted in 1 of 3 primary attentional outcomes (DKEFS Color-Word Interference Test), 2 of 3 secondary attentional outcomes (Letter-Number Sequencing, Digit Span), and 1 mood scale (Hospital Anxiety and Depression scale (HADS) - Depression Subscale), ps < .025. No significant changes were observed in the treatment as usual group.

CONCLUSION

This pilot study demonstrates that cognitive training with CWMT has the potential to improve attention/working memory in PwMS, as well as a potential positive effect on mood, in PwMS. Further exploration of this intervention in PwMS with attention/working memory impairment is warranted.

Feigning memory impairment in a forced-choice task: Evidence from event-related potentials

Strategies of malingering detection have brought about a wealth of neuropsychological studies in the last decades. However, the investigation of physiological measures to reliably differentiate between authentic and manipulated symptom presentations is still in its infancy. The present study examined event-related potentials (ERP) to identify feigned memory impairment. We tested instructed malingerers (n = 25) and control participants (n = 22) with a recognition task similar to the Test of Memory Malingering. No differences between groups were found for P1 (70-110 ms) but for N1 (120-170 ms) and P300 components, with lower amplitudes for instructed malingerers. Behavioral data showed a typical pattern of unrealistically high errors in a forced-choice recognition task and less overall recalled stimuli in instructed malingerers. We also found study-phase repetition and old/new effects in the P300, but no interactions with groups (control vs. malingering). Post-hoc analyses revealed that the P300 effect is greater when participants reported an attention-based faking strategy, as opposed to response-based malingerers and controls. The employment of physiological measures can yield additional information on the validity of test data without the need to perform additional tests.

Patterns of Cognitive Test Scores and Symptom Complaints in Persons with TBI Who Failed Performance Validity Testing

OBJECTIVE

To determine clinically meaningful subgroups of persons with traumatic brain injury (TBI) who have failed performance validity testing.

METHOD

Study participants were selected from a cohort of 674 participants with definitive medical evidence of TBI. Participants were those who failed performance validity testing (the Word Memory Test, using the standard cutoffs). Participants were administered cognitive tests and self-report questionnaires. Test and questionnaire results were summarized as 12 dimension scores. Cluster analysis using the k-means method was performed.

RESULTS

Cluster analysis for the 143 retained participants indicated three subgroups. These subgroups differed on patterns of scores. Subgroup 1 was impaired for memory and had no excessive complaints. Subgroup 2 had impaired memory and processing speed as well as concern regarding cognition function. Subgroup 3 showed impairment on all cognitive tests and excess complaints in multiple areas.

CONCLUSIONS

These results provide a preliminary basis for improved understanding of poor performance validity.

Stronger Together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain Injury

OBJECTIVE

This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV).

METHOD

Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance.

RESULTS

Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91-.95) over univariate cutoffs (.78-.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43-.67) compared to univariate cutoffs (.11-.63) while maintaining consistently high specificity (.93-.95).

CONCLUSIONS

In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment.

BRIEF SUMMARY

Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment.

Multidimensional Malingering Criteria for Neuropsychological Assessment: A 20-Year Update of the Malingered Neuropsychological Dysfunction Criteria

OBJECTIVES

Empirically informed neuropsychological opinion is critical for determining whether cognitive deficits and symptoms are legitimate, particularly in settings where there are significant external incentives for successful malingering. The Slick, Sherman, and Iversion (1999) criteria for malingered neurocognitive dysfunction (MND) are considered a major milestone in the field's operationalization of neurocognitive malingering and have strongly influenced the development of malingering detection methods, including serving as the criterion of malingering in the validation of several performance validity tests (PVTs) and symptom validity tests (SVTs) (Slick, D.J., Sherman, E.M.S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545-561). However, the MND criteria are long overdue for revision to address advances in malingering research and to address limitations identified by experts in the field.

METHOD

The MND criteria were critically reviewed, updated with reference to research on malingering, and expanded to address other forms of malingering pertinent to neuropsychological evaluation such as exaggeration of self-reported somatic and psychiatric symptoms.

RESULTS

The new proposed criteria simplify diagnostic categories, expand and clarify external incentives, more clearly define the role of compelling inconsistencies, address issues concerning PVTs and SVTs (i.e., number administered, false positives, and redundancy), better define the role of SVTs and of marked discrepancies indicative of malingering, and most importantly, clearly define exclusionary criteria based on the last two decades of research on malingering in neuropsychology. Lastly, the new criteria provide specifiers to better describe clinical presentations for use in neuropsychological assessment.

CONCLUSIONS

The proposed multidimensional malingering criteria that define cognitive, somatic, and psychiatric malingering for use in neuropsychological assessment are presented.

The other face of illness-deception: Diagnostic criteria for factitious disorder with proposed standards for clinical practice and research

Objective: This paper aims to develop diagnostic criteria for factitious disorder (FD) and a heuristic for research by creating standards for delineating criterion groups.Method: Both FD and malingering are conceptualized within a rubric of illness-deception. The history of FD research was compared to the research history on malingering. Differences in the measurement of these constructs were described. The potential utility of performance validity tests (PVTs) and symptom validity tests (SVTs) in FD is discussed in light of successful applications in malingering. Methods for obtaining evidence for FD are delineated in a table of diagnostic criteria.Results: The comparison of FD and malingering research shows that the scientific measurement of malingering evolved rapidly with the introduction of forced-choice validity testing and cogent guidelines for the formation of criterion groups. Likewise, PVTs and SVTs hold promise as methods of measuring deceptive behavior in FD. The most salient differences between FD and malingering are understood to be matter of context/setting: malingering occurs in an external incentive context, while FD occurs in a medical/psychological context. Guidelines to assess FD are developed to fill the need for known-groups research.Conclusions: Evidence for FD, a form of illness-deception, can be obtained by using validity testing, which, together with careful clinical observation, allows for the development of probabilistic diagnostic criteria. Similar to the other form of illness-deception - malingering - these criteria can be used to form known groups for research.

Assessing performance validity with the TOMM and automatized sequences task in a pediatric psychiatric inpatient setting

This study examined the performance of children consecutively admitted to an inpatient psychiatric unit on the Test of Memory Malingering (TOMM) (aged 5-12; n = 96) and Automatized Sequences Task (aged 8-12; n = 67). Eighty-three percent of children passed the TOMM Trial 2 (M raw score = 47.7, SD = 4.7) and 76% of children passed the Automatized Sequences Task total time (M = 23.1 seconds; SD = 8.2). The concordance rate between the TOMM and the total time on the Automatized Sequences Task was 73.1%. Receiver operating characteristic curves indicated that of the Automatized Sequences Task subtests, only Counting 1-20 significantly differentiated children who passed Trial 2 of the TOMM from those who did not pass Trial 2 of the TOMM (area under the curve = .756, p = .006). Performance on both PVTs was unrelated to demographic characteristics and measures of psychological and neuropsychological functioning on both the TOMM and Automatized Sequences Task. Further research is needed to determine whether the nearly 1 in 4 children (23.9%) who performed below recommended cutoffs on Automatized Sequences Task reflects genuine suboptimal effort, cognitive difficulties among these children, and/or other factors.

Rey 15 item test plus recognition trial and TOMM in a community pediatric sample

In pediatric evaluations, performance validity test (PVT) selection is often constrained by reading level, developmental appropriateness of stimuli, and administration time. The Rey 15 Item Test (FIT) addresses these constraints, and ranks among the most frequently used PVTs. Unfortunately, research indicates poor sensitivity of the FIT recall trial. Boone et al. developed a FIT recognition trial and demonstrated in an adult sample that its use increased sensitivity while maintaining high specificity. These results are promising, but, to the authors' knowledge, have only been replicated once in a pediatric sample. The present study examined the FIT plus recognition trial in a sample of 72 young athletes ages 8-16 years. All data for the present study were collected during baseline cognitive evaluations. The Test of Memory Malingering (TOMM) was used as the comparison criterion. Receiver operating characteristic curve analyses showed the addition of the recognition trial did not substantially improve sensitivity of the FIT. There was a surprising lack of concordance between TOMM and FIT scores, and, whereas the FIT correlated with multiple cognitive measures, the TOMM did not correlate with any other measures. Results suggest the FIT is not appropriate for pediatric clinical care, even with the additional recognition trial.

The validity of the test of memory malingering (TOMM) with deaf individuals

OBJECTIVE

Administration of performance validity tests (PVT) during neuropsychological assessments is standard practice, with the Test of Memory Malingering (TOMM) being a commonly used measure. The TOMM has been well validated in hearing populations with various medical and psychiatric backgrounds. A major gap in the literature is the use of the TOMM amongst culturally Deaf individuals who use American Sign Language (ASL) as their first and preferred language. The purpose of this study was to explore the use of the TOMM with this population to determine if there may be differences related to the use of semantic knowledge and recall using signs rather than spoken phonemes.

METHOD

This study recruited 30 culturally Deaf, community-dwelling adults, who self-reported that they were not involved in litigation ordisability claims. In addition to the TOMM, participants were screened for cognitive ability using non-verbal components of the Wechsler Abbreviated Scale of Intelligence, Second Edition (WASI-II) and the Mini Mental State Examination: ASL Version (MMSE:ASL).

RESULTS

Nonverbal intelligence for this sample was within the average range of ability. No participants scored lower than the standard cut-off score for Trial 2 or the Retention Trial on the TOMM (≤44 raw score to indicate invalid responding). Trial 1 performances ranged from 44 to 50, Trial 2 performances ranged from 49 to 50, and Retention performances ranged from 49 to 50.

CONCLUSION

These results support the use of the same standard cut-off scores established for hearing individuals in culturally Deaf individuals who use ASL.

Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients

This observational study examined the acute cognitive effects of cannabis. We hypothesized that cognitive performance would be negatively affected by acute cannabis intoxication. Twenty-two medical cannabis patients from Southwestern Ontario completed the study. The majority (n = 13) were male. Mean age was 36.0 years, and mean level of education was 13.7 years. Participants were administered the same brief neurocognitive battery three times during a six-hour period: at baseline ("Baseline"), once after they consumed a 20% THC cannabis product ("THC"), and once again several hours later ("Recovery"). The average self-reported level of cannabis intoxication prior to the second assessment (i.e., during THC) was 5.1 out of 10. Contrary to expectations, performance on neuropsychological tests remained stable or even improved during the acute intoxication stage (THC; d: .49-.65, medium effect), and continued to increase during Recovery (d: .45-.77, medium-large effect). Interestingly, the failure rate on performance validity indicators increased during THC. Contrary to our hypothesis, there was no psychometric evidence for a decline in cognitive ability following THC intoxication. There are several possible explanations for this finding but, in the absence of a control group, no definitive conclusion can be reached at this time.