1
|
Lesica S, Luu H, Lawrence M. Performance validity in a presurgical epilepsy population. Clin Neuropsychol 2024:1-13. [PMID: 39138860 DOI: 10.1080/13854046.2024.2391128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2024] [Accepted: 08/07/2024] [Indexed: 08/15/2024]
Abstract
Objective: This study examined the performance validity test (PVT) pass/fail rate in a sample of presurgical epilepsy candidates; assessed whether performance validity was associated with reduced performance across cognitive domains; investigated the relationship between performance validity and self-report mood questionnaires; and assessed whether PVT performance was associated with demographic or clinical factors (i.e. sex, race/ethnicity, age, years of education, reported history of special education, seizure longevity, and number of anti-seizure medications). Methods: One hundred and eighty-three presurgical epilepsy candidates were examined. Each patient's assessment battery included a stand-alone performance validity measure and two embedded validity measures. Results: PVT failure rate in this sample (10%) was associated with reduced performance on all neurocognitive measures: Full Scale IQ (FSIQ; r = -0.26), CVLT-II Total Learning (r = -0.36) and Long Delay Free Recall (LDFR; r = -0.38), BVMT-R Delayed Recall (r = -0.28), and Wisconsin Card Sorting Test (Categories Completed; r = -0.32). In addition, PVT failure rate was associated with elevated scores on the Beck Anxiety Inventory (r = .22) but not on the Beck Depression Inventory (BDI-II; r = .14). Correlations that were significant at the α = 0.05 level maintained significance following post hoc Bonferroni correction. The valid and invalid groups did not differ significantly in sex, race/ethnicity, age, years of education, reported history of special education, seizure longevity, and number of anti-seizure medications. Conclusions: Results from this study suggest that PVT performance was not impacted by demographic or clinical factors and therefore may be a reliable indicator of performance validity in a presurgical epilepsy sample.
Collapse
Affiliation(s)
- Sofia Lesica
- Corewell Health, Grand Rapids, MI, USA
- Central Michigan University, Mount Pleasant, MI, USA
| | - Hien Luu
- Corewell Health, Grand Rapids, MI, USA
| | | |
Collapse
|
2
|
Pick S, Millman LM, Sun Y, Short E, Stanton B, Winston JS, Mehta MA, Nicholson TR, Reinders AA, David AS, Edwards MJ, Goldstein LH, Hotopf M, Chalder T. Objective and subjective neurocognitive functioning in functional motor symptoms and functional seizures: preliminary findings. J Clin Exp Neuropsychol 2023; 45:970-987. [PMID: 37724767 PMCID: PMC11057846 DOI: 10.1080/13803395.2023.2245110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Accepted: 07/30/2023] [Indexed: 09/21/2023]
Abstract
INTRODUCTION This study aimed to provide a preliminary assessment of objective and subjective neurocognitive functioning in individuals with functional motor symptoms (FMS) and/or functional seizures (FS). We tested the hypotheses that the FMS/FS group would display poorer objective attentional and executive functioning, altered social cognition, and reduced metacognitive accuracy. METHOD Individuals with FMS/FS (n = 16) and healthy controls (HCs, n = 17) completed an abbreviated CANTAB battery, and measures of intellectual functioning, subjective cognitive complaints, performance validity, and comorbid symptoms. Subjective performance ratings were obtained to assess local metacognitive accuracy. RESULTS The groups were comparable in age (p = 0.45), sex (p = 0.62), IQ (p = 0.57), and performance validity (p-values = 0.10-0.91). We observed no impairment on any CANTAB test in this FMS/FS sample compared to HCs, although the FMS/FS group displayed shorter reaction times on the Emotional Bias task (anger) (p = 0.01, np2 = 0.20). The groups did not differ in subjective performance ratings (p-values 0.15). Whilst CANTAB attentional set-shifting performance (total trials/errors) correlated with subjective performance ratings in HCs (p-values<0.005, rs = -0.85), these correlations were non-significant in the FMS/FS sample (p-values = 0.10-0.13, rs-values = -0.46-0.50). The FMS/FS group reported more daily cognitive complaints than HCs (p = 0.006, g = 0.92), which were associated with subjective performance ratings on CANTAB sustained attention (p = 0.001, rs = -0.74) and working memory tests (p < 0.001, rs = -0.75), and with depression (p = 0.003, rs = 0.70), and somatoform (p = 0.003, rs = 0.70) and psychological dissociation (p-values<0.005, rs-values = 0.67-0.85). CONCLUSIONS These results suggest a discordance between objective and subjective neurocognitive functioning in this FMS/FS sample, reflecting intact test performance alongside poorer subjective cognitive functioning. Further investigation of neurocognitive functioning in FND subgroups is necessary.
Collapse
Affiliation(s)
- Susannah Pick
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - L.S. Merritt Millman
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Yiqing Sun
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Eleanor Short
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Biba Stanton
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Joel S. Winston
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Mitul A. Mehta
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Timothy R. Nicholson
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | | | | | - Mark J. Edwards
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Laura H. Goldstein
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| | - Matthew Hotopf
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
- South London and Maudsley NHS Foundation Trust, UK
| | - Trudie Chalder
- Institute of Psychiatry, Psychology, and Neuroscience, King’s College London, UK
| |
Collapse
|
3
|
Mascarenhas MA, Cocunato JL, Armstrong IT, Harrison AG, Zakzanis KK. Base rates of non-credible performance in a post-secondary student sample seeking accessibility accommodations. Clin Neuropsychol 2023; 37:1608-1628. [PMID: 36646463 DOI: 10.1080/13854046.2023.2167737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2022] [Accepted: 01/09/2023] [Indexed: 01/18/2023]
Abstract
Objective: Performance Validity Tests (PVTs) have been used to identify non-credible performance in clinical, medicolegal, forensic, and, more recently, academic settings. The inclusion of PVTs when administering psychoeducational assessments is essential given that specific accommodation such as flexible deadlines and increased writing time can provide an external incentive for students without disabilities to feign symptoms. Method: The present study used archival data to establish base rates of non-credible performance in a sample of post-secondary students (n = 1045) who underwent a comprehensive psychoeducational evaluation for the purposes of obtaining academic accommodations. In accordance with current guidelines, non-credible performance was determined by failure on two or more freestanding or embedded PVTs. Results: 9.4% of participants failed at least two of the PVTs they were administered, of which 8.5% failed two PVTs, and approximately 1% failed three PVTs. Base rates of failure for specific PVTs ranged from 25% (b Test) to 11.2% (TOVA). Conclusions: The present study found a lower base rate of non-credible performance than previously observed in comparable populations. This likely reflects the utilization of conservative criteria in detecting non-credible performance to avoid false positives. By contrast, inconsistent base rates previously found in the literature may reflect inconsistent methodologies. These results further emphasize the importance of administering multiple PVTs during psychoeducational assessments. The implications of these findings can further inform clinicians administering assessments in academic settings and aid in the appropriate utilization of PVTs in psychoeducational evaluation to determine accessibility accommodations.
Collapse
Affiliation(s)
- Melanie A Mascarenhas
- Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Canada
| | - Jessica L Cocunato
- Department of Psychology, University of Toronto Scarborough, Toronto, Canada
| | - Irene T Armstrong
- Regional Assessment and Resource Centre, Queen's University, Kingston, Canada
| | - Allyson G Harrison
- Regional Assessment and Resource Centre, Queen's University, Kingston, Canada
| | - Konstantine K Zakzanis
- Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Canada
- Department of Psychology, University of Toronto Scarborough, Toronto, Canada
| |
Collapse
|
4
|
Bajjaleh C, Braw YC, Elkana O. Adaptation and initial validation of the Arabic version of the Word Memory Test (WMT ARB). APPLIED NEUROPSYCHOLOGY. ADULT 2023; 30:204-213. [PMID: 34043924 DOI: 10.1080/23279095.2021.1923495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
BACKGROUND The feigning of cognitive impairment is common in neuropsychological assessments, especially in a medicolegal setting. The Word Memory Test (WMT) is a forced-choice recognition memory performance validity test (PVT) which is widely used to detect noncredible performance. Though translated to several languages, this was not done for one of the most common languages, Arabic. The aim of the current study was to evaluate the convergent validity of the Arabic adaptation of the WMT (WMTARB) among Israeli Arabic speakers. METHODS We adapted the WMT to Arabic using the back-translation method and in accordance with relevant guidelines. We then randomly assigned healthy Arabic speaking adults (N = 63) to either a simulation or honest control condition. The participants then performed neuropsychological tests which included the WMTARB and the Test of Memory Malingering (TOMM), a well-validated nonverbal PVT. RESULTS The WMTARB had high split-half reliability and its measures were significantly correlated with that of the TOMM (p < .001). High concordance was found in classification of participants using the WMTARB and TOMM (specificity = 94.29% and sensitivity = 100% using the conventional TOMM trial 2 cutoff as gold standard). As expected, simulators' accuracy on the WMTARB was significantly lower than that of honest controls. None of the demographic variables significantly correlated with WMTARB measures. CONCLUSION The WMTARB shows initial evidence of reliability and validity, emphasizing its potential use in the large population of Arabic speakers and universality in detecting noncredible performance. The findings, however, are preliminary and mandate validation in clinical settings.
Collapse
Affiliation(s)
- Christine Bajjaleh
- Department of Psychology, the Academic College of Tel Aviv-Yaffo, Tel Aviv-Yaffo, Israel
| | - Yoram C Braw
- Department of Psychology, Ariel University, Ariel, Israel
| | - Odelia Elkana
- Department of Psychology, the Academic College of Tel Aviv-Yaffo, Tel Aviv-Yaffo, Israel
| |
Collapse
|
5
|
Erdodi LA. Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. NeuroRehabilitation 2021; 49:179-213. [PMID: 34420986 DOI: 10.3233/nre-218020] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE This study was designed to empirically investigate the signal detection profile of various multivariate models of performance validity tests (MV-PVTs) and explore several contested assumptions underlying validity assessment in general and MV-PVTs specifically. METHOD Archival data were collected from 167 patients (52.4%male; MAge = 39.7) clinicially evaluated subsequent to a TBI. Performance validity was psychometrically defined using two free-standing PVTs and five composite measures, each based on five embedded PVTs. RESULTS MV-PVTs had superior classification accuracy compared to univariate cutoffs. The similarity between predictor and criterion PVTs influenced signal detection profiles. False positive rates (FPR) in MV-PVTs can be effectively controlled using more stringent multivariate cutoffs. In addition to Pass and Fail, Borderline is a legitimate third outcome of performance validity assessment. Failing memory-based PVTs was associated with elevated self-reported psychiatric symptoms. CONCLUSIONS Concerns about elevated FPR in MV-PVTs are unsubstantiated. In fact, MV-PVTs are psychometrically superior to individual components. Instrumentation artifacts are endemic to PVTs, and represent both a threat and an opportunity during the interpretation of a given neurocognitive profile. There is no such thing as too much information in performance validity assessment. Psychometric issues should be evaluated based on empirical, not theoretical models. As the number/severity of embedded PVT failures accumulates, assessors must consider the possibility of non-credible presentation and its clinical implications to neurorehabilitation.
Collapse
|
6
|
Nayar K, Ventura LM, DeDios-Stern S, Oh A, Soble JR. The Impact of Learning and Memory on Performance Validity Tests in a Mixed Clinical Pediatric Population. Arch Clin Neuropsychol 2021; 37:50-62. [PMID: 34050354 DOI: 10.1093/arclin/acab040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/04/2021] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE This study examined the degree to which verbal and visuospatial memory abilities influence performance validity test (PVT) performance in a mixed clinical pediatric sample. METHOD Data from 252 consecutive clinical pediatric cases (Mage=11.23 years, SD=4.02; 61.9% male) seen for outpatient neuropsychological assessment were collected. Measures of learning and memory (e.g., The California Verbal Learning Test-Children's Version; Child and Adolescent Memory Profile [ChAMP]), performance validity (Test of Memory Malingering Trial 1 [TOMM T1]; Wechsler Intelligence Scale for Children-Fifth Edition [WISC-V] or Wechsler Adult Intelligence Scale-Fourth Edition Digit Span indices; ChAMP Overall Validity Index), and intellectual abilities (e.g., WISC-V) were included. RESULTS Learning/memory abilities were not significantly correlated with TOMM T1 and accounted for relatively little variance in overall TOMM T1 performance (i.e., ≤6%). Conversely, ChAMP Validity Index scores were significantly correlated with verbal and visual learning/memory abilities, and learning/memory accounted for significant variance in PVT performance (12%-26%). Verbal learning/memory performance accounted for 5%-16% of the variance across the Digit Span PVTs. No significant differences in TOMM T1 and Digit Span PVT scores emerged between verbal/visual learning/memory impairment groups. ChAMP validity scores were lower for the visual learning/memory impairment group relative to the nonimpaired group. CONCLUSIONS Findings highlight the utility of including PVTs as standard practice for pediatric populations, particularly when memory is a concern. Consistent with the adult literature, TOMM T1 outperformed other PVTs in its utility even among the diverse clinical sample with/without learning/memory impairment. In contrast, use of Digit Span indices appear to be best suited in the presence of visuospatial (but not verbal) learning/memory concerns. Finally, the ChAMP's embedded validity measure was most strongly impacted by learning/memory performance.
Collapse
Affiliation(s)
- Kritika Nayar
- Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Lea M Ventura
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Pediatrics, University of Illinois College of Medicine, Chicago, IL, USA
| | - Samantha DeDios-Stern
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Alison Oh
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
7
|
Graver C, Green P. Misleading conclusions about word memory test results in multiple sclerosis (MS) by Loring and Goldstein (2019). APPLIED NEUROPSYCHOLOGY-ADULT 2020; 29:315-323. [DOI: 10.1080/23279095.2020.1748035] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
8
|
Green P, Horton AM. Introduction to special issue on effort testing in children and adolescents. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:290-291. [PMID: 32320282 DOI: 10.1080/21622965.2020.1750105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
This manuscript reviews the past history of effort testing in children and adolescents. Results in children and adults are briefly described on tests such as the Word Memory Test (WMT), the Medical Symptom Validity Test (MSVT), the Nonverbal Medical Symptom Validity Test (NV-MSVT) and Test of Memory Malingering (TOMM). Articles in the Special Issue are also briefly described.
Collapse
|
9
|
MacAllister WS, Désiré N, Vasserman M, Dalrymple J, Salinas L, Brooks BL. The use of the MSVT in children and adolescents with epilepsy. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:323-328. [PMID: 32297798 DOI: 10.1080/21622965.2020.1750127] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
Pediatric neuropsychologists are increasingly recognizing the importance of performance validity testing during evaluations. The use of such measures to detect insufficient effort is of particular importance in pediatric epilepsy evaluations, where test results are often used to guide surgical decisions and failure to detect poor task engagement can result in postsurgical cognitive decline. The present investigation assesses the utility of the Medical Symptom Validity Test (MSVT) in 104 clinically referred children and adolescents with epilepsy. Though the overall failure rate was 15.4% of the total group, children with 2nd grade or higher reading skills (a requirement of the task) passed at a very high rate (96.6%). Of the three failures, two were unequivocally deemed true positives, while the third failed due to extreme somnolence during testing. Notably, for those with ≥2nd grade reading levels, MSVT validity indices were unrelated to patient age, intellectual functioning, or age of epilepsy onset, while modest relations were seen with specific memory measures, number of epilepsy medications, and seizure frequency. Despite these associations, however, this did not result in more failures in this population of children and adolescents with substantial neurologic involvement, as pass rates exceeded 92% for those with intellectual disability, high seizure frequency, high medication burden, and even prior surgical resection of critical memory structures.
Collapse
Affiliation(s)
- William S MacAllister
- Neuropsychology Service, Alberta Children's Hospital, Calgary, Canada.,Department of Pediatrics, University of Calgary, Calgary, Canada.,Alberta Children's Hospital Research Institute, Calgary, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | - Naddley Désiré
- Neuropsychology Service, Alberta Children's Hospital, Calgary, Canada
| | - Marsha Vasserman
- Neuropsychology Service, Alberta Children's Hospital, Calgary, Canada.,Department of Pediatrics, University of Calgary, Calgary, Canada.,Alberta Children's Hospital Research Institute, Calgary, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | | | - Lilian Salinas
- New York University Comprehensive Epilepsy Center, New York, New York, USA
| | - Brian L Brooks
- Neuropsychology Service, Alberta Children's Hospital, Calgary, Canada.,Department of Pediatrics, University of Calgary, Calgary, Canada.,Alberta Children's Hospital Research Institute, Calgary, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, Canada.,Department of Psychology, University of Calgary, Calgary, Canada
| |
Collapse
|
10
|
Bosworth C, Dodd JN. Noncredible effort on the Nonverbal-Medical Symptom Validity Test (NV-MSVT): Impact on cognitive performance in pediatric mild traumatic brain injury. APPLIED NEUROPSYCHOLOGY. CHILD 2020; 9:367-374. [PMID: 32223424 DOI: 10.1080/21622965.2020.1742717] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
This study examined failure rates on the Nonverbal-Medical Symptom Validity Test (NV-MSVT) and its impact on cognitive performance in a sample of youths with mild traumatic brain injury (mTBI). Participants were 184 children and adolescents who presented to a multidisciplinary concussion clinic for a targeted neuropsychological evaluation. Performance Validity Tests (PVTs) were a part of the standard battery, including the NV-MSVT. Twenty-eight participants (15.2%) failed the NV-MSVT, none of whom displayed a genuine memory impairment profile (GMIP). Participants who failed the NV-MSVT performed significantly worse than those who passed the NV-MSVT on measures of IQ, memory, and immediate attention/working memory. There was no significant difference between groups on processing speed, sustained attention, cognitive flexibility, or sight word reading level. Aside from a slight difference in age, NV-MSVT failure was not impacted by demographic variables (sex, race), premorbid risk factors (pre-injury ADHD, learning disabilities, psychiatric diagnoses or treatment, developmental delays, or prior special education), injury-related variables (time since injury, positive neuroimaging findings, post-traumatic amnesia, number of prior mTBIs, etc.) or post-mTBI anxiety/depression. That said, participants who failed NV-MSVT endorsed significantly more severe postconcussive symptoms. These findings support the use of the NV-MSVT in neuropsychological evaluation of children and adolescents with mTBI.
Collapse
Affiliation(s)
- Christopher Bosworth
- St. Louis Children's Hospital, Washington University School of Medicine, St. Louis, MO, USA
| | - Jonathan N Dodd
- Department of Neuropsychology, WellStar Medical Group-Psychological Services, Marietta, GA, USA
| |
Collapse
|
11
|
Bhowmick C, Hirst R, Green P. Comparison of the Word Memory Test and the Test of Memory Malingering in detecting invalid performance in neuropsychological testing. APPLIED NEUROPSYCHOLOGY-ADULT 2019; 28:486-496. [PMID: 31519112 DOI: 10.1080/23279095.2019.1658585] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Given the prevalence of compensation seeking patients who exaggerate or fabricate their symptoms, the assessment of performance and symptom validity throughout testing is vital in neuropsychological evaluations. Two of the most commonly utilized performance validity tests (PVTs) are the Word Memory Test (WMT) and the Test of Memory Malingering (TOMM). While both have proven successful in detecting invalid performance, some studies suggest greater sensitivity in the WMT relative to the TOMM. To improve upon previous research, this study compared performance in individuals who completed both the WMT and TOMM during a neuropsychological evaluation. Participants included 268 cases from a clinical private practice consisting of primarily disability claimants. One-way multivariate analysis of variance (MANOVA) compared neuropsychological performance of participants who passed both PVTs (n = 198) versus those who failed the WMT but passed the TOMM (n = 70). Global suppression of neuropsychological scores was found for participants who failed the WMT but passed the TOMM, as well as more psychiatric symptoms reported on questionnaires, relative to those who passed both PVTs. These findings suggest that those passing the TOMM but failing the WMT demonstrated performance invalidity, which illustrates the WMT's enhanced sensitivity.
Collapse
Affiliation(s)
- Chloe Bhowmick
- Department of Psychology, Palo Alto University, Palo Alto, CA, USA
| | - Rayna Hirst
- Department of Psychology, Palo Alto University, Palo Alto, CA, USA
| | - Paul Green
- William Green, Greens Publishing, Kelowna, British Columbia, Canada
| |
Collapse
|
12
|
|
13
|
Green P, Flaro L. Performance validity test failure predicts suppression of neuropsychological test results in developmentally disabled children. APPLIED NEUROPSYCHOLOGY-CHILD 2019; 10:65-81. [PMID: 31084379 DOI: 10.1080/21622965.2019.1604342] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
There is increasing awareness of the need to use Performance Validity Tests (PVTs) when assessing cognitive abilities in children. Since 1996, there has been an ongoing clinical study of the use of three PVTs with a consecutive series of 1,285 developmentally disabled children. In this study, we report on the results of these PVTs in children of many diagnostic categories. Failure rates on all three tests were very low. The mean scores on the effort measures in those passing the PVTs were extremely high. Failure on each PVT was found to be associated with a significant and widespread suppression of scores across a neuropsychological battery. Failure on even one PVT significantly suppresses ability test scores.
Collapse
Affiliation(s)
- Paul Green
- Green's Publishing Ltd., Kelowna, British Columbia, Canada
| | | |
Collapse
|
14
|
Abstract
The present study introduces the Verbal Associated Pairs Screen (VAPS) as a new measure for assessing performance validity in pediatric populations. This study presents initial data on psychometric properties and establishes construct validity for the VAPS in a sample of 30 adolescent healthy controls and 206 youths with traumatic brain injury (TBI: moderate/severe, N = 30; mild, N = 176). The control group's age (M = 14.93, SD = 1.8) was significantly higher than the moderate/severe TBI (M = 13.9, SD = 2.8), t(68.508) = -3.038, p = .003, and mild TBI (mTBI) groups (M = 14, SD = 2.8), t(54.147) = 2.038, p = .046. The TBI groups were administered the VAPS in accord with other established performance validity tests (PVTs) and well-established memory tests as part of routine clinical evaluations. The healthy control group was administered the VAPS only. VAPS score distributions for the control group were negatively skewed and highly kurtotic. VAPS scores from the moderate/severe TBI and control groups were indistinguishable for Trial 2 (U = 274, p < .01) and the Delay (U = 396, p = .218). In the mTBI group, convergent and divergent validity was established with other well-validated PVTs and memory tests, respectively. ROC curve analyses identified optimal cutoff scores for the VAPS Total Score, with acceptable sensitivity (55%) and excellent specificity (100%), as well as strong detectability (AUC = .829, 95% CI: 0.731 - 0.928, p < .001). Clinical applications, limitations, and directions for future research with the VAPS are discussed.
Collapse
Affiliation(s)
- Jonathan Dodd
- a Department of Psychology , St. Louis Children's Hospital , St. Louis , MO , USA.,b Department of Neurology , Washington University School of Medicine , St. Louis , MO , USA
| | - Samantha Murphy
- c Department of Psychology , University of Missouri - St. Louis , St. Louis , MO , USA
| | - Meghan Doherty
- d Department of Occupational Therapy , St. Louis Children's Hospital , St. Louis , MO , USA
| |
Collapse
|
15
|
Emhoff SM, Lynch JK, McCaffrey RJ. Performance and Symptom Validity Testing in Pediatric Assessment: A Review of the Literature. Dev Neuropsychol 2018; 43:671-707. [DOI: 10.1080/87565641.2018.1525612] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Stephanie M. Emhoff
- Department of Psychology, University at Albany, State University of New York, Albany, New York, USA
| | - Julie K. Lynch
- Department of Psychology, University at Albany, State University of New York, Albany, New York, USA
- Albany Neuropsychological Associates, Albany, New York, USA
| | - Robert J. McCaffrey
- Department of Psychology, University at Albany, State University of New York, Albany, New York, USA
- Albany Neuropsychological Associates, Albany, New York, USA
| |
Collapse
|
16
|
Ryan JJ, Blacksmith JL, Kreiner DS, Glass Umfleet L. Use of the 21-Item Test with children and adolescents 5 to 16 years of age. APPLIED NEUROPSYCHOLOGY. CHILD 2018; 7:354-365. [PMID: 28707956 DOI: 10.1080/21622965.2017.1346507] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The goals of the present study were to: (a) collect preliminary normative data on the 21-Item Test in children and adolescents and to determine if cutoffs for biased responding in adults can be generalized to a younger population; (b) determine if Caucasian and Hispanic children perform differently on the test; and (c) ascertain the relationships of age and verbal intelligence with effort test performance. The 21-Item Test was administered to 153 children attending either a public (n = 96) or private (n = 57) school. The Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) was also administered to the private school sample. The results indicated that the 21-Item Test has potential as a tool for identifying children who do not put forth maximal effort during formal assessment and that the adult cutoffs appear applicable to children 8 years and older. Caucasian and Hispanic participants performed similarly on the test. Forced-choice scores ≤12 were associated with age and lower levels of performance on the Verbal Comprehension Index of the WISC-IV.
Collapse
Affiliation(s)
- Joseph J Ryan
- a Department of Psychological Science , University of Central Missouri , Warrensburg , Missouri
| | - Jennifer L Blacksmith
- a Department of Psychological Science , University of Central Missouri , Warrensburg , Missouri
| | - David S Kreiner
- a Department of Psychological Science , University of Central Missouri , Warrensburg , Missouri
| | | |
Collapse
|
17
|
Weiss SJ, Blackwell MC, Griffith KM, Jordan LS, Culotta VP. Performance validity testing in children and adolescents: A descriptive study comparing direct and embedded measures. APPLIED NEUROPSYCHOLOGY-CHILD 2017; 8:158-162. [PMID: 29286844 DOI: 10.1080/21622965.2017.1413982] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
Effort testing is a standard element in adult neuropsychological assessment. Research examining performance validity tests (PVTs) has focused on adults. The purpose of this descriptive study was to examine direct and embedded PVTs in children and adolescents. The Test of Memory Malingering (TOMM), a stand-alone PVT, was compared to two embedded measures of effort: California Verbal Learning Test-Children's Version/Second Edition (CVLT-C/II) Recognition Discriminability and Reliable Digit Span (RDS). The sample consisted of 119 children and adolescents referred for outpatient assessment. Cut-off scores used for PVTs were based on previous studies. Results revealed 3/119 failures on the TOMM, 14/119 failures on the RDS, and 34/119 failures on the CVLT-C/II. There was a significant difference between failures on the TOMM and the RDS, as well as between failures on the TOMM and the CVLT-C/II and the RDS and the CVLT-C/II. The results of this study demonstrate that PVTs commonly used with adults may require modifications, including adjusted cut-off scores, to be appropriate with children and adolescents. Results of this study also suggest that relying on more than one measure likely provides the most utility.
Collapse
Affiliation(s)
- Stephanie J Weiss
- a NeuroBehavioral Associates , Columbia , Maryland , USA.,b Loyola University Maryland , Psychology Department , Baltimore , Maryland
| | | | | | - Leslie S Jordan
- a NeuroBehavioral Associates , Columbia , Maryland , USA.,b Loyola University Maryland , Psychology Department , Baltimore , Maryland
| | | |
Collapse
|
18
|
Denning JH, Shura RD. Cost of malingering mild traumatic brain injury-related cognitive deficits during compensation and pension evaluations in the veterans benefits administration. APPLIED NEUROPSYCHOLOGY-ADULT 2017; 26:1-16. [DOI: 10.1080/23279095.2017.1350684] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- John H. Denning
- Department of Veteran Affairs, Mental Health Service, Ralph H. Johnson Veterans Affairs Medical Center, Charleston, South Carolina, USA
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, South Carolina, USA
| | - Robert D. Shura
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center, Salisbury, North Carolina, USA
- Mental Health and Behavioral Science Service Line, W. G. (Bill) Hefner Veterans Affairs Medical Center (VAMC), Salisbury, North Carolina, USA
- Department of Psychiatry and Behavioral Medicine, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA
| |
Collapse
|
19
|
Lupu T, Elbaum T, Wagner M, Braw Y. Enhanced detection of feigned cognitive impairment using per item response time measurements in the Word Memory Test. APPLIED NEUROPSYCHOLOGY-ADULT 2017; 25:532-542. [DOI: 10.1080/23279095.2017.1341410] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- T. Lupu
- Department of Psychology, Ariel University, Ariel, Israel
| | - T. Elbaum
- Department of Psychology, Ariel University, Ariel, Israel
| | - M. Wagner
- Department of Psychology, Ariel University, Ariel, Israel
| | - Y. Braw
- Department of Psychology, Ariel University, Ariel, Israel
| |
Collapse
|
20
|
The Importance of Performance Validity Assessment in Pediatric Neuropsychological Evaluations. JOURNAL OF PEDIATRIC NEUROPSYCHOLOGY 2017. [DOI: 10.1007/s40817-017-0031-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
21
|
Macciocchi SN, Seel RT, Yi A, Small S. Medical Symptom Validity Test Performance Following Moderate-Severe Traumatic Brain Injury: Expectations Based on Orientation Log Classification. Arch Clin Neuropsychol 2017; 32:339-348. [DOI: 10.1093/arclin/acw112] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 12/12/2016] [Indexed: 11/12/2022] Open
|
22
|
Lichtenstein JD, Erdodi LA, Linnea KS. Introducing a forced-choice recognition task to the California Verbal Learning Test – Children’s Version. Child Neuropsychol 2016; 23:284-299. [DOI: 10.1080/09297049.2015.1135422] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|