1
|
Crişan I, Erdodi L. Examining the cross-cultural validity of the test of memory malingering and the Rey 15-item test. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:721-731. [PMID: 35476611 DOI: 10.1080/23279095.2022.2064753] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
OBJECTIVE This study was designed to investigate the cross-cultural validity of two freestanding performance validity tests (PVTs), the Test of Memory Malingering - Trial 1 (TOMM-1) and the Rey Fifteen Item Test (Rey-15) in Romanian-speaking patients. METHODS The TOMM-1 and Rey-15 free recall (FR) and the combination score incorporating the recognition trial (COMB) were administered to a mixed clinical sample of 61 adults referred for cognitive evaluation, 24 of whom had external incentives to appear impaired. Average scores on PVTs were compared between the two groups. Classification accuracies were computed using one PVT against another. RESULTS Patients with identifiable external incentives to appear impaired produced significantly lower scores and more errors on validity indicators. The largest effect sizes emerged on TOMM-1 (Cohen's d = 1.00-1.19). TOMM-1 was a significant predictor of the Rey-15 COMB ≤20 (AUC = .80; .38 sensitivity; .89 specificity at a cutoff of ≤39). Similarly, both Rey-15 indicators were significant predictors of TOMM-1 at ≤39 as the criterion (AUCs = .73-.76; .33 sensitivity; .89-.90 specificity). CONCLUSION Results offer a proof of concept for the cross-cultural validity of the TOMM-1 and Rey-15 in a Romanian clinical sample.
Collapse
Affiliation(s)
- Iulia Crişan
- Department of Psychology, West University of Timişoara, Timişoara, Romania
| | - Laszlo Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
2
|
Varela JL, Ord AS, Phillips JI, Shura RD, Sautter SW. Preliminary evidence for digit span performance validity indicators within the neuropsychological assessment battery. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:818-824. [PMID: 35603608 DOI: 10.1080/23279095.2022.2076602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The purpose of this study was to evaluate multiple embedded performance validity indicators within the Digits Forward and Digits Backward subtests of the Neuropsychological Assessment Battery (NAB), including Reliable Digit Span (RDS), as no published papers have examined embedded digit span validity indicators within these subtests of the NAB. Retrospective archival chart review was conducted at an outpatient neuropsychology clinic. Participants were 92 adults (ages 19-68) who completed NAB Digits Forward and Digits Backward, and the Word Choice Test (WCT). Receiver operating characteristic (ROC) curves, t-tests, and sensitivity and specificity analyses were conducted. Analyses showed that RDS demonstrated acceptable classification accuracy between those who passed the WCT and those who did not. The area under the curve (AUC) value for RDS was 0.702; however, AUC values for all other digit span indices were unacceptably low. The optimal cutoff for RDS was identified (<8). RDS for the NAB appears to be an adequate indicator of performance validity; however, considering the very small number of participants who were invalid on the WCT (n = 15), as well as the utilization of only one stand-alone PVT to classify validity status, these findings are preliminary and in need of replication.
Collapse
Affiliation(s)
- Jacob L Varela
- College of Health and Behavioral Sciences, Regent University, Virginia Beach, VA, USA
| | - Anna S Ord
- College of Health and Behavioral Sciences, Regent University, Virginia Beach, VA, USA
- W.G. Hefner VA Medical Center, Salisbury, NC, USA
- Mid-Atlantic Mental Illness Research Education and Clinical Center, Durham, NC, USA
| | - Jacob I Phillips
- College of Health and Behavioral Sciences, Regent University, Virginia Beach, VA, USA
- Independent Private Practice, Virginia Beach, VA, USA
| | - Robert D Shura
- W.G. Hefner VA Medical Center, Salisbury, NC, USA
- Mid-Atlantic Mental Illness Research Education and Clinical Center, Durham, NC, USA
- Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Scott W Sautter
- College of Health and Behavioral Sciences, Regent University, Virginia Beach, VA, USA
- Independent Private Practice, Virginia Beach, VA, USA
| |
Collapse
|
3
|
Boskovic I, Akca AYE, Giromini L. Symptom coaching and symptom validity tests: An analog study using the structured inventory of malingered symptomatology, Self-Report Symptom Inventory, and Inventory of Problems-29. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:626-638. [PMID: 35414324 DOI: 10.1080/23279095.2022.2057856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
In this pilot and exploratory study, we tested the robustness of three self-report symptom validity tests (SVTs) to symptom coaching for depression, with and without additional information available on the Internet. Specifically, we divided our sample (N = 193) so that each subject received either the Structured Inventory of Malingered Symptomatology (SIMS; n = 64), the Self-Report Symptom Inventory (SRSI; n = 66), or the Inventory of Problems-29 (IOP-29; n = 63). Within each of the three subgroups, approximately one third of participants were instructed to respond honestly (Genuine Condition, nSIMS = 21; nSRSI = 24; nIOP-29 = 26) and approximately two-thirds were instructed to feign depression. One half of the feigners were presented with a vignette to increase their compliance with instructions and were given information about symptoms of depression (Coached Feigning, nSIMS = 25; nSRSI = 18; nIOP-29 = 21), and the other half were given the same vignette and information about symptoms of depression, plus two Internet links to review before completing the test (Internet-Coached Feigning, nSIMS = 18; nSRSI = 24; nIOP-29 = 16). Overall, the results showed that the genuine conditions yielded the lowest total scores on all three measures, while the two feigning conditions did not significantly differ from each other. Looking at the detection rates for all feigning participants, all three measures showed satisfactory results, with IOP-29 performing slightly better than SIMS and SIMS performing slightly better than SRSI. Internet-Coached Feigners scored slightly lower on all three measures than feigners who were coached without the Internet links. Taken together, the results of this preliminary and exploratory study suggest that all three SVTs examined are sensitive to feigned depression even in the presence of symptom coaching, both with and without additional Internet-based information.
Collapse
Affiliation(s)
- Irena Boskovic
- Forensic Psychology Section, Clinical Psychology Department, Erasmus School of Social and Behavioral Sciences, Erasmus University Rotterdam, Rotterdam, The Netherlands
- Forensic Psychology Section, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | | | | |
Collapse
|
4
|
Considine CM, Rossetti MA, Anderson K, Del Bene VA, Anderson SA, Celka AS, Edmondson MC, Sheese ALN, Piccolino A, Teixeira AL, Stout JC. Huntington study group's neuropsychology working group position on best practice recommendations for the clinical neuropsychological evaluation of patients with Huntington disease. Clin Neuropsychol 2024; 38:984-1006. [PMID: 37849335 DOI: 10.1080/13854046.2023.2267789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 10/02/2023] [Indexed: 10/19/2023]
Abstract
Objective: Neuropsychological evaluation is critical to detection and management of cognitive and neuropsychiatric changes associated with Huntington disease (HD). Accurate assessment of non-motor complications of HD is critical given the prominent impact on functional disability, frequently commensurate with or exceeding that of motor symptoms. The increasing emphasis on developing disease-modifying therapies targeting cognitive decline in HD requires consensus on clinical neuropsychological assessment methods. The Neuropsychology Working Group (NPWG) of the Huntington Study Group (HSG) sought to provide evidence and consensus-based, practical guidelines for the evaluation of cognitive and neuropsychiatric symptoms associated with HD. Method: The NPWG recruited a multi-disciplinary group of neuropsychologists, neurologists, and psychiatrists to inform best practices in assessing, diagnosing, and treating the non-motor symptoms in HD. A review was circulated among the NPWG, and in an iterative process informed by reviewed literature, best practices in neuropsychological evaluation of patients with HD were identified. Results: A brief review of the available literature and rational for a clinical consensus battery is offered. Conclusion: Clinical neuropsychologists are uniquely positioned to both detect and characterize the non-motor symptoms in HD, and further, provide neurologists and allied health professions with clinically meaningful information that impacts functional outcomes and quality of life. The NPWG provides guidance on best practices to clinical neuropsychologists in this statement. A companion paper operationalizing clinical application of previous research-based non-motor diagnostic criteria for HD is forthcoming, which also advises on non-motor symptom screening methods for the non-neuropsychologist working with HD.
Collapse
Affiliation(s)
- Ciaran M Considine
- Department of Neurology, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - M Agustina Rossetti
- Department of Neurology, University of Virginia School of Medicine, Charlottesville, VA, USA
| | - Kendra Anderson
- Department of Neurology, McGovern Medical School UT Health, The University of Texas Health Science Center, Houston, TX, USA
| | - Victor A Del Bene
- Department of Neurology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | - Sharlet A Anderson
- Department of Neurological Sciences, Rush University Medical Center, Chicago, IL, USA
| | - Andrea S Celka
- Department of Neurology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | | | - Amelia L Nelson Sheese
- Department of Neurological Sciences, University of Nebraska Medical Center College of Medicine, Omaha, NE, USA
| | - Adam Piccolino
- Psychology, Piccolino Psychological Services, Burnsville, MN, USA
| | - Antonio L Teixeira
- Department of Neurology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | - Julie C Stout
- Turner Institute for Brain and Mental Health, and School of Psychological Science, Monash University, Melbourne, Australia
| |
Collapse
|
5
|
Basso MR, Whiteside DM, Combs D. Introduction to the special issue on performance validity: what are we doing? What should we do? J Clin Exp Neuropsychol 2024; 46:1-5. [PMID: 38678395 DOI: 10.1080/13803395.2024.2347119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/30/2024]
|
6
|
Basso MR, Guzman D, Hoffmeister J, Mulligan R, Whiteside DM, Combs D. Use of perceptual memory as a performance validity indicator: initial validation with simulated mild traumatic brain injury. J Clin Exp Neuropsychol 2024; 46:55-66. [PMID: 38346160 DOI: 10.1080/13803395.2024.2314991] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Accepted: 01/21/2024] [Indexed: 05/12/2024]
Abstract
INTRODUCTION Many commonly employed performance validity tests (PVTs) are several decades old and vulnerable to compromise, leading to a need for novel instruments. Because implicit/non-declarative memory may be robust to brain damage, tasks that rely upon such memory may serve as an effective PVT. Using a simulation design, this experiment evaluated whether novel tasks that rely upon perceptual memory hold promise as PVTs. METHOD Sixty healthy participants were provided instructions to simulate symptoms of mild traumatic brain injury (TBI), and they were compared to a group of 20 honest responding individuals. Simulator groups received varying levels of information concerning TBI symptoms, resulting in naïve, sophisticated, and test-coached groups. The Word Memory Test, Test of Memory Malingering, and California Verbal Learning Test-II Forced Choice Recognition Test were administered. To assess perceptual memory, selected images from the Gollin Incomplete Figures and Mooney Closure Test were presented as visual perception tasks. After brief delays, memory for the images was assessed. RESULTS No group differences emerged on the perception trials of the Gollin and Mooney figures, but simulators remembered fewer images than the honest responders. Simulator groups differed on the standard PVTs, but they performed equivalently on the Gollin and Mooney figures, implying robustness to coaching. Relying upon a criterion of 90% specificity, the Gollin and Mooney figures achieved at least 90% sensitivity, comparing favorably to the standard PVTs. CONCLUSIONS The Gollin and Mooney figures hold promise as novel PVTs. As perceptual memory tests, they may be relatively robust to brain damage, but future research involving clinical samples is necessary to substantiate this assertion.
Collapse
Affiliation(s)
| | | | | | - Ryan Mulligan
- VA Central Western Massachusetts, Leeds, Massachusetts
| | | | | |
Collapse
|
7
|
Crișan I, Sava FA. Validity assessment in Eastern Europe: cross-validation of the Dot Counting Test and MODEMM against the TOMM-1 and Rey-15 in a Romanian mixed clinical sample. Arch Clin Neuropsychol 2023:acad085. [PMID: 37961918 DOI: 10.1093/arclin/acad085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 10/13/2023] [Accepted: 10/16/2023] [Indexed: 11/15/2023] Open
Abstract
OBJECTIVE This study investigated performance validity in the understudied Romanian clinical population by exploring classification accuracies of the Dot Counting Test (DCT) and the first Romanian performance validity test (PVT) (Memory of Objects and Digits and Evaluation of Memory Malingering/MODEMM) in a heterogeneous clinical sample. METHODS We evaluated 54 outpatients (26 females; MAge = 62.02; SDAge = 12.3; MEducation = 2.41, SDEducation = 2.82) with the Test of Memory Malingering 1 (TOMM-1), Rey Fifteen Items Test (Rey-15) (free recall and recognition trials), DCT, MODEMM, and MMSE/MoCA as part of their neuropsychological assessment. Accuracy parameters and base failure rates were computed for the DCT and MODEMM indicators against the TOMM-1 and Rey-15. Two patient groups were constructed according to psychometrically defined credible/noncredible performance (i.e., pass/fail both TOMM-1 and Rey-15). RESULTS Similar to other cultures, a cutoff of ≥18 on the DCT E score produced the best combination between sensitivity (0.50-0.57) and specificity (≥0.90). MODEMM indicators based on recognition accuracy, inconsistencies, and inclusion false positives generated 0.75-0.86 sensitivities at ≥0.90 specificities. Multivariable models of MODEMM indicators reached perfect sensitivities at ≥0.90 specificities against two PVTs. Patients who failed the TOMM-1 and Rey-15 were significantly more likely to fail the DCT and MODEMM than patients who passed both PVTs. CONCLUSIONS Our results offer proof of concept for the DCT's cross-cultural validity and the applicability of the MODEMM on Romanian clinical examinees, further recommending the use of heterogeneous validity indicators in clinical assessments.
Collapse
Affiliation(s)
- Iulia Crișan
- Department of Psychology, West University of Timișoara, Timișoara 300223, Romania
| | - Florin Alin Sava
- Department of Psychology, West University of Timişoara, Timișoara 300223, Romania
| |
Collapse
|
8
|
Crişan I, Sava FA, Maricuţoiu LP. Strategies of feigning mild head injuries related to validity indicators and types of coaching: Results of two experimental studies. APPLIED NEUROPSYCHOLOGY. ADULT 2023; 30:705-715. [PMID: 34510965 DOI: 10.1080/23279095.2021.1973004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE In this paper, we analyzed differences between uncoached, symptom-coached, and test-coached simulators regarding strategies of feigning mild head injuries. METHOD Healthy undergraduates (n = 67 in the first study; n = 48 in the second study), randomized into three simulator groups, were assessed with four experimental memory tests. In the first study, tests were administered face-to-face, while in the second study, the procedure was adapted for online testing. RESULTS Online simulators showed a different approach to testing than face-to-face participants (U tests < 920, p < .05). Nevertheless, both samples favored strategies like memory loss, error making, concentration difficulties, and slow responding. Except for slow responding and concentration difficulties, the favorite strategies correlated with validity indicators. In the first study, test-coached simulators (m = 4.58-5.68, SD = 2.2-3) used strategies less than uncoached participants (m = 5.25-5.88, SD = 2.26-2.84). In the second study, test-coached participants (m = 3.8-5.6, SD = 1.51-2.2) employed strategies less than uncoached (m = 6.21-7.29, SD = 1.25-1.85) and symptom-coached participants (m = 6.14-6.79, SD = 1.69-2.76). DISCUSSION Similarities and differences between online and face-to-face assessments are discussed. Recommendations to associate heterogeneous indicators for detecting feigning strategies are issued.
Collapse
Affiliation(s)
- Iulia Crişan
- Department of Psychology, West University of Timişoara, Timişoara, Romania
| | - Florin Alin Sava
- Department of Psychology, West University of Timişoara, Timişoara, Romania
| | | |
Collapse
|
9
|
Brooks BL, Fay-McClymont TB, MacAllister WS, Vasserman M, Mish S, Sherman EMS. New Child and Adolescent Memory Profile Embedded Performance Validity Test. ARCHIVES OF CLINICAL NEUROPSYCHOLOGY : THE OFFICIAL JOURNAL OF THE NATIONAL ACADEMY OF NEUROPSYCHOLOGISTS 2023:6972889. [PMID: 36617240 DOI: 10.1093/arclin/acac110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 12/14/2022] [Indexed: 01/09/2023]
Abstract
OBJECTIVE It is essential to interpret performance validity tests (PVTs) that are well-established and have strong psychometrics. This study evaluated the Child and Adolescent Memory Profile (ChAMP) Validity Indicator (VI) using a pediatric sample with traumatic brain injury (TBI). METHOD A cross-sectional sample of N = 110 youth (mean age = 15.1 years, standard deviation [SD] = 2.4 range = 8-18) on average 32.7 weeks (SD = 40.9) post TBI (71.8% mild/concussion; 3.6% complicated mild; 24.6% moderate-to-severe) were administered the ChAMP and two stand-alone PVTs. Criterion for valid performance was scores above cutoffs on both PVTs; criterion for invalid performance was scores below cutoffs on both PVTs. Classification statistics were used to evaluate the existing ChAMP VI and establish a new VI cutoff score if needed. RESULTS There were no significant differences in demographics or time since injury between those deemed valid (n = 96) or invalid (n = 14), but all ChAMP scores were significantly lower in those deemed invalid. The original ChAMP VI cutoff score was highly specific (no false positives) but also highly insensitive (sensitivity [SN] = .07, specificity [SP] = 1.0). Based on area under the curve (AUC) analysis (0.94), a new cutoff score was established using the sum of scaled scores (VI-SS). A ChAMP VI-SS score of 32 or lower achieved strong SN (86%) and SP (92%). Using a 15% base rate, positive predictive value was 64% and negative predictive value was 97%. CONCLUSIONS The originally proposed ChAMP VI has insufficient SN in pediatric TBI. However, this study yields a promising new ChAMP VI-SS, with classification metrics that exceed any other current embedded PVT in pediatrics.
Collapse
Affiliation(s)
- Brian L Brooks
- Neurosciences Program, Alberta Children's Hospital, Calgary, Alberta T3B 6A8, Canada.,Departments of Pediatrics, Clinical Neurosciences, and Psychology, University of Calgary, Calgary, Alberta T2N 1N4, Canada.,Child Brain and Mental Health Section, Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Alberta T2N 1N4, Canada
| | - Taryn B Fay-McClymont
- Neurosciences Program, Alberta Children's Hospital, Calgary, Alberta T3B 6A8, Canada.,Child Brain and Mental Health Section, Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Alberta T2N 1N4, Canada.,Department of Pediatrics, University of Calgary, Calgary, Alberta T2N 1N4, Canada.,Department of Psychology, University of British Columbia Okanagan, Kelowna, British Columbia V1V 1V7, Canada
| | - William S MacAllister
- Neurosciences Program, Alberta Children's Hospital, Calgary, Alberta T3B 6A8, Canada.,Child Brain and Mental Health Section, Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Alberta T2N 1N4, Canada.,Department of Pediatrics, University of Calgary, Calgary, Alberta T2N 1N4, Canada
| | - Marsha Vasserman
- Neurosciences Program, Alberta Children's Hospital, Calgary, Alberta T3B 6A8, Canada.,Child Brain and Mental Health Section, Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Alberta T2N 1N4, Canada.,Department of Pediatrics, University of Calgary, Calgary, Alberta T2N 1N4, Canada
| | - Sandra Mish
- Neurosciences Program, Alberta Children's Hospital, Calgary, Alberta T3B 6A8, Canada
| | | |
Collapse
|
10
|
Raudeberg R, Karr JE, Iverson GL, Hammar Å. Examining the repeatable battery for the assessment of neuropsychological status validity indices in people with schizophrenia spectrum disorders. Clin Neuropsychol 2023; 37:101-118. [PMID: 33522847 DOI: 10.1080/13854046.2021.1876169] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Objective: We examined the frequency of possible invalid test scores on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) in patients with schizophrenia spectrum disorders, and whether there was an association between scores on the embedded RBANS performance validity tests (PVTs) and self-reported symptoms of apathy as measured by the Initiate Scale of the Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A). Methods: Participants included 250 patients (M = 24.4 years-old, SD = 5.7) with schizophrenia spectrum disorders. Base rates of RBANS Effort Index (EI), Effort Scale (ES), and Performance Validity Index (PVI) test scores were computed. Spearman correlations were used to examine the associations between the RBANS PVTs, the RBANS Index scores, and the BRIEF-A Initiate Scale. Regression analyses were used to investigate how well the RBANS PVTs predicted scores on the BRIEF-A Initiate Scale. Results: The frequency of invalid scores on the EI (>3) and the PVI (<42) in participants with schizophrenia spectrum disorders was 6%. The frequency of invalid ES scores (<12) was 28% in the patients compared to 15% in the U.S. standardization sample. There was a small significant correlation between the EI and the BRIEF-A Initiate Scale (rho=.158, p<.05). Conclusions: The rates of invalid scores were similar to previously published studies. Invalid scores on the BRIEF-A were uncommon. Apathy measured with the BRIEF-A Initiate Scale was not associated with performance on the RBANS validity measures or with measures of cognition.
Collapse
Affiliation(s)
- Rune Raudeberg
- Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway
| | - Justin E Karr
- Department of Psychology, University of Kentucky, Lexington, Kentucky, USA
| | - Grant L Iverson
- Department of Physical Medicine and Rehabilitation, Harvard Medical School; Spaulding Rehabilitation Hospital and Spaulding Research Institute; & Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Charlestown, Massachusetts, USA
| | - Åsa Hammar
- Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway.,Division of Psychiatry, Haukeland University Hospital, Bergen, Norway
| |
Collapse
|
11
|
Kanser RJ, Logan PM, Steward KA, Vanderbleek EN, Kamper JE. Specificity of Embedded Performance Validity Tests in Elderly Veterans with Mild and Major Neurocognitive Disorder. ARCHIVES OF CLINICAL NEUROPSYCHOLOGY : THE OFFICIAL JOURNAL OF THE NATIONAL ACADEMY OF NEUROPSYCHOLOGISTS 2022:6964520. [PMID: 36578198 DOI: 10.1093/arclin/acac106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 12/03/2022] [Indexed: 12/30/2022]
Abstract
OBJECTIVE This study explored the specificity of four embedded performance validity tests (PVTs) derived from common neuropsychological tasks in a sample of older veterans with verified cognitive decline and whose performance was deemed valid by licensed psychologists. METHOD Participants were 180 veterans who underwent comprehensive neuropsychological evaluation, were determined to have valid performance following profile analysis/conceptualization, and were diagnosed with mild neurocognitive disorder (i.e., MCI; n = 64) or major neurocognitive disorder (i.e., Dementia; n = 116). All participants completed at least one of four embedded PVTs: Reliable Digit Span (RDS), California Verbal Learning Test-2nd ed. Short Form (CVLT-II SF) Forced choice, Trails B:A, and Delis-Kaplan Executive Function System (DKEFS) Letter and Category Fluency. RESULTS Adequate specificity (i.e., ≥90%) was achieved at modified cut-scores for all embedded PVTs across MCI and Dementia groups. Trails B:A demonstrated near perfect specificity at its traditional cut-score (Trails B:A < 1.5). RDS ≤ 5 and CVLT-II SF Forced Choice ≤7 led to <10% false positive classification errors across MCI and dementia groups. DKEFS Letter and Category Fluency achieved 90% specificity at extremely low normative cut-scores. CONCLUSIONS RDS, Trails B:A, and CVLT-II SF Forced Choice reflect promising embedded PVTs in the context of dementia evaluations. DKEFS Letter and Category Fluency appear too sensitive to genuine neurocognitive decline and, therefore, are inappropriate PVTs in adults with MCI or dementia. Additional research into embedded PVT sensitivity (via known-groups or analogue designs) in MCI and dementia is needed.
Collapse
Affiliation(s)
- Robert J Kanser
- Department of Physical Medicine and Rehabilitation, University of North Carolina School of Medicine, Chapel Hill, NC, USA.,Mental Health and Behavioral Science, James A. Haley Veterans' Hospital, Tampa, FL, USA
| | - Patrick M Logan
- Mental Health and Behavioral Science, James A. Haley Veterans' Hospital, Tampa, FL, USA.,Mental Health and Behavioral Science, Louisville VA Medical Center, Louisville, KY, USA
| | - Kayla A Steward
- Mental Health and Behavioral Science, James A. Haley Veterans' Hospital, Tampa, FL, USA
| | - Emily N Vanderbleek
- Mental Health and Behavioral Science, James A. Haley Veterans' Hospital, Tampa, FL, USA
| | - Joel E Kamper
- Mental Health and Behavioral Science, James A. Haley Veterans' Hospital, Tampa, FL, USA
| |
Collapse
|
12
|
Potts HE, Lewandowski LJ, Lovett BJ. Identifying Feigned ADHD in College Students: Comparing the Multidimensional ADHD Rating Scale to Established Validity Measures. J Atten Disord 2022; 26:1622-1630. [PMID: 35466735 DOI: 10.1177/10870547221092095] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
OBJECTIVE There is increased concern for malingering in ADHD evaluations due to presence of incentives such as accommodations and medications. Although several validity tests are available to classify malingering in non-ADHD populations, there is no test with proven effectiveness to detect feigned ADHD. This study investigated the ability of the MARS Symptom Validity Index 4 (MARS SV-index 4) and two published validity tests (the Word Memory Test [WMT] and Clinical Assessment of Attention Deficit-Adult [CAT-A] Infrequency scale) to detect malingered ADHD. METHOD The participants consisted of 68 young adults, 34 with ADHD. Participants completed the MARS, CAT-A, and WMT validity measures. RESULTS The MARS SV index-4 demonstrated higher sensitivity rates for simulated malingering (61.8%) at close to optimal specificity (88.2%) compared to two published tests (which had sensitivity <42% at specificity >90%). CONCLUSION The MARS shows good ability to detect feigned ADHD and appears to be useful for adult ADHD assessments.
Collapse
|
13
|
Profile of Embedded Validity Indicators in Criminal Defendants with Verified Valid Neuropsychological Test Performance. Arch Clin Neuropsychol 2022; 38:513-524. [DOI: 10.1093/arclin/acac073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 07/21/2022] [Accepted: 08/09/2022] [Indexed: 11/15/2022] Open
Abstract
Abstract
Objective
Few studies have examined the use of embedded validity indicators (EVIs) in criminal-forensic practice settings, where judgements regarding performance validity can carry severe consequences for the individual and society. This study sought to examine how various EVIs perform in criminal defendant populations, and determine relationships between EVI scores and intrapersonal variables thought to influence performance validity.
Method
Performance on 16 empirically established EVI cutoffs were examined in a sample of 164 criminal defendants with valid performance who were referred for forensic neuropsychological evaluation. Subsequent analyses examined the relationship between EVI scores and intrapersonal variables in 83 of these defendants.
Results
Half of the EVIs (within the Wechsler Adult Intelligence Scale Digit Span Total, Conners’ Continuous Performance Test Commissions, Wechsler Memory Scale Logical Memory I and II, Controlled Oral Word Association Test, Trail Making Test Part B, and Stroop Word and Color) performed as intended in this sample. The EVIs that did not perform as intended were significantly influenced by relevant intrapersonal variables, including below-average intellectual functioning and history of moderate–severe traumatic brain injury and neurodevelopmental disorder.
Conclusions
This study identifies multiple EVIs appropriate for use in criminal-forensic settings. However, based on these findings, practitioners may wish to be selective in choosing and interpreting EVIs for forensic evaluations of criminal court defendants.
Collapse
|
14
|
Ali S, Crisan I, Abeare CA, Erdodi LA. Cross-Cultural Performance Validity Testing: Managing False Positives in Examinees with Limited English Proficiency. Dev Neuropsychol 2022; 47:273-294. [PMID: 35984309 DOI: 10.1080/87565641.2022.2105847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Base rates of failure (BRFail) on performance validity tests (PVTs) were examined in university students with limited English proficiency (LEP). BRFail was calculated for several free-standing and embedded PVTs. All free-standing PVTs and certain embedded indicators were robust to LEP. However, LEP was associated with unacceptably high BRFail (20-50%) on several embedded PVTs with high levels of verbal mediation (even multivariate models of PVT could not contain BRFail). In conclusion, failing free-standing/dedicated PVTs cannot be attributed to LEP. However, the elevated BRFail on several embedded PVTs in university students suggest an unacceptably high overall risk of false positives associated with LEP.
Collapse
Affiliation(s)
- Sami Ali
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Iulia Crisan
- Department of Psychology, West University of Timişoara, Timişoara, Romania
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
15
|
Holcomb M, Pyne S, Cutler L, Oikle DA, Erdodi LA. Take Their Word for It: The Inventory of Problems Provides Valuable Information on Both Symptom and Performance Validity. J Pers Assess 2022:1-11. [PMID: 36041087 DOI: 10.1080/00223891.2022.2114358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Abstract
This study was designed to compare the validity of the Inventory of Problems (IOP-29) and its newly developed memory module (IOP-M) in 150 patients clinically referred for neuropsychological assessment. Criterion groups were psychometrically derived based on established performance and symptom validity tests (PVTs and SVTs). The criterion-related validity of the IOP-29 was compared to that of the Negative Impression Management scale of the Personality Assessment Inventory (NIMPAI) and the criterion-related validity of the IOP-M was compared to that of Trial-1 on the Test of Memory Malingering (TOMM-1). The IOP-29 correlated significantly more strongly (z = 2.50, p = .01) with criterion PVTs than the NIMPAI (rIOP-29 = .34; rNIM-PAI = .06), generating similar overall correct classification values (OCCIOP-29: 79-81%; OCCNIM-PAI: 71-79%). Similarly, the IOP-M correlated significantly more strongly (z = 2.26, p = .02) with criterion PVTs than the TOMM-1 (rIOP-M = .79; rTOMM-1 = .59), generating similar overall correct classification values (OCCIOP-M: 89-91%; OCCTOMM-1: 84-86%). Findings converge with the cumulative evidence that the IOP-29 and IOP-M are valuable additions to comprehensive neuropsychological batteries. Results also confirm that symptom and performance validity are distinct clinical constructs, and domain specificity should be considered while calibrating instruments.
Collapse
Affiliation(s)
| | | | - Laura Cutler
- Department of Psychology, Neuropsychology Track, University of Windsor
| | | | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor
| |
Collapse
|
16
|
Fox ME, King TZ. Considerations for Reliable Digit Span as a performance validity test for long-term survivors of childhood brain tumors. APPLIED NEUROPSYCHOLOGY. ADULT 2022; 29:469-477. [PMID: 32503366 DOI: 10.1080/23279095.2020.1771714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The Reliable Digit Span (RDS) is a performance validity test (PVT) used widely within non-clinical samples, but its utility is in question in clinical groups with cognitive impairment. To investigate, RDS scores were calculated and correlated with the Neurological Predictor Scale, an informant-reported Activities of Daily Living score, and a proxy measure of intelligence (Vocabulary) for 83 adult survivors of childhood brain tumors and 105 healthy controls. Analyses were covaried for age at examination. Participants were divided into passing and failing groups at each RDS cutoff, and ANCOVAs for each of the three variables of interest covaried for age at the examination were run. RDS was correlated with all three variables of interest in survivors but only Vocabulary in controls. At the ≤7 cutoff, passing and failing survivors demonstrated significant differences across all variables of interest, while passing and failing controls differed only on Vocabulary. Differences were also found between passing and failing survivors at lower cutoffs. RDS is related to and likely impacted by various neurological and cognitive challenges faced by brain tumor survivors. Using the standard RDS cutoff of ≤7 may result in inaccurate interpretation of valid performance in this population; therefore, the use of other PVTs is recommended.
Collapse
Affiliation(s)
| | - Tricia Z King
- Department of Psychology and the Neuroscience Institute, Georgia State University, Atlanta, GA, USA
| |
Collapse
|
17
|
Erdodi LA. Multivariate Models of Performance Validity: The Erdodi Index Captures the Dual Nature of Non-Credible Responding (Continuous and Categorical). Assessment 2022:10731911221101910. [PMID: 35757996 DOI: 10.1177/10731911221101910] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This study was designed to examine the classification accuracy of the Erdodi Index (EI-5), a novel method for aggregating validity indicators that takes into account both the number and extent of performance validity test (PVT) failures. Archival data were collected from a mixed clinical/forensic sample of 452 adults referred for neuropsychological assessment. The classification accuracy of the EI-5 was evaluated against established free-standing PVTs. The EI-5 achieved a good combination of sensitivity (.65) and specificity (.97), correctly classifying 92% of the sample. Its classification accuracy was comparable with that of another free-standing PVT. An indeterminate range between Pass and Fail emerged as a legitimate third outcome of performance validity assessment, indicating that the underlying construct is an inherently continuous variable. Results support the use of the EI model as a practical and psychometrically sound method of aggregating multiple embedded PVTs into a single-number summary of performance validity. Combining free-standing PVTs with the EI-5 resulted in a better separation between credible and non-credible profiles, demonstrating incremental validity. Findings are consistent with recent endorsements of a three-way outcome for PVTs (Pass, Borderline, and Fail).
Collapse
|
18
|
Jurick SM, Eglit GML, Delis DC, Bondi MW, Jak AJ. D-KEFS trail making test as an embedded performance validity measure. J Clin Exp Neuropsychol 2022; 44:62-72. [DOI: 10.1080/13803395.2022.2073334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- S. M. Jurick
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - G. M. L. Eglit
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - D. C. Delis
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - M. W. Bondi
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - A. J. Jak
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| |
Collapse
|
19
|
Ali S, Elliott L, Biss RK, Abumeeiz M, Brantuo M, Kuzmenka P, Odenigbo P, Erdodi LA. The BNT-15 provides an accurate measure of English proficiency in cognitively intact bilinguals - a study in cross-cultural assessment. APPLIED NEUROPSYCHOLOGY. ADULT 2022; 29:351-363. [PMID: 32449371 DOI: 10.1080/23279095.2020.1760277] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
This study was designed to replicate earlier reports of the utility of the Boston Naming Test - Short Form (BNT-15) as an index of limited English proficiency (LEP). Twenty-eight English-Arabic bilingual student volunteers were administered the BNT-15 as part of a brief battery of cognitive tests. The majority (23) were women, and half had LEP. Mean age was 21.1 years. The BNT-15 was an excellent psychometric marker of LEP status (area under the curve: .990-.995). Participants with LEP underperformed on several cognitive measures (verbal comprehension, visuomotor processing speed, single word reading, and performance validity tests). Although no participant with LEP failed the accuracy cutoff on the Word Choice Test, 35.7% of them failed the time cutoff. Overall, LEP was associated with an increased risk of failing performance validity tests. Previously published BNT-15 validity cutoffs had unacceptably low specificity (.33-.52) among participants with LEP. The BNT-15 has the potential to serve as a quick and effective objective measure of LEP. Students with LEP may need academic accommodations to compensate for slower test completion time. Likewise, LEP status should be considered for exemption from failing performance validity tests to protect against false positive errors.
Collapse
Affiliation(s)
- Sami Ali
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Lauren Elliott
- Behaviour-Cognition-Neuroscience Program, University of Windsor, Windsor, Canada
| | - Renee K Biss
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Mustafa Abumeeiz
- Behaviour-Cognition-Neuroscience Program, University of Windsor, Windsor, Canada
| | - Maame Brantuo
- Department of Psychology, University of Windsor, Windsor, Canada
| | | | - Paula Odenigbo
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|
20
|
Abstract
AbstractAre personality traits related to symptom overreporting and/or symptom underreporting? With this question in mind, we evaluated studies from 1979 to 2020 (k = 55), in which personality traits were linked to scores on stand-alone validity tests, including symptom validity tests (SVTs) and measures of socially desirable responding (SDR) and/or supernormality. As to symptom overreporting (k = 14), associations with depression, alexithymia, apathy, dissociation, and fantasy proneness varied widely from weak to strong (rs .27 to .79). For underreporting (k = 41), inconsistent links (rs − .43 to .63) were found with narcissism, whereas alexithymia and dissociation were often associated with lower SDR tendencies, although effect sizes were small. Taken together, the extant literature mainly consists of cross-sectional studies on single traits and contexts, mostly offering weak correlations that do not necessarily reflect causation. What this field lacks is an overarching theory relating traits to symptom reporting. Longitudinal studies involving a broad range of traits, samples, and incentives would be informative. Until such studies have been done, traits are best viewed as modest concomitants of symptom distortion.
Collapse
|
21
|
Nussbaum S, May N, Cutler L, Abeare CA, Watson M, Erdodi LA. Failing Performance Validity Cutoffs on the Boston Naming Test (BNT) Is Specific, but Insensitive to Non-Credible Responding. Dev Neuropsychol 2022; 47:17-31. [PMID: 35157548 DOI: 10.1080/87565641.2022.2038602] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
This study was designed to examine alternative validity cutoffs on the Boston Naming Test (BNT).Archival data were collected from 206 adults assessed in a medicolegal setting following a motor vehicle collision. Classification accuracy was evaluated against three criterion PVTs.The first cutoff to achieve minimum specificity (.87-.88) was T ≤ 35, at .33-.45 sensitivity. T ≤ 33 improved specificity (.92-.93) at .24-.34 sensitivity. BNT validity cutoffs correctly classified 67-85% of the sample. Failing the BNT was unrelated to self-reported emotional distress. Although constrained by its low sensitivity, the BNT remains a useful embedded PVT.
Collapse
Affiliation(s)
- Shayna Nussbaum
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Natalie May
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Laura Cutler
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Mark Watson
- Mark S. Watson Psychology Professional Corporation, Mississauga, ON, Canada
| | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
22
|
Boone KB, Sweet JJ, Byrd DA, Denney RL, Hanks RA, Kaufmann PM, Kirkwood MW, Larrabee GJ, Marcopulos BA, Morgan JE, Paltzer JY, Rivera Mindt M, Schroeder RW, Sim AH, Suhr JA. Official position of the American Academy of Clinical Neuropsychology on test security. Clin Neuropsychol 2022; 36:523-545. [DOI: 10.1080/13854046.2021.2022214] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Affiliation(s)
| | | | - Desiree A. Byrd
- Department of Psychiatry, Queens College and The Graduate Center, City University of New York, Queens, NY
| | - Robert L. Denney
- Missouri Memory Center, Citizens Memorial Healthcare, Bolivar, MO
| | - Robin A. Hanks
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
| | - Paul M. Kaufmann
- Office of the General Counsel, Health Law Section, University of Texas System, Austin, TX
| | - Michael W. Kirkwood
- Department of Physical Medicine and Rehabilitation, University of Colorado School of Medicine and Children’s Hospital Colorado, Aurora, CO
| | | | - Bernice A. Marcopulos
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- Department of Graduate Psychology, James Madison University, Harrisonburg, VA
| | - Joel E. Morgan
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- Independent Practice, Morristown, NJ
| | - June Yu Paltzer
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- Department of Neurology, UC Davis School of Medicine, Sacramento, CA
| | - Monica Rivera Mindt
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- Department of Psychology, Latin American Studies Institute, and African and African American Studies Icahn School of Medicine at Mount Sinai, Department of Neurology, Fordham University, Bronx, NY
| | - Ryan W. Schroeder
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- School of Medicine, University of Kansas, Wichita, KS
| | - Anita H. Sim
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- Minneapolis VA Health Care System, Minneapolis, MN
| | - Julie A. Suhr
- Department of Physical Medicine and Rehabilitation, Wayne State University School of Medicine, Detroit, MI
- Department of Psychology, Ohio University, Athens, OH
| |
Collapse
|
23
|
Lajiness-O'Neill R, Warschausky S, Huth-Bocks A, Taylor HG, Brooks J, Lukomski A, Raghunathan TE, Berglund P, Staples AD, Erdodi L, Schilling S. PediaTrac V.3.0 protocol: a prospective, longitudinal study of the development and validation of a web-based tool to measure and track infant and toddler development from birth through 18 months. BMJ Open 2021; 11:e050488. [PMID: 34949614 PMCID: PMC8705066 DOI: 10.1136/bmjopen-2021-050488] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Accepted: 11/18/2021] [Indexed: 12/11/2022] Open
Abstract
INTRODUCTION The need for an efficient, low-cost, comprehensive measure to track infant/toddler development and treatment outcomes is critical, given the importance of early detection and monitoring. This manuscript describes the protocol for the development and testing of a novel measure, PediaTrac, that collects longitudinal, prospective, multidomain data from parents/caregivers to characterise infant/toddler developmental trajectories in term and preterm infants. PediaTrac, a web-based measure, has the potential to become the standard method for monitoring development and detecting risk in infancy and toddlerhood. METHODS AND ANALYSES Using a multisite, prospective design, primarcaregivers will complete PediaTrac V.3.0, a survey tool that queries core domains of early development, including feeding/eating/elimination, sleep, sensorimotor, social/sensory information processing, social/communication/cognition and early relational health. Information also will be obtained about demographic, medical and environmental factors and embedded response bias indices are being developed as part of the measure. Using an approach that systematically measures infant/toddler developmental domains during a schedule that corresponds to well-child visits (newborn, 2, 4, 6, 9, 12, 15, 18 months), we will assess 360 caregiver/term infant dyads and 240 caregiver/preterm infant dyads (gestational age <37 weeks). Parameter estimates of our items and latent traits (eg, sensorimotor) will be estimated by theta using item response theory-graded response modelling. Participants also will complete legacy (ie, established) measures of development and caregiver health and functioning, used to provide evidence for construct (discriminant) validity. Predictive validity will be evaluated by examining relationships between the PediaTrac domains and the legacy measures in the total sample and in a subsample of 100 participants who will undergo a neurodevelopmental assessment at 24 months of age. ETHICS AND DISSEMINATION This investigation has single Institutional Review Board (IRB) multisite approval from the University of Michigan (IRB HUM00151584). The results will be presented at prominent conferences and published in peer-reviewed scientific journals.
Collapse
Affiliation(s)
- Renee Lajiness-O'Neill
- Psychology, Eastern Michigan University, Ypsilanti, Michigan, USA
- Physical Medicine and Rehabilitation, University of Michigan Michigan Medicine, Ann Arbor, Michigan, USA
| | - Seth Warschausky
- Physical Medicine and Rehabilitation, University of Michigan Michigan Medicine, Ann Arbor, Michigan, USA
| | - Alissa Huth-Bocks
- Pediatrics, University Hospitals Cleveland Medical Center, Cleveland, Ohio, USA
- Department of Pediatrics, Case Western Reserve University and Rainbow Babies & Children's Hospital, Cleveland, Ohio, USA
| | - H Gerry Taylor
- Department of Pediatrics, Case Western Reserve University and Rainbow Babies & Children's Hospital, Cleveland, Ohio, USA
- Department of Pediatrics, Nationwide Children's Hospital Research Institute and The Ohio State University, Columbus, Ohio, USA
| | - Judith Brooks
- Dietetics and Human Nutrition, Eastern Michigan University, Ypsilanti, Michigan, USA
| | - Angela Lukomski
- Nursing, Eastern Michigan University, Ypsilanti, Michigan, USA
| | - Trivellore Eachambadi Raghunathan
- Survey Research Center, Institute for Social Research, University of Michigan Institute for Social Research, Ann Arbor, Michigan, USA
| | - Patricia Berglund
- Survey Research Center, Institute for Social Research, University of Michigan Institute for Social Research, Ann Arbor, Michigan, USA
| | - Angela D Staples
- Psychology, Eastern Michigan University, Ypsilanti, Michigan, USA
| | - Laszlo Erdodi
- Psychology, University of Windsor, Windsor, Ontario, Canada
| | - Stephen Schilling
- Survey Research Center, Institute for Social Research, University of Michigan Institute for Social Research, Ann Arbor, Michigan, USA
| |
Collapse
|
24
|
Mulligan R, Basso MR, Hoffmeister J, Lau L, Whiteside DM, Combs D. Classification accuracy of the word memory test genuine memory impairment index. J Clin Exp Neuropsychol 2021; 43:655-662. [PMID: 34686108 DOI: 10.1080/13803395.2021.1988520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE The Word Memory Test (WMT) assesses non-credible performance in neuropsychological assessment. To mitigate risk of false positives among patients with severe cognitive dysfunction, the Genuine Memory Impairment Profile was derived. Only a modest number of investigations has evaluated classification accuracy among clinical samples, leaving the GMIP's accuracy largely uncertain. Accordingly, a simulation experiment evaluated the classification accuracy of the GMIP in a group of healthy individuals coached to simulate mild traumatic brain injury (TBI) related memory impairment on the WMT. PARTICIPANTS AND METHODS Eighty healthy individuals were randomly assigned to one of the four experimental groups. One group was provided superficial information concerning TBI symptoms (naïve simulators), another was provided extensive information concerning TBI symptoms (sophisticated simulators), and a third group was provided extensive TBI symptom information and tactics to evade detection by performance validity tests (PVT) (test-coached). An honest responding control group was directed to give their best performance. All participants were administered the California Verbal Learning Test-2 (CVLT-2) and the WMT. RESULTS Among the TBI simulators, 90% of the test-coached, 95% of the sophisticated simulators, and 100% of the naïve simulators were correctly classified as exaggerating memory impairment on the primary WMT indices. The simulator groups performed worse than the honest responding group on the CVLT-2. Of those who exceeded the WMT cutoffs, 60%, 27%, and 6% of the naïve-, sophisticated-, and test-coached simulators manifested the GMIP profile, respectively. CONCLUSIONS The GMIP is apt to misclassify individuals as having genuine memory impairment, especially if a naïve or unsophisticated effort is made to exert non-credible performance. Indeed, individuals who employ the least sophisticated efforts to exaggerate cognitive impairment appear most likely to manifest the GMIP. The GMIP should be used cautiously to discriminate genuine impairment from non-credible performance, especially among people with mild TBI.
Collapse
Affiliation(s)
- Ryan Mulligan
- Department of Psychology, University of Tulsa, Tulsa, US
| | - Michael R Basso
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, US
| | | | - Lily Lau
- Department of Psychology, University of Tulsa, Tulsa, US
| | - Douglas M Whiteside
- Department of Rehabilitation Medicine, University of Minnesota, Minneapolis, US
| | - Dennis Combs
- Department of Psychology, University of Texas, Austin, US
| |
Collapse
|
25
|
Dunn A, Pyne S, Tyson B, Roth R, Shahein A, Erdodi L. Critical Item Analysis Enhances the Classification Accuracy of the Logical Memory Recognition Trial as a Performance Validity Indicator. Dev Neuropsychol 2021; 46:327-346. [PMID: 34525856 DOI: 10.1080/87565641.2021.1956499] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE : Replicate previous research on Logical Memory Recognition (LMRecog) and perform a critical item analysis. METHOD : Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LMRecog and nine critical items (CR-9) was computed. RESULTS : LMRecog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LMRecog ≤20; CR-9 ≥6 increased specificity by 6-8% over LMRecog ≤20; CR-9 ≥7 increased specificity by 8-15%. CONCLUSIONS : Critical item analysis enhances the classification accuracy of the optimal LMRecog cutoff (≤20).
Collapse
Affiliation(s)
- Alexa Dunn
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Sadie Pyne
- Windsor Neuropsychology, Windsor, Canada
| | - Brad Tyson
- Neuroscience Institute, Evergreen Neuroscience Institute, EvergreenHealth Medical Center, Kirkland, USA
| | - Robert Roth
- Neuropsychology Services, Dartmouth-Hitchcock Medical Center, USA
| | - Ayman Shahein
- Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | - Laszlo Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|
26
|
Erdodi LA. Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. NeuroRehabilitation 2021; 49:179-213. [PMID: 34420986 DOI: 10.3233/nre-218020] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE This study was designed to empirically investigate the signal detection profile of various multivariate models of performance validity tests (MV-PVTs) and explore several contested assumptions underlying validity assessment in general and MV-PVTs specifically. METHOD Archival data were collected from 167 patients (52.4%male; MAge = 39.7) clinicially evaluated subsequent to a TBI. Performance validity was psychometrically defined using two free-standing PVTs and five composite measures, each based on five embedded PVTs. RESULTS MV-PVTs had superior classification accuracy compared to univariate cutoffs. The similarity between predictor and criterion PVTs influenced signal detection profiles. False positive rates (FPR) in MV-PVTs can be effectively controlled using more stringent multivariate cutoffs. In addition to Pass and Fail, Borderline is a legitimate third outcome of performance validity assessment. Failing memory-based PVTs was associated with elevated self-reported psychiatric symptoms. CONCLUSIONS Concerns about elevated FPR in MV-PVTs are unsubstantiated. In fact, MV-PVTs are psychometrically superior to individual components. Instrumentation artifacts are endemic to PVTs, and represent both a threat and an opportunity during the interpretation of a given neurocognitive profile. There is no such thing as too much information in performance validity assessment. Psychometric issues should be evaluated based on empirical, not theoretical models. As the number/severity of embedded PVT failures accumulates, assessors must consider the possibility of non-credible presentation and its clinical implications to neurorehabilitation.
Collapse
|
27
|
Messa I, Holcomb M, Lichtenstein JD, Tyson BT, Roth RM, Erdodi LA. They are not destined to fail: a systematic examination of scores on embedded performance validity indicators in patients with intellectual disability. AUST J FORENSIC SCI 2021. [DOI: 10.1080/00450618.2020.1865457] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Affiliation(s)
- Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | | | | | - Brad T Tyson
- Neuropsychological Service, EvergreenHealth Medical Center, Kirkland, WA, USA
| | - Robert M Roth
- Department of Psychiatry, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
28
|
Abeare CA, An K, Tyson B, Holcomb M, Cutler L, May N, Erdodi LA. The emotion word fluency test as an embedded performance validity indicator - Alone and in a multivariate validity composite. APPLIED NEUROPSYCHOLOGY. CHILD 2021; 11:713-724. [PMID: 34424798 DOI: 10.1080/21622965.2021.1939027] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
OBJECTIVE This project was designed to cross-validate existing performance validity cutoffs embedded within measures of verbal fluency (FAS and animals) and develop new ones for the Emotion Word Fluency Test (EWFT), a novel measure of category fluency. METHOD The classification accuracy of the verbal fluency tests was examined in two samples (70 cognitively healthy university students and 52 clinical patients) against psychometrically defined criterion measures. RESULTS A demographically adjusted T-score of ≤31 on the FAS was specific (.88-.97) to noncredible responding in both samples. Animals T ≤ 29 achieved high specificity (.90-.93) among students at .27-.38 sensitivity. A more conservative cutoff (T ≤ 27) was needed in the patient sample for a similar combination of sensitivity (.24-.45) and specificity (.87-.93). An EWFT raw score ≤5 was highly specific (.94-.97) but insensitive (.10-.18) to invalid performance. Failing multiple cutoffs improved specificity (.90-1.00) at variable sensitivity (.19-.45). CONCLUSIONS Results help resolve the inconsistency in previous reports, and confirm the overall utility of existing verbal fluency tests as embedded validity indicators. Multivariate models of performance validity assessment are superior to single indicators. The clinical utility and limitations of the EWFT as a novel measure are discussed.
Collapse
Affiliation(s)
- Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| | - Kelly An
- Private Practice, London, Ontario, Canada
| | - Brad Tyson
- Evergreen Health Medical Center, Kirkland, Washington, USA
| | - Matthew Holcomb
- Jefferson Neurobehavioral Group, New Orleans, Louisiana, USA
| | - Laura Cutler
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| | - Natalie May
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| |
Collapse
|
29
|
Kanser R, O'Rourke J, Silva MA. Performance validity testing via telehealth and failure rate in veterans with moderate-to-severe traumatic brain injury: A veterans affairs TBI model systems study. NeuroRehabilitation 2021; 49:169-177. [PMID: 34397429 DOI: 10.3233/nre-218019] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND The COVID-19 pandemic has led to increased utilization of teleneuropsychology (TeleNP) services. Unfortunately, investigations of performance validity tests (PVT) delivered via TeleNP are sparse. OBJECTIVE The purpose of this study was to examine the specificity of the Reliable Digit Span (RDS) and 21-item test administered via telephoneMETHOD:Participants were 51 veterans with moderate-to-severe traumatic brain injury (TBI). All participants completed the RDS and 21-item test in the context of a larger TeleNP battery. Specificity rates were examined across multiple cutoffs for both PVTs. RESULTS Consistent with research employing traditional face-to-face neuropsychological evaluations, both PVTs maintained adequate specificity (i.e., > 90%) across previously established cutoffs. Specifically, defining performance invalidity as RDS < 7 or 21-item test forced choice total correct < 11 led to < 10%false positive classification errors. CONCLUSIONS Findings add to the limited body of research examining and provide preliminary support for the use of the RDS and 21-item test in TeleNP via telephone. Both measures maintained adequate specificity in veterans with moderate-to-severe TBI. Future investigations including clinical or experimental "feigners" in a counter-balanced cross-over design (i.e., face-to-face vs. TeleNP) are recommended.
Collapse
Affiliation(s)
- Robert Kanser
- Mental Health & Behavioral Sciences Section (MHBSS), James A. Haley Veterans' Hospital, Tampa, FL, USA
| | - Justin O'Rourke
- Polytrauma Section, Audie L. Murphy Memorial Veterans' Hospital, San Antonio, TX, USA
| | - Marc A Silva
- Mental Health & Behavioral Sciences Section (MHBSS), James A. Haley Veterans' Hospital, Tampa, FL, USA.,Department of Internal Medicine, University of South Florida, Tampa, FL, USA.,Department of Psychiatry and Behavioral Neurosciences, University of South Florida, Tampa, FL, USA.,Department of Psychology, University of South Florida, Tampa, FL, USA
| |
Collapse
|
30
|
The Multi-Level Pattern Memory Test (MPMT): Initial Validation of a Novel Performance Validity Test. Brain Sci 2021; 11:brainsci11081039. [PMID: 34439658 PMCID: PMC8393330 DOI: 10.3390/brainsci11081039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Revised: 07/30/2021] [Accepted: 08/01/2021] [Indexed: 11/16/2022] Open
Abstract
Performance validity tests (PVTs) are used for the detection of noncredible performance in neuropsychological assessments. The aim of the study was to assess the efficacy (i.e., discrimination capacity) of a novel PVT, the Multi-Level Pattern Memory Test (MPMT). It includes stages that allow profile analysis (i.e., detecting noncredible performance based on an analysis of participants' performance across stages) and minimizes the likelihood that it would be perceived as a PVT by examinees. In addition, it utilizes nonverbal stimuli and is therefore more likely to be cross-culturally valid. In Experiment 1, participants that were instructed to simulate cognitive impairment performed less accurately than honest controls in the MPMT (n = 67). Importantly, the MPMT has shown an adequate discrimination capacity, though somewhat lower than an established PVT (i.e., Test of Memory Malingering-TOMM). Experiment 2 (n = 77) validated the findings of the first experiment while also indicating a dissociation between the simulators' objective performance and their perceived cognitive load while performing the MPMT. The MPMT and the profile analysis based on its outcome measures show initial promise in detecting noncredible performance. It may, therefore, increase the range of available PVTs at the disposal of clinicians, though further validation in clinical settings is mandated. The fact that it is an open-source software will hopefully also encourage the development of research programs aimed at clarifying the cognitive processes involved in noncredible performance and the impact of PVT characteristics on clinical utility.
Collapse
|
31
|
Potts HE, Lewandowski LJ, Lovett BJ. The Multidimensional ADHD Rating Scale: A measure of symptoms, impairment, and symptom validity. J Clin Exp Neuropsychol 2021; 43:426-436. [PMID: 34233579 DOI: 10.1080/13803395.2021.1942795] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Objective: Two studies examined the psychometric properties of the Multidimensional ADHD Rating Scale (MARS), which assesses ADHD symptoms, related functional impairment, and symptom validity (SV). Method: Study 1 used MARS item responses from college students with and without ADHD (with some of the latter group assigned to feign ADHD) to create an SV-index, and to identify optimal cut scores for the clinical (symptom and impairment) indexes. Study 2 cross-validated the findings on a new sample. Results: In both studies, malingerers reported more symptoms and impairment than participants with ADHD, who reported more symptoms and impairment than controls. Receiver operating characteristic analyses found very good discrimination of genuine ADHD from control cases by the clinical MARS indexes, and very good discrimination of genuine ADHD from malingered ADHD by the SV-index. Conclusion: This research provides initial support for the effectiveness of the MARS to detect simulated cases of malingering, and to differentiate ADHD from non-ADHD cases in college students.
Collapse
Affiliation(s)
- Heather E Potts
- Department of Psychiatry, Boston Children's Hospital, Boston, MA, USA
| | | | - Benjamin J Lovett
- School Psychology Program, Teachers College, Columbia University, New York, NY, USA
| |
Collapse
|
32
|
Boskovic I, Merten T, Merckelbach H. How Plausible Is the Implausible? Students’ Plausibility and Prevalence Ratings of the Self-Report Symptom Inventory. PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09409-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
AbstractSome self-report symptom validity tests, such as the Self-Report Symptom Inventory (SRSI), rely on a detection strategy that uses bizarre, extreme, or very rare symptoms. Thus, items are constructed to invite respondents with an invalid response style to affirm pseudosymptoms that are usually not experienced by genuine patients. However, these pseudosymptoms should not be easily recognizable, because otherwise sophisticated over-reporters could strategically avoid them and go undetected. Therefore, we tested how well future psychology professionals were able to differentiate between genuine complaints and pseudosymptoms in terms of their plausibility and prevalence.Psychology students (N = 87) received the items of the SRSI online and were given the task to rate each item as to its plausibility and prevalence in the community.Students evaluated genuine symptoms as significantly more plausible and more prevalent than pseudosymptoms. However, 56% of students rated pseudosymptoms as moderately plausible, whereas 17% rated them as moderately prevalent in the general public.Overall, it appears that psychology students are successful in distinguishing bizarre, unusual, or rare symptoms from genuine complaints. Yet, the majority of students still attributed relatively high prima facie plausibility to pseudosymptoms. We contend that if such a trusting attitude is true for psychology students, it may also be the case for young psychology practitioners, which, consequently, may diminish the probability of employing self-report validity measures in psychological assessments.
Collapse
|
33
|
Varela JL, Ord AS, Phillips JI, Shura RD, Sautter SW. The Development and Validation of the Embedded Validity Indicator for the Neuropsychological Assessment Battery. Arch Clin Neuropsychol 2021; 37:133-145. [PMID: 33876179 DOI: 10.1093/arclin/acab025] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/31/2021] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE The purpose of this study was to develop and validate an embedded measure of performance validity within the Neuropsychological Assessment Battery (NAB). METHOD This study involved a retrospective chart review at an outpatient neuropsychology clinic. Participants were 183 adults (ages 18-70) who completed the attention and memory modules of the NAB, as well as the Word Choice Test, Green's Medical Symptom Validity Test (MSVT), and Green's Non-Verbal MSVT, as part of a clinical neuropsychological assessment (n = 147) or as part of a forensic neuropsychological evaluation (n = 36). Replicating methodology utilized by Silverberg et al. (2007) for the development of the Effort Index within the Repeatable Battery for the Assessment of Neuropsychological Status, an Embedded Validity Indictor (EVI) for the NAB was developed in the present study based on Digits Forward and List Learning Long Delayed Forced-Choice Recognition (list recognition) subtests. RESULTS Receiver operating characteristic curve analyses indicated the newly developed NAB EVI was able to significantly differentiate between valid and invalid status on stand-alone performance-validity tests, with area under the curve values ranging from 0.797 to 0.977. Optimal cutoffs for medical, forensic, and mixed samples were identified. CONCLUSIONS The newly developed NAB EVI shows promise as an embedded performance validity measure; however, due to moderate sensitivity, it should be used in combination with stand-alone performance validity tests to detect invalid performance.
Collapse
Affiliation(s)
- Jacob L Varela
- School of Psychology and Counseling, Regent University, Virginia Beach, VA 23464, USA
| | - Anna S Ord
- School of Psychology and Counseling, Regent University, Virginia Beach, VA 23464, USA.,Research & Academic Affairs Service Line, W. G. Hefner VA Medical Center, Salisbury, NC 28144, USA.,Mid-Atlantic Mental Illness Research, Education, and Clinical Center, Durham, NC 27707, USA.,Department of Neurology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Jacob I Phillips
- School of Psychology and Counseling, Regent University, Virginia Beach, VA 23464, USA.,Independent Private Practice, Virginia Beach, VA 23451, USA
| | - Robert D Shura
- Research & Academic Affairs Service Line, W. G. Hefner VA Medical Center, Salisbury, NC 28144, USA.,Mid-Atlantic Mental Illness Research, Education, and Clinical Center, Durham, NC 27707, USA.,Department of Neurology, Wake Forest School of Medicine, Winston-Salem, NC 27101, USA
| | - Scott W Sautter
- School of Psychology and Counseling, Regent University, Virginia Beach, VA 23464, USA.,Independent Private Practice, Virginia Beach, VA 23451, USA
| |
Collapse
|
34
|
Abeare K, Razvi P, Sirianni CD, Giromini L, Holcomb M, Cutler L, Kuzmenka P, Erdodi LA. Introducing Alternative Validity Cutoffs to Improve the Detection of Non-credible Symptom Report on the BRIEF. PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09402-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
35
|
Sabelli AG, Messa I, Giromini L, Lichtenstein JD, May N, Erdodi LA. Symptom Versus Performance Validity in Patients with Mild TBI: Independent Sources of Non-credible Responding. PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09400-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
36
|
Carvalho LDF, Reis A, Colombarolli MS, Pasian SR, Miguel FK, Erdodi LA, Viglione DJ, Giromini L. Discriminating Feigned from Credible PTSD Symptoms: a Validation of a Brazilian Version of the Inventory of Problems-29 (IOP-29). PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09403-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
37
|
Cutler L, Abeare CA, Messa I, Holcomb M, Erdodi LA. This will only take a minute: Time cutoffs are superior to accuracy cutoffs on the forced choice recognition trial of the Hopkins Verbal Learning Test - Revised. APPLIED NEUROPSYCHOLOGY-ADULT 2021; 29:1425-1439. [PMID: 33631077 DOI: 10.1080/23279095.2021.1884555] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
OBJECTIVE This study was designed to evaluate the classification accuracy of the recently introduced forced-choice recognition trial to the Hopkins Verbal Learning Test - Revised (FCRHVLT-R) as a performance validity test (PVT) in a clinical sample. Time-to-completion (T2C) for FCRHVLT-R was also examined. METHOD Forty-three students were assigned to either the control or the experimental malingering (expMAL) condition. Archival data were collected from 52 adults clinically referred for neuropsychological assessment. Invalid performance was defined using expMAL status, two free-standing PVTs and two validity composites. RESULTS Among students, FCRHVLT-R ≤11 or T2C ≥45 seconds was specific (0.86-0.93) to invalid performance. Among patients, an FCRHVLT-R ≤11 was specific (0.94-1.00), but relatively insensitive (0.38-0.60) to non-credible responding0. T2C ≥35 s produced notably higher sensitivity (0.71-0.89), but variable specificity (0.83-0.96). The T2C achieved superior overall correct classification (81-86%) compared to the accuracy score (68-77%). The FCRHVLT-R provided incremental utility in performance validity assessment compared to previously introduced validity cutoffs on Recognition Discrimination. CONCLUSIONS Combined with T2C, the FCRHVLT-R has the potential to function as a quick, inexpensive and effective embedded PVT. The time-cutoff effectively attenuated the low ceiling of the accuracy scores, increasing sensitivity by 19%. Replication in larger and more geographically and demographically diverse samples is needed before the FCRHVLT-R can be endorsed for routine clinical application.
Collapse
Affiliation(s)
- Laura Cutler
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Isabelle Messa
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | | | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
38
|
Blair M, Goveas D, Safi A, Marshall C, Rosehart H, Orenczuk S, Morrow SA. Does cognitive training improve attention/working memory in persons with MS? A pilot study using the Cogmed Working Memory Training program. Mult Scler Relat Disord 2021; 49:102770. [PMID: 33497850 DOI: 10.1016/j.msard.2021.102770] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 01/06/2021] [Accepted: 01/14/2021] [Indexed: 10/22/2022]
Abstract
BACKGROUND Cognitive deficits, especially in attention, are common in persons with MS (PwMS) and are associated with clinically meaningful outcomes, such as work disability and lower quality of life (QOL). In this study, we aimed to determine whether Cogmed Working Memory Training (CWMT) improves attention/working memory in PwMS displaying impairment in these domains. METHODS This single blind, randomized controlled, pilot study compared the effects of CWMT, a five-week evidenced-based computer-assisted training program that is supported by weekly meetings with a coach, to standard medical care (treatment as usual). We recruited PwMS from one MS center (London (ON) Canada), aged 18-64, with an Expanded Disability Status Scale (EDSS) score of ≤ 7.0, and a visual acuity (corrected) of at least 20/70. Potential subjects had to demonstrate impaired attention on at least two of three measures (Paced Auditory Serial Addition Test [PASAT], Symbol Digit Modalities Test [SDMT], and/or DKEFS Color-Word Interference Test); these measures also served as the primary study outcomes. Subjects were randomized to either the CWMT or treatment as usual. Secondary cognitive outcomes included other measures of attention, memory, as well as a self-reported cognitive function measure. Self-reported measures of mood (depression and anxiety), pain, and QOL were also included as other secondary outcomes. Subjects received assessments at baseline, post-treatment, and 6-month follow-up, or an equivalent time period for the treatment as usual group. The two groups were compared at baseline on background measures using independent samples t-tests, Chi-Square tests, and Mann-Whitney U tests. To analyze primary and secondary outcomes, a non-parametric approach was used due the small sample size and that many of our outcomes did not meet assumptions for parametric analyses. Friedman's test was conducted followed by post hoc pairwise comparisons within each group using Wilcoxon Signed-Rank tests with Bonferroni corrected post hoc contrasts, which allowed us to examine for differences between time points. RESULTS Of 30 subjects, 15 were assigned to CWMT. Significant training effects were noted in 1 of 3 primary attentional outcomes (DKEFS Color-Word Interference Test), 2 of 3 secondary attentional outcomes (Letter-Number Sequencing, Digit Span), and 1 mood scale (Hospital Anxiety and Depression scale (HADS) - Depression Subscale), ps < .025. No significant changes were observed in the treatment as usual group. CONCLUSION This pilot study demonstrates that cognitive training with CWMT has the potential to improve attention/working memory in PwMS, as well as a potential positive effect on mood, in PwMS. Further exploration of this intervention in PwMS with attention/working memory impairment is warranted.
Collapse
Affiliation(s)
- Mervin Blair
- Lawson Health Research Institute, Clinical Neuropsychiatry & Therapeutic Brain Stimulation Research, Ontario Shores Centre for Mental Health Sciences, 550 Wellington Rd, London, ON, Canada
| | - Daphne Goveas
- Lawson Health Research Institute, Clinical Neuropsychiatry & Therapeutic Brain Stimulation Research, Ontario Shores Centre for Mental Health Sciences, 550 Wellington Rd, London, ON, Canada
| | - Ajmal Safi
- Lawson Health Research Institute, Clinical Neuropsychiatry & Therapeutic Brain Stimulation Research, Ontario Shores Centre for Mental Health Sciences, 550 Wellington Rd, London, ON, Canada
| | - Connie Marshall
- Parkwood Institute, Rehabilitation Program, 550 Wellington Rd, London, ON, Canada
| | - Heather Rosehart
- Western University, Department of Clinical Neurological Sciences and, Parkwood Institute, Department of Cognitive Neurology London Health Sciences Center, London, ON Canada
| | - Steven Orenczuk
- Parkwood Institute, Veterans Care Program, 550 Wellington Rd, London, ON, Canada
| | - Sarah A Morrow
- Western University, Department of Clinical Neurological Sciences and, Parkwood Institute, Department of Cognitive Neurology London Health Sciences Center, London, ON Canada.
| |
Collapse
|
39
|
Feigning memory impairment in a forced-choice task: Evidence from event-related potentials. Int J Psychophysiol 2020; 158:190-200. [PMID: 33086099 DOI: 10.1016/j.ijpsycho.2020.10.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Revised: 09/28/2020] [Accepted: 10/09/2020] [Indexed: 11/23/2022]
Abstract
Strategies of malingering detection have brought about a wealth of neuropsychological studies in the last decades. However, the investigation of physiological measures to reliably differentiate between authentic and manipulated symptom presentations is still in its infancy. The present study examined event-related potentials (ERP) to identify feigned memory impairment. We tested instructed malingerers (n = 25) and control participants (n = 22) with a recognition task similar to the Test of Memory Malingering. No differences between groups were found for P1 (70-110 ms) but for N1 (120-170 ms) and P300 components, with lower amplitudes for instructed malingerers. Behavioral data showed a typical pattern of unrealistically high errors in a forced-choice recognition task and less overall recalled stimuli in instructed malingerers. We also found study-phase repetition and old/new effects in the P300, but no interactions with groups (control vs. malingering). Post-hoc analyses revealed that the P300 effect is greater when participants reported an attention-based faking strategy, as opposed to response-based malingerers and controls. The employment of physiological measures can yield additional information on the validity of test data without the need to perform additional tests.
Collapse
|
40
|
Patterns of Cognitive Test Scores and Symptom Complaints in Persons with TBI Who Failed Performance Validity Testing. J Int Neuropsychol Soc 2020; 26:932-938. [PMID: 32456725 PMCID: PMC7554049 DOI: 10.1017/s1355617720000351] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE To determine clinically meaningful subgroups of persons with traumatic brain injury (TBI) who have failed performance validity testing. METHOD Study participants were selected from a cohort of 674 participants with definitive medical evidence of TBI. Participants were those who failed performance validity testing (the Word Memory Test, using the standard cutoffs). Participants were administered cognitive tests and self-report questionnaires. Test and questionnaire results were summarized as 12 dimension scores. Cluster analysis using the k-means method was performed. RESULTS Cluster analysis for the 143 retained participants indicated three subgroups. These subgroups differed on patterns of scores. Subgroup 1 was impaired for memory and had no excessive complaints. Subgroup 2 had impaired memory and processing speed as well as concern regarding cognition function. Subgroup 3 showed impairment on all cognitive tests and excess complaints in multiple areas. CONCLUSIONS These results provide a preliminary basis for improved understanding of poor performance validity.
Collapse
|
41
|
Erdodi LA, Abeare CA. Stronger Together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain Injury. Arch Clin Neuropsychol 2020; 35:188-204. [PMID: 31696203 DOI: 10.1093/arclin/acz032] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 06/18/2019] [Accepted: 06/22/2019] [Indexed: 12/17/2022] Open
Abstract
OBJECTIVE This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV). METHOD Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance. RESULTS Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91-.95) over univariate cutoffs (.78-.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43-.67) compared to univariate cutoffs (.11-.63) while maintaining consistently high specificity (.93-.95). CONCLUSIONS In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment. BRIEF SUMMARY Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment.
Collapse
Affiliation(s)
- Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
42
|
Sherman EMS, Slick DJ, Iverson GL. Multidimensional Malingering Criteria for Neuropsychological Assessment: A 20-Year Update of the Malingered Neuropsychological Dysfunction Criteria. Arch Clin Neuropsychol 2020; 35:735-764. [PMID: 32377667 PMCID: PMC7452950 DOI: 10.1093/arclin/acaa019] [Citation(s) in RCA: 152] [Impact Index Per Article: 38.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Accepted: 03/12/2020] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVES Empirically informed neuropsychological opinion is critical for determining whether cognitive deficits and symptoms are legitimate, particularly in settings where there are significant external incentives for successful malingering. The Slick, Sherman, and Iversion (1999) criteria for malingered neurocognitive dysfunction (MND) are considered a major milestone in the field's operationalization of neurocognitive malingering and have strongly influenced the development of malingering detection methods, including serving as the criterion of malingering in the validation of several performance validity tests (PVTs) and symptom validity tests (SVTs) (Slick, D.J., Sherman, E.M.S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545-561). However, the MND criteria are long overdue for revision to address advances in malingering research and to address limitations identified by experts in the field. METHOD The MND criteria were critically reviewed, updated with reference to research on malingering, and expanded to address other forms of malingering pertinent to neuropsychological evaluation such as exaggeration of self-reported somatic and psychiatric symptoms. RESULTS The new proposed criteria simplify diagnostic categories, expand and clarify external incentives, more clearly define the role of compelling inconsistencies, address issues concerning PVTs and SVTs (i.e., number administered, false positives, and redundancy), better define the role of SVTs and of marked discrepancies indicative of malingering, and most importantly, clearly define exclusionary criteria based on the last two decades of research on malingering in neuropsychology. Lastly, the new criteria provide specifiers to better describe clinical presentations for use in neuropsychological assessment. CONCLUSIONS The proposed multidimensional malingering criteria that define cognitive, somatic, and psychiatric malingering for use in neuropsychological assessment are presented.
Collapse
Affiliation(s)
| | | | - Grant L Iverson
- Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, USA
- Spaulding Rehabilitation Hospital and Spaulding Research Institute, Charlestown, MA, USA
- Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Charlestown, MA, USA
| |
Collapse
|
43
|
Abeare CA, Hurtubise JL, Cutler L, Sirianni C, Brantuo M, Makhzoum N, Erdodi LA. Introducing a forced choice recognition trial to the Hopkins Verbal Learning Test – Revised. Clin Neuropsychol 2020; 35:1442-1470. [DOI: 10.1080/13854046.2020.1779348] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Affiliation(s)
| | | | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | | | - Maame Brantuo
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Nadeen Makhzoum
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
44
|
Chafetz MD, Bauer RM, Haley PS. The other face of illness-deception: Diagnostic criteria for factitious disorder with proposed standards for clinical practice and research. Clin Neuropsychol 2020; 34:454-476. [PMID: 31535601 PMCID: PMC9257702 DOI: 10.1080/13854046.2019.1663265] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2018] [Revised: 08/17/2019] [Accepted: 08/25/2019] [Indexed: 10/26/2022]
Abstract
Objective: This paper aims to develop diagnostic criteria for factitious disorder (FD) and a heuristic for research by creating standards for delineating criterion groups.Method: Both FD and malingering are conceptualized within a rubric of illness-deception. The history of FD research was compared to the research history on malingering. Differences in the measurement of these constructs were described. The potential utility of performance validity tests (PVTs) and symptom validity tests (SVTs) in FD is discussed in light of successful applications in malingering. Methods for obtaining evidence for FD are delineated in a table of diagnostic criteria.Results: The comparison of FD and malingering research shows that the scientific measurement of malingering evolved rapidly with the introduction of forced-choice validity testing and cogent guidelines for the formation of criterion groups. Likewise, PVTs and SVTs hold promise as methods of measuring deceptive behavior in FD. The most salient differences between FD and malingering are understood to be matter of context/setting: malingering occurs in an external incentive context, while FD occurs in a medical/psychological context. Guidelines to assess FD are developed to fill the need for known-groups research.Conclusions: Evidence for FD, a form of illness-deception, can be obtained by using validity testing, which, together with careful clinical observation, allows for the development of probabilistic diagnostic criteria. Similar to the other form of illness-deception - malingering - these criteria can be used to form known groups for research.
Collapse
Affiliation(s)
- Michael D. Chafetz
- Independent Practice, Algiers Neurobehavioral Resource, LLC, New Orleans, LA, USA
| | - Russell M. Bauer
- Department of Clinical and Health Psychology, University of Florida, Gainesville, FL, USA
| | - Paige S. Haley
- The Chicago School of Professional Psychology, Xavier University, New Orleans, LA, USA
| |
Collapse
|
45
|
Hurtubise J, Baher T, Messa I, Cutler L, Shahein A, Hastings M, Carignan-Querqui M, Erdodi LA. Verbal fluency and digit span variables as performance validity indicators in experimentally induced malingering and real world patients with TBI. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:337-354. [DOI: 10.1080/21622965.2020.1719409] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
| | - Tabarak Baher
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Ayman Shahein
- Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | | | | | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|
46
|
Weber Ku E, Oliveira JS, Cook NE, McCurdy K, Kavanaugh B, Cancilliere MK, Holler KA. Assessing performance validity with the TOMM and automatized sequences task in a pediatric psychiatric inpatient setting. Child Neuropsychol 2020; 26:801-816. [PMID: 31937183 DOI: 10.1080/09297049.2020.1712345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
This study examined the performance of children consecutively admitted to an inpatient psychiatric unit on the Test of Memory Malingering (TOMM) (aged 5-12; n = 96) and Automatized Sequences Task (aged 8-12; n = 67). Eighty-three percent of children passed the TOMM Trial 2 (M raw score = 47.7, SD = 4.7) and 76% of children passed the Automatized Sequences Task total time (M = 23.1 seconds; SD = 8.2). The concordance rate between the TOMM and the total time on the Automatized Sequences Task was 73.1%. Receiver operating characteristic curves indicated that of the Automatized Sequences Task subtests, only Counting 1-20 significantly differentiated children who passed Trial 2 of the TOMM from those who did not pass Trial 2 of the TOMM (area under the curve = .756, p = .006). Performance on both PVTs was unrelated to demographic characteristics and measures of psychological and neuropsychological functioning on both the TOMM and Automatized Sequences Task. Further research is needed to determine whether the nearly 1 in 4 children (23.9%) who performed below recommended cutoffs on Automatized Sequences Task reflects genuine suboptimal effort, cognitive difficulties among these children, and/or other factors.
Collapse
Affiliation(s)
- Elyssa Weber Ku
- Clinical Psychology, University of Massachusetts Boston , Boston, MA, USA
| | - Jane S Oliveira
- Clinical Psychology, Antioch University - New England, Keene, NH, USA
| | - Nathan E Cook
- Department of Physical Medicine and Rehabilitation, Massachusetts General Hospital and Harvard Medical School , Boston, USA
| | - Kyle McCurdy
- Department of Counseling, Leadership, & Expressive Arts, Salve Regina , Newport, RI, USA
| | - Brian Kavanaugh
- Department of Psychiatry & Human Behavior E.P. Bradley Hospital/ Alpert Medical School of Brown University , Providence, RI, USA
| | | | - Karen A Holler
- Department of Psychiatry & Human Behavior E.P. Bradley Hospital/ Alpert Medical School of Brown University , Providence, RI, USA
| |
Collapse
|
47
|
Teague AM, Hirst RB. Rey 15 item test plus recognition trial and TOMM in a community pediatric sample. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:329-336. [PMID: 31918597 DOI: 10.1080/21622965.2019.1709068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
In pediatric evaluations, performance validity test (PVT) selection is often constrained by reading level, developmental appropriateness of stimuli, and administration time. The Rey 15 Item Test (FIT) addresses these constraints, and ranks among the most frequently used PVTs. Unfortunately, research indicates poor sensitivity of the FIT recall trial. Boone et al. developed a FIT recognition trial and demonstrated in an adult sample that its use increased sensitivity while maintaining high specificity. These results are promising, but, to the authors' knowledge, have only been replicated once in a pediatric sample. The present study examined the FIT plus recognition trial in a sample of 72 young athletes ages 8-16 years. All data for the present study were collected during baseline cognitive evaluations. The Test of Memory Malingering (TOMM) was used as the comparison criterion. Receiver operating characteristic curve analyses showed the addition of the recognition trial did not substantially improve sensitivity of the FIT. There was a surprising lack of concordance between TOMM and FIT scores, and, whereas the FIT correlated with multiple cognitive measures, the TOMM did not correlate with any other measures. Results suggest the FIT is not appropriate for pediatric clinical care, even with the additional recognition trial.
Collapse
Affiliation(s)
- Anna M Teague
- Neuropsychology Program, Palo Alto University, Palo Alto, CA, USA
| | - Rayna B Hirst
- Neuropsychology Program, Palo Alto University, Palo Alto, CA, USA
| |
Collapse
|
48
|
Chovaz CJ, Rennison VLA, Chorostecki DO. The validity of the test of memory malingering (TOMM) with deaf individuals. Clin Neuropsychol 2019; 35:597-614. [PMID: 31797722 DOI: 10.1080/13854046.2019.1696408] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
OBJECTIVE Administration of performance validity tests (PVT) during neuropsychological assessments is standard practice, with the Test of Memory Malingering (TOMM) being a commonly used measure. The TOMM has been well validated in hearing populations with various medical and psychiatric backgrounds. A major gap in the literature is the use of the TOMM amongst culturally Deaf individuals who use American Sign Language (ASL) as their first and preferred language. The purpose of this study was to explore the use of the TOMM with this population to determine if there may be differences related to the use of semantic knowledge and recall using signs rather than spoken phonemes. METHOD This study recruited 30 culturally Deaf, community-dwelling adults, who self-reported that they were not involved in litigation ordisability claims. In addition to the TOMM, participants were screened for cognitive ability using non-verbal components of the Wechsler Abbreviated Scale of Intelligence, Second Edition (WASI-II) and the Mini Mental State Examination: ASL Version (MMSE:ASL). RESULTS Nonverbal intelligence for this sample was within the average range of ability. No participants scored lower than the standard cut-off score for Trial 2 or the Retention Trial on the TOMM (≤44 raw score to indicate invalid responding). Trial 1 performances ranged from 44 to 50, Trial 2 performances ranged from 49 to 50, and Retention performances ranged from 49 to 50. CONCLUSION These results support the use of the same standard cut-off scores established for hearing individuals in culturally Deaf individuals who use ASL.
Collapse
Affiliation(s)
- Cathy J Chovaz
- Psychology Department, King's University College at Western University, London, Canada
| | | | | |
Collapse
|
49
|
Olla P, Rykulski N, Hurtubise JL, Bartol S, Foote R, Cutler L, Abeare K, McVinnie N, Sabelli AG, Hastings M, Erdodi LA. Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients. APPLIED NEUROPSYCHOLOGY-ADULT 2019; 28:647-657. [PMID: 31790276 DOI: 10.1080/23279095.2019.1681424] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
This observational study examined the acute cognitive effects of cannabis. We hypothesized that cognitive performance would be negatively affected by acute cannabis intoxication. Twenty-two medical cannabis patients from Southwestern Ontario completed the study. The majority (n = 13) were male. Mean age was 36.0 years, and mean level of education was 13.7 years. Participants were administered the same brief neurocognitive battery three times during a six-hour period: at baseline ("Baseline"), once after they consumed a 20% THC cannabis product ("THC"), and once again several hours later ("Recovery"). The average self-reported level of cannabis intoxication prior to the second assessment (i.e., during THC) was 5.1 out of 10. Contrary to expectations, performance on neuropsychological tests remained stable or even improved during the acute intoxication stage (THC; d: .49-.65, medium effect), and continued to increase during Recovery (d: .45-.77, medium-large effect). Interestingly, the failure rate on performance validity indicators increased during THC. Contrary to our hypothesis, there was no psychometric evidence for a decline in cognitive ability following THC intoxication. There are several possible explanations for this finding but, in the absence of a control group, no definitive conclusion can be reached at this time.
Collapse
Affiliation(s)
| | - Nicholas Rykulski
- College of Human Medicine, Michigan State University, Lansing, MI, USA
| | | | - Stephen Bartol
- School of Medicine, Wayne State University, Detroit, MI, USA
| | | | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Kaitlyn Abeare
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Nora McVinnie
- Brain-Cognition-Neuroscience Program, University of Windsor, Windsor, ON, Canada
| | - Alana G Sabelli
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Maurissa Hastings
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
50
|
Eglit GML, Jurick SM, Delis DC, Filoteo JV, Bondi MW, Jak AJ. Utility of the D-KEFS Color Word Interference Test as an embedded measure of performance validity. Clin Neuropsychol 2019; 34:332-352. [DOI: 10.1080/13854046.2019.1643923] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
| | - Sarah M. Jurick
- Veteran Affairs San Diego Healthcare System, San Diego, CA, USA
- Center of Excellence for Stress and Mental Health, VASHDS, San Diego, CA, USA
| | - Dean C. Delis
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
| | - J. Vincent Filoteo
- Veteran Affairs San Diego Healthcare System, San Diego, CA, USA
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
- Department of Neurosciences, University of California San Diego, La Jolla, CA, USA
| | - Mark W. Bondi
- Veteran Affairs San Diego Healthcare System, San Diego, CA, USA
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
| | - Amy J. Jak
- Veteran Affairs San Diego Healthcare System, San Diego, CA, USA
- Center of Excellence for Stress and Mental Health, VASHDS, San Diego, CA, USA
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
| |
Collapse
|