1
|
Stocks JK, Shields AN, DeBoer AB, Cerny BM, Ogram Buckley CM, Ovsiew GP, Jennette KJ, Resch ZJ, Basurto KS, Song W, Pliskin NH, Soble JR. The impact of visual memory impairment on Victoria Symptom Validity Test performance: A known-groups analysis. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:329-338. [PMID: 34985401 DOI: 10.1080/23279095.2021.2021911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
OBJECTIVE We assessed the effect of visual learning and recall impairment on Victoria Symptom Validity Test (VSVT) accuracy and response latency for Easy, Difficult, and Total Items. METHOD A sample of 163 adult patients administered the VSVT and Brief Visuospatial Memory Test-Revised were classified as valid (114/163) or invalid (49/163) groups via independent criterion performance validity tests (PVTs). Classification accuracies for all VSVT indices were examined for the overall sample, and separately for subgroups based on visual memory functioning. RESULTS In the overall sample, all indices produced acceptable classification accuracy (areas under the curve [AUCs] ≥ 0.79). When stratified by visual learning/recall impairment, accuracy indices yielded acceptable classification for both the unimpaired (AUCs ≥0.79) and impaired subsamples (AUCs ≥0.75). Latency indices had acceptable classification accuracy for the unimpaired subsample (AUCs ≥0.74), but accuracy and sensitivity dropped for the impaired sample (AUCs ≥0.67). CONCLUSIONS VSVT accuracy and response latency yielded acceptable classification accuracies in the overall sample, and this effect was maintained in those with and without visual learning/recall impairment for the accuracy indices. Findings indicate that the VSVT is a psychometrically robust PVT with largely invariant cut-scores, even in the presence of bona fide visual learning/recall impairment.
Collapse
Affiliation(s)
- Jane K Stocks
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Allison N Shields
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Adam B DeBoer
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Wheaton College, Wheaton, IL, USA
| | - Brian M Cerny
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Illinois Institute of Technology, Chicago, IL, USA
| | | | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Karen S Basurto
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Woojin Song
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| | - Neil H Pliskin
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
2
|
Kim S, Currao A, Brown E, Milberg WP, Fortier CB. Importance of validity testing in psychiatric assessment: evidence from a sample of multimorbid post-9/11 veterans. J Int Neuropsychol Soc 2024; 30:410-419. [PMID: 38014547 DOI: 10.1017/s1355617723000711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
OBJECTIVE Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures. METHOD Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures. RESULTS Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's d = .60-.69), processing speed (Cohen's d = .68), working memory (Cohen's d = .98), and visual memory (Cohen's d = .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; β = 0.16; p = .0002), and worse self-reported depression (β = 0.17; p = .0001), anxiety (β = 0.15; p = .0007), sleep (β = 0.10; p = .0233), and functional outcomes (β = 0.15; p = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (p's < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (AUC = 0.83; 95% CI = 0.76, 0.91). CONCLUSION PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.
Collapse
Affiliation(s)
- Sahra Kim
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - Alyssa Currao
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - Emma Brown
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - William P Milberg
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Catherine B Fortier
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
3
|
Denning JH, Horner MD. The impact of race and other demographic factors on the false positive rates of five embedded Performance Validity Tests (PVTs) in a Veteran sample. J Clin Exp Neuropsychol 2024; 46:25-35. [PMID: 38353039 DOI: 10.1080/13803395.2024.2314737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 01/11/2024] [Indexed: 05/12/2024]
Abstract
INTRODUCTION It is common to use normative adjustments based on race to maintain accuracy when interpreting cognitive test results during neuropsychological assessment. However, embedded performance validity tests (PVTs) do not adjust for these racial differences and may result in elevated rates of false positives in African American/Black (AA) samples compared to European American/White (EA) samples. METHODS Veterans without Major Neurocognitive Disorder completed an outpatient neuropsychological assessment and were deemed to be performing in a valid manner (e.g., passing both the Test of Memory Malingering Trial 1 (TOMM1) and the Medical Symptom Validity Test (MSVT), (n = 531, EA = 473, AA = 58). Five embedded PVTs were administered to all patients: WAIS-III/IV Processing Speed Index (PSI), Brief Visuospatial Memory Test-Revised: Discrimination Index (BVMT-R), TMT-A (secs), California Verbal Learning Test-II (CVLT-II) Forced Choice, and WAIS-III/IV Digit Span Scaled Score. Individual PVT false positive rates, as well as the rate of failing two or more embedded PVTs, were calculated. RESULTS Failure rates of two embedded PVTs (PSI, TMT-A), and the total number of PVTs failed, were higher in the AA sample. The PSI and TMT-A remained significantly impacted by race after accounting for age, education, sex, and presence of Mild Neurocognitive Disorder. There were PVT failure rates greater than 10% (and considered false positives) in both groups (AA: PSI, TMT-A, and BVMT-R, 12-24%; EA: BVMT-R, 17%). Failing 2 or more PVTs (AA = 9%, EA = 4%) was impacted by education and Mild Neurocognitive Disorder but not by race. CONCLUSIONS Individual (timed) PVTs showed higher false positive rates in the AA sample even after accounting for demographic factors and diagnosis of Mild Neurocognitive Disorder. Requiring failure on 2 or more embedded PVTs reduced false positive rates to acceptable levels across both groups (10% or less) and was not significantly influenced by race.
Collapse
Affiliation(s)
- John H Denning
- Mental Health Service, Ralph H. Johnson Veterans Affairs Health Care System, Charleston, SC, USA
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Michael David Horner
- Mental Health Service, Ralph H. Johnson Veterans Affairs Health Care System, Charleston, SC, USA
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| |
Collapse
|
4
|
Climent G, Rebon-Ortiz F, Saura-Carrasco M, Diaz-Orueta U. Suite test. A virtual reality based neuropsychological assessment tool for memory. A normative study on immediate, short-term and delayed memory tasks. APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-11. [PMID: 38265940 DOI: 10.1080/23279095.2024.2306128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/26/2024]
Abstract
OBJECTIVE To collect normative data for the Suite test, a virtual reality (VR) tool designed to assess memory processes. METHOD The normative sample included 676 subjects (49.7% female), aged from 12 to 85 years. The Suite test comprises a 360-degree VR environment designed as a furniture shop, in which participants must group specific sets of furniture items (ordered by different families of customers) by clicking on the furniture to be packed following instructions from a voice-over. RESULTS Core variables provided were grouped into immediate, short-term and long-term delayed recall. Cluster analyses established five age groups (12 years old, 13 to 26, 27 to 44, 45 to 58, and 59 to 85) with gender differentiated norms only deemed necessary for those transitioning from adolescence to adulthood (13 to 26) and from middle age to older adulthood (45 to 58). No statistically significant differences were found for additional gender × age normative groups, or for any group differentiated by educational level. A confirmatory factor analysis raised the existence of two differentiated factors, one associated to encoding processes (immediate memory trials) and the other to retrieval processes (both short term and long-term delayed recall trials grouping into the same factor). Additional results on the test reliability and internal consistency are presented. CONCLUSIONS Suite Test can help explore memory deficits across the life span and differentiate between visual and verbal memory strategies. Further research is required to study the test sensitivity and specificity, as well as convergent validity studies with well-established memory assessment tools.
Collapse
Affiliation(s)
| | | | | | - Unai Diaz-Orueta
- Maynooth University, Maynooth, Ireland
- Universidad Internacional de la Rioja (UNIR), Logroño, Spain
| |
Collapse
|
5
|
Merritt VC, Goodwin GJ, Sakamoto MS, Crocker LD, Jak AJ. Symptom Attribution and Neuropsychological Outcomes Among Treatment-Seeking Veterans With a History of Traumatic Brain Injury. J Neuropsychiatry Clin Neurosci 2024; 36:134-142. [PMID: 38192216 DOI: 10.1176/appi.neuropsych.20230067] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2024]
Abstract
OBJECTIVE In this cross-sectional study, the authors aimed to examine relationships between illness perception, measured as symptom attribution, and neurobehavioral and neurocognitive outcomes among veterans with a history of traumatic brain injury (TBI). METHODS This study included 55 treatment-seeking veterans (N=43 with adequate performance validity testing) with a remote history of TBI (80% with mild TBI). Veterans completed a clinical interview, self-report questionnaires, and a neuropsychological assessment. A modified version of the Neurobehavioral Symptom Inventory (NSI) was administered to assess neurobehavioral symptom endorsement and symptom attribution. Composite scores were calculated from standardized cognitive tests to assess specific aspects of objective cognitive functioning, including memory, executive functioning, attention and working memory, and processing speed. RESULTS The symptoms most frequently attributed to TBI included forgetfulness, poor concentration, slowed thinking, and headaches. There was a significant positive association between symptom attribution and overall symptom endorsement (NSI total score) (r=0.675) and endorsement of specific symptom domains (NSI symptom domain scores) (r=0.506-0.674), indicating that greater attribution of symptoms to TBI was associated with greater symptom endorsement. Furthermore, linear regressions showed that symptom attribution was significantly associated with objective cognitive functioning, whereas symptom endorsement generally did not show this relationship. Specifically, greater attribution of symptoms to TBI was associated with worse executive functioning (β=-0.34), attention and working memory (β=-0.43), and processing speed (β=-0.35). CONCLUSIONS These findings suggest that veterans who routinely attribute neurobehavioral symptoms to their TBI are at greater risk of experiencing poor long-term outcomes, including elevated symptom endorsement and worse objective cognition. Although more research is needed to understand how illness perception influences outcomes in this population, these preliminary results highlight the importance of early psychoeducation regarding the anticipated course of recovery following TBI.
Collapse
Affiliation(s)
- Victoria C Merritt
- Psychology and Research Services and Center of Excellence for Stress and Mental Health, Veterans Affairs San Diego Healthcare System, San Diego (Merritt, Crocker, Jak); Department of Psychiatry, School of Medicine, University of California, San Diego, La Jolla (Merritt, Jak); Department of Psychology, University of Nevada, Las Vegas (Goodwin); Department of Psychology, Pennsylvania State University, University Park (Sakamoto)
| | - Grace J Goodwin
- Psychology and Research Services and Center of Excellence for Stress and Mental Health, Veterans Affairs San Diego Healthcare System, San Diego (Merritt, Crocker, Jak); Department of Psychiatry, School of Medicine, University of California, San Diego, La Jolla (Merritt, Jak); Department of Psychology, University of Nevada, Las Vegas (Goodwin); Department of Psychology, Pennsylvania State University, University Park (Sakamoto)
| | - McKenna S Sakamoto
- Psychology and Research Services and Center of Excellence for Stress and Mental Health, Veterans Affairs San Diego Healthcare System, San Diego (Merritt, Crocker, Jak); Department of Psychiatry, School of Medicine, University of California, San Diego, La Jolla (Merritt, Jak); Department of Psychology, University of Nevada, Las Vegas (Goodwin); Department of Psychology, Pennsylvania State University, University Park (Sakamoto)
| | - Laura D Crocker
- Psychology and Research Services and Center of Excellence for Stress and Mental Health, Veterans Affairs San Diego Healthcare System, San Diego (Merritt, Crocker, Jak); Department of Psychiatry, School of Medicine, University of California, San Diego, La Jolla (Merritt, Jak); Department of Psychology, University of Nevada, Las Vegas (Goodwin); Department of Psychology, Pennsylvania State University, University Park (Sakamoto)
| | - Amy J Jak
- Psychology and Research Services and Center of Excellence for Stress and Mental Health, Veterans Affairs San Diego Healthcare System, San Diego (Merritt, Crocker, Jak); Department of Psychiatry, School of Medicine, University of California, San Diego, La Jolla (Merritt, Jak); Department of Psychology, University of Nevada, Las Vegas (Goodwin); Department of Psychology, Pennsylvania State University, University Park (Sakamoto)
| |
Collapse
|
6
|
Rogers R, Bender SD, Hartigan SE. An overview of malingering and deception in neuropsychiatric cases. BEHAVIORAL SCIENCES & THE LAW 2024; 42:28-38. [PMID: 38047870 DOI: 10.1002/bsl.2636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Accepted: 10/26/2023] [Indexed: 12/05/2023]
Abstract
Forensic practitioners must shoulder special responsibilities when evaluating over-stated pathology (e.g., malingering) as well as simulated adjustment. Such determinations may modify or even override other clinical findings. As a result, practitioners must be alert to their own misassumptions that may unintentionally bias their conclusions about response styles. Detection strategies for malingering-based on unlikely or markedly amplified presentations-are highlighted in this article. Given page constraints, assessment methods for feigning are succinctly presented with their applications to administrative, civil, and criminal referrals.
Collapse
Affiliation(s)
- Richard Rogers
- Department of Psychology, University of North Texas, Denton, Texas, USA
| | - Scott D Bender
- Department of Psychiatry and Neurobehavioral Sciences, University of Virginia School of Medicine, Charlottesville, Virginia, USA
| | - Sara E Hartigan
- Forensic Psychologist at the Office of Forensic Mental Health Services (OFMHS) in Tacoma, Olympia, Washington, USA
| |
Collapse
|
7
|
Picard EH, Bopp LL, Rosenfeld B. Neuropsychological Functioning in Sexual Offenders With and Without Pedophilic Disorder. ARCHIVES OF SEXUAL BEHAVIOR 2024; 53:43-56. [PMID: 37749338 DOI: 10.1007/s10508-023-02689-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Revised: 08/14/2023] [Accepted: 08/16/2023] [Indexed: 09/27/2023]
Abstract
This study sought to examine neuropsychological functioning in men with pedophilic disorder (PD), in order to assess whether findings from prior neuropsychological studies are replicated in a diverse sample including men with non-contact sexual offenses. It was hypothesized that when non-contact offenders are included in the study, a slowed processing speed will emerge as the only finding unique to men with PD. A comprehensive neuropsychological battery was administered to 58 men convicted of a sexual offense, 20 of whom were classified as having PD. The sample included men with contact sexual offenses (n = 33), non-contact sexual offenses (n = 5), and child sexual abuse material (CSAM) offenses (n = 20). Test performance was compared by PD status. Participants with PD performed significantly better on verbal memory and visual discrimination than those without PD. Men with PD made more errors on a set-shifting task but no significant differences were seen in domains of attention, intellectual functioning, visual learning and memory, visuospatial ability, or language ability. Effect sizes were generally small, although some medium effects were seen (visual discrimination and verbal learning and memory). Scores in both groups (with and without PD) were generally in the average range across tasks. Within the subgroup of CSAM offenders, minimal differences emerged between those with and without PD, although those with PD were slower on visuomotor set-shifting but made fewer errors (d = - 0.89). CSAM offenders with PD were in the high average range on many tasks of intellectual functioning; however, a potential trend was identified such that CSAM offenders without PD had lower scores on a task of verbal learning and memory, with medium effect sizes observed. As few differences in neuropsychological functioning emerged when comparing offenders with and without PD, differences demonstrated in prior research may be better attributed to contact offending status rather than sexual interest.
Collapse
Affiliation(s)
- Emilie H Picard
- Department of Psychiatry, University of Virginia Medical Center, West Complex, Rm. 4472, 1300 Jefferson Park Ave., Charlottesville, VA, 22903, USA.
| | - Lillian L Bopp
- Department of Psychology, University of Nebraska-Lincoln, Lincoln, NE, USA
| | - Barry Rosenfeld
- Department of Psychology, Fordham University, New York, NY, USA
| |
Collapse
|
8
|
Ly MT, Merritt VC, Ozturk ED, Clark AL, Hanson KL, Delano-Wood LM, Sorg SF. Subjective memory complaints are associated with decreased cortical thickness in Veterans with histories of mild traumatic brain injury. Clin Neuropsychol 2023; 37:1745-1765. [PMID: 36883430 DOI: 10.1080/13854046.2023.2184720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 02/21/2023] [Indexed: 03/09/2023]
Abstract
Objective: Memory problems are frequently endorsed in Veterans following mild traumatic brain injury (mTBI), but subjective complaints are poorly associated with objective memory performance. Few studies have examined associations between subjective memory complaints and brain morphometry. We investigated whether self-reported memory problems were associated with objective memory performance and cortical thickness in Veterans with a history of mTBI. Methods: 40 Veterans with a history of remote mTBI and 29 Veterans with no history of TBI completed the Prospective-Retrospective Memory Questionnaire (PRMQ), PTSD Checklist (PCL), California Verbal Learning Test-2nd edition (CVLT-II), and 3 T T1 structural magnetic resonance imaging. Cortical thickness was estimated in 14 a priori frontal and temporal regions. Multiple regressions adjusting for age and PCL scores examined associations between PRMQ, CVLT-II scores, and cortical thickness within each Veteran group. Results: Greater subjective memory complaints on the PRMQ were associated with lower cortical thickness in the right middle temporal gyrus (β = 0.64, q = .004), right inferior temporal gyrus (β = 0.56, q = .014), right rostral middle frontal gyrus (β = 0.45, q = .046), and right rostral anterior cingulate gyrus (β = 0.58, q = .014) in the mTBI group but not the control group (q's > .05). These associations remained significant after adjusting for CVLT-II learning. CVLT-II performance was not associated with PRMQ score or cortical thickness in either group. Conclusions: Subjective memory complaints were associated with lower cortical thickness in right frontal and temporal regions, but not with objective memory performance, in Veterans with histories of mTBI. Subjective complaints post-mTBI may indicate underlying brain morphometry independently of objective cognitive testing.
Collapse
Affiliation(s)
- Monica T Ly
- Veterans Affairs San Diego Healthcare System (VASDHS), San Diego, CA, USA
- Department of Psychiatry, University of California San Diego Health, CA, USA
| | - Victoria C Merritt
- Veterans Affairs San Diego Healthcare System (VASDHS), San Diego, CA, USA
- Department of Psychiatry, University of California San Diego Health, CA, USA
- Center of Excellence for Stress and Mental Health, VASDHS, San Diego, CA, USA
| | - Erin D Ozturk
- Veterans Affairs San Diego Healthcare System (VASDHS), San Diego, CA, USA
- San Diego Joint Doctoral Program, San Diego State University/University of California San Diego, San Diego, CA, USA
| | - Alexandra L Clark
- Department of Psychology, The University of Texas at Austin, Austin, TX, USA
| | - Karen L Hanson
- Veterans Affairs San Diego Healthcare System (VASDHS), San Diego, CA, USA
- Department of Psychiatry, University of California San Diego Health, CA, USA
| | - Lisa M Delano-Wood
- Veterans Affairs San Diego Healthcare System (VASDHS), San Diego, CA, USA
- Department of Psychiatry, University of California San Diego Health, CA, USA
- Center of Excellence for Stress and Mental Health, VASDHS, San Diego, CA, USA
| | - Scott F Sorg
- Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Boston, MA, USA
| |
Collapse
|
9
|
Leonhard C. Review of Statistical and Methodological Issues in the Forensic Prediction of Malingering from Validity Tests: Part I: Statistical Issues. Neuropsychol Rev 2023; 33:581-603. [PMID: 37612531 DOI: 10.1007/s11065-023-09601-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Accepted: 03/29/2023] [Indexed: 08/25/2023]
Abstract
Forensic neuropsychological examinations with determination of malingering have tremendous social, legal, and economic consequences. Thousands of studies have been published aimed at developing and validating methods to diagnose malingering in forensic settings, based largely on approximately 50 validity tests, including embedded and stand-alone performance validity tests. This is the first part of a two-part review. Part I explores three statistical issues related to the validation of validity tests as predictors of malingering, including (a) the need to report a complete set of classification accuracy statistics, (b) how to detect and handle collinearity among validity tests, and (c) how to assess the classification accuracy of algorithms for aggregating information from multiple validity tests. In the Part II companion paper, three closely related research methodological issues will be examined. Statistical issues are explored through conceptual analysis, statistical simulations, and through reanalysis of findings from prior validation studies. Findings suggest extant neuropsychological validity tests are collinear and contribute redundant information to the prediction of malingering among forensic examinees. Findings further suggest that existing diagnostic algorithms may miss diagnostic accuracy targets under most realistic conditions. The review makes several recommendations to address these concerns, including (a) reporting of full confusion table statistics with 95% confidence intervals in diagnostic trials, (b) the use of logistic regression, and (c) adoption of the consensus model on the "transparent reporting of multivariate prediction models for individual prognosis or diagnosis" (TRIPOD) in the malingering literature.
Collapse
Affiliation(s)
- Christoph Leonhard
- The Chicago School of Professional Psychology at Xavier University of Louisiana, Box 200, 1 Drexel Dr, New Orleans, LA, 70125, USA.
| |
Collapse
|
10
|
Tyson BT, Pyne SR, Crisan I, Calamia M, Holcomb M, Giromini L, Erdodi LA. Logical memory, visual reproduction, and verbal paired associates are effective embedded validity indicators in patients with traumatic brain injury. APPLIED NEUROPSYCHOLOGY. ADULT 2023:1-10. [PMID: 36881969 DOI: 10.1080/23279095.2023.2179400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/09/2023]
Abstract
OBJECTIVE This study was design to evaluate the potential of the recognition trials for the Logical Memory (LM), Visual Reproduction (VR), and Verbal Paired Associates (VPA) subtests of the Wechsler Memory Scales-Fourth Edition (WMS-IV) to serve as embedded performance validity tests (PVTs). METHOD The classification accuracy of the three WMS-IV subtests was computed against three different criterion PVTs in a sample of 103 adults with traumatic brain injury (TBI). RESULTS The optimal cutoffs (LM ≤ 20, VR ≤ 3, VPA ≤ 36) produced good combinations of sensitivity (.33-.87) and specificity (.92-.98). An age-corrected scaled score of ≤5 on either of the free recall trials on the VPA was specific (.91-.92) and relatively sensitive (.48-.57) to psychometrically defined invalid performance. A VR I ≤ 5 or VR II ≤ 4 had comparable specificity, but lower sensitivity (.25-.42). There was no difference in failure rate as a function of TBI severity. CONCLUSIONS In addition to LM, VR, and VPA can also function as embedded PVTs. Failing validity cutoffs on these subtests signals an increased risk of non-credible presentation and is robust to genuine neurocognitive impairment. However, they should not be used in isolation to determine the validity of an overall neurocognitive profile.
Collapse
Affiliation(s)
- Brad T Tyson
- Evergreen Neuroscience Institute, Evergreen Health Medical Center, Kirkland, WA, USA
| | | | - Iulia Crisan
- Department of Psychology, West University of Timisoara, Timisoara, Romania
| | - Matthew Calamia
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | | | | | - Laszlo A Erdodi
- Jefferson Neurobehavioral Group, New Orleans, LA, USA
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
11
|
Low rate of performance validity failures among individuals with bipolar disorder. J Int Neuropsychol Soc 2023; 29:298-305. [PMID: 35403599 DOI: 10.1017/s1355617722000145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Assessing performance validity is imperative in both clinical and research contexts as data interpretation presupposes adequate participation from examinees. Performance validity tests (PVTs) are utilized to identify instances in which results cannot be interpreted at face value. This study explored the hit rates for two frequently used PVTs in a research sample of individuals with and without histories of bipolar disorder (BD). METHOD As part of an ongoing longitudinal study of individuals with BD, we examined the performance of 736 individuals with BD and 255 individuals with no history of mental health disorder on the Test of Memory Malingering (TOMM) and the California Verbal Learning Test forced choice trial (CVLT-FC) at three time points. RESULTS Undiagnosed individuals demonstrated 100% pass rate on PVTs and individuals with BD passed over 98% of the time. A mixed effects model adjusting for relevant demographic variables revealed no significant difference in TOMM scores between the groups, a = .07, SE = .07, p = .31. On the CVLT-FC, no clinically significant differences were observed (ps < .001). CONCLUSIONS Perfect PVT scores were obtained by the majority of individuals, with no differences in failure rates between groups. The tests have approximately >98% specificity in BD and 100% specificity among non-diagnosed individuals. Further, nearly 90% of individuals with BD obtained perfect scores on both measures, a trend observed at each time point.
Collapse
|
12
|
"It's on the tip of my tongue!" exploring confrontation naming difficulties in patients with multiple sclerosis. Mult Scler Relat Disord 2023; 71:104579. [PMID: 36805174 DOI: 10.1016/j.msard.2023.104579] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 01/25/2023] [Accepted: 02/13/2023] [Indexed: 02/16/2023]
Abstract
BACKGROUND Naming difficulty is commonly reported by patients with multiple sclerosis (pwMS). Though many cognitive batteries recommended for pwMS include fluency tasks, they do not include naming tasks. The aim of this study was to examine the prevalence of naming impairment in pwMS by using a measure of confrontation naming and to identify correlates with neuroimaging. METHODS One-hundred-eighty-five pwMS (Mage = 48.75 ± 11.23) completed neuropsychological testing and fifty had brain MRI scans within one year of neuropsychological testing. Controlling for demographic variables, partial correlations and hierarchical regressions with language tests as the outcome variables and neuroimaging variables as predictors were performed. RESULTS Performance on language tasks ranged within low average to average, with impairment most frequently found on a measure of confrontation naming (Boston Naming Test [BNT];27.6%), followed by a measure of phonemic fluency (Controlled Oral Word Association Test [COWAT]; 24.3%) and semantic fluency (animals [AF]; 18.3%). In the subset of patients with neuroimaging, thalamic volume had the strongest relationship with language variables, followed by white matter volume and T2 lesion volume. Language variables had no association with fractional gray matter volume. Of the language measures, BNT demonstrated the strongest relationship with MRI variables, followed by AF. There were no significant associations between neuroimaging variables and COWAT. Regression results revealed that fractional thalamic volume significantly contributed to BNT scores after adjusting for demographics, while T2 lesion volume predicted AF and no neuroimaging variables emerged as predictors for COWAT after controlling for demographics. CONCLUSIONS Objective naming impairment is common in pwMS and are more strongly associated with neuroimaging of MS brain pathology than verbal fluency tasks that are commonly used in cognitive batteries for pwMS. Continued research on language (especially naming) deficits and neuroimaging correlates (particularly thalamic involvement) in pwMS is needed.
Collapse
|
13
|
Crocker LD, Sullan MJ, Jurick SM, Thomas KR, Davey DK, Hoffman SN, Twamley EW, Jak AJ. Baseline executive functioning moderates treatment-related changes in quality of life in veterans with posttraumatic stress disorder and comorbid traumatic brain injury. J Trauma Stress 2023; 36:94-105. [PMID: 36204974 DOI: 10.1002/jts.22883] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 08/09/2022] [Accepted: 08/22/2022] [Indexed: 11/08/2022]
Abstract
Posttraumatic stress disorder (PTSD) treatment has been associated with improvement in quality of life (QOL); however, little is known about factors that moderate treatment-related changes in QOL, particularly cognitive factors. Executive functioning (EF) is important for success across all aspects of everyday life and predicts better psychological and physical health. EF is important to QOL, but more work is needed to better understand the association between EF and QOL improvements following interventions. We hypothesized that poorer baseline EF would be associated with less improvement in overall life satisfaction and satisfaction with health following PTSD treatment. U.S. veterans who served after the September 11, 2001 terrorist attacks (post 9-11; N = 80) with PTSD and a history of mild-to-moderate traumatic brain injury were randomized to standard cognitive processing therapy (CPT) or CPT combined with cognitive rehabilitation (SMART-CPT). Multilevel modeling was used to examine whether baseline EF performance was associated with changes in QOL scores from pretreatment to follow-up across both groups. Results indicated that poorer baseline performance on EF tests of working memory and inhibition were associated with less treatment-related improvements in general life satisfaction and satisfaction with health, rs = .26-.36. Treatment condition did not moderate any results. Future research should examine whether implementing EF-focused techniques before and/or concurrently with CPT for individuals with poorer baseline working memory and inhibition enhances QOL treatment gains, particularly in terms of general life and health-related satisfaction.
Collapse
Affiliation(s)
- Laura D Crocker
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
| | - Molly J Sullan
- Psychology Service, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Sarah M Jurick
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Kelsey R Thomas
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Delaney K Davey
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - Samantha N Hoffman
- San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, California, USA
| | - Elizabeth W Twamley
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Amy J Jak
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Psychology Service, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| |
Collapse
|
14
|
Cerny BM, Reynolds TP, Chang F, Scimeca LM, Phillips MS, Ogram Buckley CM, Leib SI, Resch ZJ, Pliskin NH, Soble JR. Cognitive Performance and Psychiatric Self-Reports Across Adult Cognitive Disengagement Syndrome and ADHD Diagnostic Groups. J Atten Disord 2023; 27:258-269. [PMID: 36354066 DOI: 10.1177/10870547221136216] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Cognitive disengagement syndrome (CDS) is characterized by inattention, under-arousal, and fatigue and frequently co-occurs with attention-deficit/hyperactivity disorder (ADHD). Although CDS is associated with cognitive complaints, its association with objective cognitive performance is less well understood. METHOD This study investigated neuropsychological correlates of CDS symptoms among 169 adults (Mage = 29.4) referred for outpatient neuropsychological evaluation following inattention complaints. We evaluated cognitive and self-report differences across four high/low CDS and positive/negative ADHD groups, and cognitive and self-report correlates of CDS symptomology. RESULTS There were no differences in cognitive performance, significant differences in self-reported psychiatric symptoms (greater CDS symptomatology, impulsivity among the high CDS groups; greater inattention among the positive ADHD/high CDS groups; greater hyperactivity among the positive ADHD groups), significant intercorrelations within cognitive and self-report measures, nonsignificant correlations between cognitive measures and self-report measures. CONCLUSION Findings support prior work demonstrating weak to null associations between ADHD and CDS symptoms and cognitive performance among adults.
Collapse
Affiliation(s)
- Brian M Cerny
- University of Illinois College of Medicine, Chicago, USA.,Illinois Institute of Technology, Chicago, USA
| | | | - Fini Chang
- University of Illinois College of Medicine, Chicago, USA.,University of Illinois at Chicago, USA
| | - Lauren M Scimeca
- University of Illinois College of Medicine, Chicago, USA.,Illinois Institute of Technology, Chicago, USA
| | - Matthew S Phillips
- University of Illinois College of Medicine, Chicago, USA.,The Chicago School of Professional Psychology, IL, USA
| | - Caitlin M Ogram Buckley
- University of Illinois College of Medicine, Chicago, USA.,University of Rhode Island, Kingston, USA
| | - Sophie I Leib
- University of Illinois College of Medicine, Chicago, USA.,Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | | | - Neil H Pliskin
- University of Illinois College of Medicine, Chicago, USA
| | - Jason R Soble
- University of Illinois College of Medicine, Chicago, USA
| |
Collapse
|
15
|
Obolsky MA, Resch ZJ, Fellin TJ, Cerny BM, Khan H, Bing-Canar H, McCollum K, Lee RC, Fink JW, Pliskin NH, Soble JR. Concordance of Performance and Symptom Validity Tests Within an Electrical Injury Sample. PSYCHOLOGICAL INJURY & LAW 2022. [DOI: 10.1007/s12207-022-09469-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
16
|
Crocker LD, Jurick SM, Merritt VC, Keller AV, Hoffman SN, Davey DK, Jak AJ. Mechanisms through which executive dysfunction influences suicidal ideation in combat-exposed Iraq and Afghanistan veterans. Clin Neuropsychol 2022; 36:2073-2092. [PMID: 34524071 DOI: 10.1080/13854046.2021.1974566] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
OBJECTIVE Executive dysfunction has previously been associated with suicidality, but it remains unclear how deficits in executive functioning contribute to increased suicidal thoughts and behaviors. Although it has been proposed that poorer executive functioning leads to difficulty generating and implementing appropriate coping strategies to regulate distress and inhibit suicidal thoughts and behaviors, studies have not systematically examined these relationships. Therefore, the present study examined various hypotheses to elucidate the mechanisms through which executive dysfunction influences suicidal ideation (SI) in combat-exposed Iraq/Afghanistan veterans. METHOD Veterans who endorsed SI were compared to those who denied SI on demographic and diagnostic variables and measures of neuropsychological functioning, psychological symptoms, coping styles, and combat experiences. Serial mediation models were tested to examine mechanistic relationships among executive functioning, psychological distress, coping, and SI. RESULTS Those who endorsed SI had worse executive functioning, greater psychological distress, and greater avoidant coping relative to those who denied SI. Serial mediation model testing indicated a significant indirect path, such that executive dysfunction increased psychological distress, which in turn increased avoidant coping, leading to SI. CONCLUSIONS Findings support and extend previous hypotheses regarding how executive functioning contributes to increased risk of suicidality via increased distress and avoidant coping. Intervention efforts focused on reducing suicidality may benefit from techniques that enhance executive functioning (e.g. computerized training, cognitive rehabilitation) and in turn reduce distress prior to targeting coping strategies.
Collapse
Affiliation(s)
- Laura D Crocker
- Research Service, VA San Diego Healthcare System, San Diego, CA, USA.,Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA
| | - Sarah M Jurick
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA.,Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA, USA
| | - Victoria C Merritt
- Research Service, VA San Diego Healthcare System, San Diego, CA, USA.,Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA.,Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA, USA
| | - Amber V Keller
- San Diego Joint Doctoral Program in Clinical Psychology, San Diego State University/University of California, San Diego, CA, USA
| | - Samantha N Hoffman
- San Diego Joint Doctoral Program in Clinical Psychology, San Diego State University/University of California, San Diego, CA, USA
| | - Delaney K Davey
- Research Service, VA San Diego Healthcare System, San Diego, CA, USA
| | - Amy J Jak
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA.,Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA, USA.,Psychology Service, VA San Diego Healthcare System, San Diego, CA, USA
| |
Collapse
|
17
|
Doddato FR, Forde J, Wang Y, Puente AE. An alternative approach to TOMM cutoff scores using a large sample of military personnel. APPLIED NEUROPSYCHOLOGY. ADULT 2022:1-9. [PMID: 36227693 DOI: 10.1080/23279095.2022.2119391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
The accuracy of neuropsychological assessments relies on participants exhibiting their true abilities during administration. The Test of Memory Malingering (TOMM) is a popular performance validity test used to determine whether an individual is providing honest answers. While the TOMM has proven to be highly sensitive to those who are deliberately exaggerating their symptoms, there is a limited explanation regarding the significance of using 45 as a cutoff score. The present study aims to further investigate this question by examining TOMM scores obtained in a large sample of active-duty military personnel (N = 859, M = 26 years, SD = 6.14, 97.31% males, 72.44% white). Results indicated that no notable discrepancies existed between the frequency of participants who scored a 45 and those who scored slightly below a 45 on the TOMM. The sensitivity and specificity of the TOMM were derived using the forced-choice recognition (FCR) scores obtained by participants on the California Verbal Learning Test, Second Edition (CVLT-II). The sensitivity for each trial of the TOMM was 0.84, 0.55, and 0.63, respectively; the specificity for each trial of the TOMM was 0.69, 0.93, and 0.92, respectively. Because sensitivity and specificity rates are both of importance in this study, balanced accuracy scores were also reported. Results suggested that various alternative cutoff scores produced a more accurate classification compared to the traditional cutoff of 45. Further analyses using Fisher's exact test also indicated that there were no significant performance differences on the FCR of the CVLT-II between individuals who received a 44 and individuals who received a 45 on the TOMM. The current study provides evidence on why the traditional cutoff may not be the most effective score. Future research should consider employing alternative methods which do not rely on a single score.
Collapse
Affiliation(s)
- Felicity R Doddato
- Department of Psychology, University of North Carolina Wilmington, Wilmington, NC, USA
| | - Jessica Forde
- Naval Hospital, Marine Corps Base Camp LeJeune, Hampstead, NC, USA
| | - Yishi Wang
- Department of Mathematics and Statistics, University of North Carolina Wilmington, Wilmington, NC, USA
| | - Antonio E Puente
- Department of Psychology, University of North Carolina Wilmington, Wilmington, NC, USA
| |
Collapse
|
18
|
Neurocognitive Outcome Following Recovery from Severe Acute Respiratory Syndrome - Coronavirus-1 (SARS-CoV-1). J Int Neuropsychol Soc 2022; 28:891-901. [PMID: 34488921 DOI: 10.1017/s1355617721001107] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Severe acute respiratory syndrome (SARS) is a highly contagious viral respiratory illness associated with hypoxia and dyspnea. Many of those who contracted and recovered from SARS during the 2002-2003 outbreak reported persistent physical, psychological, and cognitive difficulties. Here, we investigated the residual influences of SARS on cognition for a subset of healthcare professionals who recovered and were referred for neuropsychological evaluation through their workplace insurance. METHOD Twenty-eight healthcare professionals were evaluated on neuropsychological and mood functioning approximately 1.5 years post-recovery from a severe respiratory illness. Test scores were compared with age-matched normative data, and correlations were examined between mood, self-report memory scales, subjective complaints (e.g., poor concentration, pain, fatigue), illness severity (i.e., length of hospitalization, oxygen use during hospital stay), and cognitive performance. RESULTS Participants performed within age expectations on the majority of cognitive measures including overall memory ability. Although processing speed was generally within normal limits, 43% showed significant speed-accuracy trade-offs favoring accuracy over maintaining speed. Deficits were observed on measures of complex attention, such as working memory and the ability to sustain attention under conditions of distraction. Participants endorsed poorer memory ability than same-age peers on a meta-memory measure and mild to moderate depression and anxiety symptoms. Objective test performance was largely uncorrelated with self-reports, mood, or illness severity, except for moderate correlations between complex attention and participants' subjective ratings of Everyday Task-Oriented Memory. CONCLUSIONS These findings demonstrate specific long-term cognitive deficits associated with SARS and provide further evidence of the cognitive effects of hypoxic illnesses.
Collapse
|
19
|
Neale AC, Aase DM, Soble JR, Baker JC, Phan KL. Disentangling subjective symptom complaints and objective cognitive performance in veterans: Impact of posttraumatic stress disorder and lifetime traumatic brain injury burden. APPLIED NEUROPSYCHOLOGY. ADULT 2022:1-16. [PMID: 35819927 DOI: 10.1080/23279095.2022.2096452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Self-reported histories of mild traumatic brain injury (mTBI) and posttraumatic stress disorder (PTSD) symptoms are prevalent among post-9/11 veterans. Both are associated with subjective and often overlapping symptom complaints, but variably with objective neuropsychological test performances. These outcomes are seldom explored in relation to lifetime mTBI burden. This cross-sectional study examined associations of PTSD and lifetime mTBI with subjective (persistent symptoms after concussion and cognitive complaints) and objective (performances across five cognitive domains) measures among 46 veterans. Within this sample, 20 veterans had Clinician-Administered PTSD Scale for DSM-5 (CAPS-5) confirmed PTSD (PTSD+), whereas 26 demographically-similar participants did not meet criteria (PTSD-). The Boston Assessment of Traumatic Brain Injury-Lifetime (BAT-L) yielded total mTBI scores ranging from 0 to 8. Regressions showed PTSD was associated with increased subjective symptoms/cognitive complaints, along with reduced verbal fluency, visuospatial memory, and processing speed performances. Lifetime mTBI burden was associated with subjective symptoms, but not with objective cognitive test performance, after controlling for PTSD. No significant interactions were observed. Exploratory correlations suggested that all PTSD symptom clusters were generally associated with the subjective and objective measures. However, fewer significant associations emerged within the PTSD+/- groups separately, with each group yielding somewhat different patterns of relationships. PTSD and increasing mTBI burden are consistently associated with negative subjective symptoms, including cognitive complaints. Each condition likely explains some degree of unique variance in symptom reporting. PTSD is associated with poorer objective cognition on some tasks, including processing speed, executive functioning, and learning/memory. Implications are explored.
Collapse
Affiliation(s)
- Alec C Neale
- Psychiatry and Behavioral Health, Wexner Medical Center, The Ohio State University, Columbus, Ohio, USA
- Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
| | - Darrin M Aase
- Psychiatry and Behavioral Health, Wexner Medical Center, The Ohio State University, Columbus, Ohio, USA
- Mental Health Service Line, Jesse Brown VA Medical Center, Chicago, Illinois, USA
| | - Jason R Soble
- Psychiatry, University of Illinois at Chicago, Chicago, Illinois, USA
- Neurology, University of Illinois at Chicago, Chicago, Illinois, USA
| | - Justin C Baker
- Psychiatry and Behavioral Health, Wexner Medical Center, The Ohio State University, Columbus, Ohio, USA
| | - K Luan Phan
- Psychiatry and Behavioral Health, Wexner Medical Center, The Ohio State University, Columbus, Ohio, USA
- Mental Health Service Line, Jesse Brown VA Medical Center, Chicago, Illinois, USA
| |
Collapse
|
20
|
Grewal KS, Trites M, Kirk A, MacDonald SWS, Morgan D, Gowda-Sookochoff R, O'Connell ME. CVLT-II short form forced choice recognition in a clinical dementia sample: Cautions for performance validity assessment. APPLIED NEUROPSYCHOLOGY. ADULT 2022:1-10. [PMID: 35635794 DOI: 10.1080/23279095.2022.2079088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Performance validity tests are susceptible to false positives from genuine cognitive impairment (e.g., dementia); this has not been explored with the short form of the California Verbal Learning Test II (CVLT-II-SF). In a memory clinic sample, we examined whether CVLT-II-SF Forced Choice Recognition (FCR) scores differed across diagnostic groups, and how the severity of impairment [Clinical Dementia Rating Sum of Boxes (CDR-SOB) or Mini-Mental State Examination (MMSE)] modulated test performance. Three diagnostic groups were identified: subjective cognitive impairment (SCI; n = 85), amnestic mild cognitive impairment (a-MCI; n = 17), and dementia due to Alzheimer's Disease (AD; n = 50). Significant group differences in FCR were observed using one-way ANOVA; post-hoc analysis indicated the AD group performed significantly worse than the other groups. Using multiple regression, FCR performance was modeled as a function of the diagnostic group, severity (MMSE or CDR-SOB), and their interaction. Results yielded significant main effects for MMSE and diagnostic group, with a significant interaction. CDR-SOB analyses were non-significant. Increases in impairment disproportionately impacted FCR performance for persons with AD, adding caution to research-based cutoffs for performance validity in dementia. Caution is warranted when assessing performance validity in dementia populations. Future research should examine whether CVLT-II-SF-FCR is appropriately specific for best-practice testing batteries for dementia.
Collapse
Affiliation(s)
- Karl S Grewal
- Department of Psychology, University of Saskatchewan, Saskatoon, Canada
| | - Michaella Trites
- Department of Psychology, University of Victoria, Victoria, Canada
| | - Andrew Kirk
- Department of Medicine, University of Saskatchewan, Saskatoon, Canada
| | | | - Debra Morgan
- Canadian Centre for Health and Safety in Agriculture, University of Saskatchewan, Saskatoon, Canada
| | | | - Megan E O'Connell
- Department of Psychology, University of Saskatchewan, Saskatoon, Canada
| |
Collapse
|
21
|
Nussbaum S, May N, Cutler L, Abeare CA, Watson M, Erdodi LA. Failing Performance Validity Cutoffs on the Boston Naming Test (BNT) Is Specific, but Insensitive to Non-Credible Responding. Dev Neuropsychol 2022; 47:17-31. [PMID: 35157548 DOI: 10.1080/87565641.2022.2038602] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
This study was designed to examine alternative validity cutoffs on the Boston Naming Test (BNT).Archival data were collected from 206 adults assessed in a medicolegal setting following a motor vehicle collision. Classification accuracy was evaluated against three criterion PVTs.The first cutoff to achieve minimum specificity (.87-.88) was T ≤ 35, at .33-.45 sensitivity. T ≤ 33 improved specificity (.92-.93) at .24-.34 sensitivity. BNT validity cutoffs correctly classified 67-85% of the sample. Failing the BNT was unrelated to self-reported emotional distress. Although constrained by its low sensitivity, the BNT remains a useful embedded PVT.
Collapse
Affiliation(s)
- Shayna Nussbaum
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Natalie May
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Laura Cutler
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Mark Watson
- Mark S. Watson Psychology Professional Corporation, Mississauga, ON, Canada
| | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
22
|
White DJ, Ovsiew GP, Rhoads T, Resch ZJ, Lee M, Oh AJ, Soble JR. The Divergent Roles of Symptom and Performance Validity in the Assessment of ADHD. J Atten Disord 2022; 26:101-108. [PMID: 33084457 DOI: 10.1177/1087054720964575] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE This study examined concordance between symptom and performance validity among clinically-referred patients undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD). METHOD Data from 203 patients who completed the WAIS-IV Working Memory Index, the Clinical Assessment of Attention Deficit-Adult (CAT-A), and ≥4 criterion performance validity tests (PVTs) were analyzed. RESULTS Symptom and performance validity were concordant in 76% of cases, with the majority being valid performance. Of the remaining 24% of cases with divergent validity findings, patients were more likely to exhibit symptom invalidity (15%) than performance invalidity (9%). Patients demonstrating symptom invalidity endorsed significantly more ADHD symptoms than those with credible symptom reporting (ηp2 = .06-.15), but comparable working memory test performance, whereas patients with performance invalidity had significantly worse working memory performance than those with valid PVT performance (ηp2 = .18). CONCLUSION Symptom and performance invalidity represent dissociable constructs in patients undergoing neuropsychological evaluation of ADHD and should be evaluated independently.
Collapse
Affiliation(s)
- Daniel J White
- University of Illinois College of Medicine, Chicago, IL USA.,Roosevelt University, Chicago, IL, USA
| | | | - Tasha Rhoads
- University of Illinois College of Medicine, Chicago, IL USA
| | - Zachary J Resch
- University of Illinois College of Medicine, Chicago, IL USA.,Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Mary Lee
- University of Illinois College of Medicine, Chicago, IL USA
| | - Alison J Oh
- University of Illinois College of Medicine, Chicago, IL USA
| | - Jason R Soble
- University of Illinois College of Medicine, Chicago, IL USA
| |
Collapse
|
23
|
Davey DK, Jurick SM, Crocker LD, Hoffman SN, Sanderson-Cimino M, Tate DF, Velez CS, Delano-Wood L, Jak AJ. White matter integrity, suicidal ideation, and cognitive dysfunction in combat-exposed Iraq and Afghanistan Veterans. Psychiatry Res Neuroimaging 2021; 317:111389. [PMID: 34563989 DOI: 10.1016/j.pscychresns.2021.111389] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 08/31/2021] [Accepted: 09/08/2021] [Indexed: 11/26/2022]
Abstract
White matter alterations in frontolimbic circuits and poorer cognitive functioning have been observed in individuals endorsing suicidality across numerous psychiatric conditions. However, relationships between white matter integrity, cognition, and suicidality in Veterans are poorly understood, particularly for those at increased risk for suicide due to mental health conditions (e.g., posttraumatic stress disorder, depression) and traumatic brain injury history. We (1) examined white matter alterations in combat-exposed Iraq/Afghanistan Veterans with and without suicidal ideation (SI) and (2) investigated relationships between white matter integrity and neuropsychological functioning in regions that differed between SI groups. No group differences were found regarding psychiatric diagnoses. Participants with SI had lower fractional anisotropy (FA) in the posterior corona radiata, superior corona radiata, and superior longitudinal fasciculus relative to those without SI. Worse processing speed/attention performance was associated with lower FA in the superior longitudinal fasciculus, while worse executive functioning performance was associated with lower FA in the superior corona radiata and superior longitudinal fasciculus. Memory performance was not associated with FA. These findings suggest that white matter integrity may be involved in cognitive dysfunction and increased risk for SI. Interventions that target cognitive dysfunction may ameliorate SI, and in turn, reduce risk for suicide among Veterans.
Collapse
Affiliation(s)
- Delaney K Davey
- Research Service, VA San Diego Healthcare System, San Diego, CA, United States
| | - Sarah M Jurick
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, United States; Psychology Service, VA San Diego Healthcare System, San Diego, CA, United States
| | - Laura D Crocker
- Research Service, VA San Diego Healthcare System, San Diego, CA, United States; Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, United States
| | - Samantha N Hoffman
- San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - Mark Sanderson-Cimino
- San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - David F Tate
- Department of Neurology, School of Medicine, University of Utah, Salt Lake City, UT, United States; George E. Wahlen VA Medical Center, Salt Lake City, UT, United States
| | - Carmen S Velez
- Department of Neurology, School of Medicine, University of Utah, Salt Lake City, UT, United States
| | - Lisa Delano-Wood
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, United States; Psychology Service, VA San Diego Healthcare System, San Diego, CA, United States; Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA, United States
| | - Amy J Jak
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, United States; Psychology Service, VA San Diego Healthcare System, San Diego, CA, United States; Department of Psychiatry, School of Medicine, University of California San Diego, La Jolla, CA, United States.
| |
Collapse
|
24
|
Lace JW, Merz ZC, Galioto R. Examining the Clinical Utility of Selected Memory-Based Embedded Performance Validity Tests in Neuropsychological Assessment of Patients with Multiple Sclerosis. Neurol Int 2021; 13:477-486. [PMID: 34698256 PMCID: PMC8544445 DOI: 10.3390/neurolint13040047] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/02/2021] [Accepted: 09/08/2021] [Indexed: 11/16/2022] Open
Abstract
Within the neuropsychological assessment, clinicians are responsible for ensuring the validity of obtained cognitive data. As such, increased attention is being paid to performance validity in patients with multiple sclerosis (pwMS). Experts have proposed batteries of neuropsychological tests for use in this population, though none contain recommendations for standalone performance validity tests (PVTs). The California Verbal Learning Test, Second Edition (CVLT-II) and Brief Visuospatial Memory Test, Revised (BVMT-R)—both of which are included in the aforementioned recommended neuropsychological batteries—include previously validated embedded PVTs (which offer some advantages, including expedience and reduced costs), with no prior work exploring their utility in pwMS. The purpose of the present study was to determine the potential clinical utility of embedded PVTs to detect the signal of non-credibility as operationally defined by below criterion standalone PVT performance. One hundred thirty-three (133) patients (M age = 48.28; 76.7% women; 85.0% White) with MS were referred for neuropsychological assessment at a large, Midwestern academic medical center. Patients were placed into “credible” (n = 100) or “noncredible” (n = 33) groups based on a standalone PVT criterion. Classification statistics for four CVLT-II and BVMT-R PVTs of interest in isolation were poor (AUCs = 0.58–0.62). Several arithmetic and logistic regression-derived multivariate formulas were calculated, all of which similarly demonstrated poor discriminability (AUCs = 0.61–0.64). Although embedded PVTs may arguably maximize efficiency and minimize test burden in pwMS, common ones in the CVLT-II and BVMT-R may not be psychometrically appropriate, sufficiently sensitive, nor substitutable for standalone PVTs in this population. Clinical neuropsychologists who evaluate such patients are encouraged to include standalone PVTs in their assessment batteries to ensure that clinical care conclusions drawn from neuropsychological data are valid.
Collapse
Affiliation(s)
- John W. Lace
- Neurological Institute, Section of Neuropsychology, Cleveland Clinic Foundation, Cleveland, OH 44195, USA;
- Correspondence:
| | - Zachary C. Merz
- LeBauer Department of Neurology, The Moses H. Cone Memorial Hospital, Greensboro, NC 27401, USA;
| | - Rachel Galioto
- Neurological Institute, Section of Neuropsychology, Cleveland Clinic Foundation, Cleveland, OH 44195, USA;
- Mellen Center for Multiple Sclerosis, Cleveland Clinic Foundation, Cleveland, OH 44195, USA
| |
Collapse
|
25
|
Future Directions in Performance Validity Assessment to Optimize Detection of Invalid Neuropsychological Test Performance: Special Issue Introduction. PSYCHOLOGICAL INJURY & LAW 2021; 14:227-231. [PMID: 34567346 PMCID: PMC8455301 DOI: 10.1007/s12207-021-09425-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 09/13/2021] [Indexed: 11/27/2022]
|
26
|
Dunn A, Pyne S, Tyson B, Roth R, Shahein A, Erdodi L. Critical Item Analysis Enhances the Classification Accuracy of the Logical Memory Recognition Trial as a Performance Validity Indicator. Dev Neuropsychol 2021; 46:327-346. [PMID: 34525856 DOI: 10.1080/87565641.2021.1956499] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE : Replicate previous research on Logical Memory Recognition (LMRecog) and perform a critical item analysis. METHOD : Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LMRecog and nine critical items (CR-9) was computed. RESULTS : LMRecog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LMRecog ≤20; CR-9 ≥6 increased specificity by 6-8% over LMRecog ≤20; CR-9 ≥7 increased specificity by 8-15%. CONCLUSIONS : Critical item analysis enhances the classification accuracy of the optimal LMRecog cutoff (≤20).
Collapse
Affiliation(s)
- Alexa Dunn
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Sadie Pyne
- Windsor Neuropsychology, Windsor, Canada
| | - Brad Tyson
- Neuroscience Institute, Evergreen Neuroscience Institute, EvergreenHealth Medical Center, Kirkland, USA
| | - Robert Roth
- Neuropsychology Services, Dartmouth-Hitchcock Medical Center, USA
| | - Ayman Shahein
- Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | - Laszlo Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|
27
|
Joseph ALC, Lippa SM, McNally SM, Garcia KM, Leary JB, Dsurney J, Chan L. Estimating premorbid intelligence in persons with traumatic brain injury: an examination of the Test of Premorbid Functioning. APPLIED NEUROPSYCHOLOGY. ADULT 2021; 28:535-543. [PMID: 31519111 PMCID: PMC7067634 DOI: 10.1080/23279095.2019.1661247] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Knowledge of intelligence is essential for interpreting cognitive performance following traumatic brain injury (TBI). The Test of Premorbid Functioning (ToPF), a word reading test co-normed with the Wechsler Adult Intelligence Scale 4th Edition (WAIS-IV), was examined as a tool for estimating premorbid intelligence in persons with a history of TBI. Fifty-two participants with mild, moderate, or severe TBI were administered the ToPF and WAIS-IV between two weeks and 19 months post-injury. The independent ability of the ToPF/demographic score and the Verbal Comprehension Index (VCI) to predict WAIS-IV Full Scale IQ (FSIQ) was examined, as were discrepancies between ToPF and WAIS-IV scores within and between participants. The ToPF/demographic predicted FSIQ accounted for a significant proportion of variability in actual FSIQ, above and beyond that accounted for by education or time since injury. ToPF and WAIS-IV scores did not differ by injury severity. In our sample, the ToPF/demographic predicted FSIQ underestimated intelligence in a substantial portion of our participants (31%), particularly in those with high average to superior intelligence. Finally, VCI scores were more predictive of actual FSIQ than the ToPF/demographic predicted FSIQ. The ToPF frequently underestimated post-injury intelligence and is therefore not accurately measuring premorbid intelligence in our sample, particularly in those with above average to superior intelligence. Clinicians are encouraged to administer the entire WAIS-IV, or at minimum the VCI subtests, for a more accurate measure of intelligence in those with above average intelligence and history of TBI.
Collapse
Affiliation(s)
- Annie-Lori C. Joseph
- Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD, USA
| | - S. M. Lippa
- Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD, USA
- Defense and Veterans Brain Injury Center, Bethesda, MD, USA
- National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA
| | - S. M. McNally
- Center for Neuroscience and Regenerative Medicine, National Institutes of Health Clinical Center, Bethesda, MD
| | - K. M. Garcia
- Center for Neuroscience and Regenerative Medicine, National Institutes of Health Clinical Center, Bethesda, MD
| | - J. B. Leary
- Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD, USA
| | - J. Dsurney
- Tampa Psychological Associates, Tampa, FL, USA
| | - L. Chan
- Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD, USA
- Center for Neuroscience and Regenerative Medicine, National Institutes of Health Clinical Center, Bethesda, MD
| |
Collapse
|
28
|
Lace JW, Merz ZC, Galioto R. Nonmemory Composite Embedded Performance Validity Formulas in Patients with Multiple Sclerosis. Arch Clin Neuropsychol 2021; 37:309-321. [PMID: 34467368 DOI: 10.1093/arclin/acab066] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/21/2021] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE Research regarding performance validity tests (PVTs) in patients with multiple sclerosis (MS) is scant, with recommended batteries for neuropsychological evaluations in this population lacking suggestions to include PVTs. Moreover, limited work has examined embedded PVTs in this population. As previous investigations indicated that nonmemory-based embedded PVTs provide clinical utility in other populations, this study sought to determine if a logistic regression-derived PVT formula can be identified from selected nonmemory variables in a sample of patients with MS. METHOD A total of 184 patients (M age = 48.45; 76.6% female) with MS were referred for neuropsychological assessment at a large, Midwestern academic medical center. Patients were placed into "credible" (n = 146) or "noncredible" (n = 38) groups according to performance on standalone PVT. Missing data were imputed with HOTDECK. RESULTS Classification statistics for a variety of embedded PVTs were examined, with none appearing psychometrically appropriate in isolation (areas under the curve [AUCs] = .48-.64). Four exponentiated equations were created via logistic regression. Six, five, and three predictor equations yielded acceptable discriminability (AUC = .71-.74) with modest sensitivity (.34-.39) while maintaining good specificity (≥.90). The two predictor equation appeared unacceptable (AUC = .67). CONCLUSIONS Results suggest that multivariate combinations of embedded PVTs may provide some clinical utility while minimizing test burden in determining performance validity in patients with MS. Nonetheless, the authors recommend routine inclusion of several PVTs and utilization of comprehensive clinical judgment to maximize signal detection of noncredible performance and avoid incorrect conclusions. Clinical implications, limitations, and avenues for future research are discussed.
Collapse
Affiliation(s)
- John W Lace
- Section of Neuropsychology, P57, Cleveland Clinic, Cleveland, OH, USA
| | - Zachary C Merz
- LeBauer Department of Neurology, The Moses H. Cone Memorial Hospital, Greensboro, NC, USA
| | - Rachel Galioto
- Section of Neuropsychology, P57, Cleveland Clinic, Cleveland, OH, USA.,Mellen Center for Multiple Sclerosis, Cleveland Clinic, Cleveland, OH, USA
| |
Collapse
|
29
|
Uiterwijk D, Wong D, Stargatt R, Crowe SF. Performance and symptom validity testing in neuropsychological assessments in Australia: a survey of practises and beliefs. AUSTRALIAN PSYCHOLOGIST 2021. [DOI: 10.1080/00050067.2021.1948797] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Affiliation(s)
- Daniel Uiterwijk
- School of Psychology and Public Health, La Trobe University, Victoria Australia
| | - Dana Wong
- School of Psychology and Public Health, La Trobe University, Victoria Australia
| | - Robyn Stargatt
- School of Psychology and Public Health, La Trobe University, Victoria Australia
| | - Simon F. Crowe
- School of Psychology and Public Health, La Trobe University, Victoria Australia
| |
Collapse
|
30
|
Messa I, Holcomb M, Lichtenstein JD, Tyson BT, Roth RM, Erdodi LA. They are not destined to fail: a systematic examination of scores on embedded performance validity indicators in patients with intellectual disability. AUST J FORENSIC SCI 2021. [DOI: 10.1080/00450618.2020.1865457] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Affiliation(s)
- Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | | | | | - Brad T Tyson
- Neuropsychological Service, EvergreenHealth Medical Center, Kirkland, WA, USA
| | - Robert M Roth
- Department of Psychiatry, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
31
|
Martinez KA, Sayers C, Hayes C, Martin PK, Clark CB, Schroeder RW. Normal cognitive test scores cannot be interpreted as accurate measures of ability in the context of failed performance validity testing: A symptom- and detection-coached simulation study. J Clin Exp Neuropsychol 2021; 43:301-309. [PMID: 33998369 DOI: 10.1080/13803395.2021.1926435] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Introduction: While use of performance validity tests (PVTs) has become a standard of practice in neuropsychology, there are differing opinions regarding whether to interpret cognitive test data when standard scores fall within normal limits despite PVTs being failed. This study is the first to empirically determine whether normal cognitive test scores underrepresent functioning when PVTs are failed.Method: Participants, randomly assigned to either a simulated malingering group (n = 50) instructed to mildly suppress test performances or a best-effort/control group (n = 50), completed neuropsychological tests which included the North American Adult Reading Test (NAART), California Verbal Learning Test - 2nd Edition (CVLT-II), and Test of Memory Malingering (TOMM).Results: Groups were not significantly different in age, sex, education, or NAART predicted intellectual ability, but simulators performed significantly worse than controls on the TOMM, CVLT-II Forced Choice Recognition, and CVLT-II Short Delay Free Recall. The groups did not significantly differ on other examined CVLT-II measures. Of simulators who failed validity testing, 36% scored no worse than average and 73% scored no worse than low average on any of the examined CVLT-II indices.Conclusions: Of simulated malingerers who failed validity testing, nearly three-fourths were able to produce cognitive test scores that were within normal limits, which indicates that normal cognitive performances cannot be interpreted as accurately reflecting an individual's capabilities when obtained in the presence of validity test failure. At the same time, only 2 of 50 simulators were successful in passing validity testing while scoring within an impaired range on cognitive testing. This latter finding indicates that successfully feigning cognitive deficits is difficult when PVTs are utilized within the examination.
Collapse
Affiliation(s)
- Karen A Martinez
- Department of Psychology, Wichita State University, Wichita, KS, USA
| | - Courtney Sayers
- Department of Psychology, Wichita State University, Wichita, KS, USA
| | - Charles Hayes
- Department of Psychology, Wichita State University, Wichita, KS, USA
| | - Phillip K Martin
- Department of Psychiatry & Behavioral Sciences, University of Kansas School of Medicine - Wichita, Wichita, KS, USA
| | - C Brendan Clark
- Department of Psychology, Wichita State University, Wichita, KS, USA
| | - Ryan W Schroeder
- Department of Psychiatry & Behavioral Sciences, University of Kansas School of Medicine - Wichita, Wichita, KS, USA
| |
Collapse
|
32
|
Ovsiew GP, Carter DA, Rhoads T, Resch ZJ, Jennette KJ, Soble JR. Concordance Between Standard and Abbreviated Administrations of the Test of Memory Malingering: Implications for Streamlining Performance Validity Assessment. PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09408-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
33
|
Resch ZJ, Paxton JL, Obolsky MA, Lapitan F, Cation B, Schulze ET, Calderone V, Fink JW, Lee RC, Pliskin NH, Soble JR. Establishing the base rate of performance invalidity in a clinical electrical injury sample: Implications for neuropsychological test performance. J Clin Exp Neuropsychol 2021; 43:213-223. [PMID: 33858295 DOI: 10.1080/13803395.2021.1914002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Objective: The base rate of neuropsychological performance invalidity in electrical injury, a clinically-distinct and frequently compensation-seeking population, is not well established. This study determined the base rate of performance invalidity in a large electrical injury sample, and examined patient characteristics, injury parameters, and neuropsychological test performance based on validity status.Method: This cross-sectional study included data from 101 patients with electrical injury consecutively referred for post-acute neuropsychological evaluation. Eighty-five percent of the sample was compensation-seeking. Multiple performance validity tests (PVTs) were administered as part of standard clinical evaluation. For patients with four or more PVTs, valid performance was operationalized as less than or equal to one PVT failure and invalid performance as two or more failures.Results: Frequency analysis revealed 66% (n = 67) had valid performance while 29% (n = 29) demonstrated probable invalid performance; the remaining 5% (n = 5) had indeterminate validity. No significant differences in demographics or injury parameters emerged between validity groups (0 vs. 1 vs. ≥2 PVT failures). In contrast, the electrical injury group with invalid performance performed significantly worse across tests of processing speed and executive abilities than those with valid performance (ps< .05, ηp2 = .19-.25).Conclusions: The current study is the first to establish the base rate of neuropsychological performance invalidity in electrical injury survivors using empirical methods and current practice standards. Patient and clinical variables, including compensation-seeking status, did not differ between validity groups; however, neuropsychological test performance did, supporting the need for multi-method, objective performance validity assessment.
Collapse
Affiliation(s)
- Zachary J Resch
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Jessica L Paxton
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Maximillian A Obolsky
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Franchezka Lapitan
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Bailey Cation
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Evan T Schulze
- Department of Neurology, Saint Louis University, St. Louis, MO, USA
| | - Veroly Calderone
- The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA
| | - Joseph W Fink
- The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA.,Department of Psychiatry and Behavioral Neuroscience, University of Chicago, Chicago, IL, USA
| | - Raphael C Lee
- The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA.,Departments of Surgery, Medicine and Organismal Biology, University of Chicago, Chicago, IL, USA
| | - Neil H Pliskin
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA.,Department of Neurology, University of Illinois at Chicago College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Neurology, University of Illinois at Chicago College of Medicine, Chicago, IL, USA
| |
Collapse
|
34
|
Strategies to detect invalid performance in cognitive testing: An updated and extended meta-analysis. CURRENT PSYCHOLOGY 2021. [DOI: 10.1007/s12144-021-01659-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
35
|
Ogawa EF, Leritz E, McGlinchey R, Milberg W, Bean JF. Metabolic Syndrome and Physical Performance: The Moderating Role of Cognition among Middle-to-Older-Aged Adults. J Int Neuropsychol Soc 2021; 27:172-180. [PMID: 32772961 PMCID: PMC8059433 DOI: 10.1017/s1355617720000788] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
OBJECTIVE Mobility limitation and cognitive decline are related. Metabolic syndrome (MetS), the clustering of three or more cardiovascular risk factors, is associated with decline in both mobility and cognition. However, the interrelationship among MetS, mobility, and cognition is unknown. This study investigated a proposed pathway where cognition moderates the relationship between MetS and Mobility. METHOD Adults ages 45-90 years were recruited. MetS risk factors and mobility performance (Short Physical Performance Battery (SPPB) and gait speed) were evaluated. Cognition was assessed using a comprehensive neuropsychological battery. A factor analysis of neuropsychological test scores yielded three factors: executive function, explicit memory, and semantic/contextual memory. Multivariable linear regression models were used to examine the relationship among MetS, mobility, and cognition. RESULTS Of the 74 participants (average age 61 ± 9 years; 41% female; 69% White), 27 (36%) participants manifested MetS. Mean SPPB score was 10.9 ± 1.2 out of 12 and gait speed was 1.0 ± 0.2 m/s. There were no statistically significant differences in mobility by MetS status. However, increase in any one of the MetS risk factors was associated with decreased mobility performance after adjusting for age and gender (SPPB score: β (SE) -.17 (0.08), p < .05; gait speed: -.03 (.01), p < .01). Further adjusting for cognitive factors (SPPB score: explicit memory .31 (.14), p = .03; executive function 0.45 (0.13), p < .01; gait speed: explicit memory 0.04 (0.02), p = .03; executive function 0.06 (0.02), p < .01) moderated the relationships between number of metabolic risk factors and mobility. CONCLUSION The relationship between metabolic risk factors and mobility may be moderated by cognitive performance, specifically through executive function and explicit memory.
Collapse
Affiliation(s)
- Elisa F. Ogawa
- New England Geriatric Research, Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - Elizabeth Leritz
- New England Geriatric Research, Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Neuroimaging Research for Veterans Center, Translational Research Center for TBI and Stress Disorders, VA Boston Healthcare System, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Regina McGlinchey
- New England Geriatric Research, Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Neuroimaging Research for Veterans Center, Translational Research Center for TBI and Stress Disorders, VA Boston Healthcare System, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - William Milberg
- New England Geriatric Research, Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Neuroimaging Research for Veterans Center, Translational Research Center for TBI and Stress Disorders, VA Boston Healthcare System, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Jonathan F. Bean
- New England Geriatric Research, Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
- Spaulding Rehabilitation Hospital, Boston, MA, USA
| |
Collapse
|
36
|
Basso MR, Whiteside D, Combs D, Woods SP, Hoffmeister J, Mulligan R, Arnett P, Alden E, Tobin O. Memory in multiple sclerosis: A reappraisal using the item specific deficit approach. Neuropsychology 2021; 35:207-219. [PMID: 33764111 PMCID: PMC8396077 DOI: 10.1037/neu0000712] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023] Open
Abstract
OBJECTIVE As many as 65% of people with multiple sclerosis (MS) have clinically significant memory impairment, but the nature of this deficit is controversial. Some investigations suggest that an inability to retrieve newly learned information from memory is prominent, whereas others imply that compromised acquisition accounts for impairment. Prior research has not simultaneously evaluated acquisition and retrieval processes in MS, and fewer have attempted to account for initial acquisition when studying retrieval. The Item Specific Deficit Approach (ISDA) offers a method of quantifying acquisition, retrieval, and retention processes, with the latter two mechanisms being adjusted for initial acquisition. To simultaneously quantify acquisition and retrieval abilities, the ISDA was applied to list learning performance in two independent samples of people with MS and corresponding healthy comparison groups. PARTICIPANTS AND METHODS Study 1 included 85 people with MS and 47 healthy individuals. Study 2 involved a separate sample of 79 people with MS and 22 healthy people. They were administered neuropsychological batteries, and participants with MS were classified as globally impaired or unimpaired. The California Verbal Learning Test-II was administered to assess new-learning in both studies, and responses were scored using the ISDA. RESULTS Both studies revealed that cognitively impaired people with MS manifest weaknesses involving acquisition and retrieval. Nearly identical effect sizes emerged across samples, with cognitive impairment achieving a medium effect upon acquisition and a large effect upon retrieval. CONCLUSIONS These findings accord well with previous research showing diminished acquisition and retrieval among people with MS. The results may also reconcile contradictory findings in the extant literature by showing that memory impairment in MS is not exclusively attributable to either acquisition or retrieval. Rather, both processes may manifest across people with MS. The replication across samples with nearly identical effect sizes implies that these effects are reliable and possess external validity. These data hold implications for memory rehabilitation interventions involving people with MS, and suggest that acquisition and retrieval processes should be addressed in treatment. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
37
|
Cerny BM, Rhoads T, Leib SI, Jennette KJ, Basurto KS, Durkin NM, Ovsiew GP, Resch ZJ, Soble JR. Mean response latency indices on the Victoria Symptom Validity Test do not contribute meaningful predictive value over accuracy scores for detecting invalid performance. APPLIED NEUROPSYCHOLOGY-ADULT 2021; 29:1304-1311. [PMID: 33470869 DOI: 10.1080/23279095.2021.1872575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
The utility of the Victoria Symptom Validity Test (VSVT) as a performance validity test (PVT) has been primarily established using response accuracy scores. However, the degree to which response latency may contribute to accurate classification of performance invalidity over and above accuracy scores remains understudied. Therefore, this study investigated whether combining VSVT accuracy and response latency scores would increase predictive utility beyond use of accuracy scores alone. Data from a mixed clinical sample of 163 patients, who were administered the VSVT as part of a larger neuropsychological battery, were analyzed. At least four independent criterion PVTs were used to establish validity groups (121 valid/42 invalid). Logistic regression models examining each difficulty level revealed that all VSVT measures were useful in classifying validity groups, both independently and when combined. Individual predictor classification accuracy ranged from 77.9 to 81.6%, indicating acceptable to excellent discriminability across the validity indices. The results of this study support the value of both accuracy and latency scores on the VSVT to identify performance invalidity, although the accuracy scores had superior classification statistics compared to response latency, and mean latency indices provided no unique benefit for classification accuracy beyond dimensional accuracy scores alone.
Collapse
Affiliation(s)
- Brian M Cerny
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Psychology, Illinois Institute of Technology, Chicago, IL, USA
| | - Tasha Rhoads
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Sophie I Leib
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Karen S Basurto
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Nicole M Durkin
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
38
|
Victoria Symptom Validity Test: A Systematic Review and Cross-Validation Study. Neuropsychol Rev 2021; 31:331-348. [PMID: 33433828 DOI: 10.1007/s11065-021-09477-5] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Accepted: 01/03/2021] [Indexed: 12/12/2022]
Abstract
The Victoria Symptom Validity Test (VSVT) is a performance validity test (PVT) with over two decades of empirical backing, although methodological limitations within the extant literature restrict its clinical and research generalizability. Chief among these constraints includes limited consensus on the most accurate index within the VSVT and the most appropriate cut-scores within each VSVT validity index. The current systematic review synthesizes existing VSVT validation studies and provides additional cross-validation in an independent sample using a known-groups design. We completed a systematic search of the literature, identifying 17 peer-reviewed studies for synthesis (7 simulation designs, 7 differential prevalence designs, and 3 known-groups designs). The independent cross-validation sample consisted of 200 mixed clinical neuropsychiatric patients referred for outpatient neuropsychological evaluation. Across all indices, Total item accuracy produced the strongest psychometric properties at an optimal cut-score of ≤ 40 (62% sensitivity/88% specificity). However, ROC curve analyses for all VSVT indices yielded statistically significant areas under the curve (AUCs; .73-81), suggestive of moderate classification accuracy. Cut-scores derived using the independent cross-validation sample converged with some previous findings supporting cut-scores of ≤ 22 for Easy item accuracy and ≤ 40 for Total item accuracy, although divergent findings were noted for Difficult item accuracy. Overall, VSVT validity indicators have adequate diagnostic accuracy across populations, with the current study providing additional support for its use as a psychometrically sound PVT in clinical settings. However, caution is recommended among patients with certain verified clinical conditions (e.g., dementia) and those with pronounced working memory deficits due to concerns for increased risk of false positives.
Collapse
|
39
|
Sanchez-Flack JC, Tussing-Humphreys L, Lamar M, Fantuzzi G, Schiffer L, Blumstein L, McLeod A, Dakers R, Strahan D, Restrepo L, Hemphill NON, Siegel L, Antonic M, Fitzgibbon M. Building research in diet and cognition (BRIDGE): Baseline characteristics of older obese African American adults in a randomized controlled trial to examine the effect of the Mediterranean diet with and without weight loss on cognitive functioning. Prev Med Rep 2020; 22:101302. [PMID: 33665063 PMCID: PMC7902520 DOI: 10.1016/j.pmedr.2020.101302] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2020] [Revised: 11/24/2020] [Accepted: 12/01/2020] [Indexed: 12/29/2022] Open
Abstract
The MedDiet is correlated with slower cognitive decline in longitudinal studies. Self-reported MedDiet adherence positively associated with select cognitive domains. Women outperformed men across verbal tasks, including learning and memory. Younger participants outperformed older participants on cognitive assessments.
In the United States, >5.4 million people age 65 and older are affected by cognitive impairment and dementia, including Alzheimer’s disease. African Americans are more likely than non-Hispanic whites to suffer from these disorders. Obesity is linked to accelerated age-related cognitive decline, and weight loss through caloric restriction is a potential strategy to prevent this cognitive impairment. Adherence to a healthful dietary pattern, such as the Mediterranean Diet (MedDiet), has also shown positive effects on reducing risk for dementia. African Americans are disproportionately affected by obesity and have less healthful diets than non-Hispanic whites. We present baseline characteristics from a three-arm randomized controlled trial that randomized 185 obese (BMI ≥ 30 kg/m2 and ≤ 50 kg/m2) healthy older adults (55–85 years of age) to: 1) Typical Diet Control (TDC); 2) MedDiet alone (MedDiet-A) intervention; or 3) MedDiet caloric restricted intervention to promote weight loss (MedDiet-WL). The majority of the sample was African American (91.4%) and female (85.9%). The two active interventions (MedDiet-A and MedDiet-WL) met once weekly for 8 months, and the TDC received weekly general health newsletters. Baseline data were collected between January 2017 and July 2019 in Chicago, IL. In our sample, closer adherence to a MedDiet pattern was associated with higher attention and information processing (AIP) and higher executive functioning (EF). Consistent with the literature, we saw that older participants performed more poorly on the cognitive assessments than younger participants, and women outperformed men across verbally mediated tasks, especially ones related to learning and memory.
Collapse
Affiliation(s)
- Jennifer C Sanchez-Flack
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States.,Department of Pediatrics, University of Illinois at Chicago, 1200 West Harrison Street, Chicago, IL 60607, United States
| | - Lisa Tussing-Humphreys
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States.,Department of Medicine, University of Illinois at Chicago, 1853 West Polk Street, Chicago, IL 60612, United States.,University of Illinois Cancer Center, University of Illinois at Chicago, 818 South Wolcott Avenue, Chicago, IL 60612, United States
| | - Melissa Lamar
- Rush Alzheimer's Disease Center, Rush University, 1750 West Harrison Street, Chicago, IL 60612, United States
| | - Giamilla Fantuzzi
- Department of Kinesiology and Nutrition, University of Illinois at Chicago, 1919 W. Taylor Street, Chicago, IL 60612, United States
| | - Linda Schiffer
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States
| | - Lara Blumstein
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States
| | - Andrew McLeod
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States.,Department of Medicine, University of Illinois at Chicago, 1853 West Polk Street, Chicago, IL 60612, United States
| | - Roxanne Dakers
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States
| | - Desmona Strahan
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States
| | - Leo Restrepo
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States
| | - Nefertiti Oji Njideka Hemphill
- Department of Kinesiology and Nutrition, University of Illinois at Chicago, 1919 W. Taylor Street, Chicago, IL 60612, United States
| | - Leilah Siegel
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States.,University of Illinois Cancer Center, University of Illinois at Chicago, 818 South Wolcott Avenue, Chicago, IL 60612, United States
| | - Mirjana Antonic
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States
| | - Marian Fitzgibbon
- Institute for Health Research and Policy, University of Illinois at Chicago, 1747 West Roosevelt Road, Chicago, IL 60608, United States.,Department of Medicine, University of Illinois at Chicago, 1853 West Polk Street, Chicago, IL 60612, United States.,University of Illinois Cancer Center, University of Illinois at Chicago, 818 South Wolcott Avenue, Chicago, IL 60612, United States.,Department of Pediatrics, University of Illinois at Chicago, 1200 West Harrison Street, Chicago, IL 60607, United States
| |
Collapse
|
40
|
Kosky KM, Lace JW, Austin TA, Seitz DJ, Clark B. The utility of the Wisconsin card sorting test, 64-card version to detect noncredible attention-deficit/hyperactivity disorder. APPLIED NEUROPSYCHOLOGY-ADULT 2020; 29:1231-1241. [DOI: 10.1080/23279095.2020.1864633] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Affiliation(s)
- Karen M. Kosky
- Department of Health Psychology, University of Missouri, Columbia, MO, USA
| | - John W. Lace
- Department of Neurology, Cleveland Clinic, Cleveland, OH, USA
| | - Tara A. Austin
- University of Texas at Austin Dell Medical School, Austin, TX, USA
| | - Dylan J. Seitz
- Department of Neurology, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Brook Clark
- Department of Health Psychology, University of Missouri, Columbia, MO, USA
| |
Collapse
|
41
|
Abstract
OBJECTIVE Performance validity tests (PVTs) are designed to detect nonvalid responding on neuropsychological testing, but their associations with disease-specific and other factors are not well understood in multiple sclerosis (MS). We examined PVT performance among MS patients and associations with clinical characteristics, cognition, mood, and disability status. METHOD Retrospective data analysis was conducted on a sample of patients with definite MS (n = 102) who were seen for a clinical neuropsychological evaluation. Comparison samples included patients with intractable epilepsy seen for presurgical workup (n = 102) and patients with nonacute mild traumatic brain injury (mTBI; n = 50). Patients completed the Victoria Symptom Validity Test (VSVT) and validity cutoffs were defined as <16/24 and <18/24 on the hard items. RESULTS In this MS cohort, 14.4% of patients scored <16 on the VSVT hard items and 21.2% scored <18. VSVT hard item scores were associated with disability status and depression, but not with neuropsychological scores, T2 lesion burden, atrophy, disease duration, or MS subtype. Patients applying for disability benefits were 6.75 times more likely to score <18 relative to those who were not seeking disability. Rates of nonvalid scores were similar to the mTBI group and greater than the epilepsy group. CONCLUSIONS This study demonstrates that nonvalid VSVT scores are relatively common among MS patients seen for clinical neuropsychological evaluation. VSVT performance in this group relates primarily to disability status and psychological symptoms and does not reflect factors specific to MS (i.e., cognitive impairment, disease severity). Recommendations for future clinical and research practices are provided.
Collapse
|
42
|
Erdodi LA, Abeare CA. Stronger Together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain Injury. Arch Clin Neuropsychol 2020; 35:188-204. [PMID: 31696203 DOI: 10.1093/arclin/acz032] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 06/18/2019] [Accepted: 06/22/2019] [Indexed: 12/17/2022] Open
Abstract
OBJECTIVE This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV). METHOD Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance. RESULTS Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91-.95) over univariate cutoffs (.78-.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43-.67) compared to univariate cutoffs (.11-.63) while maintaining consistently high specificity (.93-.95). CONCLUSIONS In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment. BRIEF SUMMARY Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment.
Collapse
Affiliation(s)
- Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
43
|
Abeare CA, Hurtubise JL, Cutler L, Sirianni C, Brantuo M, Makhzoum N, Erdodi LA. Introducing a forced choice recognition trial to the Hopkins Verbal Learning Test – Revised. Clin Neuropsychol 2020; 35:1442-1470. [DOI: 10.1080/13854046.2020.1779348] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Affiliation(s)
| | | | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | | | - Maame Brantuo
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Nadeen Makhzoum
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
44
|
Holiday KA, Clark AL, Merritt VC, Nakhla MZ, Sorg S, Delano-Wood L, Schiehser DM. Response inhibition in Veterans with a history of mild traumatic brain injury: The role of self-reported complaints in objective performance. J Clin Exp Neuropsychol 2020; 42:556-568. [PMID: 32657255 DOI: 10.1080/13803395.2020.1776847] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
INTRODUCTION Although objective deficits in response inhibition (RI) have been detected in civilians with mild traumatic brain injury (mTBI), it remains unclear whether objective RI is worse in military Veterans with mTBI despite the prevalence of self-reported disinhibition. Assessing RI in Veterans is critical due to their unique characteristics, including combat and blast exposure, in addition to the prevalence of psychiatric comorbidity. Therefore, the aims of this study were to (1) examine RI performance in Veterans with mTBI compared to non-mTBI Veterans and (2) compare RI performance in well-defined subgroups of mTBI Veterans with and without self-reported complaints of disinhibition to non-mTBI Veterans. METHOD 53 mTBI Veterans and 37 non-mTBI Veterans completed a Go/No-Go RI task and measures of self-reported disinhibition (Frontal Systems Behavior Scale) and psychiatric symptoms. ANCOVAs covarying for mood and demographics compared RI performances of the non-mTBI Veterans to (1) the total sample of mTBI Veterans (n= 53) and to (2) mTBI Veterans with elevated (t-score ≥ 60; mTBI-SubjDis; n= 23) and low (t-score < 60; mTBI-NoSubjDis; n= 30) levels of self-reported disinhibition. RESULTS There were no significant differences in RI between the mTBI group as a whole and the non-mTBI Veterans group. However, when Veterans with mTBI were divided into groups by clinically-significant concern about their disinhibition, the mTBI-SubjDis group demonstrated significantly worse RI than the mTBI-NoSubjDis and non-mTBI Veteran groups. No significant differences in RI performance were observed between the mTBI-NoSubjDis and non-mTBI Veteran groups. CONCLUSIONS Results indicate that mTBI Veterans with elevated levels of self-reported disinhibition show diminished performance on objective measures of RI, independent of mood. Findings highlight the unique contribution of subjective complaints on executive functioning in mTBI, and they underscore the importance of assessing cognitive complaints in order to identify those most at risk for poor-long term outcomes.
Collapse
Affiliation(s)
- Kelsey A Holiday
- San Diego State University/University of California, San Diego (SDSU/UCSD) Joint Doctoral Program in Clinical Psychology , San Diego, CA, USA.,Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA
| | - Alexandra L Clark
- Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA
| | - Victoria C Merritt
- Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA
| | - Marina Z Nakhla
- San Diego State University/University of California, San Diego (SDSU/UCSD) Joint Doctoral Program in Clinical Psychology , San Diego, CA, USA.,Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA
| | - Scott Sorg
- Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA.,Department of Psychiatry, University of California , San Diego, CA, USA
| | - Lisa Delano-Wood
- Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA.,Department of Psychiatry, University of California , San Diego, CA, USA.,Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA
| | - Dawn M Schiehser
- Psychology and Research Services, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA.,Department of Psychiatry, University of California , San Diego, CA, USA.,Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System (VASDHS) , San Diego, CA, USA
| |
Collapse
|
45
|
Identifying Novel Embedded Performance Validity Test Formulas Within the Repeatable Battery for the Assessment of Neuropsychological Status: a Simulation Study. PSYCHOLOGICAL INJURY & LAW 2020. [DOI: 10.1007/s12207-020-09382-x] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
|
46
|
Ovsiew GP, Resch ZJ, Nayar K, Williams CP, Soble JR. Not so fast! Limitations of processing speed and working memory indices as embedded performance validity tests in a mixed neuropsychiatric sample. J Clin Exp Neuropsychol 2020; 42:473-484. [DOI: 10.1080/13803395.2020.1758635] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Gabriel P. Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Kritika Nayar
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychiatry and Behavioral Sciences, Northwestern Feinberg School of Medicine, Chicago, IL, USA
| | - Christopher P. Williams
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Jason R. Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
47
|
Polsinelli AJ, Cerhan JH. Early Cutoff Criteria for Strong Performance on the Test of Memory Malingering. Arch Clin Neuropsychol 2020; 35:429-433. [PMID: 31867600 DOI: 10.1093/arclin/acz079] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2019] [Revised: 11/19/2019] [Accepted: 11/26/2019] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE The Test of Memory Malingering (TOMM) is widely used to assess performance validity. To improve efficiency, we investigated whether abbreviated administration (i.e., only the first 25 items of Trial 1 [T1]) is possible when effort is very strong (≥49/50 on T1 or T2). METHOD We collected TOMM scores of 501 consecutive adult patients ranging in cognitive status who underwent standard neuropsychological evaluation at Mayo Clinic, Rochester, MN. RESULTS Receiver Operating Characteristic (ROC) analysis showed excellent area under the curve (AUC) (0.94; CI95% [0.92, 0.97]) and a cutoff of 25/25 had 100% specificity for identifying strong performance. Of the 224 patients who obtained a perfect score on the first 25 items, 197 (88%) obtained ≥49 on T1 and the remaining patients (n = 27) obtained ≥49 on T2. CONCLUSION A perfect score on the first 25 items of the TOMM predicted overall strong performance 100% of the time, supporting abbreviated administration in select cases in a general outpatient clinical setting.
Collapse
Affiliation(s)
| | - Jane H Cerhan
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN 55904, USA
| |
Collapse
|
48
|
Resch ZJ, Pham AT, Abramson DA, White DJ, DeDios-Stern S, Ovsiew GP, Castillo LR, Soble JR. Examining independent and combined accuracy of embedded performance validity tests in the California Verbal Learning Test-II and Brief Visuospatial Memory Test-Revised for detecting invalid performance. APPLIED NEUROPSYCHOLOGY-ADULT 2020; 29:252-261. [DOI: 10.1080/23279095.2020.1742718] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Zachary J. Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Amber T. Pham
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, DePaul University, Chicago, IL, USA
| | - Dayna A. Abramson
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Daniel J. White
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Samantha DeDios-Stern
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Gabriel P. Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Liliam R. Castillo
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R. Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
49
|
Domen CH, Greher MR, Hosokawa PW, Barnes SL, Hoyt BD, Wodushek TR. Are Established Embedded Performance Validity Test Cut-Offs Generalizable to Patients With Multiple Sclerosis? Arch Clin Neuropsychol 2020; 35:511-516. [DOI: 10.1093/arclin/acaa016] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2019] [Revised: 02/20/2019] [Accepted: 02/27/2020] [Indexed: 11/13/2022] Open
Abstract
Abstract
Objective
Data for the use of embedded performance validity tests (ePVTs) with multiple sclerosis (MS) patients are limited. The purpose of the current study was to determine whether ePVTs previously validated in other neurological samples perform similarly in an MS sample.
Methods
In this retrospective study, the prevalence of below-criterion responding at different cut-off scores was calculated for each ePVT of interest among patients with MS who passed a stand-alone PVT.
Results
Previously established PVT cut-offs generally demonstrated acceptable specificity when applied to our sample. However, the overall cognitive burden of the sample was limited relative to that observed in prior large-scale MS studies.
Conclusion
The current study provides initial data regarding the performance of select ePVTs among an MS sample. Results indicate most previously validated cut-offs avoid excessive false positive errors in a predominantly relapsing remitting MS sample. Further validation among MS patients with more advanced disease is warranted.
Collapse
Affiliation(s)
- Christopher H Domen
- Department of Neurosurgery, University of Colorado School of Medicine, Aurora, CO, USA
| | - Michael R Greher
- Department of Neurosurgery, University of Colorado School of Medicine, Aurora, CO, USA
| | | | - Sierra L Barnes
- Neurosciences, University of Colorado Health, Aurora, CO, USA
| | - Brian D Hoyt
- Department of Neurosurgery, University of Colorado School of Medicine, Aurora, CO, USA
| | - Thomas R Wodushek
- Department of Neurosurgery, University of Colorado School of Medicine, Aurora, CO, USA
| |
Collapse
|
50
|
Hurtubise J, Baher T, Messa I, Cutler L, Shahein A, Hastings M, Carignan-Querqui M, Erdodi LA. Verbal fluency and digit span variables as performance validity indicators in experimentally induced malingering and real world patients with TBI. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:337-354. [DOI: 10.1080/21622965.2020.1719409] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
| | - Tabarak Baher
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Ayman Shahein
- Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | | | | | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|