1
|
Rodriguez VJ, Basurto KS, Finley JCA, Liu Q, Khalid E, Halliburton AM, Tse PKY, Resch ZJ, Soble JR, Ulrich DM. Multidimensional ADHD Symptom Profiles: Associations with Adverse Childhood Experiences. Arch Clin Neuropsychol 2024:acae050. [PMID: 38916192 DOI: 10.1093/arclin/acae050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 05/14/2024] [Accepted: 06/10/2024] [Indexed: 06/26/2024] Open
Abstract
OBJECTIVE Adverse childhood experiences (ACEs) are associated with a range of negative health outcomes, including attention-deficit/hyperactivity disorder (ADHD) and neurocognitive deficits. This study identified symptom profiles in adult patients undergoing neuropsychological evaluations for ADHD and examined the association between these profiles and ACEs. METHODS Utilizing unsupervised machine learning models, the study analyzed data from 208 adult patients. RESULTS The Gaussian Mixture Model revealed two distinct symptom profiles: "Severely Impaired" and "Moderately Impaired". The "Severely Impaired" profile, 23.6% of the sample, was characterized by more severe ADHD symptomatology in childhood and worse neurocognitive performance. The "Moderately Impaired" profile, 76.4% of the sample, had scores in the average range for self-reported internalizing and externalizing psychopathology and better neurocognitive performance. There was a greater number of ACEs reported by patients in the Severely Impaired profile than the Moderately Impaired profile (p = .022). Specifically, using an ACEs cutoff of ≥4, 53.1% of patients in the Severely Impaired profile reported four or more ACEs, compared with 34.6% in the Moderately Impaired profile (p = .020). Profiles were not related to clinician-ascribed diagnosis. CONCLUSIONS Findings underscore the association between ACEs and worse symptom profiles marked by impaired neurocognitive function, increased internalizing and externalizing psychopathology, and heightened perceived stress in adults with ADHD. Future research may explore the effect of ACEs on symptom profiles in diverse populations and potential moderators or mediators of these associations. Findings offers valuable insights for clinicians in their assessment and treatment planning.
Collapse
Affiliation(s)
| | - Karen S Basurto
- Department of Psychiatry, University of Illinois, Chicago, IL, USA
| | - John-Christopher A Finley
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Qimin Liu
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA
| | - Elmma Khalid
- Department of Psychiatry, University of Illinois, Chicago, IL, USA
| | | | | | - Zachary J Resch
- Department of Psychiatry, University of Illinois, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois, Chicago, IL, USA
| | - Devin M Ulrich
- Department of Psychiatry, University of Illinois, Chicago, IL, USA
| |
Collapse
|
2
|
Brooks JM, Guilfoyle J, Alfonso D, Oh A, Nili AN, Frick LA, Resch ZJ, Soble JR, Ulrich DM. Differentiating Performance on the Connors Continuous Performance Test (CPT-3) as a Function of Comorbid Internalizing Psychopathology. J Atten Disord 2024; 28:1024-1031. [PMID: 38214177 DOI: 10.1177/10870547231219000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/13/2024]
Abstract
OBJECTIVE Internalizing psychopathology commonly co-occurs with attention-deficit/hyperactivity disorder (ADHD). Attention concerns are present in both ADHD and internalizing disorders, yet the neuropsychological functioning of those with comorbid ADHD and internalizing psychopathology is underexamined. METHOD This study compared Conners' Continuous Performance Test-Third Edition (CPT-3) profiles across ADHD (n = 141), internalizing psychopathology (n = 78), and comorbid (ADHD/internalizing psychopathology; n = 240) groups. RESULTS Compared to the internalizing psychopathology group, the comorbid group had higher mean T-scores on CPT-3 indices indicative of inattentiveness and impulsivity and more clinically elevated T-scores (T>60) on indices measuring inattentiveness and impaired sustained attention. Patients in the comorbid group were also more likely to have abnormal overall CPT-3 profiles (>2 elevated T-scores) than the ADHD and psychopathology only groups. CONCLUSION Patients with comorbid ADHD/internalizing psychopathology may evidence a more impaired attentional performance on the CPT-3, which could aid in more tailored treatment planning.
Collapse
Affiliation(s)
- Julia M Brooks
- University of Illinois College of Medicine, Chicago, USA
- University of Illinois at Chicago, IL, USA
| | - Janna Guilfoyle
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | - Alison Oh
- Illinois Institute of Technology, Chicago, USA
| | - Amanda N Nili
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | | | - Jason R Soble
- University of Illinois College of Medicine, Chicago, USA
| | - Devin M Ulrich
- University of Illinois College of Medicine, Chicago, USA
| |
Collapse
|
3
|
Khalid E, VanLandingham HB, Basurto KS, Nili AN, Gonzalez C, Guilfoyle JL, Ovsiew GP, Durkin NM, Ulrich DM, Resch ZJ, Pliskin NH, Soble JR, Cerny BM. Exploring Subfactors of Adult Cognitive Disengagement Syndrome and Impact on Neuropsychological Performance. J Atten Disord 2024; 28:957-969. [PMID: 38178579 DOI: 10.1177/10870547231218945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/06/2024]
Abstract
OBJECTIVE This study investigated subfactors of cognitive disengagement syndrome (CDS; previously referred as sluggish cognitive tempo) among adults referred for neuropsychological evaluation of attentiondeficit/hyperactivity disorder (ADHD). METHOD Retrospective analyses of data from 164 outpatient neuropsychological evaluations examined associations between CDS subfactors and self-reported psychological symptoms and cognitive performance. RESULTS Factor analysis produced two distinct but positively correlated constructs: "Cognitive Complaints'' and "Lethargy." Both correlated positively with symptom reports (rs = 0.26-0.57). Cognitive Complaints correlated negatively with working memory, processing speed, and executive functioning performance (rs = -0.21 to -0.37), whereas Lethargy correlated negatively only with processing speed and executive functioning performance (rs = -0.26 to -0.42). Both predicted depression symptoms, but only Cognitive Complaints predicted inattention symptoms. Both subfactors demonstrated modest to nonsignificant associations with cognitive performance after accounting for estimated premorbid intelligence and inattention. CONCLUSION Findings indicate a bidimensional conceptualization of CDS, with differential associations between its constituent subfactors, reported symptoms, and cognitive performance.
Collapse
Affiliation(s)
- Elmma Khalid
- University of Illinois College of Medicine, Chicago, IL, USA
- Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Hannah B VanLandingham
- University of Illinois College of Medicine, Chicago, IL, USA
- Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Karen S Basurto
- University of Illinois College of Medicine, Chicago, IL, USA
- Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Amanda N Nili
- University of Illinois College of Medicine, Chicago, IL, USA
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Christopher Gonzalez
- University of Illinois College of Medicine, Chicago, IL, USA
- Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Janna L Guilfoyle
- University of Illinois College of Medicine, Chicago, IL, USA
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | - Nicole M Durkin
- University of Illinois College of Medicine, Chicago, IL, USA
| | - Devin M Ulrich
- University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- University of Illinois College of Medicine, Chicago, IL, USA
| | - Neil H Pliskin
- University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- University of Illinois College of Medicine, Chicago, IL, USA
| | - Brian M Cerny
- University of Illinois College of Medicine, Chicago, IL, USA
- Illinois Institute of Technology, Chicago, IL, USA
| |
Collapse
|
4
|
Williamson ES, Arentsen TJ, Roper BL, Pedersen HA, Shultz LA, Crouse EM. The Importance of the Morel Emotional Numbing Test Instructions: A Diagnosis Threat Induction Study. Arch Clin Neuropsychol 2024; 39:35-50. [PMID: 37449530 DOI: 10.1093/arclin/acad048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/07/2023] [Indexed: 07/18/2023] Open
Abstract
OBJECTIVE Marketed as a validity test that detects feigning of posttraumatic stress disorder (PTSD), the Morel Emotional Numbing Test for PTSD (MENT) instructs examinees that PTSD may negatively affect performance on the measure. This study explored the potential that MENT performance depends on inclusion of "PTSD" in its instructions and the nature of the MENT as a performance validity versus a symptom validity test (PVT/SVT). METHOD 358 participants completed the MENT as a part of a clinical neuropsychological evaluation. Participants were either administered the MENT with the standard instructions (SIs) that referenced "PTSD" or revised instructions (RIs) that did not. Others were administered instructions that referenced "ADHD" rather than PTSD (AI). Comparisons were conducted on those who presented with concerns for potential traumatic-stress related symptoms (SI vs. RI-1) or attention deficit (AI vs. RI-2). RESULTS Participants in either the SI or AI condition produced more MENT errors than those in their respective RI conditions. The relationship between MENT errors and other S/PVTs was significantly stronger in the SI: RI-1 comparison, such that errors correlated with self-reported trauma-related symptoms in the SI but not RI-1 condition. MENT failure also predicted PVT failure at nearly four times the rate of SVT failure. CONCLUSIONS Findings suggest that the MENT relies on overt reference to PTSD in its instructions, which is linked to the growing body of literature on "diagnosis threat" effects. The MENT may be considered a measure of suggestibility. Ethical considerations are discussed, as are the construct(s) measured by PVTs versus SVTs.
Collapse
Affiliation(s)
- Emily S Williamson
- Department of Veterans Affairs, Lt. Col. Luke Weathers, Jr. VA Medical Center, Memphis, TN, USA
| | - Timothy J Arentsen
- Department of Veterans Affairs, Lt. Col. Luke Weathers, Jr. VA Medical Center, Memphis, TN, USA
- Department of Psychiatry, University of Tennessee Health Science Center, Memphis, TN, USA
| | - Brad L Roper
- Department of Veterans Affairs, Lt. Col. Luke Weathers, Jr. VA Medical Center, Memphis, TN, USA
- Department of Psychiatry, University of Tennessee Health Science Center, Memphis, TN, USA
| | - Heather A Pedersen
- Department of Veterans Affairs, Lt. Col. Luke Weathers, Jr. VA Medical Center, Memphis, TN, USA
| | - Laura A Shultz
- Department of Veterans Affairs, Lt. Col. Luke Weathers, Jr. VA Medical Center, Memphis, TN, USA
| | - Ellen M Crouse
- Department of Veterans Affairs, Lt. Col. Luke Weathers, Jr. VA Medical Center, Memphis, TN, USA
- Department of Psychiatry, University of Tennessee Health Science Center, Memphis, TN, USA
| |
Collapse
|
5
|
Keezer RD, Leib SI, Scimeca LM, Smith JT, Holbrook LR, Sharp DW, Jennette KJ, Ovsiew GP, Resch ZJ, Soble JR. Masking effect of high IQ on the Rey Auditory Verbal Learning Test in an adult sample with attention deficit/hyperactivity disorder. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:1-9. [PMID: 34623950 DOI: 10.1080/23279095.2021.1983575] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE High intelligence (IQ) adults with attention-deficit/hyperactivity disorder (ADHD) often perform better on neuropsychological tests relative to average IQ adults with ADHD, despite commensurate functional impairment. This study compared adults with ADHD and high versus average IQ on the Rey Auditory Verbal Learning Test (RAVLT) to specifically assess this proposed masking effect of IQ on verbal learning/memory performance among those undergoing neuropsychological evaluation. METHOD RAVLT performance between patients with ADHD and average versus high Test of Premorbid Function-estimated IQ were compared. Latent growth curve modeling (LGCM) evaluated learning acquisition across trials. RESULTS RAVLT total learning, immediate, and delayed free recall performances were significantly better in the high IQ relative to the average IQ group. LGCM showed similar quadradic growth trajectories for both IQ groups. Both groups reported equivalent symptom severity and functional complaints in childhood and adulthood. CONCLUSIONS Adults with ADHD and high IQ performed normally on a verbal learning/memory test compared to adults with average IQ, who scored 0.5-1.0 standard deviations below the mean. These results suggest a masking of performance-based memory deficits in the context of higher IQ in adults with ADHD, supporting growing evidence that higher IQ masks neurocognitive deficits during the assessment of adults with ADHD.
Collapse
Affiliation(s)
- Richard D Keezer
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Deparment of Psychology, Wheaton College, Wheaton, IL, USA
| | - Sophie I Leib
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Lauren M Scimeca
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Illinois Institute of Technology, Chicago, IL, USA
| | - Justin T Smith
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Deparment of Psychology, Wheaton College, Wheaton, IL, USA
| | - Lindsey R Holbrook
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Dillon W Sharp
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
6
|
Alfonso D, Basurto K, Guilfoyle J, VanLandingham HB, Gonzalez C, Ovsiew GP, Rodriguez VJ, Resch ZJ, Ulrich DM, Soble JR. The Effect of Adverse Childhood Experiences on ADHD Symptom Reporting, Psychological Symptoms, and Cognitive Performance Among Adult Neuropsychological Referrals. J Atten Disord 2024; 28:43-50. [PMID: 37694981 DOI: 10.1177/10870547231196326] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
OBJECTIVE Adverse childhood experiences (ACEs) are early life experiences that influence mental health outcomes, though there are mixed findings reported in relation to attention deficit hyperactivity disorder (ADHD) symptoms. The current study compared adults who experienced ACEs on measures of ADHD symptom reporting, psychological symptoms, and neurocognitive test performance. METHOD The sample (n = 115) had mean age of 28.42 (SD = 6.46); educational attainment of 16.47 years (SD = 1.99); and was 35% male/65% female and racially/ethnically diverse. Participants completed measures of ACEs, ADHD symptoms, psychopathology, and perceived stress, as well as neuropsychological tests. RESULTS The high ACEs group endorsed higher levels of childhood/adulthood inattentive, impulsive, and hyperactive symptoms, and overall childhood symptoms when compared to the low ACEs group. CONCLUSIONS This study provides a more comprehensive understanding of the association between ACEs and cognitive/mental health outcomes. Greater ACEs resulted in higher ADHD symptom reporting but not significantly greater psychological symptoms or worse neurocognitive performance.
Collapse
Affiliation(s)
- Demy Alfonso
- University of Illinois at Chicago, IL, USA
- Northern Illinois University, Dekalb, IL, USA
| | | | | | | | - Christopher Gonzalez
- University of Illinois at Chicago, IL, USA
- Illinois Institute of Technology, IL, USA
| | | | | | | | | | | |
Collapse
|
7
|
Crișan I, Sava FA. Validity assessment in Eastern Europe: cross-validation of the Dot Counting Test and MODEMM against the TOMM-1 and Rey-15 in a Romanian mixed clinical sample. Arch Clin Neuropsychol 2023:acad085. [PMID: 37961918 DOI: 10.1093/arclin/acad085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 10/13/2023] [Accepted: 10/16/2023] [Indexed: 11/15/2023] Open
Abstract
OBJECTIVE This study investigated performance validity in the understudied Romanian clinical population by exploring classification accuracies of the Dot Counting Test (DCT) and the first Romanian performance validity test (PVT) (Memory of Objects and Digits and Evaluation of Memory Malingering/MODEMM) in a heterogeneous clinical sample. METHODS We evaluated 54 outpatients (26 females; MAge = 62.02; SDAge = 12.3; MEducation = 2.41, SDEducation = 2.82) with the Test of Memory Malingering 1 (TOMM-1), Rey Fifteen Items Test (Rey-15) (free recall and recognition trials), DCT, MODEMM, and MMSE/MoCA as part of their neuropsychological assessment. Accuracy parameters and base failure rates were computed for the DCT and MODEMM indicators against the TOMM-1 and Rey-15. Two patient groups were constructed according to psychometrically defined credible/noncredible performance (i.e., pass/fail both TOMM-1 and Rey-15). RESULTS Similar to other cultures, a cutoff of ≥18 on the DCT E score produced the best combination between sensitivity (0.50-0.57) and specificity (≥0.90). MODEMM indicators based on recognition accuracy, inconsistencies, and inclusion false positives generated 0.75-0.86 sensitivities at ≥0.90 specificities. Multivariable models of MODEMM indicators reached perfect sensitivities at ≥0.90 specificities against two PVTs. Patients who failed the TOMM-1 and Rey-15 were significantly more likely to fail the DCT and MODEMM than patients who passed both PVTs. CONCLUSIONS Our results offer proof of concept for the DCT's cross-cultural validity and the applicability of the MODEMM on Romanian clinical examinees, further recommending the use of heterogeneous validity indicators in clinical assessments.
Collapse
Affiliation(s)
- Iulia Crișan
- Department of Psychology, West University of Timișoara, Timișoara 300223, Romania
| | - Florin Alin Sava
- Department of Psychology, West University of Timişoara, Timișoara 300223, Romania
| |
Collapse
|
8
|
Erdodi LA. From "below chance" to "a single error is one too many": Evaluating various thresholds for invalid performance on two forced choice recognition tests. BEHAVIORAL SCIENCES & THE LAW 2023; 41:445-462. [PMID: 36893020 DOI: 10.1002/bsl.2609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 01/16/2023] [Accepted: 02/13/2023] [Indexed: 06/18/2023]
Abstract
This study was designed to empirically evaluate the classification accuracy of various definitions of invalid performance in two forced-choice recognition performance validity tests (PVTs; FCRCVLT-II and Test of Memory Malingering [TOMM-2]). The proportion of at and below chance level responding defined by the binomial theory and making any errors was computed across two mixed clinical samples from the United States and Canada (N = 470) and two sets of criterion PVTs. There was virtually no overlap between the binomial and empirical distributions. Over 95% of patients who passed all PVTs obtained a perfect score. At chance level responding was limited to patients who failed ≥2 PVTs (91% of them failed 3 PVTs). No one scored below chance level on FCRCVLT-II or TOMM-2. All 40 patients with dementia scored above chance. Although at or below chance level performance provides very strong evidence of non-credible responding, scores above chance level have no negative predictive value. Even at chance level scores on PVTs provide compelling evidence for non-credible presentation. A single error on the FCRCVLT-II or TOMM-2 is highly specific (0.95) to psychometrically defined invalid performance. Defining non-credible responding as below chance level scores is an unnecessarily restrictive threshold that gives most examinees with invalid profiles a Pass.
Collapse
Affiliation(s)
- Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| |
Collapse
|
9
|
Skymba HV, Shields AN, Rauch AA, Phillips MS, Bing-Canar H, Finley JCA, Khan H, Ovsiew GP, Durkin NM, Jennette KJ, Resch ZJ, Soble JR. Does comorbid depression impact executive functioning (EF) in adults diagnosed with ADHD?: a comparison of EF across diagnoses in clinically-referred individuals. J Clin Exp Neuropsychol 2023; 45:1-11. [PMID: 37083506 DOI: 10.1080/13803395.2023.2203464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/22/2023]
Abstract
INTRODUCTION Executive functioning (EF) is a salient factor in both ADHD as well as depressive disorders. However, sparse literature has examined whether depression severity impacts EF concurrently among adults with ADHD. The goal of this study was to examine differences in EF between adult patients diagnosed with ADHD and those diagnosed with a non-ADHD primary psychopathological condition, as a function of both ADHD presentation and depression severity in a diverse clinical sample. METHOD This crosssectional study included 404 adult patients clinically referred for neuropsychological evaluation to assist with differential diagnosis and/or treatment planning related to known or suspected ADHD. Various EF tasks and a measure of depression severity were administered. One-way MANOVA analyses were conducted to compare EF performance between individuals diagnosed with ADHD or a non-ADHD primary psychopathological condition, with additional analyses examining group differences based on ADHD presentation and depression severity. Regression analyses also examined the potential contribution of depression severity to each EF measure within each group. RESULTS No significant EF performance differences were found when comparing individuals diagnosed with ADHD and those with a non-ADHD primary psychopathological condition, nor based on ADHD presentation. When comparing across groups using cut-offs for high or low depression, only one EF measure showed significant differences between groups. Further, depression severity generally did not predict reduced EF performances with the exception of verbal fluency and working memory performances in select groups. CONCLUSIONS This study demonstrated that individuals with ADHD generally perform comparably on EF measures regardless of the presence or absence of comorbid depression. These results suggest further examination of EF deficits when they emerge for adults with ADHD, especially beyond comorbid depression severity.
Collapse
Affiliation(s)
- Haley V Skymba
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Allison N Shields
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, Northwestern University, Evanston, Illinois, USA
| | - Andrew A Rauch
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, Loyola University, Chicago, Illinois, USA
| | - Matthew S Phillips
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, The Chicago School of Professional Psychology, Chicago, Illinois, USA
| | - Hanaan Bing-Canar
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, University of Illinois at Chicago, Chicago, Illinois, USA
| | - John-Christopher A Finley
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, Northwestern University, Evanston, Illinois, USA
| | - Humza Khan
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Psychology, Illinois Institute of Technology, Chicago, Illinois, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
| | - Nicole M Durkin
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Urbana, Illinois, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, Illinois, USA
| |
Collapse
|
10
|
Cutler L, Greenacre M, Abeare CA, Sirianni CD, Roth R, Erdodi LA. Multivariate models provide an effective psychometric solution to the variability in classification accuracy of D-KEFS Stroop performance validity cutoffs. Clin Neuropsychol 2023; 37:617-649. [PMID: 35946813 DOI: 10.1080/13854046.2022.2073914] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
ObjectiveThe study was designed to expand on the results of previous investigations on the D-KEFS Stroop as a performance validity test (PVT), which produced diverging conclusions. Method The classification accuracy of previously proposed validity cutoffs on the D-KEFS Stroop was computed against four different criterion PVTs in two independent samples: patients with uncomplicated mild TBI (n = 68) and disability benefit applicants (n = 49). Results Age-corrected scaled scores (ACSSs) ≤6 on individual subtests often fell short of specificity standards. Making the cutoffs more conservative improved specificity, but at a significant cost to sensitivity. In contrast, multivariate models (≥3 failures at ACSS ≤6 or ≥2 failures at ACSS ≤5 on the four subtests) produced good combinations of sensitivity (.39-.79) and specificity (.85-1.00), correctly classifying 74.6-90.6% of the sample. A novel validity scale, the D-KEFS Stroop Index correctly classified between 78.7% and 93.3% of the sample. Conclusions A multivariate approach to performance validity assessment provides a methodological safeguard against sample- and instrument-specific fluctuations in classification accuracy, strikes a reasonable balance between sensitivity and specificity, and mitigates the invalid before impaired paradox.
Collapse
Affiliation(s)
- Laura Cutler
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| | - Matthew Greenacre
- Schulich School of Medicine, Western University, London, Ontario, Canada
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| | | | - Robert Roth
- Department of Psychiatry, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire, USA
| | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, Ontario, Canada
| |
Collapse
|
11
|
Phillips MS, Bing-Canar H, Shields AN, Cerny B, Chang F, Wisinger AM, Leib SI, Ovsiew GP, Resch ZJ, Jennette KJ, Soble JR. Assessment of learning and memory impairments in adults with predominately inattentive versus combined presentation attention-deficit/hyperactivity disorder. APPLIED NEUROPSYCHOLOGY. ADULT 2023:1-10. [PMID: 36697387 DOI: 10.1080/23279095.2023.2169887] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
This cross-sectional study compared adults diagnosed with Attention-Deficit/Hyperactivity Disorder-Inattentive (ADHD-I) and ADHD-Combined (ADHD-C) presentations with a non-ADHD group on verbal and visual learning and delayed recall using the Rey Auditory Verbal Learning Test (RAVLT) and Brief Visuospatial Memory Test-Revised (BVMT-R), respectively. Data from 380 predominately college student adult outpatients were used, with 155 who met criteria for ADHD-I, 165 who met criteria for ADHD-C, and 60 who did not meet criteria for ADHD but were diagnosed with a primary depressive or anxiety disorder or received no diagnosis. Each patient was administered the RAVLT and BVMT-R as part of a comprehensive neuropsychological evaluation. Significant main effects of study group were found, such that patients with ADHD-C demonstrated worse learning and delayed recall of both verbal and visual information than patients with ADHD-I and the non-ADHD group. Patients with ADHD-I performed comparably to the non-ADHD group, apart from visual learning and delayed recall. Notably, more patients in the ADHD groups had possible or probable learning and memory impairment compared to the non-ADHD group. Findings were consistent with previous research indicating that those with ADHD exhibit poorer verbal and visual learning and delayed recall than those without ADHD.
Collapse
Affiliation(s)
- Matthew S Phillips
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Hanaan Bing-Canar
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Allison N Shields
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Brian Cerny
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Fini Chang
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Amanda M Wisinger
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Sophie I Leib
- Psychology Department, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology and Rehabiliation, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
12
|
Obolsky MA, Resch ZJ, Fellin TJ, Cerny BM, Khan H, Bing-Canar H, McCollum K, Lee RC, Fink JW, Pliskin NH, Soble JR. Concordance of Performance and Symptom Validity Tests Within an Electrical Injury Sample. PSYCHOLOGICAL INJURY & LAW 2022. [DOI: 10.1007/s12207-022-09469-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
13
|
Boone KB, Sherman D, Mishler J, Daoud G, Cottingham M, Victor TL, Ziegler E, Zeller MA, Wright M. Cross-validation of RAVLT performance validity indicators and the RAVLT/RO discriminant function in a large known groups sample. Clin Neuropsychol 2022; 36:2342-2360. [PMID: 34311662 DOI: 10.1080/13854046.2021.1948611] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
OBJECTIVE To cross-validate RAVLT performance validity cut-offs and the RAVLT/RO discriminant function in a large neuropsychological sample. METHOD RAVLT scores and the RAVLT/RO discriminant function were compared in credible (n = 100) and noncredible (n = 353) neuropsychology referrals. RESULTS Noncredible patients scored lower than credible patients on RAVLT scores and the RAVLT/RO discriminant function. With cut-offs set to ≥90% specificity, highest sensitivities were observed for the discriminant function (cut-off ≤.064; 55.8%), recognition total (cut-off ≤9; 53.1%), the recognition combination score (≤10; 47.7%), and total learning across trials (cut-off ≤31; 45.3%). Individuals with histories of learning difficulties were over-represented in the 10% of credible patients exceeding cut-offs. When these individuals were removed, cut-offs could be tightened while still maintaining at least 90% specificity, and thereby increasing sensitivity (e.g., recognition total cut-off ≤10, 65% sensitivity; RAVLT/RO discriminant function cut-off ≤.176, 58% sensitivity). When three of the most sensitive, non-overlapping scores were considered in combination, 17% of credible patients failed ≥1 of the three cut-offs, while 3% failed two, and only 1% failed all three. In contrast, in the noncredible sample, more than two-thirds failed one or more of the three cut-offs, nearly half failed ≥2, and nearly a quarter failed all three. CONCLUSIONS RAVLT PVT cut-offs and the RAVLT/RO discriminant function achieve approximately 50% sensitivity, and approach 65% sensitivity when cut-offs specific to samples without histories of learning problems are employed, confirming that RAVLT cut-offs and the RAVLT/RO discriminant function continue to be valuable techniques in the identification of performance invalidity.
Collapse
Affiliation(s)
- Kyle B Boone
- California School of Forensic Studies, Alliant International University, Los Angeles, CA, USA
| | - Dale Sherman
- University of Southern California, Los Angeles, CA, USA
| | - Jamie Mishler
- California School of Forensic Studies, Alliant International University, Los Angeles, CA, USA
| | - Georg Daoud
- California School of Forensic Studies, Alliant Internal University, Los Angeles, CA, USA
| | - Maria Cottingham
- Mental Health Care Line, Veterans Administration Tennessee Valley Healthcare System, Nashville, TN, USA
| | - Tara L Victor
- California State University, Dominguez Hills, Carson, CA, USA
| | | | - Michelle A Zeller
- West Los Angeles Veterans Administration Medical Center, Los Angeles, CA, USA
| | | |
Collapse
|
14
|
Ali S, Crisan I, Abeare CA, Erdodi LA. Cross-Cultural Performance Validity Testing: Managing False Positives in Examinees with Limited English Proficiency. Dev Neuropsychol 2022; 47:273-294. [PMID: 35984309 DOI: 10.1080/87565641.2022.2105847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Base rates of failure (BRFail) on performance validity tests (PVTs) were examined in university students with limited English proficiency (LEP). BRFail was calculated for several free-standing and embedded PVTs. All free-standing PVTs and certain embedded indicators were robust to LEP. However, LEP was associated with unacceptably high BRFail (20-50%) on several embedded PVTs with high levels of verbal mediation (even multivariate models of PVT could not contain BRFail). In conclusion, failing free-standing/dedicated PVTs cannot be attributed to LEP. However, the elevated BRFail on several embedded PVTs in university students suggest an unacceptably high overall risk of false positives associated with LEP.
Collapse
Affiliation(s)
- Sami Ali
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Iulia Crisan
- Department of Psychology, West University of Timişoara, Timişoara, Romania
| | - Christopher A Abeare
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| | - Laszlo A Erdodi
- Department of Psychology, Neuropsychology Track, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
15
|
Ausloos-Lozano JE, Bing-Canar H, Khan H, Singh PG, Wisinger AM, Rauch AA, Ogram Buckley CM, Petry LG, Jennette KJ, Soble JR, Resch ZJ. Assessing performance validity during attention-deficit/hyperactivity disorder evaluations: Cross-validation of non-memory embedded validity indicators. Dev Neuropsychol 2022; 47:247-257. [PMID: 35787068 DOI: 10.1080/87565641.2022.2096889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Embedded performance validity tests (PVTs) are key components of neuropsychological evaluations. However, most are memory-based and may be less useful in the assessment of attention-deficit/hyperactivity disorder (ADHD). Four non-memory-based validity indices derived from processing speed and executive functioning measures commonly included in ADHD evaluations, namely Verbal Fluency (VF) and the Trail Making Test (TMT), were cross-validated using the Rey 15-Item Test (RFIT) Recall and Recall/Recognition as memory-based comparison measures. This consecutive case series included data from 416 demographically-diverse adults who underwent outpatient neuropsychological evaluation for ADHD. Validity classifications were established, with ≤1 PVT failure of five independent criterion PVTs as indicative of valid performance (374 valid performers/42 invalid performers). Among the statistically significant validity indicators, TMT-A and TMT-B T-scores (AUCs = .707-.723) had acceptable classification accuracy ranges and sensitivities ranging from 29%-36% (≥89% specificity). RFIT Recall/Recognition produced similar results as TMT-B T-score with 42% sensitivity/90% specificity, but with lower classification accuracy. In evaluating adult ADHD, VF and TMT embedded PVTs demonstrated comparable sensitivity and specificity values to those found in other clinical populations but necessitated alternate cut-scores. Results also support use of RFIT Recall/Recognition over the standard RFIT Recall as a PVT for adult ADHD evaluations.
Collapse
Affiliation(s)
- Jenna E Ausloos-Lozano
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Hanaan Bing-Canar
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Humza Khan
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Palak G Singh
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Amanda M Wisinger
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Andrew A Rauch
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Caitlin M Ogram Buckley
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Luke G Petry
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA.,Department of Neurology, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, Illinois, USA
| |
Collapse
|
16
|
Ali S, Elliott L, Biss RK, Abumeeiz M, Brantuo M, Kuzmenka P, Odenigbo P, Erdodi LA. The BNT-15 provides an accurate measure of English proficiency in cognitively intact bilinguals - a study in cross-cultural assessment. APPLIED NEUROPSYCHOLOGY. ADULT 2022; 29:351-363. [PMID: 32449371 DOI: 10.1080/23279095.2020.1760277] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
This study was designed to replicate earlier reports of the utility of the Boston Naming Test - Short Form (BNT-15) as an index of limited English proficiency (LEP). Twenty-eight English-Arabic bilingual student volunteers were administered the BNT-15 as part of a brief battery of cognitive tests. The majority (23) were women, and half had LEP. Mean age was 21.1 years. The BNT-15 was an excellent psychometric marker of LEP status (area under the curve: .990-.995). Participants with LEP underperformed on several cognitive measures (verbal comprehension, visuomotor processing speed, single word reading, and performance validity tests). Although no participant with LEP failed the accuracy cutoff on the Word Choice Test, 35.7% of them failed the time cutoff. Overall, LEP was associated with an increased risk of failing performance validity tests. Previously published BNT-15 validity cutoffs had unacceptably low specificity (.33-.52) among participants with LEP. The BNT-15 has the potential to serve as a quick and effective objective measure of LEP. Students with LEP may need academic accommodations to compensate for slower test completion time. Likewise, LEP status should be considered for exemption from failing performance validity tests to protect against false positive errors.
Collapse
Affiliation(s)
- Sami Ali
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Lauren Elliott
- Behaviour-Cognition-Neuroscience Program, University of Windsor, Windsor, Canada
| | - Renee K Biss
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Mustafa Abumeeiz
- Behaviour-Cognition-Neuroscience Program, University of Windsor, Windsor, Canada
| | - Maame Brantuo
- Department of Psychology, University of Windsor, Windsor, Canada
| | | | - Paula Odenigbo
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|
17
|
Crişan I, Erdodi L. Examining the cross-cultural validity of the test of memory malingering and the Rey 15-item test. APPLIED NEUROPSYCHOLOGY. ADULT 2022:1-11. [PMID: 35476611 DOI: 10.1080/23279095.2022.2064753] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
OBJECTIVE This study was designed to investigate the cross-cultural validity of two freestanding performance validity tests (PVTs), the Test of Memory Malingering - Trial 1 (TOMM-1) and the Rey Fifteen Item Test (Rey-15) in Romanian-speaking patients. METHODS The TOMM-1 and Rey-15 free recall (FR) and the combination score incorporating the recognition trial (COMB) were administered to a mixed clinical sample of 61 adults referred for cognitive evaluation, 24 of whom had external incentives to appear impaired. Average scores on PVTs were compared between the two groups. Classification accuracies were computed using one PVT against another. RESULTS Patients with identifiable external incentives to appear impaired produced significantly lower scores and more errors on validity indicators. The largest effect sizes emerged on TOMM-1 (Cohen's d = 1.00-1.19). TOMM-1 was a significant predictor of the Rey-15 COMB ≤20 (AUC = .80; .38 sensitivity; .89 specificity at a cutoff of ≤39). Similarly, both Rey-15 indicators were significant predictors of TOMM-1 at ≤39 as the criterion (AUCs = .73-.76; .33 sensitivity; .89-.90 specificity). CONCLUSION Results offer a proof of concept for the cross-cultural validity of the TOMM-1 and Rey-15 in a Romanian clinical sample.
Collapse
Affiliation(s)
- Iulia Crişan
- Department of Psychology, West University of Timişoara, Timişoara, Romania
| | - Laszlo Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
18
|
D Hood E, B Boone K, S Miora D, E Cottingham M, L Victor T, A Zeigler E, A Zeller M, J Wright M. Are there differences in performance validity test scores between African American and White American neuropsychology clinic patients? J Clin Exp Neuropsychol 2022; 44:31-41. [PMID: 35670549 DOI: 10.1080/13803395.2022.2069230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
OBJECTIVE The purpose of the present study was to compare performance on a wide range of PVTs in a neuropsychology clinic sample of African Americans and White Americans to determine if there are differences in mean scores or cut-off failure rates between the two groups, and to identify factors that may account for false positive PVT results in African American patients. METHOD African American and White American non-compensation-seeking neuropsychology clinic patients were compared on a wide range of standalone and embedded PVTs: Dot Counting Test, b Test, Warrington Recognition Memory Test, Rey 15-item plus recognition, Rey Word Recognition Test, Digit Span (ACSS, RDS, 3-digit time, 4-digit time), WAIS-III Picture Completion (Most discrepant index), WAIS-III Digit Symbol/Coding (recognition equation), Rey Auditory Verbal Learning Test, Rey Complex figure, WMS-III Logical Memory, Comalli Stroop Test, Trails A, and Wisconsin Card Sorting Test. RESULTS When groups were equated for age and education, African Americans obtained mean performances significantly worse than White Americans on only four of 25 PVT scores across the 14 different measures (Stroop Word Reading and Color Naming, Trails A, Digit Span 3-digit time); however, FSIQ was also significantly higher in White American patients. When subjects with borderline IQ (FSIQ = 70 to 79) were excluded (resulting in 74 White Americans and 25 African Americans), groups no longer differed in IQ and only continued to differ on a single PVT cutoff (Trails A). Further, specificity rates in African Americans were comparable to those of White Americans with the exception of the b Test, the Dot Counting Test, and Stroop B. CONCLUSIONS PVT performance generally does not differ as a function of Black versus White race once the impact of intellectual level is controlled, and most PVT cutoffs appear appropriate for use in African Americans of low average IQ or higher.
Collapse
Affiliation(s)
- Elexsia D Hood
- California School of Forensic Studies, Alliant International University, Los Angeles, USA
| | - Kyle B Boone
- California School of Forensic Studies, Alliant International University, Los Angeles, USA.,Department of Psychiatry and Biobehavioral Sciences, UCLA, Los Angeles, USA
| | - Deborah S Miora
- California School of Forensic Studies, Alliant International University, Los Angeles, USA
| | - Maria E Cottingham
- Mental Health Care Line, Veterans Administration Tennessee Valley Healthcare System, Nashville, USA
| | - Tara L Victor
- Department of Psychology, California State University, Dominguez Hills, Carson, USA
| | | | - Michelle A Zeller
- West Los Angeles Veterans Administration Medical Center, Los Angeles, USA
| | - Matthew J Wright
- Department of Psychiatry, Harbor-UCLA Medical Center, Torrance, USA
| |
Collapse
|
19
|
Ashendorf L, Withrow S, Ward SH, Sullivan SK, Sugarman MA. Decision rules for an abbreviated administration of the Test of Memory Malingering. APPLIED NEUROPSYCHOLOGY. ADULT 2022:1-10. [PMID: 35068279 DOI: 10.1080/23279095.2022.2026948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The present study investigated abbreviation methods for the Test of Memory Malingering (TOMM) in relation to traditional manual-based test cutoffs and independently derived more stringent cutoffs suggested by recent research (≤48 on Trial 2 or 3). Consecutively referred outpatient U.S. military veterans (n = 260) were seen for neuropsychological evaluation for mild traumatic brain injury or possible attention-deficit/hyperactivity disorder. Performance on TOMM Trial 1 was evaluated, including the total score and errors on the first 10 items (TOMMe10), to determine correspondence and redundancy with Trials 2 and 3. Using the traditional cutoff, valid performance on Trials 2 and 3 was predicted by zero errors on TOMMe10 and by Trial 1 scores greater than 41. Invalid performance was predicted by commission of more than three errors on TOMMe10 and by Trial 1 scores less than 34. For revised TOMM cutoffs, a Trial 1 score above 46 was predictive of a valid score, and a TOMMe10 score of three or more errors or a Trial 1 score below 36 was associated with invalid TOMM performance. Conditional abbreviation of the TOMM is feasible in a vast majority of cases without sacrificing information regarding performance validity. Decision trees are provided to facilitate administration of the three trials.
Collapse
Affiliation(s)
- Lee Ashendorf
- Mental Health Service Line, VA Central Western Massachusetts, Worcester, MA, USA
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| | - Susanne Withrow
- Behavioral Health Service Line, VA Pittsburgh Healthcare System, Pittsburgh, PA, USA
| | - Sarah H Ward
- Mental Health Service Line, VA Central Western Massachusetts, Worcester, MA, USA
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| | - Sara K Sullivan
- Psychology Service, VA Bedford Healthcare System, Bedford, MA, USA
| | - Michael A Sugarman
- Department of Neurology, Medical University of South Carolina, Charleston, SC, USA
| |
Collapse
|
20
|
Cross-Validation of Multiple Embedded Performance Validity Indices in the Rey Auditory Verbal Learning Test and Brief Visuospatial Memory Test-Revised in an Adult Attention Deficit/Hyperactivity Disorder Clinical Sample. PSYCHOLOGICAL INJURY & LAW 2022. [DOI: 10.1007/s12207-022-09443-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
21
|
White DJ, Ovsiew GP, Rhoads T, Resch ZJ, Lee M, Oh AJ, Soble JR. The Divergent Roles of Symptom and Performance Validity in the Assessment of ADHD. J Atten Disord 2022; 26:101-108. [PMID: 33084457 DOI: 10.1177/1087054720964575] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE This study examined concordance between symptom and performance validity among clinically-referred patients undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD). METHOD Data from 203 patients who completed the WAIS-IV Working Memory Index, the Clinical Assessment of Attention Deficit-Adult (CAT-A), and ≥4 criterion performance validity tests (PVTs) were analyzed. RESULTS Symptom and performance validity were concordant in 76% of cases, with the majority being valid performance. Of the remaining 24% of cases with divergent validity findings, patients were more likely to exhibit symptom invalidity (15%) than performance invalidity (9%). Patients demonstrating symptom invalidity endorsed significantly more ADHD symptoms than those with credible symptom reporting (ηp2 = .06-.15), but comparable working memory test performance, whereas patients with performance invalidity had significantly worse working memory performance than those with valid PVT performance (ηp2 = .18). CONCLUSION Symptom and performance invalidity represent dissociable constructs in patients undergoing neuropsychological evaluation of ADHD and should be evaluated independently.
Collapse
Affiliation(s)
- Daniel J White
- University of Illinois College of Medicine, Chicago, IL USA.,Roosevelt University, Chicago, IL, USA
| | | | - Tasha Rhoads
- University of Illinois College of Medicine, Chicago, IL USA
| | - Zachary J Resch
- University of Illinois College of Medicine, Chicago, IL USA.,Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Mary Lee
- University of Illinois College of Medicine, Chicago, IL USA
| | - Alison J Oh
- University of Illinois College of Medicine, Chicago, IL USA
| | - Jason R Soble
- University of Illinois College of Medicine, Chicago, IL USA
| |
Collapse
|
22
|
Leib SI, Keezer RD, Cerny BM, Holbrook LR, Gallagher VT, Jennette KJ, Ovsiew GP, Soble JR. Distinct Latent Profiles of Working Memory and Processing Speed in Adults with ADHD. Dev Neuropsychol 2021; 46:574-587. [PMID: 34743616 DOI: 10.1080/87565641.2021.1999454] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
This study examined the neuropsychological profile of patients with Attention-Deficit/Hyperactivity Disorder (ADHD) based on Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) working memory and processing speed indices. We aimed to establish whether distinct ADHD subtypes emerge based on neuropsychological testing and determine whether ADHD subgroups differ based on neurocognitive and demographic factors in 179 adult patients with ADHD. Latent Profile Analysis (LPA) revealed four discrete latent subgroups within the sample, each with distinct patterns of working memory and processing speed. Classes significantly differed in demographically predicted IQ, education, and self-reported depression and anxiety. Results reveal heterogeneity in cognitive performance in adult ADHD.
Collapse
Affiliation(s)
- Sophie I Leib
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
| | - Richard D Keezer
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Wheaton College, Wheaton, Illinois, USA
| | - Brian M Cerny
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Illinois Institute of Technology, Chicago, Illinois, USA
| | - Lindsey R Holbrook
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
| | - Virginia T Gallagher
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Neurology, University of Illinois College of Medicine, Chicago, Illinois, USA
| |
Collapse
|
23
|
Introducing the ImPACT-5: An Empirically Derived Multivariate Validity Composite. J Head Trauma Rehabil 2021; 36:103-113. [PMID: 32472832 DOI: 10.1097/htr.0000000000000576] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
OBJECTIVE To create novel Immediate Post-Concussion and Cognitive Testing (ImPACT)-based embedded validity indicators (EVIs) and to compare the classification accuracy to 4 existing EVIImPACT. METHOD The ImPACT was administered to 82 male varsity football players during preseason baseline cognitive testing. The classification accuracy of existing EVIImPACT was compared with a newly developed index (ImPACT-5A and B). The ImPACT-5A represents the number of cutoffs failed on the 5 ImPACT composite scores at a liberal cutoff (0.85 specificity); ImPACT-5B is the sum of failures on conservative cutoffs (≥0.90 specificity). RESULTS ImPACT-5A ≥1 was sensitive (0.81), but not specific (0.49) to invalid performance, consistent with EVIImPACT developed by independent researchers (0.68 sensitivity at 0.73-0.75 specificity). Conversely, ImPACT-5B ≥3 was highly specific (0.98), but insensitive (0.22), similar to Default EVIImPACT (0.04 sensitivity at 1.00 specificity). ImPACT-5A ≥3 or ImPACT-5B ≥2 met forensic standards of specificity (0.91-0.93) at 0.33 to 0.37 sensitivity. Also, the ImPACT-5s had the strongest linear relationship with clinically meaningful levels of invalid performance of existing EVIImPACT. CONCLUSIONS The ImPACT-5s were superior to the standard EVIImPACT and comparable to existing aftermarket EVIImPACT, with the flexibility to optimize the detection model for either sensitivity or specificity. The wide range of ImPACT-5 cutoffs allows for a more nuanced clinical interpretation.
Collapse
|
24
|
Erdodi LA. Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. NeuroRehabilitation 2021; 49:179-213. [PMID: 34420986 DOI: 10.3233/nre-218020] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE This study was designed to empirically investigate the signal detection profile of various multivariate models of performance validity tests (MV-PVTs) and explore several contested assumptions underlying validity assessment in general and MV-PVTs specifically. METHOD Archival data were collected from 167 patients (52.4%male; MAge = 39.7) clinicially evaluated subsequent to a TBI. Performance validity was psychometrically defined using two free-standing PVTs and five composite measures, each based on five embedded PVTs. RESULTS MV-PVTs had superior classification accuracy compared to univariate cutoffs. The similarity between predictor and criterion PVTs influenced signal detection profiles. False positive rates (FPR) in MV-PVTs can be effectively controlled using more stringent multivariate cutoffs. In addition to Pass and Fail, Borderline is a legitimate third outcome of performance validity assessment. Failing memory-based PVTs was associated with elevated self-reported psychiatric symptoms. CONCLUSIONS Concerns about elevated FPR in MV-PVTs are unsubstantiated. In fact, MV-PVTs are psychometrically superior to individual components. Instrumentation artifacts are endemic to PVTs, and represent both a threat and an opportunity during the interpretation of a given neurocognitive profile. There is no such thing as too much information in performance validity assessment. Psychometric issues should be evaluated based on empirical, not theoretical models. As the number/severity of embedded PVT failures accumulates, assessors must consider the possibility of non-credible presentation and its clinical implications to neurorehabilitation.
Collapse
|
25
|
Messa I, Holcomb M, Lichtenstein JD, Tyson BT, Roth RM, Erdodi LA. They are not destined to fail: a systematic examination of scores on embedded performance validity indicators in patients with intellectual disability. AUST J FORENSIC SCI 2021. [DOI: 10.1080/00450618.2020.1865457] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Affiliation(s)
- Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | | | | | - Brad T Tyson
- Neuropsychological Service, EvergreenHealth Medical Center, Kirkland, WA, USA
| | - Robert M Roth
- Department of Psychiatry, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
26
|
Scimeca LM, Holbrook L, Rhoads T, Cerny BM, Jennette KJ, Resch ZJ, Obolsky MA, Ovsiew GP, Soble JR. Examining Conners Continuous Performance Test-3 (CPT-3) Embedded Performance Validity Indicators in an Adult Clinical Sample Referred for ADHD Evaluation. Dev Neuropsychol 2021; 46:347-359. [PMID: 34256665 DOI: 10.1080/87565641.2021.1951270] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
This study evaluated multiple previously-identified Continuous Performance Test-Third Edition (CPT-3) scores as embedded validity indicators (EVIs) among 201 adults undergoing neuropsychological evaluation for Attention-Deficit/Hyperactivity Disorder (ADHD) divided into valid (n = 169) and invalid (n = 32) groups based on seven criterion measures. Although 6/10 CPT-3 scores accurately detected invalidity, only two reached minimally acceptable classification accuracy of ≥0.70. The remaining four had unacceptably low accuracy (AUCs = 0.62-0.69) with 0.19-0.41 sensitivity at ≥0.90 specificity. Composite scores did not provide better classification accuracy than individual CPT-3 scores. In sum, CPT-3 individual and composite scores generally are not accurate PVTs among adults undergoing clinical evaluation for ADHD.
Collapse
Affiliation(s)
- Lauren M Scimeca
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Illinois Institute of Technology, Chicago, Illinois, USA
| | - Lindsey Holbrook
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
| | - Tasha Rhoads
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
| | - Brian M Cerny
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Illinois Institute of Technology, Chicago, Illinois, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA
| | - Maximillian A Obolsky
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Psychology, Roosevelt University, Chicago, Illinois, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, Illinois, USA.,Department of Neurology, University of Illinois College of Medicine, Chicago, Illinois, USA
| |
Collapse
|
27
|
Abstract
INTRODUCTION The Rey 15-item Test is a public-domain, memory-based performance validity test, frequently used in clinical settings. Various efforts have been made to modify the test to make it more sensitive and more robust to effects of lower education and intelligence. The most promising of these is the addition of a recognition trial to the existing free recall paradigm. METHOD The present study explored the use of the Rey-15 + Recognition Trial in a sample of 155 younger U.S. military veterans seen for evaluation of mild traumatic brain injury or attention deficit hyperactivity disorder (50 cases classified as invalid, 105 classified as valid). RESULTS Optimal classification accuracy was obtained on the Combination index (cutoff ≤23, sensitivity = 50%, specificity = 95%) and the Recognition Hits score (cutoff ≤11, sensitivity = 52%, specificity = 93%). The Free Recall score had somewhat lower sensitivity when a similar 95% specificity threshold was set (cutoff ≤11, 38% sensitivity). A qualitative error score used in previous studies did not improve classification accuracy. CONCLUSIONS The Rey-15 + Recognition Trial proved to be effective, with particular advantage bestowed by the recognition trial. Implications of these findings in the context of the study's clinical sample of military veterans and in the broader literature are discussed.
Collapse
Affiliation(s)
- Lee Ashendorf
- Mental Health Service Line, VA Central Western Massachusetts, Worcester, MA, USA.,Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| | - Erika L Clark
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| | - Clare T Humphreys
- Department of Psychiatry, University of Massachusetts Medical School, Worcester, MA, USA
| |
Collapse
|
28
|
Abeare K, Romero K, Cutler L, Sirianni CD, Erdodi LA. Flipping the Script: Measuring Both Performance Validity and Cognitive Ability with the Forced Choice Recognition Trial of the RCFT. Percept Mot Skills 2021; 128:1373-1408. [PMID: 34024205 PMCID: PMC8267081 DOI: 10.1177/00315125211019704] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
In this study we attempted to replicate the classification accuracy of the newly introduced Forced Choice Recognition trial (FCR) of the Rey Complex Figure Test (RCFT) in a clinical sample. We administered the RCFTFCR and the earlier Yes/No Recognition trial from the RCFT to 52 clinically referred patients as part of a comprehensive neuropsychological test battery and incentivized a separate control group of 83 university students to perform well on these measures. We then computed the classification accuracies of both measures against criterion performance validity tests (PVTs) and compared results between the two samples. At previously published validity cutoffs (≤16 & ≤17), the RCFTFCR remained specific (.84-1.00) to psychometrically defined non-credible responding. Simultaneously, the RCFTFCR was more sensitive to examinees' natural variability in visual-perceptual and verbal memory skills than the Yes/No Recognition trial. Even after being reduced to a seven-point scale (18-24) by the validity cutoffs, both RCFT recognition scores continued to provide clinically useful information on visual memory. This is the first study to validate the RCFTFCR as a PVT in a clinical sample. Our data also support its use for measuring cognitive ability. Replication studies with more diverse samples and different criterion measures are still needed before large-scale clinical application of this scale.
Collapse
Affiliation(s)
- Kaitlyn Abeare
- Department of Psychology, University of Windsor, Windsor, Ontario, Canada
| | - Kristoffer Romero
- Department of Psychology, University of Windsor, Windsor, Ontario, Canada
| | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, Ontario, Canada
| | | | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, Ontario, Canada
| |
Collapse
|
29
|
Resch ZJ, Paxton JL, Obolsky MA, Lapitan F, Cation B, Schulze ET, Calderone V, Fink JW, Lee RC, Pliskin NH, Soble JR. Establishing the base rate of performance invalidity in a clinical electrical injury sample: Implications for neuropsychological test performance. J Clin Exp Neuropsychol 2021; 43:213-223. [PMID: 33858295 DOI: 10.1080/13803395.2021.1914002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Objective: The base rate of neuropsychological performance invalidity in electrical injury, a clinically-distinct and frequently compensation-seeking population, is not well established. This study determined the base rate of performance invalidity in a large electrical injury sample, and examined patient characteristics, injury parameters, and neuropsychological test performance based on validity status.Method: This cross-sectional study included data from 101 patients with electrical injury consecutively referred for post-acute neuropsychological evaluation. Eighty-five percent of the sample was compensation-seeking. Multiple performance validity tests (PVTs) were administered as part of standard clinical evaluation. For patients with four or more PVTs, valid performance was operationalized as less than or equal to one PVT failure and invalid performance as two or more failures.Results: Frequency analysis revealed 66% (n = 67) had valid performance while 29% (n = 29) demonstrated probable invalid performance; the remaining 5% (n = 5) had indeterminate validity. No significant differences in demographics or injury parameters emerged between validity groups (0 vs. 1 vs. ≥2 PVT failures). In contrast, the electrical injury group with invalid performance performed significantly worse across tests of processing speed and executive abilities than those with valid performance (ps< .05, ηp2 = .19-.25).Conclusions: The current study is the first to establish the base rate of neuropsychological performance invalidity in electrical injury survivors using empirical methods and current practice standards. Patient and clinical variables, including compensation-seeking status, did not differ between validity groups; however, neuropsychological test performance did, supporting the need for multi-method, objective performance validity assessment.
Collapse
Affiliation(s)
- Zachary J Resch
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Jessica L Paxton
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Maximillian A Obolsky
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Franchezka Lapitan
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Bailey Cation
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Psychology, Roosevelt University, Chicago, IL, USA
| | - Evan T Schulze
- Department of Neurology, Saint Louis University, St. Louis, MO, USA
| | - Veroly Calderone
- The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA
| | - Joseph W Fink
- The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA.,Department of Psychiatry and Behavioral Neuroscience, University of Chicago, Chicago, IL, USA
| | - Raphael C Lee
- The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA.,Departments of Surgery, Medicine and Organismal Biology, University of Chicago, Chicago, IL, USA
| | - Neil H Pliskin
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,The Chicago Electrical Trauma Rehabilitation Institute (CETRI), Chicago, IL, USA.,Department of Neurology, University of Illinois at Chicago College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois at Chicago College of Medicine, Chicago, IL, USA.,Department of Neurology, University of Illinois at Chicago College of Medicine, Chicago, IL, USA
| |
Collapse
|
30
|
Leib SI, Schieszler-Ockrassa C, White DJ, Gallagher VT, Carter DA, Basurto KS, Ovsiew GP, Resch ZJ, Jennette KJ, Soble JR. Concordance between the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) and Clinical Assessment of Attention Deficit-Adult (CAT-A) over-reporting validity scales for detecting invalid ADHD symptom reporting. APPLIED NEUROPSYCHOLOGY-ADULT 2021; 29:1522-1529. [PMID: 33719792 DOI: 10.1080/23279095.2021.1894150] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
This study investigated the relationship between symptom validity scales on the Clinical Assessment of Attention Deficit-Adult (CAT-A) and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in the context of Attention-Deficit/Hyperactivity Disorder (ADHD) evaluation. The sample comprised 140 consecutive patients referred for a neuropsychological evaluation of ADHD and were administered the CAT-A and the MMPI-2-RF and a battery of performance-based neurocognitive tests. Results indicated CAT-A/MMPI-2-RF symptom validity concordance of 51% between measures, with 38% concordant valid and 13% concordant invalid responses. Among those with discordance symptom validity results, rates of valid CAT-A/invalid MMPI-2-RF responding (41%) were more common than invalid CAT-A/valid MMPI-2-RF responding (8%). Results also indicated higher levels of ADHD symptoms among invalid responding within the CAT-A, whereas the MMPI-2-RF Cognitive Complaints scale did not differ by CAT-A validity status. Finally, symptom validity scales on both the CAT-A and MMPI-2-RF were largely discordant from neuropsychological test validity status per performance validity tests. Findings highlight the need for symptom validity testing when assessing ADHD and indicate that validity indices on broad personality assessments may assess different constructs than embedded validity indices in ADHD-specific measures.
Collapse
Affiliation(s)
- Sophie I Leib
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Christine Schieszler-Ockrassa
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Deparment of Psychology, Roosevelt University, Chicago, IL, USA
| | - Daniel J White
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Deparment of Psychology, Roosevelt University, Chicago, IL, USA
| | - Virginia T Gallagher
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Dustin A Carter
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Karen S Basurto
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Zachary J Resch
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Psychology, Rosalind Franklin University of Medicine and Science, North Chicago, IL, USA
| | - Kyle J Jennette
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.,Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
31
|
Gegner J, Erdodi LA, Giromini L, Viglione DJ, Bosi J, Brusadelli E. An Australian study on feigned mTBI using the Inventory of Problems - 29 (IOP-29), its Memory Module (IOP-M), and the Rey Fifteen Item Test (FIT). APPLIED NEUROPSYCHOLOGY-ADULT 2021; 29:1221-1230. [PMID: 33403885 DOI: 10.1080/23279095.2020.1864375] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
We investigated the classification accuracy of the Inventory of Problems - 29 (IOP-29), its newly developed memory module (IOP-M) and the Fifteen Item Test (FIT) in an Australian community sample (N = 275). One third of the participants (n = 93) were asked to respond honestly, two thirds were instructed to feign mild TBI. Half of the feigners (n = 90) were coached to avoid detection by not exaggerating, half were not (n = 92). All measures successfully discriminated between honest responders and feigners, with large effect sizes (d ≥ 1.96). The effect size for the IOP-29 (d ≥ 4.90), however, was about two-to-three times larger than those produced by the IOP-M and FIT. Also noteworthy, the IOP-29 and IOP-M showed excellent sensitivity (>90% the former, > 80% the latter), in both the coached and uncoached feigning conditions, at perfect specificity. Instead, the sensitivity of the FIT was 71.7% within the uncoached simulator group and 53.3% within the coached simulator group, at a nearly perfect specificity of 98.9%. These findings suggest that the validity of the IOP-29 and IOP-M should generalize to Australian examinees and that the IOP-29 and IOP-M likely outperform the FIT in the detection of feigned mTBI.
Collapse
Affiliation(s)
- Jennifer Gegner
- Department of Psychology, University of Wollongong, Wollongong, Australia
| | - Laszlo A Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| | | | | | | | | |
Collapse
|
32
|
Abeare CA, Hurtubise JL, Cutler L, Sirianni C, Brantuo M, Makhzoum N, Erdodi LA. Introducing a forced choice recognition trial to the Hopkins Verbal Learning Test – Revised. Clin Neuropsychol 2020; 35:1442-1470. [DOI: 10.1080/13854046.2020.1779348] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Affiliation(s)
| | | | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | | | - Maame Brantuo
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Nadeen Makhzoum
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, ON, Canada
| |
Collapse
|
33
|
Hurtubise J, Baher T, Messa I, Cutler L, Shahein A, Hastings M, Carignan-Querqui M, Erdodi LA. Verbal fluency and digit span variables as performance validity indicators in experimentally induced malingering and real world patients with TBI. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:337-354. [DOI: 10.1080/21622965.2020.1719409] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
| | - Tabarak Baher
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Isabelle Messa
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Laura Cutler
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Ayman Shahein
- Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| | | | | | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| |
Collapse
|
34
|
Teague AM, Hirst RB. Rey 15 item test plus recognition trial and TOMM in a community pediatric sample. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:329-336. [PMID: 31918597 DOI: 10.1080/21622965.2019.1709068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
In pediatric evaluations, performance validity test (PVT) selection is often constrained by reading level, developmental appropriateness of stimuli, and administration time. The Rey 15 Item Test (FIT) addresses these constraints, and ranks among the most frequently used PVTs. Unfortunately, research indicates poor sensitivity of the FIT recall trial. Boone et al. developed a FIT recognition trial and demonstrated in an adult sample that its use increased sensitivity while maintaining high specificity. These results are promising, but, to the authors' knowledge, have only been replicated once in a pediatric sample. The present study examined the FIT plus recognition trial in a sample of 72 young athletes ages 8-16 years. All data for the present study were collected during baseline cognitive evaluations. The Test of Memory Malingering (TOMM) was used as the comparison criterion. Receiver operating characteristic curve analyses showed the addition of the recognition trial did not substantially improve sensitivity of the FIT. There was a surprising lack of concordance between TOMM and FIT scores, and, whereas the FIT correlated with multiple cognitive measures, the TOMM did not correlate with any other measures. Results suggest the FIT is not appropriate for pediatric clinical care, even with the additional recognition trial.
Collapse
Affiliation(s)
- Anna M Teague
- Neuropsychology Program, Palo Alto University, Palo Alto, CA, USA
| | - Rayna B Hirst
- Neuropsychology Program, Palo Alto University, Palo Alto, CA, USA
| |
Collapse
|
35
|
Soble JR, Alverson WA, Phillips JI, Critchfield EA, Fullen C, O’Rourke JJF, Messerly J, Highsmith JM, Bailey KC, Webber TA, Marceaux JC. Strength in Numbers or Quality over Quantity? Examining the Importance of Criterion Measure Selection to Define Validity Groups in Performance Validity Test (PVT) Research. PSYCHOLOGICAL INJURY & LAW 2020. [DOI: 10.1007/s12207-019-09370-w] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|