1
|
Kim S, Currao A, Brown E, Milberg WP, Fortier CB. Importance of validity testing in psychiatric assessment: evidence from a sample of multimorbid post-9/11 veterans. J Int Neuropsychol Soc 2024; 30:410-419. [PMID: 38014547 DOI: 10.1017/s1355617723000711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
OBJECTIVE Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures. METHOD Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures. RESULTS Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's d = .60-.69), processing speed (Cohen's d = .68), working memory (Cohen's d = .98), and visual memory (Cohen's d = .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; β = 0.16; p = .0002), and worse self-reported depression (β = 0.17; p = .0001), anxiety (β = 0.15; p = .0007), sleep (β = 0.10; p = .0233), and functional outcomes (β = 0.15; p = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (p's < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (AUC = 0.83; 95% CI = 0.76, 0.91). CONCLUSION PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.
Collapse
Affiliation(s)
- Sahra Kim
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - Alyssa Currao
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - Emma Brown
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
| | - William P Milberg
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Catherine B Fortier
- Translational Research Center for TBI and Stress Disorders and Geriatric Research Education and Clinical Center, VA Boston Healthcare System, Boston, MA, USA
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
2
|
Etzel L, Miskey HM, Webb JB, Demakis GJ, Harris HL, Shura RD. An Executive Functioning Composite Does Not Moderate the Relationship Between Combat Exposure and Posttraumatic Stress Disorder Symptom Clusters. Arch Clin Neuropsychol 2024; 39:11-23. [PMID: 37565825 DOI: 10.1093/arclin/acad055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Revised: 04/30/2023] [Accepted: 06/07/2023] [Indexed: 08/12/2023] Open
Abstract
OBJECTIVE Posttraumatic stress disorder (PTSD) is prevalent among U.S. combat Veterans, and associated with poor health and wellbeing. As combat experiences are likely to significantly modify self-, other-, and society-oriented cognitions and heighten risk for PTSD, examination of related cognitive processes may yield new treatment strategies. The cognitive model of PTSD suggests that persistent threat perceptions contribute to symptom worsening. Thus, cognitive processes of shifting perspectives or generating novel interpretations may be particularly relevant to lessen PTSD symptoms. This cross-sectional study examined executive functioning as a moderator to the relationship between combat exposure and PTSD symptom clusters among post-9/11 Veterans. METHOD Data from 168 Veterans were drawn from a larger study examining post-deployment mental health and cognitive function. An executive functioning composite derived from Wisconsin Card Sorting Test Perseveration Errors, WAIS-III Similarities, Trail Making Test B, and Stroop Color-Word Inhibition scores was computed. Path analysis was used to test the moderation model. RESULTS After accounting for age, sex, and estimated premorbid functioning, results indicated that combat exposure was associated with all symptom clusters on the PTSD Checklist-Military. Executive functioning was not significantly associated with the PTSD symptom clusters and did not moderate the relationship between combat exposure and any of the PTSD symptom clusters. CONCLUSIONS Combat exposure is an important dimension of risk related to PTSD in Veterans that warrants regular screening. Moderation by executive functioning was not observed despite theoretical support. Future work could test methodological and sampling reasons for this finding to determine if theoretical adjustment is necessary.
Collapse
Affiliation(s)
- Lena Etzel
- Health Psychology Ph.D. Program, University of North Carolina at Charlotte, Charlotte, NC, USA
- W. G. (Bill) Hefner VA Medical Center, Research & Academic Affairs, Salisbury, NC, USA
| | - Holly M Miskey
- W. G. (Bill) Hefner VA Medical Center, Mental Health and Behavioral Sciences, Salisbury, NC, USA
- VA VISN 6 Mid Atlantic Mental Illness Research, Education and Clinical Center (MIRECC), Durham, NC, USA
- Wake Forest School of Medicine, Department of Neurology, Winston-Salem, NC, USA
- University of North Carolina at Charlotte, Department of Psychological Science, Charlotte, NC, USA
| | - Jennifer B Webb
- Health Psychology Ph.D. Program, University of North Carolina at Charlotte, Charlotte, NC, USA
- University of North Carolina at Charlotte, Department of Psychological Science, Charlotte, NC, USA
| | - George J Demakis
- Health Psychology Ph.D. Program, University of North Carolina at Charlotte, Charlotte, NC, USA
- University of North Carolina at Charlotte, Department of Psychological Science, Charlotte, NC, USA
| | - Henry L Harris
- University of North Carolina at Charlotte, Department of Counseling, Charlotte, NC, USA
| | - Robert D Shura
- W. G. (Bill) Hefner VA Medical Center, Research & Academic Affairs, Salisbury, NC, USA
- VA VISN 6 Mid Atlantic Mental Illness Research, Education and Clinical Center (MIRECC), Durham, NC, USA
- Wake Forest School of Medicine, Department of Neurology, Winston-Salem, NC, USA
| |
Collapse
|
3
|
Scott JC, Moore TM, Roalf DR, Satterthwaite TD, Wolf DH, Port AM, Butler ER, Ruparel K, Nievergelt CM, Risbrough VB, Baker DG, Gur RE, Gur RC. Development and application of novel performance validity metrics for computerized neurocognitive batteries. J Int Neuropsychol Soc 2023; 29:789-797. [PMID: 36503573 PMCID: PMC10258222 DOI: 10.1017/s1355617722000893] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
OBJECTIVES Data from neurocognitive assessments may not be accurate in the context of factors impacting validity, such as disengagement, unmotivated responding, or intentional underperformance. Performance validity tests (PVTs) were developed to address these phenomena and assess underperformance on neurocognitive tests. However, PVTs can be burdensome, rely on cutoff scores that reduce information, do not examine potential variations in task engagement across a battery, and are typically not well-suited to acquisition of large cognitive datasets. Here we describe the development of novel performance validity measures that could address some of these limitations by leveraging psychometric concepts using data embedded within the Penn Computerized Neurocognitive Battery (PennCNB). METHODS We first developed these validity measures using simulations of invalid response patterns with parameters drawn from real data. Next, we examined their application in two large, independent samples: 1) children and adolescents from the Philadelphia Neurodevelopmental Cohort (n = 9498); and 2) adult servicemembers from the Marine Resiliency Study-II (n = 1444). RESULTS Our performance validity metrics detected patterns of invalid responding in simulated data, even at subtle levels. Furthermore, a combination of these metrics significantly predicted previously established validity rules for these tests in both developmental and adult datasets. Moreover, most clinical diagnostic groups did not show reduced validity estimates. CONCLUSIONS These results provide proof-of-concept evidence for multivariate, data-driven performance validity metrics. These metrics offer a novel method for determining the performance validity for individual neurocognitive tests that is scalable, applicable across different tests, less burdensome, and dimensional. However, more research is needed into their application.
Collapse
Affiliation(s)
- J. Cobb Scott
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- VISN4 Mental Illness Research, Education, and Clinical Center at the Corporal Michael J. Crescenz VA Medical Center, Philadelphia, PA, USA
| | - Tyler M. Moore
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - David R. Roalf
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Theodore D. Satterthwaite
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Daniel H. Wolf
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Allison M. Port
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Ellyn R. Butler
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Kosha Ruparel
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Caroline M. Nievergelt
- Center for Excellent in Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA
- Department of Psychiatry, University of California (UCSD), San Diego, CA, USA
| | - Victoria B. Risbrough
- Center for Excellent in Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA
- Department of Psychiatry, University of California (UCSD), San Diego, CA, USA
| | - Dewleen G. Baker
- Center for Excellent in Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA
- Department of Psychiatry, University of California (UCSD), San Diego, CA, USA
| | - Raquel E. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Lifespan Brain Institute, Department of Child and Adolescent Psychiatry and Behavioral Sciences, Children’s Hospital of Philadelphia, Philadelphia, PA, USA
| | - Ruben C. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- VISN4 Mental Illness Research, Education, and Clinical Center at the Corporal Michael J. Crescenz VA Medical Center, Philadelphia, PA, USA
- Lifespan Brain Institute, Department of Child and Adolescent Psychiatry and Behavioral Sciences, Children’s Hospital of Philadelphia, Philadelphia, PA, USA
| |
Collapse
|
4
|
Horner MD, Denning JH, Cool DL. Self-reported disability-seeking predicts PVT failure in veterans undergoing clinical neuropsychological evaluation. Clin Neuropsychol 2023; 37:387-401. [PMID: 35387574 DOI: 10.1080/13854046.2022.2056923] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
Objective: This study examined disability-related factors as predictors of PVT performance in Veterans who underwent neuropsychological evaluation for clinical purposes, not for determination of disability benefits. Method: Participants were 1,438 Veterans who were seen for clinical evaluation in a VA Medical Center's Neuropsychology Clinic. All were administered the TOMM, MSVT, or both. Predictors of PVT performance included (1) whether Veterans were receiving VA disability benefits ("service connection") for psychiatric or neurological conditions at the time of evaluation, and (2) whether Veterans reported on clinical interview that they were in the process of applying for disability benefits. Data were analyzed using binary logistic regression, with PVT performance as the dependent variable in separate analyses for the TOMM and MSVT. Results: Veterans who were already receiving VA disability benefits for psychiatric or neurological conditions were significantly more likely to fail both the TOMM and the MSVT, compared to Veterans who were not receiving benefits for such conditions. Independently of receiving such benefits, Veterans who reported that they were applying for disability benefits were significantly more likely to fail the TOMM and MSVT than were Veterans who denied applying for benefits at the time of evaluation. Conclusions: These findings demonstrate that simply being in the process of applying for disability benefits increases the likelihood of noncredible performance. The presence of external incentives can predict the validity of neuropsychological performance even in clinical, non-forensic settings.
Collapse
Affiliation(s)
- Michael David Horner
- Mental Health Service, Ralph H. Johnson Department of Veterans Affairs Medical Center, Charleston, SC, USA.,Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - John H Denning
- Mental Health Service, Ralph H. Johnson Department of Veterans Affairs Medical Center, Charleston, SC, USA.,Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA
| | - Danielle L Cool
- Mental Health Service, Ralph H. Johnson Department of Veterans Affairs Medical Center, Charleston, SC, USA
| |
Collapse
|
5
|
Fountain-Zaragoza S, Braun SE, Horner MD, Benitez A. Comparison of conventional and actuarial neuropsychological criteria for mild cognitive impairment in a clinical setting. J Clin Exp Neuropsychol 2021; 43:753-765. [PMID: 34962226 DOI: 10.1080/13803395.2021.2007857] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
INTRODUCTION Evidence-based practice in neuropsychology involves the use of validated tests, cutoff scores, and interpretive algorithms to identify clinically significant cognitive deficits. Recently, actuarial neuropsychological criteria (ANP) for identifying mild cognitive impairment were developed, demonstrating improved criterion validity and temporal stability compared to conventional criteria (CNP). However, benefits of the ANP criteria have not been investigated in non-research, clinical settings with varied etiologies, severities, and comorbidities. This study compared the utility of CNP and ANP criteria using data from a memory disorders clinic. METHOD Data from 500 non-demented older adults evaluated in a Veterans Affairs Medical Center memory disorders clinic were retrospectively analyzed. We applied CNP and ANP criteria to the Repeatable Battery for the Assessment of Neuropsychological Status, compared outcomes to consensus clinical diagnoses, and conducted cluster analyses of scores from each group. RESULTS The majority (72%) of patients met both the CNP and ANP criteria and both approaches were susceptible to confounding factors such as invalid test data and mood disturbance. However, the CNP approach mislabeled impairment in more patients with non-cognitive disorders and intact cognition. Comparatively, the ANP approach misdiagnosed patients with depression at a third of the rate and those with no diagnosis at nearly half the rate of CNP. Cluster analyses revealed groups with: 1) minimal impairment, 2) amnestic impairment, and 3) multi-domain impairment. The ANP approach yielded subgroups with more distinct neuropsychological profiles. CONCLUSIONS We replicated previous findings that the CNP approach is over-inclusive, particularly for those determined to have no cognitive disorder by a consensus team. The ANP approach yielded fewer false positives and better diagnostic specificity than the CNP. Despite clear benefits of the ANP vs. CNP, there was substantial overlap in their performance in this heterogeneous sample. These findings highlight the critical role of clinical interpretation when wielding these empirically-derived tools.
Collapse
Affiliation(s)
- Stephanie Fountain-Zaragoza
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA.,Ralph H. Johnson Department of Veterans Affairs Medical Center, Mental Health Service, Charleston, SC, USA
| | - Sarah Ellen Braun
- Department of Neurology, School of Medicine, Virginia Commonwealth University, Richmond, VA, USA
| | - Michael David Horner
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA.,Ralph H. Johnson Department of Veterans Affairs Medical Center, Mental Health Service, Charleston, SC, USA
| | - Andreana Benitez
- Department of Neurology, Medical University of South Carolina, Charleston, SC, USA
| |
Collapse
|
6
|
Eagle SR, Collins MW, Dretsch MN, Uomoto JM, Connaboy C, Flanagan SD, Kontos AP. Network Analysis of Research on Mild Traumatic Brain Injury in US Military Service Members and Veterans During the Past Decade (2010-2019). J Head Trauma Rehabil 2021; 36:E345-E354. [PMID: 33741827 DOI: 10.1097/htr.0000000000000675] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVE To evaluate trends in the extant literature on mild traumatic brain injury (mTBI) in military service members and veterans using network analysis based on a comprehensive search of original, peer-reviewed research articles involving human participants published between January 1, 2010, and December 31, 2019. Specifically, we employed network analysis to evaluate associations in the following areas: (1) peer-reviewed journals, (2) authors, (3) organizations/institutions, and (4) relevant key words. PARTICIPANTS Included studies were published in peer-reviewed journals available on Web of Science database, using US military service members or veterans. DESIGN Bibliometric network analytical review. MAIN MEASURES Outcomes for each analysis included number of articles, citations, total link strength, and clusters. RESULTS The top publishing journals were (1) Journal of Head Trauma and Rehabilitation, (2) Military Medicine, (3) Brain Injury, (4) Journal of Neurotrauma, and (5) Journal of Rehabilitation Research and Development. The top publishing authors were (1) French, (2) Lange, (3) Cooper, (4) Vanderploeg, and (5) Brickell. The top research institutions were (1) Defense and Veterans Brain Injury Center, (2) Uniformed Services University of the Health Sciences, (3) University of California San Diego, (4) Walter Reed National Military Medical Center, and (5) Boston University. The top co-occurring key words in this analysis were (1) posttraumatic stress disorder (PTSD), (2) persistent postconcussion symptoms (PPCS), (3) blast injury, (4) postconcussion syndrome (PCS), and (5) Alzheimer's disease. CONCLUSIONS The results of this network analysis indicate a clear focus on veteran health, as well as investigations on chronic effects of mTBI. Research in civilian mTBI indicates that delaying treatment for symptoms and impairments related to mTBI may not be the most precise treatment strategy. Increasing the number of early, active, and targeted treatment trials in military personnel could translate to meaningful improvements in clinical practices for managing mTBI in this population.
Collapse
Affiliation(s)
- Shawn R Eagle
- Departments of Orthopaedic Surgery (Drs Eagle, Collins, and Kontos) and Sports Medicine and Nutrition (Drs Connaboy and Flanagan), University of Pittsburgh, Pittsburgh, Pennsylvania; UPMC Sports Medicine Concussion Program, Pittsburgh, Pennsylvania (Drs Collins and Kontos); US Army Medical Research Directorate-West, Walter Reed Army Institute of Research, Joint Base Lewis-McChord, Washington (Dr Dretsch); and VA Puget Sound Health Care System-American Lake Division, Tacoma, Washington (Dr Uomoto)
| | | | | | | | | | | | | |
Collapse
|
7
|
Relations Among Performance and Symptom Validity, Mild Traumatic Brain Injury, and Posttraumatic Stress Disorder Symptom Burden in Postdeployment Veterans. PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09415-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
8
|
Nelson NW, Disner SG, Anderson CR, Doane BM, McGuire K, Lamberty GJ, Hoelzle J, Sponheim SR. Blast concussion and posttraumatic stress as predictors of postcombat neuropsychological functioning in OEF/OIF/OND veterans. Neuropsychology 2020; 34:116-126. [PMID: 31545626 PMCID: PMC6940504 DOI: 10.1037/neu0000594] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
OBJECTIVES Many combat veterans exhibit cognitive limitations of uncertain origin. In this study, we examined factors that predict cognitive functioning by considering effects of blast-related concussion (BRC), non-blast-related concussion (NBRC), and posttraumatic stress disorder (PTSD) symptoms. Analyses specifically tested whether (a) BRC and NBRC were distinct in their prediction of cognitive performance; (b) a dose-response relationship existed between recurrent concussion (BRC and NBRC) and cognitive impairment; and (c) PTSD symptoms mediated the relationship between BRC and cognitive performance. METHOD Two hundred eighty veterans with combat zone deployment histories completed semistructured clinical interviews to define BRC and NBRC histories, current and past mental health disorders, and dimensional ratings of PTSD symptomatology. Participants were also administered a number of neuropsychological measures to appraise cognitive functioning. RESULTS A structural equation model (SEM) suggested that BRC and NBRC were not distinct in their prediction of cognitive performance, and there was no evidence that recurrent concussion (blast or nonblast) was directly associated with cognitive performance. BRC was significantly associated with PTSD symptoms (r = .24), PTSD symptoms were significantly associated with cognitive performance in the SEM (r = -.27), and PTSD symptoms significantly mediated the link between BRC and cognitive performance (p = .03). CONCLUSIONS These results suggest that concussion history fails to directly contribute to cognitive performance, regardless of mechanism (blast or nonblast) and recurrence. BRC is nonetheless unique in its contribution to PTSD and PTSD-related cognitive deficits. Results support interventions specific to PTSD management in the interest of promoting neuropsychological functioning among war veterans. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Collapse
|
9
|
Moore RA, Lippa SM, Brickell TA, French LM, Lange RT. Clinical utility of WAIS-IV 'excessive decline from premorbid functioning' scores to detect invalid test performance following traumatic brain injury. Clin Neuropsychol 2019; 34:512-528. [PMID: 31608766 DOI: 10.1080/13854046.2019.1668059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Objective: Excessive Decline from Premorbid Functioning (EDPF), an atypical discrepancy between demographically predicted and obtained Wechsler Adult Intelligence Scale-4th Edition (WAIS-IV) scores, has been recently proposed as a potential embedded performance validity test (PVT). This study examined the clinical utility of EDPF scores to detect invalid test performance following traumatic brain injury (TBI).Methods: Participants were 194 U.S. military service members who completed neuropsychological testing on average 2.4 years (SD = 4.0) following uncomplicated mild, complicated mild, moderate, severe, or penetrating TBI (Age: M = 34.0, SD = 9.9). Using TBI severity and PVT performance (i.e., PVT Pass/Fail), participants were classified into three groups: Uncomplicated Mild TBI-PVT Fail (MTBI-Fail; n = 21), Uncomplicated Mild TBI-PVT Pass (MTBI-Pass; n = 94), and Complicated Mild to Severe/Penetrating TBI-PVT Pass (CM/STBI-Pass; n = 79). Seven EDPF measures were calculated by subtracting WAIS-IV obtained index scores from the demographically predicted scores from the Test of Premorbid Functioning (TOPF). Cutoff scores to detect invalid test performance were examined for each EDPF measure separately.Results: The MTBI-Fail group had higher scores than the MTBI-Pass and CM/STBI-Pass groups on five of the seven EDPF measures (p<.05). Overall, the EDPF measure using the Processing Speed Index (EDPF-PSI) was the most useful score to detect invalid test performance. However, sensitivity was only low to moderate depending on the cutoff score used.Conclusions: These findings provide support for the use of EDPF as an embedded PVT to be considered along with other performance validity data when administering the WAIS-IV.
Collapse
Affiliation(s)
- Rich A Moore
- Neuropsychology Assessment Services, Walter Reed National Military Medical Center, Bethesda, MD, USA
| | - Sara M Lippa
- Defense and Veterans Brain Injury Center, Walter Reed National Military Medical Center, Silver Spring, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA
| | - Tracey A Brickell
- Defense and Veterans Brain Injury Center, Walter Reed National Military Medical Center, Silver Spring, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA.,Uniformed Services University of the Health Sciences, Bethesda, MD, USA
| | - Louis M French
- Defense and Veterans Brain Injury Center, Walter Reed National Military Medical Center, Silver Spring, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA.,Uniformed Services University of the Health Sciences, Bethesda, MD, USA
| | - Rael T Lange
- Defense and Veterans Brain Injury Center, Walter Reed National Military Medical Center, Silver Spring, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA.,University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
10
|
Lippa SM, Lange RT, French LM, Iverson GL. Performance Validity, Neurocognitive Disorder, and Post-concussion Symptom Reporting in Service Members with a History of Mild Traumatic Brain Injury. Arch Clin Neuropsychol 2019; 33:606-618. [PMID: 29069278 DOI: 10.1093/arclin/acx098] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2017] [Accepted: 09/26/2017] [Indexed: 11/13/2022] Open
Abstract
Objective To examine the influence of different performance validity test (PVT) cutoffs on neuropsychological performance, post-concussion symptoms, and rates of neurocognitive disorder and postconcussional syndrome following mild traumatic brain injury (MTBI) in active duty service members. Method Participants were 164 service members (Age: M = 28.1 years [SD = 7.3]) evaluated on average 4.1 months (SD = 5.0) following injury. Participants were divided into three mutually exclusive groups using original and alternative cutoff scores on the Test of Memory Malingering (TOMM) and the Effort Index (EI) from the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): (a) PVT-Pass, n = 85; (b) Alternative PVT-Fail, n = 53; and (c) Original PVT-Fail, n = 26. Participants also completed the Neurobehavioral Symptom Inventory. Results The PVT-Pass group performed better on cognitive testing and reported fewer symptoms than the two PVT-Fail groups. The Original PVT-Fail group performed more poorly on cognitive testing and reported more symptoms than the Alternative PVT-Fail group. Both PVT-Fail groups were more likely to meet DSM-5 Category A criteria for mild and major neurocognitive disorder and symptom reporting criteria for postconcussional syndrome than the PVT-Pass group. When alternative PVT cutoffs were used instead of original PVT cutoffs, the number of participants with valid data meeting cognitive testing criteria for neurocognitive disorder or postconcussional syndrome decreased dramatically. Conclusion PVT performance is significantly and meaningfully related to overall neuropsychological outcome. By using only original cutoffs, clinicians and researchers may miss people with invalid performances.
Collapse
Affiliation(s)
- Sara M Lippa
- Defense and Veterans Brain Injury Center, Bethesda, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA
| | - Rael T Lange
- Defense and Veterans Brain Injury Center, Bethesda, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA.,Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada
| | - Louis M French
- Defense and Veterans Brain Injury Center, Bethesda, MD, USA.,National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA.,Center for Neuroscience and Regenerative Medicine, Bethesda, MD, USA.,Department of Physical Medicine and Rehabilitation, Center for Rehabilitation Sciences Research, Uniformed Services University of the Health Sciences, Bethesda, MD, USA
| | - Grant L Iverson
- Defense and Veterans Brain Injury Center, Bethesda, MD, USA.,Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, USA.,Department of Physical Medicine and Rehabilitation, Spaulding Rehabilitation Hospital, Charlestown, MA, USA.,Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Boston, MA, USA
| |
Collapse
|
11
|
Abstract
OBJECTIVES This study investigated the relationship between close proximity to detonated blast munitions and cognitive functioning in OEF/OIF/OND Veterans. METHODS A total of 333 participants completed a comprehensive evaluation that included assessment of neuropsychological functions, psychiatric diagnoses and history of military and non-military brain injury. Participants were assigned to a Close-Range Blast Exposure (CBE) or Non-Close-Range Blast Exposure (nonCBE) group based on whether they had reported being exposed to at least one blast within 10 meters. RESULTS Groups were compared on principal component scores representing the domains of memory, verbal fluency, and complex attention (empirically derived from a battery of standardized cognitive tests), after adjusting for age, education, PTSD diagnosis, sleep quality, substance abuse disorder, and pain. The CBE group showed poorer performance on the memory component. Rates of clinical impairment were significantly higher in the CBE group on select CVLT-II indices. Exploratory analyses examined the effects of concussion and multiple blasts on test performance and revealed that number of lifetime concussions did not contribute to memory performance. However, accumulating blast exposures at distances greater than 10 meters did contribute to poorer performance. CONCLUSIONS Close proximity to detonated blast munitions may impact memory, and Veterans exposed to close-range blast are more likely to demonstrate clinically meaningful deficits. These findings were observed after statistically adjusting for comorbid factors. Results suggest that proximity to blast should be considered when assessing for memory deficits in returning Veterans. Comorbid psychiatric factors may not entirely account for cognitive difficulties. (JINS, 2018, 24, 466-475).
Collapse
|
12
|
Lippa SM, Lange RT, Bailie JM, Kennedy JE, Brickell TA, French LM. Utility of the Validity-10 scale across the recovery trajectory following traumatic brain injury. ACTA ACUST UNITED AC 2018; 53:379-90. [PMID: 27273336 DOI: 10.1682/jrrd.2015.01.0009] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2015] [Revised: 07/16/2015] [Indexed: 11/05/2022]
Abstract
The Validity-10 scale was recently developed to screen for symptom exaggeration in patients following traumatic brain injury (TBI). However, it has only been validated on patients with TBI largely in the chronic phase of recovery. The influence of time since injury on the Validity-10 scale was investigated in 2,661 male servicemembers with TBI presenting to six U.S. Defense and Veterans Brain Injury Centers. Participants completed the Neurobehavioral Symptom Inventory (NSI). The Validity-10 scale and NSI total score were both weakly statistically significantly (1) positively correlated with time since injury, (2) negatively correlated with bodily injury severity, and (3) higher in participants undergoing medical board evaluations than in participants who returned to duty or were still hospitalized. Participants were statistically more likely to screen positive for possible symptom exaggeration on the Validity-10 scale as time since injury increased. However, the Validity-10 scale was only weakly related to time since injury, TBI severity, bodily injury severity, disposition, age, and return to duty status. That false positives are not increased in the acute phase of recovery and that the Validity-10 scale is not strongly related to clinical factors support the use of the Validity-10 scale in the acute recovery phase and across the TBI recovery trajectory.
Collapse
|
13
|
White Matter Associations With Performance Validity Testing in Veterans With Mild Traumatic Brain Injury: The Utility of Biomarkers in Complicated Assessment. J Head Trauma Rehabil 2018; 31:346-59. [PMID: 26360002 DOI: 10.1097/htr.0000000000000183] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE Failure on performance validity tests (PVTs) is common in Veterans with histories of mild traumatic brain injury (mTBI), leading to questionable validity of clinical presentations. PARTICIPANTS Using diffusion tensor imaging, we investigated white matter (WM) integrity and cognition in 79 Veterans with history of mTBI who passed PVTs (n = 43; traumatic brain injury [TBI]-passed), history of mTBI who failed at least 1 PVT (n = 13; TBI-failed), and military controls (n = 23; MCs) with no history of TBI. RESULTS The TBI-failed group demonstrated significantly lower cognitive scores relative to MCs and the TBI-passed group; however, no such differences were observed between MCs and the TBI-passed group. On a global measure of WM integrity (ie, WM burden), the TBI-failed group showed more overall WM abnormalities than the other groups. However, no differences were observed between the MCs and TBI-passed group on WM burden. Interestingly, regional WM analyses revealed abnormalities in the anterior internal capsule and cingulum of both TBI subgroups relative to MCs. Moreover, compared with the TBI-passed group, the TBI-failed group demonstrated significantly decreased WM integrity in the corpus callosum. CONCLUSIONS Findings revealed that, within our sample, WM abnormalities are evident in those who fail PVTs. This study adds to the burgeoning PVT literature by suggesting that poor PVT performance does not negate the possibility of underlying WM abnormalities in military personnel with history of mTBI.
Collapse
|
14
|
Brancu M, Wagner HR, Morey RA, Beckham JC, Calhoun PS, Tupler LA, Marx CE, Taber KH, Hurley RA, Rowland J, McDonald SD, Hoerle JM, Moore SD, Kudler HS, Weiner RD, Fairbank JA. The Post-Deployment Mental Health (PDMH) study and repository: A multi-site study of US Afghanistan and Iraq era veterans. Int J Methods Psychiatr Res 2017; 26:e1570. [PMID: 28656593 PMCID: PMC6492939 DOI: 10.1002/mpr.1570] [Citation(s) in RCA: 57] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2016] [Revised: 03/21/2017] [Accepted: 04/10/2017] [Indexed: 12/15/2022] Open
Abstract
The United States (US) Department of Veterans Affairs (VA) Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MIRECC) Post-Deployment Mental Health (PDMH) multi-site study examines post-deployment mental health in US military Afghanistan/Iraq-era veterans. The study includes the comprehensive behavioral health characterization of over 3600 study participants and the genetic, metabolomic, neurocognitive, and neuroimaging data for many of the participants. The study design also incorporates an infrastructure for a data repository to re-contact participants for follow-up studies. The overwhelming majority (94%) of participants consented to be re-contacted for future studies, and our recently completed feasibility study indicates that 73-83% of these participants could be reached successfully for enrollment into longitudinal follow-up investigations. Longitudinal concurrent cohort follow-up studies will be conducted (5-10+ years post-baseline) to examine predictors of illness chronicity, resilience, recovery, functional outcome, and other variables, and will include neuroimaging, genetic/epigenetic, serum biomarker, and neurocognitive studies, among others. To date, the PDMH study has generated more than 35 publications from the baseline data and the repository has been leveraged in over 20 publications from follow-up studies drawing from this cohort. Limitations that may affect data collection for a longitudinal follow-up study are also presented.
Collapse
Affiliation(s)
- Mira Brancu
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - H. Ryan Wagner
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Rajendra A. Morey
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Jean C. Beckham
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Patrick S. Calhoun
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Larry A. Tupler
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Christine E. Marx
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Katherine H. Taber
- W.G. Hefner VA Medical CenterSalisburyNorth CarolinaUSA
- Division of Biomedical SciencesEdward Via College of Osteopathic MedicineBlacksburgVirginiaUSA
- Department of Physical Medicine and RehabilitationBaylor College of MedicineHoustonTexasUSA
| | - Robin A. Hurley
- W.G. Hefner VA Medical CenterSalisburyNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesBaylor College of MedicineHoustonTexasUSA
- Departments of Psychiatry and Behavioral MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
- Department of RadiologyWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - Jared Rowland
- W.G. Hefner VA Medical CenterSalisburyNorth CarolinaUSA
- Departments of Psychiatry and Behavioral MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
- Department of Neurobiology and AnatomyWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - Scott D. McDonald
- Hunter Holmes McGuire VA Medical CenterRichmondVirginiaUSA
- Departments of Psychology and Physical Medicine and RehabilitationVirginia Commonwealth UniversityRichmondVirginiaUSA
| | | | - Scott D. Moore
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | - Harold S. Kudler
- Mental Health ServicesUS Department of Veterans AffairsWashingtonDistrict of ColumbiaUSA
| | - Richard D. Weiner
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| | | | - John A. Fairbank
- Durham VA Medical CenterDurhamNorth CarolinaUSA
- Department of Psychiatry and Behavioral SciencesDuke University School of MedicineDurhamNorth CarolinaUSA
| |
Collapse
|
15
|
Denning JH, Shura RD. Cost of malingering mild traumatic brain injury-related cognitive deficits during compensation and pension evaluations in the veterans benefits administration. APPLIED NEUROPSYCHOLOGY-ADULT 2017; 26:1-16. [DOI: 10.1080/23279095.2017.1350684] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- John H. Denning
- Department of Veteran Affairs, Mental Health Service, Ralph H. Johnson Veterans Affairs Medical Center, Charleston, South Carolina, USA
- Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, South Carolina, USA
| | - Robert D. Shura
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center, Salisbury, North Carolina, USA
- Mental Health and Behavioral Science Service Line, W. G. (Bill) Hefner Veterans Affairs Medical Center (VAMC), Salisbury, North Carolina, USA
- Department of Psychiatry and Behavioral Medicine, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA
| |
Collapse
|
16
|
Shura RD, Rowland JA, Martindale SL, Brearly TW, Delahanty MB, Miskey HM. Evaluating the motor slowing hypothesis of depression. Psychiatry Res 2017; 252:188-195. [PMID: 28284087 DOI: 10.1016/j.psychres.2017.01.074] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/18/2016] [Revised: 01/27/2017] [Accepted: 01/27/2017] [Indexed: 11/27/2022]
Abstract
The purpose of this study was to evaluate the hypothesis that processing speed deficits are the primary cognitive deficits in those with depression, consistent with the motor slowing hypothesis. Participants (n=223) were research volunteers who served in the US military since September 11, 2001, and denied a history of significant brain injuries. Depression was measured using a structured interview, the Personality Assessment Inventory (PAI), and the Beck Depression Inventory-II (BDI-II). Outcomes included performance on 10 processing speed variables. Invalid performance/report accounted for significant variance for 8 of 10 processing speed measures. There was not a consistent pattern of slowed processing speed in those with current depressive diagnoses compared to those without. However, depression symptom burden per the PAI Depression scale was significant for 7 of 10 processing speed tests. Only non-dominant fine motor dexterity was significantly slower in those with high versus low burden using BDI-II quartiles. Thus, the motor slowing hypothesis was supported, but only for depression burden and not diagnostic status or high versus low categorical classification. These results underscore the importance of validity assessment and consideration of how one measures psychiatric constructs when evaluating relations among symptoms and cognition.
Collapse
Affiliation(s)
- Robert D Shura
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC), Salisbury, NC, USA; Mental Health and Behavioral Sciences, W.G. "Bill" Hefner Veterans Affairs Medical Center, Salisbury, NC, USA; Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, NC, USA.
| | - Jared A Rowland
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC), Salisbury, NC, USA; Research and Academic Affairs, W.G. "Bill" Hefner Veterans Affairs Medical Center, Salisbury, NC, USA; Department of Neurobiology and Anatomy, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Sarah L Martindale
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC), Salisbury, NC, USA; Mental Health and Behavioral Sciences, W.G. "Bill" Hefner Veterans Affairs Medical Center, Salisbury, NC, USA; Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Timothy W Brearly
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC), Salisbury, NC, USA; Mental Health and Behavioral Sciences, W.G. "Bill" Hefner Veterans Affairs Medical Center, Salisbury, NC, USA; Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Mariah B Delahanty
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC), Salisbury, NC, USA; Research and Academic Affairs, W.G. "Bill" Hefner Veterans Affairs Medical Center, Salisbury, NC, USA
| | - Holly M Miskey
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC), Salisbury, NC, USA; Mental Health and Behavioral Sciences, W.G. "Bill" Hefner Veterans Affairs Medical Center, Salisbury, NC, USA; Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, NC, USA
| |
Collapse
|
17
|
Jackson CE, Nordstrom L, Fonda JR, Fortier CB, Milberg WP, McGlinchey RE. Reporting of symptoms associated with concussion by OEF/OIF/OND Veterans: Comparison between research and clinical contexts. Brain Inj 2017; 31:485-492. [DOI: 10.1080/02699052.2017.1280740] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Colleen E. Jackson
- Geriatric Research, Education and Clinical Center (GRECC), and Translational Research Center for TBI and Stress Disorders (TRACTS), VA Boston Healthcare System, and Boston University School of Medicine, Boston, Massachusetts, USA
| | - Leslie Nordstrom
- Translational Research Center for TBI and Stress Disorders (TRACTS), VA Boston Healthcare System, Boston, Massachusetts, USA
| | - Jennifer R. Fonda
- Translational Research Center for TBI and Stress Disorders (TRACTS), VA Boston Healthcare System, Boston, Massachusetts, USA
| | - Catherine B. Fortier
- Geriatric Research, Education and Clinical Center (GRECC), and Translational Research Center for TBI and Stress Disorders (TRACTS), VA Boston Healthcare System, and Harvard Medical School, Boston, Massachusetts, USA
| | - William P. Milberg
- Geriatric Research, Education and Clinical Center (GRECC), and Translational Research Center for TBI and Stress Disorders (TRACTS), VA Boston Healthcare System, and Harvard Medical School, Boston, Massachusetts, USA
| | - Regina E. McGlinchey
- Geriatric Research, Education and Clinical Center (GRECC), and Translational Research Center for TBI and Stress Disorders (TRACTS), VA Boston Healthcare System, and Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
18
|
Stricker NH, Lippa SM, Green DL, McGlynn SM, Grande LJ, Milberg WP, McGlinchey RE. Elevated rates of memory impairment in military service-members and veterans with posttraumatic stress disorder. J Clin Exp Neuropsychol 2016; 39:768-785. [PMID: 27976973 DOI: 10.1080/13803395.2016.1264575] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
INTRODUCTION Studies investigating the neurocognitive effects of posttraumatic stress disorder (PTSD) routinely find "deficits" in various cognitive domains. However, the rate of cognitive impairment in individuals with PTSD remains unclear, as studies have focused on null hypothesis testing (NHT) and inferring patterns of impairment rather than empirically determining the rate of cognitive impairment in this sample. METHOD This study examined rates of cognitive impairment using a domain-specific approach in non-treatment-seeking Operation Enduring Freedom/Operation Iraqi Freedom/Operation New Dawn service members and veterans with (n = 92) and without (n = 79) PTSD and without substance abuse/dependence who passed a performance validity measure and were matched on age, education, estimated IQ, and ethnicity. Chi-square analyses were used to compare the rate of cognitive impairment across groups based on normative scores using three cutoffs (-1, -1.5, and -2 SDs). NHT was also used to compare performances across groups. RESULTS Individuals with PTSD showed higher rates of impairment in memory (-1-SD cutoff) than controls, but equivalent rates of impairment in attention, processing speed, and executive functioning; no significant differences were found on NHT. Impairment in any domain was also more prevalent in PTSD (-1-, -1.5-, and -2-SD cutoffs). No differences were found on NHT or rates of impairment in individuals with PTSD with (n = 34) and without (n = 58) depression. CONCLUSIONS Patients with PTSD were more likely to meet criteria for memory impairment and to show impairment in any domain than controls. Patients with PTSD and comorbid depression were no more likely to be impaired in any cognitive domain or to have lower scores on individual cognitive tasks than patients with PTSD alone. Clinicians noting cognitive impairment in individuals with PTSD should exercise caution before ascribing that impairment to another etiology if deficits are limited to memory.
Collapse
Affiliation(s)
- Nikki H Stricker
- a VA Boston Healthcare System , Boston , MA , USA.,b Department of Psychiatry , Boston University School of Medicine , Boston , MA , USA.,c Department of Psychiatry and Psychology , Mayo Clinic , Rochester , MN , USA
| | - Sara M Lippa
- d Defense and Veterans Brain Injury Center , Bethesda , MD , USA
| | | | - Susan M McGlynn
- a VA Boston Healthcare System , Boston , MA , USA.,b Department of Psychiatry , Boston University School of Medicine , Boston , MA , USA
| | - Laura J Grande
- b Department of Psychiatry , Boston University School of Medicine , Boston , MA , USA
| | - William P Milberg
- e Translational Research Center for TBI and Stress Disorders (TRACTS) and Geriatric; Research, Education and Clinical Center (GRECC) , Boston , MA , USA.,f Department of Psychiatry , Harvard Medical School , Boston , MA , USA
| | - Regina E McGlinchey
- e Translational Research Center for TBI and Stress Disorders (TRACTS) and Geriatric; Research, Education and Clinical Center (GRECC) , Boston , MA , USA.,f Department of Psychiatry , Harvard Medical School , Boston , MA , USA
| |
Collapse
|
19
|
An KY, Kaploun K, Erdodi LA, Abeare CA. Performance validity in undergraduate research participants: a comparison of failure rates across tests and cutoffs. Clin Neuropsychol 2016; 31:193-206. [DOI: 10.1080/13854046.2016.1217046] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Kelly Y. An
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Kristen Kaploun
- Department of Psychology, University of Windsor, Windsor, Canada
| | - Laszlo A. Erdodi
- Department of Psychology, University of Windsor, Windsor, Canada
| | | |
Collapse
|
20
|
Shura RD, Miskey HM, Rowland JA, Yoash-Gantz RE, Denning JH. Embedded Performance Validity Measures with Postdeployment Veterans: Cross-Validation and Efficiency with Multiple Measures. APPLIED NEUROPSYCHOLOGY-ADULT 2015; 23:94-104. [DOI: 10.1080/23279095.2015.1014556] [Citation(s) in RCA: 49] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Robert D. Shura
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center, and Mental Health and Behavioral Sciences Service Line, W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, and Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Holly M. Miskey
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center, and Mental Health and Behavioral Sciences Service Line, W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, and Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Jared A. Rowland
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center, and Research & Academic Affairs Service Line, W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, and Department of Psychiatry & Behavioral Sciences, Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Ruth E. Yoash-Gantz
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center, and Mental Health and Behavioral Sciences Service Line, W. G. “Bill” Hefner Veterans Affairs Medical Center, Salisbury, and Department of Psychiatry and Behavioral Sciences, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - John H. Denning
- Tennessee Valley Healthcare System, Alvin C. York Veterans Affairs Medical Center, Mental Health Care Line, Murfreesboro, Tennessee
| |
Collapse
|
21
|
Silver JM. Invalid symptom reporting and performance: What are we missing? NeuroRehabilitation 2015; 36:463-9. [DOI: 10.3233/nre-151234] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
22
|
Bigler ED. Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging Behav 2015; 9:421-44. [DOI: 10.1007/s11682-015-9409-1] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
|
23
|
Sherer M, Davis LC, Sander AM, Nick TG, Luo C, Pastorek N, Hanks R. Factors Associated with Word Memory Test Performance in Persons with Medically Documented Traumatic Brain Injury. Clin Neuropsychol 2015; 29:522-41. [PMID: 26063081 DOI: 10.1080/13854046.2015.1052763] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
OBJECTIVES (1) To examine the rate of poor performance validity in a large, multicenter, prospectively accrued cohort of community dwelling persons with medically documented traumatic brain injury (TBI), (2) to identify factors associated with Word Memory Test (WMT) performance in persons with TBI. METHOD This was a prospective cohort, observational study of 491 persons with medically documented TBI. Participants were administered a battery of cognitive tests, questionnaires on emotional distress and post-concussive symptoms, and a performance validity test (WMT). Additional data were collected by interview and review of medical records. RESULTS One hundred and seventeen participants showed poor performance validity using the standard cutoff. Variable cluster analysis was conducted as a data reduction strategy. Findings revealed that the 10 cognitive tests and questionnaires could be summarized as 4 indices of emotional distress, speed of cognitive processing, verbal memory, and verbal fluency. Regression models revealed that verbal memory, emotional distress, age, and injury severity (time to follow commands) made unique contribution to prediction of poor performance validity. CONCLUSIONS Poor performance validity was common in a research sample of persons with medically documented TBI who were not evaluated in conjunction with litigation, compensation claims, or current report of symptoms. Poor performance validity was associated with poor performance on cognitive tests, greater emotional distress, lower injury severity, and greater age. Many participants expected to have residual deficits based on initial injury severity showed poor performance validity.
Collapse
Affiliation(s)
- Mark Sherer
- a Brain Injury Research Center , TIRR Memorial Hermann , Houston , TX , USA
| | | | | | | | | | | | | |
Collapse
|
24
|
Scott JC, Matt GE, Wrocklage KM, Crnich C, Jordan J, Southwick SM, Krystal JH, Schweinsburg BC. A quantitative meta-analysis of neurocognitive functioning in posttraumatic stress disorder. Psychol Bull 2015. [PMID: 25365762 DOI: 10.1037/a00389039] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Posttraumatic stress disorder (PTSD) is associated with regional alterations in brain structure and function that are hypothesized to contribute to symptoms and cognitive deficits associated with the disorder. We present here the first systematic meta-analysis of neurocognitive outcomes associated with PTSD to examine a broad range of cognitive domains and describe the profile of cognitive deficits, as well as modifying clinical factors and study characteristics. This report is based on data from 60 studies totaling 4,108 participants, including 1,779 with PTSD, 1,446 trauma-exposed comparison participants, and 895 healthy comparison participants without trauma exposure. Effect-size estimates were calculated using a mixed-effects meta-analysis for 9 cognitive domains: attention/working memory, executive functions, verbal learning, verbal memory, visual learning, visual memory, language, speed of information processing, and visuospatial abilities. Analyses revealed significant neurocognitive effects associated with PTSD, although these ranged widely in magnitude, with the largest effect sizes in verbal learning (d = -.62), speed of information processing (d = -.59), attention/working memory (d = -.50), and verbal memory (d =-.46). Effect-size estimates were significantly larger in treatment-seeking than community samples and in studies that did not exclude participants with attention-deficit/hyperactivity disorder, and effect sizes were affected by between-group IQ discrepancies and the gender composition of the PTSD groups. Our findings indicate that consideration of neuropsychological functioning in attention, verbal memory, and speed of information processing may have important implications for the effective clinical management of persons with PTSD. Results are further discussed in the context of cognitive models of PTSD and the limitations of this literature.
Collapse
Affiliation(s)
- J Cobb Scott
- VISN4 Mental Illness Research, Education, and Clinical Center, Philadelphia VA Medical Center
| | - Georg E Matt
- Department of Psychology, San Diego State University
| | | | | | - Jessica Jordan
- National Center for PTSD, VA Connecticut Healthcare System
| | | | - John H Krystal
- National Center for PTSD, VA Connecticut Healthcare System
| | | |
Collapse
|
25
|
Scott JC, Matt GE, Wrocklage KM, Crnich C, Jordan J, Southwick SM, Krystal JH, Schweinsburg BC. A quantitative meta-analysis of neurocognitive functioning in posttraumatic stress disorder. Psychol Bull 2015; 141:105-140. [PMID: 25365762 PMCID: PMC4293317 DOI: 10.1037/a0038039] [Citation(s) in RCA: 317] [Impact Index Per Article: 35.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Posttraumatic stress disorder (PTSD) is associated with regional alterations in brain structure and function that are hypothesized to contribute to symptoms and cognitive deficits associated with the disorder. We present here the first systematic meta-analysis of neurocognitive outcomes associated with PTSD to examine a broad range of cognitive domains and describe the profile of cognitive deficits, as well as modifying clinical factors and study characteristics. This report is based on data from 60 studies totaling 4,108 participants, including 1,779 with PTSD, 1,446 trauma-exposed comparison participants, and 895 healthy comparison participants without trauma exposure. Effect-size estimates were calculated using a mixed-effects meta-analysis for 9 cognitive domains: attention/working memory, executive functions, verbal learning, verbal memory, visual learning, visual memory, language, speed of information processing, and visuospatial abilities. Analyses revealed significant neurocognitive effects associated with PTSD, although these ranged widely in magnitude, with the largest effect sizes in verbal learning (d = -.62), speed of information processing (d = -.59), attention/working memory (d = -.50), and verbal memory (d =-.46). Effect-size estimates were significantly larger in treatment-seeking than community samples and in studies that did not exclude participants with attention-deficit/hyperactivity disorder, and effect sizes were affected by between-group IQ discrepancies and the gender composition of the PTSD groups. Our findings indicate that consideration of neuropsychological functioning in attention, verbal memory, and speed of information processing may have important implications for the effective clinical management of persons with PTSD. Results are further discussed in the context of cognitive models of PTSD and the limitations of this literature.
Collapse
Affiliation(s)
- J. Cobb Scott
- VISN4 Mental Illness Research, Education, and Clinical Center at the Philadelphia VA Medical Center, Philadelphia, PA, 19104, USA
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Georg E. Matt
- Department of Psychology, San Diego State University, San Diego, CA, 92182, USA
| | | | | | - Jessica Jordan
- VA Connecticut Healthcare System, West Haven, CT, 06516, USA
| | - Steven M. Southwick
- VA Connecticut Healthcare System, West Haven, CT, 06516, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, 06511, USA
| | - John H. Krystal
- VA Connecticut Healthcare System, West Haven, CT, 06516, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, 06511, USA
- Department of Neurobiology, Yale University School of Medicine, New Haven, CT 06510 USA
- Psychiatry Services, Yale-New Haven Hospital, New Haven, CT 06510
| | - Brian C. Schweinsburg
- VA Connecticut Healthcare System, West Haven, CT, 06516, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, 06511, USA
| |
Collapse
|
26
|
Bigler ED. Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Inj 2014; 28:1623-38. [PMID: 25215453 PMCID: PMC4673569 DOI: 10.3109/02699052.2014.947627] [Citation(s) in RCA: 64] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2014] [Revised: 05/09/2014] [Accepted: 07/20/2014] [Indexed: 11/22/2022]
Abstract
BACKGROUND To understand the neurocognitive effects of brain injury, valid neuropsychological test findings are paramount. REVIEW This review examines the research on what has been referred to a symptom validity testing (SVT). Above a designated cut-score signifies a 'passing' SVT performance which is likely the best indicator of valid neuropsychological test findings. Likewise, substantially below cut-point performance that nears chance or is at chance signifies invalid test performance. Significantly below chance is the sine qua non neuropsychological indicator for malingering. However, the interpretative problems with SVT performance below the cut-point yet far above chance are substantial, as pointed out in this review. This intermediate, border-zone performance on SVT measures is where substantial interpretative challenges exist. Case studies are used to highlight the many areas where additional research is needed. Historical perspectives are reviewed along with the neurobiology of effort. Reasons why performance validity testing (PVT) may be better than the SVT term are reviewed. CONCLUSIONS Advances in neuroimaging techniques may be key in better understanding the meaning of border zone SVT failure. The review demonstrates the problems with rigidity in interpretation with established cut-scores. A better understanding of how certain types of neurological, neuropsychiatric and/or even test conditions may affect SVT performance is needed.
Collapse
Affiliation(s)
- Erin D. Bigler
- Department of Psychology
- Neuroscience Center
- Magnetic Resonance Imaging Research Facility, Brigham Young University
Provo, UTUSA
- Department of Psychiatry
- The Brain Institute of Utah, University of Utah
Salt Lake City, UTUSA
| |
Collapse
|
27
|
Clark AL, Amick MM, Fortier C, Milberg WP, McGlinchey RE. Poor Performance Validity Predicts Clinical Characteristics and Cognitive Test Performance of OEF/OIF/OND Veterans in a Research Setting. Clin Neuropsychol 2014; 28:802-25. [DOI: 10.1080/13854046.2014.904928] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|