1
|
Donders J, Vos M. Utility of CVLT-3 response bias as a measure of performance validity after traumatic brain injury. Clin Neuropsychol 2023; 37:91-100. [PMID: 35285406 DOI: 10.1080/13854046.2022.2051152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
OBJECTIVE We sought to determine the utility of a new performance validity index that was recently proposed. In particular, we wanted to determine if this index would be associated with a specificity of at least .90, a sensitivity of at least .40, and an Area Under the Curve of at least .70 in a traumatic brain injury (TBI) sample. METHOD We used logistic regression to investigate how well this new index could distinguish persons with TBI (n = 148) who were evaluated within 1-36 months after injury. All participants had been classified on the basis of at least two independent performance validity tests as having provided valid performance (n = 128) or invalid performance (n = 20). RESULTS The new performance validity index had acceptable specificity (.96) but had suboptimal sensitivity (.35) and Area Under the Curve (.66). It was concerning that almost half (5/12) of the cases that were identified by this index as providing invalid effort were false positives. Although a slightly more liberal cut-off improved sensitivity, the problem with poor positive predictive power remained. The conventional Forced Choice index had relatively better classification accuracy. CONCLUSION Differences in base rates between the original sample of Martin et al. and the current one most likely affected positive predictive power of the new index. Although their performance validity has excellent specificity, the current results do not support the application of this index in the clinical evaluation of patients with traumatic brain injury when base rates of invalid performance differ markedly from those in the original study.
Collapse
Affiliation(s)
- Jacobus Donders
- Department of Psychology, Mary Free Bed Rehabilitation Hospital, Grand Rapids, MI, USA
| | - Matthew Vos
- Department of Psychology, Calvin College, Grand Rapids, MI, USA
| |
Collapse
|
2
|
Donders J, Hayden A. Utility of the D-KEFS color word interference test as an embedded measure of performance validity after traumatic brain injury. Clin Neuropsychol 2022; 36:1964-1974. [PMID: 33327855 DOI: 10.1080/13854046.2020.1861659] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
ObjectiveWe sought to determine the accuracy of embedded performance measures for the D-KEFS Color Word Interference Test that were recently proposed by Eglit et al. In particular, we wanted to determine if these indices would be associated with a specificity of at least .90, an Area Under the Curve of at least .70 and a positive likelihood ratio of at least 2. Method: We used logistic regression to investigate how well these indices could distinguish persons with traumatic brain injury (n = 169) who were evaluated within 1-12 months after injury. All participants had been classified on the basis of at least three independent performance validity tests as valid performance (n = 145) or invalid performance (n = 24). Results: None of the three indices that Eglit et al. had proposed as embedded performance measures for the D-KEFS Color Word Interference Test achieved the a priori defined minimally acceptable level of specificity. One of them did meet the criteria for Area Under the Curve as well as positive likelihood ratio. Conclusion: The current results do not support the application of the Eglit et al. embedded performance validity measures for the D-KEFS Color Word Interference Test in the clinical evaluation of patients with traumatic brain injury.
Collapse
Affiliation(s)
- Jacobus Donders
- Department of Psychology, Mary Free Bed Rehabilitation Hospital, Grand Rapids, MI, USA
| | - Ashley Hayden
- Department of Psychology, Hope College, Holland, MI, USA
| |
Collapse
|
3
|
What are the predictors of TOMM failure in clinical TBI populations? A retrospective analysis. J Int Neuropsychol Soc 2022; 29:336-345. [PMID: 35811454 DOI: 10.1017/s1355617722000339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVES To determine base rates of invalid performance on the Test of Memory Malingering (TOMM) in patients with traumatic brain injury (TBI) undertaking rehabilitation who were referred for clinical assessment, and the factors contributing to TOMM failure. METHODS Retrospective file review of consecutive TBI referrals for neuropsychological assessment over seven years. TOMM failure was conventionally defined as performance <45/50 on Trial 2 or Retention Trial. Demographic, injury, financial compensation, occupational, and medical variables were collected. RESULTS Four hundred and ninety one TBI cases (Median age = 40 years [IQR = 26-52], 79% male, 82% severe TBI) were identified. Overall, 48 cases (9.78%) failed the TOMM. Logistic regression analyses revealed that use of an interpreter during the assessment (adjusted odds ratio [aOR] = 8.25, 95%CI = 3.96-17.18), outpatient setting (aOR = 4.80, 95%CI = 1.87-12.31) and post-injury psychological distress (aOR = 2.77, 95%CI = 1.35-5.70) were significant multivariate predictors of TOMM failure. The TOMM failure rate for interpreter cases was 49% (21/43) in the outpatient setting vs. 7% (2/30) in the inpatient setting. By comparison, 9% (21/230) of non-interpreter outpatient cases failed the TOMM vs. 2% (4/188) of inpatient cases. CONCLUSIONS TOMM failure very rarely occurs in clinical assessment of TBI patients in the inpatient rehabilitation setting. It is more common in the outpatient setting, particularly in non-English-speaking people requiring an interpreter. The findings reinforce the importance of routinely administering stand-alone performance validity tests in assessments of clinical TBI populations, particularly in outpatient settings, to ensure that neuropsychological test results can be interpreted with a high degree of confidence.
Collapse
|
4
|
Uiterwijk D, Stargatt R, Crowe SF. Objective Cognitive Outcomes and Subjective Emotional Sequelae in Litigating Adults with a Traumatic Brain Injury: The Impact of Performance and Symptom Validity Measures. Arch Clin Neuropsychol 2022; 37:1662-1687. [PMID: 35704852 DOI: 10.1093/arclin/acac039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/13/2022] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE This study examined the relative contribution of performance and symptom validity in litigating adults with traumatic brain injury (TBI), as a function of TBI severity, and examined the relationship between self-reported emotional symptoms and cognitive tests scores while controlling for validity test performance. METHOD Participants underwent neuropsychological assessment between January 2012 and June 2021 in the context of compensation-seeking claims related to a TBI. All participants completed a cognitive test battery, the Personality Assessment Inventory (including symptom validity tests; SVTs), and multiple performance validity tests (PVTs). Data analyses included independent t-tests, one-way ANOVAs, correlation analyses, and hierarchical multiple regression. RESULTS A total of 370 participants were included. Atypical PVT and SVT performance were associated with poorer cognitive test performance and higher emotional symptom report, irrespective of TBI severity. PVTs and SVTs had an additive effect on cognitive test performance for uncomplicated mTBI, but less so for more severe TBI. The relationship between emotional symptoms and cognitive test performance diminished substantially when validity test performance was controlled, and validity test performance had a substantially larger impact than emotional symptoms on cognitive test performance. CONCLUSION Validity test performance has a significant impact on the neuropsychological profiles of people with TBI, irrespective of TBI severity, and plays a significant role in the relationship between emotional symptoms and cognitive test performance. Adequate validity testing should be incorporated into every neuropsychological assessment, and associations between emotional symptoms and cognitive outcomes that do not consider validity testing should be interpreted with extreme caution.
Collapse
Affiliation(s)
- Daniel Uiterwijk
- Department of Psychology, Counselling and Therapy, School of Psychology and Public Health, La Trobe University, Victoria, Australia
| | - Robyn Stargatt
- Department of Psychology, Counselling and Therapy, School of Psychology and Public Health, La Trobe University, Victoria, Australia
| | - Simon F Crowe
- Department of Psychology, Counselling and Therapy, School of Psychology and Public Health, La Trobe University, Victoria, Australia
| |
Collapse
|
5
|
Niesten IJM, Merckelbach H, Dandachi-FitzGerald B, Jutten-Rooijakkers I, van Impelen A. Experts’ Failure to Consider the Negative Predictive Power of Symptom Validity Tests. Front Psychol 2022; 13:789762. [PMID: 35369141 PMCID: PMC8971289 DOI: 10.3389/fpsyg.2022.789762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 02/21/2022] [Indexed: 11/13/2022] Open
Abstract
Feigning (i.e., grossly exaggerating or fabricating) symptoms distorts diagnostic evaluations. Therefore, dedicated tools known as symptom validity tests (SVTs) have been developed to help clinicians differentiate feigned from genuine symptom presentations. While a deviant SVT score is an indicator of a feigned symptom presentation, a non-deviant score provides support for the hypothesis that the symptom presentation is valid. Ideally, non-deviant SVT scores should temper suspicion of feigning even in cases where the patient fits the DSM’s stereotypical yet faulty profile of the “antisocial” feigner. Across three studies, we tested whether non-deviant SVT scores, indeed, have this corrective effect. We gave psychology students (Study 1, N = 55) and clinical experts (Study 2, N = 42; Study 3, N = 93) a case alluding to the DSM profile of feigning. In successive steps, they received information about the case, among which non-deviant SVT outcomes. After each step, participants rated how strongly they suspected feigning and how confident they were about their judgment. Both students and experts showed suspicion rates around the midpoint of the scale (i.e., 50) and did not respond to non-deviant SVT outcomes with lowered suspicion rates. In Study 4, we educated participants (i.e., psychology students, N = 92) about the shortcomings of the DSM’s antisocial typology of feigning and the importance of the negative predictive power of SVTs, after which they processed the case information. Judgments remained roughly similar to those in Studies 1–3. Taken together, our findings suggest that students and experts alike have difficulties understanding that non-deviant scores on SVTs reduce the probability of feigning as a correct differential diagnosis.
Collapse
Affiliation(s)
- Isabella J. M. Niesten
- Clinical Psychological Science, Maastricht University, Maastricht, Netherlands
- Clinical Psychology, Open University of the Netherlands, Heerlen, Netherlands
- *Correspondence: Isabella J. M. Niesten,
| | - Harald Merckelbach
- Clinical Psychological Science, Maastricht University, Maastricht, Netherlands
| | | | | | - Alfons van Impelen
- Clinical Psychological Science, Maastricht University, Maastricht, Netherlands
| |
Collapse
|
6
|
The Relationship Between Cognitive Functioning and Symptoms of Depression, Anxiety, and Post-Traumatic Stress Disorder in Adults with a Traumatic Brain Injury: a Meta-Analysis. Neuropsychol Rev 2021; 32:758-806. [PMID: 34694543 DOI: 10.1007/s11065-021-09524-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2020] [Accepted: 09/09/2021] [Indexed: 12/12/2022]
Abstract
A thorough understanding of the relationship between cognitive test performance and symptoms of depression, anxiety, or post-traumatic stress disorder (PTSD) in people with traumatic brain injury (TBI) is important given the high prevalence of these emotional symptoms following injury. It is also important to understand whether these relationships are affected by TBI severity, and the validity of test performance and symptom report. This meta-analysis was conducted to investigate whether these symptoms are associated with cognitive test performance alterations in adults with a TBI. This meta-analysis was prospectively registered on the PROSPERO International Prospective Register of Systematic Reviews website (registration number: CRD42018089194). The electronic databases Medline, PsycINFO, and CINAHL were searched for journal articles published up until May 2020. In total, 61 studies were included, which enabled calculation of pooled effect sizes for the cognitive domains of immediate memory (verbal and visual), recent memory (verbal and visual), attention, executive function, processing speed, and language. Depression had a small, negative relationship with most cognitive domains. These relationships remained, for the most part, when samples with mild TBI (mTBI)-only were analysed separately, but not for samples with more severe TBI (sTBI)-only. A similar pattern of results was found in the anxiety analysis. PTSD had a small, negative relationship with verbal memory, in samples with mTBI-only. No data were available for the PTSD analysis with sTBI samples. Moderator analyses indicated that the relationships between emotional symptoms and cognitive test performance may be impacted to some degree by exclusion of participants with atypical performance on performance validity tests (PVTs) or symptom validity tests (SVTs), however there were small study numbers and changes in effect size were not statistically significant. These findings are useful in synthesising what is currently known about the relationship between cognitive test performance and emotional symptoms in adults with TBI, demonstrating significant, albeit small, relationships between emotional symptoms and cognitive test performance in multiple domains, in non-military samples. Some of these relationships appeared to be mildly impacted by controlling for performance validity or symptom validity, however this was based on the relatively few studies using validity tests. More research including PVTs and SVTs whilst examining the relationship between emotional symptoms and cognitive outcomes is needed.
Collapse
|
7
|
Sanborn V, Lace J, Gunstad J, Galioto R. Considerations regarding noncredible performance in the neuropsychological assessment of patients with multiple sclerosis: A case series. APPLIED NEUROPSYCHOLOGY-ADULT 2021; 30:458-467. [PMID: 34514920 DOI: 10.1080/23279095.2021.1971229] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Determining the validity of data during clinical neuropsychological assessment is crucial for proper interpretation, and extensive literature has emphasized myriad methods of doing so in diverse samples. However, little research has considered noncredible presentation in persons with multiple sclerosis (pwMS). PwMS often experience one or more factors known to impact validity of data, including major neurocognitive impairment, psychological distress/psychogenic interference, and secondary gain. This case series aimed to illustrate the potential relationships between these factors and performance validity testing in pwMS. Six cases from an IRB-approved database containing pwMS referred for neuropsychological assessment at a large, academic medical center involving at least one of the above-stated factors were identified. Backgrounds, neuropsychological test data, and clinical considerations for each were reviewed. Interestingly, no pwMS diagnosed with major neurocognitive impairment was found to have noncredible performance, nor was any patient with noncredible performance in the absence of notable psychological distress. Given the variability of noncredible performance and multiplicity of factors affecting performance validity in pwMS, clinicians are strongly encouraged to consider psychometrically appropriate methods for evaluating validity of cognitive data in pwMS. Additional research aiming to elucidate base rates of, mechanisms begetting, and methods for assessing noncredible performance in pwMS is imperative.
Collapse
Affiliation(s)
| | - John Lace
- Cleveland Clinic, Neurological Institute, Section of Neuropsychology, Cleveland, OH, USA
| | - John Gunstad
- Psychological Sciences, Kent State University, Kent, OH, USA.,Brain Health Research Institute, Kent State University, Kent, OH, USA
| | - Rachel Galioto
- Cleveland Clinic, Neurological Institute, Section of Neuropsychology, Cleveland, OH, USA.,Cleveland Clinic, Mellen Center for Multiple Sclerosis, Cleveland, OH, USA
| |
Collapse
|
8
|
Ord AS, Shura RD, Sansone AR, Martindale SL, Taber KH, Rowland JA. Performance validity and symptom validity tests: Are they measuring different constructs? Neuropsychology 2021; 35:241-251. [PMID: 33829824 DOI: 10.1037/neu0000722] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
OBJECTIVE To evaluate the relationships among performance validity, symptom validity, symptom self-report, and objective cognitive testing. METHOD Combat Veterans (N = 338) completed a neurocognitive assessment battery and several self-report symptom measures assessing depression, posttraumatic stress disorder (PTSD) symptoms, sleep quality, pain interference, and neurobehavioral complaints. All participants also completed two performance validity tests (PVTs) and one stand-alone symptom validity test (SVT) along with two embedded SVTs. RESULTS Results of an exploratory factor analysis revealed a three-factor solution: performance validity, cognitive performance, and symptom report (SVTs loaded on the third factor). Results of t tests demonstrated that participants who failed PVTs displayed significantly more severe symptoms and significantly worse performance on most measures of neurocognitive functioning compared to those who passed. Participants who failed a stand-alone SVT also reported significantly more severe symptomatology on all symptom report measures, but the pattern of cognitive performance differed based on the selected SVT cutoff. Multiple linear regressions revealed that both SVT and PVT failure explained unique variance in symptom report, but only PVT failure significantly predicted cognitive performance. CONCLUSIONS Performance and symptom validity tests measure distinct but related constructs. SVTs and PVTs are significantly related to both cognitive performance and symptom report; however, the relationship between symptom validity and symptom report is strongest. SVTs are also differentially related to cognitive performance and symptom report based on the utilized cutoff score. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
Affiliation(s)
- Anna S Ord
- Mid-Atlantic Mental Illness Research, Education, and Clinical Center (MA-MIRECC)
| | | | | | | | | | | |
Collapse
|
9
|
Sherman EMS, Slick DJ, Iverson GL. Multidimensional Malingering Criteria for Neuropsychological Assessment: A 20-Year Update of the Malingered Neuropsychological Dysfunction Criteria. Arch Clin Neuropsychol 2020; 35:735-764. [PMID: 32377667 PMCID: PMC7452950 DOI: 10.1093/arclin/acaa019] [Citation(s) in RCA: 152] [Impact Index Per Article: 38.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Accepted: 03/12/2020] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVES Empirically informed neuropsychological opinion is critical for determining whether cognitive deficits and symptoms are legitimate, particularly in settings where there are significant external incentives for successful malingering. The Slick, Sherman, and Iversion (1999) criteria for malingered neurocognitive dysfunction (MND) are considered a major milestone in the field's operationalization of neurocognitive malingering and have strongly influenced the development of malingering detection methods, including serving as the criterion of malingering in the validation of several performance validity tests (PVTs) and symptom validity tests (SVTs) (Slick, D.J., Sherman, E.M.S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545-561). However, the MND criteria are long overdue for revision to address advances in malingering research and to address limitations identified by experts in the field. METHOD The MND criteria were critically reviewed, updated with reference to research on malingering, and expanded to address other forms of malingering pertinent to neuropsychological evaluation such as exaggeration of self-reported somatic and psychiatric symptoms. RESULTS The new proposed criteria simplify diagnostic categories, expand and clarify external incentives, more clearly define the role of compelling inconsistencies, address issues concerning PVTs and SVTs (i.e., number administered, false positives, and redundancy), better define the role of SVTs and of marked discrepancies indicative of malingering, and most importantly, clearly define exclusionary criteria based on the last two decades of research on malingering in neuropsychology. Lastly, the new criteria provide specifiers to better describe clinical presentations for use in neuropsychological assessment. CONCLUSIONS The proposed multidimensional malingering criteria that define cognitive, somatic, and psychiatric malingering for use in neuropsychological assessment are presented.
Collapse
Affiliation(s)
| | | | - Grant L Iverson
- Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, USA
- Spaulding Rehabilitation Hospital and Spaulding Research Institute, Charlestown, MA, USA
- Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Charlestown, MA, USA
| |
Collapse
|
10
|
Martin PK, Schroeder RW. Base Rates of Invalid Test Performance Across Clinical Non-forensic Contexts and Settings. Arch Clin Neuropsychol 2020; 35:717-725. [DOI: 10.1093/arclin/acaa017] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2019] [Revised: 01/22/2020] [Accepted: 02/25/2020] [Indexed: 11/14/2022] Open
Abstract
Abstract
Objective
Base rates of invalidity in forensic neuropsychological contexts are well explored and believed to approximate 40%, whereas base rates of invalidity across clinical non-forensic contexts are relatively less known.
Methods
Adult-focused neuropsychologists (n = 178) were surveyed regarding base rates of invalidity across various clinical non-forensic contexts and practice settings. Median values were calculated and compared across contexts and settings.
Results
The median estimated base rate of invalidity across clinical non-forensic evaluations was 15%. When examining specific clinical contexts and settings, base rate estimates varied from 5% to 50%. Patients with medically unexplained symptoms (50%), external incentives (25%–40%), and oppositional attitudes toward testing (37.5%) were reported to have the highest base rates of invalidity. Patients with psychiatric illness, patients evaluated for attention deficit hyperactivity disorder, and patients with a history of mild traumatic brain injury were also reported to invalidate testing at relatively high base rates (approximately 20%). Conversely, patients presenting for dementia evaluation and patients with none of the previously mentioned histories and for whom invalid testing was unanticipated were estimated to produce invalid testing in only 5% of cases. Regarding practice setting, Veterans Affairs providers reported base rates of invalidity to be nearly twice that of any other clinical settings.
Conclusions
Non-forensic clinical patients presenting with medically unexplained symptoms, external incentives, or oppositional attitudes are reported to invalidate testing at base rates similar to that of forensic examinees. The impact of context-specific base rates on the clinical evaluation of invalidity is discussed.
Collapse
Affiliation(s)
- Phillip K Martin
- Department of Psychiatry and Behavioral Sciences, University of Kansas School of Medicine, Wichita, KS, USA
| | - Ryan W Schroeder
- Department of Psychiatry and Behavioral Sciences, University of Kansas School of Medicine, Wichita, KS, USA
| |
Collapse
|
11
|
Touradji P, Aucott JN, Yang T, Rebman AW, Bechtold KT. Cognitive Decline in Post-treatment Lyme Disease Syndrome. Arch Clin Neuropsychol 2019; 34:455-465. [PMID: 29945190 DOI: 10.1093/arclin/acy051] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Revised: 04/20/2018] [Accepted: 05/24/2018] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVE Patient-reported cognitive complaints are common in those with post-treatment Lyme disease syndrome (PTLDS). Objective evidence of cognitive impairment in this population is variable in part due to methodological variability in existing studies. In this study, we sought to use a systematic approach to characterizing PTLDS based on the most current consensus diagnosis. We further examined PTLDS-related cognitive decline, operationalized as a significant decline in cognitive test performance relative to premorbid cognitive ability. METHOD We enrolled a case series of 124 patients with confirmed PTLDS defined by Infectious Diseases Society of America-proposed case definition. Cognitive functioning was evaluated using standardized neuropsychological measures. RESULTS The majority (92%) of participants endorsed some level of cognitive difficulty, yet 50% of the sample showed no statistically or clinically significant cognitive decline, 26% of the sample evidenced significant cognitive decline on measures of memory and variably on measures of processing speed, and 24% of the sample were excluded from analyses due to suboptimal test engagement. CONCLUSIONS The current findings are consistent with the literature showing that the most robust neurocognitive deficit associated with PTLDS is in verbal memory and with variable decline in processing speed. Compared to population normative comparison standards, PTLDS-related cognitive decline remains mild. Thus, further research is needed to better understand factors related to the magnitude of subjective cognitive complaints as well as objective evidence of mild cognitive decline.
Collapse
Affiliation(s)
- Pegah Touradji
- Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - John N Aucott
- Division of Rheumatology, Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Ting Yang
- Division of Rheumatology, Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Alison W Rebman
- Division of Rheumatology, Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kathleen T Bechtold
- Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
12
|
Teodoro T, Edwards MJ, Isaacs JD. A unifying theory for cognitive abnormalities in functional neurological disorders, fibromyalgia and chronic fatigue syndrome: systematic review. J Neurol Neurosurg Psychiatry 2018; 89:1308-1319. [PMID: 29735513 PMCID: PMC6288708 DOI: 10.1136/jnnp-2017-317823] [Citation(s) in RCA: 91] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2017] [Revised: 03/24/2018] [Accepted: 04/10/2018] [Indexed: 12/17/2022]
Abstract
BACKGROUND Functional cognitive disorder (FCD) describes cognitive dysfunction in the absence of an organic cause. It is increasingly prevalent in healthcare settings yet its key neuropsychological features have not been reported in large patient cohorts. We hypothesised that cognitive profiles in fibromyalgia (FM), chronic fatigue syndrome (CFS) and functional neurological disorders (FNDs) would provide a template for characterising FCD. METHODS We conducted a systematic review of studies with cognition-related outcomes in FM, CFS and FND. RESULTS We selected 52 studies on FM, 95 on CFS and 39 on FND. We found a general discordance between high rates of subjective cognitive symptoms, including forgetfulness, distractibility and word-finding difficulties, and inconsistent objective neuropsychological deficits. Objective deficits were reported, including poor selective and divided attention, slow information processing and vulnerability to distraction. In some studies, cognitive performance was inversely correlated with pain, exertion and fatigue. Performance validity testing demonstrated poor effort in only a minority of subjects, and patients with CFS showed a heightened perception of effort. DISCUSSION The cognitive profiles of FM, CFS and non-cognitive FND are similar to the proposed features of FCD, suggesting common mechanistic underpinnings. Similar findings have been reported in patients with mild traumatic brain injury and whiplash. We hypothesise that pain, fatigue and excessive interoceptive monitoring produce a decrease in externally directed attention. This increases susceptibility to distraction and slows information processing, interfering with cognitive function, in particular multitasking. Routine cognitive processes are experienced as unduly effortful. This may reflect a switch from an automatic to a less efficient controlled or explicit cognitive mode, a mechanism that has also been proposed for impaired motor control in FND. These experiences might then be overinterpreted due to memory perfectionism and heightened self-monitoring of cognitive performance.
Collapse
Affiliation(s)
- Tiago Teodoro
- Neurosciences Research Centre, Molecular and Clinical Sciences Research Institute, St George's, University of London, London, UK.,Department of Neurology, St George's University Hospitals NHS Foundation Trust, London, UK.,Instituto de Medicina Molecular Faculdade de Medicina, Universidade de Lisboa & Serviço de Neurologia Hospital de Santa Maria, Lisboa, Portugal
| | - Mark J Edwards
- Neurosciences Research Centre, Molecular and Clinical Sciences Research Institute, St George's, University of London, London, UK.,Department of Neurology, St George's University Hospitals NHS Foundation Trust, London, UK
| | - Jeremy D Isaacs
- Neurosciences Research Centre, Molecular and Clinical Sciences Research Institute, St George's, University of London, London, UK.,Department of Neurology, St George's University Hospitals NHS Foundation Trust, London, UK
| |
Collapse
|
13
|
|
14
|
Muñoz Ladrón de Guevara C, Fernández-Serrano MJ, Reyes del Paso GA, Duschek S. Executive function impairments in fibromyalgia syndrome: Relevance of clinical variables and body mass index. PLoS One 2018; 13:e0196329. [PMID: 29694417 PMCID: PMC5918817 DOI: 10.1371/journal.pone.0196329] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2017] [Accepted: 04/11/2018] [Indexed: 11/18/2022] Open
Abstract
Background Several investigations suggest the presence of deterioration of executive function in fibromyalgia syndrome (FMS). The study quantified executive functions in patients with FMS. A wide array of functions was assessed, including updating, shifting and inhibition, as well as decision making and mental planning. Moreover, clinical variables were investigated as possible mediators of executive dysfunction, including pain severity, psychiatric comorbidity, medication and body mass index (BMI). Methods Fifty-two FMS patients and 32 healthy controls completed a battery of 14 neuropsychological tests. Clinical interviews were conducted and the McGill Pain Questionnaire, Beck Depression Inventory, State-Trait Anxiety Inventory, Fatigue Severity Scale and Oviedo Quality of Sleep Questionnaire were presented. Results Patients performed poorer than controls on the Letter Number Sequencing, Arithmetic and Similarities subtests of the Wechsler Adult Intelligence Scale, the Spatial Span subtest of the Wechsler Memory Scale, an N-back task, a verbal fluency task, the Ruff Figural Fluency Test, the Inhibition score of the Stroop Test, the Inhibition and Shifting scores of the Five Digits Test, the Key Search Test and the Zoo Map Task. Moreover, patients exhibited less steep learning curves on the Iowa Gambling Task. Among clinical variables, BMI and pain severity explained the largest proportion of performance variance. Conclusions This study demonstrated impairments in executive functions of updating, shifting inhibition, decision making and planning in FMS. While the mediating role of pain in cognitive impairments in FMS had been previously established, the influence of BMI is a novel finding. Overweight and obesity should be considered by FMS researchers, and in the treatment of the condition.
Collapse
Affiliation(s)
| | | | | | - Stefan Duschek
- UMIT—University for Health Sciences Medical Informatics and Technology, Hall in Tirol, Austria
| |
Collapse
|
15
|
Bar-On Kalfon T, Gal G, Shorer R, Ablin JN. Cognitive functioning in fibromyalgia: The central role of effort. J Psychosom Res 2016; 87:30-6. [PMID: 27411749 DOI: 10.1016/j.jpsychores.2016.06.004] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2016] [Revised: 05/29/2016] [Accepted: 06/03/2016] [Indexed: 01/28/2023]
Abstract
OBJECTIVE Fibromyalgia syndrome (FM) patients demonstrate deficits in tests of attention, executive functioning and verbal memory. We assessed the role of effort in the cognitive impairment in FM patients, alongside common symptoms of pain, fatigue and depression. METHOD 50 FM patients underwent a computerized cognitive assessment battery including memory, executive function, attention and information processing speed (NeuroTrax Corp.). Age and education standardized scores were computed. Effort was assessed by the Test of Memory Malingering (TOMM). FM symptoms were assessed by the Fibromyalgia Impact Questionnaire (FIQ), Widespread Pain Index (WPI) and Symptom Severity Scale (SSS), a Visual Analog Scale (VAS) of clinical pain and the Beck Depression Inventory (BDI-2). RESULTS FM patients showed impaired performance on the memory, attention and information processing speed domains. According to the TOMM, sub-optimal effort was shown by 16% of patients. TOMM scores were not associated with pain, fatigue or depression. After controlling for effort, no significant impairment was found in memory scores; however attention and information processing speed scores remained significantly low. Multiple regressions analysis, performed in order to evaluate the contribution of effort, pain, fatigue and depression, found effort to be the only significant variable accounting for variance of cognitive scores on all domains. CONCLUSION The findings confirm impaired attention and processing speed in FM patients, independent of effort level. Nonetheless, the findings point to a general and strong effect of effort on neuropsychological performance in FM patients, especially in the domain of memory, emphasizes the importance of effort testing in this population.
Collapse
Affiliation(s)
- Tamar Bar-On Kalfon
- School of Behavioral Sciences, Tel Aviv-Jaffa Academic College, Jaffa, Israel
| | - Gilad Gal
- School of Behavioral Sciences, Tel Aviv-Jaffa Academic College, Jaffa, Israel
| | - Ran Shorer
- Institute of Rheumatology, Tel-Aviv Sourasky Medical Center, Israel
| | - Jacob N Ablin
- Institute of Rheumatology, Tel-Aviv Sourasky Medical Center, Israel
| |
Collapse
|
16
|
Dandachi-FitzGerald B, van Twillert B, van de Sande P, van Os Y, Ponds RWHM. Poor symptom and performance validity in regularly referred Hospital outpatients: Link with standard clinical measures, and role of incentives. Psychiatry Res 2016; 239:47-53. [PMID: 27137961 DOI: 10.1016/j.psychres.2016.02.061] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2015] [Revised: 10/12/2015] [Accepted: 02/27/2016] [Indexed: 10/22/2022]
Abstract
We investigated the frequency of symptom validity test (SVT) failure and its clinical correlates in a large, heterogeneous sample of hospital outpatients referred for psychological assessment for clinical purposes. We studied patients (N=469), who were regularly referred for assessment to the psychology departments of five hospitals. Background characteristics, including information about incentives, were obtained with a checklist completed by the clinician. As a measure of over-reporting, the Structured Inventory of Malingered Symptomatology (SIMS) was administered to all patients. The Amsterdam Short-Term Memory test (ASTM), a cognitive underperformance measure, was only administered to patients who were referred for a neuropsychological assessment. Symptom over-reporting occurred in a minority of patients, ranging from 12% to 19% in the main diagnostic patient groups. Patients with morbid obesity had a low rate of over-reporting (1%). The SIMS was positively associated with levels of self-reported psychological symptoms. Cognitive underperformance occurred in 29.3% of the neuropsychological assessments. The ASTM was negatively associated with memory test performance. We found no association between SVT failure and financial incentives. Our results support the recommendation to routinely evaluate symptom validity in clinical assessments of hospital patients. The dynamics behind invalid symptom reporting need to be further elucidated.
Collapse
Affiliation(s)
- Brechje Dandachi-FitzGerald
- Department of Psychiatry and Psychology, School for Mental Health and Neuroscience, Maastricht University Medical Centre, Maastricht, The Netherlands.
| | - Björn van Twillert
- Department of Clinical and Medical Psychology, Atrium Medical Centre Parkstad, Heerlen, The Netherlands
| | - Peter van de Sande
- Department of Medical Psychology, St Elisabeth Hospital Tilburg, The Netherlands
| | - Yindee van Os
- Department of Medical Psychology, Elkerliek Hospital Helmond, The Netherlands
| | - Rudolf W H M Ponds
- Department of Psychiatry and Psychology, School for Mental Health and Neuroscience, Maastricht University Medical Centre, Maastricht, The Netherlands
| |
Collapse
|
17
|
Roor JJ, Dandachi-FitzGerald B, Ponds RWHM. A case of misdiagnosis of mild cognitive impairment: The utility of symptom validity testing in an outpatient memory clinic. APPLIED NEUROPSYCHOLOGY-ADULT 2015; 23:172-8. [DOI: 10.1080/23279095.2015.1030018] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Affiliation(s)
- Jeroen J. Roor
- Department of Medical Psychology, VieCuri Medical Centre, Venlo, The Netherlands
- School for Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Brechje Dandachi-FitzGerald
- School for Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
- Department of Medical Psychology, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Rudolf W. H. M. Ponds
- School for Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
- Department of Medical Psychology, Maastricht University Medical Centre, Maastricht, The Netherlands
| |
Collapse
|
18
|
Abstract
BACKGROUND Adjudication of disability claims related to fibromyalgia (FM) syndrome can be a challenging and complex process. A commentary published in the current issue of Pain Research & Management makes suggestions for improvement. The authors of the commentary contend that: previously and currently used criteria for the diagnosis of FM are irrelevant to clinical practice; the opinions of family physicians should supersede those of experts; there is little evidence that trauma can cause FM; no formal instruments are necessary to assess disability; and many FM patients on or applying for disability are exaggerating or malingering, and tests of symptoms validity should be used to identify malingerers. OBJECTIVES To assess the assertions made by Fitzcharles et al. METHODS A narrative review of the available research literature was performed. RESULTS Available diagnostic criteria should be used in a medicolegal context; family physicians are frequently uncertain about FM and⁄or biased; there is considerable evidence that trauma can be a cause of FM; it is essential to use validated instruments to assess functional impairment; and the available tests of physical effort and symptom validity are of uncertain value in identifying malingering in FM. CONCLUSIONS The available evidence does not support many of the suggestions presented in the commentary. Caution is advised in adopting simple solutions for disability adjudication in FM because they are generally incompatible with the inherently complex nature of the problem.
Collapse
|
19
|
O'Brien FM, Fortune GM, Dicker P, O'Hanlon E, Cassidy E, Delanty N, Garavan H, Murphy KC. Psychiatric and neuropsychological profiles of people with psychogenic nonepileptic seizures. Epilepsy Behav 2015; 43:39-45. [PMID: 25553390 DOI: 10.1016/j.yebeh.2014.11.012] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2014] [Revised: 11/07/2014] [Accepted: 11/10/2014] [Indexed: 01/13/2023]
Abstract
OBJECTIVE This study examined the psychiatric and neuropsychological profiles of people with psychogenic nonepileptic seizures (PNES). METHODS Twenty-people who had been diagnosed with psychogenic nonepileptic seizures (PNES), but not epilepsy, were recruited into this study. A healthy control group was also recruited and was matched for age and gender. All participants underwent structured psychiatric assessment and psychometric assessment. Neuropsychological assessment was carried out using the Cambridge Neuropsychological Test Battery (CANTAB) after participants passed the Medical Symptom Validity Test (MSVT) of effort. RESULTS One patient failed the MSVT and was excluded from the analysis. Therefore, data from 19 people with PNES and their matched healthy controls were analyzed. Compared with controls, people with PNES had significantly higher levels of depressive symptoms, anxiety symptoms, dissociative experiences, and alexithymic traits. In addition, people with PNES had impairments in spatial working memory and attention when compared with healthy controls. CONCLUSION To our knowledge, this is the first study to report that, compared with controls, people with PNES have abnormal cognitive functioning after controlling for effects of effort and FSIQ. People with PNES also have high levels of anxiety, depressive, and dissociative symptoms. In addition, they appear to particularly focus on health problems and show evidence of chronic emotional dysregulation. Further studies are required to replicate our results and to help clarify the pathogenic mechanisms underlying PNES.
Collapse
Affiliation(s)
- Finian M O'Brien
- Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin 2, Ireland; Department of Psychiatry, Cavan Monaghan Mental Health Service, Cavan General Hospital, Cavan, Ireland.
| | - Gillian M Fortune
- Department of Psychology, Beaumont Hospital, Dublin 9, Ireland; Department of Psychology, Our Lady's Children's Hospital, Crumlin, Dublin 12, Ireland
| | - Patrick Dicker
- Department of Epidemiology & Public Health Medicine, Royal College of Surgeons in Ireland, Dublin 2, Ireland
| | - Erik O'Hanlon
- Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin 2, Ireland
| | - Eugene Cassidy
- Cork University Hospital, Cork, Ireland; Department of Psychiatry, College of Medicine and Health, University College Cork, Ireland
| | - Norman Delanty
- Department of Molecular and Cellular Therapeutics, Royal College of Surgeons in Ireland, Dublin 2, Ireland; Department of Neurology, Beaumont Hospital, Dublin 9, Ireland
| | - Hugh Garavan
- Trinity College Dublin, Dublin 2, Ireland; University of Vermont, VT, USA
| | - Kieran C Murphy
- Department of Psychiatry, Royal College of Surgeons in Ireland, Dublin 2, Ireland; Department of Psychiatry, Education and Research Centre, Beaumont Hospital, Dublin 9, Ireland
| |
Collapse
|
20
|
|
21
|
Bigler ED. Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Inj 2014; 28:1623-38. [PMID: 25215453 PMCID: PMC4673569 DOI: 10.3109/02699052.2014.947627] [Citation(s) in RCA: 64] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2014] [Revised: 05/09/2014] [Accepted: 07/20/2014] [Indexed: 11/22/2022]
Abstract
BACKGROUND To understand the neurocognitive effects of brain injury, valid neuropsychological test findings are paramount. REVIEW This review examines the research on what has been referred to a symptom validity testing (SVT). Above a designated cut-score signifies a 'passing' SVT performance which is likely the best indicator of valid neuropsychological test findings. Likewise, substantially below cut-point performance that nears chance or is at chance signifies invalid test performance. Significantly below chance is the sine qua non neuropsychological indicator for malingering. However, the interpretative problems with SVT performance below the cut-point yet far above chance are substantial, as pointed out in this review. This intermediate, border-zone performance on SVT measures is where substantial interpretative challenges exist. Case studies are used to highlight the many areas where additional research is needed. Historical perspectives are reviewed along with the neurobiology of effort. Reasons why performance validity testing (PVT) may be better than the SVT term are reviewed. CONCLUSIONS Advances in neuroimaging techniques may be key in better understanding the meaning of border zone SVT failure. The review demonstrates the problems with rigidity in interpretation with established cut-scores. A better understanding of how certain types of neurological, neuropsychiatric and/or even test conditions may affect SVT performance is needed.
Collapse
Affiliation(s)
- Erin D. Bigler
- Department of Psychology
- Neuroscience Center
- Magnetic Resonance Imaging Research Facility, Brigham Young University
Provo, UTUSA
- Department of Psychiatry
- The Brain Institute of Utah, University of Utah
Salt Lake City, UTUSA
| |
Collapse
|
22
|
Abstract
Compared with other psychiatric disorders, diagnosis of factitious disorders is rare, with identification largely dependent on the systematic collection of relevant information, including a detailed chronology and scrutiny of the patient's medical record. Management of such disorders ideally requires a team-based approach and close involvement of the primary care doctor. As deception is a key defining component of factitious disorders, diagnosis has important implications for young children, particularly when identified in women and health-care workers. Malingering is considered to be rare in clinical practice, whereas simulation of symptoms, motivated by financial rewards, is regarded as more common in medicolegal settings. Although psychometric investigations (eg, symptom validity testing) can inform the detection of illness deception, such tests need support from converging evidence sources, including detailed interview assessments, medical notes, and relevant non-medical investigations. A key challenge in any discussion of abnormal health-care-seeking behaviour is the extent to which a person's reported symptoms are considered to be a product of choice, or psychopathology beyond volitional control, or perhaps both. Clinical skills alone are not typically sufficient for diagnosis or to detect malingering. Medical education needs to provide doctors with the conceptual, developmental, and management frameworks to understand and deal with patients whose symptoms appear to be simulated. Central to the understanding of factitious disorders and malingering are the explanatory models and beliefs used to provide meaning for both patients and doctors. Future progress in management will benefit from an increased appreciation of the contribution of non-medical factors and a greater awareness of the conceptual and clinical findings from social neuroscience, occupational health, and clinical psychology.
Collapse
Affiliation(s)
- Christopher Bass
- Department of Psychological Medicine, John Radcliffe Hospital, Oxford, UK.
| | | |
Collapse
|
23
|
Cheville AL, Basford JR, Dos Santos K, Kroenke K. Symptom burden and comorbidities impact the consistency of responses on patient-reported functional outcomes. Arch Phys Med Rehabil 2013; 95:79-86. [PMID: 23988394 DOI: 10.1016/j.apmr.2013.08.009] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2013] [Revised: 07/22/2013] [Accepted: 08/11/2013] [Indexed: 01/11/2023]
Abstract
OBJECTIVE To assess the influence of symptom intensity, mood, and comorbidities on patient-clinician agreement and the consistency of responses to functional patient-reported outcomes (PROs). DESIGN Two data sources were used. The first, a cross-sectional database of patients with breast cancer who completed functional PROs and were administered the FIM, was used to examine whether average pain intensity (as measured with an 11-point numeric rating scale [NRS]) and Rand Mental Health inventory scores differed among those rating their functional independence as different than clinicians. The second, a longitudinal database of 311 adults with late-stage lung cancer who completed the Activity Measure for Post Acute Care Computer Adaptive Test (AM PAC CAT) with differences between their expected and actual responses as reflected in their AM PAC CAT SEs. SETTING Two tertiary medical centers. PARTICIPANTS Data source #1, 163 women with stage IV breast cancer; data source #2, 311 adults with late-stage lung cancer. INTERVENTIONS Not applicable. MAIN OUTCOME MEASURES Data source #1, FIM, pain NRS, Older Americans Resource Study activities of daily living subscale, Physical Function-10, Mental Health Inventory-17. Data source #2, AM PAC CAT and NRS symptom ratings. RESULTS Pain intensity was significantly higher when clinicians and patients disagreed regarding a patient's independence in the ability to transfer (NRS pain severity, 3.78 vs 2.40; P=.014), groom (3.71 vs 2.36, P=.009), bathe (3.76 vs 2.40, P=.016), and dress (3.09 vs 2.44, P=.034). The magnitude of AM PAC CAT SEs was significantly associated with the severity of participants' pain, dyspnea, and fatigue, as well as the presence of musculoskeletal disorders and coronary artery disease. Neither mood nor emotional distress was associated with clinician-patient agreement or AM PAC CAT SE. CONCLUSIONS Pain intensity is associated with disagreement between patients and clinicians about the patient's level of functioning. Moreover, physical symptoms (pain, dyspnea, fatigue) as well as specific medical comorbidities (musculoskeletal disorders, coronary artery disease), but not mood, are associated with inconsistency in patients' assessment of their functional abilities.
Collapse
Affiliation(s)
| | | | - Katiuska Dos Santos
- Department of Physical Medicine and Rehabilitation, Mayo Clinic, Rochester, MN
| | - Kurt Kroenke
- Regenstrief Institute, Inc, Indianapolis, IN; Indiana University Center for Health Services and Outcomes, Indianapolis, IN
| |
Collapse
|