Abuse, Not Financial Incentive, Predicts Non-Credible Cognitive Performance in Patients With Psychogenic Non-Epileptic Seizures

Performance Validity Test Failure in the Clinical Population: A Systematic Review and Meta-Analysis of Prevalence Rates

Performance validity tests (PVTs) are used to measure the validity of the obtained neuropsychological test data. However, when an individual fails a PVT, the likelihood that failure truly reflects invalid performance (i.e., the positive predictive value) depends on the base rate in the context in which the assessment takes place. Therefore, accurate base rate information is needed to guide interpretation of PVT performance. This systematic review and meta-analysis examined the base rate of PVT failure in the clinical population (PROSPERO number: CRD42020164128). PubMed/MEDLINE, Web of Science, and PsychINFO were searched to identify articles published up to November 5, 2021. Main eligibility criteria were a clinical evaluation context and utilization of stand-alone and well-validated PVTs. Of the 457 articles scrutinized for eligibility, 47 were selected for systematic review and meta-analyses. Pooled base rate of PVT failure for all included studies was 16%, 95% CI [14, 19]. High heterogeneity existed among these studies (Cochran's Q = 697.97, p < .001; I2 = 91%; τ2 = 0.08). Subgroup analysis indicated that pooled PVT failure rates varied across clinical context, presence of external incentives, clinical diagnosis, and utilized PVT. Our findings can be used for calculating clinically applied statistics (i.e., positive and negative predictive values, and likelihood ratios) to increase the diagnostic accuracy of performance validity determination in clinical evaluation. Future research is necessary with more detailed recruitment procedures and sample descriptions to further improve the accuracy of the base rate of PVT failure in clinical practice.

Neuropsychological evaluation of functional cognitive disorder: A narrative review

Objective: To critically review contemporary theoretical models, diagnostic approaches, clinical features, and assessment findings in Functional Cognitive Disorder (FCD), and make recommendations for neuropsychological evaluation of this condition. Method: Narrative review. Results: FCD is common in neuropsychological practice. It is characterized by cognitive symptoms that are not better explained by another medical or psychiatric disorder. The cognitive symptoms are associated with distress and/or limitations in daily functioning, but are potentially reversible with appropriate identification and treatment. Historically, a variety of diagnostic frameworks have attempted to capture this condition. A contemporary conceptualization of FCD positions it as a subtype of Functional Neurological Disorder, with shared and unique etiological factors. Patients with FCD tend to perform normally on neuropsychological testing or demonstrate relatively weak memory acquisition (e.g. list learning trials) in comparison to strong attention and delayed recall performance. Careful history-taking and behavioral observations are essential to support the diagnosis of FCD. Areas of ongoing controversy include operationalizing "internal inconsistencies" and the role of performance validity testing. Evidence for targeted interventions remains scarce. Conclusions: Neuropsychologists familiar with FCD can uniquely contribute to the care of patients with this condition by improving diagnostic clarity, richening case formulation, communicating effectively with referrers, and leading clinical management. Further research is needed to refine diagnosis, prognosis, and treatment.

Stronger Together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in Patients with Traumatic Brain Injury

OBJECTIVE

This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV).

METHOD

Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance.

RESULTS

Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91-.95) over univariate cutoffs (.78-.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43-.67) compared to univariate cutoffs (.11-.63) while maintaining consistently high specificity (.93-.95).

CONCLUSIONS

In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment.

BRIEF SUMMARY

Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment.

The other face of illness-deception: Diagnostic criteria for factitious disorder with proposed standards for clinical practice and research

Objective: This paper aims to develop diagnostic criteria for factitious disorder (FD) and a heuristic for research by creating standards for delineating criterion groups.Method: Both FD and malingering are conceptualized within a rubric of illness-deception. The history of FD research was compared to the research history on malingering. Differences in the measurement of these constructs were described. The potential utility of performance validity tests (PVTs) and symptom validity tests (SVTs) in FD is discussed in light of successful applications in malingering. Methods for obtaining evidence for FD are delineated in a table of diagnostic criteria.Results: The comparison of FD and malingering research shows that the scientific measurement of malingering evolved rapidly with the introduction of forced-choice validity testing and cogent guidelines for the formation of criterion groups. Likewise, PVTs and SVTs hold promise as methods of measuring deceptive behavior in FD. The most salient differences between FD and malingering are understood to be matter of context/setting: malingering occurs in an external incentive context, while FD occurs in a medical/psychological context. Guidelines to assess FD are developed to fill the need for known-groups research.Conclusions: Evidence for FD, a form of illness-deception, can be obtained by using validity testing, which, together with careful clinical observation, allows for the development of probabilistic diagnostic criteria. Similar to the other form of illness-deception - malingering - these criteria can be used to form known groups for research.

Modification of both functional neurological symptoms and neuroimaging patterns with a good anatomoclinical concordance: a case report

Background

In the nineteenth century, Jean Martin Charcot explained functional neurological disorder (formerly called conversion disorder) as a “psychodynamic” lesion. Numerous advances in neuroimaging have permitted identification of the neural underpinnings of this disorder.

Case presentation

Herein we describe a case of functional neurological disorder (FND) with initial left sensorimotor deficit, in-coordinated limb movements, neglect, clouded consciousness, slurred speech and a semiology of visual impairment. A single photon emission computed tomography (SPECT) showed a right thalamic hypoperfusion, which is rather concordant with the initial semiology. Later, the semiology changed, presenting with a predominantly neurovisual complex presentation. The second SPECT showed no more thalamic abnormalities but an hypoperfusion in the right temporo-occipital junction, right inferior parietal lobe and left superior frontal lobe, which is also rather concordant with the changing semiology.

Conclusions

This case illustrates the evolving neuroimaging patterns of FND but also the concordance between semiology and neuroimaging findings in FND supporting Charcot's theory of “dynamic lesion”.

Impact of criterion measures on the classification accuracy of TOMM-1

This study was designed to examine the effect of various criterion measures on the classification accuracy of Trial 1 of the Test of Memory Malingering (TOMM-1), a free-standing performance validity test (PVT). Archival data were collected from a case sequence of 91 (M _Age = 42.2 years; M _Education = 12.7) patients clinically referred for neuropsychological assessment. Trials 2 and Retention of the TOMM, the Word Choice Test, and three validity composites were used as criterion PVTs. Classification accuracy varied systematically as a function of criterion PVT. TOMM-1 ≤ 43 emerged as the optimal cutoff, resulting in a wide range of sensitivity (.47-1.00), with perfect overall specificity. Failing the TOMM-1 was unrelated to age, education or gender, but was associated with elevated self-reported depression. Results support the utility of TOMM-1 as an independent, free-standing, single-trial PVT. Consistent with previous reports, the choice of criterion measure influences parameter estimates of the PVT being calibrated. The methodological implications of modality specificity to PVT research and clinical/forensic practice should be considered when evaluating cutoffs or interpreting scores in the failing range.

Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data

OBJECTIVE

Differentiating epileptic seizures (ES) from psychogenic nonepileptic seizures (PNES) represents a challenging differential diagnosis with important treatment implications. This study was designed to explore the utility of neuropsychological test scores in differentiating ES from PNES.

METHOD

Psychometric data from 72 patients with ES and 33 patients with PNES were compared on various tests of cognitive ability and performance validity. Individual measures that best discriminated the diagnoses were then entered as predictors in a logistic regression equation with group membership (ES vs. PNES) as the criterion.

RESULTS

On most tests of cognitive ability, the PNES sample outperformed the ES sample (medium-large effect) and was less likely to fail the Reliable Digit Span. However, patients with PNES failed two embedded validity indicators at significantly higher rates (risk ratios (RR): 2.45-4.16). There were no group differences on the Test of Memory Malingering (TOMM). A logistic regression equation based on seven neuropsychological tests correctly classified 85.1% of patients. The cutoff with perfect specificity was associated with 0.47 sensitivity.

CONCLUSIONS

Consistent with previous research, the utility of psychometric methods of differential diagnosis is limited by the complex neurocognitive profiles associated with ES and PNES. Although individual measures might help differentiate ES from PNES, multivariate assessment models have superior discriminant power. The strongest psychometric evidence for PNES appears to be a consistent lack of impairment on tests sensitive to diffuse neurocognitive deficits such as processing speed, working memory, and verbal fluency. While video-electroencephalogram (EEG) monitoring is the gold standard of differential diagnosis, psychometric testing has the potential to enhance clinical decision-making, particularly in complex or unclear cases such as patients with nondiagnostic video-EEGs. Adopting a standardized, fixed neuropsychological battery at epilepsy centers would advance research on the differential diagnostic power of psychometric testing.

Illness Perceptions Predict Cognitive Performance Validity

OBJECTIVES

The aim of this study was to investigate the relationship of psychological variables to cognitive performance validity test (PVT) results in mixed forensic and nonforensic clinical samples.

METHODS

Participants included 183 adults who underwent comprehensive neuropsychological examination. Criterion groups were formed, that is, Credible Group or Noncredible Group, based upon their performance on the Word Memory Test and other stand-alone and embedded PVT measures.

RESULTS

Multivariate logistic regression analysis identified three significant predictors of cognitive performance validity. These included two psychological constructs, for example, Cogniphobia (perception that cognitive effort will exacerbate neurological symptoms), and Symptom Identity (perception that current symptoms are the result of illness or injury), and one contextual factor (forensic). While there was no interaction between these factors, elevated scores were most often observed in the forensic sample, suggesting that these independently contributing intrinsic psychological factors are more likely to occur in a forensic environment.

CONCLUSIONS

Illness perceptions were significant predictors of cognitive performance validity particularly when they reached very elevated levels. Extreme elevations were more common among participants in the forensic sample, and potential reasons for this pattern are explored. (JINS, 2018, 24, 735-745).

Poor symptom and performance validity in regularly referred Hospital outpatients: Link with standard clinical measures, and role of incentives

We investigated the frequency of symptom validity test (SVT) failure and its clinical correlates in a large, heterogeneous sample of hospital outpatients referred for psychological assessment for clinical purposes. We studied patients (N=469), who were regularly referred for assessment to the psychology departments of five hospitals. Background characteristics, including information about incentives, were obtained with a checklist completed by the clinician. As a measure of over-reporting, the Structured Inventory of Malingered Symptomatology (SIMS) was administered to all patients. The Amsterdam Short-Term Memory test (ASTM), a cognitive underperformance measure, was only administered to patients who were referred for a neuropsychological assessment. Symptom over-reporting occurred in a minority of patients, ranging from 12% to 19% in the main diagnostic patient groups. Patients with morbid obesity had a low rate of over-reporting (1%). The SIMS was positively associated with levels of self-reported psychological symptoms. Cognitive underperformance occurred in 29.3% of the neuropsychological assessments. The ASTM was negatively associated with memory test performance. We found no association between SVT failure and financial incentives. Our results support the recommendation to routinely evaluate symptom validity in clinical assessments of hospital patients. The dynamics behind invalid symptom reporting need to be further elucidated.

Psychological and psychiatric aspects of psychogenic non-epileptic seizures (PNES): A systematic review

Psychogenic non-epileptic seizures (PNES) are common in neurological settings and often associated with considerable distress and disability. The psychological mechanisms underlying PNES are poorly understood and there is a lack of well-established, evidence-based treatments. This paper advances our understanding of PNES by providing a comprehensive systematic review of the evidence pertaining to the main theoretical models of this phenomenon. Methodological quality appraisal and effect size calculation were conducted on one hundred forty empirical studies on the following aspects of PNES: life adversity, dissociation, anxiety, suggestibility, attentional dysfunction, family/relationship problems, insecure attachment, defence mechanisms, somatization/conversion, coping, emotion regulation, alexithymia, emotional processing, symptom modelling, learning and expectancy. Although most of the studies were only of low to moderate quality, some findings are sufficiently consistent to warrant tentative conclusions: (i) physical symptom reporting is elevated in patients with PNES; (ii) trait dissociation and exposure to traumatic events are common but not inevitable correlates of PNES; (iii) there is a mismatch between subjective reports of anxiety and physical arousal during PNES; and (iv) inconsistent findings in this area are likely to be attributable to the heterogeneity of patients with PNES. Empirical, theoretical and clinical implications are discussed.

Factitious disorders and malingering in relation to functional neurologic disorders

Interest in malingering has grown in recent years, and is reflected in the exponential increase in academic publications since 1990. Although malingering is more commonly detected in medicolegal practice, it is not an all-or-nothing presentation and moreover can vary in the extent of presentation. As a nonmedical disorder, the challenge for clinical practice remains that malingering by definition is intentional and deliberate. As such, clinical skills alone are often insufficient to detect it and we describe psychometric tests such as symptom validity tests and relevant nonmedical investigations. Finally, we describe those areas of neurologic practice where symptom exaggeration and deception are more likely to occur, e.g., postconcussional syndrome, psychogenic nonepileptic seizures, motor weakness and movement disorders, and chronic pain. Factitious disorders are rare in clinical practice and their detection depends largely on the level of clinical suspicion supported by the systematic collection of relevant information from a variety of sources. In this chapter we challenge the accepted DSM-5 definition of factitious disorder and suggest that the traditional glossaries have neglected the extent to which a person's reported symptoms can be considered a product of intentional choice or selective psychopathology largely beyond the subject's voluntary control, or more likely, both. We present evidence to suggest that neurologists preferentially diagnose factitious presentations in healthcare workers as "hysterical," possibly to avoid the stigma of simulated illness.

Psychiatric and neuropsychological profiles of people with psychogenic nonepileptic seizures

OBJECTIVE

This study examined the psychiatric and neuropsychological profiles of people with psychogenic nonepileptic seizures (PNES).

METHODS

Twenty-people who had been diagnosed with psychogenic nonepileptic seizures (PNES), but not epilepsy, were recruited into this study. A healthy control group was also recruited and was matched for age and gender. All participants underwent structured psychiatric assessment and psychometric assessment. Neuropsychological assessment was carried out using the Cambridge Neuropsychological Test Battery (CANTAB) after participants passed the Medical Symptom Validity Test (MSVT) of effort.

RESULTS

One patient failed the MSVT and was excluded from the analysis. Therefore, data from 19 people with PNES and their matched healthy controls were analyzed. Compared with controls, people with PNES had significantly higher levels of depressive symptoms, anxiety symptoms, dissociative experiences, and alexithymic traits. In addition, people with PNES had impairments in spatial working memory and attention when compared with healthy controls.

CONCLUSION

To our knowledge, this is the first study to report that, compared with controls, people with PNES have abnormal cognitive functioning after controlling for effects of effort and FSIQ. People with PNES also have high levels of anxiety, depressive, and dissociative symptoms. In addition, they appear to particularly focus on health problems and show evidence of chronic emotional dysregulation. Further studies are required to replicate our results and to help clarify the pathogenic mechanisms underlying PNES.

Effort, symptom validity testing, performance validity testing and traumatic brain injury

BACKGROUND

To understand the neurocognitive effects of brain injury, valid neuropsychological test findings are paramount.

REVIEW

This review examines the research on what has been referred to a symptom validity testing (SVT). Above a designated cut-score signifies a 'passing' SVT performance which is likely the best indicator of valid neuropsychological test findings. Likewise, substantially below cut-point performance that nears chance or is at chance signifies invalid test performance. Significantly below chance is the sine qua non neuropsychological indicator for malingering. However, the interpretative problems with SVT performance below the cut-point yet far above chance are substantial, as pointed out in this review. This intermediate, border-zone performance on SVT measures is where substantial interpretative challenges exist. Case studies are used to highlight the many areas where additional research is needed. Historical perspectives are reviewed along with the neurobiology of effort. Reasons why performance validity testing (PVT) may be better than the SVT term are reviewed.

CONCLUSIONS

Advances in neuroimaging techniques may be key in better understanding the meaning of border zone SVT failure. The review demonstrates the problems with rigidity in interpretation with established cut-scores. A better understanding of how certain types of neurological, neuropsychiatric and/or even test conditions may affect SVT performance is needed.

Symptom overreporting obscures the dose-response relationship between trauma severity and symptoms

We investigated whether symptom overreporting affects the dose-response relationship between self-reported abuse severity and psychiatric symptoms in two samples. The first sample (N=599) consisted of adults who had previously reported to a public commission that they had been witnesses to or victims of childhood sexual abuse by Roman Catholic Church representatives. The second sample (N=1756) consisted of general population respondents who indicated that they had been victims of non-familial childhood sexual abuse. Using a web-based data collection procedure, both samples completed the Brief Symptom Inventory (BSI-18), items addressing abuse severity, and items flagging symptom overreporting. Adjusting for overreporting reduced the proportion of participants with clinically raised BSI-18 scores from 60% to 47% in sample 1 and from 26% to 22% in sample 2. Also, in both samples, normal range reporting participants exhibited the typical dose-response relationship between trauma severity and BSI-18 scores, whereas this pattern was largely non-significant in overreporting participants. Our findings show that symptom overreporting has a psychometric impact that may obscure relationships between clinically relevant variables and should therefore preferably be monitored in surveys.

Lying in neuropsychology

The issue of lying occurs in neuropsychology especially when examinations are conducted in a forensic context. When a subject intentionally either presents non-existent deficits or exaggerates their severity to obtain financial or material compensation, this behaviour is termed malingering. Malingering is discussed in the general framework of lying in psychology, and the different procedures used by neuropsychologists to evidence a lack of collaboration at examination are briefly presented and discussed. When a lack of collaboration is observed, specific emphasis is placed on the difficulty in unambiguously establishing that this results from the patient's voluntary decision.

Neuropsychological profile of psychogenic jerky movement disorders: importance of evaluating non-credible cognitive performance and psychopathology

BACKGROUND

Psychogenic movement disorders are disorders of movements that cannot be explained by a known neurological disorder and are assumed to be associated with psychiatric symptoms such as depression and anxiety.

OBJECTIVE

To examine the neuropsychological profile of patients with psychogenic movement disorders.

METHODS

We examined cognitive functioning using neuropsychological tests in 26 patients with clinically established psychogenic jerky movement disorders (PMD). We included 16 patients with Gilles de la Tourette syndrome (GTS) who served as a patient control group, in addition to 22 healthy control subjects. Non-credible test performance was detected using a Symptom Validity Test (SVT). Psychopathology was also assessed.

RESULTS

Apart from a worse performance on a verbal memory task, no evidence of neuropsychological impairments was found in our PMD sample. Interestingly however, patients with PMD reported more cognitive complaints in daily life and performed worse on the SVT than the two other groups. Patients with GTS did not report, or show, cognitive impairments. In patients with PMD, we found associations between verbal learning, SVT performance and severity of depression and anxiety complaints.

CONCLUSIONS

We conclude that some patients with PMD show non-credible cognitive symptoms. In contrast, no evident cognitive impairments were present in patients with PMD or GTS. Our study underlines the importance of assessment of non-credible response in patients with PMD. Additionally, non-credible response might aid in the differentiation of PMD from other movement disorders.