An Exploration of the Impact of Invalid MMPI–2 Protocols on Collateral Self-Report Measure Scores

Validity testing in veterans with epileptic seizures and psychogenic nonepileptic seizures

OBJECTIVE

Identification of clinically meaningful subgroups among patients with psychogenic nonepileptic seizures (PNES) or epileptic seizures (ES) is of potential value for assessing prognosis and predicting therapeutic response. Invalid performance on validity tests has been associated with noncredible complaints and worse cognitive test scores, and may be one such classification criteria. We studied invalid performance in Veterans with PNES or ES, and the association of invalid performance with cognitive test scores and subjective complaints.

METHODS

Patients were consecutive admissions to three veterans affairs (VA) epilepsy monitoring units. Evaluations included two validity tests: the Test of Memory Malingering (TOMM); and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) over-reporting validity scales. We compared the frequency of invalid performance on the TOMM or MMPI-2-RF in patients diagnosed with PNES vs. ES. We evaluated the association of invalid performance with scores on the Repeatable Battery for Assessment of Neuropsychological Status (RBANS), and four subjective symptom measures including the Beck Depression Inventory-II, and Quality of Life in Epilepsy-31.

RESULTS

Invalid TOMM performance was found in 25.3% of Veterans diagnosed with PNES and 10.8% of those with ES (p = .03). Invalid reporting on the MMPI-2-RF was found in 35.9% of the PNES group vs. 15.3% of the ES group (p = .01). Effects of valid vs. invalid reporting on external measures were similar for ES and PNES groups. Patients with invalid vs. valid TOMM performance had lower scores on the RBANS (p < .001). Patients with invalid performance had greater complaints on all subjective measures, with largest effect sizes for the MMPI-2-RF validity scales (p < .001).

SIGNIFICANCE

In Veterans admitted for evaluation of poorly controlled seizures, invalid performance on validity tests was not uncommon. Cognitive test results and subjective reports from patients with invalid performance may not be credible. These observations have implications for the analysis of clinical trials, where primary and secondary outcomes often rely on self-report measures.

Assessing the Clinical Utility of the MMPI-2-RF in Detecting Suicidal Ideation in a High Acuity, Partially-Hospitalized Veteran Sample

The Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011) has demonstrated utility in suicide risk assessment. Limited research with the MMPI-2-RF in higher acuity populations exists, particularly regarding the impact of possible underreporting on prediction of suicide risk. The current study serves to extend previous findings of the utility of clinically indicated MMPI-2-RF scales and proxy indices in 293 veterans (83.62% White, 85.32% male, and 74.40% with past-week suicide ideation) enrolled in a Veterans Affairs Medical Center partial psychiatric hospitalization program. Differences in self-report indicators and MMPI-2-RF scales and proxy indices relevant in assessing suicide ideation between veterans indicated as possibly underreporting and those who were not and the ability of the scales and proxy indices to predict current suicide ideation were examined. These indicators, scales, and proxy indices, with the exception of SUI, were significantly impacted by underreporting, and none of the examined scales or proxy indices (or their interaction) were consistently associated with self-reported suicide ideation after accounting for SUI. However, SUI was consistently associated with suicide ideation and was less influenced by under-reporting. In acutely ill psychiatric patients, SUI may be the most robust indicator of current suicide ideation.

Presurgical Psychological Evaluation: Risk Factor Identification and Mitigation

Presurgical psychological evaluations (PPEs) are becoming an established component of the surgical process, though methods of conducting PPEs are variable. There is a lack of clarity about the goals of PPEs, the types of information that should be included, and the process for integrating information and making recommendations to the referring physicians/surgeons. This review proposes an empirically supported model for PPEs that is systematic, but flexible enough to be utilized across the broad range of surgical evaluations. This five-step method is termed the Risk Identification and Mitigation (RIM) model and is discussed in detail. The RIM model presented in this review can both serve as a structure to be utilized in under-researched PPE areas and as a stimulus for future empirical investigations.

Illness Perceptions Predict Cognitive Performance Validity

OBJECTIVES

The aim of this study was to investigate the relationship of psychological variables to cognitive performance validity test (PVT) results in mixed forensic and nonforensic clinical samples.

METHODS

Participants included 183 adults who underwent comprehensive neuropsychological examination. Criterion groups were formed, that is, Credible Group or Noncredible Group, based upon their performance on the Word Memory Test and other stand-alone and embedded PVT measures.

RESULTS

Multivariate logistic regression analysis identified three significant predictors of cognitive performance validity. These included two psychological constructs, for example, Cogniphobia (perception that cognitive effort will exacerbate neurological symptoms), and Symptom Identity (perception that current symptoms are the result of illness or injury), and one contextual factor (forensic). While there was no interaction between these factors, elevated scores were most often observed in the forensic sample, suggesting that these independently contributing intrinsic psychological factors are more likely to occur in a forensic environment.

CONCLUSIONS

Illness perceptions were significant predictors of cognitive performance validity particularly when they reached very elevated levels. Extreme elevations were more common among participants in the forensic sample, and potential reasons for this pattern are explored. (JINS, 2018, 24, 735-745).

The Validity and Clinical Utility of the Personality Inventory for DSM-5 Response Inconsistency Scale

The Personality Inventory for DSM-5 (PID-5; Krueger, Derringer, Markon, Watson, & Skodol, 2012) is a self-report instrument designed to assess the personality traits of the alternative model of personality disorders (AMPD) in Section III of the DSM-5. Despite its relatively recent introduction to the field, the instrument is frequently and widely used. One criticism of this instrument is that it does not include validity scales to detect potentially invalidating response style, including noncredible over- and underreporting and inconsistent (random) responding. Keeley, Webb, Peterson, Roussin, and Flanagan (2016) constructed an inconsistency scale (the PID-5-INC) to assess random responding on PID-5 and proposed a number of potential cut scores that could be applied. In this study, we attempted to cross-validate the PID-5-INC, including whether the scale could detect randomly generated protocols and distinguish them from nonrandom protocols produced by two student and two clinical samples. The PID-5-INC successfully distinguished random from nonrandom protocols and the best cut scores were similar to those reported by Keeley et al. (2016). We also found that a relatively low amount of random responding compromised the psychometric validity of the PID-5 trait scales, which extended previous work on this instrument.

An Investigation of a Computerized Sequential Depression Module of the MMPI-2

The current study investigated the utility and validity of a computerized "depression" module of the Minnesota Multiphasic Personality Inventory-Second version (MMPI-2), with and without sequential testing rules, with a college student sample. Participants completed one of three MMPI-2 test-retest administrations (i.e., conventional-conventional, conventional-module, or conventional-sequential module) as well as 15 criterion measures across two testing sessions exactly 1 week apart. The findings pointed to statistically significant and clinically meaningful time-savings in administering selected MMPI-2 scales (for both full-length and variable-length versions). Criterion measures rationally selected to represent similar (depression, anhedonia, anxiety) and dissimilar (behavioral, thought, and somatic dysfunction) psychological constructs were administered to assess the convergent and discriminant validity of the depression module. The criterion correlations suggested minimal differences in discriminant and convergent validity across administration modes, suggesting limited to no impact of administering targeted MMPI-2 scales in terms of construct validity.

The Generalizability of Overreporting Across Self-Report Measures: An Investigation With the Minnesota Multiphasic Personality Inventory–2–Restructured Form and the Personality Assessment Inventory in a Civil Disability Sample

Elevated overreporting Validity Scale scores on the Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI-2-RF) are associated with higher scores on collateral measures; however, measures used in prior research lacked validity scales. We sought to extend these findings by examining associations between elevated MMPI-2-RF overreporting scale scores and Personality Assessment Inventory (PAI) scale scores among 654 non–head injury civil disability claimants. Individuals were classified as overreporting psychopathology (OR-P), overreporting somatic/cognitive complaints (OR-SC), inconclusive reporting psychopathology (IR-P), inconclusive reporting somatic/cognitive complaints (IR-SC), or valid reporting (VR). Both overreporting groups had significantly and meaningfully higher scores than the VR group on the MMPI-2-RF and PAI scales. Both IR groups had significantly and meaningfully higher scores than the VR group, as well as lower scores than their overreporting counterparts. Our findings demonstrate the utility of inventories with validity scales in assessment batteries that include instruments without measures of protocol validity.

I just want my research credit: frequency of suboptimal effort in a non-clinical healthy undergraduate sample

Although performance validity testing is becoming fairly routine in clinical settings, research protocols involving neuropsychological tests infrequently include assessments of performance validity. The current study utilized an embedded measure of effort over two administrations of CNS Vital Signs to determine the frequency of poor effort in non-clinical healthy undergraduate students participating in a research study for course credit. Results indicate that more than 1 in 10 college students participating in a cognitive test battery for research showed test scores consistent with inadequate effort, which was associated with poor performance on testing across many domains. This conclusion was supported by poor performance on many other subtests. Healthy college students with suboptimal effort (n = 11) had an overall score in the 15th percentile on average compared to the 48th percentile in the rest of the students (n = 66). Those who failed validity indicators on the baseline administration were more likely to fail validity indicators on the repeat administration. Those who were tested in the morning were also more likely to fail validity indicators. The current study provides evidence for the potential limitations of conducting research using neuropsychological tests with healthy college student volunteers in the absence of performance validity testing. Revised college-level cutoffs are proposed.

Associations Between MMPI-2-RF Validity Scale Scores and Extra-Test Measures of Personality and Psychopathology

The current study explored associations between two potentially invalidating self-report styles detected by the Validity scales of the Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI-2-RF), over-reporting and under-reporting, and scores on the MMPI-2-RF substantive, as well as eight collateral self-report measures administered either at the same time or within 1 to 10 days of MMPI-2-RF administration. Analyses were conducted with data provided by college students, male prisoners, and male psychiatric outpatients from a Veterans Administration facility. Results indicated that if either an over- or under-reporting response style was suggested by the MMPI-2-RF Validity scales, scores on the majority of the MMPI-2-RF substantive scales, as well as a number of collateral measures, were significantly affected in all three groups in the expected directions. Test takers who were identified as potentially engaging in an over- or under-reporting response style by the MMPI-2-RF Validity scales appeared to approach extra-test measures similarly regardless of when these measures were administered in relation to the MMPI-2-RF. Limitations and suggestions for future study are discussed.