Performance Validity Test Failure in the Clinical Population: A Systematic Review and Meta-Analysis of Prevalence Rates

Performance validity tests (PVTs) are used to measure the validity of the obtained neuropsychological test data. However, when an individual fails a PVT, the likelihood that failure truly reflects invalid performance (i.e., the positive predictive value) depends on the base rate in the context in which the assessment takes place. Therefore, accurate base rate information is needed to guide interpretation of PVT performance. This systematic review and meta-analysis examined the base rate of PVT failure in the clinical population (PROSPERO number: CRD42020164128). PubMed/MEDLINE, Web of Science, and PsychINFO were searched to identify articles published up to November 5, 2021. Main eligibility criteria were a clinical evaluation context and utilization of stand-alone and well-validated PVTs. Of the 457 articles scrutinized for eligibility, 47 were selected for systematic review and meta-analyses. Pooled base rate of PVT failure for all included studies was 16%, 95% CI [14, 19]. High heterogeneity existed among these studies (Cochran's Q = 697.97, p < .001; I2 = 91%; τ2 = 0.08). Subgroup analysis indicated that pooled PVT failure rates varied across clinical context, presence of external incentives, clinical diagnosis, and utilized PVT. Our findings can be used for calculating clinically applied statistics (i.e., positive and negative predictive values, and likelihood ratios) to increase the diagnostic accuracy of performance validity determination in clinical evaluation. Future research is necessary with more detailed recruitment procedures and sample descriptions to further improve the accuracy of the base rate of PVT failure in clinical practice.

Effort and liberal acceptance bias in patients with schizophrenia

Introduction: A liberal acceptance bias is implicated in the formation and maintenance of delusions in schizophrenia. The present study tested the hypothesis that patients with schizophrenia are more quickly satisfied with their task performance than controls despite poor objective performance. Methods: Fifty patients with schizophrenia and 50 healthy controls performed the newly developed copy figure task in which participants copy a complex geometrical figure up to eight times until they are satisfied with the result. Objective performance was scored blind to group status. Subjective performance was rated on a 10-point scale. Carefulness of the drawing using anchor points served as a proxy for effort. Results: Patients made as many attempts as controls to copy the figure despite their worse subjective and objective performance. The number of attempts was negatively correlated with (persecutory) delusions and the PANSS total score. Neither effort nor possible frustration due to a plateau in performance was a reason for task termination. Conclusions: This exploratory study is in line with predictions based on the liberal acceptance model. For future studies, we recommend further cross-validating this paradigm and testing whether patients' retrospective assessment of their performance is exaggerated relative to controls. We also suggest that researchers pursue this line of research with personally meaningful material where a decreased threshold of acceptance may more easily translate into the subsequent fixation of ideas.

Subjective competence breeds overconfidence in errors in psychosis. A hubris account of paranoia

BACKGROUND AND OBJECTIVES

Overconfidence in errors is a well-replicated cognitive bias in psychosis. However, prior studies have sometimes failed to find differences between patients and controls for more difficult tasks. We pursued the hypothesis that overconfidence in errors is exaggerated in participants with a liability to psychosis relative to controls only when they feel competent in the respective topic and/or deem the question easy. Whereas subjective competence likely enhances confidence in those with low psychosis liability as well, we still expected to find more 'residual' caution in the latter group.

METHODS

We adopted a psychometric high-risk approach to circumvent the confounding influence of treatment. A total of 2321 individuals from the general population were administered a task modeled after the "Who wants to be a millionaire" quiz. Participants were requested to endorse one out of four response options, graded for confidence, and were asked to provide ratings regarding subjective competence for the knowledge domain as well as the subjective difficulty of each item.

RESULTS

In line with our assumption, overconfidence in errors was increased overall in participants scoring high on the Paranoia Checklist core paranoia subscale (2 SD above the mean). This pattern of results was particularly prominent for items for which participants considered themselves competent and which they rated as easy.

LIMITATIONS

Results need to be replicated in a clinical sample.

DISCUSSION

In support of our hypothesis, subjective competence and task difficulty moderate overconfidence in errors in psychosis. Trainings that teach patients the fallibility of human cognition may help reduce delusional ideation.

Knowledge corruption for visual perception in individuals high on paranoia

Studies revealed that patients with paranoid schizophrenia display overconfidence in errors for memory and social cognition tasks. The present investigation examined whether this pattern holds true for visual perception tasks. Nonclinical participants were recruited via an online panel. Individuals were asked to complete a questionnaire that included the Paranoia Checklist and were then presented with 24 blurry pictures; half contained a hidden object while the other half showed snowy (visual) noise. Participants were asked to state whether the visual items contained an object and how confident they were in their judgment. Data from 1966 individuals were included following a conservative selection process. Participants high on core paranoid symptoms showed a poor calibration of confidence for correct versus incorrect responses. In particular, participants high on paranoia displayed overconfidence in incorrect responses and demonstrated a 20% error rate for responses made with high confidence compared to a 12% error rate in participants with low paranoia scores. Interestingly, paranoia scores declined after performance of the task. For the first time, overconfidence in errors was demonstrated among individuals with high levels of paranoia using a visual perception task, tentatively suggesting it is a ubiquitous phenomenon. In view of the significant decline in paranoia across time, bias modification programs may incorporate items such as the one employed here to teach patients with clinical paranoia the fallibility of human cognition, which may foster subsequent symptom improvement.

Assessment of subjective cognitive and emotional effects of antipsychotic drugs. Effect by defect?

Antipsychotic medication represents the first-line treatment for schizophrenia. While it is undisputed that antipsychotics ameliorate positive symptoms, the exact cognitive and emotional pathways through which the effect is exerted has remained unclear. The present study investigated the subjective effects of antipsychotics across various domains of cognition and emotion in both patients with psychotic symptoms and patients with other psychiatric diagnoses. A total of 69 patients with a probable history of psychosis or psychotic symptoms and 26 patients with psychiatric diagnoses other than psychosis participated in a survey conducted over the Internet. Multiple control measures aimed to secure response validity. All patients were currently or had previously been treated with antipsychotic agents. A questionnaire comprising 49 items and measuring possible effects of antipsychotics on cognition and emotion was administered. For 30 out of 49 items a clear response pattern emerged, which was similar for patients with psychotic disorders and patients with other diagnoses. Factor analysis of these items revealed three main effects of antipsychotic medication related to doubt and self-doubt, cognitive and emotional numbing, and social withdrawal. Antipsychotic treatment appears to be connected to a number of negative subjective effects on cognition and emotion. Further studies are warranted to assess how these effects impact on the patients' subjective well-being and quality of life, as well as their association with antipsychotic efficacy on one hand, and adherence rates on the other. Induction of doubt and dampening of emotion may be one reason why antipsychotics work and at the same time offer an explanation why they are experienced as rather unpleasant and are eventually discontinued by many patients.

Impact of emotionality on memory and meta-memory in schizophrenia using video sequences

BACKGROUND AND OBJECTIVES

A vast amount of memory and meta-memory research in schizophrenia shows that these patients perform worse on memory accuracy and hold false information with strong conviction compared to healthy controls. So far, studies investigating these effects mainly used traditional static stimulus material like word lists or pictures. The question remains whether these memory and meta-memory effects are also present in (1) more near-life dynamic situations (i.e., using standardized videos) and (2) whether emotionality has an influence on memory and meta-memory deficits (i.e., response confidence) in schizophrenia compared to healthy controls.

METHOD

Twenty-seven schizophrenia patients and 24 healthy controls were administered a newly developed emotional video paradigm with five videos differing in emotionality (positive, two negative, neutral, and delusional related). After each video, a recognition task required participants to make old-new discriminations along with confidence ratings, investigating memory accuracy and meta-memory deficits in more dynamic settings.

RESULTS

For all but the positively valenced video, patients recognized fewer correct items compared to healthy controls, and did not differ with regard to the number of false memories for related items. In line with prior findings, schizophrenia patients showed more high-confident responses for misses and false memories for related items but displayed underconfidence for hits when compared to healthy controls, independent of emotionality.

LIMITATIONS

Limited sample size and control group; combined valence and arousal indicator for emotionality; general psychopathology indicator.

CONCLUSIONS

Emotionality differentially moderated memory accuracy, biases in schizophrenia patients compared to controls. Moreover, the meta-memory deficits identified in static paradigms also manifest in more dynamic settings near-life settings and seem to be independent of emotionality.

Let's use those tests! Evaluations of crime-related amnesia claims

Suspects awaiting trial often claim that they cannot remember important parts of their violent crimes. It is not unusual that forensic experts readily accept such claims and interpret them in terms of dissociative amnesia or, more specifically, a "red-out". This interpretation hinges on the assumption that heightened levels of stress implicated in violent crimes interfere with memory. We argue that the notion of red-out is a priori not plausible and that alternative interpretations-primarily malingering and substance-induced organic amnesia-should be considered and ruled out first before concluding that memory loss is dissociative in nature. We illustrate our point with four cases that superficially have the contours of red-out tragedies. We believe that, in such cases, neuropsychological tests and/or psychopharmacological information on dose-response relationships can assist forensic experts to exclude malingering or substance-induced amnesia. There is no reason for not using tests and tools from neuropsychology and psychopharmacology.

Susceptibility to misleading information under social pressure in schizophrenia

Research looking at specific memory aberrations in the schizophrenia has primarily focused on their phenomenology using standardized semantic laboratory tasks. However, no study has investigated to what extent such aberrations have consequences for everyday episodic memories using more realistic false memory paradigms. Using a false memory paradigm where participants are presented with misleading suggestive information (Gudjonsson Suggestibility Scale), we investigated the susceptibility of patients with schizophrenia (n = 21) and healthy controls (n = 18) to post hoc misleading information acceptance and compliance. Patients with schizophrenia exhibited an increased susceptibility to go along with misleading suggestive items. Furthermore, they showed an increased tendency to change answers under conditions of social pressure. Underscoring previous findings on memory aberrations in schizophrenia, patients with schizophrenia had reduced levels of correct recognition (ie, true memory) relative to healthy controls. The effects remained stable when controlling for specific mediating variables such as symptom severity and intelligence in patients with schizophrenia. These findings are a first indication that social pressure and misleading information may impair source memory for everyday episodic memories in schizophrenia, and such impairment has clear consequences for treatment issues and forensic practice.

Heart rate variability in response to affective scenes in posttraumatic stress disorder

Posttraumatic stress disorder (PTSD) is characterized by psychophysiological abnormalities, such as an altered baseline heart rate and either hyper- or hyporeactivity to a wide range of stimuli, implying dysfunctional arousal regulation. Heart rate variability (HRV) has been established as an important marker of arousal regulatory ability. The aim of the present study was to examine HRV in PTSD under different affective conditions and to explore the role of potential moderating factors. To meet this purpose, videos of varying emotional valence were presented to trauma-exposed participants with PTSD (n=26), trauma-exposed participants without PTSD (n=26), as well as non-trauma-exposed controls (n=18) while HRV was recorded. The PTSD group showed lower HRV than non-trauma-exposed controls at baseline (corrected for age) and throughout different affective conditions implying decreased parasympathetic activity and an inflexible response regulation. There was a negative relationship between HRV and self-report of both depression and state dissociation.

Underestimation of prior remembering and susceptibility to false memories: two sides of the same coin?

In two studies, we explored whether susceptibility to false memories and the underestimation of prior memories (i.e., forgot-it-all-along effect) tap overlapping memory phenomena. Study 1 investigated this issue by administering the Deese/Roediger-McDermott task (DRM) and the forgot-it-all-along (FIA) task to an undergraduate sample (N=110). It was furthermore explored how performances on these tasks correlate with clinically relevant traits such as fantasy proneness, dissociative experiences, and cognitive efficiency. Results show that FIA and DRM performances are relatively independent from each other, suggesting that these measures empirically apparently refer to separate dimensions. However, they do not seem to define different profiles in terms of dissociation, fantasy proneness, and cognitive efficiency. Study 2 replicated the finding of relative independence between false memory propensity (as measured with the DRM task) and the underestimation of prior memories (as measured with an autobiographical memory dating task) in people with a history of childhood sexual abuse (N=35).

[When the suspect hears voices: feigned imperative hallucinations]

BACKGROUND

On occasion a suspect will feign psychotic symptoms such as hallucinations in order to trivialize their criminal responsibility. If doctors exercise only their clinical judgement, however, every now and then they will fail to identify a malingerer.

CASE DESCRIPTION

A 38-year-old male was remanded in custody. He was accused of having murdered 2 family members. He claimed that he had committed the murders as a result of hearing imperative hallucinations. We conducted a structured interview and specially designed tests to examine the plausibility of this claim. All our instruments pointed to the man having feigned his imperative hallucinations. When confronted with this, he confirmed that he had simulated his hallucinations.

CONCLUSION

Feigned hallucinations in a forensic setting can be detected using validated tests.

Autobiographical memory specificity among people with recovered memories of childhood sexual abuse

Individuals who report to have recovered memories of childhood sexual abuse (CSA) almost by definition believe that these memories were previously inaccessible for them. We examined whether poor autobiographical memory specificity for all kinds of events (i.e., events not necessarily related to CSA) may underlie such impressions of amnesia. Thus, we examined whether people who report recovered memories of CSA (n=44) would exhibit more difficulty retrieving specific autobiographical memories compared to people who never forgot their abuse experiences (continuous memory group; n=42) and people without a history of abuse (controls; n=26). The standard Autobiographical Memory Test (AMT) was administered to these 3 groups along with measures of depression and posttraumatic stress disorder symptomatology. Controls were significantly better at retrieving specific autobiographical memories relative to individuals with continuous and recovered CSA memories, who did not differ from each other. Thus, reduced autobiographical memory specificity was not particularly pronounced in people with recovered memories of CSA. Poor autobiographical memory specificity is unlikely to explain the impression of amnesia reported by this group.

Metacognitive beliefs in obsessive-compulsive patients: a comparison with healthy and schizophrenia participants

INTRODUCTION

Distorted metacognitive beliefs are increasingly considered in theoretical models of obsessive-compulsive disorder (OCD). However, so far no consensus has emerged regarding the specific metacognitive profile of OCD.

METHODS

Participants with OCD (n=55), schizophrenia (n=39), and nonclinical controls (n=49) were assessed with the Metacognitions Questionnaire (MCQ-30).

RESULTS

Except for positive beliefs about worry, both patient samples exceeded nonclinical controls on all MCQ subscales. The MCQ "need to control thoughts" and "negative beliefs about uncontrollability and danger" subscales showed strong correlations with obsessions, and scores in the former scale were elevated in hallucinators. In contrast to several prior studies, "cognitive confidence" was related neither to core OCD nor to schizophrenia symptomatology.

CONCLUSIONS

Notwithstanding large pathogenetic differences between OCD and schizophrenia, findings suggest that obsessions and hallucinations may share a common metacognitive pathway. Need to control thoughts and dysfunctional beliefs about the malleability of worries may represent critical prerequisites for the two phenomena to emerge.

Cure or curse? Ambivalent attitudes towards neuroleptic medication in schizophrenia and non-schizophrenia patients

Neuroleptic non-compliance remains a serious challenge for the treatment of psychosis. Non-compliance is predominantly attributed to side effects, lack of illness insight, reduced well-being or poor therapeutic alliance. However, other still neglected factors may also play a role. Further, little is known about whether psychiatric patients without psychosis who are increasingly prescribed neuroleptics differ in terms of medication compliance or about reasons for non-compliance by psychosis patients. As direct questioning is notoriously prone to social desirability biases, we conducted an anonymous survey. After a strict selection process blind to results, 95 psychiatric patients were retained for the final analyses (69 participants with a presumed diagnosis of schizophrenia psychosis, 26 without psychosis). Self-reported neuroleptic non-compliance was more prevalent in psychosis patients than non-psychosis patients. Apart from side effects and illness insight, main reasons for non-compliance in both groups were forgetfulness, distrust in therapist, and no subjective need for treatment. Other notable reasons were stigma and advice of relatives/acquaintances against neuroleptic medication. Gain from illness was a reason for non-compliance in 11-18% of the psychosis patients. Only 9% of all patients reported no side effects and full compliance and at the same time acknowledged that neuroleptics worked well for them. While pills were preferred over depot injections by the majority of patients, depot was judged as an alternative by a substantial subgroup. Although many patients acknowledge the need and benefits of neuroleptic medication, non-compliance was the norm rather than the exception in our samples.

MILD EXECUTIVE DYSFUNCTIONS IN UNDERGRADUATES ARE RELATED TO RECOLLECTING WORDS NEVER PRESENTED

The aim of this study was to explore whether individual differences in executive function in undergraduate students (n = 72) contribute to false recall and recognition as obtained with the Deese/Roediger-McDermott (DRM) paradigm. Participants were subjected to the DRM paradigm and also were given a test designed to assess executive function--the Random Number Generation task (RNG). A relationship was found between heightened seriation on the RNG (indicating a deficiency in the ability to inhibit cognitive schemes) and false recognition of non-presented, critical lure words in the DRM paradigm. This suggests that individual differences in executive function do occur in a healthy population and that the reconstructive activity inherent in memory depends in part on executive functioning.

The corrective effects of warning on false memories in the DRM paradigm are limited to full attention conditions

Effects of attention control and forewarning on the activation and monitoring of experimentally induced false memories in the Deese/Roediger-McDermott paradigm were investigated in a young adult sample (N=77). We found that reducing the degree of attention during encoding led to a decrease in veridical recall and an increase in non-presented critical lure intrusions. This effect could not be counteracted by a forewarning instruction. However, these findings did not emerge in a (retrieval supportive) recognition task. It seems that divided attention increases false recall when attention control and forewarning have to compete for limited cognitive resources in a generative free recall as opposed to a retrieval supportive recognition task. Forewarning instructions do not always protect young adults against experimentally induced false memories.

Did I say that word or did you? Executive dysfunctions in schizophrenic patients affect memory efficiency, but not source attributions

INTRODUCTION

Schizophrenic patients have difficulties in recognising previously presented verbal information and identifying its sources. The antecedents of these recognition and source misattributions are, however, largely unknown. The current study examined to what extent schizophrenic patients' lack of memory efficiency, their memory errors, and their source misattributions are related to neurocognitive deficits (i.e., executive dysfunctions).

METHODS

23 schizophrenic patients and 20 healthy controls were administered an adapted version of the Deese/Roediger-McDermott (DRM) task from which parameters of memory efficiency, memory errors, source misattributions, and two-high threshold measures were derived. Furthermore, two neurocognitive tasks tapping executive functions were administered: the Wisconsin Card Sorting Test (WCST) and the Behavioural Assessment of the Dysexecutive Syndrome (BADS). Using multiple linear regression analyses, we examined whether these neurocognitive measures predicted various memory parameters.

RESULTS

Patients with schizophrenia showed poorer memory efficiency and were more prone to make internal-external source misattributions with high confidence. However, they did not more often falsely recognise critical lure words than controls. Executive dysfunctions predicted memory efficiency, but not source misattribution performance.

CONCLUSION

Our findings provide further evidence that schizophrenic patients' memory impairments are intimately related to fundamental neurocognitive deficits.

The false fame illusion in people with memories about a previous life

The present study examined whether individuals with full-blown memories of highly implausible events are prone to commit source monitoring errors. Participants reporting previous-life memories and those without such memories completed a false fame task. This task provides an index of source monitoring errors (i.e., misclassifying familiar non-famous names as famous names). Participants with previous-life memories had a greater tendency to judge the names of previously presented non-famous people as famous than control participants. The two groups did not differ in terms of correct recognition of new non-famous names and famous names. Although dissociation, cognitive failures, sleep-related experiences, depressive symptoms, and signs of psychological distress were all significantly higher in participants with previous-life memories than in controls, these variables did not predict the false fame illusion.