Exploratory analysis of CVLT-II forced-choice recognition and RBANS EI base rates for forensically-committed, psychotic-disordered inpatients: Implications on clinical decision-making

The use of performance validity tests among inpatient forensic monolingual Spanish-speakers

Performance validity tests (PVTs) are an integral part of neuropsychological assessments. Yet no studies have examined how Spanish-speaking forensic inpatients perform on PVTs, making it difficult to interpret these tests in this population. The present study examined archival data collected from monolingual Spanish-speaking forensic inpatients (n = 55; Mage = 49.6 years, SD = 12.0; 84.9% male; 93.5% diagnosed with a Psychotic Spectrum Disorder) to determine how this population performs on several PVTs. Most participants' scores on the Dot Counting Test (DCT; 82.2%; n = 45), Repeatable Battery for Assessment of Neuropsychological Status-Effort Index (RBANS EI; 84.4%; n = 33), and Test of Memory Malingering (TOMM; 79.1%; n = 43) were indicative of valid performance. Few participants, however, had Rey-15 Item Test (FIT) scores in the valid range (24.5% to 48.0%; Recall n = 50 and Combined n = 49, respectively); although FIT Recall specificity was improved when cutoff scores were lowered. Total years of education, but not other educational factors, were significantly associated with performance on PVTs (r = .33-.40, p = .01-.03). Study results suggest the DCT, TOMM, and RBANS EI may be more appropriate PVTs for Spanish-speaking forensic inpatients compared to the FIT.

Examining the repeatable battery for the assessment of neuropsychological status validity indices in people with schizophrenia spectrum disorders

Objective: We examined the frequency of possible invalid test scores on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) in patients with schizophrenia spectrum disorders, and whether there was an association between scores on the embedded RBANS performance validity tests (PVTs) and self-reported symptoms of apathy as measured by the Initiate Scale of the Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A). Methods: Participants included 250 patients (M = 24.4 years-old, SD = 5.7) with schizophrenia spectrum disorders. Base rates of RBANS Effort Index (EI), Effort Scale (ES), and Performance Validity Index (PVI) test scores were computed. Spearman correlations were used to examine the associations between the RBANS PVTs, the RBANS Index scores, and the BRIEF-A Initiate Scale. Regression analyses were used to investigate how well the RBANS PVTs predicted scores on the BRIEF-A Initiate Scale. Results: The frequency of invalid scores on the EI (>3) and the PVI (<42) in participants with schizophrenia spectrum disorders was 6%. The frequency of invalid ES scores (<12) was 28% in the patients compared to 15% in the U.S. standardization sample. There was a small significant correlation between the EI and the BRIEF-A Initiate Scale (rho=.158, p<.05). Conclusions: The rates of invalid scores were similar to previously published studies. Invalid scores on the BRIEF-A were uncommon. Apathy measured with the BRIEF-A Initiate Scale was not associated with performance on the RBANS validity measures or with measures of cognition.

Verbal memory measurement towards digital perspectives in first-episode psychosis: A review

BACKGROUND

Even in the early phases of psychotic spectrum illnesses such as schizophrenia, patients can experience cognitive decline or deficits prior to the onset of psychotic symptoms such as delusions and hallucinations. In this systematic review, we assessed which verbal memory assessments are most widely used in first-episode psychosis and may be applied via digital technologies (smartphone applications, etc.) for use in early detection.

METHODS

In November 2019, we searched for studies measuring verbal memory in first episode psychosis or schizophrenia over the past 10 years on PubMed and PsycINFO. We screened abstracts of these studies and excluded review studies. Full-texts of included studies were used to identify the verbal memory measurement tests, follow-up frequencies, and sample sizes.

RESULTS

We screened 233 reports and found that 120 original research studies measured verbal memory in first episode psychosis over the past 10 years. Four of these studies specified using a computer, 24 (20%) used a paper-pen format, 1(1%) used both, and 91 (76%) studies did not specify their administration tools or suggest there were offered in digital formats. Thirty-five (30%) studies had follow-up measurements of verbal memory, while 85 (70%) had only a single verbal memory measurement.

DISCUSSION

While many scales are commonly used to measure verbal memory in first episode psychosis, they are not often administered via digital technology. There is an emerging opportunity to administer these and other tests via digital technologies for expanding access to early detection of cognitive decline in clinical high risk and first-episode psychosis.

A Meta-Analysis of Neuropsychological Effort Test Performance in Psychotic Disorders

Psychotic disorders are characterized by a generalized neurocognitive deficit (i.e., performance 1.5 SD below controls across neuropsychological domains with no specific profile of differential deficits). A motivational account of the generalized neurocognitive deficit has been proposed, which attributes poor neuropsychological testing performance to low effort. However, findings are inconsistent regarding effort test failure rate in individuals with psychotic disorders across studies (0-72%), and moderators are unclear, making it difficult to know whether the motivational explanation is viable. To address these issues, a meta-analysis was performed on data from 2205 individuals with psychotic disorders across 19 studies with 24 independent effects. Effort failure rate was examined along with moderators of effort test type, forensic status, IQ, positive symptoms, negative symptoms, diagnosis, age, gender, education, and antipsychotic use. The pooled weighted effort test failure rate was 18% across studies and there was a moderate pooled association between effort failure rate and global neurocognitive performance (r = .57). IQ and education significantly moderated failure rate. Collectively, these findings suggest that a nontrivial proportion of individuals with a psychotic disorder fail effort testing, and failure rate is associated with global neuropsychological impairment. However, given that effort tests are not immune to the effects of IQ in psychotic disorders, these results cannot attest to the viability of the motivational account of the generalized neurocognitive deficit. Furthermore, the significant moderating effect of IQ and education on effort test performance suggests that effort tests have questionable validity in this population and should be interpreted with caution.

A meta-analysis of the accuracy of embedded performance validity indicators from the repeatable battery for the assessment of neuropsychological status

Objective: Meta-analyze the embedded performance validity tests of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), emphasizing two topics: diagnostic accuracy and relationships with demographics. Method: Literature was identified through a review of PsycINFO, PubMed, and Google Scholar. Bivariate linear mixed models were used for diagnostic accuracy analyses. Random-effects analysis of correlations with demographic variables was also used for the Effort Index. Results: Diagnostic accuracy analyses utilized 12 studies of the Effort Index (EI; N = 1469) and 6 studies of the Effort Scale (ES; N = 854). The EI was found to have a sensitivity of .44 (95% CI: .28 - .62), specificity of .87 (95% CI: .78 - .93), and diagnostic odds ratio (DOR) of 5.41 (95% CI: 3.74 - 7.58). The ES produced a sensitivity of .67 (95% CI: .50 - .81), specificity of .72 (95% CI: .53 - .85), and DOR of 5.97 (95% CI: 1.70 - 15.30). Meta-analysis of correlations utilized 14 samples of the EI (N = 3781), but insufficient data were available for the ES. Correlations between the EI and age (r = .10, 95% CI: .05 - .16), education (r = -.11, 95% CI: -.18 to -.04), and the RBANS Total Scale (r = -.45, 95% CI: -.62 to -.24) were significant. These results appeared to be robust to publication bias. Conclusion: Results support use of the EI over the ES; however, the latter is comparatively less studied and did not have similar variability in reported cut-off scores. ES accuracy statistics were significantly predicted by sample variables, which may be related to its relatively fewer studies. Both measures should be used cautiously in the context of genuine cognitive impairment.