Deciding to adopt revised and new psychological and neuropsychological tests: an inter-organizational position paper

New Versions of the MMPI and Rorschach: How Have Training Programs Responded?

In this brief article, we update the training of newer versions of the Minnesota Multiphasic Personality Inventory (MMPI) and Rorschach and compare to a 2015 assessment training survey of American Psychological Association accredited clinical psychology doctoral programs. The survey sample sizes for 2015, 2021, and 2022 were 83, 81, and 88, respectively. By 2015, of the programs teaching any adult MMPI version, almost all (94%) were still teaching the MMPI-2, and 68% had started teaching the MMPI-2-RF. In 2021 and 2022, respectively, almost all programs (96% and 94%) had started teaching the MMPI-2-RF or MMPI-3, although most were still teaching the MMPI-2 (77% and 66%). By 2015, of the programs teaching the Rorschach, 85% were still teaching the Comprehensive System (CS) and 60% had started teaching the Rorschach Performance Assessment System (R-PAS). In 2021 and 2022, respectively, most programs had started teaching R-PAS (77% and 77%) although many (65% and 50%) were still teaching the CS. Therefore, doctoral programs are indeed switching to newer versions of the MMPI and Rorschach, although more slowly than one might expect. We recommend that APA provide more guidance in selecting test versions for training programs, practitioners, and researchers.

Evaluation of the Wechsler Individual Achievement Test-Fourth Edition as a Measurement Instrument

The Wechsler Individual Achievement Test (WIAT-4) is the latest iteration of a popular instrument that psychologists employ to assess academic achievement. The WIAT-4 authors make both pragmatic and measurement claims about the instrument. The pragmatic claims involve being useful for identifying individuals in certain academic achievement-related groups (e.g., specific learning disability). The measurement claims are twofold: (a) the instrument’s scores represent psychological attributes, and (b) scores transformed to standard score values have equal-interval properties. The WIAT-4 authors did not provide the evidence necessary to support the pragmatic claims in the technical manual, so we could not evaluate them. Thus, we limited our evaluation to the measurement claims for the composite scores. To do so, we used information in the technical manual along with some additional factor analyses. Support for the first measurement claim varies substantially across scores. Although none of the evidence is particularly strong, scores in mathematics and reading domains tend to have more support than the writing and total achievement scores. Support for the second claim was insufficient for all scores. Consequently, we recommend that psychologists wishing to interpret WIAT-4 composite scores limit those interpretations to just a few in the mathematics and reading domains. Second, psychologists should completely refrain from using any composite score in a way that requires equal-interval values (e.g., quantitative score comparisons). Neither of these recommendations necessarily disqualifies the scores from being useful for pragmatic purposes, but support for these uses will need to come from evidence not currently provided in the WIAT-4 technical manual.

Reynolds Intellectual Screening Instrument 1st versus 2nd Edition in a Memory Disorder Sample

OBJECTIVE

The Reynolds Intellectual Screening Instrument (RIST) and its second edition (RIST-2) are brief intelligence screening instruments that potentially have value in older populations as their norms extend over age 90. This study examined performance on these two instruments in a sample of individuals presenting for evaluation in a memory disorder clinic.

METHOD

A sample of 1,145 subjects over the age of 50 was chosen from 1,761 consecutive referrals. Individuals who obtained a consensus diagnosis of Mild Cognitive Impairment (MCI; n = 536), possible dementia of the Alzheimer Type (DAT; n = 400), or those with subjective cognitive complaints (SCC; n = 209) and who completed a neuropsychological battery that included either the RIST (n = 747) or the RIST-2 (n = 398) were included in the sample. No clinically significant demographic or neuropsychological performance differences were found for those taking either version of the RIST.

RESULTS

Unlike the original version, RIST-2 Total and subtest scores were well below the mean for the DAT group and over 1 SD mean difference was seen for the DAT group when comparing the RIST and RIST-2 Totals. Diagnostic accuracy calculations suggested that the RIST-2 showed greater discrimination between the three groups although both versions achieved greater sensitivity than specificity.

CONCLUSIONS

Performance differences were evident when comparing the RIST and RIST-2, particularly for the DAT group. Although the RIST-2 evidenced greater diagnostic accuracy than its predecessor it should not be utilized in isolation for the clinical determination of DAT or MCI.

Therapy development for the mucopolysaccharidoses: Updated consensus recommendations for neuropsychological endpoints

Neurological dysfunction represents a significant clinical component of many of the mucopolysaccharidoses (also known as MPS disorders). The accurate and consistent assessment of neuropsychological function is essential to gain a greater understanding of the precise natural history of these conditions and to design effective clinical trials to evaluate the impact of therapies on the brain. In 2017, an International MPS Consensus Panel published recommendations for best practice in the design and conduct of clinical studies investigating the effects of therapies on cognitive function and adaptive behavior in patients with neuronopathic mucopolysaccharidoses. Based on an International MPS Consensus Conference held in February 2020, this article provides updated consensus recommendations and expands the objectives to include approaches for assessing behavioral and social-emotional state, caregiver burden and quality of life in patients with all mucopolysaccharidoses.

Cohort differences on the CVLT-II and CVLT3: Evidence of a negative Flynn effect on the attention/working memory and learning trials

OBJECTIVE

Although cohort effects on IQ measures have been investigated extensively, studies exploring cohort differences on verbal memory tests, and the extent to which they are influenced by socioenvironmental changes across decades (e.g. educational attainment; ethnic makeup), have been limited.

METHOD

We examined differences in performance between the normative samples of the CVLT-II from 1999 and the CVLT3 from 2016 to 2017 on the immediate- and delayed-recall trials, and we explored the degree to which verbal learning and memory skills might be influenced by the cohort year in which norms were collected versus demographic factors (e.g. education level).

RESULTS

Multivariate analysis of variance tests and follow-up univariate tests yielded evidence for a negative cohort effect (also referred to as negative Flynn effect) on performance, controlling for demographic factors (p = .001). In particular, findings revealed evidence of a negative Flynn effect on the attention/working memory and learning trials (Trial 1, Trial 2, Trial 3, Trials 1-5 Total, List B; ps < .007), with no significant cohort differences found on the delayed-recall trials. As expected, education level, age group, and ethnicity were significant predictors of CVLT performance (ps < .01). Importantly, however, there were no interactions between cohort year of norms collection and education level, age group, or ethnicity on performance.

CONCLUSIONS

The clinical implications of the present findings for using word list learning and memory tests like the CVLT, and the potential role of socioenvironmental factors on the observed negative Flynn effect on the attention/working memory and learning trials, are discussed.