The Performance of Juvenile Offenders on the Test of Memory Malingering

A Systematic Review and Meta-Analysis of the Utility of the Test of Memory Malingering in Pediatric Examinees

Objective

This is the first systematic review and meta-analysis of the Test of Memory Malingering (TOMM) in pediatric examinees. It adheres to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

Method

A systematic literature search was conducted using PsycINFO and PubMed, reviewing articles from January 1997 to July 2019. Books providing data on pediatric validity testing were also reviewed for references to relevant articles. Eligibility criteria included publication in a peer-reviewed journal, utilizing a pediatric sample, providing sufficient data to calculate specificity and/or sensitivity, and providing a means for evaluating validity status external to the TOMM. After selection criteria were applied, 9 articles remained for meta-analysis. Samples included clinical patients and healthy children recruited for research purposes; ages ranged from 5 to 18. Fixed and random effects models were used to calculate classification accuracy statistics.

Results

Traditional adult-derived cutoffs for Trial 2 and Retention were highly specific (0.96–0.99) in pediatric examinees for both clinical and research samples. Sensitivity was relatively strong (0.68–0.70), although only two studies reported sensitivity rates. A supplemental review of the literature corroborated these findings, revealing that traditional adult-based TOMM cutoffs are supported in most pediatric settings. However, limited research exists on the impact of very young age, extremely low cognitive functioning, and varying clinical diagnoses.

Conclusions

The TOMM, at traditional adult cutoffs, has strong specificity as a performance validity test in pediatric neuropsychological evaluations. This meta-analysis found that specificity values in children are comparable to those of adults. Areas for further research are discussed.

Assessing performance validity with the TOMM and automatized sequences task in a pediatric psychiatric inpatient setting

This study examined the performance of children consecutively admitted to an inpatient psychiatric unit on the Test of Memory Malingering (TOMM) (aged 5-12; n = 96) and Automatized Sequences Task (aged 8-12; n = 67). Eighty-three percent of children passed the TOMM Trial 2 (M raw score = 47.7, SD = 4.7) and 76% of children passed the Automatized Sequences Task total time (M = 23.1 seconds; SD = 8.2). The concordance rate between the TOMM and the total time on the Automatized Sequences Task was 73.1%. Receiver operating characteristic curves indicated that of the Automatized Sequences Task subtests, only Counting 1-20 significantly differentiated children who passed Trial 2 of the TOMM from those who did not pass Trial 2 of the TOMM (area under the curve = .756, p = .006). Performance on both PVTs was unrelated to demographic characteristics and measures of psychological and neuropsychological functioning on both the TOMM and Automatized Sequences Task. Further research is needed to determine whether the nearly 1 in 4 children (23.9%) who performed below recommended cutoffs on Automatized Sequences Task reflects genuine suboptimal effort, cognitive difficulties among these children, and/or other factors.

Detecting memory performance validity with DETECTS: A computerized performance validity test

Evaluating performance validity is essential in neuropsychological and forensic assessments. Nonetheless, most psychological assessment tests are unable to detect performance validity and other methods must be used for this purpose. A new Performance Validity Test (DETECTS - Memory Performance Validity Test) was developed with several characteristics that enhance test utility. Moreover, precise response time measurement was added to DETECTS. Two groups of participants (normative and simulator group) completed DETECTS and three memory tests from the Wechsler Memory Scale III. Simulators achieved considerably lower scores (hits) and higher response times in DETECTS compared with the normative group. All participants in the normative group were classified correctly and no simulator was classified as having legitimate memory deficits. Thus, DETECTS seems to be a valuable computerized Performance Validity Test with reduced application time and effective cut-off scores as well as high sensitivity, specificity, and positive and negative predictive power values. Lastly, response time may be a very useful measure for detecting memory malingering.

The influence of effort on neuropsychological performance in children: is performance on the TOMM indicative of neuropsychological ability?

The Test of Memory Malingering (TOMM) is a measure of effort that has traditionally been utilized with adults but is being increasingly used with children, though it is not yet entirely clear what suboptimal TOMM performance means in terms of neuropsychological test scores. The purpose of this study was to investigate whether performance on the TOMM can be used as a predictive marker for neuropsychological performance in children. Participants (N = 75) completed the TOMM, Wechsler Intelligence Scale for Children-Fourth Edition, Wisconsin Card-Sorting Test (WCST), Children's Memory Test, and Delis-Kaplan Executive Function System Trails. Results revealed significant correlations between age, education level, IQ, and many of the neuropsychological measures administered, indicating that as children's TOMM scores increase, so do their cognitive performances. Children were subsequently divided into two groups: optimal effort and suboptimal effort, based on their TOMM Trial 2 scores. Results suggest significant differences in IQ performance and WCST Failure to Maintain Set; however, there were no differences in regard to any other neuropsychological measures administered. It was also found that a larger proportion of the younger children (aged 6 to 10 years old) scored below the TOMM cutoff compared with older children. This study illustrates that although correlations exist, suboptimal effort on the TOMM may not predict poorer performance on a neuropsychological evaluation in children as has been reported in other studies.

Intelligent diagnosing of intellectual disabilities in offenders: food for thought

Research on offenders with intellectual disabilities (IDs) in the criminal justice arena is on the rise, reflected by a growing number of relevant publications each year. However, there is a long recognized methodological problem that hampers the comparability of empirical studies and that raises doubts about the accuracy of prevalence rates, comorbidities, and various correlates and characteristics. In this paper we will argue that the crux of the problem can, on the one hand, be found in the plurality of assessment methods for intelligence and adaptive functioning, which are not all sufficiently reliable and valid. On the other hand, assessment of IQ in criminal justice and mental health-related areas appears to be informed more by practical aspects and needs rather than grounded in a solid theoretical model. Hence, we suggest that the Cattell-Horn-Carroll (CHC) model of intelligence has potential value in this regard, and deserves a closer look. Finally, we will discuss its incorporation into, and possible implications for, criminal justice practice and future study designs.