Examining the cross-cultural validity of the test of memory malingering and the Rey 15-item test

OBJECTIVE

This study was designed to investigate the cross-cultural validity of two freestanding performance validity tests (PVTs), the Test of Memory Malingering - Trial 1 (TOMM-1) and the Rey Fifteen Item Test (Rey-15) in Romanian-speaking patients.

METHODS

The TOMM-1 and Rey-15 free recall (FR) and the combination score incorporating the recognition trial (COMB) were administered to a mixed clinical sample of 61 adults referred for cognitive evaluation, 24 of whom had external incentives to appear impaired. Average scores on PVTs were compared between the two groups. Classification accuracies were computed using one PVT against another.

RESULTS

Patients with identifiable external incentives to appear impaired produced significantly lower scores and more errors on validity indicators. The largest effect sizes emerged on TOMM-1 (Cohen's d = 1.00-1.19). TOMM-1 was a significant predictor of the Rey-15 COMB ≤20 (AUC = .80; .38 sensitivity; .89 specificity at a cutoff of ≤39). Similarly, both Rey-15 indicators were significant predictors of TOMM-1 at ≤39 as the criterion (AUCs = .73-.76; .33 sensitivity; .89-.90 specificity).

CONCLUSION

Results offer a proof of concept for the cross-cultural validity of the TOMM-1 and Rey-15 in a Romanian clinical sample.

The influence of sociodemographic factors and response style on caregiver report of infant developmental status

Caregiver report is the most feasible way to assess early childhood development but is susceptible to the influences of response style and sociodemographic factors. In a sample of 571 caregiver-infant dyads (47.8% female; 48% White), we compared caregiver reports on the Ages and Stages Questionnaire-Third Edition (ASQ-3) with reports on a novel, web-based assessment, PediaTrac™. Ratings on PediaTrac correlated with ratings on the ASQ-3 at all time points (2, 4, 6, and 9 months). Caregiver age, response style, and sociodemographic factors accounted for significant variance on both measures. Developmental reporting of early childhood skills is influenced by caregiver response style and sociodemographic factors. These influences must be considered in order to ensure the accurate identification of infant developmental status.

PediaTrac V.3.0 protocol: a prospective, longitudinal study of the development and validation of a web-based tool to measure and track infant and toddler development from birth through 18 months

INTRODUCTION

The need for an efficient, low-cost, comprehensive measure to track infant/toddler development and treatment outcomes is critical, given the importance of early detection and monitoring. This manuscript describes the protocol for the development and testing of a novel measure, PediaTrac, that collects longitudinal, prospective, multidomain data from parents/caregivers to characterise infant/toddler developmental trajectories in term and preterm infants. PediaTrac, a web-based measure, has the potential to become the standard method for monitoring development and detecting risk in infancy and toddlerhood.

METHODS AND ANALYSES

Using a multisite, prospective design, primarcaregivers will complete PediaTrac V.3.0, a survey tool that queries core domains of early development, including feeding/eating/elimination, sleep, sensorimotor, social/sensory information processing, social/communication/cognition and early relational health. Information also will be obtained about demographic, medical and environmental factors and embedded response bias indices are being developed as part of the measure. Using an approach that systematically measures infant/toddler developmental domains during a schedule that corresponds to well-child visits (newborn, 2, 4, 6, 9, 12, 15, 18 months), we will assess 360 caregiver/term infant dyads and 240 caregiver/preterm infant dyads (gestational age <37 weeks). Parameter estimates of our items and latent traits (eg, sensorimotor) will be estimated by theta using item response theory-graded response modelling. Participants also will complete legacy (ie, established) measures of development and caregiver health and functioning, used to provide evidence for construct (discriminant) validity. Predictive validity will be evaluated by examining relationships between the PediaTrac domains and the legacy measures in the total sample and in a subsample of 100 participants who will undergo a neurodevelopmental assessment at 24 months of age.

ETHICS AND DISSEMINATION

This investigation has single Institutional Review Board (IRB) multisite approval from the University of Michigan (IRB HUM00151584). The results will be presented at prominent conferences and published in peer-reviewed scientific journals.

Critical Item Analysis Enhances the Classification Accuracy of the Logical Memory Recognition Trial as a Performance Validity Indicator

OBJECTIVE

: Replicate previous research on Logical Memory Recognition (LM_Recog) and perform a critical item analysis.

METHOD

: Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LM_Recog and nine critical items (CR-9) was computed.

RESULTS

: LM_Recog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LM_Recog ≤20; CR-9 ≥6 increased specificity by 6-8% over LM_Recog ≤20; CR-9 ≥7 increased specificity by 8-15%.

CONCLUSIONS

: Critical item analysis enhances the classification accuracy of the optimal LM_Recog cutoff (≤20).

Altered mental status in 71 deaths due to COVID-19

OBJECTIVE

The purpose of this study was to investigate the occurrence of neurologic symptoms with a focus on altered mental status in a sample of deaths due to COVID-19.

METHODS

We reviewed neurologic symptoms in 71 deaths due to COVID-19 at the first US hospital with reported cases, of which 66 (93%) had medical comorbidities, 47 (66%) came from assisted living facilities or nursing homes and 35 (49%) had baseline dementia.

RESULTS

Sixty-one patients (86%) demonstrated neurologic symptoms at hospital admission. Altered mental status was seen in 47 patients (66%) and represented the most common neurologic symptom. Seven patients (10%) were comatose at hospital admission and 5 (7%) presented with altered mental status without respiratory symptoms. Three patients had seizures and two had strokes. Hypertension (61%), cardiovascular disease (59%), and dementia (49%) were the most common comorbidities associated with death due to COVID-19 in our sample.

CONCLUSIONS

Neurologic symptoms, particularly altered mental status, are very common in COVID-19 patients with high risk of mortality. In a small subset of patients, altered mental status is the defining feature of disease presentation. A mental status examination should be incorporated in the medical assessment of COVID-19.

Prevalence of Invalid Performance on Baseline Testing for Sport-Related Concussion by Age and Validity Indicator

Importance

Estimated base rates of invalid performance on baseline testing (base rates of failure) for the management of sport-related concussion range from 6.1% to 40.0%, depending on the validity indicator used. The instability of this key measure represents a challenge in the clinical interpretation of test results that could undermine the utility of baseline testing.

Objectives

To determine the prevalence of invalid performance on baseline testing and to assess whether the prevalence varies as a function of age and validity indicator.

Design, Setting, and Participants

This retrospective, cross-sectional study included data collected between January 1, 2012, and December 31, 2016, from a clinical referral center in the Midwestern United States. Participants included 7897 consecutively tested, equivalently proportioned male and female athletes aged 10 to 21 years, who completed baseline neurocognitive testing for the purpose of concussion management.

Interventions

Baseline assessment was conducted with the Immediate Postconcussion Assessment and Cognitive Testing (ImPACT), a computerized neurocognitive test designed for assessment of concussion.

Main Outcomes and Measures

Base rates of failure on published ImPACT validity indicators were compared within and across age groups. Hypotheses were developed after data collection but prior to analyses.

Results

Of the 7897 study participants, 4086 (51.7%) were male, mean (SD) age was 14.71 (1.78) years, 7820 (99.0%) were primarily English speaking, and the mean (SD) educational level was 8.79 (1.68) years. The base rate of failure ranged from 6.4% to 47.6% across individual indicators. Most of the sample (55.7%) failed at least 1 of 4 validity indicators. The base rate of failure varied considerably across age groups (117 of 140 [83.6%] for those aged 10 years to 14 of 48 [29.2%] for those aged 21 years), representing a risk ratio of 2.86 (95% CI, 2.60-3.16; P < .001).

Conclusions and Relevance

The results for base rate of failure were surprisingly high overall and varied widely depending on the specific validity indicator and the age of the examinee. The strong age association, with 3 of 4 participants aged 10 to 12 years failing validity indicators, suggests that the clinical interpretation and utility of baseline testing in this age group is questionable. These findings underscore the need for close scrutiny of performance validity indicators on baseline testing across age groups.

Demographic and injury-related moderators of memory and achievement outcome in pediatric TBI

Critical factors affecting traumatic brain injury (TBI) outcome in children and adolescents are explored with an emphasis on an examination of age at injury as a predictor of memory functioning. Age at injury and other injury-related and demographic predictors (i.e., severity, time postinjury, gender, and socioeconomic status [SES]) of memory and achievement outcome were examined in 65 children and adolescents post-TBI compared to 65 age-matched noninjured controls. Although robust findings have been found for age at injury as a general predictor of outcome, age was not found to be a significant predictor of memory functioning following pediatric TBI. Structural equation modeling suggests that the most parsimonious model of post-TBI outcome contains two causally related latent variables: one defined by gender, SES, injury severity, and age at injury, and one defined by general cognitive functioning.

Memory and learning in pediatric traumatic brain injury: a review and examination of moderators of outcome

This article reviews empirically supported assessment methods to examine impairments in memory and learning following pediatric traumatic brain injury (TBI). Critical factors affecting outcome are explored with an emphasis on an examination of age at injury. The article closes with discussion of current evidence-based interventions for deficits in memory and learning following pediatric TBI.