Multivariate Base Rates of Low Scores on Tests of Executive Functions in a Multi-Country Latin American Sample

Measurement invariance of a neuropsychological battery across urban and rural older adults in Costa Rica

This study evaluated the measurement invariance of a neuropsychological battery across rural and urban older adults from Costa Rica. Rural and urban older adults (N = 295) from the Epidemiology and Development of Alzheimer's Disease (EDAD) study in Costa Rica were assessed. The baseline factor model for the EDAD neuropsychological measures was identified with nine neuropsychological measures and three cognitive constructs: Verbal Memory, Spatial Reasoning, and Cognitive Flexibility. Measurement and structural invariance were established, and, then, group comparisons of the latent cognitive factors were conducted to explore regional disparities. The findings showed that most of the neuropsychological tests in EDAD can be directly compared across the groups, allowing for cognitive constructs comparisons. The rural sample showed a disadvantage in the Spatial Reasoning and Cognitive Flexibility abilities. When age and education were included in the models, differences between the regions disappeared. Having more years of education was associated with higher cognitive abilities, with a larger effect for the rural group. Norms for Costa Rican older adults should consider age and education adjustments. This study contributes to the growing area of measurement invariance in neuropsychological assessment as it highlights the importance of examining the comparability of assessment measures across different cultural groups.

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Multivariate Base Rates of Low Score on Neuropsychological Tests of Individuals with Coca Paste Use Disorder

OBJECTIVE

The aim of this study was to determine the prevalence of low scores on eight commonly used neuropsychological tests to evaluate learning and memory, language, and executive functions in individuals with coca paste use disorders (CPUD) and to identify the differences with respect to a group of healthy nonconsuming subjects (HCs).

METHODS

162 Colombian adults with CPUD and a group of 162 Colombian adult HCs participated in this comparative study. Eight tests (eighteen test scores) were grouped into three categories: learning and memory, language, and executive functions. Each participant was categorized based on the number of low scoring tests in specific percentile cut-off groups (25th, 16th, 10th, 5th, and 2nd).

RESULTS

In the learning and memory domain, 89.5% of individuals with CPUD and 55.6% of HCs scored below the 25th percentile on at least one of the five test scores, in the language domain, 80.7% of individuals with CPUD and 58% of HCs and in the executive function domain, 92% of individuals with CPUD and 67.3% of HCs. Having two or more scores below the 10th percentile or 10 or more at the 5th percentile shows an optimal cut-off for determining the sensitivity and specificity for discriminating between the two groups.

CONCLUSIONS

The individuals with CPUD had a higher percentage of low scores than the HCs in the domains of learning and memory, language, and executive function. It is important for clinicians to be aware of low scores in individuals with CPUD to avoid false-positive diagnoses of cognitive impairment.

Validation of the Norma Latina Neuropsychological Assessment Battery in Patients with Alzheimer's Disease in Mexico

To our knowledge, this is the first study reported in the literature that has validated the Norma Latina Battery in a population of people with Alzheimer's disease (AD) in Mexico. The objective of the study was to determine the discriminant validity of the Norma Latina Battery in a group of Mexican individuals with AD and a group of heathy controls (HC). The Norma Latina Battery was administered to 234 Mexican participants (117 HC and 117 individuals with AD). Results show that: (1) the Norma Latina Battery has high discriminative capacity between groups in all domains; (2) participants with AD presented worse scores in each of the cognitive domains compared to the HC and a greater number of low scores in each of the established thresholds or cut-off points; and finally, (3) the Norma Latina Battery had optimal sensitivity and specificity, especially when a set was observed ≥5 scores below the 10th percentile or ≥4 scores below the 5th percentile. In conclusion, it is recommended that both clinicians and researchers use this battery in the evaluation of Mexican people with AD to better understand the prognosis of the disease and its subsequent treatment.

Multivariate Base Rates of Low Neuropsychological Test Scores in Cognitively Intact Older Adults with Subjective Cognitive Decline from a Specialist Memory Clinic

OBJECTIVE

To avoid misdiagnosing mild cognitive impairment (MCI), knowledge of the multivariate base rates (MVBRs) of low scores on neuropsychological tests is crucial. Base rates have typically been determined from normative population samples, which may differ from clinically referred samples. The current study addresses this limitation by calculating the MVBR of low or high cognitive scores in older adults who presented to a memory clinic experiencing subjective cognitive decline but were not diagnosed with MCI.

METHOD

We determined the MVBRs on the Kaplan-Baycrest Neurocognitive Assessment for 107 cognitively healthy older adults (M age = 75.81), by calculating the frequency of patients producing n scores below or above different cut-off values (i.e., 1, 1.5, 2.0, 2.5 SD from the mean), stratifying by education and gender.

RESULTS

Performing below or above cut-off was common, with more stringent cut-offs leading to lower base rates (≥1 low scores occurred in 84.1% of older adults at -1 SD, 55.1% at -1.5 SD, and 39.3% at -2 SD below the mean; ≥1 high scores occurred in 80.4% of older adults at +1 SD, 35.5% at +1.5 SD, and 16.8% at +2 SD above the mean). Higher education was associated with varying base rates. Overall, the MVBR of obtaining a low cognitive test score was higher in this clinic sample, compared with prior studies of normative samples.

CONCLUSIONS

MVBRs for clinically referred older adults experiencing memory complaints provide a diagnostic benefit, helping to prevent attributing normal variability to cognitive impairment and limiting false positive diagnoses.

A Multivariate Interpretation of the Spanish-Language NIH Toolbox Cognition Battery: The Normal Frequency of Low Scores

OBJECTIVE

The current study involved the preparation of multivariate base rates for the Spanish-language NIH Toolbox Cognition Battery (NIHTB-CB) based on the U.S. normative sample, quantifying the normal frequency of low scores among healthy adults.

METHOD

Participants included 250 healthy Latinx adults (M = 38.8 ± 13.7 years old, range: 19-80; 72.0% women; education: M = 11.5 ± 3.9 years) who completed the full Spanish-language NIHTB-CB, including two tests of crystallized cognition and five tests of fluid cognition. Multivariate base rates quantified the frequency at which participants obtained 1 or more fluid scores ≤25th, ≤16th, ≤9th, ≤5th, and ≤2nd percentile, per age-adjusted or demographically adjusted (age, gender, education) normed scores.

RESULTS

A substantial minority of participants had 1 or more low scores (e.g., 40.4% had 1 or more age-adjusted score ≤16th percentile). The frequencies of low scores increased with fewer years of education and lower crystallized cognitive ability. Higher frequencies of low scores were observed among participants who were born and educated abroad, versus within the USA; monolingual Spanish speakers, versus bilingual Spanish/English speakers; and from households below the national median income, versus households above the national median.

CONCLUSION

Low scores were common and related to crystallized ability, education, and sociocultural variables. Although using demographically adjusted scores reduced group differences related to sociocultural variables, group differences were not eliminated, indicating that age, gender, and education score adjustments do not fully explain the associations between sociocultural variables and test performances. These stratified base rates may be useful when working with Spanish-speaking patients with diverse sociocultural characteristics.