An initial exploration of the convergent and ecological validity of the UDS 3.0 neuropsychological battery in Parkinson's Disease

Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action

OBJECTIVE

"Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid.

METHOD

MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used.

RESULTS

About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations).

CONCLUSIONS

Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).

Ecological validity of cognitive fluctuations in dementia with Lewy bodies

OBJECTIVES

Cognitive fluctuations are a core clinical feature of dementia with Lewy bodies (DLB), but their contribution to the everyday functioning difficulties evident DLB are not well understood. The current study evaluated whether intraindividual variability across a battery of neurocognitive tests (intraindividual variability-dispersion) and daily cognitive fluctuations as measured by informant report are associated with worse daily functioning in DLB.

METHODS

The study sample included 97 participants with consensus-defined DLB from the National Alzheimer's Coordinating Center (NACC). Intraindividual variability-dispersion was measured using the coefficient of variation, which divides the standard deviation of an individual's performance scores across 12 normed neurocognitive indices from the NACC neuropsychological battery by that individual's performance mean. Informants reported on daily cognitive fluctuations using the Mayo Fluctuations Scale (MFS) and on daily functioning using the functional activities questionnaire (FAQ).

RESULTS

Logistic regression identified a large univariate association of intraindividual variability-dispersion and presence of daily cognitive fluctuations on the MFS (Odds Ratio = 73.27, 95% Confidence Interval = 1.38, 3,895.05). Multiple linear regression demonstrated that higher intraindividual variability-dispersion and presence of daily cognitive fluctuations as assessed by the MFS were significantly and independently related to worse daily functioning (FAQ scores).

CONCLUSIONS

Among those with DLB, informant-rated daily cognitive fluctuations and cognitive fluctuations measured in the clinic (as indexed by intraindividual variability-dispersion across a battery of tests) were independently associated with poorer everyday functioning. These data demonstrate ecological validity in measures of cognitive fluctuations in DLB.

Mild cognitive impairment in patients with Parkinson’s disease: An updated mini-review and future outlook

Mild cognitive impairment (MCI) is one of the common non-motor symptoms in patients with Parkinson’s disease (PD). MCI is the transition stage between normal aging and full-blown dementia and is also a powerful predictor of dementia. Although the concept of MCI has been used to describe some of the PD symptoms for many years, there is a lack of consistent diagnostic criteria. Moreover, because of the diverse patterns of the cognitive functions, each cognitive impairment will have a different progression. In this review, we overviewed the diagnostic criteria for PD-MCI, primarily focused on the heterogeneity of PD-MCI patients’ cognitive function, including various types of cognitive functions and their progression rates. A review of this topic is expected to be beneficial for clinical diagnosis, early intervention, and treatment. In addition, we also discussed the unmet needs and future vision in this field.