Cognitive reserve estimated with a life experience questionnaire outperforms education in predicting performance on MoCA: Italian normative data

Consequences of age and education correction of cognitive screening tests - A simulation study of the MoCA test in Italy

BACKGROUND

Cognitive screening tools are widely used in clinical practice to screen for age-related cognitive impairment and dementia. These tools' test scores are known to be influenced by age and education, leading to routine correction of raw scores for these factors. Despite these corrections being common practice, there is evidence suggesting that corrected scores may perform worse in terms of discrimination than raw scores.

OBJECTIVE

To address the ongoing debate in the field of dementia research, we assessed the impact of the corrections on discrimination, specificity, and sensitivity of the Montreal Cognitive Assessment test in Italy, both for the overall population and across age and education strata.

METHODOLOGY

We created a realistic model of the resident population in Italy in terms of age, education, cognitive impairment and test scores, and performed a simulation study.

RESULTS

We confirmed that the discrimination performance was higher for raw scores than for corrected scores in discriminating patients with cognitive impairment from individuals without (areas under the curve of 0.947 and 0.923 respectively). With thresholds determined on the overall population, raw scores showed higher sensitivities for higher-risk age-education groups and higher specificities for lower-risk groups. Conversely, corrected scores showed uniform sensitivity and specificity across demographic strata, and thus better performance for certain age-education groups.

CONCLUSION

Raw and corrected scores show different performances due to the underlying causal relationships between the variables. Each approach has advantages and disadvantages, the optimal choice between raw and corrected scores depends on the aims and preferences of practitioners and policymakers.

Assessing Theory of Mind in Children: A Tablet-Based Adaptation of a Classic Picture Sequencing Task

Correctly assessing children's theory of mind (TOM) is essential to clinical practice. Yet, most tasks heavily rely on language, which is an obstacle for several populations. Langdon and Coltheart's (Cognition 71(1):43-71, 1999) Picture Sequencing Task (PST), developed for research purposes, avoids this limitation through a minimally-verbal procedure. We thus developed a tablet adaptation of this task for individual application, engaging children's motivation and allowing response times collection. To assess this tablet-PST, we first tested a large sample of neurotypical children (6-11 years-old, N = 248), whose results confirmed the task's structural and content validity, and permitted the construction of three standardized clinical indices. In a second experiment, we applied those to previously diagnosed autistic children (N = 23), who were expected to show atypical TOM performance. Children's outcomes were consistent with what was hypothesized and confirmed the task's external validity and moderate clinical sensitivity. The tablet-PST thus appears as a suitable tool, providing detailed profiles to inform clinical decisions.

Tele-Global Examination of Mental State (Tele-GEMS): an open tool for the remote neuropsychological screening

Tele-neuropsychology, i.e., the application of remote audio-visual technologies to neuropsychological evaluation or rehabilitation, has become increasingly popular and widespread during and after the COVID-19 pandemic. New tools with updated normative data and appropriate methodological developments are necessary. We present Tele-GEMS, a telephone-based cognitive screening developed on N = 601 Italian participants. It yields a global score tapping on orientation, memory, spatial representation, language, and pragmatic abilities. Its administration lasts about 10 min. Clinical cut-offs are provided, accounting for demographic variables (age, education, and sex) and also for a comprehensive index taking into account cognitively stimulating life experiences that can build up a cognitive reserve. Tele-GEMS shows good internal consistency and a good inter-rater agreement. The test includes the thresholds for estimating a significant change after repeated measurements. Tele-GEMS has a good construct validity as assessed with MoCA and a suitable criterion validity assessed with its in-person version (GEMS). All the materials and the instructions, including scripts and an online Application for the automatic calculation of cut-offs, are accessible on OSF at https://osf.io/t3bma/ under a Creative Commons license.

Education differentiates cognitive performance and resting state fMRI connectivity in healthy aging

Objectives

In healthy aging, the way people cope differently with cognitive and neural decline is influenced by exposure to cognitively enriching life-experiences. Education is one of them, so that in general, the higher the education, the better the expected cognitive performance in aging. At the neural level, it is not clear yet how education can differentiate resting state functional connectivity profiles and their cognitive underpinnings. Thus, with this study, we aimed to investigate whether the variable education allowed for a finer description of age-related differences in cognition and resting state FC.

Methods

We analyzed in 197 healthy individuals (137 young adults aged 20-35 and 60 older adults aged 55-80 from the publicly available LEMON database), a pool of cognitive and neural variables, derived from magnetic resonance imaging, in relation to education. Firstly, we assessed age-related differences, by comparing young and older adults. Then, we investigated the possible role of education in outlining such differences, by splitting the group of older adults based on their education.

Results

In terms of cognitive performance, older adults with higher education and young adults were comparable in language and executive functions. Interestingly, they had a wider vocabulary compared to young adults and older adults with lower education. Concerning functional connectivity, the results showed significant age- and education-related differences within three networks: the Visual-Medial, the Dorsal Attentional, and the Default Mode network (DMN). For the DMN, we also found a relationship with memory performance, which strengthen the evidence that this network has a specific role in linking cognitive maintenance and FC at rest in healthy aging.

Discussion

Our study revealed that education contributes to differentiating cognitive and neural profiles in healthy older adults. Also, the DMN could be a key network in this context, as it may reflect some compensatory mechanisms relative to memory capacities in older adults with higher education.

Optimal MoCA cutoffs for detecting biologically-defined patients with MCI and early dementia

OBJECTIVE

In this phase II psychometric study on the Montreal cognitive assessment (MoCA), we tested the clinicometric properties of Italian norms for patients with mild cognitive impairment (PwMCI) and early dementia (PwD) and provided optimal cutoffs for diagnostic purposes.

METHODS

Retrospective data collection was performed for consecutive patients with clinically and biologically defined MCI and early dementia. Forty-five patients (24 PwMCI and 21 PwD) and 25 healthy controls were included. Raw MoCA scores were adjusted according to the conventional 1-point correction (Nasreddine) and Italian norms (Conti, Santangelo, Aiello). The diagnostic properties of the original cutoff (< 26) and normative cutoffs, namely, the upper limits (uLs) of equivalent scores (ES) 1, 2, and 3, were evaluated. ROC curve analysis was performed to obtain optimal cutoffs.

RESULTS

The original cutoff demonstrated high sensitivity (0.93 [95% CI 0.84-0.98]) but low specificity (0.44 [0.32-0.56]) in discriminating between patients and controls. Nominal normative cutoffs (ES0 uLs) showed excellent specificity (SP range = 0.96-1.00 [0.88-1.00]) but poor sensitivity (SE range = 0.09-0.24 [0.04-0.36]). The optimal cutoff for Nasreddine's method was 23.50 (SE = 0.82 [0.71-0.90]; SP = 0.72 [0.60-0.82]). Optimal cutoffs were 20.97, 22.85, and 22.29 (SE range = 0.69-0.73 [0.57-0.83], SP range = 0.88-0.92 [0.77-0.97]) for Conti's, Santangelo's, and Aiello's methods, respectively.

CONCLUSION

Using the 1-point correction, combined with a cutoff of 23.50, might be useful in ambulatory settings with a large turnout. Our optimal cutoffs can offset the poor sensitivity of Italian cutoffs.