One-week practice effects in older adults: tools for assessing cognitive change

Test-retest reliability and reliable change index of the Philips IntelliSpace Cognition digital test battery

OBJECTIVE

This article provides the test-retest reliability and Reliable Change Indices (RCIs) of the Philips IntelliSpace Cognition (ISC) platform, which contains digitized versions of well-established neuropsychological tests.

METHOD

147 participants (ages 19 to 88) completed a digital cognitive test battery on the ISC platform or paper-pencil versions of the same test battery during two separate visits. Intraclass correlation coefficients (ICC) were calculated separately for the ISC and analog test versions to compare reliabilities between administration modalities. RCIs were calculated for the digital tests using the practice-adjusted RCI and standardized regression-based (SRB) method.

RESULTS

Test-retest reliabilities for the ISC tests ranged from moderate to excellent and were comparable to the test-retest reliabilities for the paper-pencil tests. Baseline test performance, retest interval, age, and education predicted test performance at visit 2 with baseline test performance being the strongest predictor for all outcome measures. For most outcome measures, both methods for the calculation of RCIs show agreement on whether or not a reliable change was observed.

CONCLUSIONS

RCIs for the digital tests enable clinicians to determine whether a measured change between assessments is due to real improvement or decline. Together, this contributes to the growing evidence for the clinical utility of the ISC platform.

Derivation of Indices of Cognitive Change Among Hispanic Adults and Elders

Importance

Determining the influence of race and ethnicity on change in cognitive test performance has significant implications for clinical practice and research in populations at risk for Alzheimer disease.

Objective

To evaluate the significance of race and ethnicity in predicting longitudinal cognitive test performance and to develop models to support evidence-based practice.

Design, Setting, and Participants

This prognostic study included baseline and 24-month follow-up data that were obtained from the Health and Aging Brain Study-Health Disparities (HABS-HD) study, an ongoing longitudinal observational study of aging and dementia in a multiracial, multiethnic cohort. Participants included community-dwelling adults and elders living in the Dallas and Fort Worth metropolitan area who were Hispanic and non-Hispanic adults older than the age of 50 years and were cognitively unimpaired.

Exposure

The primary exposure of interest was time, measured in months.

Main Outcomes and Measures

Demographic variables included age, sex, education, and race and ethnicity. Cognitive domains included attention and working memory, processing speed, language, memory, and executive functioning. Linear regression models predicted follow-up performance from baseline performance and demographic variables for 13 commonly used neuropsychological tests. Follow-up testing was the primary outcome for all domains. Raw scores from 13 standardized tests were used for analyses.

Results

This study included 799 adults who were cognitively unimpaired (352 Hispanic individuals [44.1%]; 447 non-Hispanic individuals [55.9%]; 524 female [65.6%]; mean [SD] age, 65.4 [8.1] years). In the regression models, all 13 follow-up scores were significantly predicted from their respective baseline scores and demographic variables. Baseline performance and education were the most consistent predictors of follow-up scores, contributing to all 13 models. Age was significantly associated with follow-up in 11 models, and sex was significant in 5 models. Race and ethnicity contributed to 10 of 13 models, with Hispanic participants predicted to have poorer follow-up scores than their non-Hispanic White counterparts on each test.

Conclusions and Relevance

In this longitudinal study of cognitive change in Hispanic and non-Hispanic older adults who were cognitively unimpaired, standardized regression-based models were influenced by multiple demographic variables, including race and ethnicity. These findings highlight the importance of including race and ethnicity in such cognitive change models. This ability to accurately predict cognitive change is expected to become increasingly important as clinical practice and clinical trials need to become more diverse and culturally appropriate in this burgeoning global medical and societal crisis.

Feasibility and reliability of online vs in-person cognitive testing in healthy older people

BACKGROUND

Early evidence in using online cognitive assessments show that they could offer a feasible and resource-efficient alternative to in-person clinical assessments in evaluating cognitive performance, yet there is currently little understanding about how these assessments relate to traditional, in-person cognitive tests.

OBJECTIVES

In this preliminary study, we assess the feasibility and reliability of NeurOn, a novel online cognitive assessment tool. NeurOn measures various cognitive domains including processing speed, executive functioning, spatial working memory, episodic memory, attentional control, visuospatial functioning, and spatial orientation.

DESIGN

Thirty-two participants (mean age: 70.19) completed two testing sessions, unsupervised online and in-person, one-week apart. Participants were randomised in the order of testing appointments. For both sessions, participants completed questionnaires prior to a cognitive assessment. Test-retest reliability and concurrent validity of the online cognitive battery was assessed using intraclass correlation coefficients (ICCs) and correlational analysis, respectively. This was conducted by comparing performance in repeated tasks across testing sessions as well as with traditional, in-person cognitive tests.

RESULTS

Global cognition in the NeurOn battery moderately validated against MoCA performance, and the battery demonstrated moderate test-retest reliability. Concurrent validity was found only between the online and paper versions of the Trail Making Test -A, as well as global cognitive performance between online and in-person testing sessions.

CONCLUSIONS

The NeurOn cognitive battery provides a promising tool for measuring cognitive performance online both longitudinally and across short retesting intervals within healthy older adults. When considering cost-effectiveness, flexible administration, and improved accessibility for wider populations, online cognitive assessments show promise for future screening of neurodegenerative diseases.

Misinterpreting cognitive change over multiple timepoints: When practice effects meet age-related decline

OBJECTIVE

Practice effects (PE) on cognitive testing have been shown to delay detection of impairment and impede our ability to assess change. When decline over time is expected, as with older adults or progressive diseases, failure to adequately address PEs may lead to inaccurate conclusions because PEs artificially boost scores while pathology- or age-related decline reduces scores. Unlike most methods, a participant-replacement approach can separate pathology- or age-related decline from PEs; however, this approach has only been used across two timepoints. More than two timepoints make it possible to determine if PEs level out after the first follow-up, but it is analytically challenging because individuals may not be assessed at every timepoint.

METHOD

We examined 1,190 older adults who were cognitively unimpaired (n = 809) or had mild cognitive impairment (MCI; n = 381). Participants completed six neuropsychological measures at three timepoints (baseline, 12-month, 24-month). We implemented a participant-replacement method using generalized estimating equations in comparisons of matched returnees and replacements to calculate PEs.

RESULTS

Without accounting for PEs, cognitive function appeared to improve or stay the same. However, with the participant-replacement method, we observed significant PEs within both groups at all timepoints. PEs did not uniformly decrease across time; some-specifically on episodic memory measures-continued to increase beyond the first follow-up.

CONCLUSION

A replacement method of PE adjustment revealed significant PEs across two follow-ups. As expected in these older adults, accounting for PEs revealed cognitive decline. This, in turn, means earlier detection of cognitive deficits, including progression to MCI, and more accurate characterization of longitudinal change. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Cognitive Safety Data from a Randomized, Double-Blind, Parallel-Group, Placebo-Controlled Phase IIb Study of the Effects of a Cannabidiol and Δ9-Tetrahydrocannabinol Drug on Parkinson's Disease-Related Motor Symptoms

BACKGROUND

Cannabis is increasingly available worldwide but its impact on cognition in Parkinson's disease (PD) is unknown.

OBJECTIVE

Present cognitive safety data from study of an oral high-dose cannabidiol (CBD; 100 mg) and low-dose Δ9-tetrahydocannabinol (THC; 3.3 mg) drug in PD.

METHODS

Randomized, double-blind, parallel-group, placebo-controlled study of a CBD/THC drug administered for 16.3 (SD: 4.2) days, with dosage escalating to twice per day. Neuropsychological tests were administered at baseline and 1-1½ hours after final dose; scores were analyzed with longitudinal regression models (alpha = 0.05). Cognitive adverse events were collected.

RESULTS

When adjusted for age and education, the CBD/THC group (n = 29) performed worse than the placebo group (n = 29) on Animal Verbal Fluency. Adverse cognitive events were reported at least twice as often by the CBD/THC than the placebo group.

CONCLUSION

Data suggest this CBD/THC drug has a small detrimental effect on cognition following acute/short-term use in PD. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Cognitive trajectories during and after electroconvulsive therapy in patients with MDE: Taking different perspectives

Cognitive function during an ECT care pathway is mainly investigated at the group level by analyzing mean cognitive test scores over time. However, there are important inter-individual differences, with some patients experiencing residual invalidating cognitive deficits. This study provides a nuanced examination of cognitive functioning during and after ECT by combining three approaches for data analysis. A cognitive test battery was assessed in seventy-three ECT-treated patients with a Major Depressive Episode (MDE) at up to five time points (baseline, immediately prior to the third session and 1 week, 3 months and 6 months after completion of the index course). Group-level changes in cognitive function were investigated using linear mixed models and individual-level changes were examined using Reliable Change Indices (RCI). The presence of patient subgroups with similar cognitive trajectories was explored using Latent Class Growth Analysis (LCGA). At the group level, there was a temporary deterioration in processing speed, verbal memory and retrograde amnesia during and after index course of ECT. Individual-level analyses revealed considerable variability in cognitive effects of ECT. Three patient classes with a similar cognitive trajectory could be identified, all with a rather parallel courses over time, thus mainly differing in terms of pre-ECT cognitive functioning.

Cardiovascular risk in subjects over 55 years of age and cognitive performance after five years. NEDICES2-RISK study. Study protocol

BACKGROUND

Cognitive impairment and dementia have a high prevalence among the elderly and cause significant socio-economic impact. Any progress in their prevention can benefit millions of people. Current data indicate that cardiovascular risk (CVR) factors increase the risk of developing cognitive impairment and dementia. Using models to calculate CVR specific for the Spanish population can be useful for estimating the risk of cognitive deterioration since research on this topic is limited and predicting this risk is mainly based on outcomes in the Anglo-Saxon population. The aim of this study is to assess the relationship between CVR in the Spanish population, as calculated using the FRESCO (Función de Riesgo Española de acontecimientos Coronarios y Otros) and REGICOR (Registre Gironí del Cor) CVR tables, and the change in cognitive performance at a 5-year follow-up.

METHODS

Design: Observational, analytic, prospective cohort study, with a 5-year follow-up. Ambit: Population. Population: Subjects 55 to 74 years of age, included in the NEDICES2 (2014-2017) cohort, who did not present dementia and had undergone the neuropsychological evaluation (N = 962). Variables: Exposure factors (CVR factors and estimated risk according to the CVR predictors by REGICOR and FRESCO), dependent variables (change in the score of the brief neuropsychological test in the study NEDICES2 five years after the first evaluation), and clinical and socio-demographic variables. Statistical analysis: Analysis of data quality. Descriptive analysis: socio-demographic and clinical variables of subjects. Bivariate analysis: relationship between basal CVR and change in neuropsychological tests. Multivariate analysis: relationship between basal CVR and change in neuropsychological tests adjusted by co-variables. Analysis and comparison of the reliable change in independent samples.

DISCUSSION

The Spanish population can benefit from determining if individuals with high CVR, which is commonly detected in usual clinical practice, will present decreased cognitive performance compared to subjects with lower CVR. This study can affect how to address CVR factors and the design of effective prevention strategies for cognitive deterioration.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT03925844.

Validation of one-year reliable change in the RBANS for community-dwelling older adults with amnestic mild cognitive impairment

Objective: The current study sought to externally validate previously published standardized regression-based (SRB) equations for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Indexes administered twice over a one-year period. Method: Hammers and colleagues' SRB prediction equations were applied to two independent samples of community-dwelling older adults with amnestic Mild Cognitive Impairment (MCI), including those recruited from the community (n = 64) and those recruited from a memory disorders clinic (n = 58). Results: While Observed Baseline and Observed Follow-up performances were generally comparable for both MCI samples over one year, both samples possessed significantly lower Observed One-Year Follow-up scores than were predicted based on Hammers and colleagues' development sample across many RBANS Indexes. Relatedly, both amnestic MCI samples possessed a greater percentage of participants either "declining" or failing to exhibit a long-term practice effect over one year relative to expectation across most Indexes. Further, the clinic-recruited amnestic MCI sample displayed worse baseline performances, smaller long-term practice effects, and greater proportions of individual participants exhibiting a decline across one year relative to the community amnestic MCI sample. Conclusions: These findings validate Hammers and colleagues' SRB prediction equations by (1) indicating their ability to identify clinically meaningful change across RBANS Indexes in independent samples, and (2) discriminating rates of cognitive change among cognitively nuanced samples.

Logistic versus linear regression-based reliable change index: A simulation study with implications for clinical studies with different sample sizes

The linear regression-based reliable change index (RCI) is widely used to identify memory impairments through longitudinal assessment. However, the minimum sample size required for estimates to be reliable has never been specified. Using data from 920 participants from the Alzheimer's Disease Neuroimaging Initiative data as true parameters, we run 12,000 simulations for samples of size 10-1,000 and analyzed the percentage of times the estimates are significant, their coverage rate, and the accuracy of the models including both the true-positive rate and the true-negative rate. We compared the linear RCI with a logistic RCI for discrete, bounded scores. We found that the logistic RCI is more accurate than the linear RCI overall, with the linear RCI approximating the logistic RCI for samples of size 200 or greater. We provide an R package to compute the logistic RCI, which can be downloaded from the Comprehensive R Archive Network (CRAN) at https://cran.r-project.org/web/packages/LogisticRCI/, and the code to reproduce all results in this article at https://github.com/rafamoral/LogisticRCIpaper/. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Cognitive outcomes are differentially associated with depression severity trajectories during psychotherapy treatment for late life major depressive disorder

OBJECTIVES

Late Life Depression (LLD) is associated with persistent cognitive dysfunction even after depression symptoms improve. The present study was designed to examine cognitive outcomes associated with the pattern of depression severity change during psychotherapy intervention for LLD.

METHODS

96 community-dwelling adults ages 65-91 with major depressive disorder completed 12 sessions of Problem-Solving Therapy at the University of California, San Francisco. Nonlinear trajectories of depression severity ratings using the Hamilton Depression Rating Scale were computed from multiple time points collected throughout the weekly psychotherapy intervention. Performance on measures of cognition (information processing speed, executive functioning, verbal learning, memory) was assessed at baseline and post-treatment. Linear mixed-effects models examined associations between nonlinear depression severity trajectories and post-treatment change in cognitive performance.

RESULTS

Broadly, different patterns of depression change during treatment were associated with improved cognition post-treatment. Greater and more consistent interval improvements in depression ratings were differentially associated with improvements in aspects of verbal learning, memory, and executive function post-treatment, while no associations were found with information processing speed.

CONCLUSIONS

The heterogeneity of depression trajectories associated with improved cognitive outcomes suggests that the temporal pattern of depression response may impact specific cognitive processes distinctly. Results suggest that use of nonlinear depression severity trajectories may help to elucidate complex associations between the time course of depression response and cognitive outcomes of psychotherapy in LLD. These findings have important implications for identifying treatment targets to enhance clinical and cognitive outcomes of psychotherapy in LLD.

Update on the Cognitive Presentations of iNPH for Clinicians

This mini-review focuses on cognitive impairment in iNPH. This symptom is one of the characteristic triad of symptoms in a condition long considered to be the only treatable dementia. We present an update on recent developments in clinical, neuropsychological, neuroimaging and biomarker aspects. Significant advances in our understanding have been made, notably regarding biomarkers, but iNPH remains a difficult diagnosis. Stronger evidence for permanent surgical treatment is emerging but selection for treatment remains challenging, particularly with regards to cognitive presentations. Encouragingly, there has been increasing interest in iNPH, but more research is required to better define the underlying pathology and delineate it from overlapping conditions, in order to inform best practise for the clinician managing the cognitively impaired patient. In the meantime, we strongly encourage a multidisciplinary approach and a structured service pathway to maximise patient benefit.

Practice Effects in Mild Cognitive Impairment Increase Reversion Rates and Delay Detection of New Impairments

Objective

Cognitive practice effects (PEs) can delay detection of progression from cognitively unimpaired to mild cognitive impairment (MCI). They also reduce diagnostic accuracy as suggested by biomarker positivity data. Even among those who decline, PEs can mask steeper declines by inflating cognitive scores. Within MCI samples, PEs may increase reversion rates and thus impede detection of further impairment. Within an MCI sample at baseline, we evaluated how PEs impact prevalence, reversion rates, and dementia progression after 1 year.

Methods

We examined 329 baseline Alzheimer's Disease Neuroimaging Initiative MCI participants (mean age = 73.1; SD = 7.4). We identified test-naïve participants who were demographically matched to returnees at their 1-year follow-up. Since the only major difference between groups was that one completed testing once and the other twice, comparison of scores in each group yielded PEs. PEs were subtracted from each test to yield PE-adjusted scores. Biomarkers included cerebrospinal fluid phosphorylated tau and amyloid beta. Cox proportional models predicted time until first dementia diagnosis using PE-unadjusted and PE-adjusted diagnoses.

Results

Accounting for PEs increased MCI prevalence at follow-up by 9.2% (272 vs. 249 MCI), and reduced reversion to normal by 28.8% (57 vs. 80 reverters). PEs also increased stability of single-domain MCI by 12.0% (164 vs. 147). Compared to PE-unadjusted diagnoses, use of PE-adjusted follow-up diagnoses led to a twofold increase in hazard ratios for incident dementia. We classified individuals as false reverters if they reverted to cognitively unimpaired status based on PE-unadjusted scores, but remained classified as MCI cases after accounting for PEs. When amyloid and tau positivity were examined together, 72.2% of these false reverters were positive for at least one biomarker.

Interpretation

Even when PEs are small, they can meaningfully change whether some individuals with MCI retain the diagnosis at a 1-year follow-up. Accounting for PEs resulted in increased MCI prevalence and altered stability/reversion rates. This improved diagnostic accuracy also increased the dementia-predicting ability of MCI diagnoses.

Assessing and validating reliable change across ADNI protocols

OBJECTIVE

Reliable change methods can aid in determining whether changes in cognitive performance over time are meaningful. The current study sought to develop and cross-validate 12-month standardized regression-based (SRB) equations for the neuropsychological measures commonly administered in the Alzheimer's Disease Neuroimaging Initiative (ADNI) longitudinal study.

METHOD

Prediction algorithms were developed using baseline score, retest interval, the presence/absence of a 6-month evaluation, age, education, sex, and ethnicity in two different samples (n = 192 each) of robustly cognitively intact community-dwelling older adults from ADNI - matched for demographic and testing factors. The developed formulae for each sample were then applied to one of the samples to determine goodness-of-fit and appropriateness of combining samples for a single set of SRB equations.

RESULTS

Minimal differences were seen between Observed 12-month and Predicted 12-month scores on most neuropsychological tests from ADNI, and when compared across samples the resultant Predicted 12-month scores were highly correlated. As a result, samples were combined and SRB prediction equations were successfully developed for each of the measures.

CONCLUSIONS

Establishing cross-validation for these SRB prediction equations provides initial support of their use to detect meaningful change in the ADNI sample, and provides the basis for future research with clinical samples to evaluate potential clinical utility. While some caution should be considered for measuring true cognitive change over time - particularly in clinical samples - when using these prediction equations given the relatively lower coefficients of stability observed, use of these SRBs reflects an improvement over current practice in ADNI.

Cognitive practice effects delay diagnosis of MCI: Implications for clinical trials

INTRODUCTION

Practice effects (PEs) on cognitive tests obscure decline, thereby delaying detection of mild cognitive impairment (MCI). Importantly, PEs may be present even when there are performance declines, if scores would have been even lower without prior test exposure. We assessed how accounting for PEs using a replacement-participants method impacts incident MCI diagnosis.

METHODS

Of 889 baseline cognitively normal (CN) Alzheimer's Disease Neuroimaging Initiative (ADNI) participants, 722 returned 1 year later (mean age = 74.9 ± 6.8 at baseline). The scores of test-naïve demographically matched "replacement" participants who took tests for the first time were compared to returnee scores at follow-up. PEs-calculated as the difference between returnee follow-up scores and replacement participants scores-were subtracted from follow-up scores of returnees. PE-adjusted cognitive scores were then used to determine if individuals were below the impairment threshold for MCI. Cerebrospinal fluid amyloid beta, phosphorylated tau, and total tau were used for criterion validation. In addition, based on screening and recruitment numbers from a clinical trial of amyloid-positive individuals, we estimated the effect of earlier detection of MCI by accounting for cognitive PEs on a hypothetical clinical trial in which the key outcome was progression to MCI.

RESULTS

In the ADNI sample, PE-adjusted scores increased MCI incidence by 19% (P < .001), increased proportion of amyloid-positive MCI cases (+12%), and reduced proportion of amyloid-positive CNs (-5%; P's < .04). Additional calculations showed that the earlier detection and increased MCI incidence would also substantially reduce necessary sample size and study duration for a clinical trial of progression to MCI. Cost savings were estimated at ≈$5.41 million.

DISCUSSION

Detecting MCI as early as possible is of obvious importance. Accounting for cognitive PEs with the replacement-participants method leads to earlier detection of MCI, improved diagnostic accuracy, and can lead to multi-million-dollar cost reductions for clinical trials.

Association Between Motor Task Performance and Hippocampal Atrophy Across Cognitively Unimpaired, Amnestic Mild Cognitive Impairment, and Alzheimer's Disease Individuals

Hippocampal atrophy is a widely used biomarker for Alzheimer's disease (AD), but the cost, time, and contraindications associated with magnetic resonance imaging (MRI) limit its use. Recent work has shown that a low-cost upper extremity motor task has potential in identifying AD risk. Fifty-four older adults (15 cognitively unimpaired, 24 amnestic mild cognitive impairment, and 15 AD) completed six motor task trials and a structural MRI. Several measures of motor task performance significantly predicted bilateral hippocampal volume, controlling for age, sex, education, and memory. Thus, this motor task may be an affordable, non-invasive screen for AD risk and progression.

Validation of one-week reliable change methods in cognitively intact community-dwelling older adults

OBJECTIVE

Reliable change methods can assist the determination of whether observed changes in performance are meaningful. The current study sought to validate previously published standardized regression-based (SRB) equations for commonly administered cognitive tests using a cognitively intact sample of older adults, and extend findings by including relevant demographic and test-related variables known to predict cognitive performance. Method: This study applied previously published SRB prediction equations to 107 cognitively intact older adults assessed twice over one week. Prediction equations were also updated by pooling the current validation sample with 93 cognitively intact participants from original development sample to create a combined development sample. Results: Significant improvements were seen between observed baseline and follow-up scores on most measures. However, few differences were seen between observed follow-up scores and those predicted from these SRB algorithms, and the level of practice effects observed based on these equations were consistent with expectations. When SRBs were re-calculated from this combined development sample, predicted follow-up scores were mostly comparable with these equations, but standard errors of the estimate were consistently smaller. Conclusions: These results help support the validity of of these SRB equations to predict cognitive performance on these measures when repeated administration is necessary over short intervals. Findings also highlight the utility of expanding SRB models when predicting follow-up performance serially to provide more accurate assessment of reliable change at the level of the individual. As short-term practice effects are shown to predict cognitive performance annually, they possess the potential to inform clinical decision-making about individuals along the Alzheimer's continuum.

Reliable change in cognition over 1 week in community-dwelling older adults: a validation and extension study

OBJECTIVE

Reliable change methods can aid neuropsychologists in understanding if performance differences over time represent clinically meaningful change or reflect benefit from practice. The current study sought to externally validate the previously published standardized regression-based (SRB) prediction equations developed by Duff for commonly administered cognitive measures.

METHOD

This study applied Duff's SRB prediction equations to an independent sample of community-dwelling participants with amnestic mild cognitive impairment (MCI) assessed twice over a 1-week period. A comparison of MCI subgroups (e.g., single v. multi domain) on the amount of change observed over 1 week was also examined.

RESULTS

Using pairwise t-tests, large and statistically significant improvements were observed on most measures across 1 week. However, the observed follow-up scores were consistently below expectation compared with predictions based on Duff's SRB algorithms. In individual analyses, a greater percentage of MCI participants showed smaller-than-expected practice effects based on normal distributions. In secondary analyses, smaller-than-expected practice effects were observed in participants with worse baseline memory impairment and a greater number of impaired cognitive domains, particularly for measures of executive functioning/speeded processing.

CONCLUSIONS

These findings help to further support the validity of Duff's 1-week SRB prediction equations in MCI samples and extend previous research by showing incrementally smaller-than-expected benefit from practice for increasingly impaired amnestic MCI subtypes.

Application of Different Standard Error Estimates in Reliable Change Methods

OBJECTIVE

This study attempted to clarify the applicability of standard error (SE) terms in clinical research when examining the impact of short-term practice effects on cognitive performance via reliable change methodology.

METHOD

This study compared McSweeney's SE of the estimate (SEest) to Crawford and Howell's SE for prediction of the regression (SEpred) using a developmental sample of 167 participants with either normal cognition or mild cognitive impairment (MCI) assessed twice over 1 week. One-week practice effects in older adults: Tools for assessing cognitive change. Using these SEs, previously published standardized regression-based (SRB) reliable change prediction equations were then applied to an independent sample of 143 participants with MCI.

RESULTS

This clinical developmental sample yielded nearly identical SE values (e.g., 3.697 vs. 3.719 for HVLT-R Total Recall SEest and SEpred, respectively), and the resultant SRB-based discrepancy z scores were comparable and strongly correlated (r = 1.0, p < .001). Consequently, observed follow-up scores for our sample with MCI were consistently below expectation compared to predictions based on Duff's SRB algorithms.

CONCLUSIONS

These results appear to replicate and extend previous work showing that the calculation of the SEest and SEpred from a clinical sample of cognitively intact and MCI participants yields similar values and can be incorporated into SRB reliable change statistics with comparable results. As a result, neuropsychologists utilizing reliable change methods in research investigation (or clinical practice) should carefully balance mathematical accuracy and ease of use, among other factors, when determining which SE metric to use.

Connectome-based prediction of global cognitive performance in people with HIV

•

Networks strengths predicted global cognitive performance in PWH.

•

Model generalized to data from an independent PWH sample.

•

Network strengths in PWH with HAND were different from either controls or PWH without HAND.

•

Network strengths may serve as a potential biomarker to assist HAND diagnosis.

Global cognitive performance plays an important role in the diagnosis of HIV-associated neurocognitive disorders (HAND), yet to date, there is no simple way to measure global cognitive performance in people with HIV (PWH). Here, we performed connectome-based predictive modeling (CPM) to pursue a neural biomarker of global cognitive performance in PWH based on whole-brain resting-state functional connectivity. We built a CPM model that successfully predicted individual differences in global cognitive performance in the training set of 67 PWH by using leave-one-out cross-validation. This model generalized to both 33 novel PWH in the testing set and a subset of 39 PWH who completed a follow-up visit two years later. Furthermore, network strengths identified by the CPM model were significantly different between PWH with HAND and without HAND. Together, these results demonstrate that whole-brain functional network strengths could serve as a potential neural biomarker of global cognitive performance in PWH.

Cognitive-Postural Multitasking Training in Older Adults - Effects of Input-Output Modality Mappings on Cognitive Performance and Postural Control

Older adults exhibit impaired cognitive and balance performance, particularly under multi-task conditions, which can be improved through training. Compatibility of modality mappings in cognitive tasks (i.e., match between stimulus modality and anticipated sensory effects of motor responses), modulates physical and cognitive dual-task costs. However, the effects of modality specific training programs have not been evaluated yet. Here, we tested the effects of cognitive-postural multi-tasking training on the ability to coordinate task mappings under high postural demands in healthy older adults. Twenty-one adults aged 65-85 years were assigned to one of two groups. While group 1 performed cognitive-postural triple-task training with compatible modality mappings (i.e., visual-manual and auditory-vocal dual n-back tasks), group 2 performed the same tasks with incompatible modality mappings (i.e., visual-vocal and auditory-manual n-back tasks). Throughout the 6-weeks balance training intervention, working-memory load was gradually increased while base-of-support was reduced. Before training (T0), after a 6-week passive control period (T1), and immediately after the intervention (T2), participants performed spatial dual one-back tasks in semi-tandem stance position. Our results indicate improved working-memory performance and reduced dual-task costs for both groups after the passive control period, but no training-specific performance gains. Furthermore, balance performance did not improve in response to training. Notably, the cohort demonstrated meaningful interindividual variability in training responses. Our findings raise questions about practice effects and age-related heterogeneity of training responses following cognitive-motor training. Following multi-modal balance training, neither compatible nor incompatible modality mappings had an impact on the observed outcomes.

Cognitive Practice Effects Delay Diagnosis; Implications for Clinical Trials

OBJECTIVE

Practice effects on cognitive tests obscure decline, thereby delaying detection of mild cognitive impairment (MCI). This reduces opportunities for slowing Alzheimer's disease progression and can hinder clinical trials. Using a novel method, we assessed the ability of practice-effect-adjusted diagnoses to detect MCI earlier, and tested the validity of these diagnoses based on AD biomarkers.

METHODS

Of 889 Alzheimer's Disease Neuroimaging Initiative participants who were cognitively normal (CN) at baseline, 722 returned at 1-year-follow-up (mean age=74.9±6.8). Practice effects were calculated by comparing returnee scores at follow-up to demographically-matched individuals who had only taken the tests once, with an additional adjustment for attrition effects. Practice effects for each test were subtracted from follow-up scores. The lower scores put additional individuals below the impairment threshold for MCI. CSF amyloid-beta, phosphorylated tau, and total tau were measured at baseline and used for criterion validation.

RESULTS

Practice-effect-adjusted scores increased MCI incidence by 26% (p<.001). Adjustment increased proportions of amyloid-positive MCI cases (+20%) and reduced proportions of amyloid-positive CNs (-6%) (ps<.007). With the increased MCI base rate, adjustment for practice effects would reduce the sample size needed for detecting significant drug treatment effects by an average of 21%, which we demonstrate would result in multi-million-dollar savings in a clinical trial.

INTERPRETATION

Adjusting for practice effects on cognitive testing leads to earlier detection of MCI. When MCI is an outcome, this reduces recruitment needed for clinical trials, study duration, staff and participant burden, and can dramatically lower costs. Importantly, biomarker evidence also indicates improved diagnostic accuracy.

Lower practice effects as a marker of cognitive performance and dementia risk: A literature review

BACKGROUND

Practice effects (PEs) are improvements in performance after repeated exposure to test materials, and typically viewed as a source of bias in repeated cognitive assessments. We aimed to determine whether characterizing PEs could also provide a useful marker of early cognitive decline.

METHODS

We conducted a systematic review of the literature, searching PsycInfo (Ebsco) and PubMed databases for articles studying PEs in aging and dementia populations. Articles published between 1920 and 2019 were included.

RESULT

We identified 259 articles, of which 27 studied PEs as markers of cognitive performance. These studies consistently showed that smaller, less-robust PEs were associated with current diagnostic status and/or future cognitive decline. In addition, lower PEs were associated with Alzheimer's disease risk factors and neurodegeneration biomarkers.

CONCLUSION

PEs provide a potentially useful marker of cognitive decline, and could prove valuable as part of a cost-effective strategy to select individuals who are at-risk for dementia for future interventions.

Clinical outcomes of normal pressure hydrocephalus in 116 patients: objective versus subjective assessment

OBJECTIVE

Objective assessment tests are commonly used to predict the response to ventriculoperitoneal (VP) shunting in patients with normal pressure hydrocephalus (NPH). Whether subjective reports of improvement after a lumbar drain (LD) trial can predict response to VP shunting remains controversial. The goal in this study was to compare clinical characteristics, complication rates, and shunt outcomes of objective and subjective LD responders who underwent VP shunt placement.

METHODS

This was a retrospective review of patients with NPH who underwent VP shunt placement after clinical improvement with the LD trial. Patients who responded after the LD trial were subclassified into objective LD responders and subjective LD responders. Clinical characteristics, complication rates, and shunt outcomes between the 2 groups were compared with chi-square test of independence and t-test.

RESULTS

A total of 116 patients received a VP shunt; 75 were objective LD responders and 41 were subjective LD responders. There was no statistically significant difference in patient characteristics between the 2 groups, except for a shorter length of stay after LD trial seen with subjective responders. The complication rates after LD trial and VP shunting were not significantly different between the 2 groups. Similarly, there was no significant difference in shunt response between objective and subjective LD responders. The mean duration of follow-up was 1.73 years.

CONCLUSIONS

Reports of subjective improvement after LD trial in patients with NPH can be a reliable predictor of shunt response. The currently used objective assessment scales may not be sensitive enough to detect subtle changes in symptomatology after LD trial.

Generalizability of reliable change equations for the RBANS over one year in community-dwelling older adults

Objective: Reliable change methods can assist neuropsychologists in determining whether observed changes in a patient's performance are clinically meaningful. The current study sought to validate previously published standardized regression-based (SRB) equations for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Indexes and subtests.Methods: Duff and colleagues's SRB prediction equations, developed from 223 cognitively intact primary care patients, were applied to an independent sample of robustly cognitively intact (n = 129) community-dwelling older adults assessed with the RBANS twice over a one-year period.Results: Results suggest that the cognitively intact participants in the current validation sample possessed significantly better Observed Follow-up scores than was predicted based on Duff's developmental sample across most RBANS Indexes and many RBANS subtests, though significantly lower Observed Follow-up scores were observed for the Visuospatial/Constructional Index than was predicted. As a result of these findings, the current study calculated updated prediction algorithms for the RBANS Index and subtest scores from the sample of 129 cognitively intact participants.Conclusions: Duff's 2004 and 2005 SRB prediction equations for the RBANS Index and subtest scores failed to generalize to a sample of cognitively intact community-dwelling participants recruited from senior living centers and independent assisted living facilities. These updated SRB prediction equations - being developed from a more medically "clean" sample of cognitively intact older adults who remained stable over 12 months - have the potential to provide a more accurate assessment of reliable change in an individual patient.

Reliable change indices for the 37-item version of the MMSE in Spanish older adults

OBJECTIVE

The aim of this study was to establish reliable change and regression-based change score norms on the 37-item version of MMSE in older Spanish adults at the three-year follow-up.

METHOD

All subjects of this research were selected from the Neurological Disorders in Central Spain (NEDICES), a prospective population-based cohort study of older adults (65 years and over). Of the 4208 individuals free from neurological disorders in this cohort, 2073 participants completed the MMSE-37 at baseline and at the three-year follow-up. Reliable Change Indices were computed for the 80, 90% and 95 confidence intervals (CIs). Multiple regression analyses were used to derive equations for predicting MMSE-37 post-test scores taking into account baseline scores, time to follow-up and sociodemographic factors.

RESULTS

The MMSE-37 obtained a marginal test-retest reliability (.70). The results showed significant effects of education, age, and sex on the MMSE-37 change scores. After correcting for regression to the mean, at least a 6-point change on MMSE-37 (three-years follow-up) is required to be classified as reliable (90% CI).

CONCLUSIONS

These findings demonstrate that the MMSE-37 is a reliable test-retest measure whose change scores are significantly influenced by sociodemographic factors. Importantly, small changes on this measure require a cautious interpretation.

Effect of fine and gross motor training or motor imagery, delivered via novel or routine modes, on cognitive function

There is extensive literature linking motor activity to cognitive effects at various stages in life, promoting both development and the reduction of aging associated pathologies. It is unclear whether the benefits of this activity on the cognitive level are associated with brain functions that are necessary for their performance or recurrence of activity or type of activity itself. The aim of this study was to evaluate whether the type of motor activity (fine, gross, and motor imagery) in two modes (novel and routine) can affect cognitive functions such as attention, executive functions, and praxis in college students. A 2 × 3 factorial design with repeated measures was used without a control group and pre- and post-training evaluation. Fifty-three young people (14 men and 39 women) participated, with mean age of 18.94 years (SD = 1.61 years) and were divided into six groups. Each of the groups performed relevant training 20 minutes per day for five days depending on the group. Measures were taken pre and post-training for attention tests, attention span, working memory, visual constructive skills, procedural memory, and motor skills. The results show a "learning effect" from the exposure to the tests in measurements after training. It was also found that between groups, there is a difference in some of the variables of procedural memory (number of errors) and working memory. More extensive training could better reflect the effects of the training, and longitudinal evaluation could show the rate of change of functions. The main clinical implication could be the evaluation of training programs for recovery and motor training in cerebral plasticity having effect on the cognitive aspects.

Short-term repeat cognitive testing and its relationship to hippocampal volumes in older adults

BACKGROUND

Practice effects are improvements in cognitive test scores due to repeated exposure to testing materials. If practice effects provide information about Alzheimer's disease pathology, then they could be useful for clinical trials enrichment. The current study sought to add to the limited literature on short-term practice effects on cognitive tests and their relationship to neuroimaging biomarkers.

METHODS

Twenty-five, non-demented older adults (8 cognitively intact, 17 with mild cognitive impairment) received magnetic resonance imaging and two testing sessions across one week to determine practice effects on seven neuropsychological test scores. A series of correlations examined if hippocampal volume was associated with baseline, one-week, or practice effects scores on these tests. Next, a series of stepwise multiple regression models examined which of the three test scores best predicted hippocampal volumes RESULTS: In the correlation analysis, baseline scores on 5 of the 7 tests were significantly associated with hippocampal volumes, one week scores were significantly related for 7 of the 7 tests, and practice effects scores were significantly correlated for 4 of the 7 tests. In the stepwise regression models, 5 of the 7 tests indicated that one-week scores best predicted hippocampal volumes. For the other models, baseline score and practice effects score each best predicted hippocampal volume.

CONCLUSIONS

These results add to the growing body of evidence suggesting that diminished practice effects on short-term repeat testing is related to neuroimaging biomarkers of Alzheimer's disease and may serve as a screening tool for clinical practice and to enrich samples for research trials.

External validation of change formulae in neuropsychology with neuroimaging biomarkers: A methodological recommendation and preliminary clinical data

OBJECTIVE

Within neuropsychology, a number of mathematical formulae (e.g. reliable change index, standardized regression based) have been used to determine if change across time has reliably occurred. When these formulae have been compared, they often produce different results, but 'different' results do not necessarily indicate which formulae are 'best.' The current study sought to further our understanding of change formulae by comparing them to clinically relevant external criteria (amyloid deposition and hippocampal volume).

METHOD

In a sample of 25 older adults with varying levels of cognitive intactness, participants were tested twice across one week with a brief cognitive battery. Seven different change scores were calculated for each participant. An amyloid PET scan (to get a composite of amyloid deposition) and an MRI (to get hippocampal volume) were also obtained.

RESULTS

Deviation-based change formulae (e.g. simple discrepancy score, reliable change index with or without correction for practice effects) were all identical in their relationship to the two neuroimaging biomarkers, and all were non-significant. Conversely, regression-based change formulae (e.g. simple and complex indices) showed stronger relationships to amyloid deposition and hippocampal volume.

CONCLUSIONS

These results highlight the need for external validation of the various change formulae used by neuropsychologists in clinical settings and research projects. The findings also preliminarily suggest that regression-based change formulae may be more relevant than deviation-based change formulae in this context.

Within-session and one-week practice effects on a motor task in amnestic mild cognitive impairment

Practice effects on neuropsychological tests, which are improvements in test scores due to repeated exposure to testing materials, are robust in healthy elders, but muted in older adults with cognitive disorders. Conversely, few studies have investigated practice effects on motor tasks involving procedural memory, particularly across test-retest periods exceeding 24 hours. The current study examined one-week practice effects on a novel upper extremity motor task in 54 older adults with amnestic mild cognitive impairment. Results indicate that these individuals with primary memory deficits did improve on this motor task within a brief training session as well as across one week. These practice effects were unrelated to demographic characteristics or global cognition. One-week practice effects were, however, negatively related to delayed memory function, with larger practice effects being associated with poorer delayed memory and potentially better visuospatial ability. The presence of longer term practice effects on a procedural motor task not only has implications for how longitudinal assessments with similar measures involving implicit memory might be interpreted, but may also inform future rehabilitative strategies for patients with more severe declarative memory deficits.

Short-term practice effects in mild cognitive impairment: Evaluating different methods of change

Practice effects are improvements on cognitive tests as a result of repeated exposure to testing material. However, variability exists in the literature about whether patients with amnestic mild cognitive impairment (MCI) display practice effects, which may be partially due to the methods used to calculate these changes on repeated tests. The purpose of the current study was to examine multiple methods of assessing short-term practice effects in 58 older adults with MCI. The cognitive battery, which included tests of memory (Hopkins Verbal Learning Test-Revised and Brief Visuospatial Memory Test-Revised) and processing speed (Symbol Digit Modalities Test and Trail Making Test Parts A and B), was administered twice across one week. Dependent t tests showed statistically significant improvement on memory scores (ps < .01, ds = 0.8-1.3), but not on processing speed scores. Despite this, the sample showed no clinically meaningful improvement on any cognitive scores using three different reliable change indices. Regression-based change scores did identify relatively large groups of participants who showed smaller than expected practice effects, which may indicate that this method is more sensitive in identifying individuals who may portend a declining trajectory. Practice effects remain a complex construct, worthy of continued investigation in diverse clinical conditions.

Clarifying Discrepancies in Responsiveness Between Reliable Change Indices

OBJECTIVE

Several reliable change indices (RCIs) exist to evaluate statistically significant individual change with repeated neuropsychological assessment. Yet there is little guidance on model selection and subsequent implications. Using existing test-retest norms, key parameters were systematically evaluated for influence on different RCI models.

METHOD

Normative test-retest data for selected Wechsler Memory Scale-IV subtests were chosen based on the direction and magnitude of differential practice (inequality of test and retest variance). The influence of individual relative position compared to the normative mean was systematically manipulated to evaluate for predictable differences in responsiveness for three RCI models.

RESULTS

With respect to negative change, RCI McSweeny was most responsive when individual baseline scores were below the normative mean, irrespective of differential practice. When an individual score was greater than the normative mean, RCI Chelune was most responsive with lower retest variance, and RCI Maassen most responsive with greater retest variance. This pattern of results can change when test-retest reliability is excellent and there is greater retest variability. Order of responsiveness is reversed if positive change is of interest.

CONCLUSION

RCI models tend to agree when the individual approximates the normative mean at baseline and test-retest variability is equal. However, no RCI model will be universally more or less responsive across all conditions, and model selection may influence subsequent interpretation of change. Given the systematic and predictable differences between models, a more rationale choice can now be made. While a consensus on RCI model preference does not exist, we prefer the regression-based model for several reasons outlined.

Short-Term Practice Effects and Brain Hypometabolism: Preliminary Data from an FDG PET Study

Practice effects are improvements in cognitive test scores due to repeated exposure to the same tests. Typically viewed as error, short-term practice effects have been shown to provide valuable clinical information about diagnosis, prognosis, and treatment outcomes in older patients with mild cognitive impairments. This study examined short-term practice effects across one week and brain hypometabolism on fluoro-2-deoxyglucose (FDG) positron emission tomography (PET) in 25 older adults (15 intact, 10 Mild Cognitive Impairment). Averaged cerebral brain metabolism on FDG PET was correlated with multiple cognitive scores at baseline in those with Mild Cognitive Impairment, and short-term practice effects accounted for additional variance in these same subjects. The relationship between brain metabolism and cognition (either at baseline or practice effects) was minimal in the intact individuals. Although needing replication in larger samples, short-term practice effects on tests of executive functioning and memory may provide valuable information about biomarkers of Alzheimer's disease.

Test-retest reliability analysis of the Cambridge Neuropsychological Automated Tests for the assessment of dementia in older people living in retirement homes

The validity of the Cambridge Neuropsychological Automated Tests has been widely studied, but their reliability has not. This study aimed to estimate the test-retest reliability of these tests in a sample of 34 older adults, aged 69 to 90 years old, without neuropsychiatric diagnoses and living in retirement homes in the district of Lisbon, Portugal. The battery was administered twice, with a 4-week interval between sessions. The Paired Associates Learning (PAL), Spatial Working Memory (SWM), Rapid Visual Information Processing, and Reaction Time tests revealed measures with high-to-adequate test-retest correlations (.71-.89), although several PAL and SWM measures showed susceptibility to practice effects. Two estimated standardized regression-based methods were found to be more efficient at correcting for practice effects than a method of fixed correction. We also found weak test-retest correlations (.56-.68) for several measures. These results suggest that some, but not all, measures are suitable for cognitive assessment and monitoring in this population.

Cognitive Effects of Hormone Therapy Continuation or Discontinuation in a Sample of Women at Risk for Alzheimer Disease

OBJECTIVE

Use of estrogen-based hormone therapy (HT) as a protection from cognitive decline and Alzheimer disease (AD) is controversial, although cumulative data support HT use when initiated close to menopause onset with estrogen formulations containing 17β-estradiol preferable to conjugated equine estrogen formulations. Little is known regarding specific populations of women who may derive benefit from HT.

METHODS

Women with heightened risk for AD (aged 49-69), all of whom were taking HT for at least 1 year and most of whom initiated HT close to menopause onset, underwent cognitive assessment followed by randomization to continue or discontinue HT. Assessments were repeated at 2 years after randomization.

RESULTS

Women who continued HT performed better on cognitive domains composed of measures of verbal memory and combined attention, working memory, and processing speed measures. Women who used 17β-estradiol versus conjugated equine estrogen, whether randomized to continue or discontinue HT, showed better verbal memory performance at the 2-year follow-up assessment. An interaction was also found with HT randomization and family history of AD in a first-degree relative. All female offspring of patients with AD declined in verbal memory; however, women who continued HT declined less than women who discontinued HT. Women without a first-degree relative with AD showed verbal memory improvement (likely because of practice effects) with continuance and declined with discontinuance of HT.

CONCLUSION

Continuation of HT use appears to protect cognition in women with heightened risk for AD when initiated close to menopause onset.

Efficacy and Feasibility of Functional Upper Extremity Task-Specific Training for Older Adults With and Without Cognitive Impairment

BACKGROUND

Although functional task-specific training is a viable approach for upper extremity neurorehabilitation, its appropriateness for older populations is unclear. If task-specific training is to be prescribed to older adults, it must be efficacious and feasible, even in patients with cognitive decline due to advancing age.

OBJECTIVE

This cross-sectional study tested the efficacy and feasibility of upper extremity task-specific training in older adults, including those with lower cognitive scores.

METHODS

Fifty older adults (age 65-89 years) without any confounding neuromuscular impairment were randomly assigned to a training group or no-training group. The training group completed 3 days (dosage = 2250 repetitions) of a functional upper extremity motor task (simulated feeding) with their nondominant hand; the no-training group completed no form of training at all. Both groups' task performance (measured as trial time) was tested at pre- and posttest, and the training group was retested 1 month later. Efficacy was determined by rate, amount, and retention of training-related improvement, and compared across levels of cognitive status. Feasibility was determined by participants' tolerance of the prescribed training dose.

RESULTS

The training group was able to complete the training dose without adverse responses and showed a significant rate, amount, and retention of improvement compared with the no-training group. Cognitive status did not alter results, although participants with lower scores on the Montreal Cognitive Assessment were slower overall.

CONCLUSIONS

Task-specific training may be appropriate for improving upper extremity function in older adults, yet future work in older patients with specific neurological conditions is needed.