Reliable change and minimum clinically important difference (MCID) of the Repeatable Battery for the Assessment of Neuropsychology Status (RBANS) in a heterogeneous dementia sample: Support for reliable change methods but not the MCID

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Change on the Repeatable Battery for the Assessment of Neuropsychological Status and its relationship to brain amyloid

BACKGROUND

The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) has been associated with commonly used biomarkers of Alzheimer's disease (AD), including brain amyloid plaque density. However, less is known about if changes in the RBANS across time are also related to brain amyloid deposition. The current study sought to expand on prior work by examining the relationship between changes over time on the RBANS and amyloid deposition via positron emission tomography (PET).

METHOD

One-hundred twenty-six older adults with intact or impaired cognition and daily functioning underwent repeat assessment with the RBANS across nearly 16 months, as well as had a baseline amyloid PET scan.

RESULTS

In the entire sample, amyloid deposition was significantly related to change on all five Indexes and the Total Scale score of the RBANS, with greater amyloid being associated with worsening cognition. This pattern was also observed in 11 of 12 subtests.

CONCLUSIONS

Whereas prior studies have identified a relationship between baseline RBANS and amyloid status, the current findings support that changes in the RBANS are also indicative of AD brain pathology, even if these findings are mediated by cognitive status. Although replication in a more diverse sample is needed, these results continue to support the use of the RBANS in AD clinical trials.

A Novel Digital Digit-Symbol Substitution Test Measuring Processing Speed in Adults At Risk for Alzheimer Disease: Validation Study

BACKGROUND

Assessing cognitive constructs affected by Alzheimer disease, such as processing speed (PS), is important to screen for potential disease and allow for early detection. Digital PS assessments have been developed to provide widespread, efficient cognitive testing, but all have been validated only based on the correlation between test scores. Best statistical practices dictate that concurrent validity should be assessed for agreement or equivalence rather than using correlation alone.

OBJECTIVE

This study aimed to assess the concurrent validity of a novel digital PS assessment against a gold-standard measure of PS.

METHODS

Adults aged 45-75 years (n=191) participated in this study. Participants completed the novel digital digit-symbol substitution test (DDSST) and the Repeatable Battery for the Assessment of Neuropsychological Status coding test (RBANS-C). The correlation between the test scores was determined using a Pearson product-moment correlation, and a difference in mean test scores between tests was checked for using a 2-tailed dependent samples t test. Data were analyzed for agreement between the 2 tests using Bland-Altman limits of agreement and equivalency using a two one-sided t tests (TOST) approach.

RESULTS

A significant moderate, positive correlation was found between DDSST and RBANS-C scores (r=.577; P<.001), and no difference in mean scores was detected between the tests (P=.93). Bias was nearly zero (0.04). Scores between the tests were found to display adequate agreement with 90% of score differences falling between -22.66 and 22.75 (90% limits of agreement=-22.91 to 22.99), and the scores were equivalent (P=.049).

CONCLUSIONS

Analyses indicate that the DDSST is a valid digital assessment of PS. The DDSST appears to be a suitable option for widespread, immediate, and efficient PS testing.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04559789; https://clinicaltrials.gov/ct2/show/NCT04559789.

Repeatable battery for the assessment of neuropsychological status and its relationship to biomarkers of Alzheimer's disease

The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) has been associated with commonly used biomarkers of Alzheimer's disease (AD). However, prior studies have typically utilized small and poorly characterized samples, and they have not analyzed the subtests of the RBANS. The current study sought to expand on prior work by examining the relationship between the Indexes and subtest scores of the RBANS and three AD biomarkers: amyloid deposition via positron emission tomography, hippocampal volume via magnetic resonance imaging, and APOE ε4 status.

One-hundred twenty-one older adults across the AD continuum (intact, amnestic Mild Cognitive Impairment, mild AD), who were mostly Caucasian and well-educated, underwent assessment with the RBANS and collection of the three biomarkers.

Greater amyloid deposition was significantly related to lower scores on all five Indexes and the Total Scale score of the RBANS, as well as 11 of 12 subtests. For bilateral hippocampal volume, significant correlations were observed for 4 of the 5 Indexes, Total Scale score, and 9 of 12 subtests, with smaller hippocampi being related to lower RBANS scores. Participants with at least one APOE ε4 allele had significantly lower scores on 3 of the 5 Indexes, Total Scale score, and 8 of the 12 subtests.

In this sample of participants across the dementia spectrum, most RBANS Indexes and subtests showed relationships with the amyloid deposition, hippocampal volumes, and APOE status, with poorer performance on the RBANS being associated with biomarker positivity. Although memory scores on the RBANS have traditionally been linked to biomarkers in AD, other Index and subtest scores also hold promise as indicators of AD. Replication in a more diverse sample is needed.

Assessing and validating reliable change across ADNI protocols

OBJECTIVE

Reliable change methods can aid in determining whether changes in cognitive performance over time are meaningful. The current study sought to develop and cross-validate 12-month standardized regression-based (SRB) equations for the neuropsychological measures commonly administered in the Alzheimer's Disease Neuroimaging Initiative (ADNI) longitudinal study.

METHOD

Prediction algorithms were developed using baseline score, retest interval, the presence/absence of a 6-month evaluation, age, education, sex, and ethnicity in two different samples (n = 192 each) of robustly cognitively intact community-dwelling older adults from ADNI - matched for demographic and testing factors. The developed formulae for each sample were then applied to one of the samples to determine goodness-of-fit and appropriateness of combining samples for a single set of SRB equations.

RESULTS

Minimal differences were seen between Observed 12-month and Predicted 12-month scores on most neuropsychological tests from ADNI, and when compared across samples the resultant Predicted 12-month scores were highly correlated. As a result, samples were combined and SRB prediction equations were successfully developed for each of the measures.

CONCLUSIONS

Establishing cross-validation for these SRB prediction equations provides initial support of their use to detect meaningful change in the ADNI sample, and provides the basis for future research with clinical samples to evaluate potential clinical utility. While some caution should be considered for measuring true cognitive change over time - particularly in clinical samples - when using these prediction equations given the relatively lower coefficients of stability observed, use of these SRBs reflects an improvement over current practice in ADNI.

Baseline [18F]GTP1 tau PET imaging is associated with subsequent cognitive decline in Alzheimer's disease

Background

The role and implementation of tau PET imaging for predicting subsequent cognitive decline in Alzheimer’s disease (AD) remains uncertain. This study was designed to evaluate the relationship between baseline [¹⁸F]GTP1 tau PET and subsequent longitudinal change across multiple cognitive measures over 18 months.

Methods

Our analyses incorporated data from 67 participants, including cognitively normal controls (n = 10) and β-amyloid (Aβ)-positive individuals ([¹⁸F] florbetapir Aβ PET) with prodromal (n = 26), mild (n = 16), or moderate (n = 15) AD. Baseline measurements included cortical volume (MRI), tau burden ([¹⁸F]GTP1 tau PET), and cognitive assessments [Mini-Mental State Examination (MMSE), Clinical Dementia Rating (CDR), 13-item version of the Alzheimer’s Disease Assessment Scale-Cognitive Subscale (ADAS-Cog13), and Repeatable Battery for the Assessment of Neuropsychological Status (RBANS)]. Cognitive assessments were repeated at 6-month intervals over an 18-month period. Associations between baseline [¹⁸F]GTP1 tau PET indices and longitudinal cognitive performance were assessed via univariate (Spearman correlations) and multivariate (linear mixed effects models) approaches. The utility of potential prognostic tau PET cut points was assessed with ROC curves.

Results

Univariate analyses indicated that greater baseline [¹⁸F]GTP1 tau PET signal was associated with faster rates of subsequent decline on the MMSE, CDR, and ADAS-Cog13 across regions of interest (ROIs). In multivariate analyses adjusted for baseline age, cognitive performance, cortical volume, and Aβ PET SUVR, the prognostic performance of [¹⁸F]GTP1 SUVR was most robust in the whole cortical gray ROI. When AD participants were dichotomized into low versus high tau subgroups based on baseline [¹⁸F]GTP1 PET standardized uptake value ratios (SUVR) in the temporal (cutoff = 1.325) or whole cortical gray (cutoff = 1.245) ROIs, high tau subgroups demonstrated significantly more decline on the MMSE, CDR, and ADAS-Cog13.

Conclusions

Our results suggest that [¹⁸F]GTP1 tau PET represents a prognostic biomarker in AD and are consistent with data from other tau PET tracers. Tau PET imaging may have utility for identifying AD patients at risk for more rapid cognitive decline and for stratification and/or enrichment of participant selection in AD clinical trials.

Trial registration

ClinicalTrials.gov NCT02640092. Registered on December 28, 2015

Supplementary Information

The online version contains supplementary material available at 10.1186/s13195-021-00937-x.

Measuring True Change in Individual Patients: Reliable Change Indices of Cardiac Rehabilitation Outcomes, and Implications for Quality Indicators

Background

Mediated by outcomes such as improved exercise capacity, cardiac rehabilitation (CR) reduces morbidity and mortality. For accuracy, an individual CR patient's change must be measured reliably, an issue not typically considered in practice. Drawing from psychometric theory, we calculated reliable change indices (RCIs), to measure individual CR patients’ true clinical change, apart from that from error and test practice/exposure, in exercise capacity, anxiety, and depression.

Methods

Indirectly calculated exercise capacity (peak metabolic equivalents [METs]) and psychological symptoms were each measured twice, 1 week apart, by administering treadmill tests or the Hospital Anxiety and Depression Scale (HADS) to separate samples of 35 (mean age: 59.0 years; 6 women) and 96 (mean age: 64.4 years; 32 women) CR patients, respectively. Using test-retest reliability and mean difference scores from these samples to estimate error and practice/exposure effects, we calculated RCIs for a separate cohort (n = 2066; mean age: 62.0 years; 533 women) who completed 6-month CR, and compared change distributions (worsened/unchanged/improved) based on critical RCIs, mean and percent changes, cut-off scores, and standard deviations.

Results

Practice/exposure effects were nonsignificant, except the mean HADS anxiety score decreased significantly (P ≤ 0.013; d = 0.17, small effect). Test-retest reliabilities were high (METs r = 0.934; HADS anxiety score r = 0.912; HADS depression score r = 0.90; P < 0.001). Among 2066 CR patients, RCI distributions differed (P < 0.001) from those of most other change criteria.

Conclusions

Change ascertainment depends on criterion choice. A Canadian Cardiovascular Society CR quality indicator of increase by 0.5 MET may be too small to assess individuals’ functional capacity change. RCIs offer a pragmatic approach to benchmarking reliable change frequency, and pending further validation, could be used for feedback to individual patients.

Treatment of Dementia With Bosutinib: An Open-Label Study of a Tyrosine Kinase Inhibitor

OBJECTIVE

The pursuit of an effective therapeutic intervention for dementia has inspired interest in the class of medications known as tyrosine kinase inhibitors such as bosutinib.

METHODS

Thirty-one patients with probable Alzheimer dementia or Parkinson spectrum disorder with dementia completed 12 months of bosutinib therapy and an additional 12 months of follow-up. The Clinical Dementia Rating scale (as estimated by the Quick Dementia Rating System [QDRS]) was the primary cognitive status outcome measure. Secondary outcome measures included the Repeatable Battery Assessment of Neuropsychological Status (RBANS) and the Montreal Cognitive Assessment. Cox regression methods were used to compare results with population-based estimates of cognitive decline.

RESULTS

The present article reports on cognitive outcomes obtained at 12 months for 31 participants and up to 24 months for a 16-participant subset. Safety and tolerability of bosutinib were confirmed among the study population (Mage = 73.7 years, SDage = 14 years). Bosutinib was associated with less worsening in Clinical Dementia Rating (CDR) scores (hazard ratio = -0.62, p < 0.001, 95% confidence interval [CI]: -1.02 to -0.30) and less decline in RBANS performance (hazard ratio = -3.42, p < 0.001, 95% CI: -3.59 to -3.72) during the year of treatment than population-based estimates of decline. In the 24-month follow-up, wherein 16 patients were observed after 1 year postintervention, 31.2% of participants exhibited worsened CDR levels compared with their 12-month performances.

CONCLUSIONS

Results support an overall positive outcome after 1 year of bosutinib. Future studies should explore the relationship between tyrosine kinases and neurodegenerative pathology as well as related avenues of treatment.

Cognitive Function During Opioid Tapering in Patients with Chronic Pain: A Prospective Cohort Study

Purpose

Evidence for efficacy and safety lacks for long-term opioid therapy in patients with chronic non-cancer pain and adverse effects, including affection of cognitive function and quality of life, is of concern. We aimed to investigate cognitive function and health-related quality of life in patients with chronic non-cancer pain during opioid reduction.

Patients and Methods

At two multidisciplinary pain centers, all patients with planned opioid reduction were screened for eligibility. Cognitive function was assessed using the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) and Trail Making Test A and B. Health-related quality of life was assessed using Short Form-36 (SF36) and Hospital Anxiety and Depression Scale (HADS).

Results

We included 51 participants and 40 participants attended follow-up of median 254 (IQR 106–357) days. Baseline RBANS score was 82 (IQR 65–93) with reference population norm value of 100 (SD±15). Daily opioid consumption was reduced from median 80 (IQR 45–161) oral morphine milligram equivalents to 19 (IQR 0–60) mg. RBANS score estimate increased by 6.2 (95% CI 3.1–9.3, p=0.0004) points after tapering. No differences were observed for Trail Making Test times, HADS or SF36 scores.

Conclusion

Generally, cognitive function showed minor improvement after opioid tapering with stationary health-related quality of life, depression and anxiety scores. The clinical significance is unclear, as no minimal clinically important difference in RBANS score is available.

Generalizability of reliable change equations for the RBANS over one year in community-dwelling older adults

Objective: Reliable change methods can assist neuropsychologists in determining whether observed changes in a patient's performance are clinically meaningful. The current study sought to validate previously published standardized regression-based (SRB) equations for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Indexes and subtests.Methods: Duff and colleagues's SRB prediction equations, developed from 223 cognitively intact primary care patients, were applied to an independent sample of robustly cognitively intact (n = 129) community-dwelling older adults assessed with the RBANS twice over a one-year period.Results: Results suggest that the cognitively intact participants in the current validation sample possessed significantly better Observed Follow-up scores than was predicted based on Duff's developmental sample across most RBANS Indexes and many RBANS subtests, though significantly lower Observed Follow-up scores were observed for the Visuospatial/Constructional Index than was predicted. As a result of these findings, the current study calculated updated prediction algorithms for the RBANS Index and subtest scores from the sample of 129 cognitively intact participants.Conclusions: Duff's 2004 and 2005 SRB prediction equations for the RBANS Index and subtest scores failed to generalize to a sample of cognitively intact community-dwelling participants recruited from senior living centers and independent assisted living facilities. These updated SRB prediction equations - being developed from a more medically "clean" sample of cognitively intact older adults who remained stable over 12 months - have the potential to provide a more accurate assessment of reliable change in an individual patient.