Assessing reliable change using the repeatable battery for the assessment of neuropsychological status (RBANS) for patients with Parkinson's Disease undergoing deep brain stimulation (DBS) surgery

Reliable cognitive change following unilateral deep brain stimulation in essential tremor

Objective: This retrospective analysis assessed regression-based reliable change (RC) of cognition in a sample of essential tremor (ET) patients who underwent unilateral deep brain stimulation of the ventral intermediate nucleus of the thalamus (VIM-DBS).Method: Thirty patients (mean age at pre-evaluation = 70.4 ± 6.3 years) underwent neuropsychological evaluation pre- and post-unilateral VIM-DBS placement (mean time between pre and post-evaluation = 13.1 ± 4.0 months). Paired samples t-tests and RC analyses were employed.Results: No significant within-group differences were observed when cognitive scores were compared between evaluations. The vast majority of patients demonstrated stability across pre-and post-surgical evaluations (i.e. 29 out of 30); however, those with high-risk co-morbid medical conditions may be vulnerable to post-surgical cognitive decline as indicated by RC measures.Conclusions: The use of regression-based RC indices to assess individual cognitive changes between pre and post-surgical evaluations control for systematic and measurement errors that can occur over repeated evaluations, and may be able to identify cognitive changes that evade detection in traditional within-group comparisons.

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Association between cognitive impairment and olfactory deficits in systemic lupus erythematosus without major neuropsychiatric syndromes

OBJECTIVE

The aim of the study was to investigate the utility of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), evaluate cognitive deficits in systemic lupus erythematosus (SLE) patients and examine the relationship between cognitive and olfactory functions.

METHODS

55 SLE patients and 50 healthy controls were administered by RBANS including five indexes: immediate memory (IMME), visuospatial/constructional (Vis/Con), language (LANG), attention (ATT), and delayed memory (DEME). Olfactory functions were evaluated by computerized testing including three stages of smell: threshold (THR), identification (ID), and memory (ME) of different odors. The disease activity and cumulative damage were assessed by the SLE Disease Activity Index 2000 (SLEDAI-2K) and the Systemic Lupus International Collaborating Clinics (SLICC)/American College of Rheumatology (ACR) Damage Index (SDI).

RESULTS

SLE patients exhibited significant lower total RBANS scores, IMME, Vis/Con, ATT, and DEME index scores than healthy controls (p < 0.01 for all and p = 0.027 for attention). Reduced RBANS scores were associated with several organ involvement and autoantibodies. SLE patients with higher SLEDAI-2K scores or with accumulated damage (SDI≥1) showed decreased RBANS scores. All the olfactory scores in SLE patients were significantly decreased than controls (p = 0.001). Patients had higher proportion of anosmia (8.57% vs 0%) and hyposmia (28.58% vs 5.72%) than controls (χ2 = 10.533, p = 0.015). Multivariable regression analysis revealed that olfactory functions had a positive effect on RBANS index scores. Olfactory memory and total scores were significantly correlated with the DEME (r = 0.393, p = 0.021) and total scores (r = 0.429, p = 0.011).

CONCLUSION

This study indicates that significantly cognitive and olfactory functions are impaired in SLE patients. The RBANS is a potentially useful instrument for evaluating neuropsychological status in SLE. Physicians are encouraged to perform routine screening in SLE patients to detect subtle cognitive dysfunction.

Cognitive Deficits among Individuals Admitted to a Post-Acute Pneumological Rehabilitation Unit in Southern Italy after COVID-19 Infection

(1) Background: We investigated the differences in the neuropsychological profile as well as the pneumological and motor functions in two groups of patients admitted to rehabilitation who received different respiratory support during their COVID-19 infection. (2) Methods: Group-1 (n = 18; 15 male, median age 67.5) consisted of patients who received non-invasive mechanical ventilation; Group-2 (n = 19; 16 male, median age 63) consisted of patients who received invasive mechanical ventilation. All patients underwent a neuropsychological assessment including Mini-Mental State Examination (MMSE), Frontal Assessment Battery (FAB), and the Repeatable Battery for the Assessment of Neuropsychological Status (R-BANS) to evaluate the patients' cognition. Depression and anxiety were also measured at admission and discharge to rehabilitation. (3) Results: At admission, patients impaired at MMSE were 44% in Group-1 and 5% in Group-2, while patients impaired at FAB were 88% in Group-1 and 26% in Group-2. Wilcoxon's effect size revealed meaningful differences between groups for FAB, R-BANS global score, immediate and delayed memory, and attention-coding task, with Group-2 performing better than Group-1 across all measures. At discharge, 52% of the 25 patients re-assessed still had mild to moderate cognitive deficits, while 19% had depression and 35% had anxiety. (4) Conclusions: Patients who received oxygen therapy experienced higher levels of acute and chronic stress compared to those who benefitted from invasive mechanical ventilation. Despite patients showing a meaningful improvement at discharge, cognitive impairment persisted in a great number of patients; therefore, long-term neuropsychological follow-up and treatment for COVID-19 patients are recommended.

Development of standardized regression-based formulas to assess meaningful cognitive change in early Parkinson's disease

OBJECTIVE

Longitudinal assessment of cognitive and emotional functioning in patients with Parkinson's disease (PD) is helpful in tracking progression of the disease, developing treatment plans, evaluating outcomes, and educating patients and families. Determining whether change over time is meaningful in neurodegenerative conditions, such as PD, can be difficult as repeat assessment of neuropsychological functioning is impacted by factors outside of cognitive change. Regression-based prediction formulas are one method by which clinicians and researchers can determine whether an observed change is meaningful. The purpose of the current study was to develop and validate regression-based prediction models of cognitive and emotional test scores for participants with early-stage idiopathic PD and healthy controls (HC) enrolled in the Parkinson's Progression Markers Initiative (PPMI).

METHODS

Participants with de novo PD and HC were identified retrospectively from the PPMI archival database. Data from baseline testing and 12-month follow-up were utilized in this study. In total, 688 total participants were included in the present study (NPD = 508; NHC = 185). Subjects from both groups were randomly divided into development (70%) and validation (30%) subsets.

RESULTS

Early-stage idiopathic PD patients and healthy controls were similar at baseline. Regression-based models were developed for all cognitive and self-report mood measures within both populations. Within the validation subset, the predicted and observed cognitive test scores did not significantly differ, except for semantic fluency.

CONCLUSIONS

The prediction models can serve as useful tools for researchers and clinicians to study clinically meaningful cognitive and mood change over time in PD.

Reconsidering the RBANS Factor Structure: a Systematic Literature Review and Meta-Analytic Factor Analysis

The primary aim was to perform a systematic literature review and extract data necessary for a meta-analytic factor analysis of the RBANS. Secondary aims were to examine the potential validity and utility of the resulting factor structure. Literature was identified through a review of PsycINFO, PubMed, MEDLINE, Academic Search Complete, Psychology & Behavioral Sciences Collection, CINAHL Complete, Health Source: Nursing/Academic Edition, and SocINDEX. A two-stage meta-analytic structural equation modeling method was implemented to pool correlation matrices from primary studies and perform confirmatory factor analyses. Following model selection, factor scores were computed for two datasets and subjected to correlation and diagnostic accuracy analyses. A pooled correlation matrix was computed from 24 sample correlation matrices (N = 5299). Confirmatory factor analysis revealed that the theoretical five-factor model produced the best fit but only when error terms between Story Memory and Story Recall as well as between Figure Copy and Figure Recall were included. Regression-based factor scores showed mixed relationships with the manual-defined indices, and the overall diagnostic accuracy of the factor scores was adequate in both samples examined (AUC = 0.71 and 0.87). The five-factor model was an unexpected result given the failure of multiple previous studies to find support for that model. The five-factor model demonstrates several areas of potential improvement, including better representation of the factors by the indicators. The factor scores implied by this model also require further validation.

Depression, quality of life, activities of daily living, and subjective memory after deep brain stimulation in Parkinson disease-A reliable change index analysis

OBJECTIVES

In the field of Parkinson disease (PD) research, many studies have shown that deep brain stimulation (DBS) can soften side effects, which arise during long-term medical therapy. This study focuses on the changes in depressive symptoms, quality of life (with the subdivisions physical and mental health), activities of daily living, and subjective memory functioning in PD patients testing the baseline and the outcome 1 year after DBS.

METHODS

For the first time, the reliable change index (RCI) methodology was applied to compare PD-DBS patients (n = 22) with best medically treated PD patients (PD-BMT; n = 28), subjects with mild cognitive impairment (MCI, n = 43) and healthy controls (n = 25) in the above-mentioned domains. The used questionnaires included the revised Beck Depression Inventory (BDI-II), the Short Form (36) Health Survey (SF-36), the Bayer Activities of Daily Living Scale (B-ADL), and the Forgetfulness Assessment Inventory (FAI).

RESULTS

The reliable change indices show high constant or improved results of the PD-DBS patients in the domains subjective memory (85.7%-100.0%), activities of daily living (60.0%-90.0%), physical health summary (77.8%), depressive symptoms (61.9%), and mental health summary (50.0%) in comparison with the PD-BMT, MCI, and control group.

CONCLUSIONS

DBS is an established alternative to best medical treatment of PD. The comparisons between the PD-DBS and PD-BMT groups do suggest that the domains mental health, depressive symptoms, and physical health benefit most, while the domains activities of daily living and subjective memory functioning are rather constant. Nevertheless, further research is needed to identify mechanisms and predictors that lead to improvement in individual cases.

Individual cognitive change after DBS-surgery in Parkinson's disease patients using Reliable Change Index Methodology

Long-term therapy of Parkinson's disease (PD) with levodopa (L-DOPA) is associated with a high risk of developing motor fluctuations and dyskinesia. Deep brain stimulation (DBS) in PD patients of the subthalamic nucleus can improve these motor complications. Although the positive effect on motor symptoms has been proven, postoperative cognitive decline has been documented. To tackle the impact of PD-DBS on cognition, 18 DBS patients were compared to 25 best medically treated Parkinson's patients, 24 Mild Cognitive Impairment (MCI) patients and 12 healthy controls using the Neuropsychological Test Battery Vienna-long (NTBV-long) for cognitive outcome 12 months after first examination. Reliable change index methodology was used. Overall, there was cognitive change in individual patients, but the change was very heterogeneous with gains and losses. Further research is needed to identify the mechanisms that lead to improvement or deterioration of cognitive functions in individual cases.

Assessment of individual cognitive changes after deep brain stimulation surgery in Parkinson's disease using the Neuropsychological Test Battery Vienna short version

Long-term therapy of Parkinson’s disease with L‑DOPA is associated with a high risk of developing motor fluctuations and dyskinesia. Deep brain stimulation (DBS) of the subthalamic nucleus (STN) can improve these motor complications. Although the positive effect on motor symptoms has been proven, postoperative cognitive decline has been documented. To tackle the impact of DBS on cognition, 18 DBS patients were compared to 25 best medically treated Parkinson’s patients, 24 patients with mild cognitive impairment (MCI) and 12 healthy controls using the Neuropsychological Test Battery Vienna short version (NTBV-short) for cognitive outcome 12 months after the first examination. Reliable change index methodology was used. Roughly 10% of DBS patients showed cognitive decline mainly affecting the domains attention and executive functioning (phonemic fluency). Further research is needed to identify the mechanisms that lead to improvement or deterioration of cognitive functions in individual cases.

Temporal Stability of the Dutch Version of the Wechsler Memory Scale-Fourth Edition (WMS-IV-NL)

OBJECTIVE

The Wechsler Memory Scale-Fourth Edition (WMS-IV) is one of the most widely used memory batteries. We examined the test-retest reliability, practice effects, and standardized regression-based (SRB) change norms for the Dutch version of the WMS-IV (WMS-IV-NL) after both short and long retest intervals.

METHOD

The WMS-IV-NL was administered twice after either a short (M = 8.48 weeks, SD = 3.40 weeks, range = 3-16) or a long (M = 17.87 months, SD = 3.48, range = 12-24) retest interval in a sample of 234 healthy participants (M = 59.55 years, range = 16-90; 118 completed the Adult Battery; and 116 completed the Older Adult Battery).

RESULTS

The test-retest reliability estimates varied across indexes. They were adequate to good after a short retest interval (ranging from .74 to .86), with the exception of the Visual Working Memory Index (r = .59), yet generally lower after a long retest interval (ranging from .56 to .77). Practice effects were only observed after a short retest interval (overall group mean gains up to 11 points), whereas no significant change in performance was found after a long retest interval. Furthermore, practice effect-adjusted SRB change norms were calculated for all WMS-IV-NL index scores.

CONCLUSIONS

Overall, this study shows that the test-retest reliability of the WMS-IV-NL varied across indexes. Practice effects were observed after a short retest interval, but no evidence was found for practice effects after a long retest interval from one to two years. Finally, the SRB change norms were provided for the WMS-IV-NL.

Impact of bilateral subthalamic stimulation on motor/cognitive functions in Parkinson's disease

It is still unclear whether deep brain stimulation targeted to the bilateral subthalamic nucleus (STN-DBS) affects cognitive function in Parkinson's disease (PD). This prospective study was aimed to systemically evaluate the impact of bilateral STN-DBS on motor and cognitive functions in patients with PD. This study included totally 11 Japanese patients with medically intolerant PD. Neurological and cognitive status was precisely evaluated before and 1 year after bilateral STN-DBS, using unified Parkinson's disease rating scale (UPDRS), levodopa equivalent doses, mini-mental state examination (MMSE), Japanese adult reading test (JART), repeatable battery for the assessment of neuropsychological status (RBANS), and Wechsler adult intelligence scale-revised (WAIS-R). Preoperative RBANS and WAIS-R identified cognitive dysfunction that could not be detected by MMSE and JART. Before surgery, PD patients had significantly impaired immediate memory and attention. Motor function significantly improved 1 year after bilateral STN-DBS. Bilateral STN-DBS did not affect any score on cognitive examinations. However, postoperative improvements of total score on RBANS and performance intelligence quotient (PIQ) scores on WAIS-R were closely related to those of UPDRS part III off (R² = 0.61, P < 0.01; R² = 0.39, P < 0.05, respectively). These findings strongly suggest that bilateral STN-DBS may significantly improve cognitive function in a certain subgroup of patients whose therapeutic effects on motor function are prominent.

Evidence-based indicators of neuropsychological change in the individual patient: relevant concepts and methods

Repeated assessments are a relatively common occurrence in clinical neuropsychology. The current paper will review some of the relevant concepts (e.g., reliability, practice effects, alternate forms) and methods (e.g., reliable change index, standardized based regression) that are used in repeated neuropsychological evaluations. The focus will be on the understanding and application of these concepts and methods in the evaluation of the individual patient through examples. Finally, some future directions for assessing change will be described.

Urinary Urgency Medications May Compromise Discrete rather than Global Cognitive Skills

BACKGROUND/AIMS

Prior research about cognitive problems associated with the use of urinary urgency medication (UUM) has reported mixed results that suggest procedures and/or assessments may need to be refined.

METHODS

Ten elderly subjects who were actively taking a UUM were assessed with neuropsychological testing before and after a 4-week UUM washout period. Results were evaluated by examining discrete subtest results, full-scale scores, and the reliable change index methodology.

RESULTS

Four controls and 5 subjects with mild cognitive impairment showed significant improvement in at least one subtest score on well-characterized instruments.

CONCLUSION

In this case study of 10 subjects, withdrawal of oxybutynin and tolterodine resulted in significant changes in subtest scores with different patterns for each subject that were not necessarily reflected in their total scores. Thus, future clinical studies should always include analysis of subtest results as these changes may be the only indication that cognition has been improved or has declined significantly.