Measuring reliable change in cognition using the Edinburgh Cognitive and Behavioural ALS Screen (ECAS)

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Psychometric properties of the Russian version of the Edinburgh cognitive and behavioral amyotrophic lateral sclerosis screen

BACKGROUND

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative condition with observable cognitive and behavioral impairment. The Edinburgh Cognitive and Behavioral ALS Screen (ECAS) is a tool developed specifically for people with ALS (pwALS) and previously translated into Russian, but the psychometric properties have not yet been explored. The aim was to explore and determine the psychometric properties of the Russian-version of ECAS (ECAS-R).

METHODS

56 Russian speaking pwALS, 32 of their caregivers and 26 healthy controls were recruited for the study. They completed the ECAS-R, Patient Health Questionnaire-9 (PHQ-9) and Montreal Cognitive Assessment (MoCA). King Staging System was also utilized. Internal consistency, divergent and convergent validity, as well as culturally-derived cutoff scores of ECAS-R were determined.

RESULTS

The internal consistency of ECAS-R was good (Cronbach's alpha = 0.73). Convergent validity was observed though a strong correlation between the ECAS-R and MoCA scores. No correlation between ECAS-R and PHQ-9 were observed in terms of divergent validity. Based on culturally-derived cutoff scores, 64.2% (N = 36) of pwALS displayed cognitive impairment, with the most affected cognitive domains as executive function and language. Apathy was the most common behavioral impairment for pwALS followed by a loss of sympathy/empathy.

CONCLUSIONS

The ECAS-R is valid and reliable tool for the screening for the cognitive and behavioral impairment in Russian-speaking pwALS, with culturally-derived cutoffs presented.

Temporal course of cognitive and behavioural changes in motor neuron diseases

BACKGROUND

Cognitive and behavioural dysfunction may occur in people with motor neuron disease (MND), with some studies suggesting an association with the C9ORF72 repeat expansion. Their onset and progression, however, is poorly understood. We explored how cognition and behaviour change over time, and whether demographic, clinical and genetic factors impact these changes.

METHODS

Participants with MND were recruited through the Phenotype-Genotype-Biomarker study. Every 3-6 months, the Edinburgh Cognitive and Behavioural ALS Screen (ECAS) was used to assess amyotrophic lateral sclerosis (ALS) specific (executive functioning, verbal fluency, language) and ALS non-specific (memory, visuospatial) functions. Informants reported on behaviour symptoms via semi-structured interview.

RESULTS

Participants with neuropsychological data at ≥3 visits were included (n=237, mean age=59, 60% male), of which 18 (8%) were C9ORF72 positive. Baseline cognitive impairment was apparent in 18 (8%), typically in ALS specific domains, and associated with lower education, but not C9ORF72 status. Cognition, on average, remained stable over time, with two exceptions: (1) C9ORF72 carriers declined in all ECAS domains, (2) 8%-9% of participants with baseline cognitive impairment further declined, primarily in the ALS non-specific domain, which was associated with less education. Behavioural symptoms were uncommon.

CONCLUSIONS

In this study, cognitive dysfunction was less common than previously reported and remained stable over time for most. However, cognition declines longitudinally in a small subset, which is not entirely related to C9ORF72 status. Our findings raise questions about the timing of cognitive impairment in MND, and whether it arises during early clinically manifest disease or even prior to motor manifestations.

Development, reliability, validity, and acceptability of the remote administration of the Edinburgh Cognitive and Behavioural ALS Screen (ECAS)

BACKGROUND

ALS clinical care and research has changed dramatically since the COVID-19 pandemic, accelerating the need for cognitive assessments to be adapted for remote use.

OBJECTIVES

To develop the remote administration method of the Edinburgh Cognitive and Behavioural ALS Screen (ECAS), and determine its reliability and validity. Methods: The validation process consisted of: (1) Two versions of the ECAS (A and B) were administered, one in-person and one remotely via video call in a randomized order to 27 people without ALS; (2) The ECAS was administered remotely to 24 pwALS, with a second rater independently scoring performance; and (3) Acceptability was assessed by gathering feedback from 17 pwALS and 19 clinicians and researchers about their experience of using the ECAS remotely.

RESULTS

In the group without ALS, the remote and in-person ECAS total scores were found to be equivalent, and a Bland-Altman plot showed good agreement between the two administration methods. In pwALS, there was excellent agreement between two raters (ICC = 0.99). Positive feedback was gained from pwALS, researchers and clinicians with regards to ease of process, convenience, time, and the environment.

CONCLUSIONS

These findings provide evidence of the reliability and validity of the remote administration of the ECAS for pwALS, with clinicians, researchers and pwALS viewing it as a good alternative to face-to-face administration.

Neuropsychological impairment in amyotrophic lateral sclerosis-frontotemporal spectrum disorder

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disease with a rapid course, characterized by motor neuron dysfunction, leading to progressive disability and death. This Review, which is aimed at neurologists, psychologists and other health professionals who follow evidence-based practice relating to ALS and frontotemporal dementia (FTD), examines the neuropsychological evidence that has driven the reconceptualization of ALS as a spectrum disorder ranging from a pure motor phenotype to ALS-FTD. It focuses on changes in cognition and behaviour, which vary in severity across the spectrum: around 50% individuals with ALS are within the normal range, 15% meet the criteria for ALS-FTD, and the remaining 35% are in the mid-spectrum range with milder and more focal impairments. The cognitive impairments include deficits in verbal fluency, executive functions, social cognition and language, and apathy is the most prevalent behavioural change. The pattern and severity of cognitive and behavioural change predicts underlying regional cerebral dysfunction from brain imaging and post-mortem pathology. Our increased recognition of cognition and behaviour as part of the ALS phenotype has led to the development and standardization of assessment tools, which have been incorporated into research and clinical care. Measuring change over the course of the disease is vital for clinical trials, and neuropsychology is proving to be a biomarker for the earliest preclinical changes.

Palliative Care in Amyotrophic Lateral Sclerosis

Amyotrophic lateral sclerosis (ALS) is an incurable neurodegenerative disease of the motor neurons. Given the evolutive characteristics of this disease, palliative care principles should be a foundation of ALS care. A multidisciplinary medical intervention is of paramount importance in the different phases of disease. The involvement of the palliative care team improves quality of life and symptoms, and prognosis. Early initiation is of paramount importance to ensuring patient-centered care, when the patient has still the capability to communicate effectively and participate in his medical care. Advance care planning supports patients and family members in understanding and sharing their preferences according to their personal values and life goals regarding future medical treatment. The principal problems which require intensive supportive care include cognitive disturbances, psychological distress, pain, sialorrhrea, nutrition, and ventilatory support. Communication skills of health-care professionals are mandatory to manage the inevitability of death. Palliative sedation has peculiar aspects in this population, particularly with the decision of withdrawing ventilatory support.

Cognitive performance of adult patients with SMA before and after treatment initiation with nusinersen

BACKGROUND

Spinal muscular atrophy (SMA) is a genetic neuromuscular disease caused by mutations of the SMN1 gene. Deficient SMN protein causes irreversible degeneration of alpha motor neurons characterized by progressive muscle weakness and atrophy. Considering that SMA is a multi-systemic disorder and SMN protein was found to be expressed in cortical structures, the cognitive profile of adult patients with SMA has recently been of particular interest. With nusinersen, a novel, disease-modifying drug has been established, but its effects on neuropsychological functions have not been validated yet. Aim of this study was to investigate the cognitive profile of adult patients with SMA during treatment initiation with nusinersen and to reveal improvement or deterioration in cognitive performance.

METHODS

This monocentric longitudinal study included 23 patients with SMA type 2 and 3. All patients were assessed with the Edinburgh Cognitive and Behavioral ALS Screen (ECAS) before and after 14 months of treatment initiation with nusinersen. Additionally, motor function was evaluated by Hammersmith Functional Motor Scale Expanded (HFMSE), Revised Upper Limb Module (RULM) and Amyotrophic Lateral Sclerosis Functional Rating Scale Revised (ALSFRS-R).

RESULTS

Of the treatment-naive patients, only three were below the age- and education-matched cut-off for cognitive impairment in the ECAS total score. Significant differences between SMA type 2 and 3 were only detected in the domain of Language. After 14 months of treatment, patients showed significant improvement of absolute scores in all three ALS-specific domains, in the non-ALS-specific domain of Memory, in both subscores and in the ECAS total score. No associations were detected between cognitive and functional outcome measures.

CONCLUSIONS

In some adult patients with SMA abnormal cognitive performance in ALS-specific functions of the ECAS was evident. However, the presented results suggest no clinically significant cognitive changes during the observed treatment period with nusinersen.

Norwegian version of the Edinburgh cognitive and behavioural ALS screen: Construct validity, internal consistency, inter-rater, and test-retest reliability

BACKGROUND

Research collaboration highlight a need for validated tests in other languages than English. Translation and culture adjustments may threaten essential features of the original instrument.

OBJECTIVE

To assess the internal consistency, inter-rater and test-retest reliability, and construct validity of the Norwegian version of the Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis (ALS) Screen (ECAS-N).

METHODS

Performance of 71 subjects with ALS, 85 healthy controls (HC) and 6 controls with Alzheimer's disease (AD) were assessed with the ECAS-N. Test-retest interval was four months. Internal consistency was evaluated using Cronbach's alpha; reliability was assessed using intraclass correlation coefficient (ICC), Cohen's kappa, and Bland Altman plot. Five hypothesis, including the Montreal Cognitive Assessment (MoCA) screen, was evaluated for construct validity.

RESULTS

ECAS-N total score produced a Cronbach's alpha of 0.65, had excellent inter-rater reliability (ICC = 0.99) and acceptable test-retest reliability (ICC = 0.73). Construct validity analysis suggested valid use of the ECAS-N to distinguish people with ALS-specific cognitive impairment from HC (p = 0.001) and those with AD (p = 0.002). The MoCA and ECAS-N were moderately correlated (r = 0.53).

CONCLUSION

The ECAS-N has potential to be used by different testers in clinical practice and research to screen patients with ALS who speak Norwegian and for documenting cognitive impairment over time.

Defining cognitive impairment in amyotrophic lateral sclerosis: an evaluation of empirical approaches

Objective: Amyotrophic lateral sclerosis (ALS) is a multi-system disorder characterized primarily by motor neuron degeneration, but may be accompanied by cognitive dysfunction. Statistically appropriate criteria for establishing cognitive impairment (CI) in ALS are lacking. We evaluate quantile regression (QR), that accounts for age and education, relative to a traditional two standard deviation (SD) cutoff for defining CI. Methods: QR of cross-sectional data from a multi-center North American Control (NAC) cohort of 269 healthy adults was used to model the 5th percentile of cognitive scores on the Edinburgh Cognitive and Behavioral ALS Screen (ECAS). The QR approach was compared to traditional two SD cutoff approach using the same NAC cohort (2SD-NAC) and to existing UK-based normative data derived using the 2SD approach (2SD-UK) to assess the impact of cohort selection and statistical model in identifying CI in 182 ALS patients. Results: QR-NAC models revealed that age and education impact cognitive performance on the ECAS. Based on QR-NAC normative cutoffs, the frequency of CI in the 182 PENN ALS patients was 15.9% for ALS specific, 12.6% for ALS nonspecific, and 15.4% for ECAS total. This frequency of CI is substantially more conservative in comparison to the 2SD-UK (20.3%-34.6%) and modestly more conservative to the 2SD-NAC (14.3%-16.5%) approaches for estimating CI. Conclusions: The choice of normative cohort has a substantial impact and choice of statistical method a modest impact on defining CI in ALS. This report establishes normative ECAS thresholds to identify whether ALS patients in the North American population have CI.

Reliable change indices for the Italian Edinburgh Cognitive and Behavioral ALS Screen (ECAS)

This study aimed at providing standardized regression-based (SRB) reliable change indices (RCIs) for the Italian Edinburgh Cognitive and Behavioral ALS Screen (ECAS). Thirty-one consecutive ALS patients undergoing the ECAS were followed-up (T1) at 6.5 ± 1 months (range = 5-8). Ceiling/floor effects, practice effect, and test-retest reliability were assessed. Each ECAS measure was regressed by stepwise-entering as predictors demographics, respective T0 scores, T0 disease duration and ALSFRS-R, retest interval, and progression rate (ΔFS) - i.e., (48 - ALSFRS-R_T0)/disease duration_T0 in months. Ceiling effects were infrequently detected, no practice effect emerged and all ECAS measures were reliable at retest (except for Language and Visuo-spatial subscales). T0 scores predicted all ECAS measures except for the Visuo-spatial subscale. The availability of RCIs for the Italian ECAS will aid ALS-related clinical practice and research within the longitudinal dimension.

Logistic versus linear regression-based reliable change index: A simulation study with implications for clinical studies with different sample sizes

The linear regression-based reliable change index (RCI) is widely used to identify memory impairments through longitudinal assessment. However, the minimum sample size required for estimates to be reliable has never been specified. Using data from 920 participants from the Alzheimer's Disease Neuroimaging Initiative data as true parameters, we run 12,000 simulations for samples of size 10-1,000 and analyzed the percentage of times the estimates are significant, their coverage rate, and the accuracy of the models including both the true-positive rate and the true-negative rate. We compared the linear RCI with a logistic RCI for discrete, bounded scores. We found that the logistic RCI is more accurate than the linear RCI overall, with the linear RCI approximating the logistic RCI for samples of size 200 or greater. We provide an R package to compute the logistic RCI, which can be downloaded from the Comprehensive R Archive Network (CRAN) at https://cran.r-project.org/web/packages/LogisticRCI/, and the code to reproduce all results in this article at https://github.com/rafamoral/LogisticRCIpaper/. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Assessing and validating reliable change across ADNI protocols

OBJECTIVE

Reliable change methods can aid in determining whether changes in cognitive performance over time are meaningful. The current study sought to develop and cross-validate 12-month standardized regression-based (SRB) equations for the neuropsychological measures commonly administered in the Alzheimer's Disease Neuroimaging Initiative (ADNI) longitudinal study.

METHOD

Prediction algorithms were developed using baseline score, retest interval, the presence/absence of a 6-month evaluation, age, education, sex, and ethnicity in two different samples (n = 192 each) of robustly cognitively intact community-dwelling older adults from ADNI - matched for demographic and testing factors. The developed formulae for each sample were then applied to one of the samples to determine goodness-of-fit and appropriateness of combining samples for a single set of SRB equations.

RESULTS

Minimal differences were seen between Observed 12-month and Predicted 12-month scores on most neuropsychological tests from ADNI, and when compared across samples the resultant Predicted 12-month scores were highly correlated. As a result, samples were combined and SRB prediction equations were successfully developed for each of the measures.

CONCLUSIONS

Establishing cross-validation for these SRB prediction equations provides initial support of their use to detect meaningful change in the ADNI sample, and provides the basis for future research with clinical samples to evaluate potential clinical utility. While some caution should be considered for measuring true cognitive change over time - particularly in clinical samples - when using these prediction equations given the relatively lower coefficients of stability observed, use of these SRBs reflects an improvement over current practice in ADNI.

Qualitative measures that assess functional disability and quality of life in ALS

BACKGROUND

Selection of appropriate trial endpoints and outcome measures is particularly important in rare disease and rapidly progressing disease such as amyotrophic lateral sclerosis (ALS) where the challenges to conducting clinical trials, are substantial: patient and disease heterogeneity, limited understanding of exact disease pathophysiology, and lack of robust and available biomarkers. To address these challenges in ALS, the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised version (ALSFRS-R) was developed and has become a key primary endpoint in ALS clinical trials to assess functional disability and disease progression, often replacing survival as a primary outcome. However, increased understanding of the ALS disease journey and improvements in assistive technology for ALS patients have exposed issues with the ALSFRS-R, including non-linearity, multidimensionality and floor and ceiling effects that could challenge its continued utility as a primary outcome measure in ALS clinical trials. Recently, other qualitative scale measures of functioning disability have been developed to help address these issues. With this in mind, we conducted a literature search aimed at identifying both established and promising new measures for potential use in clinical trials.

METHODS

We searched PubMed, Google, Google Scholar, and the reference sections of key studies to identify papers that discussed qualitative measures of functional status for potential use in ALS studies. We also searched clinicaltrials.gov to identify functional status and health-related quality of life (HRQoL) measures that have been used in ALS interventional studies.

RESULTS

In addition to the ALSFRS-R, we identified several newer qualitative scales including ALSFRS-EX, ALS-MITOS, CNS-BFS, DALS-15, MND-DS, and ROADS. Strengths and limitations of each measure were identified and discussed, along with their potential to act as a primary or secondary outcome to assess patient functional status in ALS clinical trials.

CONCLUSION

This paper serves as a reference guide for researchers deciding which qualitative measures to use as endpoints in their ALS clinical trials to assess functional status. This paper also discusses the importance of including ALS HRQoL and ALS cognitive screens in future clinical trials to assess the value of a new ALS therapy more comprehensively.

A systematic review of non-motor symptom evaluation in clinical trials for amyotrophic lateral sclerosis

BACKGROUND

Amyotrophic lateral sclerosis (ALS) is increasingly recognised as a multi-system disorder, presenting with common and impactful non-motor symptoms, such as neuropsychiatric symtpoms, cognitive and behavioural changes, pain, disordered sleep, fatigue and problematic saliva.

AIM/HYPOTHESIS

We aimed to systematically review 25 years of ALS clinical trials data to identify if non-motor features were evaluated, in addition to the traditional measures of motor functioning and survival, and where evaluated to describe the instruments used to assess. We hypothesised that assessment of non-motor symptoms has been largely neglected in trial design and not evaluated with ALS-suitable instruments.

METHODS

We reviewed clinical trials of investigative medicinal products in ALS, since the licensing of riluzole in 1994. Trial registry databases including WHO International Trials Registry, European Clinical Trials Register, clinicaltrials.gov, and PubMed were systematically searched for Phase II, III or IV trials registered, completed or published between 01/01/1994 and 16/09/2020. No language restrictions were applied.

RESULTS

237 clinical trials, including over 29,222 participants, were investigated for their use of non-motor outcome measures. These trials evaluated neuropsychiatric symptoms (75, 32%), cognitive impairment (16, 6.8%), behavioural change (34, 14%), pain (55, 23%), sleep disturbances (12, 5%) and fatigue (18, 8%). Problematic saliva was assessed as part of composite ALS-FRS(R) scores in 184 trials (78%) but with no focus on this as an isolated symptom. 31 (13%) trials including 3585 participants did not include any assessment of non-motor symptoms.

CONCLUSIONS

Non-motor symptoms such as neuropsychiatric, cognitive and behavioural changes, pain, disordered sleep, fatigue, and problematic saliva have not been consistently evaluated in trials for people with ALS. Where evaluated, non-symptoms were primarily assessed using instruments and impairment thresholds that are not adapted for people with ALS. Future trials should include non-motor symptom assessments to evaluate the additional potential therapeutic benefit of candidate drugs.

PROPSERO REGISTRATION

CRD42020223648.

Validation of one-week reliable change methods in cognitively intact community-dwelling older adults

OBJECTIVE

Reliable change methods can assist the determination of whether observed changes in performance are meaningful. The current study sought to validate previously published standardized regression-based (SRB) equations for commonly administered cognitive tests using a cognitively intact sample of older adults, and extend findings by including relevant demographic and test-related variables known to predict cognitive performance. Method: This study applied previously published SRB prediction equations to 107 cognitively intact older adults assessed twice over one week. Prediction equations were also updated by pooling the current validation sample with 93 cognitively intact participants from original development sample to create a combined development sample. Results: Significant improvements were seen between observed baseline and follow-up scores on most measures. However, few differences were seen between observed follow-up scores and those predicted from these SRB algorithms, and the level of practice effects observed based on these equations were consistent with expectations. When SRBs were re-calculated from this combined development sample, predicted follow-up scores were mostly comparable with these equations, but standard errors of the estimate were consistently smaller. Conclusions: These results help support the validity of of these SRB equations to predict cognitive performance on these measures when repeated administration is necessary over short intervals. Findings also highlight the utility of expanding SRB models when predicting follow-up performance serially to provide more accurate assessment of reliable change at the level of the individual. As short-term practice effects are shown to predict cognitive performance annually, they possess the potential to inform clinical decision-making about individuals along the Alzheimer's continuum.

Reliable change in cognition over 1 week in community-dwelling older adults: a validation and extension study

OBJECTIVE

Reliable change methods can aid neuropsychologists in understanding if performance differences over time represent clinically meaningful change or reflect benefit from practice. The current study sought to externally validate the previously published standardized regression-based (SRB) prediction equations developed by Duff for commonly administered cognitive measures.

METHOD

This study applied Duff's SRB prediction equations to an independent sample of community-dwelling participants with amnestic mild cognitive impairment (MCI) assessed twice over a 1-week period. A comparison of MCI subgroups (e.g., single v. multi domain) on the amount of change observed over 1 week was also examined.

RESULTS

Using pairwise t-tests, large and statistically significant improvements were observed on most measures across 1 week. However, the observed follow-up scores were consistently below expectation compared with predictions based on Duff's SRB algorithms. In individual analyses, a greater percentage of MCI participants showed smaller-than-expected practice effects based on normal distributions. In secondary analyses, smaller-than-expected practice effects were observed in participants with worse baseline memory impairment and a greater number of impaired cognitive domains, particularly for measures of executive functioning/speeded processing.

CONCLUSIONS

These findings help to further support the validity of Duff's 1-week SRB prediction equations in MCI samples and extend previous research by showing incrementally smaller-than-expected benefit from practice for increasingly impaired amnestic MCI subtypes.

Application of Different Standard Error Estimates in Reliable Change Methods

OBJECTIVE

This study attempted to clarify the applicability of standard error (SE) terms in clinical research when examining the impact of short-term practice effects on cognitive performance via reliable change methodology.

METHOD

This study compared McSweeney's SE of the estimate (SEest) to Crawford and Howell's SE for prediction of the regression (SEpred) using a developmental sample of 167 participants with either normal cognition or mild cognitive impairment (MCI) assessed twice over 1 week. One-week practice effects in older adults: Tools for assessing cognitive change. Using these SEs, previously published standardized regression-based (SRB) reliable change prediction equations were then applied to an independent sample of 143 participants with MCI.

RESULTS

This clinical developmental sample yielded nearly identical SE values (e.g., 3.697 vs. 3.719 for HVLT-R Total Recall SEest and SEpred, respectively), and the resultant SRB-based discrepancy z scores were comparable and strongly correlated (r = 1.0, p < .001). Consequently, observed follow-up scores for our sample with MCI were consistently below expectation compared to predictions based on Duff's SRB algorithms.

CONCLUSIONS

These results appear to replicate and extend previous work showing that the calculation of the SEest and SEpred from a clinical sample of cognitively intact and MCI participants yields similar values and can be incorporated into SRB reliable change statistics with comparable results. As a result, neuropsychologists utilizing reliable change methods in research investigation (or clinical practice) should carefully balance mathematical accuracy and ease of use, among other factors, when determining which SE metric to use.

Cognitive and behavioural impairment in amyotrophic lateral sclerosis: A landmark of the disease? A mini review of longitudinal studies

Amyotrophic lateral sclerosis (ALS) is a heterogeneous neurodegenerative disease marked by progressive loss of motor abilities. Approximately half of patents with ALS experience cognitive (ALSci) or behavioural impairment (ALSbi) during the course of the disease, with a small percentage developing overt frontotemporal dementia (FTD). ALSci and/or ALSbi can occur simultaneously with motor neuron degeneration or develop in advanced stages of the disease, but it can even precede motor involvement in some cases, namely in ALS patients meeting criteria for FTD. Despite clear evidence that cognitive/behavioural impairment may appear early in the course of ALS, no prominent deterioration seems to occur with disease progression. Longitudinal studies have failed to reach conclusive results on the progression of cognitive and behavioural involvement in ALS. This may be due to some structural limitations of the studies, such as attrition rate, practice effect, short-time interval between neuropsychological assessments, but it can also be due to the heterogeneity of ALS phenotypes. The objective of this review is to provide a comprehensive and critical analysis of results of longitudinal studies highlighting cognitive and behavioural domains mainly affected by neurodegeneration pointing out the determinants that might be associate with the development and worsening of frontotemporal symptoms in ALS. At this regard, older age, rapidly progressing ALS, bulbar-onset, advanced disease stages are among factors mainly associated with cognitive and behavioural involvement. Moreover, the progression of cognitive and behavioural deficits seems to be not directly related to the slope of motor disability, thus suggesting the independence of neuropsychological and motor functional decline in ALS. Cognitive and motor involvement may indeed present with distinct trajectories suggesting a differential vulnerability of motor and non-motor cortical networks. In this scenario, determining the progression of extra-motor involvement in ALS may help refine understanding of the clinical implications of cognitive and behavioural abnormalities, and provide clues to the aetiology of the disease.

Working memory from pregnancy to postpartum: Do women really change?

Studies indicate that pregnancy is associated with declines in working memory (WM), potentially due to intense pregnancy hormonal fluctuations. These declines extend into the postpartum period and may even be worsened due to sleepless nights and continued hormonal changes. However, previous studies finding WM stability from pregnancy to postpartum have not used a control group to examine practice effects on WM tests. The current study used a well-matched control group, fathers, to examine a) whether mothers and fathers differ on tests of WM during pregnancy and postpartum, and b) whether mothers show a postpartum WM decline, taking into account the practice effects of fathers. Results revealed that mothers (N = 75) and fathers (N = 44) performed equally well on a WM task at both time points and improved across time at a statistically equivalent rate. Use of a Reliable Change Index and a regression-based sensitivity analysis bolstered these results, indicating that taking practice effects into account, the majority of women did not improve or decline in WM from pre- to postpartum. These findings add to the literature on pregnancy-related changes in cognition and raise new questions about potential cognitive changes in men during the same period.

Validating 1-Year Reliable Change Methods

OBJECTIVE

reliable change methods can assist in the determination of whether observed changes in performance are meaningful. The current study sought to validate previously published 1-year standardized regression-based (SRB) equations for commonly administered neuropsychological measures that incorporated baseline performances, demographics, and 1-week practice effects.

METHOD

Duff et al.'s SRB prediction equations were applied to an independent sample of 70 community-dwelling older adults with either normal cognition or mild cognitive impairment, assessed at baseline, at 1 week, and at 1 year.

RESULTS

minimal improvements or declines were seen between observed baseline and observed 1-year follow-up scores, or between observed 1-year and predicted 1-year scores, on most measures. Relatedly, a high degree of predictive accuracy was observed between observed 1-year and predicted 1-year scores across cognitive measures in this repeated battery.

CONCLUSIONS

these results, which validate Duff et al.'s SRB equations, will permit clinicians and researchers to have more confidence when predicting cognitive performance on these measures over 1 year.

Validation of one-year reliable change in the RBANS for community-dwelling older adults with amnestic mild cognitive impairment

OBJECTIVE

The current study sought to externally validate previously published standardized regression-based (SRB) equations for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Indexes administered twice over a one-year period. Method: Hammers and colleagues' SRB prediction equations were applied to two independent samples of community-dwelling older adults with amnestic Mild Cognitive Impairment (MCI), including those recruited from the community (n = 64) and those recruited from a memory disorders clinic (n = 58). Results: While Observed Baseline and Observed Follow-up performances were generally comparable for both MCI samples over one year, both samples possessed significantly lower Observed One-Year Follow-up scores than were predicted based on Hammers and colleagues' development sample across many RBANS Indexes. Relatedly, both amnestic MCI samples possessed a greater percentage of participants either "declining" or failing to exhibit a long-term practice effect over one year relative to expectation across most Indexes. Further, the clinic-recruited amnestic MCI sample displayed worse baseline performances, smaller long-term practice effects, and greater proportions of individual participants exhibiting a decline across one year relative to the community amnestic MCI sample. Conclusions: These findings validate Hammers and colleagues' SRB prediction equations by (1) indicating their ability to identify clinically meaningful change across RBANS Indexes in independent samples, and (2) discriminating rates of cognitive change among cognitively nuanced samples.

Generalizability of reliable change equations for the RBANS over one year in community-dwelling older adults

Objective: Reliable change methods can assist neuropsychologists in determining whether observed changes in a patient's performance are clinically meaningful. The current study sought to validate previously published standardized regression-based (SRB) equations for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Indexes and subtests.Methods: Duff and colleagues's SRB prediction equations, developed from 223 cognitively intact primary care patients, were applied to an independent sample of robustly cognitively intact (n = 129) community-dwelling older adults assessed with the RBANS twice over a one-year period.Results: Results suggest that the cognitively intact participants in the current validation sample possessed significantly better Observed Follow-up scores than was predicted based on Duff's developmental sample across most RBANS Indexes and many RBANS subtests, though significantly lower Observed Follow-up scores were observed for the Visuospatial/Constructional Index than was predicted. As a result of these findings, the current study calculated updated prediction algorithms for the RBANS Index and subtest scores from the sample of 129 cognitively intact participants.Conclusions: Duff's 2004 and 2005 SRB prediction equations for the RBANS Index and subtest scores failed to generalize to a sample of cognitively intact community-dwelling participants recruited from senior living centers and independent assisted living facilities. These updated SRB prediction equations - being developed from a more medically "clean" sample of cognitively intact older adults who remained stable over 12 months - have the potential to provide a more accurate assessment of reliable change in an individual patient.

Equivalency and practice effects of alternative versions of the Edinburgh Cognitive and Behavioral ALS Screen (ECAS)

To examine the equivalency of ECAS versions A, B, and C in an Irish cohort, and to examine potential practice effects, 236 healthy controls were recruited through the Irish ALS control database. One hundred and seventy-six (176) controls completed ECAS version A, B, or C. Separately, 60 controls completed all three versions (A-B-C), consecutively, four months apart. TOST analysis found that ECAS A was equivalent to ECAS B and C. ECAS B and C were not statistically equivalent, however the difference between them was minimal. Participants showed improvement in ECAS performance over time, indicative of practice effects. Significant improvement was observed from time 1 to 2, but not from time 2 to 3. We propose Irish specific reliable change index (RCI) scores that take into consideration practice effects and measurement error. These thresholds will help quantify clinically meaningful cognitive decline in ALS patients, leading to improved quality of care.

ALS Cognitive Behavioral Screen (ALS-CBS): normative values for the Italian population and clinical usability

Amyotrophic lateral sclerosis (ALS) patients often express cognitive and behavioral dysfunctions within the so-called "frontotemporal spectrum disorders." Guidelines recommend screening of such dysfunctions, albeit only ALS dedicated tools are eventually suitable, due to the profound motor limitations induced by the disease. ALS Cognitive Behavioral Screen (ALS-CBS) is such a screening tool but normative data are not available, limiting its widespread implementation. Our aim consisted in producing normative data for the Italian version of the ALS-CBS. The scale was administered to n = 458 healthy controls with different age and education. Following translation and back translation of the original version of the test, normative data and correction scores for the ALS-CBS cognitive subtest (ALS-CBSci) were generated. Furthermore, n = 100 ALS consecutive outpatients with a wide range of cognitive and motor severity underwent to the ALS-CBS, besides FAB and Weigl sorting test (WST), in order to check its usability. Completion rate was 100% for ALS-CBS and WST, and 68% for the FAB. Corrected ALS-CBS scores showed 12% detection rate of significant cognitive dysfunction with a moderate kappa with FAB and WST. For the ALS-CBS behavioral subtest (ALS-CBSbi), a caregiver was available for n = 81 ALS patients and asked to complete the subset. The detection rate for behavioral dysfunction was 55.5%, and a mild correlation between with the Caregiver Burden Inventory was present (r = - 0.26, p = 0.04). In conclusion, we offer here normative data for the ALS-CBS, a handy tool for screening frontotemporal spectrum dysfunctions in ALS patients, and confirm its usability and validity in an outpatient setting.

Clinical audit research and evaluation of motor neuron disease (CARE-MND): a national electronic platform for prospective, longitudinal monitoring of MND in Scotland

Objectives: Launched in 1989, the Scottish Motor Neuron Disease Register (SMNDR) has provided a resource for prospective clinical data collection. However, in 2015 we aimed to evolve a system to allow: i) A patient-centered approach to care based on recognized standards, ii) Harmonized data sharing between Scottish health professionals in "real-time", iii) Regular audit of care to facilitate timely improvements in service delivery, and iv) Patient participation in a diverse range of observational and interventional research studies including clinical trials. Methods: We developed a standardized national electronic data platform-Clinical Audit Research and Evaluation of MND (CARE-MND) which integrates clinical audit and research data fields. Data completion pre- and post-CARE-MND were compared, guided by recently published National Institute for Clinical Excellence (NICE) recommendations. Statistical difference in data capture between time periods was assessed using Z-test of proportions. Results: Data field completion for the historical 2011-2014 period ranged from 4 to 95%; median 50%. CARE-MND capture ranged from 32 to 98%; median 87%. 15/17 fields were significantly more complete post-CARE-MND (p < 0.001). All MND nurse/allied health specialists in Scotland use the CARE-MND platform. Management of MND in Scotland is now coordinated through a standardized template. Conclusions: Through CARE-MND, national audits of MND care and interventions have been possible, leading to protocols for harmonized service provision. Stratification of the MND population is facilitating participation in observational and interventional studies. CARE-MND can act as a template for other neurological disorders.

Palliative care in motor neurone disease: where are we now?

Palliative care has a very important role in the care of patients with motor neurone disease and their families. There is increasing emphasis on the multidisciplinary assessment and support of patients within guidelines, supported by research. This includes the telling of the diagnosis, the assessment and management of symptoms, consideration of interventions, such as gastrostomy and ventilatory support, and care at the end of life. The aim of palliative care is to enable patients, and their families, to maintain as good a quality of life as possible and helping to ensure a peaceful death.