Italian adaptation of the Beaumont Behavioral Inventory (BBI): psychometric properties and clinical usability

Ecological validity of performance-based cognitive screeners in amyotrophic lateral sclerosis: preliminary evidence

BACKGROUND

This study aimed at preliminarily assessing, in a cohort of non-demented amyotrophic lateral sclerosis (ALS) patients, the ecological validity, and more specifically the veridicality, of the Edinburgh Cognitive and Behavioural ALS Screen (ECAS) and the ALS Cognitive Behavioral Screen (ALS-CBS™), by relating their scores to caregiver-report ratings of cognitive changes.

METHODS

N = 147 patient-caregiver dyads were recruited. Patients were administered the ECAS and ALS-CBS™, whilst caregiver the Caregiver Behavioral Questionnaire (CBQ) and Beaumont Behavioural Inventory (BBI). An Ecological Cognitive Functioning Index (ECFI) was derived from those items of the CBQ and BBI that tap on executive and language changes. Ecological validity was assessed via both correlational and predictive analyses net of caregiver-rated behavioural changes (as assessed by the ECAS-Carer Interview).

RESULTS

The ECFI was associated with the total scores on both the ECAS (p = .014) and ALS-CBS™ (p = .017). When looking at ECAS and ALS-CBS™ subscales, those assessing verbal fluency were selectively associated with the ECFI. The ECFI was higher in patients performing defectively on the ECAS (p = .004) and on the ALS-CBS™ (p = .027).

DISCUSSION

This study suggests that both the ECAS and the ALS-CBS™ represent a valid estimate of non-demented ALS patients' cognitive status in the real world, also highlighting the clinical relevance of cognitive changes reported by caregivers.

Frontotemporal-spectrum disorders and functional independence in non-demented ALS patients

BACKGROUND

The present study aimed at determining whether, net of motor confounders, neuropsychological features affect functional independence (FI) in activities of daily living (ADLs) in non-demented amyotrophic lateral sclerosis (ALS) patients.

METHODS

N = 88 ALS patients without frontotemporal dementia were assessed for FI-Katz's Basic ADL Scale (BADL) and Lawton-Brody's Instrumental ADL Scale (IADL)-, cognition-Edinburgh Cognitive and Behavioural ALS Screen (ECAS)-and behaviour-Beaumont Behavioural Inventory and Dimensional Apathy Scale. The association between cognitive and behavioural measures and BADL/IADL scores was assessed by covarying for demographics, anxiety and depression levels, disease duration and motor confounders-i.e. ALS Functional Rating Scale-Revised (ALSFRS-R) scores, progression rate and both King's and Milano-Torino stages.

RESULTS

Higher scores on the ECAS-Language were associated with higher IADL scores (p = 0.005), whilst higher apathetic features-as measured by the Dimensional Apathy Scale (DAS)-were inversely related to the BADL (p = 0.003). Whilst IADL scores were related to all ECAS-Language tasks, the DAS-Initiation was the only subscale associated with BADL scores. Patients with abnormal ECAS-Language (p = 0.023) and DAS (p = 0.008) scores were more functionally dependent than those without.

DISCUSSION

Among non-motor features, language changes and apathetic features detrimentally affect FI in non-demented ALS patients.

What is the extent of reliability and validity evidence for screening tools for cognitive and behavioral change in people with ALS? A systematic review

Objective: This systematic review provides an updated summary of the existing literature on the validity of screening tools for cognitive and behavioral impairment in people with Amyotrophic Lateral Sclerosis (pwALS), and also focuses on their reliability. Method: The following cognitive and behavioral screening tools were assessed in this review: the Edinburgh Cognitive and Behavioral ALS Screen (ECAS); the ALS Cognitive Behavioral Screen (ALS-CBS), the Mini Addenbrooke's Cognitive Examination (Mini-ACE), the Beaumont Behavioral Interview (BBI); the MND Behavior Scale (MiND-B); and the ALS-FTD Questionnaire (ALS-FTD-Q). A search, using Medline, PsychINFO and Embase (21/09/2023), generated 37 results after exclusion criteria were applied. Evidence of internal consistency, item-total correlations, inter-rater reliability, clinical validity, convergent validity, and structural validity were extracted and assessed and risk of bias was evaluated. Results: The cognitive component of the ECAS was the tool with most evidence of reliability and validity for the assessment of cognitive impairment in ALS. It is well-suited to accommodate physical symptoms of ALS. For behavioral assessment, the BBI or ALS-FTD-Q had the most evidence of reliability and validity. The BBI is more thorough, but the ALS-FTD-Q is briefer. Conclusions: There is good but limited evidence for the reliability and validity of cognitive and behavioral screens. Further evidence of clinical and convergent validity would increase confidence in their clinical and research use.

The Beaumont behavioral intervention in a Chinese amyotrophic lateral sclerosis cohort

OBJECTIVE

The prevalence of behavior impairment (27.38%) in the Chinese amyotrophic lateral sclerosis (ALS) cohort is lower. We hypothesize that the screening scales used among studies might not be appropriate to diagnose behavioral disorders in ALS patients. So, we urgently need to find a behavior scale with a high detection rate designed specifically for ALS. This study aims to verify the Chinese translation of the Beaumont Behavioral Inventory (BBI) as an effective assessment in a Chinese ALS cohort.

METHODS

Ninety-eighty ALS patients and ninety-three healthy controls were included in this cross-sectional study. All participants took emotional state, overall cognitive, sleep quality and gastroenteric function, and behavioral evaluation.

RESULTS

The BBI scores showed a strong association with the amyotrophic lateral sclerosis-Frontotemporal Dementia-Questionnaire (ALS-FTD-Q) (rs = 0.71, p < 0.001) as well as a moderate correlation with the Frontal Behavioral Inventory (FBI) (rs = 0.55, p < 0.001). High internal consistency was demonstrated in patients using BBI-after items (Cronbach's a = 0.89). When tested against clinical diagnoses, the optimal cutoff of total BBI score was identified at 5.5 (AUC = 0.95; SE = 0.02; 95% CI [0.91, 0.99]), the BBI reached optimal sensitivity and specificity values (91.5% and 87.2%). The BBI turned out to be more precise than the FBI (AUC = 0.76; SE = 0.05; 95% CI [0.66, 0.86]) and the ALS-FTD-Q (AUC = 0.84; SE = 0.04; 95% CI [0.77, 0.92]).

CONCLUSION

The Chinese version of BBI is a quicker and more efficient instrument for assessing behavioral impairment in the ALS population in China.

An exploratory study on counterfactual thinking in amyotrophic lateral sclerosis

Objectives

This study aimed at exploring (1) the motor and non-motor correlates of counterfactual thinking (CFT) abilities in non-demented amyotrophic lateral sclerosis (ALS) patients and (2) the ability of CFT measures to discriminate these patients from healthy controls (HCs) and patients with and without cognitive impairment.

Methods

N = 110 ALS patients and N = 51 HCs were administered two CFT tasks, whose sum, resulting in a CFT Index (CFTI), was addressed as the outcome. Patients further underwent an in-depth cognitive, behavioral, and motor-functional evaluation. Correlational analyses were run to explore the correlates of the CFTI in patients. Logistic regressions were performed to test whether the CFTI could discriminate patients from HCs.

Results

The CFTI was selectively associated (p ≤ 0.005) with fluency and memory subscales of the Edinburgh Cognitive and Behavioral ALS Screen (ECAS), but not with other variables. CFTI scores discriminated patients from HCs (p < 0.001) with high accuracy (82%), but not patients with a normal vs. defective performance on the ECAS-Total.

Conclusion

CFT measures in non-demented ALS patients were associated with verbal fluency and memory functions, and they were also able to discriminate them from HCs.

Clinical usability of the Story-Based Empathy Task (SET) in non-demented ALS patients

BACKGROUND

This study aimed at assessing the clinical usability of the Story-Based Empathy Task (SET) in non-demented amyotrophic lateral sclerosis (ALS) patients.

METHODS

N = 106 non-demented ALS patients and N = 101 healthy controls (HCs) were administered the SET, which includes three subtests assessing Emotion Attribution (SET-EA), Intention Attribution (SET-IA) and causal inference (SET-CI) - the latter being a control task. Patients also underwent the Reading the Mind in the Eyes Test (RMET), the Edinburgh Cognitive and Behavioural ALS Screen (ECAS) and a thorough behavioural and motor-functional evaluation. The diagnostics of the SET-EA and -IA were tested against a defective performance on the RMET. The association between SET subtests and cognitive/behavioural outcomes was examined net of demographic and motor-functional confounders. Case-control discrimination was explored for each SET subtest.

RESULTS

Demographically adjusted SET-EA and -IA scores accurately detected defective RMET performances at the optimal cutoffs of <3.04 (AUC = .84) and <3.61 (AUC = .88), respectively. By contrast, the SET-CI performed poorly in doing so (AUC = .58). The SET-EA converged with the RMET, as well as with ECAS-Executive and -Memory scores, whilst the SET-IA was unrelated to cognitive measures (including the RMET); the SET-CI was related to the ECAS-Language the ECAS-Executive. SET subscores were unrelated to behavioural outcomes. Only the SET-EA discriminated patients from HCs.

CONCLUSIONS

The SET as a whole should not be addressed as a social-cognitive measure in this population. At variance, its subtest tapping on emotional processing - i.e., the SET-EA - is recommended for use as an estimate of social-cognitive abilities in non-demented ALS patients.

Diagnostic properties of the Italian ECAS Carer Interview (ECAS-CI)

BACKGROUND

This study aimed at providing diagnostic properties and normative cut-offs for the Italian ECAS Carer Interview (ECAS-CI).

MATERIALS

N = 292 non-demented ALS patients and N = 107 healthy controls (HCs) underwent the ECAS-CI and the Frontal Behavioural Inventory (FBI). Two ECAS-CI measures were addressed: (1) the number of symptoms (NoS; range = 0-13) and (2) that of individual symptom clusters (SC; range = 0-6). Diagnostics were explored against an FBI score ≥ than the 95th percentile of the patients' distribution.

RESULTS

Both the NoS and SC discriminated patient from HCs. High accuracy, sensitivity, and specificity were detected for both the NoS and SC; however, at variance with SC, the NoS showed better post-test features and did not overestimate the occurrence of behavioural changes. The ECAS-CI converged with the FBI and diverged from the cognitive section of the ECAS.

DISCUSSION

The ECAS-CI is a suitable screener for behavioural changes in ALS patients, with the NoS being its best outcome measure (cut-off: ≥ 3).

Standardization of the Italian ALS-CBS™ Caregiver Behavioral Questionnaire

Background

The present investigation aimed at testing the psychometrics and diagnostics of the Italian version of the Caregiver Behavioral Questionnaire (CBQ) from the ALS Cognitive Behavioral Screen (ALS-CBS™), as well as its case-control discrimination, in a cohort of non-demented patients with ALS.

Methods

The caregivers of N = 265 non-demented patients with ALS and N = 99 healthy controls (HCs) were administered the CBQ and the Edinburgh Cognitive and Behavioural ALS Screen-Carer Interview (ECAS-CI). For N = 98 patients, an in-depth behavioural/psychopathological assessment via the Frontal Behavioural Inventory (FBI), the Dimensional Apathy Scale (DAS), the State and Trait Anxiety Inventory-Form Y (STAI-Y), and the Beck Depression Inventory (BDI) was also available. Factorial and construct validity, internal reliability, and diagnostics against an abnormal ECAS-CI score were tested in patients. Case-control discrimination was explored through logistic regression.

Results

The CBQ was internally reliable (McDonald's ω = 0.90) and underpinned by a simple, unidimensional structure; it converged with ECAS-CI, FBI, and DAS scores and diverged from STAI-Y and BDI ones. A cutoff of ≤ 33 accurately detected abnormal ECAS-CI scores (AUC = 0.85), yielding optimal error- and information-based diagnostics. The CBQ was independent of demographic and disease-related variables and discriminated patients from HCs (p < 0.001).

Discussion

The Italian version of the CBQ from the ALS-CBS™ is a valid, reliable, diagnostically sound, and feasible screener for detecting frontotemporal-like behavioural changes in non-demented patients with ALS. Its adoption is thus recommended within clinical practice and research in the view of providing preliminary information on whether the administration of more extensive behavioural instruments is needed.

Cognition and motor phenotypes in ALS: a retrospective study

Background

Amyotrophic lateral sclerosis (ALS) is phenotypically heterogeneous in motor manifestations, and the extent of upper vs. lower motor neuron involvement is a widespread descriptor. This study aimed to examine cognition across different ALS motor phenotypes.

Methods

ALS patients (N = 124) were classified as classical (N = 66), bulbar (N = 13), predominant-upper motor neuron (PUMN; N = 19), and predominant-lower motor neuron (PLMN; N = 26) phenotypes. Cognition was assessed with the Edinburgh Cognitive and Behavioural ALS Screen (ECAS) and function with the ALS Functional Rating Scale—Revised (ALSFRS-R). Revised ALS-FTD consensus criteria were applied for cognitive/behavioral phenotyping.

Results

Defective ECAS-total scores were detected in all groups — bulbar: 15.4%, classical: 30.3%, PLMN: 23.1%, and PUMN: 36.8%. Classical and PUMN ALS patients performed worse than PLMN ones on ECAS-total, ALS-specific, Fluency, and Executive measures. No other difference was detected. Worse ASLFRS-R scores correlated with poorer ECAS-total scores in classical ALS patients.

Conclusions

Frontotemporal cognitive deficits are more prevalent in PUMN and classical ALS and linked to disease severity in the latter, but occur also in PLMN phenotypes.

Supplementary information

The online version contains supplementary material available at 10.1007/s10072-022-06157-x

Psychometrics, diagnostics and usability of Italian tools assessing behavioural and functional outcomes in neurological, geriatric and psychiatric disorders: a systematic review

Background

Psychometric instruments assessing behavioural and functional outcomes (BFIs) in neurological, geriatric and psychiatric populations are relevant towards diagnostics, prognosis and intervention. However, BFIs often happen not to meet methodological-statistical standards, thus lowering their level of recommendation in clinical practice and research. This work thus aimed at (1) providing an up-to-date compendium on psychometrics, diagnostics and usability of available Italian BFIs and (2) delivering evidence-based information on their level of recommendation.

Methods

This review was pre-registered (PROSPERO ID: CRD42021295430) and performed according to PRISMA guidelines. Several psychometric, diagnostic and usability measures were addressed as outcomes. Quality assessment was performed via an ad hoc checklist, the Behavioural and Functional Instrument Quality Assessment.

Results

Out of an initial N = 830 reports, 108 studies were included (N = 102 BFIs). Target constructs included behavioural/psychiatric symptoms, quality of life and physical functioning. BFIs were either self- or caregiver-/clinician-report. Studies in clinical conditions (including neurological, psychiatric and geriatric ones) were the most represented. Validity was investigated for 85 and reliability for 80 BFIs, respectively. Criterion and factorial validity testing were infrequent, whereas content and ecological validity and parallel forms were almost never addressed. Item response theory analyses were seldom carried out. Diagnostics and norms lacked for about one-third of BFIs. Information on administration time, ease of use and ceiling/floor effects were often unreported.

Discussion

Several available BFIs for the Italian population do not meet adequate statistical-methodological standards, this prompting a greater care from researchers involved in their development.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10072-022-06300-8.

The Italian Version of the ALS Depression Inventory-12

Introduction: Depression is a comorbidity in patients with amyotrophic lateral sclerosis (ALS). However, its diagnosis is challenged by the co-occurrence of a similar frontotemporal (FT) behavioral symptom—i.e., apathy. Moreover, its psychometric evaluation is confounded by motor disabilities. This study aimed at investigating psychometric properties and feasibility of the ALS Depression Inventory (ADI-12), a self-report questionnaire set up for this issue—as measuring mood changes without referring to movement.

Methods: Eighty-five ALS patients were administered the ADI-12 and underwent cognitive (Mini-Mental State Examination, MMSE), quality of life (McGill Quality of Life Questionnaire, MQoL) and further anxiety/mood (Hospital Anxiety and Depression Scale, HADS) assessments. Reliability, validity, sensitivity, and specificity of the ADI-12 were explored.

Results: Principal component analyses revealed two related components—“Negative Mood and Lack of Energy” (ME) and “Anhedonia” (A). Both components and the inventory as a whole were internally consistent and highly related to HADS-D. ADI-12-total score was also associated with HADS-A. ADI-12 measures were inversely related to MQoL. ADI-12-total/sub-scales were not related to either MMSE or disease-related outcomes. Estimates of depression yielded by HADS-D and ADI-12 were 11.1 and 35.3%.

Discussion: The ADI-12 is a valid, reliable and usable feasibile tool to assess depression in Italian ALS patients independently from motor disabilities. Its interplay with psycho-social outcomes is in agreement with previous studies. The lack of association with cognition suggests that the ADI-12 is partially independent from FT spectrum disorders. The disagreement in depression rates between the ADI-12 and HADS-D suggests the need to ALS-specific mood scales.