Accuracy and reproducibility of automated white matter hyperintensities segmentation with lesion segmentation tool: A European multi-site 3T study

Brain vascular damage accumulate in aging and often manifest as white matter hyperintensities (WMHs) on MRI. Despite increased interest in automated methods to segment WMHs, a gold standard has not been achieved and their longitudinal reproducibility has been poorly investigated. The aim of present work is to evaluate accuracy and reproducibility of two freely available segmentation algorithms. A harmonized MRI protocol was implemented in 3T-scanners across 13 European sites, each scanning five volunteers twice (test-retest) using 2D-FLAIR. Automated segmentation was performed using Lesion segmentation tool algorithms (LST): the Lesion growth algorithm (LGA) in SPM8 and 12 and the Lesion prediction algorithm (LPA). To assess reproducibility, we applied the LST longitudinal pipeline to the LGA and LPA outputs for both the test and retest scans. We evaluated volumetric and spatial accuracy comparing LGA and LPA with manual tracing, and for reproducibility the test versus retest. Median volume difference between automated WMH and manual segmentations (mL) was -0.22[IQR = 0.50] for LGA-SPM8, -0.12[0.57] for LGA-SPM12, -0.09[0.53] for LPA, while the spatial accuracy (Dice Coefficient) was 0.29[0.31], 0.33[0.26] and 0.41[0.23], respectively. The reproducibility analysis showed a median reproducibility error of 20%[IQR = 41] for LGA-SPM8, 14% [31] for LGA-SPM12 and 10% [27] with the LPA cross-sectional pipeline. Applying the LST longitudinal pipeline, the reproducibility errors were considerably reduced (LGA: 0%[IQR = 0], p < 0.001; LPA: 0% [3], p < 0.001) compared to those derived using the cross-sectional algorithms. The DC using the longitudinal pipeline was excellent (median = 1) for LGA [IQR = 0] and LPA [0.02]. LST algorithms showed moderate accuracy and good reproducibility. Therefore, it can be used as a reliable cross-sectional and longitudinal tool in multi-site studies.

Amygdalar nuclei and hippocampal subfields on MRI: Test-retest reliability of automated volumetry across different MRI sites and vendors

BACKGROUND

The amygdala and the hippocampus are two limbic structures that play a critical role in cognition and behavior, however their manual segmentation and that of their smaller nuclei/subfields in multicenter datasets is time consuming and difficult due to the low contrast of standard MRI. Here, we assessed the reliability of the automated segmentation of amygdalar nuclei and hippocampal subfields across sites and vendors using FreeSurfer in two independent cohorts of older and younger healthy adults.

METHODS

Sixty-five healthy older (cohort 1) and 68 younger subjects (cohort 2), from the PharmaCog and CoRR consortia, underwent repeated 3D-T1 MRI (interval 1-90 days). Segmentation was performed using FreeSurfer v6.0. Reliability was assessed using volume reproducibility error (ε) and spatial overlapping coefficient (DICE) between test and retest session.

RESULTS

Significant MRI site and vendor effects (p ​< ​.05) were found in a few subfields/nuclei for the ε, while extensive effects were found for the DICE score of most subfields/nuclei. Reliability was strongly influenced by volume, as ε correlated negatively and DICE correlated positively with volume size of structures (absolute value of Spearman's r correlations >0.43, p ​< ​1.39E-36). In particular, volumes larger than 200 ​mm³ (for amygdalar nuclei) and 300 ​mm³ (for hippocampal subfields, except for molecular layer) had the best test-retest reproducibility (ε ​< ​5% and DICE ​> ​0.80).

CONCLUSION

Our results support the use of volumetric measures of larger amygdalar nuclei and hippocampal subfields in multisite MRI studies. These measures could be useful for disease tracking and assessment of efficacy in drug trials.

[Cerebrospinal fluid protein tau levels in the differential diagnosis of Alzheimer's disease]

Tau protein concentration in cerebrospinal fluid was determined in 55 patients with Alzheimer's disease (AD), 18 patients with vascular dementia (VD), 19 patients with dementia caused by other disorders and 14 patients with major depression. Significantly (p < 0.05) elevated protein tau concentrations were found in AD patients (564.5 +/- 275.5 pg/ml) compared to all other patient groups (VD: 406.5 +/- 263.9 pg/ml; other dementia: 275.0 +/- 135.4 pg/ml; depression: 212.9 +/- 115.6 pg/ml). However, tau levels in AD patients covered a broad range (163.2 pg/ml-1200 pg/ml). AD patients with tau levels below the 25%-percentile of the distribution (among them a high percentage of patients with presenile onset) showed tau levels similar to those of the patients with late life depression. No significant correlations between tau levels and clinical variables such as severity of dementia, age, age of onset, duration of illness, and cerebral changes as assessed by volumetric magnetic resonance imaging could be demonstrated. Similarly, we could not find an influence of either APO-E genotype or psychotropic medication on the tau levels in AD patients. In accordance with other studies our results confirm elevated tau levels in AD compared to elderly not demented control subjects. Comparing groups, this finding applies as well with respect to VD and other dementing disorders. However, elevated tau levels cannot be detected in a subgroup of AD patients. This finding needs to be further investigated in future studies.