Patch-based label fusion segmentation of brainstem structures with dual-contrast MRI for Parkinson's disease

High-resolution atlasing and segmentation of the subcortex: Review and perspective on challenges and opportunities created by machine learning

This paper reviews almost three decades of work on atlasing and segmentation methods for subcortical structures in human brain MRI. In writing this survey, we have three distinct aims. First, to document the evolution of digital subcortical atlases of the human brain, from the early MRI templates published in the nineties, to the complex multi-modal atlases at the subregion level that are available today. Second, to provide a detailed record of related efforts in the automated segmentation front, from earlier atlas-based methods to modern machine learning approaches. And third, to present a perspective on the future of high-resolution atlasing and segmentation of subcortical structures in in vivo human brain MRI, including open challenges and opportunities created by recent developments in machine learning.

A Multi-Atlas-Based [18F]9-Fluoropropyl-(+)-Dihydrotetrabenazine Positron Emission Tomography Image Segmentation Method for Parkinson's Disease Quantification

Objectives

[18F]9-fluoropropyl-(+)-dihydrotetrabenazine ([18F]-FP-DTBZ) positron emission tomography (PET) provides reliable information for the diagnosis of Parkinson's disease (PD). In this study, we proposed a multi-atlas-based [18F]-FP-DTBZ PET image segmentation method for PD quantification assessment.

Methods

A total of 99 subjects from Xuanwu Hospital of Capital Medical University were included in this study, and both brain PET and magnetic resonance (MR) scans were conducted. Data from 20 subjects were used to generate atlases, based on which a multi-atlas-based [18F]-FP-DTBZ PET segmentation method was developed especially for striatum and its subregions. The proposed method was compared with the template-based method through striatal subregion parcellation performance and the standard uptake value ratio (SUVR) quantification accuracy. Discriminant analysis between healthy controls (HCs) and PD patients was further performed.

Results

Segmentation results of the multi-atlas-based method showed better consistency than the template-based method with the ground truth, yielding a dice coefficient of 0.81 over 0.73 on the full striatum. The SUVRs calculated by the multi-atlas-based method had an average interclass correlation coefficient (ICC) of 0.953 with the standardized result, whereas the template-based method only reached 0.815. The SUVRs of HCs were generally higher than that of patients with PD and showed significant differences in all of the striatal subregions (all p < 0.001). The median and posterior putamen performed best in discriminating patients with PD from HCs.

Conclusion

The proposed multi-atlas-based [18F]-FP-DTBZ PET image segmentation method achieved better performance than the template-based method, indicating great potential in improving accuracy and efficiency for PD diagnosis in clinical routine.

Image Guidance in Deep Brain Stimulation Surgery to Treat Parkinson's Disease: A Comprehensive Review

Deep brain stimulation (DBS) is an effective therapy as an alternative to pharmaceutical treatments for Parkinson's disease (PD). Aside from factors such as instrumentation, treatment plans, and surgical protocols, the success of the procedure depends heavily on the accurate placement of the electrode within the optimal therapeutic targets while avoiding vital structures that can cause surgical complications and adverse neurologic effects. Although specific surgical techniques for DBS can vary, interventional guidance with medical imaging has greatly contributed to the development, outcomes, and safety of the procedure. With rapid development in novel imaging techniques, computational methods, and surgical navigation software, as well as growing insights into the disease and mechanism of action of DBS, modern image guidance is expected to further enhance the capacity and efficacy of the procedure in treating PD. This article surveys the state-of-the-art techniques in image-guided DBS surgery to treat PD, and discusses their benefits and drawbacks, as well as future directions on the topic.

pBrain: A novel pipeline for Parkinson related brain structure segmentation

•

A novel pipeline for Parkinson`s disease structure segmentation is presented.

•

State-of-the-art fast multiatlas patch-based label fusion with systematic error correction is used to accurately and efficiently produce very competitive results in around 5 min.

•

The proposed pipeline works at high resolution (0.5 mm) but it can work also with standard resolution (1 mm) T2 images allowing the analysis of large legacy databases.

•

The proposed pipeline will be made publically available online through our volBrain platform.

Parkinson is a very prevalent neurodegenerative disease impacting the life of millions of people worldwide. Although its cause remains unknown, its functional and structural analysis is fundamental to advance in the search of a cure or symptomatic treatment. The automatic segmentation of deep brain structures related to Parkinson`s disease could be beneficial for the follow up and treatment planning. Unfortunately, there is not broadly available segmentation software to automatically measure Parkinson related structures. In this paper, we present a novel pipeline to segment three deep brain structures related to Parkinson's disease (substantia nigra, subthalamic nucleus and red nucleus). The proposed method is based on the multi-atlas label fusion technology that works on standard and high-resolution T2-weighted images. The proposed method also includes as post-processing a new neural network-based error correction step to minimize systematic segmentation errors. The proposed method has been compared to other state-of-the-art methods showing competitive results in terms of accuracy and execution time.

Multi-modal imaging with specialized sequences improves accuracy of the automated subcortical grey matter segmentation

The basal ganglia and limbic system, particularly the thalamus, putamen, internal and external globus pallidus, substantia nigra, and sub-thalamic nucleus, comprise a clinically relevant signal network for Parkinson's disease. In order to manually trace these structures, a combination of high-resolution and specialized sequences at 7 T are used, but it is not feasible to routinely scan clinical patients in those scanners. Targeted imaging sequences at 3 T have been presented to enhance contrast in a select group of these structures. In this work, we show that a series of atlases generated at 7 T can be used to accurately segment these structures at 3 T using a combination of standard and optimized imaging sequences, though no one approach provided the best result across all structures. In the thalamus and putamen, a median Dice Similarity Coefficient (DSC) over 0.88 and a mean surface distance <1.0 mm were achieved using a combination of T1 and an optimized inversion recovery imaging sequences. In the internal and external globus pallidus a DSC over 0.75 and a mean surface distance <1.2 mm were achieved using a combination of T1 and inversion recovery imaging sequences. In the substantia nigra and sub-thalamic nucleus a DSC of over 0.6 and a mean surface distance of <1.0 mm were achieved using the inversion recovery imaging sequence. On average, using T1 and optimized inversion recovery together significantly improved segmentation results than over individual modality (p < 0.05 Wilcoxon sign-rank test).

Dynamic Atlas-Based Segmentation and Quantification of Neuromelanin-Rich Brainstem Structures in Parkinson Disease

We present a dynamic atlas composed of neuromelanin-enhanced magnetic resonance brain images of 40 healthy subjects. The performance of this atlas is evaluated on the fully automated segmentation of two paired neuromelanin-rich brainstem healthy structures: the substantia nigra pars compacta and the locus coeruleus. We show that our dynamic atlas requires in average 60% less images and, therefore, 60% less computation time than a static multi-image atlas while achieving a similar segmentation performance. Then, we show that by applying our dynamic atlas, composed of healthy subjects, to the segmentation and neuromelanin quantification of a set of brain images of 39 Parkinson disease patients, we are able to find significant quantitative differences in the level of neuromelanin between healthy subjects and Parkinson disease patients, thus opening the door to the use of these structures as image biomarkers in future computer aided diagnosis systems for the diagnosis of Parkinson disease.

Automatic localization of the subthalamic nucleus on patient-specific clinical MRI by incorporating 7 T MRI and machine learning: Application in deep brain stimulation

Deep brain stimulation (DBS) of the subthalamic nucleus (STN) has shown clinical potential for relieving the motor symptoms of advanced Parkinson's disease. While accurate localization of the STN is critical for consistent across-patients effective DBS, clear visualization of the STN under standard clinical MR protocols is still challenging. Therefore, intraoperative microelectrode recordings (MER) are incorporated to accurately localize the STN. However, MER require significant neurosurgical expertise and lengthen the surgery time. Recent advances in 7 T MR technology facilitate the ability to clearly visualize the STN. The vast majority of centers, however, still do not have 7 T MRI systems, and fewer have the ability to collect and analyze the data. This work introduces an automatic STN localization framework based on standard clinical MRIs without additional cost in the current DBS planning protocol. Our approach benefits from a large database of 7 T MRI and its clinical MRI pairs. We first model in the 7 T database, using efficient machine learning algorithms, the spatial and geometric dependency between the STN and its adjacent structures (predictors). Given a standard clinical MRI, our method automatically computes the predictors and uses the learned information to predict the patient-specific STN. We validate our proposed method on clinical T2 W MRI of 80 subjects, comparing with experts-segmented STNs from the corresponding 7 T MRI pairs. The experimental results show that our framework provides more accurate and robust patient-specific STN localization than using state-of-the-art atlases. We also demonstrate the clinical feasibility of the proposed technique assessing the post-operative electrode active contact locations.

Optimization and comparative evaluation of nonlinear deformation algorithms for atlas-based segmentation of DBS target nuclei

Nonlinear registration of individual brain MRI scans to standard brain templates is common practice in neuroimaging and multiple registration algorithms have been developed and refined over the last 20 years. However, little has been done to quantitatively compare the available algorithms and much of that work has exclusively focused on cortical structures given their importance in the fMRI literature. In contrast, for clinical applications such as functional neurosurgery and deep brain stimulation (DBS), proper alignment of subcortical structures between template and individual space is important. This allows for atlas-based segmentations of anatomical DBS targets such as the subthalamic nucleus (STN) and internal pallidum (GPi). Here, we systematically evaluated the performance of six modern and established algorithms on subcortical normalization and segmentation results by calculating over 11,000 nonlinear warps in over 100 subjects. For each algorithm, we evaluated its performance using T1-or T2-weighted acquisitions alone or a combination of T1-, T2-and PD-weighted acquisitions in parallel. Furthermore, we present optimized parameters for the best performing algorithms. We tested each algorithm on two datasets, a state-of-the-art MRI cohort of young subjects and a cohort of subjects age- and MR-quality-matched to a typical DBS Parkinson's Disease cohort. Our final pipeline is able to segment DBS targets with precision comparable to manual expert segmentations in both cohorts. Although the present study focuses on the two prominent DBS targets, STN and GPi, these methods may extend to other small subcortical structures like thalamic nuclei or the nucleus accumbens.

Population-averaged MRI atlases for automated image processing and assessments of lumbar paraspinal muscles

PURPOSE

Growing evidence suggests an association between lumbar paraspinal muscle degeneration and low back pain (LBP). Currently, time-consuming and laborious manual segmentations of paraspinal muscles are commonly performed on magnetic resonance imaging (MRI) axial scans. Automated image analysis algorithms can mitigate these drawbacks, but they often require individual MRIs to be aligned to a standard "reference" atlas. Such atlases are well established in automated neuroimaging analysis. Our aim was to create atlases of similar nature for automated paraspinal muscle measurements.

METHODS

Lumbosacral T2-weighted MRIs were acquired from 117 patients who experienced LBP, stratified by gender and age group (30-39, 40-49, and 50-59 years old). Axial MRI slices of the L4-L5 and L5-S1 levels at mid-disc were obtained and aligned using group-wise linear and nonlinear image registration to produce a set of unbiased population-averaged atlases for lumbar paraspinal muscles.

RESULTS

The resulting atlases represent the averaged morphology and MRI intensity features of the corresponding cohorts. Differences in paraspinal muscle shapes and fat infiltration levels with respect to gender and age can be visually identified from the population-averaged data from both linear and nonlinear registrations.

CONCLUSION

We constructed a set of population-averaged atlases for developing automated algorithms to help analyze paraspinal muscle morphometry from axial MRI scans. Such an advancement could greatly benefit the fields of paraspinal muscle and LBP research. These slides can be retrieved under Electronic Supplementary Material.

Classification of Alzheimer's Disease Using Whole Brain Hierarchical Network

Regions of interest (ROIs) based classification has been widely investigated for analysis of brain magnetic resonance imaging (MRI) images to assist the diagnosis of Alzheimer's disease (AD) including its early warning and developing stages, e.g., mild cognitive impairment (MCI) including MCI converted to AD (MCIc) and MCI not converted to AD (MCInc). Since an ROI representation of brain structures is obtained either by pre-definition or by adaptive parcellation, the corresponding ROI in different brains can be measured. However, due to noise and small sample size of MRI images, representations generated from single or multiple ROIs may not be sufficient to reveal the underlying anatomical differences between the groups of disease-affected patients and health controls (HC). In this paper, we employ a whole brain hierarchical network (WBHN) to represent each subject. The whole brain of each subject is divided into 90, 54, 14, and 1 regions based on Automated Anatomical Labeling (AAL) atlas. The connectivity between each pair of regions is computed in terms of Pearson's correlation coefficient and used as classification feature. Then, to reduce the dimensionality of features, we select the features with higher scores. Finally, we use multiple kernel boosting (MKBoost) algorithm to perform the classification. Our proposed method is evaluated on MRI images of 710 subjects (200 AD, 120 MCIc, 160 MCInc, and 230 HC) from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The experimental results show that our proposed method achieves an accuracy of 94.65 percent and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.954 for AD/HC classification, an accuracy of 89.63 percent and an AUC of 0.907 for AD/MCI classification, an accuracy of 85.79 percent and an AUC of 0.826 for MCI/HC classification, and an accuracy of 72.08 percent and an AUC of 0.716 for MCIc/MCInc classification, respectively. Our results demonstrate that our proposed method is efficient and promising for clinical applications for the diagnosis of AD via MRI images.

A comparison of accurate automatic hippocampal segmentation methods

The hippocampus is one of the first brain structures affected by Alzheimer's disease (AD). While many automatic methods for hippocampal segmentation exist, few studies have compared them on the same data. In this study, we compare four fully automated hippocampal segmentation methods in terms of their conformity with manual segmentation and their ability to be used as an AD biomarker in clinical settings. We also apply error correction to the four automatic segmentation methods, and complete a comprehensive validation to investigate differences between the methods. The effect size and classification performance is measured for AD versus normal control (NC) groups and for stable mild cognitive impairment (sMCI) versus progressive mild cognitive impairment (pMCI) groups. Our study shows that the nonlinear patch-based segmentation method with error correction is the most accurate automatic segmentation method and yields the most conformity with manual segmentation (κ=0.894). The largest effect size between AD versus NC and sMCI versus pMCI is produced by FreeSurfer with error correction. We further show that, using only hippocampal volume, age, and sex as features, the area under the receiver operating characteristic curve reaches up to 0.8813 for AD versus NC and 0.6451 for sMCI versus pMCI. However, the automatic segmentation methods are not significantly different in their performance.

Multi-atlas segmentation of biomedical images: A survey

Multi-atlas segmentation (MAS), first introduced and popularized by the pioneering work of Rohlfing, et al. (2004), Klein, et al. (2005), and Heckemann, et al. (2006), is becoming one of the most widely-used and successful image segmentation techniques in biomedical applications. By manipulating and utilizing the entire dataset of "atlases" (training images that have been previously labeled, e.g., manually by an expert), rather than some model-based average representation, MAS has the flexibility to better capture anatomical variation, thus offering superior segmentation accuracy. This benefit, however, typically comes at a high computational cost. Recent advancements in computer hardware and image processing software have been instrumental in addressing this challenge and facilitated the wide adoption of MAS. Today, MAS has come a long way and the approach includes a wide array of sophisticated algorithms that employ ideas from machine learning, probabilistic modeling, optimization, and computer vision, among other fields. This paper presents a survey of published MAS algorithms and studies that have applied these methods to various biomedical problems. In writing this survey, we have three distinct aims. Our primary goal is to document how MAS was originally conceived, later evolved, and now relates to alternative methods. Second, this paper is intended to be a detailed reference of past research activity in MAS, which now spans over a decade (2003-2014) and entails novel methodological developments and application-specific solutions. Finally, our goal is to also present a perspective on the future of MAS, which, we believe, will be one of the dominant approaches in biomedical image segmentation.

Rotation-invariant multi-contrast non-local means for MS lesion segmentation

Multiple sclerosis (MS) lesion segmentation is crucial for evaluating disease burden, determining disease progression and measuring the impact of new clinical treatments. MS lesions can vary in size, location and intensity, making automatic segmentation challenging. In this paper, we propose a new supervised method to segment MS lesions from 3D magnetic resonance (MR) images using non-local means (NLM). The method uses a multi-channel and rotation-invariant distance measure to account for the diversity of MS lesions. The proposed segmentation method, rotation-invariant multi-contrast non-local means segmentation (RMNMS), captures the MS lesion spatial distribution and can accurately and robustly identify lesions regardless of their orientation, shape or size.

An internal validation on a large clinical magnetic resonance imaging (MRI) dataset of MS patients demonstrated a good similarity measure result (Dice similarity = 60.1% and sensitivity = 75.4%), a strong correlation between expert and automatic lesion load volumes (R² = 0.91), and a strong ability to detect lesions of different sizes and in varying spatial locations (lesion detection rate = 79.8%). On the independent MS Grand Challenge (MSGC) dataset validation, our method provided competitive results with state-of-the-art supervised and unsupervised methods. Qualitative visual and quantitative voxel- and lesion-wise evaluations demonstrated the accuracy of RMNMS method.

•

We propose a new multi-channel MS lesion segmentation technique.

•

We adapt for lesion segmentation the non-local means operator to account for multi-contrast and rotation-invariant distance.

•

The proposed method presents highly competitive results compared to state-of-the-art methods.

•

The proposed method provides segmentation quality near inter-rater variability for MS lesion segmentation.

•

Our non-local approach is able to detect structures that vary in size, shape and location such as MS lesions.