1
|
Fu T, Yang J, Li Q, Ai D, Song H, Jiang Y, Wang Y, Frangi AF. Groupwise registration with global-local graph shrinkage in atlas construction. Med Image Anal 2020; 64:101711. [PMID: 32585570 DOI: 10.1016/j.media.2020.101711] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2018] [Revised: 01/16/2020] [Accepted: 04/18/2020] [Indexed: 11/30/2022]
Abstract
Graph-based groupwise registration methods are widely used in atlas construction. Given a group of images, a graph is built whose nodes represent the images, and whose edges represent a geodesic path between two nodes. The distribution of images on an image manifold is explored through edge traversal in a graph. The final atlas is a mean image at the population center of the distribution on the manifold. The procedure of warping all images to the mean image turns to dynamic graph shrinkage in which nodes become closer to each other. Most conventional groupwise registration frameworks construct and shrink a graph without considering the local distribution of images on the dataset manifold and the local structure variations between image pairs. Neglecting the local information fundamentally decrease the accuracy and efficiency when population atlases are built for organs with large inter-subject anatomical variabilities. To overcome the problem, this paper proposes a global-local graph shrinkage approach that can generate accurate atlas. A connected graph is constructed automatically based on global similarities across the images to explore the global distribution. A local image distribution obtained by image clustering is used to simplify the edges of the constructed graph. Subsequently, local image similarities refine the deformation estimated through global image similarity for each image warping along the graph edges. Through the image warping, the overall simplified graph shrinks gradually to yield the atlas with respecting both global and local features. The proposed method is evaluated on 61 synthetic and 20 clinical liver datasets, and the results are compared with those of six state-of-the-art groupwise registration methods. The experimental results show that the proposed method outperforms non-global-local method approaches in terms of accuracy.
Collapse
Affiliation(s)
- Tianyu Fu
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Jian Yang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China.
| | - Qin Li
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China
| | - Danni Ai
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Hong Song
- School of Software, Beijing Institute of Technology, Beijing 100081, China
| | - Yurong Jiang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Yongtian Wang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Alejandro F Frangi
- Centre for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB), School of Computing and School of Medicine, University of Leeds, Leeds, UK; Leeds Institute of Cardiovascular and Metabolic Medicine, School of Medicine, University of Leeds, Leeds, UK; Medical Imaging Research Center (MIRC), University Hospital Gasthuisberg. Cardiovascular Sciences and Electrical Engineering Departments, KU Leuven, Leuven, Belgium
| |
Collapse
|
2
|
Schipaanboord B, Boukerroui D, Peressutti D, van Soest J, Lustberg T, Dekker A, Elmpt WV, Gooding MJ. An Evaluation of Atlas Selection Methods for Atlas-Based Automatic Segmentation in Radiotherapy Treatment Planning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2654-2664. [PMID: 30969918 DOI: 10.1109/tmi.2019.2907072] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Atlas-based automatic segmentation is used in radiotherapy planning to accelerate the delineation of organs at risk (OARs). Atlas selection has been proposed as a way to improve the accuracy and execution time of segmentation, assuming that, the more similar the atlas is to the patient, the better the results will be. This paper presents an analysis of atlas selection methods in the context of radiotherapy treatment planning. For a range of commonly contoured OARs, a thorough comparison of a large class of typical atlas selection methods has been performed. For this evaluation, clinically contoured CT images of the head and neck ( N=316 ) and thorax ( N=280 ) were used. The state-of-the-art intensity and deformation similarity-based atlas selection methods were found to compare poorly to perfect atlas selection. Counter-intuitively, atlas selection methods based on a fixed set of representative atlases outperformed atlas selection methods based on the patient image. This study suggests that atlas-based segmentation with currently available selection methods compares poorly to the potential best performance, hampering the clinical utility of atlas-based segmentation. Effective atlas selection remains an open challenge in atlas-based segmentation for radiotherapy planning.
Collapse
|
3
|
A model of brain morphological changes related to aging and Alzheimer's disease from cross-sectional assessments. Neuroimage 2019; 198:255-270. [DOI: 10.1016/j.neuroimage.2019.05.040] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Revised: 05/14/2019] [Accepted: 05/15/2019] [Indexed: 01/06/2023] Open
|
4
|
Ahmad S, Fan J, Dong P, Cao X, Yap PT, Shen D. Deep Learning Deformation Initialization for Rapid Groupwise Registration of Inhomogeneous Image Populations. Front Neuroinform 2019; 13:34. [PMID: 32760265 PMCID: PMC7373822 DOI: 10.3389/fninf.2019.00034] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2018] [Accepted: 04/23/2019] [Indexed: 12/22/2022] Open
Abstract
Groupwise image registration tackles biases that can potentially arise from inappropriate template selection. It typically involves simultaneous registration of a cohort of images to a common space that is not specified a priori. Existing groupwise registration methods are computationally complex and are only effective for image populations without large anatomical variations. In this paper, we propose a deep learning framework to rapidly estimate large deformations between images to significantly reduce structural variability. Specifically, we employ a multi-level graph coarsening method to agglomerate similar images into clusters, each represented by an exemplar image. We then use a deep learning framework to predict the initial deformations between images. Warping with the estimated deformations brings the images closer in the image manifold and their alignment can be further refined using conventional groupwise registration algorithms. We evaluated the effectiveness of our method in groupwise registration of MR brain images and compared it against state-of-the-art groupwise registration methods. Experimental results indicate that deformation initialization enables groupwise registration to converge significantly faster with competitive accuracy, therefore facilitates large-scale imaging studies.
Collapse
Affiliation(s)
- Sahar Ahmad
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC, United States
| | - Jingfan Fan
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC, United States
| | - Pei Dong
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC, United States
| | - Xiaohuan Cao
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC, United States.,School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC, United States
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC, United States.,Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| |
Collapse
|
5
|
Li X, Conlin CC, Decker ST, Hu N, Mueller M, Khor L, Hanrahan C, Layec G, Lee VS, Zhang JL. Sampling arterial input function (AIF) from peripheral arteries: Comparison of a temporospatial-feature based method against conventional manual method. Magn Reson Imaging 2018; 57:118-123. [PMID: 30471329 DOI: 10.1016/j.mri.2018.11.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2018] [Revised: 11/19/2018] [Accepted: 11/21/2018] [Indexed: 02/02/2023]
Abstract
It is often difficult to accurately localize small arteries in images of peripheral organs, and even more so with vascular abnormality vasculatures, including collateral arteries, in peripheral artery disease (PAD). This poses a challenge for manually sampling arterial input function (AIF) in quantifying dynamic contrast-enhanced (DCE) MRI data of peripheral organs. In this study, we designed a multi-step screening approach that utilizes both the temporal and spatial information of the dynamic images, and is presumably suitable for localizing small and unpredictable peripheral arteries. In 41 DCE MRI datasets acquired from human calf muscles, the proposed method took <5 s on average for sampling AIF for each case, much more efficient than the manual sampling method; AIFs by the two methods were comparable, with Pearson's correlation coefficient of 0.983 ± 0.004 (p-value < 0.01) and relative difference of 2.4% ± 2.6%. In conclusion, the proposed temporospatial-feature based method enables efficient and accurate sampling of AIF from peripheral arteries, and would improve measurement precision and inter-observer consistency for quantitative DCE MRI of peripheral tissues.
Collapse
Affiliation(s)
- Xiaowan Li
- Department of Radiology and Imaging Sciences, University of Utah, 729 Arapeen Drive, Salt Lake City, UT, United States
| | - Christopher C Conlin
- Department of Radiology and Imaging Sciences, University of Utah, 729 Arapeen Drive, Salt Lake City, UT, United States
| | - Stephen T Decker
- School of Public Health and Health Sciences, University of Massachusetts Amherst, Amherst, Massachusetts
| | - Nan Hu
- Division of Epidemiology, University of Utah, 295 Chipeta Way, Salt Lake City, UT, United States
| | - Michelle Mueller
- Division of Vascular Surgery, University of Utah, 30 N 1900 E, Salt Lake City, UT, United States
| | - Lillian Khor
- Division of Cardiovascular Medicine, University of Utah, 30 N 1900 E, Salt Lake City, UT, United States
| | - Christopher Hanrahan
- Department of Radiology and Imaging Sciences, University of Utah, 729 Arapeen Drive, Salt Lake City, UT, United States
| | - Gwenael Layec
- School of Public Health and Health Sciences, University of Massachusetts Amherst, Amherst, Massachusetts
| | - Vivian S Lee
- Verily Life Sciences, 355 Main St, Cambridge, MA, United States
| | - Jeff L Zhang
- Department of Radiology and Imaging Sciences, University of Utah, 729 Arapeen Drive, Salt Lake City, UT, United States.
| |
Collapse
|
6
|
Ghadimi S, Mohtasebi M, Abrishami Moghaddam H, Grebe R, Gity M, Wallois F. A Neonatal Bimodal MR-CT Head Template. PLoS One 2017; 12:e0166112. [PMID: 28129340 PMCID: PMC5271307 DOI: 10.1371/journal.pone.0166112] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 10/24/2016] [Indexed: 11/20/2022] Open
Abstract
Neonatal MR templates are appropriate for brain structural analysis and spatial normalization. However, they do not provide the essential accurate details of cranial bones and fontanels-sutures. Distinctly, CT images provide the best contrast for bone definition and fontanels-sutures. In this paper, we present, for the first time, an approach to create a fully registered bimodal MR-CT head template for neonates with a gestational age of 39 to 42 weeks. Such a template is essential for structural and functional brain studies, which require precise geometry of the head including cranial bones and fontanels-sutures. Due to the special characteristics of the problem (which requires inter-subject inter-modality registration), a two-step intensity-based registration method is proposed to globally and locally align CT images with an available MR template. By applying groupwise registration, the new neonatal CT template is then created in full alignment with the MR template to build a bimodal MR-CT template. The mutual information value between the CT and the MR template is 1.17 which shows their perfect correspondence in the bimodal template. Moreover, the average mutual information value between normalized images and the CT template proposed in this study is 1.24±0.07. Comparing this value with the one reported in a previously published approach (0.63±0.07) demonstrates the better generalization properties of the new created template and the superiority of the proposed method for the creation of CT template in the standard space provided by MR neonatal head template. The neonatal bimodal MR-CT head template is freely downloadable from https://www.u-picardie.fr/labo/GRAMFC.
Collapse
Affiliation(s)
- Sona Ghadimi
- Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
- Inserm UMR 1105, Faculté de Médecine, Université de Picardie Jules Verne, Amiens, France
| | - Mehrana Mohtasebi
- Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
| | - Hamid Abrishami Moghaddam
- Faculty of Electrical Engineering, K.N. Toosi University of Technology, Tehran, Iran
- Inserm UMR 1105, Faculté de Médecine, Université de Picardie Jules Verne, Amiens, France
- * E-mail:
| | - Reinhard Grebe
- Inserm UMR 1105, Faculté de Médecine, Université de Picardie Jules Verne, Amiens, France
| | | | - Fabrice Wallois
- Inserm UMR 1105, Faculté de Médecine, Université de Picardie Jules Verne, Amiens, France
- Inserm UMR 1105, Centre Hospitalier Universitaire d'Amiens, Amiens, France
| |
Collapse
|
7
|
Marquand AF, Wolfers T, Mennes M, Buitelaar J, Beckmann CF. Beyond Lumping and Splitting: A Review of Computational Approaches for Stratifying Psychiatric Disorders. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2016; 1:433-447. [PMID: 27642641 PMCID: PMC5013873 DOI: 10.1016/j.bpsc.2016.04.002] [Citation(s) in RCA: 108] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2016] [Revised: 04/06/2016] [Accepted: 04/06/2016] [Indexed: 01/03/2023]
Abstract
Heterogeneity is a key feature of all psychiatric disorders that manifests on many levels, including symptoms, disease course, and biological underpinnings. These form a substantial barrier to understanding disease mechanisms and developing effective, personalized treatments. In response, many studies have aimed to stratify psychiatric disorders, aiming to find more consistent subgroups on the basis of many types of data. Such approaches have received renewed interest after recent research initiatives, such as the National Institute of Mental Health Research Domain Criteria and the European Roadmap for Mental Health Research, both of which emphasize finding stratifications that are based on biological systems and that cut across current classifications. We first introduce the basic concepts for stratifying psychiatric disorders and then provide a methodologically oriented and critical review of the existing literature. This shows that the predominant clustering approach that aims to subdivide clinical populations into more coherent subgroups has made a useful contribution but is heavily dependent on the type of data used; it has produced many different ways to subgroup the disorders we review, but for most disorders it has not converged on a consistent set of subgroups. We highlight problems with current approaches that are not widely recognized and discuss the importance of validation to ensure that the derived subgroups index clinically relevant variation. Finally, we review emerging techniques-such as those that estimate normative models for mappings between biology and behavior-that provide new ways to parse the heterogeneity underlying psychiatric disorders and evaluate all methods to meeting the objectives of such as the National Institute of Mental Health Research Domain Criteria and Roadmap for Mental Health Research.
Collapse
Affiliation(s)
- Andre F. Marquand
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen
- Department of Cognitive Neuroscience , Radboud University Medical Centre, Nijmegen
- Department of Neuroimaging (AFM), Centre for Neuroimaging Sciences, Institute of Psychiatry, King’s College London, London
| | - Thomas Wolfers
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen
| | - Maarten Mennes
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen
| | - Jan Buitelaar
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen
- Department of Cognitive Neuroscience , Radboud University Medical Centre, Nijmegen
- Karakter Child and Adolescent Psychiatric University Centre, Nijmegen, The Netherlands
| | - Christian F. Beckmann
- Donders Centre for Cognitive Neuroimaging, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen
- Department of Cognitive Neuroscience , Radboud University Medical Centre, Nijmegen
- Oxford Centre for Functional Magnetic Resonance Imaging of the Brain (CFB), University of Oxford, London, United Kingdom
| |
Collapse
|
8
|
Statistical shape analysis: From landmarks to diffeomorphisms. Med Image Anal 2016; 33:155-158. [PMID: 27377332 DOI: 10.1016/j.media.2016.06.025] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2016] [Revised: 06/13/2016] [Accepted: 06/15/2016] [Indexed: 11/22/2022]
Abstract
We offer a blazingly brief review of evolution of shape analysis methods in medical imaging. As the representations and the statistical models grew more sophisticated, the problem of shape analysis has been gradually redefined to accept images rather than binary segmentations as a starting point. This transformation enabled shape analysis to take its rightful place in the arsenal of tools for extracting and understanding patterns in large clinical image sets. We speculate on the future developments in shape analysis and potential applications that would bring this mathematically rich area to bear on clinical practice.
Collapse
|
9
|
HYDRA: Revealing heterogeneity of imaging and genetic patterns through a multiple max-margin discriminative analysis framework. Neuroimage 2016; 145:346-364. [PMID: 26923371 DOI: 10.1016/j.neuroimage.2016.02.041] [Citation(s) in RCA: 102] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2015] [Revised: 02/11/2016] [Accepted: 02/12/2016] [Indexed: 11/23/2022] Open
Abstract
Multivariate pattern analysis techniques have been increasingly used over the past decade to derive highly sensitive and specific biomarkers of diseases on an individual basis. The driving assumption behind the vast majority of the existing methodologies is that a single imaging pattern can distinguish between healthy and diseased populations, or between two subgroups of patients (e.g., progressors vs. non-progressors). This assumption effectively ignores the ample evidence for the heterogeneous nature of brain diseases. Neurodegenerative, neuropsychiatric and neurodevelopmental disorders are largely characterized by high clinical heterogeneity, which likely stems in part from underlying neuroanatomical heterogeneity of various pathologies. Detecting and characterizing heterogeneity may deepen our understanding of disease mechanisms and lead to patient-specific treatments. However, few approaches tackle disease subtype discovery in a principled machine learning framework. To address this challenge, we present a novel non-linear learning algorithm for simultaneous binary classification and subtype identification, termed HYDRA (Heterogeneity through Discriminative Analysis). Neuroanatomical subtypes are effectively captured by multiple linear hyperplanes, which form a convex polytope that separates two groups (e.g., healthy controls from pathologic samples); each face of this polytope effectively defines a disease subtype. We validated HYDRA on simulated and clinical data. In the latter case, we applied the proposed method independently to the imaging and genetic datasets of the Alzheimer's Disease Neuroimaging Initiative (ADNI 1) study. The imaging dataset consisted of T1-weighted volumetric magnetic resonance images of 123 AD patients and 177 controls. The genetic dataset consisted of single nucleotide polymorphism information of 103 AD patients and 139 controls. We identified 3 reproducible subtypes of atrophy in AD relative to controls: (1) diffuse and extensive atrophy, (2) precuneus and extensive temporal lobe atrophy, as well some prefrontal atrophy, (3) atrophy pattern very much confined to the hippocampus and the medial temporal lobe. The genetics dataset yielded two subtypes of AD characterized mainly by the presence/absence of the apolipoprotein E (APOE) ε4 genotype, but also involving differential presence of risk alleles of CD2AP, SPON1 and LOC39095 SNPs that were associated with differences in the respective patterns of brain atrophy, especially in the precuneus. The results demonstrate the potential of the proposed approach to map disease heterogeneity in neuroimaging and genetic studies.
Collapse
|
10
|
Eavani H, Hsieh MK, An Y, Erus G, Beason-Held L, Resnick S, Davatzikos C. Capturing heterogeneous group differences using mixture-of-experts: Application to a study of aging. Neuroimage 2016; 125:498-514. [PMID: 26525656 PMCID: PMC5460911 DOI: 10.1016/j.neuroimage.2015.10.045] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2015] [Revised: 10/12/2015] [Accepted: 10/16/2015] [Indexed: 11/22/2022] Open
Abstract
In MRI studies, linear multi-variate methods are often employed to identify regions or connections that are affected due to disease or normal aging. Such linear models inherently assume that there is a single, homogeneous abnormality pattern that is present in all affected individuals. While kernel-based methods can implicitly model a non-linear effect, and therefore the heterogeneity in the affected group, extracting and interpreting information about affected regions is difficult. In this paper, we present a method that explicitly models and captures heterogeneous patterns of change in the affected group relative to a reference group of controls. For this purpose, we use the Mixture-of-Experts (MOE) framework, which combines unsupervised modeling of mixtures of distributions with supervised learning of classifiers. MOE approximates the non-linear boundary between the two groups with a piece-wise linear boundary, thus allowing discovery of multiple patterns of group differences. In the case of patient/control comparisons, each such pattern aims to capture a different dimension of a disease, and hence to identify patient subgroups. We validated our model using multiple simulation scenarios and performance measures. We applied this method to resting state functional MRI data from the Baltimore Longitudinal Study of Aging, to investigate heterogeneous effects of aging on brain function in cognitively normal older adults (>85years) relative to a reference group of normal young to middle-aged adults (<60years). We found strong evidence for the presence of two subgroups of older adults, with similar age distributions in each subgroup, but different connectivity patterns associated with aging. While both older subgroups showed reduced functional connectivity in the Default Mode Network (DMN), increases in functional connectivity within the pre-frontal cortex as well as the bilateral insula were observed only for one of the two subgroups. Interestingly, the subgroup showing this increased connectivity (unlike the other subgroup) was, cognitively similar at baseline to the young and middle-aged subjects in two of seven cognitive domains, and had a faster rate of cognitive decline in one of seven domains. These results suggest that older individuals whose baseline cognitive performance is comparable to that of younger individuals recruit their "cognitive reserve" later in life, to compensate for reduced connectivity in other brain regions.
Collapse
Affiliation(s)
- Harini Eavani
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, USA.
| | - Meng Kang Hsieh
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, USA
| | - Yang An
- National Institute on Aging, Baltimore, USA
| | - Guray Erus
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, USA
| | | | | | - Christos Davatzikos
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, USA
| |
Collapse
|
11
|
Cardoso MJ, Modat M, Wolz R, Melbourne A, Cash D, Rueckert D, Ourselin S. Geodesic Information Flows: Spatially-Variant Graphs and Their Application to Segmentation and Fusion. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:1976-88. [PMID: 25879909 DOI: 10.1109/tmi.2015.2418298] [Citation(s) in RCA: 210] [Impact Index Per Article: 23.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Clinical annotations, such as voxel-wise binary or probabilistic tissue segmentations, structural parcellations, pathological regions-of-interest and anatomical landmarks are key to many clinical studies. However, due to the time consuming nature of manually generating these annotations, they tend to be scarce and limited to small subsets of data. This work explores a novel framework to propagate voxel-wise annotations between morphologically dissimilar images by diffusing and mapping the available examples through intermediate steps. A spatially-variant graph structure connecting morphologically similar subjects is introduced over a database of images, enabling the gradual diffusion of information to all the subjects, even in the presence of large-scale morphological variability. We illustrate the utility of the proposed framework on two example applications: brain parcellation using categorical labels and tissue segmentation using probabilistic features. The application of the proposed method to categorical label fusion showed highly statistically significant improvements when compared to state-of-the-art methodologies. Significant improvements were also observed when applying the proposed framework to probabilistic tissue segmentation of both synthetic and real data, mainly in the presence of large morphological variability.
Collapse
|
12
|
Gao Y, Zhu L, Cates J, MacLeod RS, Bouix S, Tannenbaum A. A Kalman Filtering Perspective for Multiatlas Segmentation. SIAM JOURNAL ON IMAGING SCIENCES 2015; 8:1007-1029. [PMID: 26807162 PMCID: PMC4722821 DOI: 10.1137/130933423] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
In multiatlas segmentation, one typically registers several atlases to the novel image, and their respective segmented label images are transformed and fused to form the final segmentation. In this work, we provide a new dynamical system perspective for multiatlas segmentation, inspired by the following fact: The transformation that aligns the current atlas to the novel image can be not only computed by direct registration but also inferred from the transformation that aligns the previous atlas to the image together with the transformation between the two atlases. This process is similar to the global positioning system on a vehicle, which gets position by inquiring from the satellite and by employing the previous location and velocity-neither answer in isolation being perfect. To solve this problem, a dynamical system scheme is crucial to combine the two pieces of information; for example, a Kalman filtering scheme is used. Accordingly, in this work, a Kalman multiatlas segmentation is proposed to stabilize the global/affine registration step. The contributions of this work are twofold. First, it provides a new dynamical systematic perspective for standard independent multiatlas registrations, and it is solved by Kalman filtering. Second, with very little extra computation, it can be combined with most existing multiatlas segmentation schemes for better registration/segmentation accuracy.
Collapse
Affiliation(s)
- Yi Gao
- Department of Biomedical Informatics and Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY 11794
| | - Liangjia Zhu
- Department of Computer Science, Stony Brook University, Stony Brook, NY 11790
| | - Joshua Cates
- Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112
| | - Rob S. MacLeod
- Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112
| | - Sylvain Bouix
- Department of Psychiatry, Harvard Medical School, Boston, MA 02215
| | - Allen Tannenbaum
- Department of Computer Science and Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY 11794
| |
Collapse
|
13
|
Min R, Cheng J, Price T, Wu G, Shen D. Maximum-margin based representation learning from multiple atlases for Alzheimer's disease classification. ACTA ACUST UNITED AC 2015; 17:212-9. [PMID: 25485381 DOI: 10.1007/978-3-319-10470-6_27] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/20/2023]
Abstract
In order to establish the correspondences between different brains for comparison, spatial normalization based morphometric measurements have been widely used in the analysis of Alzheimer's disease (AD). In the literature, different subjects are often compared in one atlas space, which may be insufficient in revealing complex brain changes. In this paper, instead of deploying one atlas for feature extraction and classification, we propose a maximum-margin based representation learning (MMRL) method to learn the optimal representation from multiple atlases. Unlike traditional methods that perform the representation learning separately from the classification, we propose to learn the new representation jointly with the classification model, which is more powerful in discriminating AD patients from normal controls (NC). We evaluated the proposed method on the ADNI database, and achieved 90.69% for AD/NC classification and 73.69% for p-MCI/s-MCI classification.
Collapse
|
14
|
Awate SP, Whitaker RT. Multiatlas segmentation as nonparametric regression. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:1803-17. [PMID: 24802528 PMCID: PMC4440593 DOI: 10.1109/tmi.2014.2321281] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
This paper proposes a novel theoretical framework to model and analyze the statistical characteristics of a wide range of segmentation methods that incorporate a database of label maps or atlases; such methods are termed as label fusion or multiatlas segmentation. We model these multiatlas segmentation problems as nonparametric regression problems in the high-dimensional space of image patches. We analyze the nonparametric estimator's convergence behavior that characterizes expected segmentation error as a function of the size of the multiatlas database. We show that this error has an analytic form involving several parameters that are fundamental to the specific segmentation problem (determined by the chosen anatomical structure, imaging modality, registration algorithm, and label-fusion algorithm). We describe how to estimate these parameters and show that several human anatomical structures exhibit the trends modeled analytically. We use these parameter estimates to optimize the regression estimator. We show that the expected error for large database sizes is well predicted by models learned on small databases. Thus, a few expert segmentations can help predict the database sizes required to keep the expected error below a specified tolerance level. Such cost-benefit analysis is crucial for deploying clinical multiatlas segmentation systems.
Collapse
Affiliation(s)
| | - Ross T. Whitaker
- Scientific Computing and Imaging (SCI) Institute and the School of Computing, University of Utah, Salt Lake City, UT 84112 USA
| |
Collapse
|
15
|
Shi Y, Lai R, Wang DJ, Pelletier D, Mohr D, Sicotte N, Toga AW. Metric optimization for surface analysis in the Laplace-Beltrami embedding space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:1447-63. [PMID: 24686245 PMCID: PMC4079755 DOI: 10.1109/tmi.2014.2313812] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
In this paper, we present a novel approach for the intrinsic mapping of anatomical surfaces and its application in brain mapping research. Using the Laplace-Beltrami eigen-system, we represent each surface with an isometry invariant embedding in a high dimensional space. The key idea in our system is that we realize surface deformation in the embedding space via the iterative optimization of a conformal metric without explicitly perturbing the surface or its embedding. By minimizing a distance measure in the embedding space with metric optimization, our method generates a conformal map directly between surfaces with highly uniform metric distortion and the ability of aligning salient geometric features. Besides pairwise surface maps, we also extend the metric optimization approach for group-wise atlas construction and multi-atlas cortical label fusion. In experimental results, we demonstrate the robustness and generality of our method by applying it to map both cortical and hippocampal surfaces in population studies. For cortical labeling, our method achieves excellent performance in a cross-validation experiment with 40 manually labeled surfaces, and successfully models localized brain development in a pediatric study of 80 subjects. For hippocampal mapping, our method produces much more significant results than two popular tools on a multiple sclerosis study of 109 subjects.
Collapse
Affiliation(s)
- Yonggang Shi
- Laboratory of Neuro Imaging, Institute for Neuroimaging and Informatics, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA ()
| | - Rongjie Lai
- Department of Mathematics, University of California at Irvine, Irvine, CA 92697, USA ()
| | - Danny J.J. Wang
- Ahmanson-Lovelace Brain Mapping Center, Department of Neurology, UCLA School of Medicine, Los Angeles, CA 90095, USA ()
| | - Daniel Pelletier
- Department of Neurology, Yale School of Medicine, New Haven, CT, USA ()
| | - David Mohr
- Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA ()
| | | | - Arthur W. Toga
- Laboratory of Neuro Imaging, Institute for Neuroimaging and Informatics, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA ()
| |
Collapse
|
16
|
Langerak TR, Berendsen FF, Van der Heide UA, Kotte ANTJ, Pluim JPW. Multiatlas-based segmentation with preregistration atlas selection. Med Phys 2014; 40:091701. [PMID: 24007134 DOI: 10.1118/1.4816654] [Citation(s) in RCA: 50] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Automatic, atlas-based segmentation of medical images benefits from using multiple atlases, mainly in terms of robustness. However, a large disadvantage of using multiple atlases is the large computation time that is involved in registering atlas images to the target image. This paper aims to reduce the computation load of multiatlas-based segmentation by heuristically selecting atlases before registration. METHODS To be able to select atlases, pairwise registrations are performed for all atlas combinations. Based on the results of these registrations, atlases are clustered, such that each cluster contains atlas that registers well to each other. This can all be done in a preprocessing step. Then, the representatives of each cluster are registered to the target image. The quality of the result of this registration is estimated for each of the representatives and used to decide which clusters to fully register to the target image. Finally, the segmentations of the registered images are combined into a single segmentation in a label fusion procedure. RESULTS The authors perform multiatlas segmentation once with postregistration atlas selection and once with the proposed preregistration method, using a set of 182 segmented atlases of prostate cancer patients. The authors performed the full set of 182 leave-one-out experiments and in each experiment compared the result of the atlas-based segmentation procedure to the known segmentation of the atlas that was chosen as a target image. The results show that preregistration atlas selection is slightly less accurate than postregistration atlas selection, but this is not statistically significant. CONCLUSIONS Based on the results the authors conclude that the proposed method is able to reduce the number of atlases that have to be registered to the target image with 80% on average, without compromising segmentation accuracy.
Collapse
Affiliation(s)
- Thomas R Langerak
- Image Sciences Institute, University Medical Center Utrecht, P.O. Box 85500, 3508 GA Utrecht, The Netherlands.
| | | | | | | | | |
Collapse
|
17
|
Shi F, Wang L, Wu G, Li G, Gilmore JH, Lin W, Shen D. Neonatal atlas construction using sparse representation. Hum Brain Mapp 2014; 35:4663-77. [PMID: 24638883 DOI: 10.1002/hbm.22502] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2013] [Revised: 02/11/2014] [Accepted: 02/18/2014] [Indexed: 11/05/2022] Open
Abstract
Atlas construction generally includes first an image registration step to normalize all images into a common space and then an atlas building step to fuse the information from all the aligned images. Although numerous atlas construction studies have been performed to improve the accuracy of the image registration step, unweighted or simply weighted average is often used in the atlas building step. In this article, we propose a novel patch-based sparse representation method for atlas construction after all images have been registered into the common space. By taking advantage of local sparse representation, more anatomical details can be recovered in the built atlas. To make the anatomical structures spatially smooth in the atlas, the anatomical feature constraints on group structure of representations and also the overlapping of neighboring patches are imposed to ensure the anatomical consistency between neighboring patches. The proposed method has been applied to 73 neonatal MR images with poor spatial resolution and low tissue contrast, for constructing a neonatal brain atlas with sharp anatomical details. Experimental results demonstrate that the proposed method can significantly enhance the quality of the constructed atlas by discovering more anatomical details especially in the highly convoluted cortical regions. The resulting atlas demonstrates superior performance of our atlas when applied to spatially normalizing three different neonatal datasets, compared with other start-of-the-art neonatal brain atlases.
Collapse
Affiliation(s)
- Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina
| | | | | | | | | | | | | |
Collapse
|
18
|
Ribbens A, Hermans J, Maes F, Vandermeulen D, Suetens P. Unsupervised segmentation, clustering, and groupwise registration of heterogeneous populations of brain MR images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:201-224. [PMID: 23797244 DOI: 10.1109/tmi.2013.2270114] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Population analysis of brain morphology from magnetic resonance images contributes to the study and understanding of neurological diseases. Such analysis typically involves segmentation of a large set of images and comparisons of these segmentations between relevant subgroups of images (e.g., "normal" versus "diseased"). The images of each subgroup are usually selected in advance in a supervised way based on clinical knowledge. Their segmentations are typically guided by one or more available atlases, assumed to be suitable for the images at hand. We present a data-driven probabilistic framework that simultaneously performs atlas-guided segmentation of a heterogeneous set of brain MR images and clusters the images in homogeneous subgroups, while constructing separate probabilistic atlases for each cluster to guide the segmentation. The main benefits of integrating segmentation, clustering and atlas construction in a single framework are that: 1) our method can handle images of a heterogeneous group of subjects and automatically identifies homogeneous subgroups in an unsupervised way with minimal prior knowledge, 2) the subgroups are formed by automatical detection of the relevant morphological features based on the segmentation, 3) the atlases used by our method are constructed from the images themselves and optimally adapted for guiding the segmentation of each subgroup, and 4) the probabilistic atlases represent the morphological pattern that is specific for each subgroup and expose the groupwise differences between different subgroups. We demonstrate the feasibility of the proposed framework and evaluate its performance with respect to image segmentation, clustering and atlas construction on simulated and real data sets including the publicly available BrainWeb and ADNI data. It is shown that combined segmentation and atlas construction leads to improved segmentation accuracy. Furthermore, it is demonstrated that the clusters generated by our unsupervised framework largely coincide with the clinically determined subgroups in case of disease-specific differences in brain morphology and that the differences between the cluster-specific atlases are in agreement with the expected disease-specific patterns, indicating that our method is capable of detecting the different modes in a population. Our method can thus be seen as a comprehensive image-driven population analysis framework that can contribute to the detection of novel subgroups and distinctive image features, potentially leading to new insights in the brain development and disease.
Collapse
|
19
|
Pouch AM, Wang H, Takabe M, Jackson BM, Gorman JH, Gorman RC, Yushkevich PA, Sehgal CM. Fully automatic segmentation of the mitral leaflets in 3D transesophageal echocardiographic images using multi-atlas joint label fusion and deformable medial modeling. Med Image Anal 2014; 18:118-29. [PMID: 24184435 PMCID: PMC3897209 DOI: 10.1016/j.media.2013.10.001] [Citation(s) in RCA: 58] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2012] [Revised: 09/18/2013] [Accepted: 10/02/2013] [Indexed: 10/26/2022]
Abstract
Comprehensive visual and quantitative analysis of in vivo human mitral valve morphology is central to the diagnosis and surgical treatment of mitral valve disease. Real-time 3D transesophageal echocardiography (3D TEE) is a practical, highly informative imaging modality for examining the mitral valve in a clinical setting. To facilitate visual and quantitative 3D TEE image analysis, we describe a fully automated method for segmenting the mitral leaflets in 3D TEE image data. The algorithm integrates complementary probabilistic segmentation and shape modeling techniques (multi-atlas joint label fusion and deformable modeling with continuous medial representation) to automatically generate 3D geometric models of the mitral leaflets from 3D TEE image data. These models are unique in that they establish a shape-based coordinate system on the valves of different subjects and represent the leaflets volumetrically, as structures with locally varying thickness. In this work, expert image analysis is the gold standard for evaluating automatic segmentation. Without any user interaction, we demonstrate that the automatic segmentation method accurately captures patient-specific leaflet geometry at both systole and diastole in 3D TEE data acquired from a mixed population of subjects with normal valve morphology and mitral valve disease.
Collapse
Affiliation(s)
- A M Pouch
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States; Gorman Cardiovascular Research Group, University of Pennsylvania, Philadelphia, PA, United States.
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Ying S, Wu G, Liao S, Shen D. INTER-GROUP IMAGE REGISTRATION BY HIERARCHICAL GRAPH SHRINKAGE. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2013; 2013:1030-1033. [PMID: 24443692 PMCID: PMC3892763 DOI: 10.1109/isbi.2013.6556653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
In this paper, we propose a novel inter-group image registration method to register different groups of images (e.g., young and elderly brains) simultaneously. Specifically, we use a hierarchical two-level graph to model the distribution of entire images on the manifold, with intra-graph representing the image distribution in each group and the inter-graph describing the relationship between two groups. Then the procedure of inter-group registration is formulated as a dynamic evolution of graph shrinkage. The advantage of our method is that the topology of entire image distribution is explored to guide the image registration. In this way, each image coordinates with its neighboring images on the manifold to deform towards the population center, by following the deformation pathway simultaneously optimized within the graph. Our proposed method has been also compared with other state-of-the-art inter-group registration methods, where our method achieves better registration results in terms of registration accuracy and robustness.
Collapse
Affiliation(s)
- Shihui Ying
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
- Department of Mathematics, School of Science, Shanghai University, Shanghai 200444, China
| | - Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Shu Liao
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| |
Collapse
|
21
|
Konukoglu E, Glocker B, Zikic D, Criminisi A. Neighbourhood approximation using randomized forests. Med Image Anal 2013; 17:790-804. [DOI: 10.1016/j.media.2013.04.013] [Citation(s) in RCA: 51] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2012] [Revised: 04/23/2013] [Accepted: 04/24/2013] [Indexed: 11/29/2022]
|
22
|
Abstract
Magnetic resonance imaging has become an important noninvasive technique to gain insight into fetal brain development. Its capabilities go beyond ultrasound when diagnosing high-risk pregnancies. To summarize observations across a population in magnetic resonance imaging studies, reference systems such as atlases that establish correspondences across a cohort are key. In this article, we review the evolution of atlas-building methods in light of their relevance, limitations, and benefits for the modeling of human brain development. Starting with single anatomical templates to which brain scans where mapped to such as Talairach and Montreal Neurological Institute space, we explore the uses of atlases as a means to establish correspondences across a cohort and as a model that captures the population characteristics of the cases the atlas is built from. We discuss methods that capture features of increasingly heterogeneous populations and approaches that are able to generalize with only minimal annotation. The main focus of this review are methods that explicitly model the variability in the population with regard to time, such as in the modeling of disease progression and brain development. We highlight the applicability and limitations of state-of-the art approaches, how insights from the study of disease progression are helpful in developmental studies, and point to the directions of future research that is still necessary.
Collapse
|
23
|
Ying S, Wu G, Wang Q, Shen D. Hierarchical unbiased graph shrinkage (HUGS): a novel groupwise registration for large data set. Neuroimage 2013; 84:626-38. [PMID: 24055505 DOI: 10.1016/j.neuroimage.2013.09.023] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2013] [Revised: 07/26/2013] [Accepted: 09/12/2013] [Indexed: 11/29/2022] Open
Abstract
Normalizing all images in a large data set into a common space is a key step in many clinical and research studies, e.g., for brain development, maturation, and aging. Recently, groupwise registration has been developed for simultaneous alignment of all images without selecting a particular image as template, thus potentially avoiding bias in the registration. However, most conventional groupwise registration methods do not explore the data distribution during the image registration. Thus, their performance could be affected by large inter-subject variations in the data set under registration. To solve this potential issue, we propose to use a graph to model the distribution of all image data sitting on the image manifold, with each node representing an image and each edge representing the geodesic pathway between two nodes (or images). Then, the procedure of warping all images to their population center turns to the dynamic shrinking of the graph nodes along their graph edges until all graph nodes become close to each other. Thus, the topology of image distribution on the image manifold is always preserved during the groupwise registration. More importantly, by modeling the distribution of all images via a graph, we can potentially reduce registration error since every time each image is warped only according to its nearby images with similar structures in the graph. We have evaluated our proposed groupwise registration method on both infant and adult data sets, by also comparing with the conventional group-mean based registration and the ABSORB methods. All experimental results show that our proposed method can achieve better performance in terms of registration accuracy and robustness.
Collapse
Affiliation(s)
- Shihui Ying
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA; Department of Mathematics, School of Science, Shanghai University, Shanghai 200444, PR China.
| | | | | | | |
Collapse
|
24
|
Quantitative imaging biomarkers: the application of advanced image processing and analysis to clinical and preclinical decision making. J Digit Imaging 2013; 26:97-108. [PMID: 22415112 DOI: 10.1007/s10278-012-9465-7] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022] Open
Abstract
The importance of medical imaging for clinical decision making has been steadily increasing over the last four decades. Recently, there has also been an emphasis on medical imaging for preclinical decision making, i.e., for use in pharamaceutical and medical device development. There is also a drive towards quantification of imaging findings by using quantitative imaging biomarkers, which can improve sensitivity, specificity, accuracy and reproducibility of imaged characteristics used for diagnostic and therapeutic decisions. An important component of the discovery, characterization, validation and application of quantitative imaging biomarkers is the extraction of information and meaning from images through image processing and subsequent analysis. However, many advanced image processing and analysis methods are not applied directly to questions of clinical interest, i.e., for diagnostic and therapeutic decision making, which is a consideration that should be closely linked to the development of such algorithms. This article is meant to address these concerns. First, quantitative imaging biomarkers are introduced by providing definitions and concepts. Then, potential applications of advanced image processing and analysis to areas of quantitative imaging biomarker research are described; specifically, research into osteoarthritis (OA), Alzheimer's disease (AD) and cancer is presented. Then, challenges in quantitative imaging biomarker research are discussed. Finally, a conceptual framework for integrating clinical and preclinical considerations into the development of quantitative imaging biomarkers and their computer-assisted methods of extraction is presented.
Collapse
|
25
|
Jiang D, Du Y, Cheng H, Jiang T, Fan Y. Groupwise spatial normalization of fMRI data based on multi-range functional connectivity patterns. Neuroimage 2013; 82:355-72. [PMID: 23727315 DOI: 10.1016/j.neuroimage.2013.05.093] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2012] [Revised: 05/13/2013] [Accepted: 05/17/2013] [Indexed: 10/26/2022] Open
Abstract
Spatial alignment of functional magnetic resonance images (fMRI) of different subjects is a necessary precursor to improve functional consistency across subjects for group analysis in fMRI studies. Traditional structural MRI (sMRI) based registration methods cannot achieve accurate inter-subject functional consistency in that functional units are not necessarily located relative to anatomical structures consistently due to functional variability across subjects. Although spatial smoothing commonly used in fMRI data preprocessing can reduce the inter-subject functional variability, it may blur the functional signals and thus lose the fine-grained information. To overcome the limitations of exiting techniques, in this paper, we propose a novel method for spatial normalization of fMRI data by matching their multi-range functional connectivity patterns progressively. In particular, the image registration of different subjects is achieved by maximizing inter-subject similarity of their functional images' local functional connectivity patterns that characterize functional connectivity information for each voxel of the images to its spatial neighbors. The neighborhood size for computing the local functional connectivity patterns is gradually increased with the progression of image registration to capture the functional connectivity information in larger ranges. We also adopt the congealing groupwise image registration strategy to simultaneously warp a group of subjects to an unbiased template. Experimental comparisons between the proposed method and other fMRI image registration methods have demonstrated that the proposed method could achieve superior registration performance for resting state fMRI data. Experiment results based on real resting-state fMRI data have further demonstrated that the proposed fMRI registration method can achieve a statistically significant improvement in functional consistency across subjects.
Collapse
Affiliation(s)
- Di Jiang
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | | | | | | | | |
Collapse
|
26
|
Abstract
Groupwise image registration plays an important role in medical image analysis. The principle of groupwise image registration is to align a given set of images to a hidden template space in an iteratively manner without explicitly selecting any individual image as the template. Although many approaches have been proposed to address the groupwise image registration problem for registering a single group of images, few attentions and efforts have been paid to the registration problem between two or more different groups of images. In this paper, we propose a statistical framework to address the registration problems between two different image groups. The main contributions of this paper lie in the following aspects: (1) In this paper, we demonstrate that directly registering the group mean images estimated from two different image groups is not sufficient to establish the reliable transformation from one image group to the other image group. (2) A novel statistical framework is proposed to extract anatomical features from the white matter, gray matter and cerebrospinal fluid tissue maps of all aligned images as morphological signatures for each voxel. The extracted features provide much richer anatomical information than the voxel intensity of the group mean image, and can be integrated with the multi-channel Demons registration algorithm to perform the registration process. (3) The proposed method has been extensively evaluated on two publicly available brain MRI databases: the LONI LPBA40 and the IXI databases, and it is also compared with a conventional inter-group image registration approach which directly performs deformable registration between the group mean images of two image groups. Experimental results show that the proposed method consistently achieves higher registration accuracy than the method under comparison.
Collapse
Affiliation(s)
- Shu Liao
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | | | | |
Collapse
|
27
|
Wang H, Suh JW, Das SR, Pluta JB, Craige C, Yushkevich PA. Multi-Atlas Segmentation with Joint Label Fusion. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2013; 35:611-23. [PMID: 22732662 PMCID: PMC3864549 DOI: 10.1109/tpami.2012.143] [Citation(s) in RCA: 488] [Impact Index Per Article: 44.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Multi-atlas segmentation is an effective approach for automatically labeling objects of interest in biomedical images. In this approach, multiple expert-segmented example images, called atlases, are registered to a target image, and deformed atlas segmentations are combined using label fusion. Among the proposed label fusion strategies, weighted voting with spatially varying weight distributions derived from atlas-target intensity similarity have been particularly successful. However, one limitation of these strategies is that the weights are computed independently for each atlas, without taking into account the fact that different atlases may produce similar label errors. To address this limitation, we propose a new solution for the label fusion problem in which weighted voting is formulated in terms of minimizing the total expectation of labeling error and in which pairwise dependency between atlases is explicitly modeled as the joint probability of two atlases making a segmentation error at a voxel. This probability is approximated using intensity similarity between a pair of atlases and the target image in the neighborhood of each voxel. We validate our method in two medical image segmentation problems: hippocampus segmentation and hippocampus subfield segmentation in magnetic resonance (MR) images. For both problems, we show consistent and significant improvement over label fusion strategies that assign atlas weights independently.
Collapse
|
28
|
Xie Y, Ho J, Vemuri BC. Multiple Atlas construction from a heterogeneous brain MR image collection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:628-35. [PMID: 23335665 PMCID: PMC3595350 DOI: 10.1109/tmi.2013.2239654] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
In this paper, we propose a novel framework for computing single or multiple atlases (templates) from a large population of images. Unlike many existing methods, our proposed approach is distinguished by its emphasis on the sharpness of the computed atlases and the requirement of rotational invariance. In particular, we argue that sharp atlas images that retain crucial and important anatomical features with high fidelity are more useful for many medical imaging applications when compared with the blurry and fuzzy atlas images computed by most existing methods. The geometric notion that underlies our approach is the idea of manifold learning in a quotient space, the quotient space of the image space by the rotations. We present an extension of the existing manifold learning approach to quotient spaces by using invariant metrics, and utilizing the manifold structure for partitioning the images into more homogeneous sub-collections, each of which can be represented by a single atlas image. Specifically, we propose a three-step algorithm. First, we partition the input images into subgroups using unsupervised or semi-supervised learning methods on manifolds. Then we formulate a convex optimization problem in each subgroup to locate the atlases and determine the crucial neighbors that are used in the realization step to form the template images. We have evaluated our algorithm using whole brain MR volumes from OASIS database. Experimental results demonstrate that the atlases computed using the proposed algorithm not only discover the brain structural changes in different age groups but also preserve important structural details and generally enjoy better image quality.
Collapse
Affiliation(s)
- Yuchen Xie
- Department of Computer and Information Science and Engineering (CISE), University of Florida, Gainesville, FL 32611, USA.
| | | | | |
Collapse
|
29
|
Li J, Shi Y, Dinov ID, Toga AW. Locally Weighted Multi-atlas Construction. MULTIMODAL BRAIN IMAGE ANALYSIS : THIRD INTERNATIONAL WORKSHOP, MBIA 2013, HELD IN CONJUNCTION WITH MICCAI 2013, NAGOYA, JAPAN, SEPTEMBER 22, 2013 : PROCEEDINGS. MBIA (WORKSHOP) (3RD : 2013 : NAGOYA-SHI, JAPAN) 2013; 8159:1-8. [PMID: 25392851 PMCID: PMC4225708 DOI: 10.1007/978-3-319-02126-3_1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
In image-based medical research, atlases are widely used in many tasks, for example, spatial normalization and segmentation. If atlases are regarded as representative patterns for a population of images, then multiple atlases are required for a heterogeneous population. In conventional atlas construction methods, the "unit" of representative patterns is images. Every input image is associated with its most similar atlas. As the number of subjects increases, the heterogeneity increases accordingly, and a big number of atlases may be needed. In this paper, we explore using region-wise, instead of image-wise, patterns to represent a population. Different parts of an input image is fuzzily associated with different atlases according to voxel-level association weights. In this way, regional structure patterns from different atlases can be combined together. Based on this model, we design a variational framework for multi-atlas construction. In the application to two T1-weighted MRI data sets, the method shows promising performance, in comparison with a conventional unbiased atlas construction method.
Collapse
|
30
|
Sridharan R, Dalca AV, Fitzpatrick KM, Cloonan L, Kanakis A, Wu O, Furie KL, Rosand J, Rost NS, Golland P. Quantification and Analysis of Large Multimodal Clinical Image Studies: Application to Stroke. MULTIMODAL BRAIN IMAGE ANALYSIS : THIRD INTERNATIONAL WORKSHOP, MBIA 2013, HELD IN CONJUNCTION WITH MICCAI 2013, NAGOYA, JAPAN, SEPTEMBER 22, 2013 : PROCEEDINGS. MBIA (WORKSHOP) (3RD : 2013 : NAGOYA-SHI, JAPAN) 2013; 8159:18-30. [PMID: 25632408 PMCID: PMC4306599 DOI: 10.1007/978-3-319-02126-3_3] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
Abstract
We present an analysis framework for large studies of multimodal clinical quality brain image collections. Processing and analysis of such datasets is challenging due to low resolution, poor contrast, mis-aligned images, and restricted field of view. We adapt existing registration and segmentation methods and build a computational pipeline for spatial normalization and feature extraction. The resulting aligned dataset enables clinically meaningful analysis of spatial distributions of relevant anatomical features and of their evolution with age and disease progression. We demonstrate the approach on a neuroimaging study of stroke with more than 800 patients. We show that by combining data from several modalities, we can automatically segment important biomarkers such as white matter hyperintensity and characterize pathology evolution in this heterogeneous cohort. Specifically, we examine two sub-populations with different dynamics of white matter hyperintensity changes as a function of patients' age. Pipeline and analysis code is available at http://groups.csail.mit.edu/vision/medical-vision/stroke/.
Collapse
Affiliation(s)
| | | | | | - Lisa Cloonan
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | - Allison Kanakis
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | - Ona Wu
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | - Karen L Furie
- Department of Neurology, Rhode Island Hospital, Alpert Medical School of Brown University
| | - Jonathan Rosand
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | - Natalia S Rost
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | | |
Collapse
|
31
|
Chen T, Rangarajan A, Eisenschenk SJ, Vemuri BC. Construction of a neuroanatomical shape complex atlas from 3D MRI brain structures. Neuroimage 2012; 60:1778-87. [DOI: 10.1016/j.neuroimage.2012.01.095] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2011] [Revised: 01/14/2012] [Accepted: 01/18/2012] [Indexed: 11/24/2022] Open
|
32
|
Rehman A, Saba T. RETRACTED ARTICLE: Analysis of advanced image processing to clinical and preclinical decision making with prospectus of quantitative imaging biomarkers. Artif Intell Rev 2012. [DOI: 10.1007/s10462-012-9335-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
33
|
Eskildsen SF, Coupé P, Fonov V, Manjón JV, Leung KK, Guizard N, Wassef SN, Østergaard LR, Collins DL. BEaST: Brain extraction based on nonlocal segmentation technique. Neuroimage 2012; 59:2362-73. [PMID: 21945694 DOI: 10.1016/j.neuroimage.2011.09.012] [Citation(s) in RCA: 287] [Impact Index Per Article: 23.9] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2011] [Revised: 09/06/2011] [Accepted: 09/09/2011] [Indexed: 01/18/2023] Open
Affiliation(s)
- Simon F Eskildsen
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, 3801 University Street, Montreal, Canada.
| | | | | | | | | | | | | | | | | |
Collapse
|
34
|
Konukoglu E, Glocker B, Zikic D, Criminisi A. Neighbourhood approximation forests. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2012; 15:75-82. [PMID: 23286116 DOI: 10.1007/978-3-642-33454-2_10] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Methods that leverage neighbourhood structures in high-dimensional image spaces have recently attracted attention. These approaches extract information from a new image using its "neighbours" in the image space equipped with an application-specific distance. Finding the neighbourhood of a given image is challenging due to large dataset sizes and costly distance evaluations. Furthermore, automatic neighbourhood search for a new image is currently not possible when the distance is based on ground truth annotations. In this article we present a general and efficient solution to these problems. "neighbourhood approximation forests" (NAF) is a supervised learning algorithm that approximates the neighbourhood structure resulting from an arbitrary distance. As NAF uses only image intensities to infer neighbours it can also be applied to distances based on ground truth annotations. We demonstrate NAF in two scenarios: (i) choosing neighbours with respect to a deformation-based distance, and (ii) age prediction from brain MRI. The experiments show NAF's approximation quality, computational advantages and use in different contexts.
Collapse
|
35
|
Batmanghelich NK, Taskar B, Davatzikos C. Generative-discriminative basis learning for medical imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:51-69. [PMID: 21791408 PMCID: PMC3402718 DOI: 10.1109/tmi.2011.2162961] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
This paper presents a novel dimensionality reduction method for classification in medical imaging. The goal is to transform very high-dimensional input (typically, millions of voxels) to a low-dimensional representation (small number of constructed features) that preserves discriminative signal and is clinically interpretable. We formulate the task as a constrained optimization problem that combines generative and discriminative objectives and show how to extend it to the semi-supervised learning (SSL) setting. We propose a novel large-scale algorithm to solve the resulting optimization problem. In the fully supervised case, we demonstrate accuracy rates that are better than or comparable to state-of-the-art algorithms on several datasets while producing a representation of the group difference that is consistent with prior clinical reports. Effectiveness of the proposed algorithm for SSL is evaluated with both benchmark and medical imaging datasets. In the benchmark datasets, the results are better than or comparable to the state-of-the-art methods for SSL. For evaluation of the SSL setting in medical datasets, we use images of subjects with mild cognitive impairment (MCI), which is believed to be a precursor to Alzheimer's disease (AD), as unlabeled data. AD subjects and normal control (NC) subjects are used as labeled data, and we try to predict conversion from MCI to AD on follow-up. The semi-supervised extension of this method not only improves the generalization accuracy for the labeled data (AD/NC) slightly but is also able to predict subjects which are likely to converge to AD.
Collapse
Affiliation(s)
- Nematollah K Batmanghelich
- Department of Electrical and System Engineering, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | | | | |
Collapse
|
36
|
Directed graph based image registration. Comput Med Imaging Graph 2011; 36:139-51. [PMID: 22014476 DOI: 10.1016/j.compmedimag.2011.09.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2011] [Revised: 08/17/2011] [Accepted: 09/22/2011] [Indexed: 11/23/2022]
Abstract
In this paper, a novel image registration method is proposed to achieve accurate registration between images having large shape differences with the help of a set of appropriate intermediate templates. We first demonstrate that directionality is a key factor in both pairwise image registration and groupwise registration, which is defined in this paper to describe the influence of the registration direction and paths on the registration performance. In our solution, the intermediate template selection and intermediate template guided registration are two coherent steps with directionality being considered. To take advantage of the directionality, a directed graph is built based on the asymmetric distance defined on all ordered image pairs in the image population, which is fundamentally different from the undirected graph with symmetric distance metrics in all previous methods, and the shortest distance between template and subject on the directed graph is calculated. The allocated directed path can be thus utilized to better guide the registration by successively registering the subject through the intermediate templates one by one on the path towards the template. The proposed directed graph based solution can also be used in groupwise registration. Specifically, by building a minimum spanning arborescence (MSA) on the directed graph, the population center, i.e., a selected template, as well as the directed registration paths from all the rest of images to the population center, is determined simultaneously. The performance of directed graph based registration algorithm is demonstrated by the spatial normalization on both synthetic dataset and real brain MR images. It is shown that our method can achieve more accurate registration results than both the undirected graph based solution and the direct pairwise registration.
Collapse
|
37
|
Liao S, Jia H, Wu G, Shen D. A novel framework for longitudinal atlas construction with groupwise registration of subject image sequences. Neuroimage 2011; 59:1275-89. [PMID: 21884801 DOI: 10.1016/j.neuroimage.2011.07.095] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2011] [Revised: 07/01/2011] [Accepted: 07/26/2011] [Indexed: 11/19/2022] Open
Abstract
Longitudinal atlas construction plays an important role in medical image analysis. Given a set of longitudinal images from different subjects, the task of longitudinal atlas construction is to build an atlas sequence which can represent the trend of anatomical changes of the population. The major challenge for longitudinal atlas construction is how to effectively incorporate both the subject-specific information and population information to build the unbiased atlases. In this paper, a novel groupwise longitudinal atlas construction framework is proposed to address this challenge, and the main contributions of the proposed framework lie in the following aspects: (1) The subject-specific longitudinal information is captured by building the growth model for each subject. (2) The longitudinal atlas sequence is constructed by performing groupwise registration among all the subject image sequences, and only one transformation is needed to transform each subject's image sequence to the atlas space. The constructed longitudinal atlases are unbiased and no explicit template is assumed. (3) The proposed method is general, where the number of longitudinal images of each subject and the time points at which they are taken can be different. The proposed method is extensively evaluated on two longitudinal databases, namely the BLSA and ADNI databases, to construct the longitudinal atlas sequence. It is also compared with a state-of-the-art longitudinal atlas construction algorithm based on kernel regression on the temporal domain. Experimental results demonstrate that the proposed method consistently achieves higher registration accuracies and more consistent spatial-temporal correspondences than the compared method on both databases.
Collapse
Affiliation(s)
- Shu Liao
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | | | | | | |
Collapse
|
38
|
Wu G, Jia H, Wang Q, Shen D. SharpMean: groupwise registration guided by sharp mean image and tree-based registration. Neuroimage 2011; 56:1968-81. [PMID: 21440646 DOI: 10.1016/j.neuroimage.2011.03.050] [Citation(s) in RCA: 77] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2010] [Revised: 03/16/2011] [Accepted: 03/18/2011] [Indexed: 11/19/2022] Open
Abstract
Groupwise registration has become more and more popular due to its attractiveness for unbiased analysis of population data. One of the most popular approaches for groupwise registration is to iteratively calculate the group mean image and then register all subject images towards the latest estimated group mean image. However, its performance might be undermined by the fuzzy mean image estimated in the very beginning of groupwise registration procedure, because all subject images are far from being well-aligned at that moment. In this paper, we first point out the significance of always keeping the group mean image sharp and clear throughout the entire groupwise registration procedure, which is intuitively important but has not been explored in the literature yet. To achieve this, we resort to developing the robust mean-image estimator by the adaptive weighting strategy, where the weights are adaptive across not only the individual subject images but also all spatial locations in the image domain. On the other hand, we notice that some subjects might have large anatomical variations from the group mean image, which challenges most of the state-of-the-art registration algorithms. To ensure good registration results in each iteration, we explore the manifold of subject images and build a minimal spanning tree (MST) with the group mean image as the root of the MST. Therefore, each subject image is only registered to its parent node often with similar shapes, and its overall transformation to the group mean image space is obtained by concatenating all deformations along the paths connecting itself to the root of the MST (the group mean image). As a result, all the subjects will be well aligned to the group mean image adaptively. Our method has been evaluated in both real and simulated datasets. In all experiments, our method outperforms the conventional algorithm which generally produces a fuzzy group mean image throughout the entire groupwise registration.
Collapse
Affiliation(s)
- Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, USA.
| | | | | | | |
Collapse
|
39
|
Wu G, Wang Q, Jia H, Shen D. Feature-based groupwise registration by hierarchical anatomical correspondence detection. Hum Brain Mapp 2011; 33:253-71. [PMID: 21391266 DOI: 10.1002/hbm.21209] [Citation(s) in RCA: 40] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2010] [Revised: 08/18/2010] [Accepted: 10/20/2010] [Indexed: 11/09/2022] Open
Abstract
Groupwise registration has been widely investigated in recent years due to its importance in analyzing population data in many clinical applications. To our best knowledge, most of the groupwise registration algorithms only utilize the intensity information. However, it is well known that using intensity only is not sufficient to achieve the anatomically sound correspondences in medical image registration. In this article, we propose a novel feature-based groupwise registration algorithm to establish the anatomical correspondence across subjects by using the attribute vector that is defined as the morphological signature for each voxel. Similar to most of the state-of-the-art groupwise registration algorithms, which simultaneously estimate the transformation fields for all subjects, we develop an energy function to minimize the intersubject discrepancies on anatomical structures and drive all subjects toward the hidden common space. To make the algorithm efficient and robust, we decouple the complex groupwise registration problem into two easy-to-solve subproblems, namely (1) robust correspondence detection and (2) dense transformation field estimation, which are systematically integrated into a unified framework. To achieve the robust correspondences in the step (1), several strategies are adopted. First, the procedure of feature matching is evaluated within a neighborhood, rather than only on a single voxel. Second, the driving voxels with distinctive image features are designed to drive the transformations of other nondriving voxels. Third, we take advantage of soft correspondence assignment not only in the spatial domain but also across the population of subjects. Specifically, multiple correspondences are allowed to alleviate the ambiguity in establishing correspondences w.r.t. a particular subject and also the contributions from different subjects are dynamically controlled throughout the registration. Eventually in the step (2), based on the correspondences established for the driving voxels, thin-plate spline is used to propagate correspondences on the driving voxels to other locations in the image. By iteratively repeating correspondence detection and dense deformation estimation, all the subjects will be aligned onto the common space. Our feature-based groupwise registration algorithm has been extensively evaluated over 18 elderly brains, 16 brains from NIREP (with 32 manually delineated labels), 40 brains from LONI LPBA40 (with 54 manually delineated labels), and 12 pairs of normal controls and simulated atrophic brain images. In all experiments, our algorithm achieves more robust and accurate registration results, compared with another groupwise algorithm and a pairwise registration method.
Collapse
Affiliation(s)
- Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina 27599, USA
| | | | | | | |
Collapse
|
40
|
Depa M, Holmvang G, Schmidt EJ, Golland P, Sabuncu MR. Towards Effcient Label Fusion by Pre-Alignment of Training Data. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2011; 14:38-46. [PMID: 24660167 PMCID: PMC3958940] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Label fusion is a multi-atlas segmentation approach that explicitly maintains and exploits the entire training dataset, rather than a parametric summary of it. Recent empirical evidence suggests that label fusion can achieve significantly better segmentation accuracy over classical parametric atlas methods that utilize a single coordinate frame. However, this performance gain typically comes at an increased computational cost due to the many pairwise registrations between the novel image and training images. In this work, we present a modified label fusion method that approximates these pairwise warps by first pre-registering the training images via a diffeomorphic groupwise registration algorithm. The novel image is then only registered once, to the template image that represents the average training subject. The pairwise spatial correspondences between the novel image and training images are then computed via concatenation of appropriate transformations. Our experiments on cardiac MR data suggest that this strategy for nonparametric segmentation dramatically improves computational efficiency, while producing segmentation results that are statistically indistinguishable from those obtained with regular label fusion. These results suggest that the key benefit of label fusion approaches is the underlying nonparametric inference algorithm, and not the multiple pairwise registrations.
Collapse
Affiliation(s)
- Michal Depa
- Computer Science and Artificial Intelligence Lab, MIT, Cambridge, MA, USA
| | | | - Ehud J Schmidt
- Department of Radiology, Brigham & Women's Hospital, Boston, MA, USA
| | - Polina Golland
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA
| | | |
Collapse
|
41
|
Sabuncu MR, Yeo BTT, Van Leemput K, Fischl B, Golland P. A generative model for image segmentation based on label fusion. IEEE TRANSACTIONS ON MEDICAL IMAGING 2010; 29:1714-29. [PMID: 20562040 PMCID: PMC3268159 DOI: 10.1109/tmi.2010.2050897] [Citation(s) in RCA: 283] [Impact Index Per Article: 20.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
We propose a nonparametric, probabilistic model for the automatic segmentation of medical images, given a training set of images and corresponding label maps. The resulting inference algorithms rely on pairwise registrations between the test image and individual training images. The training labels are then transferred to the test image and fused to compute the final segmentation of the test subject. Such label fusion methods have been shown to yield accurate segmentation, since the use of multiple registrations captures greater inter-subject anatomical variability and improves robustness against occasional registration failures. To the best of our knowledge, this manuscript presents the first comprehensive probabilistic framework that rigorously motivates label fusion as a segmentation approach. The proposed framework allows us to compare different label fusion algorithms theoretically and practically. In particular, recent label fusion or multiatlas segmentation algorithms are interpreted as special cases of our framework. We conduct two sets of experiments to validate the proposed methods. In the first set of experiments, we use 39 brain MRI scans-with manually segmented white matter, cerebral cortex, ventricles and subcortical structures-to compare different label fusion algorithms and the widely-used FreeSurfer whole-brain segmentation tool. Our results indicate that the proposed framework yields more accurate segmentation than FreeSurfer and previous label fusion algorithms. In a second experiment, we use brain MRI scans of 282 subjects to demonstrate that the proposed segmentation tool is sufficiently sensitive to robustly detect hippocampal volume changes in a study of aging and Alzheimer's Disease.
Collapse
Affiliation(s)
- Mert R Sabuncu
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | | | | | | | | |
Collapse
|
42
|
Jia H, Wu G, Wang Q, Shen D. ABSORB: Atlas Building by Self-organized Registration and Bundling. Neuroimage 2010; 51:1057-70. [PMID: 20226255 PMCID: PMC2862873 DOI: 10.1016/j.neuroimage.2010.03.010] [Citation(s) in RCA: 92] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2009] [Revised: 03/01/2010] [Accepted: 03/03/2010] [Indexed: 11/25/2022] Open
Abstract
To achieve more accurate and consistent registration in an image population, a novel hierarchical groupwise registration framework, called Atlas Building by Self-Organized Registration and Bundling (ABSORB), is proposed in this paper. In this new framework, the global structure, i.e., the relative distribution of subject images is always preserved during the registration process by constraining each subject image to deform only locally with respect to its neighbors within the learned image manifold. To achieve this goal, two novel strategies, i.e., the self-organized registration by warping one image towards a set of its eligible neighbors and image bundling to cluster similar images, are specially proposed. By using these two strategies, this new framework can perform groupwise registration in a hierarchical way. Specifically, in the high level, it will perform on a much smaller dataset formed by the representative subject images of all subgroups that are generated in the previous levels of registration. Compared to the other groupwise registration methods, our proposed framework has several advantages: (1) it explores the local data distribution and uses the obtained distribution information to guide the registration; (2) the possible registration error can be greatly reduced by requiring each individual subject to move only towards its nearby subjects with similar structures; (3) it can produce a smoother registration path, in general, from each subject image to the final built atlas than other groupwise registration methods. Experimental results on both synthetic and real datasets show that the proposed framework can achieve substantial improvements, compared to the other two widely used groupwise registration methods, in terms of both registration accuracy and robustness.
Collapse
Affiliation(s)
- Hongjun Jia
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, U.S.A. , ,
| | - Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, U.S.A. , ,
| | - Qian Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, U.S.A. , ,
- Department of Computer Science, University of North Carolina at Chapel Hill, NC 27599, U.S.A.
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, U.S.A. , ,
| |
Collapse
|
43
|
Yeo BTT, Sabuncu MR, Vercauteren T, Holt DJ, Amunts K, Zilles K, Golland P, Fischl B. Learning task-optimal registration cost functions for localizing cytoarchitecture and function in the cerebral cortex. IEEE TRANSACTIONS ON MEDICAL IMAGING 2010; 29:1424-41. [PMID: 20529736 PMCID: PMC3770488 DOI: 10.1109/tmi.2010.2049497] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Image registration is typically formulated as an optimization problem with multiple tunable, manually set parameters. We present a principled framework for learning thousands of parameters of registration cost functions, such as a spatially-varying tradeoff between the image dissimilarity and regularization terms. Our approach belongs to the classic machine learning framework of model selection by optimization of cross-validation error. This second layer of optimization of cross-validation error over and above registration selects parameters in the registration cost function that result in good registration as measured by the performance of the specific application in a training data set. Much research effort has been devoted to developing generic registration algorithms, which are then specialized to particular imaging modalities, particular imaging targets and particular postregistration analyses. Our framework allows for a systematic adaptation of generic registration cost functions to specific applications by learning the "free" parameters in the cost functions. Here, we consider the application of localizing underlying cytoarchitecture and functional regions in the cerebral cortex by alignment of cortical folding. Most previous work assumes that perfectly registering the macro-anatomy also perfectly aligns the underlying cortical function even though macro-anatomy does not completely predict brain function. In contrast, we learn 1) optimal weights on different cortical folds or 2) optimal cortical folding template in the generic weighted sum of squared differences dissimilarity measure for the localization task. We demonstrate state-of-the-art localization results in both histological and functional magnetic resonance imaging data sets.
Collapse
Affiliation(s)
- B. T. Thomas Yeo
- Computer Science and Artificial Intelligence Laboratory, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139 USA ()
| | - Mert R. Sabuncu
- Computer Science and Artificial Intelligence Laboratory, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129 USA ()
| | | | - Daphne J. Holt
- Massachusetts General Hospital Psychiatry Department, Harvard Medical School, Charlestown, MA 02139 USA ()
| | - Katrin Amunts
- Department of Psychiatry and Psychotherapy, RWTH Aachen University and the Institute of Neuroscience and Medicine, Research Center Jülich, 52425 Jülich, Germany ()
| | - Karl Zilles
- Institute of Neuroscience and Medicine, Research Center Jülich and the C.&O. Vogt-Institute for Brain Research, University of Düsseldorf, 52425 Jülich, Germany ()
| | - Polina Golland
- Computer Science and Artificial Intelligence Laboratory, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139 USA ()
| | - Bruce Fischl
- Computer Science and Artificial Intelligence Laboratory, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129 USA
- Department of Radiology, Harvard Medical School and the Divison of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139 USA ()
| |
Collapse
|
44
|
Li G, Guo L, Nie J, Liu T. An automated pipeline for cortical sulcal fundi extraction. Med Image Anal 2010; 14:343-59. [PMID: 20219410 DOI: 10.1016/j.media.2010.01.005] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2008] [Revised: 01/16/2010] [Accepted: 01/28/2010] [Indexed: 11/30/2022]
Abstract
In this paper, we propose a novel automated pipeline for extraction of sulcal fundi from triangulated cortical surfaces. This method consists of four consecutive steps. Firstly, we adopt a finite difference method to estimate principal curvatures, principal directions and curvature derivatives, along the principal directions, for each vertex. Then, we detect the sulcal fundi segment in each triangle of the cortical surface based on curvatures and curvature derivatives. Afterwards, we link the sulcal fundi segments into continuous curves. Finally, we connect breaking sulcal fundi and smooth bumping sulcal fundi by using the fast marching method on the cortical surface. The proposed method can find the accurate sulcal fundi using curvatures and curvature derivatives without any manual interaction. The method was applied to 10 normal brain MR images on inner cortical surfaces. We quantitatively evaluated the accuracy of the sulcal fundi extraction method using manually labeled sulcal fundi by experts. The average difference between automatically extracted major sulcal fundi and the expert labeled results is consistently around 1.0mm on 10 subject images, indicating the good performance of the proposed method.
Collapse
Affiliation(s)
- Gang Li
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | | | | | | |
Collapse
|
45
|
Chen T, Rangarajan A, Vemuri BC. CAVIAR: CLASSIFICATION VIA AGGREGATED REGRESSION AND ITS APPLICATION IN CLASSIFYING OASIS BRAIN DATABASE. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2010; 2010:1337-1340. [PMID: 21151847 DOI: 10.1109/isbi.2010.5490244] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper presents a novel classification via aggregated regression algorithm - dubbed CAVIAR - and its application to the OASIS MRI brain image database. The CAVIAR algorithm simultaneously combines a set of weak learners based on the assumption that the weight combination for the final strong hypothesis in CAVIAR depends on both the weak learners and the training data. A regularization scheme using the nearest neighbor method is imposed in the testing stage to avoid overfitting. A closed form solution to the cost function is derived for this algorithm. We use a novel feature - the histogram of the deformation field between the MRI brain scan and the atlas which captures the structural changes in the scan with respect to the atlas brain - and this allows us to automatically discriminate between various classes within OASIS [1] using CAVIAR. We empirically show that CAVIAR significantly increases the performance of the weak classifiers by showcasing the performance of our technique on OASIS.
Collapse
Affiliation(s)
- Ting Chen
- Department of CISE, University of Florida, Gainesville, FL 32611
| | | | | |
Collapse
|
46
|
Robust Atlas-Based Segmentation of Highly Variable Anatomy: Left Atrium Segmentation. STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART. STACOM (WORKSHOP) 2010; 6364:85-94. [PMID: 26090522 DOI: 10.1007/978-3-642-15835-3_9] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
Automatic segmentation of the heart's left atrium offers great benefits for planning and outcome evaluation of atrial ablation procedures. However, the high anatomical variability of the left atrium presents significant challenges for atlas-guided segmentation. In this paper, we demonstrate an automatic method for left atrium segmentation using weighted voting label fusion and a variant of the demons registration algorithm adapted to handle images with different intensity distributions. We achieve accurate automatic segmentation that is robust to the high anatomical variations in the shape of the left atrium in a clinical dataset of MRA images.
Collapse
|
47
|
Feature-based morphometry: discovering group-related anatomical patterns. Neuroimage 2009; 49:2318-27. [PMID: 19853047 DOI: 10.1016/j.neuroimage.2009.10.032] [Citation(s) in RCA: 75] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2009] [Revised: 10/09/2009] [Accepted: 10/10/2009] [Indexed: 11/22/2022] Open
Abstract
This paper presents feature-based morphometry (FBM), a new fully data-driven technique for discovering patterns of group-related anatomical structure in volumetric imagery. In contrast to most morphometry methods which assume one-to-one correspondence between subjects, FBM explicitly aims to identify distinctive anatomical patterns that may only be present in subsets of subjects, due to disease or anatomical variability. The image is modeled as a collage of generic, localized image features that need not be present in all subjects. Scale-space theory is applied to analyze image features at the characteristic scale of underlying anatomical structures, instead of at arbitrary scales such as global or voxel-level. A probabilistic model describes features in terms of their appearance, geometry, and relationship to subject groups, and is automatically learned from a set of subject images and group labels. Features resulting from learning correspond to group-related anatomical structures that can potentially be used as image biomarkers of disease or as a basis for computer-aided diagnosis. The relationship between features and groups is quantified by the likelihood of feature occurrence within a specific group vs. the rest of the population, and feature significance is quantified in terms of the false discovery rate. Experiments validate FBM clinically in the analysis of normal (NC) and Alzheimer's (AD) brain images using the freely available OASIS database. FBM automatically identifies known structural differences between NC and AD subjects in a fully data-driven fashion, and an equal error classification rate of 0.80 is achieved for subjects aged 60-80 years exhibiting mild AD (CDR=1).
Collapse
|
48
|
Sabuncu MR, Yeo BTT, Van Leemput K, Vercauteren T, Golland P. Asymmetric image-template registration. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2009; 12:565-73. [PMID: 20426033 DOI: 10.1007/978-3-642-04268-3_70] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
A natural requirement in pairwise image registration is that the resulting deformation is independent of the order of the images. This constraint is typically achieved via a symmetric cost function and has been shown to reduce the effects of local optima. Consequently, symmetric registration has been successfully applied to pairwise image registration as well as the spatial alignment of individual images with a template. However, recent work has shown that the relationship between an image and a template is fundamentally asymmetric. In this paper, we develop a method that reconciles the practical advantages of symmetric registration with the asymmetric nature of image-template registration by adding a simple correction factor to the symmetric cost function. We instantiate our model within a log-domain diffeomorphic registration framework. Our experiments show exploiting the asymmetry in image-template registration improves alignment in the image coordinates.
Collapse
Affiliation(s)
- Mert R Sabuncu
- Computer Science and Artificial Intelligence Lab, MIT, Harvard Medical School, USA
| | | | | | | | | |
Collapse
|