1
|
Wang L, Sun Y, Seidlitz J, Bethlehem RAI, Alexander-Bloch A, Dorfschmidt L, Li G, Elison JT, Lin W, Wang L. A lifespan-generalizable skull-stripping model for magnetic resonance images that leverages prior knowledge from brain atlases. Nat Biomed Eng 2025; 9:700-715. [PMID: 39779813 DOI: 10.1038/s41551-024-01337-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 12/05/2024] [Indexed: 01/11/2025]
Abstract
In magnetic resonance imaging of the brain, an imaging-preprocessing step removes the skull and other non-brain tissue from the images. But methods for such a skull-stripping process often struggle with large data heterogeneity across medical sites and with dynamic changes in tissue contrast across lifespans. Here we report a skull-stripping model for magnetic resonance images that generalizes across lifespans by leveraging personalized priors from brain atlases. The model consists of a brain extraction module that provides an initial estimation of the brain tissue on an image, and a registration module that derives a personalized prior from an age-specific atlas. The model is substantially more accurate than state-of-the-art skull-stripping methods, as we show with a large and diverse dataset of 21,334 lifespans acquired from 18 sites with various imaging protocols and scanners, and it generates naturally consistent and seamless lifespan changes in brain volume, faithfully charting the underlying biological processes of brain development and ageing.
Collapse
Affiliation(s)
- Limei Wang
- Developing Brain Computing Lab, Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | - Yue Sun
- Developing Brain Computing Lab, Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | - Jakob Seidlitz
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
- Department of Child and Adolescent Psychiatry and Behavioral Science, The Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Lifespan Brain Institute, The Children's Hospital of Philadelphia and Penn Medicine, Philadelphia, PA, USA
| | | | - Aaron Alexander-Bloch
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
- Department of Child and Adolescent Psychiatry and Behavioral Science, The Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Lifespan Brain Institute, The Children's Hospital of Philadelphia and Penn Medicine, Philadelphia, PA, USA
| | - Lena Dorfschmidt
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
- Department of Child and Adolescent Psychiatry and Behavioral Science, The Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Lifespan Brain Institute, The Children's Hospital of Philadelphia and Penn Medicine, Philadelphia, PA, USA
| | - Gang Li
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Jed T Elison
- Institute of Child Development, University of Minnesota, Minneapolis, MN, USA
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Li Wang
- Developing Brain Computing Lab, Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
| |
Collapse
|
2
|
Zheng H, Li H, Fan Y. SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Images. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2023; 2023:10.1109/isbi53787.2023.10230488. [PMID: 37790882 PMCID: PMC10544794 DOI: 10.1109/isbi53787.2023.10230488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/05/2023]
Abstract
To achieve fast, robust, and accurate reconstruction of the human cortical surfaces from 3D magnetic resonance images (MRIs), we develop a novel deep learning-based framework, referred to as SurfNN, to reconstruct simultaneously both inner (between white matter and gray matter) and outer (pial) surfaces from MRIs. Different from existing deep learning-based cortical surface reconstruction methods that either reconstruct the cortical surfaces separately or neglect the interdependence between the inner and outer surfaces, SurfNN reconstructs both the inner and outer cortical surfaces jointly by training a single network to predict a midthickness surface that lies at the center of the inner and outer cortical surfaces. The input of SurfNN consists of a 3D MRI and an initialization of the midthickness surface that is represented both implicitly as a 3D distance map and explicitly as a triangular mesh with spherical topology, and its output includes both the inner and outer cortical surfaces, as well as the midthickness surface. The method has been evaluated on a large-scale MRI dataset and demonstrated competitive cortical surface reconstruction performance.
Collapse
Affiliation(s)
- Hao Zheng
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia USA
| | - Hongming Li
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia USA
| | - Yong Fan
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia USA
| |
Collapse
|
3
|
Zhang X, Cheng I, Liu S, Li C, Xue JH, Tam LS, Yu W. Automatic 3D joint erosion detection for the diagnosis and monitoring of rheumatoid arthritis using hand HR-pQCT images. Comput Med Imaging Graph 2023; 106:102200. [PMID: 36857951 DOI: 10.1016/j.compmedimag.2023.102200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 02/18/2023] [Accepted: 02/20/2023] [Indexed: 03/02/2023]
Abstract
Rheumatoid arthritis (RA) is a chronic inflammatory disease. It leads to bone erosion in joints and other complications, which severely affect patients' quality of life. To accurately diagnose and monitor the progression of RA, quantitative imaging and analysis tools are desirable. High-resolution peripheral quantitative computed tomography (HR-pQCT) is such a promising tool for monitoring disease progression in RA. However, automatic erosion detection tools using HR-pQCT images are not yet available. Inspired by the consensus among radiologists on the erosions in HR-pQCT images, in this paper we define erosion as the significant concave regions on the cortical layer, and develop a model-based 3D automatic erosion detection method. It mainly consists of two steps: constructing closed cortical surface, and detecting erosion regions on the surface. In the first step, we propose an initialization-robust region competition methods for joint segmentation, and then fill the surface gaps by using joint bone separation and curvature-based surface alignment. In the second step, we analyze the curvature information of each voxel, and then aggregate the candidate voxels into concave surface regions and use the shape information of the regions to detect the erosions. We perform qualitative assessments of the new method using 59 well-annotated joint volumes. Our method has shown satisfactory and consistent performance compared with the annotations provided by medical experts.
Collapse
Affiliation(s)
- Xuechen Zhang
- Department of Electronic and Computational Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Isaac Cheng
- Department of Medicine & Therapeutics, The Chinese University of Hong Kong, Hong Kong, China
| | - Shaojun Liu
- Department of Electronic and Computational Engineering, The Hong Kong University of Science and Technology, Hong Kong, China; College of Health Science and Environmental Engineering, Shenzhen Technology University, China
| | - Chenrui Li
- Department of Electronic and Computational Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Jing-Hao Xue
- Department of Statistical Science, University College London, UK
| | - Lai-Shan Tam
- Department of Medicine & Therapeutics, The Chinese University of Hong Kong, Hong Kong, China
| | - Weichuan Yu
- Department of Electronic and Computational Engineering, The Hong Kong University of Science and Technology, Hong Kong, China; HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Futian, Shenzhen, China.
| |
Collapse
|
4
|
Aswani K, Menaka D. A dual autoencoder and singular value decomposition based feature optimization for the segmentation of brain tumor from MRI images. BMC Med Imaging 2021; 21:82. [PMID: 33985449 PMCID: PMC8117624 DOI: 10.1186/s12880-021-00614-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 04/28/2021] [Indexed: 11/26/2022] Open
Abstract
BACKGROUND The brain tumor is the growth of abnormal cells inside the brain. These cells can be grown into malignant or benign tumors. Segmentation of tumor from MRI images using image processing techniques started decades back. Image processing based brain tumor segmentation can be divided in to three categories conventional image processing methods, Machine Learning methods and Deep Learning methods. Conventional methods lacks the accuracy in segmentation due to complex spatial variation of tumor. Machine Learning methods stand as a good alternative to conventional methods. Methods like SVM, KNN, Fuzzy and a combination of either of these provide good accuracy with reasonable processing speed. The difficulty in processing the various feature extraction methods and maintain accuracy as per the medical standards still exist as a limitation for machine learning methods. In Deep Learning features are extracted automatically in various stages of the network and maintain accuracy as per the medical standards. Huge database requirement and high computational time is still poses a problem for deep learning. To overcome the limitations specified above we propose an unsupervised dual autoencoder with latent space optimization here. The model require only normal MRI images for its training thus reducing the huge tumor database requirement. With a set of normal class data, an autoencoder can reproduce the feature vector into an output layer. This trained autoencoder works well with normal data while it fails to reproduce an anomaly to the output layer. But a classical autoencoder suffer due to poor latent space optimization. The Latent space loss of classical autoencoder is reduced using an auxiliary encoder along with the feature optimization based on singular value decomposition (SVD). The patches used for training are not traditional square patches but we took both horizontal and vertical patches to keep both local and global appearance features on the training set. An Autoencoder is applied separately for learning both horizontal and vertical patches. While training a logistic sigmoid transfer function is used for both encoder and decoder parts. SGD optimizer is used for optimization with an initial learning rate of .001 and the maximum epochs used are 4000. The network is trained in MATLAB 2018a with a processor capacity of 3.7 GHz with NVIDIA GPU and 16 GB of RAM. RESULTS The results are obtained using a patch size of 16 × 64, 64 × 16 for horizontal and vertical patches respectively. In Glioma images tumor is not grown from a point rather it spreads randomly. Region filling and connectivity operations are performed to get the final tumor segmentation. Overall the method segments Meningioma better than Gliomas. Three evaluation metrics are considered to measure the performance of the proposed system such as Dice Similarity Coefficient, Positive Predictive Value, and Sensitivity. CONCLUSION An unsupervised method for the segmentation of brain tumor from MRI images is proposed here. The proposed dual autoencoder with SVD based feature optimization reduce the latent space loss in the classical autoencoder. The proposed method have advantages in computational efficiency, no need of huge database requirement and better accuracy than machine learning methods. The method is compared Machine Learning methods Like SVM, KNN and supervised deep learning methods like CNN and commentable results are obtained.
Collapse
Affiliation(s)
- K Aswani
- Noorul Islam Centre for Higher Education, Kumrancoil, Tamil Nadu, India.
- , Malappuram, India.
| | - D Menaka
- Department of Applied Electronics, Noorul Islam Center for Higher Education, Kumrancoil, Tamil Nadu, India
| |
Collapse
|
5
|
Specchio N, Pepi C, De Palma L, Trivisano M, Vigevano F, Curatolo P. Neuroimaging and genetic characteristics of malformation of cortical development due to mTOR pathway dysregulation: clues for the epileptogenic lesions and indications for epilepsy surgery. Expert Rev Neurother 2021; 21:1333-1345. [PMID: 33754929 DOI: 10.1080/14737175.2021.1906651] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Introduction: Malformation of cortical development (MCD) is strongly associated with drug-resistant epilepsies for which surgery to remove epileptogenic lesions is common. Two notable technological advances in this field are identification of the underlying genetic cause and techniques in neuroimaging. These now question how presurgical evaluation ought to be approached for 'mTORpathies.'Area covered: From review of published primary and secondary articles, the authors summarize evidence to consider focal cortical dysplasia (FCD), tuber sclerosis complex (TSC), and hemimegalencephaly (HME) collectively as MCD mTORpathies. The authors also consider the unique features of these related conditions with particular focus on the practicalities of using neuroimaging techniques currently available to define surgical targets and predict post-surgical outcome. Ultimately, the authors consider the surgical dilemmas faced for each condition.Expert opinion: Considering FCD, TSC, and HME collectively as mTORpathies has some merit; however, a unified approach to presurgical evaluation would seem unachievable. Nevertheless, the authors believe combining genetic-centered classification and morphologic findings using advanced imaging techniques will eventually form the basis of a paradigm when considering candidacy for early surgery.
Collapse
Affiliation(s)
- Nicola Specchio
- Rare and Complex Epilepsy Unit, Department of Neurosciences, Bambino Gesù Children's Hospital, IRCCS, Member of European Reference Network EpiCARE, Rome, Italy
| | - Chiara Pepi
- Rare and Complex Epilepsy Unit, Department of Neurosciences, Bambino Gesù Children's Hospital, IRCCS, Member of European Reference Network EpiCARE, Rome, Italy
| | - Luca De Palma
- Rare and Complex Epilepsy Unit, Department of Neurosciences, Bambino Gesù Children's Hospital, IRCCS, Member of European Reference Network EpiCARE, Rome, Italy
| | - Marina Trivisano
- Rare and Complex Epilepsy Unit, Department of Neurosciences, Bambino Gesù Children's Hospital, IRCCS, Member of European Reference Network EpiCARE, Rome, Italy
| | - Federico Vigevano
- Department of Neuroscience, Bambino Gesù Children's Hospital, IRCCS, Member of European Reference Network EpiCARE, Rome, Italy
| | - Paolo Curatolo
- Child Neurology and Psychiatry Unit, Systems Medicine Department, Tor Vergata University, Rome, Italy
| |
Collapse
|
6
|
Tustison NJ, Holbrook AJ, Avants BB, Roberts JM, Cook PA, Reagh ZM, Duda JT, Stone JR, Gillen DL, Yassa MA. Longitudinal Mapping of Cortical Thickness Measurements: An Alzheimer's Disease Neuroimaging Initiative-Based Evaluation Study. J Alzheimers Dis 2020; 71:165-183. [PMID: 31356207 DOI: 10.3233/jad-190283] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
Longitudinal studies of development and disease in the human brain have motivated the acquisition of large neuroimaging data sets and the concomitant development of robust methodological and statistical tools for quantifying neurostructural changes. Longitudinal-specific strategies for acquisition and processing have potentially significant benefits including more consistent estimates of intra-subject measurements while retaining predictive power. Using the first phase of the Alzheimer's Disease Neuroimaging Initiative (ADNI-1) data, comprising over 600 subjects with multiple time points from baseline to 36 months, we evaluate the utility of longitudinal FreeSurfer and Advanced Normalization Tools (ANTs) surrogate thickness values in the context of a linear mixed-effects (LME) modeling strategy. Specifically, we estimate the residual variability and between-subject variability associated with each processing stream as it is known from the statistical literature that minimizing the former while simultaneously maximizing the latter leads to greater scientific interpretability in terms of tighter confidence intervals in calculated mean trends, smaller prediction intervals, and narrower confidence intervals for determining cross-sectional effects. This strategy is evaluated over the entire cortex, as defined by the Desikan-Killiany-Tourville labeling protocol, where comparisons are made with the cross-sectional and longitudinal FreeSurfer processing streams. Subsequent linear mixed effects modeling for identifying diagnostic groupings within the ADNI cohort is provided as supporting evidence for the utility of the proposed ANTs longitudinal framework which provides unbiased structural neuroimage processing and competitive to superior power for longitudinal structural change detection.
Collapse
Affiliation(s)
- Nicholas J Tustison
- Department of Radiology & Medical Imaging, University of Virginia, Charlottesville, VA, USA.,Department of Neurobiology and Behavior, University of California, Irvine, Irvine, CA, USA
| | | | - Brian B Avants
- Department of Radiology & Medical Imaging, University of Virginia, Charlottesville, VA, USA
| | - Jared M Roberts
- Department of Neurobiology and Behavior, University of California, Irvine, Irvine, CA, USA
| | - Philip A Cook
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - Zachariah M Reagh
- Department of Neurobiology and Behavior, University of California, Irvine, Irvine, CA, USA
| | - Jeffrey T Duda
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - James R Stone
- Department of Radiology & Medical Imaging, University of Virginia, Charlottesville, VA, USA
| | - Daniel L Gillen
- Department of Statistics, University of California, Irvine, CA, USA
| | - Michael A Yassa
- Department of Neurobiology and Behavior, University of California, Irvine, Irvine, CA, USA
| | | |
Collapse
|
7
|
Fatima A, Shahid AR, Raza B, Madni TM, Janjua UI. State-of-the-Art Traditional to the Machine- and Deep-Learning-Based Skull Stripping Techniques, Models, and Algorithms. J Digit Imaging 2020; 33:1443-1464. [PMID: 32666364 DOI: 10.1007/s10278-020-00367-5] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023] Open
Abstract
Several neuroimaging processing applications consider skull stripping as a crucial pre-processing step. Due to complex anatomical brain structure and intensity variations in brain magnetic resonance imaging (MRI), an appropriate skull stripping is an important part. The process of skull stripping basically deals with the removal of the skull region for clinical analysis in brain segmentation tasks, and its accuracy and efficiency are quite crucial for diagnostic purposes. It requires more accurate and detailed methods for differentiating brain regions and the skull regions and is considered as a challenging task. This paper is focused on the transition of the conventional to the machine- and deep-learning-based automated skull stripping methods for brain MRI images. It is observed in this study that deep learning approaches have outperformed conventional and machine learning techniques in many ways, but they have their limitations. It also includes the comparative analysis of the current state-of-the-art skull stripping methods, a critical discussion of some challenges, model of quantifying parameters, and future work directions.
Collapse
Affiliation(s)
- Anam Fatima
- Medical Imaging and Diagnostics (MID) Lab, National Centre of Artificial Intelligence (NCAI), Department of Computer Science, COMSATS University Islamabad (CUI), Islamabad, 45550, Pakistan
| | - Ahmad Raza Shahid
- Medical Imaging and Diagnostics (MID) Lab, National Centre of Artificial Intelligence (NCAI), Department of Computer Science, COMSATS University Islamabad (CUI), Islamabad, 45550, Pakistan
| | - Basit Raza
- Medical Imaging and Diagnostics (MID) Lab, National Centre of Artificial Intelligence (NCAI), Department of Computer Science, COMSATS University Islamabad (CUI), Islamabad, 45550, Pakistan.
| | - Tahir Mustafa Madni
- Medical Imaging and Diagnostics (MID) Lab, National Centre of Artificial Intelligence (NCAI), Department of Computer Science, COMSATS University Islamabad (CUI), Islamabad, 45550, Pakistan
| | - Uzair Iqbal Janjua
- Medical Imaging and Diagnostics (MID) Lab, National Centre of Artificial Intelligence (NCAI), Department of Computer Science, COMSATS University Islamabad (CUI), Islamabad, 45550, Pakistan
| |
Collapse
|
8
|
Sepúlveda MM, Rojas GM, Faure E, Pardo CR, Las Heras F, Okuma C, Cordovez J, de la Iglesia-Vayá M, Molina-Mateo J, Gálvez M. Visual analysis of automated segmentation in the diagnosis of focal cortical dysplasias with magnetic resonance imaging. Epilepsy Behav 2020; 102:106684. [PMID: 31778880 DOI: 10.1016/j.yebeh.2019.106684] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2019] [Revised: 10/12/2019] [Accepted: 11/02/2019] [Indexed: 01/19/2023]
Abstract
Focal cortical dysplasias (FCDs) are a frequent cause of epilepsy. It has been reported that up to 40% of them cannot be visualized with conventional magnetic resonance imaging (MRI). The main objective of this work was to evaluate by means of a retrospective descriptive observational study whether the automated brain segmentation is useful for detecting FCD. One hundred and fifty-five patients, who underwent surgery between the years 2009 and 2016, were reviewed. Twenty patients with FCD confirmed by histology and a preoperative segmentation study, with ages ranging from 3 to 43 years (14 men), were analyzed. Three expert neuroradiologists visually analyzed conventional and advanced MRI with automated segmentation. They were classified into positive and negative concerning visualization of FCD by consensus. Of the 20 patients evaluated with conventional MRI, 12 were positive for FCD. Of the negative studies for FCD with conventional MRI, 2 (25%) were positive when they were analyzed with automated segmentation. In 13 of the 20 patients (with positive segmentation for FCD), cortical thickening was observed in 5 (38.5%), while pseudothickening was observed in the rest of patients (8, 61.5%) in the anatomical region of the brain corresponding to the dysplasia. This work demonstrated that automated brain segmentation helps to increase detection of FCDs that are unable to be visualized in conventional MRI images.
Collapse
Affiliation(s)
| | - Gonzalo M Rojas
- Laboratory for Advanced Medical Image Processing, Department of Radiology, Clínica las Condes, Santiago, Chile; Health Innovation Center, Clínica las Condes, Santiago, Chile; Advanced Center for Epilepsy, Clínica la Condes, Santiago, Chile.
| | - Evelyng Faure
- Department of Radiology, Clínica las Condes, Santiago, Chile; Advanced Center for Epilepsy, Clínica la Condes, Santiago, Chile
| | - Claudio R Pardo
- Department of Radiology, Clínica las Condes, Santiago, Chile
| | - Facundo Las Heras
- Department of Pathological Anatomy, Clínica las Condes, Santiago, Chile
| | - Cecilia Okuma
- Department of Radiology, Clínica las Condes, Santiago, Chile
| | - Jorge Cordovez
- Department of Radiology, Clínica las Condes, Santiago, Chile
| | - María de la Iglesia-Vayá
- Regional Ministry of Health in Valencia Region, Valencia, Spain; Join Unit FISABIO-CIPF, Valencia, Spain
| | - José Molina-Mateo
- Center for Biomaterials and Tissue Engineering, Universitat Politècnica de València, Valencia, Spain
| | - Marcelo Gálvez
- Department of Radiology, Clínica las Condes, Santiago, Chile; Health Innovation Center, Clínica las Condes, Santiago, Chile; Advanced Center for Epilepsy, Clínica la Condes, Santiago, Chile; Academic Direction, Clinica Las Condes, Santiago, Chile
| |
Collapse
|
9
|
Cerrolaza JJ, Picazo ML, Humbert L, Sato Y, Rueckert D, Ballester MÁG, Linguraru MG. Computational anatomy for multi-organ analysis in medical imaging: A review. Med Image Anal 2019; 56:44-67. [DOI: 10.1016/j.media.2019.04.002] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2018] [Revised: 02/05/2019] [Accepted: 04/13/2019] [Indexed: 12/19/2022]
|
10
|
Makropoulos A, Counsell SJ, Rueckert D. A review on automatic fetal and neonatal brain MRI segmentation. Neuroimage 2018; 170:231-248. [DOI: 10.1016/j.neuroimage.2017.06.074] [Citation(s) in RCA: 100] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 03/06/2017] [Accepted: 06/26/2017] [Indexed: 01/18/2023] Open
|
11
|
Liu J, Zhuang X, Wu L, An D, Xu J, Peters T, Gu L. Myocardium Segmentation From DE MRI Using Multicomponent Gaussian Mixture Model and Coupled Level Set. IEEE Trans Biomed Eng 2018; 64:2650-2661. [PMID: 28129147 DOI: 10.1109/tbme.2017.2657656] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Objective: In this paper, we propose a fully automatic framework for myocardium segmentation of delayed-enhancement (DE) MRI images without relying on prior patient-specific information. Methods: We employ a multicomponent Gaussian mixture model to deal with the intensity heterogeneity of myocardium caused by the infarcts. To differentiate the myocardium from other tissues with similar intensities, while at the same time maintain spatial continuity, we introduce a coupled level set (CLS) to regularize the posterior probability. The CLS, as a spatial regularization, can be adapted to the image characteristics dynamically. We also introduce an image intensity gradient based term into the CLS, adding an extra force to the posterior probability based framework, to improve the accuracy of myocardium boundary delineation. The prebuilt atlases are propagated to the target image to initialize the framework. Results: The proposed method was tested on datasets of 22 clinical cases, and achieved Dice similarity coefficients of 87.43 ± 5.62% (endocardium), 90.53 ± 3.20% (epicardium) and 73.58 ± 5.58% (myocardium), which have outperformed three variants of the classic segmentation methods. Conclusion: The results can provide a benchmark for the myocardial segmentation in the literature. Significance: DE MRI provides an important tool to assess the viability of myocardium. The accurate segmentation of myocardium, which is a prerequisite for further quantitative analysis of myocardial infarction (MI) region, can provide important support for the diagnosis and treatment management for MI patients.Objective: In this paper, we propose a fully automatic framework for myocardium segmentation of delayed-enhancement (DE) MRI images without relying on prior patient-specific information. Methods: We employ a multicomponent Gaussian mixture model to deal with the intensity heterogeneity of myocardium caused by the infarcts. To differentiate the myocardium from other tissues with similar intensities, while at the same time maintain spatial continuity, we introduce a coupled level set (CLS) to regularize the posterior probability. The CLS, as a spatial regularization, can be adapted to the image characteristics dynamically. We also introduce an image intensity gradient based term into the CLS, adding an extra force to the posterior probability based framework, to improve the accuracy of myocardium boundary delineation. The prebuilt atlases are propagated to the target image to initialize the framework. Results: The proposed method was tested on datasets of 22 clinical cases, and achieved Dice similarity coefficients of 87.43 ± 5.62% (endocardium), 90.53 ± 3.20% (epicardium) and 73.58 ± 5.58% (myocardium), which have outperformed three variants of the classic segmentation methods. Conclusion: The results can provide a benchmark for the myocardial segmentation in the literature. Significance: DE MRI provides an important tool to assess the viability of myocardium. The accurate segmentation of myocardium, which is a prerequisite for further quantitative analysis of myocardial infarction (MI) region, can provide important support for the diagnosis and treatment management for MI patients.
Collapse
Affiliation(s)
- Jie Liu
- School of Biomedical EngineeringShanghai Jiao Tong University
| | | | - Lianming Wu
- Department of RadiologyRenji HospitalShanghai Jiao Tong University School of Medicine
| | - Dongaolei An
- Department of RadiologyRenji HospitalShanghai Jiao Tong University School of Medicine
| | - Jianrong Xu
- Department of RadiologyRenji HospitalShanghai Jiao Tong University School of Medicine
| | - Terry Peters
- Robarts Research InstituteUniversity of Western Ontario
| | - Lixu Gu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
12
|
Abstract
The high resolution magnetic resonance (MR) brain images contain some non-brain tissues such as skin, fat, muscle, neck, and eye balls compared to the functional images namely positron emission tomography (PET), single photon emission computed tomography (SPECT), and functional magnetic resonance imaging (fMRI) which usually contain relatively less non-brain tissues. The presence of these non-brain tissues is considered as a major obstacle for automatic brain image segmentation and analysis techniques. Therefore, quantitative morphometric studies of MR brain images often require a preliminary processing to isolate the brain from extra-cranial or non-brain tissues, commonly referred to as skull stripping. This paper describes the available methods on skull stripping and an exploratory review of recent literature on the existing skull stripping methods.
Collapse
Affiliation(s)
- P. Kalavathi
- />Department of Computer Science and Applications, Gandhigram Rural Institute - Deemed University, Gandhigram, Tamil Nadu 624302 India
| | - V. B. Surya Prasath
- />Computational Imaging and VisAnalysis (CIVA) Lab, Department of Computer Science, University of Missouri-Columbia, Columbia, MO 65211 USA
| |
Collapse
|
13
|
Huo Y, Plassard AJ, Carass A, Resnick SM, Pham DL, Prince JL, Landman BA. Consistent cortical reconstruction and multi-atlas brain segmentation. Neuroimage 2016; 138:197-210. [PMID: 27184203 DOI: 10.1016/j.neuroimage.2016.05.030] [Citation(s) in RCA: 78] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2016] [Accepted: 05/10/2016] [Indexed: 01/14/2023] Open
Abstract
Whole brain segmentation and cortical surface reconstruction are two essential techniques for investigating the human brain. Spatial inconsistences, which can hinder further integrated analyses of brain structure, can result due to these two tasks typically being conducted independently of each other. FreeSurfer obtains self-consistent whole brain segmentations and cortical surfaces. It starts with subcortical segmentation, then carries out cortical surface reconstruction, and ends with cortical segmentation and labeling. However, this "segmentation to surface to parcellation" strategy has shown limitations in various cohorts such as older populations with large ventricles. In this work, we propose a novel "multi-atlas segmentation to surface" method called Multi-atlas CRUISE (MaCRUISE), which achieves self-consistent whole brain segmentations and cortical surfaces by combining multi-atlas segmentation with the cortical reconstruction method CRUISE. A modification called MaCRUISE(+) is designed to perform well when white matter lesions are present. Comparing to the benchmarks CRUISE and FreeSurfer, the surface accuracy of MaCRUISE and MaCRUISE(+) is validated using two independent datasets with expertly placed cortical landmarks. A third independent dataset with expertly delineated volumetric labels is employed to compare segmentation performance. Finally, 200MR volumetric images from an older adult sample are used to assess the robustness of MaCRUISE and FreeSurfer. The advantages of MaCRUISE are: (1) MaCRUISE constructs self-consistent voxelwise segmentations and cortical surfaces, while MaCRUISE(+) is robust to white matter pathology. (2) MaCRUISE achieves more accurate whole brain segmentations than independently conducting the multi-atlas segmentation. (3) MaCRUISE is comparable in accuracy to FreeSurfer (when FreeSurfer does not exhibit global failures) while achieving greater robustness across an older adult population. MaCRUISE has been made freely available in open source.
Collapse
Affiliation(s)
- Yuankai Huo
- Electrical Engineering, Vanderbilt University, Nashville, TN, USA.
| | | | - Aaron Carass
- Image Analysis and Communications Laboratory, Johns Hopkins University, Baltimore, MD, USA
| | - Susan M Resnick
- Laboratory of Behavioral Neuroscience, National Institute on Aging, Baltimore, MD, USA
| | - Dzung L Pham
- Center for Neuroscience and Regenerative Medicine, Henry Jackson Foundation, Bethesda, MD, USA
| | - Jerry L Prince
- Image Analysis and Communications Laboratory, Johns Hopkins University, Baltimore, MD, USA
| | - Bennett A Landman
- Electrical Engineering, Vanderbilt University, Nashville, TN, USA; Computer Science, Vanderbilt University, Nashville, TN, USA; Institute of Imaging Science, Vanderbilt University, Nashville, TN, USA; Radiology and Radiological Sciences, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
14
|
Lee J, Kim SH, Oguz I, Styner M. Enhanced Cortical Thickness Measurements for Rodent Brains via Lagrangian-based RK4 Streamline Computation. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2016; 9784. [PMID: 27065047 DOI: 10.1117/12.2216420] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
The cortical thickness of the mammalian brain is an important morphological characteristic that can be used to investigate and observe the brain's developmental changes that might be caused by biologically toxic substances such as ethanol or cocaine. Although various cortical thickness analysis methods have been proposed that are applicable for human brain and have developed into well-validated open-source software packages, cortical thickness analysis methods for rodent brains have not yet become as robust and accurate as those designed for human brains. Based on a previously proposed cortical thickness measurement pipeline for rodent brain analysis,1 we present an enhanced cortical thickness pipeline in terms of accuracy and anatomical consistency. First, we propose a Lagrangian-based computational approach in the thickness measurement step in order to minimize local truncation error using the fourth-order Runge-Kutta method. Second, by constructing a line object for each streamline of the thickness measurement, we can visualize the way the thickness is measured and achieve sub-voxel accuracy by performing geometric post-processing. Last, with emphasis on the importance of an anatomically consistent partial differential equation (PDE) boundary map, we propose an automatic PDE boundary map generation algorithm that is specific to rodent brain anatomy, which does not require manual labeling. The results show that the proposed cortical thickness pipeline can produce statistically significant regions that are not observed in the the previous cortical thickness analysis pipeline.
Collapse
Affiliation(s)
- Joohwi Lee
- University of North Carolina at Chapel Hill, Department of Computer Science, United States
| | - Sun Hyung Kim
- University of North Carolina at Chapel Hill, Department of Psychiatry, United States
| | - Ipek Oguz
- The University of Iowa, Department of Electrical and Computer Engineering, United States
| | - Martin Styner
- University of North Carolina at Chapel Hill, Department of Computer Science, United States; University of North Carolina at Chapel Hill, Department of Psychiatry, United States
| |
Collapse
|
15
|
Zhao F, Xie X. Energy minimization in medical image analysis: Methodologies and applications. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2016; 32:e02733. [PMID: 26186171 DOI: 10.1002/cnm.2733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2015] [Revised: 06/23/2015] [Accepted: 06/23/2015] [Indexed: 06/04/2023]
Abstract
Energy minimization is of particular interest in medical image analysis. In the past two decades, a variety of optimization schemes have been developed. In this paper, we present a comprehensive survey of the state-of-the-art optimization approaches. These algorithms are mainly classified into two categories: continuous method and discrete method. The former includes Newton-Raphson method, gradient descent method, conjugate gradient method, proximal gradient method, coordinate descent method, and genetic algorithm-based method, while the latter covers graph cuts method, belief propagation method, tree-reweighted message passing method, linear programming method, maximum margin learning method, simulated annealing method, and iterated conditional modes method. We also discuss the minimal surface method, primal-dual method, and the multi-objective optimization method. In addition, we review several comparative studies that evaluate the performance of different minimization techniques in terms of accuracy, efficiency, or complexity. These optimization techniques are widely used in many medical applications, for example, image segmentation, registration, reconstruction, motion tracking, and compressed sensing. We thus give an overview on those applications as well.
Collapse
Affiliation(s)
- Feng Zhao
- Department of Computer Science, Swansea University, Swansea, SA2 8PP, UK
| | - Xianghua Xie
- Department of Computer Science, Swansea University, Swansea, SA2 8PP, UK
| |
Collapse
|
16
|
Del Re EC, Gao Y, Eckbo R, Petryshen TL, Blokland GAM, Seidman LJ, Konishi J, Goldstein JM, McCarley RW, Shenton ME, Bouix S. A New MRI Masking Technique Based on Multi-Atlas Brain Segmentation in Controls and Schizophrenia: A Rapid and Viable Alternative to Manual Masking. J Neuroimaging 2015; 26:28-36. [PMID: 26585545 DOI: 10.1111/jon.12313] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2015] [Revised: 09/24/2015] [Accepted: 09/25/2015] [Indexed: 01/18/2023] Open
Abstract
UNLABELLED Brain masking of MRI images separates brain from surrounding tissue and its accuracy is important for further imaging analyses. We implemented a new brain masking technique based on multi-atlas brain segmentation (MABS) and compared MABS to masks generated using FreeSurfer (FS; version 5.3), Brain Extraction Tool (BET), and Brainwash, using manually defined masks (MM) as the gold standard. We further determined the effect of different masking techniques on cortical and subcortical volumes generated by FreeSurfer. METHODS Images were acquired on a 3-Tesla MR Echospeed system General Electric scanner on five control and five schizophrenia subjects matched on age, sex, and IQ. Automated masks were generated from MABS, FS, BET, and Brainwash, and compared to MM using these metrics: a) volume difference from MM; b) Dice coefficients; and c) intraclass correlation coefficients. RESULTS Mean volume difference between MM and MABS masks was significantly less than the difference between MM and FS or BET masks. Dice coefficient between MM and MABS was significantly higher than Dice coefficients between MM and FS, BET, or Brainwash. For subcortical and left cortical regions, MABS volumes were closer to MM volumes than were BET or FS volumes. For right cortical regions, MABS volumes were closer to MM volumes than were BET volumes. CONCLUSIONS Brain masks generated using FreeSurfer, BET, and Brainwash are rapidly obtained, but are less accurate than manually defined masks. Masks generated using MABS, in contrast, resemble more closely the gold standard of manual masking, thereby offering a rapid and viable alternative.
Collapse
Affiliation(s)
- Elisabetta C Del Re
- VA Boston Healthcare System, Brockton, MA.,Department of Psychiatry, Harvard Medical School, Boston, MA
| | - Yi Gao
- Department of Psychiatry, Harvard Medical School, Boston, MA
| | - Ryan Eckbo
- Department of Psychiatry, Harvard Medical School, Boston, MA
| | | | | | - Larry J Seidman
- Department of Psychiatry, Harvard Medical School, Boston, MA
| | - Jun Konishi
- VA Boston Healthcare System, Brockton, MA.,Department of Psychiatry, Harvard Medical School, Boston, MA
| | | | - Robert W McCarley
- VA Boston Healthcare System, Brockton, MA.,Department of Psychiatry, Harvard Medical School, Boston, MA
| | - Martha E Shenton
- VA Boston Healthcare System, Brockton, MA.,Department of Psychiatry, Harvard Medical School, Boston, MA.,Department of Radiology, Harvard Medical School, Boston, MA
| | - Sylvain Bouix
- Department of Psychiatry, Harvard Medical School, Boston, MA
| |
Collapse
|
17
|
Pagnozzi AM, Gal Y, Boyd RN, Fiori S, Fripp J, Rose S, Dowson N. The need for improved brain lesion segmentation techniques for children with cerebral palsy: A review. Int J Dev Neurosci 2015; 47:229-46. [DOI: 10.1016/j.ijdevneu.2015.08.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2015] [Revised: 08/24/2015] [Accepted: 08/24/2015] [Indexed: 01/18/2023] Open
Affiliation(s)
- Alex M. Pagnozzi
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
- The University of QueenslandSchool of MedicineSt. LuciaBrisbaneAustralia
| | - Yaniv Gal
- The University of QueenslandCentre for Medical Diagnostic Technologies in QueenslandSt. LuciaBrisbaneAustralia
| | - Roslyn N. Boyd
- The University of QueenslandQueensland Cerebral Palsy and Rehabilitation Research CentreSchool of MedicineBrisbaneAustralia
| | - Simona Fiori
- Department of Developmental NeuroscienceStella Maris Scientific InstitutePisaItaly
| | - Jurgen Fripp
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
| | - Stephen Rose
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
| | - Nicholas Dowson
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
| |
Collapse
|
18
|
Coplan JD, Fathy HM, Jackowski AP, Tang CY, Perera TD, Mathew SJ, Martinez J, Abdallah CG, Dwork AJ, Pantol G, Carpenter D, Gorman JM, Nemeroff CB, Owens MJ, Kaffman A, Kaufman J. Early life stress and macaque amygdala hypertrophy: preliminary evidence for a role for the serotonin transporter gene. Front Behav Neurosci 2014; 8:342. [PMID: 25339875 PMCID: PMC4186477 DOI: 10.3389/fnbeh.2014.00342] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2014] [Accepted: 09/11/2014] [Indexed: 01/24/2023] Open
Abstract
Background: Children exposed to early life stress (ELS) exhibit enlarged amygdala volume in comparison to controls. The primary goal of this study was to examine amygdala volumes in bonnet macaques subjected to maternal variable foraging demand (VFD) rearing, a well-established model of ELS. Preliminary analyses examined the interaction of ELS and the serotonin transporter gene on amygdala volume. Secondary analyses were conducted to examine the association between amygdala volume and other stress-related variables previously found to distinguish VFD and non-VFD reared animals. Methods: Twelve VFD-reared and nine normally reared monkeys completed MRI scans on a 3T system (mean age = 5.2 years). Results: Left amygdala volume was larger in VFD vs. control macaques. Larger amygdala volume was associated with: “high” cerebrospinal fluid concentrations of corticotropin releasing-factor (CRF) determined when the animals were in adolescence (mean age = 2.7 years); reduced fractional anisotropy (FA) of the anterior limb of the internal capsule (ALIC) during young adulthood (mean age = 5.2 years) and timid anxiety-like responses to an intruder during full adulthood (mean age = 8.4 years). Right amygdala volume varied inversely with left hippocampal neurogenesis assessed in late adulthood (mean age = 8.7 years). Exploratory analyses also showed a gene-by-environment effect, with VFD-reared macaques with a single short allele of the serotonin transporter gene exhibiting larger amygdala volume compared to VFD-reared subjects with only the long allele and normally reared controls. Conclusion: These data suggest that the left amygdala exhibits hypertrophy after ELS, particularly in association with the serotonin transporter gene, and that amygdala volume variation occurs in concert with other key stress-related behavioral and neurobiological parameters observed across the lifecycle. Future research is required to understand the mechanisms underlying these diverse and persistent changes associated with ELS and amygdala volume.
Collapse
Affiliation(s)
- Jeremy D Coplan
- Department of Psychiatry and Behavioral Sciences, State University of New York, Downstate Medical Center Brooklyn, NY, USA
| | - Hassan M Fathy
- Department of Psychiatry and Behavioral Sciences, State University of New York, Downstate Medical Center Brooklyn, NY, USA
| | - Andrea P Jackowski
- Departamento de Psiquiatria, Neuroradiology, Universidade Federal de São Paulo São Paolo, Brazil
| | - Cheuk Y Tang
- Departments of Psychiatry, Neuroscience, and Radiology, Mount Sinai School of Medicine New York, NY, USA
| | - Tarique D Perera
- Psychiatry, New York State Psychiatric Institute New York, NY, USA
| | - Sanjay J Mathew
- Mental Health Care Line, Michael E. Debakey VA Medical Center Houston, TX, USA ; Menninger Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine Houston, TX, USA
| | - Jose Martinez
- Department of Psychiatry, Mount Sinai School of Medicine New York, NY, USA
| | - Chadi G Abdallah
- Department of Psychiatry, Yale University School of Medicine New Haven, CT, USA ; Clinical Neuroscience Division, National Center for PTSD West Haven, CT, USA
| | - Andrew J Dwork
- Department of Molecular Imaging and Neuropathology, New York State Psychiatric Institute New York, NY, USA ; Departmets of Psychiatry and Pathology and Cell Biology, College of Physicians and Surgeons of Columbia University New York, NY, USA
| | - Gustavo Pantol
- Departments of Psychiatry, Neuroscience, and Radiology, Mount Sinai School of Medicine New York, NY, USA
| | - David Carpenter
- Departments of Psychiatry, Neuroscience, and Radiology, Mount Sinai School of Medicine New York, NY, USA
| | - Jack M Gorman
- Comprehensive NeuroScience Corporation Westchester, NY, USA
| | - Charles B Nemeroff
- Department of Psychiatry and Behavioral Sciences, University of Miami Health Sytems Miami, FL, USA
| | - Michael J Owens
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine Emory, GA, USA
| | - Arie Kaffman
- Department of Psychiatry, Yale University School of Medicine New Haven, CT, USA
| | - Joan Kaufman
- Clinical Neuroscience Division, National Center for PTSD West Haven, CT, USA ; Department of Psychiatry, Yale University School of Medicine New Haven, CT, USA
| |
Collapse
|
19
|
Tustison NJ, Cook PA, Klein A, Song G, Das SR, Duda JT, Kandel BM, van Strien N, Stone JR, Gee JC, Avants BB. Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements. Neuroimage 2014; 99:166-79. [PMID: 24879923 DOI: 10.1016/j.neuroimage.2014.05.044] [Citation(s) in RCA: 475] [Impact Index Per Article: 43.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2014] [Revised: 05/11/2014] [Accepted: 05/15/2014] [Indexed: 12/20/2022] Open
Abstract
Many studies of the human brain have explored the relationship between cortical thickness and cognition, phenotype, or disease. Due to the subjectivity and time requirements in manual measurement of cortical thickness, scientists have relied on robust software tools for automation which facilitate the testing and refinement of neuroscientific hypotheses. The most widely used tool for cortical thickness studies is the publicly available, surface-based FreeSurfer package. Critical to the adoption of such tools is a demonstration of their reproducibility, validity, and the documentation of specific implementations that are robust across large, diverse imaging datasets. To this end, we have developed the automated, volume-based Advanced Normalization Tools (ANTs) cortical thickness pipeline comprising well-vetted components such as SyGN (multivariate template construction), SyN (image registration), N4 (bias correction), Atropos (n-tissue segmentation), and DiReCT (cortical thickness estimation). In this work, we have conducted the largest evaluation of automated cortical thickness measures in publicly available data, comparing FreeSurfer and ANTs measures computed on 1205 images from four open data sets (IXI, MMRR, NKI, and OASIS), with parcellation based on the recently proposed Desikan-Killiany-Tourville (DKT) cortical labeling protocol. We found good scan-rescan repeatability with both FreeSurfer and ANTs measures. Given that such assessments of precision do not necessarily reflect accuracy or an ability to make statistical inferences, we further tested the neurobiological validity of these approaches by evaluating thickness-based prediction of age and gender. ANTs is shown to have a higher predictive performance than FreeSurfer for both of these measures. In promotion of open science, we make all of our scripts, data, and results publicly available which complements the use of open image data sets and the open source availability of the proposed ANTs cortical thickness pipeline.
Collapse
Affiliation(s)
- Nicholas J Tustison
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, USA.
| | - Philip A Cook
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| | | | - Gang Song
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| | - Sandhitsu R Das
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| | - Jeffrey T Duda
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| | - Benjamin M Kandel
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| | - Niels van Strien
- Sage Bionetworks, Seattle, WA, USA; Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway
| | - James R Stone
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, USA
| | - James C Gee
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| | - Brian B Avants
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
20
|
Zhu L, Gao Y, Appia V, Yezzi A, Arepalli C, Faber T, Stillman A, Tannenbaum A. A complete system for automatic extraction of left ventricular myocardium from CT images using shape segmentation and contour evolution. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2014; 23:1340-1351. [PMID: 24723531 PMCID: PMC4133272 DOI: 10.1109/tip.2014.2300751] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
The left ventricular myocardium plays a key role in the entire circulation system and an automatic delineation of the myocardium is a prerequisite for most of the subsequent functional analysis. In this paper, we present a complete system for an automatic segmentation of the left ventricular myocardium from cardiac computed tomography (CT) images using the shape information from images to be segmented. The system follows a coarse-to-fine strategy by first localizing the left ventricle and then deforming the myocardial surfaces of the left ventricle to refine the segmentation. In particular, the blood pool of a CT image is extracted and represented as a triangulated surface. Then, the left ventricle is localized as a salient component on this surface using geometric and anatomical characteristics. After that, the myocardial surfaces are initialized from the localization result and evolved by applying forces from the image intensities with a constraint based on the initial myocardial surface locations. The proposed framework has been validated on 34-human and 12-pig CT images, and the robustness and accuracy are demonstrated.
Collapse
Affiliation(s)
- Liangjia Zhu
- Department of Computer Science, Stony Brook University, Stony Brook, NY 11794 USA
| | - Yi Gao
- Department of Electrical and Computer Engineering, Comprehensive Cancer Center, University of Alabama at Birmingham, Birmingham, AL 35294 USA
| | - Vikram Appia
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30303 USA
| | - Anthony Yezzi
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30303 USA
| | - Chesnal Arepalli
- Department of Radiology, Emory University, Atlanta, GA 30322 USA
| | - Tracy Faber
- Department of Radiology, Emory University, Atlanta, GA 30322 USA
| | - Arthur Stillman
- Department of Radiology, Emory University, Atlanta, GA 30322 USA
| | - Allen Tannenbaum
- Department of Computer Science and Department of Applied Mathematics/Statistics, Stony Brook University, Stony Brook, NY 11794 USA
| |
Collapse
|
21
|
Doshi J, Erus G, Ou Y, Gaonkar B, Davatzikos C. Multi-atlas skull-stripping. Acad Radiol 2013; 20:1566-76. [PMID: 24200484 DOI: 10.1016/j.acra.2013.09.010] [Citation(s) in RCA: 180] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2013] [Revised: 09/05/2013] [Accepted: 09/06/2013] [Indexed: 01/18/2023]
Abstract
RATIONALE AND OBJECTIVES We present a new method for automatic brain extraction on structural magnetic resonance images, based on a multi-atlas registration framework. MATERIALS AND METHODS Our method addresses fundamental challenges of multi-atlas approaches. To overcome the difficulties arising from the variability of imaging characteristics between studies, we propose a study-specific template selection strategy, by which we select a set of templates that best represent the anatomical variations within the data set. Against the difficulties of registering brain images with skull, we use a particularly adapted registration algorithm that is more robust to large variations between images, as it adaptively aligns different regions of the two images based not only on their similarity but also on the reliability of the matching between images. Finally, a spatially adaptive weighted voting strategy, which uses the ranking of Jacobian determinant values to measure the local similarity between the template and the target images, is applied for combining coregistered template masks. RESULTS The method is validated on three different public data sets and obtained a higher accuracy than recent state-of-the-art brain extraction methods. Also, the proposed method is successfully applied on several recent imaging studies, each containing thousands of magnetic resonance images, thus reducing the manual correction time significantly. CONCLUSIONS The new method, available as a stand-alone software package for public use, provides a robust and accurate brain extraction tool applicable for both clinical use and large population studies.
Collapse
Affiliation(s)
- Jimit Doshi
- Section of Biomedical Image Analysis, Department of Radiology, 3600 Market St. Suite 380, University of Pennsylvania, Philadelphia, PA, USA
| | | | | | | | | |
Collapse
|
22
|
Arimura H, Tokunaga C, Yoshiura T, Ohara T, Yamashita Y, Toyofuku F. Automated measurement of cerebral cortical thickness based on fuzzy membership map derived from MR images for evaluation of Alzheimer's disease. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2013:7116-9. [PMID: 24111385 DOI: 10.1109/embc.2013.6611198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
We have proposed an automated method for three-dimensional (3D) measurement of cerebral cortical thicknesses based on fuzzy membership maps derived from magnetic resonance (MR) images for evaluation of Alzheimer's disease (AD). The cerebral cortical thickness was three-dimensionally measured on each cortical surface voxel by using a localized gradient vector trajectory in a fuzzy membership map. The proposed method could be useful for the 3D measurement of the cerebral cortical thickness on individual cortical surface voxels as an atrophy feature in AD.
Collapse
|
23
|
Abstract
It's a great challenge to analyze infant brain MR images due to the small brain size and low contrast of the developing brain tissues. We have developed an Infant Brain Extraction and Analysis Toolbox (iBEAT) for various processing of magnetic resonance (MR) images of infant brains. Several major functions generally used in infant brain analysis are integrated in iBEAT, including image preprocessing, brain extraction, tissue segmentation, and brain labeling. The functions of brain extraction, tissue segmentation, and brain labeling are provided respectively by three state-of-the-art algorithms. First, a learning-based meta-algorithm which integrates a group of brain extraction results generated by the two existing brain extraction algorithms (BET and BSE) was implemented in iBEAT for extraction of infant brains from MR images. Second, a level-sets-based tissue segmentation algorithm that utilizes multimodality information, cortical thickness constraint, and longitudinal consistency constraint was also included in iBEAT for segmentation of infant brain tissues. Third, HAMMER (standing for Hierarchical Attribute Matching Mechanism for Elastic Registration) registration algorithm was further included in iBEAT to label regions of interest (ROIs) of infant brain images by warping the pre-labeled ROIs of a template to the infant brain image space. By integration of these state-of-the-art methods, iBEAT is able to segment and label infant brain MR images accurately. Moreover, it can process not only single-time-point images for cross-sectional studies, but also multiple-time-point images of the same infant for longitudinal studies. The performance of iBEAT has been comprehensively evaluated with hundreds of infant brain images. A Linux-based standalone package of iBEAT is freely available at http://www.nitrc.org/projects/ibeat .
Collapse
|
24
|
Segmentation of neonatal brain MR images using patch-driven level sets. Neuroimage 2013; 84:141-58. [PMID: 23968736 DOI: 10.1016/j.neuroimage.2013.08.008] [Citation(s) in RCA: 103] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2013] [Revised: 07/18/2013] [Accepted: 08/07/2013] [Indexed: 01/18/2023] Open
Abstract
The segmentation of neonatal brain MR image into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF), is challenging due to the low spatial resolution, severe partial volume effect, high image noise, and dynamic myelination and maturation processes. Atlas-based methods have been widely used for guiding neonatal brain segmentation. Existing brain atlases were generally constructed by equally averaging all the aligned template images from a population. However, such population-based atlases might not be representative of a testing subject in the regions with high inter-subject variability and thus often lead to a low capability in guiding segmentation in those regions. Recently, patch-based sparse representation techniques have been proposed to effectively select the most relevant elements from a large group of candidates, which can be used to generate a subject-specific representation with rich local anatomical details for guiding the segmentation. Accordingly, in this paper, we propose a novel patch-driven level set method for the segmentation of neonatal brain MR images by taking advantage of sparse representation techniques. Specifically, we first build a subject-specific atlas from a library of aligned, manually segmented images by using sparse representation in a patch-based fashion. Then, the spatial consistency in the probability maps from the subject-specific atlas is further enforced by considering the similarities of a patch with its neighboring patches. Finally, the probability maps are integrated into a coupled level set framework for more accurate segmentation. The proposed method has been extensively evaluated on 20 training subjects using leave-one-out cross validation, and also on 132 additional testing subjects. Our method achieved a high accuracy of 0.919±0.008 for white matter and 0.901±0.005 for gray matter, respectively, measured by Dice ratio for the overlap between the automated and manual segmentations in the cortical region.
Collapse
|
25
|
Han H, Li L, Duan C, Zhang H, Zhao Y, Liang Z. A unified EM approach to bladder wall segmentation with coupled level-set constraints. Med Image Anal 2013; 17:1192-205. [PMID: 24001932 DOI: 10.1016/j.media.2013.08.002] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2013] [Revised: 08/02/2013] [Accepted: 08/06/2013] [Indexed: 01/02/2023]
Abstract
Magnetic resonance (MR) imaging-based virtual cystoscopy (VCys), as a non-invasive, safe and cost-effective technique, has shown its promising virtue for early diagnosis and recurrence management of bladder carcinoma. One primary goal of VCys is to identify bladder lesions with abnormal bladder wall thickness, and consequently a precise segmentation of the inner and outer borders of the wall is required. In this paper, we propose a unified expectation-maximization (EM) approach to the maximum-a posteriori (MAP) solution of bladder wall segmentation, by integrating a novel adaptive Markov random field (AMRF) model and the coupled level-set (CLS) information into the prior term. The proposed approach is applied to the segmentation of T(1)-weighted MR images, where the wall is enhanced while the urine and surrounding soft tissues are suppressed. By introducing scale-adaptive neighborhoods as well as adaptive weights into the conventional MRF model, the AMRF model takes into account the local information more accurately. In order to mitigate the influence of image artifacts adjacent to the bladder wall and to preserve the continuity of the wall surface, we apply geometrical constraints on the wall using our previously developed CLS method. This paper not only evaluates the robustness of the presented approach against the known ground truth of simulated digital phantoms, but further compares its performance with our previous CLS approach via both volunteer and patient studies. Statistical analysis on experts' scores of the segmented borders from both approaches demonstrates that our new scheme is more effective in extracting the bladder wall. Based on the wall thickness calibrated from the segmented single-layer borders, a three-dimensional virtual bladder model can be constructed and the wall thickness can be mapped onto the model, where the bladder lesions will be eventually detected via experts' visualization and/or computer-aided detection.
Collapse
Affiliation(s)
- Hao Han
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | | | | | | | | | | |
Collapse
|
26
|
Wang L, Shi F, Li G, Shen D. 4D segmentation of brain MR images with constrained cortical thickness variation. PLoS One 2013; 8:e64207. [PMID: 23843934 PMCID: PMC3699620 DOI: 10.1371/journal.pone.0064207] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2012] [Accepted: 04/10/2013] [Indexed: 11/18/2022] Open
Abstract
Segmentation of brain MR images plays an important role in longitudinal investigation of developmental, aging, disease progression changes in the cerebral cortex. However, most existing brain segmentation methods consider multiple time-point images individually and thus cannot achieve longitudinal consistency. For example, cortical thickness measured from the segmented image will contain unnecessary temporal variations, which will affect the time related change pattern and eventually reduce the statistical power of analysis. In this paper, we propose a 4D segmentation framework for the adult brain MR images with the constraint of cortical thickness variations. Specifically, we utilize local intensity information to address the intensity inhomogeneity, spatial cortical thickness constraint to maintain the cortical thickness being within a reasonable range, and temporal cortical thickness variation constraint in neighboring time-points to suppress the artificial variations. The proposed method has been tested on BLSA dataset and ADNI dataset with promising results. Both qualitative and quantitative experimental results demonstrate the advantage of the proposed method, in comparison to other state-of-the-art 4D segmentation methods.
Collapse
Affiliation(s)
- Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
- Department of Brain and Cognitive Engineering, Korea University, Seoul, Korea
| |
Collapse
|
27
|
Mahapatra D. Skull stripping of neonatal brain MRI: using prior shape information with graph cuts. J Digit Imaging 2013; 25:802-14. [PMID: 22354704 DOI: 10.1007/s10278-012-9460-z] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
In this paper, we propose a novel technique for skull stripping of infant (neonatal) brain magnetic resonance images using prior shape information within a graph cut framework. Skull stripping plays an important role in brain image analysis and is a major challenge for neonatal brain images. Popular methods like the brain surface extractor (BSE) and brain extraction tool (BET) do not produce satisfactory results for neonatal images due to poor tissue contrast, weak boundaries between brain and non-brain regions, and low spatial resolution. Inclusion of prior shape information helps in accurate identification of brain and non-brain tissues. Prior shape information is obtained from a set of labeled training images. The probability of a pixel belonging to the brain is obtained from the prior shape mask and included in the penalty term of the cost function. An extra smoothness term is based on gradient information that helps identify the weak boundaries between the brain and non-brain region. Experimental results on real neonatal brain images show that compared to BET, BSE, and other methods, our method achieves superior segmentation performance for neonatal brain images and comparable performance for adult brain images.
Collapse
Affiliation(s)
- Dwarikanath Mahapatra
- Department of Computer Science, Swiss Federal Institute of Technology (ETH), Zurich, Switzerland.
| |
Collapse
|
28
|
Dai Y, Wang Y, Wang L, Wu G, Shi F, Shen D, Alzheimer’s Disease Neuroimaging Initiative. aBEAT: a toolbox for consistent analysis of longitudinal adult brain MRI. PLoS One 2013; 8:e60344. [PMID: 23577105 PMCID: PMC3616755 DOI: 10.1371/journal.pone.0060344] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2012] [Accepted: 02/25/2013] [Indexed: 01/18/2023] Open
Abstract
Longitudinal brain image analysis is critical for revealing subtle but complex structural and functional changes of brain during aging or in neurodevelopmental disease. However, even with the rapid increase of clinical research and trials, a software toolbox dedicated for longitudinal image analysis is still lacking publicly. To cater for this increasing need, we have developed a dedicated 4D Adult Brain Extraction and Analysis Toolbox (aBEAT) to provide robust and accurate analysis of the longitudinal adult brain MR images. Specially, a group of image processing tools were integrated into aBEAT, including 4D brain extraction, 4D tissue segmentation, and 4D brain labeling. First, a 4D deformable-surface-based brain extraction algorithm, which can deform serial brain surfaces simultaneously under temporal smoothness constraint, was developed for consistent brain extraction. Second, a level-sets-based 4D tissue segmentation algorithm that incorporates local intensity distribution, spatial cortical-thickness constraint, and temporal cortical-thickness consistency was also included in aBEAT for consistent brain tissue segmentation. Third, a longitudinal groupwise image registration framework was further integrated into aBEAT for consistent ROI labeling by simultaneously warping a pre-labeled brain atlas to the longitudinal brain images. The performance of aBEAT has been extensively evaluated on a large number of longitudinal MR T1 images which include normal and dementia subjects, achieving very promising results. A Linux-based standalone package of aBEAT is now freely available at http://www.nitrc.org/projects/abeat.
Collapse
Affiliation(s)
- Yakang Dai
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu, China
| | - Yaping Wang
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Li Wang
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Guorong Wu
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Feng Shi
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Dinggang Shen
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | | |
Collapse
|
29
|
Deformable modeling using a 3D boundary representation with quadratic constraints on the branching structure of the Blum skeleton. INFORMATION PROCESSING IN MEDICAL IMAGING : PROCEEDINGS OF THE ... CONFERENCE 2013; 23:280-91. [PMID: 24683976 PMCID: PMC3974205 DOI: 10.1007/978-3-642-38868-2_24] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
We propose a new approach for statistical shape analysis of 3D anatomical objects based on features extracted from skeletons. Like prior work on medial representations, the approach involves deforming a template to target shapes in a way that preserves the branching structure of the skeleton and provides intersubject correspondence. However, unlike medial representations, which parameterize the skeleton surfaces explicitly, our representation is boundary-centric, and the skeleton is implicit. Similar to prior constrained modeling methods developed 2D objects or tube-like 3D objects, we impose symmetry constraints on tuples of boundary points in a way that guarantees the preservation of the skeleton's topology under deformation. Once discretized, the problem of deforming a template to a target shape is formulated as a quadratically constrained quadratic programming problem. The new technique is evaluated in terms of its ability to capture the shape of the corpus callosum tract extracted from diffusion-weighted MRI.
Collapse
|
30
|
Landman BA, Bogovic JA, Carass A, Chen M, Roy S, Shiee N, Yang Z, Kishore B, Pham D, Bazin PL, Resnick SM, Prince JL. System for integrated neuroimaging analysis and processing of structure. Neuroinformatics 2013; 11:91-103. [PMID: 22932976 PMCID: PMC3511612 DOI: 10.1007/s12021-012-9159-9] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Mapping brain structure in relation to neurological development, function, plasticity, and disease is widely considered to be one of the most essential challenges for opening new lines of neuro-scientific inquiry. Recent developments with MRI analysis of structural connectivity, anatomical brain segmentation, cortical surface parcellation, and functional imaging have yielded fantastic advances in our ability to probe the neurological structure-function relationship in vivo. To date, the image analysis efforts in each of these areas have typically focused on a single modality. Here, we extend the cortical reconstruction using implicit surface evolution (CRUISE) methodology to perform efficient, consistent, and topologically correct analyses in a natively multi-parametric manner. This effort combines and extends state-of-the-art techniques to simultaneously consider and analyze structural and diffusion information alongside quantitative and functional imaging data. Robust and consistent estimates of the cortical surface extraction, cortical labeling, diffusion-inferred contrasts, diffusion tractography, and subcortical parcellation are demonstrated in a scan-rescan paradigm. Accompanying this demonstration, we present a fully automated software system complete with validation data.
Collapse
Affiliation(s)
- Bennett A Landman
- Department of Electrical Engineering, Vanderbilt University, Nashville, TN 37235-1679, USA.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
31
|
Dahnke R, Yotter RA, Gaser C. Cortical thickness and central surface estimation. Neuroimage 2013; 65:336-48. [DOI: 10.1016/j.neuroimage.2012.09.050] [Citation(s) in RCA: 262] [Impact Index Per Article: 21.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2011] [Revised: 09/17/2012] [Accepted: 09/20/2012] [Indexed: 10/27/2022] Open
|
32
|
Estellers V, Zosso D, Lai R, Osher S, Thiran JP, Bresson X. Efficient algorithm for level set method preserving distance function. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2012; 21:4722-4734. [PMID: 22692909 DOI: 10.1109/tip.2012.2202674] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The level set method is a popular technique for tracking moving interfaces in several disciplines, including computer vision and fluid dynamics. However, despite its high flexibility, the original level set method is limited by two important numerical issues. First, the level set method does not implicitly preserve the level set function as a distance function, which is necessary to estimate accurately geometric features, s.a. the curvature or the contour normal. Second, the level set algorithm is slow because the time step is limited by the standard Courant-Friedrichs-Lewy (CFL) condition, which is also essential to the numerical stability of the iterative scheme. Recent advances with graph cut methods and continuous convex relaxation methods provide powerful alternatives to the level set method for image processing problems because they are fast, accurate, and guaranteed to find the global minimizer independently to the initialization. These recent techniques use binary functions to represent the contour rather than distance functions, which are usually considered for the level set method. However, the binary function cannot provide the distance information, which can be essential for some applications, s.a. the surface reconstruction problem from scattered points and the cortex segmentation problem in medical imaging. In this paper, we propose a fast algorithm to preserve distance functions in level set methods. Our algorithm is inspired by recent efficient l(1) optimization techniques, which will provide an efficient and easy to implement algorithm. It is interesting to note that our algorithm is not limited by the CFL condition and it naturally preserves the level set function as a distance function during the evolution, which avoids the classical re-distancing problem in level set methods. We apply the proposed algorithm to carry out image segmentation, where our methods prove to be 5-6 times faster than standard distance preserving level set techniques. We also present two applications where preserving a distance function is essential. Nonetheless, our method stays generic and can be applied to any level set methods that require the distance information.
Collapse
Affiliation(s)
- Virginia Estellers
- Signal Processing Laboratory, École Polytechnique Fédérale de Lausanne, Lausanne 1015, Switzerland.
| | | | | | | | | | | |
Collapse
|
33
|
Wang L, Shi F, Yap PT, Gilmore JH, Lin W, Shen D. 4D multi-modality tissue segmentation of serial infant images. PLoS One 2012; 7:e44596. [PMID: 23049751 PMCID: PMC3458067 DOI: 10.1371/journal.pone.0044596] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2012] [Accepted: 08/03/2012] [Indexed: 11/18/2022] Open
Abstract
Accurate and consistent segmentation of infant brain MR images plays an important role in quantifying patterns of early brain development, especially in longitudinal studies. However, due to rapid maturation and myelination of brain tissues in the first year of life, the intensity contrast of gray and white matter undergoes dramatic changes. In fact, the contrast inverse around 6-8 months of age, when the white and gray matter tissues are isointense and hence exhibit the lowest contrast, posing significant challenges for segmentation algorithms. In this paper, we propose a longitudinally guided level set method to segment serial infant brain MR images acquired from 2 weeks up to 1.5 years of age, including the isointense images. At each single-time-point, the proposed method makes optimal use of T1, T2 and the diffusion-weighted images for complimentary tissue distribution information to address the difficulty caused by the low contrast. Moreover, longitudinally consistent term, which constrains the distance across the serial images within a biologically reasonable range, is employed to obtain temporally consistent segmentation results. Application of our method on 28 longitudinal infant subjects, each with 5 longitudinal scans, shows that the automated segmentations from the proposed method match the manual ground-truth with much higher Dice Ratios than other single-modality, single-time-point based methods and the longitudinal but voxel-wise based methods. The software of the proposed method is publicly available in NITRC (http://www.nitrc.org/projects/ibeat).
Collapse
Affiliation(s)
- Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - John H. Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
- * E-mail:
| |
Collapse
|
34
|
Ultrasound intima–media segmentation using Hough transform and dual snake model. Comput Med Imaging Graph 2012; 36:248-58. [DOI: 10.1016/j.compmedimag.2011.06.007] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2010] [Revised: 04/12/2011] [Accepted: 06/08/2011] [Indexed: 11/24/2022]
|
35
|
Doan NT, van Rooden S, Versluis MJ, Webb AG, van der Grond J, van Buchem MA, Reiber JH, Milles J. Combined magnitude and phase-based segmentation of the cerebral cortex in 7T MR images of the elderly. J Magn Reson Imaging 2012; 36:99-109. [DOI: 10.1002/jmri.23623] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2011] [Accepted: 01/23/2012] [Indexed: 11/09/2022] Open
|
36
|
Cortical Surface Reconstruction from High-Resolution MR Brain Images. Int J Biomed Imaging 2012; 2012:870196. [PMID: 22481909 PMCID: PMC3296314 DOI: 10.1155/2012/870196] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2011] [Revised: 09/22/2011] [Accepted: 09/28/2011] [Indexed: 11/18/2022] Open
Abstract
Reconstruction of the cerebral cortex from magnetic resonance (MR) images
is an important step in quantitative analysis of the human brain structure, for example, in sulcal morphometry and in studies of cortical thickness. Existing cortical reconstruction approaches are typically optimized for standard resolution (~1 mm) data and are not directly applicable to higher resolution images. A new PDE-based method is presented for the automated cortical reconstruction that is computationally efficient and scales well with grid resolution, and thus is particularly suitable for high-resolution MR images with submillimeter voxel size. The method uses a mathematical model of a field in an inhomogeneous dielectric. This field mapping, similarly to a Laplacian mapping, has nice laminar properties in the cortical layer, and helps to identify the unresolved boundaries between cortical banks in narrow sulci. The pial cortical surface is reconstructed by advection along the field gradient as a geometric deformable model constrained by topology-preserving level set approach. The method's performance is illustrated on exvivo images with 0.25–0.35 mm isotropic voxels. The method is further evaluated by cross-comparison with results of the FreeSurfer software on standard resolution data sets from the OASIS database featuring pairs of repeated scans for 20 healthy young subjects.
Collapse
|
37
|
Wang L, Shi F, Yap PT, Lin W, Gilmore JH, Shen D. Longitudinally guided level sets for consistent tissue segmentation of neonates. Hum Brain Mapp 2011; 34:956-72. [PMID: 22140029 DOI: 10.1002/hbm.21486] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2011] [Revised: 09/11/2011] [Accepted: 09/12/2011] [Indexed: 11/10/2022] Open
Abstract
Quantification of brain development as well as disease-induced pathologies in neonates often requires precise delineation of white matter, grey matter and cerebrospinal fluid. Unlike adults, tissue segmentation in neonates is significantly more challenging due to the inherently lower tissue contrast. Most existing methods take a voxel-based approach and are limited to working with images from a single time-point, even though longitudinal scans are available. We take a different approach by taking advantage of the fact that the pattern of the major sulci and gyri are already present in the neonates and generally preserved but fine-tuned during brain development. That is, the segmentation of late-time-point image can be used to guide the segmentation of neonatal image. Accordingly, we propose a novel longitudinally guided level-sets method for consistent neonatal image segmentation by combining local intensity information, atlas spatial prior, cortical thickness constraint, and longitudinal information into a variational framework. The minimization of the proposed energy functional is strictly derived from a variational principle. Validation performed on both simulated and in vivo neonatal brain images shows promising results.
Collapse
Affiliation(s)
- Li Wang
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina 27599, USA
| | | | | | | | | | | |
Collapse
|
38
|
Li G, Nie J, Wu G, Wang Y, Shen D. Consistent reconstruction of cortical surfaces from longitudinal brain MR images. Neuroimage 2011; 59:3805-20. [PMID: 22119005 DOI: 10.1016/j.neuroimage.2011.11.012] [Citation(s) in RCA: 74] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2011] [Revised: 10/04/2011] [Accepted: 11/04/2011] [Indexed: 11/17/2022] Open
Abstract
Accurate and consistent reconstruction of cortical surfaces from longitudinal human brain MR images is of great importance in studying longitudinal subtle change of the cerebral cortex. This paper presents a novel deformable surface method for consistent and accurate reconstruction of inner, central and outer cortical surfaces from longitudinal brain MR images. Specifically, the cortical surfaces of the group-mean image of all aligned longitudinal images of the same subject are first reconstructed by a deformable surface method, which is driven by a force derived from the Laplace's equation. And then the longitudinal cortical surfaces are consistently reconstructed by jointly deforming the cortical surfaces of the group-mean image to all longitudinal images. The proposed method has been successfully applied to two sets of longitudinal human brain MR images. Both qualitative and quantitative experimental results demonstrate the accuracy and consistency of the proposed method. Furthermore, the reconstructed longitudinal cortical surfaces are used to measure the longitudinal changes of cortical thickness in both normal and diseased groups, where the overall decline trend of cortical thickness has been clearly observed. Meanwhile, the longitudinal cortical thickness also shows its potential in distinguishing different clinical groups.
Collapse
Affiliation(s)
- Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | | | | | | | | |
Collapse
|
39
|
Wang L, Shi F, Lin W, Gilmore JH, Shen D. Automatic segmentation of neonatal images using convex optimization and coupled level sets. Neuroimage 2011; 58:805-17. [PMID: 21763443 PMCID: PMC3166374 DOI: 10.1016/j.neuroimage.2011.06.064] [Citation(s) in RCA: 84] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2011] [Revised: 06/21/2011] [Accepted: 06/23/2011] [Indexed: 10/18/2022] Open
Abstract
Accurate segmentation of neonatal brain MR images remains challenging mainly due to their poor spatial resolution, inverted contrast between white matter and gray matter, and high intensity inhomogeneity. Most existing methods for neonatal brain segmentation are atlas-based and voxel-wise. Although active contour/surface models with geometric information constraint have been successfully applied to adult brain segmentation, they are not fully explored in the neonatal image segmentation. In this paper, we propose a novel neonatal image segmentation method by combining local intensity information, atlas spatial prior, and cortical thickness constraint in a single level-set framework. Besides, we also provide a robust and reliable tissue surface initialization for the proposed method by using a convex optimization technique. Thus, tissue segmentation, as well as inner and outer cortical surface reconstruction, can be obtained simultaneously. The proposed method has been tested on a large neonatal dataset, and the validation on 10 neonatal brain images (with manual segmentations) shows very promising results.
Collapse
Affiliation(s)
- Li Wang
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC,USA
| | - Feng Shi
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC,USA
| | - Weili Lin
- MRI Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - John H. Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, NC, USA
| | - Dinggang Shen
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC,USA
| |
Collapse
|
40
|
Calabrese M, Rinaldi F, Grossi P, Gallo P. Cortical pathology and cognitive impairment in multiple sclerosis. Expert Rev Neurother 2011; 11:425-32. [PMID: 21375447 DOI: 10.1586/ern.10.155] [Citation(s) in RCA: 55] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Cognitive impairment constitutes a relevant clinical aspect of multiple sclerosis (MS). Depending on the disease phase and type, 40-65% of MS patients develop various degrees of cognitive dysfunction. Pathological and MRI studies have failed to demonstrate the existence of a strict relationship between cognitive impairment and subcortical white matter pathology. The correlation is also poor when MRI metrics of whole brain (white plus gray matter) atrophy are considered. Over the last decade, increasing observations have provided evidence of a primary role of cortical pathology - that is, inflammatory focal lesions (cortical lesions) and atrophy (cortical thickness) - in determining global and/or selective cognitive disability in MS. By applying a new semi-automated software (Freesurfer) to analyze the global and regional cortical thickness and the double inversion recovery sequence to identify cortical lesions, it has been observed that specific cognitive deficits, such as memory impairment, attention deficits and reduced mental processing speed, could be better explained by cortical structural abnormalities rather than subcortical white matter lesions. Therefore, MRI evaluation of cortical pathology should be included in the routine examination of MS patients, especially those with initial signs/symptoms of cognitive dysfunctions.
Collapse
Affiliation(s)
- Massimiliano Calabrese
- Multiple Sclerosis Centre of Veneto Region, First Neurology Clinic, Department of Neurosciences, University Hospital of Padova, Padova, 35128, Italy
| | | | | | | |
Collapse
|
41
|
Iglesias JE, Liu CY, Thompson PM, Tu Z. Robust brain extraction across datasets and comparison with publicly available methods. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:1617-1634. [PMID: 21880566 DOI: 10.1109/tmi.2011.2138152] [Citation(s) in RCA: 324] [Impact Index Per Article: 23.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
Automatic whole-brain extraction from magnetic resonance images (MRI), also known as skull stripping, is a key component in most neuroimage pipelines. As the first element in the chain, its robustness is critical for the overall performance of the system. Many skull stripping methods have been proposed, but the problem is not considered to be completely solved yet. Many systems in the literature have good performance on certain datasets (mostly the datasets they were trained/tuned on), but fail to produce satisfactory results when the acquisition conditions or study populations are different. In this paper we introduce a robust, learning-based brain extraction system (ROBEX). The method combines a discriminative and a generative model to achieve the final result. The discriminative model is a Random Forest classifier trained to detect the brain boundary; the generative model is a point distribution model that ensures that the result is plausible. When a new image is presented to the system, the generative model is explored to find the contour with highest likelihood according to the discriminative model. Because the target shape is in general not perfectly represented by the generative model, the contour is refined using graph cuts to obtain the final segmentation. Both models were trained using 92 scans from a proprietary dataset but they achieve a high degree of robustness on a variety of other datasets. ROBEX was compared with six other popular, publicly available methods (BET, BSE, FreeSurfer, AFNI, BridgeBurner, and GCUT) on three publicly available datasets (IBSR, LPBA40, and OASIS, 137 scans in total) that include a wide range of acquisition hardware and a highly variable population (different age groups, healthy/diseased). The results show that ROBEX provides significantly improved performance measures for almost every method/dataset combination.
Collapse
Affiliation(s)
- Juan Eugenio Iglesias
- Department of Biomedical Engineering, University of California-Los Angeles, Los Angeles, CA 90024, USA.
| | | | | | | |
Collapse
|
42
|
Brain MRI segmentation with multiphase minimal partitioning: a comparative study. Int J Biomed Imaging 2011; 2007:10526. [PMID: 18253474 PMCID: PMC2211521 DOI: 10.1155/2007/10526] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2006] [Revised: 11/10/2006] [Accepted: 12/19/2006] [Indexed: 11/18/2022] Open
Abstract
This paper presents the implementation and quantitative evaluation
of a multiphase three-dimensional deformable model in a level set
framework for automated segmentation of brain MRIs. The
segmentation algorithm performs an optimal partitioning of
three-dimensional data based on homogeneity measures that
naturally evolves to the extraction of different tissue types in
the brain. Random seed initialization was used to minimize the
sensitivity of the method to initial conditions while avoiding the
need for a priori information. This random initialization
ensures robustness of the method with respect to the
initialization and the minimization set up. Postprocessing
corrections with morphological operators were applied to refine
the details of the global segmentation method. A clinical study
was performed on a database of 10 adult brain MRI volumes to
compare the level set segmentation to three other methods:
“idealized” intensity thresholding, fuzzy connectedness, and an
expectation maximization classification using hidden Markov random
fields. Quantitative evaluation of segmentation accuracy was
performed with comparison to manual segmentation computing true
positive and false positive volume fractions. A statistical
comparison of the segmentation methods was performed through a
Wilcoxon analysis of these error rates and results showed very
high quality and stability of the multiphase three-dimensional
level set method.
Collapse
|
43
|
Hwang J, Han Y, Park H. Skull-stripping method for brain MRI using a 3D level set with a speedup operator. J Magn Reson Imaging 2011; 34:445-56. [PMID: 21618338 DOI: 10.1002/jmri.22661] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2010] [Accepted: 04/29/2011] [Indexed: 11/09/2022] Open
Abstract
PURPOSE To extract the brain region from brain magnetic resonance (MR) images using a fast 3D level set method and a refinement process. MATERIALS AND METHODS The proposed method introduces a speedup operator to the conventional 3D level set method in order to accelerate the level set evolution. While the processing time for brain extraction is reduced by the speedup operator, the accuracy of brain extraction is also improved by adopting a refinement process. RESULTS The speedup operator yielded a 75% reduction in the total iteration numbers for the synthesized volume. The proposed method was applied to several datasets and compared with previous methods, ie, BrainVisa, BET, and FreeSurfer. The proposed method provided a Jaccard index of 0.971 ± 0.0114 for the BrainWeb dataset, 0.864 ± 0.035 for the IBSR dataset, and 0.9414 ± 0.0517 for a self-produced dataset acquired with a 3T MRI system. CONCLUSION Utilizing a speedup operator, the proposed method reduced the evolution time. Robust and accurate results for various datasets were obtained in experiments.
Collapse
Affiliation(s)
- Jinyoung Hwang
- Department of Electrical Engineering, KAIST, Daejeon, Republic of Korea
| | | | | |
Collapse
|
44
|
Jackowski A, Perera TD, Abdallah CG, Garrido G, Tang CY, Martinez J, Mathew SJ, Gorman JM, Rosenblum LA, Smith EL, Dwork AJ, Shungu DC, Kaffman A, Gelernter J, Coplan JD, Kaufman J. Early-life stress, corpus callosum development, hippocampal volumetrics, and anxious behavior in male nonhuman primates. Psychiatry Res 2011; 192:37-44. [PMID: 21377844 PMCID: PMC4090111 DOI: 10.1016/j.pscychresns.2010.11.006] [Citation(s) in RCA: 66] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/16/2009] [Revised: 11/10/2010] [Accepted: 11/12/2010] [Indexed: 12/01/2022]
Abstract
Male bonnet monkeys (Macaca radiata) were subjected to the variable foraging demand (VFD) early stress paradigm as infants, MRI scans were completed an average of 4 years later, and behavioral assessments of anxiety and ex-vivo corpus callosum (CC) measurements were made when animals were fully matured. VFD rearing was associated with smaller CC size, CC measurements were found to correlate with fearful behavior in adulthood, and ex-vivo CC assessments showed high consistency with earlier MRI measures. Region of interest (ROI) hippocampus and whole brain voxel-based morphometry assessments were also completed and VFD rearing was associated with reduced hippocampus and inferior and middle temporal gyri volumes. The animals were also characterized according to serotonin transporter genotype (5-HTTLPR), and the effect of genotype on imaging parameters was explored. The current findings highlight the importance of future research to better understand the effects of stress on brain development in multiple regions, including the corpus callosum, hippocampus, and other regions involved in emotion processing. Nonhuman primates provide a powerful model to unravel the mechanisms by which early stress and genetic makeup interact to produce long-term changes in brain development, stress reactivity, and risk for psychiatric disorders.
Collapse
Affiliation(s)
- Andrea Jackowski
- LiNC, Departamento de Psiquiatria, Universidade Federal de São Paulo, SP, Brazil
| | - Tarique D. Perera
- Department of Biological Psychiatry, New York State Psychiatric Institute, College of Physicians and Surgeons of Columbia University, New York, NY, USA
| | - Chadi G. Abdallah
- Nonhuman Primate Facility, Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Griselda Garrido
- Serviço de Informática Médica, Instituto do Coração, Universidade de São Paulo, SP, Brazil
| | - Cheuk Y. Tang
- Department of Psychiatry, Mount Sinai School of Medicine, New York, NY, USA
| | - Jose Martinez
- Department of Psychiatry, Mount Sinai School of Medicine, New York, NY, USA
| | - Sanjay J. Mathew
- Department of Psychiatry, Mount Sinai School of Medicine, New York, NY, USA
| | - Jack M. Gorman
- Comprehensive NeuroScience Inc. (JMG), White Plains, NY, USA
| | - Leonard A. Rosenblum
- Nonhuman Primate Facility, Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Eric L.P. Smith
- Nonhuman Primate Facility, Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Andrew J. Dwork
- Department of Biological Psychiatry, New York State Psychiatric Institute, College of Physicians and Surgeons of Columbia University, New York, NY, USA
- Department of Molecular Imaging and Neuropathology, New York State Psychiatric Institute, and Department of Pathology and Cell Biology, College of Physicians and Surgeons of Columbia University, New York, NY, USA
| | - Dikoma C. Shungu
- Departments of Radiology, Psychiatry and Biophysics, Weill Medical College of Cornell University, New York, NY, USA
| | - Arie Kaffman
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT
| | - Joel Gelernter
- Division of Human Genetics (Psychiatry), Yale University School of Medicine, New Haven, CT
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT
| | - Jeremy D. Coplan
- Department of Biological Psychiatry, New York State Psychiatric Institute, College of Physicians and Surgeons of Columbia University, New York, NY, USA
- Nonhuman Primate Facility, Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Joan Kaufman
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT
| |
Collapse
|
45
|
Shen T, Li H, Huang X. Active volume models for medical image segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:774-791. [PMID: 21118771 DOI: 10.1109/tmi.2010.2094623] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
In this paper, we propose a novel predictive model, active volume model (AVM), for object boundary extraction. It is a dynamic "object" model whose manifestation includes a deformable curve or surface representing a shape, a volumetric interior carrying appearance statistics, and an embedded classifier that separates object from background based on current feature information. The model focuses on an accurate representation of the foreground object's attributes, and does not explicitly represent the background. As we will show, however, the model is capable of reasoning about the background statistics thus can detect when is change sufficient to invoke a boundary decision. When applied to object segmentation, the model alternates between two basic operations: 1) deforming according to current region of interest (ROI), which is a binary mask representing the object region predicted by the current model, and 2) predicting ROI according to current appearance statistics of the model. To further improve robustness and accuracy when segmenting multiple objects or an object with multiple parts, we also propose multiple-surface active volume model (MSAVM), which consists of several single-surface AVM models subject to high-level geometric spatial constraints. An AVM's deformation is derived from a linear system based on finite element method (FEM). To keep the model's surface triangulation optimized, surface remeshing is derived from another linear system based on Laplacian mesh optimization (LMO). Thus efficient optimization and fast convergence of the model are achieved by solving two linear systems. Segmentation, validation and comparison results are presented from experiments on a variety of 2-D and 3-D medical images.
Collapse
Affiliation(s)
- Tian Shen
- Department of Computer Science and Engineering, Lehigh University, Bethlehem, PA 18015, USA
| | | | | |
Collapse
|
46
|
Wu X, Dou X, Wahle A, Sonka M. Region detection by minimizing intraclass variance with geometric constraints, global optimality, and efficient approximation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:814-27. [PMID: 21118766 PMCID: PMC3131164 DOI: 10.1109/tmi.2010.2095870] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Efficient segmentation of globally optimal surfaces in volumetric images is a central problem in many medical image analysis applications. Intraclass variance has been successfully utilized for object segmentation, for instance, in the Chan-Vese model, especially for images without prominent edges. In this paper, we study the optimization problem of detecting a region (volume) between two coupled smooth surfaces by minimizing the intraclass variance using an efficient polynomial-time algorithm. Our algorithm is based on the shape probing technique in computational geometry and computes a sequence of minimum-cost closed sets in a derived parametric graph. The method has been validated on computer-synthetic volumetric images and in X-ray CT-scanned datasets of plexiglas tubes of known sizes. Its applicability to clinical data sets was also demonstrated. In all cases, the approach yielded highly accurate results. We believe that the developed technique is of interest on its own. We expect that it can shed some light on solving other important optimization problems arising in medical imaging. Furthermore, we report an approximation algorithm which runs much faster than the exact algorithm while yielding highly comparable segmentation accuracy.
Collapse
Affiliation(s)
- Xiaodong Wu
- Department of Electrical and Computer Engineering and the Department of Radiation Oncology, The University of Iowa, Iowa City, IA 52242 USA
| | - Xin Dou
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, 52242 USA. He is now with EDDA Technology Inc., Princeton, NJ 08540 USA
| | - Andreas Wahle
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, 52242 USA
| | - Milan Sonka
- Department of Electrical and Computer Engineering, the Department of Ophthalmology and Visual Sciences, and the Department of Radiation Oncology, The University of Iowa, Iowa City, IA, 52242 USA
| |
Collapse
|
47
|
Nakamura K, Fox R, Fisher E. CLADA: cortical longitudinal atrophy detection algorithm. Neuroimage 2011; 54:278-89. [PMID: 20674750 PMCID: PMC2965022 DOI: 10.1016/j.neuroimage.2010.07.052] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2010] [Revised: 07/22/2010] [Accepted: 07/23/2010] [Indexed: 11/17/2022] Open
Abstract
Measurement of changes in brain cortical thickness is useful for the assessment of regional gray matter atrophy in neurodegenerative conditions. A new longitudinal method, called CLADA (cortical longitudinal atrophy detection algorithm), has been developed for the measurement of changes in cortical thickness in magnetic resonance images (MRI) acquired over time. CLADA creates a subject-specific cortical model which is longitudinally deformed to match images from individual time points. The algorithm was designed to work reliably for lower resolution images, such as the MRIs with 1×1×5 mm(3) voxels previously acquired for many clinical trials in multiple sclerosis (MS). CLADA was evaluated to determine reproducibility, accuracy, and sensitivity. Scan-rescan variability was 0.45% for images with 1mm(3) isotropic voxels and 0.77% for images with 1×1×5 mm(3) voxels. The mean absolute accuracy error was 0.43 mm, as determined by comparison of CLADA measurements to cortical thickness measured directly in post-mortem tissue. CLADA's sensitivity for correctly detecting at least 0.1mm change was 86% in a simulation study. A comparison to FreeSurfer showed good agreement (Pearson correlation=0.73 for global mean thickness). CLADA was also applied to MRIs acquired over 18 months in secondary progressive MS patients who were imaged at two different resolutions. Cortical thinning was detected in this group in both the lower and higher resolution images. CLADA detected a higher rate of cortical thinning in MS patients compared to healthy controls over 2 years. These results show that CLADA can be used for reliable measurement of cortical atrophy in longitudinal studies, even in lower resolution images.
Collapse
Affiliation(s)
- Kunio Nakamura
- Department of Biomedical Engineering, Lerner Research Institute, Cleveland Clinic Foundation, Cleveland, Ohio 44195, USA
| | | | | |
Collapse
|
48
|
Osechinskiy S, Kruggel F. PDE-based reconstruction of the cerebral cortex from MR images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2010:4278-83. [PMID: 21095750 DOI: 10.1109/iembs.2010.5626179] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The topologically correct and geometrically accurate reconstruction of the cerebral cortex from magnetic resonance (MR) images is an important step in quantitative analysis of the human brain structure, e.g. in cortical thickness measurement studies. Limited resolution of MR images, noise, intensity inhomogeneities, and partial volume effects can all contribute to geometrical inaccuracies and topological errors in the model of cortical surfaces. For example, unresolved touching banks of gray matter (GM) in narrow sulci pose a particular challenge for an automated algorithm, requiring specific steps for the recovery of separating boundaries. We present a method for the automated reconstruction of the cortical compartment from MR images. The method is based on several partial differential equation (PDE) modelling stages. First, a potential field is computed in an electrostatic model with GM posing as an insulating dielectric layer surrounding a charged conductive white matter (WM) object. Second, geodesic distances from WM along the streamlines of the potential field are computed in a Eulerian framework PDE. Third, a digital skeleton surface separating GM sulcal banks is derived by finding shocks in the distance field. At the last stage, a geometric deformable model based on the level set PDE is used to reconstruct the outer cortical surface by advection along the gradient of the distance or potential field. The rule preserving the digital topology, and the skeleton of the distance field resolving fused adjacent banks in sulci, constrain the deformable model evolution. In addition, the deformable model may use the distance field as a constraint on thickness of the reconstructed cortical layer.
Collapse
Affiliation(s)
- Sergey Osechinskiy
- Department of Biomedical Engineering, University of California, Irvine, CA 92697, USA.
| | | |
Collapse
|
49
|
Duan Q, Angelini ED, Laine AF. Real-time segmentation by Active Geometric Functions. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2010; 98:223-230. [PMID: 19800708 PMCID: PMC3106291 DOI: 10.1016/j.cmpb.2009.09.001] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2009] [Revised: 08/18/2009] [Accepted: 09/03/2009] [Indexed: 05/28/2023]
Abstract
Recent advances in 4D imaging and real-time imaging provide image data with clinically important cardiac dynamic information at high spatial or temporal resolution. However, the enormous amount of information contained in these data has also raised a challenge for traditional image analysis algorithms in terms of efficiency. In this paper, a novel deformable model framework, Active Geometric Functions (AGF), is introduced to tackle the real-time segmentation problem. As an implicit framework paralleling to level-set, AGF has mathematical advantages in efficiency and computational complexity as well as several flexible feature similar to level-set framework. AGF is demonstrated in two cardiac applications: endocardial segmentation in 4D ultrasound and myocardial segmentation in MRI with super high temporal resolution. In both applications, AGF can perform real-time segmentation in several milliseconds per frame, which was less than the acquisition time per frame. Segmentation results are compared to manual tracing with comparable performance with inter-observer variability. The ability of such real-time segmentation will not only facilitate the diagnoses and workflow, but also enables novel applications such as interventional guidance and interactive image acquisition with online segmentation.
Collapse
Affiliation(s)
- Qi Duan
- Department of Biomedical Engineering, Columbia University, New York, NY 10027, USA.
| | | | | |
Collapse
|
50
|
Nie J, Guo L, Li G, Faraco C, Stephen Miller L, Liu T. A computational model of cerebral cortex folding. J Theor Biol 2010; 264:467-78. [PMID: 20167224 PMCID: PMC2856813 DOI: 10.1016/j.jtbi.2010.02.002] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2009] [Revised: 01/16/2010] [Accepted: 02/03/2010] [Indexed: 11/25/2022]
Abstract
The geometric complexity and variability of the human cerebral cortex have long intrigued the scientific community. As a result, quantitative description of cortical folding patterns and the understanding of underlying folding mechanisms have emerged as important research goals. This paper presents a computational 3D geometric model of cerebral cortex folding initialized by MRI data of a human fetal brain and deformed under the governance of a partial differential equation modeling cortical growth. By applying different simulation parameters, our model is able to generate folding convolutions and shape dynamics of the cerebral cortex. The simulations of this 3D geometric model provide computational experimental support to the following hypotheses: (1) Mechanical constraints of the skull regulate the cortical folding process. (2) The cortical folding pattern is dependent on the global cell growth rate of the whole cortex. (3) The cortical folding pattern is dependent on relative rates of cell growth in different cortical areas. (4) The cortical folding pattern is dependent on the initial geometry of the cortex.
Collapse
Affiliation(s)
- Jingxin Nie
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | | | | | | | | | | |
Collapse
|