1
|
Tayebi Arasteh S, Romanowicz J, Pace DF, Golland P, Powell AJ, Maier AK, Truhn D, Brosch T, Weese J, Lotfinia M, van der Geest RJ, Moghari MH. Automated segmentation of 3D cine cardiovascular magnetic resonance imaging. Front Cardiovasc Med 2023; 10:1167500. [PMID: 37904806 PMCID: PMC10613522 DOI: 10.3389/fcvm.2023.1167500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 09/18/2023] [Indexed: 11/01/2023] Open
Abstract
Introduction As the life expectancy of children with congenital heart disease (CHD) is rapidly increasing and the adult population with CHD is growing, there is an unmet need to improve clinical workflow and efficiency of analysis. Cardiovascular magnetic resonance (CMR) is a noninvasive imaging modality for monitoring patients with CHD. CMR exam is based on multiple breath-hold 2-dimensional (2D) cine acquisitions that should be precisely prescribed and is expert and institution dependent. Moreover, 2D cine images have relatively thick slices, which does not allow for isotropic delineation of ventricular structures. Thus, development of an isotropic 3D cine acquisition and automatic segmentation method is worthwhile to make CMR workflow straightforward and efficient, as the present work aims to establish. Methods Ninety-nine patients with many types of CHD were imaged using a non-angulated 3D cine CMR sequence covering the whole-heart and great vessels. Automatic supervised and semi-supervised deep-learning-based methods were developed for whole-heart segmentation of 3D cine images to separately delineate the cardiac structures, including both atria, both ventricles, aorta, pulmonary arteries, and superior and inferior vena cavae. The segmentation results derived from the two methods were compared with the manual segmentation in terms of Dice score, a degree of overlap agreement, and atrial and ventricular volume measurements. Results The semi-supervised method resulted in a better overlap agreement with the manual segmentation than the supervised method for all 8 structures (Dice score 83.23 ± 16.76% vs. 77.98 ± 19.64%; P-value ≤0.001). The mean difference error in atrial and ventricular volumetric measurements between manual segmentation and semi-supervised method was lower (bias ≤ 5.2 ml) than the supervised method (bias ≤ 10.1 ml). Discussion The proposed semi-supervised method is capable of cardiac segmentation and chamber volume quantification in a CHD population with wide anatomical variability. It accurately delineates the heart chambers and great vessels and can be used to accurately calculate ventricular and atrial volumes throughout the cardiac cycle. Such a segmentation method can reduce inter- and intra- observer variability and make CMR exams more standardized and efficient.
Collapse
Affiliation(s)
- Soroosh Tayebi Arasteh
- Department of Cardiology, Boston Children’s Hospital, and Department of Pediatrics, Harvard Medical School, Boston, MA, United States
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
- Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany
| | - Jennifer Romanowicz
- Department of Cardiology, Boston Children’s Hospital, and Department of Pediatrics, Harvard Medical School, Boston, MA, United States
- Department of Cardiology, Children’s Hospital Colorado, and School of Medicine, University of Colorado, Aurora, CO, United States
| | - Danielle F. Pace
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States
- Computer Science & Artificial Intelligence Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Polina Golland
- Computer Science & Artificial Intelligence Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Andrew J. Powell
- Department of Cardiology, Boston Children’s Hospital, and Department of Pediatrics, Harvard Medical School, Boston, MA, United States
| | - Andreas K. Maier
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Daniel Truhn
- Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany
| | - Tom Brosch
- Philips Research Laboratories, Hamburg, Germany
| | | | - Mahshad Lotfinia
- Institute of Heat and Mass Transfer, RWTH Aachen University, Aachen, Germany
| | | | - Mehdi H. Moghari
- Department of Radiology, Children’s Hospital Colorado, and School of Medicine, University of Colorado, Aurora, CO, United States
| |
Collapse
|
3
|
Sanchez-Martinez S, Duchateau N, Erdei T, Kunszt G, Aakhus S, Degiovanni A, Marino P, Carluccio E, Piella G, Fraser AG, Bijnens BH. Machine Learning Analysis of Left Ventricular Function to Characterize Heart Failure With Preserved Ejection Fraction. Circ Cardiovasc Imaging 2018; 11:e007138. [DOI: 10.1161/circimaging.117.007138] [Citation(s) in RCA: 75] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2017] [Accepted: 02/22/2018] [Indexed: 12/25/2022]
Affiliation(s)
- Sergio Sanchez-Martinez
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Nicolas Duchateau
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Tamas Erdei
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Gabor Kunszt
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Svend Aakhus
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Anna Degiovanni
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Paolo Marino
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Erberto Carluccio
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Gemma Piella
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Alan G. Fraser
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| | - Bart H. Bijnens
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain (S.S.-M., G.P., B.H.B.); Asclepios Research Group, Université Côte d’Azur, Inria, Sophia Antipolis, France (N.D.); Wales Heart Research Institute, Cardiff University, United Kingdom (T.E., A.G.F.); Department of Cardiology, Oslo University Hospital, Norway (G.K., S.A.); Department of Circulation and Imaging, Faculty of Medicine, NTNU, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|
4
|
Zimmer VA, Glocker B, Hahner N, Eixarch E, Sanroma G, Gratacós E, Rueckert D, González Ballester MÁ, Piella G. Learning and combining image neighborhoods using random forests for neonatal brain disease classification. Med Image Anal 2017; 42:189-199. [PMID: 28818743 DOI: 10.1016/j.media.2017.08.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2016] [Revised: 08/01/2017] [Accepted: 08/08/2017] [Indexed: 12/25/2022]
Abstract
It is challenging to characterize and classify normal and abnormal brain development during early childhood. To reduce the complexity of heterogeneous data population, manifold learning techniques are increasingly applied, which find a low-dimensional representation of the data, while preserving all relevant information. The neighborhood definition used for constructing manifold representations of the population is crucial for preserving the similarity structure and it is highly application dependent. The recently proposed neighborhood approximation forests learn a neighborhood structure in a dataset based on a user-defined distance. We propose a framework to learn multiple pairwise distances in a population of brain images and to combine them in an unsupervised manner optimally in a manifold learning step. Unlike other methods that only use a univariate distance measure, our method allows for a natural combination of multiple distances from heterogeneous sources. As a result, it yields a representation of the population that preserves the multiple distances. Furthermore, our method also selects the most predictive features associated with the distances. We evaluate our method in neonatal magnetic resonance images of three groups (term controls, patients affected by intrauterine growth restriction and mild isolated ventriculomegaly). We show that combining multiple distances related to the condition improves the overall characterization and classification of the three clinical groups compared to the use of single distances and classical unsupervised manifold learning.
Collapse
Affiliation(s)
| | - Ben Glocker
- BioMedIA Group, Imperial College London, London, UK
| | - Nadine Hahner
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain; Centre for Biomedical Research on Rare Diseases (CIBER-ER), Barcelona, Spain
| | - Elisenda Eixarch
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain; Centre for Biomedical Research on Rare Diseases (CIBER-ER), Barcelona, Spain
| | | | - Eduard Gratacós
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain; Centre for Biomedical Research on Rare Diseases (CIBER-ER), Barcelona, Spain
| | | | | | - Gemma Piella
- SIMBioSys, Universitat Pompeu Fabra, Barcelona, Spain
| |
Collapse
|
6
|
Zhang Y, Kwon D, Pohl KM. Computing group cardinality constraint solutions for logistic regression problems. Med Image Anal 2017; 35:58-69. [PMID: 27318592 PMCID: PMC5099121 DOI: 10.1016/j.media.2016.05.011] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2015] [Revised: 05/25/2016] [Accepted: 05/27/2016] [Indexed: 02/03/2023]
Abstract
We derive an algorithm to directly solve logistic regression based on cardinality constraint, group sparsity and use it to classify intra-subject MRI sequences (e.g. cine MRIs) of healthy from diseased subjects. Group cardinality constraint models are often applied to medical images in order to avoid overfitting of the classifier to the training data. Solutions within these models are generally determined by relaxing the cardinality constraint to a weighted feature selection scheme. However, these solutions relate to the original sparse problem only under specific assumptions, which generally do not hold for medical image applications. In addition, inferring clinical meaning from features weighted by a classifier is an ongoing topic of discussion. Avoiding weighing features, we propose to directly solve the group cardinality constraint logistic regression problem by generalizing the Penalty Decomposition method. To do so, we assume that an intra-subject series of images represents repeated samples of the same disease patterns. We model this assumption by combining series of measurements created by a feature across time into a single group. Our algorithm then derives a solution within that model by decoupling the minimization of the logistic regression function from enforcing the group sparsity constraint. The minimum to the smooth and convex logistic regression problem is determined via gradient descent while we derive a closed form solution for finding a sparse approximation of that minimum. We apply our method to cine MRI of 38 healthy controls and 44 adult patients that received reconstructive surgery of Tetralogy of Fallot (TOF) during infancy. Our method correctly identifies regions impacted by TOF and generally obtains statistically significant higher classification accuracy than alternative solutions to this model, i.e., ones relaxing group cardinality constraints.
Collapse
Affiliation(s)
- Yong Zhang
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA.
| | - Dongjin Kwon
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA; Center for Health Sciences, SRI International, Menlo Park, CA 94025, USA
| | - Kilian M Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA; Center for Health Sciences, SRI International, Menlo Park, CA 94025, USA
| |
Collapse
|
9
|
Li XW, Li QL, Li SY, Li DY. Local manifold learning for multiatlas segmentation: application to hippocampal segmentation in healthy population and Alzheimer's disease. CNS Neurosci Ther 2015; 21:826-36. [PMID: 26122409 DOI: 10.1111/cns.12415] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2015] [Revised: 05/06/2015] [Accepted: 05/06/2015] [Indexed: 12/01/2022] Open
Abstract
AIMS Automated hippocampal segmentation is an important issue in many neuroscience studies. METHODS We presented and evaluated a novel segmentation method that utilized a manifold learning technique under the multiatlas-based segmentation scenario. A manifold representation of local patches for each voxel was achieved by applying an Isomap algorithm, which can then be used to obtain spatially local weights of atlases for label fusion. The obtained atlas weights potentially depended on all pairwise similarities of the population, which is in contrast to most existing label fusion methods that only rely on similarities between the target image and the atlases. The performance of the proposed method was evaluated for hippocampal segmentation and compared with two representative local weighted label fusion methods, that is, local majority voting and local weighted inverse distance voting, on an in-house dataset of 28 healthy adolescents (age range: 10-17 years) and two ADNI datasets of 100 participants (age range: 60-89 years). We also implemented hippocampal volumetric analysis and evaluated segmentation performance using atlases from a different dataset. RESULTS The median Dice similarities obtained by our proposed method were approximately 0.90 for healthy subjects and above 0.88 for two mixed diagnostic groups of ADNI subjects. CONCLUSION The experimental results demonstrated that the proposed method could obtain consistent and significant improvements over label fusion strategies that are implemented in the original space.
Collapse
Affiliation(s)
- Xin-Wei Li
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.,Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | - Qiong-Ling Li
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.,Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | - Shu-Yu Li
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.,Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | - De-Yu Li
- Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | | |
Collapse
|