1
|
Hernandez M, Ramon Julvez U. Insights into traditional Large Deformation Diffeomorphic Metric Mapping and unsupervised deep-learning for diffeomorphic registration and their evaluation. Comput Biol Med 2024; 178:108761. [PMID: 38908357 DOI: 10.1016/j.compbiomed.2024.108761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 06/04/2024] [Accepted: 06/13/2024] [Indexed: 06/24/2024]
Abstract
This paper explores the connections between traditional Large Deformation Diffeomorphic Metric Mapping methods and unsupervised deep-learning approaches for non-rigid registration, particularly emphasizing diffeomorphic registration. The study provides useful insights and establishes connections between the methods, thereby facilitating a profound understanding of the methodological landscape. The methods considered in our study are extensively evaluated in T1w MRI images using traditional NIREP and Learn2Reg OASIS evaluation protocols with a focus on fairness, to establish equitable benchmarks and facilitate informed comparisons. Through a comprehensive analysis of the results, we address key questions, including the intricate relationship between accuracy and transformation quality in performance, the disentanglement of the influence of registration ingredients on performance, and the determination of benchmark methods and baselines. We offer valuable insights into the strengths and limitations of both traditional and deep-learning methods, shedding light on their comparative performance and guiding future advancements in the field.
Collapse
Affiliation(s)
- Monica Hernandez
- Computer Science Department, University of Zaragoza, Spain; Aragon Institute on Engineering Research, Spain.
| | - Ubaldo Ramon Julvez
- Computer Science Department, University of Zaragoza, Spain; Aragon Institute on Engineering Research, Spain
| |
Collapse
|
2
|
Computational anatomy and diffeomorphometry: A dynamical systems model of neuroanatomy in the soft condensed matter continuum. WIREs Mech Dis 2021; 13:e1524. [PMID: 34730291 DOI: 10.1002/wsbm.1524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
3
|
Charles AS, Falk B, Turner N, Pereira TD, Tward D, Pedigo BD, Chung J, Burns R, Ghosh SS, Kebschull JM, Silversmith W, Vogelstein JT. Toward Community-Driven Big Open Brain Science: Open Big Data and Tools for Structure, Function, and Genetics. Annu Rev Neurosci 2020; 43:441-464. [PMID: 32283996 DOI: 10.1146/annurev-neuro-100119-110036] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
As acquiring bigger data becomes easier in experimental brain science, computational and statistical brain science must achieve similar advances to fully capitalize on these data. Tackling these problems will benefit from a more explicit and concerted effort to work together. Specifically, brain science can be further democratized by harnessing the power of community-driven tools, which both are built by and benefit from many different people with different backgrounds and expertise. This perspective can be applied across modalities and scales and enables collaborations across previously siloed communities.
Collapse
Affiliation(s)
- Adam S Charles
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA; .,Institute for Computational Medicine, Kavli Neuroscience Discovery Institute, and Center for Imaging Science, Johns Hopkins University, Baltimore, Maryland 21218, USA
| | - Benjamin Falk
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA;
| | - Nicholas Turner
- Department of Computer Science, Princeton University, Princeton, New Jersey 08540, USA
| | - Talmo D Pereira
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey 08540, USA
| | - Daniel Tward
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA;
| | - Benjamin D Pedigo
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA;
| | - Jaewon Chung
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA;
| | - Randal Burns
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA;
| | - Satrajit S Ghosh
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA.,Department of Otolaryngology-Head and Neck Surgery, Harvard Medical School, Boston, Massachusetts 02115, USA
| | - Justus M Kebschull
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA; .,Stanford University, Palo Alto, California 94305, USA
| | - William Silversmith
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey 08540, USA
| | - Joshua T Vogelstein
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland 21218, USA; .,Institute for Computational Medicine, Kavli Neuroscience Discovery Institute, and Center for Imaging Science, Johns Hopkins University, Baltimore, Maryland 21218, USA
| |
Collapse
|
4
|
Tward D, Brown T, Kageyama Y, Patel J, Hou Z, Mori S, Albert M, Troncoso J, Miller M. Diffeomorphic Registration With Intensity Transformation and Missing Data: Application to 3D Digital Pathology of Alzheimer's Disease. Front Neurosci 2020; 14:52. [PMID: 32116503 PMCID: PMC7027169 DOI: 10.3389/fnins.2020.00052] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Accepted: 01/14/2020] [Indexed: 12/15/2022] Open
Abstract
This paper examines the problem of diffeomorphic image registration in the presence of differing image intensity profiles and sparsely sampled, missing, or damaged tissue. Our motivation comes from the problem of aligning 3D brain MRI with 100-micron isotropic resolution to histology sections at 1 × 1 × 1,000-micron resolution with multiple varying stains. We pose registration as a penalized Bayesian estimation, exploiting statistical models of image formation where the target images are modeled as sparse and noisy observations of the atlas. In this injective setting, there is no assumption of symmetry between atlas and target. Cross-modality image matching is achieved by jointly estimating polynomial transformations of the atlas intensity. Missing data is accommodated via a multiple atlas selection procedure where several atlas images may be of homogeneous intensity and correspond to "background" or "artifact." The two concepts are combined within an Expectation-Maximization algorithm, where atlas selection posteriors and deformation parameters are updated iteratively and polynomial coefficients are computed in closed form. We validate our method with simulated images, examples from neuropathology, and a standard benchmarking dataset. Finally, we apply it to reconstructing digital pathology and MRI in standard atlas coordinates. By using a standard convolutional neural network to detect tau tangles in histology slices, this registration method enabled us to quantify the 3D density distribution of tauopathy throughout the medial temporal lobe of an Alzheimer's disease postmortem specimen.
Collapse
Affiliation(s)
- Daniel Tward
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Center for Imaging Science, Johns Hopkins University, Baltimore, MD, United States
| | - Timothy Brown
- Center for Imaging Science, Johns Hopkins University, Baltimore, MD, United States
| | - Yusuke Kageyama
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Jaymin Patel
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Zhipeng Hou
- Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Susumu Mori
- Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Marilyn Albert
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Juan Troncoso
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Michael Miller
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Center for Imaging Science, Johns Hopkins University, Baltimore, MD, United States
| |
Collapse
|