1
|
Han Y, Zhang Z, Li Y, Fan G, Liang M, Liu Z, Nie S, Ning K, Luo Q, Yuan J. FastCellpose: A Fast and Accurate Deep-Learning Framework for Segmentation of All Glomeruli in Mouse Whole-Kidney Microscopic Optical Images. Cells 2023; 12:2753. [PMID: 38067181 PMCID: PMC10706842 DOI: 10.3390/cells12232753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 11/28/2023] [Accepted: 11/29/2023] [Indexed: 12/18/2023] Open
Abstract
Automated evaluation of all glomeruli throughout the whole kidney is essential for the comprehensive study of kidney function as well as understanding the mechanisms of kidney disease and development. The emerging large-volume microscopic optical imaging techniques allow for the acquisition of mouse whole-kidney 3D datasets at a high resolution. However, fast and accurate analysis of massive imaging data remains a challenge. Here, we propose a deep learning-based segmentation method called FastCellpose to efficiently segment all glomeruli in whole mouse kidneys. Our framework is based on Cellpose, with comprehensive optimization in network architecture and the mask reconstruction process. By means of visual and quantitative analysis, we demonstrate that FastCellpose can achieve superior segmentation performance compared to other state-of-the-art cellular segmentation methods, and the processing speed was 12-fold higher than before. Based on this high-performance framework, we quantitatively analyzed the development changes of mouse glomeruli from birth to maturity, which is promising in terms of providing new insights for research on kidney development and function.
Collapse
Affiliation(s)
- Yutong Han
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| | - Zhan Zhang
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Yafeng Li
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| | - Guoqing Fan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| | - Mengfei Liang
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
| | - Zhijie Liu
- School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan 430074, China;
| | - Shuo Nie
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Kefu Ning
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| | - Qingming Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- School of Biomedical Engineering, Hainan University, Haikou 570228, China
| | - Jing Yuan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China; (Y.H.); (Z.Z.); (Y.L.); (G.F.); (M.L.); (S.N.); (K.N.); (Q.L.)
- MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| |
Collapse
|
2
|
Dejene EM, Brenner W, Makowski MR, Kolbitsch C. Unified Bayesian network for uncertainty quantification of physiological parameters in dynamic contrast enhanced (DCE) MRI of the liver. Phys Med Biol 2023; 68:215018. [PMID: 37820640 DOI: 10.1088/1361-6560/ad0284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Accepted: 10/11/2023] [Indexed: 10/13/2023]
Abstract
Objective. Physiological parameter estimation is affected by intrinsic ambiguity in the data such as noise and model inaccuracies. The aim of this work is to provide a deep learning framework for accurate parameter and uncertainty estimates for DCE-MRI in the liver.Approach. Concentration time curves are simulated to train a Bayesian neural network (BNN). Training of the BNN involves minimization of a loss function that jointly minimizes the aleatoric and epistemic uncertainties. Uncertainty estimation is evaluated for different noise levels and for different out of distribution (OD) cases, i.e. where the data during inference differs strongly to the data during training. The accuracy of parameter estimates are compared to a nonlinear least squares (NLLS) fitting in numerical simulations andin vivodata of a patient suffering from hepatic tumor lesions.Main results. BNN achieved lower root-mean-squared-errors (RMSE) than the NLLS for the simulated data. RMSE of BNN was on overage of all noise levels lower by 33% ± 1.9% forktrans, 22% ± 6% forveand 89% ± 5% forvpthan the NLLS. The aleatoric uncertainties of the parameters increased with increasing noise level, whereas the epistemic uncertainty increased when a BNN was evaluated with OD data. For thein vivodata, more robust parameter estimations were obtained by the BNN than the NLLS fit. In addition, the differences between estimated parameters for healthy and tumor regions-of-interest were significant (p< 0.0001).Significance. The proposed framework allowed for accurate parameter estimates for quantitative DCE-MRI. In addition, the BNN provided uncertainty estimates which highlighted cases of high noise and in which the training data did not match the data during inference. This is important for clinical application because it would indicate cases in which the trained model is inadequate and additional training with an adapted training data set is required.
Collapse
Affiliation(s)
- Edengenet M Dejene
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
- Department of Radiology, Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Winfried Brenner
- Department of Nuclear Medicine, Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Marcus R Makowski
- Department of Radiology, Charité Universitätsmedizin Berlin, Berlin, Germany
- Department of Diagnostic and Interventional Radiology, Faculty of Medicine, Technical University of Munich, Munich, Germany
| | - Christoph Kolbitsch
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| |
Collapse
|
3
|
Bagher-Ebadian H, Brown SL, Ghassemi MM, Nagaraja TN, Movsas B, Ewing JR, Chetty IJ. Radiomics characterization of tissues in an animal brain tumor model imaged using dynamic contrast enhanced (DCE) MRI. Sci Rep 2023; 13:10693. [PMID: 37394559 DOI: 10.1038/s41598-023-37723-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 06/27/2023] [Indexed: 07/04/2023] Open
Abstract
Here, we investigate radiomics-based characterization of tumor vascular and microenvironmental properties in an orthotopic rat brain tumor model measured using dynamic-contrast-enhanced (DCE) MRI. Thirty-two immune compromised-RNU rats implanted with human U-251N cancer cells were imaged using DCE-MRI (7Tesla, Dual-Gradient-Echo). The aim was to perform pharmacokinetic analysis using a nested model (NM) selection technique to classify brain regions according to vasculature properties considered as the source of truth. A two-dimensional convolutional-based radiomics analysis was performed on the raw-DCE-MRI of the rat brains to generate dynamic radiomics maps. The raw-DCE-MRI and respective radiomics maps were used to build 28 unsupervised Kohonen self-organizing-maps (K-SOMs). A Silhouette-Coefficient (SC), k-fold Nested-Cross-Validation (k-fold-NCV), and feature engineering analyses were performed on the K-SOMs' feature spaces to quantify the distinction power of radiomics features compared to raw-DCE-MRI for classification of different Nested Models. Results showed that eight radiomics features outperformed respective raw-DCE-MRI in prediction of the three nested models. The average percent difference in SCs between radiomics features and raw-DCE-MRI was: 29.875% ± 12.922%, p < 0.001. This work establishes an important first step toward spatiotemporal characterization of brain regions using radiomics signatures, which is fundamental toward staging of tumors and evaluation of tumor response to different treatments.
Collapse
Affiliation(s)
- Hassan Bagher-Ebadian
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA.
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA.
- Department of Osteopathic Medicine, Michigan State University, East Lansing, MI, 48824, USA.
- Department of Physics, Oakland University, Rochester, MI, 48309, USA.
| | - Stephen L Brown
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| | - Mohammad M Ghassemi
- Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, 48824, USA
| | - Tavarekere N Nagaraja
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Neurosurgery, Henry Ford Health, Detroit, MI, 48202, USA
| | - Benjamin Movsas
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| | - James R Ewing
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Physics, Oakland University, Rochester, MI, 48309, USA
- Department of Neurosurgery, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Neurology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Neurology, Wayne State University, Detroit, MI, 48202, USA
| | - Indrin J Chetty
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Physics, Oakland University, Rochester, MI, 48309, USA
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| |
Collapse
|
4
|
Bagher-Ebadian H, Brown SL, Ghassemi MM, Nagaraja TN, Valadie OG, Acharya PC, Cabral G, Divine G, Knight RA, Lee IY, Xu JH, Movsas B, Chetty IJ, Ewing JR. Dynamic contrast enhanced (DCE) MRI estimation of vascular parameters using knowledge-based adaptive models. Sci Rep 2023; 13:9672. [PMID: 37316579 PMCID: PMC10267191 DOI: 10.1038/s41598-023-36483-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Accepted: 06/05/2023] [Indexed: 06/16/2023] Open
Abstract
We introduce and validate four adaptive models (AMs) to perform a physiologically based Nested-Model-Selection (NMS) estimation of such microvascular parameters as forward volumetric transfer constant, Ktrans, plasma volume fraction, vp, and extravascular, extracellular space, ve, directly from Dynamic Contrast-Enhanced (DCE) MRI raw information without the need for an Arterial-Input Function (AIF). In sixty-six immune-compromised-RNU rats implanted with human U-251 cancer cells, DCE-MRI studies estimated pharmacokinetic (PK) parameters using a group-averaged radiological AIF and an extended Patlak-based NMS paradigm. One-hundred-ninety features extracted from raw DCE-MRI information were used to construct and validate (nested-cross-validation, NCV) four AMs for estimation of model-based regions and their three PK parameters. An NMS-based a priori knowledge was used to fine-tune the AMs to improve their performance. Compared to the conventional analysis, AMs produced stable maps of vascular parameters and nested-model regions less impacted by AIF-dispersion. The performance (Correlation coefficient and Adjusted R-squared for NCV test cohorts) of the AMs were: 0.914/0.834, 0.825/0.720, 0.938/0.880, and 0.890/0.792 for predictions of nested model regions, vp, Ktrans, and ve, respectively. This study demonstrates an application of AMs that quickens and improves DCE-MRI based quantification of microvasculature properties of tumors and normal tissues relative to conventional approaches.
Collapse
Affiliation(s)
- Hassan Bagher-Ebadian
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA.
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA.
- Department of Osteopathic Medicine, Michigan State University, East Lansing, MI, 48824, USA.
- Department of Physics, Oakland University, Rochester, MI, 48309, USA.
| | - Stephen L Brown
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| | - Mohammad M Ghassemi
- Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, 48824, USA
| | - Tavarekere N Nagaraja
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Neurosurgery, Henry Ford Health, Detroit, MI, 48202, USA
| | - Olivia Grahm Valadie
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| | - Prabhu C Acharya
- Department of Physics, Oakland University, Rochester, MI, 48309, USA
| | - Glauber Cabral
- Department of Neurology, Henry Ford Health, Detroit, MI, 48202, USA
| | - George Divine
- Department of Public Health Sciences, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Epidemiology and Biostatistics, Michigan State University, E. Lansing, MI, 48824, USA
| | - Robert A Knight
- Department of Neurology, Henry Ford Health, Detroit, MI, 48202, USA
| | - Ian Y Lee
- Department of Neurosurgery, Henry Ford Health, Detroit, MI, 48202, USA
| | - Jun H Xu
- Department of Neurosurgery, Henry Ford Health, Detroit, MI, 48202, USA
| | - Benjamin Movsas
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| | - Indrin J Chetty
- Department of Radiation Oncology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Physics, Oakland University, Rochester, MI, 48309, USA
- Department of Radiation Oncology, Wayne State University, Detroit, MI, 48202, USA
| | - James R Ewing
- Department of Radiology, Michigan State University, East Lansing, MI, 48824, USA
- Department of Physics, Oakland University, Rochester, MI, 48309, USA
- Department of Neurosurgery, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Neurology, Henry Ford Health, Detroit, MI, 48202, USA
- Department of Neurology, Wayne State University, Detroit, MI, 48202, USA
| |
Collapse
|
5
|
Abstract
The tremendous development of technology also affects medical science, including imaging diagnostics [...]
Collapse
|
6
|
Klepaczko A, Majos M, Stefańczyk L, Ejkefjord E, Lundervold A. Whole kidney and renal cortex segmentation in contrast-enhanced MRI using a joint classification and segmentation convolutional neural network. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.02.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
|
7
|
Healthy Kidney Segmentation in the Dce-Mr Images Using a Convolutional Neural Network and Temporal Signal Characteristics. SENSORS 2021; 21:s21206714. [PMID: 34695931 PMCID: PMC8538657 DOI: 10.3390/s21206714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 09/30/2021] [Accepted: 10/04/2021] [Indexed: 11/17/2022]
Abstract
Quantification of renal perfusion based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) requires determination of signal intensity time courses in the region of renal parenchyma. Thus, selection of voxels representing the kidney must be accomplished with special care and constitutes one of the major technical limitations which hampers wider usage of this technique as a standard clinical routine. Manual segmentation of renal compartments—even if performed by experts—is a common source of decreased repeatability and reproducibility. In this paper, we present a processing framework for the automatic kidney segmentation in DCE-MR images. The framework consists of two stages. Firstly, kidney masks are generated using a convolutional neural network. Then, mask voxels are classified to one of three regions—cortex, medulla, and pelvis–based on DCE-MRI signal intensity time courses. The proposed approach was evaluated on a cohort of 10 healthy volunteers who underwent the DCE-MRI examination. MRI scanning was repeated on two time events within a 10-day interval. For semantic segmentation task we employed a classic U-Net architecture, whereas experiments on voxel classification were performed using three alternative algorithms—support vector machines, logistic regression and extreme gradient boosting trees, among which SVM produced the most accurate results. Both segmentation and classification steps were accomplished by a series of models, each trained separately for a given subject using the data from other participants only. The mean achieved accuracy of the whole kidney segmentation was 94% in terms of IoU coefficient. Cortex, medulla and pelvis were segmented with IoU ranging from 90 to 93% depending on the tissue and body side. The results were also validated by comparing image-derived perfusion parameters with ground truth measurements of glomerular filtration rate (GFR). The repeatability of GFR calculation, as assessed by the coefficient of variation was determined at the level of 14.5 and 17.5% for the left and right kidney, respectively and it improved relative to manual segmentation. Reproduciblity, in turn, was evaluated by measuring agreement between image-derived and iohexol-based GFR values. The estimated absolute mean differences were equal to 9.4 and 12.9 mL/min/1.73 m2 for scanning sessions 1 and 2 and the proposed automated segmentation method. The result for session 2 was comparable with manual segmentation, whereas for session 1 reproducibility in the automatic pipeline was weaker.
Collapse
|