1
|
Rong R, Denton K, Jin KW, Quan P, Wen Z, Kozlitina J, Lyon S, Wang A, Wise CA, Beutler B, Yang DM, Li Q, Rios JJ, Xiao G. Deep Learning-Based Automated Measurement of Murine Bone Length in Radiographs. Bioengineering (Basel) 2024; 11:670. [PMID: 39061752 PMCID: PMC11273961 DOI: 10.3390/bioengineering11070670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 06/18/2024] [Accepted: 06/18/2024] [Indexed: 07/28/2024] Open
Abstract
Genetic mouse models of skeletal abnormalities have demonstrated promise in the identification of phenotypes relevant to human skeletal diseases. Traditionally, phenotypes are assessed by manually examining radiographs, a tedious and potentially error-prone process. In response, this study developed a deep learning-based model that streamlines the measurement of murine bone lengths from radiographs in an accurate and reproducible manner. A bone detection and measurement pipeline utilizing the Keypoint R-CNN algorithm with an EfficientNet-B3 feature extraction backbone was developed to detect murine bone positions and measure their lengths. The pipeline was developed utilizing 94 X-ray images with expert annotations on the start and end position of each murine bone. The accuracy of our pipeline was evaluated on an independent dataset test with 592 images, and further validated on a previously published dataset of 21,300 mouse radiographs. The results showed that our model performed comparably to humans in measuring tibia and femur lengths (R2 > 0.92, p-value = 0) and significantly outperformed humans in measuring pelvic lengths in terms of precision and consistency. Furthermore, the model improved the precision and consistency of genetic association mapping results, identifying significant associations between genetic mutations and skeletal phenotypes with reduced variability. This study demonstrates the feasibility and efficiency of automated murine bone length measurement in the identification of mouse models of abnormal skeletal phenotypes.
Collapse
Affiliation(s)
- Ruichen Rong
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
| | - Kristin Denton
- Center for Pediatric Bone Biology and Translational Research, Scottish Rite for Children, Dallas, TX 75219, USA; (K.D.); (C.A.W.)
| | - Kevin W. Jin
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
| | - Peiran Quan
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
| | - Zhuoyu Wen
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
| | - Julia Kozlitina
- McDermott Center for Human Growth and Development, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA;
| | - Stephen Lyon
- Center for the Genetics of Host Defense, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (S.L.); (B.B.)
| | - Aileen Wang
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
| | - Carol A. Wise
- Center for Pediatric Bone Biology and Translational Research, Scottish Rite for Children, Dallas, TX 75219, USA; (K.D.); (C.A.W.)
- McDermott Center for Human Growth and Development, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA;
- Department of Orthopaedic Surgery, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
- Department of Pediatrics, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| | - Bruce Beutler
- Center for the Genetics of Host Defense, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (S.L.); (B.B.)
| | - Donghan M. Yang
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
| | - Qiwei Li
- Department of Mathematical Sciences, The University of Texas at Dallas, Richardson, TX 75083, USA;
| | - Jonathan J. Rios
- Center for Pediatric Bone Biology and Translational Research, Scottish Rite for Children, Dallas, TX 75219, USA; (K.D.); (C.A.W.)
- McDermott Center for Human Growth and Development, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA;
- Department of Orthopaedic Surgery, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
- Department of Pediatrics, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
- Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| | - Guanghua Xiao
- Quantitative Biomedical Research Center, Peter O’Donnell Jr. School of Public Health, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA; (R.R.); (K.W.J.); (P.Q.); (Z.W.); (A.W.); (D.M.Y.)
- Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
- Department of Bioinformatics, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| |
Collapse
|
2
|
Khodadadi Shoushtari F, Dehkordi ANV, Sina S. Quantitative and Visual Analysis of Data Augmentation and Hyperparameter Optimization in Deep Learning-Based Segmentation of Low-Grade Glioma Tumors Using Grad-CAM. Ann Biomed Eng 2024; 52:1359-1377. [PMID: 38409433 DOI: 10.1007/s10439-024-03461-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 01/29/2024] [Indexed: 02/28/2024]
Abstract
This study executes a quantitative and visual investigation on the effectiveness of data augmentation and hyperparameter optimization on the accuracy of deep learning-based segmentation of LGG tumors. The study employed the MobileNetV2 and ResNet backbones with atrous convolution in DeepLabV3+ structure. The Grad-CAM tool was also used to interpret the effect of augmentation and network optimization on segmentation performance. A wide investigation was performed to optimize the network hyperparameters. In addition, the study examined 35 different models to evaluate different data augmentation techniques. The results of the study indicated that incorporating data augmentation techniques and optimization can improve the performance of segmenting brain LGG tumors up to 10%. Our extensive investigation of the data augmentation techniques indicated that enlargement of data from 90° and 225° rotated data,up to down and left to right flipping are the most effective techniques. MobilenetV2 as the backbone,"Focal Loss" as the loss function and "Adam" as the optimizer showed the superior results. The optimal model (DLG-Net) achieved an overall accuracy of 96.1% with a loss value of 0.006. Specifically, the segmentation performance for Whole Tumor (WT), Tumor Core (TC), and Enhanced Tumor (ET) reached a Dice Similarity Coefficient (DSC) of 89.4%, 70.1%, and 49.9%, respectively. Simultaneous visual and quantitative assessment of data augmentation and network optimization can lead to an optimal model with a reasonable performance in segmenting the LGG tumors.
Collapse
Affiliation(s)
| | - Azimeh N V Dehkordi
- Department of Physics, Faculty of Computer Engineering, Najafabad Branch, Islamic Azad University, Najafabad, Iran.
- Najafabad Branch, Islamic Azad University, Najafabad, 8514143131, Iran.
| | - Sedigheh Sina
- Nuclear Engineering Department, Shiraz University, Shiraz, Iran
- Radiation Research Center, Shiraz University, Shiraz, Iran
| |
Collapse
|
3
|
Terzi DS, Azginoglu N. In-Domain Transfer Learning Strategy for Tumor Detection on Brain MRI. Diagnostics (Basel) 2023; 13:2110. [PMID: 37371005 DOI: 10.3390/diagnostics13122110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 06/16/2023] [Accepted: 06/16/2023] [Indexed: 06/29/2023] Open
Abstract
Transfer learning has gained importance in areas where there is a labeled data shortage. However, it is still controversial as to what extent natural image datasets as pre-training sources contribute scientifically to success in different fields, such as medical imaging. In this study, the effect of transfer learning for medical object detection was quantitatively compared using natural and medical image datasets. Within the scope of this study, transfer learning strategies based on five different weight initialization methods were discussed. A natural image dataset MS COCO and brain tumor dataset BraTS 2020 were used as the transfer learning source, and Gazi Brains 2020 was used for the target. Mask R-CNN was adopted as a deep learning architecture for its capability to effectively handle both object detection and segmentation tasks. The experimental results show that transfer learning from the medical image dataset was found to be 10% more successful and showed 24% better convergence performance than the MS COCO pre-trained model, although it contains fewer data. While the effect of data augmentation on the natural image pre-trained model was 5%, the same domain pre-trained model was measured as 2%. According to the most widely used object detection metric, transfer learning strategies using MS COCO weights and random weights showed the same object detection performance as data augmentation. The performance of the most effective strategies identified in the Mask R-CNN model was also tested with YOLOv8. Results showed that even if the amount of data is less than the natural dataset, in-domain transfer learning is more efficient than cross-domain transfer learning. Moreover, this study demonstrates the first use of the Gazi Brains 2020 dataset, which was generated to address the lack of labeled and qualified brain MRI data in the medical field for in-domain transfer learning. Thus, knowledge transfer was carried out from the deep neural network, which was trained with brain tumor data and tested on a different brain tumor dataset.
Collapse
Affiliation(s)
- Duygu Sinanc Terzi
- Department of Computer Engineering, Amasya University, Amasya 05100, Turkey
| | - Nuh Azginoglu
- Department of Computer Engineering, Kayseri University, Kayseri 38280, Turkey
| |
Collapse
|
4
|
Terzi R. An Ensemble of Deep Learning Object Detection Models for Anatomical and Pathological Regions in Brain MRI. Diagnostics (Basel) 2023; 13:diagnostics13081494. [PMID: 37189595 DOI: 10.3390/diagnostics13081494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 04/13/2023] [Accepted: 04/17/2023] [Indexed: 05/17/2023] Open
Abstract
This paper proposes ensemble strategies for the deep learning object detection models carried out by combining the variants of a model and different models to enhance the anatomical and pathological object detection performance in brain MRI. In this study, with the help of the novel Gazi Brains 2020 dataset, five different anatomical parts and one pathological part that can be observed in brain MRI were identified, such as the region of interest, eye, optic nerves, lateral ventricles, third ventricle, and a whole tumor. Firstly, comprehensive benchmarking of the nine state-of-the-art object detection models was carried out to determine the capabilities of the models in detecting the anatomical and pathological parts. Then, four different ensemble strategies for nine object detectors were applied to boost the detection performance using the bounding box fusion technique. The ensemble of individual model variants increased the anatomical and pathological object detection performance by up to 10% in terms of the mean average precision (mAP). In addition, considering the class-based average precision (AP) value of the anatomical parts, an up to 18% AP improvement was achieved. Similarly, the ensemble strategy of the best different models outperformed the best individual model by 3.3% mAP. Additionally, while an up to 7% better FAUC, which is the area under the TPR vs. FPPI curve, was achieved on the Gazi Brains 2020 dataset, a 2% better FAUC score was obtained on the BraTS 2020 dataset. The proposed ensemble strategies were found to be much more efficient in finding the anatomical and pathological parts with a small number of anatomic objects, such as the optic nerve and third ventricle, and producing higher TPR values, especially at low FPPI values, compared to the best individual methods.
Collapse
Affiliation(s)
- Ramazan Terzi
- Department of Big Data and Artificial Intelligence, Digital Transformation Office of the Presidency of Republic of Türkiye, Ankara 06100, Turkey
- Department of Computer Engineering, Amasya University, Amasya 05100, Turkey
| |
Collapse
|
5
|
Khalid F, Goya-Outi J, Escobar T, Dangouloff-Ros V, Grigis A, Philippe C, Boddaert N, Grill J, Frouin V, Frouin F. Multimodal MRI radiomic models to predict genomic mutations in diffuse intrinsic pontine glioma with missing imaging modalities. Front Med (Lausanne) 2023; 10:1071447. [PMID: 36910474 PMCID: PMC9995801 DOI: 10.3389/fmed.2023.1071447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Accepted: 02/06/2023] [Indexed: 02/25/2023] Open
Abstract
Purpose Predicting H3.1, TP53, and ACVR1 mutations in DIPG could aid in the selection of therapeutic options. The contribution of clinical data and multi-modal MRI were studied for these three predictive tasks. To keep the maximum number of subjects, which is essential for a rare disease, missing data were considered. A multi-modal model was proposed, collecting all available data for each patient, without performing any imputation. Methods A retrospective cohort of 80 patients with confirmed DIPG and at least one of the four MR modalities (T1w, T1c, T2w, and FLAIR), acquired with two different MR scanners was built. A pipeline including standardization of MR data and extraction of radiomic features within the tumor was applied. The values of radiomic features between the two MR scanners were realigned using the ComBat method. For each prediction task, the most robust features were selected based on a recursive feature elimination with cross-validation. Five different models, one based on clinical data and one per MR modality, were developed using logistic regression classifiers. The prediction of the multi-modal model was defined as the average of all possible prediction results among five for each patient. The performances of the models were compared using a leave-one-out approach. Results The percentage of missing modalities ranged from 6 to 11% across modalities and tasks. The performance of each individual model was dependent on each specific task, with an AUC of the ROC curve ranging from 0.63 to 0.80. The multi-modal model outperformed the clinical model for each prediction tasks, thus demonstrating the added value of MRI. Furthermore, regardless of performance criteria, the multi-modal model came in the first place or second place (very close to first). In the leave-one-out approach, the prediction of H3.1 (resp. ACVR1 and TP53) mutations achieved a balanced accuracy of 87.8% (resp. 82.1 and 78.3%). Conclusion Compared with a single modality approach, the multi-modal model combining multiple MRI modalities and clinical features was the most powerful to predict H3.1, ACVR1, and TP53 mutations and provided prediction, even in the case of missing modality. It could be proposed in the absence of a conclusive biopsy.
Collapse
Affiliation(s)
- Fahad Khalid
- Laboratoire d'Imagerie Translationnelle en Oncologie (LITO)-U1288, Institut Curie, Inserm, Université Paris-Saclay, Orsay, France
| | - Jessica Goya-Outi
- Laboratoire d'Imagerie Translationnelle en Oncologie (LITO)-U1288, Institut Curie, Inserm, Université Paris-Saclay, Orsay, France
| | - Thibault Escobar
- Laboratoire d'Imagerie Translationnelle en Oncologie (LITO)-U1288, Institut Curie, Inserm, Université Paris-Saclay, Orsay, France.,DOSIsoft SA, Cachan, France
| | - Volodia Dangouloff-Ros
- Department of Paediatric Radiology, Hôpital Universitaire Necker Enfants Malades, Paris, France.,Institut Imagine, Inserm U1163 and U1299, Université Paris Cité, Paris, France
| | | | | | - Nathalie Boddaert
- Department of Paediatric Radiology, Hôpital Universitaire Necker Enfants Malades, Paris, France.,Institut Imagine, Inserm U1163 and U1299, Université Paris Cité, Paris, France
| | - Jacques Grill
- Département Cancérologie de l'enfant et de l'adolescent, Gustave-Roussy, Villejuif, France.,Prédicteurs moléculaires et nouvelles cibles en oncologie-U981, Inserm, Université Paris-Saclay, Villejuif, France
| | | | - Frédérique Frouin
- Laboratoire d'Imagerie Translationnelle en Oncologie (LITO)-U1288, Institut Curie, Inserm, Université Paris-Saclay, Orsay, France
| |
Collapse
|