1
|
Zhan Y, Dai R, Li F, Cheng Z, Zhuo Y, Shan F, Zhou L. Repeatability and reproducibility of deep learning features for lung adenocarcinoma subtypes with nodules less than 10 mm in size: a multicenter thin-slice computed tomography phantom and clinical validation study. Quant Imaging Med Surg 2024; 14:5396-5407. [PMID: 39144035 PMCID: PMC11320509 DOI: 10.21037/qims-24-77] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Accepted: 07/01/2024] [Indexed: 08/16/2024]
Abstract
Background Deep learning features (DLFs) derived from radiomics features (RFs) fused with deep learning have shown potential in enhancing diagnostic capability. However, the limited repeatability and reproducibility of DLFs across multiple centers represents a challenge in the clinically validation of these features. This study thus aimed to evaluate the repeatability and reproducibility of DLFs and their potential efficiency in differentiating subtypes of lung adenocarcinoma less than 10 mm in size and manifesting as ground-glass nodules (GGNs). Methods A chest phantom with nodules was scanned repeatedly using different thin-slice computed tomography (TSCT) scanners with varying acquisition and reconstruction parameters. The robustness of the DLFs was measured using the concordance correlation coefficient (CCC) and intraclass correlation coefficient (ICC). A deep learning approach was used for visualizing the DLFs. To assess the clinical effectiveness and generalizability of the stable and informative DLFs, three hospitals were used to source 275 patients, in whom 405 nodules were pathologically differentially diagnosed as GGN lung adenocarcinoma less than 10 mm in size and were retrospectively reviewed for clinical validation. Results A total of 64 DLFs were analyzed, which revealed that the variables of slice thickness and slice interval (ICC, 0.79±0.18) and reconstruction kernel (ICC, 0.82±0.07) were significantly associated with the robustness of DLFs. Feature visualization showed that the DLFs were mainly focused around the nodule areas. In the external validation, a subset of 28 robust DLFs identified as stable under all sources of variability achieved the highest area under curve [AUC =0.65, 95% confidence interval (CI): 0.53-0.76] compared to other DLF models and the radiomics model. Conclusions Although different manufacturers and scanning schemes affect the reproducibility of DLFs, certain DLFs demonstrated excellent stability and effectively improved diagnostic the efficacy for identifying subtypes of lung adenocarcinoma. Therefore, as the first step, screening stable DLFs in multicenter DLFs research may improve diagnostic efficacy and promote the application of these features.
Collapse
Affiliation(s)
- Yi Zhan
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China
| | - Renxiang Dai
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| | - Fangyun Li
- Lianren Digital Health Technology Co., Ltd., Shanghai, China
| | - Zenghui Cheng
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yaoyao Zhuo
- Department of Radiology, Zhongshan Hospital, Fudan University School of Medicine, Shanghai, China
| | - Fei Shan
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China
| | - Lingxiao Zhou
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| |
Collapse
|
2
|
Zhu L, Dong H, Sun J, Wang L, Xing Y, Hu Y, Lu J, Yang J, Chu J, Yan C, Yuan F, Zhong J. Robustness of radiomics among photon-counting detector CT and dual-energy CT systems: a texture phantom study. Eur Radiol 2024:10.1007/s00330-024-10976-1. [PMID: 39048741 DOI: 10.1007/s00330-024-10976-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 06/18/2024] [Accepted: 07/05/2024] [Indexed: 07/27/2024]
Abstract
OBJECTIVES To evaluate the robustness of radiomics features among photon-counting detector CT (PCD-CT) and dual-energy CT (DECT) systems. METHODS A texture phantom consisting of twenty-eight materials was scanned with one PCD-CT and four DECT systems (dual-source, rapid kV-switching, dual-layer, and sequential scanning) at three dose levels twice. Thirty sets of virtual monochromatic images at 70 keV were reconstructed. Regions of interest were delineated for each material with a rigid registration. Ninety-three radiomics were extracted per PyRadiomics. The test-retest repeatability between repeated scans was assessed by Bland-Altman analysis. The intra-system reproducibility between dose levels, and inter-system reproducibility within the same dose level, were evaluated by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). Inter-system variability among five scanners was assessed by coefficient of variation (CV) and quartile coefficient of dispersion (QCD). RESULTS The test-retest repeatability analysis presented that 97.1% of features were repeatable between scan-rescans. The mean ± standard deviation ICC and CCC were 0.945 ± 0.079 and 0.945 ± 0.079 for intra-system reproducibility, respectively, and 86.0% and 85.7% of features were with ICC > 0.90 and CCC > 0.90, respectively, between different dose levels. The mean ± standard deviation ICC and CCC were 0.157 ± 0.174 and 0.157 ± 0.174 for inter-system reproducibility, respectively, and none of the features were with ICC > 0.90 or CCC > 0.90 within the same dose level. The inter-system variability suggested that 6.5% and 12.8% of features were with CV < 10% and QCD < 10%, respectively, among five CT systems. CONCLUSION The radiomics features were non-reproducible with significant variability in values among different CT techniques. CLINICAL RELEVANCE STATEMENT Radiomics features are non-reproducible with significant variability in values among photon-counting detector CT and dual-energy CT systems, necessitating careful attention to improve the cross-system generalizability of radiomic features before implementation of radiomics analysis in clinical routine. KEY POINTS CT radiomics stability should be guaranteed before the implementation in the clinical routine. Radiomics robustness was on a low level among photon-counting detectors and dual-energy CT techniques. Limited inter-system robustness of radiomic features may impact the generalizability of models.
Collapse
Affiliation(s)
- Lan Zhu
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Haipeng Dong
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Jing Sun
- Department of General Surgery, Shanghai Minimally Invasive Surgery Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Lingyun Wang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Jiarui Yang
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA
| | - Jingshen Chu
- Department of Science and Technology Development, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Chao Yan
- Department of Surgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Fei Yuan
- Department of Pathology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
3
|
Wennmann M, Rotkopf LT, Bauer F, Hielscher T, Kächele J, Mai EK, Weinhold N, Raab MS, Goldschmidt H, Weber TF, Schlemmer HP, Delorme S, Maier-Hein K, Neher P. Reproducible Radiomics Features from Multi-MRI-Scanner Test-Retest-Study: Influence on Performance and Generalizability of Models. J Magn Reson Imaging 2024. [PMID: 38733369 DOI: 10.1002/jmri.29442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Revised: 03/29/2024] [Accepted: 04/01/2024] [Indexed: 05/13/2024] Open
Abstract
BACKGROUND Radiomics models trained on data from one center typically show a decline of performance when applied to data from external centers, hindering their introduction into large-scale clinical practice. Current expert recommendations suggest to use only reproducible radiomics features isolated by multiscanner test-retest experiments, which might help to overcome the problem of limited generalizability to external data. PURPOSE To evaluate the influence of using only a subset of robust radiomics features, defined in a prior in vivo multi-MRI-scanner test-retest-study, on the performance and generalizability of radiomics models. STUDY TYPE Retrospective. POPULATION Patients with monoclonal plasma cell disorders. Training set (117 MRIs from center 1); internal test set (42 MRIs from center 1); external test set (143 MRIs from center 2-8). FIELD STRENGTH/SEQUENCE 1.5T and 3.0T; T1-weighted turbo spin echo. ASSESSMENT The task for the radiomics models was to predict plasma cell infiltration, determined by bone marrow biopsy, noninvasively from MRI. Radiomics machine learning models, including linear regressor, support vector regressor (SVR), and random forest regressor (RFR), were trained on data from center 1, using either all radiomics features, or using only reproducible radiomics features. Models were tested on an internal (center 1) and a multicentric external data set (center 2-8). STATISTICAL TESTS Pearson correlation coefficient r and mean absolute error (MAE) between predicted and actual plasma cell infiltration. Fisher's z-transformation, Wilcoxon signed-rank test, Wilcoxon rank-sum test; significance level P < 0.05. RESULTS When using only reproducible features compared with all features, the performance of the SVR on the external test set significantly improved (r = 0.43 vs. r = 0.18 and MAE = 22.6 vs. MAE = 28.2). For the RFR, the performance on the external test set deteriorated when using only reproducible instead of all radiomics features (r = 0.33 vs. r = 0.44, P = 0.29 and MAE = 21.9 vs. MAE = 20.5, P = 0.10). CONCLUSION Using only reproducible radiomics features improves the external performance of some, but not all machine learning models, and did not automatically lead to an improvement of the external performance of the overall best radiomics model. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY Stage 2.
Collapse
Affiliation(s)
- Markus Wennmann
- Division of Radiology, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- Diagnostic and Interventional Radiology, University Hospital Heidelberg, Heidelberg, Germany
| | - Lukas T Rotkopf
- Division of Radiology, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
| | - Fabian Bauer
- Division of Radiology, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
| | - Thomas Hielscher
- Division of Biostatistics, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
| | - Jessica Kächele
- Division of Medical Image Computing, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- German Cancer Consortium (DKTK), Partner Site Heidelberg, Heidelberg, Germany
| | - Elias K Mai
- Heidelberg Myeloma Center, Department of Medicine, University Hospital Heidelberg, Heidelberg, Germany
| | - Niels Weinhold
- Heidelberg Myeloma Center, Department of Medicine, University Hospital Heidelberg, Heidelberg, Germany
| | - Marc-Steffen Raab
- Heidelberg Myeloma Center, Department of Medicine, University Hospital Heidelberg, Heidelberg, Germany
| | - Hartmut Goldschmidt
- Heidelberg Myeloma Center, Department of Medicine, University Hospital Heidelberg, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, Heidelberg, Germany
| | - Tim F Weber
- Diagnostic and Interventional Radiology, University Hospital Heidelberg, Heidelberg, Germany
| | - Heinz-Peter Schlemmer
- Division of Radiology, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, Heidelberg, Germany
| | - Stefan Delorme
- Division of Radiology, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
| | - Klaus Maier-Hein
- Division of Medical Image Computing, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- German Cancer Consortium (DKTK), Partner Site Heidelberg, Heidelberg, Germany
- Pattern Analysis and Learning Group, Department of Radiation Oncology, University Hospital Heidelberg, Heidelberg, Germany
| | - Peter Neher
- Division of Medical Image Computing, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- German Cancer Consortium (DKTK), Partner Site Heidelberg, Heidelberg, Germany
- Pattern Analysis and Learning Group, Department of Radiation Oncology, University Hospital Heidelberg, Heidelberg, Germany
| |
Collapse
|
4
|
Zhong J, Wu Z, Wang L, Chen Y, Xia Y, Wang L, Li J, Lu W, Shi X, Feng J, Dong H, Zhang H, Yao W. Impacts of Adaptive Statistical Iterative Reconstruction-V and Deep Learning Image Reconstruction Algorithms on Robustness of CT Radiomics Features: Opportunity for Minimizing Radiomics Variability Among Scans of Different Dose Levels. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:123-133. [PMID: 38343265 DOI: 10.1007/s10278-023-00901-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 08/15/2023] [Accepted: 08/16/2023] [Indexed: 03/02/2024]
Abstract
This study aims to investigate the influence of adaptive statistical iterative reconstruction-V (ASIR-V) and deep learning image reconstruction (DLIR) on CT radiomics feature robustness. A standardized phantom was scanned under single-energy CT (SECT) and dual-energy CT (DECT) modes at standard and low (20 and 10 mGy) dose levels. Images of SECT 120 kVp and corresponding DECT 120 kVp-like virtual monochromatic images were generated with filtered back-projection (FBP), ASIR-V at 40% (AV-40) and 100% (AV-100) blending levels, and DLIR algorithm at low (DLIR-L), medium (DLIR-M), and high (DLIR-H) strength levels. Ninety-four features were extracted via Pyradiomics. Reproducibility of features was calculated between standard and low dose levels, between reconstruction algorithms in reference to FBP images, and within scan mode, using intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). The average percentage of features with ICC > 0.90 and CCC > 0.90 between the two dose levels was 21.28% and 20.75% in AV-40 images, and 39.90% and 35.11% in AV-100 images, respectively, and increased from 15.43 to 45.22% and from 15.43 to 44.15% with an increasing strength level of DLIR. The average percentage of features with ICC > 0.90 and CCC > 0.90 in reference to FBP images was 26.07% and 25.80% in AV-40 images, and 18.88% and 18.62% in AV-100 images, respectively, and decreased from 27.93 to 17.82% and from 27.66 to 17.29% with an increasing strength level of DLIR. DLIR and ASIR-V algorithms showed low reproducibility in reference to FBP images, while the high-strength DLIR algorithm provides an opportunity for minimizing radiomics variability due to dose reduction.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Zhiyuan Wu
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Lingyun Wang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Yong Chen
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Yihan Xia
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Lan Wang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Jianying Li
- Computed Tomography Research Center, GE Healthcare, Beijing, 100176, China
| | - Wei Lu
- Computed Tomography Research Center, GE Healthcare, Shanghai, 201203, China
| | - Xiaomeng Shi
- Department of Materials, Imperial College London, South Kensington Campus, London, SW7 2AZ, UK
| | - Jianxing Feng
- Haohua Technology Co., Ltd., Shanghai, 201100, China
| | - Haipeng Dong
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
5
|
He X, Chen Z, Gao Y, Wang W, You M. Reproducibility and location-stability of radiomic features derived from cone-beam computed tomography: a phantom study. Dentomaxillofac Radiol 2023; 52:20230180. [PMID: 37664997 DOI: 10.1259/dmfr.20230180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/05/2023] Open
Abstract
OBJECTIVES This study aims to determine the reproducibility and location-stability of cone-beam computed tomography (CBCT) radiomic features. METHODS Centrifugal tubes with six concentrations of K2HPO4 solutions (50, 100, 200, 400, 600, and 800 mg ml-1) were imaged within a customized phantom. For each concentration, images were captured twice as test and retest sets. Totally, 69 radiomic features were extracted by LIFEx. The reproducibility was assessed between the test and retest sets. We used the concordance correlation coefficient (CCC) to screen qualified features and then compared the differences in the numbers of them under 24 series (four locations groups * six concentrations). The location-stability was assessed using the Kruskal-Wallis test under different concentration sets; likewise, the numbers of qualified features under six test sets were analyzed. RESULTS There were 20 and 23 qualified features in the reproducibility and location-stability experiments, respectively. In the reproducibility experiment, the performance of the peripheral groups and high-concentration sets was significantly better than the center groups and low-concentration sets. The effect of concentration on the location-stability of features was not monotonic, and the number of qualified features in the low-concentration sets was greater than that in the high-concentration sets. No features were qualified in both experiments. CONCLUSIONS The density and location of the target object can affect the number of reproducible radiomic features, and its density can also affect the number of location-stable radiomic features. The problem of feature reliability should be treated cautiously in radiomic research on CBCT.
Collapse
Affiliation(s)
- Xian He
- State Key Laboratory of Oral Diseases, National Center for Stomatology, National Clinical Research Center for Oral Diseases, West China School of Stomatology, Sichuan University, Chengdu, China
| | - Zhi Chen
- School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
| | - Yutao Gao
- School of Computer Science, Sichuan University, Chengdu, China
| | - Wanjing Wang
- Faculty of Mathematics, Sichuan University, Chengdu, China
| | - Meng You
- Department of Oral Medical Imaging, State Key Laboratory of Oral Diseases, National Center for Stomatology, National Clinical Research Center for Oral Diseases, West China Hospital of Stomatology, Sichuan University, Chengdu, China
| |
Collapse
|
6
|
Hertel A, Tharmaseelan H, Rotkopf LT, Nörenberg D, Riffel P, Nikolaou K, Weiss J, Bamberg F, Schoenberg SO, Froelich MF, Ayx I. Phantom-based radiomics feature test-retest stability analysis on photon-counting detector CT. Eur Radiol 2023; 33:4905-4914. [PMID: 36809435 PMCID: PMC10289937 DOI: 10.1007/s00330-023-09460-z] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 01/02/2023] [Accepted: 01/22/2023] [Indexed: 02/23/2023]
Abstract
OBJECTIVES Radiomics image data analysis offers promising approaches in research but has not been implemented in clinical practice yet, partly due to the instability of many parameters. The aim of this study is to evaluate the stability of radiomics analysis on phantom scans with photon-counting detector CT (PCCT). METHODS Photon-counting CT scans of organic phantoms consisting of 4 apples, kiwis, limes, and onions each were performed at 10 mAs, 50 mAs, and 100 mAs with 120-kV tube current. The phantoms were segmented semi-automatically and original radiomics parameters were extracted. This was followed by statistical analysis including concordance correlation coefficients (CCC), intraclass correlation coefficients (ICC), as well as random forest (RF) analysis, and cluster analysis to determine the stable and important parameters. RESULTS Seventy-three of the 104 (70%) extracted features showed excellent stability with a CCC value > 0.9 when compared in a test and retest analysis, and 68 features (65.4%) were stable compared to the original in a rescan after repositioning. Between the test scans with different mAs values, 78 (75%) features were rated with excellent stability. Eight radiomics features were identified that had an ICC value greater than 0.75 in at least 3 of 4 groups when comparing the different phantoms in a phantom group. In addition, the RF analysis identified many features that are important for distinguishing the phantom groups. CONCLUSION Radiomics analysis using PCCT data provides high feature stability on organic phantoms, which may facilitate the implementation of radiomics analysis likewise in clinical routine. KEY POINTS • Radiomics analysis using photon-counting computed tomography provides high feature stability. • Photon-counting computed tomography may pave the way for implementation of radiomics analysis in clinical routine.
Collapse
Affiliation(s)
- Alexander Hertel
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Hishan Tharmaseelan
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Lukas T Rotkopf
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
- Department of Radiology, German Cancer Research Center, Im Neuenheimer Feld 280, 69120, Heidelberg, Germany
| | - Dominik Nörenberg
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Philipp Riffel
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Konstantin Nikolaou
- Department of Diagnostic and Interventional Radiology, University of Tübingen, Hoppe-Seyler-Straße 3, 72076, Tübingen, Germany
| | - Jakob Weiss
- Department of Diagnostic and Interventional Radiology, Medial Center-University of Freiburg, Hugstetter Str. 55, 79106, Freiburg Im Breisgau, Germany
| | - Fabian Bamberg
- Department of Diagnostic and Interventional Radiology, Medial Center-University of Freiburg, Hugstetter Str. 55, 79106, Freiburg Im Breisgau, Germany
| | - Stefan O Schoenberg
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Matthias F Froelich
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany.
| | - Isabelle Ayx
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| |
Collapse
|
7
|
Ghetti C, Ortenzia O, Bertolini M, Sceni G, Sverzellati N, Silva M, Maddalo M. Lung dual energy CT: Impact of different technological solutions on quantitative analysis. Eur J Radiol 2023; 163:110812. [PMID: 37068414 DOI: 10.1016/j.ejrad.2023.110812] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 03/30/2023] [Accepted: 04/03/2023] [Indexed: 04/19/2023]
Abstract
PURPOSE To evaluated the accuracy of spectral parameters quantification of four different CT scanners in dual energy examinations of the lung using a dedicated phantom. METHOD Measurements were made with different technologies of the same vendor: one dual source CT scanner (DSCT), one TwinBeam (i.e. split filter) and two sequential acquisition single source scanners (SSCT). Angular separation of Calcium and Iodine signals were calculated from scatter plots of low-kVp versus high-kVp HUs. Electron density (ρe), effective atomic number (Zeff) and Iodine concentration (Iconc) were measured using Syngo.via software. Accuracy (A) of ρe, Zeff and Iconc was evaluated as the absolute percentage difference (D%) between reference values and measured ones, while precision (P) was evaluated as the variability σ obtained by repeating the measurement with different acquisition/reconstruction settings. RESULTS Angular separation was significantly larger for DSCT (α = 9.7°) and for sequential SSCT (α = 9.9°) systems. TwinBeam was less performing in material separation (α = 5.0°). The lowest average A was observed for TwinBeam (Aρe = [4.7 ± 1.0], AZ = [9.1 ± 3.1], AIconc = [19.4 ± 4.4]), while the best average A was obtained for Flash (Aρe = [1.8 ± 0.4], AZ = [3.5 ± 0.7], AIconc = [7.3 ± 1.8]). TwinBeam presented inferior average P (Pρe = [0.6 ± 0.1], PZ = [1.1 ± 0.2], PIconc = [10.9 ± 4.9]), while other technologies demonstrate a comparable average. CONCLUSIONS Different technologies performed material separation and spectral parameter quantification with different degrees of accuracy and precision. DSCT performed better while TwinBeam demonstrated not excellent performance. Iodine concentration measurements exhibited high variability due to low Iodine absolute content in lung nodules, thus limiting its clinical usefulness in pulmonary applications.
Collapse
Affiliation(s)
- Caterina Ghetti
- Medical Physics Unit - University Hospital of Parma, Via Gramsci 14, 43126 Parma, Italy
| | - Ornella Ortenzia
- Medical Physics Unit - University Hospital of Parma, Via Gramsci 14, 43126 Parma, Italy.
| | - Marco Bertolini
- Medical Physics Unit - AUSL-IRCCS of Reggio Emilia, Via Amendola 2, 42122 Reggio Emilia, Italy
| | - Giada Sceni
- Medical Physics Unit - AUSL-IRCCS of Reggio Emilia, Via Amendola 2, 42122 Reggio Emilia, Italy
| | - Nicola Sverzellati
- Unit of Scienze Radiologiche, Department of Medicine and Surgery, University of Parma, Via Gramsci 14, 43126 Parma, Italy
| | - Mario Silva
- Unit of Scienze Radiologiche, Department of Medicine and Surgery, University of Parma, Via Gramsci 14, 43126 Parma, Italy
| | - Michele Maddalo
- Medical Physics Unit - University Hospital of Parma, Via Gramsci 14, 43126 Parma, Italy
| |
Collapse
|
8
|
Ma X, Xia L, Chen J, Wan W, Zhou W. Development and validation of a deep learning signature for predicting lymph node metastasis in lung adenocarcinoma: comparison with radiomics signature and clinical-semantic model. Eur Radiol 2023; 33:1949-1962. [PMID: 36169691 DOI: 10.1007/s00330-022-09153-z] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 07/23/2022] [Accepted: 09/08/2022] [Indexed: 11/04/2022]
Abstract
OBJECTIVE To develop and validate a deep learning (DL) signature for predicting lymph node (LN) metastasis in patients with lung adenocarcinoma. METHODS A total of 612 patients with pathologically-confirmed lung adenocarcinoma were retrospectively enrolled and were randomly divided into training cohort (n = 489) and internal validation cohort (n = 123). Besides, 108 patients were enrolled and constituted an independent test cohort (n = 108). Patients' clinical characteristics and CT semantic features were collected. The radiomics features were derived from contrast-enhanced CT images. The clinical-semantic model and radiomics signature were built to predict LN metastasis. Furthermore, Swin Transformer was adopted to develop a DL signature predictive of LN metastasis. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), sensitivity, specificity, calibration curve, and decision curve analysis. The comparisons of AUC were conducted by the DeLong test. RESULTS The proposed DL signature yielded an AUC of 0.948-0.961 across all three cohorts, significantly superior to both clinical-semantic model and radiomics signature (all p < 0.05). The calibration curves show that DL signature predicted probabilities fit well the actual observed probabilities of LN metastasis. DL signature gained a higher net benefit than both clinical-semantic model and radiomics signature. The incorporation of radiomics signature or clinical-semantic risk predictors failed to reveal an incremental value over the DL signature. CONCLUSIONS The proposed DL signature based on Swin Transformer achieved a promising performance in predicting LN metastasis and could confer important information in noninvasive mediastinal LN staging and individualized therapeutic options. KEY POINTS • Accurate prediction for lymph node metastasis is crucial to formulate individualized therapeutic options for patients with lung adenocarcinoma. • The deep learning signature yielded an AUC of 0.948-0.961 across all three cohorts in predicting lymph node metastasis, superior to both radiomics signature and clinical-semantic model. • The incorporation of radiomics signature or clinical-semantic risk predictors into deep learning signature failed to reveal an incremental value over deep learning signature.
Collapse
Affiliation(s)
- Xiaoling Ma
- Medical Imaging Center, People's Hospital of Ningxia Hui Autonomous Region, Yinchuan, China
| | - Liming Xia
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1095 Jiefang Road, Qiaokou District, Wuhan, 430030, Hubei, China.
| | | | - Weijia Wan
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1095 Jiefang Road, Qiaokou District, Wuhan, 430030, Hubei, China
| | - Wen Zhou
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1095 Jiefang Road, Qiaokou District, Wuhan, 430030, Hubei, China
| |
Collapse
|
9
|
Wichtmann BD, Harder FN, Weiss K, Schönberg SO, Attenberger UI, Alkadhi H, Pinto Dos Santos D, Baeßler B. Influence of Image Processing on Radiomic Features From Magnetic Resonance Imaging. Invest Radiol 2023; 58:199-208. [PMID: 36070524 DOI: 10.1097/rli.0000000000000921] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE Before implementing radiomics in routine clinical practice, comprehensive knowledge about the repeatability and reproducibility of radiomic features is required. The aim of this study was to systematically investigate the influence of image processing parameters on radiomic features from magnetic resonance imaging (MRI) in terms of feature values as well as test-retest repeatability. MATERIALS AND METHODS Utilizing a phantom consisting of 4 onions, 4 limes, 4 kiwifruits, and 4 apples, we acquired a test-retest dataset featuring 3 of the most commonly used MRI sequences on a 3 T scanner, namely, a T1-weighted, a T2-weighted, and a fluid-attenuated inversion recovery sequence, each at high and low resolution. After semiautomatic image segmentation, image processing with systematic variation of image processing parameters was performed, including spatial resampling, intensity discretization, and intensity rescaling. For each respective image processing setting, a total of 45 radiomic features were extracted, corresponding to the following 7 matrices/feature classes: conventional indices, histogram matrix, shape matrix, gray-level zone length matrix, gray-level run length matrix, neighboring gray-level dependence matrix, and gray-level cooccurrence matrix. Systematic differences of individual features between different resampling steps were assessed using 1-way analysis of variance with Tukey-type post hoc comparisons to adjust for multiple testing. Test-retest repeatability of radiomic features was measured using the concordance correlation coefficient, dynamic range, and intraclass correlation coefficient. RESULTS Image processing influenced radiological feature values. Regardless of the acquired sequence and feature class, significant differences ( P < 0.05) in feature values were found when the size of the resampled voxels was too large, that is, bigger than 3 mm. Almost all higher-order features depended strongly on intensity discretization. The effects of intensity rescaling were negligible except for some features derived from T1-weighted sequences. For all sequences, the percentage of repeatable features (concordance correlation coefficient and dynamic range ≥ 0.9) varied considerably depending on the image processing settings. The optimal image processing setting to achieve the highest percentage of stable features varied per sequence. Irrespective of image processing, the fluid-attenuated inversion recovery sequence in high-resolution overall yielded the highest number of stable features in comparison with the other sequences (89% vs 64%-78% for the respective optimal image processing settings). Across all sequences, the most repeatable features were generally obtained for a spatial resampling close to the originally acquired voxel size and an intensity discretization to at least 32 bins. CONCLUSION Variation of image processing parameters has a significant impact on the values of radiomic features as well as their repeatability. Furthermore, the optimal image processing parameters differ for each MRI sequence. Therefore, it is recommended that these processing parameters be determined in corresponding test-retest scans before clinical application. Extensive repeatability, reproducibility, and validation studies as well as standardization are required before quantitative image analysis and radiomics can be reliably translated into routine clinical care.
Collapse
Affiliation(s)
- Barbara D Wichtmann
- From the Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany
| | - Felix N Harder
- Institute of Diagnostic and Interventional Radiology, Technical University of Munich, School of Medicine, Munich, Germany
| | | | - Stefan O Schönberg
- Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, Germany
| | - Ulrike I Attenberger
- From the Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany
| | - Hatem Alkadhi
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Switzerland
| | | | | |
Collapse
|
10
|
Differentiation of MOGAD in ADEM-like presentation children based on FLAIR MRI features. Mult Scler Relat Disord 2023; 70:104496. [PMID: 36623395 DOI: 10.1016/j.msard.2022.104496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 12/26/2022] [Accepted: 12/30/2022] [Indexed: 01/02/2023]
Abstract
OBJECTIVE The differences in magnetic resonance imaging (MRI) between children with classic acute disseminated encephalomyelitis (ADEM) and myelinal oligodendrocyte glycoprotein antibody associated disease (MOGAD) with ADEM-like presentation are controversial. The purpose of this study was to investigate whether the radiological characteristics of the MRI-FLAIR sequence can predict MOGAD in children with ADEM-like presentation and to further explore its imaging differences. METHODS We extracted 1041 radiomics features from MRI-FLAIR lesions. Then we used the redundancy analysis (Spearman correlation coefficient), significance test (student test or Mann-Whitney U test), least absolute contraction and selection operator (LASSO) to select potential predictors from the feature groups. The selected potential predictors and MOG antibody test results were used to fit the machine learning model for classification. Combined with feature selection and machine learning classifiers, the optimal model for each subgroup was derived. The resulting models have been evaluated using the receiver operator characteristic curve (ROC) at the lesion level and the model performance was evaluated at the case level using decision curve analysis. RESULTS We retrospectively reviewed and re-diagnosed 70 ADEM-like presentation cases in our center from April 2015 to January 2020. Including 49 cases with classic ADEM and 21 cases with MOGAD. 30(43%) were female, with a median age of 5.3 years. On the four subgroups by age and gender, the area under the curve (AUC) of the optimal models were 89%, 90%, 98%, and 99%, and the MOGAD detection rates (Specificity) were 83%, 83%, 92%, and 75%, respectively. CONCLUSIONS The machine learning model trained on radiomics features of MR-FLAIR images can effectively predict patients' MOGAD. This study provides a fast, objective, and quantifiable method for MOGAD diagnosis.
Collapse
|
11
|
Zhong J, Xia Y, Chen Y, Li J, Lu W, Shi X, Feng J, Yan F, Yao W, Zhang H. Deep learning image reconstruction algorithm reduces image noise while alters radiomics features in dual-energy CT in comparison with conventional iterative reconstruction algorithms: a phantom study. Eur Radiol 2023; 33:812-824. [PMID: 36197579 DOI: 10.1007/s00330-022-09119-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/26/2022] [Accepted: 08/17/2022] [Indexed: 02/03/2023]
Abstract
OBJECTIVES To compare image quality between a deep learning image reconstruction (DLIR) algorithm and conventional iterative reconstruction (IR) algorithms in dual-energy CT (DECT) and to assess the impact of these algorithms on radiomics robustness. METHODS A phantom with clinical-relevant densities was imaged on seven DECT scanners with the same voxel size using typical abdominal-pelvis examination protocols. On one DECT scanner, raw data were reconstructed using both conventional IR (adaptive statistical iterative reconstruction-V, ASIR-V) and DLIR. Nine sets of corresponding images were generated on other six DECT scanners using scanner-equipped conventional IR. Regions of interest were delineated through rigid registrations. Image quality was compared. Pyradiomics platform was used for radiomics feature extraction. Test-retest repeatability was assessed by Bland-Altman analysis for repeated scans. Inter-reconstruction algorithm reproducibility between conventional IR and DLIR was tested by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). Inter-scanner reproducibility was evaluated by coefficient of variation (CV) and quartile coefficient of dispersion (QCD). Robust features were identified. RESULTS DLIR significantly improved image quality. Ninety-four radiomics features were extracted and nine features were considered as robust. 93.87% features were repeatable between repeated scans. ASIR-V images showed higher reproducibility to other conventional IR than DLIR (ICC mean, 0.603 vs 0.558, p = 0.001; CCC mean, 0.554 vs 0.510, p = 0.004). 7.45% and 26.83% features were reproducible among scanners evaluated by CV and QCD, respectively. CONCLUSIONS DLIR improves quality of DECT images but may alter radiomics features compared to conventional IR. Nine robust DECT radiomics features were identified. KEY POINTS • DLIR improves DECT image quality in terms of signal-to-noise ratio and contrast-to-noise ratio compared with ASIR-V and showed the highest noise reduction rate and lowest peak frequency shift. • Most of radiomics features are repeatable between repeated DECT scans, while inter-reconstruction algorithm reproducibility between conventional IR and DLIR, and inter-scanner reproducibility, are low. • Although DLIR may alter radiomics features compared to IR algorithms, nine radiomics features survived repeatability and reproducibility analysis among DECT scanners and reconstruction algorithms, which allows further validation and clinical-relevant analysis.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yihan Xia
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Yong Chen
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Jianying Li
- Computed Tomography Research Center, GE Healthcare, Beijing, 100176, China
| | - Wei Lu
- Computed Tomography Research Center, GE Healthcare, Shanghai, 201203, China
| | - Xiaomeng Shi
- Department of Materials, Imperial College London, South Kensington Campus, London, SW7 2AZ, UK
| | - Jianxing Feng
- Haohua Technology Co., Ltd., Shanghai, 201100, China
| | - Fuhua Yan
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| |
Collapse
|
12
|
Li Y, Liu J, Yang X, Xu F, Wang L, He C, Lin L, Qing H, Ren J, Zhou P. Radiomic and quantitative-semantic models of low-dose computed tomography for predicting the poorly differentiated invasive non-mucinous pulmonary adenocarcinoma. LA RADIOLOGIA MEDICA 2023; 128:191-202. [PMID: 36637740 DOI: 10.1007/s11547-023-01591-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 01/04/2023] [Indexed: 01/14/2023]
Abstract
PURPOSE Poorly differentiated invasive non-mucinous pulmonary adenocarcinoma (IPA), based on the novel grading system, was related to poor prognosis, with a high risk of lymph node metastasis and local recurrence. This study aimed to build the radiomic and quantitative-semantic models of low-dose computed tomography (LDCT) to preoperatively predict the poorly differentiated IPA in nodules with solid component, and compare their diagnostic performance with radiologists. MATERIALS AND METHODS A total of 396 nodules from 388 eligible patients, who underwent LDCT scan within 2 weeks before surgery and were pathologically diagnosed with IPA, were retrospectively enrolled between July 2018 and December 2021. Nodules were divided into two independent cohorts according to scanners: primary cohort (195 well/moderate differentiated and 64 poorly differentiated) and validation cohort (104 well/moderate differentiated and 33 poorly differentiated). The radiomic and quantitative-semantic models were built using multivariable logistic regression. The diagnostic performance of the models and radiologists was assessed by area under curve (AUC) of receiver operating characteristic (ROC) curve, accuracy, sensitivity, and specificity. RESULTS No significant differences of AUCs were found between the radiomic and quantitative-semantic model in primary and validation cohorts (0.921 vs. 0.923, P = 0.846 and 0.938 vs. 0.911, P = 0.161). Both the models outperformed three radiologists in the validation cohort (all P < 0.05). CONCLUSIONS The radiomic and quantitative-semantic models of LDCT, which could identify the poorly differentiated IPA with excellent diagnostic performance, might provide guidance for therapeutic decision making, such as choosing appropriate surgical method or adjuvant chemotherapy.
Collapse
Affiliation(s)
- Yong Li
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Jieke Liu
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Xi Yang
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Fuyang Xu
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Lu Wang
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Changjiu He
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Libo Lin
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Haomiao Qing
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Jing Ren
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China
| | - Peng Zhou
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, No.55, Section 4, South Renmin Road, Chengdu, 610041, Sichuan, China.
| |
Collapse
|
13
|
Can quantitative peritumoral CT radiomics features predict the prognosis of patients with non-small cell lung cancer? A systematic review. Eur Radiol 2023; 33:2105-2117. [PMID: 36307554 PMCID: PMC9935659 DOI: 10.1007/s00330-022-09174-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 08/20/2022] [Accepted: 09/16/2022] [Indexed: 11/04/2022]
Abstract
OBJECTIVES To provide an overarching evaluation of the value of peritumoral CT radiomics features for predicting the prognosis of non-small cell lung cancer and to assess the quality of the available studies. METHODS The PubMed, Embase, Web of Science, and Cochrane Library databases were searched for studies predicting the prognosis in patients with non-small cell lung cancer (NSCLC) using CT-based peritumoral radiomics features. Information about the patient, CT-scanner, and radiomics analyses were all extracted for the included studies. Study quality was assessed using the Radiomics Quality Score (RQS) and the Prediction Model Risk of Bias Assessment Tool (PROBAST). RESULTS Thirteen studies were included with 2942 patients from 2017 to 2022. Only one study was prospective, and the others were all retrospectively designed. Manual segmentation and multicenter studies were performed by 69% and 46% of the included studies, respectively. 3D-Slicer and MATLAB software were most commonly used for the segmentation of lesions and extraction of features. The peritumoral region was most frequently defined as dilated from the tumor boundary of 15 mm, 20 mm, or 30 mm. The median RQS of the studies was 13 (range 4-19), while all of included studies were assessed as having a high risk of bias (ROB) overall. CONCLUSIONS Peritumoral radiomics features based on CT images showed promise in predicting the prognosis of NSCLC, although well-designed studies and further biological validation are still needed. KEY POINTS • Peritumoral radiomics features based on CT images are promising and encouraging for predicting the prognosis of non-small cell lung cancer. • The peritumoral region was often dilated from the tumor boundary of 15 mm or 20 mm because these were considered safe margins. • The median Radiomics Quality Score of the included studies was 13 (range 4-19), and all of studies were considered to have a high risk of bias overall.
Collapse
|
14
|
Wennmann M, Klein A, Bauer F, Chmelik J, Grözinger M, Uhlenbrock C, Lochner J, Nonnenmacher T, Rotkopf LT, Sauer S, Hielscher T, Götz M, Floca RO, Neher P, Bonekamp D, Hillengass J, Kleesiek J, Weinhold N, Weber TF, Goldschmidt H, Delorme S, Maier-Hein K, Schlemmer HP. Combining Deep Learning and Radiomics for Automated, Objective, Comprehensive Bone Marrow Characterization From Whole-Body MRI: A Multicentric Feasibility Study. Invest Radiol 2022; 57:752-763. [PMID: 35640004 DOI: 10.1097/rli.0000000000000891] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVES Disseminated bone marrow (BM) involvement is frequent in multiple myeloma (MM). Whole-body magnetic resonance imaging (wb-MRI) enables to evaluate the whole BM. Reading of such whole-body scans is time-consuming, and yet radiologists can transfer only a small fraction of the information of the imaging data set to the report. This limits the influence that imaging can have on clinical decision-making and in research toward precision oncology. The objective of this feasibility study was to implement a concept for automatic, comprehensive characterization of the BM from wb-MRI, by automatic BM segmentation and subsequent radiomics analysis of 30 different BM spaces (BMS). MATERIALS AND METHODS This retrospective multicentric pilot study used a total of 106 wb-MRI from 102 patients with (smoldering) MM from 8 centers. Fifty wb-MRI from center 1 were used for training of segmentation algorithms (nnU-Nets) and radiomics algorithms. Fifty-six wb-MRI from 8 centers, acquired with a variety of different MRI scanners and protocols, were used for independent testing. Manual segmentations of 2700 BMS from 90 wb-MRI were performed for training and testing of the segmentation algorithms. For each BMS, 296 radiomics features were calculated individually. Dice score was used to assess similarity between automatic segmentations and manual reference segmentations. RESULTS The "multilabel nnU-Net" segmentation algorithm, which performs segmentation of 30 BMS and labels them individually, reached mean dice scores of 0.88 ± 0.06/0.87 ± 0.06/0.83 ± 0.11 in independent test sets from center 1/center 2/center 3-8 (interrater variability between radiologists, 0.88 ± 0.01). The subset from the multicenter, multivendor test set (center 3-8) that was of high imaging quality was segmented with high precision (mean dice score, 0.87), comparable to the internal test data from center 1. The radiomic BM phenotype consisting of 8880 descriptive parameters per patient, which result from calculation of 296 radiomics features for each of the 30 BMS, was calculated for all patients. Exemplary cases demonstrated connections between typical BM patterns in MM and radiomic signatures of the respective BMS. In plausibility tests, predicted size and weight based on radiomics models of the radiomic BM phenotype significantly correlated with patients' actual size and weight ( P = 0.002 and P = 0.003, respectively). CONCLUSIONS This pilot study demonstrates the feasibility of automatic, objective, comprehensive BM characterization from wb-MRI in multicentric data sets. This concept allows the extraction of high-dimensional phenotypes to capture the complexity of disseminated BM disorders from imaging. Further studies need to assess the clinical potential of this method for automatic staging, therapy response assessment, or prediction of biopsy results.
Collapse
Affiliation(s)
| | - André Klein
- Medical Image Computing, German Cancer Research Center
| | | | | | | | | | | | - Tobias Nonnenmacher
- Department of Diagnostic and Interventional Radiology, University Hospital Heidelberg
| | | | - Sandra Sauer
- Department of Medicine V, Multiple Myeloma Section, University Hospital Heidelberg
| | - Thomas Hielscher
- Division of Biostatistics, German Cancer Research Center, Heidelberg
| | | | | | - Peter Neher
- Medical Image Computing, German Cancer Research Center
| | | | - Jens Hillengass
- Department of Medicine, Roswell Park Comprehensive Cancer Center, Elm and Carlton Streets, Buffalo, NY
| | | | - Niels Weinhold
- Department of Medicine V, Multiple Myeloma Section, University Hospital Heidelberg
| | - Tim Frederik Weber
- Department of Diagnostic and Interventional Radiology, University Hospital Heidelberg
| | | | | | | | | |
Collapse
|