1
|
Mali SA, Ibrahim A, Woodruff HC, Andrearczyk V, Müller H, Primakov S, Salahuddin Z, Chatterjee A, Lambin P. Making Radiomics More Reproducible across Scanner and Imaging Protocol Variations: A Review of Harmonization Methods. J Pers Med 2021; 11:842. [PMID: 34575619 PMCID: PMC8472571 DOI: 10.3390/jpm11090842] [Citation(s) in RCA: 68] [Impact Index Per Article: 22.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 08/21/2021] [Accepted: 08/24/2021] [Indexed: 12/13/2022] Open
Abstract
Radiomics converts medical images into mineable data via a high-throughput extraction of quantitative features used for clinical decision support. However, these radiomic features are susceptible to variation across scanners, acquisition protocols, and reconstruction settings. Various investigations have assessed the reproducibility and validation of radiomic features across these discrepancies. In this narrative review, we combine systematic keyword searches with prior domain knowledge to discuss various harmonization solutions to make the radiomic features more reproducible across various scanners and protocol settings. Different harmonization solutions are discussed and divided into two main categories: image domain and feature domain. The image domain category comprises methods such as the standardization of image acquisition, post-processing of raw sensor-level image data, data augmentation techniques, and style transfer. The feature domain category consists of methods such as the identification of reproducible features and normalization techniques such as statistical normalization, intensity harmonization, ComBat and its derivatives, and normalization using deep learning. We also reflect upon the importance of deep learning solutions for addressing variability across multi-centric radiomic studies especially using generative adversarial networks (GANs), neural style transfer (NST) techniques, or a combination of both. We cover a broader range of methods especially GANs and NST methods in more detail than previous reviews.
Collapse
Affiliation(s)
- Shruti Atul Mali
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
| | - Abdalla Ibrahim
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
- Department of Radiology and Nuclear Medicine, GROW—School for Oncology, Maastricht University Medical Center+, P.O. Box 5800, 6202 AZ Maastricht, The Netherlands
- Department of Medical Physics, Division of Nuclear Medicine and Oncological Imaging, Hospital Center Universitaire de Liege, 4000 Liege, Belgium
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
| | - Henry C. Woodruff
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
- Department of Radiology and Nuclear Medicine, GROW—School for Oncology, Maastricht University Medical Center+, P.O. Box 5800, 6202 AZ Maastricht, The Netherlands
| | - Vincent Andrearczyk
- Institute of Information Systems, University of Applied Sciences and Arts Western Switzerland (HES-SO), rue du Technopole 3, 3960 Sierre, Switzerland; (V.A.); (H.M.)
| | - Henning Müller
- Institute of Information Systems, University of Applied Sciences and Arts Western Switzerland (HES-SO), rue du Technopole 3, 3960 Sierre, Switzerland; (V.A.); (H.M.)
| | - Sergey Primakov
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
| | - Zohaib Salahuddin
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
| | - Avishek Chatterjee
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
| | - Philippe Lambin
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, Maastricht, Universiteitssingel 40, 6229 ER Maastricht, The Netherlands; (A.I.); (H.C.W.); (S.P.); (Z.S.); (A.C.); (P.L.)
- Department of Radiology and Nuclear Medicine, GROW—School for Oncology, Maastricht University Medical Center+, P.O. Box 5800, 6202 AZ Maastricht, The Netherlands
| |
Collapse
|
2
|
Hotta M, Minamimoto R, Gohda Y, Miwa K, Otani K, Kiyomatsu T, Yano H. Prognostic value of 18F-FDG PET/CT with texture analysis in patients with rectal cancer treated by surgery. Ann Nucl Med 2021; 35:843-852. [PMID: 33948903 DOI: 10.1007/s12149-021-01622-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 04/27/2021] [Indexed: 12/24/2022]
Abstract
PURPOSE The aim of this study was to evaluate the ability of texture analysis using pretreatment 18F-FDG PET/CT to predict prognosis in patients with surgically treated rectal cancer. METHODS We analyzed 94 patients with pathologically proven rectal cancer who underwent pretreatment 18F-FDG PET/CT and were subsequently treated with surgery. The volume of interest of the primary tumor was defined using a threshold of 40% of the maximum standardized uptake value (SUVmax), and conventional (SUVmax, metabolic tumor volume [MTV], total lesion glycolysis [TLG]) and textural PET features were extracted. Harmonization of PET features was performed with the ComBat method. The study endpoints were overall survival (OS) and progression-free survival (PFS), and the prognostic value of PET features was evaluated by Cox regression analysis. RESULTS In the follow-up period (median 41.7 [interquartile range, 30.5-60.4] months), 21 (22.3%) and 30 (31.9%) patients had cancer-related death or disease progression, respectively. Univariate analysis revealed a significant association of (1) MTV, TLG, and gray-level co-occurrence matrix (GLCM) entropy with OS; and (2) SUVmax, MTV, TLG, and GLCM entropy with PFS. In multivariate analysis including clinical characteristics, GLCM entropy (≥ 2.13) was the only relevant prognostic PET feature for poor OS (hazard ratio [HR]: 4.16, p = 0.035) and PFS (HR: 2.70, p = 0.046). CONCLUSION GLCM entropy, which indicates metabolic intratumoral heterogeneity, was an independent prognostic factor in patients with surgically treated rectal cancer. Compared with conventional PET features, GLCM entropy has better predictive value and shows potential to facilitate precision medicine.
Collapse
Affiliation(s)
- Masatoshi Hotta
- Division of Nuclear Medicine, Department of Radiology, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan.
| | - Ryogo Minamimoto
- Division of Nuclear Medicine, Department of Radiology, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Yoshimasa Gohda
- Department of Surgery, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Kenta Miwa
- Department of Radiological Sciences, School of Health Science, International University of Health and Welfare, 2600-1 Kitakanemaru, Ohtawara City, Tochigi, 324-8501, Japan
| | - Kensuke Otani
- Department of Surgery, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Tomomichi Kiyomatsu
- Department of Surgery, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Hideaki Yano
- Department of Surgery, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| |
Collapse
|
3
|
Cardiac Computed Tomography Radiomics for the Non-Invasive Assessment of Coronary Inflammation. Cells 2021; 10:cells10040879. [PMID: 33921502 PMCID: PMC8069372 DOI: 10.3390/cells10040879] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 04/07/2021] [Accepted: 04/09/2021] [Indexed: 12/23/2022] Open
Abstract
Radiomics, via the extraction of quantitative information from conventional radiologic images, can identify imperceptible imaging biomarkers that can advance the characterization of coronary plaques and the surrounding adipose tissue. Such an approach can unravel the underlying pathophysiology of atherosclerosis which has the potential to aid diagnostic, prognostic and, therapeutic decision making. Several studies have demonstrated that radiomic analysis can characterize coronary atherosclerotic plaques with a level of accuracy comparable, if not superior, to current conventional qualitative and quantitative image analysis. While there are many milestones still to be reached before radiomics can be integrated into current clinical practice, such techniques hold great promise for improving the imaging phenotyping of coronary artery disease.
Collapse
|
4
|
Pfaehler E, Beukinga RJ, de Jong JR, Slart RHJA, Slump CH, Dierckx RAJO, Boellaard R. Repeatability of 18 F-FDG PET radiomic features: A phantom study to explore sensitivity to image reconstruction settings, noise, and delineation method. Med Phys 2019; 46:665-678. [PMID: 30506687 PMCID: PMC7380016 DOI: 10.1002/mp.13322] [Citation(s) in RCA: 71] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2018] [Revised: 11/14/2018] [Accepted: 11/21/2018] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND 18 F-fluoro-2-deoxy-D-Glucose positron emission tomography (18 F-FDG PET) radiomics has the potential to guide the clinical decision making in cancer patients, but validation is required before radiomics can be implemented in the clinical setting. The aim of this study was to explore how feature space reduction and repeatability of 18 F-FDG PET radiomic features are affected by various sources of variation such as underlying data (e.g., object size and uptake), image reconstruction methods and settings, noise, discretization method, and delineation method. METHODS The NEMA image quality phantom was scanned with various sphere-to-background ratios (SBR), simulating different activity uptakes, including spheres with low uptake, that is, SBR smaller than 1. Furthermore, images of a phantom containing 3D printed inserts reflecting realistic heterogeneity uptake patterns were acquired. Data were reconstructed using various matrix sizes, reconstruction algorithms, and scan durations (noise). For every specific reconstruction and noise level, ten statistically equal replicates were generated. The phantom inserts were delineated using CT and PET-based segmentation methods. A total of 246 radiomic features was extracted from each image dataset. Images were discretized with a fixed number of 64 bins (FBN) and a fixed bin width (FBW) of 0.25 for the high and a FBW of 0.05 for the low uptake data. In terms of feature reduction, we determined the impact of these factors on the composition of feature clusters, which were defined on the basis of Spearman's correlation matrices. To assess feature repeatability, the intraclass correlation coefficient was calculated over the ten replicates. RESULTS In general, larger spheres with high uptake resulted in better repeatability compared to smaller low uptake spheres. In terms of repeatability, features extracted from heterogeneous phantom inserts were comparable to features extracted from bigger high uptake spheres. For example, for an EARL-compliant reconstruction, larger and smaller high uptake spheres yielded good repeatability for 32% and 30% of the features, while the heterogeneous inserts resulted in 34% repeatable features. For the low uptake spheres, this was the case for 22% and 20% of the features for bigger and smaller spheres, respectively. Images reconstructed with point-spread-function (PSF) resulted in the highest repeatability when compared with OSEM or time-of-flight, for example, 53%, 30%, and 32% of repeatable features, respectively (for unsmoothed data, discretized with FBN, 300 s scan duration). Reducing image noise (increasing scan duration and smoothing) and using CT-based segmentation for the low uptake spheres yielded improved repeatability. FBW discretization resulted in higher repeatability than FBN discretization, for example, 89% and 35% of the features, respectively (for the EARL-compliant reconstruction and larger high uptake spheres). CONCLUSION Feature space reduction and repeatability of 18 F-FDG PET radiomic features depended on all studied factors. The high sensitivity of PET radiomic features to image quality suggests that a high level of image acquisition and preprocessing standardization is required to be used as clinical imaging biomarker.
Collapse
Affiliation(s)
- Elisabeth Pfaehler
- Department of Nuclear Medicine and Molecular ImagingMedical Imaging CenterUniversity of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
| | - Roelof J. Beukinga
- Department of Nuclear Medicine and Molecular ImagingMedical Imaging CenterUniversity of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
- Department of Biomedical Photonic ImagingUniversity of TwenteEnschedeThe Netherlands
| | - Johan R. de Jong
- Department of Nuclear Medicine and Molecular ImagingMedical Imaging CenterUniversity of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
| | - Riemer H. J. A. Slart
- Department of Nuclear Medicine and Molecular ImagingMedical Imaging CenterUniversity of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
- Department of Biomedical Photonic ImagingUniversity of TwenteEnschedeThe Netherlands
| | - Cornelis H. Slump
- MIRA Institute for Biomedical Technology and Technical MedicineUniversity of TwenteEnschedeThe Netherlands
| | - Rudi A. J. O. Dierckx
- Department of Nuclear Medicine and Molecular ImagingMedical Imaging CenterUniversity of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
| | - Ronald Boellaard
- Department of Nuclear Medicine and Molecular ImagingMedical Imaging CenterUniversity of GroningenUniversity Medical Center GroningenGroningenThe Netherlands
- Department of Radiology & Nuclear MedicineAmsterdam University Medical CentersLocation VUMCAmsterdamThe Netherlands
| |
Collapse
|
5
|
Kolossváry M, Karády J, Szilveszter B, Kitslaar P, Hoffmann U, Merkely B, Maurovich-Horvat P. Radiomic Features Are Superior to Conventional Quantitative Computed Tomographic Metrics to Identify Coronary Plaques With Napkin-Ring Sign. Circ Cardiovasc Imaging 2017; 10:CIRCIMAGING.117.006843. [PMID: 29233836 PMCID: PMC5753832 DOI: 10.1161/circimaging.117.006843] [Citation(s) in RCA: 137] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2017] [Accepted: 10/19/2017] [Indexed: 12/22/2022]
Abstract
BACKGROUND Napkin-ring sign (NRS) is an independent prognostic imaging marker of major adverse cardiac events. However, identification of NRS is challenging because of its qualitative nature. Radiomics is the process of extracting thousands of quantitative parameters from medical images to create big-data data sets that can identify distinct patterns in radiological images. Therefore, we sought to determine whether radiomic analysis improves the identification of NRS plaques. METHODS AND RESULTS From 2674 patients referred to coronary computed tomographic angiography caused by stable chest pain, expert readers identified 30 patients with NRS plaques and matched these with 30 non-NRS plaques with similar degree of calcification, luminal obstruction, localization, and imaging parameters. All plaques were segmented manually, and image data information was analyzed using Radiomics Image Analysis package for the presence of 8 conventional and 4440 radiomic parameters. We used the permutation test of symmetry to assess differences between NRS and non-NRS plaques, whereas we calculated receiver-operating characteristics' area under the curve values to evaluate diagnostic accuracy. Bonferroni-corrected P<0.0012 was considered significant. None of the conventional quantitative parameters but 20.6% (916/4440) of radiomic features were significantly different between NRS and non-NRS plaques. Almost half of these (418/916) reached an area under the curve value >0.80. Short- and long-run low gray-level emphasis and surface ratio of high attenuation voxels to total surface had the highest area under the curve values (0.918; 0.894 and 0.890, respectively). CONCLUSIONS A large number of radiomic features are different between NRS and non-NRS plaques and exhibit excellent discriminatory value.
Collapse
Affiliation(s)
- Márton Kolossváry
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.)
| | - Júlia Karády
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.)
| | - Bálint Szilveszter
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.)
| | - Pieter Kitslaar
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.)
| | - Udo Hoffmann
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.)
| | - Béla Merkely
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.)
| | - Pál Maurovich-Horvat
- From the MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary (M.K., J.K., B.S., B.M., P.M.-H.); Department of Radiology, Leiden University Medical Center, The Netherlands (P.K.); Medis Medical Imaging Systems B.V., Leiden, The Netherlands (P.K.); and Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston (U.H.).
| |
Collapse
|
6
|
Shiri I, Rahmim A, Ghaffarian P, Geramifar P, Abdollahi H, Bitarafan-Rajabi A. The impact of image reconstruction settings on 18F-FDG PET radiomic features: multi-scanner phantom and patient studies. Eur Radiol 2017; 27:4498-4509. [PMID: 28567548 DOI: 10.1007/s00330-017-4859-z] [Citation(s) in RCA: 129] [Impact Index Per Article: 18.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2017] [Revised: 04/02/2017] [Accepted: 04/19/2017] [Indexed: 12/11/2022]
Abstract
OBJECTIVES The purpose of this study was to investigate the robustness of different PET/CT image radiomic features over a wide range of different reconstruction settings. METHODS Phantom and patient studies were conducted, including two PET/CT scanners. Different reconstruction algorithms and parameters including number of sub-iterations, number of subsets, full width at half maximum (FWHM) of Gaussian filter, scan time per bed position and matrix size were studied. Lesions were delineated and one hundred radiomic features were extracted. All radiomics features were categorized based on coefficient of variation (COV). RESULTS Forty seven percent features showed COV ≤ 5% and 10% of which showed COV > 20%. All geometry based, 44% and 41% of intensity based and texture based features were found as robust respectively. In regard to matrix size, 56% and 6% of all features were found non-robust (COV > 20%) and robust (COV ≤ 5%) respectively. CONCLUSIONS Variability and robustness of PET/CT image radiomics in advanced reconstruction settings is feature-dependent, and different settings have different effects on different features. Radiomic features with low COV can be considered as good candidates for reproducible tumour quantification in multi-center studies. KEY POINTS • PET/CT image radiomics is a quantitative approach assessing different aspects of tumour uptake. • Radiomic features robustness is an important issue over different image reconstruction settings. • Variability and robustness of PET/CT image radiomics in advanced reconstruction settings is feature-dependent. • Robust radiomic features can be considered as good candidates for tumour quantification.
Collapse
Affiliation(s)
- Isaac Shiri
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Junction of Shahid Hemmat and Shahid Chamran Expressways, Tehran, Iran
| | - Arman Rahmim
- Department of Radiology, Johns Hopkins University, Baltimore, MD, 21287, USA.,Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Pardis Ghaffarian
- Chronic Respiratory Diseases Research Center, National Research Institute of Tuberculosis and Lung Diseases (NRITLD), Shahid Beheshti University of Medical Sciences, Tehran, Iran.,PET/CT and Cyclotron Center, Masih Daneshvari Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Parham Geramifar
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Junction of Shahid Hemmat and Shahid Chamran Expressways, Tehran, Iran.
| | - Ahmad Bitarafan-Rajabi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Junction of Shahid Hemmat and Shahid Chamran Expressways, Tehran, Iran. .,Department of Nuclear Medicine, Rajaei Cardiovascular, Medical and Research Center, Iran University of Medical Sciences, Vali-Asr Avenue, Niyayesh Blvd, Tehran, Iran.
| |
Collapse
|