1
|
Fok WYR, Fieselmann A, Huemmer C, Biniazan R, Beister M, Geiger B, Kappler S, Saalfeld S. Adversarial robustness improvement for X-ray bone segmentation using synthetic data created from computed tomography scans. Sci Rep 2024; 14:25813. [PMID: 39468116 PMCID: PMC11519576 DOI: 10.1038/s41598-024-73363-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 09/17/2024] [Indexed: 10/30/2024] Open
Abstract
Deep learning-based image analysis offers great potential in clinical practice. However, it faces mainly two challenges: scarcity of large-scale annotated clinical data for training and susceptibility to adversarial data in inference. As an example, an artificial intelligence (AI) system could check patient positioning, by segmenting and evaluating relative positions of anatomical structures in medical images. Nevertheless, data to train such AI system might be highly imbalanced with mostly well-positioned images being available. Thus, we propose the use of synthetic X-ray images and annotation masks forward projected from 3D photon-counting CT volumes to create realistic non-optimally positioned X-ray images for training. An open-source model (TotalSegmentator) was used to annotate the clavicles in 3D CT volumes. We evaluated model robustness with respect to the internal (simulated) patient rotation α on real-data-trained models and real&synthetic-data-trained models. Our results showed that real&synthetic- data-trained models have Dice score percentage improvements of 3% to 15% across different α groups compared to the real-data-trained model. Therefore, we demonstrated that synthetic data could be supplementary used to train and enrich heavily underrepresented conditions to increase model robustness.
Collapse
Affiliation(s)
- Wai Yan Ryana Fok
- Faculty of Computer Science, Otto-von-Guericke-University Magdeburg, 39106, Magdeburg, Germany.
- X-ray Products, Siemens Healthineers AG, 91301, Forchheim, Germany.
| | | | | | - Ramyar Biniazan
- X-ray Products, Siemens Healthineers AG, 91301, Forchheim, Germany
| | - Marcel Beister
- X-ray Products, Siemens Healthineers AG, 91301, Forchheim, Germany
| | - Bernhard Geiger
- X-ray Products, Siemens Healthineers AG, 91301, Forchheim, Germany
| | - Steffen Kappler
- X-ray Products, Siemens Healthineers AG, 91301, Forchheim, Germany
| | - Sylvia Saalfeld
- Faculty of Computer Science, Otto-von-Guericke-University Magdeburg, 39106, Magdeburg, Germany
- Institute for Medical Informatics and Statistics, University Hospital Schleswig-Holstein Campus Kiel, 24105, Kiel, Germany
| |
Collapse
|
2
|
Gong J, Wang Q, Li J, Yang Z, Zhang J, Teng X, Sun H, Cai J, Zhao L. Using high-repeatable radiomic features improves the cross-institutional generalization of prognostic model in esophageal squamous cell cancer receiving definitive chemoradiotherapy. Insights Imaging 2024; 15:239. [PMID: 39373828 PMCID: PMC11458848 DOI: 10.1186/s13244-024-01816-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2024] [Accepted: 09/10/2024] [Indexed: 10/08/2024] Open
Abstract
OBJECTIVES Repeatability is crucial for ensuring the generalizability and clinical utility of radiomics-based prognostic models. This study aims to investigate the repeatability of radiomic feature (RF) and its impact on the cross-institutional generalizability of the prognostic model for predicting local recurrence-free survival (LRFS) and overall survival (OS) in esophageal squamous cell cancer (ESCC) receiving definitive (chemo) radiotherapy (dCRT). METHODS Nine hundred and twelve patients from two hospitals were included as training and external validation sets, respectively. Image perturbations were applied to contrast-enhanced computed tomography to generate perturbed images. Six thousand five hundred ten RFs from different feature types, bin widths, and filters were extracted from the original and perturbed images separately to evaluate RF repeatability by intraclass correlation coefficient (ICC). The high-repeatable and low-repeatable RF groups grouped by the median ICC were further analyzed separately by feature selection and multivariate Cox proportional hazards regression model for predicting LRFS and OS. RESULTS First-order statistical features were more repeatable than texture features (median ICC: 0.70 vs 0.42-0.62). RFs from LoG had better repeatability than that of wavelet (median ICC: 0.70-0.84 vs 0.14-0.64). Features with smaller bin widths had higher repeatability (median ICC of 8-128: 0.65-0.47). For both LRFS and OS, the performance of the models based on high- and low-repeatable RFs remained stable in the training set with similar C-index (LRFS: 0.65 vs 0.67, p = 0.958; OS: 0.64 vs 0.65, p = 0.651), while the performance of the model based on the low-repeatable group was significantly lower than that based on the high-repeatable group in the external validation set (LRFS: 0.61 vs 0.67, p = 0.013; OS: 0.56 vs 0.63, p = 0.013). CONCLUSIONS Applying high-repeatable RFs in modeling could safeguard the cross-institutional generalizability of the prognostic model in ESCC. CRITICAL RELEVANCE STATEMENT The exploration of repeatable RFs in different diseases and different types of imaging is conducive to promoting the proper use of radiomics in clinical research. KEY POINTS The repeatability of RFs impacts the generalizability of the radiomic model. The high-repeatable RFs safeguard the cross-institutional generalizability of the model. Smaller bin width helps improve the repeatability of RFs.
Collapse
Affiliation(s)
- Jie Gong
- Department of Radiation Oncology, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Qifeng Wang
- Department of Radiation Oncology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Jie Li
- Department of Radiation Oncology, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Zhi Yang
- Department of Radiation Oncology, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Hongfei Sun
- Department of Radiation Oncology, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China.
| | - Lina Zhao
- Department of Radiation Oncology, Xijing Hospital, Fourth Military Medical University, Xi'an, China.
| |
Collapse
|
3
|
Teng X, Wang Y, Nicol AJ, Ching JCF, Wong EKY, Lam KTC, Zhang J, Lee SWY, Cai J. Enhancing the Clinical Utility of Radiomics: Addressing the Challenges of Repeatability and Reproducibility in CT and MRI. Diagnostics (Basel) 2024; 14:1835. [PMID: 39202322 PMCID: PMC11353986 DOI: 10.3390/diagnostics14161835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 08/03/2024] [Accepted: 08/16/2024] [Indexed: 09/03/2024] Open
Abstract
Radiomics, which integrates the comprehensive characterization of imaging phenotypes with machine learning algorithms, is increasingly recognized for its potential in the diagnosis and prognosis of oncological conditions. However, the repeatability and reproducibility of radiomic features are critical challenges that hinder their widespread clinical adoption. This review aims to address the paucity of discussion regarding the factors that influence the reproducibility and repeatability of radiomic features and their subsequent impact on the application of radiomic models. We provide a synthesis of the literature on the repeatability and reproducibility of CT/MR-based radiomic features, examining sources of variation, the number of reproducible features, and the availability of individual feature repeatability indices. We differentiate sources of variation into random effects, which are challenging to control but can be quantified through simulation methods such as perturbation, and biases, which arise from scanner variability and inter-reader differences and can significantly affect the generalizability of radiomic model performance in diverse settings. Four suggestions for repeatability and reproducibility studies are suggested: (1) detailed reporting of variation sources, (2) transparent disclosure of calculation parameters, (3) careful selection of suitable reliability indices, and (4) comprehensive reporting of reliability metrics. This review underscores the importance of random effects in feature selection and harmonizing biases between development and clinical application settings to facilitate the successful translation of radiomic models from research to clinical practice.
Collapse
Affiliation(s)
- Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Yongqiang Wang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Alexander James Nicol
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Jerry Chi Fung Ching
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Edwin Ka Yiu Wong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Kenneth Tsz Chun Lam
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Shara Wee-Yee Lee
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
- Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen 518057, China
| |
Collapse
|
4
|
Zhang X, Teng X, Zhang J, Lai Q, Cai J. Enhancing pathological complete response prediction in breast cancer: the role of dynamic characterization of DCE-MRI and its association with tumor heterogeneity. Breast Cancer Res 2024; 26:77. [PMID: 38745321 PMCID: PMC11094888 DOI: 10.1186/s13058-024-01836-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Accepted: 05/07/2024] [Indexed: 05/16/2024] Open
Abstract
BACKGROUND Early prediction of pathological complete response (pCR) is important for deciding appropriate treatment strategies for patients. In this study, we aimed to quantify the dynamic characteristics of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) and investigate its value to improve pCR prediction as well as its association with tumor heterogeneity in breast cancer patients. METHODS The DCE-MRI, clinicopathologic record, and full transcriptomic data of 785 breast cancer patients receiving neoadjuvant chemotherapy were retrospectively included from a public dataset. Dynamic features of DCE-MRI were computed from extracted phase-varying radiomic feature series using 22 CAnonical Time-sereis CHaracteristics. Dynamic model and radiomic model were developed by logistic regression using dynamic features and traditional radiomic features respectively. Various combined models with clinical factors were also developed to find the optimal combination and the significance of each components was evaluated. All the models were evaluated in independent test set in terms of area under receiver operating characteristic curve (AUC). To explore the potential underlying biological mechanisms, radiogenomic analysis was implemented on patient subgroups stratified by dynamic model to identify differentially expressed genes (DEGs) and enriched pathways. RESULTS A 10-feature dynamic model and a 4-feature radiomic model were developed (AUC = 0.688, 95%CI: 0.635-0.741 and AUC = 0.650, 95%CI: 0.595-0.705) and tested (AUC = 0.686, 95%CI: 0.594-0.778 and AUC = 0.626, 95%CI: 0.529-0.722), with the dynamic model showing slightly higher AUC (train p = 0.181, test p = 0.222). The combined model of clinical, radiomic, and dynamic achieved the highest AUC in pCR prediction (train: 0.769, 95%CI: 0.722-0.816 and test: 0.762, 95%CI: 0.679-0.845). Compared with clinical-radiomic combined model (train AUC = 0.716, 95%CI: 0.665-0.767 and test AUC = 0.695, 95%CI: 0.656-0.714), adding the dynamic component brought significant improvement in model performance (train p < 0.001 and test p = 0.005). Radiogenomic analysis identified 297 DEGs, including CXCL9, CCL18, and HLA-DPB1 which are known to be associated with breast cancer prognosis or angiogenesis. Gene set enrichment analysis further revealed enrichment of gene ontology terms and pathways related to immune system. CONCLUSION Dynamic characteristics of DCE-MRI were quantified and used to develop dynamic model for improving pCR prediction in breast cancer patients. The dynamic model was associated with tumor heterogeniety in prognostic-related gene expression and immune-related pathways.
Collapse
Affiliation(s)
- Xinyu Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Qingpei Lai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China.
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, China.
| |
Collapse
|
5
|
Louis T, Lucia F, Cousin F, Mievis C, Jansen N, Duysinx B, Le Pennec R, Visvikis D, Nebbache M, Rehn M, Hamya M, Geier M, Salaun PY, Schick U, Hatt M, Coucke P, Lovinfosse P, Hustinx R. Identification of CT radiomic features robust to acquisition and segmentation variations for improved prediction of radiotherapy-treated lung cancer patient recurrence. Sci Rep 2024; 14:9028. [PMID: 38641673 PMCID: PMC11031577 DOI: 10.1038/s41598-024-58551-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 04/01/2024] [Indexed: 04/21/2024] Open
Abstract
The primary objective of the present study was to identify a subset of radiomic features extracted from primary tumor imaged by computed tomography of early-stage non-small cell lung cancer patients, which remain unaffected by variations in segmentation quality and in computed tomography image acquisition protocol. The robustness of these features to segmentation variations was assessed by analyzing the correlation of feature values extracted from lesion volumes delineated by two annotators. The robustness to variations in acquisition protocol was evaluated by examining the correlation of features extracted from high-dose and low-dose computed tomography scans, both of which were acquired for each patient as part of the stereotactic body radiotherapy planning process. Among 106 radiomic features considered, 21 were identified as robust. An analysis including univariate and multivariate assessments was subsequently conducted to estimate the predictive performance of these robust features on the outcome of early-stage non-small cell lung cancer patients treated with stereotactic body radiation therapy. The univariate predictive analysis revealed that robust features demonstrated superior predictive potential compared to non-robust features. The multivariate analysis indicated that linear regression models built with robust features displayed greater generalization capabilities by outperforming other models in predicting the outcomes of an external validation dataset.
Collapse
Affiliation(s)
- Thomas Louis
- Division of Nuclear Medicine and Oncological Imaging, University Hospital of Liège, Liège, Belgium.
| | - François Lucia
- Division of Nuclear Medicine and Oncological Imaging, University Hospital of Liège, Liège, Belgium.
- Radiation Oncology Department, University Hospital of Brest, Brest, France.
- LaTIM, INSERM, UMR 1101, University of Brest, Brest, France.
| | - François Cousin
- Division of Nuclear Medicine and Oncological Imaging, University Hospital of Liège, Liège, Belgium
| | - Carole Mievis
- Department of Radiotherapy Oncology, University Hospital of Liège, Liège, Belgium
| | - Nicolas Jansen
- Department of Radiotherapy Oncology, University Hospital of Liège, Liège, Belgium
| | - Bernard Duysinx
- Division of Pulmonology, University Hospital of Liège, Liège, Belgium
| | - Romain Le Pennec
- Nuclear Medicine Department, University Hospital of Brest, Brest, France
- GETBO INSERM UMR 1304, University of Brest, UBO, Brest, France
| | | | - Malik Nebbache
- Radiation Oncology Department, University Hospital of Brest, Brest, France
| | - Martin Rehn
- Radiation Oncology Department, University Hospital of Brest, Brest, France
| | - Mohamed Hamya
- Radiation Oncology Department, University Hospital of Brest, Brest, France
| | - Margaux Geier
- Medical Oncology Department, University Hospital of Brest, Brest, France
| | - Pierre-Yves Salaun
- Nuclear Medicine Department, University Hospital of Brest, Brest, France
- GETBO INSERM UMR 1304, University of Brest, UBO, Brest, France
| | - Ulrike Schick
- Radiation Oncology Department, University Hospital of Brest, Brest, France
- LaTIM, INSERM, UMR 1101, University of Brest, Brest, France
| | - Mathieu Hatt
- LaTIM, INSERM, UMR 1101, University of Brest, Brest, France
| | - Philippe Coucke
- Department of Radiotherapy Oncology, University Hospital of Liège, Liège, Belgium
| | - Pierre Lovinfosse
- Division of Nuclear Medicine and Oncological Imaging, University Hospital of Liège, Liège, Belgium
| | - Roland Hustinx
- Division of Nuclear Medicine and Oncological Imaging, University Hospital of Liège, Liège, Belgium
| |
Collapse
|
6
|
Mukherjee S, Korfiatis P, Patnam NG, Trivedi KH, Karbhari A, Suman G, Fletcher JG, Goenka AH. Assessing the robustness of a machine-learning model for early detection of pancreatic adenocarcinoma (PDA): evaluating resilience to variations in image acquisition and radiomics workflow using image perturbation methods. Abdom Radiol (NY) 2024; 49:964-974. [PMID: 38175255 DOI: 10.1007/s00261-023-04127-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 11/08/2023] [Accepted: 11/12/2023] [Indexed: 01/05/2024]
Abstract
PURPOSE To evaluate robustness of a radiomics-based support vector machine (SVM) model for detection of visually occult PDA on pre-diagnostic CTs by simulating common variations in image acquisition and radiomics workflow using image perturbation methods. METHODS Eighteen algorithmically generated-perturbations, which simulated variations in image noise levels (σ, 2σ, 3σ, 5σ), image rotation [both CT image and the corresponding pancreas segmentation mask by 45° and 90° in axial plane], voxel resampling (isotropic and anisotropic), gray-level discretization [bin width (BW) 32 and 64)], and pancreas segmentation (sequential erosions by 3, 4, 6, and 8 pixels and dilations by 3, 4, and 6 pixels from the boundary), were introduced to the original (unperturbed) test subset (n = 128; 45 pre-diagnostic CTs, 83 control CTs with normal pancreas). Radiomic features were extracted from pancreas masks of these additional test subsets, and the model's performance was compared vis-a-vis the unperturbed test subset. RESULTS The model correctly classified 43 out of 45 pre-diagnostic CTs and 75 out of 83 control CTs in the unperturbed test subset, achieving 92.2% accuracy and 0.98 AUC. Model's performance was unaffected by a three-fold increase in noise level except for sensitivity declining to 80% at 3σ (p = 0.02). Performance remained comparable vis-a-vis the unperturbed test subset despite variations in image rotation (p = 0.99), voxel resampling (p = 0.25-0.31), change in gray-level BW to 32 (p = 0.31-0.99), and erosions/dilations up to 4 pixels from the pancreas boundary (p = 0.12-0.34). CONCLUSION The model's high performance for detection of visually occult PDA was robust within a broad range of clinically relevant variations in image acquisition and radiomics workflow.
Collapse
Affiliation(s)
- Sovanlal Mukherjee
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Panagiotis Korfiatis
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Nandakumar G Patnam
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Kamaxi H Trivedi
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Aashna Karbhari
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Garima Suman
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Joel G Fletcher
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA
| | - Ajit H Goenka
- Divisions of Abdominal and Nuclear Imaging, Nuclear Radiology Fellowship, Nuclear Radiology Research Operations, Enterprise PET/MR Research and Development, Department of Radiology, Mayo Clinic, 200 First St SW, Charlton 1, Rochester, MN, 55905, USA.
| |
Collapse
|
7
|
Boubnovski Martell M, Linton-Reid K, Hindocha S, Chen M, Moreno P, Álvarez-Benito M, Salvatierra Á, Lee R, Posma JM, Calzado MA, Aboagye EO. Deep representation learning of tissue metabolome and computed tomography annotates NSCLC classification and prognosis. NPJ Precis Oncol 2024; 8:28. [PMID: 38310164 PMCID: PMC10838282 DOI: 10.1038/s41698-024-00502-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 01/04/2024] [Indexed: 02/05/2024] Open
Abstract
The rich chemical information from tissue metabolomics provides a powerful means to elaborate tissue physiology or tumor characteristics at cellular and tumor microenvironment levels. However, the process of obtaining such information requires invasive biopsies, is costly, and can delay clinical patient management. Conversely, computed tomography (CT) is a clinical standard of care but does not intuitively harbor histological or prognostic information. Furthermore, the ability to embed metabolome information into CT to subsequently use the learned representation for classification or prognosis has yet to be described. This study develops a deep learning-based framework -- tissue-metabolomic-radiomic-CT (TMR-CT) by combining 48 paired CT images and tumor/normal tissue metabolite intensities to generate ten image embeddings to infer metabolite-derived representation from CT alone. In clinical NSCLC settings, we ascertain whether TMR-CT results in an enhanced feature generation model solving histology classification/prognosis tasks in an unseen international CT dataset of 742 patients. TMR-CT non-invasively determines histological classes - adenocarcinoma/squamous cell carcinoma with an F1-score = 0.78 and further asserts patients' prognosis with a c-index = 0.72, surpassing the performance of radiomics models and deep learning on single modality CT feature extraction. Additionally, our work shows the potential to generate informative biology-inspired CT-led features to explore connections between hard-to-obtain tissue metabolic profiles and routine lesion-derived image data.
Collapse
Affiliation(s)
| | | | - Sumeet Hindocha
- Early Diagnosis and Detection Centre, National Institute for Health and Care Research Biomedical Research Centre at the Royal Marsden and Institute of Cancer Research, London, SW3 6JJ, UK
| | - Mitchell Chen
- Imperial College London Hammersmith Campus, London, SW7 2AZ, UK
| | - Paula Moreno
- Instituto Maimónides de Investigación Biomédica de Córdoba (IMIBIC), Córdoba, 14004, Spain
- Departamento de Cirugía Toráxica y Trasplante de Pulmón, Hospital Universitario Reina Sofía, Córdoba, 14014, Spain
| | - Marina Álvarez-Benito
- Instituto Maimónides de Investigación Biomédica de Córdoba (IMIBIC), Córdoba, 14004, Spain
- Unidad de Radiodiagnóstico y Cáncer de Mama, Hospital Universitario Reina Sofía, Córdoba, 14004, Spain
| | - Ángel Salvatierra
- Instituto Maimónides de Investigación Biomédica de Córdoba (IMIBIC), Córdoba, 14004, Spain
- Unidad de Radiodiagnóstico y Cáncer de Mama, Hospital Universitario Reina Sofía, Córdoba, 14004, Spain
| | - Richard Lee
- Early Diagnosis and Detection Centre, National Institute for Health and Care Research Biomedical Research Centre at the Royal Marsden and Institute of Cancer Research, London, SW3 6JJ, UK
- National Heart and Lung Institute, Imperial College London, Guy Scadding Building, Dovehouse Street, London, SW3 6LY, UK
| | - Joram M Posma
- Imperial College London Hammersmith Campus, London, SW7 2AZ, UK
| | - Marco A Calzado
- Instituto Maimónides de Investigación Biomédica de Córdoba (IMIBIC), Córdoba, 14004, Spain.
- Departamento de Biología Celular, Fisiología e Inmunología, Universidad de Córdoba, Córdoba, 14014, Spain.
| | - Eric O Aboagye
- Imperial College London Hammersmith Campus, London, SW7 2AZ, UK.
| |
Collapse
|
8
|
Guo W, Li B, Xu W, Cheng C, Qiu C, Sam SK, Zhang J, Teng X, Meng L, Zheng X, Wang Y, Lou Z, Mao R, Lei H, Zhang Y, Zhou T, Li A, Cai J, Ge H. Multi-omics and Multi-VOIs to predict esophageal fistula in esophageal cancer patients treated with radiotherapy. J Cancer Res Clin Oncol 2024; 150:39. [PMID: 38280037 PMCID: PMC10821966 DOI: 10.1007/s00432-023-05520-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 11/20/2023] [Indexed: 01/29/2024]
Abstract
OBJECTIVE This study aimed to develop a prediction model for esophageal fistula (EF) in esophageal cancer (EC) patients treated with intensity-modulated radiation therapy (IMRT), by integrating multi-omics features from multiple volumes of interest (VOIs). METHODS We retrospectively analyzed pretreatment planning computed tomographic (CT) images, three-dimensional dose distributions, and clinical factors of 287 EC patients. Nine groups of features from different combination of omics [Radiomics (R), Dosiomics (D), and RD (the combination of R and D)], and VOIs [esophagus (ESO), gross tumor volume (GTV), and EG (the combination of ESO and GTV)] were extracted and separately selected by unsupervised (analysis of variance (ANOVA) and Pearson correlation test) and supervised (Student T test) approaches. The final model performance was evaluated using five metrics: average area under the receiver-operator-characteristics curve (AUC), accuracy, precision, recall, and F1 score. RESULTS For multi-omics using RD features, the model performance in EG model shows: AUC, 0.817 ± 0.031; 95% CI 0.805, 0.825; p < 0.001, which is better than single VOI (ESO or GTV). CONCLUSION Integrating multi-omics features from multi-VOIs enables better prediction of EF in EC patients treated with IMRT. The incorporation of dosiomics features can enhance the model performance of the prediction.
Collapse
Affiliation(s)
- Wei Guo
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Bing Li
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Wencai Xu
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Chen Cheng
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Chengyu Qiu
- Department of Medical Informatics, Nantong University, Nantong, China
| | - Sai-Kit Sam
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Lingguang Meng
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Xiaoli Zheng
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Yuan Wang
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Zhaoyang Lou
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Ronghu Mao
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Hongchang Lei
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China
| | - Yuanpeng Zhang
- Department of Medical Informatics, Nantong University, Nantong, China
| | - Ta Zhou
- School of Electrical and Information Engineering, Jiangsu University of Science and Technology, Zhenjiang, China
| | - Aijia Li
- Zhengzhou University School of Medicine, Zhengzhou, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Hong Ge
- Department of Radiation Oncology, The Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, 127 Dong Ming Rd, Zhengzhou, Henan Province, China.
| |
Collapse
|
9
|
Wang H, He L, Chen X, Ding S, Xie M, Cai J. Predicting Bone Marrow Metastasis in Neuroblastoma: An Explainable Machine Learning Approach Using Contrast-Enhanced Computed Tomography Radiomics Features. Technol Cancer Res Treat 2024; 23:15330338241290386. [PMID: 39440370 PMCID: PMC11500234 DOI: 10.1177/15330338241290386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2024] [Revised: 09/08/2024] [Accepted: 09/13/2024] [Indexed: 10/25/2024] Open
Abstract
PURPOSE To predict bone marrow metastasis in neuroblastoma using contrast-enhanced computed tomography (CECT) radiomics features and explainable machine learning. METHODS This cohort study retrospectively included a total of 345 neuroblastoma patients who underwent testing for bone marrow metastatic status. Tumor lesions on CECT images were delineated by two radiologists, and 1409 radiomics features were extracted. Correlation analysis, Least Absolute Shrinkage and Selection Operator regression, and one-way analysis of variance were used to identify radiomics features associated with bone marrow metastasis. A predictive model for bone marrow metastasis was then developed using the support vector machine algorithm based on the selected radiomics features. The performance of the radiomics model was evaluated using the area under the curve (AUC), 95% confidence interval (CI), accuracy, sensitivity, and specificity. RESULTS The radiomics model included 16 features, with a predominant focus on texture features (12/16, 75%). In the training set, the model demonstrated an AUC of 0.891 (95% CI: 0.848-0.933), an accuracy of 0.831 (95% CI: 0.829-0.832), a sensitivity of 0.893 (95% CI: 0.840-0.946), and a specificity of 0.757 (95% CI: 0.677-0.837). In the test set, the AUC, accuracy, sensitivity, and specificity were 0.807 (95% CI: 0.720-0.893), 0.767 (95% CI: 0.764-0.770), 0.696 (95% CI: 0.576-0.817), and 0.851 (95% CI: 0.749-0.953), respectively. CONCLUSION Radiomics features extracted from CECT images are associated with the presence of bone marrow metastasis in neuroblastoma, providing potential new imaging biomarkers for predicting bone marrow metastasis in this disease.
Collapse
Affiliation(s)
- Haoru Wang
- Department of Radiology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, No. 136 Zhongshan Road 2, Yuzhong District, Chongqing 400014, China
| | - Ling He
- Department of Radiology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, No. 136 Zhongshan Road 2, Yuzhong District, Chongqing 400014, China
| | - Xin Chen
- Department of Radiology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, No. 136 Zhongshan Road 2, Yuzhong District, Chongqing 400014, China
| | - Shuang Ding
- Department of Radiology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, No. 136 Zhongshan Road 2, Yuzhong District, Chongqing 400014, China
| | - Mingye Xie
- Department of Radiology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, No. 136 Zhongshan Road 2, Yuzhong District, Chongqing 400014, China
| | - Jinhua Cai
- Department of Radiology, Children's Hospital of Chongqing Medical University, National Clinical Research Center for Child Health and Disorders, Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, No. 136 Zhongshan Road 2, Yuzhong District, Chongqing 400014, China
| |
Collapse
|
10
|
Sheng J, Lam S, Zhang J, Zhang Y, Cai J. Multi-omics fusion with soft labeling for enhanced prediction of distant metastasis in nasopharyngeal carcinoma patients after radiotherapy. Comput Biol Med 2024; 168:107684. [PMID: 38039891 DOI: 10.1016/j.compbiomed.2023.107684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 10/06/2023] [Accepted: 11/06/2023] [Indexed: 12/03/2023]
Abstract
Omics fusion has emerged as a crucial preprocessing approach in medical image processing, significantly assisting several studies. One of the challenges encountered in integrating omics data is the unpredictability arising from disparities in data sources and medical imaging equipment. Due to these differences, the distribution of omics futures exhibits spatial heterogeneity, diminishing their capacity to enhance subsequent tasks. To overcome this challenge and facilitate the integration of their joint application to specific medical objectives, this study aims to develop a fusion methodology for nasopharyngeal carcinoma (NPC) distant metastasis prediction to mitigate the disparities inherent in omics data. The multi-kernel late-fusion method can reduce the impact of these differences by mapping the features using the most suiTable single-kernel function and then combining them in a high-dimensional space that can effectively represent the data. The proposed approach in this study employs a distinctive framework incorporating a label-softening technique alongside a multi-kernel-based Radial basis function (RBF) neural network to address these limitations. An efficient representation of the data may be achieved by utilizing the multi-kernel to map the inherent features and then merging them in a space with many dimensions. However, the inflexibility of label fitting poses a constraint on using multi-kernel late-fusion methods in complex NPC datasets, hence affecting the efficacy of general classifiers in dealing with high-dimensional characteristics. The label softening increases the disparity between the two cohorts, providing a more flexible structure for allocating labels. The proposed model is evaluated on multi-omics datasets, and the results demonstrate its strength and effectiveness in predicting distant metastasis of NPC patients.
Collapse
Affiliation(s)
- Jiabao Sheng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China; Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China.
| | - SaiKit Lam
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China; Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China.
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China.
| | - Yuanpeng Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China; The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, China.
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China; Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China; The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, China.
| |
Collapse
|
11
|
Teng X, Zhang J, Zhang X, Fan X, Zhou T, Huang YH, Wang L, Lee EYP, Yang R, Cai J. Noninvasive imaging signatures of HER2 and HR using ADC in invasive breast cancer: repeatability, reproducibility, and association with pathological complete response to neoadjuvant chemotherapy. Breast Cancer Res 2023; 25:77. [PMID: 37381020 DOI: 10.1186/s13058-023-01674-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 06/13/2023] [Indexed: 06/30/2023] Open
Abstract
BACKGROUND The immunohistochemical test (IHC) of HER2 and HR can provide prognostic information and treatment guidance for invasive breast cancer patients. We aimed to develop noninvasive image signatures ISHER2 and ISHR of HER2 and HR, respectively. We independently evaluate their repeatability, reproducibility, and association with pathological complete response (pCR) to neoadjuvant chemotherapy. METHODS Pre-treatment DWI, IHC receptor status HER2/HR, and pCR to neoadjuvant chemotherapy of 222 patients from the multi-institutional ACRIN 6698 trial were retrospectively collected. They were pre-separated for development, independent validation, and test-retest. 1316 image features were extracted from DWI-derived ADC maps within manual tumor segmentations. ISHER2 and ISHR were developed by RIDGE logistic regression using non-redundant and test-retest reproducible features relevant to IHC receptor status. We evaluated their association with pCR using area under receiver operating curve (AUC) and odds ratio (OR) after binarization. Their reproducibility was further evaluated using the test-retest set with intra-class coefficient of correlation (ICC). RESULTS A 5-feature ISHER2 targeting HER2 was developed (AUC = 0.70, 95% CI 0.59 to 0.82) and validated (AUC = 0.72, 95% CI 0.58 to 0.86) with high perturbation repeatability (ICC = 0.92) and test-retest reproducibility (ICC = 0.83). ISHR was developed using 5 features with higher association with HR during development (AUC = 0.75, 95% CI 0.66 to 0.84) and validation (AUC = 0.74, 95% CI 0.61 to 0.86) and similar repeatability (ICC = 0.91) and reproducibility (ICC = 0.82). Both image signatures showed significant associations with pCR with AUC of 0.65 (95% CI 0.50 to 0.80) for ISHER2 and 0.64 (95% CI 0.50 to 0.78) for ISHER2 in the validation cohort. Patients with high ISHER2 were more likely to achieve pCR to neoadjuvant chemotherapy with validation OR of 4.73 (95% CI 1.64 to 13.65, P value = 0.006). Low ISHR patients had higher pCR with OR = 0.29 (95% CI 0.10 to 0.81, P value = 0.021). Molecular subtypes derived from the image signatures showed comparable pCR prediction values to IHC-based molecular subtypes (P value > 0.05). CONCLUSION Robust ADC-based image signatures were developed and validated for noninvasive evaluation of IHC receptors HER2 and HR. We also confirmed their value in predicting treatment response to neoadjuvant chemotherapy. Further evaluations in treatment guidance are warranted to fully validate their potential as IHC surrogates.
Collapse
Affiliation(s)
- Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Xinyu Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Xinyu Fan
- Department of Applied Mathematics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Ta Zhou
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Yu-Hua Huang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Lu Wang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Elaine Yuen Phin Lee
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Y920, Lee Shau Kee Building, Hong Kong, China
| | - Ruijie Yang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China.
- The Hong Kong Polytechnic University Shenzhen Research Institute, Hong Kong, China.
- Research Institute for Smart Aging, The Hong Kong Polytechnic University, Hong Kong, China.
| |
Collapse
|
12
|
Zhang YP, Zhang XY, Cheng YT, Li B, Teng XZ, Zhang J, Lam S, Zhou T, Ma ZR, Sheng JB, Tam VCW, Lee SWY, Ge H, Cai J. Artificial intelligence-driven radiomics study in cancer: the role of feature engineering and modeling. Mil Med Res 2023; 10:22. [PMID: 37189155 DOI: 10.1186/s40779-023-00458-8] [Citation(s) in RCA: 22] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 05/04/2023] [Indexed: 05/17/2023] Open
Abstract
Modern medicine is reliant on various medical imaging technologies for non-invasively observing patients' anatomy. However, the interpretation of medical images can be highly subjective and dependent on the expertise of clinicians. Moreover, some potentially useful quantitative information in medical images, especially that which is not visible to the naked eye, is often ignored during clinical practice. In contrast, radiomics performs high-throughput feature extraction from medical images, which enables quantitative analysis of medical images and prediction of various clinical endpoints. Studies have reported that radiomics exhibits promising performance in diagnosis and predicting treatment responses and prognosis, demonstrating its potential to be a non-invasive auxiliary tool for personalized medicine. However, radiomics remains in a developmental phase as numerous technical challenges have yet to be solved, especially in feature engineering and statistical modeling. In this review, we introduce the current utility of radiomics by summarizing research on its application in the diagnosis, prognosis, and prediction of treatment responses in patients with cancer. We focus on machine learning approaches, for feature extraction and selection during feature engineering and for imbalanced datasets and multi-modality fusion during statistical modeling. Furthermore, we introduce the stability, reproducibility, and interpretability of features, and the generalizability and interpretability of models. Finally, we offer possible solutions to current challenges in radiomics research.
Collapse
Affiliation(s)
- Yuan-Peng Zhang
- Department of Medical Informatics, Nantong University, Nantong, 226001, Jiangsu, China
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, 518000, Guangdong, China
| | - Xin-Yun Zhang
- Department of Medical Informatics, Nantong University, Nantong, 226001, Jiangsu, China
| | - Yu-Ting Cheng
- Department of Medical Informatics, Nantong University, Nantong, 226001, Jiangsu, China
| | - Bing Li
- Department of Radiation Oncology, the Affiliated Cancer Hospital of Zhengzhou University and Henan Cancer Hospital, Zhengzhou, 450008, Henan, China
| | - Xin-Zhi Teng
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Saikit Lam
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Ta Zhou
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Zong-Rui Ma
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Jia-Bao Sheng
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Victor C W Tam
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Shara W Y Lee
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China
| | - Hong Ge
- Department of Radiation Oncology, the Affiliated Cancer Hospital of Zhengzhou University and Henan Cancer Hospital, Zhengzhou, 450008, Henan, China
| | - Jing Cai
- Department of Health Technology and Informatics, the Hong Kong Polytechnic University, Hong Kong, 999077, China.
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen, 518000, Guangdong, China.
| |
Collapse
|
13
|
Dong Y, Zhang J, Lam S, Zhang X, Liu A, Teng X, Han X, Cao J, Li H, Lee FK, Yip CW, Au K, Zhang Y, Cai J. Multimodal Data Integration to Predict Severe Acute Oral Mucositis of Nasopharyngeal Carcinoma Patients Following Radiation Therapy. Cancers (Basel) 2023; 15:cancers15072032. [PMID: 37046693 PMCID: PMC10093711 DOI: 10.3390/cancers15072032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 03/21/2023] [Accepted: 03/26/2023] [Indexed: 04/14/2023] Open
Abstract
(1) Background: Acute oral mucositis is the most common side effect for nasopharyngeal carcinoma patients receiving radiotherapy. Improper or delayed intervention to severe AOM could degrade the quality of life or survival for NPC patients. An effective prediction method for severe AOM is needed for the individualized management of NPC patients in the era of personalized medicine. (2) Methods: A total of 242 biopsy-proven NPC patients were retrospectively recruited in this study. Radiomics features were extracted from contrast-enhanced CT (CECT), contrast-enhanced T1-weighted (cT1WI), and T2-weighted (T2WI) images in the primary tumor and tumor-related area. Dosiomics features were extracted from 2D or 3D dose-volume histograms (DVH). Multiple models were established with single and integrated data. The dataset was randomized into training and test sets at a ratio of 7:3 with 10-fold cross-validation. (3) Results: The best-performing model using Gaussian Naive Bayes (GNB) (mean validation AUC = 0.81 ± 0.10) was established with integrated radiomics and dosiomics data. The GNB radiomics and dosiomics models yielded mean validation AUC of 0.6 ± 0.20 and 0.69 ± 0.14, respectively. (4) Conclusions: Integrating radiomics and dosiomics data from the primary tumor area could generate the best-performing model for severe AOM prediction.
Collapse
Affiliation(s)
- Yanjing Dong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Saikt Lam
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Xinyu Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Anran Liu
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Xinyang Han
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Jin Cao
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Hongxiang Li
- Department of Radiology, Fujian Medical University Union Hospital, Fujian Medical University, Fuzhou 350000, China
| | - Francis Karho Lee
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong SAR, China
| | - Celia Waiyi Yip
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong SAR, China
| | - Kwokhung Au
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong SAR, China
| | - Yuanpeng Zhang
- Department of Medical Informatics, Nantong University, Nantong 226000, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China
- The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen 518000, China
| |
Collapse
|
14
|
Zhang J, Lam SK, Teng X, Ma Z, Han X, Zhang Y, Cheung ALY, Chau TC, Ng SCY, Lee FKH, Au KH, Yip CWY, Lee VHF, Han Y, Cai J. Radiomic feature repeatability and its impact on prognostic model generalizability: A multi-institutional study on nasopharyngeal carcinoma patients. Radiother Oncol 2023; 183:109578. [PMID: 36822357 DOI: 10.1016/j.radonc.2023.109578] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 02/09/2023] [Accepted: 02/17/2023] [Indexed: 02/23/2023]
Abstract
BACKGROUND AND PURPOSE To investigate the radiomic feature (RF) repeatability via perturbation and its impact on cross-institutional prognostic model generalizability in Nasopharyngeal Carcinoma (NPC) patients. MATERIALS AND METHODS 286 and 183 NPC patients from two institutions were included for model training and validation. Perturbations with random translations and rotations were applied to contrast-enhanced T1-weighted (CET1-w) MR images. RFs were extracted from primary tumor volume under a wide range of image filtering and discretization settings. RF repeatability was assessed by intraclass correlation coefficient (ICC), which was used to equally separate the RFs into low- and high-repeatable groups by the median value. After feature selection, multivariate Cox regression and Kaplan-Meier analysis were independently employed to develop and analyze prognostic models. Concordance index (C-index) and P-value from log-rank test were used to assess model performance. RESULTS Most textural RFs from high-pass wavelet-filtered images were susceptible to image perturbations. It was more prominent when a smaller discretization bin number was used (e.g., 8, mean ICC = 0.69). Using high-repeatable RFs for model development yielded a significantly higher C-index (0.63) in the validation cohort than when only low-repeatable RFs were used (0.57, P = 0.024), suggesting higher model generalizability. Besides, significant risk stratification in the validation cohort was observed only when high-repeatable RFs were used (P < 0.001). CONCLUSION Repeatability of RFs from high-pass wavelet-filtered CET1-w MR images of primary NPC tumor was poor, particularly when a smaller bin number was used. Exclusive use of high-repeatable RFs is suggested to safeguard model generalizability for wide-spreading clinical utilization.
Collapse
Affiliation(s)
- Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Sai-Kit Lam
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China; Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| | - Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Zongrui Ma
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Xinyang Han
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China
| | - Yuanpeng Zhang
- Department of Medical Informatics, Nantong University, Nantong, Jiangsu, China
| | - Andy Lai-Yin Cheung
- Department of Clinical Oncology, The University of Hong Kong, Hong Kong, China
| | - Tin-Ching Chau
- Department of Clinical Oncology, Queen Mary Hospital, Hong Kong, China
| | - Sherry Chor-Yi Ng
- Department of Clinical Oncology, Queen Mary Hospital, Hong Kong, China
| | - Francis Kar-Ho Lee
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong, China
| | - Kwok-Hung Au
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong, China
| | - Celia Wai-Yi Yip
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong, China
| | - Victor Ho-Fun Lee
- Department of Clinical Oncology, The University of Hong Kong, Hong Kong, China
| | - Ying Han
- Department of Clinical Oncology, The University of Hong Kong-Shenzhen Hospital, Shenzhen, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China; Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China.
| |
Collapse
|
15
|
Association of Multi-Phasic MR-Based Radiomic and Dosimetric Features with Treatment Response in Unresectable Hepatocellular Carcinoma Patients following Novel Sequential TACE-SBRT-Immunotherapy. Cancers (Basel) 2023; 15:cancers15041105. [PMID: 36831445 PMCID: PMC9954441 DOI: 10.3390/cancers15041105] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 01/27/2023] [Accepted: 02/07/2023] [Indexed: 02/11/2023] Open
Abstract
This study aims to investigate the association of pre-treatment multi-phasic MR-based radiomics and dosimetric features with treatment response to a novel sequential trans-arterial chemoembolization (TACE) plus stereotactic body radiotherapy (SBRT) plus immunotherapy regimen in unresectable Hepatocellular Carcinoma (HCC) sub-population. Twenty-six patients with unresectable HCC were retrospectively analyzed. Radiomic features were extracted from 42 lesions on arterial phase (AP) and portal-venous phase (PVP) MR images. Delta-phase (DeltaP) radiomic features were calculated as AP-to-PVP ratio. Dosimetric data of the tumor was extracted from dose-volume-histograms. A two-sided independent Mann-Whitney U test was used to assess the clinical association of each feature, and the classification performance of each significant independent feature was assessed using logistic regression. For the 3-month timepoint, four DeltaP-derived radiomics that characterize the temporal change in intratumoral randomness and uniformity were the only contributors to the treatment response association (p-value = 0.038-0.063, AUC = 0.690-0.766). For the 6-month timepoint, DeltaP-derived radiomic features (n = 4) maintained strong clinical associations with the treatment response (p-value = 0.047-0.070, AUC = 0.699-0.788), additional AP-derived radiomic features (n = 4) that reflect baseline tumoral arterial-enhanced signal pattern and tumor morphology (n = 1) that denotes initial tumor burden were shown to have strong associations with treatment response (p-value = 0.028-0.074, AUC = 0.719-0.773). This pilot study successfully demonstrated associations of pre-treatment multi-phasic MR-based radiomics with tumor response to the novel treatment regimen.
Collapse
|
16
|
Irmici G, Cè M, Caloro E, Khenkina N, Della Pepa G, Ascenti V, Martinenghi C, Papa S, Oliva G, Cellina M. Chest X-ray in Emergency Radiology: What Artificial Intelligence Applications Are Available? Diagnostics (Basel) 2023; 13:diagnostics13020216. [PMID: 36673027 PMCID: PMC9858224 DOI: 10.3390/diagnostics13020216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 12/28/2022] [Accepted: 01/03/2023] [Indexed: 01/11/2023] Open
Abstract
Due to its widespread availability, low cost, feasibility at the patient's bedside and accessibility even in low-resource settings, chest X-ray is one of the most requested examinations in radiology departments. Whilst it provides essential information on thoracic pathology, it can be difficult to interpret and is prone to diagnostic errors, particularly in the emergency setting. The increasing availability of large chest X-ray datasets has allowed the development of reliable Artificial Intelligence (AI) tools to help radiologists in everyday clinical practice. AI integration into the diagnostic workflow would benefit patients, radiologists, and healthcare systems in terms of improved and standardized reporting accuracy, quicker diagnosis, more efficient management, and appropriateness of the therapy. This review article aims to provide an overview of the applications of AI for chest X-rays in the emergency setting, emphasizing the detection and evaluation of pneumothorax, pneumonia, heart failure, and pleural effusion.
Collapse
Affiliation(s)
- Giovanni Irmici
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Maurizio Cè
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Elena Caloro
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Natallia Khenkina
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Gianmarco Della Pepa
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Velio Ascenti
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Carlo Martinenghi
- Radiology Department, San Raffaele Hospital, Via Olgettina 60, 20132 Milan, Italy
| | - Sergio Papa
- Unit of Diagnostic Imaging and Stereotactic Radiosurgery, Centro Diagnostico Italiano, Via Saint Bon 20, 20147 Milan, Italy
| | - Giancarlo Oliva
- Radiology Department, Fatebenefratelli Hospital, ASST Fatebenefratelli Sacco, Milano, Piazza Principessa Clotilde 3, 20121 Milan, Italy
| | - Michaela Cellina
- Radiology Department, Fatebenefratelli Hospital, ASST Fatebenefratelli Sacco, Milano, Piazza Principessa Clotilde 3, 20121 Milan, Italy
| |
Collapse
|