1
|
Li J, Liao L, Jia M, Chen Z, Liu X. Latent relation shared learning for endometrial cancer diagnosis with incomplete multi-modality medical images. iScience 2024; 27:110509. [PMID: 39161958 PMCID: PMC11332793 DOI: 10.1016/j.isci.2024.110509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Revised: 05/22/2024] [Accepted: 07/11/2024] [Indexed: 08/21/2024] Open
Abstract
Magnetic resonance imaging (MRI), ultrasound (US), and contrast-enhanced ultrasound (CEUS) can provide different image data about uterus, which have been used in the preoperative assessment of endometrial cancer. In practice, not all the patients have complete multi-modality medical images due to the high cost or long examination period. Most of the existing methods need to perform data cleansing or discard samples with missing modalities, which will influence the performance of the model. In this work, we propose an incomplete multi-modality images data fusion method based on latent relation shared to overcome this limitation. The shared space contains the common latent feature representation and modality-specific latent feature representation from the complete and incomplete multi-modality data, which jointly exploits both consistent and complementary information among multiple images. The experimental results show that our method outperforms the current representative approaches in terms of classification accuracy, sensitivity, specificity, and area under curve (AUC). Furthermore, our method performs well under varying imaging missing rates.
Collapse
Affiliation(s)
- Jiaqi Li
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
- Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, Beijing 100081, China
| | - Lejian Liao
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
- Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, Beijing 100081, China
| | - Meihuizi Jia
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
- Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, Beijing 100081, China
| | - Zhendong Chen
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China
- Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, Beijing 100081, China
| | - Xin Liu
- Department of Ultrasound, Beijing Tiantan Hospital, Capital Medical University, Beijing 100070, China
| |
Collapse
|
2
|
Shimozono T, Shiiba T, Takano K. Radiomics score derived from T1-w/T2-w ratio image can predict motor symptom progression in Parkinson's disease. Eur Radiol 2024:10.1007/s00330-024-10886-2. [PMID: 38958697 DOI: 10.1007/s00330-024-10886-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 04/08/2024] [Accepted: 04/26/2024] [Indexed: 07/04/2024]
Abstract
OBJECTIVES To clarify the association between a radiomics score (Rad-score) derived from T1-weighted signal intensity to T2-weighted signal intensity (T1-w/T2-w) ratio images and the progression of motor symptoms in Parkinson's disease (PD). MATERIALS AND METHODS This retrospective study included patients with PD enrolled in the Parkinson's Progression Markers Initiative. The Movement Disorders Society-Unified Parkinson's Disease Rating Scale Part III score ≥ 33 and/or Hoehn and Yahr stage ≥ 3 indicated motor function decline. The Rad-score was constructed using radiomics features extracted from T1-w/T2-w ratio images. The Kaplan-Meier analysis and Cox regression analyses were used to assess the time differences in motor function decline between the high and low Rad-score groups. RESULTS A total of 171 patients with PD were divided into training (n = 101, mean age at baseline, 61.6 ± 9.3 years) and testing (n = 70, mean age at baseline, 61.6 ± 10 years). The patients in the high Rad-score group had a shorter time to motor function decline than those in the low Rad-score group in the training dataset (log-rank test, p < 0.001) and testing dataset (log-rank test, p < 0.001). The multivariate Cox regression using the Rad-score and clinical factors revealed a significant association between the Rad-score and motor function decline in the training dataset (HR = 2.368, 95%CI:1.423-3.943, p < 0.001) and testing dataset (HR = 2.931, 95%CI:1.472-5.837, p = 0.002). CONCLUSION Rad-scores based on radiomics features derived from T1-w/T2-w ratio images were associated with the progression of motor symptoms in PD. CLINICAL RELEVANCE STATEMENT The radiomics score derived from the T1-weighted/T2-weighted ratio images offers a predictive tool for assessing the progression of motor symptom in patients with PD. KEY POINTS Radiomics score derived from T1-weighted/T2-weighted ratio images is correlated with the motor symptoms of Parkinson's disease. A high radiomics score correlated with faster motor function decline in patients with Parkinson's disease. The proposed radiomics score offers predictive insight into the progression of motor symptoms of Parkinson's disease.
Collapse
Affiliation(s)
- Takuya Shimozono
- Department of Neuroimaging and Brain Science, Major in Health Science, Graduate School of Health Sciences, Fujita Health University, 1-98, Dengakugakubo, Kutsukake-cho, Toyoake, Aichi, 470-1192, Japan
| | - Takuro Shiiba
- Department of Molecular Imaging, Clinical Collaboration Unit, School of Medical Sciences, Fujita Health University, 1-98, Dengakugakubo, Kutsukake-cho, Toyoake, Aichi, 470-1192, Japan.
| | - Kazuki Takano
- Department of Molecular Imaging, Clinical Collaboration Unit, School of Medical Sciences, Fujita Health University, 1-98, Dengakugakubo, Kutsukake-cho, Toyoake, Aichi, 470-1192, Japan
| |
Collapse
|
3
|
Shiri I, Amini M, Yousefirizi F, Vafaei Sadr A, Hajianfar G, Salimi Y, Mansouri Z, Jenabi E, Maghsudi M, Mainta I, Becker M, Rahmim A, Zaidi H. Information fusion for fully automated segmentation of head and neck tumors from PET and CT images. Med Phys 2024; 51:319-333. [PMID: 37475591 DOI: 10.1002/mp.16615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Revised: 05/16/2023] [Accepted: 06/19/2023] [Indexed: 07/22/2023] Open
Abstract
BACKGROUND PET/CT images combining anatomic and metabolic data provide complementary information that can improve clinical task performance. PET image segmentation algorithms exploiting the multi-modal information available are still lacking. PURPOSE Our study aimed to assess the performance of PET and CT image fusion for gross tumor volume (GTV) segmentations of head and neck cancers (HNCs) utilizing conventional, deep learning (DL), and output-level voting-based fusions. METHODS The current study is based on a total of 328 histologically confirmed HNCs from six different centers. The images were automatically cropped to a 200 × 200 head and neck region box, and CT and PET images were normalized for further processing. Eighteen conventional image-level fusions were implemented. In addition, a modified U2-Net architecture as DL fusion model baseline was used. Three different input, layer, and decision-level information fusions were used. Simultaneous truth and performance level estimation (STAPLE) and majority voting to merge different segmentation outputs (from PET and image-level and network-level fusions), that is, output-level information fusion (voting-based fusions) were employed. Different networks were trained in a 2D manner with a batch size of 64. Twenty percent of the dataset with stratification concerning the centers (20% in each center) were used for final result reporting. Different standard segmentation metrics and conventional PET metrics, such as SUV, were calculated. RESULTS In single modalities, PET had a reasonable performance with a Dice score of 0.77 ± 0.09, while CT did not perform acceptably and reached a Dice score of only 0.38 ± 0.22. Conventional fusion algorithms obtained a Dice score range of [0.76-0.81] with guided-filter-based context enhancement (GFCE) at the low-end, and anisotropic diffusion and Karhunen-Loeve transform fusion (ADF), multi-resolution singular value decomposition (MSVD), and multi-level image decomposition based on latent low-rank representation (MDLatLRR) at the high-end. All DL fusion models achieved Dice scores of 0.80. Output-level voting-based models outperformed all other models, achieving superior results with a Dice score of 0.84 for Majority_ImgFus, Majority_All, and Majority_Fast. A mean error of almost zero was achieved for all fusions using SUVpeak , SUVmean and SUVmedian . CONCLUSION PET/CT information fusion adds significant value to segmentation tasks, considerably outperforming PET-only and CT-only methods. In addition, both conventional image-level and DL fusions achieve competitive results. Meanwhile, output-level voting-based fusion using majority voting of several algorithms results in statistically significant improvements in the segmentation of HNC.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Mehdi Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Fereshteh Yousefirizi
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, British Columbia, Canada
| | - Alireza Vafaei Sadr
- Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany
- Department of Public Health Sciences, College of Medicine, The Pennsylvania State University, Hershey, USA
| | - Ghasem Hajianfar
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Zahra Mansouri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Elnaz Jenabi
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Mehdi Maghsudi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Ismini Mainta
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Minerva Becker
- Service of Radiology, Geneva University Hospital, Geneva, Switzerland
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, British Columbia, Canada
- Department of Radiology and Physics, University of British Columbia, Vancouver, Canada
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
- Geneva University Neurocenter, Geneva University, Geneva, Switzerland
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
4
|
Gu J, Bao S, Akemuhan R, Jia Z, Zhang Y, Huang C. Radiomics Based on Contrast-Enhanced CT for Recognizing c-Met-Positive Hepatocellular Carcinoma: a Noninvasive Approach to Predict the Outcome of Sorafenib Resistance. Mol Imaging Biol 2023; 25:1073-1083. [PMID: 37932610 DOI: 10.1007/s11307-023-01870-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 10/16/2023] [Accepted: 10/23/2023] [Indexed: 11/08/2023]
Abstract
OBJECTIVES The purpose of our project was to investigate the effectiveness of radiomic features based on contrast-enhanced computed tomography (CT) that can detect the expression of c-Met in hepatocellular carcinoma (HCC) and to validate its efficacy in predicting the outcome of sorafenib resistance. MATERIALS AND METHODS In total, 130 patients (median age, 60 years) with pathologically confirmed HCC who underwent contrast material-enhanced CT from October 2012 to July 2020 were randomly divided into a training set (n = 91) and a test set (n = 39). Radiomic features were extracted from arterial phase (AP), portal venous phase (VP) and delayed phase (DP) images of every participant's enhanced CT images. RESULTS The entire group comprised 39 Met-positive and 91 Met-negative patients. The combined model, which included the clinical factors and the radiomic features, performed well in the training (area under the curve [AUC] = 0.878) and validation (AUC = 0.851) cohorts. The nomogram, which relied on the combined model, fits well in the calibration curves. Decision curve analysis (DCA) further confirmed that the clinical valuation of the nomogram achieved comparable accuracy in c-Met prediction. Among another 20 patients with HCC who had received sorafenib, the predicted high-risk group had shorter overall survival (OS) than the predicted low-risk group (p < 0.05). CONCLUSION A multivariate model acquired from three phases (AP, VP and DP) of enhanced CT, HBV-DNA and γ glutamyl transpeptidase isoenzyme II (GGT-II) could be considered a satisfactory preoperative marker of the expression of c-Met in patients with HCC. This approach may help in overcoming sorafenib resistance in advanced HCC.
Collapse
Affiliation(s)
- Jingxiao Gu
- Department of Vascular Surgery, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong, 226001, the, People's Republic of China
- Department of Radiology, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong, China
| | - Shanlei Bao
- Department of Nuclear Medicine, Affiliated Hospital of Nantong University, Nantong, China
| | | | - Zhongzheng Jia
- Department of Radiology, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong, China.
| | - Yu Zhang
- Department of Hepatobiliary and Pancreatic Surgery, Affiliated Hospital of Nantong University, Nantong, China.
| | - Chen Huang
- Department of Vascular Surgery, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong, 226001, the, People's Republic of China.
| |
Collapse
|
5
|
Khodabakhshi Z, Amini M, Hajianfar G, Oveisi M, Shiri I, Zaidi H. Dual-Centre Harmonised Multimodal Positron Emission Tomography/Computed Tomography Image Radiomic Features and Machine Learning Algorithms for Non-small Cell Lung Cancer Histopathological Subtype Phenotype Decoding. Clin Oncol (R Coll Radiol) 2023; 35:713-725. [PMID: 37599160 DOI: 10.1016/j.clon.2023.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 06/10/2023] [Accepted: 08/05/2023] [Indexed: 08/22/2023]
Abstract
AIMS We aimed to build radiomic models for classifying non-small cell lung cancer (NSCLC) histopathological subtypes through a dual-centre dataset and comprehensively evaluate the effect of ComBat harmonisation on the performance of single- and multimodality radiomic models. MATERIALS AND METHODS A public dataset of NSCLC patients from two independent centres was used. Two image fusion methods, namely guided filtering-based fusion and image fusion based on visual saliency map and weighted least square optimisation, were used. Radiomic features were extracted from each scan, including first-order, texture and moment-invariant features. Subsequently, ComBat harmonisation was applied to the extracted features from computed tomography (CT), positron emission tomography (PET) and fused images to correct the centre effect. For feature selection, least absolute shrinkage and selection operator (Lasso) and recursive feature elimination (RFE) were investigated. For machine learning, logistic regression (LR), support vector machine (SVM) and AdaBoost were evaluated for classifying NSCLC subtypes. Training and evaluation of the models were carried out in a robust framework to offset plausible errors and performance was reported using area under the curve, balanced accuracy, sensitivity and specificity before and after harmonisation. N-way ANOVA was used to assess the effect of different factors on the performance of the models. RESULTS Support vector machine fed with selected features by recursive feature elimination from a harmonised PET feature set achieved the highest performance (area under the curve = 0.82) in classifying NSCLC histopathological subtypes. Although the performance of the models did not significantly improve for CT images after harmonisation, the performance of PET and guided filtering-based fusion feature signatures significantly improved for almost all models. Although the selection of the image modality and feature selection methods was effective on the performance of the model (ANOVA P-values <0.001), machine learning and harmonisation did not change the performance significantly (ANOVA P-values = 0.839 and 0.292, respectively). CONCLUSION This study confirmed the potential of radiomic analysis on PET, CT and hybrid images for histopathological classification of NSCLC subtypes.
Collapse
Affiliation(s)
- Z Khodabakhshi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - M Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - G Hajianfar
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - M Oveisi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran; Comprehensive Cancer Centre, School of Cancer & Pharmaceutical Sciences, Faculty of Life Sciences & Medicine, Kings College London, London, UK; Department of Computer Science, University of British Columbia, Vancouver, BC, Canada
| | - I Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - H Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland; Geneva University Neurocenter, Geneva University, Geneva, Switzerland; Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands; Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
6
|
Amini M, Pursamimi M, Hajianfar G, Salimi Y, Saberi A, Mehri-Kakavand G, Nazari M, Ghorbani M, Shalbaf A, Shiri I, Zaidi H. Machine learning-based diagnosis and risk classification of coronary artery disease using myocardial perfusion imaging SPECT: A radiomics study. Sci Rep 2023; 13:14920. [PMID: 37691039 PMCID: PMC10493219 DOI: 10.1038/s41598-023-42142-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 09/06/2023] [Indexed: 09/12/2023] Open
Abstract
This study aimed to investigate the diagnostic performance of machine learning-based radiomics analysis to diagnose coronary artery disease status and risk from rest/stress Myocardial Perfusion Imaging (MPI) single-photon emission computed tomography (SPECT). A total of 395 patients suspicious of coronary artery disease who underwent 2-day stress-rest protocol MPI SPECT were enrolled in this study. The left ventricle myocardium, excluding the cardiac cavity, was manually delineated on rest and stress images to define a volume of interest. Added to clinical features (age, sex, family history, diabetes status, smoking, and ejection fraction), a total of 118 radiomics features, were extracted from rest and stress MPI SPECT images to establish different feature sets, including Rest-, Stress-, Delta-, and Combined-radiomics (all together) feature sets. The data were randomly divided into 80% and 20% subsets for training and testing, respectively. The performance of classifiers built from combinations of three feature selections, and nine machine learning algorithms was evaluated for two different diagnostic tasks, including 1) normal/abnormal (no CAD vs. CAD) classification, and 2) low-risk/high-risk CAD classification. Different metrics, including the area under the ROC curve (AUC), accuracy (ACC), sensitivity (SEN), and specificity (SPE), were reported for models' evaluation. Overall, models built on the Stress feature set (compared to other feature sets), and models to diagnose the second task (compared to task 1 models) revealed better performance. The Stress-mRMR-KNN (feature set-feature selection-classifier) reached the highest performance for task 1 with AUC, ACC, SEN, and SPE equal to 0.61, 0.63, 0.64, and 0.6, respectively. The Stress-Boruta-GB model achieved the highest performance for task 2 with AUC, ACC, SEN, and SPE of 0.79, 0.76, 0.75, and 0.76, respectively. Diabetes status from the clinical feature family, and dependence count non-uniformity normalized, from the NGLDM family, which is representative of non-uniformity in the region of interest were the most frequently selected features from stress feature set for CAD risk classification. This study revealed promising results for CAD risk classification using machine learning models built on MPI SPECT radiomics. The proposed models are helpful to alleviate the labor-intensive MPI SPECT interpretation process regarding CAD status and can potentially expedite the diagnostic process.
Collapse
Affiliation(s)
- Mehdi Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
| | - Mohamad Pursamimi
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ghasem Hajianfar
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
| | - Abdollah Saberi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
| | - Ghazal Mehri-Kakavand
- Department of Medical Physics, School of Medicine, Semnan University of Medical Sciences, Semnan, Iran
| | - Mostafa Nazari
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mahdi Ghorbani
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
- Department of Cardiology, Inselspital, University of Bern, Bern, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland.
- University Research and Innovation Center, Obuda University, Budapest, Hungary.
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University of Medical Center Groningen, Groningen, The Netherlands.
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
7
|
Mohebi M, Amini M, Alemzadeh-Ansari MJ, Alizadehasl A, Rajabi AB, Shiri I, Zaidi H, Orooji M. Post-revascularization Ejection Fraction Prediction for Patients Undergoing Percutaneous Coronary Intervention Based on Myocardial Perfusion SPECT Imaging Radiomics: a Preliminary Machine Learning Study. J Digit Imaging 2023; 36:1348-1363. [PMID: 37059890 PMCID: PMC10407007 DOI: 10.1007/s10278-023-00820-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Revised: 03/24/2023] [Accepted: 03/27/2023] [Indexed: 04/16/2023] Open
Abstract
In this study, the ability of radiomics features extracted from myocardial perfusion imaging with SPECT (MPI-SPECT) was investigated for the prediction of ejection fraction (EF) post-percutaneous coronary intervention (PCI) treatment. A total of 52 patients who had undergone pre-PCI MPI-SPECT were enrolled in this study. After normalization of the images, features were extracted from the left ventricle, initially automatically segmented by k-means and active contour methods, and finally edited and approved by an expert radiologist. More than 1700 2D and 3D radiomics features were extracted from each patient's scan. A cross-combination of three feature selections and seven classifier methods was implemented. Three classes of no or dis-improvement (class 1), improved EF from 0 to 5% (class 2), and improved EF over 5% (class 3) were predicted by using tenfold cross-validation. Lastly, the models were evaluated based on accuracy, AUC, sensitivity, specificity, precision, and F-score. Neighborhood component analysis (NCA) selected the most predictive feature signatures, including Gabor, first-order, and NGTDM features. Among the classifiers, the best performance was achieved by the fine KNN classifier, which yielded mean accuracy, AUC, sensitivity, specificity, precision, and F-score of 0.84, 0.83, 0.75, 0.87, 0.78, and 0.76, respectively, in 100 iterations of classification, within the 52 patients with 10-fold cross-validation. The MPI-SPECT-based radiomic features are well suited for predicting post-revascularization EF and therefore provide a helpful approach for deciding on the most appropriate treatment.
Collapse
Affiliation(s)
- Mobin Mohebi
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
| | - Mehdi Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | | | - Azin Alizadehasl
- Echocardiography Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
- Cardio-Oncology Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Ahmad Bitarafan Rajabi
- Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
- Echocardiography Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
- Geneva University Neuro Center, Geneva University, Geneva, Switzerland
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
| | - Mahdi Orooji
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
- Department of Electrical and Computer Engineering, University of California–Davis, Davis, CA USA
| |
Collapse
|
8
|
Samimi R, Shiri I, Ahmadyar Y, van den Hoff J, Kamali-Asl A, Rezaee A, Yousefirizi F, Geramifar P, Rahmim A. Radiomics predictive modeling from dual-time-point FDG PET K i parametric maps: application to chemotherapy response in lymphoma. EJNMMI Res 2023; 13:70. [PMID: 37493872 PMCID: PMC10371962 DOI: 10.1186/s13550-023-01022-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 07/18/2023] [Indexed: 07/27/2023] Open
Abstract
BACKGROUND To investigate the use of dynamic radiomics features derived from dual-time-point (DTP-feature) [18F]FDG PET metabolic uptake rate Ki parametric maps to develop a predictive model for response to chemotherapy in lymphoma patients. METHODS We analyzed 126 lesions from 45 lymphoma patients (responding n = 75 and non-responding n = 51) treated with chemotherapy from two different centers. Static and DTP radiomics features were extracted from baseline static PET images and DTP Ki parametric maps. Spearman's rank correlations were calculated between static and DTP features to identify features with potential additional information. We first employed univariate analysis to determine correlations between individual features, and subsequently utilized multivariate analysis to derive predictive models utilizing DTP and static radiomics features before and after ComBat harmonization. For multivariate modeling, we utilized both the minimum redundancy maximum relevance feature selection technique and the XGBoost classifier. To evaluate our model, we partitioned the patient datasets into training/validation and testing sets using an 80/20% split. Different metrics for classification including area under the curve (AUC), sensitivity (SEN), specificity (SPE), and accuracy (ACC) were reported in test sets. RESULTS Via Spearman's rank correlations, there was negligible to moderate correlation between 32 out of 65 DTP features and some static features (ρ < 0.7); all the other 33 features showed high correlations (ρ ≥ 0.7). In univariate modeling, no significant difference between AUC of DTP and static features was observed. GLRLM_RLNU from static features demonstrated a strong correlation (AUC = 0.75, p value = 0.0001, q value = 0.0007) with therapy response. The most predictive DTP features were GLCM_Energy, GLCM_Entropy, and Uniformity, each with AUC = 0.73, p value = 0.0001, and q value < 0.0005. In multivariate analysis, the mean ranges of AUCs increased following harmonization. Use of harmonization plus combining DTP and static features was shown to provide significantly improved predictions (AUC = 0.97 ± 0.02, accuracy = 0.89 ± 0.05, sensitivity = 0.92 ± 0.09, and specificity = 0.88 ± 0.05). All models depicted significant performance in terms of AUC, ACC, SEN, and SPE (p < 0.05, Mann-Whitney test). CONCLUSIONS Our results demonstrate significant value in harmonization of radiomics features as well as combining DTP and static radiomics models for predicting response to chemotherapy in lymphoma patients.
Collapse
Affiliation(s)
- Rezvan Samimi
- Department of Medical Radiation Engineering, Shahid Beheshti University, Tehran, Iran
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva 4, Switzerland
| | - Yashar Ahmadyar
- Department of Medical Radiation Engineering, Shahid Beheshti University, Tehran, Iran
| | - Jörg van den Hoff
- PET Center, Institute of Radiopharmaceutical Cancer Research, Helmholtz-Zentrum Dresden-Rossendorf, 01328, Dresden, Germany
- Department of Nuclear Medicine, University Hospital Carl Gustav Carus, Technische Universität Dresden, 01307, Dresden, Germany
| | - Alireza Kamali-Asl
- Department of Medical Radiation Engineering, Shahid Beheshti University, Tehran, Iran.
| | | | - Fereshteh Yousefirizi
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Parham Geramifar
- Research Center for Nuclear Medicine, Tehran University of Medical Sciences, Tehran, Iran.
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
9
|
Capobianco E, Dominietto M. Assessment of brain cancer atlas maps with multimodal imaging features. J Transl Med 2023; 21:385. [PMID: 37308956 DOI: 10.1186/s12967-023-04222-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 05/22/2023] [Indexed: 06/14/2023] Open
Abstract
BACKGROUND Glioblastoma Multiforme (GBM) is a fast-growing and highly aggressive brain tumor that invades the nearby brain tissue and presents secondary nodular lesions across the whole brain but generally does not spread to distant organs. Without treatment, GBM can result in death in about 6 months. The challenges are known to depend on multiple factors: brain localization, resistance to conventional therapy, disrupted tumor blood supply inhibiting effective drug delivery, complications from peritumoral edema, intracranial hypertension, seizures, and neurotoxicity. MAIN TEXT Imaging techniques are routinely used to obtain accurate detections of lesions that localize brain tumors. Especially magnetic resonance imaging (MRI) delivers multimodal images both before and after the administration of contrast, which results in displaying enhancement and describing physiological features as hemodynamic processes. This review considers one possible extension of the use of radiomics in GBM studies, one that recalibrates the analysis of targeted segmentations to the whole organ scale. After identifying critical areas of research, the focus is on illustrating the potential utility of an integrated approach with multimodal imaging, radiomic data processing and brain atlases as the main components. The templates associated with the outcome of straightforward analyses represent promising inference tools able to spatio-temporally inform on the GBM evolution while being generalizable also to other cancers. CONCLUSIONS The focus on novel inference strategies applicable to complex cancer systems and based on building radiomic models from multimodal imaging data can be well supported by machine learning and other computational tools potentially able to translate suitably processed information into more accurate patient stratifications and evaluations of treatment efficacy.
Collapse
Affiliation(s)
- Enrico Capobianco
- The Jackson Laboratory, 10 Discovery Drive, Farmington, CT, 06032, USA.
| | - Marco Dominietto
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, 5232, Villigen, Switzerland
- Gate To Brain SA, Via Livio 7, 6830, Chiasso, Switzerland
| |
Collapse
|
10
|
Sabouri M, Hajianfar G, Hosseini Z, Amini M, Mohebi M, Ghaedian T, Madadi S, Rastgou F, Oveisi M, Bitarafan Rajabi A, Shiri I, Zaidi H. Myocardial Perfusion SPECT Imaging Radiomic Features and Machine Learning Algorithms for Cardiac Contractile Pattern Recognition. J Digit Imaging 2023; 36:497-509. [PMID: 36376780 PMCID: PMC10039187 DOI: 10.1007/s10278-022-00705-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 08/31/2022] [Accepted: 09/15/2022] [Indexed: 11/16/2022] Open
Abstract
A U-shaped contraction pattern was shown to be associated with a better Cardiac resynchronization therapy (CRT) response. The main goal of this study is to automatically recognize left ventricular contractile patterns using machine learning algorithms trained on conventional quantitative features (ConQuaFea) and radiomic features extracted from Gated single-photon emission computed tomography myocardial perfusion imaging (GSPECT MPI). Among 98 patients with standard resting GSPECT MPI included in this study, 29 received CRT therapy and 69 did not (also had CRT inclusion criteria but did not receive treatment yet at the time of data collection, or refused treatment). A total of 69 non-CRT patients were employed for training, and the 29 were employed for testing. The models were built utilizing features from three distinct feature sets (ConQuaFea, radiomics, and ConQuaFea + radiomics (combined)), which were chosen using Recursive feature elimination (RFE) feature selection (FS), and then trained using seven different machine learning (ML) classifiers. In addition, CRT outcome prediction was assessed by different treatment inclusion criteria as the study's final phase. The MLP classifier had the highest performance among ConQuaFea models (AUC, SEN, SPE = 0.80, 0.85, 0.76). RF achieved the best performance in terms of AUC, SEN, and SPE with values of 0.65, 0.62, and 0.68, respectively, among radiomic models. GB and RF approaches achieved the best AUC, SEN, and SPE values of 0.78, 0.92, and 0.63 and 0.74, 0.93, and 0.56, respectively, among the combined models. A promising outcome was obtained when using radiomic and ConQuaFea from GSPECT MPI to detect left ventricular contractile patterns by machine learning.
Collapse
Affiliation(s)
- Maziar Sabouri
- Department of Medical Physics, School of Medicine, Iran University of Medical Science, Tehran, Iran
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Zahra Hosseini
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Mehdi Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland
| | - Mobin Mohebi
- Department of Biomedical Engineering, Tarbiat Modares University, Tehran, Iran
| | - Tahereh Ghaedian
- Nuclear Medicine and Molecular Imaging Research Center, School of Medicine, Namazi Teaching Hospital, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Shabnam Madadi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Fereydoon Rastgou
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Mehrdad Oveisi
- Comprehensive Cancer Centre, School of Cancer & Pharmaceutical Sciences, Faculty of Life Sciences & Medicine, King's College London, London, UK
- Department of Computer Science, University of British Columbia, Vancouver BC, Canada
| | - Ahmad Bitarafan Rajabi
- Echocardiography Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran.
- Cardiovascular Interventional Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran.
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland.
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva 4, Switzerland.
- Geneva University Neurocenter, Geneva University, Geneva, Switzerland.
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands.
- Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
11
|
Dai J, Wang H, Xu Y, Chen X, Tian R. Clinical application of AI-based PET images in oncological patients. Semin Cancer Biol 2023; 91:124-142. [PMID: 36906112 DOI: 10.1016/j.semcancer.2023.03.005] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 02/28/2023] [Accepted: 03/07/2023] [Indexed: 03/11/2023]
Abstract
Based on the advantages of revealing the functional status and molecular expression of tumor cells, positron emission tomography (PET) imaging has been performed in numerous types of malignant diseases for diagnosis and monitoring. However, insufficient image quality, the lack of a convincing evaluation tool and intra- and interobserver variation in human work are well-known limitations of nuclear medicine imaging and restrict its clinical application. Artificial intelligence (AI) has gained increasing interest in the field of medical imaging due to its powerful information collection and interpretation ability. The combination of AI and PET imaging potentially provides great assistance to physicians managing patients. Radiomics, an important branch of AI applied in medical imaging, can extract hundreds of abstract mathematical features of images for further analysis. In this review, an overview of the applications of AI in PET imaging is provided, focusing on image enhancement, tumor detection, response and prognosis prediction and correlation analyses with pathology or specific gene mutations in several types of tumors. Our aim is to describe recent clinical applications of AI-based PET imaging in malignant diseases and to focus on the description of possible future developments.
Collapse
Affiliation(s)
- Jiaona Dai
- Department of Nuclear Medicine, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Hui Wang
- Department of Nuclear Medicine, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Yuchao Xu
- School of Nuclear Science and Technology, University of South China, Hengyang City 421001, China
| | - Xiyang Chen
- Division of Vascular Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu 610041, China.
| | - Rong Tian
- Department of Nuclear Medicine, West China Hospital, Sichuan University, Chengdu 610041, China.
| |
Collapse
|
12
|
Collinearity and Dimensionality Reduction in Radiomics: Effect of Preprocessing Parameters in Hypertrophic Cardiomyopathy Magnetic Resonance T1 and T2 Mapping. BIOENGINEERING (BASEL, SWITZERLAND) 2023; 10:bioengineering10010080. [PMID: 36671652 PMCID: PMC9854492 DOI: 10.3390/bioengineering10010080] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 12/23/2022] [Indexed: 01/11/2023]
Abstract
Radiomics and artificial intelligence have the potential to become a valuable tool in clinical applications. Frequently, radiomic analyses through machine learning methods present issues caused by high dimensionality and multicollinearity, and redundant radiomic features are usually removed based on correlation analysis. We assessed the effect of preprocessing-in terms of voxel size resampling, discretization, and filtering-on correlation-based dimensionality reduction in radiomic features from cardiac T1 and T2 maps of patients with hypertrophic cardiomyopathy. For different combinations of preprocessing parameters, we performed a dimensionality reduction of radiomic features based on either Pearson's or Spearman's correlation coefficient, followed by the computation of the stability index. With varying resampling voxel size and discretization bin width, for both T1 and T2 maps, Pearson's and Spearman's dimensionality reduction produced a slightly different percentage of remaining radiomic features, with a relatively high stability index. For different filters, the remaining features' stability was instead relatively low. Overall, the percentage of eliminated radiomic features through correlation-based dimensionality reduction was more dependent on resampling voxel size and discretization bin width for textural features than for shape or first-order features. Notably, correlation-based dimensionality reduction was less sensitive to preprocessing when considering radiomic features from T2 compared with T1 maps.
Collapse
|
13
|
Abdalvand N, Sadeghi M, Mahdavi SR, Abdollahi H, Qasempour Y, Mohammadian F, Birgani MJT, Hosseini K. Brachytherapy outcome modeling in cervical cancer patients: A predictive machine learning study on patient-specific clinical, physical and dosimetric parameters. Brachytherapy 2022; 21:769-782. [PMID: 35933272 DOI: 10.1016/j.brachy.2022.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 06/09/2022] [Accepted: 06/26/2022] [Indexed: 12/14/2022]
Abstract
PURPOSE To predict clinical response in locally advanced cervical cancer (LACC) patients by a combination of measures, including clinical and brachytherapy parameters and several machine learning (ML) approaches. METHODS Brachytherapy features such as insertion approaches, source metrics, dosimetric, and clinical measures were used for modeling. Four different ML approaches, including LASSO, Ridge, support vector machine (SVM), and Random Forest (RF), were applied to extracted measures for model development alone or in combination. Model performance was evaluated using the area under the curve (AUC) of receiver operating characteristics curve, sensitivity, specificity, and accuracy. Our results were compared with a reference model developed by simple logistic regression applied to three distinct clinical features identified by previous papers. RESULTS One hundred eleven LACC patients were included. Nine data sets were obtained based on the features, and 36 predictive models were built. In terms of AUC, the model developed using RF applied to dosimetric, physical, and total BT sessions features were found as the most predictive [AUC; 0.82 (0.95 confidence interval (CI); 0.79 -0.93), sensitivity; 0.79, specificity; 0.76, and accuracy; 0.77]. The AUC (0.95 CI), sensitivity, specificity, and accuracy for the reference model were found as 0.56 (0.52 ...0.68), 0.51, 0.51, and 0.48, respectively. Most RF models had significantly better performance than the reference model (Bonferroni corrected p-value < 0.0014). CONCLUSION Brachytherapy response can be predicted using dosimetric and physical parameters extracted from treatment parameters. Machine learning algorithms, including Random Forest, could play a critical role in such predictive modeling.
Collapse
Affiliation(s)
- Neda Abdalvand
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Mahdi Sadeghi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran.
| | - Seied Rabi Mahdavi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran; Radiation Biology Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Radiologic Technology, Faculty of Allied Medicine, Kerman University of Medical Sciences, Kerman, Iran
| | - Younes Qasempour
- Student Research Committee, Faculty of Allied Medicine, Kerman University of Medical Sciences, Kerman, Iran
| | - Fatemeh Mohammadian
- Department of Radiation Oncology, Golestan Hospital, Ahvaz Jundishapour University of Medical Sciences, Ahvaz, Iran
| | | | - Khadijeh Hosseini
- Department of Radiation Oncology, Golestan Hospital, Ahvaz Jundishapour University of Medical Sciences, Ahvaz, Iran
| |
Collapse
|
14
|
Shiri I, Mostafaei S, Haddadi Avval A, Salimi Y, Sanaat A, Akhavanallaf A, Arabi H, Rahmim A, Zaidi H. High-dimensional multinomial multiclass severity scoring of COVID-19 pneumonia using CT radiomics features and machine learning algorithms. Sci Rep 2022; 12:14817. [PMID: 36050434 PMCID: PMC9437017 DOI: 10.1038/s41598-022-18994-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 08/23/2022] [Indexed: 12/11/2022] Open
Abstract
We aimed to construct a prediction model based on computed tomography (CT) radiomics features to classify COVID-19 patients into severe-, moderate-, mild-, and non-pneumonic. A total of 1110 patients were studied from a publicly available dataset with 4-class severity scoring performed by a radiologist (based on CT images and clinical features). The entire lungs were segmented and followed by resizing, bin discretization and radiomic features extraction. We utilized two feature selection algorithms, namely bagging random forest (BRF) and multivariate adaptive regression splines (MARS), each coupled to a classifier, namely multinomial logistic regression (MLR), to construct multiclass classification models. The dataset was divided into 50% (555 samples), 20% (223 samples), and 30% (332 samples) for training, validation, and untouched test datasets, respectively. Subsequently, nested cross-validation was performed on train/validation to select the features and tune the models. All predictive power indices were reported based on the testing set. The performance of multi-class models was assessed using precision, recall, F1-score, and accuracy based on the 4 × 4 confusion matrices. In addition, the areas under the receiver operating characteristic curves (AUCs) for multi-class classifications were calculated and compared for both models. Using BRF, 23 radiomic features were selected, 11 from first-order, 9 from GLCM, 1 GLRLM, 1 from GLDM, and 1 from shape. Ten features were selected using the MARS algorithm, namely 3 from first-order, 1 from GLDM, 1 from GLRLM, 1 from GLSZM, 1 from shape, and 3 from GLCM features. The mean absolute deviation, skewness, and variance from first-order and flatness from shape, and cluster prominence from GLCM features and Gray Level Non Uniformity Normalize from GLRLM were selected by both BRF and MARS algorithms. All selected features by BRF or MARS were significantly associated with four-class outcomes as assessed within MLR (All p values < 0.05). BRF + MLR and MARS + MLR resulted in pseudo-R2 prediction performances of 0.305 and 0.253, respectively. Meanwhile, there was a significant difference between the feature selection models when using a likelihood ratio test (p value = 0.046). Based on confusion matrices for BRF + MLR and MARS + MLR algorithms, the precision was 0.856 and 0.728, the recall was 0.852 and 0.722, whereas the accuracy was 0.921 and 0.861, respectively. AUCs (95% CI) for multi-class classification were 0.846 (0.805-0.887) and 0.807 (0.752-0.861) for BRF + MLR and MARS + MLR algorithms, respectively. Our models based on the utilization of radiomic features, coupled with machine learning were able to accurately classify patients according to the severity of pneumonia, thus highlighting the potential of this emerging paradigm in the prognostication and management of COVID-19 patients.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Shayan Mostafaei
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | | | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Azadeh Akhavanallaf
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland
| | - Arman Rahmim
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada.,Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211, Geneva, Switzerland. .,Geneva University Neurocenter, Geneva University, Geneva, Switzerland. .,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands. .,Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
15
|
Integrating Radiomics with Genomics for Non-Small Cell Lung Cancer Survival Analysis. JOURNAL OF ONCOLOGY 2022; 2022:5131170. [PMID: 36065309 PMCID: PMC9440821 DOI: 10.1155/2022/5131170] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 06/14/2022] [Accepted: 07/11/2022] [Indexed: 11/18/2022]
Abstract
Purpose The objectives of our study were to assess the association of radiological imaging and gene expression with patient outcomes in non-small cell lung cancer (NSCLC) and construct a nomogram by combining selected radiomic, genomic, and clinical risk factors to improve the performance of the risk model. Methods A total of 116 cases of NSCLC with CT images, gene expression, and clinical factors were studied, wherein 87 patients were used as the training cohort, and 29 patients were used as an independent testing cohort. Handcrafted radiomic features and deep-learning genomic features were extracted and selected from CT images and gene expression analysis, respectively. Two risk scores were calculated through Cox regression models for each patient based on radiomic features and genomic features to predict overall survival (OS). Finally, a fusion survival model was constructed by incorporating these two risk scores and clinical factors. Results The fusion model that combined CT images, gene expression data, and clinical factors effectively stratified patients into low- and high-risk groups. The C-indexes for OS prediction were 0.85 and 0.736 in the training and testing cohorts, respectively, which was better than that based on unimodal data. Conclusions Combining radiomics and genomics can effectively improve OS prediction for NSCLC patients.
Collapse
|
16
|
Arian F, Amini M, Mostafaei S, Rezaei Kalantari K, Haddadi Avval A, Shahbazi Z, Kasani K, Bitarafan Rajabi A, Chatterjee S, Oveisi M, Shiri I, Zaidi H. Myocardial Function Prediction After Coronary Artery Bypass Grafting Using MRI Radiomic Features and Machine Learning Algorithms. J Digit Imaging 2022; 35:1708-1718. [PMID: 35995896 DOI: 10.1007/s10278-022-00681-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 06/21/2022] [Accepted: 07/12/2022] [Indexed: 01/02/2023] Open
Abstract
The main aim of the present study was to predict myocardial function improvement in cardiac MR (LGE-CMR) images in patients after coronary artery bypass grafting (CABG) using radiomics and machine learning algorithms. Altogether, 43 patients who had visible scars on short-axis LGE-CMR images and were candidates for CABG surgery were selected and enrolled in this study. MR imaging was performed preoperatively using a 1.5-T MRI scanner. All images were segmented by two expert radiologists (in consensus). Prior to extraction of radiomics features, all MR images were resampled to an isotropic voxel size of 1.8 × 1.8 × 1.8 mm3. Subsequently, intensities were quantized to 64 discretized gray levels and a total of 93 features were extracted. The applied algorithms included a smoothly clipped absolute deviation (SCAD)-penalized support vector machine (SVM) and the recursive partitioning (RP) algorithm as a robust classifier for binary classification in this high-dimensional and non-sparse data. All models were validated with repeated fivefold cross-validation and 10,000 bootstrapping resamples. Ten and seven features were selected with SCAD-penalized SVM and RP algorithm, respectively, for CABG responder/non-responder classification. Considering univariate analysis, the GLSZM gray-level non-uniformity-normalized feature achieved the best performance (AUC: 0.62, 95% CI: 0.53-0.76) with SCAD-penalized SVM. Regarding multivariable modeling, SCAD-penalized SVM obtained an AUC of 0.784 (95% CI: 0.64-0.92), whereas the RP algorithm achieved an AUC of 0.654 (95% CI: 0.50-0.82). In conclusion, different radiomics texture features alone or combined in multivariate analysis using machine learning algorithms provide prognostic information regarding myocardial function in patients after CABG.
Collapse
Affiliation(s)
- Fatemeh Arian
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Mehdi Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva 4, CH-1211, Switzerland
| | - Shayan Mostafaei
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Kiara Rezaei Kalantari
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran.,Cardio-Oncology Research Center, Rajaei Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | | | - Zahra Shahbazi
- Department of Biostatistics, School of Health, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Kianosh Kasani
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Ahmad Bitarafan Rajabi
- Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran. .,Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran. .,Echocardiography Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran. .,Cardiovascular interventional research center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran.
| | - Saikat Chatterjee
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Brinellvägen 8, Stockholm, Sweden
| | - Mehrdad Oveisi
- Comprehensive Cancer Centre, School of Cancer & Pharmaceutical Sciences, Faculty of Life Sciences & Medicine, Kings College London, London, UK.,Department of Computer Science, University of British Columbia, Vancouver BC, Canada
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva 4, CH-1211, Switzerland.
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva 4, CH-1211, Switzerland. .,Geneva University Neurocenter, Geneva University, Geneva, Switzerland. .,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands. .,Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
17
|
Manafi-Farid R, Askari E, Shiri I, Pirich C, Asadi M, Khateri M, Zaidi H, Beheshti M. [ 18F]FDG-PET/CT radiomics and artificial intelligence in lung cancer: Technical aspects and potential clinical applications. Semin Nucl Med 2022; 52:759-780. [PMID: 35717201 DOI: 10.1053/j.semnuclmed.2022.04.004] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 04/10/2022] [Accepted: 04/13/2022] [Indexed: 02/07/2023]
Abstract
Lung cancer is the second most common cancer and the leading cause of cancer-related death worldwide. Molecular imaging using [18F]fluorodeoxyglucose Positron Emission Tomography and/or Computed Tomography ([18F]FDG-PET/CT) plays an essential role in the diagnosis, evaluation of response to treatment, and prediction of outcomes. The images are evaluated using qualitative and conventional quantitative indices. However, there is far more information embedded in the images, which can be extracted by sophisticated algorithms. Recently, the concept of uncovering and analyzing the invisible data extracted from medical images, called radiomics, is gaining more attention. Currently, [18F]FDG-PET/CT radiomics is growingly evaluated in lung cancer to discover if it enhances the diagnostic performance or implication of [18F]FDG-PET/CT in the management of lung cancer. In this review, we provide a short overview of the technical aspects, as they are discussed in different articles of this special issue. We mainly focus on the diagnostic performance of the [18F]FDG-PET/CT-based radiomics and the role of artificial intelligence in non-small cell lung cancer, impacting the early detection, staging, prediction of tumor subtypes, biomarkers, and patient's outcomes.
Collapse
Affiliation(s)
- Reyhaneh Manafi-Farid
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Emran Askari
- Department of Nuclear Medicine, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Christian Pirich
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital Salzburg, Paracelsus Medical University, Salzburg, Austria
| | - Mahboobeh Asadi
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Maziar Khateri
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland; Geneva University Neurocenter, Geneva University, Geneva, Switzerland; Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands; Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
| | - Mohsen Beheshti
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital Salzburg, Paracelsus Medical University, Salzburg, Austria.
| |
Collapse
|
18
|
Shiri I, Salimi Y, Pakbin M, Hajianfar G, Avval AH, Sanaat A, Mostafaei S, Akhavanallaf A, Saberi A, Mansouri Z, Askari D, Ghasemian M, Sharifipour E, Sandoughdaran S, Sohrabi A, Sadati E, Livani S, Iranpour P, Kolahi S, Khateri M, Bijari S, Atashzar MR, Shayesteh SP, Khosravi B, Babaei MR, Jenabi E, Hasanian M, Shahhamzeh A, Foroghi Ghomi SY, Mozafari A, Teimouri A, Movaseghi F, Ahmari A, Goharpey N, Bozorgmehr R, Shirzad-Aski H, Mortazavi R, Karimi J, Mortazavi N, Besharat S, Afsharpad M, Abdollahi H, Geramifar P, Radmard AR, Arabi H, Rezaei-Kalantari K, Oveisi M, Rahmim A, Zaidi H. COVID-19 prognostic modeling using CT radiomic features and machine learning algorithms: Analysis of a multi-institutional dataset of 14,339 patients. Comput Biol Med 2022; 145:105467. [PMID: 35378436 PMCID: PMC8964015 DOI: 10.1016/j.compbiomed.2022.105467] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 03/24/2022] [Accepted: 03/26/2022] [Indexed: 12/16/2022]
Abstract
BACKGROUND We aimed to analyze the prognostic power of CT-based radiomics models using data of 14,339 COVID-19 patients. METHODS Whole lung segmentations were performed automatically using a deep learning-based model to extract 107 intensity and texture radiomics features. We used four feature selection algorithms and seven classifiers. We evaluated the models using ten different splitting and cross-validation strategies, including non-harmonized and ComBat-harmonized datasets. The sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) were reported. RESULTS In the test dataset (4,301) consisting of CT and/or RT-PCR positive cases, AUC, sensitivity, and specificity of 0.83 ± 0.01 (CI95%: 0.81-0.85), 0.81, and 0.72, respectively, were obtained by ANOVA feature selector + Random Forest (RF) classifier. Similar results were achieved in RT-PCR-only positive test sets (3,644). In ComBat harmonized dataset, Relief feature selector + RF classifier resulted in the highest performance of AUC, reaching 0.83 ± 0.01 (CI95%: 0.81-0.85), with a sensitivity and specificity of 0.77 and 0.74, respectively. ComBat harmonization did not depict statistically significant improvement compared to a non-harmonized dataset. In leave-one-center-out, the combination of ANOVA feature selector and RF classifier resulted in the highest performance. CONCLUSION Lung CT radiomics features can be used for robust prognostic modeling of COVID-19. The predictive power of the proposed CT radiomics model is more reliable when using a large multicentric heterogeneous dataset, and may be used prospectively in clinical setting to manage COVID-19 patients.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Masoumeh Pakbin
- Imaging Department, Qom University of Medical Sciences, Qum, Iran
| | - Ghasem Hajianfar
- Rajaie Cardiovascular, Medical & Research Center, Iran University of Medical Science, Tehran, Iran
| | | | - Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Shayan Mostafaei
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Azadeh Akhavanallaf
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Abdollah Saberi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Zahra Mansouri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Dariush Askari
- Department of Radiology Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohammadreza Ghasemian
- Department of Radiology, Shahid Beheshti Hospital, Qom University of Medical Sciences, Qum, Iran
| | - Ehsan Sharifipour
- Neuroscience Research Center, Qom University of Medical Sciences, Qum, Iran
| | - Saleh Sandoughdaran
- Men's Health and Reproductive Health Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ahmad Sohrabi
- Cancer Control Research Center, Cancer Control Foundation, Iran University of Medical Sciences, Tehran, Iran
| | - Elham Sadati
- Department of Medical Physics, Faculty of Medical Sciences, Tarbiat Modares University, Tehran, Iran
| | - Somayeh Livani
- Clinical Research Development Unit (CRDU), Sayad Shirazi Hospital, Golestan University of Medical Sciences, Gorgan, Iran
| | - Pooya Iranpour
- Medical Imaging Research Center, Department of Radiology, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Shahriar Kolahi
- Department of Radiology, School of Medicine, Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Imam Khomeini Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Maziar Khateri
- Department of Medical Radiation Engineering, Science and Research Branch, Islamic Azad University, Tehran, Tehran, Iran
| | - Salar Bijari
- Department of Medical Physics, Faculty of Medical Sciences, Tarbiat Modares University, Tehran, Iran
| | - Mohammad Reza Atashzar
- Department of Immunology, School of Medicine, Fasa University of Medical Sciences, Fasa, Iran
| | - Sajad P. Shayesteh
- Department of Physiology, Pharmacology and Medical Physics, Alborz University of Medical Sciences, Karaj, Iran
| | - Bardia Khosravi
- Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Mohammad Reza Babaei
- Department of Interventional Radiology, Firouzgar Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Elnaz Jenabi
- Research Centre for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Mohammad Hasanian
- Department of Radiology, Arak University of Medical Sciences, Arak, Iran
| | - Alireza Shahhamzeh
- Clinical Research Development Center, Qom University of Medical Sciences, Qum, Iran
| | - Seyaed Yaser Foroghi Ghomi
- Clinical Research Development Center, Shahid Beheshti Hospital, Qom University Of Medical Sciences, Qom, Iran
| | - Abolfazl Mozafari
- Department of Medical Sciences, Qom Branch, Islamic Azad University, Qum, Iran
| | - Arash Teimouri
- Medical Imaging Research Center, Department of Radiology, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Fatemeh Movaseghi
- Department of Medical Sciences, Qom Branch, Islamic Azad University, Qum, Iran
| | - Azin Ahmari
- Ayatolah Khansary Hospital, Arak University of Medical Sciences, Arak, Iran
| | - Neda Goharpey
- Department of Radiation Oncology, Shohadaye Tajrish Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Rama Bozorgmehr
- Clinical Research Development Unit, Shohadaye Tajrish Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | | | - Roozbeh Mortazavi
- Department of Internal Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Jalal Karimi
- Department of Infectious Disease, School of Medicine, Fasa University of Medical Sciences, Fasa, Iran
| | - Nazanin Mortazavi
- Dental Research Center, Golestan University of Medical Sciences, Gorgan, Iran
| | - Sima Besharat
- Golestan Research Center of Gastroenterology and Hepatology, Golestan University of Medical Sciences, Gorgan, Iran
| | - Mandana Afsharpad
- Cancer Control Research Center, Cancer Control Foundation, Iran University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Radiologic Technology, Faculty of Allied Medical Sciences, Kerman University of Medical Sciences, Kerman, Iran
| | - Parham Geramifar
- Research Centre for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Amir Reza Radmard
- Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland
| | - Kiara Rezaei-Kalantari
- Rajaie Cardiovascular, Medical & Research Center, Iran University of Medical Science, Tehran, Iran
| | - Mehrdad Oveisi
- Comprehensive Cancer Centre, School of Cancer & Pharmaceutical Sciences, Faculty of Life Sciences & Medicine, King’s College London, London, United Kingdom
| | - Arman Rahmim
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada,Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, 1211, Switzerland,Geneva University Neurocenter, Geneva University, Geneva, Switzerland,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands,Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark,Corresponding author. Geneva University Hospital Division of Nuclear Medicine and Molecular Imaging, CH-1211, Geneva, Switzerland
| |
Collapse
|
19
|
Lv W, Xu H, Han X, Zhang H, Ma J, Rahmim A, Lu L. Context-Aware Saliency Guided Radiomics: Application to Prediction of Outcome and HPV-Status from Multi-Center PET/CT Images of Head and Neck Cancer. Cancers (Basel) 2022; 14:cancers14071674. [PMID: 35406449 PMCID: PMC8996849 DOI: 10.3390/cancers14071674] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/19/2022] [Accepted: 03/21/2022] [Indexed: 12/15/2022] Open
Abstract
Simple Summary This study investigated the ability of context-aware saliency-guided PET/CT radiomics in the prediction of outcome and HPV status for head and neck cancer. In total, 806 HNC patients (training vs. validation vs. external testing: 500 vs. 97 vs. 209) from 9 centers were collected from The Cancer Imaging Archive (TCIA). Saliency-guided radiomics showed enhanced performance for both outcome and HPV-status predictions relative to conventional radiomics. The radiomics-predicted HPV status also showed complementary prognostic value. This multi-center study highlights the feasibility of saliency-guided PET/CT radiomics in outcome predictions of head and neck cancer, confirming that certain regions are more relevant to tumor aggressiveness and prognosis. Abstract Purpose: This multi-center study aims to investigate the prognostic value of context-aware saliency-guided radiomics in 18F-FDG PET/CT images of head and neck cancer (HNC). Methods: 806 HNC patients (training vs. validation vs. external testing: 500 vs. 97 vs. 209) from 9 centers were collected from The Cancer Imaging Archive (TCIA). There were 100/384 and 60/123 oropharyngeal carcinoma (OPC) patients with human papillomavirus (HPV) status in training and testing cohorts, respectively. Six types of images were used for radiomics feature extraction and further model construction, namely (i) the original image (Origin), (ii) a context-aware saliency map (SalMap), (iii, iv) high- or low-saliency regions in the original image (highSal or lowSal), (v) a saliency-weighted image (SalxImg), and finally, (vi) a fused PET-CT image (FusedImg). Four outcomes were evaluated, i.e., recurrence-free survival (RFS), metastasis-free survival (MFS), overall survival (OS), and disease-free survival (DFS), respectively. Multivariate Cox analysis and logistic regression were adopted to construct radiomics scores for the prediction of outcome (Rad_Ocm) and HPV-status (Rad_HPV), respectively. Besides, the prognostic value of their integration (Rad_Ocm_HPV) was also investigated. Results: In the external testing cohort, compared with the Origin model, SalMap and SalxImg achieved the highest C-indices for RFS (0.621 vs. 0.559) and MFS (0.785 vs. 0.739) predictions, respectively, while FusedImg performed the best for both OS (0.685 vs. 0.659) and DFS (0.641 vs. 0.582) predictions. In the OPC HPV testing cohort, FusedImg showed higher AUC for HPV-status prediction compared with the Origin model (0.653 vs. 0.484). In the OPC testing cohort, compared with Rad_Ocm or Rad_HPV alone, Rad_Ocm_HPV performed the best for OS and DFS predictions with C-indices of 0.702 (p = 0.002) and 0.684 (p = 0.006), respectively. Conclusion: Saliency-guided radiomics showed enhanced performance for both outcome and HPV-status predictions relative to conventional radiomics. The radiomics-predicted HPV status also showed complementary prognostic value.
Collapse
Affiliation(s)
- Wenbing Lv
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China; (W.L.); (H.X.); (X.H.); (J.M.)
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Pazhou Lab, Guangzhou 510330, China
| | - Hui Xu
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China; (W.L.); (H.X.); (X.H.); (J.M.)
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Pazhou Lab, Guangzhou 510330, China
| | - Xu Han
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China; (W.L.); (H.X.); (X.H.); (J.M.)
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Pazhou Lab, Guangzhou 510330, China
| | - Hao Zhang
- Department of Medical Imaging, Nanfang Hospital, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China;
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China; (W.L.); (H.X.); (X.H.); (J.M.)
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Pazhou Lab, Guangzhou 510330, China
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, BC V5Z 1L3, Canada;
- Department of Radiology, University of British Columbia, 2211 Wesbrook Mall, Vancouver, BC V6T 1Z1, Canada
- Department of Physics, University of British Columbia, 6224 Agricultural Road, Vancouver, BC V6T 1Z1, Canada
| | - Lijun Lu
- School of Biomedical Engineering, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China; (W.L.); (H.X.); (X.H.); (J.M.)
- Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, 1023 Shatai Road, Guangzhou 510515, China
- Pazhou Lab, Guangzhou 510330, China
- Correspondence: ; Tel.: +86-020-62789116
| |
Collapse
|
20
|
Impact of feature harmonization on radiogenomics analysis: Prediction of EGFR and KRAS mutations from non-small cell lung cancer PET/CT images. Comput Biol Med 2022; 142:105230. [DOI: 10.1016/j.compbiomed.2022.105230] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Revised: 12/23/2021] [Accepted: 01/07/2022] [Indexed: 12/13/2022]
|
21
|
Zhang X, Zhang Y, Zhang G, Qiu X, Tan W, Yin X, Liao L. Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential. Front Oncol 2022; 12:773840. [PMID: 35251962 PMCID: PMC8891653 DOI: 10.3389/fonc.2022.773840] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 01/17/2022] [Indexed: 12/12/2022] Open
Abstract
The high-throughput extraction of quantitative imaging features from medical images for the purpose of radiomic analysis, i.e., radiomics in a broad sense, is a rapidly developing and emerging research field that has been attracting increasing interest, particularly in multimodality and multi-omics studies. In this context, the quantitative analysis of multidimensional data plays an essential role in assessing the spatio-temporal characteristics of different tissues and organs and their microenvironment. Herein, recent developments in this method, including manually defined features, data acquisition and preprocessing, lesion segmentation, feature extraction, feature selection and dimension reduction, statistical analysis, and model construction, are reviewed. In addition, deep learning-based techniques for automatic segmentation and radiomic analysis are being analyzed to address limitations such as rigorous workflow, manual/semi-automatic lesion annotation, and inadequate feature criteria, and multicenter validation. Furthermore, a summary of the current state-of-the-art applications of this technology in disease diagnosis, treatment response, and prognosis prediction from the perspective of radiology images, multimodality images, histopathology images, and three-dimensional dose distribution data, particularly in oncology, is presented. The potential and value of radiomics in diagnostic and therapeutic strategies are also further analyzed, and for the first time, the advances and challenges associated with dosiomics in radiotherapy are summarized, highlighting the latest progress in radiomics. Finally, a robust framework for radiomic analysis is presented and challenges and recommendations for future development are discussed, including but not limited to the factors that affect model stability (medical big data and multitype data and expert knowledge in medical), limitations of data-driven processes (reproducibility and interpretability of studies, different treatment alternatives for various institutions, and prospective researches and clinical trials), and thoughts on future directions (the capability to achieve clinical applications and open platform for radiomics analysis).
Collapse
Affiliation(s)
- Xingping Zhang
- Institute of Advanced Cyberspace Technology, Guangzhou University, Guangzhou, China
- Department of New Networks, Peng Cheng Laboratory, Shenzhen, China
| | - Yanchun Zhang
- Institute of Advanced Cyberspace Technology, Guangzhou University, Guangzhou, China
- Department of New Networks, Peng Cheng Laboratory, Shenzhen, China
| | - Guijuan Zhang
- Department of Respiratory Medicine, First Affiliated Hospital of Gannan Medical University, Ganzhou, China
| | - Xingting Qiu
- Department of Radiology, First Affiliated Hospital of Gannan Medical University, Ganzhou, China
| | - Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China
| | - Xiaoxia Yin
- Institute of Advanced Cyberspace Technology, Guangzhou University, Guangzhou, China
| | - Liefa Liao
- School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou, China
| |
Collapse
|
22
|
Non-contrast Cine Cardiac Magnetic Resonance image radiomics features and machine learning algorithms for myocardial infarction detection. Comput Biol Med 2021; 141:105145. [PMID: 34929466 DOI: 10.1016/j.compbiomed.2021.105145] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 12/13/2021] [Indexed: 12/22/2022]
Abstract
OBJECTIVE Robust differentiation between infarcted and normal tissue is important for clinical diagnosis and precision medicine. The aim of this work is to investigate the radiomic features and to develop a machine learning algorithm for the differentiation of myocardial infarction (MI) and viable tissues/normal cases in the left ventricular myocardium on non-contrast Cine Cardiac Magnetic Resonance (Cine-CMR) images. METHODS Seventy-two patients (52 with MI and 20 healthy control patients) were enrolled in this study. MR imaging was performed on a 1.5 T MRI using the following parameters: TR = 43.35 ms, TE = 1.22 ms, flip angle = 65°, temporal resolution of 30-40 ms. N4 bias field correction algorithm was applied to correct the inhomogeneity of images. All images were segmented and verified simultaneously by two cardiac imaging experts in consensus. Subsequently, features extraction was performed within the whole left ventricular myocardium (3D volume) in end-diastolic volume phase. Re-sampling to 1 × 1 × 1 mm3 voxels was performed for MR images. All intensities within the VOI of MR images were discretized to 64 bins. Radiomic features were normalized to obtain Z-scores, followed by Student's t-test statistical analysis for comparison. A p-value < 0.05 was used as a threshold for statistically significant differences and false discovery rate (FDR) correction performed to report q-value (FDR adjusted p-value). The extracted features were ranked using the MSVM-RFE algorithm, then Spearman correlation between features was performed to eliminate highly correlated features (R2 > 0.80). Ten different machine learning algorithms were used for classification and different metrics used for evaluation and various parameters used for models' evaluation. RESULTS In univariate analysis, the highest area under the curve (AUC) of receiver operating characteristic (ROC) value was achieved for the Maximum 2D diameter slice (M2DS) shape feature (AUC = 0.88, q-value = 1.02E-7), while the average of univariate AUCs was 0.62 ± 0.08. In multivariate analysis, Logistic Regression (AUC = 0.93 ± 0.03, Accuracy = 0.86 ± 0.05, Recall = 0.87 ± 0.1, Precision = 0.93 ± 0.03 and F1 Score = 0.90 ± 0.04) and SVM (AUC = 0.92 ± 0.05, Accuracy = 0.85 ± 0.04, Recall = 0.92 ± 0.01, Precision = 0.88 ± 0.04 and F1 Score = 0.90 ± 0.02) yielded optimal performance as the best machine learning algorithm for this radiomics analysis. CONCLUSION This study demonstrated that using radiomics analysis on non-contrast Cine-CMR images enables to accurately detect MI, which could potentially be used as an alternative diagnostic method for Late Gadolinium Enhancement Cardiac Magnetic Resonance (LGE-CMR).
Collapse
|
23
|
Overall Survival Prognostic Modelling of Non-small Cell Lung Cancer Patients Using Positron Emission Tomography/Computed Tomography Harmonised Radiomics Features: The Quest for the Optimal Machine Learning Algorithm. Clin Oncol (R Coll Radiol) 2021; 34:114-127. [PMID: 34872823 DOI: 10.1016/j.clon.2021.11.014] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 11/01/2021] [Accepted: 11/17/2021] [Indexed: 02/06/2023]
Abstract
AIMS Despite the promising results achieved by radiomics prognostic models for various clinical applications, multiple challenges still need to be addressed. The two main limitations of radiomics prognostic models include information limitation owing to single imaging modalities and the selection of optimum machine learning and feature selection methods for the considered modality and clinical outcome. In this work, we applied several feature selection and machine learning methods to single-modality positron emission tomography (PET) and computed tomography (CT) and multimodality PET/CT fusion to identify the best combinations for different radiomics modalities towards overall survival prediction in non-small cell lung cancer patients. MATERIALS AND METHODS A PET/CT dataset from The Cancer Imaging Archive, including subjects from two independent institutions (87 and 95 patients), was used in this study. Each cohort was used once as training and once as a test, followed by averaging of the results. ComBat harmonisation was used to address the centre effect. In our proposed radiomics framework, apart from single-modality PET and CT models, multimodality radiomics models were developed using multilevel (feature and image levels) fusion. Two different methods were considered for the feature-level strategy, including concatenating PET and CT features into a single feature set and alternatively averaging them. For image-level fusion, we used three different fusion methods, namely wavelet fusion, guided filtering-based fusion and latent low-rank representation fusion. In the proposed prognostic modelling framework, combinations of four feature selection and seven machine learning methods were applied to all radiomics modalities (two single and five multimodalities), machine learning hyper-parameters were optimised and finally the models were evaluated in the test cohort with 1000 repetitions via bootstrapping. Feature selection and machine learning methods were selected as popular techniques in the literature, supported by open source software in the public domain and their ability to cope with continuous time-to-event survival data. Multifactor ANOVA was used to carry out variability analysis and the proportion of total variance explained by radiomics modality, feature selection and machine learning methods was calculated by a bias-corrected effect size estimate known as ω2. RESULTS Optimum feature selection and machine learning methods differed owing to the applied radiomics modality. However, minimum depth (MD) as feature selection and Lasso and Elastic-Net regularized generalized linear model (glmnet) as machine learning method had the highest average results. Results from the ANOVA test indicated that the variability that each factor (radiomics modality, feature selection and machine learning methods) introduces to the performance of models is case specific, i.e. variances differ regarding different radiomics modalities and fusion strategies. Overall, the greatest proportion of variance was explained by machine learning, except for models in feature-level fusion strategy. CONCLUSION The identification of optimal feature selection and machine learning methods is a crucial step in developing sound and accurate radiomics risk models. Furthermore, optimum methods are case specific, differing due to the radiomics modality and fusion strategy used.
Collapse
|