1
|
Zheng Y, Zhang J, Huang D, Hao X, Qin W, Liu Y. Detecting MRI-Invisible Prostate Cancers Using a Weakly Supervised Deep Learning Model. Int J Biomed Imaging 2024; 2024:2741986. [PMID: 38532840 PMCID: PMC10965281 DOI: 10.1155/2024/2741986] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 02/24/2024] [Accepted: 02/28/2024] [Indexed: 03/28/2024] Open
Abstract
Background MRI is an important tool for accurate detection and targeted biopsy of prostate lesions. However, the imaging appearances of some prostate cancers are similar to those of the surrounding normal tissue on MRI, which are referred to as MRI-invisible prostate cancers (MIPCas). The detection of MIPCas remains challenging and requires extensive systematic biopsy for identification. In this study, we developed a weakly supervised UNet (WSUNet) to detect MIPCas. Methods The study included 777 patients (training set: 600; testing set: 177), all of them underwent comprehensive prostate biopsies using an MRI-ultrasound fusion system. MIPCas were identified in MRI based on the Gleason grade (≥7) from known systematic biopsy results. Results The WSUNet model underwent validation through systematic biopsy in the testing set with an AUC of 0.764 (95% CI: 0.728-0.798). Furthermore, WSUNet exhibited a statistically significant precision improvement of 91.3% (p < 0.01) over conventional systematic biopsy methods in the testing set. This improvement resulted in a substantial 47.6% (p < 0.01) decrease in unnecessary biopsy needles, while maintaining the same number of positively identified cores as in the original systematic biopsy. Conclusions In conclusion, the proposed WSUNet could effectively detect MIPCas, thereby reducing unnecessary biopsies.
Collapse
Affiliation(s)
- Yao Zheng
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, China
| | - Jingliang Zhang
- Department of Urology, Xijing Hospital, Air Force Medical University, No. 127 Changle West Road, Xi'an, Shaanxi Province, China
| | - Dong Huang
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, China
| | - Xiaoshuo Hao
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, China
| | - Weijun Qin
- Department of Urology, Xijing Hospital, Air Force Medical University, No. 127 Changle West Road, Xi'an, Shaanxi Province, China
| | - Yang Liu
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, China
| |
Collapse
|
2
|
Khanfari H, Mehranfar S, Cheki M, Mohammadi Sadr M, Moniri S, Heydarheydari S, Rezaeijo SM. Exploring the efficacy of multi-flavored feature extraction with radiomics and deep features for prostate cancer grading on mpMRI. BMC Med Imaging 2023; 23:195. [PMID: 37993801 PMCID: PMC10664625 DOI: 10.1186/s12880-023-01140-0] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 10/26/2023] [Indexed: 11/24/2023] Open
Abstract
BACKGROUND The purpose of this study is to investigate the use of radiomics and deep features obtained from multiparametric magnetic resonance imaging (mpMRI) for grading prostate cancer. We propose a novel approach called multi-flavored feature extraction or tensor, which combines four mpMRI images using eight different fusion techniques to create 52 images or datasets for each patient. We evaluate the effectiveness of this approach in grading prostate cancer and compare it to traditional methods. METHODS We used the PROSTATEx-2 dataset consisting of 111 patients' images from T2W-transverse, T2W-sagittal, DWI, and ADC images. We used eight fusion techniques to merge T2W, DWI, and ADC images, namely Laplacian Pyramid, Ratio of the low-pass pyramid, Discrete Wavelet Transform, Dual-Tree Complex Wavelet Transform, Curvelet Transform, Wavelet Fusion, Weighted Fusion, and Principal Component Analysis. Prostate cancer images were manually segmented, and radiomics features were extracted using the Pyradiomics library in Python. We also used an Autoencoder for deep feature extraction. We used five different feature sets to train the classifiers: all radiomics features, all deep features, radiomics features linked with PCA, deep features linked with PCA, and a combination of radiomics and deep features. We processed the data, including balancing, standardization, PCA, correlation, and Least Absolute Shrinkage and Selection Operator (LASSO) regression. Finally, we used nine classifiers to classify different Gleason grades. RESULTS Our results show that the SVM classifier with deep features linked with PCA achieved the most promising results, with an AUC of 0.94 and a balanced accuracy of 0.79. Logistic regression performed best when using only the deep features, with an AUC of 0.93 and balanced accuracy of 0.76. Gaussian Naive Bayes had lower performance compared to other classifiers, while KNN achieved high performance using deep features linked with PCA. Random Forest performed well with the combination of deep features and radiomics features, achieving an AUC of 0.94 and balanced accuracy of 0.76. The Voting classifiers showed higher performance when using only the deep features, with Voting 2 achieving the highest performance, with an AUC of 0.95 and balanced accuracy of 0.78. CONCLUSION Our study concludes that the proposed multi-flavored feature extraction or tensor approach using radiomics and deep features can be an effective method for grading prostate cancer. Our findings suggest that deep features may be more effective than radiomics features alone in accurately classifying prostate cancer.
Collapse
Affiliation(s)
- Hasan Khanfari
- Department of Mechanical Engineering, Petroleum University of Technology, Ahvaz, Iran
| | - Saeed Mehranfar
- Department of Electrical Engineering, Amirkabir University of Technology, Tehran, Iran
| | - Mohsen Cheki
- Department of Medical Imaging and Radiation Sciences, Faculty of Paramedicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Mahmoud Mohammadi Sadr
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Samir Moniri
- Department of Medical Imaging and Radiation Sciences, Faculty of Paramedicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Sahel Heydarheydari
- Department of Medical Imaging and Radiation Sciences, Faculty of Paramedicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Seyed Masoud Rezaeijo
- Department of Medical Physics, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran.
- Cancer Research Center, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran.
| |
Collapse
|
3
|
Zhang J, Xu Y, Li W, Zhang C, Liu W, Li D, Chen Y. The Predictive Value of Myocardial Native T1 Mapping Radiomics in Dilated Cardiomyopathy: A Study in a Chinese Population. J Magn Reson Imaging 2023; 58:772-779. [PMID: 36416613 DOI: 10.1002/jmri.28527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 10/26/2022] [Accepted: 10/27/2022] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND Investigation of the factors influencing dilated cardiomyopathy (DCM) prognosis is important as it could facilitate risk stratification and guide clinical decision-making. PURPOSE To assess the prognostic value of magnetic resonance imaging (MRI) radiomics analysis of native T1 mapping in DCM. STUDY TYPE Prospective. SUBJECTS Three hundred and thirty consecutive patients with non-ischemic DCM (mean age 48.42 ± 14.20 years, 247 males). FIELD STRENGTH/SEQUENCE Balanced steady-state free precession and modified Look-Locker inversion recovery T1 mapping sequences at 3 T. ASSESSMENT Clinical characteristics, conventional MRI parameters (ventricular volumes, function, and mass), native myocardial T1, and radiomics features extracted from native T1 mapping were obtained. The study endpoint was defined as all-cause mortality or heart transplantation. Models were developed based on 1) clinical data; 2) radiomics data based on T1 mapping; 3) clinical and conventional MRI data; 4) clinical, conventional MRI, and native T1 data; and 5) clinical, conventional MRI, and radiomics T1 mapping data. Each prediction model was trained according to follow-up results with AdaBoost, random forest, and logistic regression classifiers. STATISTICAL TESTS The predictive performance was evaluated using the area under the receiver operating characteristic curve (AUC) and F1 score by 5-fold cross-validation. RESULTS During a median follow-up of 53.5 months (interquartile range, 41.6-69.5 months), 77 patients with DCM experienced all-cause mortality or heart transplantation. The random forest model based on radiomics combined with clinical and conventional MRI parameters achieved the best performance, with AUC and F1 score of 0.95 and 0.89, respectively. DATA CONCLUSION A machine-learning framework based on radiomics analysis of T1 mapping prognosis prediction in DCM. LEVEL OF EVIDENCE 1 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Jian Zhang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Yuanwei Xu
- Division of Cardiology, West China Hospital, Sichuan University, Chengdu, China
| | - Weihao Li
- Division of Cardiology, West China Hospital, Sichuan University, Chengdu, China
| | - Chao Zhang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Wentao Liu
- Fundamental Technology Center of CCB Financial Technology Co., Ltd, Shanghai, China
| | - Dong Li
- Division of Hospital Medicine, Emory School of Medicine, Atlanta, Georgia, USA
| | - Yucheng Chen
- Division of Cardiology, West China Hospital, Sichuan University, Chengdu, China
| |
Collapse
|
4
|
Fischer M, Küstner T, Pappa S, Niendorf T, Pischon T, Kröncke T, Bette S, Schramm S, Schmidt B, Haubold J, Nensa F, Nonnenmacher T, Palm V, Bamberg F, Kiefer L, Schick F, Yang B. Identification of radiomic biomarkers in a set of four skeletal muscle groups on Dixon MRI of the NAKO MR study. BMC Med Imaging 2023; 23:104. [PMID: 37553619 PMCID: PMC10408104 DOI: 10.1186/s12880-023-01056-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Accepted: 07/18/2023] [Indexed: 08/10/2023] Open
Abstract
In this work, we propose a processing pipeline for the extraction and identification of meaningful radiomics biomarkers in skeletal muscle tissue as displayed using Dixon-weighted MRI. Diverse and robust radiomics features can be identified that may be of aid in the accurate quantification e.g. varying degrees of sarcopenia in respective muscles of large cohorts. As such, the approach comprises the texture feature extraction from raw data based on well established approaches, such as a nnU-Net neural network and the Pyradiomics toolbox, a subsequent selection according to adequate conditions for the muscle tissue of the general population, and an importance-based ranking to further narrow the amount of meaningful features with respect to auxiliary targets. The performance was investigated with respect to the included auxiliary targets, namely age, body mass index (BMI), and fat fraction (FF). Four skeletal muscles with different fiber architecture were included: the mm. glutaei, m. psoas, as well as the extensors and adductors of the thigh. The selection allowed for a reduction from 1015 available texture features to 65 for age, 53 for BMI, and 36 for FF from the available fat/water contrast images considering all muscles jointly. Further, the dependence of the importance rankings calculated for the auxiliary targets on validation sets (in a cross-validation scheme) was investigated by boxplots. In addition, significant differences between subgroups of respective auxiliary targets as well as between both sexes were shown to be present within the ten lowest ranked features by means of Kruskal-Wallis H-tests and Mann-Whitney U-tests. The prediction performance for the selected features and the ranking scheme were verified on validation sets by a random forest based multi-class classification, with strong area under the curve (AUC) values of the receiver operator characteristic (ROC) of 73.03 ± 0.70 % and 73.63 ± 0.70 % for the water and fat images in age, 80.68 ± 0.30 % and 88.03 ± 0.89 % in BMI, as well as 98.36 ± 0.03 % and 98.52 ± 0.09 % in FF.
Collapse
Affiliation(s)
- Marc Fischer
- Institute of Signal Processing and System Theory, University of Stuttgart, Stuttgart, Germany
| | - Thomas Küstner
- Medical Image and Data Analysis (MIDAS.lab), University Hospital Tübingen, Tübingen, Germany.
| | - Sofia Pappa
- Section on Experimental Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Thoralf Niendorf
- Berlin Ultrahigh Field Facility (B.U.F.F.), Max-Delbrück-Center for Molecular Medicine, Berlin, Germany
| | - Tobias Pischon
- Berlin Ultrahigh Field Facility (B.U.F.F.), Max-Delbrück-Center for Molecular Medicine, Berlin, Germany
| | - Thomas Kröncke
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg, Germany
- Centre for Advanced Analytics and Predictive Sciences (CAAPS), University Augsburg, Augsburg, Germany
| | - Stefanie Bette
- Department of Diagnostic and Interventional Radiology, University Hospital Augsburg, Augsburg, Germany
| | - Sara Schramm
- Institute for Medical Informatics, Biometry and Epidemiology, Essen University Hospital, Essen, Germany
| | - Börge Schmidt
- Institute for Medical Informatics, Biometry and Epidemiology, Essen University Hospital, Essen, Germany
| | | | | | | | | | | | - Lena Kiefer
- Department of Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Fritz Schick
- Section on Experimental Radiology, University Hospital Tübingen, Tübingen, Germany
| | - Bin Yang
- Institute of Signal Processing and System Theory, University of Stuttgart, Stuttgart, Germany
| |
Collapse
|
5
|
Jin P, Shen J, Yang L, Zhang J, Shen A, Bao J, Wang X. Machine learning-based radiomics model to predict benign and malignant PI-RADS v2.1 category 3 lesions: a retrospective multi-center study. BMC Med Imaging 2023; 23:47. [PMID: 36991347 PMCID: PMC10053087 DOI: 10.1186/s12880-023-01002-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Accepted: 03/15/2023] [Indexed: 03/30/2023] Open
Abstract
Purpose To develop machine learning-based radiomics models derive from different MRI sequences for distinction between benign and malignant PI-RADS 3 lesions before intervention, and to cross-institution validate the generalization ability of the models. Methods The pre-biopsy MRI datas of 463 patients classified as PI-RADS 3 lesions were collected from 4 medical institutions retrospectively. 2347 radiomics features were extracted from the VOI of T2WI, DWI and ADC images. The ANOVA feature ranking method and support vector machine classifier were used to construct 3 single-sequence models and 1 integrated model combined with the features of three sequences. All the models were established in the training set and independently verified in the internal test and external validation set. The AUC was used to compared the predictive performance of PSAD with each model. Hosmer–lemeshow test was used to evaluate the degree of fitting between prediction probability and pathological results. Non-inferiority test was used to check generalization performance of the integrated model. Results The difference of PSAD between PCa and benign lesions was statistically significant (P = 0.006), with the mean AUC of 0.701 for predicting clinically significant prostate cancer (internal test AUC = 0.709 vs. external validation AUC = 0.692, P = 0.013) and 0.630 for predicting all cancer (internal test AUC = 0.637 vs. external validation AUC = 0.623, P = 0.036). T2WI-model with the mean AUC of 0.717 for predicting csPCa (internal test AUC = 0.738 vs. external validation AUC = 0.695, P = 0.264) and 0.634 for predicting all cancer (internal test AUC = 0.678 vs. external validation AUC = 0.589, P = 0.547). DWI-model with the mean AUC of 0.658 for predicting csPCa (internal test AUC = 0.635 vs. external validation AUC = 0.681, P = 0.086) and 0.655 for predicting all cancer (internal test AUC = 0.712 vs. external validation AUC = 0.598, P = 0.437). ADC-model with the mean AUC of 0.746 for predicting csPCa (internal test AUC = 0.767 vs. external validation AUC = 0.724, P = 0.269) and 0.645 for predicting all cancer (internal test AUC = 0.650 vs. external validation AUC = 0.640, P = 0.848). Integrated model with the mean AUC of 0.803 for predicting csPCa (internal test AUC = 0.804 vs. external validation AUC = 0.801, P = 0.019) and 0.778 for predicting all cancer (internal test AUC = 0.801 vs. external validation AUC = 0.754, P = 0.047). Conclusions The radiomics model based on machine learning has the potential to be a non-invasive tool to distinguish cancerous, noncancerous and csPCa in PI-RADS 3 lesions, and has relatively high generalization ability between different date set.
Collapse
Affiliation(s)
- Pengfei Jin
- grid.509676.bDepartment of Radiology, The Cancer Hospital of the University of Chinese Academy of Science (Zhejiang Cancer Hospital), Institute of Basic Medicine and Cancer (IBMC), Chinese Academy of Science, 1# Banshan East Road, Hangzhou, 310022 Zhejiang China
| | - Junkang Shen
- grid.452666.50000 0004 1762 8363Department of Radiology, The Second Affiliated Hospital of Soochow University, 1055# Sanxiang Road, Suzhou, 215000 China
| | - Liqin Yang
- grid.429222.d0000 0004 1798 0228Department of Radiology, The First Affiliated Hospital of SooChow University, 188#, Shizi Road, Suzhou, 215006 Jiangsu China
| | - Ji Zhang
- grid.479690.50000 0004 1789 6747Department of Radiology, Taizhou People’s Hospital of Jiangsu Province, 10# Yigchun Road, Taizhou, 225300 Jiangsu China
| | - Ao Shen
- grid.9227.e0000000119573309Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, 88# Keling Road, Suzhou, 215163 Jiangsu China
| | - Jie Bao
- grid.429222.d0000 0004 1798 0228Department of Radiology, The First Affiliated Hospital of SooChow University, 188#, Shizi Road, Suzhou, 215006 Jiangsu China
| | - Ximing Wang
- grid.429222.d0000 0004 1798 0228Department of Radiology, The First Affiliated Hospital of SooChow University, 188#, Shizi Road, Suzhou, 215006 Jiangsu China
| |
Collapse
|
6
|
Chiacchio G, Castellani D, Nedbal C, De Stefano V, Brocca C, Tramanzoli P, Galosi AB, Donalisio da Silva R, Teoh JYC, Tiong HY, Naik N, Somani BK, Merseburger AS, Gauhar V. Radiomics vs radiologist in prostate cancer. Results from a systematic review. World J Urol 2023; 41:709-724. [PMID: 36867239 DOI: 10.1007/s00345-023-04305-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 01/20/2023] [Indexed: 03/04/2023] Open
Abstract
PURPOSE Radiomics in uro-oncology is a rapidly evolving science proving to be a novel approach for optimizing the analysis of massive data from medical images to provide auxiliary guidance in clinical issues. This scoping review aimed to identify key aspects wherein radiomics can potentially improve the accuracy of diagnosis, staging, and extraprostatic extension in prostate cancer (PCa). METHODS The literature search was performed on June 2022 using PubMed, Embase, and Cochrane Central Controlled Register of Trials. Studies were included if radiomics were compared with radiological reports only. RESULTS Seventeen papers were included. The combination of PIRADS and radiomics score models improves the PIRADS score reporting of 2 and 3 lesions even in the peripheral zone. Multiparametric MRI-based radiomics models suggest that by simply omitting diffusion contrast enhancement imaging in radiomics models can simplify the process of analysis of clinically significant PCa by PIRADS. Radiomics features correlated with the Gleason grade with excellent discriminative ability. Radiomics has higher accuracy in predicting not only the presence but also the side of extraprostatic extension. CONCLUSIONS Radiomics research on PCa mainly uses MRI as an imaging modality and is focused on diagnosis and risk stratification and has the best future possibility of improving PIRADS reporting. Radiomics has established its superiority over radiologist-reported outcomes but the variability has to be taken into consideration before translating it to clinical practice.
Collapse
Affiliation(s)
- Giuseppe Chiacchio
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy
| | - Daniele Castellani
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy.
| | - Carlotta Nedbal
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy
| | - Virgilio De Stefano
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy
| | - Carlo Brocca
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy
| | - Pietro Tramanzoli
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy
| | - Andrea Benedetto Galosi
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti di Ancona, Università Politecnica delle Marche, Via Conca 71, 60126, Ancona, Italy
| | | | - Jeremy Yuen-Chun Teoh
- Department of Surgery, S.H.Ho Urology Centre, The Chinese University of Hong Kong, Hong Kong, China
| | - Ho Yee Tiong
- Department of Urology, National University Hospital, Singapore, Singapore
| | - Nithesh Naik
- Department of Mechanical and Industrial Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Bhaskar K Somani
- Department of Urology, University Hospitals Southampton, NHS Trust, Southampton, UK
| | - Axel S Merseburger
- Clinic of Urology, University Hospital Schleswig-Holstein, Lübeck, Germany
| | - Vineet Gauhar
- Department of Urology, Ng Teng Fong General Hospital, Singapore, Singapore
| |
Collapse
|
7
|
Belue MJ, Harmon SA, Lay NS, Daryanani A, Phelps TE, Choyke PL, Turkbey B. The Low Rate of Adherence to Checklist for Artificial Intelligence in Medical Imaging Criteria Among Published Prostate MRI Artificial Intelligence Algorithms. J Am Coll Radiol 2023; 20:134-145. [PMID: 35922018 PMCID: PMC9887098 DOI: 10.1016/j.jacr.2022.05.022] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 05/13/2022] [Accepted: 05/18/2022] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To determine the rigor, generalizability, and reproducibility of published classification and detection artificial intelligence (AI) models for prostate cancer (PCa) on MRI using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines, a 42-item checklist that is considered a measure of best practice for presenting and reviewing medical imaging AI research. MATERIALS AND METHODS This review searched English literature for studies proposing PCa AI detection and classification models on MRI. Each study was evaluated with the CLAIM checklist. The additional outcomes for which data were sought included measures of AI model performance (eg, area under the curve [AUC], sensitivity, specificity, free-response operating characteristic curves), training and validation and testing group sample size, AI approach, detection versus classification AI, public data set utilization, MRI sequences used, and definition of gold standard for ground truth. The percentage of CLAIM checklist fulfillment was used to stratify studies into quartiles. Wilcoxon's rank-sum test was used for pair-wise comparisons. RESULTS In all, 75 studies were identified, and 53 studies qualified for analysis. The original CLAIM items that most studies did not fulfill includes item 12 (77% no): de-identification methods; item 13 (68% no): handling missing data; item 15 (47% no): rationale for choosing ground truth reference standard; item 18 (55% no): measurements of inter- and intrareader variability; item 31 (60% no): inclusion of validated interpretability maps; item 37 (92% no): inclusion of failure analysis to elucidate AI model weaknesses. An AUC score versus percentage CLAIM fulfillment quartile revealed a significant difference of the mean AUC scores between quartile 1 versus quartile 2 (0.78 versus 0.86, P = .034) and quartile 1 versus quartile 4 (0.78 versus 0.89, P = .003) scores. Based on additional information and outcome metrics gathered in this study, additional measures of best practice are defined. These new items include disclosure of public dataset usage, ground truth definition in comparison to other referenced works in the defined task, and sample size power calculation. CONCLUSION A large proportion of AI studies do not fulfill key items in CLAIM guidelines within their methods and results sections. The percentage of CLAIM checklist fulfillment is weakly associated with improved AI model performance. Additions or supplementations to CLAIM are recommended to improve publishing standards and aid reviewers in determining study rigor.
Collapse
Affiliation(s)
- Mason J Belue
- Medical Research Scholars Program Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Stephanie A Harmon
- Staff Scientist, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Nathan S Lay
- Staff Scientist, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Asha Daryanani
- Intramural Research Training Program Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Tim E Phelps
- Postdoctoral Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Peter L Choyke
- Artificial Intelligence Resource, Chief of Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Baris Turkbey
- Senior Clinician/Director, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland.
| |
Collapse
|
8
|
Predicting Local Failure after Partial Prostate Re-Irradiation Using a Dosiomic-Based Machine Learning Model. J Pers Med 2022; 12:jpm12091491. [PMID: 36143276 PMCID: PMC9505150 DOI: 10.3390/jpm12091491] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 09/02/2022] [Accepted: 09/05/2022] [Indexed: 12/22/2022] Open
Abstract
The aim of this study is to predict local failure after partial prostate re-irradiation for the treatment of isolated locally recurrent prostate cancer by using a machine learning classifier based on radiomic features from pre-treatment computed tomography (CT), positron-emission tomography (PET) and biological effective dose distribution (BED) of the radiotherapy plan. The analysis was conducted on a monocentric dataset of 43 patients with evidence of isolated intraprostatic recurrence of prostate cancer after primary external beam radiotherapy. All patients received partial prostate re-irradiation delivered by volumetric modulated arc therapy. The gross tumor volume (GTV) of each patient was manually contoured from planning CT, choline-PET and dose maps. An ensemble machine learning pipeline including unbalanced data correction and feature selection was trained using the radiomic and dosiomic features as input for predicting occurrence of local failure. The model performance was assessed using sensitivity, specificity, accuracy and area under receiver operating characteristic curves of the score function in 10-fold cross validation repeated 100 times. Local failure was observed in 13 patients (30%), with a median time to recurrence of 36.7 months (range = 6.1–102.4 months). A four variables ensemble machine learning model resulted in accuracy of 0.62 and AUC 0.65. According to our results, a dosiomic machine learning classifier can predict local failure after partial prostate re-irradiation.
Collapse
|
9
|
Quantib Prostate Compared to an Expert Radiologist for the Diagnosis of Prostate Cancer on mpMRI: A Single-Center Preliminary Study. Tomography 2022; 8:2010-2019. [PMID: 36006066 PMCID: PMC9415513 DOI: 10.3390/tomography8040168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 08/07/2022] [Accepted: 08/08/2022] [Indexed: 11/30/2022] Open
Abstract
Background: To evaluate the clinical utility of an Artificial Intelligence (AI) radiology solution, Quantib Prostate, for prostate cancer (PCa) lesions detection on multiparametric Magnetic Resonance Images (mpMRI). Methods: Prostate mpMRI exams of 108 patients were retrospectively studied. The diagnostic performance of an expert radiologist (>8 years of experience) and of an inexperienced radiologist aided by Quantib software were compared. Three groups of patients were assessed: patients with positive mpMRI, positive target biopsy, and/or at least one positive random biopsy (group A, 73 patients); patients with positive mpMRI and a negative biopsy (group B, 14 patients), and patients with negative mpMRI who did not undergo biopsy (group-C, 21 patients). Results: In group A, the AI-assisted radiologist found new lesions with positive biopsy correlation, increasing the diagnostic PCa performance when compared with the expert radiologist, reaching an SE of 92.3% and a PPV of 90.1% (vs. 71.7% and 84.4%). In group A, the expert radiologist found 96 lesions on 73 mpMRI exams (17.7% PIRADS3, 56.3% PIRADS4, and 26% PIRADS5). The AI-assisted radiologist found 121 lesions (0.8% PIRADS3, 53.7% PIRADS4, and 45.5% PIRADS5). At biopsy, 33.9% of the lesions were ISUP1, 31.4% were ISUP2, 22% were ISUP3, 10.2% were ISUP4, and 2.5% were ISUP5. In group B, where biopsies were negative, the AI-assisted radiologist excluded three lesions but confirmed all the others. In group-C, the AI-assisted radiologist found 37 new lesions, most of them PIRADS 3, with 32.4% localized in the peripherical zone and 67.6% in the transition zone. Conclusions: Quantib software is a very sensitive tool to use specifically in high-risk patients (high PIRADS and high Gleason score).
Collapse
|
10
|
Fernandes MC, Yildirim O, Woo S, Vargas HA, Hricak H. The role of MRI in prostate cancer: current and future directions. MAGMA (NEW YORK, N.Y.) 2022; 35:503-521. [PMID: 35294642 PMCID: PMC9378354 DOI: 10.1007/s10334-022-01006-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Revised: 01/16/2022] [Accepted: 03/03/2022] [Indexed: 06/14/2023]
Abstract
There has been an increasing role of magnetic resonance imaging (MRI) in the management of prostate cancer. MRI already plays an essential role in the detection and staging, with the introduction of functional MRI sequences. Recent advancements in radiomics and artificial intelligence are being tested to potentially improve detection, assessment of aggressiveness, and provide usefulness as a prognostic marker. MRI can improve pretreatment risk stratification and therefore selection of and follow-up of patients for active surveillance. MRI can also assist in guiding targeted biopsy, treatment planning and follow-up after treatment to assess local recurrence. MRI has gained importance in the evaluation of metastatic disease with emerging technology including whole-body MRI and integrated positron emission tomography/MRI, allowing for not only better detection but also quantification. The main goal of this article is to review the most recent advances on MRI in prostate cancer and provide insights into its potential clinical roles from the radiologist's perspective. In each of the sections, specific roles of MRI tailored to each clinical setting are discussed along with its strengths and weakness including already established material related to MRI and the introduction of recent advancements on MRI.
Collapse
Affiliation(s)
- Maria Clara Fernandes
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Onur Yildirim
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Sungmin Woo
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA.
| | - Hebert Alberto Vargas
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Hedvig Hricak
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| |
Collapse
|
11
|
Bertelli E, Mercatelli L, Marzi C, Pachetti E, Baccini M, Barucci A, Colantonio S, Gherardini L, Lattavo L, Pascali MA, Agostini S, Miele V. Machine and Deep Learning Prediction Of Prostate Cancer Aggressiveness Using Multiparametric MRI. Front Oncol 2022; 11:802964. [PMID: 35096605 PMCID: PMC8792745 DOI: 10.3389/fonc.2021.802964] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Accepted: 12/07/2021] [Indexed: 12/24/2022] Open
Abstract
Prostate cancer (PCa) is the most frequent male malignancy and the assessment of PCa aggressiveness, for which a biopsy is required, is fundamental for patient management. Currently, multiparametric (mp) MRI is strongly recommended before biopsy. Quantitative assessment of mpMRI might provide the radiologist with an objective and noninvasive tool for supporting the decision-making in clinical practice and decreasing intra- and inter-reader variability. In this view, high dimensional radiomics features and Machine Learning (ML) techniques, along with Deep Learning (DL) methods working on raw images directly, could assist the radiologist in the clinical workflow. The aim of this study was to develop and validate ML/DL frameworks on mpMRI data to characterize PCas according to their aggressiveness. We optimized several ML/DL frameworks on T2w, ADC and T2w+ADC data, using a patient-based nested validation scheme. The dataset was composed of 112 patients (132 peripheral lesions with Prostate Imaging Reporting and Data System (PI-RADS) score ≥ 3) acquired following both PI-RADS 2.0 and 2.1 guidelines. Firstly, ML/DL frameworks trained and validated on PI-RADS 2.0 data were tested on both PI-RADS 2.0 and 2.1 data. Then, we trained, validated and tested ML/DL frameworks on a multi PI-RADS dataset. We reported the performances in terms of Area Under the Receiver Operating curve (AUROC), specificity and sensitivity. The ML/DL frameworks trained on T2w data achieved the overall best performance. Notably, ML and DL frameworks trained and validated on PI-RADS 2.0 data obtained median AUROC values equal to 0.750 and 0.875, respectively, on unseen PI-RADS 2.0 test set. Similarly, ML/DL frameworks trained and validated on multi PI-RADS T2w data showed median AUROC values equal to 0.795 and 0.750, respectively, on unseen multi PI-RADS test set. Conversely, all the ML/DL frameworks trained and validated on PI-RADS 2.0 data, achieved AUROC values no better than the chance level when tested on PI-RADS 2.1 data. Both ML/DL techniques applied on mpMRI seem to be a valid aid in predicting PCa aggressiveness. In particular, ML/DL frameworks fed with T2w images data (objective, fast and non-invasive) show good performances and might support decision-making in patient diagnostic and therapeutic management, reducing intra- and inter-reader variability.
Collapse
Affiliation(s)
- Elena Bertelli
- Department of Radiology, Careggi University Hospital, Florence, Italy
| | - Laura Mercatelli
- Department of Radiology, Careggi University Hospital, Florence, Italy
| | - Chiara Marzi
- “Nello Carrara” Institute of Applied Physics (IFAC), National Research Council of Italy (CNR), Sesto Fiorentino, Italy
| | - Eva Pachetti
- “Alessandro Faedo” Institute of Information Science and Technologies (ISTI), National Research Council of Italy (CNR), Pisa, Italy
- Department of Information Engineering (DII), University of Pisa, Pisa, Italy
| | - Michela Baccini
- “Giuseppe Parenti” Department of Statistics, Computer Science, Applications(DiSIA), University of Florence, Florence, Italy
- Florence Center for Data Science, University of Florence, Florence, Italy
| | - Andrea Barucci
- “Nello Carrara” Institute of Applied Physics (IFAC), National Research Council of Italy (CNR), Sesto Fiorentino, Italy
| | - Sara Colantonio
- “Alessandro Faedo” Institute of Information Science and Technologies (ISTI), National Research Council of Italy (CNR), Pisa, Italy
| | - Luca Gherardini
- “Giuseppe Parenti” Department of Statistics, Computer Science, Applications(DiSIA), University of Florence, Florence, Italy
| | - Lorenzo Lattavo
- Department of Radiology, Careggi University Hospital, Florence, Italy
| | - Maria Antonietta Pascali
- “Alessandro Faedo” Institute of Information Science and Technologies (ISTI), National Research Council of Italy (CNR), Pisa, Italy
| | - Simone Agostini
- Department of Radiology, Careggi University Hospital, Florence, Italy
| | - Vittorio Miele
- Department of Radiology, Careggi University Hospital, Florence, Italy
| |
Collapse
|
12
|
Ferro M, de Cobelli O, Musi G, del Giudice F, Carrieri G, Busetto GM, Falagario UG, Sciarra A, Maggi M, Crocetto F, Barone B, Caputo VF, Marchioni M, Lucarelli G, Imbimbo C, Mistretta FA, Luzzago S, Vartolomei MD, Cormio L, Autorino R, Tătaru OS. Radiomics in prostate cancer: an up-to-date review. Ther Adv Urol 2022; 14:17562872221109020. [PMID: 35814914 PMCID: PMC9260602 DOI: 10.1177/17562872221109020] [Citation(s) in RCA: 53] [Impact Index Per Article: 26.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2021] [Accepted: 05/30/2022] [Indexed: 12/24/2022] Open
Abstract
Prostate cancer (PCa) is the most common worldwide diagnosed malignancy in male population. The diagnosis, the identification of aggressive disease, and the post-treatment follow-up needs a more comprehensive and holistic approach. Radiomics is the extraction and interpretation of images phenotypes in a quantitative manner. Radiomics may give an advantage through advancements in imaging modalities and through the potential power of artificial intelligence techniques by translating those features into clinical outcome prediction. This article gives an overview on the current evidence of methodology and reviews the available literature on radiomics in PCa patients, highlighting its potential for personalized treatment and future applications.
Collapse
Affiliation(s)
- Matteo Ferro
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy, via Ripamonti 435 Milano, Italy
| | - Ottavio de Cobelli
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Gennaro Musi
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Francesco del Giudice
- Department of Urology, Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
| | - Giuseppe Carrieri
- Department of Urology and Organ Transplantation, University of Foggia, Foggia, Italy
| | - Gian Maria Busetto
- Department of Urology and Organ Transplantation, University of Foggia, Foggia, Italy
| | | | - Alessandro Sciarra
- Department of Urology, Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
| | - Martina Maggi
- Department of Urology, Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
| | - Felice Crocetto
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Biagio Barone
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Vincenzo Francesco Caputo
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Michele Marchioni
- Department of Medical, Oral and Biotechnological Sciences, G. d’Annunzio, University of Chieti, Chieti, Italy; Urology Unit, ‘SS. Annunziata’ Hospital, Chieti, Italy
- Department of Urology, ASL Abruzzo 2, Chieti, Italy
| | - Giuseppe Lucarelli
- Department of Emergency and Organ Transplantation, Urology, Andrology and Kidney Transplantation Unit, University of Bari, Bari, Italy
| | - Ciro Imbimbo
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Francesco Alessandro Mistretta
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy
- Università degli Studi di Milano, Milan, Italy
| | - Stefano Luzzago
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy
- Università degli Studi di Milano, Milan, Italy
| | - Mihai Dorin Vartolomei
- Department of Cell and Molecular Biology, George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mures, Târgu Mures, Romania
- Department of Urology, Medical University of Vienna, Vienna, Austria
| | - Luigi Cormio
- Urology and Renal Transplantation Unit, Department of Medical and Surgical Sciences, University of Foggia, Foggia, Italy
- Urology Unit, Bonomo Teaching Hospital, Foggia, Italy
| | | | - Octavian Sabin Tătaru
- Institution Organizing University Doctoral Studies, I.O.S.U.D., George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mures, Târgu Mures, Romania
| |
Collapse
|
13
|
Hu L, Wei L, Wang S, Fu C, Benker T, Zhao J. Better lesion conspicuity translates into improved prostate cancer detection: comparison of non-parallel-transmission-zoomed-DWI with conventional-DWI. Abdom Radiol (NY) 2021; 46:5659-5668. [PMID: 34514538 DOI: 10.1007/s00261-021-03268-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 08/31/2021] [Accepted: 09/01/2021] [Indexed: 01/07/2023]
Abstract
PURPOSE To compare advanced non-parallel transmission zoomed diffusion-weighted imaging (nonPTX zoom-DWI) to conventional DWI (conv-DWI) for the assessment of prostate cancer (PCa). METHODS This retrospective study included 98 patients who underwent conv-DWI, nonPTX zoom-DWI, and T2-weighted imaging of the prostate. The image qualities of the two DWI sets, including the distortion of the prostate and the existence of artifacts, were evaluated. To compare the overall PCa and clinically important PCa (ciPCa) detection ability between the sets, lesions were scored using the Prostate Imaging Reporting and Data System (PI-RADS) version 2. Apparent diffusion coefficient (ADC) values of the lesions were also measured and compared. The Mann-Whitney U test was used to compare continuous variables, and the χ2 test was used to compare categorical variables. Two-sided P values of < 0.05 were considered significant. RESULTS Non-PTX zoom-DWI yielded significantly better image quality and image analysis reproducibility than conv-DWI (all P < 0.001). Compared with conv-ADC, nonPTX zoom-ADC showed slightly better detection performance for overall PCa (AUC: 0.827 vs. 0.797; P = 0.55) and ciPCa (AUC: 0.822 vs. 0.749; P = 0.58). At a PI-RADS score of 4 as the cutoff value for PCa prediction, nonPTX zoom-DWI showed significantly higher diagnostic efficiency for overall PCa detection (sensitivity: 87.9% vs. 72.4%; specificity: 87.5% vs. 77.5%; both P < 0.05) and ciPCa detection (sensitivity: 86.3% vs. 74.5%; specificity: 72.3% vs. 63.8%; both P ≤ 0.001). CONCLUSION Non-PTX zoom-DWI yields better image quality and higher PCa detection performance than Conv-DWI.
Collapse
|
14
|
Yousefirizi F, Pierre Decazes, Amyar A, Ruan S, Saboury B, Rahmim A. AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics. PET Clin 2021; 17:183-212. [PMID: 34809866 DOI: 10.1016/j.cpet.2021.09.010] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.
Collapse
Affiliation(s)
- Fereshteh Yousefirizi
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, British Columbia V5Z 1L3, Canada.
| | - Pierre Decazes
- Department of Nuclear Medicine, Henri Becquerel Centre, Rue d'Amiens - CS 11516 - 76038 Rouen Cedex 1, France; QuantIF-LITIS, Faculty of Medicine and Pharmacy, Research Building - 1st floor, 22 boulevard Gambetta, 76183 Rouen Cedex, France
| | - Amine Amyar
- QuantIF-LITIS, Faculty of Medicine and Pharmacy, Research Building - 1st floor, 22 boulevard Gambetta, 76183 Rouen Cedex, France; General Electric Healthcare, Buc, France
| | - Su Ruan
- QuantIF-LITIS, Faculty of Medicine and Pharmacy, Research Building - 1st floor, 22 boulevard Gambetta, 76183 Rouen Cedex, France
| | - Babak Saboury
- Department of Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA; Department of Computer Science and Electrical Engineering, University of Maryland, Baltimore County, Baltimore, MD, USA; Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA, USA
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, British Columbia V5Z 1L3, Canada; Department of Radiology, University of British Columbia, Vancouver, British Columbia, Canada; Department of Physics, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
15
|
Ghezzo S, Bezzi C, Presotto L, Mapelli P, Bettinardi V, Savi A, Neri I, Preza E, Samanes Gajate AM, De Cobelli F, Scifo P, Picchio M. State of the art of radiomic analysis in the clinical management of prostate cancer: A systematic review. Crit Rev Oncol Hematol 2021; 169:103544. [PMID: 34801699 DOI: 10.1016/j.critrevonc.2021.103544] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 10/18/2021] [Accepted: 10/18/2021] [Indexed: 02/04/2023] Open
Abstract
We present the current clinical applications of radiomics in the context of prostate cancer (PCa) management. Several online databases for original articles using a combination of the following keywords: "(radiomic or radiomics) AND (prostate cancer or prostate tumour or prostate tumor or prostate neoplasia)" have been searched. The selected papers have been pooled as focus on (i) PCa detection, (ii) assessing the clinical significance of PCa, (iii) biochemical recurrence prediction, (iv) radiation-therapy outcome prediction and treatment efficacy monitoring, (v) metastases detection, (vi) metastases prediction, (vii) prediction of extra-prostatic extension. Seventy-six studies were included for qualitative analyses. Classifiers powered with radiomic features were able to discriminate between healthy tissue and PCa and between low- and high-risk PCa. However, before radiomics can be proposed for clinical use its methods have to be standardized, and these first encouraging results need to be robustly replicated in large and independent cohorts.
Collapse
Affiliation(s)
| | | | - Luca Presotto
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Paola Mapelli
- Vita-Salute San Raffaele University, Milan, Italy; Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Valentino Bettinardi
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Annarita Savi
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Ilaria Neri
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Erik Preza
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | | | - Francesco De Cobelli
- Vita-Salute San Raffaele University, Milan, Italy; Radiology Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Paola Scifo
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Maria Picchio
- Vita-Salute San Raffaele University, Milan, Italy; Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy.
| |
Collapse
|
16
|
Machine Learning: Applications and Advanced Progresses of Radiomics in Endocrine Neoplasms. JOURNAL OF ONCOLOGY 2021; 2021:8615450. [PMID: 34671399 PMCID: PMC8523238 DOI: 10.1155/2021/8615450] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Revised: 07/13/2021] [Accepted: 09/20/2021] [Indexed: 12/24/2022]
Abstract
Endocrine neoplasms remain a great threat to human health. It is extremely important to make a clear diagnosis and timely treatment of endocrine tumors. Machine learning includes radiomics, which has long been utilized in clinical cancer research. Radiomics refers to the extraction of valuable information by analyzing a large amount of standard data with high-throughput medical images mainly including computed tomography, positron emission tomography, magnetic resonance imaging, and ultrasound. With the quantitative imaging analysis and model building, radiomics can reflect specific underlying characteristics of a disease that otherwise could not be evaluated visually. More and more promising results of radiomics in oncological practice have been seen in recent years. Radiomics may have the potential to supplement traditional imaging analysis and assist in providing precision medicine for patients. Radiomics had developed rapidly in endocrine neoplasms practice in the past decade. In this review, we would introduce the general workflow of radiomics and summarize the applications and developments of radiomics in endocrine neoplasms in recent years. The limitations of current radiomic research studies and future development directions would also be discussed.
Collapse
|
17
|
Prostate Cancer Radiogenomics-From Imaging to Molecular Characterization. Int J Mol Sci 2021; 22:ijms22189971. [PMID: 34576134 PMCID: PMC8465891 DOI: 10.3390/ijms22189971] [Citation(s) in RCA: 51] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 09/06/2021] [Accepted: 09/10/2021] [Indexed: 12/24/2022] Open
Abstract
Radiomics and genomics represent two of the most promising fields of cancer research, designed to improve the risk stratification and disease management of patients with prostate cancer (PCa). Radiomics involves a conversion of imaging derivate quantitative features using manual or automated algorithms, enhancing existing data through mathematical analysis. This could increase the clinical value in PCa management. To extract features from imaging methods such as magnetic resonance imaging (MRI), the empiric nature of the analysis using machine learning and artificial intelligence could help make the best clinical decisions. Genomics information can be explained or decoded by radiomics. The development of methodologies can create more-efficient predictive models and can better characterize the molecular features of PCa. Additionally, the identification of new imaging biomarkers can overcome the known heterogeneity of PCa, by non-invasive radiological assessment of the whole specific organ. In the future, the validation of recent findings, in large, randomized cohorts of PCa patients, can establish the role of radiogenomics. Briefly, we aimed to review the current literature of highly quantitative and qualitative results from well-designed studies for the diagnoses, treatment, and follow-up of prostate cancer, based on radiomics, genomics and radiogenomics research.
Collapse
|
18
|
Sakai K. [2. Radiomics of MRI]. Nihon Hoshasen Gijutsu Gakkai Zasshi 2021; 77:866-875. [PMID: 34421076 DOI: 10.6009/jjrt.2021_jsrt_77.8.866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Koji Sakai
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine
| |
Collapse
|
19
|
A Comprehensive Study of Data Augmentation Strategies for Prostate Cancer Detection in Diffusion-Weighted MRI Using Convolutional Neural Networks. J Digit Imaging 2021; 34:862-876. [PMID: 34254200 DOI: 10.1007/s10278-021-00478-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Revised: 02/12/2021] [Accepted: 06/21/2021] [Indexed: 12/14/2022] Open
Abstract
Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies and their combinations have been investigated for various computer vision tasks in the context of deep learning, a specific work in the domain of medical imaging is rare and to the best of our knowledge, there has been no dedicated work on exploring the effects of various augmentation methods on the performance of deep learning models in prostate cancer detection. In this work, we have statically applied five most frequently used augmentation techniques (random rotation, horizontal flip, vertical flip, random crop, and translation) to prostate diffusion-weighted magnetic resonance imaging training dataset of 217 patients separately and evaluated the effect of each method on the accuracy of prostate cancer detection. The augmentation algorithms were applied independently to each data channel and a shallow as well as a deep convolutional neural network (CNN) was trained on the five augmented sets separately. We used area under receiver operating characteristic (ROC) curve (AUC) to evaluate the performance of the trained CNNs on a separate test set of 95 patients, using a validation set of 102 patients for finetuning. The shallow network outperformed the deep network with the best 2D slice-based AUC of 0.85 obtained by the rotation method.
Collapse
|
20
|
Spohn SK, Bettermann AS, Bamberg F, Benndorf M, Mix M, Nicolay NH, Fechter T, Hölscher T, Grosu R, Chiti A, Grosu AL, Zamboglou C. Radiomics in prostate cancer imaging for a personalized treatment approach - current aspects of methodology and a systematic review on validated studies. Theranostics 2021; 11:8027-8042. [PMID: 34335978 PMCID: PMC8315055 DOI: 10.7150/thno.61207] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Accepted: 06/17/2021] [Indexed: 12/14/2022] Open
Abstract
Prostate cancer (PCa) is one of the most frequently diagnosed malignancies of men in the world. Due to a variety of treatment options in different risk groups, proper diagnostic and risk stratification is pivotal in treatment of PCa. The development of precise medical imaging procedures simultaneously to improvements in big data analysis has led to the establishment of radiomics - a computer-based method of extracting and analyzing image features quantitatively. This approach bears the potential to assess and improve PCa detection, tissue characterization and clinical outcome prediction. This article gives an overview on the current aspects of methodology and systematically reviews available literature on radiomics in PCa patients, showing its potential for personalized therapy approaches. The qualitative synthesis includes all imaging modalities and focuses on validated studies, putting forward future directions.
Collapse
Affiliation(s)
- Simon K.B. Spohn
- Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
- German Cancer Consortium (DKTK). Partner Site Freiburg, Germany
- Berta-Ottenstein-Programme, Faculty of Medicine, University of Freiburg, Germany
| | - Alisa S. Bettermann
- Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
| | - Fabian Bamberg
- Department of Radiology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
| | - Matthias Benndorf
- Department of Radiology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
| | - Michael Mix
- Department of Nuclear Medicine, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
| | - Nils H. Nicolay
- Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
- German Cancer Consortium (DKTK). Partner Site Freiburg, Germany
| | - Tobias Fechter
- Department of Radiation Oncology - Division of Medical Physics, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
| | - Tobias Hölscher
- Radiotherapy and Radiation Oncology, Faculty of Medicine and University Hospital Carl Gustav Carus, Technische Universität Dresden
- OncoRay-National Center for Radiation Research in Oncology, Faculty of Medicine and University Hospital Carl Gustav Carus, Technische Universität Dresden, Helmholtz-Zentrum Dresden-Rossendorf, Dresden, Germany
| | - Radu Grosu
- Institute of Computer Engineering, Vienne University of Technology, Vienna, Austria
| | - Arturo Chiti
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, 20090 Pieve Emanuele - Milan, Italy
- IRCCS Humanitas Research Hospital, Via Manzoni 56, 20089 Rozzano - Milan, Italy
| | - Anca L. Grosu
- Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
- German Cancer Consortium (DKTK). Partner Site Freiburg, Germany
| | - Constantinos Zamboglou
- Department of Radiation Oncology, Medical Center - University of Freiburg, Faculty of Medicine. University of Freiburg, Germany
- German Cancer Consortium (DKTK). Partner Site Freiburg, Germany
- Berta-Ottenstein-Programme, Faculty of Medicine, University of Freiburg, Germany
- German Oncology Center, European University of Cyprus, Limassol, Cyprus
| |
Collapse
|
21
|
Ma S, Xie H, Wang H, Yang J, Han C, Wang X, Zhang X. Preoperative Prediction of Extracapsular Extension: Radiomics Signature Based on Magnetic Resonance Imaging to Stage Prostate Cancer. Mol Imaging Biol 2021; 22:711-721. [PMID: 31321651 DOI: 10.1007/s11307-019-01405-7] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
PURPOSE To investigate and validate the potential role of a radiomics signature in predicting the side-specific probability of extracapsular extension (ECE) of prostate cancer (PCa). PROCEDURES The preoperative magnetic resonance imaging data of 238 prostatic samples from 119 enrolled PCa patients were retrospectively assessed. The samples with were randomized in a two-to-one ratio into training (n = 74) and validation (n = 45) datasets. The radiomics features were derived from T2-weighted images (T2WIs). The optimal radiomics features were identified from the least absolute shrinkage and selection operator (LASSO) logistic regression model and were used to construct a predictive radiomics signature via dimension reduction and selection approaches. The association between the radiomics signatures and pathological ECE status was explored. Receiver operating characteristic (ROC) analysis was used to assess the discriminatory ability of the signature. The calibration performance and clinical usefulness of the radiomics signature were subsequently assessed by calibration curve and decision curve analyses. RESULTS The proposed radiomics signature that incorporated 17 selected radiomics features was significantly associated with pathological ECE outcomes (P < 0.001) in both the training and validation datasets. The constructed model displayed good discrimination, with areas under the curve (AUC) of 0.906 (95 % confidence interval (CI), 0.847, 0.948) and 0.821 (95 % CI, 0.726, 0.894) for the training and validation datasets, respectively, and had a good calibration performance. The clinical utility of this model was confirmed through decision curve analysis. CONCLUSIONS The radiomics signature based on T2WIs showed the potential to predict the side-specific probability of pathological ECE status and can facilitate the preoperative individualized predictions for PCa patients.
Collapse
Affiliation(s)
- Shuai Ma
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China
| | - Huihui Xie
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China
| | - Huihui Wang
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China
| | - Jiejin Yang
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China
| | - Chao Han
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China
| | - Xiaoying Wang
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China
| | - Xiaodong Zhang
- Department of Radiology, Peking University First Hospital, 8 Xishiku Street, Xicheng District, Beijing, 100034, China.
| |
Collapse
|
22
|
Twilt JJ, van Leeuwen KG, Huisman HJ, Fütterer JJ, de Rooij M. Artificial Intelligence Based Algorithms for Prostate Cancer Classification and Detection on Magnetic Resonance Imaging: A Narrative Review. Diagnostics (Basel) 2021; 11:diagnostics11060959. [PMID: 34073627 PMCID: PMC8229869 DOI: 10.3390/diagnostics11060959] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 05/19/2021] [Accepted: 05/21/2021] [Indexed: 12/14/2022] Open
Abstract
Due to the upfront role of magnetic resonance imaging (MRI) for prostate cancer (PCa) diagnosis, a multitude of artificial intelligence (AI) applications have been suggested to aid in the diagnosis and detection of PCa. In this review, we provide an overview of the current field, including studies between 2018 and February 2021, describing AI algorithms for (1) lesion classification and (2) lesion detection for PCa. Our evaluation of 59 included studies showed that most research has been conducted for the task of PCa lesion classification (66%) followed by PCa lesion detection (34%). Studies showed large heterogeneity in cohort sizes, ranging between 18 to 499 patients (median = 162) combined with different approaches for performance validation. Furthermore, 85% of the studies reported on the stand-alone diagnostic accuracy, whereas 15% demonstrated the impact of AI on diagnostic thinking efficacy, indicating limited proof for the clinical utility of PCa AI applications. In order to introduce AI within the clinical workflow of PCa assessment, robustness and generalizability of AI applications need to be further validated utilizing external validation and clinical workflow experiments.
Collapse
|
23
|
TCGA-TCIA-Based CT Radiomics Study for Noninvasively Predicting Epstein-Barr Virus Status in Gastric Cancer. AJR Am J Roentgenol 2021; 217:124-134. [PMID: 33955777 DOI: 10.2214/ajr.20.23534] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
OBJECTIVE. The purpose of this study was to investigate the value of TCGA-TCIA (The Cancer Genome Atlas and The Cancer Imaging Archive)-based CT radiomics for noninvasive prediction of Epstein-Barr virus (EBV) status in gastric cancer (GC). MATERIALS AND METHODS. A total of 133 patients with pathologically confirmed GC (94 in the training cohort and 39 in the validation cohort) who were identified from the TCGA-TCIA public data repository and two hospitals were retrospectively enrolled in the study. Two-dimensional and 3D radiomics features were extracted to construct corresponding radiomics signatures. Then, 2D and 3D nomograms were built by combining radiomics signatures and clinical information on the basis of multivariable analysis. Their performance and clinical practicability were determined, validated, and compared with respect to discrimination, calibration, reclassification, and time spent on tumor segmentation. RESULTS. Both 2D and 3D nomograms were robust and showed good calibration. The AUCs of the 2D and 3D nomograms showed no significant difference in the training cohort (0.919 vs 0.945, respectively; p = .41) or validation cohort (0.939 vs 0.955, respectively; p = .71). The net reclassification index showed that the 3D nomogram revealed no significant improvement in risk reclassification when compared with the 2D nomogram in the training cohort (net reclassification index, 0.68%; p = .14) and the validation cohort (net reclassification index, 6.06%; p = .08). Of note, the time spent on 3D segmentation (median, 907 seconds) was higher than that spent on 2D segmentation (median, 129 seconds). CONCLUSION. The 2D and 3D radiomics nomograms might have the potential to be used as effective tools for prediction of EBV in GC. When time spent on segmentation is considered, the 2D nomogram is more highly recommended for clinical application.
Collapse
|
24
|
Cutaia G, La Tona G, Comelli A, Vernuccio F, Agnello F, Gagliardo C, Salvaggio L, Quartuccio N, Sturiale L, Stefano A, Calamia M, Arnone G, Midiri M, Salvaggio G. Radiomics and Prostate MRI: Current Role and Future Applications. J Imaging 2021; 7:jimaging7020034. [PMID: 34460633 PMCID: PMC8321264 DOI: 10.3390/jimaging7020034] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 02/07/2021] [Accepted: 02/08/2021] [Indexed: 02/07/2023] Open
Abstract
Multiparametric prostate magnetic resonance imaging (mpMRI) is widely used as a triage test for men at a risk of prostate cancer. However, the traditional role of mpMRI was confined to prostate cancer staging. Radiomics is the quantitative extraction and analysis of minable data from medical images; it is emerging as a promising tool to detect and categorize prostate lesions. In this paper we review the role of radiomics applied to prostate mpMRI in detection and localization of prostate cancer, prediction of Gleason score and PI-RADS classification, prediction of extracapsular extension and of biochemical recurrence. We also provide a future perspective of artificial intelligence (machine learning and deep learning) applied to the field of prostate cancer.
Collapse
Affiliation(s)
- Giuseppe Cutaia
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Giuseppe La Tona
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Albert Comelli
- Ri.Med Foundation, Via Bandiera 11, 90133 Palermo, Italy;
| | - Federica Vernuccio
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Francesco Agnello
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Cesare Gagliardo
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Leonardo Salvaggio
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
- Correspondence:
| | - Natale Quartuccio
- Nuclear Medicine Unit, ARNAS Ospedali Civico, Di Cristina e Benfratelli, 90133 Palermo, Italy; (N.Q.); (L.S.); (G.A.)
| | - Letterio Sturiale
- Nuclear Medicine Unit, ARNAS Ospedali Civico, Di Cristina e Benfratelli, 90133 Palermo, Italy; (N.Q.); (L.S.); (G.A.)
| | - Alessandro Stefano
- Institute of Molecular Bioimaging and Physiology, National Research Council (IBFM-CNR), 90015 Cefalù, Italy;
| | - Mauro Calamia
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Gaspare Arnone
- Nuclear Medicine Unit, ARNAS Ospedali Civico, Di Cristina e Benfratelli, 90133 Palermo, Italy; (N.Q.); (L.S.); (G.A.)
| | - Massimo Midiri
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| | - Giuseppe Salvaggio
- Section of Radiology, BiND, University Hospital “Paolo Giaccone”, University of Palermo, Via del Vespro 129, 90127 Palermo, Italy; (G.C.); (G.L.T.); (F.V.); (F.A.); (C.G.); (M.C.); (M.M.); (G.S.)
| |
Collapse
|
25
|
Magnetic Resonance Imaging Based Radiomic Models of Prostate Cancer: A Narrative Review. Cancers (Basel) 2021; 13:cancers13030552. [PMID: 33535569 PMCID: PMC7867056 DOI: 10.3390/cancers13030552] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Revised: 01/18/2021] [Accepted: 01/27/2021] [Indexed: 12/11/2022] Open
Abstract
Simple Summary The increasing interest in implementing artificial intelligence in radiomic models has occurred alongside advancement in the tools used for computer-aided diagnosis. Such tools typically apply both statistical and machine learning methodologies to assess the various modalities used in medical image analysis. Specific to prostate cancer, the radiomics pipeline has multiple facets that are amenable to improvement. This review discusses the steps of a magnetic resonance imaging based radiomics pipeline. Present successes, existing opportunities for refinement, and the most pertinent pending steps leading to clinical validation are highlighted. Abstract The management of prostate cancer (PCa) is dependent on biomarkers of biological aggression. This includes an invasive biopsy to facilitate a histopathological assessment of the tumor’s grade. This review explores the technical processes of applying magnetic resonance imaging based radiomic models to the evaluation of PCa. By exploring how a deep radiomics approach further optimizes the prediction of a PCa’s grade group, it will be clear how this integration of artificial intelligence mitigates existing major technological challenges faced by a traditional radiomic model: image acquisition, small data sets, image processing, labeling/segmentation, informative features, predicting molecular features and incorporating predictive models. Other potential impacts of artificial intelligence on the personalized treatment of PCa will also be discussed. The role of deep radiomics analysis-a deep texture analysis, which extracts features from convolutional neural networks layers, will be highlighted. Existing clinical work and upcoming clinical trials will be reviewed, directing investigators to pertinent future directions in the field. For future progress to result in clinical translation, the field will likely require multi-institutional collaboration in producing prospectively populated and expertly labeled imaging libraries.
Collapse
|
26
|
Radiomics in radiation oncology-basics, methods, and limitations. Strahlenther Onkol 2020; 196:848-855. [PMID: 32647917 PMCID: PMC7498498 DOI: 10.1007/s00066-020-01663-3] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2020] [Accepted: 06/22/2020] [Indexed: 12/19/2022]
Abstract
Over the past years, the quantity and complexity of imaging data available for the clinical management of patients with solid tumors has increased substantially. Without the support of methods from the field of artificial intelligence (AI) and machine learning, a complete evaluation of the available image information is hardly feasible in clinical routine. Especially in radiotherapy planning, manual detection and segmentation of lesions is laborious, time consuming, and shows significant variability among observers. Here, AI already offers techniques to support radiation oncologists, whereby ultimately, the productivity and the quality are increased, potentially leading to an improved patient outcome. Besides detection and segmentation of lesions, AI allows the extraction of a vast number of quantitative imaging features from structural or functional imaging data that are typically not accessible by means of human perception. These features can be used alone or in combination with other clinical parameters to generate mathematical models that allow, for example, prediction of the response to radiotherapy. Within the large field of AI, radiomics is the subdiscipline that deals with the extraction of quantitative image features as well as the generation of predictive or prognostic mathematical models. This review gives an overview of the basics, methods, and limitations of radiomics, with a focus on patients with brain tumors treated by radiation therapy.
Collapse
|
27
|
Using decision curve analysis to benchmark performance of a magnetic resonance imaging-based deep learning model for prostate cancer risk assessment. Eur Radiol 2020; 30:6867-6876. [PMID: 32591889 DOI: 10.1007/s00330-020-07030-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Accepted: 06/10/2020] [Indexed: 10/24/2022]
Abstract
OBJECTIVES To benchmark the performance of a calibrated 3D convolutional neural network (CNN) applied to multiparametric MRI (mpMRI) for risk assessment of clinically significant prostate cancer (csPCa) using decision curve analysis (DCA). METHODS We retrospectively analyzed 499 patients who had positive mpMRI (PI-RADSv2 ≥ 3) and MRI-targeted biopsy. The training cohort comprised 449 men, including a calibration set of 50 men. Biopsy decision strategies included using risk estimates from the CNN (original and calibrated), to perform biopsy in men with PI-RADSv2 ≥ 4 only, or additionally in men with PI-RADSv2 3 and PSA density (PSAd) ≥ 0.15 ng/ml/ml. Discrimination, calibration and clinical usefulness in the unseen test cohort (n = 50) were assessed using C-statistic, calibration plots and DCA, respectively. RESULTS The calibrated CNN achieved moderate calibration (Hosmer-Lemeshow calibration test, p = 0.41) and good discrimination (C = 0.85). DCA revealed consistently higher net benefit and net reduction in biopsies for the calibrated CNN compared with the original CNN, PI-RADSv2 ≥ 4 and the combined strategy of PI-RADSv2 and PSAd. Original CNN predictions were severely miscalibrated (p < 0.0001) resulting in net harm compared with a 'biopsy all' patients strategy. At-risk thresholds ≥ 10% using the calibrated CNN and the combined strategy reduced the number of biopsies by an estimated 201 and 55 men, respectively, per 1000 men at risk, without missing csPCa, while original CNN and PI-RADSv2 ≥ 4 could not achieve a net reduction in biopsies. CONCLUSIONS DCA revealed that our calibrated 3D-CNN resulted in fewer unnecessary biopsies compared with using PI-RADSv2 alone or in combination with PSAd. CNN calibration is important in achieving clinical utility. KEY POINTS • A 3D deep learning model applied to multiparametric MRI may help to prevent unnecessary prostate biopsies in patients eligible for MRI-targeted biopsy. • Owing to miscalibration, original risk estimates by the deep learning model require prior calibration to enable clinical utility. • Decision curve analysis confirmed a net benefit of using our calibrated deep learning model for biopsy decisions compared with alternative strategies, including PI-RADSv2 alone and in combination with prostate-specific antigen density.
Collapse
|
28
|
Stanzione A, Gambardella M, Cuocolo R, Ponsiglione A, Romeo V, Imbriaco M. Prostate MRI radiomics: A systematic review and radiomic quality score assessment. Eur J Radiol 2020; 129:109095. [PMID: 32531722 DOI: 10.1016/j.ejrad.2020.109095] [Citation(s) in RCA: 76] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 05/20/2020] [Accepted: 05/25/2020] [Indexed: 12/24/2022]
Abstract
BACKGROUND Radiomics have the potential to further increase the value of MRI in prostate cancer management. However, implementation in clinical practice is still far and concerns have been raised regarding the methodological quality of radiomic studies. Therefore, we aimed to systematically review the literature to assess the quality of prostate MRI radiomic studies using the radiomics quality score (RQS). METHODS Multiple medical literature archives (PubMed, Web of Science and EMBASE) were searched to retrieve original investigations focused on prostate MRI radiomic approaches up to the end of June 2019. Three researchers independently assessed each paper using the RQS. Data from the most experienced researcher were used for descriptive analysis. Inter-rater reproducibility was assessed using the intraclass correlation coefficient (ICC) on the total RQS score. RESULTS 73 studies were included in the analysis. Overall, the average RQS total score was 7.93 ± 5.13 on a maximum of 36 points, with a final average percentage of 23 ± 13%. Among the most critical items, the lack of feature robustness testing strategies and external validation datasets. The ICC resulted poor to moderate, with an average value of 0.57 and 95% Confidence Intervals between 0.44 and 0.69. CONCLUSIONS Current studies on prostate MRI radiomics still lack the quality required to allow their introduction in clinical practice.
Collapse
Affiliation(s)
- Arnaldo Stanzione
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131, Naples, Italy
| | - Michele Gambardella
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131, Naples, Italy
| | - Renato Cuocolo
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131, Naples, Italy.
| | - Andrea Ponsiglione
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131, Naples, Italy
| | - Valeria Romeo
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131, Naples, Italy
| | - Massimo Imbriaco
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131, Naples, Italy
| |
Collapse
|
29
|
Implementation of eHealth and AI integrated diagnostics with multidisciplinary digitized data: are we ready from an international perspective? Eur Radiol 2020; 30:5510-5524. [PMID: 32377810 PMCID: PMC7476980 DOI: 10.1007/s00330-020-06874-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2019] [Revised: 03/18/2020] [Accepted: 04/08/2020] [Indexed: 12/18/2022]
Abstract
Digitization of medicine requires systematic handling of the increasing amount of health data to improve medical diagnosis. In this context, the integration of the versatile diagnostic information, e.g., from anamnesis, imaging, histopathology, and clinical chemistry, and its comprehensive analysis by artificial intelligence (AI)–based tools is expected to improve diagnostic precision and the therapeutic conduct. However, the complex medical environment poses a major obstacle to the translation of integrated diagnostics into clinical research and routine. There is a high need to address aspects like data privacy, data integration, interoperability standards, appropriate IT infrastructure, and education of staff. Besides this, a plethora of technical, political, and ethical challenges exists. This is complicated by the high diversity of approaches across Europe. Thus, we here provide insights into current international activities on the way to digital comprehensive diagnostics. This includes a technical view on challenges and solutions for comprehensive diagnostics in terms of data integration and analysis. Current data communications standards and common IT solutions that are in place in hospitals are reported. Furthermore, the international hospital digitalization scoring and the European funding situation were analyzed. In addition, the regional activities in radiomics and the related publication trends are discussed. Our findings show that prerequisites for comprehensive diagnostics have not yet been sufficiently established throughout Europe. The manifold activities are characterized by a heterogeneous digitization progress and they are driven by national efforts. This emphasizes the importance of clear governance, concerted investments, and cooperation at various levels in the health systems. Key Points • Europe is characterized by heterogeneity in its digitization progress with predominantly national efforts. Infrastructural prerequisites for comprehensive diagnostics are not given and not sufficiently funded throughout Europe, which is particularly true for data integration. • The clinical establishment of comprehensive diagnostics demands for a clear governance, significant investments, and cooperation at various levels in the healthcare systems. • While comprehensive diagnostics is on its way, concerted efforts should be taken in Europe to get consensus concerning interoperability and standards, security, and privacy as well as ethical and legal concerns.
Collapse
|
30
|
Murakami Y, Magome T, Matsumoto K, Sato T, Yoshioka Y, Oguchi M. Fully automated dose prediction using generative adversarial networks in prostate cancer patients. PLoS One 2020; 15:e0232697. [PMID: 32365088 PMCID: PMC7197852 DOI: 10.1371/journal.pone.0232697] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2020] [Accepted: 04/19/2020] [Indexed: 12/20/2022] Open
Abstract
Purpose Although dose prediction for intensity modulated radiation therapy (IMRT) has been accomplished by a deep learning approach, delineation of some structures is needed for the prediction. We sought to develop a fully automated dose-generation framework for IMRT of prostate cancer by entering the patient CT datasets without the contour information into a generative adversarial network (GAN) and to compare its prediction performance to a conventional prediction model trained from patient contours. Methods We propose a synthetic approach to translate patient CT datasets into a dose distribution for IMRT. The framework requires only paired-images, i.e., patient CT images and corresponding RT-doses. The model was trained from 81 IMRT plans of prostate cancer patients, and then produced the dose distribution for 9 test cases. To compare its prediction performance to that of another trained model, we created a model trained from structure images. Dosimetric parameters for the planning target volume (PTV) and organs at risk (OARs) were calculated from the generated and original dose distributions, and mean differences of dosimetric parameters were compared between the CT-based model and the structure-based model. Results The mean differences of all dosimetric parameters except for D98% and D95% for PTV were within approximately 2% and 3% of the prescription dose for OARs in the CT-based model, while the differences in the structure-based model were within approximately 1% for PTV and approximately 2% for OARs, with a mean prediction time of 5 seconds per patient. Conclusions Accurate and rapid dose prediction was achieved by the learning of patient CT datasets by a GAN-based framework. The CT-based dose prediction could reduce the time required for both the iterative optimization process and the structure contouring, allowing physicians and dosimetrists to focus their expertise on more challenging cases.
Collapse
Affiliation(s)
- Yu Murakami
- Graduate Division of Health Sciences, Komazawa University, Komazawa, Setagaya-ku, Tokyo, Japan
- Radiation Oncology Department, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Ariake, Koto-ku, Tokyo, Japan
| | - Taiki Magome
- Graduate Division of Health Sciences, Komazawa University, Komazawa, Setagaya-ku, Tokyo, Japan
- * E-mail:
| | - Kazuki Matsumoto
- Graduate Division of Health Sciences, Komazawa University, Komazawa, Setagaya-ku, Tokyo, Japan
| | - Tomoharu Sato
- Radiation Oncology Department, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Ariake, Koto-ku, Tokyo, Japan
| | - Yasuo Yoshioka
- Radiation Oncology Department, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Ariake, Koto-ku, Tokyo, Japan
| | - Masahiko Oguchi
- Radiation Oncology Department, Cancer Institute Hospital, Japanese Foundation for Cancer Research, Ariake, Koto-ku, Tokyo, Japan
| |
Collapse
|
31
|
Effects of MRI image normalization techniques in prostate cancer radiomics. Phys Med 2020; 71:7-13. [PMID: 32086149 DOI: 10.1016/j.ejmp.2020.02.007] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Revised: 01/15/2020] [Accepted: 02/07/2020] [Indexed: 12/16/2022] Open
Abstract
The variance in intensities of MRI scans is a fundamental impediment for quantitative MRI analysis. Intensity values are not only highly dependent on acquisition parameters, but also on the subject and body region being scanned. This warrants the need for image normalization techniques to ensure that intensity values are consistent within tissues across different subjects and visits. Many intensity normalization methods have been developed and proven successful for the analysis of brain pathologies, but evaluation of these methods for images of the prostate region is lagging. In this paper, we compare four different normalization methods on 49 T2-w scans of prostate cancer patients: 1) the well-established histogram normalization, 2) the generalized scale normalization, 3) an extension of generalized scale normalization called generalized ball-scale normalization, and 4) a custom normalization based on healthy prostate tissue intensities. The methods are compared qualitatively and quantitatively in terms of behaviors of intensity distributions as well as impact on radiomic features. Our findings suggest that normalization based on prior knowledge of the healthy prostate tissue intensities may be the most effective way of acquiring the desired properties of normalized images. In addition, the histogram normalization method outperform the generalized scale and generalized ball-scale methods which have proven superior for other body regions.
Collapse
|
32
|
Yoo S, Gujrathi I, Haider MA, Khalvati F. Prostate Cancer Detection using Deep Convolutional Neural Networks. Sci Rep 2019; 9:19518. [PMID: 31863034 PMCID: PMC6925141 DOI: 10.1038/s41598-019-55972-4] [Citation(s) in RCA: 81] [Impact Index Per Article: 16.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Accepted: 12/02/2019] [Indexed: 12/13/2022] Open
Abstract
Prostate cancer is one of the most common forms of cancer and the third leading cause of cancer death in North America. As an integrated part of computer-aided detection (CAD) tools, diffusion-weighted magnetic resonance imaging (DWI) has been intensively studied for accurate detection of prostate cancer. With deep convolutional neural networks (CNNs) significant success in computer vision tasks such as object detection and segmentation, different CNN architectures are increasingly investigated in medical imaging research community as promising solutions for designing more accurate CAD tools for cancer detection. In this work, we developed and implemented an automated CNN-based pipeline for detection of clinically significant prostate cancer (PCa) for a given axial DWI image and for each patient. DWI images of 427 patients were used as the dataset, which contained 175 patients with PCa and 252 patients without PCa. To measure the performance of the proposed pipeline, a test set of 108 (out of 427) patients were set aside and not used in the training phase. The proposed pipeline achieved area under the receiver operating characteristic curve (AUC) of 0.87 (95[Formula: see text] Confidence Interval (CI): 0.84-0.90) and 0.84 (95[Formula: see text] CI: 0.76-0.91) at slice level and patient level, respectively.
Collapse
Affiliation(s)
- Sunghwan Yoo
- Lunenfeld-Tanenbaum Research Institute, Sinai Health System, Toronto, ON, Canada
| | - Isha Gujrathi
- Lunenfeld-Tanenbaum Research Institute, Sinai Health System, Toronto, ON, Canada
| | - Masoom A Haider
- Lunenfeld-Tanenbaum Research Institute, Sinai Health System, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
- Sunnybrook Research Institute, Toronto, ON, Canada
| | - Farzad Khalvati
- Lunenfeld-Tanenbaum Research Institute, Sinai Health System, Toronto, ON, Canada.
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada.
- Department of Medical Imaging, University of Toronto, Toronto, ON, Canada.
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
33
|
Multiparametric MRI and auto-fixed volume of interest-based radiomics signature for clinically significant peripheral zone prostate cancer. Eur Radiol 2019; 30:1313-1324. [PMID: 31776744 PMCID: PMC7033141 DOI: 10.1007/s00330-019-06488-y] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Revised: 08/28/2019] [Accepted: 10/09/2019] [Indexed: 12/22/2022]
Abstract
Objectives To create a radiomics approach based on multiparametric magnetic resonance imaging (mpMRI) features extracted from an auto-fixed volume of interest (VOI) that quantifies the phenotype of clinically significant (CS) peripheral zone (PZ) prostate cancer (PCa). Methods This study included 206 patients with 262 prospectively called mpMRI prostate imaging reporting and data system 3–5 PZ lesions. Gleason scores > 6 were defined as CS PCa. Features were extracted with an auto-fixed 12-mm spherical VOI placed around a pin point in each lesion. The value of dynamic contrast-enhanced imaging(DCE), multivariate feature selection and extreme gradient boosting (XGB) vs. univariate feature selection and random forest (RF), expert-based feature pre-selection, and the addition of image filters was investigated using the training (171 lesions) and test (91 lesions) datasets. Results The best model with features from T2-weighted (T2-w) + diffusion-weighted imaging (DWI) + DCE had an area under the curve (AUC) of 0.870 (95% CI 0.980–0.754). Removal of DCE features decreased AUC to 0.816 (95% CI 0.920–0.710), although not significantly (p = 0.119). Multivariate and XGB outperformed univariate and RF (p = 0.028). Expert-based feature pre-selection and image filters had no significant contribution. Conclusions The phenotype of CS PZ PCa lesions can be quantified using a radiomics approach based on features extracted from T2-w + DWI using an auto-fixed VOI. Although DCE features improve diagnostic performance, this is not statistically significant. Multivariate feature selection and XGB should be preferred over univariate feature selection and RF. The developed model may be a valuable addition to traditional visual assessment in diagnosing CS PZ PCa. Key Points • T2-weighted and diffusion-weighted imaging features are essential components of a radiomics model for clinically significant prostate cancer; addition of dynamic contrast-enhanced imaging does not significantly improve diagnostic performance. • Multivariate feature selection and extreme gradient outperform univariate feature selection and random forest. • The developed radiomics model that extracts multiparametric MRI features with an auto-fixed volume of interest may be a valuable addition to visual assessment in diagnosing clinically significant prostate cancer. Electronic supplementary material The online version of this article (10.1007/s00330-019-06488-y) contains supplementary material, which is available to authorized users.
Collapse
|