MPCaD: a multi-scale radiomics-driven framework for automated prostate cancer localization and detection

Detecting MRI-Invisible Prostate Cancers Using a Weakly Supervised Deep Learning Model

Background

MRI is an important tool for accurate detection and targeted biopsy of prostate lesions. However, the imaging appearances of some prostate cancers are similar to those of the surrounding normal tissue on MRI, which are referred to as MRI-invisible prostate cancers (MIPCas). The detection of MIPCas remains challenging and requires extensive systematic biopsy for identification. In this study, we developed a weakly supervised UNet (WSUNet) to detect MIPCas.

Methods

The study included 777 patients (training set: 600; testing set: 177), all of them underwent comprehensive prostate biopsies using an MRI-ultrasound fusion system. MIPCas were identified in MRI based on the Gleason grade (≥7) from known systematic biopsy results.

Results

The WSUNet model underwent validation through systematic biopsy in the testing set with an AUC of 0.764 (95% CI: 0.728-0.798). Furthermore, WSUNet exhibited a statistically significant precision improvement of 91.3% (p < 0.01) over conventional systematic biopsy methods in the testing set. This improvement resulted in a substantial 47.6% (p < 0.01) decrease in unnecessary biopsy needles, while maintaining the same number of positively identified cores as in the original systematic biopsy.

Conclusions

In conclusion, the proposed WSUNet could effectively detect MIPCas, thereby reducing unnecessary biopsies.

Exploring the efficacy of multi-flavored feature extraction with radiomics and deep features for prostate cancer grading on mpMRI

BACKGROUND

The purpose of this study is to investigate the use of radiomics and deep features obtained from multiparametric magnetic resonance imaging (mpMRI) for grading prostate cancer. We propose a novel approach called multi-flavored feature extraction or tensor, which combines four mpMRI images using eight different fusion techniques to create 52 images or datasets for each patient. We evaluate the effectiveness of this approach in grading prostate cancer and compare it to traditional methods.

METHODS

We used the PROSTATEx-2 dataset consisting of 111 patients' images from T2W-transverse, T2W-sagittal, DWI, and ADC images. We used eight fusion techniques to merge T2W, DWI, and ADC images, namely Laplacian Pyramid, Ratio of the low-pass pyramid, Discrete Wavelet Transform, Dual-Tree Complex Wavelet Transform, Curvelet Transform, Wavelet Fusion, Weighted Fusion, and Principal Component Analysis. Prostate cancer images were manually segmented, and radiomics features were extracted using the Pyradiomics library in Python. We also used an Autoencoder for deep feature extraction. We used five different feature sets to train the classifiers: all radiomics features, all deep features, radiomics features linked with PCA, deep features linked with PCA, and a combination of radiomics and deep features. We processed the data, including balancing, standardization, PCA, correlation, and Least Absolute Shrinkage and Selection Operator (LASSO) regression. Finally, we used nine classifiers to classify different Gleason grades.

RESULTS

Our results show that the SVM classifier with deep features linked with PCA achieved the most promising results, with an AUC of 0.94 and a balanced accuracy of 0.79. Logistic regression performed best when using only the deep features, with an AUC of 0.93 and balanced accuracy of 0.76. Gaussian Naive Bayes had lower performance compared to other classifiers, while KNN achieved high performance using deep features linked with PCA. Random Forest performed well with the combination of deep features and radiomics features, achieving an AUC of 0.94 and balanced accuracy of 0.76. The Voting classifiers showed higher performance when using only the deep features, with Voting 2 achieving the highest performance, with an AUC of 0.95 and balanced accuracy of 0.78.

CONCLUSION

Our study concludes that the proposed multi-flavored feature extraction or tensor approach using radiomics and deep features can be an effective method for grading prostate cancer. Our findings suggest that deep features may be more effective than radiomics features alone in accurately classifying prostate cancer.

The Predictive Value of Myocardial Native T1 Mapping Radiomics in Dilated Cardiomyopathy: A Study in a Chinese Population

BACKGROUND

Investigation of the factors influencing dilated cardiomyopathy (DCM) prognosis is important as it could facilitate risk stratification and guide clinical decision-making.

PURPOSE

To assess the prognostic value of magnetic resonance imaging (MRI) radiomics analysis of native T1 mapping in DCM.

STUDY TYPE

Prospective.

SUBJECTS

Three hundred and thirty consecutive patients with non-ischemic DCM (mean age 48.42 ± 14.20 years, 247 males).

FIELD STRENGTH/SEQUENCE

Balanced steady-state free precession and modified Look-Locker inversion recovery T1 mapping sequences at 3 T.

ASSESSMENT

Clinical characteristics, conventional MRI parameters (ventricular volumes, function, and mass), native myocardial T1, and radiomics features extracted from native T1 mapping were obtained. The study endpoint was defined as all-cause mortality or heart transplantation. Models were developed based on 1) clinical data; 2) radiomics data based on T1 mapping; 3) clinical and conventional MRI data; 4) clinical, conventional MRI, and native T1 data; and 5) clinical, conventional MRI, and radiomics T1 mapping data. Each prediction model was trained according to follow-up results with AdaBoost, random forest, and logistic regression classifiers.

STATISTICAL TESTS

The predictive performance was evaluated using the area under the receiver operating characteristic curve (AUC) and F1 score by 5-fold cross-validation.

RESULTS

During a median follow-up of 53.5 months (interquartile range, 41.6-69.5 months), 77 patients with DCM experienced all-cause mortality or heart transplantation. The random forest model based on radiomics combined with clinical and conventional MRI parameters achieved the best performance, with AUC and F1 score of 0.95 and 0.89, respectively.

DATA CONCLUSION

A machine-learning framework based on radiomics analysis of T1 mapping prognosis prediction in DCM.

LEVEL OF EVIDENCE

1 TECHNICAL EFFICACY: Stage 2.

Identification of radiomic biomarkers in a set of four skeletal muscle groups on Dixon MRI of the NAKO MR study

In this work, we propose a processing pipeline for the extraction and identification of meaningful radiomics biomarkers in skeletal muscle tissue as displayed using Dixon-weighted MRI. Diverse and robust radiomics features can be identified that may be of aid in the accurate quantification e.g. varying degrees of sarcopenia in respective muscles of large cohorts. As such, the approach comprises the texture feature extraction from raw data based on well established approaches, such as a nnU-Net neural network and the Pyradiomics toolbox, a subsequent selection according to adequate conditions for the muscle tissue of the general population, and an importance-based ranking to further narrow the amount of meaningful features with respect to auxiliary targets. The performance was investigated with respect to the included auxiliary targets, namely age, body mass index (BMI), and fat fraction (FF). Four skeletal muscles with different fiber architecture were included: the mm. glutaei, m. psoas, as well as the extensors and adductors of the thigh. The selection allowed for a reduction from 1015 available texture features to 65 for age, 53 for BMI, and 36 for FF from the available fat/water contrast images considering all muscles jointly. Further, the dependence of the importance rankings calculated for the auxiliary targets on validation sets (in a cross-validation scheme) was investigated by boxplots. In addition, significant differences between subgroups of respective auxiliary targets as well as between both sexes were shown to be present within the ten lowest ranked features by means of Kruskal-Wallis H-tests and Mann-Whitney U-tests. The prediction performance for the selected features and the ranking scheme were verified on validation sets by a random forest based multi-class classification, with strong area under the curve (AUC) values of the receiver operator characteristic (ROC) of 73.03 ± 0.70 % and 73.63 ± 0.70 % for the water and fat images in age, 80.68 ± 0.30 % and 88.03 ± 0.89 % in BMI, as well as 98.36 ± 0.03 % and 98.52 ± 0.09 % in FF.

Machine learning-based radiomics model to predict benign and malignant PI-RADS v2.1 category 3 lesions: a retrospective multi-center study

Purpose

To develop machine learning-based radiomics models derive from different MRI sequences for distinction between benign and malignant PI-RADS 3 lesions before intervention, and to cross-institution validate the generalization ability of the models.

Methods

The pre-biopsy MRI datas of 463 patients classified as PI-RADS 3 lesions were collected from 4 medical institutions retrospectively. 2347 radiomics features were extracted from the VOI of T2WI, DWI and ADC images. The ANOVA feature ranking method and support vector machine classifier were used to construct 3 single-sequence models and 1 integrated model combined with the features of three sequences. All the models were established in the training set and independently verified in the internal test and external validation set. The AUC was used to compared the predictive performance of PSAD with each model. Hosmer–lemeshow test was used to evaluate the degree of fitting between prediction probability and pathological results. Non-inferiority test was used to check generalization performance of the integrated model.

Results

The difference of PSAD between PCa and benign lesions was statistically significant (P = 0.006), with the mean AUC of 0.701 for predicting clinically significant prostate cancer (internal test AUC = 0.709 vs. external validation AUC = 0.692, P = 0.013) and 0.630 for predicting all cancer (internal test AUC = 0.637 vs. external validation AUC = 0.623, P = 0.036). T2WI-model with the mean AUC of 0.717 for predicting csPCa (internal test AUC = 0.738 vs. external validation AUC = 0.695, P = 0.264) and 0.634 for predicting all cancer (internal test AUC = 0.678 vs. external validation AUC = 0.589, P = 0.547). DWI-model with the mean AUC of 0.658 for predicting csPCa (internal test AUC = 0.635 vs. external validation AUC = 0.681, P = 0.086) and 0.655 for predicting all cancer (internal test AUC = 0.712 vs. external validation AUC = 0.598, P = 0.437). ADC-model with the mean AUC of 0.746 for predicting csPCa (internal test AUC = 0.767 vs. external validation AUC = 0.724, P = 0.269) and 0.645 for predicting all cancer (internal test AUC = 0.650 vs. external validation AUC = 0.640, P = 0.848). Integrated model with the mean AUC of 0.803 for predicting csPCa (internal test AUC = 0.804 vs. external validation AUC = 0.801, P = 0.019) and 0.778 for predicting all cancer (internal test AUC = 0.801 vs. external validation AUC = 0.754, P = 0.047).

Conclusions

The radiomics model based on machine learning has the potential to be a non-invasive tool to distinguish cancerous, noncancerous and csPCa in PI-RADS 3 lesions, and has relatively high generalization ability between different date set.

Radiomics vs radiologist in prostate cancer. Results from a systematic review

PURPOSE

Radiomics in uro-oncology is a rapidly evolving science proving to be a novel approach for optimizing the analysis of massive data from medical images to provide auxiliary guidance in clinical issues. This scoping review aimed to identify key aspects wherein radiomics can potentially improve the accuracy of diagnosis, staging, and extraprostatic extension in prostate cancer (PCa).

METHODS

The literature search was performed on June 2022 using PubMed, Embase, and Cochrane Central Controlled Register of Trials. Studies were included if radiomics were compared with radiological reports only.

RESULTS

Seventeen papers were included. The combination of PIRADS and radiomics score models improves the PIRADS score reporting of 2 and 3 lesions even in the peripheral zone. Multiparametric MRI-based radiomics models suggest that by simply omitting diffusion contrast enhancement imaging in radiomics models can simplify the process of analysis of clinically significant PCa by PIRADS. Radiomics features correlated with the Gleason grade with excellent discriminative ability. Radiomics has higher accuracy in predicting not only the presence but also the side of extraprostatic extension.

CONCLUSIONS

Radiomics research on PCa mainly uses MRI as an imaging modality and is focused on diagnosis and risk stratification and has the best future possibility of improving PIRADS reporting. Radiomics has established its superiority over radiologist-reported outcomes but the variability has to be taken into consideration before translating it to clinical practice.

The Low Rate of Adherence to Checklist for Artificial Intelligence in Medical Imaging Criteria Among Published Prostate MRI Artificial Intelligence Algorithms

OBJECTIVE

To determine the rigor, generalizability, and reproducibility of published classification and detection artificial intelligence (AI) models for prostate cancer (PCa) on MRI using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines, a 42-item checklist that is considered a measure of best practice for presenting and reviewing medical imaging AI research.

MATERIALS AND METHODS

This review searched English literature for studies proposing PCa AI detection and classification models on MRI. Each study was evaluated with the CLAIM checklist. The additional outcomes for which data were sought included measures of AI model performance (eg, area under the curve [AUC], sensitivity, specificity, free-response operating characteristic curves), training and validation and testing group sample size, AI approach, detection versus classification AI, public data set utilization, MRI sequences used, and definition of gold standard for ground truth. The percentage of CLAIM checklist fulfillment was used to stratify studies into quartiles. Wilcoxon's rank-sum test was used for pair-wise comparisons.

RESULTS

In all, 75 studies were identified, and 53 studies qualified for analysis. The original CLAIM items that most studies did not fulfill includes item 12 (77% no): de-identification methods; item 13 (68% no): handling missing data; item 15 (47% no): rationale for choosing ground truth reference standard; item 18 (55% no): measurements of inter- and intrareader variability; item 31 (60% no): inclusion of validated interpretability maps; item 37 (92% no): inclusion of failure analysis to elucidate AI model weaknesses. An AUC score versus percentage CLAIM fulfillment quartile revealed a significant difference of the mean AUC scores between quartile 1 versus quartile 2 (0.78 versus 0.86, P = .034) and quartile 1 versus quartile 4 (0.78 versus 0.89, P = .003) scores. Based on additional information and outcome metrics gathered in this study, additional measures of best practice are defined. These new items include disclosure of public dataset usage, ground truth definition in comparison to other referenced works in the defined task, and sample size power calculation.

CONCLUSION

A large proportion of AI studies do not fulfill key items in CLAIM guidelines within their methods and results sections. The percentage of CLAIM checklist fulfillment is weakly associated with improved AI model performance. Additions or supplementations to CLAIM are recommended to improve publishing standards and aid reviewers in determining study rigor.

Predicting Local Failure after Partial Prostate Re-Irradiation Using a Dosiomic-Based Machine Learning Model

The aim of this study is to predict local failure after partial prostate re-irradiation for the treatment of isolated locally recurrent prostate cancer by using a machine learning classifier based on radiomic features from pre-treatment computed tomography (CT), positron-emission tomography (PET) and biological effective dose distribution (BED) of the radiotherapy plan. The analysis was conducted on a monocentric dataset of 43 patients with evidence of isolated intraprostatic recurrence of prostate cancer after primary external beam radiotherapy. All patients received partial prostate re-irradiation delivered by volumetric modulated arc therapy. The gross tumor volume (GTV) of each patient was manually contoured from planning CT, choline-PET and dose maps. An ensemble machine learning pipeline including unbalanced data correction and feature selection was trained using the radiomic and dosiomic features as input for predicting occurrence of local failure. The model performance was assessed using sensitivity, specificity, accuracy and area under receiver operating characteristic curves of the score function in 10-fold cross validation repeated 100 times. Local failure was observed in 13 patients (30%), with a median time to recurrence of 36.7 months (range = 6.1–102.4 months). A four variables ensemble machine learning model resulted in accuracy of 0.62 and AUC 0.65. According to our results, a dosiomic machine learning classifier can predict local failure after partial prostate re-irradiation.

Quantib Prostate Compared to an Expert Radiologist for the Diagnosis of Prostate Cancer on mpMRI: A Single-Center Preliminary Study

Background: To evaluate the clinical utility of an Artificial Intelligence (AI) radiology solution, Quantib Prostate, for prostate cancer (PCa) lesions detection on multiparametric Magnetic Resonance Images (mpMRI). Methods: Prostate mpMRI exams of 108 patients were retrospectively studied. The diagnostic performance of an expert radiologist (>8 years of experience) and of an inexperienced radiologist aided by Quantib software were compared. Three groups of patients were assessed: patients with positive mpMRI, positive target biopsy, and/or at least one positive random biopsy (group A, 73 patients); patients with positive mpMRI and a negative biopsy (group B, 14 patients), and patients with negative mpMRI who did not undergo biopsy (group-C, 21 patients). Results: In group A, the AI-assisted radiologist found new lesions with positive biopsy correlation, increasing the diagnostic PCa performance when compared with the expert radiologist, reaching an SE of 92.3% and a PPV of 90.1% (vs. 71.7% and 84.4%). In group A, the expert radiologist found 96 lesions on 73 mpMRI exams (17.7% PIRADS3, 56.3% PIRADS4, and 26% PIRADS5). The AI-assisted radiologist found 121 lesions (0.8% PIRADS3, 53.7% PIRADS4, and 45.5% PIRADS5). At biopsy, 33.9% of the lesions were ISUP1, 31.4% were ISUP2, 22% were ISUP3, 10.2% were ISUP4, and 2.5% were ISUP5. In group B, where biopsies were negative, the AI-assisted radiologist excluded three lesions but confirmed all the others. In group-C, the AI-assisted radiologist found 37 new lesions, most of them PIRADS 3, with 32.4% localized in the peripherical zone and 67.6% in the transition zone. Conclusions: Quantib software is a very sensitive tool to use specifically in high-risk patients (high PIRADS and high Gleason score).

The role of MRI in prostate cancer: current and future directions

There has been an increasing role of magnetic resonance imaging (MRI) in the management of prostate cancer. MRI already plays an essential role in the detection and staging, with the introduction of functional MRI sequences. Recent advancements in radiomics and artificial intelligence are being tested to potentially improve detection, assessment of aggressiveness, and provide usefulness as a prognostic marker. MRI can improve pretreatment risk stratification and therefore selection of and follow-up of patients for active surveillance. MRI can also assist in guiding targeted biopsy, treatment planning and follow-up after treatment to assess local recurrence. MRI has gained importance in the evaluation of metastatic disease with emerging technology including whole-body MRI and integrated positron emission tomography/MRI, allowing for not only better detection but also quantification. The main goal of this article is to review the most recent advances on MRI in prostate cancer and provide insights into its potential clinical roles from the radiologist's perspective. In each of the sections, specific roles of MRI tailored to each clinical setting are discussed along with its strengths and weakness including already established material related to MRI and the introduction of recent advancements on MRI.

Machine and Deep Learning Prediction Of Prostate Cancer Aggressiveness Using Multiparametric MRI

Prostate cancer (PCa) is the most frequent male malignancy and the assessment of PCa aggressiveness, for which a biopsy is required, is fundamental for patient management. Currently, multiparametric (mp) MRI is strongly recommended before biopsy. Quantitative assessment of mpMRI might provide the radiologist with an objective and noninvasive tool for supporting the decision-making in clinical practice and decreasing intra- and inter-reader variability. In this view, high dimensional radiomics features and Machine Learning (ML) techniques, along with Deep Learning (DL) methods working on raw images directly, could assist the radiologist in the clinical workflow. The aim of this study was to develop and validate ML/DL frameworks on mpMRI data to characterize PCas according to their aggressiveness. We optimized several ML/DL frameworks on T2w, ADC and T2w+ADC data, using a patient-based nested validation scheme. The dataset was composed of 112 patients (132 peripheral lesions with Prostate Imaging Reporting and Data System (PI-RADS) score ≥ 3) acquired following both PI-RADS 2.0 and 2.1 guidelines. Firstly, ML/DL frameworks trained and validated on PI-RADS 2.0 data were tested on both PI-RADS 2.0 and 2.1 data. Then, we trained, validated and tested ML/DL frameworks on a multi PI-RADS dataset. We reported the performances in terms of Area Under the Receiver Operating curve (AUROC), specificity and sensitivity. The ML/DL frameworks trained on T2w data achieved the overall best performance. Notably, ML and DL frameworks trained and validated on PI-RADS 2.0 data obtained median AUROC values equal to 0.750 and 0.875, respectively, on unseen PI-RADS 2.0 test set. Similarly, ML/DL frameworks trained and validated on multi PI-RADS T2w data showed median AUROC values equal to 0.795 and 0.750, respectively, on unseen multi PI-RADS test set. Conversely, all the ML/DL frameworks trained and validated on PI-RADS 2.0 data, achieved AUROC values no better than the chance level when tested on PI-RADS 2.1 data. Both ML/DL techniques applied on mpMRI seem to be a valid aid in predicting PCa aggressiveness. In particular, ML/DL frameworks fed with T2w images data (objective, fast and non-invasive) show good performances and might support decision-making in patient diagnostic and therapeutic management, reducing intra- and inter-reader variability.

Radiomics in prostate cancer: an up-to-date review

Prostate cancer (PCa) is the most common worldwide diagnosed malignancy in male population. The diagnosis, the identification of aggressive disease, and the post-treatment follow-up needs a more comprehensive and holistic approach. Radiomics is the extraction and interpretation of images phenotypes in a quantitative manner. Radiomics may give an advantage through advancements in imaging modalities and through the potential power of artificial intelligence techniques by translating those features into clinical outcome prediction. This article gives an overview on the current evidence of methodology and reviews the available literature on radiomics in PCa patients, highlighting its potential for personalized treatment and future applications.

Better lesion conspicuity translates into improved prostate cancer detection: comparison of non-parallel-transmission-zoomed-DWI with conventional-DWI

PURPOSE

To compare advanced non-parallel transmission zoomed diffusion-weighted imaging (nonPTX zoom-DWI) to conventional DWI (conv-DWI) for the assessment of prostate cancer (PCa).

METHODS

This retrospective study included 98 patients who underwent conv-DWI, nonPTX zoom-DWI, and T2-weighted imaging of the prostate. The image qualities of the two DWI sets, including the distortion of the prostate and the existence of artifacts, were evaluated. To compare the overall PCa and clinically important PCa (ciPCa) detection ability between the sets, lesions were scored using the Prostate Imaging Reporting and Data System (PI-RADS) version 2. Apparent diffusion coefficient (ADC) values of the lesions were also measured and compared. The Mann-Whitney U test was used to compare continuous variables, and the χ² test was used to compare categorical variables. Two-sided P values of < 0.05 were considered significant.

RESULTS

Non-PTX zoom-DWI yielded significantly better image quality and image analysis reproducibility than conv-DWI (all P < 0.001). Compared with conv-ADC, nonPTX zoom-ADC showed slightly better detection performance for overall PCa (AUC: 0.827 vs. 0.797; P = 0.55) and ciPCa (AUC: 0.822 vs. 0.749; P = 0.58). At a PI-RADS score of 4 as the cutoff value for PCa prediction, nonPTX zoom-DWI showed significantly higher diagnostic efficiency for overall PCa detection (sensitivity: 87.9% vs. 72.4%; specificity: 87.5% vs. 77.5%; both P < 0.05) and ciPCa detection (sensitivity: 86.3% vs. 74.5%; specificity: 72.3% vs. 63.8%; both P ≤ 0.001).

CONCLUSION

Non-PTX zoom-DWI yields better image quality and higher PCa detection performance than Conv-DWI.

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics

Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.

State of the art of radiomic analysis in the clinical management of prostate cancer: A systematic review

We present the current clinical applications of radiomics in the context of prostate cancer (PCa) management. Several online databases for original articles using a combination of the following keywords: "(radiomic or radiomics) AND (prostate cancer or prostate tumour or prostate tumor or prostate neoplasia)" have been searched. The selected papers have been pooled as focus on (i) PCa detection, (ii) assessing the clinical significance of PCa, (iii) biochemical recurrence prediction, (iv) radiation-therapy outcome prediction and treatment efficacy monitoring, (v) metastases detection, (vi) metastases prediction, (vii) prediction of extra-prostatic extension. Seventy-six studies were included for qualitative analyses. Classifiers powered with radiomic features were able to discriminate between healthy tissue and PCa and between low- and high-risk PCa. However, before radiomics can be proposed for clinical use its methods have to be standardized, and these first encouraging results need to be robustly replicated in large and independent cohorts.

Machine Learning: Applications and Advanced Progresses of Radiomics in Endocrine Neoplasms

Endocrine neoplasms remain a great threat to human health. It is extremely important to make a clear diagnosis and timely treatment of endocrine tumors. Machine learning includes radiomics, which has long been utilized in clinical cancer research. Radiomics refers to the extraction of valuable information by analyzing a large amount of standard data with high-throughput medical images mainly including computed tomography, positron emission tomography, magnetic resonance imaging, and ultrasound. With the quantitative imaging analysis and model building, radiomics can reflect specific underlying characteristics of a disease that otherwise could not be evaluated visually. More and more promising results of radiomics in oncological practice have been seen in recent years. Radiomics may have the potential to supplement traditional imaging analysis and assist in providing precision medicine for patients. Radiomics had developed rapidly in endocrine neoplasms practice in the past decade. In this review, we would introduce the general workflow of radiomics and summarize the applications and developments of radiomics in endocrine neoplasms in recent years. The limitations of current radiomic research studies and future development directions would also be discussed.

Prostate Cancer Radiogenomics-From Imaging to Molecular Characterization

Radiomics and genomics represent two of the most promising fields of cancer research, designed to improve the risk stratification and disease management of patients with prostate cancer (PCa). Radiomics involves a conversion of imaging derivate quantitative features using manual or automated algorithms, enhancing existing data through mathematical analysis. This could increase the clinical value in PCa management. To extract features from imaging methods such as magnetic resonance imaging (MRI), the empiric nature of the analysis using machine learning and artificial intelligence could help make the best clinical decisions. Genomics information can be explained or decoded by radiomics. The development of methodologies can create more-efficient predictive models and can better characterize the molecular features of PCa. Additionally, the identification of new imaging biomarkers can overcome the known heterogeneity of PCa, by non-invasive radiological assessment of the whole specific organ. In the future, the validation of recent findings, in large, randomized cohorts of PCa patients, can establish the role of radiogenomics. Briefly, we aimed to review the current literature of highly quantitative and qualitative results from well-designed studies for the diagnoses, treatment, and follow-up of prostate cancer, based on radiomics, genomics and radiogenomics research.

A Comprehensive Study of Data Augmentation Strategies for Prostate Cancer Detection in Diffusion-Weighted MRI Using Convolutional Neural Networks

Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies and their combinations have been investigated for various computer vision tasks in the context of deep learning, a specific work in the domain of medical imaging is rare and to the best of our knowledge, there has been no dedicated work on exploring the effects of various augmentation methods on the performance of deep learning models in prostate cancer detection. In this work, we have statically applied five most frequently used augmentation techniques (random rotation, horizontal flip, vertical flip, random crop, and translation) to prostate diffusion-weighted magnetic resonance imaging training dataset of 217 patients separately and evaluated the effect of each method on the accuracy of prostate cancer detection. The augmentation algorithms were applied independently to each data channel and a shallow as well as a deep convolutional neural network (CNN) was trained on the five augmented sets separately. We used area under receiver operating characteristic (ROC) curve (AUC) to evaluate the performance of the trained CNNs on a separate test set of 95 patients, using a validation set of 102 patients for finetuning. The shallow network outperformed the deep network with the best 2D slice-based AUC of 0.85 obtained by the rotation method.

Radiomics in prostate cancer imaging for a personalized treatment approach - current aspects of methodology and a systematic review on validated studies

Prostate cancer (PCa) is one of the most frequently diagnosed malignancies of men in the world. Due to a variety of treatment options in different risk groups, proper diagnostic and risk stratification is pivotal in treatment of PCa. The development of precise medical imaging procedures simultaneously to improvements in big data analysis has led to the establishment of radiomics - a computer-based method of extracting and analyzing image features quantitatively. This approach bears the potential to assess and improve PCa detection, tissue characterization and clinical outcome prediction. This article gives an overview on the current aspects of methodology and systematically reviews available literature on radiomics in PCa patients, showing its potential for personalized therapy approaches. The qualitative synthesis includes all imaging modalities and focuses on validated studies, putting forward future directions.

Preoperative Prediction of Extracapsular Extension: Radiomics Signature Based on Magnetic Resonance Imaging to Stage Prostate Cancer

PURPOSE

To investigate and validate the potential role of a radiomics signature in predicting the side-specific probability of extracapsular extension (ECE) of prostate cancer (PCa).

PROCEDURES

The preoperative magnetic resonance imaging data of 238 prostatic samples from 119 enrolled PCa patients were retrospectively assessed. The samples with were randomized in a two-to-one ratio into training (n = 74) and validation (n = 45) datasets. The radiomics features were derived from T2-weighted images (T2WIs). The optimal radiomics features were identified from the least absolute shrinkage and selection operator (LASSO) logistic regression model and were used to construct a predictive radiomics signature via dimension reduction and selection approaches. The association between the radiomics signatures and pathological ECE status was explored. Receiver operating characteristic (ROC) analysis was used to assess the discriminatory ability of the signature. The calibration performance and clinical usefulness of the radiomics signature were subsequently assessed by calibration curve and decision curve analyses.

RESULTS

The proposed radiomics signature that incorporated 17 selected radiomics features was significantly associated with pathological ECE outcomes (P < 0.001) in both the training and validation datasets. The constructed model displayed good discrimination, with areas under the curve (AUC) of 0.906 (95 % confidence interval (CI), 0.847, 0.948) and 0.821 (95 % CI, 0.726, 0.894) for the training and validation datasets, respectively, and had a good calibration performance. The clinical utility of this model was confirmed through decision curve analysis.

CONCLUSIONS

The radiomics signature based on T2WIs showed the potential to predict the side-specific probability of pathological ECE status and can facilitate the preoperative individualized predictions for PCa patients.

Artificial Intelligence Based Algorithms for Prostate Cancer Classification and Detection on Magnetic Resonance Imaging: A Narrative Review

Due to the upfront role of magnetic resonance imaging (MRI) for prostate cancer (PCa) diagnosis, a multitude of artificial intelligence (AI) applications have been suggested to aid in the diagnosis and detection of PCa. In this review, we provide an overview of the current field, including studies between 2018 and February 2021, describing AI algorithms for (1) lesion classification and (2) lesion detection for PCa. Our evaluation of 59 included studies showed that most research has been conducted for the task of PCa lesion classification (66%) followed by PCa lesion detection (34%). Studies showed large heterogeneity in cohort sizes, ranging between 18 to 499 patients (median = 162) combined with different approaches for performance validation. Furthermore, 85% of the studies reported on the stand-alone diagnostic accuracy, whereas 15% demonstrated the impact of AI on diagnostic thinking efficacy, indicating limited proof for the clinical utility of PCa AI applications. In order to introduce AI within the clinical workflow of PCa assessment, robustness and generalizability of AI applications need to be further validated utilizing external validation and clinical workflow experiments.

TCGA-TCIA-Based CT Radiomics Study for Noninvasively Predicting Epstein-Barr Virus Status in Gastric Cancer

OBJECTIVE. The purpose of this study was to investigate the value of TCGA-TCIA (The Cancer Genome Atlas and The Cancer Imaging Archive)-based CT radiomics for noninvasive prediction of Epstein-Barr virus (EBV) status in gastric cancer (GC). MATERIALS AND METHODS. A total of 133 patients with pathologically confirmed GC (94 in the training cohort and 39 in the validation cohort) who were identified from the TCGA-TCIA public data repository and two hospitals were retrospectively enrolled in the study. Two-dimensional and 3D radiomics features were extracted to construct corresponding radiomics signatures. Then, 2D and 3D nomograms were built by combining radiomics signatures and clinical information on the basis of multivariable analysis. Their performance and clinical practicability were determined, validated, and compared with respect to discrimination, calibration, reclassification, and time spent on tumor segmentation. RESULTS. Both 2D and 3D nomograms were robust and showed good calibration. The AUCs of the 2D and 3D nomograms showed no significant difference in the training cohort (0.919 vs 0.945, respectively; p = .41) or validation cohort (0.939 vs 0.955, respectively; p = .71). The net reclassification index showed that the 3D nomogram revealed no significant improvement in risk reclassification when compared with the 2D nomogram in the training cohort (net reclassification index, 0.68%; p = .14) and the validation cohort (net reclassification index, 6.06%; p = .08). Of note, the time spent on 3D segmentation (median, 907 seconds) was higher than that spent on 2D segmentation (median, 129 seconds). CONCLUSION. The 2D and 3D radiomics nomograms might have the potential to be used as effective tools for prediction of EBV in GC. When time spent on segmentation is considered, the 2D nomogram is more highly recommended for clinical application.

Radiomics and Prostate MRI: Current Role and Future Applications

Multiparametric prostate magnetic resonance imaging (mpMRI) is widely used as a triage test for men at a risk of prostate cancer. However, the traditional role of mpMRI was confined to prostate cancer staging. Radiomics is the quantitative extraction and analysis of minable data from medical images; it is emerging as a promising tool to detect and categorize prostate lesions. In this paper we review the role of radiomics applied to prostate mpMRI in detection and localization of prostate cancer, prediction of Gleason score and PI-RADS classification, prediction of extracapsular extension and of biochemical recurrence. We also provide a future perspective of artificial intelligence (machine learning and deep learning) applied to the field of prostate cancer.

Magnetic Resonance Imaging Based Radiomic Models of Prostate Cancer: A Narrative Review

Simple Summary

The increasing interest in implementing artificial intelligence in radiomic models has occurred alongside advancement in the tools used for computer-aided diagnosis. Such tools typically apply both statistical and machine learning methodologies to assess the various modalities used in medical image analysis. Specific to prostate cancer, the radiomics pipeline has multiple facets that are amenable to improvement. This review discusses the steps of a magnetic resonance imaging based radiomics pipeline. Present successes, existing opportunities for refinement, and the most pertinent pending steps leading to clinical validation are highlighted.

Abstract

The management of prostate cancer (PCa) is dependent on biomarkers of biological aggression. This includes an invasive biopsy to facilitate a histopathological assessment of the tumor’s grade. This review explores the technical processes of applying magnetic resonance imaging based radiomic models to the evaluation of PCa. By exploring how a deep radiomics approach further optimizes the prediction of a PCa’s grade group, it will be clear how this integration of artificial intelligence mitigates existing major technological challenges faced by a traditional radiomic model: image acquisition, small data sets, image processing, labeling/segmentation, informative features, predicting molecular features and incorporating predictive models. Other potential impacts of artificial intelligence on the personalized treatment of PCa will also be discussed. The role of deep radiomics analysis-a deep texture analysis, which extracts features from convolutional neural networks layers, will be highlighted. Existing clinical work and upcoming clinical trials will be reviewed, directing investigators to pertinent future directions in the field. For future progress to result in clinical translation, the field will likely require multi-institutional collaboration in producing prospectively populated and expertly labeled imaging libraries.

Radiomics in radiation oncology-basics, methods, and limitations

Over the past years, the quantity and complexity of imaging data available for the clinical management of patients with solid tumors has increased substantially. Without the support of methods from the field of artificial intelligence (AI) and machine learning, a complete evaluation of the available image information is hardly feasible in clinical routine. Especially in radiotherapy planning, manual detection and segmentation of lesions is laborious, time consuming, and shows significant variability among observers. Here, AI already offers techniques to support radiation oncologists, whereby ultimately, the productivity and the quality are increased, potentially leading to an improved patient outcome. Besides detection and segmentation of lesions, AI allows the extraction of a vast number of quantitative imaging features from structural or functional imaging data that are typically not accessible by means of human perception. These features can be used alone or in combination with other clinical parameters to generate mathematical models that allow, for example, prediction of the response to radiotherapy. Within the large field of AI, radiomics is the subdiscipline that deals with the extraction of quantitative image features as well as the generation of predictive or prognostic mathematical models. This review gives an overview of the basics, methods, and limitations of radiomics, with a focus on patients with brain tumors treated by radiation therapy.

Using decision curve analysis to benchmark performance of a magnetic resonance imaging-based deep learning model for prostate cancer risk assessment

OBJECTIVES

To benchmark the performance of a calibrated 3D convolutional neural network (CNN) applied to multiparametric MRI (mpMRI) for risk assessment of clinically significant prostate cancer (csPCa) using decision curve analysis (DCA).

METHODS

We retrospectively analyzed 499 patients who had positive mpMRI (PI-RADSv2 ≥ 3) and MRI-targeted biopsy. The training cohort comprised 449 men, including a calibration set of 50 men. Biopsy decision strategies included using risk estimates from the CNN (original and calibrated), to perform biopsy in men with PI-RADSv2 ≥ 4 only, or additionally in men with PI-RADSv2 3 and PSA density (PSAd) ≥ 0.15 ng/ml/ml. Discrimination, calibration and clinical usefulness in the unseen test cohort (n = 50) were assessed using C-statistic, calibration plots and DCA, respectively.

RESULTS

The calibrated CNN achieved moderate calibration (Hosmer-Lemeshow calibration test, p = 0.41) and good discrimination (C = 0.85). DCA revealed consistently higher net benefit and net reduction in biopsies for the calibrated CNN compared with the original CNN, PI-RADSv2 ≥ 4 and the combined strategy of PI-RADSv2 and PSAd. Original CNN predictions were severely miscalibrated (p < 0.0001) resulting in net harm compared with a 'biopsy all' patients strategy. At-risk thresholds ≥ 10% using the calibrated CNN and the combined strategy reduced the number of biopsies by an estimated 201 and 55 men, respectively, per 1000 men at risk, without missing csPCa, while original CNN and PI-RADSv2 ≥ 4 could not achieve a net reduction in biopsies.

CONCLUSIONS

DCA revealed that our calibrated 3D-CNN resulted in fewer unnecessary biopsies compared with using PI-RADSv2 alone or in combination with PSAd. CNN calibration is important in achieving clinical utility.

KEY POINTS

• A 3D deep learning model applied to multiparametric MRI may help to prevent unnecessary prostate biopsies in patients eligible for MRI-targeted biopsy. • Owing to miscalibration, original risk estimates by the deep learning model require prior calibration to enable clinical utility. • Decision curve analysis confirmed a net benefit of using our calibrated deep learning model for biopsy decisions compared with alternative strategies, including PI-RADSv2 alone and in combination with prostate-specific antigen density.

Prostate MRI radiomics: A systematic review and radiomic quality score assessment

BACKGROUND

Radiomics have the potential to further increase the value of MRI in prostate cancer management. However, implementation in clinical practice is still far and concerns have been raised regarding the methodological quality of radiomic studies. Therefore, we aimed to systematically review the literature to assess the quality of prostate MRI radiomic studies using the radiomics quality score (RQS).

METHODS

Multiple medical literature archives (PubMed, Web of Science and EMBASE) were searched to retrieve original investigations focused on prostate MRI radiomic approaches up to the end of June 2019. Three researchers independently assessed each paper using the RQS. Data from the most experienced researcher were used for descriptive analysis. Inter-rater reproducibility was assessed using the intraclass correlation coefficient (ICC) on the total RQS score.

RESULTS

73 studies were included in the analysis. Overall, the average RQS total score was 7.93 ± 5.13 on a maximum of 36 points, with a final average percentage of 23 ± 13%. Among the most critical items, the lack of feature robustness testing strategies and external validation datasets. The ICC resulted poor to moderate, with an average value of 0.57 and 95% Confidence Intervals between 0.44 and 0.69.

CONCLUSIONS

Current studies on prostate MRI radiomics still lack the quality required to allow their introduction in clinical practice.

Implementation of eHealth and AI integrated diagnostics with multidisciplinary digitized data: are we ready from an international perspective?

Digitization of medicine requires systematic handling of the increasing amount of health data to improve medical diagnosis. In this context, the integration of the versatile diagnostic information, e.g., from anamnesis, imaging, histopathology, and clinical chemistry, and its comprehensive analysis by artificial intelligence (AI)–based tools is expected to improve diagnostic precision and the therapeutic conduct. However, the complex medical environment poses a major obstacle to the translation of integrated diagnostics into clinical research and routine. There is a high need to address aspects like data privacy, data integration, interoperability standards, appropriate IT infrastructure, and education of staff. Besides this, a plethora of technical, political, and ethical challenges exists. This is complicated by the high diversity of approaches across Europe. Thus, we here provide insights into current international activities on the way to digital comprehensive diagnostics. This includes a technical view on challenges and solutions for comprehensive diagnostics in terms of data integration and analysis. Current data communications standards and common IT solutions that are in place in hospitals are reported. Furthermore, the international hospital digitalization scoring and the European funding situation were analyzed. In addition, the regional activities in radiomics and the related publication trends are discussed. Our findings show that prerequisites for comprehensive diagnostics have not yet been sufficiently established throughout Europe. The manifold activities are characterized by a heterogeneous digitization progress and they are driven by national efforts. This emphasizes the importance of clear governance, concerted investments, and cooperation at various levels in the health systems.

Key Points

• Europe is characterized by heterogeneity in its digitization progress with predominantly national efforts. Infrastructural prerequisites for comprehensive diagnostics are not given and not sufficiently funded throughout Europe, which is particularly true for data integration.

• The clinical establishment of comprehensive diagnostics demands for a clear governance, significant investments, and cooperation at various levels in the healthcare systems.

• While comprehensive diagnostics is on its way, concerted efforts should be taken in Europe to get consensus concerning interoperability and standards, security, and privacy as well as ethical and legal concerns.

Fully automated dose prediction using generative adversarial networks in prostate cancer patients

Purpose

Although dose prediction for intensity modulated radiation therapy (IMRT) has been accomplished by a deep learning approach, delineation of some structures is needed for the prediction. We sought to develop a fully automated dose-generation framework for IMRT of prostate cancer by entering the patient CT datasets without the contour information into a generative adversarial network (GAN) and to compare its prediction performance to a conventional prediction model trained from patient contours.

Methods

We propose a synthetic approach to translate patient CT datasets into a dose distribution for IMRT. The framework requires only paired-images, i.e., patient CT images and corresponding RT-doses. The model was trained from 81 IMRT plans of prostate cancer patients, and then produced the dose distribution for 9 test cases. To compare its prediction performance to that of another trained model, we created a model trained from structure images. Dosimetric parameters for the planning target volume (PTV) and organs at risk (OARs) were calculated from the generated and original dose distributions, and mean differences of dosimetric parameters were compared between the CT-based model and the structure-based model.

Results

The mean differences of all dosimetric parameters except for D_98% and D_95% for PTV were within approximately 2% and 3% of the prescription dose for OARs in the CT-based model, while the differences in the structure-based model were within approximately 1% for PTV and approximately 2% for OARs, with a mean prediction time of 5 seconds per patient.

Conclusions

Accurate and rapid dose prediction was achieved by the learning of patient CT datasets by a GAN-based framework. The CT-based dose prediction could reduce the time required for both the iterative optimization process and the structure contouring, allowing physicians and dosimetrists to focus their expertise on more challenging cases.

Effects of MRI image normalization techniques in prostate cancer radiomics

The variance in intensities of MRI scans is a fundamental impediment for quantitative MRI analysis. Intensity values are not only highly dependent on acquisition parameters, but also on the subject and body region being scanned. This warrants the need for image normalization techniques to ensure that intensity values are consistent within tissues across different subjects and visits. Many intensity normalization methods have been developed and proven successful for the analysis of brain pathologies, but evaluation of these methods for images of the prostate region is lagging. In this paper, we compare four different normalization methods on 49 T2-w scans of prostate cancer patients: 1) the well-established histogram normalization, 2) the generalized scale normalization, 3) an extension of generalized scale normalization called generalized ball-scale normalization, and 4) a custom normalization based on healthy prostate tissue intensities. The methods are compared qualitatively and quantitatively in terms of behaviors of intensity distributions as well as impact on radiomic features. Our findings suggest that normalization based on prior knowledge of the healthy prostate tissue intensities may be the most effective way of acquiring the desired properties of normalized images. In addition, the histogram normalization method outperform the generalized scale and generalized ball-scale methods which have proven superior for other body regions.

Prostate Cancer Detection using Deep Convolutional Neural Networks

Prostate cancer is one of the most common forms of cancer and the third leading cause of cancer death in North America. As an integrated part of computer-aided detection (CAD) tools, diffusion-weighted magnetic resonance imaging (DWI) has been intensively studied for accurate detection of prostate cancer. With deep convolutional neural networks (CNNs) significant success in computer vision tasks such as object detection and segmentation, different CNN architectures are increasingly investigated in medical imaging research community as promising solutions for designing more accurate CAD tools for cancer detection. In this work, we developed and implemented an automated CNN-based pipeline for detection of clinically significant prostate cancer (PCa) for a given axial DWI image and for each patient. DWI images of 427 patients were used as the dataset, which contained 175 patients with PCa and 252 patients without PCa. To measure the performance of the proposed pipeline, a test set of 108 (out of 427) patients were set aside and not used in the training phase. The proposed pipeline achieved area under the receiver operating characteristic curve (AUC) of 0.87 (95[Formula: see text] Confidence Interval (CI): 0.84-0.90) and 0.84 (95[Formula: see text] CI: 0.76-0.91) at slice level and patient level, respectively.

Multiparametric MRI and auto-fixed volume of interest-based radiomics signature for clinically significant peripheral zone prostate cancer

Objectives

To create a radiomics approach based on multiparametric magnetic resonance imaging (mpMRI) features extracted from an auto-fixed volume of interest (VOI) that quantifies the phenotype of clinically significant (CS) peripheral zone (PZ) prostate cancer (PCa).

Methods

This study included 206 patients with 262 prospectively called mpMRI prostate imaging reporting and data system 3–5 PZ lesions. Gleason scores > 6 were defined as CS PCa. Features were extracted with an auto-fixed 12-mm spherical VOI placed around a pin point in each lesion. The value of dynamic contrast-enhanced imaging(DCE), multivariate feature selection and extreme gradient boosting (XGB) vs. univariate feature selection and random forest (RF), expert-based feature pre-selection, and the addition of image filters was investigated using the training (171 lesions) and test (91 lesions) datasets.

Results

The best model with features from T2-weighted (T2-w) + diffusion-weighted imaging (DWI) + DCE had an area under the curve (AUC) of 0.870 (95% CI 0.980–0.754). Removal of DCE features decreased AUC to 0.816 (95% CI 0.920–0.710), although not significantly (p = 0.119). Multivariate and XGB outperformed univariate and RF (p = 0.028). Expert-based feature pre-selection and image filters had no significant contribution.

Conclusions

The phenotype of CS PZ PCa lesions can be quantified using a radiomics approach based on features extracted from T2-w + DWI using an auto-fixed VOI. Although DCE features improve diagnostic performance, this is not statistically significant. Multivariate feature selection and XGB should be preferred over univariate feature selection and RF. The developed model may be a valuable addition to traditional visual assessment in diagnosing CS PZ PCa.

Key Points

• T2-weighted and diffusion-weighted imaging features are essential components of a radiomics model for clinically significant prostate cancer; addition of dynamic contrast-enhanced imaging does not significantly improve diagnostic performance.

• Multivariate feature selection and extreme gradient outperform univariate feature selection and random forest.

• The developed radiomics model that extracts multiparametric MRI features with an auto-fixed volume of interest may be a valuable addition to visual assessment in diagnosing clinically significant prostate cancer.

Electronic supplementary material

The online version of this article (10.1007/s00330-019-06488-y) contains supplementary material, which is available to authorized users.