Automatic classification of prostate cancer Gleason scores from multiparametric magnetic resonance images

[Artificial intelligence (AI) in radiology? : Do we need as many radiologists in the future?]

We are in the middle of a digital revolution in medicine. This raises the question of whether subjects such as radiology, which is superficially concerned with the interpretation of images, will be particularly changed by this revolution. In particular, it should be discussed whether in the future the completion of initially simpler, then more complex image analysis tasks by computer systems may lead to a reduced need for radiologists. What distinguishes radiology in particular is its key position between advanced technology and medical care. This article discusses that not only radiology but every medical discipline will be affected by innovations due to the digital revolution, and that a redefinition of medical specialties focusing on imaging and visual interpretation makes sense and that the arrival of artificial intelligence (AI) in radiology is to be welcomed in the context of ever larger amounts of image data-to at all be able to handle the increasing amount of image data in the future at the current number of radiologists. In this respect, the balance between research and teaching in comparison to patient care is more difficult to maintain in the academic environment. AI can help improve efficiency and balance in the areas mentioned. With regard to specialist training, information technology topics are expected to be integrated into the radiological curriculum. Radiology acts as a pioneer designing the entry of AI into medicine. It is to be expected that by the time radiologists can be substantially replaced by AI, the replacement of human contributions in other medical and non-medical fields will also be well advanced.

External validation of the computerized analysis of TRUS of the prostate with the ANNA/C-TRUS system: a potential role of artificial intelligence for improving prostate cancer detection

PURPOSE

Prostate cancer (PCa) imaging has been revolutionized by the introduction of multi-parametric Magnetic Resonance Imaging (mpMRI). Transrectal ultrasound (TRUS) has always been considered a low-performance modality. To overcome this, a computerized artificial neural network analysis (ANNA/C-TRUS) of the TRUS based on an artificial intelligence (AI) analysis has been proposed. Our aim was to evaluate the diagnostic performance of the ANNA/C-TRUS system and its ability to improve conventional TRUS in PCa diagnosis.

METHODS

We retrospectively analyzed data from 64 patients with PCa and scheduled for radical prostatectomy who underwent TRUS followed by ANNA/C-TRUS analysis before the procedure. The results of ANNA/C-TRUS analysis with whole mount sections from final pathology.

RESULTS

On a per-sectors analysis, sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and accuracy were 62%, 81%, 80%, 64% and 78% respectively. The values for the detection of clinically significant prostate cancer were 69%, 77%, 88%, 50% and 75%. The diagnostic values for high grade tumours were 70%, 74%, 91%, 41% and 74%, respectively. Cancer volume (≤ 0.5 or greater) did not influence the diagnostic performance of the ANNA/C-TRUS system.

CONCLUSIONS

ANNA/C-TRUS represents a promising diagnostic tool and application of AI for PCa diagnosis. It improves the ability of conventional TRUS to diagnose prostate cancer, preserving its simplicity and availability. Since it is an AI system, it does not hold the inter-observer variability nor a learning curve. Multicenter biopsy-based studies with the inclusion of an adequate number of patients are needed to confirm these results.

Quality in MR reporting of the prostate – improving acquisition, the role of AI and future perspectives

The high quality of MRI reporting of the prostate is the most critical component of the service provided by a radiologist. Prostate MRI structured reporting with PI-RADS v. 2.1 has been proven to improve consistency, quality, guideline-based care in the management of prostate cancer. There is room for improved accuracy of prostate mpMRI reporting, particularly as PI-RADS core criteria are subjective for radiologists. The application of artificial intelligence may support radiologists in interpreting MRI scans. This review addresses the quality of prostate multiparametric MRI (mpMRI) structured reporting (include improvements in acquisition using artificial intelligence) in terms of size of prostate gland, imaging quality, lesion location, lesion size, TNM staging, sector map, and discusses the future prospects of quality in MR reporting.

Local binary pattern and deep learning feature extraction fusion for COVID-19 detection on computed tomography images

The deadly coronavirus virus (COVID-19) was confirmed as a pandemic by the World Health Organization (WHO) in December 2019. It is important to identify suspected patients as early as possible in order to control the spread of the virus, improve the efficacy of medical treatment, and, as a result, lower the mortality rate. The adopted method of detecting COVID-19 is the reverse-transcription polymerase chain reaction (RT-PCR), the process is affected by a scarcity of RT-PCR kits as well as its complexities. Medical imaging using machine learning and deep learning has proved to be one of the most efficient methods of detecting respiratory diseases, but to train machine learning features needs to be extracted manually, and in deep learning, efficiency is affected by deep learning architecture and low data. In this study, handcrafted local binary pattern (LBP) and automatic seven deep learning models extracted features were used to train support vector machines (SVM) and K-nearest neighbour (KNN) classifiers, to improve the performance of the classifier, a concatenated LBP and deep learning feature was proposed to train the KNN and SVM, based on the performance criteria, the models VGG-19 + LBP achieved the highest accuracy of 99.4%. The SVM and KNN classifiers trained on the hybrid feature outperform the state of the art model. This shows that the proposed feature can improve the performance of the classifiers in detecting COVID-19.

Diffusion and quantification of diffusion of prostate cancer

For assessing a cancer treatment, and for detecting and characterizing cancer, Diffusion-weighted imaging (DWI) is commonly used. The key in DWI's use extracranially has been due to the emergence of of high-gradient amplitude and multichannel coils, parallelimaging, and echo-planar imaging. The benefit has been fewer motion artefacts and high-quality prostate images.Recently, new techniques have been developed to improve the signal-to-noise ratio of DWI with fewer artefacts, allowing an increase in spatial resolution. For apparent diffusion coefficient quantification, non-Gaussian diffusion models have been proposed as additional tools for prostate cancer detection and evaluation of its aggressiveness. More recently, radiomics and machine learning for prostate magnetic resonance imaging have emerged as novel techniques for the non-invasive characterisation of prostate cancer. This review presents recent developments in prostate DWI and discusses its potential use in clinical practice.

Development and Validation of a Radiomics Nomogram for Predicting Clinically Significant Prostate Cancer in PI-RADS 3 Lesions

Purpose

To develop and validate a radiomics nomogram for the prediction of clinically significant prostate cancer (CsPCa) in Prostate Imaging-Reporting and Data System (PI-RADS) category 3 lesions.

Methods

We retrospectively enrolled 306 patients within PI-RADS 3 lesion from January 2015 to July 2020 in institution 1; the enrolled patients were randomly divided into the training group (n = 199) and test group (n = 107). Radiomics features were extracted from T2-weighted imaging (T2WI), apparent diffusion coefficient (ADC) imaging, and dynamic contrast-enhanced (DCE) imaging. Synthetic minority oversampling technique (SMOTE) was used to address the class imbalance. The ANOVA and least absolute shrinkage and selection operator (LASSO) regression model were used for feature selection and radiomics signature building. Then, a radiomics score (Rad-score) was acquired. Combined with serum prostate-specific antigen density (PSAD) level, a multivariate logistic regression analysis was used to construct a radiomics nomogram. Receiver operating characteristic (ROC) curve analysis was used to evaluate radiomics signature and nomogram. The radiomics nomogram calibration and clinical usefulness were estimated through calibration curve and decision curve analysis (DCA). External validation was assessed, and the independent validation cohort contained 65 patients within PI-RADS 3 lesion from January 2020 to July 2021 in institution 2.

Results

A total of 75 (24.5%) and 16 (24.6%) patients had CsPCa in institution 1 and 2, respectively. The radiomics signature with SMOTE augmentation method had a higher area under the ROC curve (AUC) [0.840 (95% CI, 0.776–0.904)] than that without SMOTE method [0.730 (95% CI, 0.624–0.836), p = 0.08] in the test group and significantly increased in the external validation group [0.834 (95% CI, 0.709–0.959) vs. 0.718 (95% CI, 0.562–0.874), p = 0.017]. The radiomics nomogram showed good discrimination and calibration, with an AUC of 0.939 (95% CI, 0.913–0.965), 0.884 (95% CI, 0.831–0.937), and 0.907 (95% CI, 0.814–1) in the training, test, and external validation groups, respectively. The DCA demonstrated the clinical usefulness of radiomics nomogram.

Conclusion

The radiomics nomogram that incorporates the MRI-based radiomics signature and PSAD can be conveniently used to individually predict CsPCa in patients within PI-RADS 3 lesion.

Extraction parameter optimized radiomics for neoadjuvant chemotherapy response prognosis in advanced nasopharyngeal carcinoma

•

MRI radiomics is promising for NAC early response prediction in NPC patients.

•

Predictive performance could be improved by the optimized strategy.

•

The model could help with NPC individualized treatment.

Background and purpose

Neoadjuvant Chemotherapy (NAC) followed by concurrent chemoradiotherapy (CCRT) is promising in improving the survival rate for advanced nasopharyngeal carcinoma (NPC) patients relative to CCRT alone. However, not all patients respond well to NAC. Therefore, we aimed to develop and evaluate a modified radiomics model for the NAC response prognosis in NPC patients.

Methods

A total of 165 patients with biopsy-proven locally advanced NPC were retrospectively selected from the database of our hospital. 85 out of them were for training and cross-validation, while the other 80 patients were for independent testing. All patients were treated with NAC and underwent MRI inspection, including T1-weighted (T1), T2-weighted (T2), and contrast-enhanced T1-weighted (T1-cs) sequences before and after two cycles of NAC. We classified the patients into the response or non-response groups by the Response Evaluation Criteria in Solid Tumors 1.1 (RECIST 1.1). Radiomics features were extracted from the primary and lymph node gross tumor volume in each sequence. To further improve the predictive performance, the permutation of multiple combinations of extraction parameters has first ever been investigated in the NAC prognosis for NPC patients. The model was constructed by logistic regression and cross-validated by bootstrapping with a resampling number of 1000. Independent testing was also implemented. In addition, we also applied an imbalance-adjusted bootstrap strategy to decrease the bias of small samples.

Results

For the cross-validation cohort, the resultant AUC, sensitivity, and specificity in terms of 95% confidence interval were 0.948 ± 0.004, 0.849 ± 0.005, and 0.840 ± 0.010. For the independent testing cohort, the model reached an AUC of 0.925, a sensitivity of 0.821, and a specificity of 0.792. There was a significant difference in the estimated radiomics score between the response and non-response groups (P < 0.005).

Conclusions

An MRI-based radiomics model was developed and demonstrated promising capability for the individual prediction of NAC response in NPC patients. In particular, we have optimized the multiple combinations of texture extraction parameters with the permutation test and observed an encouraging improvement of the prediction performance compared to the previously published studies. The proposed model might provide chances for individualized treatment in NPC patients while retrenching the cost of clinical resources.

Machine and Deep Learning Prediction Of Prostate Cancer Aggressiveness Using Multiparametric MRI

Prostate cancer (PCa) is the most frequent male malignancy and the assessment of PCa aggressiveness, for which a biopsy is required, is fundamental for patient management. Currently, multiparametric (mp) MRI is strongly recommended before biopsy. Quantitative assessment of mpMRI might provide the radiologist with an objective and noninvasive tool for supporting the decision-making in clinical practice and decreasing intra- and inter-reader variability. In this view, high dimensional radiomics features and Machine Learning (ML) techniques, along with Deep Learning (DL) methods working on raw images directly, could assist the radiologist in the clinical workflow. The aim of this study was to develop and validate ML/DL frameworks on mpMRI data to characterize PCas according to their aggressiveness. We optimized several ML/DL frameworks on T2w, ADC and T2w+ADC data, using a patient-based nested validation scheme. The dataset was composed of 112 patients (132 peripheral lesions with Prostate Imaging Reporting and Data System (PI-RADS) score ≥ 3) acquired following both PI-RADS 2.0 and 2.1 guidelines. Firstly, ML/DL frameworks trained and validated on PI-RADS 2.0 data were tested on both PI-RADS 2.0 and 2.1 data. Then, we trained, validated and tested ML/DL frameworks on a multi PI-RADS dataset. We reported the performances in terms of Area Under the Receiver Operating curve (AUROC), specificity and sensitivity. The ML/DL frameworks trained on T2w data achieved the overall best performance. Notably, ML and DL frameworks trained and validated on PI-RADS 2.0 data obtained median AUROC values equal to 0.750 and 0.875, respectively, on unseen PI-RADS 2.0 test set. Similarly, ML/DL frameworks trained and validated on multi PI-RADS T2w data showed median AUROC values equal to 0.795 and 0.750, respectively, on unseen multi PI-RADS test set. Conversely, all the ML/DL frameworks trained and validated on PI-RADS 2.0 data, achieved AUROC values no better than the chance level when tested on PI-RADS 2.1 data. Both ML/DL techniques applied on mpMRI seem to be a valid aid in predicting PCa aggressiveness. In particular, ML/DL frameworks fed with T2w images data (objective, fast and non-invasive) show good performances and might support decision-making in patient diagnostic and therapeutic management, reducing intra- and inter-reader variability.

Multimodality MRI-based radiomics approach to predict the posttreatment response of lung cancer brain metastases to gamma knife radiosurgery

OBJECTIVES

To develop and validate a multimodality MRI-based radiomics approach to predicting the posttreatment response of lung cancer brain metastases (LCBM) to gamma knife radiosurgery (GKRS).

METHODS

We retrospectively analyzed 213 lesions from 137 patients with LCBM who received GKRS between January 2017 and November 2020. The data were divided into a primary cohort (102 patients with 173 lesions) and an independent validation cohort (35 patients with 40 lesions) according to the time of treatment. Benefit result was defined using pretreatment and 3-month follow-up MRI images based on the Response Assessment in Neuro-Oncology Brain Metastases criteria. Valuable radiomics features were extracted from pretreatment multimodality MRI images using random forests. Prediction performance among the radiomics features of tumor core (RFTC) and radiomics features of peritumoral edema (RFPE) together was evaluated separately. Then, the random forest radiomics score and nomogram were developed through the primary cohort and evaluated through an independent validation cohort. Prediction performance was evaluated by ROC curve, calibration curve, and decision curve.

RESULTS

Gender (p = 0.018), histological subtype (p = 0.009), epidermal growth factor receptor mutation (p = 0.034), and targeted drug treatment (p = 0.021) were significantly associated with posttreatment response. Adding RFPE to RFTC showed improved prediction performance than RFTC alone in primary cohort (AUC = 0.848 versus AUC = 0.750; p < 0.001). Finally, the radiomics nomogram had an AUC of 0.930, a C-index of 0.930 (specificity of 83.1%, sensitivity of 87.3%) in primary cohort, and an AUC of 0.852, a C-index of 0.848 (specificity of 84.2%, sensitivity of 76.2%) in validation cohort.

CONCLUSIONS

Multimodality MRI-based radiomics models can predict the posttreatment response of LCBM to GKRS.

KEY POINTS

• Among the selected radiomics features, texture features basically contributed the dominant force in prediction tasks (80%), especially gray-level co-occurrence matrix features (40%). • Adding RFPE to RFTC showed improved prediction performance than RFTC alone in primary cohort (AUC = 0.848 versus AUC = 0.750; p < 0.001). • The multimodality MRI-based radiomics nomogram showed high accuracy for distinguishing the posttreatment response of LCBM to GKRS (AUC = 0.930, in primary cohort; AUC = 0.852, in validation cohort).

Identification of prostate cancer using multiparametric MR imaging characteristics of prostate tissues referenced to whole mount histopathology

In this study, the objective was to characterize the MR signatures of the various benign prostate tissues and to differentiate them from cancer. Data was from seventy prostate cancer patients who underwent multiparametric MRI (mpMRI) and subsequent prostatectomy. The scans included T2-weighted imaging (T2W), diffusion weighted imaging, dynamic contrast-enhanced MRI (DCE MRI), and MR spectroscopic imaging. Histopathology tissue information was translated to MRI images. The mpMRI parameters were characterized separately per zone and by tissue type. The tissues were ordered according to trends in tissue parameter means. The peripheral zone tissue order was cystic atrophy, high grade prostatic intraepithelial neoplasia (HGPIN), normal, atrophy, inflammation, and cancer. Decreasing values for tissue order were exhibited by ADC (1.8 10^-3 mm²/s to 1.2 10^-3 mm²/s) and T2W intensity (3447 to 2576). Increasing values occurred for DCE MRI peak (143% to 157%), DCE MRI slope (101%/min to 169%/min), fractional anisotropy (FA) (0.16 to 0.19), choline (7.2 to 12.2), and choline / citrate (0.3 to 0.9). The transition zone tissue order was cystic atrophy, mixed benign prostatic hyperplasia (BPH), normal, atrophy, inflammation, stroma, anterior fibromuscular stroma, and cancer. Decreasing values occurred for ADC (1.6 10^-3 mm²/s to 1.1 10^-3 mm²/s) and T2W intensity (2863 to 2001). Increasing values occurred for DCE MRI peak (143% to 150%), DCE MRI slope (101%/min to 137%/min), FA (0.18 to 0.25), choline (7.9 to 11.7), and choline / citrate (0.3 to 0.7). Logistic regression was used to create parameter model fits to differentiate cancer from benign prostate tissues. The fits achieved AUCs ≥0.91. This study quantified the mpMRI characteristics of benign prostate tissues and demonstrated the capability of mpMRI to discriminate among benign as well as cancer tissues, potentially aiding future discrimination of cancer from benign confounders.

Comparative performance of MRI-derived PRECISE scores and delta-radiomics models for the prediction of prostate cancer progression in patients on active surveillance

OBJECTIVES

To compare the performance of the PRECISE scoring system against several MRI-derived delta-radiomics models for predicting histopathological prostate cancer (PCa) progression in patients on active surveillance (AS).

METHODS

The study included AS patients with biopsy-proven PCa with a minimum follow-up of 2 years and at least one repeat targeted biopsy. Histopathological progression was defined as grade group progression from diagnostic biopsy. The control group included patients with both radiologically and histopathologically stable disease. PRECISE scores were applied prospectively by four uro-radiologists with 5-16 years' experience. T2WI- and ADC-derived delta-radiomics features were computed using baseline and latest available MRI scans, with the predictive modelling performed using the parenclitic networks (PN), least absolute shrinkage and selection operator (LASSO) logistic regression, and random forests (RF) algorithms. Standard measures of discrimination and areas under the ROC curve (AUCs) were calculated, with AUCs compared using DeLong's test.

RESULTS

The study included 64 patients (27 progressors and 37 non-progressors) with a median follow-up of 46 months. PRECISE scores had the highest specificity (94.7%) and positive predictive value (90.9%), whilst RF had the highest sensitivity (92.6%) and negative predictive value (92.6%) for predicting disease progression. The AUC for PRECISE (84.4%) was non-significantly higher than AUCs of 81.5%, 78.0%, and 80.9% for PN, LASSO regression, and RF, respectively (p = 0.64, 0.43, and 0.57, respectively). No significant differences were observed between AUCs of the three delta-radiomics models (p-value range 0.34-0.77).

CONCLUSIONS

PRECISE and delta-radiomics models achieved comparably good performance for predicting PCa progression in AS patients.

KEY POINTS

• The observed high specificity and PPV of PRECISE are complemented by the high sensitivity and NPV of delta-radiomics, suggesting a possible synergy between the two image assessment approaches. • The comparable performance of delta-radiomics to PRECISE scores applied by expert readers highlights the prospective use of the former as an objective and standardisable quantitative tool for MRI-guided AS follow-up. • The marginally superior performance of parenclitic networks compared to conventional machine learning algorithms warrants its further use in radiomics research.

The added value of PSMA PET/MR radiomics for prostate cancer staging

PURPOSE

To evaluate the performance of combined PET and multiparametric MRI (mpMRI) radiomics for the group-wise prediction of postsurgical Gleason scores (psGSs) in primary prostate cancer (PCa) patients.

METHODS

Patients with PCa, who underwent [68 Ga]Ga-PSMA-11 PET/MRI followed by radical prostatectomy, were included in this retrospective analysis (n = 101). Patients were grouped by psGS in three categories: ISUP grades 1-3, ISUP grade 4, and ISUP grade 5. mpMRI images included T1-weighted, T2-weighted, and apparent diffusion coefficient (ADC) map. Whole-prostate segmentations were performed on each modality, and image biomarker standardization initiative (IBSI)-compliant radiomic features were extracted. Nine support vector machine (SVM) models were trained: four single-modality radiomic models (PET, T1w, T2w, ADC); three PET + MRI double-modality models (PET + T1w, PET + T2w, PET + ADC), and two baseline models (one with patient data, one image-based) for comparison. A sixfold stratified cross-validation was performed, and balanced accuracies (bAcc) of the predictions of the best-performing models were reported and compared through Student's t-tests. The predictions of the best-performing model were compared against biopsy GS (bGS).

RESULTS

All radiomic models outperformed the baseline models. The best-performing (mean ± stdv [%]) single-modality model was the ADC model (76 ± 6%), although not significantly better (p > 0.05) than other single-modality models (T1w: 72 ± 3%, T2w: 73 ± 2%; PET: 75 ± 5%). The overall best-performing model combined PET + ADC radiomics (82 ± 5%). It significantly outperformed most other double-modality (PET + T1w: 74 ± 5%, p = 0.026; PET + T2w: 71 ± 4%, p = 0.003) and single-modality models (PET: p = 0.042; T1w: p = 0.002; T2w: p = 0.003), except the ADC-only model (p = 0.138). In this initial cohort, the PET + ADC model outperformed bGS overall (82.5% vs 72.4%) in the prediction of psGS.

CONCLUSION

All single- and double-modality models outperformed the baseline models, showing their potential in the prediction of GS, even with an unbalanced cohort. The best-performing model included PET + ADC radiomics, suggesting a complementary value of PSMA-PET and ADC radiomics.

Multi-resolution super learner for voxel-wise classification of prostate cancer using multi-parametric MRI

Multi-parametric MRI (mpMRI) is a critical tool in prostate cancer (PCa) diagnosis and management. To further advance the use of mpMRI in patient care, computer aided diagnostic methods are under continuous development for supporting/supplanting standard radiological interpretation. While voxel-wise PCa classification models are the gold standard, few if any approaches have incorporated the inherent structure of the mpMRI data, such as spatial heterogeneity and between-voxel correlation, into PCa classification. We propose a machine learning-based method to fill in this gap. Our method uses an ensemble learning approach to capture regional heterogeneity in the data, where classifiers are developed at multiple resolutions and combined using the super learner algorithm, and further account for between-voxel correlation through a Gaussian kernel smoother. It allows any type of classifier to be the base learner and can be extended to further classify PCa sub-categories. We introduce the algorithms for binary PCa classification, as well as for classifying the ordinal clinical significance of PCa for which a weighted likelihood approach is implemented to improve the detection of less prevalent cancer categories. The proposed method has shown important advantages over conventional modeling and machine learning approaches in simulations and application to our motivating patient data.

Demethylation of m1A assisted degradation of the signal probe for rapid electrochemical detection of ALKBH3 activity with practical applications

ALKBH3 is an important marker for early diagnosis and histopathological grading of prostate cancer. However, the lack of a rapid and sensitive method to quantify the enzyme's activity in the current time necessitates the development of a new quantitative assay. Herein, we first tried to quantitative assay for ALKBH3 activity using an electrochemical method based on the degradation of the signal probe due to alkyl group of the m1A removal by ALKBH3. A strong electrochemical signal can be obtained when the ferrocene (Fc) labeled dsDNAs with 1-methyladenine are immobilized on the electrode. In the presence of ALKBH3, the 3' blunt of DNA can be formed because of the removal of alkyl group of the Fc-DNA probe, which can be recognized and degraded by Exonuclease III (Exo III). As a result, the electrochemical signal produced by Fc greatly decreases, and the activity of ALKBH3 can be easily detected via changes in electrochemical signal. Quantitative analysis of ALKBH3 activity showed a wide detection range (0.1 and 20 ng/mL) and low detection limit (0.04 ng/mL). Furthermore, the method can be applied to detect 1-methyladenine through ALKBH3 in cell lysates and tissue samples, providing a new method for clinical detection of prostate cancer.

Automatic lung nodule segmentation and intra-nodular heterogeneity image generation

Automatic segmentation of lung nodules on computed tomography (CT) images is challenging owing to the variability of morphology, location, and intensity. In addition, few segmentation methods can capture intra-nodular heterogeneity to assist lung nodule diagnosis. In this study, we propose an end-to-end architecture to perform fully automated segmentation of multiple types of lung nodules and generate intra-nodular heterogeneity images for clinical use. To this end, a hybrid loss is considered by introducing a Faster R-CNN model based on generalized intersection over union loss in generative adversarial network. The Lung Image Database Consortium image collection dataset, comprising 2,635 lung nodules, was combined with 3,200 lung nodules from five hospitals for this study. Compared with manual segmentation by radiologists, the proposed model obtained an average dice coefficient (DC) of 82.05% on the test dataset. Compared with U-net, NoduleNet, nnU-net, and other three models, the proposed method achieved comparable performance on lung nodule segmentation and generated more vivid and valid intra-nodular heterogeneity images, which are beneficial in radiological diagnosis. In an external test of 91 patients from another hospital, the proposed model achieved an average DC of 81.61%. The proposed method effectively addresses the challenges of inevitable human interaction and additional pre-processing procedures in the existing solutions for lung nodule segmentation. In addition, the results show that the intra-nodular heterogeneity images generated by the proposed model are suitable to facilitate lung nodule diagnosis in radiology.

Prediction of Clinically Significant Cancer Using Radiomics Features of Pre-Biopsy of Multiparametric MRI in Men Suspected of Prostate Cancer

Background: Texture features based on the spatial relationship of pixels, known as the gray-level co-occurrence matrix (GLCM), may play an important role in providing the accurate classification of suspected prostate cancer. The purpose of this study was to use quantitative imaging parameters of pre-biopsy multiparametric magnetic resonance imaging (mpMRI) for the prediction of clinically significant prostate cancer. Methods: This was a prospective study, recruiting 200 men suspected of having prostate cancer. Participants were imaged using a protocol-based 3T MRI in the pre-biopsy setting. Radiomics parameters were extracted from the T2WI and ADC texture features of the gray-level co-occurrence matrix were delineated from the region of interest. Radical prostatectomy histopathology was used as a reference standard. A Kruskal–Wallis test was applied first to identify the significant radiomic features between the three groups of Gleason scores (i.e., G1, G2 and G3). Subsequently, the Holm–Bonferroni method was applied to correct and control the probability of false rejections. We compared the probability of correctly predicting significant prostate cancer between the explanatory GLCM radiomic features, PIRADS and PSAD, using the area under the receiver operation characteristic curves. Results: We identified the significant difference in radiomic features between the three groups of Gleason scores. In total, 12 features out of 22 radiomics features correlated with the Gleason groups. Our model demonstrated excellent discriminative ability (C-statistic = 0.901, 95%CI 0.859–0.943). When comparing the probability of correctly predicting significant prostate cancer between explanatory GLCM radiomic features (Sum Variance T2WI, Sum Entropy T2WI, Difference Variance T2WI, Entropy ADC and Difference Variance ADC), PSAD and PIRADS via area under the ROC curve, radiomic features were 35.0% and 34.4% more successful than PIRADS and PSAD, respectively, in correctly predicting significant prostate cancer in our patients (p < 0.001). The Sum Entropy T2WI score had the greatest impact followed by the Sum Variance T2WI. Conclusion: Quantitative GLCM texture analyses of pre-biopsy MRI has the potential to be used as a non-invasive imaging technique to predict clinically significant cancer in men suspected of having prostate cancer.

Development of a Deep Learning Model to Assist With Diagnosis of Hepatocellular Carcinoma

Background

An accurate pathological diagnosis of hepatocellular carcinoma (HCC), one of the malignant tumors with the highest mortality rate, is time-consuming and heavily reliant on the experience of a pathologist. In this report, we proposed a deep learning model that required minimal noise reduction or manual annotation by an experienced pathologist for HCC diagnosis and classification.

Methods

We collected a whole-slide image of hematoxylin and eosin-stained pathological slides from 592 HCC patients at the First Affiliated Hospital, College of Medicine, Zhejiang University between 2015 and 2020. We propose a noise-specific deep learning model. The model was trained initially with 137 cases cropped into multiple-scaled datasets. Patch screening and dynamic label smoothing strategies are adopted to handle the histopathological liver image with noise annotation from the perspective of input and output. The model was then tested in an independent cohort of 455 cases with comparable tumor types and differentiations.

Results

Exhaustive experiments demonstrated that our two-step method achieved 87.81% pixel-level accuracy and 98.77% slide-level accuracy in the test dataset. Furthermore, the generalization performance of our model was also verified using The Cancer Genome Atlas dataset, which contains 157 HCC pathological slides, and achieved an accuracy of 87.90%.

Conclusions

The noise-specific histopathological classification model of HCC based on deep learning is effective for the dataset with noisy annotation, and it significantly improved the pixel-level accuracy of the regular convolutional neural network (CNN) model. Moreover, the model also has an advantage in detecting well-differentiated HCC and microvascular invasion.

Prostate heterogeneity correlates with clinical features on multiparametric MRI

BACKGROUND

Prostate heterogeneity on multi-parametric MRI (mpMRI) may confound image interpretation by obscuring lesions; systematic biopsy may have a role in this context.

PURPOSE

To determine if prostate heterogeneity (1) correlates with clinical risk factors for prostate cancer and (2) associates with higher-grade tumor in systematic biopsy (SB), compared with MRI-directed target biopsy (MDTB), i.e., SB > MDTB, thus providing a rationale for combined biopsy.

METHODS

IRB-approved retrospective study included men who underwent mpMRI, SB, and MDTB between 2015 and 2017. Regions of interest were applied to the entire transition zone (TZ) and peripheral zone (PZ) on T2-weighted imaging (T2WI), apparent diffusion coefficient maps (ADC), and early dynamic contrast-enhanced (DCE) images on the midgland slice. Mean signal intensities and standard deviation (SD) of each zone were calculated. SD served as a measure of heterogeneity. Spearman's rank correlation analysis of clinical and imaging variables was performed. Univariate logistic regression was used to determine if any imaging variable associated with SB > MDTB.

RESULTS

93 patients were included. Significant correlations included age and TZ ADC heterogeneity (rho = 0.34, p = 0.013), PSA density, and mean TZ ADC (rho = - 0.29, p = 0.049). PZ T2WI heterogeneity correlated with PZ ADC heterogeneity (rho = 0.48, p < 0.001). PZ DCE heterogeneity correlated with TZ DCE heterogeneity (rho = 0.46, p < 0.001). TZ ADC heterogeneity was associated with SB > MDTB prior to multiple comparison correction (p = 0.032). p value after correction was 0.24.

CONCLUSION

TZ ADC heterogeneity correlated with age and may reflect prostatic hyperplasia and/or prostate cancer. PZ heterogeneity, possibly a measure of prostatitis, correlated with TZ hyperplasia and/or inflammation. TZ ADC heterogeneity was associated with SB > MDTB with p value of < 0.05 prior to multiple correction; future investigation is needed to further elucidate significance of ADC heterogeneity in prostate imaging.

A Combined Radiomics and Machine Learning Approach to Distinguish Clinically Significant Prostate Lesions on a Publicly Available MRI Dataset

Although prostate cancer is one of the most common causes of mortality and morbidity in advancing-age males, early diagnosis improves prognosis and modifies the therapy of choice. The aim of this study was the evaluation of a combined radiomics and machine learning approach on a publicly available dataset in order to distinguish a clinically significant from a clinically non-significant prostate lesion. A total of 299 prostate lesions were included in the analysis. A univariate statistical analysis was performed to prove the goodness of the 60 extracted radiomic features in distinguishing prostate lesions. Then, a 10-fold cross-validation was used to train and test some models and the evaluation metrics were calculated; finally, a hold-out was performed and a wrapper feature selection was applied. The employed algorithms were Naïve bayes, K nearest neighbour and some tree-based ones. The tree-based algorithms achieved the highest evaluation metrics, with accuracies over 80%, and area-under-the-curve receiver-operating characteristics below 0.80. Combined machine learning algorithms and radiomics based on clinical, routine, multiparametric, magnetic-resonance imaging were demonstrated to be a useful tool in prostate cancer stratification.

Assessing PD-L1 Expression Level via Preoperative MRI in HCC Based on Integrating Deep Learning and Radiomics Features

To assess if quantitative integrated deep learning and radiomics features can predict the PD-L1 expression level in preoperative MRI of hepatocellular carcinoma (HCC) patients. The data in this study consist of 103 hepatocellular carcinoma patients who received immunotherapy in a single center. These patients were divided into a high PD-L1 expression group (30 patients) and a low PD-L1 expression group (73 patients). Both radiomics and deep learning features were extracted from their MRI sequence of T2-WI, which were merged into an integrative feature space for machine learning for the prediction of PD-L1 expression. The five-fold cross-validation was adopted to validate the performance of the model, while the AUC was used to assess the predictive ability of the model. Based on the five-fold cross-validation, the integrated model achieved the best prediction performance, with an AUC score of 0.897 ± 0.084, followed by the deep learning-based model with an AUC of 0.852 ± 0.043 then the radiomics-based model with AUC of 0.794 ± 0.035. The feature set integrating radiomics and deep learning features is more effective in predicting PD-L1 expression level than only one feature type. The integrated model can achieve fast and accurate prediction of PD-L1 expression status in preoperative MRI of HCC patients.

Multiparametric MRI and Radiomics in Prostate Cancer: A Review of the Current Literature

Prostate cancer (PCa) represents the fourth most common cancer and the fifth leading cause of cancer death of men worldwide. Multiparametric MRI (mp-MRI) has high sensitivity and specificity in the detection of PCa, and it is currently the most widely used imaging technique for tumor localization and cancer staging. mp-MRI plays a key role in risk stratification of naïve patients, in active surveillance for low-risk patients, and in monitoring recurrence after definitive therapy. Radiomics is an emerging and promising tool which allows a quantitative tumor evaluation from radiological images via conversion of digital images into mineable high-dimensional data. The purpose of radiomics is to increase the features available to detect PCa, to avoid unnecessary biopsies, to define tumor aggressiveness, and to monitor post-treatment recurrence of PCa. The integration of radiomics data, including different imaging modalities (such as PET-CT) and other clinical and histopathological data, could improve the prediction of tumor aggressiveness as well as guide clinical decisions and patient management. The purpose of this review is to describe the current research applications of radiomics in PCa on MR images.

Artificial Intelligence-assisted Prostate Cancer Diagnosis: Radiologic-Pathologic Correlation

The classic prostate cancer (PCa) diagnostic pathway that is based on prostate-specific antigen (PSA) levels and the findings of digital rectal examination followed by systematic biopsy has shown multiple limitations. The use of multiparametric MRI (mpMRI) is now widely accepted in men with clinical suspicion for PCa. In addition, clinical information, PSA density, risk calculators, and genomic and other "omics" biomarkers are being used to improve risk stratification. On the basis of mpMRI and MRI-targeted biopsies (MRI-TBx), new diagnostic pathways have been established, aiming to improve the limitations of the classic diagnostic approach. However, these pathways still show limitations associated with mpMRI and MRI-TBx. Definitive PCa diagnosis is made on the basis of histopathologic Gleason grading, which has demonstrated an excellent correlation with clinical outcomes. However, Gleason grading is done subjectively by pathologists and involves poor reproducibility, and PCa may have a heterogeneous distribution of histologic patterns. Thus, important discrepancies persist between biopsy tumor grading and final whole-organ pathologic assessment after radical prostatectomy. PCa offers a unique opportunity to establish a real radiologic-pathologic correlation, as whole-mount radical prostatectomy specimens permit a complete spatial relationship with mpMRI. Artificial intelligence is increasingly being applied to radiologic and pathologic images to improve clinical accuracy and efficiency in PCa diagnosis. This review delineates current PCa diagnostic pathways, with a focus on the role of mpMRI, MRI-TBx, and pathologic analysis. An overview of the expected improvements in PCa diagnosis derived from the use of artificial intelligence, integrated radiologic-pathologic systems, and decision support tools for multidisciplinary teams is provided. An invited commentary by Purysko is available online. Online supplemental material is available for this article. ^©RSNA, 2021.

De Novo Radiomics Approach Using Image Augmentation and Features From T1 Mapping to Predict Gleason Scores in Prostate Cancer

OBJECTIVES

The aims of this study were to discriminate among prostate cancers (PCa's) with Gleason scores 6, 7, and ≥8 on biparametric magnetic resonance imaging (bpMRI) of the prostate using radiomics and to evaluate the added value of image augmentation and quantitative T1 mapping.

MATERIALS AND METHODS

Eighty-five patients with subsequently histologically proven PCa underwent bpMRI at 3 T (T2-weighted imaging, diffusion-weighted imaging) with 66 patients undergoing additional T1 mapping at 3 T. The PCa lesions as well as the peripheral and transition zones were segmented pixel by pixel in multiple slices of the 3D MRI data sets (T2-weighted images, apparent diffusion coefficient, and T1 maps). To increase the size of the data set, images were augmented for contrast, brightness, noise, and perspective multiple times, effectively increasing the sample size 10-fold, and 322 different radiomics features were extracted before and after augmentation. Four different machine learning algorithms, including a random forest (RF), stochastic gradient boosting (SGB), support vector machine (SVM), and k-nearest neighbor, were trained with and without features from T1 maps to differentiate among 3 different Gleason groups (6, 7, and ≥8).

RESULTS

Support vector machine showed the highest accuracy of 0.92 (95% confidence interval [CI], 0.62-1.00) for classifying the different Gleason scores, followed by RF (0.83; 95% CI, 0.52-0.98), SGB (0.75; 95% CI, 0.43-0.95), and k-nearest neighbor (0.50; 95% CI, 0.21-0.79). Image augmentation resulted in an average increase in accuracy between 0.08 (SGB) and 0.48 (SVM). Removing T1 mapping features led to a decline in accuracy for RF (-0.16) and SGB (-0.25) and a higher generalization error.

CONCLUSIONS

When data are limited, image augmentations and features from quantitative T1 mapping sequences might help to achieve higher accuracy and lower generalization error for classification among different Gleason groups in bpMRI by using radiomics.

A deep look into radiomics

Radiomics is a process that allows the extraction and analysis of quantitative data from medical images. It is an evolving field of research with many potential applications in medical imaging. The purpose of this review is to offer a deep look into radiomics, from the basis, deeply discussed from a technical point of view, through the main applications, to the challenges that have to be addressed to translate this process in clinical practice. A detailed description of the main techniques used in the various steps of radiomics workflow, which includes image acquisition, reconstruction, pre-processing, segmentation, features extraction and analysis, is here proposed, as well as an overview of the main promising results achieved in various applications, focusing on the limitations and possible solutions for clinical implementation. Only an in-depth and comprehensive description of current methods and applications can suggest the potential power of radiomics in fostering precision medicine and thus the care of patients, especially in cancer detection, diagnosis, prognosis and treatment evaluation.

Target Heterogeneity in Oncology: The Best Predictor for Differential Response to Radioligand Therapy in Neuroendocrine Tumors and Prostate Cancer

Simple Summary

In the era of precision medicine, novel targets have emerged on the surface of cancer cells, which have been exploited for the purpose of radioligand therapy. However, there have been variations in the way these receptors are expressed, especially in prostate cancers and neuroendocrine tumors. This variable expression of receptors across the grades of cancers led to the concept of ‘target heterogeneity’, which has not just impacted therapeutic decisions but also their outcomes. Radiopharmaceuticals targeting receptors need to be used when there are specific indicators—either clinical, radiological, or at molecular level—warranting their use. In addition, response to these radioligands can be assessed using different techniques, whereby we can prognosticate further outcomes. We shall also discuss, in this review, the conventional as well as novel approaches of detecting heterogeneity in prostate cancers and neuroendocrine tumors.

Abstract

Tumor or target heterogeneity (TH) implies presence of variable cellular populations having different genomic characteristics within the same tumor, or in different tumor sites of the same patient. The challenge is to identify this heterogeneity, as it has emerged as the most common cause of ‘treatment resistance’, to current therapeutic agents. We have focused our discussion on ‘Prostate Cancer’ and ‘Neuroendocrine Tumors’, and looked at the established methods for demonstrating heterogeneity, each with its advantages and drawbacks. Also, the available theranostic radiotracers targeting PSMA and somatostatin receptors combined with targeted systemic agents, have been described. Lu-177 labeled PSMA and DOTATATE are the ‘standard of care’ radionuclide therapeutic tracers for management of progressive treatment-resistant prostate cancer and NET. These approved therapies have shown reasonable benefit in treatment outcome, with improvement in quality of life parameters. Various biomarkers and predictors of response to radionuclide therapies targeting TH which are currently available and those which can be explored have been elaborated in details. Imaging-based features using artificial intelligence (AI) need to be developed to further predict the presence of TH. Also, novel theranostic tools binding to newer targets on surface of cancer cell should be explored to overcome the treatment resistance to current treatment regimens.

Radiomics in prostate cancer imaging for a personalized treatment approach - current aspects of methodology and a systematic review on validated studies

Prostate cancer (PCa) is one of the most frequently diagnosed malignancies of men in the world. Due to a variety of treatment options in different risk groups, proper diagnostic and risk stratification is pivotal in treatment of PCa. The development of precise medical imaging procedures simultaneously to improvements in big data analysis has led to the establishment of radiomics - a computer-based method of extracting and analyzing image features quantitatively. This approach bears the potential to assess and improve PCa detection, tissue characterization and clinical outcome prediction. This article gives an overview on the current aspects of methodology and systematically reviews available literature on radiomics in PCa patients, showing its potential for personalized therapy approaches. The qualitative synthesis includes all imaging modalities and focuses on validated studies, putting forward future directions.

MRI-based radiomics models to assess prostate cancer, extracapsular extension and positive surgical margins

Purpose

To investigate the performance of magnetic resonance imaging (MRI)-based radiomics models for benign and malignant prostate lesion discrimination and extracapsular extension (ECE) and positive surgical margins (PSM) prediction.

Methods and materials

In total, 459 patients who underwent multiparametric MRI (mpMRI) before prostate biopsy were included. Radiomic features were extracted from both T2-weighted imaging (T2WI) and the apparent diffusion coefficient (ADC). Patients were divided into different training sets and testing sets for different targets according to a ratio of 7:3. Radiomics signatures were built using radiomic features on the training set, and integrated models were built by adding clinical characteristics. The areas under the receiver operating characteristic curves (AUCs) were calculated to assess the classification performance on the testing sets.

Results

The radiomics signatures for benign and malignant lesion discrimination achieved AUCs of 0.775 (T2WI), 0.863 (ADC) and 0.855 (ADC + T2WI). The corresponding integrated models improved the AUC to 0.851/0.912/0.905, respectively. The radiomics signatures for ECE achieved the highest AUC of 0.625 (ADC), and the corresponding integrated model achieved the highest AUC (0.728). The radiomics signatures for PSM prediction achieved AUCs of 0.614 (T2WI) and 0.733 (ADC). The corresponding integrated models reached AUCs of 0.680 and 0.766, respectively.

Conclusions

The MRI-based radiomics models, which took advantage of radiomic features on ADC and T2WI scans, showed good performance in discriminating benign and malignant prostate lesions and predicting ECE and PSM. Combining radiomics signatures and clinical factors enhanced the performance of the models, which may contribute to clinical diagnosis and treatment.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40644-021-00414-6.

CT-based multi-phase Radiomic models for differentiating clear cell renal cell carcinoma

Background

The aim of the study is to compare the diagnostic value of models that based on a set of CT texture and non-texture features for differentiating clear cell renal cell carcinomas(ccRCCs) from non-clear cell renal cell carcinomas(non-ccRCCs).

Methods

A total of 197 pathologically proven renal tumors were divided into ccRCC(n = 143) and non-ccRCC (n = 54) groups. The 43 non-texture features and 296 texture features that extracted from the 3D volume tumor tissue were assessed for each tumor at both Non-contrast Phase, NCP; Corticomedullary Phase, CMP; Nephrographic Phase, NP and Excretory Phase, EP. Texture-score were calculated by the Least Absolute Shrinkage and Selection Operator (LASSO) to screen the most valuable texture features. Model 1 contains the three most distinctive non-texture features with p < 0.001, Model 2 contains texture scores, and Model 3 contains the above two types of features.

Results

The three models shown good discrimination of the ccRCC from non-ccRCC in NCP, CMP, NP, and EP. The area under receiver operating characteristic curve (AUC)values of the Model 1, Model 2, and Model 3 in differentiating the two groups were 0.748–0.823, 0.776–0.887 and 0.864–0.900, respectively. The difference in AUC between every two of the three Models was statistically significant (p < 0.001).

Conclusions

The predictive efficacy of ccRCC was significantly improved by combining non-texture features and texture features to construct a combined diagnostic model, which could provide a reliable basis for clinical treatment options.

Integration of functional imaging in brachytherapy

Functional imaging allows the evaluation of numerous biological properties that could be considered at all steps of the therapeutic management of patients treated with brachytherapy. Indeed, it enables better initial staging of the disease, and some parameters may also be used as predictive biomarkers for treatment response, allowing better selection of patients eligible for brachytherapy. It may also improve the definition of target volumes with the aim of dose escalations by dose-painting. Finally, it could be useful during the follow-up to assess response to treatment. In this review, we report how functional imaging is integrated at the present time during the brachytherapy procedure, and what are its potential future contributions in the main tumour locations where brachytherapy is recommended. Functional imaging has great potential in the contact of brachytherapy, but still, several issues remain to be resolved before integrating it into clinical practice, especially as a biomarker or in dose painting strategies.

Intra-scanner repeatability of quantitative imaging features in a 3D printed semi-anthropomorphic CT phantom

OBJECTIVES

Radiomics has shown to provide novel diagnostic and predictive disease information based on quantitative image features in study settings. However, limited data yielded contradictory results and important questions regarding the validity of the methods remain to be answered. The purpose of this study was to evaluate how clinical imaging techniques affect the stability of radiomics features by using 3D printed anthropomorphic CT phantom to test for repeatability and reproducibility of quantitative parameters.

METHODS

48 PET/CT validated lymph nodes of prostate cancer patients (24 metastatic, 24 non-metastatic) were used as a template to create a customized 3D printed anthropomorphic phantom. We subsequently scanned the phantom five times with a routine abdominal CT protocol. Images were reconstructed using iterative reconstruction and two soft tissue kernels and one bone kernel. Radiomics features were extracted and assessed for repeatability and susceptibility towards image reconstruction settings using concordance correlation coefficients.

RESULTS

Our analysis revealed 19 of 86 features (22 %) as highly repeatable (CCC ≥ 0.85) with low susceptibility towards image reconstruction protocols. Most features analyzed depicted critical non-repeatability with CCC's < 0.75 even under entirely consistent imaging acquisition settings. Edge enhancing kernels result in higher variances between the scans and differences in repeatability and reproducibility were detected between PSMA-positive and negative lymph nodes with overall more stable features seen in tumor positive lymph nodes.

CONCLUSIONS

Both, repeatability and reproducibility play a crucial role in the validation process of radiomics features in clinical routine. This phantom study shows that most radiomics features in contrast to previous studies, including phantom and clinical, do not depict sufficient intra-scanner repeatability to serve as reliable diagnostic tools.

Preoperative Prediction of Extracapsular Extension: Radiomics Signature Based on Magnetic Resonance Imaging to Stage Prostate Cancer

PURPOSE

To investigate and validate the potential role of a radiomics signature in predicting the side-specific probability of extracapsular extension (ECE) of prostate cancer (PCa).

PROCEDURES

The preoperative magnetic resonance imaging data of 238 prostatic samples from 119 enrolled PCa patients were retrospectively assessed. The samples with were randomized in a two-to-one ratio into training (n = 74) and validation (n = 45) datasets. The radiomics features were derived from T2-weighted images (T2WIs). The optimal radiomics features were identified from the least absolute shrinkage and selection operator (LASSO) logistic regression model and were used to construct a predictive radiomics signature via dimension reduction and selection approaches. The association between the radiomics signatures and pathological ECE status was explored. Receiver operating characteristic (ROC) analysis was used to assess the discriminatory ability of the signature. The calibration performance and clinical usefulness of the radiomics signature were subsequently assessed by calibration curve and decision curve analyses.

RESULTS

The proposed radiomics signature that incorporated 17 selected radiomics features was significantly associated with pathological ECE outcomes (P < 0.001) in both the training and validation datasets. The constructed model displayed good discrimination, with areas under the curve (AUC) of 0.906 (95 % confidence interval (CI), 0.847, 0.948) and 0.821 (95 % CI, 0.726, 0.894) for the training and validation datasets, respectively, and had a good calibration performance. The clinical utility of this model was confirmed through decision curve analysis.

CONCLUSIONS

The radiomics signature based on T2WIs showed the potential to predict the side-specific probability of pathological ECE status and can facilitate the preoperative individualized predictions for PCa patients.

Radiomics in hepatic metastasis by colorectal cancer

Background

Radiomics is an emerging field and has a keen interest, especially in the oncology field. The process of a radiomics study consists of lesion segmentation, feature extraction, consistency analysis of features, feature selection, and model building. Manual segmentation is one of the most critical parts of radiomics. It can be time-consuming and suffers from variability in tumor delineation, which leads to the reproducibility problem of calculating parameters and assessing spatial tumor heterogeneity, particularly in large or multiple tumors. Radiomic features provides data on tumor phenotype as well as cancer microenvironment. Radiomics derived parameters, when associated with other pertinent data and correlated with outcomes data, can produce accurate robust evidence based clinical decision support systems. The principal challenge is the optimal collection and integration of diverse multimodal data sources in a quantitative manner that delivers unambiguous clinical predictions that accurately and robustly enable outcome prediction as a function of the impending decisions.

Methods

The search covered the years from January 2010 to January 2021. The inclusion criterion was: clinical study evaluating radiomics of liver colorectal metastases. Exclusion criteria were studies with no sufficient reported data, case report, review or editorial letter.

Results

We recognized 38 studies that assessed radiomics in mCRC from January 2010 to January 2021. Twenty were on different tpics, 5 corresponded to most criteria; 3 are review, or letter to editors; so 10 articles were included.

Conclusions

In colorectal liver metastases radiomics should be a valid tool for the characterization of lesions, in the stratification of patients based on the risk of relapse after surgical treatment and in the prediction of response to chemotherapy treatment.

Characterisation of prostate cancer using texture analysis for diagnostic and prognostic monitoring

Automated classification of significant prostate cancer (PCa) using MRI plays a potential role in assisting in clinical decision-making. Multiparametric MRI using a machine-aided approach is a better step to improve the overall accuracy of diagnosis of PCa. The objective of this study was to develop and validate a framework for differentiating Prostate Imaging-Reporting and Data System version 2 (PI-RADS v2) grades (grade 2 to grade 5) of PCa using texture features and machine learning (ML) methods with diffusion-weighted imaging (DWI) and apparent diffusion coefficient (ADC). The study cohort included an MRI dataset of 59 patients with clinically proven PCa. Regions of interest (ROIs) for a total of 435 lesions were delineated from the segmented peripheral zones of DWI and ADC. Six texture methods comprising 98 texture features in total (49 each of DWI and ADC) were extracted from lesion ROIs. Random forest (RF) and correlation-based feature selection methods were applied on feature vectors to select the best features for classification. Two ML classifiers, support vector machine (SVM) and K-nearest neighbour, were used and validated by 10-fold cross-validation. The proposed framework achieved high diagnostic performance with a sensitivity of 85.25% ± 3.84%, specificity of 95.71% ± 1.96%, accuracy of 84.90% ± 3.37% and area under the receiver-operating characteristic curve of 0.98 for PI-RADS v2 grades (2 to 5) classification using the RF feature selection method and Gaussian SVM classifier with combined features of DWI + ADC. The proposed computer-assisted framework can distinguish between PCa lesions with different aggressiveness based on PI-RADS v2 standards using texture analysis to improve the efficiency of PCa diagnostic performance.

Supervised machine learning enables non-invasive lesion characterization in primary prostate cancer with [68Ga]Ga-PSMA-11 PET/MRI

PURPOSE

Risk classification of primary prostate cancer in clinical routine is mainly based on prostate-specific antigen (PSA) levels, Gleason scores from biopsy samples, and tumor-nodes-metastasis (TNM) staging. This study aimed to investigate the diagnostic performance of positron emission tomography/magnetic resonance imaging (PET/MRI) in vivo models for predicting low-vs-high lesion risk (LH) as well as biochemical recurrence (BCR) and overall patient risk (OPR) with machine learning.

METHODS

Fifty-two patients who underwent multi-parametric dual-tracer [18F]FMC and [68Ga]Ga-PSMA-11 PET/MRI as well as radical prostatectomy between 2014 and 2015 were included as part of a single-center pilot to a randomized prospective trial (NCT02659527). Radiomics in combination with ensemble machine learning was applied including the [68Ga]Ga-PSMA-11 PET, the apparent diffusion coefficient, and the transverse relaxation time-weighted MRI scans of each patient to establish a low-vs-high risk lesion prediction model (MLH). Furthermore, MBCR and MOPR predictive model schemes were built by combining MLH, PSA, and clinical stage values of patients. Performance evaluation of the established models was performed with 1000-fold Monte Carlo (MC) cross-validation. Results were additionally compared to conventional [68Ga]Ga-PSMA-11 standardized uptake value (SUV) analyses.

RESULTS

The area under the receiver operator characteristic curve (AUC) of the MLH model (0.86) was higher than the AUC of the [68Ga]Ga-PSMA-11 SUVmax analysis (0.80). MC cross-validation revealed 89% and 91% accuracies with 0.90 and 0.94 AUCs for the MBCR and MOPR models respectively, while standard routine analysis based on PSA, biopsy Gleason score, and TNM staging resulted in 69% and 70% accuracies to predict BCR and OPR respectively.

CONCLUSION

Our results demonstrate the potential to enhance risk classification in primary prostate cancer patients built on PET/MRI radiomics and machine learning without biopsy sampling.

Development and validation of MRI-based deep learning models for prediction of microsatellite instability in rectal cancer

BACKGROUND

Microsatellite instability (MSI) predetermines responses to adjuvant 5-fluorouracil and immunotherapy in rectal cancer and serves as a prognostic biomarker for clinical outcomes. Our objective was to develop and validate a deep learning model that could preoperatively predict the MSI status of rectal cancer based on magnetic resonance images.

METHODS

This single-center retrospective study included 491 rectal cancer patients with pathologically proven microsatellite status. Patients were randomly divided into the training/validation cohort (n = 395) and the testing cohort (n = 96). A clinical model using logistic regression was constructed to discriminate MSI status using only clinical factors. Based on a modified MobileNetV2 architecture, deep learning models were tested for the predictive ability of MSI status from magnetic resonance images, with or without integrating clinical factors.

RESULTS

The clinical model correctly classified 37.5% of MSI status in the testing cohort, with an AUC value of 0.573 (95% confidence interval [CI], 0.468 ~ 0.674). The pure imaging-based model and the combined model correctly classified 75.0% and 85.4% of MSI status in the testing cohort, with AUC values of 0.820 (95% CI, 0.718 ~ 0.884) and 0.868 (95% CI, 0.784 ~ 0.929), respectively. Both deep learning models performed better than the clinical model (p < 0.05). There was no statistically significant difference between the deep learning models with or without integrating clinical factors.

CONCLUSIONS

Deep learning based on high-resolution T2-weighted magnetic resonance images showed a good predictive performance for MSI status in rectal cancer patients. The proposed model may help to identify patients who would benefit from chemotherapy or immunotherapy and determine individualized therapeutic strategies for these patients.

Integration of clinicopathologic identification and deep transferrable image feature representation improves predictions of lymph node metastasis in prostate cancer

Background

Accurate identification of pelvic lymph node metastasis (PLNM) in patients with prostate cancer (PCa) is crucial for determining appropriate treatment options. Here, we built a PLNM-Risk calculator to obtain a precisely informed decision about whether to perform extended pelvic lymph node dissection (ePLND).

Methods

The PLNM-Risk calculator was developed in 280 patients and verified internally in 71 patients and externally in 50 patients by integrating a set of radiologists’ interpretations, clinicopathological factors and newly refined imaging indicators from MR images with radiomics machine learning and deep transfer learning algorithms. Its clinical applicability was compared with Briganti and Memorial Sloan Kettering Cancer Center (MSKCC) nomograms.

Findings

The PLNM-Risk achieved good diagnostic discrimination with areas under the receiver operating characteristic curve (AUCs) of 0.93 (95% CI, 0.90-0.96), 0.92 (95% CI, 0.84-0.97) and 0.76 (95% CI, 0.62-0.87) in the training/validation, internal test and external test cohorts, respectively. If the number of ePLNDs missed was controlled at < 2%, PLNM-Risk provided both a higher number of ePLNDs spared (PLNM-Risk 59.6% vs MSKCC 44.9% vs Briganti 38.9%) and a lower number of false positives (PLNM-Risk 59.3% vs MSKCC 70.1% and Briganti 72.7%). In follow-up, patients stratified by the PLNM-Risk calculator showed significantly different biochemical recurrence rates after surgery.

Interpretation

The PLNM-Risk calculator offers a noninvasive clinical biomarker to predict PLNM for patients with PCa. It shows improved accuracy of diagnosis support and reduced overtreatment burdens for patients with findings suggestive of PCa.

Funding

This work was supported by the Key Research and Development Program of Jiangsu Province (BE2017756) and the Suzhou Science and Technology Bureau-Science and Technology Demonstration Project (SS201808).

Magnetic Resonance Imaging Radiomics-Based Machine Learning Prediction of Clinically Significant Prostate Cancer in Equivocal PI-RADS 3 Lesions

BACKGROUND

While Prostate Imaging Reporting and Data System (PI-RADS) 4 and 5 lesions typically warrant prostate biopsy and PI-RADS 1 and 2 lesions may be safely observed, PI-RADS 3 lesions are equivocal.

PURPOSE

To construct and cross-validate a machine learning model based on radiomics features from T₂ -weighted imaging (T₂ WI) of PI-RADS 3 lesions to identify clinically significant prostate cancer (csPCa), that is, pathological Grade Group ≥ 2.

STUDY TYPE

Single-center retrospective study.

POPULATION

A total of 240 patients were included (training cohort, n = 188, age range 43-82 years; test cohort, n = 52, age range 41-79 years). Eligibility criteria were 1) magnetic resonance imaging (MRI)-targeted biopsy between 2015 and 2020; 2) PI-RADS 3 index lesion identified on multiparametric MRI; (3) biopsy performed within 1 year of MRI. The percentages of csPCa lesions were 10.6% and 15.4% in the training and test cohorts, respectively.

FIELD STRENGTH/SEQUENCE

A 3 T; T₂ WI turbo-spin echo, diffusion-weighted spin-echo echo planar imaging, dynamic contrast-enhanced MRI with time-resolved T1-weighted imaging.

ASSESSMENT

Multislice volumes-of-interest (VOIs) were drawn in the PI-RADS 3 index lesions on T₂ WI. A total of 107 radiomics features (first-order histogram and second-order texture) were extracted from the segmented lesions.

STATISTICAL TESTS

A random forest classifier using the radiomics features as input was trained and validated for prediction of csPCa. The performance of the machine learning classifier, prostate specific antigen (PSA) density, and prostate volume for csPCa prediction was evaluated using receiver operating characteristic (ROC) analysis.

RESULTS

The trained random forest classifier constructed from the T₂ WI radiomics features good and statistically significant area-under-the-curves (AUCs) of 0.76 (P = 0.022) for prediction of csPCa in the test set. Prostate volume and PSA density showed moderate and nonsignificant performance (AUC 0.62, P = 0.275 and 0.61, P = 0.348, respectively) for csPCa prediction in the test set.

CONCLUSION

The machine learning classifier based on T₂ WI radiomic features demonstrated good performance for prediction of csPCa in PI-RADS 3 lesions.

EVIDENCE LEVEL

4 TECHNICAL EFFICACY: 2.

Automated detection of aggressive and indolent prostate cancer on magnetic resonance imaging

PURPOSE

While multi-parametric magnetic resonance imaging (MRI) shows great promise in assisting with prostate cancer diagnosis and localization, subtle differences in appearance between cancer and normal tissue lead to many false positive and false negative interpretations by radiologists. We sought to automatically detect aggressive cancer (Gleason pattern ≥ 4) and indolent cancer (Gleason pattern 3) on a per-pixel basis on MRI to facilitate the targeting of aggressive cancer during biopsy.

METHODS

We created the Stanford Prostate Cancer Network (SPCNet), a convolutional neural network model, trained to distinguish between aggressive cancer, indolent cancer, and normal tissue on MRI. Ground truth cancer labels were obtained by registering MRI with whole-mount digital histopathology images from patients who underwent radical prostatectomy. Before registration, these histopathology images were automatically annotated to show Gleason patterns on a per-pixel basis. The model was trained on data from 78 patients who underwent radical prostatectomy and 24 patients without prostate cancer. The model was evaluated on a pixel and lesion level in 322 patients, including six patients with normal MRI and no cancer, 23 patients who underwent radical prostatectomy, and 293 patients who underwent biopsy. Moreover, we assessed the ability of our model to detect clinically significant cancer (lesions with an aggressive component) and compared it to the performance of radiologists.

RESULTS

Our model detected clinically significant lesions with an area under the receiver operator characteristics curve of 0.75 for radical prostatectomy patients and 0.80 for biopsy patients. Moreover, the model detected up to 18% of lesions missed by radiologists, and overall had a sensitivity and specificity that approached that of radiologists in detecting clinically significant cancer.

CONCLUSIONS

Our SPCNet model accurately detected aggressive prostate cancer. Its performance approached that of radiologists, and it helped identify lesions otherwise missed by radiologists. Our model has the potential to assist physicians in specifically targeting the aggressive component of prostate cancers during biopsy or focal treatment.

Do the combination of multiparametric MRI-based radiomics and selected blood inflammatory markers predict the grade and proliferation in glioma patients?

PURPOSE

We aimed to explore whether multiparametric magnetic resonance imaging (MRI)-based radiomics combined with selected blood inflammatory markers could effectively predict the grade and proliferation in glioma patients.

METHODS

This retrospective study included 152 patients histopathologically diagnosed with glioma. Stratified sampling was used to divide all patients into a training cohort (n=107) and a validation cohort (n=45) according to a ratio of 7:3, and five-fold repeat cross-validation was adopted in the training cohort. Multiparametric MRI and clinical parameters, including age, the neutrophil-lymphocyte ratio and red cell distribution width, were assessed. During image processing, image registration and gray normalization were conducted. A radiomics analysis was performed by extracting 1584 multiparametric MRI-based features, and the least absolute shrinkage and selection operator (LASSO) was applied to generate a radiomics signature for predicting grade and Ki-67 index in both training and validation cohorts. Statistical analysis included analysis of variance, Pearson correlation, intraclass correlation coefficient, multivariate logistic regression, Hosmer-Lemeshow test, and receiver operating characteristic (ROC) curve.

RESULTS

The radiomics signature demonstrated good performance in both the training and validation cohorts, with areas under the ROC curve (AUCs) of 0.92, 0.91, and 0.94 and 0.94, 0.75, and 0.82 for differentiating between low and high grade gliomas, grade III and grade IV gliomas, and low Ki-67 and high Ki-67, respectively, and was better than the clinical model; the AUCs of the combined model were 0.93, 0.91, and 0.95 and 0.94, 0.76, and 0.80, respectively.

CONCLUSION

Both the radiomics signature and combined model showed high diagnostic efficacy and outperformed the clinical model. The clinical factors did not provide additional improvement in the prediction of the grade and proliferation index in glioma patients, but the stability was improved.

Artificial Intelligence and Its Impact on Urological Diseases and Management: A Comprehensive Review of the Literature

Recent advances in artificial intelligence (AI) have certainly had a significant impact on the healthcare industry. In urology, AI has been widely adopted to deal with numerous disorders, irrespective of their severity, extending from conditions such as benign prostate hyperplasia to critical illnesses such as urothelial and prostate cancer. In this article, we aim to discuss how algorithms and techniques of artificial intelligence are equipped in the field of urology to detect, treat, and estimate the outcomes of urological diseases. Furthermore, we explain the advantages that come from using AI over any existing traditional methods.

Development and Validation a Nomogram Incorporating CT Radiomics Signatures and Radiological Features for Differentiating Invasive Adenocarcinoma From Adenocarcinoma In Situ and Minimally Invasive Adenocarcinoma Presenting as Ground-Glass Nodules Measuring 5-10mm in Diameter

Purpose

To develop and validate a nomogram for differentiating invasive adenocarcinoma (IAC) from adenocarcinoma in situ (AIS) and minimally invasive adenocarcinoma (MIA) presenting as ground-glass nodules (GGNs) measuring 5-10mm in diameter.

Materials and Methods

This retrospective study included 446 patients with 478 GGNs histopathologically confirmed AIS, MIA or IAC. These patients were assigned to a primary cohort, an internal validation cohort and an external validation cohort. The segmentation of these GGNs on thin-slice computed tomography (CT) were performed semi-automatically with in-house software. Radiomics features were then extracted from unenhanced CT images with PyRadiomics. Radiological features of these GGNs were also collected. Radiomics features were investigated for usefulness in building radiomics signatures by spearman correlation analysis, minimum redundancy maximum relevance (mRMR) feature ranking method and least absolute shrinkage and selection operator (LASSO) classifier. Multivariable logistic regression analysis was used to develop a nomogram incorporating the radiomics signature and radiological features. The performance of the nomogram was assessed with discrimination, calibration, clinical usefulness and evaluated on the validation cohorts.

Results

Five radiomics features remained after features selection. The model incorporating radiomics signatures and four radiological features (bubble-like appearance, tumor-lung interface, mean CT value, average diameter) showed good calibration and good discrimination with AUC of 0.831(95%CI, 0.772~0.890). Application of the nomogram in the internal validation cohort with AUC of 0.792 (95%CI, 0.712~0.871) and in the external validation cohort with AUC of 0.833 (95%CI, 0.729-0.938) also indicated good calibration and good discrimination. The decision curve analysis demonstrated that the nomogram was clinically useful.

Conclusion

This study presents a nomogram incorporating the radiomics signatures and radiological features, which can be used to predict the risk of IAC in patients with GGNs measuring 5-10mm in diameter individually.

The Primacy of High B-Value 3T-DWI Radiomics in the Prediction of Clinically Significant Prostate Cancer

Predicting clinically significant prostate cancer (csPCa) is crucial in PCa management. 3T-magnetic resonance (MR) systems may have a novel role in quantitative imaging and early csPCa prediction, accordingly. In this study, we develop a radiomic model for predicting csPCa based solely on native b2000 diffusion weighted imaging (DWI_b2000) and debate the effectiveness of apparent diffusion coefficient (ADC) in the same task. In total, 105 patients were retrospectively enrolled between January–November 2020, with confirmed csPCa or ncsPCa based on biopsy. DWI_b2000 and ADC images acquired with a 3T-MRI were analyzed by computing 84 local first-order radiomic features (RFs). Two predictive models were built based on DWI_b2000 and ADC, separately. Relevant RFs were selected through LASSO, a support vector machine (SVM) classifier was trained using repeated 3-fold cross validation (CV) and validated on a holdout set. The SVM models rely on a single couple of uncorrelated RFs (ρ < 0.15) selected through Wilcoxon rank-sum test (p ≤ 0.05) with Holm–Bonferroni correction. On the holdout set, while the ADC model yielded AUC = 0.76 (95% CI, 0.63–0.96), the DWI_b2000 model reached AUC = 0.84 (95% CI, 0.63–0.90), with specificity = 75%, sensitivity = 90%, and informedness = 0.65. This study establishes the primary role of 3T-DWI_b2000 in PCa quantitative analyses, whilst ADC can remain the leading sequence for detection.

Subregion Radiomics Analysis to Display Necrosis After Hepatic Microwave Ablation-A Proof of Concept Study

OBJECTIVES

The aim of this study was to improve the visualization of coagulation necrosis after computed tomography (CT)-guided microwave ablation (MWA) in routine postablational imaging.

MATERIALS AND METHODS

Ten MWAs were performed in 8 pigs under CT guidance. After each ablation, we obtained contrast-enhanced CT scans in venous phase. Ablations were then resected as a whole, and histologic slices were obtained orthogonally through the ablation center. Subsequently, a vital stain was applied to the sections for visualization of coagulation necrosis. Computed tomography images were reformatted to match the histologic slices. Afterwards, quantitative imaging features were extracted from the subregions of all images, and binary classifiers were used to predict the presence of coagulation necrosis for each subregion. From this, heatmaps could be created, which visually represented the extent of necrosis in each CT image. Two independent observers evaluated the extent of coagulative necrosis between the heat maps and histological sections.

RESULTS

We applied 4 different classifiers, including a generalized linear mixed model (GLMM), a stochastic gradient boosting classifier, a random forest classifier, and a k-nearest neighbor classifier, out of which the GLMM showed the best performance to display coagulation necrosis. The GLMM resulted in an area under the curve of 0.84 and a Jaccard index of 0.6 between the generated heat map and the histologic reference standard as well as a good interobserver agreement with a Jaccard index of 0.9.

CONCLUSIONS

Subregion radiomics analysis may improve visualization of coagulation necrosis after hepatic MWA in an in vivo porcine model.

CT Texture Analysis for Preoperative Identification of Lymphoma from Other Types of Primary Small Bowel Malignancies

Objectives

To explore the application of computed tomography (CT) texture analysis in differentiating lymphomas from other malignancies of the small bowel.

Methods

Arterial and venous CT images of 87 patients with small bowel malignancies were retrospectively analyzed. The subjective radiological features were evaluated by the two radiologists with a consensus agreement. The region of interest (ROI) was manually delineated along the edge of the lesion on the largest slice, and a total of 402 quantified features were extracted automatically from AK software. The inter- and intrareader reproducibility was evaluated to select highly reproductive features. The univariate analysis and minimum redundancy maximum relevance (mRMR) algorithm were applied to select the feature subsets with high correlation and low redundancy. The multivariate logistic regression analysis based on texture features and radiological features was employed to construct predictive models for identification of small bowel lymphoma. The diagnostic performance of multivariate models was evaluated using receiver operating characteristic (ROC) curve analysis.

Results

The clinical data (age, melena, and abdominal pain) and radiological features (location, shape, margin, dilated lumen, intussusception, enhancement level, adjacent peritoneum, and locoregional lymph node) differed significantly between the nonlymphoma group and lymphoma group (p < 0.05). The areas under the ROC curve of the clinical model, arterial texture model, and venous texture model were 0.93, 0.92, and 0.87, respectively.

Conclusion

The arterial texture model showed a great diagnostic value and fitted performance in preoperatively discriminating lymphoma from nonlymphoma of the small bowel.