Prediction of Benign and Malignant Solid Renal Masses: Machine Learning-Based CT Texture Analysis

The influence of manual segmentation strategies and different phases selection on machine learning-based computed tomography in renal tumors: a systematic review and meta-analysis

BACKGROUND

Delineating the region/volume of interest (ROI/VOI) and selecting the phases are of importance in developing machine learning (ML). The results will change when choosing different methods of drawing the ROI/VOI and selecting different phases. However, there is no related standard for delineating the ROI/VOI and selecting the phases in renal tumors to develop ML based on computed tomography (CT).

METHODS

The PubMed and Web of Science were searched for related studies published until March 1, 2023. Inclusion criteria were studies that developed ML models in renal tumors from CT images. And the binary diagnostic accuracy data were extracted to obtain the outcomes, such as sensitivity (SE), specificity (SP), accuracy (ACC), and area under the curve (AUC).

RESULTS

Twenty-three papers were included in the meta-analysis with a pooled SE of 87% (95% CI 85-88%), SP of 82% (95% CI 79-85%), and AUC of 91% (95% CI 89-93%) in phases; a pooled SE of 82% (95% CI 80-84%), SP of 85% (95% CI 83-86%), and AUC of 90% (95% CI 88-93%) in phases combined with delineating strategies, respectively. In all different combinations, the contour-focused and single phase produce the highest AUC of 93% (95% CI 90-95%). In subgroup analyses (sample size, year of publication, and geographical distribution), the performance was acceptable on phases and phases combined strategies.

CONCLUSIONS

To explore the effect of manual segmentation strategies and different phases selection on ML-based CT, we find that the method of single phase (CMP or NP) combined with contour-focused was considered a better strategy compared to the other strategies.

Kidney medicine meets computer vision: a bibliometric analysis

BACKGROUND AND OBJECTIVE

Rapid advances in computer vision (CV) have the potential to facilitate the examination, diagnosis, and treatment of diseases of the kidney. The bibliometric study aims to explore the research landscape and evolving research focus of the application of CV in kidney medicine research.

METHODS

The Web of Science Core Collection was utilized to identify publications related to the research or applications of CV technology in the field of kidney medicine from January 1, 1900, to December 31, 2022. We analyzed emerging research trends, highly influential publications and journals, prolific researchers, countries/regions, research institutions, co-authorship networks, and co-occurrence networks. Bibliographic information was analyzed and visualized using Python, Matplotlib, Seaborn, HistCite, and Vosviewer.

RESULTS

There was an increasing trend in the number of publications on CV-based kidney medicine research. These publications mainly focused on medical image processing, surgical procedures, medical image analysis/diagnosis, as well as the application and innovation of CV technology in medical imaging. The United States is currently the leading country in terms of the quantities of published articles and international collaborations, followed by China. Deep learning-based segmentation and machine learning-based texture analysis are the most commonly used techniques in this field. Regarding research hotspot trends, CV algorithms are shifting toward artificial intelligence, and research objects are expanding to encompass a wider range of kidney-related objects, with data dimensions used in research transitioning from 2D to 3D while simultaneously incorporating more diverse data modalities.

CONCLUSION

The present study provides a scientometric overview of the current progress in the research and application of CV technology in kidney medicine research. Through the use of bibliometric analysis and network visualization, we elucidate emerging trends, key sources, leading institutions, and popular topics. Our findings and analysis are expected to provide valuable insights for future research on the use of CV in kidney medicine research.

Interpretable multiphasic CT-based radiomic analysis for preoperatively differentiating benign and malignant solid renal tumors: a multicenter study

BACKGROUND

To develop and compare machine learning models based on triphasic contrast-enhanced CT (CECT) for distinguishing between benign and malignant renal tumors.

MATERIALS AND METHODS

In total, 427 patients were enrolled from two medical centers: Center 1 (serving as the training set) and Center 2 (serving as the external validation set). First, 1781 radiomic features were individually extracted from corticomedullary phase (CP), nephrographic phase (NP), and excretory phase (EP) CECT images, after which 10 features were selected by the minimum redundancy maximum relevance method. Second, random forest (RF) models were constructed from single-phase features (CP, NP, and EP) as well as from the combination of features from all three phases (TP). Third, the RF models were assessed in the training and external validation sets. Finally, the internal prediction mechanisms of the models were explained by the SHapley Additive exPlanations (SHAP) approach.

RESULTS

A total of 266 patients with renal tumors from Center 1 and 161 patients from Center 2 were included. In the training set, the AUCs of the RF models constructed from the CP, NP, EP, and TP features were 0.886, 0.912, 0.930, and 0.944, respectively. In the external validation set, the models achieved AUCs of 0.860, 0.821, 0.921, and 0.908, respectively. The "original_shape_Flatness" feature played the most important role in the prediction outcome for the RF model based on EP features according to the SHAP method.

CONCLUSIONS

The four RF models efficiently differentiated benign from malignant solid renal tumors, with the EP feature-based RF model displaying the best performance.

Deep Learning Assessment of Small Renal Masses at Contrast-enhanced Multiphase CT

Background Accurate characterization of suspicious small renal masses is crucial for optimized management. Deep learning (DL) algorithms may assist with this effort. Purpose To develop and validate a DL algorithm for identifying benign small renal masses at contrast-enhanced multiphase CT. Materials and Methods Surgically resected renal masses measuring 3 cm or less in diameter at contrast-enhanced CT were included. The DL algorithm was developed by using retrospective data from one hospital between 2009 and 2021, with patients randomly allocated in a training and internal test set ratio of 8:2. Between 2013 and 2021, external testing was performed on data from five independent hospitals. A prospective test set was obtained between 2021 and 2022 from one hospital. Algorithm performance was evaluated by using the area under the receiver operating characteristic curve (AUC) and compared with the results of seven clinicians using the DeLong test. Results A total of 1703 patients (mean age, 56 years ± 12 [SD]; 619 female) with a single renal mass per patient were evaluated. The retrospective data set included 1063 lesions (874 in training set, 189 internal test set); the multicenter external test set included 537 lesions (12.3%, 66 benign) with 89 subcentimeter (≤1 cm) lesions (16.6%); and the prospective test set included 103 lesions (13.6%, 14 benign) with 20 (19.4%) subcentimeter lesions. The DL algorithm performance was comparable with that of urological radiologists: for the external test set, AUC was 0.80 (95% CI: 0.75, 0.85) versus 0.84 (95% CI: 0.78, 0.88) (P = .61); for the prospective test set, AUC was 0.87 (95% CI: 0.79, 0.93) versus 0.92 (95% CI: 0.86, 0.96) (P = .70). For subcentimeter lesions in the external test set, the algorithm and urological radiologists had similar AUC of 0.74 (95% CI: 0.63, 0.83) and 0.81 (95% CI: 0.68, 0.92) (P = .78), respectively. Conclusion The multiphase CT-based DL algorithm showed comparable performance with that of radiologists for identifying benign small renal masses, including lesions of 1 cm or less. Published under a CC BY 4.0 license. Supplemental material is available for this article.

Artificial intelligence support in MR imaging of incidental renal masses: an early health technology assessment

OBJECTIVE

This study analyzes the potential cost-effectiveness of integrating an artificial intelligence (AI)-assisted system into the differentiation of incidental renal lesions as benign or malignant on MR images during follow-up.

MATERIALS AND METHODS

For estimation of quality-adjusted life years (QALYs) and lifetime costs, a decision model was created, including the MRI strategy and MRI + AI strategy. Model input parameters were derived from recent literature. Willingness to pay (WTP) was set to $100,000/QALY. Costs of $0 for the AI were assumed in the base-case scenario. Model uncertainty and costs of the AI system were assessed using deterministic and probabilistic sensitivity analysis.

RESULTS

Average total costs were at $8054 for the MRI strategy and $7939 for additional use of an AI-based algorithm. The model yielded a cumulative effectiveness of 8.76 QALYs for the MRI strategy and of 8.77 for the MRI + AI strategy. The economically dominant strategy was MRI + AI. Deterministic and probabilistic sensitivity analysis showed high robustness of the model with the incremental cost-effectiveness ratio (ICER), which represents the incremental cost associated with one additional QALY gained, remaining below the WTP for variation of the input parameters. If increasing costs for the algorithm, the ICER of $0/QALY was exceeded at $115, and the defined WTP was exceeded at $667 for the use of the AI.

CONCLUSIONS

This analysis, rooted in assumptions, suggests that the additional use of an AI-based algorithm may be a potentially cost-effective alternative in the differentiation of incidental renal lesions using MRI and needs to be confirmed in the future.

CLINICAL RELEVANCE STATEMENT

These results hint at AI's the potential impact on diagnosing renal masses. While the current study urges careful interpretation, ongoing research is essential to confirm and seamlessly integrate AI into clinical practice, ensuring its efficacy in routine diagnostics.

KEY POINTS

• This is a model-based study using data from literature where AI has been applied in the diagnostic workup of incidental renal lesions. • MRI + AI has the potential to be a cost-effective alternative in the differentiation of incidental renal lesions. • The additional use of AI can reduce costs in the diagnostic workup of incidental renal lesions.

Scientific Status Quo of Small Renal Lesions: Diagnostic Assessment and Radiomics

Background: Small renal masses (SRMs) are defined as contrast-enhanced renal lesions less than or equal to 4 cm in maximal diameter, which can be compatible with stage T1a renal cell carcinomas (RCCs). Currently, 50-61% of all renal tumors are found incidentally. Methods: The characteristics of the lesion influence the choice of the type of management, which include several methods SRM of management, including nephrectomy, partial nephrectomy, ablation, observation, and also stereotactic body radiotherapy. Typical imaging methods available for differentiating benign from malignant renal lesions include ultrasound (US), contrast-enhanced ultrasound (CEUS), computed tomography (CT), and magnetic resonance imaging (MRI). Results: Although ultrasound is the first imaging technique used to detect small renal lesions, it has several limitations. CT is the main and most widely used imaging technique for SRM characterization. The main advantages of MRI compared to CT are the better contrast resolution and tissue characterization, the use of functional imaging sequences, the possibility of performing the examination in patients allergic to iodine-containing contrast medium, and the absence of exposure to ionizing radiation. For a correct evaluation during imaging follow-up, it is necessary to use a reliable method for the assessment of renal lesions, represented by the Bosniak classification system. This classification was initially developed based on contrast-enhanced CT imaging findings, and the 2019 revision proposed the inclusion of MRI features; however, the latest classification has not yet received widespread validation. Conclusions: The use of radiomics in the evaluation of renal masses is an emerging and increasingly central field with several applications such as characterizing renal masses, distinguishing RCC subtypes, monitoring response to targeted therapeutic agents, and prognosis in a metastatic context.

Multiparametric MRI-Based Machine Learning Models for the Characterization of Cystic Renal Masses Compared to the Bosniak Classification, Version 2019: A Multicenter Study

RATIONALE AND OBJECTIVE

Accurate differentiation between benign and malignant cystic renal masses (CRMs) is challenging in clinical practice. This study aimed to develop MRI-based machine learning models for differentiating between benign and malignant CRMs and compare the best-performing model with the Bosniak classification, version 2019 (BC, version 2019).

METHODS

Between 2009 and 2021, consecutive surgery-proven CRM patients with renal MRI were enrolled in this multicenter study. Models were constructed to differentiate between benign and malignant CRMs using logistic regression (LR), random forest (RF), and support vector machine (SVM) algorithms, respectively. Meanwhile, two radiologists classified CRMs into I-IV categories according to the BC, version 2019 in consensus in the test set. A subgroup analysis was conducted to investigate the performance of the best-performing model in complicated CRMs (II-IV lesions in the test set). The performances of models and BC, version 2019 were evaluated using the area under the receiver operating characteristic curve (AUC). Performance was statistically compared between the best-performing model and the BC, version 2019.

RESULTS

278 and 48 patients were assigned to the training and test sets, respectively. In the test set, the AUC and accuracy of the LR model, the RF model, the SVM model, and the BC, version 2019 were 0.884 and 75.0%, 0.907 and 83.3%, 0.814 and 72.9%, and 0.893 and 81.2%, respectively. Neither the AUC nor the accuracy of the RF model that performed best were significantly different from the BC, version 2019 (P = 0.780, P = 0.065). The RF model achieved an AUC and accuracy of 0.880 and 81.0% in complicated CRMs.

CONCLUSIONS

The MRI-based RF model can accurately differentiate between benign and malignant CRMs with comparable performance to the BC, version 2019, and has good performance in complicated CRMs, which may facilitate treatment decision-making and is less affected by interobserver disagreements.

Machine learning-based CT texture analysis in the differentiation of testicular masses

Purpose

To evaluate the ability of texture features for distinguishing between benign and malignant testicular masses, and furthermore, for identifying primary testicular lymphoma in malignant tumors and identifying seminoma in testicular germ cell tumors, respectively.

Methods

We retrospectively collected 77 patients with an abdominal and pelvic enhanced computed tomography (CT) examination and a histopathologically confirmed testicular mass from a single center. The ROI of each mass was split into two parts by the largest cross-sectional slice and deemed to be two samples. After all processing steps, three-dimensional texture features were extracted from unenhanced and contrast-enhanced CT images. Excellent reproducibility of texture features was defined as intra-class correlation coefficient ≥0.8 (ICC ≥0.8). All the groups were balanced via the synthetic minority over-sampling technique (SMOTE) method. Dimension reduction was based on pearson correlation coefficient (PCC). Before model building, minimum-redundancy maximum-relevance (mRMR) selection and recursive feature elimination (RFE) were used for further feature selection. At last, three ML classifiers with the highest cross validation with 5-fold were selected: autoencoder (AE), support vector machine(SVM), linear discriminant analysis (LAD). Logistics regression (LR) and LR-LASSO were also constructed to compare with the ML classifiers.

Results

985 texture features with ICC ≥0.8 were extracted for further feature selection process. With the highest AUC of 0.946 (P <0.01), logistics regression was proved to be the best model for the identification of benign or malignant testicular masses. Besides, LR also had the best performance in identifying primary testicular lymphoma in malignant testicular tumors and in identifying seminoma in testicular germ cell tumors, with the AUC of 0.982 (P <0.01) and 0.928 (P <0.01), respectively.

Conclusion

Until now, this is the first study that applied CT texture analysis (CTTA) to assess the heterogeneity of testicular tumors. LR model based on CTTA might be a promising non-invasive tool for the diagnosis and differentiation of testicular masses. The accurate diagnosis of testicular masses would assist urologists in correct preoperative and perioperative decision making.

Radiomics analysis based on single phase and different phase combinations of radiomics features from tri-phasic CT to distinguish renal oncocytoma from chromophobe renal cell carcinoma

OBJECTIVES

To investigate different radiomics models based on single phase and the different phase combinations of radiomics features from 3D tri-phasic CT to distinguish RO from chRCC.

METHODS

A total of 96 patients (30 RO and 66 chRCC) were enrolled in this study. Radiomics features were extracted from unenhanced phase (UP), corticomedullary phase (CMP), and nephrographic phase (NP) CT images. Feature selection was based on the least absolute shrinkage and selection operator regression (LASSO) method. The selected features were used to develop different radiomics models using logistic regression (LR) analysis, including model 1 (UP), model 2(CMP), model 3(NP), model 4(UP+CMP), model 5(UP+NP), model 6(CMP+NP), and model 7(UP+CMP+NP). The radiomics model demonstrating the highest discrimination performance was utilized to construct the combined model (model 8) with clinical factors. A nomogram based on the model 8 was established. To evaluate the diagnostic performance of the different models, the receiver operating characteristic (ROC) curve and decision curve analysis (DCA) were used. Delong's test was utilized to assess the statistical significance of the AUC improvement across the models.

RESULTS

Among the seven radiomics models, model 7 exhibited the highest AUC of 0.84 (95% CI 0.69, 0.99), and model 7 demonstrated a significantly superior AUC compared to the other radiomics models (all P < 0.05). The AUC values of radiomics models based on two phases (model4, mode5, mode6) were greater than the models based on single phase (model1, mode2, mode3) (all P < 0.05). Model 3 illustrated the best performance of the three radiomics models based on single phase with an AUC of 0.76 (95% CI 0.57, 099). Model 6 illustrated the best performance of the three radiomics models based on two-phases combination with an AUC of 0.83 (0.66, 0.99). Model 8 achieved an AUC of 0.93 (95% CI 0.83, 1.00) which is higher than those all radiomics models.

CONCLUSION

Radiomics models based on combination of radiomics features from UP, CMP, and NP can be a useful and promising technique to differentiate RO from chRCC. Moreover, the model combining clinical factors and radiomics features showed better classification performance to distinguish them.

Improving the malignancy prediction of breast cancer based on the integration of radiomics features from dual-view mammography and clinical parameters

Radiomics has been a promising imaging biomarker for many malignant diseases. We developed a novel radiomics strategy that incorporating radiomics features extracted from dual-view mammograms and clinical parameters for identifying benign and malignant breast lesions, and validated whether the radiomics assessment could improve the accurate diagnosis of breast cancer. A total of 380 patients (mean age, 52 ± 7 years) with 621 breast lesions utilizing mammograms on craniocaudal (CC) and mediolateral oblique (MLO) views were randomly allocated into the training (n = 486) and testing (n = 135) sets in this retrospective study. A total of 1184 and 2368 radiomics features were extracted from single-position region of interest (ROI) and position-paired ROI, separately. Clinical parameters were then combined for better prediction. Recursive feature elimination and least absolute shrinkage and selection operator methods were applied to select optimal predictive features. Random forest was used to conduct the predictive model. Intraclass correlation coefficient test was used to assess repeatability and reproducibility of features. After preprocessing, 467 radiomics features and clinical parameters remained in the single-view and dual-view models. The performance and significance of models were quantified by the area under the curve (AUC), sensitivity, specificity, and accuracy. The correlation analysis between variables was evaluated using the correlation ratio and Pearson correlation coefficient. The model using a combination of dual-view radiomics and clinical parameters achieved a favorable performance (AUC: 0.804, 95% CI: 0.668-0.916), outperformed single-view model and model without clinical parameters. Incorporating with radiomics features of dual-view (CC&MLO) mammogram, age, breast density, and type of suspicious lesions can provide a noninvasive approach to evaluate the malignancy of breast lesions and facilitate clinical decision-making.

Small Renal Masses: Developing a Robust Radiomic Signature

(1) Background and (2) Methods: In this retrospective, observational, monocentric study, we selected a cohort of eighty-five patients (age range 38-87 years old, 51 men), enrolled between January 2014 and December 2020, with a newly diagnosed renal mass smaller than 4 cm (SRM) that later underwent nephrectomy surgery (partial or total) or tumorectomy with an associated histopatological study of the lesion. The radiomic features (RFs) of eighty-five SRMs were extracted from abdominal CTs bought in the portal venous phase using three different CT scanners. Lesions were manually segmented by an abdominal radiologist. Image analysis was performed with the Pyradiomic library of 3D-Slicer. A total of 108 RFs were included for each volume. A machine learning model based on radiomic features was developed to distinguish between benign and malignant small renal masses. The pipeline included redundant RFs elimination, RFs standardization, dataset balancing, exclusion of non-reproducible RFs, feature selection (FS), model training, model tuning and validation of unseen data. (3) Results: The study population was composed of fifty-one RCCs and thirty-four benign lesions (twenty-five oncocytomas, seven lipid-poor angiomyolipomas and two renal leiomyomas). The final radiomic signature included 10 RFs. The average performance of the model on unseen data was 0.79 ± 0.12 for ROC-AUC, 0.73 ± 0.12 for accuracy, 0.78 ± 0.19 for sensitivity and 0.63 ± 0.15 for specificity. (4) Conclusions: Using a robust pipeline, we found that the developed RFs signature is capable of distinguishing RCCs from benign renal tumors.

Artificial Intelligence in Urooncology: What We Have and What We Expect

INTRODUCTION

Artificial intelligence is transforming healthcare by driving innovation, automation, and optimization across various fields of medicine. The aim of this study was to determine whether artificial intelligence (AI) techniques can be used in the diagnosis, treatment planning, and monitoring of urological cancers.

METHODOLOGY

We conducted a thorough search for original and review articles published until 31 May 2022 in the PUBMED/Scopus database. Our search included several terms related to AI and urooncology. Articles were selected with the consensus of all authors.

RESULTS

Several types of AI can be used in the medical field. The most common forms of AI are machine learning (ML), deep learning (DL), neural networks (NNs), natural language processing (NLP) systems, and computer vision. AI can improve various domains related to the management of urologic cancers, such as imaging, grading, and nodal staging. AI can also help identify appropriate diagnoses, treatment options, and even biomarkers. In the majority of these instances, AI is as accurate as or sometimes even superior to medical doctors.

CONCLUSIONS

AI techniques have the potential to revolutionize the diagnosis, treatment, and monitoring of urologic cancers. The use of AI in urooncology care is expected to increase in the future, leading to improved patient outcomes and better overall management of these tumors.

A CT-based radiomics nomogram for distinguishing between malignant and benign Bosniak IIF masses: a two-centre study

AIM

To establish and assess a computed tomography (CT)-based radiomics nomogram for identifying malignant and benign Bosniak IIF masses.

MATERIALS AND METHODS

In total, 150 patients with Bosniak IIF masses were separated into a training set (n=106) and a test set (n=44) in a ratio of 7:3. A radiomics signature was calculated based on extracted features from the three phases of CT images. A clinical model was constructed based on clinical characteristics and CT features, and a nomogram incorporating the radiomics signature and independent clinical variables was established. The calibration ability, discrimination accuracy, and clinical value of the nomogram model were assessed.

RESULTS

Twelve features derived from CT images were applied to establish the radiomics signature. The performance levels of three machine-learning models were improved by adding the synthetic minority oversampling technique algorithm. The optimised machine learning model was a combination of the minimum redundancy maximum relevance-least absolute shrinkage and selection operator feature screening method + logistic regression classifier + synthetic minority oversampling technique algorithm, which demonstrated excellent identification ability on the test set (area under the curve [AUC], 0.970; 95% confidence interval [CI], 0.940-1.000). The nomogram model displayed outstanding discrimination ability on the test set (AUC, 0.972; 95% CI, 0.942-1.000).

CONCLUSIONS

The CT-based radiomics nomogram was useful for discriminating between malignant and benign Bosniak IIF masses, which improved the precision of preoperative diagnosis.

A CT-Based Clinical, Radiological and Radiomic Machine Learning Model for Predicting Malignancy of Solid Renal Tumors (UroCCR-75)

BACKGROUND

Differentiating benign from malignant renal tumors is important for patient management, and it may be improved by quantitative CT features analysis including radiomic.

PURPOSE

This study aimed to compare performances of machine learning models using bio-clinical, conventional radiologic and 3D-radiomic features for the differentiation of benign and malignant solid renal tumors using pre-operative multiphasic contrast-enhanced CT examinations.

MATERIALS AND METHODS

A unicentric retrospective analysis of prospectively acquired data from a national kidney cancer database was conducted between January 2016 and December 2020. Histologic findings were obtained by robotic-assisted partial nephrectomy. Lesion images were semi-automatically segmented, allowing for a 3D-radiomic features extraction in the nephrographic phase. Conventional radiologic parameters such as shape, content and enhancement were combined in the analysis. Biological and clinical features were obtained from the national database. Eight machine learning (ML) models were trained and validated using a ten-fold cross-validation. Predictive performances were evaluated comparing sensitivity, specificity, accuracy and AUC.

RESULTS

A total of 122 patients with 132 renal lesions, including 111 renal cell carcinomas (RCCs) (111/132, 84%) and 21 benign tumors (21/132, 16%), were evaluated (58 +/- 14 years, men 74%). Unilaterality (100/111, 90% vs. 13/21, 62%; p = 0.02), necrosis (81/111, 73% vs. 8/21, 38%; p = 0.02), lower values of tumor/cortex ratio at portal time (0.61 vs. 0.74, p = 0.01) and higher variation of tumor/cortex ratio between arterial and portal times (0.22 vs. 0.05, p = 0.008) were associated with malignancy. A total of 35 radiomics features were selected, and "intensity mean value" was associated with RCCs in multivariate analysis (OR = 0.99). After ten-fold cross-validation, a C5.0Tree model was retained for its predictive performances, yielding a sensitivity of 95%, specificity of 42%, accuracy of 87% and AUC of 0.74.

CONCLUSION

Our machine learning-based model combining clinical, radiologic and radiomics features from multiphasic contrast-enhanced CT scans may help differentiate benign from malignant solid renal tumors.

Radiogenomics in Renal Cancer Management-Current Evidence and Future Prospects

Renal cancer management is challenging from diagnosis to treatment and follow-up. In cases of small renal masses and cystic lesions the differential diagnosis of benign or malignant tissues has potential pitfalls when imaging or even renal biopsy is applied. The recent artificial intelligence, imaging techniques, and genomics advancements have the ability to help clinicians set the stratification risk, treatment selection, follow-up strategy, and prognosis of the disease. The combination of radiomics features and genomics data has achieved good results but is currently limited by the retrospective design and the small number of patients included in clinical trials. The road ahead for radiogenomics is open to new, well-designed prospective studies, with large cohorts of patients required to validate previously obtained results and enter clinical practice.

Differentiating Benign From Malignant Cystic Renal Masses: A Feasibility Study of Computed Tomography Texture-Based Machine Learning Algorithms

OBJECTIVE

The Bosniak classification attempts to predict the likelihood of renal cell carcinoma (RCC) among cystic renal masses but is subject to interobserver variability and often requires multiphase imaging. Artificial intelligence may provide a more objective assessment. We applied computed tomography texture-based machine learning algorithms to differentiate benign from malignant cystic renal masses.

METHODS

This is an institutional review board-approved, Health Insurance Portability and Accountability Act-compliant retrospective study of 147 patients (mean age, 62.4 years; range, 28-89 years; 94 men) with 144 cystic renal masses (93 benign, 51 RCC); 69 were pathology proven (51 RCC, 18 benign), and 75 were considered benign based on more than 4 years of stability at follow-up imaging. Using a single image from a contrast-enhanced abdominal computed tomography scan, mean, SD, mean value of positive pixels, entropy, skewness, and kurtosis radiomics features were extracted. Random forest, multivariate logistic regression, and support vector machine models were used to classify each mass as benign or malignant with 10-fold cross validation. Receiver operating characteristic curves assessed algorithm performance in the aggregated test data.

RESULTS

For the detection of malignancy, sensitivity, specificity, positive predictive value, negative predictive value, and area under the curve were 0.61, 0.87, 0.72, 0.80, and 0.79 for the random forest model; 0.59, 0.87, 0.71, 0.79, and 0.80 for the logistic regression model; and 0.55, 0.86, 0.68, 0.78, and 0.76 for the support vector machine model.

CONCLUSION

Computed tomography texture-based machine learning algorithms show promise in differentiating benign from malignant cystic renal masses. Once validated, these may serve as an adjunct to radiologists' assessments.

A CT-based radiomics nomogram for differentiation of benign and malignant small renal masses (≤4 cm)

RATIONALE AND OBJECTIVES

Based on radiomics signature and clinical data, to develop and verify a radiomics nomogram for preoperative distinguish between benign and malignant of small renal masses (SRM).

MATERIALS AND METHODS

One hundred and fifty-six patients with malignant (n = 92) and benign (n = 64) SRM were divided into the following three categories: category A, typical angiomyolipoma (AML) with visible fat; category B, benign SRM without visible fat, including fat-poor angiomyolipoma (fp-AML), and other rare benign renal tumors; category C, malignant renal tumors. At the same time, one hundred and fifty-six patients included in the study were divided into the training set (n = 108) and test set (n = 48). Respectively from corticomedullary phase (CP), nephrogram phase (NP) and excretory phase (EP) CT images to extract the radiomics features, and the optimal features were screened to establish the logistic regression model and decision tree model, and computed the radiomics score (Rad-score). Demographics and CT findings were evaluated and statistically significant factors were selected to construct a clinical factors model. The radiomics nomogram was established by merging Rad-score and selected clinical factors. The Akaike information criterion (AIC) values and the area under the curve (AUC) were used to compare model discriminant performance, and decision curve analysis (DCA) was used to assess clinical usefulness.

RESULTS

Seven, fifteen, nineteen, and seventeen distinguishing features were obtained in the CP, NP, EP, and three-phase joint, respectively, and the logistic regression and decision tree models were built based on this features. In the training set, the logistic regression model works better than the decision tree model for distinguishing categories A and B from category C, with the AUC of CP, NP, EP and three-phase joint were 0.868, 0.906, 0.937 and 0.975, respectively. The radiomics nomogram constructed based on the three-phase joint Rad-score and selected clinical factor performed well on the training set (AUC, 0.988; 95% CI, 0.974-1.000) for differentiation of categories A and B from category C. In the test set, the AUC of clinical factors model, radiomics signature and radiomics nomogram for discriminating categories A and B from category C were 0.814, 0.954 and 0.968, respectively; for the identification of category A from category C, the AUC of the three models were 0.789, 0.979, 0.985, respectively; for discriminating category B from category C, the AUC of the three models were 0.853, 0.915, 0.946, respectively. The radiomics nomogram had better discriminative than the clinical factors model in both training and test sets (P < 0.05). The radiomics nomogram (AIC = 40.222) with the lowest AIC value was considered the best model compared with that of the clinical factors model (AIC = 106.814) and the radiomics signature (AIC = 44.224). The DCA showed that the radiomics nomogram have better clinical utility than the clinical factors model and radiomics signature.

CONCLUSIONS

The logistic regression model has better discriminative performance than the decision tree model, and the radiomics nomogram based on Rad-score of three-phase joint and clinical factors has a good predictive effect in differentiating benign from malignant of SRM, which may help clinicians develop accurate and individualized treatment strategies.

CT differentiation of the oncocytoma and renal cell carcinoma based on peripheral tumor parenchyma and central hypodense area characterisation

BACKGROUND

Although the central scar is an essential imaging characteristic of renal oncocytoma (RO), its utility in distinguishing RO from renal cell carcinoma (RCC) has not been well explored. The study aimed to evaluate whether the combination of CT characteristics of the peripheral tumor parenchyma (PTP) and central hypodense area (CHA) can differentiate typical RO with CHA from RCC.

METHODS

A total of 132 tumors on the initial dataset were retrospectively evaluated using four-phase CT. The excretory phases were performed more than 20 min after the contrast injection. In corticomedullary phase (CMP) images, all tumors had CHAs. These tumors were categorized into RO (n = 23), clear cell RCC (ccRCC) (n = 85), and non-ccRCC (n = 24) groups. The differences in these qualitative and quantitative CT features of CHA and PTP between ROs and ccRCCs/non-ccRCCs were statistically examined. Logistic regression filters the main factors for separating ROs from ccRCCs/non-ccRCCs. The prediction models omitting and incorporating CHA features were constructed and evaluated, respectively. The effectiveness of the prediction models including CHA characteristics was then confirmed through a validation dataset (8 ROs, 35 ccRCCs, and 10 non-ccRCCs).

RESULTS

The findings indicate that for differentiating ROs from ccRCCs and non-ccRCCs, prediction models with CHA characteristics surpassed models without CHA, with the corresponding areas under the curve (AUC) being 0.962 and 0.914 versus 0.952 and 0.839 respectively. In the prediction models that included CHA parameters, the relative enhancement ratio (RER) in CMP and enhancement inversion, as well as RER in nephrographic phase and enhancement inversion were the primary drivers for differentiating ROs from ccRCCs and non-ccRCCs, respectively. The prediction models with CHA characteristics had the comparable diagnostic ability on the validation dataset, with respective AUC values of 0.936 and 0.938 for differentiating ROs from ccRCCs and non-ccRCCs.

CONCLUSION

The prediction models with CHA characteristics can help better differentiate typical ROs from RCCs. When a mass with CHA is discovered, particularly if RO is suspected, EP images with longer delay scanning periods should be acquired to evaluate the enhancement inversion characteristics of CHA.

Distinguishing common renal cell carcinomas from benign renal tumors based on machine learning: comparing various CT imaging phases, slices, tumor sizes, and ROI segmentation strategies

OBJECTIVES

To determine whether a CT-based machine learning (ML) can differentiate benign renal tumors from renal cell carcinomas (RCCs) and improve radiologists' diagnostic performance, and evaluate the impact of variable CT imaging phases, slices, tumor sizes, and region of interest (ROI) segmentation strategies.

METHODS

Patients with pathologically proven RCCs and benign renal tumors from our institution between 2008 and 2020 were included as the training dataset for ML model development and internal validation (including 418 RCCs and 78 benign tumors), and patients from two independent institutions and a public database (TCIA) were included as the external dataset for individual testing (including 262 RCCs and 47 benign tumors). Features were extracted from three-phase CT images. CatBoost was used for feature selection and ML model establishment. The area under the receiver operating characteristic curve (AUC) was used to assess the performance of the ML model.

RESULTS

The ML model based on 3D images performed better than that based on 2D images, with the highest AUC of 0.81 and accuracy (ACC) of 0.86. All three radiologists achieved better performance by referring to the classifier's decision, with accuracies increasing from 0.82 to 0.87, 0.82 to 0.88, and 0.76 to 0.87. The ML model achieved higher negative predictive values (NPV, 0.82-0.99), and the radiologists achieved higher positive predictive values (PPV, 0.91-0.95).

CONCLUSIONS

A ML classifier based on whole-tumor three-phase CT images can be a useful and promising tool for differentiating RCCs from benign renal tumors. The ML model also perfectly complements radiologist interpretations.

KEY POINTS

• A machine learning classifier based on CT images could be a reliable way to differentiate RCCs from benign renal tumors. • The machine learning model perfectly complemented the radiologists' interpretations. • Subtle variances in ROI delineation had little effect on the performance of the ML classifier.

Artificial intelligence and radiomics in evaluation of kidney lesions: a comprehensive literature review

Radiomics and artificial intelligence (AI) may increase the differentiation of benign from malignant kidney lesions, differentiation of angiomyolipoma (AML) from renal cell carcinoma (RCC), differentiation of oncocytoma from RCC, differentiation of different subtypes of RCC, to predict Fuhrman grade, to predict gene mutation through molecular biomarkers and to predict treatment response in metastatic RCC undergoing immunotherapy. Neural networks analyze imaging data. Statistical, geometrical, textural features derived are giving quantitative data of contour, internal heterogeneity and gray zone features of lesions. A comprehensive literature review was performed, until July 2022. Studies investigating the diagnostic value of radiomics in differentiation of renal lesions, grade prediction, gene alterations, molecular biomarkers and ongoing clinical trials have been analyzed. The application of AI and radiomics could lead to improved sensitivity, specificity, accuracy in detecting and differentiating between renal lesions. Standardization of scanner protocols will improve preoperative differentiation between benign, low-risk cancers and clinically significant renal cancers and holds the premises to enhance the diagnostic ability of imaging tools to characterize renal lesions.

A Novel, Simple, and Low-Cost Approach for Machine Learning Screening of Kidney Cancer: An Eight-Indicator Blood Test Panel with Predictive Value for Early Diagnosis

Clear cell renal cell carcinoma (ccRCC) accounts for more than 90% of all renal cancers. The five-year survival rate of early-stage (TNM 1) ccRCC reaches 96%, while the advanced-stage (TNM 4) is only 23%. Therefore, early screening of patients with renal cancer is essential for the treatment of renal cancer and the long-term survival of patients. In this study, blood samples of patients were collected and a pre-defined set of blood indicators were measured. A random forest (RF) model was established to predict based on each indicator in the blood, and was trained with all relevant indicators for comprehensive predictions. In our study, we found that there was a high statistical significance (p < 0.001) for all indicators of healthy individuals and early cancer patients, except for uric acid (UA). At the same time, ccRCC also presented great differences in most blood indicators between males and females. In addition, patients with ccRCC had a higher probability of developing a low ratio of albumin (ALB) to globulin (GLB) (AGR < 1.2). Eight key indicators were used to classify and predict renal cell carcinoma. The area under the receiver operating characteristic (ROC) curve (AUC) of the eight-indicator model was as high as 0.932, the sensitivity was 88.2%, and the specificity was 86.3%, which are acceptable in many applications, thus realising early screening for renal cancer by blood indicators in a simple blood-draw physical examination. Furthermore, the composite indicator prediction method described in our study can be applied to other clinical conditions or diseases, where multiple blood indicators may be key to enhancing the diagnostic potential of screening strategies.

Usefulness of computed tomography textural analysis in renal cell carcinoma nuclear grading

Purpose: To evaluate the usefulness of computed tomography (CT) texture descriptors integrated with machine-learning (ML) models in the identification of clear cell renal cell carcinoma (ccRCC) and for the first time papillary renal cell carcinoma (pRCC) tumor nuclear grades [World Health Organization (WHO)/International Society of Urologic Pathologists (ISUP) 1, 2, 3, and 4]. Approach: A total of 143 ccRCC and 21 pRCC patients were analyzed in this study. Texture features were extracted from late arterial phase CT images. A complete separation of training/validation and testing subsets from the beginning to the end of the pipeline was adopted. Feature dimension was reduced by collinearity analysis and Gini impurity-based feature selection. The synthetic minority over-sampling technique was employed for imbalanced datasets. The ML classifiers were logistic regression, SVM, RF, multi-layer perceptron, and K -NN. The differentiation between low grades/ high grades, grade 1/grade 2, grade 3/grade 4, and between all grades was assessed for ccRCC and pRCC datasets. The classification performance was assessed and compared by certain metrics. Results: Textures-based classifiers were able to efficiently identify ccRCC and pRCC grades. An accuracy and area under the characteristic operating curve (AUC) up to 91%/0.9, 91%/0.9, 90%/0.9, and 88%/1 were reached when discriminating ccRCC low grades/ high grades, grade 1/grade 2, grade 3/grade 4, and all grades, respectively. An accuracy and AUC up to 96%/1, 81%/0.8, 86%/0.9, and 88%/0.9 were found when differentiating pRCC low grades/ high grades, grade 1/grade 2, grade 3/grade 4, and all grades, respectively. Conclusion: CT texture-based ML models can be used to assist radiologist in predicting the WHO/ISUP grade of ccRCC and pRCC pre-operatively.

A Clinical Radiomics Nomogram Was Developed by Integrating Radiomics Signatures and Clinical Variables to Distinguish High-Grade ccRCC from Type 2 pRCC

Purpose

A nomogram was constructed by combining clinical factors and a CT-based radiomics signature to discriminate between high-grade clear cell renal cell carcinoma (ccRCC) and type 2 papillary renal cell carcinoma (pRCC).

Methods

A total of 142 patients with 71 in high-grade ccRCC and seventy-one in type 2 pRCC were enrolled and split into a training cohort (n = 98) and a testing cohort (n = 44). A clinical factor model containing patient demographics and CT imaging characteristics was designed. By extracting the radiomics features from the precontrast phase, corticomedullary phase (CMP), and nephrographic phase (NP) CT images, a radiomics signature was established, and a Rad-score was computed. By combining the Rad-score and significant clinical factors using multivariate logistic regression analysis, a clinical radiomics nomogram was subsequently developed. The diagnostic performance of these three models was evaluated by using data from both the training and testing groups using a receiver operating characteristic (ROC) curve analysis.

Results

The radiomics signature contained eight validated features from the CT images. The relative enhancement value of CMP (REV1) was an independent risk factor in the clinical factor model. The area under the curve (AUC) value of the clinical radiomics nomogram was 0.974 and 0.952 in the training and testing cohorts, respectively. In the training cohort, the decision curves of the nomogram demonstrated an added overall net advantage compared to the clinical factor model.

Conclusion

A noninvasive prediction tool termed radiomics nomogram, combining clinical criteria and the radiomics signature, may accurately predict high-grade ccRCC and type 2 pRCC before surgery. It also has some importance in assisting clinicians in determining future treatment strategies.

Comparative Analysis for the Distinction of Chromophobe Renal Cell Carcinoma from Renal Oncocytoma in Computed Tomography Imaging Using Machine Learning Radiomics Analysis

Background: ChRCC and RO are two types of rarely occurring renal tumors that are difficult to distinguish from one another based on morphological features alone. They differ in prognosis, with ChRCC capable of progressing and metastasizing, but RO is benign. This means discrimination of the two tumors is of crucial importance. Objectives: The purpose of this research was to develop and comprehensively evaluate predictive models that can discriminate between ChRCC and RO tumors using Computed Tomography (CT) scans and ML-Radiomics texture analysis methods. Methods: Data were obtained from 78 pathologically confirmed renal masses, scanned at two institutions. Data from the two institutions were combined to form a third set resulting in three data cohorts, i.e., cohort 1, 2 and combined. Contrast-enhanced scans were used and the axial cross-sectional slices of each tumor were extracted from the 3D data using a semi-automatic segmentation technique for both 2D and 3D scans. Radiomics features were extracted before and after applying filters and the dimensions of the radiomic features reduced using the least absolute shrinkage and selection operator (LASSO) method. Synthetic minority oversampling technique (SMOTE) was applied to avoid class imbalance. Five ML algorithms were used to train models for predictive classification and evaluated using 5-fold cross-validation. Results: The number of selected features with good model performance was 20, 40 and 6 for cohorts 1, 2 and combined, respectively. The best model performance in cohorts 1, 2 and combined had an excellent Area Under the Curve (AUC) of 1.00 ± 0.000, 1.00 ± 0.000 and 0.87 ± 0.073, respectively. Conclusions: ML-based radiomics signatures are potentially useful for distinguishing ChRCC and RO tumors, with a reliable level of performance for both 2D and 3D scanning.

Machine Learning for Renal Pathologies: An Updated Survey

Within the literature concerning modern machine learning techniques applied to the medical field, there is a growing interest in the application of these technologies to the nephrological area, especially regarding the study of renal pathologies, because they are very common and widespread in our society, afflicting a high percentage of the population and leading to various complications, up to death in some cases. For these reasons, the authors have considered it appropriate to collect, using one of the major bibliographic databases available, and analyze the studies carried out until February 2022 on the use of machine learning techniques in the nephrological field, grouping them according to the addressed pathologies: renal masses, acute kidney injury, chronic kidney disease, kidney stone, glomerular disease, kidney transplant, and others less widespread. Of a total of 224 studies, 59 were analyzed according to inclusion and exclusion criteria in this review, considering the method used and the type of data available. Based on the study conducted, it is possible to see a growing trend and interest in the use of machine learning applications in nephrology, becoming an additional tool for physicians, which can enable them to make more accurate and faster diagnoses, although there remains a major limitation given the difficulty in creating public databases that can be used by the scientific community to corroborate and eventually make a positive contribution in this area.

Utility of radiomics features of diffusion-weighted magnetic resonance imaging for differentiation of fat-poor angiomyolipoma from clear cell renal cell carcinoma: model development and external validation

PURPOSE

To investigate the utility of radiomics features of diffusion-weighted magnetic resonance imaging (DW-MRI) to differentiate fat-poor angiomyolipoma (fpAML) from clear cell renal cell carcinoma (ccRCC).

MATERIALS AND METHODS

This multi-institutional study included two cohorts with pathologically confirmed renal tumors: 65 patients with ccRCC and 18 with fpAML in the model development cohort, and 17 with ccRCC and 13 with fpAML in the external validation cohort. All patients underwent magnetic resonance imaging (MRI) including DW-MRI. Radiomics analysis was used to extract 39 imaging features from the apparent diffusion coefficient (ADC) map. The radiomics features were analyzed with unsupervised hierarchical cluster analysis. A random forest (RF) model was used to identify radiomics features important for differentiating fpAML from ccRCC in the development cohort. The diagnostic performance of the RF model was evaluated in the development and validation cohorts.

RESULTS

The cases in the developmental cohort were classified into three groups with different frequencies of fpAML by cluster analysis of radiomics features. RF analysis of the development cohort showed that the mean ADC value was important for differentiating fpAML from ccRCC, as well as higher-texture features including gray-level run length matrix (GLRLM)_long-run low gray-level enhancement (LRLGE), and GLRLM_low gray-level run emphasis (LGRE). The area under the curve values of the development [0.90, 95% confidence interval (CI) 0.80-1.00] and validation cohorts (0.87, 95% CI 0.74-1.00) were similar (P = 0.91).

CONCLUSION

The radiomics features of ADC maps are useful for differentiating fpAML from ccRCC.

Artificial Intelligence in Kidney Cancer

Artificial intelligence is rapidly expanding into nearly all facets of life, particularly within the field of medicine. The diagnosis, characterization, management, and treatment of kidney cancer is ripe with areas for improvement that may be met with the promises of artificial intelligence. Here, we explore the impact of current research work in artificial intelligence for clinicians caring for patients with renal cancer, with a focus on the perspectives of radiologists, pathologists, and urologists. Promising preliminary results indicate that artificial intelligence may assist in the diagnosis and risk stratification of newly discovered renal masses and help guide the clinical treatment of patients with kidney cancer. However, much of the work in this field is still in its early stages, limited in its broader applicability, and hampered by small datasets, the varied appearance and presentation of kidney cancers, and the intrinsic limitations of the rigidly structured tasks artificial intelligence algorithms are trained to complete. Nonetheless, the continued exploration of artificial intelligence holds promise toward improving the clinical care of patients with kidney cancer.

An Ultrasonic-Based Radiomics Nomogram for Distinguishing Between Benign and Malignant Solid Renal Masses

Objectives

This study was conducted in order to develop and validate an ultrasonic-based radiomics nomogram for diagnosing solid renal masses.

Methods

Six hundred renal solid masses with benign renal lesions (n = 204) and malignant renal tumors (n = 396) were divided into a training set (n = 480) and a validation set (n = 120). Radiomics features were extracted from ultrasound (US) images preoperatively and then a radiomics score (RadScore) was calculated. By integrating the RadScore and independent clinical factors, a radiomics nomogram was constructed. The diagnostic performance of junior physician, senior physician, RadScore, and radiomics nomogram in identifying benign from malignant solid renal masses was evaluated based on the area under the receiver operating characteristic curve (ROC) in both the training and validation sets. The clinical usefulness of the nomogram was assessed using decision curve analysis (DCA).

Results

The radiomics signature model showed satisfactory discrimination in the training set [area under the ROC (AUC), 0.887; 95% confidence interval (CI), 0.860–0.915] and the validation set (AUC, 0.874; 95% CI, 0.816–0.932). The radiomics nomogram also demonstrated good calibration and discrimination in the training set (AUC, 0.911; 95% CI, 0.886–0.936) and the validation set (AUC, 0.861; 95% CI, 0.802–0.921). In addition, the radiomics nomogram model showed higher accuracy in discriminating benign and malignant renal masses compared with the evaluations by junior physician (DeLong p = 0.004), and the model also showed significantly higher specificity than the senior and junior physicians (0.93 vs. 0.57 vs. 0.46).

Conclusions

The ultrasonic-based radiomics nomogram shows favorable predictive efficacy in differentiating solid renal masses.

Small Renal Masses without Gross Fat: What Is the Role of Contrast-Enhanced MDCT?

Increased detection of small renal masses (SRMs) has encouraged research for non-invasive diagnostic tools capable of adequately differentiating malignant vs. benign SRMs and the type of the tumour. Multi-detector computed tomography (MDCT) has been suggested as an alternative to intervention, therefore, it is important to determine both the capabilities and limitations of MDCT for SRM evaluation. In our study, two abdominal radiologists retrospectively blindly assessed MDCT scan images of 98 patients with incidentally detected lipid-poor SRMs that did not present as definitely aggressive lesions on CT. Radiological conclusions were compared to histopathological findings of materials obtained during surgery that were assumed as the gold standard. The probability (odds ratio (OR)) in regression analyses, sensitivity (SE), and specificity (SP) of predetermined SRM characteristics were calculated. Correct differentiation between malignant vs. benign SRMs was detected in 70.4% of cases, with more accurate identification of malignant (73%) in comparison to benign (65.7%) lesions. The radiological conclusions of SRM type matched histopathological findings in 56.1%. Central scarring (OR 10.6, p = 0.001), diameter of lesion (OR 2.4, p = 0.003), and homogeneous accumulation of contrast medium (OR 3.4, p = 0.03) significantly influenced the accuracy of malignant diagnosis. SE and SP of these parameters varied from 20.6% to 91.3% and 22.9% to 74.3%, respectively. In conclusion, MDCT is able to correctly differentiate malignant versus uncharacteristic benign SRMs in more than 2/3 of cases. However, frequency of the correct histopathological SRM type MDCT identification remains low.

Texture and shape analysis of diffusion-weighted imaging for thyroid nodules classification using machine learning

PURPOSE

To assess whether the integration between (a) functional imaging features that will be extracted from diffusion-weighted imaging (DWI); and (b) shape and texture imaging features as well as volumetric features that will be extracted from T2-weighted magnetic resonance imaging (MRI) can noninvasively improve the diagnostic accuracy of thyroid nodules classification.

PATIENTS AND METHODS

In a retrospective study of 55 patients with pathologically proven thyroid nodules, T2-weighted and diffusion-weighted MRI scans of the thyroid gland were acquired. Spatial maps of the apparent diffusion coefficient (ADC) were reconstructed in all cases. To quantify the nodules' morphology, we used spherical harmonics as a new parametric shape descriptor to describe the complexity of the thyroid nodules in addition to traditional volumetric descriptors (e.g., tumor volume and cuboidal volume). To capture the inhomogeneity of the texture of the thyroid nodules, we used the histogram-based statistics (e.g., kurtosis, entropy, skewness, etc.) of the T2-weighted signal. To achieve the main goal of this paper, a fusion system using an artificial neural network (NN) is proposed to integrate both the functional imaging features (ADC) with the structural morphology and texture features. This framework has been tested on 55 patients (20 patients with malignant nodules and 35 patients with benign nodules), using leave-one-subject-out (LOSO) for training/testing validation tests.

RESULTS

The functionality, morphology, and texture imaging features were estimated for 55 patients. The accuracy of the computer-aided diagnosis (CAD) system steadily improved as we integrate the proposed imaging features. The fusion system combining all biomarkers achieved a sensitivity, specificity, positive predictive value, negative predictive value, F1-score, and accuracy of 92.9 % (confidence interval [CI]: 78.9 % -- 99.5 % ), 95.8 % (CI: 87.4 % -- 99.7 % ), 93 % (CI: 80.7 % -- 99.5 % ), 96 % (CI: 88.8 % -- 99.7 % ), 92.8 % (CI: 83.5 % -- 98.5 % ), and 95.5 % (CI: 88.8 % -- 99.2 % ), respectively, using the LOSO cross-validation approach.

CONCLUSION

The results demonstrated in this paper show the promise that integrating the functional features with morphology as well as texture features by using the current state-of-the-art machine learning approaches will be extremely useful for identifying thyroid nodules as well as diagnosing their malignancy.

Robustness and performance of radiomic features in diagnosing cystic renal masses

PURPOSE

We study the inter-reader variability in manual delineation of cystic renal masses (CRMs) presented in computerized tomography (CT) images and its effect on the classification performance of a machine learning algorithm in distinguishing benign from potentially malignant CRMs. In addition, we assessed whether the inclusion of higher-order robust radiomic features improves the classification performance over the use of first-order features.

METHODS

230 CRMs were independently delineated by two radiologists. Through a combination of random fluctuations, dilation, and erosion operations over the original region of interests (ROIs), we generated four additional sets of synthetic ROIs to capture the inter-reader variability realistically, as confirmed by dice coefficient measurements and visual assessment. We then identified the robust features based on the intra-class coefficient (ICC > 0.85) across these datasets. We applied a tenfold stratified cross-validation (CV) to train and test the performance of the random forest model for the classification of CRMs into benign and potentially malignant.

RESULTS

The mean area under the curve (AUC), sensitivity, specificity, positive predictive value, and negative predictive value were 0.87, 0.82, 0.90, 0.85, and 0.93, respectively. With the usage of first-order features alone, the corresponding values were nearly identical.

CONCLUSION

AUC ranged for the robust and uncorrelated features from 0.83 ± 0.09 to 0.93 ± 0.04 and for the first-order features from 0.84 ± 0.09 to 0.91 ± 0.04. Our study indicates that the first-order features alone are sufficient for the classification of CRMs, and that inclusion of higher-order features does not necessarily improve performance.

Overall Survival Prediction in Renal Cell Carcinoma Patients Using Computed Tomography Radiomic and Clinical Information

The aim of this work is to investigate the applicability of radiomic features alone and in combination with clinical information for the prediction of renal cell carcinoma (RCC) patients’ overall survival after partial or radical nephrectomy. Clinical studies of 210 RCC patients from The Cancer Imaging Archive (TCIA) who underwent either partial or radical nephrectomy were included in this study. Regions of interest (ROIs) were manually defined on CT images. A total of 225 radiomic features were extracted and analyzed along with the 59 clinical features. An elastic net penalized Cox regression was used for feature selection. Accelerated failure time (AFT) with the shared frailty model was used to determine the effects of the selected features on the overall survival time. Eleven radiomic and twelve clinical features were selected based on their non-zero coefficients. Tumor grade, tumor malignancy, and pathology t-stage were the most significant predictors of overall survival (OS) among the clinical features (p < 0.002, < 0.02, and < 0.018, respectively). The most significant predictors of OS among the selected radiomic features were flatness, area density, and median (p < 0.02, < 0.02, and < 0.05, respectively). Along with important clinical features, such as tumor heterogeneity and tumor grade, imaging biomarkers such as tumor flatness, area density, and median are significantly correlated with OS of RCC patients.

Radiomics to better characterize small renal masses

PURPOSE

Radiomics is a specific field of medical research that uses programmable recognition tools to extract objective information from standard images to combine with clinical data, with the aim of improving diagnostic, prognostic, and predictive accuracy beyond standard visual interpretation. We performed a narrative review of radiomic applications that may support improved characterization of small renal masses (SRM). The main focus of the review was to identify and discuss methods which may accurately differentiate benign from malignant renal masses, specifically between renal cell carcinoma (RCC) subtypes and from angiomyolipoma without visible fat (fat-poor AML) and oncocytoma. Furthermore, prediction of grade, sarcomatoid features, and gene mutations would be of importance in terms of potential clinical utility in prognostic stratification and selecting personalised patient management strategies.

METHODS

A detailed search of original articles was performed using the PubMed-MEDLINE database until 20 September 2020 to identify the English literature relevant to radiomics applications in renal tumour assessment. In total, 42 articles were included in the analysis in 3 main categories related to SRM: prediction of benign versus malignant SRM, subtypes, and nuclear grade, and other features of aggressiveness.

CONCLUSION

Overall, studies reported the superiority of radiomics over expert radiological assessment, but were mainly of retrospective design and therefore of low-quality evidence. However, it is clear that radiomics is an attractive modality that has the potential to improve the non-invasive diagnostic accuracy of SRM imaging and prediction of its natural behaviour. Further prospective validation studies of radiomics are needed to augment management algorithms of SRM.

Kidney cancer management 3.0: can artificial intelligence make us better?

PURPOSE OF REVIEW

Artificial intelligence holds tremendous potential for disrupting clinical medicine. Here we review the current role of artificial intelligence in the kidney cancer space.

RECENT FINDINGS

Machine learning and deep learning algorithms have been developed using information extracted from radiomic, histopathologic, and genomic datasets of patients with renal masses.

SUMMARY

Although artificial intelligence applications in medicine are still in their infancy, they already hold immediate promise to improve accuracy of renal mass characterization, grade, and prognostication. As algorithms become more robust and generalizable, artificial intelligence is poised to significantly disrupt kidney cancer care.

Radiomics Score Combined with ACR TI-RADS in Discriminating Benign and Malignant Thyroid Nodules Based on Ultrasound Images: A Retrospective Study

This study aimed to explore the ability of combination model of ultrasound radiomics score (Rad-score) and the thyroid imaging, reporting and data system by the American College of Radiology (ACR TI-RADS) in predicting benign and malignant thyroid nodules (TNs). Up to 286 radiomics features were extracted from ultrasound images of TNs. By using the lowest probability of classification error and average correlation coefficients (POE + ACC) and the least absolute shrinkage and selection operator (LASSO), we finally selected four features to establish Rad-score (Vertl-RLNonUni, Vertl-GLevNonU, WavEnLH-s4 and WavEnHL-s5). DeLong’s test and decision curve analysis (DCA) showed that the method of combining Rad-score and ACR TI-RADS had the best performance (the area under the receiver operating characteristic curve (AUC = 0.913 (95% confidence interval (CI), 0.881–0.939) and 0.899 (95%CI, 0.840–0.942) in the training group and verification group, respectively), followed by ACR TI-RADS (AUC = 0.898 (95%CI, 0.863–0.926) and 0.870 (95%CI, 0.806–0.919) in the training group and verification group, respectively), and followed by Rad-score (AUC = 0.750 (95%CI, 0.704–0.792) and 0.750 (95%CI, 0.672–0.817) in the training group and verification group, respectively). We concluded that the ability of ultrasound Rad-score to distinguish benign and malignant TNs was not as good as that of ACR TI-RADS, and the ability of the combination model of Rad-score and ACR TI-RADS to discriminate benign and malignant TNs was better than ACR TI-RADS or Rad-score alone. Ultrasound Rad-score might play a potential role in improving the differentiation of malignant TNs from benign TNs.

CT-based radiomics for differentiating renal tumours: a systematic review

PURPOSE

Differentiating renal tumours into grades and tumour subtype from medical imaging is important for patient management; however, there is an element of subjectivity when performed qualitatively. Quantitative analysis such as radiomics may provide a more objective approach. The purpose of this article is to systematically review the literature on computed tomography (CT) radiomics for grading and differentiating renal tumour subtypes. An educational perspective will also be provided.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist was followed. PubMed, Scopus and Web of Science were searched for relevant articles. The quality of each study was assessed using the Radiomic Quality Score (RQS).

RESULTS

13 studies were found. The main outcomes were prediction of pathological grade and differentiating between renal tumour types, measured as area under the curve (AUC) for either the receiver operator curve or precision recall curve. Features extracted to predict pathological grade or tumour subtype included shape, intensity, texture and wavelet (a type of higher order feature). Four studies differentiated between low-grade and high-grade clear cell renal cell cancer (RCC) with good performance (AUC = 0.82-0.978). One other study differentiated low- and high-grade chromophobe with AUC = 0.84. Finally, eight studies used radiomics to differentiate between tumour types such as clear cell RCC, fat-poor angiomyolipoma, papillary RCC, chromophobe RCC and renal oncocytoma with high levels of performance (AUC 0.82-0.96).

CONCLUSION

Renal tumours can be pathologically classified using CT-based radiomics with good performance. The main radiomic feature used for tumour differentiation was texture. Fuhrman was the most common pathologic grading system used in the reviewed studies. Renal tumour grading studies should be extended beyond clear cell RCC and chromophobe RCC. Further research with larger prospective studies, performed in the clinical setting, across multiple institutions would help with clinical translation to the radiologist's workstation.

Impact of feature selection methods and subgroup factors on prognostic analysis with CT-based radiomics in non-small cell lung cancer patients

Background

Radiomics is a new technology to noninvasively predict survival prognosis with quantitative features extracted from medical images. Most radiomics-based prognostic studies of non-small-cell lung cancer (NSCLC) patients have used mixed datasets of different subgroups. Therefore, we investigated the radiomics-based survival prediction of NSCLC patients by focusing on subgroups with identical characteristics.

Methods

A total of 304 NSCLC (Stages I–IV) patients treated with radiotherapy in our hospital were used. We extracted 107 radiomic features (i.e., 14 shape features, 18 first-order statistical features, and 75 texture features) from the gross tumor volume drawn on the free breathing planning computed tomography image. Three feature selection methods [i.e., test–retest and multiple segmentation (FS1), Pearson's correlation analysis (FS2), and a method that combined FS1 and FS2 (FS3)] were used to clarify how they affect survival prediction performance. Subgroup analysis for each histological subtype and each T stage applied the best selection method for the analysis of All data. We used a least absolute shrinkage and selection operator Cox regression model for all analyses and evaluated prognostic performance using the concordance-index (C-index) and the Kaplan–Meier method. For subgroup analysis, fivefold cross-validation was applied to ensure model reliability.

Results

In the analysis of All data, the C-index for the test dataset is 0.62 (FS1), 0.63 (FS2), and 0.62 (FS3). The subgroup analysis indicated that the prediction model based on specific histological subtypes and T stages had a higher C-index for the test dataset than that based on All data (All data, 0.64 vs. SCC_all, 060; ADC_all, 0.69; T1, 0.68; T2, 0.65; T3, 0.66; T4, 0.70). In addition, the prediction models unified for each T stage in histological subtype showed a different trend in the C-index for the test dataset between ADC-related and SCC-related models (ADC_T1–ADC_T4, 0.72–0.83; SCC_T1–SCC_T4, 0.58–0.71).

Conclusions

Our results showed that feature selection methods moderately affected the survival prediction performance. In addition, prediction models based on specific subgroups may improve the prediction performance. These results may prove useful for determining the optimal radiomics-based predication model.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13014-021-01810-9.

Assessment of Renal Cell Carcinoma by Texture Analysis in Clinical Practice: A Six-Site, Six-Platform Analysis of Reliability

Background: Multiple commercial and open-source software applications are available for texture analysis. Nonstandard techniques can cause undesirable variability that impedes result reproducibility and limits clinical utility. Objective: The purpose of this study is to measure agreement of texture metrics extracted by 6 software packages. Methods: This retrospective study included 40 renal cell carcinomas with contrast-enhanced CT from The Cancer Genome Atlas and Imaging Archive. Images were analyzed by 7 readers at 6 sites. Each reader used 1 of 6 software packages to extract commonly studied texture features. Inter and intra-reader agreement for segmentation was assessed with intra-class correlation coefficients. First-order (available in 6 packages) and second-order (available in 3 packages) texture features were compared between software pairs using Pearson correlation. Results: Inter- and intra-reader agreement was excellent (ICC 0.93-1). First-order feature correlations were strong (r>0.8, p<0.001) between 75% (21/28) of software pairs for mean and standard deviation, 48% (10/21) for entropy, 29% (8/28) for skewness, and 25% (7/28) for kurtosis. Of 15 second-order features, only co-occurrence matrix correlation, grey-level non-uniformity, and run-length non-uniformity showed strong correlation between software packages (0.90-1, p<0.001). Conclusion: Variability in first and second order texture features was common across software configurations and produced inconsistent results. Standardized algorithms and reporting methods are needed before texture data can be reliably used for clinical applications. Clinical Impact: It is important to be aware of variability related to texture software processing and configuration when reporting and comparing outputs.

Radiomic Features and Machine Learning for the Discrimination of Renal Tumor Histological Subtypes: A Pragmatic Study Using Clinical-Routine Computed Tomography

Simple Summary

This study evaluates how advanced image analyses (radiomic features) and machine learning algorithms can help to distinguish subtypes of kidney tumors in computed tomography (CT) images, which is important for further patient treatment. For 201 patients, the image analyses showed a moderate performance, but robustly performed across various imaging centers and even in cases with suboptimal image quality. In particular, distinguishing one specific subtype of kidney tumor (oncocytomas) from other subtypes proves to be challenging. The algorithms presented in this study can help in the clinical decision-making process for kidney tumor patients, for example, to decide whether to perform kidney surgery or not.

Abstract

This study evaluates the diagnostic performance of radiomic features and machine learning algorithms for renal tumor subtype assessment in venous computed tomography (CT) studies from clinical routine. Patients undergoing surgical resection and histopathological assessment of renal tumors at a tertiary referral center between 2012 and 2019 were included. Preoperative venous-phase CTs from multiple referring imaging centers were segmented, and standardized radiomic features extracted. After preprocessing, class imbalance handling, and feature selection, machine learning algorithms were used to predict renal tumor subtypes using 10-fold cross validation, assessed as multiclass area under the curve (AUC). In total, n = 201 patients were included (73.7% male; mean age 66 ± 11 years), with n = 131 clear cell renal cell carcinomas (ccRCC), n = 29 papillary RCC, n = 11 chromophobe RCC, n = 16 oncocytomas, and n = 14 angiomyolipomas (AML). An extreme gradient boosting algorithm demonstrated the highest accuracy (multiclass area under the curve (AUC) = 0.72). The worst discrimination was evident for oncocytomas vs. AML and oncocytomas vs. chromophobe RCC (AUC = 0.55 and AUC = 0.45, respectively). In sensitivity analyses excluding oncocytomas, a random forest algorithm showed the highest accuracy, with multiclass AUC = 0.78. Radiomic feature analyses from venous-phase CT acquired in clinical practice with subsequent machine learning can discriminate renal tumor subtypes with moderate accuracy. The classification of oncocytomas seems to be the most complex with the lowest accuracy.

Radiomics Applications in Renal Tumor Assessment: A Comprehensive Review of the Literature

Radiomics texture analysis offers objective image information that could otherwise not be obtained by radiologists′ subjective radiological interpretation. We investigated radiomics applications in renal tumor assessment and provide a comprehensive review. A detailed search of original articles was performed using the PubMed-MEDLINE database until 20 March 2020 to identify English literature relevant to radiomics applications in renal tumor assessment. In total, 42 articles were included in the analysis and divided into four main categories: renal mass differentiation, nuclear grade prediction, gene expression-based molecular signatures, and patient outcome prediction. The main area of research involves accurately differentiating benign and malignant renal masses, specifically between renal cell carcinoma (RCC) subtypes and from angiomyolipoma without visible fat and oncocytoma. Nuclear grade prediction may enhance proper patient selection for risk-stratified treatment. Radiomics-predicted gene mutations may serve as surrogate biomarkers for high-risk disease, while predicting patients’ responses to targeted therapies and their outcomes will help develop personalized treatment algorithms. Studies generally reported the superiority of radiomics over expert radiological interpretation. Radiomics provides an alternative to subjective image interpretation for improving renal tumor diagnostic accuracy. Further incorporation of clinical and imaging data into radiomics algorithms will augment tumor prediction accuracy and enhance individualized medicine.

The feasibility of differentiating colorectal cancer from normal and inflammatory thickening colon wall using CT texture analysis

To investigate the diagnostic value of texture analysis (TA) for differentiating between colorectal cancer (CRC), colonic lesions caused by inflammatory bowel disease (IBD), and normal thickened colon wall (NTC) on computed tomography (CT) and assess which scanning phase has the highest differential diagnostic value. In all, 107 patients with CRC, 113 IBD patients with colonic lesions, and 96 participants with NTC were retrospectively enrolled. All subjects underwent multiphase CT examination, including pre-contrast phase (PCP), arterial phase (AP), and portal venous phase (PVP) scans. Based on these images, classification by TA and visual classification by radiologists were performed to discriminate among the three tissue types. The performance of TA and visual classification was compared. Precise TA classification results (error, 2.03–12.48%) were acquired by nonlinear discriminant analysis for CRC, IBD and NTC, regardless of phase or feature selection. PVP images showed a better ability to discriminate the three tissues by comprising the three scanning phases. TA showed significantly better performance in discriminating CRC, IBD and NTC than visual classification for residents, but there was no significant difference in classification between TA and experienced radiologists. TA could provide useful quantitative information for the differentiation of CRC, IBD and NTC on CT, particularly in PVP images.