Automated Classification of Papillary Renal Cell Carcinoma and Chromophobe Renal Cell Carcinoma Based on a Small Computed Tomography Imaging Dataset Using Deep Learning

Convolutional neural networks for the differentiation between benign and malignant renal tumors with a multicenter international computed tomography dataset

OBJECTIVES

To use convolutional neural networks (CNNs) for the differentiation between benign and malignant renal tumors using contrast-enhanced CT images of a multi-institutional, multi-vendor, and multicenter CT dataset.

METHODS

A total of 264 histologically confirmed renal tumors were included, from US and Swedish centers. Images were augmented and divided randomly 70%:30% for algorithm training and testing. Three CNNs (InceptionV3, Inception-ResNetV2, VGG-16) were pretrained with transfer learning and fine-tuned with our dataset to distinguish between malignant and benign tumors. The ensemble consensus decision of the three networks was also recorded. Performance of each network was assessed with receiver operating characteristics (ROC) curves and their area under the curve (AUC-ROC). Saliency maps were created to demonstrate the attention of the highest performing CNN.

RESULTS

Inception-ResNetV2 achieved the highest AUC of 0.918 (95% CI 0.873-0.963), whereas VGG-16 achieved an AUC of 0.813 (95% CI 0.752-0.874). InceptionV3 and ensemble achieved the same performance with an AUC of 0.894 (95% CI 0.844-0.943). Saliency maps indicated that Inception-ResNetV2 decisions are based on the characteristics of the tumor while in most tumors considering the characteristics of the interface between the tumor and the surrounding renal parenchyma.

CONCLUSION

Deep learning based on a diverse multicenter international dataset can enable accurate differentiation between benign and malignant renal tumors.

CRITICAL RELEVANCE STATEMENT

Convolutional neural networks trained on a diverse CT dataset can accurately differentiate between benign and malignant renal tumors.

KEY POINTS

• Differentiation between benign and malignant tumors based on CT is extremely challenging. • Inception-ResNetV2 trained on a diverse dataset achieved excellent differentiation between tumor types. • Deep learning can be used to distinguish between benign and malignant renal tumors.

Radiomics and Artificial Intelligence in Renal Lesion Assessment

Radiomics, the extraction and analysis of quantitative features from medical images, has emerged as a promising field in radiology with the potential to revolutionize the diagnosis and management of renal lesions. This comprehensive review explores the radiomics workflow, including image acquisition, feature extraction, selection, and classification, and highlights its application in differentiating between benign and malignant renal lesions. The integration of radiomics with artificial intelligence (AI) techniques, such as machine learning and deep learning, can help patients' management and allow the planning of the appropriate treatments. AI models have shown remarkable accuracy in predicting tumor aggressiveness, treatment response, and patient outcomes. This review provides insights into the current state of radiomics and AI in renal lesion assessment and outlines future directions for research in this rapidly evolving field.

A CT-based deep learning radiomics nomogram outperforms the existing prognostic models for outcome prediction in clear cell renal cell carcinoma: a multicenter study

OBJECTIVES

To develop and validate a CT-based deep learning radiomics nomogram (DLRN) for outcome prediction in clear cell renal cell carcinoma (ccRCC), and its performance was compared with the Stage, Size, Grade, and Necrosis (SSIGN) score, the University of California, Los Angeles, Integrated Staging System (UISS), the Memorial Sloan-Kettering Cancer Center (MSKCC), and the International Metastatic Renal Cell Database Consortium (IMDC).

METHODS

A multicenter of 799 localized (training/ test cohort, 558/241) and 45 metastatic ccRCC patients were studied. A DLRN was developed for predicting recurrence-free survival (RFS) in localized ccRCC patients, and another DLRN was developed for predicting overall survival (OS) in metastatic ccRCC patients. The performance of the two DLRNs was compared with that of the SSIGN, UISS, MSKCC, and IMDC. Model performance was assessed with Kaplan-Meier curves, time-dependent area under the curve (time-AUC), Harrell's concordance index (C-index), and decision curve analysis (DCA).

RESULTS

In the test cohort, the DLRN achieved higher time-AUCs (0.921, 0.911, and 0.900 for 1, 3, and 5 years, respectively), C-index (0.883), and net benefit than SSIGN and UISS in predicting RFS for localized ccRCC patients. The DLRN provided higher time-AUCs (0.594, 0.649, and 0.754 for 1, 3, and 5 years, respectively) than MSKCC and IMDC in predicting OS for metastatic ccRCC patients.

CONCLUSIONS

The DLRN can accurately predict outcomes and outperformed the existing prognostic models in ccRCC patients.

CLINICAL RELEVANCE STATEMENT

This deep learning radiomics nomogram may facilitate individualized treatment, surveillance, and adjuvant trial design for patients with clear cell renal cell carcinoma.

KEY POINTS

• SSIGN, UISS, MSKCC, and IMDC may be insufficient for outcome prediction in ccRCC patients. • Radiomics and deep learning allow for the characterization of tumor heterogeneity. • The CT-based deep learning radiomics nomogram outperforms the existing prognostic models in ccRCC outcome prediction.

Deep learning techniques for imaging diagnosis of renal cell carcinoma: current and emerging trends

This study summarizes the latest achievements, challenges, and future research directions in deep learning technologies for the diagnosis of renal cell carcinoma (RCC). This is the first review of deep learning in RCC applications. This review aims to show that deep learning technologies hold great promise in the field of RCC diagnosis, and we look forward to more research results to meet us for the mutual benefit of renal cell carcinoma patients. Medical imaging plays an important role in the early detection of renal cell carcinoma (RCC), as well as in the monitoring and evaluation of RCC during treatment. The most commonly used technologies such as contrast enhanced computed tomography (CECT), ultrasound and magnetic resonance imaging (MRI) are now digitalized, allowing deep learning to be applied to them. Deep learning is one of the fastest growing fields in the direction of medical imaging, with rapidly emerging applications that have changed the traditional medical treatment paradigm. With the help of deep learning-based medical imaging tools, clinicians can diagnose and evaluate renal tumors more accurately and quickly. This paper describes the application of deep learning-based imaging techniques in RCC assessment and provides a comprehensive review.

Deep Learning for Image Analysis in Kidney Care

Analysis of medical images, such as radiological or tissue specimens, is an indispensable part of medical diagnostics. Conventionally done manually, the process may sometimes be time-consuming and prone to interobserver variability. Image classification and segmentation by deep learning strategies, predominantly convolutional neural networks, may provide a significant advance in the diagnostic process. In renal medicine, most evidence has been generated around the radiological assessment of renal abnormalities and histological analysis of renal biopsy specimens' segmentation. In this article, the basic principles of image analysis by convolutional neural networks, brief descriptions of convolutional neural networks, and their system architecture for image analysis are discussed, in combination with examples regarding their use in image analysis in nephrology.

Applying a radiomics-based CAD scheme to classify between malignant and benign pancreatic tumors using CT images

BACKGROUND

Pancreatic cancer is one of the most aggressive cancers with approximate 10% five-year survival rate. To reduce mortality rate, accurate detection and diagnose of suspicious pancreatic tumors at an early stage plays an important role.

OBJECTIVE

To develop and test a new radiomics-based computer-aided diagnosis (CAD) scheme of computed tomography (CT) images to detect and classify suspicious pancreatic tumors.

METHODS

A retrospective dataset consisting of 77 patients who had suspicious pancreatic tumors detected on CT images was assembled in which 33 tumors are malignant. A CAD scheme was developed using the following 5 steps namely, (1) apply an image pre-processing algorithm to filter and reduce image noise, (2) use a deep learning model to detect and segment pancreas region, (3) apply a modified region growing algorithm to segment tumor region, (4) compute and select optimal radiomics features, and (5) train and test a support vector machine (SVM) model to classify the detected pancreatic tumor using a leave-one-case-out cross-validation method.

RESULTS

By using the area under receiver operating characteristic (ROC) curve (AUC) as an evaluation index, SVM model yields AUC = 0.750 with 95% confidence interval [0.624, 0.885] to classify pancreatic tumors.

CONCLUSIONS

Study results indicate that radiomics features computed from CT images contain useful information associated with risk of tumor malignancy. This study also built a foundation to support further effort to develop and optimize CAD schemes with more advanced image processing and machine learning methods to more accurately and robustly detect and classify pancreatic tumors in future.