Positive surgical margins in renal cell carcinoma: translating tumor biology into clinical outcomes

Convolutional neural networks for the differentiation between benign and malignant renal tumors with a multicenter international computed tomography dataset

OBJECTIVES

To use convolutional neural networks (CNNs) for the differentiation between benign and malignant renal tumors using contrast-enhanced CT images of a multi-institutional, multi-vendor, and multicenter CT dataset.

METHODS

A total of 264 histologically confirmed renal tumors were included, from US and Swedish centers. Images were augmented and divided randomly 70%:30% for algorithm training and testing. Three CNNs (InceptionV3, Inception-ResNetV2, VGG-16) were pretrained with transfer learning and fine-tuned with our dataset to distinguish between malignant and benign tumors. The ensemble consensus decision of the three networks was also recorded. Performance of each network was assessed with receiver operating characteristics (ROC) curves and their area under the curve (AUC-ROC). Saliency maps were created to demonstrate the attention of the highest performing CNN.

RESULTS

Inception-ResNetV2 achieved the highest AUC of 0.918 (95% CI 0.873-0.963), whereas VGG-16 achieved an AUC of 0.813 (95% CI 0.752-0.874). InceptionV3 and ensemble achieved the same performance with an AUC of 0.894 (95% CI 0.844-0.943). Saliency maps indicated that Inception-ResNetV2 decisions are based on the characteristics of the tumor while in most tumors considering the characteristics of the interface between the tumor and the surrounding renal parenchyma.

CONCLUSION

Deep learning based on a diverse multicenter international dataset can enable accurate differentiation between benign and malignant renal tumors.

CRITICAL RELEVANCE STATEMENT

Convolutional neural networks trained on a diverse CT dataset can accurately differentiate between benign and malignant renal tumors.

KEY POINTS

• Differentiation between benign and malignant tumors based on CT is extremely challenging. • Inception-ResNetV2 trained on a diverse dataset achieved excellent differentiation between tumor types. • Deep learning can be used to distinguish between benign and malignant renal tumors.

An Ensemble of U-Net Models for Kidney Tumor Segmentation With CT Images

We present here the Arkansas AI-Campus solution method for the 2019 Kidney Tumor Segmentation Challenge (KiTS19). Our Arkansas AI-Campus team participated the KiTS19 Challenge for four months, from March to July of 2019. This paper provides a summary of our methods, training, testing and validation results for this grand challenge in biomedical imaging analysis. Our deep learning model is an ensemble of U-Net models developed after testing many model variations. Our model has consistent performance on the local test dataset and the final competition independent test dataset. The model achieved local test Dice scores of 0.949 for kidney and tumor segmentation, and 0.601 for tumor segmentation, and the final competition test earned Dice scores 0.9470 and 0.6099 respectively. The Arkansas AI-Campus team solution with a composite DICE score of 0.7784 has achieved a final ranking of top fifty worldwide, and top five among the United States teams in the KiTS19 Competition.

Three-Dimensional Printed Molds for Image-Guided Surgical Biopsies: An Open Source Computational Platform

PURPOSE

Spatial heterogeneity of tumors is a major challenge in precision oncology. The relationship between molecular and imaging heterogeneity is still poorly understood because it relies on the accurate coregistration of medical images and tissue biopsies. Tumor molds can guide the localization of biopsies, but their creation is time consuming, technologically challenging, and difficult to interface with routine clinical practice. These hurdles have so far hindered the progress in the area of multiscale integration of tumor heterogeneity data.

METHODS

We have developed an open-source computational framework to automatically produce patient-specific 3-dimensional-printed molds that can be used in the clinical setting. Our approach achieves accurate coregistration of sampling location between tissue and imaging, and integrates seamlessly with clinical, imaging, and pathology workflows.

RESULTS

We applied our framework to patients with renal cancer undergoing radical nephrectomy. We created personalized molds for 6 patients, obtaining Dice similarity coefficients between imaging and tissue sections ranging from 0.86 to 0.96 for tumor regions and between 0.70 and 0.76 for healthy kidneys. The framework required minimal manual intervention, producing the final mold design in just minutes, while automatically taking into account clinical considerations such as a preference for specific cutting planes.

CONCLUSION

Our work provides a robust and automated interface between imaging and tissue samples, enabling the development of clinical studies to probe tumor heterogeneity on multiple spatial scales.