Automated Renal Cancer Grading Using Nuclear Pleomorphic Patterns

Artificial Intelligence in Pathomics and Genomics of Renal Cell Carcinoma

The integration of artificial intelligence (AI) with histopathology images and gene expression patterns has led to the emergence of the dynamic fields of pathomics and genomics. These fields have revolutionized renal cell carcinoma (RCC) diagnosis and subtyping and improved survival prediction models. Machine learning has identified unique gene patterns across RCC subtypes and grades, providing insights into RCC origins and potential treatments, as targeted therapies. The combination of pathomics and genomics using AI opens new avenues in RCC research, promising future breakthroughs and innovations that patients and physicians can anticipate.

Empowering Renal Cancer Management with AI and Digital Pathology: Pathology, Diagnostics and Prognosis

Renal cell carcinoma is a significant health burden worldwide, necessitating accurate and efficient diagnostic methods to guide treatment decisions. Traditional pathology practices have limitations, including interobserver variability and time-consuming evaluations. In recent years, digital pathology tools emerged as a promising solution to enhance the diagnosis and management of renal cancer. This review aims to provide a comprehensive overview of the current state and potential of digital pathology in the context of renal cell carcinoma. Through advanced image analysis algorithms, artificial intelligence (AI) technologies facilitate quantification of cellular and molecular markers, leading to improved accuracy and reproducibility in renal cancer diagnosis. Digital pathology platforms empower remote collaboration between pathologists and help with the creation of comprehensive databases for further research and machine learning applications. The integration of digital pathology tools with other diagnostic modalities, such as radiology and genomics, enables a novel multimodal characterization of different types of renal cell carcinoma. With continuous advancements and refinement, AI technologies are expected to play an integral role in diagnostics and clinical decision-making, improving patient outcomes. In this article, we explored the digital pathology instruments available for clear cell, papillary and chromophobe renal cancers from pathologist and data analyst perspectives.

Artificial Intelligence in Urooncology: What We Have and What We Expect

INTRODUCTION

Artificial intelligence is transforming healthcare by driving innovation, automation, and optimization across various fields of medicine. The aim of this study was to determine whether artificial intelligence (AI) techniques can be used in the diagnosis, treatment planning, and monitoring of urological cancers.

METHODOLOGY

We conducted a thorough search for original and review articles published until 31 May 2022 in the PUBMED/Scopus database. Our search included several terms related to AI and urooncology. Articles were selected with the consensus of all authors.

RESULTS

Several types of AI can be used in the medical field. The most common forms of AI are machine learning (ML), deep learning (DL), neural networks (NNs), natural language processing (NLP) systems, and computer vision. AI can improve various domains related to the management of urologic cancers, such as imaging, grading, and nodal staging. AI can also help identify appropriate diagnoses, treatment options, and even biomarkers. In the majority of these instances, AI is as accurate as or sometimes even superior to medical doctors.

CONCLUSIONS

AI techniques have the potential to revolutionize the diagnosis, treatment, and monitoring of urologic cancers. The use of AI in urooncology care is expected to increase in the future, leading to improved patient outcomes and better overall management of these tumors.

A self-supervised vision transformer to predict survival from histopathology in renal cell carcinoma

PURPOSE

To develop and validate an interpretable deep learning model to predict overall and disease-specific survival (OS/DSS) in clear cell renal cell carcinoma (ccRCC).

METHODS

Digitised haematoxylin and eosin-stained slides from The Cancer Genome Atlas were used as a training set for a vision transformer (ViT) to extract image features with a self-supervised model called DINO (self-distillation with no labels). Extracted features were used in Cox regression models to prognosticate OS and DSS. Kaplan-Meier for univariable evaluation and Cox regression analyses for multivariable evaluation of the DINO-ViT risk groups were performed for prediction of OS and DSS. For validation, a cohort from a tertiary care centre was used.

RESULTS

A significant risk stratification was achieved in univariable analysis for OS and DSS in the training (n = 443, log rank test, p < 0.01) and validation set (n = 266, p < 0.01). In multivariable analysis, including age, metastatic status, tumour size and grading, the DINO-ViT risk stratification was a significant predictor for OS (hazard ratio [HR] 3.03; 95%-confidence interval [95%-CI] 2.11-4.35; p < 0.01) and DSS (HR 4.90; 95%-CI 2.78-8.64; p < 0.01) in the training set but only for DSS in the validation set (HR 2.31; 95%-CI 1.15-4.65; p = 0.02). DINO-ViT visualisation showed that features were mainly extracted from nuclei, cytoplasm, and peritumoural stroma, demonstrating good interpretability.

CONCLUSION

The DINO-ViT can identify high-risk patients using histological images of ccRCC. This model might improve individual risk-adapted renal cancer therapy in the future.

Artificial Intelligence in Renal Cell Carcinoma Histopathology: Current Applications and Future Perspectives

Renal cell carcinoma (RCC) is characterized by its diverse histopathological features, which pose possible challenges to accurate diagnosis and prognosis. A comprehensive literature review was conducted to explore recent advancements in the field of artificial intelligence (AI) in RCC pathology. The aim of this paper is to assess whether these advancements hold promise in improving the precision, efficiency, and objectivity of histopathological analysis for RCC, while also reducing costs and interobserver variability and potentially alleviating the labor and time burden experienced by pathologists. The reviewed AI-powered approaches demonstrate effective identification and classification abilities regarding several histopathological features associated with RCC, facilitating accurate diagnosis, grading, and prognosis prediction and enabling precise and reliable assessments. Nevertheless, implementing AI in renal cell carcinoma generates challenges concerning standardization, generalizability, benchmarking performance, and integration of data into clinical workflows. Developing methodologies that enable pathologists to interpret AI decisions accurately is imperative. Moreover, establishing more robust and standardized validation workflows is crucial to instill confidence in AI-powered systems' outcomes. These efforts are vital for advancing current state-of-the-art practices and enhancing patient care in the future.

Deep learning-based predictions of clear and eosinophilic phenotypes in clear cell renal cell carcinoma

We have recently shown that histological phenotypes focusing on clear and eosinophilic cytoplasm in clear cell renal cell carcinoma (ccRCC) correlated with prognosis and the response to angiogenesis inhibition and checkpoint blockade. This study aims to objectively show the diagnostic utility of clear or eosinophilic phenotypes of ccRCC by developing an artificial intelligence (AI) model using the TCGA-ccRCC dataset and to demonstrate if the clear or eosinophilic predicted phenotypes correlate with pathological factors and gene signatures associated with angiogenesis and cancer immunity. Before the development of the AI model, histological evaluation using hematoxylin and eosin whole-slide images of the TCGA-ccRCC cohort (n = 435) was performed by a urologic pathologist. The AI model was developed as follows. First, the highest-grade area on each whole slide image was captured for image processing. Second, the selected regions were cropped into tiles. Third, the AI model was trained using transfer learning on a deep convolutional neural network, and clear or eosinophilic predictions were scaled as AI scores. Next, we verified the AI model using a validation cohort (n = 95). Finally, we evaluated the accuracy of the prognostic predictions of the AI model and revealed that the AI model detected clear and eosinophilic phenotypes with high accuracy. The AI model stratified the patients' outcomes, and the predicted eosinophilic phenotypes correlated with adverse clinicopathological characteristics and high immune-related gene signatures. In conclusion, the AI-based histologic subclassification accurately predicted clear or eosinophilic phenotypes of ccRCC, allowing for consistently reproducible stratification for prognostic and therapeutic stratification.

Guiding Irregular Nuclear Morphology on Nanopillar Arrays for Malignancy Differentiation in Tumor Cells

For more than a century, abnormal nuclei in tumor cells, presenting subnuclear invaginations and folds on the nuclear envelope, have been known to be associated with high malignancy and poor prognosis. However, current nuclear morphology analysis focuses on the features of the entire nucleus, overlooking the malignancy-related subnuclear features in nanometer scale. The main technical challenge is to probe such tiny and randomly distributed features inside cells. We here employ nanopillar arrays to guide subnuclear features into ordered patterns, enabling their quantification as a strong indicator of cell malignancy. Both breast and liver cancer cells were validated as well as the quantification of nuclear abnormality heterogeneity. The alterations of subnuclear patterns were also explored as effective readouts for drug treatment. We envision that this nanopillar-enabled quantification of subnuclear abnormal features in tumor cells opens a new angle in characterizing malignant cells and studying the unique nuclear biology in cancer.

Artificial intelligence for renal cancer: From imaging to histology and beyond

Artificial intelligence (AI) has made considerable progress within the last decade and is the subject of contemporary literature. This trend is driven by improved computational abilities and increasing amounts of complex data that allow for new approaches in analysis and interpretation. Renal cell carcinoma (RCC) has a rising incidence since most tumors are now detected at an earlier stage due to improved imaging. This creates considerable challenges as approximately 10%–17% of kidney tumors are designated as benign in histopathological evaluation; however, certain co-morbid populations (the obese and elderly) have an increased peri-interventional risk. AI offers an alternative solution by helping to optimize precision and guidance for diagnostic and therapeutic decisions. The narrative review introduced basic principles and provide a comprehensive overview of current AI techniques for RCC. Currently, AI applications can be found in any aspect of RCC management including diagnostics, perioperative care, pathology, and follow-up. Most commonly applied models include neural networks, random forest, support vector machines, and regression. However, for implementation in daily practice, health care providers need to develop a basic understanding and establish interdisciplinary collaborations in order to standardize datasets, define meaningful endpoints, and unify interpretation.

The cancer multidisciplinary team meeting: in need of change? History, challenges and future perspectives

Two decades since their inception, multidisciplinary teams (MDTs) are widely regarded as the 'gold standard' of cancer care delivery. Benefits of MDT working include improved patient outcomes, adherence to guidelines, and even economic benefits. Benefits to MDT members have also been demonstrated. An increasing body of evidence supports the use of MDTs and provides guidance on best practise. The system of MDTs in cancer care has come under increasing pressure of late, due to the increasing incidence of cancer, the popularity of MDT working, and financial pressures. This pressure has resulted in recommendations by national bodies to implement streamlining to reduce workload and improve efficiency. In the present review we examine the historical evidence for MDT working, and the scientific developments that dictate best practise. We also explore how streamlining can be safely and effectively undertaken. Finally, we discuss the future of MDT working including the integration of artificial intelligence and decision support systems and propose a new model for improving patient centredness.

Artificial intelligence in urological oncology: An update and future applications

There continues to be rapid developments and research in the field of Artificial Intelligence (AI) in Urological Oncology worldwide. In this review we discuss the basics of AI, application of AI per tumour group (Renal, Prostate and Bladder Cancer) and application of AI in Robotic Urological Surgery. We also discuss future applications of AI being developed with the benefits to patients with Urological Oncology.

Can artificial intelligence overtake human intelligence on the bumpy road towards glioma therapy?

Gliomas are one of the most devastating primary brain tumors which impose significant management challenges to the clinicians. The aggressive behaviour of gliomas is mainly attributed to their rapid proliferation, unravelled genomics and the blood-brain barrier which protects the tumor cells from chemotherapeutic regimens. Suspects of brain tumors are usually assessed by magnetic resonance imaging and computed tomography. These images allow surgeons to decide on the tumor grading, intra-operative pathology, feasibility of surgery, and treatment planning. All these data are compiled manually by physicians, wherein it takes time for the validation of results and concluding the treatment modality. In this context, the arrival of artificial intelligence in this era of personalized medicine, has proven promising performance in the diagnosis and management of gliomas. Starting from grading prediction till outcome evaluation, artificial intelligence-based forefronts have revolutionized oncological research. Interestingly, this approach has also been able to precisely differentiate tumor lesion from healthy tissues. However, till date, their utility in neuro-oncological field remains limited due to the issues pertaining to their reliability and transparency. Hence, to shed novel insights on the "clinical utility of this novel approach on glioma management" and to reveal "the black-boxes that have to be solved for fruitful application of artificial intelligence in neuro-oncology research", we provide in this review, a succinct description of the potential gear of artificial intelligence-based avenues in glioma treatment and the barriers that impede their rapid implementation in neuro-oncology.

Deep learning based prediction of prognosis in nonmetastatic clear cell renal cell carcinoma

Survival analyses for malignancies, including renal cell carcinoma (RCC), have primarily been conducted using the Cox proportional hazards (CPH) model. We compared the random survival forest (RSF) and DeepSurv models with the CPH model to predict recurrence-free survival (RFS) and cancer-specific survival (CSS) in non-metastatic clear cell RCC (nm-cRCC) patients. Our cohort included 2139 nm-cRCC patients who underwent curative-intent surgery at six Korean institutions between 2000 and 2014. The data of two largest hospitals’ patients were assigned into the training and validation dataset, and the data of the remaining hospitals were assigned into the external validation dataset. The performance of the RSF and DeepSurv models was compared with that of CPH using Harrel’s C-index. During the follow-up, recurrence and cancer-specific deaths were recorded in 190 (12.7%) and 108 (7.0%) patients, respectively, in the training-dataset. Harrel’s C-indices for RFS in the test-dataset were 0.794, 0.789, and 0.802 for CPH, RSF, and DeepSurv, respectively. Harrel’s C-indices for CSS in the test-dataset were 0.831, 0.790, and 0.834 for CPH, RSF, and DeepSurv, respectively. In predicting RFS and CSS in nm-cRCC patients, the performance of DeepSurv was superior to that of CPH and RSF. In no distant time, deep learning-based survival predictions may be useful in RCC patients.

Early experience with Watson for Oncology: a clinical decision-support system for prostate cancer treatment recommendations

PURPOSE

Urological oncologists have difficulty providing optimal personalized care due to rapid alterations in scientific research results, medical advancements, and treatment guidelines. IBM's Watson for Oncology (WFO) is an artificial intelligence clinical decision-support system that assists oncologists with evidence-based treatment recommendations. In the present study, we examined the level of concordance between the treatment recommendations for prostate cancer according to WFO and the actual treatments that the patients received in the department of urology.

METHODS

We enrolled 201 patients who received prostate cancer treatment between January 2018 and June 2018. WFO provided treatment recommendations using clinical data in three categories: recommended, for consideration, and not recommended. These were compared with the actual treatments received by patients. Prostate cancer treatments were considered concordant if the received treatments were included in the "recommended" or "for consideration" categories by WFO.

RESULTS

The patients' mean age was 71.2 years. There were 60 (29.9%) and 114 (56.7%) patients with an Eastern Cooperative Oncology Group (ECOG) performance score ≥ 1 and non-organ confined disease (stage III/IV), respectively. The overall prostate cancer treatment concordance rate was 73.6% ("recommended": 53.2%; "for consideration": 20.4%). An ECOG performance score ≥ 1 and older age (≥ 75 years) were significantly associated with discordance (p = 0.001 and p = 0.026, respectively) on multivariate analysis.

CONCLUSION

In the present study, the treatment recommendations by WFO and the actual received treatments in the department of urology showed a relatively high concordance rate in prostate cancer patients.

Current and future applications of machine and deep learning in urology: a review of the literature on urolithiasis, renal cell carcinoma, and bladder and prostate cancer

PURPOSE

The purpose of the study was to provide a comprehensive review of recent machine learning (ML) and deep learning (DL) applications in urological practice. Numerous studies have reported their use in the medical care of various urological disorders; however, no critical analysis has been made to date.

METHODS

A detailed search of original articles was performed using the PubMed MEDLINE database to identify recent English literature relevant to ML and DL applications in the fields of urolithiasis, renal cell carcinoma (RCC), bladder cancer (BCa), and prostate cancer (PCa).

RESULTS

In total, 43 articles were included addressing these four subfields. The most common ML and DL application in urolithiasis is in the prediction of endourologic surgical outcomes. The main area of research involving ML and DL in RCC concerns the differentiation between benign and malignant small renal masses, Fuhrman nuclear grade prediction, and gene expression-based molecular signatures. BCa studies employ radiomics and texture feature analysis for the distinction between low- and high-grade tumors, address accurate image-based cytology, and use algorithms to predict treatment response, tumor recurrence, and patient survival. PCa studies aim at developing algorithms for Gleason score prediction, MRI computer-aided diagnosis, and surgical outcomes and biochemical recurrence prediction. Studies consistently found the superiority of these methods over traditional statistical methods.

CONCLUSIONS

The continuous incorporation of clinical data, further ML and DL algorithm retraining, and generalizability of models will augment the prediction accuracy and enhance individualized medicine.

Automated clear cell renal carcinoma grade classification with prognostic significance

We developed an automated 2-tiered Fuhrman's grading system for clear cell renal cell carcinoma (ccRCC). Whole slide images (WSI) and clinical data were retrieved for 395 The Cancer Genome Atlas (TCGA) ccRCC cases. Pathologist 1 reviewed and selected regions of interests (ROIs). Nuclear segmentation was performed. Quantitative morphological, intensity, and texture features (n = 72) were extracted. Features associated with grade were identified by constructing a Lasso model using data from cases with concordant 2-tiered Fuhrman's grades between TCGA and Pathologist 1 (training set n = 235; held-out test set n = 42). Discordant cases (n = 118) were additionally reviewed by Pathologist 2. Cox proportional hazard model evaluated the prognostic efficacy of the predicted grades in an extended test set which was created by combining the test set and discordant cases (n = 160). The Lasso model consisted of 26 features and predicted grade with 84.6% sensitivity and 81.3% specificity in the test set. In the extended test set, predicted grade was significantly associated with overall survival after adjusting for age and gender (Hazard Ratio 2.05; 95% CI 1.21-3.47); manual grades were not prognostic. Future work can adapt our computational system to predict WHO/ISUP grades, and validating this system on other ccRCC cohorts.