The potential of artificial intelligence-based applications in kidney pathology

Synthetic data as an investigative tool in hypertension and renal diseases research

There is a growing body of clinical research on the utility of synthetic data derivatives, an emerging research tool in medicine. In nephrology, clinicians can use machine learning and artificial intelligence as powerful aids in their clinical decision-making while also preserving patient privacy. This is especially important given the epidemiology of chronic kidney disease, renal oncology, and hypertension worldwide. However, there remains a need to create a framework for guidance regarding how to better utilize synthetic data as a practical application in this research.

Kidney medicine meets computer vision: a bibliometric analysis

BACKGROUND AND OBJECTIVE

Rapid advances in computer vision (CV) have the potential to facilitate the examination, diagnosis, and treatment of diseases of the kidney. The bibliometric study aims to explore the research landscape and evolving research focus of the application of CV in kidney medicine research.

METHODS

The Web of Science Core Collection was utilized to identify publications related to the research or applications of CV technology in the field of kidney medicine from January 1, 1900, to December 31, 2022. We analyzed emerging research trends, highly influential publications and journals, prolific researchers, countries/regions, research institutions, co-authorship networks, and co-occurrence networks. Bibliographic information was analyzed and visualized using Python, Matplotlib, Seaborn, HistCite, and Vosviewer.

RESULTS

There was an increasing trend in the number of publications on CV-based kidney medicine research. These publications mainly focused on medical image processing, surgical procedures, medical image analysis/diagnosis, as well as the application and innovation of CV technology in medical imaging. The United States is currently the leading country in terms of the quantities of published articles and international collaborations, followed by China. Deep learning-based segmentation and machine learning-based texture analysis are the most commonly used techniques in this field. Regarding research hotspot trends, CV algorithms are shifting toward artificial intelligence, and research objects are expanding to encompass a wider range of kidney-related objects, with data dimensions used in research transitioning from 2D to 3D while simultaneously incorporating more diverse data modalities.

CONCLUSION

The present study provides a scientometric overview of the current progress in the research and application of CV technology in kidney medicine research. Through the use of bibliometric analysis and network visualization, we elucidate emerging trends, key sources, leading institutions, and popular topics. Our findings and analysis are expected to provide valuable insights for future research on the use of CV in kidney medicine research.

A new, deep learning-based method for the analysis of autopsy kidney samples used to study sex differences in glomerular density and size in a forensic population

Artificial intelligence (AI) is increasingly used in forensic anthropology and genetics to identify the victim and the cause of death. The large autopsy samples from persons with traumatic causes of death but without comorbidities also offer possibilities to analyze normal histology with AI. We propose a new deep learning-based method to rapidly count glomerular number and measure glomerular density (GD) and volume in post-mortem kidney samples obtained in a forensic population. We assessed whether this new method detects glomerular differences between men and women without known kidney disease. Autopsies performed between 2009 and 2015 were analyzed if subjects were aged ≥ 18 years and had no known kidney disease, diabetes mellitus, or hypertension. A large biopsy was taken from each kidney, stained with hematoxylin and eosin, and scanned. An in-house developed deep learning-based algorithm counted the glomerular density (GD), number, and size. Out of 1165 forensic autopsies, 86 met all inclusion criteria (54 men). Mean (± SD) age was 43.5 ± 14.6; 786 ± 277 glomeruli were analyzed per individual. There was no significant difference in GD between men and women (2.18 ± 0.49 vs. 2.30 ± 0.57 glomeruli/mm2, p = 0.71); glomerular diameter, area, and volume also did not differ. GD correlated inversely with age, kidney weight, and glomerular area. Glomerular area and volume increased significantly with age. In this study, there were no sex differences in glomerular density or size. Considering the size of the kidney samples, the use of the presented deep learning method can help to analyze large renal autopsy biopsies and opens perspectives for the histological study of other organs.

The Cross-Scale Association between Pathomics and Radiomics Features in Immunotherapy-Treated NSCLC Patients: A Preliminary Study

BACKGROUND

Recent advances in cancer biomarker development have led to a surge of distinct data modalities, such as medical imaging and histopathology. To develop predictive immunotherapy biomarkers, these modalities are leveraged independently, despite their orthogonality. This study aims to explore the cross-scale association between radiological scans and digitalized pathology images for immunotherapy-treated non-small cell lung cancer (NSCLC) patients.

METHODS

This study involves 36 NSCLC patients who were treated with immunotherapy and for whom both radiology and pathology images were available. A total of 851 and 260 features were extracted from CT scans and cell density maps of histology images at different resolutions. We investigated the radiopathomics relationship and their association with clinical and biological endpoints. We used the Kolmogorov-Smirnov (KS) method to test the differences between the distributions of correlation coefficients with the two imaging modality features. Unsupervised clustering was done to identify which imaging modality captures poor and good survival patients.

RESULTS

Our results demonstrated a significant correlation between cell density pathomics and radiomics features. Furthermore, we also found a varying distribution of correlation values between imaging-derived features and clinical endpoints. The KS test revealed that the two imaging feature distributions were different for PFS and CD8 counts, while similar for OS. In addition, clustering analysis resulted in significant differences in the two clusters generated from the radiomics and pathomics features with respect to patient survival and CD8 counts.

CONCLUSION

The results of this study suggest a cross-scale association between CT scans and pathology H&E slides among ICI-treated patients. These relationships can be further explored to develop multimodal immunotherapy biomarkers to advance personalized lung cancer care.

Time for a full digital approach in nephropathology: a systematic review of current artificial intelligence applications and future directions

INTRODUCTION

Artificial intelligence (AI) integration in nephropathology has been growing rapidly in recent years, facing several challenges including the wide range of histological techniques used, the low occurrence of certain diseases, and the need for data sharing. This narrative review retraces the history of AI in nephropathology and provides insights into potential future developments.

METHODS

Electronic searches in PubMed-MEDLINE and Embase were made to extract pertinent articles from the literature. Works about automated image analysis or the application of an AI algorithm on non-neoplastic kidney histological samples were included and analyzed to extract information such as publication year, AI task, and learning type. Prepublication servers and reviews were not included.

RESULTS

Seventy-six (76) original research articles were selected. Most of the studies were conducted in the United States in the last 7 years. To date, research has been mainly conducted on relatively easy tasks, like single-stain glomerular segmentation. However, there is a trend towards developing more complex tasks such as glomerular multi-stain classification.

CONCLUSION

Deep learning has been used to identify patterns in complex histopathology data and looks promising for the comprehensive assessment of renal biopsy, through the use of multiple stains and virtual staining techniques. Hybrid and collaborative learning approaches have also been explored to utilize large amounts of unlabeled data. A diverse team of experts, including nephropathologists, computer scientists, and clinicians, is crucial for the development of AI systems for nephropathology. Collaborative efforts among multidisciplinary experts result in clinically relevant and effective AI tools.

Operational greenhouse-gas emissions of deep learning in digital pathology: a modelling study

BACKGROUND

Deep learning is a promising way to improve health care. Image-processing medical disciplines, such as pathology, are expected to be transformed by deep learning. The first clinically applicable deep-learning diagnostic support tools are already available in cancer pathology, and their number is increasing. However, data on the environmental sustainability of these tools are scarce. We aimed to conduct an environmental-sustainability analysis of a theoretical implementation of deep learning in patient-care pathology.

METHODS

For this modelling study, we first assembled and calculated relevant data and parameters of a digital-pathology workflow. Data were breast and prostate specimens from the university clinic at the Institute of Pathology of the Rheinisch-Westfälische Technische Hochschule Aachen (Aachen, Germany), for which commercially available deep learning was already available. Only specimens collected between Jan 1 and Dec 31, 2019 were used, to omit potential biases due to the COVID-19 pandemic. Our final selection was based on 2 representative weeks outside holidays, covering different types of specimens. To calculate carbon dioxide (CO2) or CO2 equivalent (CO2 eq) emissions of deep learning in pathology, we gathered relevant data for exact numbers and sizes of whole-slide images (WSIs), which were generated by scanning histopathology samples of prostate and breast specimens. We also evaluated different data input scenarios (including all slide tiles, only tiles containing tissue, or only tiles containing regions of interest). To convert estimated energy consumption from kWh to CO2 eq, we used the internet protocol address of the computational server and the Electricity Maps database to obtain information on the sources of the local electricity grid (ie, renewable vs non-renewable), and estimated the number of trees and proportion of the local and world's forests needed to sequester the CO2 eq emissions. We calculated the computational requirements and CO2 eq emissions of 30 deep-learning models that varied in task and size. The first scenario represented the use of one commercially available deep-learning model for one task in one case (1-task), the second scenario considered two deep-learning models for two tasks per case (2-task), the third scenario represented a future, potentially automated workflow that could handle 7 tasks per case (7-task), and the fourth scenario represented the use of a single potential, large, computer-vision model that could conduct multiple tasks (multitask). We also compared the performance (ie, accuracy) and CO2 eq emissions of different deep-learning models for the classification of renal cell carcinoma on WSIs, also from Rheinisch-Westfälische Technische Hochschule Aachen. We also tested other approaches to reducing CO2 eq emissions, including model pruning and an alternative method for histopathology analysis (pathomics).

FINDINGS

The pathology database contained 35 552 specimens (237 179 slides), 6420 of which were prostate specimens (10 115 slides) and 11 801 of which were breast specimens (19 763 slides). We selected and subsequently digitised 140 slides from eight breast-cancer cases and 223 slides from five prostate-cancer cases. Applying large deep-learning models on all WSI tiles of prostate and breast pathology cases would result in yearly CO2 eq emissions of 7·65 metric tons (t; 95% CI 7·62-7·68) with the use of a single deep-learning model per case; yearly CO2 eq emissions were up to 100·56 t (100·21-100·99) with the use of seven deep-learning models per case. CO2 eq emissions for different deep-learning model scenarios, data inputs, and deep-learning model sizes for all slides varied from 3·61 t (3·59-3·63) to 2795·30 t (1177·51-6482·13. For the estimated number of overall pathology cases worldwide, the yearly CO2 eq emissions varied, reaching up to 16 megatons (Mt) of CO2 eq, requiring up to 86 590 km2 (0·22%) of world forest to sequester the CO2 eq emissions. Use of the 7-task scenario and small deep-learning models on slides containing tissue only could substantially reduce CO2 eq emissions worldwide by up to 141 times (0·1 Mt, 95% CI 0·1-0·1). Considering the local environment in Aachen, Germany, the maximum CO2 eq emission from the use of deep learning in digital pathology only would require 32·8% (95% CI 13·8-76·6) of the local forest to sequester the CO2 eq emissions. A single pathomics run on a tissue could provide information that was comparable to or even better than the output of multitask deep-learning models, but with 147 times reduced CO2 eq emissions.

INTERPRETATION

Our findings suggest that widespread use of deep learning in pathology might have considerable global-warming potential. The medical community, policy decision makers, and the public should be aware of this potential and encourage the use of CO2 eq emissions reduction strategies where possible.

FUNDING

German Research Foundation, European Research Council, German Federal Ministry of Education and Research, Health, Economic Affairs and Climate Action, and the Innovation Fund of the Federal Joint Committee.

Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments

The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.

A Spatially Guided Machine-Learning Method to Classify and Quantify Glomerular Patterns of Injury in Histology Images

Introduction The diagnosis of glomerular diseases is primarily based on visual assessment of histologic patterns. Semi-quantitative scoring of active and chronic lesions is often required to assess individual characteristics of the disease. Reproducibility of the visual scoring systems remains debatable, while digital and machine-learning technologies present opportunities to detect, classify and quantify glomerular lesions, also considering their inter- and intraglomerular heterogeneity.

MATERIALS AND METHODS

We performed a cross-validated comparison of three modifications of a convolutional neural network (CNN)-based approach for recognition and intraglomerular quantification of nine main glomerular patterns of injury. Reference values provided by two nephropathologists were used for validation. For each glomerular image, visual attention heatmaps were generated with a probability of class attribution for further intraglomerular quantification. The quality of classifier-produced heatmaps was evaluated by intersection over union metrics (IoU) between predicted and ground truth localization heatmaps.

RESULTS

A proposed spatially guided modification of the CNN classifier achieved the highest glomerular pattern classification accuracies, with area under curve (AUC) values up to 0.981. With regards to heatmap overlap area and intraglomerular pattern quantification, the spatially guided classifier achieved a significantly higher generalized mean IoU value compared to single-multiclass and multiple-binary classifiers.

CONCLUSIONS

We propose a spatially guided CNN classifier that in our experiments reveals the potential to achieve high accuracy for the localization of intraglomerular patterns.

Automated quantification and statistical assessment of proliferating cardiomyocyte rates in embryonic hearts

The use of digital image analysis and count regression models contributes to the reproducibility and rigor of histological studies in cardiovascular research. The use of formalized computer-based quantification strategies of histological images essentially removes potential researcher bias, allows for higher analysis throughput, and enables easy sharing of formalized quantification tools, contributing to research transparency, and data transferability. Moreover, the use of count regression models rather than ratios in statistical analysis of cell population data incorporates the extent of sampling into analysis and acknowledges the non-Gaussian nature of count distributions. Using quantification of proliferating cardiomyocytes in embryonic murine hearts as an example, we describe how these improvements can be implemented using open-source artificial intelligence-based image analysis tools and novel count regression models to efficiently analyze real-life data.