Deep Learning-Based Histopathologic Assessment of Kidney Tissue

Advancing the application of the analytical renal pathology system in allograft IgA nephropathy patients

BACKGROUND

The analytical renal pathology system (ARPS) based on convolutional neural networks has been used successfully in native IgA nephropathy (IgAN) patients. Considering the similarity of pathologic features, we aim to evaluate the performance of the ARPS in allograft IgAN patients and broaden its implementation.

METHODS

Biopsy-proven allograft IgAN patients from two different centers were enrolled for internal and external validation. We implemented the ARPS to identify glomerular lesions and intrinsic glomerular cells, and then evaluated its performance. Consistency between the ARPS and pathologists was assessed using intraclass correlation coefficients. The association of digital pathological features with clinical and pathological data was measured. Kaplan-Meier survival curve and cox proportional hazards model were applied to investigate prognosis prediction.

RESULTS

A total of 56 biopsy-proven allograft IgAN patients from the internal center and 17 biopsy-proven allograft IgAN patients from the external center were enrolled in this study. The ARPS was successfully applied to identify the glomerular lesions (F1-score, 0.696-0.959) and quantify intrinsic glomerular cells (F1-score, 0.888-0.968) in allograft IgAN patients rapidly and precisely. Furthermore, the mesangial hypercellularity score was positively correlated with all mesangial metrics provided by ARPS [Spearman's correlation coefficient (r), 0.439-0.472, and all p values < 0.001]. Besides, a higher allograft survival was noticed among patients in the high-level groups of the maximum and ratio of endothelial cells, as well as the maximum and density of podocytes.

CONCLUSION

We propose that the ARPS could be implemented in future clinical practice with outstanding capability.

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Discovery and generalization of tissue structures from spatial omics data

Tissues are organized into anatomical and functional units at different scales. New technologies for high-dimensional molecular profiling in situ have enabled the characterization of structure-function relationships in increasing molecular detail. However, it remains a challenge to consistently identify key functional units across experiments, tissues, and disease contexts, a task that demands extensive manual annotation. Here, we present spatial cellular graph partitioning (SCGP), a flexible method for the unsupervised annotation of tissue structures. We further present a reference-query extension pipeline, SCGP-Extension, that generalizes reference tissue structure labels to previously unseen samples, performing data integration and tissue structure discovery. Our experiments demonstrate reliable, robust partitioning of spatial data in a wide variety of contexts and best-in-class accuracy in identifying expertly annotated structures. Downstream analysis on SCGP-identified tissue structures reveals disease-relevant insights regarding diabetic kidney disease, skin disorder, and neoplastic diseases, underscoring its potential to drive biological insight and discovery from spatial datasets.

A graph-learning based model for automatic diagnosis of Sjögren's syndrome on digital pathological images: a multicentre cohort study

BACKGROUND

Sjögren's Syndrome (SS) is a rare chronic autoimmune disorder primarily affecting adult females, characterized by chronic inflammation and salivary and lacrimal gland dysfunction. It is often associated with systemic lupus erythematosus, rheumatoid arthritis and kidney disease, which can lead to increased mortality. Early diagnosis is critical, but traditional methods for diagnosing SS, mainly through histopathological evaluation of salivary gland tissue, have limitations.

METHODS

The study used 100 labial gland biopsy, creating whole-slide images (WSIs) for analysis. The proposed model, named Cell-tissue-graph-based pathological image analysis model (CTG-PAM) and based on graph theory, characterizes single-cell feature, cell-cell feature, and cell-tissue feature. Building upon these features, CTG-PAM achieves cellular-level classification, enabling lymphocyte recognition. Furthermore, it leverages connected component analysis techniques in the cell graph structure to perform SS diagnosis based on lymphocyte counts.

FINDINGS

CTG-PAM outperforms traditional deep learning methods in diagnosing SS. Its area under the receiver operating characteristic curve (AUC) is 1.0 for the internal validation dataset and 0.8035 for the external test dataset. This indicates high accuracy. The sensitivity of CTG-PAM for the external dataset is 98.21%, while the accuracy is 93.75%. In comparison, the sensitivity and accuracy for traditional deep learning methods (ResNet-50) are lower. The study also shows that CTG-PAM's diagnostic accuracy is closer to skilled pathologists compared to beginners.

INTERPRETATION

Our findings indicate that CTG-PAM is a reliable method for diagnosing SS. Additionally, CTG-PAM shows promise in enhancing the prognosis of SS patients and holds significant potential for the differential diagnosis of both non-neoplastic and neoplastic diseases. The AI model potentially extends its application to diagnosing immune cells in tumor microenvironments.

Decoding pathology: the role of computational pathology in research and diagnostics

Traditional histopathology, characterized by manual quantifications and assessments, faces challenges such as low-throughput and inter-observer variability that hinder the introduction of precision medicine in pathology diagnostics and research. The advent of digital pathology allowed the introduction of computational pathology, a discipline that leverages computational methods, especially based on deep learning (DL) techniques, to analyze histopathology specimens. A growing body of research shows impressive performances of DL-based models in pathology for a multitude of tasks, such as mutation prediction, large-scale pathomics analyses, or prognosis prediction. New approaches integrate multimodal data sources and increasingly rely on multi-purpose foundation models. This review provides an introductory overview of advancements in computational pathology and discusses their implications for the future of histopathology in research and diagnostics.

Protective effects of dietary additive quercetin: Nephrotoxicity and ferroptosis induced by avermectin pesticide

In recent years, contamination of aquatic systems with Avermectin (AVM) has emerged as a significant concern. This contamination poses substantial challenges to freshwater aquaculture. Plant-derived Quercetin (QUE), known for its anti-inflammatory, antioxidant, and ferroptosis-inhibiting properties, is commonly employed as a supplement in animal feed. However, its protective role against chronic renal injury in freshwater carp induced by AVM remains unclear. This study assesses the influence of dietary supplementation with QUE on the consequences of chronic AVM exposure on carp renal function. The carp were subjected to a 30-day exposure to AVM and were provided with a diet containing 400 mg/kg of QUE. Pathological observations indicated that QUE alleviated renal tissue structural damage caused by AVM. RT-QPCR study revealed that QUE effectively reduced the increased expression levels of pro-inflammatory factors mRNA produced by AVM exposure, by concurrently raising the mRNA expression level of the anti-inflammatory factor. Quantitative analysis using DHE tests and biochemical analysis demonstrated that QUE effectively reduced the buildup of ROS in the renal tissues of carp, activity of antioxidant enzymes CAT, SOD, and GSH-px, which were inhibited by AVM, and increased the content of GSH, which was induced by prolonged exposure to AVM. QUE also reduced the levels of MDA, a marker of oxidative damage. Furthermore, assays for ferroptosis markers indicated that QUE increased the mRNA expression levels of gpx4 and slc7a11, which were reduced due to AVM induction, and it caused a reduction in the mRNA expression levels of ftl, ncoa4, and cox2, along with a drop in the Fe2+ concentration. In summary, QUE mitigates chronic AVM exposure-induced renal inflammation in carp by inhibiting the transcription of pro-inflammatory cytokines. By blocking ROS accumulation, renal redox homeostasis is restored, thereby inhibiting renal inflammation and ferroptosis. This provides a theoretical basis for the development of freshwater carp feed formula.

Telemedicine-medical "snack community"-PHS ecosystem: Insights into the double-edged sword role of telemedicine in clinical practice and medical education during the COVID-19 pandemic and beyond

Telemedicine has gained tremendous development during the COVID-19 pandemic. With deblocking and opening, telemedicine accelerates the evolvution of the medical "snack community" and undermines the perception of medical students and staff, which promotes the incidence of psychosocial-related disorders. Moreover, the inconsistent telemedicine adaptability between medical workers and patients aggravates the doctor-patient conflict due to the aging population and COVID-19 squeal. Telemedicine is colliding with the national healthcare system, whose synchronization with conventional medical service is crucial to coordinate the relationship among medical payment, patient privacy and qualifications of clinicians. This study puts more emphasis on the double-edged sword role of telemedicine in clinical practice and medical education during the COVID-19 pandemic and beyond. Overall, while telemedicine has demonstrated its utility in health care throughout the COVID pandemic, it is pretty critical to continue evaluating the efficacy and limitations of telemedicine in order to maintain equal access to medical service and high-quality medical education. A new concept as telemedicine-medical "snack community"-PHS ecosystem, where the psychological health education system and partners healthcare system with enough bandwidth, especially 5G technology, could optimize the effect of telemedicine on medical practice and education, is proposed.

Bifidobacterium bifidum alleviates adenine-induced acute kidney injury in mice by improving intestinal barrier function

Acute kidney injury (AKI) is a kind of critical kidney disease characterized by tubular injury, rapid decline of renal function and renal inflammation, with high clinical incidence. AKI has been shown to be associated with dysregulation of the gut microbiota and impaired intestinal barrier. Bifidobacterium has a positive impact on the treatment of many diseases. However, little is known about the role and mechanism of Bifidobacterium in AKI. Based on previous experiments, Bifidobacterium bifidum FL228.1 and FL276.1, which can relieve intestinal inflammation, and Bifidobacterium bifidum ZL.1, which has anti-inflammatory potential, were screened. This study aimed to investigate the effects of Bifidobacterium bifidum FL228.1, FL276.1 and ZL.1 on AKI, focusing on their role in the gut microbiota composition and intestinal barrier function. Our results showed that Bifidobacterium bifidum FL228.1, FL276.1 and ZL.1 effectively improved kidney function in mice with AKI by regulating the gut microbiota dysregulation, inhibiting intestinal inflammation and rebuilding the intestinal mucosal barrier. In addition, intervention with probiotics turned the gut microbiota disturbance caused by AKI into a normalized trend, reversed the adverse outcome of microbiota imbalance, and increased the abundance of potentially beneficial bacteria Bifidobacterium and Faecalibaculum. In summary, Bifidobacterium bifidum FL228.1, FL276.1, and ZL.1 alleviate adenine-induced AKI based on the gut-kidney axis. Although their mechanisms of action are different, their effect on alleviating AKI is almost the same.

Application of spatial-omics to the classification of kidney biopsy samples in transplantation

Improvement of long-term outcomes through targeted treatment is a primary concern in kidney transplant medicine. Currently, the validation of a rejection diagnosis and subsequent treatment depends on the histological assessment of allograft biopsy samples, according to the Banff classification system. However, the lack of (early) disease-specific tissue markers hinders accurate diagnosis and thus timely intervention. This challenge mainly results from an incomplete understanding of the pathophysiological processes underlying late allograft failure. Integration of large-scale multimodal approaches for investigating allograft biopsy samples might offer new insights into this pathophysiology, which are necessary for the identification of novel therapeutic targets and the development of tailored immunotherapeutic interventions. Several omics technologies - including transcriptomic, proteomic, lipidomic and metabolomic tools (and multimodal data analysis strategies) - can be applied to allograft biopsy investigation. However, despite their successful application in research settings and their potential clinical value, several barriers limit the broad implementation of many of these tools into clinical practice. Among spatial-omics technologies, mass spectrometry imaging, which is under-represented in the transplant field, has the potential to enable multi-omics investigations that might expand the insights gained with current clinical analysis technologies.

Deep learning-based glomerulus detection and classification with generative morphology augmentation in renal pathology images

Glomerulus morphology on renal pathology images provides valuable diagnosis and outcome prediction information. To provide better care, an efficient, standardized, and scalable method is urgently needed to optimize the time-consuming and labor-intensive interpretation process by renal pathologists. This paper proposes a deep convolutional neural network (CNN)-based approach to automatically detect and classify glomeruli with different stains in renal pathology images. In the glomerulus detection stage, this paper proposes a flattened Xception with a feature pyramid network (FX-FPN). The FX-FPN is employed as a backbone in the framework of faster region-based CNN to improve glomerulus detection performance. In the classification stage, this paper considers classifications of five glomerulus morphologies using a flattened Xception classifier. To endow the classifier with higher discriminability, this paper proposes a generative data augmentation approach for patch-based glomerulus morphology augmentation. New glomerulus patches of different morphologies are generated for data augmentation through the cycle-consistent generative adversarial network (CycleGAN). The single detection model shows the F1 score up to 0.9524 in H&E and PAS stains. The classification result shows that the average sensitivity and specificity are 0.7077 and 0.9316, respectively, by using the flattened Xception with the original training data. The sensitivity and specificity increase to 0.7623 and 0.9443, respectively, by using the generative data augmentation. Comparisons with different deep CNN models show the effectiveness and superiority of the proposed approach.

[Artificial intelligence in kidney transplant pathology]

BACKGROUND

Artificial intelligence (AI) systems have showed promising results in digital pathology, including digital nephropathology and specifically also kidney transplant pathology.

AIM

Summarize the current state of research and limitations in the field of AI in kidney transplant pathology diagnostics and provide a future outlook.

MATERIALS AND METHODS

Literature search in PubMed and Web of Science using the search terms "deep learning", "transplant", and "kidney". Based on these results and studies cited in the identified literature, a selection was made of studies that have a histopathological focus and use AI to improve kidney transplant diagnostics.

RESULTS AND CONCLUSION

Many studies have already made important contributions, particularly to the automation of the quantification of some histopathological lesions in nephropathology. This likely can be extended to automatically quantify all relevant lesions for a kidney transplant, such as Banff lesions. Important limitations and challenges exist in the collection of representative data sets and the updates of Banff classification, making large-scale studies challenging. The already positive study results make future AI support in kidney transplant pathology appear likely.

Kidney medicine meets computer vision: a bibliometric analysis

BACKGROUND AND OBJECTIVE

Rapid advances in computer vision (CV) have the potential to facilitate the examination, diagnosis, and treatment of diseases of the kidney. The bibliometric study aims to explore the research landscape and evolving research focus of the application of CV in kidney medicine research.

METHODS

The Web of Science Core Collection was utilized to identify publications related to the research or applications of CV technology in the field of kidney medicine from January 1, 1900, to December 31, 2022. We analyzed emerging research trends, highly influential publications and journals, prolific researchers, countries/regions, research institutions, co-authorship networks, and co-occurrence networks. Bibliographic information was analyzed and visualized using Python, Matplotlib, Seaborn, HistCite, and Vosviewer.

RESULTS

There was an increasing trend in the number of publications on CV-based kidney medicine research. These publications mainly focused on medical image processing, surgical procedures, medical image analysis/diagnosis, as well as the application and innovation of CV technology in medical imaging. The United States is currently the leading country in terms of the quantities of published articles and international collaborations, followed by China. Deep learning-based segmentation and machine learning-based texture analysis are the most commonly used techniques in this field. Regarding research hotspot trends, CV algorithms are shifting toward artificial intelligence, and research objects are expanding to encompass a wider range of kidney-related objects, with data dimensions used in research transitioning from 2D to 3D while simultaneously incorporating more diverse data modalities.

CONCLUSION

The present study provides a scientometric overview of the current progress in the research and application of CV technology in kidney medicine research. Through the use of bibliometric analysis and network visualization, we elucidate emerging trends, key sources, leading institutions, and popular topics. Our findings and analysis are expected to provide valuable insights for future research on the use of CV in kidney medicine research.

Deep learning applications for kidney histology analysis

PURPOSE OF REVIEW

Nephropathology is increasingly incorporating computational methods to enhance research and diagnostic accuracy. The widespread adoption of digital pathology, coupled with advancements in deep learning, will likely transform our pathology practices. Here, we discuss basic concepts of deep learning, recent applications in nephropathology, current challenges in implementation and future perspectives.

RECENT FINDINGS

Deep learning models have been developed and tested in various areas of nephropathology, for example, predicting kidney disease progression or diagnosing diseases based on imaging and clinical data. Despite their promising potential, challenges remain that hinder a wider adoption, for example, the lack of prospective evidence and testing in real-world scenarios.

SUMMARY

Deep learning offers great opportunities to improve quantitative and qualitative kidney histology analysis for research and clinical nephropathology diagnostics. Although exciting approaches already exist, the potential of deep learning in nephropathology is only at its beginning and we can expect much more to come.

Artificial intelligence assists identification and pathologic classification of glomerular lesions in patients with diabetic nephropathy

BACKGROUND

Glomerular lesions are the main injuries of diabetic nephropathy (DN) and are used as a crucial index for pathologic classification. Manual quantification of these morphologic features currently used is semi-quantitative and time-consuming. Automatically quantifying glomerular morphologic features is urgently needed.

METHODS

A series of convolutional neural networks (CNN) were designed to identify and classify glomerular morphologic features in DN patients. Associations of these digital features with pathologic classification and prognosis were further analyzed.

RESULTS

Our CNN-based model achieved a 0.928 F1-score for global glomerulosclerosis and 0.953 F1-score for Kimmelstiel-Wilson lesion, further obtained a dice of 0.870 for the mesangial area and F1-score beyond 0.839 for three glomerular intrinsic cells. As the pathologic classes increased, mesangial cell numbers and mesangial area increased, and podocyte numbers decreased (p for all < 0.001), while endothelial cell numbers remained stable (p = 0.431). Glomeruli with Kimmelstiel-Wilson lesion showed more severe podocyte deletion compared to those without (p < 0.001). Furthermore, CNN-based classifications showed moderate agreement with pathologists-based classification, the kappa value between the CNN model 3 and pathologists reached 0.624 (ranging from 0.529 to 0.688, p < 0.001). Notably, CNN-based classifications obtained equivalent performance to pathologists-based classifications on predicting baseline and long-term renal function.

CONCLUSION

Our CNN-based model is promising in assisting the identification and pathologic classification of glomerular lesions in DN patients.

Deep-learning model for evaluating histopathology of acute renal tubular injury

Tubular injury is the most common cause of acute kidney injury. Histopathological diagnosis may help distinguish between the different types of acute kidney injury and aid in treatment. To date, a limited number of study has used deep-learning models to assist in the histopathological diagnosis of acute kidney injury. This study aimed to perform histopathological segmentation to identify the four structures of acute renal tubular injury using deep-learning models. A segmentation model was used to classify tubule-specific injuries following cisplatin treatment. A total of 45 whole-slide images with 400 generated patches were used in the segmentation model, and 27,478 annotations were created for four classes: glomerulus, healthy tubules, necrotic tubules, and tubules with casts. A segmentation model was developed using the DeepLabV3 architecture with a MobileNetv3-Large backbone to accurately identify the four histopathological structures associated with acute renal tubular injury in PAS-stained mouse samples. In the segmentation model for four structures, the highest Intersection over Union and the Dice coefficient were obtained for the segmentation of the "glomerulus" class, followed by "necrotic tubules," "healthy tubules," and "tubules with cast" classes. The overall performance of the segmentation algorithm for all classes in the test set included an Intersection over Union of 0.7968 and a Dice coefficient of 0.8772. The Dice scores for the glomerulus, healthy tubules, necrotic tubules, and tubules with cast are 91.78 ± 11.09, 87.37 ± 4.02, 88.08 ± 6.83, and 83.64 ± 20.39%, respectively. The utilization of deep learning in a predictive model has demonstrated promising performance in accurately identifying the degree of injured renal tubules. These results may provide new opportunities for the application of the proposed methods to evaluate renal pathology more effectively.

Morphomics via next-generation electron microscopy

The living body is composed of innumerable fine and complex structures. Although these structures have been studied in the past, a vast amount of information pertaining to them still remains unknown. When attempting to observe these ultra-structures, the use of electron microscopy (EM) has become indispensable. However, conventional EM settings are limited to a narrow tissue area, which can bias observations. Recently, new trends in EM research have emerged, enabling coverage of far broader, nano-scale fields of view for two-dimensional wide areas and three-dimensional large volumes. Moreover, cutting-edge bioimage informatics conducted via deep learning has accelerated the quantification of complex morphological bioimages. Taken together, these technological and analytical advances have led to the comprehensive acquisition and quantification of cellular morphology, which now arises as a new omics science termed 'morphomics'.

Predicting clinical endpoints and visual changes with quality-weighted tissue-based renal histological features

Two common obstacles limiting the performance of data-driven algorithms in digital histopathology classification tasks are the lack of expert annotations and the narrow diversity of datasets. Multi-instance learning (MIL) can address the former challenge for the analysis of whole slide images (WSI), but performance is often inferior to full supervision. We show that the inclusion of weak annotations can significantly enhance the effectiveness of MIL while keeping the approach scalable. An analysis framework was developed to process periodic acid-Schiff (PAS) and Sirius Red (SR) slides of renal biopsies. The workflow segments tissues into coarse tissue classes. Handcrafted and deep features were extracted from these tissues and combined using a soft attention model to predict several slide-level labels: delayed graft function (DGF), acute tubular injury (ATI), and Remuzzi grade components. A tissue segmentation quality metric was also developed to reduce the adverse impact of poorly segmented instances. The soft attention model was trained using 5-fold cross-validation on a mixed dataset and tested on the QUOD dataset containing n = 373 PAS and n = 195 SR biopsies. The average ROC-AUC over different prediction tasks was found to be 0.598 ± 0.011 , significantly higher than using only ResNet50 ( 0.545 ± 0.012 ), only handcrafted features ( 0.542 ± 0.011 ), and the baseline ( 0.532 ± 0.012 ) of state-of-the-art performance. In conjunction with soft attention, weighting tissues by segmentation quality has led to further improvement ( A U C = 0.618 ± 0.010 ) . Using an intuitive visualisation scheme, we show that our approach may also be used to support clinical decision making as it allows pinpointing individual tissues relevant to the predictions.

Reproducibility and prognostic ability of chronicity parameters in kidney biopsy - Comprehensive evaluation comparing microscopy and artificial intelligence in digital pathology

INTRODUCTION

Semi-quantitative scoring of various parameters in renal biopsy is accepted as an important tool to assess disease activity and prognostication. There are concerns on the impact of interobserver variability in its prognostic utility, generating a need for computerized quantification.

METHODS

We studied 94 patients with renal biopsies, 45 with native diseases and 49 transplant patients with index biopsies for Polyomavirus nephropathy. Chronicity scores were evaluated using two methods. A standard definition diagram was agreed after international consultation and four renal pathologists scored each parameter in a double-blinded manner. Interstitial fibrosis (IF) score was assessed with five different computerized and AI-based algorithms on trichrome and PAS stains.

RESULTS

There was strong prognostic correlation with renal function and graft outcome at a median follow-up ranging from 24 to 42 months respectively, independent of moderate concordance for pathologists scores. IF scores with two of the computerized algorithms showed significant correlation with estimated glomerular filtration rate (eGFR) at biopsy but not at the end of follow-up. There was poor concordance for AI based platforms.

CONCLUSION

Chronicity scores are robust prognostic tools despite interobserver reproducibility. AI-algorithms have absolute precision but are limited by significant variation when different hardware and software algorithms are used for quantification.

Exploring the single-cell immune landscape of kidney allograft inflammation using imaging mass cytometry

Kidney allograft inflammation, mostly attributed to rejection and infection, is an important cause of graft injury and loss. Standard histopathological assessment of allograft inflammation provides limited insights into biological processes and the immune landscape. Here, using imaging mass cytometry with a panel of 28 validated biomarkers, we explored the single-cell landscape of kidney allograft inflammation in 32 kidney transplant biopsies and 247 high-dimensional histopathology images of various phenotypes of allograft inflammation (antibody-mediated rejection, T cell-mediated rejection, BK nephropathy, and chronic pyelonephritis). Using novel analytical tools, for cell segmentation, we segmented over 900 000 cells and developed a tissue-based classifier using over 3000 manually annotated kidney microstructures (glomeruli, tubules, interstitium, and arteries). Using PhenoGraph, we identified 11 immune and 9 nonimmune clusters and found a high prevalence of memory T cell and macrophage-enriched immune populations across phenotypes. Additionally, we trained a machine learning classifier to identify spatial biomarkers that could discriminate between the different allograft inflammatory phenotypes. Further validation of imaging mass cytometry in larger cohorts and with more biomarkers will likely help interrogate kidney allograft inflammation in more depth than has been possible to date.

Prediction of immunotherapy response in idiopathic membranous nephropathy using deep learning-pathological and clinical factors

Background

Owing to individual heterogeneity, patients with idiopathic membranous nephropathy (IMN) exhibit varying sensitivities to immunotherapy. This study aimed to establish and validate a model incorporating pathological and clinical features using deep learning training to evaluate the response of patients with IMN to immunosuppressive therapy.

Methods

The 291 patients were randomly categorized into training (n = 219) and validation (n = 72) cohorts. Patch-level convolutional neural network training in a weakly supervised manner was utilized to analyze whole-slide histopathological features. We developed a machine-learning model to assess the predictive value of pathological signatures compared to clinical factors. The performance levels of the models were evaluated using the area under the receiver operating characteristic curve (AUC) on the training and validation tests, and the prediction accuracies of the models for immunotherapy response were compared.

Results

Multivariate analysis indicated that diabetes and smoking were independent risk factors affecting the response to immunotherapy in IMN patients. The model integrating pathologic features had a favorable predictive value for determining the response to immunotherapy in IMN patients, with AUCs of 0.85 and 0.77 when employed in the training and test cohorts, respectively. However, when incorporating clinical features into the model, the predictive efficacy diminishes, as evidenced by lower AUC values of 0.75 and 0.62 on the training and testing cohorts, respectively.

Conclusions

The model incorporating pathological signatures demonstrated a superior predictive ability for determining the response to immunosuppressive therapy in IMN patients compared to the integration of clinical factors.

[Advances in computational quantitative nephropathology]

BACKGROUND

Semiquantitative histological scoring systems are frequently used in nephropathology. In computational nephropathology, the focus is on generating quantitative data from histology (so-called pathomics). Several recent studies have collected such data using next-generation morphometry (NGM) based on segmentations by artificial neural networks and investigated their usability for various clinical or diagnostic purposes.

AIM

To present an overview of the current state of studies regarding renal pathomics and to identify current challenges and potential solutions.

MATERIALS AND METHODS

Due to the literature restriction (maximum of 30 references), studies were selected based on a database search that processed as much data as possible, used innovative methodologies, and/or were ideally multicentric in design.

RESULTS AND DISCUSSION

Pathomics studies in the kidney have impressively demonstrated that morphometric data are useful clinically (for example, for prognosis assessment) and translationally. Further development of NGM requires overcoming some challenges, including better standardization and generation of prospective evidence.

Association of Implantation Biopsy Findings in Living Donor Kidneys With Donor and Recipient Outcomes

RATIONALE & OBJECTIVE

Some living donor kidneys are found to have biopsy evidence of chronic scarring and/or glomerular disease at implantation, but it is unclear if these biopsy findings help predict donor kidney recovery or allograft outcomes. Our objective was to identify the prevalence of chronic histological changes and glomerular disease in donor kidneys, and their association with donor and recipient outcomes.

STUDY DESIGN

Retrospective cohort study.

SETTING & PARTICIPANTS

Single center, living donor kidney transplants from January 2010 to July 2022.

EXPOSURE

Chronic histological changes, glomerular disease in donor kidney implantation biopsies.

OUTCOME

For donors, single-kidney estimated glomerular filtration rate (eGFR) increase, percent total eGFR loss, ≥40% eGFR decline from predonation baseline, and eGFR<60mL/min/1.73m2 at 6 months after donation; for recipients, death-censored allograft survival.

ANALYTICAL APPROACH

Biopsies were classified as having possible glomerular disease by pathologist diagnosis or chronic changes based on the percentage of glomerulosclerosis, interstitial fibrosis/tubular atrophy, and vascular disease. We used logistic regression to identify factors associated with the presence of chronic changes, linear regression to identify the association between chronic changes and single-kidney estimated glomerular filtration rate (eGFR) recovery, and time-to-event analyses to identify the relationship between abnormal biopsy findings and allograft outcomes.

RESULTS

Among 1,104 living donor kidneys, 155 (14%) had advanced chronic changes on implantation biopsy, and 12 (1%) had findings suggestive of possible donor glomerular disease. Adjusted logistic regression showed that age (odds ratio [OR], 2.44 per 10 years [95% CI, 1.98-3.01), Hispanic ethnicity (OR, 1.87 [95% CI, 1.15-3.05), and hypertension (OR, 1.92 [95% CI, 1.01-3.64), were associated with higher odds of chronic changes on implantation biopsy. Adjusted linear regression showed no association of advanced chronic changes with single-kidney eGFR increase or relative risk of eGFR<60mL/min/1.73m2. There were no differences in time-to-death-censored allograft failure in unadjusted or adjusted Cox proportional hazards models when comparing kidneys with chronic changes to kidneys without histological abnormalities.

LIMITATIONS

Retrospective, absence of measured GFR.

CONCLUSIONS

Approximately 1 in 7 living donor kidneys had chronic changes on implantation biopsy, primarily in the form of moderate vascular disease, and 1% had possible donor glomerular disease. Abnormal implantation biopsy findings were not significantly associated with 6-month donor eGFR outcomes or allograft survival.

PLAIN-LANGUAGE SUMMARY

Kidney biopsies are the gold standard test to identify the presence or absence of kidney disease. However, kidneys donated by healthy living donors-who are extensively screened for any evidence of kidney disease before donation-occasionally show findings that might be considered "abnormal," including the presence of scarring in the kidney or findings suggestive of a primary kidney disease. We studied the frequency of abnormal kidney biopsy findings among living donors at our center. We found that about 14% of kidneys had chronic abnormalities and 1% had findings suggesting possible glomerular kidney disease, but the presence of abnormal biopsy findings was not associated with worse outcomes for the donors or their recipients.

Precision Medicine in Nephrology: An Integrative Framework of Multidimensional Data in the Kidney Precision Medicine Project

Chronic kidney disease (CKD) and acute kidney injury (AKI) are heterogeneous syndromes defined clinically by serial measures of kidney function. Each condition possesses strong histopathologic associations, including glomerular obsolescence or acute tubular necrosis, respectively. Despite such characterization, there remains wide variation in patient outcomes and treatment responses. Precision medicine efforts, as exemplified by the Kidney Precision Medicine Project (KPMP), have begun to establish evolving, spatially anchored, cellular and molecular atlases of the cell types, states, and niches of the kidney in health and disease. The KPMP atlas provides molecular context for CKD and AKI disease drivers and will help define subtypes of disease that are not readily apparent from canonical functional or histopathologic characterization but instead are appreciable through advanced clinical phenotyping, pathomic, transcriptomic, proteomic, epigenomic, and metabolomic interrogation of kidney biopsy samples. This perspective outlines the structure of the KPMP, its approach to the integration of these diverse datasets, and its major outputs relevant to future patient care.

DEPICTER: Deep representation clustering for histology annotation

Automatic segmentation of histopathology whole-slide images (WSI) usually involves supervised training of deep learning models with pixel-level labels to classify each pixel of the WSI into tissue regions such as benign or cancerous. However, fully supervised segmentation requires large-scale data manually annotated by experts, which can be expensive and time-consuming to obtain. Non-fully supervised methods, ranging from semi-supervised to unsupervised, have been proposed to address this issue and have been successful in WSI segmentation tasks. But these methods have mainly been focused on technical advancements in algorithmic performance rather than on the development of practical tools that could be used by pathologists or researchers in real-world scenarios. In contrast, we present DEPICTER (Deep rEPresentatIon ClusTERing), an interactive segmentation tool for histopathology annotation that produces a patch-wise dense segmentation map at WSI level. The interactive nature of DEPICTER leverages self- and semi-supervised learning approaches to allow the user to participate in the segmentation producing reliable results while reducing the workload. DEPICTER consists of three steps: first, a pretrained model is used to compute embeddings from image patches. Next, the user selects a number of benign and cancerous patches from the multi-resolution image. Finally, guided by the deep representations, label propagation is achieved using our novel seeded iterative clustering method or by directly interacting with the embedding space via feature space gating. We report both real-time interaction results with three pathologists and evaluate the performance on three public cancer classification dataset benchmarks through simulations. The code and demos of DEPICTER are publicly available at https://github.com/eduardchelebian/depicter.

The Banff 2022 Kidney Meeting Work Plan: Data-driven refinement of the Banff Classification for renal allografts

The XVIth Banff Meeting for Allograft Pathology was held in Banff, Alberta, Canada, from September 19 to 23, 2022, as a joint meeting with the Canadian Society of Transplantation. In addition to a key focus on the impact of microvascular inflammation and biopsy-based transcript analysis on the Banff Classification, further sessions were devoted to other aspects of kidney transplant pathology, in particular T cell-mediated rejection, activity and chronicity indices, digital pathology, xenotransplantation, clinical trials, and surrogate endpoints. Although the output of these sessions has not led to any changes in the classification, the key role of Banff Working Groups in phrasing unanswered questions, and coordinating and disseminating results of investigations addressing these unanswered questions was emphasized. This paper summarizes the key Banff Meeting 2022 sessions not covered in the Banff Kidney Meeting 2022 Report paper and also provides an update on other Banff Working Group activities relevant to kidney allografts.

Recent Advances in Endoscopic Ultrasound for Gallbladder Disease Diagnosis

Gallbladder (GB) disease is classified into two broad categories: GB wall-thickening and protuberant lesions, which include various lesions, such as adenomyomatosis, cholecystitis, GB polyps, and GB carcinoma. This review summarizes recent advances in the differential diagnosis of GB lesions, focusing primarily on endoscopic ultrasound (EUS) and related technologies. Fundamental B-mode EUS and contrast-enhanced harmonic EUS (CH-EUS) have been reported to be useful for the diagnosis of GB diseases because they can evaluate the thickening of the GB wall and protuberant lesions in detail. We also outline the current status of EUS-guided fine-needle aspiration (EUS-FNA) for GB lesions, as there have been scattered reports on EUS-FNA in recent years. Furthermore, artificial intelligence (AI) technologies, ranging from machine learning to deep learning, have become popular in healthcare for disease diagnosis, drug discovery, drug development, and patient risk identification. In this review, we outline the current status of AI in the diagnosis of GB.

A large-scale retrospective study enabled deep-learning based pathological assessment of frozen procurement kidney biopsies to predict graft loss and guide organ utilization

Lesion scores on procurement donor biopsies are commonly used to guide organ utilization for deceased-donor kidneys. However, frozen sections present challenges for histological scoring, leading to inter- and intra-observer variability and inappropriate discard. Therefore, we constructed deep-learning based models to recognize kidney tissue compartments in hematoxylin & eosin-stained sections from procurement needle biopsies performed nationwide in years 2011-2020. To do this, we extracted whole-slide abnormality features from 2431 kidneys and correlated with pathologists' scores and transplant outcomes. A Kidney Donor Quality Score (KDQS) was derived and used in combination with recipient demographic and peri-transplant characteristics to predict graft loss or assist organ utilization. The performance on wedge biopsies was additionally evaluated. Our model identified 96% and 91% of normal/sclerotic glomeruli respectively; 94% of arteries/arterial intimal fibrosis; 90% of tubules. Whole-slide features of Sclerotic Glomeruli (GS)%, Arterial Intimal Fibrosis (AIF)%, and Interstitial Space Abnormality (ISA)% demonstrated strong correlations with corresponding pathologists' scores of all 2431 kidneys, but had superior associations with post-transplant estimated glomerular filtration rates in 2033 and graft loss in 1560 kidneys. The combination of KDQS and other factors predicted one- and four-year graft loss in a discovery set of 520 kidneys and a validation set of 1040 kidneys. By using the composite KDQS of 398 discarded kidneys due to "biopsy findings", we suggest that if transplanted, 110 discarded kidneys could have had similar survival to that of other transplanted kidneys. Thus, our composite KDQS and survival prediction models may facilitate risk stratification and organ utilization while potentially reducing unnecessary organ discard.

Artificial intelligence-assisted quantification and assessment of whole slide images for pediatric kidney disease diagnosis

MOTIVATION

Pediatric kidney disease is a widespread, progressive condition that severely impacts growth and development of children. Chronic kidney disease is often more insidious in children than in adults, usually requiring a renal biopsy for diagnosis. Biopsy evaluation requires copious examination by trained pathologists, which can be tedious and prone to human error. In this study, we propose an artificial intelligence (AI) method to assist pathologists in accurate segmentation and classification of pediatric kidney structures, named as AI-based Pediatric Kidney Diagnosis (APKD).

RESULTS

We collected 2935 pediatric patients diagnosed with kidney disease for the development of APKD. The dataset comprised 93 932 histological structures annotated manually by three skilled nephropathologists. APKD scored an average accuracy of 94% for each kidney structure category, including 99% in the glomerulus. We found strong correlation between the model and manual detection in detected glomeruli (Spearman correlation coefficient r = 0.98, P < .001; intraclass correlation coefficient ICC = 0.98, 95% CI = 0.96-0.98). Compared to manual detection, APKD was approximately 5.5 times faster in segmenting glomeruli. Finally, we show how the pathological features extracted by APKD can identify focal abnormalities of the glomerular capillary wall to aid in the early diagnosis of pediatric kidney disease.

AVAILABILITY AND IMPLEMENTATION

https://github.com/ChunyueFeng/Kidney-DataSet.

Deep learning links localized digital pathology phenotypes with transcriptional subtype and patient outcome in glioblastoma

BACKGROUND

Deep learning has revolutionized medical image analysis in cancer pathology, where it had a substantial clinical impact by supporting the diagnosis and prognostic rating of cancer. Among the first available digital resources in the field of brain cancer is glioblastoma, the most common and fatal brain cancer. At the histologic level, glioblastoma is characterized by abundant phenotypic variability that is poorly linked with patient prognosis. At the transcriptional level, 3 molecular subtypes are distinguished with mesenchymal-subtype tumors being associated with increased immune cell infiltration and worse outcome.

RESULTS

We address genotype-phenotype correlations by applying an Xception convolutional neural network to a discovery set of 276 digital hematozylin and eosin (H&E) slides with molecular subtype annotation and an independent The Cancer Genome Atlas-based validation cohort of 178 cases. Using this approach, we achieve high accuracy in H&E-based mapping of molecular subtypes (area under the curve for classical, mesenchymal, and proneural = 0.84, 0.81, and 0.71, respectively; P < 0.001) and regions associated with worse outcome (univariable survival model P < 0.001, multivariable P = 0.01). The latter were characterized by higher tumor cell density (P < 0.001), phenotypic variability of tumor cells (P < 0.001), and decreased T-cell infiltration (P = 0.017).

CONCLUSIONS

We modify a well-known convolutional neural network architecture for glioblastoma digital slides to accurately map the spatial distribution of transcriptional subtypes and regions predictive of worse outcome, thereby showcasing the relevance of artificial intelligence-enabled image mining in brain cancer.

Time for a full digital approach in nephropathology: a systematic review of current artificial intelligence applications and future directions

INTRODUCTION

Artificial intelligence (AI) integration in nephropathology has been growing rapidly in recent years, facing several challenges including the wide range of histological techniques used, the low occurrence of certain diseases, and the need for data sharing. This narrative review retraces the history of AI in nephropathology and provides insights into potential future developments.

METHODS

Electronic searches in PubMed-MEDLINE and Embase were made to extract pertinent articles from the literature. Works about automated image analysis or the application of an AI algorithm on non-neoplastic kidney histological samples were included and analyzed to extract information such as publication year, AI task, and learning type. Prepublication servers and reviews were not included.

RESULTS

Seventy-six (76) original research articles were selected. Most of the studies were conducted in the United States in the last 7 years. To date, research has been mainly conducted on relatively easy tasks, like single-stain glomerular segmentation. However, there is a trend towards developing more complex tasks such as glomerular multi-stain classification.

CONCLUSION

Deep learning has been used to identify patterns in complex histopathology data and looks promising for the comprehensive assessment of renal biopsy, through the use of multiple stains and virtual staining techniques. Hybrid and collaborative learning approaches have also been explored to utilize large amounts of unlabeled data. A diverse team of experts, including nephropathologists, computer scientists, and clinicians, is crucial for the development of AI systems for nephropathology. Collaborative efforts among multidisciplinary experts result in clinically relevant and effective AI tools.

Application of cloud server-based machine learning for assisting pathological structure recognition in IgA nephropathy

BACKGROUND

Machine learning (ML) models can help assisting diagnosis by rapidly localising and classifying regions of interest (ROIs) within whole slide images (WSIs). Effective ML models for clinical decision support require a substantial dataset of 'real' data, and in reality, it should be robust, user-friendly and universally applicable.

METHODS

WSIs of primary IgAN were collected and annotated. The H-AI-L algorithm which could facilitate direct WSI viewing and potential ROI detection for clinicians was built on the cloud server of matpool, a shared internet-based service platform. Model performance was evaluated using F1-score, precision, recall and Matthew's correlation coefficient (MCC).

RESULTS

The F1-score of glomerular localisation in WSIs was 0.85 and 0.89 for the initial and pretrained models, respectively, with corresponding recall values of 0.79 and 0.83, and precision scores of 0.92 and 0.97. Dichotomous differentiation between global sclerotic (GS) and other glomeruli revealed F1-scores of 0.70 and 0.91, and MCC values of 0.55 and 0.87, for the initial and pretrained models, respectively. The overall F1-score of multiclassification was 0.81 for the pretrained models. The total glomerular recall rate was 0.96, with F1-scores of 0.68, 0.56 and 0.26 for GS, segmental glomerulosclerosis and crescent (C), respectively. Interstitial fibrosis/tubular atrophy lesion similarity between the true label and model predictions was 0.75.

CONCLUSIONS

Our results underscore the efficacy of the ML integration algorithm in segmenting ROIs in IgAN WSIs, and the internet-based model deployment is in favour of widespread adoption and utilisation across multiple centres and increased volumes of WSIs.

Artificial intelligence: a new field of knowledge for nephrologists?

Artificial intelligence (AI) is a science that involves creating machines that can imitate human intelligence and learn. AI is ubiquitous in our daily lives, from search engines like Google to home assistants like Alexa and, more recently, OpenAI with its chatbot. AI can improve clinical care and research, but its use requires a solid understanding of its fundamentals, the promises and perils of algorithmic fairness, the barriers and solutions to its clinical implementation, and the pathways to developing an AI-competent workforce. The potential of AI in the field of nephrology is vast, particularly in the areas of diagnosis, treatment and prediction. One of the most significant advantages of AI is the ability to improve diagnostic accuracy. Machine learning algorithms can be trained to recognize patterns in patient data, including lab results, imaging and medical history, in order to identify early signs of kidney disease and thereby allow timely diagnoses and prompt initiation of treatment plans that can improve outcomes for patients. In short, AI holds the promise of advancing personalized medicine to new levels. While AI has tremendous potential, there are also significant challenges to its implementation, including data access and quality, data privacy and security, bias, trustworthiness, computing power, AI integration and legal issues. The European Commission's proposed regulatory framework for AI technology will play a significant role in ensuring the safe and ethical implementation of these technologies in the healthcare industry. Training nephrologists in the fundamentals of AI is imperative because traditionally, decision-making pertaining to the diagnosis, prognosis and treatment of renal patients has relied on ingrained practices, whereas AI serves as a powerful tool for swiftly and confidently synthesizing this information.

Pathologist Computer-Aided Diagnostic Scoring of Tumor Cell Fraction: A Swiss National Study

Tumor cell fraction (TCF) estimation is a common clinical task with well-established large interobserver variability. It thus provides an ideal test bed to evaluate potential impacts of employing a tumor cell fraction computer-aided diagnostic (TCFCAD) tool to support pathologists' evaluation. During a National Slide Seminar event, pathologists (n = 69) were asked to visually estimate TCF in 10 regions of interest (ROIs) from hematoxylin and eosin colorectal cancer images intentionally curated for diverse tissue compositions, cellularity, and stain intensities. Next, they re-evaluated the same ROIs while being provided a TCFCAD-created overlay highlighting predicted tumor vs nontumor cells, together with the corresponding TCF percentage. Participants also reported confidence levels in their assessments using a 5-tier scale, indicating no confidence to high confidence, respectively. The TCF ground truth (GT) was defined by manual cell-counting by experts. When assisted, interobserver variability significantly decreased, showing estimates converging to the GT. This improvement remained even when TCFCAD predictions deviated slightly from the GT. The standard deviation (SD) of the estimated TCF to the GT across ROIs was 9.9% vs 5.8% with TCFCAD (P < .0001). The intraclass correlation coefficient increased from 0.8 to 0.93 (95% CI, 0.65-0.93 vs 0.86-0.98), and pathologists stated feeling more confident when aided (3.67 ± 0.81 vs 4.17 ± 0.82 with the computer-aided diagnostic [CAD] tool). TCFCAD estimation support demonstrated improved scoring accuracy, interpathologist agreement, and scoring confidence. Interestingly, pathologists also expressed more willingness to use such a CAD tool at the end of the survey, highlighting the importance of training/education to increase adoption of CAD systems.

Development of a multiple convolutional neural network-facilitated diagnostic screening program for immunofluorescence images of IgA nephropathy and idiopathic membranous nephropathy

Background

Immunoglobulin A nephropathy (IgAN) and idiopathic membranous nephropathy (IMN) are the most common glomerular diseases. Immunofluorescence (IF) tests of renal tissues are crucial for the diagnosis. We developed a multiple convolutional neural network (CNN)-facilitated diagnostic program to assist the IF diagnosis of IgAN and IMN.

Methods

The diagnostic program consisted of four parts: a CNN trained as a glomeruli detection module, an IF intensity comparator, dual-CNN (D-CNN) trained as a deposition appearance and location classifier and a post-processing module. A total of 1573 glomerular IF images from 1009 patients with glomerular diseases were used for the training and validation of the diagnostic program. A total of 1610 images of 426 patients from different hospitals were used as test datasets. The performance of the diagnostic program was compared with nephropathologists.

Results

In >90% of the tested images, the glomerulus location module achieved an intersection over union >0.8. The accuracy of the D-CNN in recognizing irregular granular mesangial deposition and fine granular deposition along the glomerular basement membrane was 96.1% and 93.3%, respectively. As for the diagnostic program, the accuracy, sensitivity and specificity of diagnosing suspected IgAN were 97.6%, 94.4% and 96.0%, respectively. The accuracy, sensitivity and specificity of diagnosing suspected IMN were 91.7%, 88.9% and 95.8%, respectively. The corresponding areas under the curve (AUCs) were 0.983 and 0.935. When tested with images from the outside hospital, the diagnostic program showed stable performance. The AUCs for diagnosing suspected IgAN and IMN were 0.972 and 0.948, respectively. Compared with inexperienced nephropathologists, the program showed better performance.

Conclusion

The proposed diagnostic program could assist the IF diagnosis of IgAN and IMN.

Automated evaluation with deep learning of total interstitial inflammation and peritubular capillaritis on kidney biopsies

BACKGROUND

Interstitial inflammation and peritubular capillaritis are observed in many diseases on native and transplant kidney biopsies. A precise and automated evaluation of these histological criteria could help stratify patients' kidney prognoses and facilitate therapeutic management.

METHODS

We used a convolutional neural network to evaluate those criteria on kidney biopsies. A total of 423 kidney samples from various diseases were included; 83 kidney samples were used for the neural network training, 106 for comparing manual annotations on limited areas to automated predictions, and 234 to compare automated and visual gradings.

RESULTS

The precision, recall and F-score for leukocyte detection were, respectively, 81%, 71% and 76%. Regarding peritubular capillaries detection the precision, recall and F-score were, respectively, 82%, 83% and 82%. There was a strong correlation between the predicted and observed grading of total inflammation, as for the grading of capillaritis (r = 0.89 and r = 0.82, respectively, all P < .0001). The areas under the receiver operating characteristics curves for the prediction of pathologists' Banff total inflammation (ti) and peritubular capillaritis (ptc) scores were respectively all above 0.94 and 0.86. The kappa coefficients between the visual and the neural networks' scores were respectively 0.74, 0.78 and 0.68 for ti ≥1, ti ≥2 and ti ≥3, and 0.62, 0.64 and 0.79 for ptc ≥1, ptc ≥2 and ptc ≥3. In a subgroup of patients with immunoglobulin A nephropathy, the inflammation severity was highly correlated to kidney function at biopsy on univariate and multivariate analyses.

CONCLUSION

We developed a tool using deep learning that scores the total inflammation and capillaritis, demonstrating the potential of artificial intelligence in kidney pathology.

Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments

The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.

A Spatially Guided Machine-Learning Method to Classify and Quantify Glomerular Patterns of Injury in Histology Images

Introduction The diagnosis of glomerular diseases is primarily based on visual assessment of histologic patterns. Semi-quantitative scoring of active and chronic lesions is often required to assess individual characteristics of the disease. Reproducibility of the visual scoring systems remains debatable, while digital and machine-learning technologies present opportunities to detect, classify and quantify glomerular lesions, also considering their inter- and intraglomerular heterogeneity.

MATERIALS AND METHODS

We performed a cross-validated comparison of three modifications of a convolutional neural network (CNN)-based approach for recognition and intraglomerular quantification of nine main glomerular patterns of injury. Reference values provided by two nephropathologists were used for validation. For each glomerular image, visual attention heatmaps were generated with a probability of class attribution for further intraglomerular quantification. The quality of classifier-produced heatmaps was evaluated by intersection over union metrics (IoU) between predicted and ground truth localization heatmaps.

RESULTS

A proposed spatially guided modification of the CNN classifier achieved the highest glomerular pattern classification accuracies, with area under curve (AUC) values up to 0.981. With regards to heatmap overlap area and intraglomerular pattern quantification, the spatially guided classifier achieved a significantly higher generalized mean IoU value compared to single-multiclass and multiple-binary classifiers.

CONCLUSIONS

We propose a spatially guided CNN classifier that in our experiments reveals the potential to achieve high accuracy for the localization of intraglomerular patterns.

Preparing Data for Artificial Intelligence in Pathology with Clinical-Grade Performance

The pathology is decisive for disease diagnosis but relies heavily on experienced pathologists. In recent years, there has been growing interest in the use of artificial intelligence in pathology (AIP) to enhance diagnostic accuracy and efficiency. However, the impressive performance of deep learning-based AIP in laboratory settings often proves challenging to replicate in clinical practice. As the data preparation is important for AIP, the paper has reviewed AIP-related studies in the PubMed database published from January 2017 to February 2022, and 118 studies were included. An in-depth analysis of data preparation methods is conducted, encompassing the acquisition of pathological tissue slides, data cleaning, screening, and subsequent digitization. Expert review, image annotation, dataset division for model training and validation are also discussed. Furthermore, we delve into the reasons behind the challenges in reproducing the high performance of AIP in clinical settings and present effective strategies to enhance AIP's clinical performance. The robustness of AIP depends on a randomized collection of representative disease slides, incorporating rigorous quality control and screening, correction of digital discrepancies, reasonable annotation, and sufficient data volume. Digital pathology is fundamental in clinical-grade AIP, and the techniques of data standardization and weakly supervised learning methods based on whole slide image (WSI) are effective ways to overcome obstacles of performance reproduction. The key to performance reproducibility lies in having representative data, an adequate amount of labeling, and ensuring consistency across multiple centers. Digital pathology for clinical diagnosis, data standardization and the technique of WSI-based weakly supervised learning will hopefully build clinical-grade AIP.

"Hi, how can i help you?": embracing artificial intelligence in kidney research

In recent years, biology and precision medicine have benefited from major advancements in generating large-scale molecular and biomedical datasets and in analyzing those data using advanced machine learning algorithms. Machine learning applications in kidney physiology and pathophysiology include segmenting kidney structures from imaging data and predicting conditions like acute kidney injury or chronic kidney disease using electronic health records. Despite the potential of machine learning to revolutionize nephrology by providing innovative diagnostic and therapeutic tools, its adoption in kidney research has been slower than in other organ systems. Several factors contribute to this underutilization. The complexity of the kidney as an organ, with intricate physiology and specialized cell populations, makes it challenging to extrapolate bulk omics data to specific processes. In addition, kidney diseases often present with overlapping manifestations and morphological changes, making diagnosis and treatment complex. Moreover, kidney diseases receive less funding compared with other pathologies, leading to lower awareness and limited public-private partnerships. To promote the use of machine learning in kidney research, this review provides an introduction to machine learning and reviews its notable applications in renal research, such as morphological analysis, omics data examination, and disease diagnosis and prognosis. Challenges and limitations associated with data-driven predictive techniques are also discussed. The goal of this review is to raise awareness and encourage the kidney research community to embrace machine learning as a powerful tool that can drive advancements in understanding kidney diseases and improving patient care.

Evolution of human kidney allograft pathology diagnostics through 30 years of the Banff classification process

The second half of the previous century witnessed a tremendous rise in the number of clinical kidney transplants worldwide. This activity was, however, accompanied by many issues and challenges. An accurate diagnosis and appropriate management of causes of graft dysfunction were and still are, a big challenge. Kidney allograft biopsy played a vital role in addressing the above challenge. However, its interpretation was not standardized for many years until, in 1991, the Banff process was started to fill this void. Thereafter, regular Banff meetings took place every 2 years for the past 30 years. Marked changes have taken place in the interpretation of kidney allograft biopsies, diagnosis, and classification of rejection and other non-rejection pathologies from the original Banff 93 classification. This review attempts to summarize those changes for increasing the awareness and understanding of kidney allograft pathology through the eyes of the Banff process. It will interest the transplant surgeons, physicians, pathologists, and allied professionals associated with the care of kidney transplant patients.

Quantifying acute kidney injury in an Ischaemia-Reperfusion Injury mouse model using deep-learning-based semantic segmentation in histology

This study focuses on ischaemia-reperfusion injury (IRI) in kidneys, a cause of acute kidney injury (AKI) and end-stage kidney disease (ESKD). Traditional kidney damage assessment methods are semi-quantitative and subjective. This study aims to use a convolutional neural network (CNN) to segment murine kidney structures after IRI, quantify damage via CNN-generated pathological measurements, and compare this to conventional scoring. The CNN was able to accurately segment the different pathological classes, such as Intratubular casts and Tubular necrosis, with an F1 score of over 0.75. Some classes, such as Glomeruli and Proximal tubules, had even higher statistical values with F1 scores over 0.90. The scoring generated based on the segmentation approach statistically correlated with the semiquantitative assessment (Spearman's rank correlation coefficient=0.94). The heatmap approach localised the intratubular necrosis mainly in the outer stripe of the outer medulla, while the tubular casts were also present in more superficial or deeper portions of the cortex and medullary areas. This study presents a CNN model capable of segmenting multiple classes of interest, including acute IRI-specific pathological changes, in a whole mouse kidney section and can provide insights into the distribution of pathological classes within the whole mouse kidney section.

Artificial Intelligence Advances in Transplant Pathology

Transplant pathology plays a critical role in ensuring that transplanted organs function properly and the immune systems of the recipients do not reject them. To improve outcomes for transplant recipients, accurate diagnosis and timely treatment are essential. Recent advances in artificial intelligence (AI)-empowered digital pathology could help monitor allograft rejection and weaning of immunosuppressive drugs. To explore the role of AI in transplant pathology, we conducted a systematic search of electronic databases from January 2010 to April 2023. The PRISMA checklist was used as a guide for screening article titles, abstracts, and full texts, and we selected articles that met our inclusion criteria. Through this search, we identified 68 articles from multiple databases. After careful screening, only 14 articles were included based on title and abstract. Our review focuses on the AI approaches applied to four transplant organs: heart, lungs, liver, and kidneys. Specifically, we found that several deep learning-based AI models have been developed to analyze digital pathology slides of biopsy specimens from transplant organs. The use of AI models could improve clinicians' decision-making capabilities and reduce diagnostic variability. In conclusion, our review highlights the advancements and limitations of AI in transplant pathology. We believe that these AI technologies have the potential to significantly improve transplant outcomes and pave the way for future advancements in this field.

Identification of lymph node metastasis in pre-operation cervical cancer patients by weakly supervised deep learning from histopathological whole-slide biopsy images

BACKGROUND

Lymph node metastasis (LNM) significantly impacts the prognosis of individuals diagnosed with cervical cancer, as it is closely linked to disease recurrence and mortality, thereby impacting therapeutic schedule choices for patients. However, accurately predicting LNM prior to treatment remains challenging. Consequently, this study seeks to utilize digital pathological features extracted from histopathological slides of primary cervical cancer patients to preoperatively predict the presence of LNM.

METHODS

A deep learning (DL) model was trained using the Vision transformer (ViT) and recurrent neural network (RNN) frameworks to predict LNM. This prediction was based on the analysis of 554 histopathological whole-slide images (WSIs) obtained from Qilu Hospital of Shandong University. To validate the model's performance, an external test was conducted using 336 WSIs from four other hospitals. Additionally, the efficiency of the DL model was evaluated using 190 cervical biopsies WSIs in a prospective set.

RESULTS

In the internal test set, our DL model achieved an area under the curve (AUC) of 0.919, with sensitivity and specificity values of 0.923 and 0.905, respectively, and an accuracy (ACC) of 0.909. The performance of the DL model remained strong in the external test set. In the prospective cohort, the AUC was 0.91, and the ACC was 0.895. Additionally, the DL model exhibited higher accuracy compared to imaging examination in the evaluation of LNM. By utilizing the transformer visualization method, we generated a heatmap that illustrates the local pathological features in primary lesions relevant to LNM.

CONCLUSION

DL-based image analysis has demonstrated efficiency in predicting LNM in early operable cervical cancer through the utilization of biopsies WSI. This approach has the potential to enhance therapeutic decision-making for patients diagnosed with cervical cancer.

Machine learning in computational histopathology: Challenges and opportunities

Digital histopathological images, high-resolution images of stained tissue samples, are a vital tool for clinicians to diagnose and stage cancers. The visual analysis of patient state based on these images are an important part of oncology workflow. Although pathology workflows have historically been conducted in laboratories under a microscope, the increasing digitization of histopathological images has led to their analysis on computers in the clinic. The last decade has seen the emergence of machine learning, and deep learning in particular, a powerful set of tools for the analysis of histopathological images. Machine learning models trained on large datasets of digitized histopathology slides have resulted in automated models for prediction and stratification of patient risk. In this review, we provide context for the rise of such models in computational histopathology, highlight the clinical tasks they have found success in automating, discuss the various machine learning techniques that have been applied to this domain, and underscore open problems and opportunities.

Artificial Intelligence in Healthcare: Perception and Reality

Artificial intelligence (AI) has birthed the new "big thing" in modern medicine. It promises to bring about safer and improved care that will be beneficial to patients and become a helpful tool in the hands of a skilled physician. Despite its anticipation, however, the implementation and usage of AI are still in their elementary phases, particularly due to legal and ethical considerations that border on "data." These challenges should not be brushed aside but rather be recognized and resolved to enable acceptance by all relevant stakeholders without prejudice. Once these challenges can be overcome, AI will truly revolutionize the field of medicine with improved diagnostic accuracy, a reduction in physician burnout, and an enhanced treatment modality. It is therefore paramount that AI be embraced by physicians and integrated into medical education in order to be well-prepared for our role in the future of medicine.

Omni-Seg: A Scale-Aware Dynamic Network for Renal Pathological Image Segmentation

Comprehensive semantic segmentation on renal pathological images is challenging due to the heterogeneous scales of the objects. For example, on a whole slide image (WSI), the cross-sectional areas of glomeruli can be 64 times larger than that of the peritubular capillaries, making it impractical to segment both objects on the same patch, at the same scale. To handle this scaling issue, prior studies have typically trained multiple segmentation networks in order to match the optimal pixel resolution of heterogeneous tissue types. This multi-network solution is resource-intensive and fails to model the spatial relationship between tissue types. In this article, we propose the Omni-Seg network, a scale-aware dynamic neural network that achieves multi-object (six tissue types) and multi-scale (5× to 40× scale) pathological image segmentation via a single neural network. The contribution of this article is three-fold: (1) a novel scale-aware controller is proposed to generalize the dynamic neural network from single-scale to multi-scale; (2) semi-supervised consistency regularization of pseudo-labels is introduced to model the inter-scale correlation of unannotated tissue types into a single end-to-end learning paradigm; and (3) superior scale-aware generalization is evidenced by directly applying a model trained on human kidney images to mouse kidney images, without retraining. By learning from 150,000 human pathological image patches from six tissue types at three different resolutions, our approach achieved superior segmentation performance according to human visual assessment and evaluation of image-omics (i.e., spatial transcriptomics).

Tubular and Glomerular Size by Cortex Depth as Predictor of Progressive CKD after Radical Nephrectomy for Tumor

SIGNIFICANCE STATEMENT

Glomerular size differs by cortex depth. Larger nephrons are prognostic of progressive kidney disease, but it is unknown whether this risk differs by cortex depth or by glomeruli versus proximal or distal tubule size. We studied the average minor axis diameter in oval proximal and distal tubules separately and by cortex depth in patients who had radical nephrectomy to remove a tumor from 2019 to 2020. In adjusted analyses, larger glomerular volume in the middle and deep cortex predicted progressive kidney disease. Wider proximal tubular diameter did not predict progressive kidney disease independent of glomerular volume. Wider distal tubular diameter showed a gradient of strength of prediction of progressive kidney disease in the more superficial cortex than in the deep cortex.

BACKGROUND

Larger nephrons are prognostic of progressive kidney disease, but whether this risk differs by nephron segments or by depth in the cortex is unclear.

METHODS

We studied patients who underwent radical nephrectomy for a tumor between 2000 and 2019. Large wedge kidney sections were scanned into digital images. We estimated the diameters of proximal and distal tubules by the minor axis of oval tubular profiles and estimated glomerular volume with the Weibel-Gomez stereological model. Analyses were performed separately in the superficial, middle, and deep cortex. Cox proportional hazard models assessed the risk of progressive CKD (dialysis, kidney transplantation, sustained eGFR <10 ml/min per 1.73 m 2 , or a sustained 40% decline from the postnephrectomy baseline eGFR) with glomerular volume or tubule diameters. At each cortical depth, models were unadjusted, adjusted for glomerular volume or tubular diameter, and further adjusted for clinical characteristics (age, sex, body mass index, hypertension, diabetes, postnephrectomy baseline eGFR, and proteinuria).

RESULTS

Among 1367 patients were 62 progressive CKD events during a median follow-up of 4.5 years. Glomerular volume predicted CKD outcomes at all depths, but only in the middle and deep cortex after adjusted analyses. Proximal tubular diameter also predicted progressive CKD at any depth but not after adjusted analyses. Distal tubular diameter showed a gradient of more strongly predicting progressive CKD in the superficial than deep cortex, even in adjusted analysis.

CONCLUSIONS

Larger glomeruli are independent predictors of progressive CKD in the deeper cortex, whereas in the superficial cortex, wider distal tubular diameters are an independent predictor of progressive CKD.

Artificial Intelligence Assists in the Detection of Blood Vessels in Whole Slide Images: Practical Benefits for Oncological Pathology

The analysis of the microvasculature and the assessment of angiogenesis have significant prognostic value in various diseases, including cancer. The search for invasion into the blood and lymphatic vessels and the assessment of angiogenesis are important aspects of oncological diagnosis. These features determine the prognosis and aggressiveness of the tumor. Traditional manual evaluation methods are time consuming and subject to inter-observer variability. Blood vessel detection is a perfect task for artificial intelligence, which is capable of rapid analyzing thousands of tissue structures in whole slide images. The development of computer vision solutions requires the segmentation of tissue regions, the extraction of features and the training of machine learning models. In this review, we focus on the methodologies employed by researchers to identify blood vessels and vascular invasion across a range of tumor localizations, including breast, lung, colon, brain, renal, pancreatic, gastric and oral cavity cancers. Contemporary models herald a new era of computational pathology in morphological diagnostics.

Histology for nephrology, from pre-implantation to post-transplant kidney biopsy. Lesson learned from ReBIrth (Renal BIopsy for Kidney Transplantation Therapy)

A meeting entitled Renal BIopsy for Kidney Transplantation Therapy (ReBIrth) took place on May 31st, 2022 in Bologna, Italy. The meeting drew together nephrologists, surgeons, and pathologists and recognized as experts in the field of kidney transplantation in Italy. In this paper, we present our experience working with kidney transplants in the current era of immunosuppression therapy. The primary aim is to report the histopathological characteristics of failed kidney allografts after a consensus of experts reviewed the cases on a wholeslide imaging digital platform. Regardless of the cases discussed, digital pathology was reliable in identifying all the morphological and immunohistochemical features required to improve the correct use of immunosuppressive therapy to prevent graft failure and optimize patient management.