1
|
Hosseini MS, Bejnordi BE, Trinh VQH, Chan L, Hasan D, Li X, Yang S, Kim T, Zhang H, Wu T, Chinniah K, Maghsoudlou S, Zhang R, Zhu J, Khaki S, Buin A, Chaji F, Salehi A, Nguyen BN, Samaras D, Plataniotis KN. Computational pathology: A survey review and the way forward. J Pathol Inform 2024; 15:100357. [PMID: 38420608 PMCID: PMC10900832 DOI: 10.1016/j.jpi.2023.100357] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 12/21/2023] [Accepted: 12/23/2023] [Indexed: 03/02/2024] Open
Abstract
Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.
Collapse
Affiliation(s)
- Mahdi S Hosseini
- Department of Computer Science and Software Engineering (CSSE), Concordia Univeristy, Montreal, QC H3H 2R9, Canada
| | | | - Vincent Quoc-Huy Trinh
- Institute for Research in Immunology and Cancer of the University of Montreal, Montreal, QC H3T 1J4, Canada
| | - Lyndon Chan
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Danial Hasan
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Xingwen Li
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Stephen Yang
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Taehyo Kim
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Haochen Zhang
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Theodore Wu
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Kajanan Chinniah
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Sina Maghsoudlou
- Department of Computer Science and Software Engineering (CSSE), Concordia Univeristy, Montreal, QC H3H 2R9, Canada
| | - Ryan Zhang
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Jiadai Zhu
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Samir Khaki
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Andrei Buin
- Huron Digitial Pathology, St. Jacobs, ON N0B 2N0, Canada
| | - Fatemeh Chaji
- Department of Computer Science and Software Engineering (CSSE), Concordia Univeristy, Montreal, QC H3H 2R9, Canada
| | - Ala Salehi
- Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB E3B 5A3, Canada
| | - Bich Ngoc Nguyen
- University of Montreal Hospital Center, Montreal, QC H2X 0C2, Canada
| | - Dimitris Samaras
- Department of Computer Science, Stony Brook University, Stony Brook, NY 11794, United States
| | - Konstantinos N Plataniotis
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| |
Collapse
|
2
|
Liu X, Shi J, Jiao Y, An J, Tian J, Yang Y, Zhuo L. Integrated multi-omics with machine learning to uncover the intricacies of kidney disease. Brief Bioinform 2024; 25:bbae364. [PMID: 39082652 PMCID: PMC11289682 DOI: 10.1093/bib/bbae364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 06/20/2024] [Accepted: 07/17/2024] [Indexed: 08/03/2024] Open
Abstract
The development of omics technologies has driven a profound expansion in the scale of biological data and the increased complexity in internal dimensions, prompting the utilization of machine learning (ML) as a powerful toolkit for extracting knowledge and understanding underlying biological patterns. Kidney disease represents one of the major growing global health threats with intricate pathogenic mechanisms and a lack of precise molecular pathology-based therapeutic modalities. Accordingly, there is a need for advanced high-throughput approaches to capture implicit molecular features and complement current experiments and statistics. This review aims to delineate strategies for integrating multi-omics data with appropriate ML methods, highlighting key clinical translational scenarios, including predicting disease progression risks to improve medical decision-making, comprehensively understanding disease molecular mechanisms, and practical applications of image recognition in renal digital pathology. Examining the benefits and challenges of current integration efforts is expected to shed light on the complexity of kidney disease and advance clinical practice.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Li Zhuo
- Corresponding author. Department of Nephrology, China-Japan Friendship Hospital, Beijing 100029, China; China-Japan Friendship Clinic Medical College, Beijing University of Chinese Medicine, 100029 Beijing, China. E-mail:
| |
Collapse
|
3
|
Juang CF, Chuang YW, Lin GW, Chung IF, Lo YC. Deep learning-based glomerulus detection and classification with generative morphology augmentation in renal pathology images. Comput Med Imaging Graph 2024; 115:102375. [PMID: 38599040 DOI: 10.1016/j.compmedimag.2024.102375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 02/01/2024] [Accepted: 03/19/2024] [Indexed: 04/12/2024]
Abstract
Glomerulus morphology on renal pathology images provides valuable diagnosis and outcome prediction information. To provide better care, an efficient, standardized, and scalable method is urgently needed to optimize the time-consuming and labor-intensive interpretation process by renal pathologists. This paper proposes a deep convolutional neural network (CNN)-based approach to automatically detect and classify glomeruli with different stains in renal pathology images. In the glomerulus detection stage, this paper proposes a flattened Xception with a feature pyramid network (FX-FPN). The FX-FPN is employed as a backbone in the framework of faster region-based CNN to improve glomerulus detection performance. In the classification stage, this paper considers classifications of five glomerulus morphologies using a flattened Xception classifier. To endow the classifier with higher discriminability, this paper proposes a generative data augmentation approach for patch-based glomerulus morphology augmentation. New glomerulus patches of different morphologies are generated for data augmentation through the cycle-consistent generative adversarial network (CycleGAN). The single detection model shows the F1 score up to 0.9524 in H&E and PAS stains. The classification result shows that the average sensitivity and specificity are 0.7077 and 0.9316, respectively, by using the flattened Xception with the original training data. The sensitivity and specificity increase to 0.7623 and 0.9443, respectively, by using the generative data augmentation. Comparisons with different deep CNN models show the effectiveness and superiority of the proposed approach.
Collapse
Affiliation(s)
- Chia-Feng Juang
- Department of Electrical Engineering, National Chung Hsing University, Taichung 40227, Taiwan, ROC
| | - Ya-Wen Chuang
- Section of Nephrology, Department of Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan, ROC; Graduate Institute of Biomedical Sciences, College of Medicine, China Medical University, Taichung 406040, Taiwan, ROC; School of Medicine, College of Medicine, China Medical University, Taichung 406040, Taiwan, ROC; Department of Post-Baccalaureate Medicine, College of Medicine, National Chung Hsing University, Taichung 40227, Taiwan, ROC
| | - Guan-Wen Lin
- Department of Electrical Engineering, National Chung Hsing University, Taichung 40227, Taiwan, ROC
| | - I-Fang Chung
- Institute of Biomedical Informatics, National Yang Ming Chiao Tung University, Taipei 112304, Taiwan, ROC.
| | - Ying-Chih Lo
- Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA 02115, USA; Harvard Medical School, Boston, MA 02115, USA.
| |
Collapse
|
4
|
Pilva P, Bülow R, Boor P. Deep learning applications for kidney histology analysis. Curr Opin Nephrol Hypertens 2024; 33:291-297. [PMID: 38411024 DOI: 10.1097/mnh.0000000000000973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/28/2024]
Abstract
PURPOSE OF REVIEW Nephropathology is increasingly incorporating computational methods to enhance research and diagnostic accuracy. The widespread adoption of digital pathology, coupled with advancements in deep learning, will likely transform our pathology practices. Here, we discuss basic concepts of deep learning, recent applications in nephropathology, current challenges in implementation and future perspectives. RECENT FINDINGS Deep learning models have been developed and tested in various areas of nephropathology, for example, predicting kidney disease progression or diagnosing diseases based on imaging and clinical data. Despite their promising potential, challenges remain that hinder a wider adoption, for example, the lack of prospective evidence and testing in real-world scenarios. SUMMARY Deep learning offers great opportunities to improve quantitative and qualitative kidney histology analysis for research and clinical nephropathology diagnostics. Although exciting approaches already exist, the potential of deep learning in nephropathology is only at its beginning and we can expect much more to come.
Collapse
Affiliation(s)
| | | | - Peter Boor
- Institute of Pathology
- Department of Nephrology and Clinical Immunology, RWTH Aachen University Hospital, Aachen, Germany
| |
Collapse
|
5
|
Tam KH, Soares MF, Kers J, Sharples EJ, Ploeg RJ, Kaisar M, Rittscher J. Predicting clinical endpoints and visual changes with quality-weighted tissue-based renal histological features. FRONTIERS IN TRANSPLANTATION 2024; 3:1305468. [PMID: 38993786 PMCID: PMC11235227 DOI: 10.3389/frtra.2024.1305468] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 03/15/2024] [Indexed: 07/13/2024]
Abstract
Two common obstacles limiting the performance of data-driven algorithms in digital histopathology classification tasks are the lack of expert annotations and the narrow diversity of datasets. Multi-instance learning (MIL) can address the former challenge for the analysis of whole slide images (WSI), but performance is often inferior to full supervision. We show that the inclusion of weak annotations can significantly enhance the effectiveness of MIL while keeping the approach scalable. An analysis framework was developed to process periodic acid-Schiff (PAS) and Sirius Red (SR) slides of renal biopsies. The workflow segments tissues into coarse tissue classes. Handcrafted and deep features were extracted from these tissues and combined using a soft attention model to predict several slide-level labels: delayed graft function (DGF), acute tubular injury (ATI), and Remuzzi grade components. A tissue segmentation quality metric was also developed to reduce the adverse impact of poorly segmented instances. The soft attention model was trained using 5-fold cross-validation on a mixed dataset and tested on the QUOD dataset containing n = 373 PAS and n = 195 SR biopsies. The average ROC-AUC over different prediction tasks was found to be 0.598 ± 0.011 , significantly higher than using only ResNet50 ( 0.545 ± 0.012 ), only handcrafted features ( 0.542 ± 0.011 ), and the baseline ( 0.532 ± 0.012 ) of state-of-the-art performance. In conjunction with soft attention, weighting tissues by segmentation quality has led to further improvement ( A U C = 0.618 ± 0.010 ) . Using an intuitive visualisation scheme, we show that our approach may also be used to support clinical decision making as it allows pinpointing individual tissues relevant to the predictions.
Collapse
Affiliation(s)
- Ka Ho Tam
- Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| | - Maria F. Soares
- Department of Cellular Pathology, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Oxford, United Kingdom
| | - Jesper Kers
- Department of Pathology, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands
- Department of Pathology, Leiden Transplant Center, Leiden University Medical Center, Leiden, Netherlands
- Van’t Hoff Institute for Molecular Sciences, University of Amsterdam, Amsterdam, Netherlands
| | - Edward J. Sharples
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, United Kingdom
| | - Rutger J. Ploeg
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, United Kingdom
- Research and Development, NHS Blood and Transplant Filton and Oxford, Oxford, United Kingdom
| | - Maria Kaisar
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, United Kingdom
- Research and Development, NHS Blood and Transplant Filton and Oxford, Oxford, United Kingdom
| | - Jens Rittscher
- Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
6
|
Greenberg A, Samueli B, Farkash S, Zohar Y, Ish-Shalom S, Hagege RR, Hershkovitz D. Algorithm-assisted diagnosis of Hirschsprung's disease - evaluation of robustness and comparative image analysis on data from various labs and slide scanners. Diagn Pathol 2024; 19:26. [PMID: 38321431 PMCID: PMC10845737 DOI: 10.1186/s13000-024-01452-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Accepted: 01/25/2024] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND Differences in the preparation, staining and scanning of digital pathology slides create significant pre-analytic variability. Algorithm-assisted tools must be able to contend with this variability in order to be applicable in clinical practice. In a previous study, a decision support algorithm was developed to assist in the diagnosis of Hirschsprung's disease. In the current study, we tested the robustness of this algorithm while assessing for pre-analytic factors which may affect its performance. METHODS The decision support algorithm was used on digital pathology slides obtained from four different medical centers (A-D) and scanned by three different scanner models (by Philips, Hamamatsu and 3DHISTECH). A total of 192 cases and 1782 slides were used in this study. RGB histograms were constructed to compare images from the various medical centers and scanner models and highlight the differences in color and contrast. RESULTS The algorithm was able to correctly identify ganglion cells in 99.2% of cases, from all medical centers (All scanned by the Philips slide scanner) as well as 95.5% and 100% of the slides scanned by the 3DHISTECH and Hamamatsu brand slide scanners, respectively. The total error rate for center D was lower than the other medical centers (3.9% vs 7.1%, 10.8% and 6% for centers A-C, respectively), the vast majority of errors being false positives (3.45% vs 0.45% false negatives). The other medical centers showed a higher rate of false negatives in relation to false positives (6.81% vs 0.29%, 9.8% vs 1.2% and 5.37% vs 0.63% for centers A-C, respectively). The total error rates for the Philips, Hamamatsu and 3DHISTECH brand scanners were 3.9%, 3.2% and 9.8%, respectively. RGB histograms demonstrated significant differences in pixel value distribution between the four medical centers, as well as between the 3DHISTECH brand scanner when compared to the Philips and Hamamatsu brand scanners. CONCLUSIONS The results reported in this paper suggest that the algorithm-based decision support system has sufficient robustness to be applicable for clinical practice. In addition, the novel method used in its development - Hierarchial-Contexual Analysis (HCA) may be applicable to the development of algorithm-assisted tools in other diseases, for which available datasets are limited. Validation of any given algorithm-assisted support system should nonetheless include data from as many medical centers and scanner models as possible.
Collapse
Affiliation(s)
- Ariel Greenberg
- Institute of Pathology, Tel-Aviv Sourasky Medical Center, 6 Weizmann Street, 6423906, Tel Aviv, Israel.
| | - Benzion Samueli
- Department of Pathology, Soroka University Medical Center, 76 Wingate Street, 8486614, Be'er Sheva, Israel
| | - Shai Farkash
- Department of Pathology, Emek Medical Center, Yitshak Rabin Boulevard 21, 1834111, Afula, Israel
| | - Yaniv Zohar
- Department of Pathology, Rambam Medical Center, 8 Haalia Hashnia, 3525408, Haifa, Israel
| | - Shahar Ish-Shalom
- Department of Pathology, Kaplan Medical Center, Pasternak St. P.O.B. 1, 76100, Rehovot, Israel
| | - Rami R Hagege
- Institute of Pathology, Tel-Aviv Sourasky Medical Center, 6 Weizmann Street, 6423906, Tel Aviv, Israel
| | - Dov Hershkovitz
- Institute of Pathology, Tel-Aviv Sourasky Medical Center, 6 Weizmann Street, 6423906, Tel Aviv, Israel
- Sackler Faculty of Medicine, Tel-Aviv University, Ramat Aviv 69978, Tel-Aviv, Israel
| |
Collapse
|
7
|
Yoo D, Divard G, Raynaud M, Cohen A, Mone TD, Rosenthal JT, Bentall AJ, Stegall MD, Naesens M, Zhang H, Wang C, Gueguen J, Kamar N, Bouquegneau A, Batal I, Coley SM, Gill JS, Oppenheimer F, De Sousa-Amorim E, Kuypers DRJ, Durrbach A, Seron D, Rabant M, Van Huyen JPD, Campbell P, Shojai S, Mengel M, Bestard O, Basic-Jukic N, Jurić I, Boor P, Cornell LD, Alexander MP, Toby Coates P, Legendre C, Reese PP, Lefaucheur C, Aubert O, Loupy A. A Machine Learning-Driven Virtual Biopsy System For Kidney Transplant Patients. Nat Commun 2024; 15:554. [PMID: 38228634 DOI: 10.1038/s41467-023-44595-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 12/21/2023] [Indexed: 01/18/2024] Open
Abstract
In kidney transplantation, day-zero biopsies are used to assess organ quality and discriminate between donor-inherited lesions and those acquired post-transplantation. However, many centers do not perform such biopsies since they are invasive, costly and may delay the transplant procedure. We aim to generate a non-invasive virtual biopsy system using routinely collected donor parameters. Using 14,032 day-zero kidney biopsies from 17 international centers, we develop a virtual biopsy system. 11 basic donor parameters are used to predict four Banff kidney lesions: arteriosclerosis, arteriolar hyalinosis, interstitial fibrosis and tubular atrophy, and the percentage of renal sclerotic glomeruli. Six machine learning models are aggregated into an ensemble model. The virtual biopsy system shows good performance in the internal and external validation sets. We confirm the generalizability of the system in various scenarios. This system could assist physicians in assessing organ quality, optimizing allograft allocation together with discriminating between donor derived and acquired lesions post-transplantation.
Collapse
Affiliation(s)
- Daniel Yoo
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
| | - Gillian Divard
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
- Kidney Transplant Department, Saint-Louis Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Marc Raynaud
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
| | | | | | | | - Andrew J Bentall
- Division of Nephrology and Hypertension, Mayo Clinic Transplant Center, Rochester, MN, USA
| | | | - Maarten Naesens
- Department of Microbiology, Immunology and Transplantation, KU Leuven, Leuven, Belgium
| | - Huanxi Zhang
- Organ Transplant Center, First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Changxi Wang
- Organ Transplant Center, First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Juliette Gueguen
- Néphrologie-Immunologie Clinique, Hôpital Bretonneau, CHU Tours, Tours, France
| | - Nassim Kamar
- Department of Nephrology and Organ Transplantation, Paul Sabatier University, INSERM, Toulouse, France
| | - Antoine Bouquegneau
- Department of Nephrology-Dialysis-Transplantation, Centre hospitalier universitaire de Liège, Liège, Belgium
| | - Ibrahim Batal
- Department of Pathology and Cell Biology, Columbia University Medical Center, New York, NY, USA
| | - Shana M Coley
- Department of Pathology and Cell Biology, Columbia University Medical Center, New York, NY, USA
| | - John S Gill
- Division of Nephrology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Federico Oppenheimer
- Kidney Transplant Department, Hospital Clínic i Provincial de Barcelona, Barcelona, Spain
| | - Erika De Sousa-Amorim
- Kidney Transplant Department, Hospital Clínic i Provincial de Barcelona, Barcelona, Spain
| | - Dirk R J Kuypers
- Department of Microbiology, Immunology and Transplantation, KU Leuven, Leuven, Belgium
| | - Antoine Durrbach
- Department of Nephrology, AP-HP Hôpital Henri Mondor, Créteil, Île de France, France
| | - Daniel Seron
- Nephrology Department, Hospital Vall d'Hebrón, Autonomous University of Barcelona, Barcelona, Spain
| | - Marion Rabant
- Department of Pathology, Necker-Enfants Malades Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Jean-Paul Duong Van Huyen
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
- Department of Pathology, Necker-Enfants Malades Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Patricia Campbell
- Faculty of Medicine & Dentistry - Laboratory Medicine & Pathology Dept, University of Alberta, Edmonton, AB, Canada
| | - Soroush Shojai
- Faculty of Medicine & Dentistry - Laboratory Medicine & Pathology Dept, University of Alberta, Edmonton, AB, Canada
| | - Michael Mengel
- Faculty of Medicine & Dentistry - Laboratory Medicine & Pathology Dept, University of Alberta, Edmonton, AB, Canada
| | - Oriol Bestard
- Nephrology Department, Hospital Vall d'Hebrón, Autonomous University of Barcelona, Barcelona, Spain
| | - Nikolina Basic-Jukic
- Department of nephrology, arterial hypertension, dialysis and transplantation, University Hospital Centre Zagreb, Zagreb, Croatia
| | - Ivana Jurić
- Department of nephrology, arterial hypertension, dialysis and transplantation, University Hospital Centre Zagreb, Zagreb, Croatia
| | - Peter Boor
- Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany
| | - Lynn D Cornell
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, USA
| | - Mariam P Alexander
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, USA
| | - P Toby Coates
- Department of Renal and Transplantation, University of Adelaide, Royal Adelaide Hospital Campus, Adelaide, SA, Australia
| | - Christophe Legendre
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
- Department of Kidney Transplantation, Necker-Enfants Malades Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Peter P Reese
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
- Renal-Electrolyte and Hypertension Division, Perelman School of Medicine, University of Pennsylvania, Philadephia, PA, USA
| | - Carmen Lefaucheur
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
- Kidney Transplant Department, Saint-Louis Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Olivier Aubert
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France
- Department of Kidney Transplantation, Necker-Enfants Malades Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France
| | - Alexandre Loupy
- Université Paris Cité, INSERM U970 PARCC, Paris Institute for Transplantation and Organ Regeneration, F-75015, Paris, France.
- Department of Kidney Transplantation, Necker-Enfants Malades Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France.
| |
Collapse
|
8
|
He S, Zou Y, Li B, Peng F, Lu X, Guo H, Tan X, Chen Y. An image inpainting-based data augmentation method for improved sclerosed glomerular identification performance with the segmentation model EfficientNetB3-Unet. Sci Rep 2024; 14:1033. [PMID: 38200109 PMCID: PMC10781987 DOI: 10.1038/s41598-024-51651-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Accepted: 01/08/2024] [Indexed: 01/12/2024] Open
Abstract
The percent global glomerulosclerosis is a key factor in determining the outcome of renal transfer surgery. At present, the rate is typically computed by pathologists, which is labour intensive and nonstandardized. With the development of Deep Learning (DL), DL-based segmentation models can be used to better identify and segment normal and sclerosed glomeruli. Based on this, we can better quantify percent global glomerulosclerosis to reduce the discard rate of donor kidneys. We used 51 whole slide images (WSIs) from different institutions that are publicly available on the internet. However, the number of sclerosed glomeruli is much smaller than that of normal glomeruli in different WSIs, which can reduce the effectiveness of Deep Learning. For better sclerosed glomerular identification and segmentation performance, we modified and trained a GAN (generative adversarial network)-based image inpainting model to obtain more synthetic sclerosed glomeruli. Our proposed inpainting method achieved an average SSIM (Structural Similarity) of 0.8086 and an average PSNR (Peak Signal-to-Noise Ratio) of 22.8943 dB in the area of generated sclerosed glomeruli. We obtained sclerosed glomerular segmentation performance improvement by adding synthetic sclerosed glomerular images and achieved the best Dice of glomerular segmentation in different test sets based on the modified Unet model.
Collapse
Affiliation(s)
- Songping He
- Digital Manufacturing Equipment National Engineering Research Center, Huazhong University of Science and Technology, Wuhan, China
| | - Yi Zou
- National NC System Engineering Research Center, Huazhong University of Science and Technology, Wuhan, China
| | - Bin Li
- Digital Manufacturing Equipment National Engineering Research Center, Huazhong University of Science and Technology, Wuhan, China
| | - Fangyu Peng
- National NC System Engineering Research Center, Huazhong University of Science and Technology, Wuhan, China
| | - Xia Lu
- Key Laboratory of Organ Transplantation of Ministry of Education, Institute of Organ Transplantation, Tongji Hospital, Tongji Medical College, National Health Commission and Chinese Academy of Medical Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Hui Guo
- Key Laboratory of Organ Transplantation of Ministry of Education, Institute of Organ Transplantation, Tongji Hospital, Tongji Medical College, National Health Commission and Chinese Academy of Medical Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Xin Tan
- Wuhan Intelligent Equipment Industrial Institute Co Ltd, Wuhan, China
| | - Yanyan Chen
- Department of Information Management, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.
| |
Collapse
|
9
|
Feng C, Ong K, Young DM, Chen B, Li L, Huo X, Lu H, Gu W, Liu F, Tang H, Zhao M, Yang M, Zhu K, Huang L, Wang Q, Marini GPL, Gui K, Han H, Sanders SJ, Li L, Yu W, Mao J. Artificial intelligence-assisted quantification and assessment of whole slide images for pediatric kidney disease diagnosis. Bioinformatics 2024; 40:btad740. [PMID: 38058211 PMCID: PMC10796177 DOI: 10.1093/bioinformatics/btad740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 11/13/2023] [Accepted: 12/05/2023] [Indexed: 12/08/2023] Open
Abstract
MOTIVATION Pediatric kidney disease is a widespread, progressive condition that severely impacts growth and development of children. Chronic kidney disease is often more insidious in children than in adults, usually requiring a renal biopsy for diagnosis. Biopsy evaluation requires copious examination by trained pathologists, which can be tedious and prone to human error. In this study, we propose an artificial intelligence (AI) method to assist pathologists in accurate segmentation and classification of pediatric kidney structures, named as AI-based Pediatric Kidney Diagnosis (APKD). RESULTS We collected 2935 pediatric patients diagnosed with kidney disease for the development of APKD. The dataset comprised 93 932 histological structures annotated manually by three skilled nephropathologists. APKD scored an average accuracy of 94% for each kidney structure category, including 99% in the glomerulus. We found strong correlation between the model and manual detection in detected glomeruli (Spearman correlation coefficient r = 0.98, P < .001; intraclass correlation coefficient ICC = 0.98, 95% CI = 0.96-0.98). Compared to manual detection, APKD was approximately 5.5 times faster in segmenting glomeruli. Finally, we show how the pathological features extracted by APKD can identify focal abnormalities of the glomerular capillary wall to aid in the early diagnosis of pediatric kidney disease. AVAILABILITY AND IMPLEMENTATION https://github.com/ChunyueFeng/Kidney-DataSet.
Collapse
Affiliation(s)
- Chunyue Feng
- Department of Nephrology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou 310000, China
- National Clinical Research Center for Child Health, Hangzhou 310000, China
| | - Kokhaur Ong
- Bioinformatics Institute, A*STAR, Singapore 138673, Singapore
| | - David M Young
- Institute of Molecular and Cell Biology, A*STAR, Singapore 138673, Singapore
- Department of Psychiatry and Behavioral Sciences, UCSF Weill Institute for Neurosciences, University of California, San Francisco, CA, 94143, United States
| | - Bingxian Chen
- Ningbo Konfoong Bioinformation Tech Co., Ltd., Ningbo 315000, China
| | - Longjie Li
- Bioinformatics Institute, A*STAR, Singapore 138673, Singapore
| | - Xinmi Huo
- Bioinformatics Institute, A*STAR, Singapore 138673, Singapore
| | - Haoda Lu
- Bioinformatics Institute, A*STAR, Singapore 138673, Singapore
- Institute for AI in Medicine, Nanjing University of Information Science and Technology, Nanjing 210044, China
| | - Weizhong Gu
- National Clinical Research Center for Child Health, Hangzhou 310000, China
- Department of Pathology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou, 310000, China
| | - Fei Liu
- Department of Nephrology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou 310000, China
- National Clinical Research Center for Child Health, Hangzhou 310000, China
| | - Hongfeng Tang
- National Clinical Research Center for Child Health, Hangzhou 310000, China
- Department of Pathology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou, 310000, China
| | - Manli Zhao
- National Clinical Research Center for Child Health, Hangzhou 310000, China
- Department of Pathology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou, 310000, China
| | - Min Yang
- National Clinical Research Center for Child Health, Hangzhou 310000, China
- Department of Pathology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou, 310000, China
| | - Kun Zhu
- National Clinical Research Center for Child Health, Hangzhou 310000, China
- Department of Pathology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou, 310000, China
| | - Limin Huang
- Department of Nephrology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou 310000, China
- National Clinical Research Center for Child Health, Hangzhou 310000, China
| | - Qiang Wang
- Ningbo Konfoong Bioinformation Tech Co., Ltd., Ningbo 315000, China
| | | | - Kun Gui
- Ningbo Konfoong Bioinformation Tech Co., Ltd., Ningbo 315000, China
| | - Hao Han
- Institute of Molecular and Cell Biology, A*STAR, Singapore 138673, Singapore
| | - Stephan J Sanders
- Department of Psychiatry and Behavioral Sciences, UCSF Weill Institute for Neurosciences, University of California, San Francisco, CA, 94143, United States
| | - Lin Li
- Department of Nephrology, Shanghai Changzheng Hospital, Naval Medical University, Shanghai 200003, China
| | - Weimiao Yu
- Bioinformatics Institute, A*STAR, Singapore 138673, Singapore
- Institute of Molecular and Cell Biology, A*STAR, Singapore 138673, Singapore
- Institute for AI in Medicine, Nanjing University of Information Science and Technology, Nanjing 210044, China
| | - Jianhua Mao
- Department of Nephrology, Children’s Hospital, Zhejiang University School of Medicine, Hangzhou 310000, China
- National Clinical Research Center for Child Health, Hangzhou 310000, China
| |
Collapse
|
10
|
Cazzaniga G, Rossi M, Eccher A, Girolami I, L'Imperio V, Van Nguyen H, Becker JU, Bueno García MG, Sbaraglia M, Dei Tos AP, Gambaro G, Pagni F. Time for a full digital approach in nephropathology: a systematic review of current artificial intelligence applications and future directions. J Nephrol 2024; 37:65-76. [PMID: 37768550 PMCID: PMC10920416 DOI: 10.1007/s40620-023-01775-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 08/22/2023] [Indexed: 09/29/2023]
Abstract
INTRODUCTION Artificial intelligence (AI) integration in nephropathology has been growing rapidly in recent years, facing several challenges including the wide range of histological techniques used, the low occurrence of certain diseases, and the need for data sharing. This narrative review retraces the history of AI in nephropathology and provides insights into potential future developments. METHODS Electronic searches in PubMed-MEDLINE and Embase were made to extract pertinent articles from the literature. Works about automated image analysis or the application of an AI algorithm on non-neoplastic kidney histological samples were included and analyzed to extract information such as publication year, AI task, and learning type. Prepublication servers and reviews were not included. RESULTS Seventy-six (76) original research articles were selected. Most of the studies were conducted in the United States in the last 7 years. To date, research has been mainly conducted on relatively easy tasks, like single-stain glomerular segmentation. However, there is a trend towards developing more complex tasks such as glomerular multi-stain classification. CONCLUSION Deep learning has been used to identify patterns in complex histopathology data and looks promising for the comprehensive assessment of renal biopsy, through the use of multiple stains and virtual staining techniques. Hybrid and collaborative learning approaches have also been explored to utilize large amounts of unlabeled data. A diverse team of experts, including nephropathologists, computer scientists, and clinicians, is crucial for the development of AI systems for nephropathology. Collaborative efforts among multidisciplinary experts result in clinically relevant and effective AI tools.
Collapse
Affiliation(s)
- Giorgio Cazzaniga
- Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy.
| | - Mattia Rossi
- Division of Nephrology, Department of Medicine, University of Verona, Piazzale Aristide Stefani, 1, 37126, Verona, Italy
| | - Albino Eccher
- Department of Pathology and Diagnostics, University and Hospital Trust of Verona, P.le Stefani n. 1, 37126, Verona, Italy
- Department of Medical and Surgical Sciences for Children and Adults, University of Modena and Reggio Emilia, University Hospital of Modena, Modena, Italy
| | - Ilaria Girolami
- Department of Pathology and Diagnostics, University and Hospital Trust of Verona, P.le Stefani n. 1, 37126, Verona, Italy
| | - Vincenzo L'Imperio
- Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
| | - Hien Van Nguyen
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, 77004, USA
| | - Jan Ulrich Becker
- Institute of Pathology, University Hospital of Cologne, Cologne, Germany
| | - María Gloria Bueno García
- VISILAB Research Group, E.T.S. Ingenieros Industriales, University of Castilla-La Mancha, Ciudad Real, Spain
| | - Marta Sbaraglia
- Department of Pathology, Azienda Ospedale-Università Padova, Padua, Italy
- Department of Medicine, University of Padua School of Medicine, Padua, Italy
| | - Angelo Paolo Dei Tos
- Department of Pathology, Azienda Ospedale-Università Padova, Padua, Italy
- Department of Medicine, University of Padua School of Medicine, Padua, Italy
| | - Giovanni Gambaro
- Division of Nephrology, Department of Medicine, University of Verona, Piazzale Aristide Stefani, 1, 37126, Verona, Italy
| | - Fabio Pagni
- Department of Medicine and Surgery, Pathology, Fondazione IRCCS San Gerardo dei Tintori, Università di Milano-Bicocca, Monza, Italy
| |
Collapse
|
11
|
Wingfield LR, Salaun A, Khan A, Webb H, Zhu T, Knight S. Clinical Decision Support Systems Used in Transplantation: Are They Tools for Success or an Unnecessary Gadget? A Systematic Review. Transplantation 2024; 108:72-99. [PMID: 37143191 DOI: 10.1097/tp.0000000000004627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
Although clinical decision support systems (CDSSs) have been used since the 1970s for a wide variety of clinical tasks including optimization of medication orders, improved documentation, and improved patient adherence, to date, no systematic reviews have been carried out to assess their utilization and efficacy in transplant medicine. The aim of this study is to systematically review studies that utilized a CDSS and assess impact on patient outcomes. A total of 48 articles were identified as meeting the author-derived inclusion criteria, including tools for posttransplant monitoring, pretransplant risk assessment, waiting list management, immunosuppressant management, and interpretation of histopathology. Studies included 15 984 transplant recipients. Tools aimed at helping with transplant patient immunosuppressant management were the most common (19 studies). Thirty-four studies (85%) found an overall clinical benefit following the implementation of a CDSS in clinical practice. Although there are limitations to the existing literature, current evidence suggests that implementing CDSS in transplant clinical settings may improve outcomes for patients. Limited evidence was found using more advanced technologies such as artificial intelligence in transplantation, and future studies should investigate the role of these emerging technologies.
Collapse
Affiliation(s)
- Laura R Wingfield
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, United Kingdom
| | - Achille Salaun
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Aparajita Khan
- Department of Neurosurgery, Stanford University, Stanford, CA
| | - Helena Webb
- School of Computer Science, University of Nottingham, Nottingham, United Kingdom
| | - Tingting Zhu
- Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Simon Knight
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
12
|
Farris AB, Alexander MP, Balis UGJ, Barisoni L, Boor P, Bülow RD, Cornell LD, Demetris AJ, Farkash E, Hermsen M, Hogan J, Kain R, Kers J, Kong J, Levenson RM, Loupy A, Naesens M, Sarder P, Tomaszewski JE, van der Laak J, van Midden D, Yagi Y, Solez K. Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments. Transpl Int 2023; 36:11783. [PMID: 37908675 PMCID: PMC10614670 DOI: 10.3389/ti.2023.11783] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Accepted: 09/22/2023] [Indexed: 11/02/2023]
Abstract
The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.
Collapse
Affiliation(s)
- Alton B. Farris
- Department of Pathology and Laboratory Medicine, Emory University, Atlanta, GE, United States
| | - Mariam P. Alexander
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, United States
| | - Ulysses G. J. Balis
- Department of Pathology, University of Michigan, Ann Arbor, MI, United States
| | - Laura Barisoni
- Department of Pathology and Medicine, Duke University, Durham, NC, United States
| | - Peter Boor
- Institute of Pathology, Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen University Clinic, Aachen, Germany
- Department of Nephrology and Immunology, RWTH Aachen University Clinic, Aachen, Germany
| | - Roman D. Bülow
- Institute of Pathology, Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen University Clinic, Aachen, Germany
| | - Lynn D. Cornell
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, United States
| | - Anthony J. Demetris
- Department of Pathology, University of Pittsburgh, Pittsburgh, PA, United States
| | - Evan Farkash
- Department of Pathology, University of Michigan, Ann Arbor, MI, United States
| | - Meyke Hermsen
- Department of Pathology, Radboud University Medical Center, Nijmegen, Netherlands
| | - Julien Hogan
- Department of Pathology and Laboratory Medicine, Emory University, Atlanta, GE, United States
- Nephrology Service, Robert Debré Hospital, University of Paris, Paris, France
| | - Renate Kain
- Department of Pathology, Medical University of Vienna, Vienna, Austria
| | - Jesper Kers
- Department of Pathology, Amsterdam University Medical Centers, Amsterdam, Netherlands
- Department of Pathology, Leiden University Medical Center, Leiden, Netherlands
| | - Jun Kong
- Georgia State University, Atlanta, GA, United States
- Emory University, Atlanta, GA, United States
| | - Richard M. Levenson
- Department of Pathology, University of California Davis Health System, Sacramento, CA, United States
| | - Alexandre Loupy
- Institut National de la Santé et de la Recherche Médicale, UMR 970, Paris Translational Research Centre for Organ Transplantation, and Kidney Transplant Department, Hôpital Necker, Assistance Publique-Hôpitaux de Paris, University of Paris, Paris, France
| | - Maarten Naesens
- Department of Microbiology, Immunology and Transplantation, KU Leuven, Leuven, Belgium
| | - Pinaki Sarder
- Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, Intelligent Critical Care Center, College of Medicine, University of Florida at Gainesville, Gainesville, FL, United States
| | - John E. Tomaszewski
- Department of Pathology, The State University of New York at Buffalo, Buffalo, NY, United States
| | - Jeroen van der Laak
- Department of Pathology, Radboud University Medical Center, Nijmegen, Netherlands
- Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| | - Dominique van Midden
- Department of Pathology, Radboud University Medical Center, Nijmegen, Netherlands
| | - Yukako Yagi
- Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Kim Solez
- Department of Pathology, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
13
|
Besusparis J, Morkunas M, Laurinavicius A. A Spatially Guided Machine-Learning Method to Classify and Quantify Glomerular Patterns of Injury in Histology Images. J Imaging 2023; 9:220. [PMID: 37888327 PMCID: PMC10607091 DOI: 10.3390/jimaging9100220] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 09/26/2023] [Accepted: 10/09/2023] [Indexed: 10/28/2023] Open
Abstract
Introduction The diagnosis of glomerular diseases is primarily based on visual assessment of histologic patterns. Semi-quantitative scoring of active and chronic lesions is often required to assess individual characteristics of the disease. Reproducibility of the visual scoring systems remains debatable, while digital and machine-learning technologies present opportunities to detect, classify and quantify glomerular lesions, also considering their inter- and intraglomerular heterogeneity. MATERIALS AND METHODS We performed a cross-validated comparison of three modifications of a convolutional neural network (CNN)-based approach for recognition and intraglomerular quantification of nine main glomerular patterns of injury. Reference values provided by two nephropathologists were used for validation. For each glomerular image, visual attention heatmaps were generated with a probability of class attribution for further intraglomerular quantification. The quality of classifier-produced heatmaps was evaluated by intersection over union metrics (IoU) between predicted and ground truth localization heatmaps. RESULTS A proposed spatially guided modification of the CNN classifier achieved the highest glomerular pattern classification accuracies, with area under curve (AUC) values up to 0.981. With regards to heatmap overlap area and intraglomerular pattern quantification, the spatially guided classifier achieved a significantly higher generalized mean IoU value compared to single-multiclass and multiple-binary classifiers. CONCLUSIONS We propose a spatially guided CNN classifier that in our experiments reveals the potential to achieve high accuracy for the localization of intraglomerular patterns.
Collapse
Affiliation(s)
- Justinas Besusparis
- Faculty of Medicine, Vilnius University, M.K.Ciurlionio 21, LT-03101 Vilnius, Lithuania; (M.M.); (A.L.)
- National Center of Pathology, Affiliate of Vilnius University Hospital Santaros Clinics, P. Baublio 5, LT-08406 Vilnius, Lithuania
| | - Mindaugas Morkunas
- Faculty of Medicine, Vilnius University, M.K.Ciurlionio 21, LT-03101 Vilnius, Lithuania; (M.M.); (A.L.)
- National Center of Pathology, Affiliate of Vilnius University Hospital Santaros Clinics, P. Baublio 5, LT-08406 Vilnius, Lithuania
| | - Arvydas Laurinavicius
- Faculty of Medicine, Vilnius University, M.K.Ciurlionio 21, LT-03101 Vilnius, Lithuania; (M.M.); (A.L.)
- National Center of Pathology, Affiliate of Vilnius University Hospital Santaros Clinics, P. Baublio 5, LT-08406 Vilnius, Lithuania
| |
Collapse
|
14
|
Mubarak M, Raza A, Rashid R, Shakeel S. Evolution of human kidney allograft pathology diagnostics through 30 years of the Banff classification process. World J Transplant 2023; 13:221-238. [PMID: 37746037 PMCID: PMC10514746 DOI: 10.5500/wjt.v13.i5.221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Revised: 06/05/2023] [Accepted: 06/12/2023] [Indexed: 09/15/2023] Open
Abstract
The second half of the previous century witnessed a tremendous rise in the number of clinical kidney transplants worldwide. This activity was, however, accompanied by many issues and challenges. An accurate diagnosis and appropriate management of causes of graft dysfunction were and still are, a big challenge. Kidney allograft biopsy played a vital role in addressing the above challenge. However, its interpretation was not standardized for many years until, in 1991, the Banff process was started to fill this void. Thereafter, regular Banff meetings took place every 2 years for the past 30 years. Marked changes have taken place in the interpretation of kidney allograft biopsies, diagnosis, and classification of rejection and other non-rejection pathologies from the original Banff 93 classification. This review attempts to summarize those changes for increasing the awareness and understanding of kidney allograft pathology through the eyes of the Banff process. It will interest the transplant surgeons, physicians, pathologists, and allied professionals associated with the care of kidney transplant patients.
Collapse
Affiliation(s)
- Muhammed Mubarak
- Department of Histopathology, Sindh Institute of Urology and Transplantation, Karachi 74200, Sindh, Pakistan
| | - Amber Raza
- Department of Nephrology, Sindh Institute of Urology and Transplantation, Karachi 74200, Sindh, Pakistan
| | - Rahma Rashid
- Department of Histopathology, Sindh Institute of Urology and Transplantation, Karachi 74200, Sindh, Pakistan
| | - Shaheera Shakeel
- Department of Histopathology, Sindh Institute of Urology and Transplantation, Karachi 74200, Sindh, Pakistan
| |
Collapse
|
15
|
Gorman BG, Lifson MA, Vidal NY. Artificial intelligence and frozen section histopathology: A systematic review. J Cutan Pathol 2023; 50:852-859. [PMID: 37394789 DOI: 10.1111/cup.14481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 05/14/2023] [Accepted: 05/29/2023] [Indexed: 07/04/2023]
Abstract
Frozen sections are a useful pathologic tool, but variable image quality may impede the use of artificial intelligence and machine learning in their interpretation. We aimed to identify the current research on machine learning models trained or tested on frozen section images. We searched PubMed and Web of Science for articles presenting new machine learning models published in any year. Eighteen papers met all inclusion criteria. All papers presented at least one novel model trained or tested on frozen section images. Overall, convolutional neural networks tended to have the best performance. When physicians were able to view the output of the model, they tended to perform better than either the model or physicians alone at the tested task. Models trained on frozen sections performed well when tested on other slide preparations, but models trained on only formalin-fixed tissue performed significantly worse across other modalities. This suggests not only that machine learning can be applied to frozen section image processing, but also use of frozen section images may increase model generalizability. Additionally, expert physicians working in concert with artificial intelligence may be the future of frozen section histopathology.
Collapse
Affiliation(s)
- Benjamin G Gorman
- Mayo Clinic Alix School of Medicine, Rochester, Minnesota, USA
- Mayo Clinic Graduate School of Biomedical Sciences, Rochester, Minnesota, USA
| | - Mark A Lifson
- Center for Digital Health, Mayo Clinic, Rochester, Minnesota, USA
| | - Nahid Y Vidal
- Department of Dermatology, Mayo Clinic, Rochester, Minnesota, USA
- Division of Dermatologic Surgery, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
16
|
Singh Samant S, Chauhan A, DN J, Singh V. Glomerulus Detection Using Segmentation Neural Networks. J Digit Imaging 2023; 36:1633-1642. [PMID: 37020148 PMCID: PMC10406769 DOI: 10.1007/s10278-022-00764-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 08/29/2022] [Accepted: 12/15/2022] [Indexed: 04/07/2023] Open
Abstract
Digital pathology is vital for the correct diagnosis of kidney before transplantation or kidney disease identification. One of the key challenges in kidney diagnosis is glomerulus detection in kidney tissue segments. In this study, we propose a deep learning-based method for glomerulus detection from digitized kidney slide segments. The proposed method applies models based on convolutional neural networks to detect image segments containing the glomerulus region. We employ various networks such as ResNets, UNet, LinkNet, and EfficientNet to train the models. In our experiments on a network trained on the NIH HuBMAP kidney whole slide image dataset, the proposed method achieves the highest scores with Dice coefficient of 0.942.
Collapse
Affiliation(s)
- Surender Singh Samant
- Department of Computer Science and Engineering, Graphic Era (Deemed to be University), Dehradun, 248002 Uttarkhand India
| | - Arun Chauhan
- Department of Computer Science and Engineering, Graphic Era (Deemed to be University), Dehradun, 248002 Uttarkhand India
| | - Jagadish DN
- Department of Electronics and Communication Engineering, Indian Institute of Information Technology, Dharwad, Karnataka 580009 India
| | - Vijay Singh
- Department of Computer Science and Engineering, Graphic Era (Deemed to be University), Dehradun, 248002 Uttarkhand India
| |
Collapse
|
17
|
Jain Y, Godwin LL, Ju Y, Sood N, Quardokus EM, Bueckle A, Longacre T, Horning A, Lin Y, Esplin ED, Hickey JW, Snyder MP, Patterson NH, Spraggins JM, Börner K. Segmentation of human functional tissue units in support of a Human Reference Atlas. Commun Biol 2023; 6:717. [PMID: 37468557 PMCID: PMC10356924 DOI: 10.1038/s42003-023-04848-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 04/17/2023] [Indexed: 07/21/2023] Open
Abstract
The Human BioMolecular Atlas Program (HuBMAP) aims to compile a Human Reference Atlas (HRA) for the healthy adult body at the cellular level. Functional tissue units (FTUs), relevant for HRA construction, are of pathobiological significance. Manual segmentation of FTUs does not scale; highly accurate and performant, open-source machine-learning algorithms are needed. We designed and hosted a Kaggle competition that focused on development of such algorithms and 1200 teams from 60 countries participated. We present the competition outcomes and an expanded analysis of the winning algorithms on additional kidney and colon tissue data, and conduct a pilot study to understand spatial location and density of FTUs across the kidney. The top algorithm from the competition, Tom, outperforms other algorithms in the expanded study, while using fewer computational resources. Tom was added to the HuBMAP infrastructure to run kidney FTU segmentation at scale-showcasing the value of Kaggle competitions for advancing research.
Collapse
Affiliation(s)
- Yashvardhan Jain
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA.
| | - Leah L Godwin
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA
| | - Yingnan Ju
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA
| | - Naveksha Sood
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA
| | - Ellen M Quardokus
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA
| | - Andreas Bueckle
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA
| | - Teri Longacre
- Department of Pathology, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Aaron Horning
- Thermo Fisher Scientific, South San Francisco, CA, 94080, USA
| | - Yiing Lin
- Department of Surgery, Washington University School of Medicine, St. Louis, MO, 63110, USA
| | - Edward D Esplin
- Department of Genetics, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - John W Hickey
- Department of Microbiology & Immunology, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Michael P Snyder
- Department of Genetics, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | | | - Jeffrey M Spraggins
- Mass Spectrometry Research Center, Vanderbilt University, Nashville, TN, 37232, USA
- Department of Cell and Developmental Biology, Vanderbilt University, Nashville, TN, 37232, USA
| | - Katy Börner
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, 47408, USA.
| |
Collapse
|
18
|
Zaza G, Cucchiari D, Becker JU, de Vries APJ, Eccher A, Florquin S, Kers J, Rabant M, Rossini M, Pengel L, Marson L, Furian L. European Society for Organ Transplantation (ESOT)-TLJ 3.0 Consensus on Histopathological Analysis of Pre-Implantation Donor Kidney Biopsy: Redefining the Role in the Process of Graft Assessment. Transpl Int 2023; 36:11410. [PMID: 37470063 PMCID: PMC10353313 DOI: 10.3389/ti.2023.11410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 05/31/2023] [Indexed: 07/21/2023]
Abstract
The ESOT TLJ 3.0. consensus conference brought together leading experts in transplantation to develop evidence-based guidance on the standardization and clinical utility of pre-implantation kidney biopsy in the assessment of grafts from Expanded Criteria Donors (ECD). Seven themes were selected and underwent in-depth analysis after formulation of PICO (patient/population, intervention, comparison, outcomes) questions. After literature search, the statements for each key question were produced, rated according the GRADE approach [Quality of evidence: High (A), Moderate (B), Low (C); Strength of Recommendation: Strong (1), Weak (2)]. The statements were subsequently presented in-person at the Prague kick-off meeting, discussed and voted. After two rounds of discussion and voting, all 7 statements reached an overall agreement of 100% on the following issues: needle core/wedge/punch technique representatively [B,1], frozen/paraffin embedded section reliability [B,2], experienced/non-experienced on-call renal pathologist reproducibility/accuracy of the histological report [A,1], glomerulosclerosis/other parameters reproducibility [C,2], digital pathology/light microscopy in the measurement of histological variables [A,1], special stainings/Haematoxylin and Eosin alone comparison [A,1], glomerulosclerosis reliability versus other histological parameters to predict the graft survival, graft function, primary non-function [B,1]. This methodology has allowed to reach a full consensus among European experts on important technical topics regarding pre-implantation biopsy in the ECD graft assessment.
Collapse
Affiliation(s)
- Gianluigi Zaza
- Nephrology, Dialysis and Transplantation Unit, Department of Medical and Surgical Sciences, University/Hospital of Foggia, Foggia, Italy
| | - David Cucchiari
- Department of Nephrology and Kidney Transplantation, Hospital Clínic, Barcelona, Spain
| | - Jan Ulrich Becker
- Institut für Pathologie und Molekularpathologie, University Hospital of Cologne, Cologne, Germany
| | - Aiko P. J. de Vries
- Division of Nephrology, Department of Medicine, Transplant Center, Leiden University Medical Center, Leiden, Netherlands
| | - Albino Eccher
- Department of Pathology and Diagnostics, University and Hospital Trust of Verona, Verona, Italy
| | - Sandrine Florquin
- Department of Pathology, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands
| | - Jesper Kers
- Department of Pathology, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands
| | - Marion Rabant
- Department of Pathology, Necker-Enfants Malades University Hospital, Paris, France
| | - Michele Rossini
- Nephrology, Dialysis and Transplantation Unit, University/Hospital of Bari, Bari, Italy
| | - Liset Pengel
- Centre for Evidence in Transplantation, Oxford, United Kindom
| | - Lorna Marson
- Department of Surgery, University of Edinburgh, Edinburgh, United Kingdom
| | - Lucrezia Furian
- Kidney and Pancreas Transplantation Unit, University of Padova, Padova, Italy
| |
Collapse
|
19
|
Fan Z, Yang Q, Xia H, Zhang P, Sun K, Yang M, Yin R, Zhao D, Ma H, Shen Y, Fan J. Artificial intelligence can accurately distinguish IgA nephropathy from diabetic nephropathy under Masson staining and becomes an important assistant for renal pathologists. Front Med (Lausanne) 2023; 10:1066125. [PMID: 37469661 PMCID: PMC10352102 DOI: 10.3389/fmed.2023.1066125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 05/31/2023] [Indexed: 07/21/2023] Open
Abstract
Introduction Hyperplasia of the mesangial area is common in IgA nephropathy (IgAN) and diabetic nephropathy (DN), and it is often difficult to distinguish them by light microscopy alone, especially in the absence of clinical data. At present, artificial intelligence (AI) is widely used in pathological diagnosis, but mainly in tumor pathology. The application of AI in renal pathological is still in its infancy. Methods Patients diagnosed as IgAN or DN by renal biopsy in First Affiliated Hospital of Zhejiang Chinese Medicine University from September 1, 2020 to April 30, 2022 were selected as the training set, and patients who diagnosed from May 1, 2022 to June 30, 2022 were selected as the test set. We focused on the glomerulus and captured the field of the glomerulus in Masson staining WSI at 200x magnification, all in 1,000 × 1,000 pixels JPEG format. We augmented the data from training set through minor affine transformation, and then randomly split the training set into training and adjustment data according to 8:2. The training data and the Yolov5 6.1 algorithm were used to train the AI model with constant adjustment of parameters according to the adjusted data. Finally, we obtained the optimal model, tested this model with test set and compared it with renal pathologists. Results AI can accurately detect the glomeruli. The overall accuracy of AI glomerulus detection was 98.67% and the omission rate was only 1.30%. No Intact glomerulus was missed. The overall accuracy of AI reached 73.24%, among which the accuracy of IgAN reached 77.27% and DN reached 69.59%. The AUC of IgAN was 0.733 and that of DN was 0.627. In addition, compared with renal pathologists, AI can distinguish IgAN from DN more quickly and accurately, and has higher consistency. Discussion We constructed an AI model based on Masson staining images of renal tissue to distinguish IgAN from DN. This model has also been successfully deployed in the work of renal pathologists to assist them in their daily diagnosis and teaching work.
Collapse
Affiliation(s)
- Zhenliang Fan
- Nephrology Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
- Academy of Chinese Medical Science, Zhejiang Chinese Medical University, Hangzhou, China
| | - Qiaorui Yang
- Harbin Institute of Physical Education, Harbin, China
| | - Hong Xia
- Nephrology Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
| | - Peipei Zhang
- Nephrology Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
| | - Ke Sun
- Graduate School, Zhejiang Chinese Medical University, Hangzhou, China
| | - Mengfan Yang
- Chengdu University of Traditional Chinese Medicine, Chengdu, China
| | - Riping Yin
- Nephrology and Endocrinology Department, Pinghu Hospital of Traditional Chinese Medicine, Pinghu, China
| | - Dongxue Zhao
- Harbin Institute of Physical Education, Harbin, China
| | - Hongzhen Ma
- Nephrology Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
| | - Yiwei Shen
- Ningbo Municipal Hospital of Traditional Chinese Medicine (Affiliated Hospital of Zhejiang Chinese Medical University), Ningbo, China
| | - Junfen Fan
- Nephrology Department, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
| |
Collapse
|
20
|
Border S, Lucarelli N, Eadon MT, El-Achkar TM, Jain S, Sarder P. Computational Pathology Fusing Spatial Technologies. Clin J Am Soc Nephrol 2023; 18:675-677. [PMID: 36913267 PMCID: PMC10278855 DOI: 10.2215/cjn.0000000000000146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 03/06/2023] [Indexed: 03/14/2023]
Affiliation(s)
- Samuel Border
- Department of Biomedical Engineering, University of Florida College of Engineering, Gainesville, Florida
| | - Nicholas Lucarelli
- Department of Biomedical Engineering, University of Florida College of Engineering, Gainesville, Florida
| | - Michael T. Eadon
- Department of Medicine–Division of Nephrology and Hypertension, Indiana University School of Medicine, Indianapolis, Indiana
| | - Tarek M. El-Achkar
- Department of Medicine–Division of Nephrology and Hypertension, Indiana University School of Medicine, Indianapolis, Indiana
| | - Sanjay Jain
- Department of Medicine–Division of Nephrology, Washington University School of Medicine, St. Louis, Missouri
| | - Pinaki Sarder
- Department of Biomedical Engineering, University of Florida College of Engineering, Gainesville, Florida
- Department of Medicine–Quantitative Health, University of Florida College of Medicine, Gainesville, Florida
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, Florida
| |
Collapse
|
21
|
Atasever S, Azginoglu N, Terzi DS, Terzi R. A comprehensive survey of deep learning research on medical image analysis with focus on transfer learning. Clin Imaging 2023; 94:18-41. [PMID: 36462229 DOI: 10.1016/j.clinimag.2022.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 10/17/2022] [Accepted: 11/01/2022] [Indexed: 11/13/2022]
Abstract
This survey aims to identify commonly used methods, datasets, future trends, knowledge gaps, constraints, and limitations in the field to provide an overview of current solutions used in medical image analysis in parallel with the rapid developments in transfer learning (TL). Unlike previous studies, this survey grouped the last five years of current studies for the period between January 2017 and February 2021 according to different anatomical regions and detailed the modality, medical task, TL method, source data, target data, and public or private datasets used in medical imaging. Also, it provides readers with detailed information on technical challenges, opportunities, and future research trends. In this way, an overview of recent developments is provided to help researchers to select the most effective and efficient methods and access widely used and publicly available medical datasets, research gaps, and limitations of the available literature.
Collapse
Affiliation(s)
- Sema Atasever
- Computer Engineering Department, Nevsehir Hacı Bektas Veli University, Nevsehir, Turkey.
| | - Nuh Azginoglu
- Computer Engineering Department, Kayseri University, Kayseri, Turkey.
| | | | - Ramazan Terzi
- Computer Engineering Department, Amasya University, Amasya, Turkey.
| |
Collapse
|
22
|
Hao F, Liu X, Li M, Han W. Accurate Kidney Pathological Image Classification Method Based on Deep Learning and Multi-Modal Fusion Method with Application to Membranous Nephropathy. Life (Basel) 2023; 13:life13020399. [PMID: 36836756 PMCID: PMC9960995 DOI: 10.3390/life13020399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 01/25/2023] [Accepted: 01/27/2023] [Indexed: 02/04/2023] Open
Abstract
Membranous nephropathy is one of the most prevalent conditions responsible for nephrotic syndrome in adults. It is clinically nonspecific and mainly diagnosed by kidney biopsy pathology, with three prevalent techniques: light microscopy, electron microscopy, and immunofluorescence microscopy. Manual observation of glomeruli one by one under the microscope is very time-consuming, and there are certain differences in the observation results between physicians. This study makes use of whole-slide images scanned by a light microscope as well as immunofluorescence images to classify patients with membranous nephropathy. The framework mainly includes a glomerular segmentation module, a confidence coefficient extraction module, and a multi-modal fusion module. This framework first identifies and segments the glomerulus from whole-slide images and immunofluorescence images, and then a glomerular classifier is trained to extract the features of each glomerulus. The results are then combined to produce the final diagnosis. The results of the experiments show that the F1-score of image classification results obtained by combining two kinds of features, which can reach 97.32%, is higher than those obtained by using only light-microscopy-observed images or immunofluorescent images, which reach 92.76% and 93.20%, respectively. Experiments demonstrate that considering both WSIs and immunofluorescence images is effective in improving the diagnosis of membranous nephropathy.
Collapse
Affiliation(s)
- Fang Hao
- College of Data Science, Taiyuan University of Technology, Taiyuan 030024, China
- Correspondence:
| | - Xueyu Liu
- College of Data Science, Taiyuan University of Technology, Taiyuan 030024, China
| | - Ming Li
- College of Data Science, Taiyuan University of Technology, Taiyuan 030024, China
| | - Weixia Han
- Department of Pathology, Second Hospital of Shanxi Medical University, Taiyuan 030001, China
| |
Collapse
|
23
|
Glomerulosclerosis detection with pre-trained CNNs ensemble. Comput Stat 2022. [DOI: 10.1007/s00180-022-01307-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
24
|
Ayorinde JOO, Citterio F, Landrò M, Peruzzo E, Islam T, Tilley S, Taylor G, Bardsley V, Liò P, Samoshkin A, Pettigrew GJ. Artificial Intelligence You Can Trust: What Matters Beyond Performance When Applying Artificial Intelligence to Renal Histopathology? J Am Soc Nephrol 2022; 33:2133-2140. [PMID: 36351761 PMCID: PMC9731632 DOI: 10.1681/asn.2022010069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
Although still in its infancy, artificial intelligence (AI) analysis of kidney biopsy images is anticipated to become an integral aspect of renal histopathology. As these systems are developed, the focus will understandably be on developing ever more accurate models, but successful translation to the clinic will also depend upon other characteristics of the system.In the extreme, deployment of highly performant but "black box" AI is fraught with risk, and high-profile errors could damage future trust in the technology. Furthermore, a major factor determining whether new systems are adopted in clinical settings is whether they are "trusted" by clinicians. Key to unlocking trust will be designing platforms optimized for intuitive human-AI interactions and ensuring that, where judgment is required to resolve ambiguous areas of assessment, the workings of the AI image classifier are understandable to the human observer. Therefore, determining the optimal design for AI systems depends on factors beyond performance, with considerations of goals, interpretability, and safety constraining many design and engineering choices.In this article, we explore challenges that arise in the application of AI to renal histopathology, and consider areas where choices around model architecture, training strategy, and workflow design may be influenced by factors beyond the final performance metrics of the system.
Collapse
Affiliation(s)
- John O O Ayorinde
- Department of Surgery, University of Cambridge, Addenbrooke's Hospital, Cambridge, United Kingdom
| | | | | | | | | | | | | | - Victoria Bardsley
- Department of Histopathology, Addenbrooke's Hospital, Cambridge, United Kingdom
| | - Pietro Liò
- Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom
| | - Alex Samoshkin
- Office for Translational Research, School of Clinical Medicine, University of Cambridge, Cambridge, United Kingdom
| | - Gavin J Pettigrew
- Department of Surgery, University of Cambridge, Addenbrooke's Hospital, Cambridge, United Kingdom
| |
Collapse
|
25
|
Mekov E, Ilieva V. Machine learning in lung transplantation: Where are we? Presse Med 2022; 51:104140. [PMID: 36252820 DOI: 10.1016/j.lpm.2022.104140] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 09/29/2022] [Indexed: 11/06/2022] Open
Abstract
Lung transplantation has been accepted as a viable treatment for end-stage respiratory failure. While regression models continue to be a standard approach for attempting to predict patients' outcomes after lung transplantation, more sophisticated supervised machine learning (ML) techniques are being developed and show encouraging results. Transplant clinicians could utilize ML as a decision-support tool in a variety of situations (e.g. waiting list mortality, donor selection, immunosuppression, rejection prediction). Although for some topics ML is at an advanced stage of research (i.e. imaging and pathology) there are certain topics in lung transplantation that needs to be aware of the benefits it could provide.
Collapse
Affiliation(s)
- Evgeni Mekov
- Department of Occupational Diseases, Faculty of Medicine, Medical University - Sofia, Sofia, Bulgaria
| | - Viktoria Ilieva
- Department of Anesthesiology and Intensive Care, Faculty of Medicine, Medical University - Sofia, Sofia, Bulgaria.
| |
Collapse
|
26
|
Basso MN, Barua M, Meyer J, John R, Khademi A. Machine learning in renal pathology. FRONTIERS IN NEPHROLOGY 2022; 2:1007002. [PMID: 37675000 PMCID: PMC10479587 DOI: 10.3389/fneph.2022.1007002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 11/09/2022] [Indexed: 09/08/2023]
Abstract
Introduction When assessing kidney biopsies, pathologists use light microscopy, immunofluorescence, and electron microscopy to describe and diagnose glomerular lesions and diseases. These methods can be laborious, costly, fraught with inter-observer variability, and can have delays in turn-around time. Thus, computational approaches can be designed as screening and/or diagnostic tools, potentially relieving pathologist time, healthcare resources, while also having the ability to identify novel biomarkers, including subvisual features. Methods Here, we implement our recently published biomarker feature extraction (BFE) model along with 3 pre-trained deep learning models (VGG16, VGG19, and InceptionV3) to diagnose 3 glomerular diseases using PAS-stained digital pathology images alone. The BFE model extracts a panel of 233 explainable features related to underlying pathology, which are subsequently narrowed down to 10 morphological and microstructural texture features for classification with a linear discriminant analysis machine learning classifier. 45 patient renal biopsies (371 glomeruli) from minimal change disease (MCD), membranous nephropathy (MN), and thin-basement membrane nephropathy (TBMN) were split into training/validation and held out sets. For the 3 deep learningmodels, data augmentation and Grad-CAM were used for better performance and interpretability. Results The BFE model showed glomerular validation accuracy of 67.6% and testing accuracy of 76.8%. All deep learning approaches had higher validation accuracies (most for VGG16 at 78.5%) but lower testing accuracies. The highest testing accuracy at the glomerular level was VGG16 at 71.9%, while at the patient-level was InceptionV3 at 73.3%. Discussion The results highlight the potential of both traditional machine learning and deep learning-based approaches for kidney biopsy evaluation.
Collapse
Affiliation(s)
- Matthew Nicholas Basso
- Image Analysis in Medicine Lab (IAMLAB), Department of Electrical, Computer, and Biomedical Engineering, Ryerson University, Toronto, ON, Canada
| | - Moumita Barua
- Division of Nephrology, University Health Network, Toronto, ON, Canada
- Toronto General Hospital Research Institute, Toronto General Hospital, Toronto, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada
| | - Julien Meyer
- School of Health Services Management, Ryerson University, Toronto, ON, Canada
| | - Rohan John
- Department of Pathology, University Health Network, Toronto, ON, Canada
| | - April Khademi
- Image Analysis in Medicine Lab (IAMLAB), Department of Electrical, Computer, and Biomedical Engineering, Ryerson University, Toronto, ON, Canada
- Keenan Research Center for Biomedical Science, St. Michael’s Hospital, Unity Health Network, Toronto, ON, Canada
- Institute for Biomedical Engineering, Science, and Technology (iBEST), a partnership between St. Michael’s Hospital and Ryerson University, Toronto, ON, Canada
| |
Collapse
|
27
|
Qiao Y, Zhao L, Luo C, Luo Y, Wu Y, Li S, Bu D, Zhao Y. Multi-modality artificial intelligence in digital pathology. Brief Bioinform 2022; 23:6702380. [PMID: 36124675 PMCID: PMC9677480 DOI: 10.1093/bib/bbac367] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/27/2022] [Accepted: 08/05/2022] [Indexed: 12/14/2022] Open
Abstract
In common medical procedures, the time-consuming and expensive nature of obtaining test results plagues doctors and patients. Digital pathology research allows using computational technologies to manage data, presenting an opportunity to improve the efficiency of diagnosis and treatment. Artificial intelligence (AI) has a great advantage in the data analytics phase. Extensive research has shown that AI algorithms can produce more up-to-date and standardized conclusions for whole slide images. In conjunction with the development of high-throughput sequencing technologies, algorithms can integrate and analyze data from multiple modalities to explore the correspondence between morphological features and gene expression. This review investigates using the most popular image data, hematoxylin-eosin stained tissue slide images, to find a strategic solution for the imbalance of healthcare resources. The article focuses on the role that the development of deep learning technology has in assisting doctors' work and discusses the opportunities and challenges of AI.
Collapse
Affiliation(s)
- Yixuan Qiao
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Lianhe Zhao
- Corresponding authors: Yi Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences; Shandong First Medical University & Shandong Academy of Medical Sciences. Tel.: +86 10 6260 0822; Fax: +86 10 6260 1356; E-mail: ; Lianhe Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences. Tel.: +86 18513983324; E-mail:
| | - Chunlong Luo
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yufan Luo
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yang Wu
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China
| | - Shengtong Li
- Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Dechao Bu
- Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China
| | - Yi Zhao
- Corresponding authors: Yi Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences; Shandong First Medical University & Shandong Academy of Medical Sciences. Tel.: +86 10 6260 0822; Fax: +86 10 6260 1356; E-mail: ; Lianhe Zhao, Research Center for Ubiquitous Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China; University of Chinese Academy of Sciences. Tel.: +86 18513983324; E-mail:
| |
Collapse
|
28
|
Boekestijn I, van Oosterom MN, Dell'Oglio P, van Velden FHP, Pool M, Maurer T, Rietbergen DDD, Buckle T, van Leeuwen FWB. The current status and future prospects for molecular imaging-guided precision surgery. Cancer Imaging 2022; 22:48. [PMID: 36068619 PMCID: PMC9446692 DOI: 10.1186/s40644-022-00482-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 08/21/2022] [Indexed: 01/19/2023] Open
Abstract
Molecular imaging technologies are increasingly used to diagnose, monitor, and guide treatment of i.e., cancer. In this review, the current status and future prospects of the use of molecular imaging as an instrument to help realize precision surgery is addressed with focus on the main components that form the conceptual basis of intraoperative molecular imaging. Paramount for successful interventions is the relevance and accessibility of surgical targets. In addition, selection of the correct combination of imaging agents and modalities is critical to visualize both microscopic and bulk disease sites with high affinity and specificity. In this context developments within engineering/imaging physics continue to drive the growth of image-guided surgery. Particularly important herein is enhancement of sensitivity through improved contrast and spatial resolution, features that are critical if sites of cancer involvement are not to be overlooked during surgery. By facilitating the connection between surgical planning and surgical execution, digital surgery technologies such as computer-aided visualization nicely complement these technologies. The complexity of image guidance, combined with the plurality of technologies that are becoming available, also drives the need for evaluation mechanisms that can objectively score the impact that technologies exert on the performance of healthcare professionals and outcome improvement for patients.
Collapse
Affiliation(s)
- Imke Boekestijn
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands.,Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
| | - Matthias N van Oosterom
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
| | - Paolo Dell'Oglio
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands.,Department of Urology, ASST Grande Ospedale Metropolitano Niguarda, Milan, Italy
| | - Floris H P van Velden
- Medical Physics, Department of Radiology , Leiden University Medical Center, Leiden, the Netherlands
| | - Martin Pool
- Department of Clinical Farmacy and Toxicology, Leiden University Medical Center, Leiden, the Netherlands
| | - Tobias Maurer
- Martini-Klinik Prostate Cancer Centre Hamburg, Hamburg, Germany
| | - Daphne D D Rietbergen
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands.,Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
| | - Tessa Buckle
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
| | - Fijs W B van Leeuwen
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands.
| |
Collapse
|
29
|
Silva J, Souza L, Chagas P, Calumby R, Souza B, Pontes I, Duarte A, Pinheiro N, Santos W, Oliveira L. Boundary-aware glomerulus segmentation: Toward one-to-many stain generalization. Comput Med Imaging Graph 2022; 100:102104. [PMID: 36007483 DOI: 10.1016/j.compmedimag.2022.102104] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 05/28/2022] [Accepted: 07/08/2022] [Indexed: 11/30/2022]
Abstract
The growing availability of scanned whole-slide images (WSIs) has allowed nephropathology to open new possibilities for medical decision-making over high-resolution images. Diagnosis of renal WSIs includes locating and identifying specific structures in the tissue. Considering the glomerulus as one of the first structures analyzed by pathologists, we propose here a novel convolutional neural network for glomerulus segmentation. Our end-to-end network, named DS-FNet, combines the strengths of semantic segmentation and semantic boundary detection networks via an attention-aware mechanism. Although we trained the proposed network on periodic acid-Schiff (PAS)-stained WSIs, we found that our network was capable to segment glomeruli on WSIs stained with different techniques, such as periodic acid-methenamine silver (PAMS), hematoxylin-eosin (HE), and Masson trichrome (TRI). To assess the performance of the proposed method, we used three public data sets: HuBMAP (available in a Kaggle competition), a subset of the NEPTUNE data set, and a novel challenging data set, called WSI_Fiocruz. We compared the DS-FNet with six other deep learning networks: original U-Net, our attention version of U-Net called AU-Net, U-Net++, U-Net3Plus, ResU-Net, and DeepLabV3+. Results showed that DS-FNet achieved equivalent or superior results on all data sets: On the HuBMAP data set, it reached a dice score (DSC) of 95.05%, very close to the first place (95.15%); on the NEPTUNE and WSI_Fiocruz data sets, DS-FNet obtained the highest average DSC, whether on PAS-stained images or images stained with other techniques. To the best we know, this is the first work to show consistently high performance in a one-to-many-stain glomerulus segmentation following a thorough protocol on data sets from different medical labs.
Collapse
Affiliation(s)
- Jefferson Silva
- Universidade Federal do Maranhão, Brazil; Universidade Federal da Bahia, Brazil
| | | | | | | | - Bianca Souza
- Universidade Federal da Bahia, Brazil; Fundação Oswaldo Cruz, Brazil
| | | | | | | | - Washington Santos
- Universidade Federal da Bahia, Brazil; Fundação Oswaldo Cruz, Brazil
| | | |
Collapse
|
30
|
Yao T, Lu Y, Long J, Jha A, Zhu Z, Asad Z, Yang H, Fogo AB, Huo Y. Glo-In-One: holistic glomerular detection, segmentation, and lesion characterization with large-scale web image mining. J Med Imaging (Bellingham) 2022; 9:052408. [PMID: 35747553 DOI: 10.1117/1.jmi.9.5.052408] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Accepted: 05/31/2022] [Indexed: 11/14/2022] Open
Abstract
Purpose: The quantitative detection, segmentation, and characterization of glomeruli from high-resolution whole slide imaging (WSI) play essential roles in the computer-assisted diagnosis and scientific research in digital renal pathology. Historically, such comprehensive quantification requires extensive programming skills to be able to handle heterogeneous and customized computational tools. To bridge the gap of performing glomerular quantification for non-technical users, we develop the Glo-In-One toolkit to achieve holistic glomerular detection, segmentation, and characterization via a single line of command. Additionally, we release a large-scale collection of 30,000 unlabeled glomerular images to further facilitate the algorithmic development of self-supervised deep learning. Approach: The inputs of the Glo-In-One toolkit are WSIs, while the outputs are (1) WSI-level multi-class circle glomerular detection results (which can be directly manipulated with ImageScope), (2) glomerular image patches with segmentation masks, and (3) different lesion types. In the current version, the fine-grained global glomerulosclerosis (GGS) characterization is provided, including assessed-solidified-GSS (associated with hypertension-related injury), disappearing-GSS (a further end result of the SGGS becoming contiguous with fibrotic interstitium), and obsolescent-GSS (nonspecific GGS increasing with aging) glomeruli. To leverage the performance of the Glo-In-One toolkit, we introduce self-supervised deep learning to glomerular quantification via large-scale web image mining. Results: The GGS fine-grained classification model achieved a decent performance compared with baseline supervised methods while only using 10% of the annotated data. The glomerular detection achieved an average precision of 0.627 with circle representations, while the glomerular segmentation achieved a 0.955 patch-wise Dice dimilarity coefficient. Conclusion: We develop and release an open-source Glo-In-One toolkit, a software with holistic glomerular detection, segmentation, and lesion characterization. This toolkit is user-friendly to non-technical users via a single line of command. The toolbox and the 30,000 web mined glomerular images have been made publicly available at https://github.com/hrlblab/Glo-In-One.
Collapse
Affiliation(s)
- Tianyuan Yao
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States
| | - Yuzhe Lu
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States
| | - Jun Long
- Central South University, Big Data Institute, Changsha, China
| | - Aadarsh Jha
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States
| | - Zheyu Zhu
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States
| | - Zuhayr Asad
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States
| | - Haichun Yang
- Vanderbilt University Medical Center, Department of Pathology, Microbiology and Immunology, Nashville, Tennessee, United States
| | - Agnes B Fogo
- Vanderbilt University Medical Center, Department of Pathology, Microbiology and Immunology, Nashville, Tennessee, United States
| | - Yuankai Huo
- Vanderbilt University, Department of Computer Science, Nashville, Tennessee, United States
| |
Collapse
|
31
|
Artificial Intelligence-Assisted Renal Pathology: Advances and Prospects. J Clin Med 2022; 11:jcm11164918. [PMID: 36013157 PMCID: PMC9410196 DOI: 10.3390/jcm11164918] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 07/30/2022] [Accepted: 08/11/2022] [Indexed: 11/17/2022] Open
Abstract
Digital imaging and advanced microscopy play a pivotal role in the diagnosis of kidney diseases. In recent years, great achievements have been made in digital imaging, providing novel approaches for precise quantitative assessments of nephropathology and relieving burdens of renal pathologists. Developing novel methods of artificial intelligence (AI)-assisted technology through multidisciplinary interaction among computer engineers, renal specialists, and nephropathologists could prove beneficial for renal pathology diagnoses. An increasing number of publications has demonstrated the rapid growth of AI-based technology in nephrology. In this review, we offer an overview of AI-assisted renal pathology, including AI concepts and the workflow of processing digital image data, focusing on the impressive advances of AI application in disease-specific backgrounds. In particular, this review describes the applied computer vision algorithms for the segmentation of kidney structures, diagnosis of specific pathological changes, and prognosis prediction based on images. Lastly, we discuss challenges and prospects to provide an objective view of this topic.
Collapse
|
32
|
Patel AU, Shaker N, Mohanty S, Sharma S, Gangal S, Eloy C, Parwani AV. Cultivating Clinical Clarity through Computer Vision: A Current Perspective on Whole Slide Imaging and Artificial Intelligence. Diagnostics (Basel) 2022; 12:diagnostics12081778. [PMID: 35892487 PMCID: PMC9332710 DOI: 10.3390/diagnostics12081778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Revised: 07/10/2022] [Accepted: 07/11/2022] [Indexed: 11/17/2022] Open
Abstract
Diagnostic devices, methodological approaches, and traditional constructs of clinical pathology practice, cultivated throughout centuries, have transformed radically in the wake of explosive technological growth and other, e.g., environmental, catalysts of change. Ushered into the fray of modern laboratory medicine are digital imaging devices and machine-learning (ML) software fashioned to mitigate challenges, e.g., practitioner shortage while preparing clinicians for emerging interconnectivity of environments and diagnostic information in the era of big data. As computer vision shapes new constructs for the modern world and intertwines with clinical medicine, cultivating clarity of our new terrain through examining the trajectory and current scope of computational pathology and its pertinence to clinical practice is vital. Through review of numerous studies, we find developmental efforts for ML migrating from research to standardized clinical frameworks while overcoming obstacles that have formerly curtailed adoption of these tools, e.g., generalizability, data availability, and user-friendly accessibility. Groundbreaking validatory efforts have facilitated the clinical deployment of ML tools demonstrating the capacity to effectively aid in distinguishing tumor subtype and grade, classify early vs. advanced cancer stages, and assist in quality control and primary diagnosis applications. Case studies have demonstrated the benefits of streamlined, digitized workflows for practitioners alleviated by decreased burdens.
Collapse
Affiliation(s)
- Ankush U. Patel
- Mayo Clinic Department of Laboratory Medicine and Pathology, Rochester, MN 55905, USA
- Correspondence: ; Tel.: +1-206-451-3519
| | - Nada Shaker
- Department of Pathology, Wexner Medical Center, The Ohio State University, Columbus, OH 43210, USA; (N.S.); (S.G.); (A.V.P.)
| | - Sambit Mohanty
- CORE Diagnostics, Gurugram 122016, India; (S.M.); (S.S.)
- Advanced Medical Research Institute, Bareilly 243001, India
| | - Shivani Sharma
- CORE Diagnostics, Gurugram 122016, India; (S.M.); (S.S.)
| | - Shivam Gangal
- Department of Pathology, Wexner Medical Center, The Ohio State University, Columbus, OH 43210, USA; (N.S.); (S.G.); (A.V.P.)
- College of Engineering, Biomedical Engineering, The Ohio State University, Columbus, OH 43210, USA
| | - Catarina Eloy
- Institute of Molecular Pathology and Immunology of the University of Porto (IPATIMUP), Rua Júlio Amaral de Carvalho, 45, 4200-135 Porto, Portugal;
- Institute for Research and Innovation in Health (I3S Consortium), Rua Alfredo Allen, 208, 4200-135 Porto, Portugal
| | - Anil V. Parwani
- Department of Pathology, Wexner Medical Center, The Ohio State University, Columbus, OH 43210, USA; (N.S.); (S.G.); (A.V.P.)
- Cooperative Human Tissue Network (CHTN) Midwestern Division, Columbus, OH 43240, USA
| |
Collapse
|
33
|
Jiang J, Chan L, Nadkarni GN. The promise of artificial intelligence for kidney pathophysiology. Curr Opin Nephrol Hypertens 2022; 31:380-386. [PMID: 35703218 PMCID: PMC10309072 DOI: 10.1097/mnh.0000000000000808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
PURPOSE OF REVIEW We seek to determine recent advances in kidney pathophysiology that have been enabled or enhanced by artificial intelligence. We describe some of the challenges in the field as well as future directions. RECENT FINDINGS We first provide an overview of artificial intelligence terminologies and methodologies. We then describe the use of artificial intelligence in kidney diseases to discover risk factors from clinical data for disease progression, annotate whole slide imaging and decipher multiomics data. We delineate key examples of risk stratification and prognostication in acute kidney injury (AKI) and chronic kidney disease (CKD). We contextualize these applications in kidney disease oncology, one of the subfields to benefit demonstrably from artificial intelligence using all if these approaches. We conclude by elucidating technical challenges and ethical considerations and briefly considering future directions. SUMMARY The integration of clinical data, patient derived data, histology and proteomics and genomics can enhance the work of clinicians in providing more accurate diagnoses and elevating understanding of disease progression. Implementation research needs to be performed to translate these algorithms to the clinical setting.
Collapse
Affiliation(s)
- Joy Jiang
- Division of Data Driven and Digital Medicine (D3M), Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Lili Chan
- Division of Data Driven and Digital Medicine (D3M), Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Girish N. Nadkarni
- Division of Data Driven and Digital Medicine (D3M), Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Mount Sinai Clinical Intelligence Center, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
34
|
|
35
|
Girolami I, Pantanowitz L, Marletta S, Hermsen M, van der Laak J, Munari E, Furian L, Vistoli F, Zaza G, Cardillo M, Gesualdo L, Gambaro G, Eccher A. Artificial intelligence applications for pre-implantation kidney biopsy pathology practice: a systematic review. J Nephrol 2022; 35:1801-1808. [PMID: 35441256 PMCID: PMC9458558 DOI: 10.1007/s40620-022-01327-8] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 03/28/2022] [Indexed: 10/29/2022]
Abstract
BACKGROUND Transplant nephropathology is a highly specialized field of pathology comprising both the evaluation of organ donor biopsy for organ allocation and post-transplant graft biopsy for assessment of rejection or graft damage. The introduction of digital pathology with whole-slide imaging (WSI) in clinical research, trials and practice has catalyzed the application of artificial intelligence (AI) for histopathology, with development of novel machine-learning models for tissue interrogation and discovery. We aimed to review the literature for studies specifically applying AI algorithms to WSI-digitized pre-implantation kidney biopsy. METHODS A systematic search was carried out in the electronic databases PubMed-MEDLINE and Embase until 25th September, 2021 with a combination of the key terms "kidney", "biopsy", "transplantation" and "artificial intelligence" and their aliases. Studies dealing with the application of AI algorithms coupled with WSI in pre-implantation kidney biopsies were included. The main theme addressed was detection and quantification of tissue components. Extracted data were: author, year and country of the study, type of biopsy features investigated, number of cases, type of algorithm deployed, main results of the study in terms of diagnostic outcome, and the main limitations of the study. RESULTS Of 5761 retrieved articles, 7 met our inclusion criteria. All studies focused largely on AI-based detection and classification of glomerular structures and to a lesser extent on tubular and vascular structures. Performance of AI algorithms was excellent and promising. CONCLUSION All studies highlighted the importance of expert pathologist annotation to reliably train models and the need to acknowledge clinical nuances of the pre-implantation setting. Close cooperation between computer scientists and practicing as well as expert renal pathologists is needed, helping to refine the performance of AI-based models for routine pre-implantation kidney biopsy clinical practice.
Collapse
Affiliation(s)
- Ilaria Girolami
- Division of Pathology, Central Hospital Bolzano, Bolzano, Italy
| | - Liron Pantanowitz
- Department of Pathology and Clinical Labs, University of Michigan, Ann Arbor, MI, USA
| | - Stefano Marletta
- Department of Diagnostics and Public Health, University and Hospital Trust of Verona, Verona, Italy
| | - Meyke Hermsen
- Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Jeroen van der Laak
- Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Enrico Munari
- Pathology Unit, Department of Molecular and Translational Medicine, Spedali Civili-University of Brescia, Brescia, Italy
| | - Lucrezia Furian
- Department of Surgical, Oncological and Gastroenterological Sciences, Unit of Kidney and Pancreas Transplantation, University of Padua, Padua, Italy
| | - Fabio Vistoli
- Division of General and Transplant Surgery, University of Pisa, Pisa, Italy
| | - Gianluigi Zaza
- Department of Nephro-Urology, Nephrology, Dialysis and Transplant Unit, University of Foggia, Foggia, Italy
| | | | - Loreto Gesualdo
- Nephrology, Dialysis, and Transplantation Unit, Department of Emergency and Organ Transplantation, University of Bari Aldo Moro, Bari, Italy
| | - Giovanni Gambaro
- Department of General Medicine, Renal Unit, University and Hospital Trust of Verona, Verona, Italy
| | - Albino Eccher
- Department of Pathology and Diagnostics, University and Hospital Trust of Verona, P.le Stefani n. 1, 37126, Verona, Italy.
| |
Collapse
|
36
|
Kim HE, Cosa-Linan A, Santhanam N, Jannesari M, Maros ME, Ganslandt T. Transfer learning for medical image classification: a literature review. BMC Med Imaging 2022; 22:69. [PMID: 35418051 PMCID: PMC9007400 DOI: 10.1186/s12880-022-00793-7] [Citation(s) in RCA: 109] [Impact Index Per Article: 54.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 03/30/2022] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND Transfer learning (TL) with convolutional neural networks aims to improve performances on a new task by leveraging the knowledge of similar tasks learned in advance. It has made a major contribution to medical image analysis as it overcomes the data scarcity problem as well as it saves time and hardware resources. However, transfer learning has been arbitrarily configured in the majority of studies. This review paper attempts to provide guidance for selecting a model and TL approaches for the medical image classification task. METHODS 425 peer-reviewed articles were retrieved from two databases, PubMed and Web of Science, published in English, up until December 31, 2020. Articles were assessed by two independent reviewers, with the aid of a third reviewer in the case of discrepancies. We followed the PRISMA guidelines for the paper selection and 121 studies were regarded as eligible for the scope of this review. We investigated articles focused on selecting backbone models and TL approaches including feature extractor, feature extractor hybrid, fine-tuning and fine-tuning from scratch. RESULTS The majority of studies (n = 57) empirically evaluated multiple models followed by deep models (n = 33) and shallow (n = 24) models. Inception, one of the deep models, was the most employed in literature (n = 26). With respect to the TL, the majority of studies (n = 46) empirically benchmarked multiple approaches to identify the optimal configuration. The rest of the studies applied only a single approach for which feature extractor (n = 38) and fine-tuning from scratch (n = 27) were the two most favored approaches. Only a few studies applied feature extractor hybrid (n = 7) and fine-tuning (n = 3) with pretrained models. CONCLUSION The investigated studies demonstrated the efficacy of transfer learning despite the data scarcity. We encourage data scientists and practitioners to use deep models (e.g. ResNet or Inception) as feature extractors, which can save computational costs and time without degrading the predictive power.
Collapse
Affiliation(s)
- Hee E Kim
- Department of Biomedical Informatics at the Center for Preventive Medicine and Digital Health (CPD-BW), Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany.
| | - Alejandro Cosa-Linan
- Department of Biomedical Informatics at the Center for Preventive Medicine and Digital Health (CPD-BW), Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Nandhini Santhanam
- Department of Biomedical Informatics at the Center for Preventive Medicine and Digital Health (CPD-BW), Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Mahboubeh Jannesari
- Department of Biomedical Informatics at the Center for Preventive Medicine and Digital Health (CPD-BW), Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Mate E Maros
- Department of Biomedical Informatics at the Center for Preventive Medicine and Digital Health (CPD-BW), Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Thomas Ganslandt
- Department of Biomedical Informatics at the Center for Preventive Medicine and Digital Health (CPD-BW), Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Wetterkreuz 15, 91058, Erlangen, Germany
| |
Collapse
|
37
|
Poonia RC, Gupta MK, Abunadi I, Albraikan AA, Al-Wesabi FN, Hamza MA, B T. Intelligent Diagnostic Prediction and Classification Models for Detection of Kidney Disease. Healthcare (Basel) 2022; 10:healthcare10020371. [PMID: 35206985 PMCID: PMC8871759 DOI: 10.3390/healthcare10020371] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 02/02/2022] [Accepted: 02/03/2022] [Indexed: 11/17/2022] Open
Abstract
Kidney disease is a major public health concern that has only recently emerged. Toxins are removed from the body by the kidneys through urine. In the early stages of the condition, the patient has no problems, but recovery is difficult in the later stages. Doctors must be able to recognize this condition early in order to save the lives of their patients. To detect this illness early on, researchers have used a variety of methods. Prediction analysis based on machine learning has been shown to be more accurate than other methodologies. This research can help us to better understand global disparities in kidney disease, as well as what we can do to address them and coordinate our efforts to achieve global kidney health equity. This study provides an excellent feature-based prediction model for detecting kidney disease. Various machine learning algorithms, including k-nearest neighbors algorithm (KNN), artificial neural networks (ANN), support vector machines (SVM), naive bayes (NB), and others, as well as Re-cursive Feature Elimination (RFE) and Chi-Square test feature-selection techniques, were used to build and analyze various prediction models on a publicly available dataset of healthy and kidney disease patients. The studies found that a logistic regression-based prediction model with optimal features chosen using the Chi-Square technique had the highest accuracy of 98.75 percent. White Blood Cell Count (Wbcc), Blood Glucose Random (bgr), Blood Urea (Bu), Serum Creatinine (Sc), Packed Cell Volume (Pcv), Albumin (Al), Hemoglobin (Hemo), Age, Sugar (Su), Hypertension (Htn), Diabetes Mellitus (Dm), and Blood Pressure (Bp) are examples of these traits.
Collapse
Affiliation(s)
- Ramesh Chandra Poonia
- Department of Computer Science, CHRIST (Deemed to be University), Bangalore 560029, India; (R.C.P.); (T.B.)
| | - Mukesh Kumar Gupta
- Department of Computer Science & Engineering, Swami Keshvanand Institute of Technology, Management & Gramothan (SKIT), Jaipur 302017, India;
| | - Ibrahim Abunadi
- Department of Information Systems, Prince Sultan University, P.O. Box No. 66833 Rafha Street, Riyadh 11586, Saudi Arabia;
| | - Amani Abdulrahman Albraikan
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia;
| | - Fahd N. Al-Wesabi
- Department of Computer Science, College of Science & Art at Mahayil, King Khalid University, Abha 61421, Saudi Arabia
- Correspondence: ; Tel.: +966-534227096
| | - Manar Ahmed Hamza
- Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam bin Abdulaziz University, Al-Kharj 16273, Saudi Arabia;
| | - Tulasi B
- Department of Computer Science, CHRIST (Deemed to be University), Bangalore 560029, India; (R.C.P.); (T.B.)
| |
Collapse
|
38
|
Glomerulus Semantic Segmentation Using Ensemble of Deep Learning Models. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2022. [DOI: 10.1007/s13369-022-06608-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
39
|
Marechal E, Jaugey A, Tarris G, Paindavoine M, Seibel J, Martin L, Funes de la Vega M, Crepin T, Ducloux D, Zanetta G, Felix S, Bonnot PH, Bardet F, Cormier L, Rebibou JM, Legendre M. Automatic Evaluation of Histological Prognostic Factors Using Two Consecutive Convolutional Neural Networks on Kidney Samples. Clin J Am Soc Nephrol 2022; 17:260-270. [PMID: 34862241 PMCID: PMC8823945 DOI: 10.2215/cjn.07830621] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Accepted: 11/16/2021] [Indexed: 02/03/2023]
Abstract
BACKGROUND AND OBJECTIVES The prognosis of patients undergoing kidney tumor resection or kidney donation is linked to many histologic criteria. These criteria notably include glomerular density, glomerular volume, vascular luminal stenosis, and severity of interstitial fibrosis/tubular atrophy. Automated measurements through a deep-learning approach could save time and provide more precise data. This work aimed to develop a free tool to automatically obtain kidney histologic prognostic features. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS In total, 241 samples of healthy kidney tissue were split into three independent cohorts. The "Training" cohort (n=65) was used to train two convolutional neural networks: one to detect the cortex and a second to segment the kidney structures. The "Test" cohort (n=50) assessed their performance by comparing manually outlined regions of interest to predicted ones. The "Application" cohort (n=126) compared prognostic histologic data obtained manually or through the algorithm on the basis of the combination of the two convolutional neural networks. RESULTS In the Test cohort, the networks isolated the cortex and segmented the elements of interest with good performances (>90% of the cortex, healthy tubules, glomeruli, and even globally sclerotic glomeruli were detected). In the Application cohort, the expected and predicted prognostic data were significantly correlated. The correlation coefficients r were 0.85 for glomerular volume, 0.51 for glomerular density, 0.75 for interstitial fibrosis, 0.71 for tubular atrophy, and 0.73 for vascular intimal thickness, respectively. The algorithm had a good ability to predict significant (>25%) tubular atrophy and interstitial fibrosis level (receiver operator characteristic curve with an area under the curve, 0.92 and 0.91, respectively) or a significant vascular luminal stenosis (>50%) (area under the curve, 0.85). CONCLUSION This freely available tool enables the automated segmentation of kidney tissue to obtain prognostic histologic data in a fast, objective, reliable, and reproducible way.
Collapse
Affiliation(s)
- Elise Marechal
- Department of Nephrology, CHU Dijon, France,Université de Bourgogne Franche comté, France,UMR 1098, INCREASE, Besançon, France
| | - Adrien Jaugey
- Université de Bourgogne Franche comté, France,ESIREM school, Dijon, France
| | - Georges Tarris
- Université de Bourgogne Franche comté, France,Department of Pathology, CHU Besançon France
| | - Michel Paindavoine
- Université de Bourgogne Franche comté, France,ESIREM school, Dijon, France,Laboratoire de l’étude de l’apprentissage et du Développement, Dijon, France
| | - Jean Seibel
- Department of Nephrology, CHU Dijon, France,Department of Nephrology, CHU Besançon, France
| | - Laurent Martin
- Université de Bourgogne Franche comté, France,Department of Pathology, CHU Dijon, France
| | | | - Thomas Crepin
- Université de Bourgogne Franche comté, France,UMR 1098, INCREASE, Besançon, France,Department of Nephrology, CHU Besançon, France
| | - Didier Ducloux
- Université de Bourgogne Franche comté, France,UMR 1098, INCREASE, Besançon, France,Department of Nephrology, CHU Besançon, France
| | | | | | | | - Florian Bardet
- Université de Bourgogne Franche comté, France,Department of Urology, CHU Dijon France
| | - Luc Cormier
- Université de Bourgogne Franche comté, France,Department of Urology, CHU Dijon France
| | - Jean-Michel Rebibou
- Department of Nephrology, CHU Dijon, France,Université de Bourgogne Franche comté, France,UMR 1098, INCREASE, Besançon, France
| | - Mathieu Legendre
- Department of Nephrology, CHU Dijon, France,Université de Bourgogne Franche comté, France,UMR 1098, INCREASE, Besançon, France
| |
Collapse
|
40
|
Combination of Transfer Learning Methods for Kidney Glomeruli Image Classification. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12031040] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
The rising global incidence of chronic kidney disease necessitates the development of image categorization of renal glomeruli. COVID-19 has been shown to enter the glomerulus, a tissue structure in the kidney. This study observes the differences between focal-segmental, normal and sclerotic renal glomerular tissue diseases. The splitting and combining of allied and multivariate models was accomplished utilizing a combined technique using existing models. In this study, model combinations are created by using a high-accuracy accuracy-based model to improve other models. This research exhibits excellent accuracy and consistent classification results on the ResNet101V2 combination using a mix of transfer learning methods, with the combined model on ResNet101V2 showing an accuracy of up to 97 percent with an F1-score of 0.97, compared to other models. However, this study discovered that the anticipated time required was higher than the model employed in general, which was mitigated by the usage of high-performance computing in this study.
Collapse
|
41
|
Luo Y, Liang J, Hu X, Tang Z, Zhang J, Han L, Dong Z, Deng W, Miao B, Ren Y, Na N. Deep Learning Algorithms for the Prediction of Posttransplant Renal Function in Deceased-Donor Kidney Recipients: A Preliminary Study Based on Pretransplant Biopsy. Front Med (Lausanne) 2022; 8:676461. [PMID: 35118080 PMCID: PMC8804205 DOI: 10.3389/fmed.2021.676461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Accepted: 12/06/2021] [Indexed: 11/13/2022] Open
Abstract
Background Posttransplant renal function is critically important for kidney transplant recipients. Accurate prediction of graft function would greatly help in deciding acceptance or discard of allocated kidneys. Methods : Whole-slide images (WSIs) of H&E-stained donor kidney biopsies at × 200 magnification between January 2015 and December 2019 were collected. The clinical characteristics of each donor and corresponding recipient were retrieved. Graft function was indexed with a stable estimated glomerular filtration rate (eGFR) and reduced graft function (RGF). We used convolutional neural network (CNN)-based models, such as EfficientNet-B5, Inception-V3, and VGG19 for the prediction of these two outcomes. Results In total, 219 recipients with H&E-stained slides of the donor kidneys were included for analysis [biopsies from standard criteria donor (SCD)/expanded criteria donor (ECD) was 191/28]. The results showed distinct improvements in the prediction performance of the deep learning algorithm plus the clinical characteristics model. The EfficientNet-B5 plus clinical data model showed the lowest mean absolute error (MAE) and root mean square error (RMSE). Compared with the clinical data model, the area under the receiver operating characteristic (ROC) curve (AUC) of the clinical data plus image model for eGFR classification increased from 0.69 to 0.83. In addition, the predictive performance for RGF increased from 0.66 to 0.80. Gradient-weighted class activation mappings (Grad-CAMs) showed that the models localized the areas of the tubules and interstitium near the glomeruli, which were discriminative features for RGF. Conclusion Our results preliminarily show that deep learning for formalin-fixed paraffin-embedded H&E-stained WSIs improves graft function prediction accuracy for deceased-donor kidney transplant recipients.
Collapse
Affiliation(s)
- You Luo
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Jing Liang
- Department of Pathology, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiao Hu
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Zuofu Tang
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Jinhua Zhang
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Lanqing Han
- Artificial Intelligence Innovation Center, Research Institute of Tsinghua, Pearl River Delta, Guangzhou, China
| | - Zhanwen Dong
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Weiming Deng
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Bin Miao
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yong Ren
- Artificial Intelligence Innovation Center, Research Institute of Tsinghua, Pearl River Delta, Guangzhou, China
- Guangdong Provincial Key Laboratory of Digestive Cancer Research, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, China
- *Correspondence: Yong Ren
| | - Ning Na
- Department of Kidney Transplantation, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Ning Na
| |
Collapse
|
42
|
Noriaki S, Eiichiro U, Yasushi O. Artificial Intelligence in Kidney Pathology. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
43
|
Pal A, Chaturvedi A, Chandra A, Chatterjee R, Senapati S, Frangi AF, Garain U. MICaps: Multi-instance capsule network for machine inspection of Munro's microabscess. Comput Biol Med 2022; 140:105071. [PMID: 34864301 DOI: 10.1016/j.compbiomed.2021.105071] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 11/21/2021] [Accepted: 11/22/2021] [Indexed: 02/03/2023]
Abstract
Munro's Microabscess (MM) is the diagnostic hallmark of psoriasis. Neutrophil detection in the Stratum Corneum (SC) of the skin epidermis is an integral part of MM detection in skin biopsy. The microscopic inspection of skin biopsy is a tedious task and staining variations in skin histopathology often hinder human performance to differentiate neutrophils from skin keratinocytes. Motivated from this, we propose a computational framework that can assist human experts and reduce potential errors in diagnosis. The framework first segments the SC layer, and multiple patches are sampled from the segmented regions which are classified to detect neutrophils. Both UNet and CapsNet are used for segmentation and classification. Experiments show that of the two choices, CapsNet, owing to its robustness towards better hierarchical object representation and localisation ability, appears as a better candidate for both segmentation and classification tasks and hence, we termed our framework as MICaps. The training algorithm explores both minimisation of Dice Loss and Focal Loss and makes a comparative study between the two. The proposed framework is validated with our in-house dataset consisting of 290 skin biopsy images. Two different experiments are considered. Under the first protocol, only 3-fold cross-validation is done to directly compare the current results with the state-of-the-art ones. Next, the performance of the system on a held-out data set is reported. The experimental results show that MICaps improves the state-of-the-art diagnosis performance by 3.27% (maximum) and reduces the number of model parameters by 50%.
Collapse
Affiliation(s)
- Anabik Pal
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
| | - Akshay Chaturvedi
- Computer Vision and Pattern Recognition Unit, Indian Statistical Institute, India
| | - Aditi Chandra
- Department of Genetics, University of Pennsylvania Perelman School of Medicine, USA
| | | | | | - Alejandro F Frangi
- Center for Computational Imaging & Simulation Technologies in Biomedicine, University of Leeds, UK
| | - Utpal Garain
- Computer Vision and Pattern Recognition Unit, Indian Statistical Institute, India
| |
Collapse
|
44
|
Gowrishankar S, Gupta K, Maitra D. Whole slide imaging vs eyeballing: The future in quantification of tubular atrophy in routine clinical practice. Indian J Nephrol 2022; 32:151-155. [PMID: 35603119 PMCID: PMC9121712 DOI: 10.4103/ijn.ijn_333_20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2020] [Revised: 09/10/2020] [Accepted: 10/18/2020] [Indexed: 11/04/2022] Open
|
45
|
Lu Y, Yang H, Asad Z, Zhu Z, Yao T, Xu J, Fogo AB, Huo Y. Holistic fine-grained global glomerulosclerosis characterization: from detection to unbalanced classification. J Med Imaging (Bellingham) 2022; 9:014005. [PMID: 35237706 PMCID: PMC8853712 DOI: 10.1117/1.jmi.9.1.014005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 01/25/2022] [Indexed: 11/14/2022] Open
Abstract
Purpose: Recent studies have demonstrated the diagnostic and prognostic values of global glomerulosclerosis (GGS) in IgA nephropathy, aging, and end-stage renal disease. However, the fine-grained quantitative analysis of multiple GGS subtypes (e.g., obsolescent, solidified, and disappearing glomerulosclerosis) is typically a resource extensive manual process. Very few automatic methods, if any, have been developed to bridge this gap for such analytics. We present a holistic pipeline to quantify GGS (with both detection and classification) from a whole slide image in a fully automatic manner. In addition, we conduct the fine-grained classification for the subtypes of GGS. Our study releases the open-source quantitative analytical tool for fine-grained GGS characterization while tackling the technical challenges in unbalanced classification and integrating detection and classification. Approach: We present a deep learning-based framework to perform fine-grained detection and classification of GGS, with a hierarchical two-stage design. Moreover, we incorporate the state-of-the-art transfer learning techniques to achieve a more generalizable deep learning model for tackling the imbalanced distribution of our dataset. This way, we build a highly efficient WSI-to-results GGS characterization pipeline. Meanwhile, we investigated the largest fine-grained GGS cohort as of yet with 11,462 glomeruli and 10,619 nonglomeruli, which include 7841 globally sclerotic glomeruli of three distinct categories. With these data, we apply deep learning techniques to achieve (1) fine-grained GGS characterization, (2) GGS versus non-GGS classification, and (3) improved glomeruli detection results. Results: For fine-grained GGS characterization, when pretrained on the larger dataset, our model can achieve a 0.778-macro- F 1 score, compared to a 0.746-macro- F 1 score when using the regular ImageNet-pretrained weights. On the external dataset, our best model achieves an area under the curve (AUC) score of 0.994 when tasked with differentiating GGS from normal glomeruli. Using our dataset, we are able to build algorithms that allow for fine-grained classification of glomeruli lesions and are robust to distribution shifts. Conclusion: Our study showed that the proposed methods consistently improve the detection and fine-grained classification performance through both cross validation and external validation. Our code and pretrained models have been released for public use at https://github.com/luyuzhe111/glomeruli.
Collapse
Affiliation(s)
- Yuzhe Lu
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, United States
| | - Haichun Yang
- Vanderbilt University Medical Center, Department of Pathology, Microbiology and Immunology, Nashville, United States
| | - Zuhayr Asad
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, United States
| | - Zheyu Zhu
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, United States
| | - Tianyuan Yao
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, United States
| | - Jiachen Xu
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, United States
| | - Agnes B. Fogo
- Vanderbilt University Medical Center, Department of Pathology, Microbiology and Immunology, Nashville, United States
| | - Yuankai Huo
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, United States,Address all correspondence to Yuankai Huo,
| |
Collapse
|
46
|
Loupy A, Mengel M, Haas M. 30 years of the International Banff Classification for Allograft Pathology: The Past, Present and Future of Kidney Transplant Diagnostics. Kidney Int 2021; 101:678-691. [DOI: 10.1016/j.kint.2021.11.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Revised: 10/06/2021] [Accepted: 11/05/2021] [Indexed: 10/19/2022]
|
47
|
Wendler T, van Leeuwen FWB, Navab N, van Oosterom MN. How molecular imaging will enable robotic precision surgery : The role of artificial intelligence, augmented reality, and navigation. Eur J Nucl Med Mol Imaging 2021; 48:4201-4224. [PMID: 34185136 PMCID: PMC8566413 DOI: 10.1007/s00259-021-05445-6] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Accepted: 06/01/2021] [Indexed: 02/08/2023]
Abstract
Molecular imaging is one of the pillars of precision surgery. Its applications range from early diagnostics to therapy planning, execution, and the accurate assessment of outcomes. In particular, molecular imaging solutions are in high demand in minimally invasive surgical strategies, such as the substantially increasing field of robotic surgery. This review aims at connecting the molecular imaging and nuclear medicine community to the rapidly expanding armory of surgical medical devices. Such devices entail technologies ranging from artificial intelligence and computer-aided visualization technologies (software) to innovative molecular imaging modalities and surgical navigation (hardware). We discuss technologies based on their role at different steps of the surgical workflow, i.e., from surgical decision and planning, over to target localization and excision guidance, all the way to (back table) surgical verification. This provides a glimpse of how innovations from the technology fields can realize an exciting future for the molecular imaging and surgery communities.
Collapse
Affiliation(s)
- Thomas Wendler
- Chair for Computer Aided Medical Procedures and Augmented Reality, Technische Universität München, Boltzmannstr. 3, 85748 Garching bei München, Germany
| | - Fijs W. B. van Leeuwen
- Department of Radiology, Interventional Molecular Imaging Laboratory, Leiden University Medical Center, Leiden, The Netherlands
- Department of Urology, The Netherlands Cancer Institute - Antonie van Leeuwenhoek Hospital, Amsterdam, The Netherlands
- Orsi Academy, Melle, Belgium
| | - Nassir Navab
- Chair for Computer Aided Medical Procedures and Augmented Reality, Technische Universität München, Boltzmannstr. 3, 85748 Garching bei München, Germany
- Chair for Computer Aided Medical Procedures Laboratory for Computational Sensing + Robotics, Johns-Hopkins University, Baltimore, MD USA
| | - Matthias N. van Oosterom
- Department of Radiology, Interventional Molecular Imaging Laboratory, Leiden University Medical Center, Leiden, The Netherlands
- Department of Urology, The Netherlands Cancer Institute - Antonie van Leeuwenhoek Hospital, Amsterdam, The Netherlands
| |
Collapse
|
48
|
Li X, Davis RC, Xu Y, Wang Z, Souma N, Sotolongo G, Bell J, Ellis M, Howell D, Shen X, Lafata KJ, Barisoni L. Deep learning segmentation of glomeruli on kidney donor frozen sections. J Med Imaging (Bellingham) 2021; 8:067501. [PMID: 34950750 PMCID: PMC8685284 DOI: 10.1117/1.jmi.8.6.067501] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 11/08/2021] [Indexed: 10/15/2023] Open
Abstract
Purpose: Recent advances in computational image analysis offer the opportunity to develop automatic quantification of histologic parameters as aid tools for practicing pathologists. We aim to develop deep learning (DL) models to quantify nonsclerotic and sclerotic glomeruli on frozen sections from donor kidney biopsies. Approach: A total of 258 whole slide images (WSI) from cadaveric donor kidney biopsies performed at our institution ( n = 123 ) and at external institutions ( n = 135 ) were used in this study. WSIs from our institution were divided at the patient level into training and validation datasets (ratio: 0.8:0.2), and external WSIs were used as an independent testing dataset. Nonsclerotic ( n = 22767 ) and sclerotic ( n = 1366 ) glomeruli were manually annotated by study pathologists on all WSIs. A nine-layer convolutional neural network based on the common U-Net architecture was developed and tested for the segmentation of nonsclerotic and sclerotic glomeruli. DL-derived, manual segmentation, and reported glomerular count (standard of care) were compared. Results: The average Dice similarity coefficient testing was 0.90 and 0.83. And the F 1 , recall, and precision scores were 0.93, 0.96, and 0.90, and 0.87, 0.93, and 0.81, for nonsclerotic and sclerotic glomeruli, respectively. DL-derived and manual segmentation-derived glomerular counts were comparable, but statistically different from reported glomerular count. Conclusions: DL segmentation is a feasible and robust approach for automatic quantification of glomeruli. We represent the first step toward new protocols for the evaluation of donor kidney biopsies.
Collapse
Affiliation(s)
- Xiang Li
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
| | - Richard C. Davis
- Duke University, Department of Pathology, Division of AI and Computational Pathology, Durham, North Carolina, United States
| | - Yuemei Xu
- Duke University, Department of Pathology, Division of AI and Computational Pathology, Durham, North Carolina, United States
- Nanjing Drum Tower Hospital, Department of Pathology, Nanjing, China
| | - Zehan Wang
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Nao Souma
- Duke University, Department of Medicine, Division of Nephrology, Durham, North Carolina, United States
| | - Gina Sotolongo
- Duke University, Department of Pathology, Division of AI and Computational Pathology, Durham, North Carolina, United States
| | - Jonathan Bell
- Duke University, Department of Pathology, Division of AI and Computational Pathology, Durham, North Carolina, United States
| | - Matthew Ellis
- Duke University, Department of Medicine, Division of Nephrology, Durham, North Carolina, United States
- Duke University, Department of Surgery, Durham, North Carolina, United States
| | - David Howell
- Duke University, Department of Pathology, Division of AI and Computational Pathology, Durham, North Carolina, United States
| | - Xiling Shen
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Kyle J. Lafata
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
- Duke University, Department of Radiation Oncology, Durham, North Carolina, United States
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Laura Barisoni
- Duke University, Department of Pathology, Division of AI and Computational Pathology, Durham, North Carolina, United States
- Duke University, Department of Medicine, Division of Nephrology, Durham, North Carolina, United States
| |
Collapse
|
49
|
Yi Z, Salem F, Menon MC, Keung K, Xi C, Hultin S, Haroon Al Rasheed MR, Li L, Su F, Sun Z, Wei C, Huang W, Fredericks S, Lin Q, Banu K, Wong G, Rogers NM, Farouk S, Cravedi P, Shingde M, Smith RN, Rosales IA, O'Connell PJ, Colvin RB, Murphy B, Zhang W. Deep learning identified pathological abnormalities predictive of graft loss in kidney transplant biopsies. Kidney Int 2021; 101:288-298. [PMID: 34757124 DOI: 10.1016/j.kint.2021.09.028] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 08/12/2021] [Accepted: 09/09/2021] [Indexed: 10/19/2022]
Abstract
Interstitial fibrosis, tubular atrophy, and inflammation are major contributors to kidney allograft failure. Here we sought an objective, quantitative pathological assessment of these lesions to improve predictive utility and constructed a deep-learning-based pipeline recognizing normal vs. abnormal kidney tissue compartments and mononuclear leukocyte infiltrates. Periodic acid- Schiff stained slides of transplant biopsies (60 training and 33 testing) were used to quantify pathological lesions specific for interstitium, tubules and mononuclear leukocyte infiltration. The pipeline was applied to the whole slide images from 789 transplant biopsies (478 baseline [pre-implantation] and 311 post-transplant 12-month protocol biopsies) in two independent cohorts (GoCAR: 404 patients, AUSCAD: 212 patients) of transplant recipients to correlate composite lesion features with graft loss. Our model accurately recognized kidney tissue compartments and mononuclear leukocytes. The digital features significantly correlated with revised Banff 2007 scores but were more sensitive to subtle pathological changes below the thresholds in the Banff scores. The Interstitial and Tubular Abnormality Score (ITAS) in baseline samples was highly predictive of one-year graft loss, while a Composite Damage Score in 12-month post-transplant protocol biopsies predicted later graft loss. ITASs and Composite Damage Scores outperformed Banff scores or clinical predictors with superior graft loss prediction accuracy. High/intermediate risk groups stratified by ITASs or Composite Damage Scores also demonstrated significantly higher incidence of estimated glomerular filtration rate decline and subsequent graft damage. Thus, our deep-learning approach accurately detected and quantified pathological lesions from baseline or post-transplant biopsies and demonstrated superior ability for prediction of post-transplant graft loss with potential application as a prevention, risk stratification or monitoring tool.
Collapse
Affiliation(s)
- Zhengzi Yi
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Fadi Salem
- Pathology Division, Department of Molecular and Cell Based Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Madhav C Menon
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA; Nephrology Division, Department of Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Karen Keung
- Centre for Transplant and Renal Research, Westmead Institute for Medical Research, University of Sydney, Sydney, New South Wales, Australia; Department of Nephrology, Prince of Wales Hospital, Sydney, New South Wales, Australia
| | - Caixia Xi
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Sebastian Hultin
- Centre for Transplant and Renal Research, Westmead Institute for Medical Research, University of Sydney, Sydney, New South Wales, Australia
| | - M Rizwan Haroon Al Rasheed
- Pathology Division, Department of Molecular and Cell Based Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Li Li
- Pathology Division, Department of Molecular and Cell Based Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Fei Su
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Zeguo Sun
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Chengguo Wei
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Weiqing Huang
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Samuel Fredericks
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Qisheng Lin
- Nephrology Division, Department of Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Khadija Banu
- Nephrology Division, Department of Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Germaine Wong
- Centre for Transplant and Renal Research, Westmead Institute for Medical Research, University of Sydney, Sydney, New South Wales, Australia
| | - Natasha M Rogers
- Centre for Transplant and Renal Research, Westmead Institute for Medical Research, University of Sydney, Sydney, New South Wales, Australia
| | - Samira Farouk
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Paolo Cravedi
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Meena Shingde
- Centre for Transplant and Renal Research, Westmead Institute for Medical Research, University of Sydney, Sydney, New South Wales, Australia
| | - R Neal Smith
- Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Ivy A Rosales
- Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Philip J O'Connell
- Centre for Transplant and Renal Research, Westmead Institute for Medical Research, University of Sydney, Sydney, New South Wales, Australia; Faculty of Medicine and Health, University of Sydney, Sydney, New South Wales, Australia; Department of Nephrology, Westmead Hospital, Sydney, New South Wales, Australia
| | - Robert B Colvin
- Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Barbara Murphy
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Weijia Zhang
- Renal Division, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA.
| |
Collapse
|
50
|
Zheng Z, Zhang X, Ding J, Zhang D, Cui J, Fu X, Han J, Zhu P. Deep Learning-Based Artificial Intelligence System for Automatic Assessment of Glomerular Pathological Findings in Lupus Nephritis. Diagnostics (Basel) 2021; 11:diagnostics11111983. [PMID: 34829330 PMCID: PMC8621095 DOI: 10.3390/diagnostics11111983] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 10/19/2021] [Accepted: 10/21/2021] [Indexed: 12/14/2022] Open
Abstract
Accurate assessment of renal histopathology is crucial for the clinical management of patients with lupus nephritis (LN). However, the current classification system has poor interpathologist agreement. This paper proposes a deep convolutional neural network (CNN)-based system that detects and classifies glomerular pathological findings in LN. A dataset of 349 renal biopsy whole-slide images (WSIs) (163 patients with LN, periodic acid-Schiff stain, 3906 glomeruli) annotated by three expert nephropathologists was used. The CNN models YOLOv4 and VGG16 were employed to localise the glomeruli and classify glomerular lesions (slight/severe impairments or sclerotic lesions). An additional 321 unannotated WSIs from 161 patients were used for performance evaluation at the per-patient kidney level. The proposed model achieved an accuracy of 0.951 and Cohen's kappa of 0.932 (95% CI 0.915-0.949) for the entire test set for classifying the glomerular lesions. For multiclass detection at the glomerular level, the mean average precision of the CNN was 0.807, with 'slight' and 'severe' glomerular lesions being easily identified (F1: 0.924 and 0.952, respectively). At the per-patient kidney level, the model achieved a high agreement with nephropathologist (linear weighted kappa: 0.855, 95% CI: 0.795-0.916, p < 0.001; quadratic weighted kappa: 0.906, 95% CI: 0.873-0.938, p < 0.001). The results suggest that deep learning is a feasible assistive tool for the objective and automatic assessment of pathological LN lesions.
Collapse
Affiliation(s)
- Zhaohui Zheng
- Department of Clinical Immunology, Xijing Hospital, Fourth Military Medical University, Xi’an 710032, China; (Z.Z.); (J.D.); (X.F.)
| | - Xiangsen Zhang
- School of Automation, Northwestern Polytechnical University, Xi’an 710072, China; (X.Z.); (D.Z.)
| | - Jin Ding
- Department of Clinical Immunology, Xijing Hospital, Fourth Military Medical University, Xi’an 710032, China; (Z.Z.); (J.D.); (X.F.)
| | - Dingwen Zhang
- School of Automation, Northwestern Polytechnical University, Xi’an 710072, China; (X.Z.); (D.Z.)
| | - Jihong Cui
- Lab of Tissue Engineering, College of Life Sciences, Northwest University, Xi’an 710069, China;
| | - Xianghui Fu
- Department of Clinical Immunology, Xijing Hospital, Fourth Military Medical University, Xi’an 710032, China; (Z.Z.); (J.D.); (X.F.)
| | - Junwei Han
- School of Automation, Northwestern Polytechnical University, Xi’an 710072, China; (X.Z.); (D.Z.)
- Correspondence: (J.H.); (P.Z.)
| | - Ping Zhu
- Department of Clinical Immunology, Xijing Hospital, Fourth Military Medical University, Xi’an 710032, China; (Z.Z.); (J.D.); (X.F.)
- Correspondence: (J.H.); (P.Z.)
| |
Collapse
|