1
|
Bukowski M, Kurek J, Świderski B, Jegorowa A. Custom Loss Functions in XGBoost Algorithm for Enhanced Critical Error Mitigation in Drill-Wear Analysis of Melamine-Faced Chipboard. SENSORS (BASEL, SWITZERLAND) 2024; 24:1092. [PMID: 38400250 PMCID: PMC10891790 DOI: 10.3390/s24041092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 01/29/2024] [Accepted: 02/06/2024] [Indexed: 02/25/2024]
Abstract
The advancement of machine learning in industrial applications has necessitated the development of tailored solutions to address specific challenges, particularly in multi-class classification tasks. This study delves into the customization of loss functions within the eXtreme Gradient Boosting (XGBoost) algorithm, which is a critical step in enhancing the algorithm's performance for specific applications. Our research is motivated by the need for precision and efficiency in the industrial domain, where the implications of misclassification can be substantial. We focus on the drill-wear analysis of melamine-faced chipboard, a common material in furniture production, to demonstrate the impact of custom loss functions. The paper explores several variants of Weighted Softmax Loss Functions, including Edge Penalty and Adaptive Weighted Softmax Loss, to address the challenges of class imbalance and the heightened importance of accurately classifying edge classes. Our findings reveal that these custom loss functions significantly reduce critical errors in classification without compromising the overall accuracy of the model. This research not only contributes to the field of industrial machine learning by providing a nuanced approach to loss function customization but also underscores the importance of context-specific adaptations in machine learning algorithms. The results showcase the potential of tailored loss functions in balancing precision and efficiency, ensuring reliable and effective machine learning solutions in industrial settings.
Collapse
Affiliation(s)
- Michał Bukowski
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland; (M.B.); (B.Ś.)
| | - Jarosław Kurek
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland; (M.B.); (B.Ś.)
| | - Bartosz Świderski
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland; (M.B.); (B.Ś.)
| | - Albina Jegorowa
- Institute of Wood Sciences and Furniture, Warsaw University of Life Sciences, 02-787 Warsaw, Poland;
| |
Collapse
|
2
|
Knudsen JE, Rich JM, Ma R. Artificial Intelligence in Pathomics and Genomics of Renal Cell Carcinoma. Urol Clin North Am 2024; 51:47-62. [PMID: 37945102 DOI: 10.1016/j.ucl.2023.06.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2023]
Abstract
The integration of artificial intelligence (AI) with histopathology images and gene expression patterns has led to the emergence of the dynamic fields of pathomics and genomics. These fields have revolutionized renal cell carcinoma (RCC) diagnosis and subtyping and improved survival prediction models. Machine learning has identified unique gene patterns across RCC subtypes and grades, providing insights into RCC origins and potential treatments, as targeted therapies. The combination of pathomics and genomics using AI opens new avenues in RCC research, promising future breakthroughs and innovations that patients and physicians can anticipate.
Collapse
Affiliation(s)
- J Everett Knudsen
- Catherine & Joseph Aresty Department of Urology, USC Institute of Urology, Center for Robotic Simulation & Education, University of Southern California, Los Angeles, CA, USA
| | - Joseph M Rich
- Catherine & Joseph Aresty Department of Urology, USC Institute of Urology, Center for Robotic Simulation & Education, University of Southern California, Los Angeles, CA, USA
| | - Runzhuo Ma
- Catherine & Joseph Aresty Department of Urology, USC Institute of Urology, Center for Robotic Simulation & Education, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
3
|
Ivanova E, Fayzullin A, Grinin V, Ermilov D, Arutyunyan A, Timashev P, Shekhter A. Empowering Renal Cancer Management with AI and Digital Pathology: Pathology, Diagnostics and Prognosis. Biomedicines 2023; 11:2875. [PMID: 38001875 PMCID: PMC10669631 DOI: 10.3390/biomedicines11112875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Revised: 09/26/2023] [Accepted: 10/09/2023] [Indexed: 11/26/2023] Open
Abstract
Renal cell carcinoma is a significant health burden worldwide, necessitating accurate and efficient diagnostic methods to guide treatment decisions. Traditional pathology practices have limitations, including interobserver variability and time-consuming evaluations. In recent years, digital pathology tools emerged as a promising solution to enhance the diagnosis and management of renal cancer. This review aims to provide a comprehensive overview of the current state and potential of digital pathology in the context of renal cell carcinoma. Through advanced image analysis algorithms, artificial intelligence (AI) technologies facilitate quantification of cellular and molecular markers, leading to improved accuracy and reproducibility in renal cancer diagnosis. Digital pathology platforms empower remote collaboration between pathologists and help with the creation of comprehensive databases for further research and machine learning applications. The integration of digital pathology tools with other diagnostic modalities, such as radiology and genomics, enables a novel multimodal characterization of different types of renal cell carcinoma. With continuous advancements and refinement, AI technologies are expected to play an integral role in diagnostics and clinical decision-making, improving patient outcomes. In this article, we explored the digital pathology instruments available for clear cell, papillary and chromophobe renal cancers from pathologist and data analyst perspectives.
Collapse
Affiliation(s)
- Elena Ivanova
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya St., Moscow 119991, Russia; (E.I.); (A.F.); (P.T.)
- B. V. Petrovsky Russian Research Center of Surgery, 2 Abrikosovskiy Lane, Moscow 119991, Russia
| | - Alexey Fayzullin
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya St., Moscow 119991, Russia; (E.I.); (A.F.); (P.T.)
| | - Victor Grinin
- PJSC VimpelCom, 10, 8th March Street, Moscow 127083, Russia; (V.G.); (D.E.); (A.A.)
| | - Dmitry Ermilov
- PJSC VimpelCom, 10, 8th March Street, Moscow 127083, Russia; (V.G.); (D.E.); (A.A.)
| | - Alexander Arutyunyan
- PJSC VimpelCom, 10, 8th March Street, Moscow 127083, Russia; (V.G.); (D.E.); (A.A.)
| | - Peter Timashev
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya St., Moscow 119991, Russia; (E.I.); (A.F.); (P.T.)
| | - Anatoly Shekhter
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya St., Moscow 119991, Russia; (E.I.); (A.F.); (P.T.)
| |
Collapse
|
4
|
Antoniuk I, Kurek J, Krupa A, Wieczorek G, Bukowski M, Kruk M, Jegorowa A. Advanced Feature Extraction Methods from Images of Drillings in Melamine Faced Chipboard for Automatic Diagnosis of Drill Wear. SENSORS (BASEL, SWITZERLAND) 2023; 23:1109. [PMID: 36772151 PMCID: PMC9918907 DOI: 10.3390/s23031109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 01/07/2023] [Accepted: 01/16/2023] [Indexed: 06/18/2023]
Abstract
In this paper, a novel approach to evaluation of feature extraction methodologies is presented. In the case of machine learning algorithms, extracting and using the most efficient features is one of the key problems that can significantly influence overall performance. It is especially the case with parameter-heavy problems, such as tool condition monitoring. In the presented case, images of drilled holes are considered, where state of the edge and the overall size of imperfections have high influence on product quality. Finding and using a set of features that accurately describes the differences between the edge that is acceptable or too damaged is not always straightforward. The presented approach focuses on detailed evaluation of various feature extraction approaches. Each chosen method produced a set of features, which was then used to train a selected set of classifiers. Five initial feature sets were obtained, and additional ones were derived from them. Different voting methods were used for ensemble approaches. In total, 38 versions of the classifiers were created and evaluated. Best accuracy was obtained by the ensemble approach based on Weighted Voting methodology. A significant difference was shown between different feature extraction methods, with a total difference of 11.14% between the worst and best feature set, as well as a further 0.2% improvement achieved by using the best voting approach.
Collapse
Affiliation(s)
- Izabella Antoniuk
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland
| | - Jarosław Kurek
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland
| | - Artur Krupa
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland
| | - Grzegorz Wieczorek
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland
| | - Michał Bukowski
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland
| | - Michał Kruk
- Institute of Information Technology, Warsaw University of Life Sciences, 02-776 Warsaw, Poland
| | - Albina Jegorowa
- Institute of Wood Sciences and Furniture, Warsaw University of Life Sciences, 02-787 Warszawa, Poland
| |
Collapse
|
5
|
Alzoubi I, Bao G, Zheng Y, Wang X, Graeber MB. Artificial intelligence techniques for neuropathological diagnostics and research. Neuropathology 2022. [PMID: 36443935 DOI: 10.1111/neup.12880] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 10/17/2022] [Accepted: 10/23/2022] [Indexed: 12/03/2022]
Abstract
Artificial intelligence (AI) research began in theoretical neurophysiology, and the resulting classical paper on the McCulloch-Pitts mathematical neuron was written in a psychiatry department almost 80 years ago. However, the application of AI in digital neuropathology is still in its infancy. Rapid progress is now being made, which prompted this article. Human brain diseases represent distinct system states that fall outside the normal spectrum. Many differ not only in functional but also in structural terms, and the morphology of abnormal nervous tissue forms the traditional basis of neuropathological disease classifications. However, only a few countries have the medical specialty of neuropathology, and, given the sheer number of newly developed histological tools that can be applied to the study of brain diseases, a tremendous shortage of qualified hands and eyes at the microscope is obvious. Similarly, in neuroanatomy, human observers no longer have the capacity to process the vast amounts of connectomics data. Therefore, it is reasonable to assume that advances in AI technology and, especially, whole-slide image (WSI) analysis will greatly aid neuropathological practice. In this paper, we discuss machine learning (ML) techniques that are important for understanding WSI analysis, such as traditional ML and deep learning, introduce a recently developed neuropathological AI termed PathoFusion, and present thoughts on some of the challenges that must be overcome before the full potential of AI in digital neuropathology can be realized.
Collapse
Affiliation(s)
- Islam Alzoubi
- School of Computer Science The University of Sydney Sydney New South Wales Australia
| | - Guoqing Bao
- School of Computer Science The University of Sydney Sydney New South Wales Australia
| | - Yuqi Zheng
- Ken Parker Brain Tumour Research Laboratories Brain and Mind Centre, Faculty of Medicine and Health, University of Sydney Camperdown New South Wales Australia
| | - Xiuying Wang
- School of Computer Science The University of Sydney Sydney New South Wales Australia
| | - Manuel B. Graeber
- Ken Parker Brain Tumour Research Laboratories Brain and Mind Centre, Faculty of Medicine and Health, University of Sydney Camperdown New South Wales Australia
| |
Collapse
|
6
|
Alzoubi I, Bao G, Zhang R, Loh C, Zheng Y, Cherepanoff S, Gracie G, Lee M, Kuligowski M, Alexander KL, Buckland ME, Wang X, Graeber MB. An Open-Source AI Framework for the Analysis of Single Cells in Whole-Slide Images with a Note on CD276 in Glioblastoma. Cancers (Basel) 2022; 14:3441. [PMID: 35884502 PMCID: PMC9316952 DOI: 10.3390/cancers14143441] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 07/10/2022] [Accepted: 07/13/2022] [Indexed: 02/04/2023] Open
Abstract
Routine examination of entire histological slides at cellular resolution poses a significant if not insurmountable challenge to human observers. However, high-resolution data such as the cellular distribution of proteins in tissues, e.g., those obtained following immunochemical staining, are highly desirable. Our present study extends the applicability of the PathoFusion framework to the cellular level. We illustrate our approach using the detection of CD276 immunoreactive cells in glioblastoma as an example. Following automatic identification by means of PathoFusion's bifocal convolutional neural network (BCNN) model, individual cells are automatically profiled and counted. Only discriminable cells selected through data filtering and thresholding were segmented for cell-level analysis. Subsequently, we converted the detection signals into the corresponding heatmaps visualizing the distribution of the detected cells in entire whole-slide images of adjacent H&E-stained sections using the Discrete Wavelet Transform (DWT). Our results demonstrate that PathoFusion is capable of autonomously detecting and counting individual immunochemically labelled cells with a high prediction performance of 0.992 AUC and 97.7% accuracy. The data can be used for whole-slide cross-modality analyses, e.g., relationships between immunochemical signals and anaplastic histological features. PathoFusion has the potential to be applied to additional problems that seek to correlate heterogeneous data streams and to serve as a clinically applicable, weakly supervised system for histological image analyses in (neuro)pathology.
Collapse
Affiliation(s)
- Islam Alzoubi
- School of Computer Science, The University of Sydney, J12/1 Cleveland St, Sydney, NSW 2008, Australia; (I.A.); (G.B.); (R.Z.)
| | - Guoqing Bao
- School of Computer Science, The University of Sydney, J12/1 Cleveland St, Sydney, NSW 2008, Australia; (I.A.); (G.B.); (R.Z.)
| | - Rong Zhang
- School of Computer Science, The University of Sydney, J12/1 Cleveland St, Sydney, NSW 2008, Australia; (I.A.); (G.B.); (R.Z.)
| | - Christina Loh
- Ken Parker Brain Tumour Research Laboratories, Brain and Mind Centre, Faculty of Medicine and Health, University of Sydney, Camperdown, NSW 2050, Australia; (C.L.); (Y.Z.)
| | - Yuqi Zheng
- Ken Parker Brain Tumour Research Laboratories, Brain and Mind Centre, Faculty of Medicine and Health, University of Sydney, Camperdown, NSW 2050, Australia; (C.L.); (Y.Z.)
| | - Svetlana Cherepanoff
- St Vincent’s Hospital, Victoria Street, Darlinghurst, NSW 2010, Australia; (S.C.); (G.G.)
| | - Gary Gracie
- St Vincent’s Hospital, Victoria Street, Darlinghurst, NSW 2010, Australia; (S.C.); (G.G.)
| | - Maggie Lee
- Department of Neuropathology, RPA Hospital and Brain and Mind Centre, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW 2006, Australia; (M.L.); (K.L.A.); (M.E.B.)
| | - Michael Kuligowski
- Sydney Microscopy and Microanalysis, The University of Sydney, Sydney, NSW 2006, Australia;
| | - Kimberley L. Alexander
- Department of Neuropathology, RPA Hospital and Brain and Mind Centre, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW 2006, Australia; (M.L.); (K.L.A.); (M.E.B.)
- Neurosurgery Department, Chris O’Brien Lifehouse, Camperdown, NSW 2050, Australia
- School of Medical Sciences, Faculty of Medicine and Health, University of Sydney, Camperdown, NSW 2050, Australia
| | - Michael E. Buckland
- Department of Neuropathology, RPA Hospital and Brain and Mind Centre, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW 2006, Australia; (M.L.); (K.L.A.); (M.E.B.)
| | - Xiuying Wang
- School of Computer Science, The University of Sydney, J12/1 Cleveland St, Sydney, NSW 2008, Australia; (I.A.); (G.B.); (R.Z.)
| | - Manuel B. Graeber
- Ken Parker Brain Tumour Research Laboratories, Brain and Mind Centre, Faculty of Medicine and Health, University of Sydney, Camperdown, NSW 2050, Australia; (C.L.); (Y.Z.)
| |
Collapse
|
7
|
Fan X, Sun Z, Tian E. Histological image color normalization using a skewed normal distribution mixed model. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:441-451. [PMID: 35297428 DOI: 10.1364/josaa.446221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Accepted: 02/01/2022] [Indexed: 06/14/2023]
Abstract
Color variation between histological images may influence the performance of computer-aided histological image analysis. Therefore, among the most essential and challenging tasks in histological image analysis are the reduction of the color variation between images and the preservation of the histological information contained in the images. In recent years, many methods have been introduced with respect to the color normalization of histological images. In this study, we introduce a new clustering method referred to as the skewed normal distribution mixed model clustering algorithm. Realizing that the color distribution of hue values approximates the combination of several skewed normal distributions, we propose to use the skewed normal distribution mixture model to analyze the hue distribution. The proposed skewed normal distribution mixture model clustering algorithm includes saturation-weighted hue histograms because it takes into account the saturation and hue information of a particular histogram image, which can diminish the influence of achromatic pixels. Finally, we conducted extensive experiments based on three data sets and compared them with commonly used color normalization methods. The experiments show that the proposed algorithm has better performance in stain separation and color normalization compared to other methods.
Collapse
|
8
|
Wu Y, Cheng M, Huang S, Pei Z, Zuo Y, Liu J, Yang K, Zhu Q, Zhang J, Hong H, Zhang D, Huang K, Cheng L, Shao W. Recent Advances of Deep Learning for Computational Histopathology: Principles and Applications. Cancers (Basel) 2022; 14:1199. [PMID: 35267505 PMCID: PMC8909166 DOI: 10.3390/cancers14051199] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 02/16/2022] [Accepted: 02/22/2022] [Indexed: 01/10/2023] Open
Abstract
With the remarkable success of digital histopathology, we have witnessed a rapid expansion of the use of computational methods for the analysis of digital pathology and biopsy image patches. However, the unprecedented scale and heterogeneous patterns of histopathological images have presented critical computational bottlenecks requiring new computational histopathology tools. Recently, deep learning technology has been extremely successful in the field of computer vision, which has also boosted considerable interest in digital pathology applications. Deep learning and its extensions have opened several avenues to tackle many challenging histopathological image analysis problems including color normalization, image segmentation, and the diagnosis/prognosis of human cancers. In this paper, we provide a comprehensive up-to-date review of the deep learning methods for digital H&E-stained pathology image analysis. Specifically, we first describe recent literature that uses deep learning for color normalization, which is one essential research direction for H&E-stained histopathological image analysis. Followed by the discussion of color normalization, we review applications of the deep learning method for various H&E-stained image analysis tasks such as nuclei and tissue segmentation. We also summarize several key clinical studies that use deep learning for the diagnosis and prognosis of human cancers from H&E-stained histopathological images. Finally, online resources and open research problems on pathological image analysis are also provided in this review for the convenience of researchers who are interested in this exciting field.
Collapse
Affiliation(s)
- Yawen Wu
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Michael Cheng
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN 46202, USA; (M.C.); (J.Z.); (K.H.)
- Regenstrief Institute, Indiana University, Indianapolis, IN 46202, USA
| | - Shuo Huang
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Zongxiang Pei
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Yingli Zuo
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Jianxin Liu
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Kai Yang
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Qi Zhu
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Jie Zhang
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN 46202, USA; (M.C.); (J.Z.); (K.H.)
- Regenstrief Institute, Indiana University, Indianapolis, IN 46202, USA
| | - Honghai Hong
- Department of Clinical Laboratory, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou 510006, China;
| | - Daoqiang Zhang
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| | - Kun Huang
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN 46202, USA; (M.C.); (J.Z.); (K.H.)
- Regenstrief Institute, Indiana University, Indianapolis, IN 46202, USA
| | - Liang Cheng
- Departments of Pathology and Laboratory Medicine, Indiana University School of Medicine, Indianapolis, IN 46202, USA
| | - Wei Shao
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China; (Y.W.); (S.H.); (Z.P.); (Y.Z.); (J.L.); (K.Y.); (Q.Z.); (D.Z.)
| |
Collapse
|
9
|
Brodie A, Dai N, Teoh JYC, Decaestecker K, Dasgupta P, Vasdev N. Artificial intelligence in urological oncology: An update and future applications. Urol Oncol 2021; 39:379-399. [PMID: 34024704 DOI: 10.1016/j.urolonc.2021.03.012] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Revised: 12/20/2020] [Accepted: 03/21/2021] [Indexed: 01/16/2023]
Abstract
There continues to be rapid developments and research in the field of Artificial Intelligence (AI) in Urological Oncology worldwide. In this review we discuss the basics of AI, application of AI per tumour group (Renal, Prostate and Bladder Cancer) and application of AI in Robotic Urological Surgery. We also discuss future applications of AI being developed with the benefits to patients with Urological Oncology.
Collapse
Affiliation(s)
- Andrew Brodie
- Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
| | - Nick Dai
- Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
| | - Jeremy Yuen-Chun Teoh
- S.H. Ho Urology Centre, Department of Surgery, The Chinese University of Hong Kong, Hong Kong, China
| | | | - Prokar Dasgupta
- Faculty of Life Sciences and Medicine, King's College London, London, United Kingdom
| | - Nikhil Vasdev
- Hertfordshire and Bedfordshire Urological Cancer Centre, Department of Urology, Lister Hospital, Stevenage, United Kingdom; School of Medicine and Life Sciences, University of Hertfordshire, Hatfield, United Kingdom.
| |
Collapse
|
10
|
Abstract
Histopathological images (HIs) are the gold standard for evaluating some types of tumors for cancer diagnosis. The analysis of such images is time and resource-consuming and very challenging even for experienced pathologists, resulting in inter-observer and intra-observer disagreements. One of the ways of accelerating such an analysis is to use computer-aided diagnosis (CAD) systems. This paper presents a review on machine learning methods for histopathological image analysis, including shallow and deep learning methods. We also cover the most common tasks in HI analysis, such as segmentation and feature extraction. Besides, we present a list of publicly available and private datasets that have been used in HI research.
Collapse
|
11
|
Shafiei S, Safarpoor A, Jamalizadeh A, Tizhoosh HR. Class-Agnostic Weighted Normalization of Staining in Histopathology Images Using a Spatially Constrained Mixture Model. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:3355-3366. [PMID: 32386145 DOI: 10.1109/tmi.2020.2992108] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The colorless biopsied tissue samples are usually stained in order to visualize different microscopic structures for diagnostic purposes. But color variations associated with the process of sample preparation, usage of raw materials, diverse staining protocols, and using different slide scanners may adversely influence both visual inspection and computer-aided image analysis. As a result, many methods are proposed for histopathology image stain normalization in recent years. In this study, we introduce a novel approach for stain normalization based on learning a mixture of multivariate skew-normal distributions for stain clustering and parameter estimation alongside a stain transformation technique. The proposed method, labeled "Class-Agnostic Weighted Normalization" (short CLAW normalization), has the ability to normalize a source image by learning the color distribution of both source and target images within an expectation-maximization framework. The novelty of this approach is its flexibility to quantify the underlying both symmetric and nonsymmetric distributions of the different stain components while it is considering the spatial information. The performance of this new stain normalization scheme is tested on several publicly available digital pathology datasets to compare it against state-of-the-art normalization algorithms in terms of ability to preserve the image structure and information. All in all, our proposed method performed superior more consistently in comparison with existing methods in terms of information preservation, visual quality enhancement, and boosting computer-aided diagnosis algorithm performance.
Collapse
|
12
|
Holdbrook DA, Singh M, Choudhury Y, Kalaw EM, Koh V, Tan HS, Kanesvaran R, Tan PH, Peng JYS, Tan MH, Lee HK. Automated Renal Cancer Grading Using Nuclear Pleomorphic Patterns. JCO Clin Cancer Inform 2019; 2:1-12. [PMID: 30652593 DOI: 10.1200/cci.17.00100] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023] Open
Abstract
PURPOSE Nuclear pleomorphic patterns are essential for Fuhrman grading of clear cell renal cell carcinoma (ccRCC). Manual observation of renal histopathologic slides may lead to subjective and inconsistent assessment between pathologists. An automated, image-based system that classifies ccRCC slides by quantifying nuclear pleomorphic patterns in an objective and consistent interpretable fashion can aid pathologists in histopathologic assessment. METHODS In the current study, histopathologic tissue slides of 59 patients with ccRCC who underwent surgery at Singapore General Hospital were assembled retrospectively. An automated image classification pipeline detects and analyzes prominent nucleoli in ccRCC images to classify them as either low (Fuhrman grade 1 and 2) or high (Fuhrman grade 3 and 4). The pipeline uses machine learning and image pixel intensity-based feature extraction techniques for nuclear analysis. We trained classification systems that concurrently analyze different permutations of multiple prominent nucleoli image patches. RESULTS Given the parameters for feature combination and extraction, we present experimental results across various configurations for the classification of a given ccRCC histopathologic image. We also demonstrate that the image score used by the pipeline, termed fraction value, is correlated ( R = 0.59) with an existing multigene assay-based scoring system that has previously been demonstrated to be a strong indicator of prognosis in patients with ccRCC. CONCLUSION The current method provides an objective and fully automated way by which to process pathologic slides. The correlation study with a multigene assay-based scoring system also allows us to provide quantitative interpretation for already established nuclear pleomorphic patterns in ccRCC. This method can be extended to other cancers whose corresponding grading systems use nuclear pattern information.
Collapse
Affiliation(s)
- Daniel Aitor Holdbrook
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Malay Singh
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Yukti Choudhury
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Emarene Mationg Kalaw
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Valerie Koh
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Hui Shan Tan
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Ravindran Kanesvaran
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Puay Hoon Tan
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - John Yuen Shyi Peng
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Min-Han Tan
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| | - Hwee Kuan Lee
- Daniel Aitor Holdbrook, Malay Singh, Emarene Mationg Kalaw, and Hwee Kuan Lee, Bioinformatics Institute; Malay Singh and Hwee Kuan Lee, National University of Singapore; Yukti Choudhury and Min-Han Tan, Lucence Diagnostics; Yukti Choudhury and Min-Han Tan, Institute of Bioengineering and Nanotechnology; Valerie Koh, Puay Hoon Tan, and John Yuen Shyi Peng, Singapore General Hospital; Hui Shan Tan, Ravindran Kanesvaran, and Min-Han Tan, National Cancer Center Singapore; and Hwee Kuan Lee, Institute for Infocomm Research, Singapore
| |
Collapse
|
13
|
Tian K, Rubadue CA, Lin DI, Veta M, Pyle ME, Irshad H, Heng YJ. Automated clear cell renal carcinoma grade classification with prognostic significance. PLoS One 2019; 14:e0222641. [PMID: 31581201 PMCID: PMC6776313 DOI: 10.1371/journal.pone.0222641] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2019] [Accepted: 09/04/2019] [Indexed: 01/31/2023] Open
Abstract
We developed an automated 2-tiered Fuhrman's grading system for clear cell renal cell carcinoma (ccRCC). Whole slide images (WSI) and clinical data were retrieved for 395 The Cancer Genome Atlas (TCGA) ccRCC cases. Pathologist 1 reviewed and selected regions of interests (ROIs). Nuclear segmentation was performed. Quantitative morphological, intensity, and texture features (n = 72) were extracted. Features associated with grade were identified by constructing a Lasso model using data from cases with concordant 2-tiered Fuhrman's grades between TCGA and Pathologist 1 (training set n = 235; held-out test set n = 42). Discordant cases (n = 118) were additionally reviewed by Pathologist 2. Cox proportional hazard model evaluated the prognostic efficacy of the predicted grades in an extended test set which was created by combining the test set and discordant cases (n = 160). The Lasso model consisted of 26 features and predicted grade with 84.6% sensitivity and 81.3% specificity in the test set. In the extended test set, predicted grade was significantly associated with overall survival after adjusting for age and gender (Hazard Ratio 2.05; 95% CI 1.21-3.47); manual grades were not prognostic. Future work can adapt our computational system to predict WHO/ISUP grades, and validating this system on other ccRCC cohorts.
Collapse
Affiliation(s)
- Katherine Tian
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, United States of America
- The Harker School, San Jose, CA, United States of America
| | - Christopher A. Rubadue
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, United States of America
| | - Douglas I. Lin
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, United States of America
| | - Mitko Veta
- Medical Image Analysis Group, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Michael E. Pyle
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, United States of America
| | - Humayun Irshad
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, United States of America
| | - Yujing J. Heng
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, United States of America
- Cancer Research Institute, Beth Israel Deaconess Cancer Center, Boston, MA, United States of America
| |
Collapse
|
14
|
Shahid AH, Singh M. Computational intelligence techniques for medical diagnosis and prognosis: Problems and current developments. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2019.05.010] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
15
|
Roy S, Kumar Jain A, Lal S, Kini J. A study about color normalization methods for histopathology images. Micron 2018; 114:42-61. [PMID: 30096632 DOI: 10.1016/j.micron.2018.07.005] [Citation(s) in RCA: 61] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2018] [Revised: 07/07/2018] [Accepted: 07/16/2018] [Indexed: 11/16/2022]
Abstract
Histopathology images are used for the diagnosis of the cancerous disease by the examination of tissue with the help of Whole Slide Imaging (WSI) scanner. A decision support system works well by the analysis of the histopathology images but a lot of problems arise in its decision. Color variation in the histopathology images is occurring due to use of the different scanner, use of various equipments, different stain coloring and reactivity from a different manufacturer. In this paper, detailed study and performance evaluation of color normalization methods on histopathology image datasets are presented. Color normalization of the source image by transferring the mean color of the target image in the source image and also to separate stain present in the source image. Stain separation and color normalization of the histopathology images can be helped for both pathology and computerized decision support system. Quality performances of different color normalization methods are evaluated and compared in terms of quaternion structure similarity index matrix (QSSIM), structure similarity index matrix (SSIM) and Pearson correlation coefficient (PCC) on various histopathology image datasets. Our experimental analysis suggests that structure-preserving color normalization (SPCN) provides better qualitatively and qualitatively results in comparison to the all the presented methods for breast and colorectal cancer histopathology image datasets.
Collapse
Affiliation(s)
- Santanu Roy
- Department of E&C Engineering, National Institute of Technology Karnataka, Surathkal, Mangalore-575025, India.
| | - Alok Kumar Jain
- Department of E&C Engineering, National Institute of Technology Karnataka, Surathkal, Mangalore-575025, India.
| | - Shyam Lal
- Department of E&C Engineering, National Institute of Technology Karnataka, Surathkal, Mangalore-575025, India.
| | - Jyoti Kini
- Department of Pathology, Kasturba Medical College, Mangalore, Manipal Academy of Higher Education, Karnataka, 575001, India.
| |
Collapse
|