1
|
Zhao X, Lai L, Li Y, Zhou X, Cheng X, Chen Y, Huang H, Guo J, Wang G. A lightweight bladder tumor segmentation method based on attention mechanism. Med Biol Eng Comput 2024; 62:1519-1534. [PMID: 38308022 DOI: 10.1007/s11517-024-03018-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 01/05/2024] [Indexed: 02/04/2024]
Abstract
In the endoscopic images of bladder, accurate segmentation of different grade bladder tumor from blurred boundary regions and highly variable shapes is of great significance for doctors' diagnosis and patients' later treatment. We propose a nested attentional feature fusion segmentation network (NAFF-Net) based on the encoder-decoder structure formed by the combination of weighted pyramid pooling module (WPPM) and nested attentional feature fusion (NAFF). Among them, WPPM applies the cascade of atrous convolution to enhance the overall perceptual field while introducing adaptive weights to optimize multi-scale feature extraction, NAFF integrates deep semantic information into shallow feature maps, effectively focusing on edge and detail information in bladder tumor images. Additionally, a weighted mixed loss function is constructed to alleviate the impact of imbalance between positive and negative sample distribution on segmentation accuracy. Experiments illustrate the proposed NAFF-Net achieves better segmentation results compared to other mainstream models, with a MIoU of 84.05%, MPrecision of 91.52%, MRecall of 90.81%, and F1-score of 91.16%, and also achieves good results on the public datasets Kvasir-SEG and CVC-ClinicDB. Compared to other models, NAFF-Net has a smaller number of parameters, which is a significant advantage in model deployment.
Collapse
Affiliation(s)
- Xiushun Zhao
- School of Automation, Guangdong University of Technology, Guangzhou, 510006, China
| | - Libing Lai
- Department of Urology, The First Affiliated Hospital of Nanchang University, Nanchang, 330006, China
| | - Yunjiao Li
- School of Automation, Guangdong University of Technology, Guangzhou, 510006, China
| | - Xiaochen Zhou
- Department of Urology, The First Affiliated Hospital of Nanchang University, Nanchang, 330006, China
| | - Xiaofeng Cheng
- Department of Urology, The First Affiliated Hospital of Nanchang University, Nanchang, 330006, China
| | - Yujun Chen
- Department of Urology, The First Affiliated Hospital of Nanchang University, Nanchang, 330006, China
| | - Haohui Huang
- School of Automation, Guangdong University of Technology, Guangzhou, 510006, China
| | - Jing Guo
- School of Automation, Guangdong University of Technology, Guangzhou, 510006, China.
| | - Gongxian Wang
- Department of Urology, The First Affiliated Hospital of Nanchang University, Nanchang, 330006, China.
| |
Collapse
|
2
|
Jain E, Patel A, Parwani AV, Shafi S, Brar Z, Sharma S, Mohanty SK. Whole Slide Imaging Technology and Its Applications: Current and Emerging Perspectives. Int J Surg Pathol 2024; 32:433-448. [PMID: 37437093 DOI: 10.1177/10668969231185089] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/14/2023]
Abstract
Background. Whole slide imaging (WSI) represents a paradigm shift in pathology, serving as a necessary first step for a wide array of digital tools to enter the field. It utilizes virtual microscopy wherein glass slides are converted into digital slides and are viewed by pathologists by automated image analysis. Its impact on pathology workflow, reproducibility, dissemination of educational material, expansion of service to underprivileged areas, and institutional collaboration exemplifies a significant innovative movement. The recent US Food and Drug Administration approval to WSI for its use in primary surgical pathology diagnosis has opened opportunities for wider application of this technology in routine practice. Main Text. The ongoing technological advances in digital scanners, image visualization methods, and the integration of artificial intelligence-derived algorithms with these systems provide avenues to exploit its applications. Its benefits are innumerable such as ease of access through the internet, avoidance of physical storage space, and no risk of deterioration of staining quality or breakage of slides to name a few. Although the benefits of WSI to pathology practices are many, the complexities of implementation remain an obstacle to widespread adoption. Some barriers including the high cost, technical glitches, and most importantly professional hesitation to adopt a new technology have hindered its use in routine pathology. Conclusions. In this review, we summarize the technical aspects of WSI, its applications in diagnostic pathology, training, and research along with future perspectives. It also highlights improved understanding of the current challenges to implementation, as well as the benefits and successes of the technology. WSI provides a golden opportunity for pathologists to guide its evolution, standardization, and implementation to better acquaint them with the key aspects of this technology and its judicial use. Also, implementation of routine digital pathology is an extra step requiring resources which (currently) does not usually result increased efficiency or payment.
Collapse
Affiliation(s)
- Ekta Jain
- Department of Pathology and Laboratory Medicine, CORE Diagnostics, Gurgaon, India
| | - Ankush Patel
- Department of Pathology, Wexner Medical Center, Columbus, OH, USA
| | - Anil V Parwani
- Department of Pathology, Wexner Medical Center, Columbus, OH, USA
| | - Saba Shafi
- Department of Pathology, Wexner Medical Center, Columbus, OH, USA
| | - Zoya Brar
- Department of Pathology and Laboratory Medicine, CORE Diagnostics, Gurgaon, India
| | - Shivani Sharma
- Department of Pathology and Laboratory Medicine, CORE Diagnostics, Gurgaon, India
| | - Sambit K Mohanty
- Department of Pathology and Laboratory Medicine, CORE Diagnostics, Gurgaon, India
| |
Collapse
|
3
|
Ceachi B, Cioplea M, Mustatea P, Gerald Dcruz J, Zurac S, Cauni V, Popp C, Mogodici C, Sticlaru L, Cioroianu A, Busca M, Stefan O, Tudor I, Dumitru C, Vilaia A, Oprisan A, Bastian A, Nichita L. A New Method of Artificial-Intelligence-Based Automatic Identification of Lymphovascular Invasion in Urothelial Carcinomas. Diagnostics (Basel) 2024; 14:432. [PMID: 38396472 PMCID: PMC10888137 DOI: 10.3390/diagnostics14040432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Revised: 02/07/2024] [Accepted: 02/14/2024] [Indexed: 02/25/2024] Open
Abstract
The presence of lymphovascular invasion (LVI) in urothelial carcinoma (UC) is a poor prognostic finding. This is difficult to identify on routine hematoxylin-eosin (H&E)-stained slides, but considering the costs and time required for examination, immunohistochemical stains for the endothelium are not the recommended diagnostic protocol. We developed an AI-based automated method for LVI identification on H&E-stained slides. We selected two separate groups of UC patients with transurethral resection specimens. Group A had 105 patients (100 with UC; 5 with cystitis); group B had 55 patients (all with high-grade UC; D2-40 and CD34 immunohistochemical stains performed on each block). All the group A slides and 52 H&E cases from group B showing LVI using immunohistochemistry were scanned using an Aperio GT450 automatic scanner. We performed a pixel-per-pixel semantic segmentation of selected areas, and we trained InternImage to identify several classes. The DiceCoefficient and Intersection-over-Union scores for LVI detection using our method were 0.77 and 0.52, respectively. The pathologists' H&E-based evaluation in group B revealed 89.65% specificity, 42.30% sensitivity, 67.27% accuracy, and an F1 score of 0.55, which is much lower than the algorithm's DCC of 0.77. Our model outlines LVI on H&E-stained-slides more effectively than human examiners; thus, it proves a valuable tool for pathologists.
Collapse
Affiliation(s)
- Bogdan Ceachi
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
- Faculty of Automatic Control and Computer Science, National University of Science and Technology Politehnica Bucharest, 313 Splaiul Independenţei, Sector 6, 060042 Bucharest, Romania
| | - Mirela Cioplea
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
| | - Petronel Mustatea
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
- Department of Surgery, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania
| | - Julian Gerald Dcruz
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
| | - Sabina Zurac
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
- Department of Pathology, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania;
| | - Victor Cauni
- Department of Urology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania
| | - Cristiana Popp
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
| | - Cristian Mogodici
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
| | - Liana Sticlaru
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
| | - Alexandra Cioroianu
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
- Department of Pathology, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania;
| | - Mihai Busca
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
| | - Oana Stefan
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
| | - Irina Tudor
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
| | - Carmen Dumitru
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
| | - Alexandra Vilaia
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
- Department of Pathology, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania;
| | - Alexandra Oprisan
- Department of Pathology, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania;
- Department of Neurology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania
| | - Alexandra Bastian
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Department of Pathology, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania;
| | - Luciana Nichita
- Department of Pathology, Colentina University Hospital, 21 Stefan Cel Mare Str., Sector 2, 020125 Bucharest, Romania; (B.C.); (M.C.); (C.P.); (C.M.); (L.S.); (A.C.); (M.B.); (O.S.); (I.T.); (C.D.); (A.V.); (A.B.); (L.N.)
- Zaya Artificial Intelligence, 9A Stefan Cel Mare Str., Voluntari, 077190 Ilfov, Romania; (P.M.); (J.G.D.)
- Department of Pathology, University of Medicine and Pharmacy Carol Davila, 37 Dionisie Lupu Str., Sector 1, 020021 Bucharest, Romania;
| |
Collapse
|
4
|
Gheibi Y, Shirini K, Razavi SN, Farhoudi M, Samad-Soltani T. CNN-Res: deep learning framework for segmentation of acute ischemic stroke lesions on multimodal MRI images. BMC Med Inform Decis Mak 2023; 23:192. [PMID: 37752508 PMCID: PMC10521570 DOI: 10.1186/s12911-023-02289-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2022] [Accepted: 09/04/2023] [Indexed: 09/28/2023] Open
Abstract
BACKGROUND Accurate segmentation of stroke lesions on MRI images is very important for neurologists in the planning of post-stroke care. Segmentation helps clinicians to better diagnose and evaluation of any treatment risks. However, manual segmentation of brain lesions relies on the experience of neurologists and is also a very tedious and time-consuming process. So, in this study, we proposed a novel deep convolutional neural network (CNN-Res) that automatically performs the segmentation of ischemic stroke lesions from multimodal MRIs. METHODS CNN-Res used a U-shaped structure, so the network has encryption and decryption paths. The residual units are embedded in the encoder path. In this model, to reduce gradient descent, the residual units were used, and to extract more complex information in images, multimodal MRI data were applied. In the link between the encryption and decryption subnets, the bottleneck strategy was used, which reduced the number of parameters and training time compared to similar research. RESULTS CNN-Res was evaluated on two distinct datasets. First, it was examined on a dataset collected from the Neuroscience Center of Tabriz University of Medical Sciences, where the average Dice coefficient was equal to 85.43%. Then, to compare the efficiency and performance of the model with other similar works, CNN-Res was evaluated on the popular SPES 2015 competition dataset where the average Dice coefficient was 79.23%. CONCLUSION This study presented a new and accurate method for the segmentation of MRI medical images using a deep convolutional neural network called CNN-Res, which directly predicts segment maps from raw input pixels.
Collapse
Affiliation(s)
- Yousef Gheibi
- Department of Software Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, East Azerbaijan, Iran
| | - Kimia Shirini
- Department of Software Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, East Azerbaijan, Iran
| | - Seyed Naser Razavi
- Department of Software Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, East Azerbaijan, Iran
| | - Mehdi Farhoudi
- Neurosciences Research Center (NSRC), Tabriz University of Medical Sciences, Tabriz, Iran
| | - Taha Samad-Soltani
- Department of Health Information Technology, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran.
| |
Collapse
|
5
|
Khoraminia F, Fuster S, Kanwal N, Olislagers M, Engan K, van Leenders GJLH, Stubbs AP, Akram F, Zuiverloon TCM. Artificial Intelligence in Digital Pathology for Bladder Cancer: Hype or Hope? A Systematic Review. Cancers (Basel) 2023; 15:4518. [PMID: 37760487 PMCID: PMC10526515 DOI: 10.3390/cancers15184518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/30/2023] [Accepted: 09/08/2023] [Indexed: 09/29/2023] Open
Abstract
Bladder cancer (BC) diagnosis and prediction of prognosis are hindered by subjective pathological evaluation, which may cause misdiagnosis and under-/over-treatment. Computational pathology (CPATH) can identify clinical outcome predictors, offering an objective approach to improve prognosis. However, a systematic review of CPATH in BC literature is lacking. Therefore, we present a comprehensive overview of studies that used CPATH in BC, analyzing 33 out of 2285 identified studies. Most studies analyzed regions of interest to distinguish normal versus tumor tissue and identify tumor grade/stage and tissue types (e.g., urothelium, stroma, and muscle). The cell's nuclear area, shape irregularity, and roundness were the most promising markers to predict recurrence and survival based on selected regions of interest, with >80% accuracy. CPATH identified molecular subtypes by detecting features, e.g., papillary structures, hyperchromatic, and pleomorphic nuclei. Combining clinicopathological and image-derived features improved recurrence and survival prediction. However, due to the lack of outcome interpretability and independent test datasets, robustness and clinical applicability could not be ensured. The current literature demonstrates that CPATH holds the potential to improve BC diagnosis and prediction of prognosis. However, more robust, interpretable, accurate models and larger datasets-representative of clinical scenarios-are needed to address artificial intelligence's reliability, robustness, and black box challenge.
Collapse
Affiliation(s)
- Farbod Khoraminia
- Department of Urology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands;
| | - Saul Fuster
- Department of Electrical Engineering and Computer Science, University of Stavanger, 4021 Stavanger, Norway; (S.F.); (N.K.); (K.E.)
| | - Neel Kanwal
- Department of Electrical Engineering and Computer Science, University of Stavanger, 4021 Stavanger, Norway; (S.F.); (N.K.); (K.E.)
| | - Mitchell Olislagers
- Department of Urology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands;
| | - Kjersti Engan
- Department of Electrical Engineering and Computer Science, University of Stavanger, 4021 Stavanger, Norway; (S.F.); (N.K.); (K.E.)
| | - Geert J. L. H. van Leenders
- Department of Pathology and Clinical Bioinformatics, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.J.L.H.v.L.); (A.P.S.); (F.A.)
| | - Andrew P. Stubbs
- Department of Pathology and Clinical Bioinformatics, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.J.L.H.v.L.); (A.P.S.); (F.A.)
| | - Farhan Akram
- Department of Pathology and Clinical Bioinformatics, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.J.L.H.v.L.); (A.P.S.); (F.A.)
| | - Tahlita C. M. Zuiverloon
- Department of Urology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands;
| |
Collapse
|
6
|
Ferro M, Falagario UG, Barone B, Maggi M, Crocetto F, Busetto GM, Giudice FD, Terracciano D, Lucarelli G, Lasorsa F, Catellani M, Brescia A, Mistretta FA, Luzzago S, Piccinelli ML, Vartolomei MD, Jereczek-Fossa BA, Musi G, Montanari E, Cobelli OD, Tataru OS. Artificial Intelligence in the Advanced Diagnosis of Bladder Cancer-Comprehensive Literature Review and Future Advancement. Diagnostics (Basel) 2023; 13:2308. [PMID: 37443700 DOI: 10.3390/diagnostics13132308] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 07/03/2023] [Accepted: 07/05/2023] [Indexed: 07/15/2023] Open
Abstract
Artificial intelligence is highly regarded as the most promising future technology that will have a great impact on healthcare across all specialties. Its subsets, machine learning, deep learning, and artificial neural networks, are able to automatically learn from massive amounts of data and can improve the prediction algorithms to enhance their performance. This area is still under development, but the latest evidence shows great potential in the diagnosis, prognosis, and treatment of urological diseases, including bladder cancer, which are currently using old prediction tools and historical nomograms. This review focuses on highly significant and comprehensive literature evidence of artificial intelligence in the management of bladder cancer and investigates the near introduction in clinical practice.
Collapse
Affiliation(s)
- Matteo Ferro
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
| | - Ugo Giovanni Falagario
- Department of Urology and Organ Transplantation, University of Foggia, 71121 Foggia, Italy
| | - Biagio Barone
- Urology Unit, Department of Surgical Sciences, AORN Sant'Anna e San Sebastiano, 81100 Caserta, Italy
| | - Martina Maggi
- Department of Maternal Infant and Urologic Sciences, Policlinico Umberto I Hospital, Sapienza University of Rome, 00161 Rome, Italy
| | - Felice Crocetto
- Department of Neurosciences and Reproductive Sciences and Odontostomatology, University of Naples Federico II, 80131 Naples, Italy
| | - Gian Maria Busetto
- Department of Urology and Organ Transplantation, University of Foggia, 71121 Foggia, Italy
| | - Francesco Del Giudice
- Department of Maternal Infant and Urologic Sciences, Policlinico Umberto I Hospital, Sapienza University of Rome, 00161 Rome, Italy
| | - Daniela Terracciano
- Department of Translational Medical Sciences, University of Naples "Federico II", 80131 Naples, Italy
| | - Giuseppe Lucarelli
- Urology, Andrology and Kidney Transplantation Unit, Department of Emergency and Organ Transplantation, University of Bari, 70124 Bari, Italy
| | - Francesco Lasorsa
- Urology, Andrology and Kidney Transplantation Unit, Department of Emergency and Organ Transplantation, University of Bari, 70124 Bari, Italy
| | - Michele Catellani
- Department of Urology, ASST Papa Giovanni XXIII, 24127 Bergamo, Italy
| | - Antonio Brescia
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
| | - Francesco Alessandro Mistretta
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Stefano Luzzago
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Mattia Luca Piccinelli
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
| | | | - Barbara Alicja Jereczek-Fossa
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
- Division of Radiation Oncology, IEO-European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Gennaro Musi
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Emanuele Montanari
- Department of Urology, Foundation IRCCS Ca' Granda-Ospedale Maggiore Policlinico, 20122 Milan, Italy
- Department of Clinical Sciences and Community Health, University of Milan, 20122 Milan, Italy
| | - Ottavio de Cobelli
- Department of Urology, IEO-European Institute of Oncology, IRCCS-Istituto di Ricovero e Cura a Carattere Scientifico, 20141 Milan, Italy
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Octavian Sabin Tataru
- Department of Simulation Applied in Medicine, George Emil Palade University of Medicine, Pharmacy, Science and Technology of Târgu Mures, 540142 Târgu Mures, Romania
| |
Collapse
|
7
|
Ameen YA, Badary DM, Abonnoor AEI, Hussain KF, Sewisy AA. Which data subset should be augmented for deep learning? a simulation study using urothelial cell carcinoma histopathology images. BMC Bioinformatics 2023; 24:75. [PMID: 36869300 PMCID: PMC9983182 DOI: 10.1186/s12859-023-05199-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Accepted: 02/21/2023] [Indexed: 03/05/2023] Open
Abstract
BACKGROUND Applying deep learning to digital histopathology is hindered by the scarcity of manually annotated datasets. While data augmentation can ameliorate this obstacle, its methods are far from standardized. Our aim was to systematically explore the effects of skipping data augmentation; applying data augmentation to different subsets of the whole dataset (training set, validation set, test set, two of them, or all of them); and applying data augmentation at different time points (before, during, or after dividing the dataset into three subsets). Different combinations of the above possibilities resulted in 11 ways to apply augmentation. The literature contains no such comprehensive systematic comparison of these augmentation ways. RESULTS Non-overlapping photographs of all tissues on 90 hematoxylin-and-eosin-stained urinary bladder slides were obtained. Then, they were manually classified as either inflammation (5948 images), urothelial cell carcinoma (5811 images), or invalid (3132 images; excluded). If done, augmentation was eight-fold by flipping and rotation. Four convolutional neural networks (Inception-v3, ResNet-101, GoogLeNet, and SqueezeNet), pre-trained on the ImageNet dataset, were fine-tuned to binary classify images of our dataset. This task was the benchmark for our experiments. Model testing performance was evaluated using accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve. Model validation accuracy was also estimated. The best testing performance was achieved when augmentation was done to the remaining data after test-set separation, but before division into training and validation sets. This leaked information between the training and the validation sets, as evidenced by the optimistic validation accuracy. However, this leakage did not cause the validation set to malfunction. Augmentation before test-set separation led to optimistic results. Test-set augmentation yielded more accurate evaluation metrics with less uncertainty. Inception-v3 had the best overall testing performance. CONCLUSIONS In digital histopathology, augmentation should include both the test set (after its allocation), and the remaining combined training/validation set (before being split into separate training and validation sets). Future research should try to generalize our results.
Collapse
Affiliation(s)
- Yusra A Ameen
- Department of Computer Science, Faculty of Computers and Information, Assiut University, Asyut, Egypt.
| | - Dalia M Badary
- Department of Pathology, Faculty of Medicine, Assiut University, Asyut, Egypt
| | | | - Khaled F Hussain
- Department of Computer Science, Faculty of Computers and Information, Assiut University, Asyut, Egypt
| | - Adel A Sewisy
- Department of Computer Science, Faculty of Computers and Information, Assiut University, Asyut, Egypt
| |
Collapse
|
8
|
Parwani AV, Patel A, Zhou M, Cheville JC, Tizhoosh H, Humphrey P, Reuter VE, True LD. An update on computational pathology tools for genitourinary pathology practice: A review paper from the Genitourinary Pathology Society (GUPS). J Pathol Inform 2023; 14:100177. [PMID: 36654741 PMCID: PMC9841212 DOI: 10.1016/j.jpi.2022.100177] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Revised: 12/20/2022] [Accepted: 12/20/2022] [Indexed: 12/31/2022] Open
Abstract
Machine learning has been leveraged for image analysis applications throughout a multitude of subspecialties. This position paper provides a perspective on the evolutionary trajectory of practical deep learning tools for genitourinary pathology through evaluating the most recent iterations of such algorithmic devices. Deep learning tools for genitourinary pathology demonstrate potential to enhance prognostic and predictive capacity for tumor assessment including grading, staging, and subtype identification, yet limitations in data availability, regulation, and standardization have stymied their implementation.
Collapse
Affiliation(s)
- Anil V. Parwani
- The Ohio State University, Columbus, Ohio, USA
- Corresponding author.
| | - Ankush Patel
- The Ohio State University, 2441 60th Ave SE, Mercer Island, Washington 98040, USA
| | - Ming Zhou
- Tufts University, Medford, Massachusetts, USA
| | | | | | | | | | | |
Collapse
|
9
|
Su Z, Tavolara TE, Carreno-Galeano G, Lee SJ, Gurcan MN, Niazi M. Attention2majority: Weak multiple instance learning for regenerative kidney grading on whole slide images. Med Image Anal 2022; 79:102462. [PMID: 35512532 PMCID: PMC10382794 DOI: 10.1016/j.media.2022.102462] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 04/11/2022] [Accepted: 04/13/2022] [Indexed: 10/18/2022]
Abstract
Deep learning consistently demonstrates high performance in classifying and segmenting medical images like CT, PET, and MRI. However, compared to these kinds of images, whole slide images (WSIs) of stained tissue sections are huge and thus much less efficient to process, especially for deep learning algorithms. To overcome these challenges, we present attention2majority, a weak multiple instance learning model to automatically and efficiently process WSIs for classification. Our method initially assigns exhaustively sampled label-free patches with the label of the respective WSIs and trains a convolutional neural network to perform patch-wise classification. Then, an intelligent sampling method is performed in which patches with high confidence are collected to form weak representations of WSIs. Lastly, we apply a multi-head attention-based multiple instance learning model to do slide-level classification based on high-confidence patches (intelligently sampled patches). Attention2majority was trained and tested on classifying the quality of 127 WSIs (of regenerated kidney sections) into three categories. On average, attention2majority resulted in 97.4%±2.4 AUC for the four-fold cross-validation. We demonstrate that the intelligent sampling module within attention2majority is superior to the current state-of-the-art random sampling method. Furthermore, we show that the replacement of random sampling with intelligent sampling in attention2majority results in its performance boost (from 94.9%±3.1 to 97.4%±2.4 average AUC for the four-fold cross-validation). We also tested a variation of attention2majority on the famous Camelyon16 dataset, which resulted in 89.1%±0.8 AUC1. When compared to random sampling, the attention2majority demonstrated excellent slide-level interpretability. It also provided an efficient framework to arrive at a multi-class slide-level prediction.
Collapse
|
10
|
Artificial intelligence: A promising frontier in bladder cancer diagnosis and outcome prediction. Crit Rev Oncol Hematol 2022; 171:103601. [DOI: 10.1016/j.critrevonc.2022.103601] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Revised: 01/12/2022] [Accepted: 01/17/2022] [Indexed: 02/07/2023] Open
|