1
|
Hosseini MS, Bejnordi BE, Trinh VQH, Chan L, Hasan D, Li X, Yang S, Kim T, Zhang H, Wu T, Chinniah K, Maghsoudlou S, Zhang R, Zhu J, Khaki S, Buin A, Chaji F, Salehi A, Nguyen BN, Samaras D, Plataniotis KN. Computational pathology: A survey review and the way forward. J Pathol Inform 2024; 15:100357. [PMID: 38420608 PMCID: PMC10900832 DOI: 10.1016/j.jpi.2023.100357] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 12/21/2023] [Accepted: 12/23/2023] [Indexed: 03/02/2024] Open
Abstract
Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.
Collapse
Affiliation(s)
- Mahdi S. Hosseini
- Department of Computer Science and Software Engineering (CSSE), Concordia Univeristy, Montreal, QC H3H 2R9, Canada
| | | | - Vincent Quoc-Huy Trinh
- Institute for Research in Immunology and Cancer of the University of Montreal, Montreal, QC H3T 1J4, Canada
| | - Lyndon Chan
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Danial Hasan
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Xingwen Li
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Stephen Yang
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Taehyo Kim
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Haochen Zhang
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Theodore Wu
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Kajanan Chinniah
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Sina Maghsoudlou
- Department of Computer Science and Software Engineering (CSSE), Concordia Univeristy, Montreal, QC H3H 2R9, Canada
| | - Ryan Zhang
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Jiadai Zhu
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Samir Khaki
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| | - Andrei Buin
- Huron Digitial Pathology, St. Jacobs, ON N0B 2N0, Canada
| | - Fatemeh Chaji
- Department of Computer Science and Software Engineering (CSSE), Concordia Univeristy, Montreal, QC H3H 2R9, Canada
| | - Ala Salehi
- Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB E3B 5A3, Canada
| | - Bich Ngoc Nguyen
- University of Montreal Hospital Center, Montreal, QC H2X 0C2, Canada
| | - Dimitris Samaras
- Department of Computer Science, Stony Brook University, Stony Brook, NY 11794, United States
| | - Konstantinos N. Plataniotis
- The Edward S. Rogers Sr. Department of Electrical & Computer Engineering (ECE), University of Toronto, Toronto, ON M5S 3G4, Canada
| |
Collapse
|
2
|
Miura E, Emoto K, Abe T, Hashiguchi A, Hishida T, Asakura K, Sakamoto M. Establishment of artificial intelligence model for precise histological subtyping of lung adenocarcinoma and its application to quantitative and spatial analysis. Jpn J Clin Oncol 2024; 54:1009-1023. [PMID: 38757929 DOI: 10.1093/jjco/hyae066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 05/04/2024] [Indexed: 05/18/2024] Open
Abstract
BACKGROUND The histological subtype of lung adenocarcinoma is a major prognostic factor. We developed a new artificial intelligence model to classify lung adenocarcinoma images into seven histological subtypes and adopted the model for whole-slide images to investigate the relationship between the distribution of histological subtypes and clinicopathological factors. METHODS Using histological subtype images, which are typical for pathologists, we trained and validated an artificial intelligence model. Then, the model was applied to whole-slide images of resected lung adenocarcinoma specimens from 147 cases. RESULT The model achieved an accuracy of 99.7% in training sets and 90.4% in validation sets consisting of typical tiles of histological subtyping for pathologists. When the model was applied to whole-slide images, the predominant subtype according to the artificial intelligence model classification matched that determined by pathologists in 75.5% of cases. The predominant subtype and tumor grade (using the WHO fourth and fifth classifications) determined by the artificial intelligence model resulted in similar recurrence-free survival curves to those determined by pathologists. Furthermore, we stratified the recurrence-free survival curves for patients with different proportions of high-grade components (solid, micropapillary and cribriform) according to the physical distribution of the high-grade component. The results suggested that tumors with centrally located high-grade components had a higher malignant potential (P < 0.001 for 5-20% high-grade component). CONCLUSION The new artificial intelligence model for histological subtyping of lung adenocarcinoma achieved high accuracy, and subtype quantification and subtype distribution analyses could be achieved. Artificial intelligence model therefore has potential for clinical application for both quantification and spatial analysis.
Collapse
Affiliation(s)
- Eisuke Miura
- Department of Pathology, Keio University School of Medicine, Tokyo, Japan
| | - Katsura Emoto
- Department of Pathology, Keio University School of Medicine, Tokyo, Japan
- Department of Diagnostic Pathology, National Hospital Organization Saitama Hospital, Saitama, Japan
| | - Tokiya Abe
- Department of Pathology, Keio University School of Medicine, Tokyo, Japan
| | - Akinori Hashiguchi
- Department of Pathology, Keio University School of Medicine, Tokyo, Japan
| | - Tomoyuki Hishida
- Division of Thoracic Surgery, Department of Surgery, Keio University School of Medicine, Tokyo, Japan
| | - Keisuke Asakura
- Division of Thoracic Surgery, Department of Surgery, Keio University School of Medicine, Tokyo, Japan
| | - Michiie Sakamoto
- Department of Pathology, Keio University School of Medicine, Tokyo, Japan
- School of Medicine, International University of Health and Welfare, Chiba, Japan
| |
Collapse
|
3
|
Tang Y, Yao J, Dong Z, Hu Z, Wu T, Zhang Y. A highly accurate and semi-automated method for quantifying spherical microplastics based on digital slide scanners and image processing. ENVIRONMENTAL RESEARCH 2024; 250:118494. [PMID: 38365061 DOI: 10.1016/j.envres.2024.118494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 01/28/2024] [Accepted: 02/13/2024] [Indexed: 02/18/2024]
Abstract
Microplastics (MPs), the emerging pollutants appeared in water environment, have grabbed significant attention from researchers. The quantitative method of spherical MPs is the premise and key for the study of MPs in laboratory researches. However, the manual counting is time-consuming, and the existing semi-automated analysis lacked of robustness. In this study, a highly accurate quantification method for spherical MPs, called VS120-MC was proposed. VS120-MC consisted of the digital slide scanner VS120 and the MPs image processing software, MPs-Counter. The full-area scanning photography was employed to fundamentally avoid the error caused by random or partition sampling modes. To accomplish high-performance batch recognition, the Weak-Circle Elimination Algorithm (WEA) and the Variable Coefficient Threshold (VCT) was developed. Finally, lower than 0.6% recognition error rate of simulated images with different aggregated indices was achieved by MPs-Counter with fast processing speed (about 2 s/image). The smallest size for VS120-MC to detect was 1 μm. And the applicability of VS120-MC in real water body was investigated. The measured value of 1 μm spherical MPs in ultra-pure water and two kinds of polluted water after digestion showed a good linear relationship with the Manual measurements (R2 = 0.982,0.987 and 0.978, respectively). For 10 μm spherical MPs, R2 reached 0.988 for ultra-pure water and 0.984 for both of the polluted water. MPs-Counter also showed robustness when using the same set of parameters processing the images with different conditions. Overall, VS120-MC eliminated the error caused by traditional photography and realized an accurate, efficient, stable image processing tool, providing a reliable alternative for the quantification of spherical MPs.
Collapse
Affiliation(s)
- Yu Tang
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, 310058, China; Key Laboratory of Drinking Water Safety and Distribution Technology of Zhejiang Province, Hangzhou, 310058, China.
| | - Jie Yao
- Power China Huadong Engineering Corporation Limited, Hangzhou, 311122, China.
| | - Zekun Dong
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, 310058, China; Key Laboratory of Drinking Water Safety and Distribution Technology of Zhejiang Province, Hangzhou, 310058, China.
| | - Zhihui Hu
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, 310058, China; Key Laboratory of Drinking Water Safety and Distribution Technology of Zhejiang Province, Hangzhou, 310058, China.
| | - Tongqing Wu
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, 310058, China; Key Laboratory of Drinking Water Safety and Distribution Technology of Zhejiang Province, Hangzhou, 310058, China.
| | - Yan Zhang
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, 310058, China; Key Laboratory of Drinking Water Safety and Distribution Technology of Zhejiang Province, Hangzhou, 310058, China.
| |
Collapse
|
4
|
D’Abbronzo G, D’Antonio A, De Chiara A, Panico L, Sparano L, Diluvio A, Sica A, Svanera G, Franco R, Ronchi A. Development of an Artificial-Intelligence-Based Tool for Automated Assessment of Cellularity in Bone Marrow Biopsies in Ph-Negative Myeloproliferative Neoplasms. Cancers (Basel) 2024; 16:1687. [PMID: 38730640 PMCID: PMC11083301 DOI: 10.3390/cancers16091687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Revised: 04/22/2024] [Accepted: 04/24/2024] [Indexed: 05/13/2024] Open
Abstract
The cellularity assessment in bone marrow biopsies (BMBs) for the diagnosis of Philadelphia chromosome (Ph)-negative myeloproliferative neoplasms (MPNs) is a key diagnostic feature and is usually performed by the human eyes through an optical microscope with consequent inter-observer and intra-observer variability. Thus, the use of an automated tool may reduce variability, improving the uniformity of the evaluation. The aim of this work is to develop an accurate AI-based tool for the automated quantification of cellularity in BMB histology. A total of 55 BMB histological slides, diagnosed as Ph- MPN between January 2018 and June 2023 from the archives of the Pathology Unit of University "Luigi Vanvitelli" in Naples (Italy), were scanned on Ventana DP200 or Epredia P1000 and exported as whole-slide images (WSIs). Fifteen BMBs were randomly selected to obtain a training set of AI-based tools. An expert pathologist and a trained resident performed annotations of hematopoietic tissue and adipose tissue, and annotations were exported as .tiff images and .png labels with two colors (black for hematopoietic tissue and yellow for adipose tissue). Subsequently, we developed a semantic segmentation model for hematopoietic tissue and adipose tissue. The remaining 40 BMBs were used for model verification. The performance of our model was compared with an evaluation of the cellularity of five expert hematopathologists and three trainees; we obtained an optimal concordance between our model and the expert pathologists' evaluation, with poorer concordance for trainees. There were no significant differences in cellularity assessments between two different scanners.
Collapse
Affiliation(s)
- Giuseppe D’Abbronzo
- Department of Mental and Physical Health and Preventive Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (G.D.); (A.D.); (A.R.)
| | | | - Annarosaria De Chiara
- Histopathology of lymphomas and Sarcoma SSD, Istituto Nazionale dei Tumori I.R.C.C.S. Fondazione “Pascale”, 80131 Naples, Italy;
| | - Luigi Panico
- Pathology Unit, Hospital “Monaldi”, 80131 Naples, Italy;
| | | | - Anna Diluvio
- Department of Mental and Physical Health and Preventive Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (G.D.); (A.D.); (A.R.)
| | - Antonello Sica
- Haematology and Oncology Unit, Vanvitelli Hospital, 80131 Naples, Italy;
| | - Gino Svanera
- Haematology Unit, ASL Na2 North, 80014 Giugliano, Italy;
| | - Renato Franco
- Department of Mental and Physical Health and Preventive Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (G.D.); (A.D.); (A.R.)
- Pathology Unit, Vanvitelli Hospital, 80138 Naples, Italy
| | - Andrea Ronchi
- Department of Mental and Physical Health and Preventive Medicine, Università degli Studi della Campania “Luigi Vanvitelli”, 80138 Naples, Italy; (G.D.); (A.D.); (A.R.)
- Pathology Unit, Vanvitelli Hospital, 80138 Naples, Italy
| |
Collapse
|