1
|
Ramkumar M, Sarath Kumar R, Padmapriya R, Balu Mahandiran S. Improved DeTraC Binary Coyote Net-Based Multiple Instance Learning for Predicting Lymph Node Metastasis of Breast Cancer From Whole-Slide Pathological Images. Int J Med Robot 2024; 20:e70009. [PMID: 39545354 DOI: 10.1002/rcs.70009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 10/22/2024] [Accepted: 10/28/2024] [Indexed: 11/17/2024]
Abstract
BACKGROUND Early detection of lymph node metastasis in breast cancer is vital for improving treatment outcomes and prognosis. METHODS This study introduces an Improved Decompose, Transfer, and Compose Binary Coyote Net-based Multiple Instance Learning (ImDeTraC-BCNet-MIL) method for predicting lymph node metastasis from Whole Slide Images (WSIs) using multiple instance learning. The method involves segmenting WSIs into patches using Otsu and double-dimensional clustering techniques. The developed multiple instance learning approach introduces a paradigm into computational pathology by shaping pathological data and constructing features. ImDeTraC-BCNet-MIL was utilised for feature generation during both training and testing to differentiate lymph node metastasis in WSIs. RESULTS The proposed model achieves the highest accuracy of 95.3% and 99.8%, precision values of 98% and 99.8%, and recall rates of 92.9% and 99.8% on the Camelyon16 and Camelyon17 datasets. CONCLUSIONS These findings underscore the effectiveness of ImDeTraC-BCNet-MIL in enhancing the early detection of lymph node metastasis in breast cancer.
Collapse
Affiliation(s)
- M Ramkumar
- Electronics and Communication Engineering, Sri Krishna College of Engineering and Technology, Coimbatore, India
| | - R Sarath Kumar
- Electronics and Communication Engineering, Sri Krishna College of Engineering and Technology, Coimbatore, India
| | - R Padmapriya
- Electronics and Communication Engineering, Sri Aurobindo Centenary E.M High School, Tadipatri, India
| | - S Balu Mahandiran
- Mechanical Engineering, Sri Krishna College of Engineering and Technology, Coimbatore, India
| |
Collapse
|
2
|
Abe M, Kanavati F, Tsuneki M. Evaluation of a Deep Learning Model for Metastatic Squamous Cell Carcinoma Prediction From Whole Slide Images. Arch Pathol Lab Med 2024; 148:1344-1351. [PMID: 38387604 DOI: 10.5858/arpa.2023-0406-oa] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/28/2023] [Indexed: 02/24/2024]
Abstract
CONTEXT.— Squamous cell carcinoma (SCC) is a histologic type of cancer that exhibits various degrees of keratinization. Identifying lymph node metastasis in SCC is crucial for prognosis and treatment strategies. Although artificial intelligence (AI) has shown promise in cancer prediction, applications specifically targeting SCC are limited. OBJECTIVE.— To design and validate a deep learning model tailored to predict metastatic SCC in radical lymph node dissection specimens using whole slide images (WSIs). DESIGN.— Using the EfficientNetB1 architecture, a model was trained on 6587 WSIs (2413 SCC and 4174 nonneoplastic) from several hospitals, encompassing esophagus, head and neck, lung, and skin specimens. The training exclusively relied on WSI-level labels without annotations. We evaluated the model on a test set consisting of 541 WSIs (41 SCC and 500 nonneoplastic) of radical lymph node dissection specimens. RESULTS.— The model exhibited high performance, with receiver operating characteristic curve areas under the curve between 0.880 and 0.987 in detecting SCC metastases in lymph nodes. Although true positives and negatives were accurately identified, certain limitations were observed. These included false positives due to germinal centers, dust cell aggregations, and specimen-handling artifacts, as well as false negatives due to poor differentiation. CONCLUSIONS.— The developed artificial intelligence model presents significant potential in enhancing SCC lymph node detection, offering workload reduction for pathologists and increasing diagnostic efficiency. Continuous refinement is needed to overcome existing challenges, making the model more robust and clinically relevant.
Collapse
Affiliation(s)
- Makoto Abe
- From the Department of Pathology, Tochigi Cancer Center, Tochigi, Japan (Abe)
| | - Fahdi Kanavati
- Medmain Research, Medmain Inc, Fukuoka, Japan (Kanavati, Tsuneki)
| | - Masayuki Tsuneki
- Medmain Research, Medmain Inc, Fukuoka, Japan (Kanavati, Tsuneki)
| |
Collapse
|
3
|
Siarov J, Siarov A, Kumar D, Paoli J, Mölne J, Neittaanmäki N. Deep learning model shows pathologist-level detection of sentinel node metastasis of melanoma and intra-nodal nevi on whole slide images. Front Med (Lausanne) 2024; 11:1418013. [PMID: 39238597 PMCID: PMC11374739 DOI: 10.3389/fmed.2024.1418013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Accepted: 07/29/2024] [Indexed: 09/07/2024] Open
Abstract
Introduction Nodal metastasis (NM) in sentinel node biopsies (SNB) is crucial for melanoma staging. However, an intra-nodal nevus (INN) may often be misclassified as NM, leading to potential misdiagnosis and incorrect staging. There is high discordance among pathologists in assessing SNB positivity, which may lead to false staging. Digital whole slide imaging offers the potential for implementing artificial intelligence (AI) in digital pathology. In this study, we assessed the capability of AI to detect NM and INN in SNBs. Methods A total of 485 hematoxylin and eosin whole slide images (WSIs), including NM and INN from 196 SNBs, were collected and divided into training (279 WSIs), validation (89 WSIs), and test sets (117 WSIs). A deep learning model was trained with 5,956 manual pixel-wise annotations. The AI and three blinded dermatopathologists assessed the test set, with immunohistochemistry serving as the reference standard. Results The AI model showed excellent performance with an area under the curve receiver operating characteristic (AUC) of 0.965 for detecting NM. In comparison, the AUC for NM detection among dermatopathologists ranged between 0.94 and 0.98. For the detection of INN, the AUC was lower for both AI (0.781) and dermatopathologists (range of 0.63-0.79). Discussion In conclusion, the deep learning AI model showed excellent accuracy in detecting NM, achieving dermatopathologist-level performance in detecting both NM and INN. Importantly, the AI model showed the potential to differentiate between these two entities. However, further validation is warranted.
Collapse
Affiliation(s)
- Jan Siarov
- Department of Laboratory Medicine, Institute of Biomedicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Department of Clinical Pathology, Sahlgrenska University Hospital, Region Västra Götaland, Gothenburg, Sweden
| | - Angelica Siarov
- Department of Clinical Pathology, Sahlgrenska University Hospital, Region Västra Götaland, Gothenburg, Sweden
| | | | - John Paoli
- Department of Dermatology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Department of Dermatology and Venereology, Sahlgrenska University Hospital, Region Västra Götaland, Gothenburg, Sweden
| | - Johan Mölne
- Department of Laboratory Medicine, Institute of Biomedicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Department of Clinical Pathology, Sahlgrenska University Hospital, Region Västra Götaland, Gothenburg, Sweden
| | - Noora Neittaanmäki
- Department of Laboratory Medicine, Institute of Biomedicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Department of Clinical Pathology, Sahlgrenska University Hospital, Region Västra Götaland, Gothenburg, Sweden
| |
Collapse
|
4
|
Giammanco A, Bychkov A, Schallenberg S, Tsvetkov T, Fukuoka J, Pryalukhin A, Mairinger F, Seper A, Hulla W, Klein S, Quaas A, Büttner R, Tolkach Y. Fast-Track Development and Multi-Institutional Clinical Validation of an Artificial Intelligence Algorithm for Detection of Lymph Node Metastasis in Colorectal Cancer. Mod Pathol 2024; 37:100496. [PMID: 38636778 DOI: 10.1016/j.modpat.2024.100496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Revised: 03/24/2024] [Accepted: 04/10/2024] [Indexed: 04/20/2024]
Abstract
Lymph node metastasis (LNM) detection can be automated using artificial intelligence (AI)-based diagnostic tools. Only limited studies have addressed this task for colorectal cancer (CRC). This study aimed to develop of a clinical-grade digital pathology tool for LNM detection in CRC using the original fast-track framework. The training cohort included 432 slides from one department. A segmentation algorithm detecting 8 relevant tissue classes was trained. The test cohorts consisted of materials from 5 pathology departments digitized by 4 different scanning systems. A high-quality, large training data set was generated within 7 days and a minimal amount of annotation work using fast-track principles. The AI tool showed very high accuracy for LNM detection in all cohorts, with sensitivity, negative predictive value, and specificity ranges of 0.980 to 1.000, 0.997 to 1.000, and 0.913 to 0.990, correspondingly. Only 5 of 14,460 analyzed test slides with tumor cells over all cohorts were classified as false negative (3/5 representing clusters of tumor cells in lymphatic vessels). A clinical-grade tool was trained in a short time using fast-track development principles and validated using the largest international, multi-institutional, multiscanner cohort of cases to date, showing very high precision for LNM detection in CRC. We are releasing a part of the test data sets to facilitate academic research.
Collapse
Affiliation(s)
- Avri Giammanco
- Institute of Pathology, University Hospital Cologne, Cologne, Germany
| | - Andrey Bychkov
- Department of Pathology, Kameda Medical Center, Kamogawa, Japan; Department of Pathology Informatics, Nagasaki University, Nagasaki, Japan
| | | | - Tsvetan Tsvetkov
- Institute of Pathology, University Hospital Cologne, Cologne, Germany
| | - Junya Fukuoka
- Department of Pathology, Kameda Medical Center, Kamogawa, Japan; Department of Pathology Informatics, Nagasaki University, Nagasaki, Japan
| | - Alexey Pryalukhin
- Institute of Pathology, Wiener Neustadt State Hospital, Wiener Neustadt, Austria
| | - Fabian Mairinger
- Institute of Pathology, University Hospital Essen, Essen, Germany
| | - Alexander Seper
- Institute of Pathology, Wiener Neustadt State Hospital, Wiener Neustadt, Austria; Danube Private University, Wien, Austria
| | - Wolfgang Hulla
- Institute of Pathology, Wiener Neustadt State Hospital, Wiener Neustadt, Austria
| | - Sebastian Klein
- Institute of Pathology, University Hospital Cologne, Cologne, Germany
| | - Alexander Quaas
- Institute of Pathology, University Hospital Cologne, Cologne, Germany
| | - Reinhard Büttner
- Institute of Pathology, University Hospital Cologne, Cologne, Germany
| | - Yuri Tolkach
- Institute of Pathology, University Hospital Cologne, Cologne, Germany.
| |
Collapse
|
5
|
Mondello A, Dal Bo M, Toffoli G, Polano M. Machine learning in onco-pharmacogenomics: a path to precision medicine with many challenges. Front Pharmacol 2024; 14:1260276. [PMID: 38264526 PMCID: PMC10803549 DOI: 10.3389/fphar.2023.1260276] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 12/26/2023] [Indexed: 01/25/2024] Open
Abstract
Over the past two decades, Next-Generation Sequencing (NGS) has revolutionized the approach to cancer research. Applications of NGS include the identification of tumor specific alterations that can influence tumor pathobiology and also impact diagnosis, prognosis and therapeutic options. Pharmacogenomics (PGx) studies the role of inheritance of individual genetic patterns in drug response and has taken advantage of NGS technology as it provides access to high-throughput data that can, however, be difficult to manage. Machine learning (ML) has recently been used in the life sciences to discover hidden patterns from complex NGS data and to solve various PGx problems. In this review, we provide a comprehensive overview of the NGS approaches that can be employed and the different PGx studies implicating the use of NGS data. We also provide an excursus of the ML algorithms that can exert a role as fundamental strategies in the PGx field to improve personalized medicine in cancer.
Collapse
Affiliation(s)
| | | | | | - Maurizio Polano
- Experimental and Clinical Pharmacology Unit, Centro di Riferimento Oncologico di Aviano (CRO), Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS), Aviano, Italy
| |
Collapse
|
6
|
Wu L, Wu H, Li C, Zhang B, Li X, Zhen Y, Li H. Radiomics in colorectal cancer. IRADIOLOGY 2023; 1:236-244. [DOI: 10.1002/ird3.29] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 07/25/2023] [Indexed: 08/23/2024]
Abstract
AbstractColorectal cancer (CRC) is a global health challenge with high morbidity and mortality. Radiomics, an emerging field, utilizes quantitative imaging features extracted from medical images for CRC diagnosis, staging, treatment response assessment, and prognostication. This review highlights the potential of radiomics for personalized CRC management. Radiomics enables noninvasive tumor characterization, aiding in early detection and accurate diagnosis, and it can be used to predict tumor stage, lymph node involvement, and prognosis. Furthermore, radiomics guides personalized therapies by assessing the treatment response and identifying patients who could benefit. Challenges include standardizing imaging protocols and analysis techniques. Robust validation frameworks and user‐friendly software are needed for the integration of radiomics into clinical practice. Despite challenges, radiomics offers valuable insights into tumor biology, treatment response, and prognosis in CRC. Overcoming technical and clinical hurdles will unlock its full potential in CRC management.
Collapse
Affiliation(s)
- Long Wu
- Department of Anus and Intestinal Surgery The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Huan Wu
- Department of Infectious Diseases The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Chen Li
- Department of Biology, Chemistry, Pharmacy Free University of Berlin Berlin Germany
| | - Baofang Zhang
- Department of Infectious Diseases The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Xiaoyun Li
- Department of Anus and Intestinal Surgery The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Yunhuan Zhen
- Department of Anus and Intestinal Surgery The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Haiyang Li
- Department of Hepatobiliary Surgery The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| |
Collapse
|