1
|
Timakova A, Ananev V, Fayzullin A, Zemnuhov E, Rumyantsev E, Zharov A, Zharkov N, Zotova V, Shchelokova E, Demura T, Timashev P, Makarov V. LVI-PathNet: Segmentation-classification pipeline for detection of lymphovascular invasion in whole slide images of lung adenocarcinoma. J Pathol Inform 2024; 15:100395. [PMID: 39328468 PMCID: PMC11426154 DOI: 10.1016/j.jpi.2024.100395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Revised: 08/20/2024] [Accepted: 08/27/2024] [Indexed: 09/28/2024] Open
Abstract
Lymphovascular invasion (LVI) in lung cancer is a significant prognostic factor that influences treatment and outcomes, yet its reliable detection is challenging due to interobserver variability. This study aims to develop a deep learning model for LVI detection using whole slide images (WSIs) and evaluate its effectiveness within a pathologist's information system. Experienced pathologists annotated blood vessels and invading tumor cells in 162 WSIs of non-mucinous lung adenocarcinoma sourced from two external and one internal datasets. Two models were trained to segment vessels and identify images with LVI features. DeepLabV3+ model achieved an Intersection-over-Union of 0.8840 and an area under the receiver operating characteristic curve (AUC-ROC) of 0.9869 in vessel segmentation. For LVI classification, the ensemble model achieved a F1-score of 0.9683 and an AUC-ROC of 0.9987. The model demonstrated robustness and was unaffected by variations in staining and image quality. The pilot study showed that pathologists' evaluation time for LVI detecting decreased by an average of 16.95%, and by 21.5% in "hard cases". The model facilitated consistent diagnostic assessments, suggesting potential for broader applications in detecting pathological changes in blood vessels and other lung pathologies.
Collapse
Affiliation(s)
- Anna Timakova
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Vladislav Ananev
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Alexey Fayzullin
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Egor Zemnuhov
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Egor Rumyantsev
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Andrey Zharov
- Helmholtz National Medical Research Center for Eye Diseases, 14/19 Sadovaya- Chernogryazskaya, Moscow 105062, Russia
| | - Nicolay Zharkov
- Institute for Morphology and Digital Pathology, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Varvara Zotova
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Elena Shchelokova
- Institute for Morphology and Digital Pathology, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Tatiana Demura
- Institute for Morphology and Digital Pathology, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Peter Timashev
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
- World-Class Research Center “Digital Biodesign and Personalized Healthcare”, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Vladimir Makarov
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| |
Collapse
|
2
|
Kludt C, Wang Y, Ahmad W, Bychkov A, Fukuoka J, Gaisa N, Kühnel M, Jonigk D, Pryalukhin A, Mairinger F, Klein F, Schultheis AM, Seper A, Hulla W, Brägelmann J, Michels S, Klein S, Quaas A, Büttner R, Tolkach Y. Next-generation lung cancer pathology: Development and validation of diagnostic and prognostic algorithms. Cell Rep Med 2024; 5:101697. [PMID: 39178857 PMCID: PMC11524894 DOI: 10.1016/j.xcrm.2024.101697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 06/25/2024] [Accepted: 07/31/2024] [Indexed: 08/26/2024]
Abstract
Non-small cell lung cancer (NSCLC) is one of the most common malignant tumors. In this study, we develop a clinically useful computational pathology platform for NSCLC that can be a foundation for multiple downstream applications and provide immediate value for patient care optimization and individualization. We train the primary multi-class tissue segmentation algorithm on a substantial, high-quality, manually annotated dataset of whole-slide images with lung adenocarcinoma and squamous cell carcinomas. We investigate two downstream applications. NSCLC subtyping algorithm is trained and validated using a large, multi-institutional (n = 6), multi-scanner (n = 5), international cohort of NSCLC cases (slides/patients 4,097/1,527). Moreover, we develop four AI-derived, fully explainable, quantitative, prognostic parameters (based on tertiary lymphoid structure and necrosis assessment) and validate them for different clinical endpoints. The computational platform enables the high-precision, quantitative analysis of H&E-stained slides. The developed prognostic parameters facilitate robust and independent risk stratification of patients with NSCLC.
Collapse
Affiliation(s)
- Carina Kludt
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany
| | - Yuan Wang
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany
| | - Waleed Ahmad
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany
| | - Andrey Bychkov
- Department of Pathology, Kameda Medical Center, Kamogawa 296-0041, Japan; Department of Pathology Informatics, Nagasaki University, Nagasaki 852-8131, Japan
| | - Junya Fukuoka
- Department of Pathology, Kameda Medical Center, Kamogawa 296-0041, Japan; Department of Pathology Informatics, Nagasaki University, Nagasaki 852-8131, Japan
| | - Nadine Gaisa
- Institute of Pathology, University Hospital Aachen, 52074 Aachen, Germany; Institute of Pathology, University Hospital Ulm, 89081 Ulm, Germany
| | - Mark Kühnel
- Institute of Pathology, University Hospital Aachen, 52074 Aachen, Germany
| | - Danny Jonigk
- Institute of Pathology, University Hospital Aachen, 52074 Aachen, Germany; German Center for Lung Research, DZL, BREATH, 30625 Hanover, Germany
| | - Alexey Pryalukhin
- Institute of Clinical Pathology and Molecular Pathology, Wiener Neustadt State Hospital, 2700 Wiener Neustadt, Austria
| | - Fabian Mairinger
- Institute of Pathology, University Hospital Essen, 45147 Essen, Germany
| | - Franziska Klein
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany
| | - Anne Maria Schultheis
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany; Medical Faculty University of Cologne, 50937 Cologne, Germany
| | - Alexander Seper
- Institute of Clinical Pathology and Molecular Pathology, Wiener Neustadt State Hospital, 2700 Wiener Neustadt, Austria; Danube Private University, 3500 Krems an der Donau, Austria
| | - Wolfgang Hulla
- Institute of Clinical Pathology and Molecular Pathology, Wiener Neustadt State Hospital, 2700 Wiener Neustadt, Austria
| | - Johannes Brägelmann
- University of Cologne, Faculty of Medicine and University Hospital Cologne, Department of Translational Genomics, 50937 Cologne, Germany; Mildred Scheel School of Oncology, Faculty of Medicine and University Hospital Cologne, University of Cologne, 50937 Cologne, Germany; University of Cologne, Faculty of Medicine and University Hospital Cologne, Center for Molecular Medicine Cologne, 50937 Cologne, Germany
| | - Sebastian Michels
- University of Cologne, Faculty of Medicine and University Hospital of Colone, Lung Cancer Group Cologne, Department I for Internal Medicine and Center for Integrated Oncology Aachen Bonn Cologne Dusseldorf, 50937 Cologne, Germany
| | - Sebastian Klein
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany; Medical Faculty University of Cologne, 50937 Cologne, Germany
| | - Alexander Quaas
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany; Medical Faculty University of Cologne, 50937 Cologne, Germany
| | - Reinhard Büttner
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany; Medical Faculty University of Cologne, 50937 Cologne, Germany.
| | - Yuri Tolkach
- Institute of Pathology, University Hospital Cologne, 50937 Cologne, Germany; Medical Faculty University of Cologne, 50937 Cologne, Germany.
| |
Collapse
|
3
|
Kenaan N, Hanna G, Sardini M, Iyoun MO, Layka K, Hannouneh ZA, Alshehabi Z. Advances in early detection of non-small cell lung cancer: A comprehensive review. Cancer Med 2024; 13:e70156. [PMID: 39300939 PMCID: PMC11413414 DOI: 10.1002/cam4.70156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Revised: 08/11/2024] [Accepted: 08/18/2024] [Indexed: 09/22/2024] Open
Abstract
BACKGROUND Lung cancer has the highest mortality rate among malignancies globally. In addition, due to the growing number of smokers there is considerable concern over its growth. Early detection is an essential step towards reducing complications in this regard and helps to ensure the most effective treatment, reduce health care costs, and increase survival rates. AIMS To define the most efficient and cost-effective method of early detection in clinical practice. MATERIALS AND METHODS We collected the Information used to write this review by searching papers through PUBMED that were published from 2021 to 2024, mainly systematic reviews, meta-analyses and clinical-trials. We also included other older but notable papers that we found essential and valuable for understanding. RESULTS EB-OCT has a varied sensitivity and specificity-an average of 94.3% and 89.9 for each. On the other hand, detecting biomarkers via liquid biopsy carries an average sensitivity of 91.4% for RNA molecules detection, and 97% for combined methylated DNA panels. Moreover, CTCs detection did not prove to have a significant role as a screening method due to the rarity of CTCs in the bloodstream thus the need for more blood samples and for enrichment techniques. DISCUSSION Although low-dose CT scan (LDCT) is the current golden standard screening procedure, it is accompanied by a highly false positive rate. In comparison to other radiological screening methods, Endobronchial optical coherence tomography (EB-OCT) has shown a noticeable advantage with a significant degree of accuracy in distinguishing between subtypes of non-small cell lung cancer. Moreover, numerous biomarkers, including RNA molecules, circulating tumor cells, CTCs, and methylated DNA, have been studied in the literature. Many of these biomarkers have a specific high sensitivity and specificity, making them potential candidates for future early detection approaches. CONCLUSION LDCT is still the golden standard and the only recommended screening procedure for its high sensitivity and specificity and proven cost-effectiveness. Nevertheless, the notable false positive results acquired during the LDCT examination caused a presumed concern, which drives researchers to investigate better screening procedures and approaches, particularly with the rise of the AI era or by combining two methods in a well-studied screening program like LDCT and liquid biopsy. we suggest conducting more clinical studies on larger populations with a clear demographical target and adopting approaches for combining one of these new methods with LDCT to decrease false-positive cases in early detection.
Collapse
Affiliation(s)
- Nour Kenaan
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Faculty of MedicineTishreen UniversityLattakiaSyrian Arab Republic
| | - George Hanna
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Faculty of MedicineTishreen UniversityLattakiaSyrian Arab Republic
| | - Moustafa Sardini
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Faculty of MedicineTishreen UniversityLattakiaSyrian Arab Republic
| | - Mhd Omar Iyoun
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Faculty of MedicineTishreen UniversityLattakiaSyrian Arab Republic
| | - Khedr Layka
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Department of pathologyTishreen University hospitalLattakiaSyrian Arab Republic
| | - Zein Alabdin Hannouneh
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Faculty of MedicineAl Andalus University for Medical SciencesTartusSyrian Arab Republic
| | - Zuheir Alshehabi
- Cancer Research CenterTishreen UniversityLattakiaSyrian Arab Republic
- Department of pathologyTishreen University hospitalLattakiaSyrian Arab Republic
| |
Collapse
|
4
|
Weng W, Yoshida N, Morinaga Y, Sugino S, Tomita Y, Kobayashi R, Inoue K, Hirose R, Dohi O, Itoh Y, Zhu X. Development of high-quality artificial intelligence for computer-aided diagnosis in determining subtypes of colorectal cancer. J Gastroenterol Hepatol 2024. [PMID: 38923607 DOI: 10.1111/jgh.16661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 03/14/2024] [Accepted: 06/09/2024] [Indexed: 06/28/2024]
Abstract
BACKGROUND AND AIM There are no previous studies in which computer-aided diagnosis (CAD) diagnosed colorectal cancer (CRC) subtypes correctly. In this study, we developed an original CAD for the diagnosis of CRC subtypes. METHODS Pretraining for the CAD based on ResNet was performed using ImageNet and five open histopathological pretraining image datasets (HiPreD) containing 3 million images. In addition, sparse attention was introduced to improve the CAD compared to other attention networks. One thousand and seventy-two histopathological images from 29 early CRC cases at Kyoto Prefectural University of Medicine from 2019 to 2022 were collected (857 images for training and validation, 215 images for test). All images were annotated by a qualified histopathologist for segmentation of normal mucosa, adenoma, pure well-differentiated adenocarcinoma (PWDA), and moderately/poorly differentiated adenocarcinoma (MPDA). Diagnostic ability including dice sufficient coefficient (DSC) and diagnostic accuracy were evaluated. RESULTS Our original CAD, named Colon-seg, with the pretraining of both HiPreD and ImageNET showed a better DSC (88.4%) compared to CAD without both pretraining (76.8%). Regarding the attentional mechanism, Colon-seg with sparse attention showed a better DSC (88.4%) compared to other attentional mechanisms (dual: 79.7%, ECA: 80.7%, shuffle: 84.7%, SK: 86.9%). In addition, the DSC of Colon-seg (88.4%) was better than other types of CADs (TransUNet: 84.7%, MultiResUnet: 86.1%, Unet++: 86.7%). The diagnostic accuracy of Colon-seg for each histopathological type was 94.3% for adenoma, 91.8% for PWDA, and 92.8% for MPDA. CONCLUSION A deep learning-based CAD for CRC subtype differentiation was developed with pretraining and fine-tuning of abundant histopathological images.
Collapse
Affiliation(s)
- Weihao Weng
- Graduate School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu, Japan
| | - Naohisa Yoshida
- Department of Molecular Gastroenterology and Hepatology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Yukiko Morinaga
- Department of Surgical Pathology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Satoshi Sugino
- Department of Gastroenterology, Asahi University Hospital, Gifu, Japan
| | - Yuri Tomita
- Department of Gastroenterology, Koseikai Takeda Hospital, Kyoto, Japan
| | - Reo Kobayashi
- Department of Molecular Gastroenterology and Hepatology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Ken Inoue
- Department of Molecular Gastroenterology and Hepatology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Ryohei Hirose
- Department of Molecular Gastroenterology and Hepatology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Osamu Dohi
- Department of Molecular Gastroenterology and Hepatology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Yoshito Itoh
- Department of Molecular Gastroenterology and Hepatology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Xin Zhu
- Graduate School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu, Japan
| |
Collapse
|
5
|
Niedowicz DM, Gollihue JL, Weekman EM, Phe P, Wilcock DM, Norris CM, Nelson PT. Using digital pathology to analyze the murine cerebrovasculature. J Cereb Blood Flow Metab 2024; 44:595-610. [PMID: 37988134 PMCID: PMC10981399 DOI: 10.1177/0271678x231216142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/18/2023] [Accepted: 10/23/2023] [Indexed: 11/22/2023]
Abstract
Research on the cerebrovasculature may provide insights into brain health and disease. Immunohistochemical staining is one way to visualize blood vessels, and digital pathology has the potential to revolutionize the measurement of blood vessel parameters. These tools provide opportunities for translational mouse model research. However, mouse brain tissue presents a formidable set of technical challenges, including potentially high background staining and cross-reactivity of endogenous IgG. Formalin-fixed paraffin-embedded (FFPE) and fixed frozen sections, both of which are widely used, may require different methods. In this study, we optimized blood vessel staining in mouse brain tissue, testing both FFPE and frozen fixed sections. A panel of immunohistochemical blood vessel markers were tested (including CD31, CD34, collagen IV, DP71, and VWF), to evaluate their suitability for digital pathological analysis. Collagen IV provided the best immunostaining results in both FFPE and frozen fixed murine brain sections, with highly-specific staining of large and small blood vessels and low background staining. Subsequent analysis of collagen IV-stained sections showed region and sex-specific differences in vessel density and vessel wall thickness. We conclude that digital pathology provides a useful tool for relatively unbiased analysis of the murine cerebrovasculature, provided proper protein markers are used.
Collapse
Affiliation(s)
- Dana M Niedowicz
- Sanders Brown Center on Aging, University of Kentucky, Lexington, KY, USA
| | - Jenna L Gollihue
- Sanders Brown Center on Aging, University of Kentucky, Lexington, KY, USA
| | - Erica M Weekman
- Stark Neurosciences Research Institute, Department of Neurology, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Panhavuth Phe
- Sanders Brown Center on Aging, University of Kentucky, Lexington, KY, USA
| | - Donna M Wilcock
- Stark Neurosciences Research Institute, Department of Neurology, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Christopher M Norris
- Sanders Brown Center on Aging, University of Kentucky, Lexington, KY, USA
- Department of Pharmacology, University of Kentucky, Lexington, KY, USA
| | - Peter T Nelson
- Sanders Brown Center on Aging, University of Kentucky, Lexington, KY, USA
- Department of Pathology, University of Kentucky, Lexington, KY, USA
| |
Collapse
|
6
|
Abbaker N, Minervini F, Guttadauro A, Solli P, Cioffi U, Scarci M. The future of artificial intelligence in thoracic surgery for non-small cell lung cancer treatment a narrative review. Front Oncol 2024; 14:1347464. [PMID: 38414748 PMCID: PMC10897973 DOI: 10.3389/fonc.2024.1347464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Accepted: 01/16/2024] [Indexed: 02/29/2024] Open
Abstract
Objectives To present a comprehensive review of the current state of artificial intelligence (AI) applications in lung cancer management, spanning the preoperative, intraoperative, and postoperative phases. Methods A review of the literature was conducted using PubMed, EMBASE and Cochrane, including relevant studies between 2002 and 2023 to identify the latest research on artificial intelligence and lung cancer. Conclusion While AI holds promise in managing lung cancer, challenges exist. In the preoperative phase, AI can improve diagnostics and predict biomarkers, particularly in cases with limited biopsy materials. During surgery, AI provides real-time guidance. Postoperatively, AI assists in pathology assessment and predictive modeling. Challenges include interpretability issues, training limitations affecting model use and AI's ineffectiveness beyond classification. Overfitting and global generalization, along with high computational costs and ethical frameworks, pose hurdles. Addressing these challenges requires a careful approach, considering ethical, technical, and regulatory factors. Rigorous analysis, external validation, and a robust regulatory framework are crucial for responsible AI implementation in lung surgery, reflecting the evolving synergy between human expertise and technology.
Collapse
Affiliation(s)
- Namariq Abbaker
- Division of Thoracic Surgery, Imperial College NHS Healthcare Trust and National Heart and Lung Institute, London, United Kingdom
| | - Fabrizio Minervini
- Division of Thoracic Surgery, Luzerner Kantonsspital, Lucern, Switzerland
| | - Angelo Guttadauro
- Division of Surgery, Università Milano-Bicocca and Istituti Clinici Zucchi, Monza, Italy
| | - Piergiorgio Solli
- Division of Thoracic Surgery, Policlinico S. Orsola-Malpighi, Bologna, Italy
| | - Ugo Cioffi
- Department of Surgery, University of Milan, Milan, Italy
| | - Marco Scarci
- Division of Thoracic Surgery, Imperial College NHS Healthcare Trust and National Heart and Lung Institute, London, United Kingdom
| |
Collapse
|