1
|
Kiyuna T, Cosatto E, Hatanaka KC, Yokose T, Tsuta K, Motoi N, Makita K, Shimizu A, Shinohara T, Suzuki A, Takakuwa E, Takakuwa Y, Tsuji T, Tsujiwaki M, Yanai M, Yuzawa S, Ogura M, Hatanaka Y. Evaluating Cellularity Estimation Methods: Comparing AI Counting with Pathologists' Visual Estimates. Diagnostics (Basel) 2024; 14:1115. [PMID: 38893641 PMCID: PMC11171606 DOI: 10.3390/diagnostics14111115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 05/17/2024] [Accepted: 05/21/2024] [Indexed: 06/21/2024] Open
Abstract
The development of next-generation sequencing (NGS) has enabled the discovery of cancer-specific driver gene alternations, making precision medicine possible. However, accurate genetic testing requires a sufficient amount of tumor cells in the specimen. The evaluation of tumor content ratio (TCR) from hematoxylin and eosin (H&E)-stained images has been found to vary between pathologists, making it an important challenge to obtain an accurate TCR. In this study, three pathologists exhaustively labeled all cells in 41 regions from 41 lung cancer cases as either tumor, non-tumor or indistinguishable, thus establishing a "gold standard" TCR. We then compared the accuracy of the TCR estimated by 13 pathologists based on visual assessment and the TCR calculated by an AI model that we have developed. It is a compact and fast model that follows a fully convolutional neural network architecture and produces cell detection maps which can be efficiently post-processed to obtain tumor and non-tumor cell counts from which TCR is calculated. Its raw cell detection accuracy is 92% while its classification accuracy is 84%. The results show that the error between the gold standard TCR and the AI calculation was significantly smaller than that between the gold standard TCR and the pathologist's visual assessment (p<0.05). Additionally, the robustness of AI models across institutions is a key issue and we demonstrate that the variation in AI was smaller than that in the average of pathologists when evaluated by institution. These findings suggest that the accuracy of tumor cellularity assessments in clinical workflows is significantly improved by the introduction of robust AI models, leading to more efficient genetic testing and ultimately to better patient outcomes.
Collapse
Affiliation(s)
- Tomoharu Kiyuna
- Healthcare Life Science Division, NEC Corporation, Tokyo 108-8556, Japan;
| | - Eric Cosatto
- Department of Machine Learning, NEC Laboratories America, Princeton, NJ 08540, USA;
| | - Kanako C. Hatanaka
- Center for Development of Advanced Diagnostics (C-DAD), Hokkaido University Hospital, Sapporo 060-8648, Japan;
| | - Tomoyuki Yokose
- Department of Pathology, Kanagawa Cancer Center, Yokohama 241-8515, Japan;
| | - Koji Tsuta
- Department of Pathology, Kansai Medical University, Osaka 573-1010, Japan;
| | - Noriko Motoi
- Department of Pathology, Saitama Cancer Center, Saitama 362-0806, Japan;
| | - Keishi Makita
- Department of Pathology, Oji General Hospital, Tomakomai 053-8506, Japan
| | - Ai Shimizu
- Department of Surgical Pathology, Hokkaido University Hospital, Sapporo 060-8648, Japan; (A.S.); (E.T.)
| | - Toshiya Shinohara
- Department of Pathology, Teine Keijinkai Hospital, Sapporo 006-0811, Japan
| | - Akira Suzuki
- Department of Pathology, KKR Sapporo Medical Center, Sapporo 062-0931, Japan
| | - Emi Takakuwa
- Department of Surgical Pathology, Hokkaido University Hospital, Sapporo 060-8648, Japan; (A.S.); (E.T.)
| | - Yasunari Takakuwa
- Department of Pathology, NTT Medical Center Sapporo, Sapporo 060-0061, Japan;
| | - Takahiro Tsuji
- Department of Pathology, Sapporo City General Hospital, Sapporo 060-8604, Japan;
| | - Mitsuhiro Tsujiwaki
- Department of Surgical Pathology, Sapporo Medical University Hospital, Sapporo 060-8543, Japan;
| | - Mitsuru Yanai
- Department of Pathology, Sapporo Tokushukai Hospital, Sapporo 004-0041, Japan;
| | - Sayaka Yuzawa
- Department of Diagnostic Pathology, Asahikawa Medical University Hospital, Asahikawa 078-8510, Japan
| | - Maki Ogura
- Healthcare Life Science Division, NEC Corporation, Tokyo 108-8556, Japan;
| | - Yutaka Hatanaka
- Center for Development of Advanced Diagnostics (C-DAD), Hokkaido University Hospital, Sapporo 060-8648, Japan;
| |
Collapse
|
2
|
Lococo F, Ghaly G, Chiappetta M, Flamini S, Evangelista J, Bria E, Stefani A, Vita E, Martino A, Boldrini L, Sassorossi C, Campanella A, Margaritora S, Mohammed A. Implementation of Artificial Intelligence in Personalized Prognostic Assessment of Lung Cancer: A Narrative Review. Cancers (Basel) 2024; 16:1832. [PMID: 38791910 PMCID: PMC11119930 DOI: 10.3390/cancers16101832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 05/02/2024] [Accepted: 05/08/2024] [Indexed: 05/26/2024] Open
Abstract
Artificial Intelligence (AI) has revolutionized the management of non-small-cell lung cancer (NSCLC) by enhancing different aspects, including staging, prognosis assessment, treatment prediction, response evaluation, recurrence/prognosis prediction, and personalized prognostic assessment. AI algorithms may accurately classify NSCLC stages using machine learning techniques and deep imaging data analysis. This could potentially improve precision and efficiency in staging, facilitating personalized treatment decisions. Furthermore, there are data suggesting the potential application of AI-based models in predicting prognosis in terms of survival rates and disease progression by integrating clinical, imaging and molecular data. In the present narrative review, we will analyze the preliminary studies reporting on how AI algorithms could predict responses to various treatment modalities, such as surgery, radiotherapy, chemotherapy, targeted therapy, and immunotherapy. There is robust evidence suggesting that AI also plays a crucial role in predicting the likelihood of tumor recurrence after surgery and the pattern of failure, which has significant implications for tailoring adjuvant treatments. The successful implementation of AI in personalized prognostic assessment requires the integration of different data sources, including clinical, molecular, and imaging data. Machine learning (ML) and deep learning (DL) techniques enable AI models to analyze these data and generate personalized prognostic predictions, allowing for a precise and individualized approach to patient care. However, challenges relating to data quality, interpretability, and the ability of AI models to generalize need to be addressed. Collaboration among clinicians, data scientists, and regulators is critical for the responsible implementation of AI and for maximizing its benefits in providing a more personalized prognostic assessment. Continued research, validation, and collaboration are essential to fully exploit the potential of AI in NSCLC management and improve patient outcomes. Herein, we have summarized the state of the art of applications of AI in lung cancer for predicting staging, prognosis, and pattern of recurrence after treatment in order to provide to the readers a large comprehensive overview of this challenging issue.
Collapse
Affiliation(s)
- Filippo Lococo
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Galal Ghaly
- Faculty of Medicine and Surgery, Thoracic Surgery Unit, Cairo University, Giza 12613, Egypt; (G.G.); (A.M.)
| | - Marco Chiappetta
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Sara Flamini
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Jessica Evangelista
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Emilio Bria
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Medical Oncology, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy
| | - Alessio Stefani
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Medical Oncology, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy
| | - Emanuele Vita
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Medical Oncology, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy
| | - Antonella Martino
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Radiotherapy Unit, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy
| | - Luca Boldrini
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Radiotherapy Unit, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy
| | - Carolina Sassorossi
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Annalisa Campanella
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Stefano Margaritora
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy; (M.C.); (J.E.); (E.B.); (A.S.); (E.V.); (A.M.); (L.B.); (C.S.); (S.M.)
- Thoracic Surgery, A. Gemelli University Hospital Foundation IRCCS, 00168 Rome, Italy; (S.F.); (A.C.)
| | - Abdelrahman Mohammed
- Faculty of Medicine and Surgery, Thoracic Surgery Unit, Cairo University, Giza 12613, Egypt; (G.G.); (A.M.)
| |
Collapse
|
3
|
Hijazi A, Bifulco C, Baldin P, Galon J. Digital Pathology for Better Clinical Practice. Cancers (Basel) 2024; 16:1686. [PMID: 38730638 PMCID: PMC11083211 DOI: 10.3390/cancers16091686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Revised: 04/24/2024] [Accepted: 04/25/2024] [Indexed: 05/13/2024] Open
Abstract
(1) Background: Digital pathology (DP) is transforming the landscape of clinical practice, offering a revolutionary approach to traditional pathology analysis and diagnosis. (2) Methods: This innovative technology involves the digitization of traditional glass slides which enables pathologists to access, analyze, and share high-resolution whole-slide images (WSI) of tissue specimens in a digital format. By integrating cutting-edge imaging technology with advanced software, DP promises to enhance clinical practice in numerous ways. DP not only improves quality assurance and standardization but also allows remote collaboration among experts for a more accurate diagnosis. Artificial intelligence (AI) in pathology significantly improves cancer diagnosis, classification, and prognosis by automating various tasks. It also enhances the spatial analysis of tumor microenvironment (TME) and enables the discovery of new biomarkers, advancing their translation for therapeutic applications. (3) Results: The AI-driven immune assays, Immunoscore (IS) and Immunoscore-Immune Checkpoint (IS-IC), have emerged as powerful tools for improving cancer diagnosis, prognosis, and treatment selection by assessing the tumor immune contexture in cancer patients. Digital IS quantitative assessment performed on hematoxylin-eosin (H&E) and CD3+/CD8+ stained slides from colon cancer patients has proven to be more reproducible, concordant, and reliable than expert pathologists' evaluation of immune response. Outperforming traditional staging systems, IS demonstrated robust potential to enhance treatment efficiency in clinical practice, ultimately advancing cancer patient care. Certainly, addressing the challenges DP has encountered is essential to ensure its successful integration into clinical guidelines and its implementation into clinical use. (4) Conclusion: The ongoing progress in DP holds the potential to revolutionize pathology practices, emphasizing the need to incorporate powerful AI technologies, including IS, into clinical settings to enhance personalized cancer therapy.
Collapse
Affiliation(s)
- Assia Hijazi
- The French National Institute of Health & Medical Research (INSERM), Laboratory of Integrative Cancer Immunology, F-75006 Paris, France;
- Equipe Labellisée Ligue Contre le Cancer, F-75006 Paris, France
- Centre de Recherche des Cordeliers, Sorbonne Université, Université Paris Cité, F-75006 Paris, France
| | - Carlo Bifulco
- Providence Genomics, Portland, OR 02912, USA;
- Earle A Chiles Research Institute, Portland, OR 97213, USA
| | - Pamela Baldin
- Department of Pathology, Cliniques Universitaires Saint Luc, UCLouvain, 1200 Brussels, Belgium;
| | - Jérôme Galon
- The French National Institute of Health & Medical Research (INSERM), Laboratory of Integrative Cancer Immunology, F-75006 Paris, France;
- Equipe Labellisée Ligue Contre le Cancer, F-75006 Paris, France
- Centre de Recherche des Cordeliers, Sorbonne Université, Université Paris Cité, F-75006 Paris, France
- Veracyte, 13009 Marseille, France
| |
Collapse
|
4
|
Kim PJ, Hwang HS, Choi G, Sung HJ, Ahn B, Uh JS, Yoon S, Kim D, Chun SM, Jang SJ, Go H. A new model using deep learning to predict recurrence after surgical resection of lung adenocarcinoma. Sci Rep 2024; 14:6366. [PMID: 38493247 PMCID: PMC10944489 DOI: 10.1038/s41598-024-56867-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 03/12/2024] [Indexed: 03/18/2024] Open
Abstract
This study aimed to develop a deep learning (DL) model for predicting the recurrence risk of lung adenocarcinoma (LUAD) based on its histopathological features. Clinicopathological data and whole slide images from 164 LUAD cases were collected and used to train DL models with an ImageNet pre-trained efficientnet-b2 architecture, densenet201, and resnet152. The models were trained to classify each image patch into high-risk or low-risk groups, and the case-level result was determined by multiple instance learning with final FC layer's features from a model from all patches. Analysis of the clinicopathological and genetic characteristics of the model-based risk group was performed. For predicting recurrence, the model had an area under the curve score of 0.763 with 0.750, 0.633 and 0.680 of sensitivity, specificity, and accuracy in the test set, respectively. High-risk cases for recurrence predicted by the model (HR group) were significantly associated with shorter recurrence-free survival and a higher stage (both, p < 0.001). The HR group was associated with specific histopathological features such as poorly differentiated components, complex glandular pattern components, tumor spread through air spaces, and a higher grade. In the HR group, pleural invasion, necrosis, and lymphatic invasion were more frequent, and the size of the invasion was larger (all, p < 0.001). Several genetic mutations, including TP53 (p = 0.007) mutations, were more frequently found in the HR group. The results of stages I-II were similar to those of the general cohort. DL-based model can predict the recurrence risk of LUAD and identify the presence of the TP53 gene mutation by analyzing histopathologic features.
Collapse
Affiliation(s)
- Pil-Jong Kim
- School of Dentistry and Dental Research Institute, Seoul National University, Seoul, Republic of Korea
| | - Hee Sang Hwang
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Gyuheon Choi
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Hyun-Jung Sung
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Bokyung Ahn
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Ji-Su Uh
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Shinkyo Yoon
- Department of Oncology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Deokhoon Kim
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Sung-Min Chun
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Se Jin Jang
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Heounjeong Go
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|
5
|
Zhang L, Du J, Wu X. A novel neoadjuvant therapy for early-stage non-small cell lung cancer in a mouse model. J Thorac Dis 2024; 16:1108-1117. [PMID: 38505061 PMCID: PMC10944762 DOI: 10.21037/jtd-23-1555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 12/29/2023] [Indexed: 03/21/2024]
Abstract
Background Lung cancer is the common malignancy with high mortality rate in the world. Even with curative resection for early-stage lung cancer patients, the rate of postoperative recurrence and metastasis is still high. Neoadjuvant nivolumab combined with chemotherapy leads to improved pathological complete response rate and event-free survival in resectable non-small cell lung cancer (NSCLC) patients. However, the neoadjuvant therapy is not only accompanied by grade 3 or above adverse events which resulting in the potential missing out on the window for curative surgery for the patients, but also has low efficacy especially in patients with low programmed death ligand 1 (PD-L1) expression. Hence, it is particularly important to explore innovative ways to inhibit tumour recurrence and metastasis. Methods In the present study, we investigated whether neoadjuvant therapy with intralesional Rose Bengal (RB) elicited specific immune responses compared with control group, and then the lung cancer mouse model was used to evaluated the immunological mechanism. Results The secondary Lewis lung cancer cells (LLCs) tumour growth was significantly suppressed by RB intralesional injection into subcutaneous tumour; the formation rate of secondary tumours induced by the B16 melanoma cell injection was 100%. Intralesional RB neoadjuvant therapy before surgical resection exhibited effectively enhanced T central memory cells (Tcm) and T memory stem cells (Tscm) + naïve T cells (Tn) infiltration, elicited stronger cytotoxic T lymphocyte (CTL) responses against LLCs, and displayed markedly higher proportions of splenic lymphocytes that produce tumour necrosis factor-alpha (TNF-α) and interferon-gamma (IFN-γ) upon restimulation in a lung cancer mouse model. Conclusions Based on our preclinical data, neoadjuvant therapy with intralesional RB injection generated immune memory and prevented the recurrence and metastasis of tumour in a lung cancer mouse model, which provides a new strategy for neoadjuvant treatment of early-stage NSCLC.
Collapse
Affiliation(s)
- Lanlin Zhang
- Department of Medical Oncology, Tongji Hospital, School of Medicine, Tongji University, Shanghai, China
| | - Jiangyuan Du
- Laboratory for Reproductive Immunology, Hospital of Obstetrics and Gynecology, Fudan University Shanghai Medical College, Shanghai, China
| | - Xianghua Wu
- Department of Medical Oncology, Fudan University Shanghai Cancer Center, Shanghai, China
| |
Collapse
|
6
|
Fiste O, Gkiozos I, Charpidou A, Syrigos NK. Artificial Intelligence-Based Treatment Decisions: A New Era for NSCLC. Cancers (Basel) 2024; 16:831. [PMID: 38398222 PMCID: PMC10887017 DOI: 10.3390/cancers16040831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 02/12/2024] [Accepted: 02/17/2024] [Indexed: 02/25/2024] Open
Abstract
Non-small cell lung cancer (NSCLC) is the leading cause of cancer-related mortality among women and men, in developed countries, despite the public health interventions including tobacco-free campaigns, screening and early detection methods, recent therapeutic advances, and ongoing intense research on novel antineoplastic modalities. Targeting oncogenic driver mutations and immune checkpoint inhibition has indeed revolutionized NSCLC treatment, yet there still remains the unmet need for robust and standardized predictive biomarkers to accurately inform clinical decisions. Artificial intelligence (AI) represents the computer-based science concerned with large datasets for complex problem-solving. Its concept has brought a paradigm shift in oncology considering its immense potential for improved diagnosis, treatment guidance, and prognosis. In this review, we present the current state of AI-driven applications on NSCLC management, with a particular focus on radiomics and pathomics, and critically discuss both the existing limitations and future directions in this field. The thoracic oncology community should not be discouraged by the likely long road of AI implementation into daily clinical practice, as its transformative impact on personalized treatment approaches is undeniable.
Collapse
Affiliation(s)
- Oraianthi Fiste
- Oncology Unit, Third Department of Internal Medicine and Laboratory, Medical School, National and Kapodistrian University of Athens, 11527 Athens, Greece; (I.G.); (A.C.); (N.K.S.)
| | | | | | | |
Collapse
|
7
|
Dia AK, Ebrahimpour L, Yolchuyeva S, Tonneau M, Lamaze FC, Orain M, Coulombe F, Malo J, Belkaid W, Routy B, Joubert P, Després P, Manem VSK. The Cross-Scale Association between Pathomics and Radiomics Features in Immunotherapy-Treated NSCLC Patients: A Preliminary Study. Cancers (Basel) 2024; 16:348. [PMID: 38254838 PMCID: PMC10813866 DOI: 10.3390/cancers16020348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 01/10/2024] [Accepted: 01/11/2024] [Indexed: 01/24/2024] Open
Abstract
BACKGROUND Recent advances in cancer biomarker development have led to a surge of distinct data modalities, such as medical imaging and histopathology. To develop predictive immunotherapy biomarkers, these modalities are leveraged independently, despite their orthogonality. This study aims to explore the cross-scale association between radiological scans and digitalized pathology images for immunotherapy-treated non-small cell lung cancer (NSCLC) patients. METHODS This study involves 36 NSCLC patients who were treated with immunotherapy and for whom both radiology and pathology images were available. A total of 851 and 260 features were extracted from CT scans and cell density maps of histology images at different resolutions. We investigated the radiopathomics relationship and their association with clinical and biological endpoints. We used the Kolmogorov-Smirnov (KS) method to test the differences between the distributions of correlation coefficients with the two imaging modality features. Unsupervised clustering was done to identify which imaging modality captures poor and good survival patients. RESULTS Our results demonstrated a significant correlation between cell density pathomics and radiomics features. Furthermore, we also found a varying distribution of correlation values between imaging-derived features and clinical endpoints. The KS test revealed that the two imaging feature distributions were different for PFS and CD8 counts, while similar for OS. In addition, clustering analysis resulted in significant differences in the two clusters generated from the radiomics and pathomics features with respect to patient survival and CD8 counts. CONCLUSION The results of this study suggest a cross-scale association between CT scans and pathology H&E slides among ICI-treated patients. These relationships can be further explored to develop multimodal immunotherapy biomarkers to advance personalized lung cancer care.
Collapse
Affiliation(s)
- Abdou Khadir Dia
- Department of Mathematics and Computer Science, Université du Québec à Trois Rivières, Trois-Rivières, QC G8Z 4M3, Canada
| | - Leyla Ebrahimpour
- Quebec Heart & Lung Institute Research Center, Québec City, QC G1V 4G5, Canada (F.C.L.); (M.O.); (P.J.); (P.D.)
- Department of Physics, Laval University, Quebec City, QC G1V 0A6, Canada
- Centre de Recherche du CHU de Québec-Université Laval, Quebec City, QC G1V 0A6, Canada
| | - Sevinj Yolchuyeva
- Department of Mathematics and Computer Science, Université du Québec à Trois Rivières, Trois-Rivières, QC G8Z 4M3, Canada
- Centre de Recherche du CHU de Québec-Université Laval, Quebec City, QC G1V 0A6, Canada
- Department of Molecular Biology, Medical Biochemistry and Pathology, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Marion Tonneau
- Lille Faculty of Medicine, University of Lille, 59020 Lille, France
- Centre de Recherche du Centre Hospitalier Universitaire de Montréal, Montréal, QC H2X 0A9, Canada
| | - Fabien C. Lamaze
- Quebec Heart & Lung Institute Research Center, Québec City, QC G1V 4G5, Canada (F.C.L.); (M.O.); (P.J.); (P.D.)
| | - Michèle Orain
- Quebec Heart & Lung Institute Research Center, Québec City, QC G1V 4G5, Canada (F.C.L.); (M.O.); (P.J.); (P.D.)
| | - Francois Coulombe
- Quebec Heart & Lung Institute Research Center, Québec City, QC G1V 4G5, Canada (F.C.L.); (M.O.); (P.J.); (P.D.)
| | - Julie Malo
- Centre de Recherche du Centre Hospitalier Universitaire de Montréal, Montréal, QC H2X 0A9, Canada
| | - Wiam Belkaid
- Centre de Recherche du Centre Hospitalier Universitaire de Montréal, Montréal, QC H2X 0A9, Canada
| | - Bertrand Routy
- Centre de Recherche du Centre Hospitalier Universitaire de Montréal, Montréal, QC H2X 0A9, Canada
| | - Philippe Joubert
- Quebec Heart & Lung Institute Research Center, Québec City, QC G1V 4G5, Canada (F.C.L.); (M.O.); (P.J.); (P.D.)
- Department of Molecular Biology, Medical Biochemistry and Pathology, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Philippe Després
- Quebec Heart & Lung Institute Research Center, Québec City, QC G1V 4G5, Canada (F.C.L.); (M.O.); (P.J.); (P.D.)
- Department of Physics, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Venkata S. K. Manem
- Department of Mathematics and Computer Science, Université du Québec à Trois Rivières, Trois-Rivières, QC G8Z 4M3, Canada
- Centre de Recherche du CHU de Québec-Université Laval, Quebec City, QC G1V 0A6, Canada
- Department of Molecular Biology, Medical Biochemistry and Pathology, Laval University, Quebec City, QC G1V 0A6, Canada
| |
Collapse
|
8
|
Chen C, Lu C, Viswanathan V, Maveal B, Maheshwari B, Willis J, Madabhushi A. Identifying primary tumor site of origin for liver metastases via a combination of handcrafted and deep learning features. J Pathol Clin Res 2024; 10:e344. [PMID: 37822044 PMCID: PMC10766034 DOI: 10.1002/cjp2.344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 08/14/2023] [Accepted: 08/28/2023] [Indexed: 10/13/2023]
Abstract
Liver is one of the most common sites for metastases, which can occur on account of primary tumors from multiple sites of origin. Identifying the primary site of origin (PSO) of a metastasis can help in guiding therapeutic options for liver metastases. In this pilot study, we hypothesized that computer extracted handcrafted (HC) histomorphometric features can be utilized to identify the PSO of liver metastases. Cellular features, including tumor nuclei morphological and graph features as well as cytoplasm texture features, were extracted by computer algorithms from 175 slides (114 patients). The study comprised three experiments: (1) comparing and (2) fusing a machine learning (ML) model trained with HC pathomic features and deep learning (DL)-based classifiers to predict site of origin; (3) identifying the section of the primary tumor from which metastases were derived. For experiment 1, we divided the cohort into training sets composed of primary and matched liver metastases [60 patients, 121 whole slide images (WSIs)], and a hold-out validation set (54 patients, 54 WSIs) composed solely of liver metastases of known site of origin. Using the extracted HC features of the training set, a combination of supervised machine classifiers and unsupervised clustering was applied to identify the PSO. A random forest classifier achieved areas under the curve (AUCs) of 0.83, 0.64, 0.82, and 0.64 in classifying the metastatic tumor from colon, esophagus, breast, and pancreas on the validation set. The top features related to nuclear and peri-nuclear shape and textural attributes. We also trained a DL network to serve as a direct comparison to our method. The DL model achieved AUCs for colon: 0.94, esophagus: 0.66, breast: 0.79, and pancreas: 0.67 in identifying PSO. A decision fusion-based strategy was deployed to fuse the trained ML and DL classifiers and achieved slightly better results than ML or DL classifier alone (colon: 0.93, esophagus: 0.68, breast: 0.81, and pancreas: 0.69). For the third experiment, WSI-level attention maps were also generated using a trained DL network to generate a composite feature similarity heat map between paired primaries and their associated metastases. Our experiments revealed that epithelium-rich and moderately differentiated tumor regions of primary tumors were quantitatively similar to paired metastatic tumors. Our findings suggest that a combination of HC and DL features could potentially help identify the PSO for liver metastases while at the same time also potentially identify the spatial sites of origin for the metastases within primary tumors.
Collapse
Affiliation(s)
- Chuheng Chen
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
| | - Cheng Lu
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
| | - Vidya Viswanathan
- Wallace H. Coulter Department of Biomedical EngineeringGeorgia Institute of Technology and Emory UniversityAtlantaGAUSA
| | - Brandon Maveal
- Department of PathologyUniversity Hospitals Cleveland Medical Center and Case Western Reserve UniversityClevelandOHUSA
| | - Bhunesh Maheshwari
- Department of PathologyUniversity Hospitals Cleveland Medical Center and Case Western Reserve UniversityClevelandOHUSA
| | - Joseph Willis
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
- Department of PathologyUniversity Hospitals Cleveland Medical Center and Case Western Reserve UniversityClevelandOHUSA
| | - Anant Madabhushi
- Wallace H. Coulter Department of Biomedical EngineeringGeorgia Institute of Technology and Emory UniversityAtlantaGAUSA
- Radiology and Imaging Sciences, Biomedical Informatics (BMI) and PathologyGeorgia Institute of Technology and Emory UniversityAtlantaGAUSA
- Atlanta Veterans Administration Medical CenterAtlantaGAUSA
| |
Collapse
|
9
|
Dolgalev I, Zhou H, Murrell N, Le H, Sakellaropoulos T, Coudray N, Zhu K, Vasudevaraja V, Yeaton A, Goparaju C, Li Y, Sulaiman I, Tsay JCJ, Meyn P, Mohamed H, Sydney I, Shiomi T, Ramaswami S, Narula N, Kulicke R, Davis FP, Stransky N, Smolen GA, Cheng WY, Cai J, Punekar S, Velcheti V, Sterman DH, Poirier JT, Neel B, Wong KK, Chiriboga L, Heguy A, Papagiannakopoulos T, Nadorp B, Snuderl M, Segal LN, Moreira AL, Pass HI, Tsirigos A. Inflammation in the tumor-adjacent lung as a predictor of clinical outcome in lung adenocarcinoma. Nat Commun 2023; 14:6764. [PMID: 37938580 PMCID: PMC10632519 DOI: 10.1038/s41467-023-42327-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 10/06/2023] [Indexed: 11/09/2023] Open
Abstract
Approximately 30% of early-stage lung adenocarcinoma patients present with disease progression after successful surgical resection. Despite efforts of mapping the genetic landscape, there has been limited success in discovering predictive biomarkers of disease outcomes. Here we performed a systematic multi-omic assessment of 143 tumors and matched tumor-adjacent, histologically-normal lung tissue with long-term patient follow-up. Through histologic, mutational, and transcriptomic profiling of tumor and adjacent-normal tissue, we identified an inflammatory gene signature in tumor-adjacent tissue as the strongest clinical predictor of disease progression. Single-cell transcriptomic analysis demonstrated the progression-associated inflammatory signature was expressed in both immune and non-immune cells, and cell type-specific profiling in monocytes further improved outcome predictions. Additional analyses of tumor-adjacent transcriptomic data from The Cancer Genome Atlas validated the association of the inflammatory signature with worse outcomes across cancers. Collectively, our study suggests that molecular profiling of tumor-adjacent tissue can identify patients at high risk for disease progression.
Collapse
Affiliation(s)
- Igor Dolgalev
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, USA
- Division of Precision Medicine, Department of Medicine, NYU Grossman School of Medicine, New York, USA
| | - Hua Zhou
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, USA
| | - Nina Murrell
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, USA
- Division of Precision Medicine, Department of Medicine, NYU Grossman School of Medicine, New York, USA
| | - Hortense Le
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Division of Precision Medicine, Department of Medicine, NYU Grossman School of Medicine, New York, USA
| | | | - Nicolas Coudray
- Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, USA
- Division of Precision Medicine, Department of Medicine, NYU Grossman School of Medicine, New York, USA
- Department of Cell Biology, NYU Grossman School of Medicine, New York, USA
| | - Kelsey Zhu
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
| | | | - Anna Yeaton
- The Optical Profiling Platform at The Broad Institute of MIT And Harvard, Cambridge, USA
| | - Chandra Goparaju
- Department of Cardiothoracic Surgery, NYU Grossman School of Medicine, New York, USA
| | - Yonghua Li
- Division of Pulmonary, Critical Care and Sleep Medicine, NYU Grossman School of Medicine, New York, USA
| | - Imran Sulaiman
- Division of Pulmonary, Critical Care and Sleep Medicine, NYU Grossman School of Medicine, New York, USA
| | - Jun-Chieh J Tsay
- Division of Pulmonary, Critical Care and Sleep Medicine, NYU Grossman School of Medicine, New York, USA
| | - Peter Meyn
- Genome Technology Center, Office of Science and Research, NYU Grossman School of Medicine, New York, USA
| | - Hussein Mohamed
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
| | - Iris Sydney
- Center for Biospecimen Research and Development, NYU Grossman School of Medicine, New York, USA
| | - Tomoe Shiomi
- Center for Biospecimen Research and Development, NYU Grossman School of Medicine, New York, USA
| | - Sitharam Ramaswami
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Genome Technology Center, Office of Science and Research, NYU Grossman School of Medicine, New York, USA
| | - Navneet Narula
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
| | - Ruth Kulicke
- Celsius Therapeutics, Cambridge, Massachusetts, USA
| | - Fred P Davis
- Celsius Therapeutics, Cambridge, Massachusetts, USA
| | | | | | - Wei-Yi Cheng
- Pharma Research & Early Development Informatics, Roche Innovation Center New York, New Jersey, USA
| | - James Cai
- Pharma Research & Early Development Informatics, Roche Innovation Center New York, New Jersey, USA
| | - Salman Punekar
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Vamsidhar Velcheti
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Daniel H Sterman
- Division of Pulmonary, Critical Care and Sleep Medicine, NYU Grossman School of Medicine, New York, USA
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - J T Poirier
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Ben Neel
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Kwok-Kin Wong
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Luis Chiriboga
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
| | - Adriana Heguy
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Genome Technology Center, Office of Science and Research, NYU Grossman School of Medicine, New York, USA
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Thales Papagiannakopoulos
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Bettina Nadorp
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, USA
- Division of Precision Medicine, Department of Medicine, NYU Grossman School of Medicine, New York, USA
| | - Matija Snuderl
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Leopoldo N Segal
- Division of Pulmonary, Critical Care and Sleep Medicine, NYU Grossman School of Medicine, New York, USA
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Andre L Moreira
- Department of Pathology, NYU Grossman School of Medicine, New York, USA
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA
| | - Harvey I Pass
- Department of Cardiothoracic Surgery, NYU Grossman School of Medicine, New York, USA.
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA.
| | - Aristotelis Tsirigos
- Department of Pathology, NYU Grossman School of Medicine, New York, USA.
- Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, USA.
- Division of Precision Medicine, Department of Medicine, NYU Grossman School of Medicine, New York, USA.
- Laura and Isaac Perlmutter Cancer Center, New York University Langone Health, New York, NY, USA.
| |
Collapse
|
10
|
Dell’Amore A, Bonis A, Melan L, Silvestrin S, Cannone G, Shamshoum F, Zampieri A, Pezzuto F, Calabrese F, Nicotra S, Schiavon M, Faccioli E, Mammana M, Comacchio GM, Pasello G, Rea F. Microscopical Variables and Tumor Inflammatory Microenvironment Do Not Modify Survival or Recurrence in Stage I-IIA Lung Adenocarcinomas. Cancers (Basel) 2023; 15:4542. [PMID: 37760512 PMCID: PMC10527442 DOI: 10.3390/cancers15184542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 09/08/2023] [Accepted: 09/12/2023] [Indexed: 09/29/2023] Open
Abstract
Microscopical predictors and Tumor Immune Microenvironment (TIME) have been studied less in early-stage NSCLC due to the curative intent of resection and the satisfactory survival rate achievable. Despite this, the emerging literature enforces the role of the immune system and microscopical predictors as prognostic variables in NSCLC and in adenocarcinomas (ADCs) as well. Here, we investigated whether cancer-related microscopical variables and TIME influence survival and recurrence in I-IIA ADCs. We retrospectively collected I-IIA ADCs treated (lobectomy or segmentectomy) at the University Hospital (Padova) between 2016 and 2022. We assigned to pathological variables a cumulative pathological score (PS) resulting as the sum of them. TIME was investigated as tumor-infiltrating lymphocytes (TILs < 11% or ≥11%) and PD-L1 considering its expression (<1% or ≥1%). Then, we compared survival and recurrence according to PS, histology, TILs and PD-L1. A total of 358 I-IIA ADCs met the inclusion criteria. The median PS grew from IA1 to IIA, indicating an increasing microscopical cancer activity. Except for the T-SUVmax, any pathological predictor seemed to be different between PD-L1 < 1% and ≥1%. Histology, PS, TILs and PD-L1 were unable to indicate a survival difference according to the Log-rank test (p = 0.37, p = 0.25, p = 0.41 and p = 0.23). Even the recurrence was non-significant (p = 0.90, p = 0.62, p = 0.97, p = 0.74). According to our findings, resection remains the best upfront treatment in I-IIA ADCs. Microscopical cancer activity grows from IA1 to IIA tumors, but it does not affect outcomes. These outcomes are also unmodified by TIME. Probably, microscopical cancer development and immune reaction against cancer are overwhelmed by an adequate R0-N0 resection.
Collapse
Affiliation(s)
- Andrea Dell’Amore
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Alessandro Bonis
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Luca Melan
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Stefano Silvestrin
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Giorgio Cannone
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Fares Shamshoum
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Alberto Zampieri
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Federica Pezzuto
- Pathology Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy; (F.P.)
| | - Fiorella Calabrese
- Pathology Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy; (F.P.)
| | - Samuele Nicotra
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Marco Schiavon
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Eleonora Faccioli
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Marco Mammana
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Giovanni Maria Comacchio
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| | - Giulia Pasello
- Oncology 2 Unit, Veneto Institute of Oncology IOV–IRCCS, 35128 Padova, Italy
| | - Federico Rea
- Thoracic Surgery Unit, Department of Cardiac, Thoracic, Vascular Sciences and Public Health–DSCTV, University of Padova, 35128 Padova, Italy (S.N.); (G.M.C.)
| |
Collapse
|
11
|
Jovanoski N, Abogunrin S, Di Maio D, Belleli R, Hudson P, Bhadti S, Jones LG. Health State Utility Values in Early-Stage Non-small Cell Lung Cancer: A Systematic Literature Review. PHARMACOECONOMICS - OPEN 2023; 7:723-738. [PMID: 37289325 PMCID: PMC10471534 DOI: 10.1007/s41669-023-00423-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/10/2023] [Indexed: 06/09/2023]
Abstract
BACKGROUND Non-small cell lung cancer (NSCLC) is the predominant histological subtype of lung cancer and is the leading cause of cancer-related deaths globally. Quality of life is an important consideration for patients and current treatments can adversely affect health-related quality of life (HRQoL). OBJECTIVE The objectives of this systematic literature review (SLR) were to identify and provide a comprehensive catalogue of published health state utility values (HSUVs) in patients with early-stage NSCLC and to understand the factors impacting on HSUVs in this indication. METHODS Electronic searches of Embase, MEDLINE and Evidence-Based Medicine Reviews were conducted via the Ovid platform in March 2021 and June 2022 and were supplemented by grey literature searches of conference proceedings, reference lists, health technology assessment bodies, and other relevant sources. Eligibility criteria were based on patients with early-stage (stage I-III) resectable NSCLC receiving treatment in the adjuvant or neoadjuvant setting. No restriction was placed on interventions or comparators, geography, or publication date. English language publications or non-English language publications with an English abstract were of primary interest. A validated checklist was applied to conduct quality assessment of the full publications. RESULTS Twenty-nine publications (27 full publications and two conference abstracts) met all eligibility criteria and reported 217 HSUVs and seven disutilities associated with patients with early NSCLC. The data showed that increasing disease stage is associated with decreasing HRQoL. It was also indicated that utility values vary by treatment approach; however, the choice of treatment may be influenced by the patients' disease stage at presentation. Few studies aligned with the requirements of health technology assessment (HTA) bodies, indicating a need for future studies to conform to these preferences, making them suitable for use in economic evaluations. CONCLUSIONS This SLR found that disease stage and treatment approach were two of several factors that can impact patient-reported HRQoL. Additional studies are warranted to confirm these findings and to investigate emerging therapies for early NSCLC. In collecting a catalogue of HSUV data, this SLR has begun to identify the challenges associated with identifying reliable utility value estimates suitable for use in economic evaluations of early NSCLC.
Collapse
|
12
|
Timilsina M, Fey D, Buosi S, Janik A, Costabello L, Carcereny E, Abreu DR, Cobo M, Castro RL, Bernabé R, Minervini P, Torrente M, Provencio M, Nováček V. Synergy between imputed genetic pathway and clinical information for predicting recurrence in early stage non-small cell lung cancer. J Biomed Inform 2023; 144:104424. [PMID: 37352900 DOI: 10.1016/j.jbi.2023.104424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 06/06/2023] [Accepted: 06/11/2023] [Indexed: 06/25/2023]
Abstract
OBJECTIVE Lung cancer exhibits unpredictable recurrence in low-stage tumors and variable responses to different therapeutic interventions. Predicting relapse in early-stage lung cancer can facilitate precision medicine and improve patient survivability. While existing machine learning models rely on clinical data, incorporating genomic information could enhance their efficiency. This study aims to impute and integrate specific types of genomic data with clinical data to improve the accuracy of machine learning models for predicting relapse in early-stage, non-small cell lung cancer patients. METHODS The study utilized a publicly available TCGA lung cancer cohort and imputed genetic pathway scores into the Spanish Lung Cancer Group (SLCG) data, specifically in 1348 early-stage patients. Initially, tumor recurrence was predicted without imputed pathway scores. Subsequently, the SLCG data were augmented with pathway scores imputed from TCGA. The integrative approach aimed to enhance relapse risk prediction performance. RESULTS The integrative approach achieved improved relapse risk prediction with the following evaluation metrics: an area under the precision-recall curve (PR-AUC) score of 0.75, an area under the ROC (ROC-AUC) score of 0.80, an F1 score of 0.61, and a Precision of 0.80. The prediction explanation model SHAP (SHapley Additive exPlanations) was employed to explain the machine learning model's predictions. CONCLUSION We conclude that our explainable predictive model is a promising tool for oncologists that addresses an unmet clinical need of post-treatment patient stratification based on the relapse risk while also improving the predictive power by incorporating proxy genomic data not available for specific patients.
Collapse
Affiliation(s)
- Mohan Timilsina
- Data Science Institute, Insight Centre for Data Analytics, University of Galway, Ireland.
| | - Dirk Fey
- Systems Biology Ireland, University College Dublin, Ireland.
| | - Samuele Buosi
- Data Science Institute, Insight Centre for Data Analytics, University of Galway, Ireland.
| | | | | | - Enric Carcereny
- Catalan Institute of Oncology, Hospital Universitari Germans Trias i Pujol, B-ARGO, IGTP, Badalona, Spain.
| | | | - Manuel Cobo
- Medical Oncology Intercenter Unit. Regional and Virgen de la Victoria University Hospitals. IBIMA. Málaga., Spain.
| | | | - Reyes Bernabé
- Hospital Universitario Virgen del Rocio, Sevilla, Spain.
| | | | - Maria Torrente
- Medical Oncology Department, Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain.
| | - Mariano Provencio
- Medical Oncology Department, Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain.
| | - Vít Nováček
- Data Science Institute, Insight Centre for Data Analytics, University of Galway, Ireland; Faculty of Informatics, Masaryk University Brno, Czech Republic; Masaryk Memorial Cancer Institute, Brno, Czech Republic.
| |
Collapse
|
13
|
Lami K, Bychkov A, Matsumoto K, Attanoos R, Berezowska S, Brcic L, Cavazza A, English JC, Fabro AT, Ishida K, Kashima Y, Larsen BT, Marchevsky AM, Miyazaki T, Morimoto S, Roden AC, Schneider F, Soshi M, Smith ML, Tabata K, Takano AM, Tanaka K, Tanaka T, Tsuchiya T, Nagayasu T, Fukuoka J. Overcoming the Interobserver Variability in Lung Adenocarcinoma Subtyping: A Clustering Approach to Establish a Ground Truth for Downstream Applications. Arch Pathol Lab Med 2023; 147:885-895. [PMID: 36343368 DOI: 10.5858/arpa.2022-0051-oa] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/22/2022] [Indexed: 07/28/2023]
Abstract
CONTEXT.— The accurate identification of different lung adenocarcinoma histologic subtypes is important for determining prognosis but can be challenging because of overlaps in the diagnostic features, leading to considerable interobserver variability. OBJECTIVE.— To provide an overview of the diagnostic agreement for lung adenocarcinoma subtypes among pathologists and to create a ground truth using the clustering approach for downstream computational applications. DESIGN.— Three sets of lung adenocarcinoma histologic images with different evaluation levels (small patches, areas with relatively uniform histology, and whole slide images) were reviewed by 17 international expert lung pathologists and 1 pathologist in training. Each image was classified into one or several lung adenocarcinoma subtypes. RESULTS.— Among the 4702 patches of the first set, 1742 (37%) had an overall consensus among all pathologists. The overall Fleiss κ score for the agreement of all subtypes was 0.58. Using cluster analysis, pathologists were hierarchically grouped into 2 clusters, with κ scores of 0.588 and 0.563 in clusters 1 and 2, respectively. Similar results were obtained for the second and third sets, with fair-to-moderate agreements. Patches from the first 2 sets that obtained the consensus of the 18 pathologists were retrieved to form consensus patches and were regarded as the ground truth of lung adenocarcinoma subtypes. CONCLUSIONS.— Our observations highlight discrepancies among experts when assessing lung adenocarcinoma subtypes. However, a subsequent number of consensus patches could be retrieved from each cluster, which can be used as ground truth for the downstream computational pathology applications, with minimal influence from interobserver variability.
Collapse
Affiliation(s)
- Kris Lami
- From the Departments of Pathology (Lami, K. Tanaka, Fukuoka), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Andrey Bychkov
- Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan; the Department of Pathology, Kameda Medical Center, Kamogawa, Japan (Bychkov)
| | - Keitaro Matsumoto
- Surgical Oncology (Matsumoto, Miyazaki, Tsuchiya, Nagayasu), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Richard Attanoos
- The Department of Cellular Pathology, Cardiff University, Cardiff, United Kingdom (Attanoos)
| | - Sabina Berezowska
- The Institute of Pathology, Centre Hospitalier Universitaire Vaudois, University of Lausanne, Lausanne, Switzerland (Berezowska)
| | - Luka Brcic
- The Diagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria (Brcic)
| | - Alberto Cavazza
- The Unit of Pathologic Anatomy, Azienda USL/IRCCS di Reggio Emilia, Reggio Emilia, Italy (Cavazza)
| | - John C English
- The Department of Pathology, Vancouver General Hospital, Vancouver, British Columbia, Canada (English)
| | - Alexandre Todorovic Fabro
- The Department of Pathology and Legal Medicine, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil (Fabro)
| | - Kaori Ishida
- The Department of Pathology, Kansai Medical University, Osaka, Japan (Ishida)
| | - Yukio Kashima
- The Department of Pathology, Hyogo Prefectural Awaji Medical Center, Sumoto, Japan (Kashima)
| | - Brandon T Larsen
- The Department of Laboratory Medicine and Pathology, Mayo Clinic, Scottsdale, Arizona (Larsen, Smith)
| | - Alberto M Marchevsky
- The Department of Pathology, Cedars-Sinai Medical Center, Los Angeles, California (Marchevsky)
| | - Takuro Miyazaki
- Surgical Oncology (Matsumoto, Miyazaki, Tsuchiya, Nagayasu), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Shimpei Morimoto
- The Innovation Platform & Office for Precision Medicine (Morimoto), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Anja C Roden
- The Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, Minnesota (Roden)
| | - Frank Schneider
- The Department of Pathology and Laboratory Medicine, Emory University, Atlanta, Georgia (Schneider)
| | | | - Maxwell L Smith
- The Department of Laboratory Medicine and Pathology, Mayo Clinic, Scottsdale, Arizona (Larsen, Smith)
| | - Kazuhiro Tabata
- The Department of Pathology, Kagoshima University, Kagoshima, Japan (Tabata)
| | - Angela M Takano
- The Department of Anatomical Pathology, Singapore General Hospital, Singapore, Singapore (Takano)
| | - Kei Tanaka
- From the Departments of Pathology (Lami, K. Tanaka, Fukuoka), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Tomonori Tanaka
- The Department of Diagnostic Pathology, Kobe University Hospital, Kobe, Japan (T. Tanaka)
| | - Tomoshi Tsuchiya
- Surgical Oncology (Matsumoto, Miyazaki, Tsuchiya, Nagayasu), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Takeshi Nagayasu
- Surgical Oncology (Matsumoto, Miyazaki, Tsuchiya, Nagayasu), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Junya Fukuoka
- From the Departments of Pathology (Lami, K. Tanaka, Fukuoka), Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| |
Collapse
|
14
|
Iyer K, Ren S, Pu L, Mazur S, Zhao X, Dhupar R, Pu J. A Graph-Based Approach to Identify Factors Contributing to Postoperative Lung Cancer Recurrence among Patients with Non-Small-Cell Lung Cancer. Cancers (Basel) 2023; 15:3472. [PMID: 37444581 PMCID: PMC10340686 DOI: 10.3390/cancers15133472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Revised: 06/29/2023] [Accepted: 06/30/2023] [Indexed: 07/15/2023] Open
Abstract
The accurate identification of the preoperative factors impacting postoperative cancer recurrence is crucial for optimizing neoadjuvant and adjuvant therapies and guiding follow-up treatment plans. We modeled the causal relationship between radiographical features derived from CT scans and the clinicopathologic factors associated with postoperative lung cancer recurrence and recurrence-free survival. A retrospective cohort of 363 non-small-cell lung cancer (NSCLC) patients who underwent lung resections with a minimum 5-year follow-up was analyzed. Body composition tissues and tumor features were quantified based on preoperative whole-body CT scans (acquired as a component of PET-CT scans) and chest CT scans, respectively. A novel causal graphical model was used to visualize the causal relationship between these factors. Variables were assessed using the intervention do-calculus adjustment (IDA) score. Direct predictors for recurrence-free survival included smoking history, T-stage, height, and intramuscular fat mass. Subcutaneous fat mass, visceral fat volume, and bone mass exerted the greatest influence on the model. For recurrence, the most significant variables were visceral fat volume, subcutaneous fat volume, and bone mass. Pathologic variables contributed to the recurrence model, with bone mass, TNM stage, and weight being the most important. Body composition, particularly adipose tissue distribution, significantly and causally impacted both recurrence and recurrence-free survival through interconnected relationships with other variables.
Collapse
Affiliation(s)
- Kartik Iyer
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA; (K.I.); (S.R.); (X.Z.)
| | - Shangsi Ren
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA; (K.I.); (S.R.); (X.Z.)
| | - Lucy Pu
- Department of Cardiothoracic Surgery, Division of Thoracic and Foregut Surgery, University of Pittsburgh, Pittsburgh, PA 15213, USA; (L.P.); (S.M.); (R.D.)
| | - Summer Mazur
- Department of Cardiothoracic Surgery, Division of Thoracic and Foregut Surgery, University of Pittsburgh, Pittsburgh, PA 15213, USA; (L.P.); (S.M.); (R.D.)
| | - Xiaoyan Zhao
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA; (K.I.); (S.R.); (X.Z.)
| | - Rajeev Dhupar
- Department of Cardiothoracic Surgery, Division of Thoracic and Foregut Surgery, University of Pittsburgh, Pittsburgh, PA 15213, USA; (L.P.); (S.M.); (R.D.)
- Surgical Services Division, Thoracic Surgery, VA Pittsburgh Healthcare System, Pittsburgh, PA 15213, USA
| | - Jiantao Pu
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA; (K.I.); (S.R.); (X.Z.)
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA
| |
Collapse
|
15
|
Janik A, Torrente M, Costabello L, Calvo V, Walsh B, Camps C, Mohamed SK, Ortega AL, Nováček V, Massutí B, Minervini P, Campelo MRG, del Barco E, Bosch-Barrera J, Menasalvas E, Timilsina M, Provencio M. Machine Learning-Assisted Recurrence Prediction for Patients With Early-Stage Non-Small-Cell Lung Cancer. JCO Clin Cancer Inform 2023; 7:e2200062. [PMID: 37428988 PMCID: PMC10569772 DOI: 10.1200/cci.22.00062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 01/30/2023] [Accepted: 04/14/2023] [Indexed: 07/12/2023] Open
Abstract
PURPOSE Stratifying patients with cancer according to risk of relapse can personalize their care. In this work, we provide an answer to the following research question: How to use machine learning to estimate probability of relapse in patients with early-stage non-small-cell lung cancer (NSCLC)? MATERIALS AND METHODS For predicting relapse in 1,387 patients with early-stage (I-II) NSCLC from the Spanish Lung Cancer Group data (average age 65.7 years, female 24.8%, male 75.2%), we train tabular and graph machine learning models. We generate automatic explanations for the predictions of such models. For models trained on tabular data, we adopt SHapley Additive exPlanations local explanations to gauge how each patient feature contributes to the predicted outcome. We explain graph machine learning predictions with an example-based method that highlights influential past patients. RESULTS Machine learning models trained on tabular data exhibit a 76% accuracy for the random forest model at predicting relapse evaluated with a 10-fold cross-validation (the model was trained 10 times with different independent sets of patients in test, train, and validation sets, and the reported metrics are averaged over these 10 test sets). Graph machine learning reaches 68% accuracy over a held-out test set of 200 patients, calibrated on a held-out set of 100 patients. CONCLUSION Our results show that machine learning models trained on tabular and graph data can enable objective, personalized, and reproducible prediction of relapse and, therefore, disease outcome in patients with early-stage NSCLC. With further prospective and multisite validation, and additional radiological and molecular data, this prognostic model could potentially serve as a predictive decision support tool for deciding the use of adjuvant treatments in early-stage lung cancer.
Collapse
Affiliation(s)
| | - Maria Torrente
- Medical Oncology Department, Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain
| | | | - Virginia Calvo
- Medical Oncology Department, Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain
| | - Brian Walsh
- Data Science Institute, University of Galway, Galway, Ireland
- Insight Centre for Data Analytics, University of Galway, Galway, Ireland
| | | | - Sameh K. Mohamed
- Data Science Institute, University of Galway, Galway, Ireland
- Insight Centre for Data Analytics, University of Galway, Galway, Ireland
| | | | - Vít Nováček
- Data Science Institute, University of Galway, Galway, Ireland
- Insight Centre for Data Analytics, University of Galway, Galway, Ireland
- Faculty of Informatics, Masaryk University, Brno, Czech Republic
- Masaryk Memorial Cancer Institute, Brno, Czech Republic
| | | | | | | | | | | | | | - Mohan Timilsina
- Data Science Institute, University of Galway, Galway, Ireland
- Insight Centre for Data Analytics, University of Galway, Galway, Ireland
| | - Mariano Provencio
- Medical Oncology Department, Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain
| |
Collapse
|
16
|
Gezer NS, Bandos AI, Beeche CA, Leader JK, Dhupar R, Pu J. CT-derived body composition associated with lung cancer recurrence after surgery. Lung Cancer 2023; 179:107189. [PMID: 37058786 PMCID: PMC10166196 DOI: 10.1016/j.lungcan.2023.107189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 03/24/2023] [Accepted: 04/07/2023] [Indexed: 04/16/2023]
Abstract
OBJECTIVES To evaluate the impact of body composition derived from computed tomography (CT) scans on postoperative lung cancer recurrence. METHODS We created a retrospective cohort of 363 lung cancer patients who underwent lung resections and had verified recurrence, death, or at least 5-year follow-up without either event. Five key body tissues and ten tumor features were automatically segmented and quantified based on preoperative whole-body CT scans (acquired as part of a PET-CT scan) and chest CT scans, respectively. Time-to-event analysis accounting for the competing event of death was performed to analyze the impact of body composition, tumor features, clinical information, and pathological features on lung cancer recurrence after surgery. The hazard ratio (HR) of normalized factors was used to assess individual significance univariately and in the combined models. The 5-fold cross-validated time-dependent receiver operating characteristics analysis, with an emphasis on the area under the 3-year ROC curve (AUC), was used to characterize the ability to predict lung cancer recurrence. RESULTS Body tissues that showed a standalone potential to predict lung cancer recurrence include visceral adipose tissue (VAT) volume (HR = 0.88, p = 0.047), subcutaneous adipose tissue (SAT) density (HR = 1.14, p = 0.034), inter-muscle adipose tissue (IMAT) volume (HR = 0.83, p = 0.002), muscle density (HR = 1.27, p < 0.001), and total fat volume (HR = 0.89, p = 0.050). The CT-derived muscular and tumor features significantly contributed to a model including clinicopathological factors, resulting in an AUC of 0.78 (95% CI: 0.75-0.83) to predict recurrence at 3 years. CONCLUSIONS Body composition features (e.g., muscle density, or muscle and inter-muscle adipose tissue volumes) can improve the prediction of recurrence when combined with clinicopathological factors.
Collapse
Affiliation(s)
- Naciye S Gezer
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Andriy I Bandos
- Department of Biostatistics, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Cameron A Beeche
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Joseph K Leader
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Rajeev Dhupar
- Department of Cardiothoracic Surgery, Division of Thoracic and Foregut Surgery, University of Pittsburgh, Pittsburgh, PA 15213, USA; Surgical Services Division, Thoracic Surgery, VA Pittsburgh Healthcare System, Pittsburgh, PA 15213, USA.
| | - Jiantao Pu
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA 15213, USA; Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA 15213, USA.
| |
Collapse
|
17
|
Kobayashi M, Kurimoto N, Tanino R, Shiratsuki Y, Okuno T, Nakao M, Hotta T, Tsubata Y, Nagasaki M, Nishisaka T, Isobe T. Comparison of Ultra-Magnifying Endocytoscopic and Hematoxylin-Eosin-Stained Images of Lung Specimens. Diagnostics (Basel) 2023; 13:diagnostics13051003. [PMID: 36900147 PMCID: PMC10000767 DOI: 10.3390/diagnostics13051003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/01/2023] [Accepted: 03/02/2023] [Indexed: 03/09/2023] Open
Abstract
Endocytoscopy enables real-time observation of lesions at ultra-magnification. In the gastrointestinal and respiratory fields, endocytoscopic images are similar to hematoxylin-eosin-stained images. This study aimed to compare the nuclear features of pulmonary lesions in endocytoscopic and hematoxylin-eosin-stained images. We performed an endocytoscopy to observe resected specimens of normal lung tissue and lesions. Nuclear features were extracted using ImageJ. We analyzed five nuclear features: nuclear number per area, mean nucleus area, median circularity, coefficient of variation of roundness, and median Voronoi area. We conducted dimensionality reduction analyses for these features, followed by assessments of the inter-observer agreement among two pathologists and two pulmonologists to evaluate endocytoscopic videos. We analyzed the nuclear features of hematoxylin-eosin-stained and endocytoscopic images from 40 and 33 cases, respectively. Endocytoscopic and hematoxylin-eosin-stained images displayed a similar tendency for each feature, despite there being no correlation. Conversely, the dimensionality reduction analyses demonstrated similar distributions of normal lung and malignant clusters in both images, thus differentiating between the clusters. The diagnostic accuracy of the pathologists was 58.3% and 52.8% (κ-value 0.38, fair), and that of the pulmonologists was 50% and 47.2% (κ-value 0.33, fair). The five nuclear features of pulmonary lesions were similar in the endocytoscopic and hematoxylin-eosin-stained images.
Collapse
Affiliation(s)
- Misato Kobayashi
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Noriaki Kurimoto
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
- Correspondence: ; Tel.: +81-853-20-2580
| | - Ryosuke Tanino
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Yohei Shiratsuki
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Takae Okuno
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Mika Nakao
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Takamasa Hotta
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Yukari Tsubata
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| | - Makoto Nagasaki
- Division of Pathology, National Hospital Organization Hamada Medical Center, Hamada 697-8511, Japan
| | - Takashi Nishisaka
- Department of Pathology and Laboratory Medicine, Hiroshima Prefectural Hospital, Hiroshima 734-8530, Japan
| | - Takeshi Isobe
- Division of Medical Oncology & Respiratory Medicine, Department of Internal Medicine, Faculty of Medicine, Shimane University, Izumo 693-8501, Japan
| |
Collapse
|
18
|
Torrente M, Sousa PA, Guerreiro GR, Franco F, Hernández R, Parejo C, Sousa A, Campo-Cañaveral JL, Pimentão J, Provencio M. Clinical factors influencing long-term survival in a real-life cohort of early stage non-small-cell lung cancer patients in Spain. Front Oncol 2023; 13:1074337. [PMID: 36910629 PMCID: PMC9996278 DOI: 10.3389/fonc.2023.1074337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Accepted: 01/30/2023] [Indexed: 02/25/2023] Open
Abstract
Background Current prognosis in oncology is reduced to the tumour stage and performance status, leaving out many other factors that may impact the patient´s management. Prognostic stratification of early stage non-small-cell lung cancer (NSCLC) patients with poor prognosis after surgery is of considerable clinical relevance. The objective of this study was to identify clinical factors associated with long-term overall survival in a real-life cohort of patients with stage I-II NSCLC and develop a prognostic model that identifies features associated with poor prognosis and stratifies patients by risk. Methods This is a cohort study including 505 patients, diagnosed with stage I-II NSCLC, who underwent curative surgical procedures at a tertiary hospital in Madrid, Spain. Results Median OS (in months) was 63.7 (95% CI, 58.7-68.7) for the whole cohort, 62.4 in patients submitted to surgery and 65 in patients submitted to surgery and adjuvant treatment. The univariate analysis estimated that a female diagnosed with NSCLC has a 0.967 (95% CI 0.936 - 0.999) probability of survival one year after diagnosis and a 0.784 (95% CI 0.712 - 0.863) five years after diagnosis. For males, these probabilities drop to 0.904 (95% CI 0.875 - 0.934) and 0.613 (95% CI 0.566 - 0.665), respectively. Multivariable analysis shows that sex, age at diagnosis, type of treatment, ECOG-PS, and stage are statistically significant variables (p<0.10). According to the Cox regression model, age over 50, ECOG-PS 1 or 2, and stage ll are risk factors for survival (HR>1) while adjuvant chemotherapy is a good prognostic variable (HR<1). The prognostic model identified a high-risk profile defined by males over 71 years old, former smokers, treated with surgery, ECOG-PS 2. Conclusions The results of the present study found that, overall, adjuvant chemotherapy was associated with the best long-term OS in patients with resected NSCLC. Age, stage and ECOG-PS were also significant factors to take into account when making decisions regarding adjuvant therapy.
Collapse
Affiliation(s)
- Maria Torrente
- Department of Medical Oncology, Puerta de Hierro-Majadahonda University Hospital, Madrid, Spain.,Faculty of Health Sciences, Francisco de Vitoria University, Madrid, Spain
| | - Pedro A Sousa
- Department of Electrical Engineering, NOVA School of Science and Technology, Universidade Nova de Lisboa, Lisbon, Portugal
| | - Gracinda R Guerreiro
- Department of Mathematics and CMA, NOVA School of Science and Technology, Universidade Nova de Lisboa, Lisbon, Portugal
| | - Fabio Franco
- Department of Medical Oncology, Puerta de Hierro-Majadahonda University Hospital, Madrid, Spain
| | - Roberto Hernández
- Department of Medical Oncology, Puerta de Hierro-Majadahonda University Hospital, Madrid, Spain
| | - Consuelo Parejo
- Department of Medical Oncology, Puerta de Hierro-Majadahonda University Hospital, Madrid, Spain
| | - Alexandre Sousa
- Department of Electrical Engineering, NOVA School of Science and Technology, Universidade Nova de Lisboa, Lisbon, Portugal
| | | | - João Pimentão
- Department of Electrical Engineering, NOVA School of Science and Technology, Universidade Nova de Lisboa, Lisbon, Portugal
| | - Mariano Provencio
- Department of Medical Oncology, Puerta de Hierro-Majadahonda University Hospital, Madrid, Spain
| |
Collapse
|
19
|
Ahmed AA, Abouzid M, Kaczmarek E. Deep Learning Approaches in Histopathology. Cancers (Basel) 2022; 14:5264. [PMID: 36358683 PMCID: PMC9654172 DOI: 10.3390/cancers14215264] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2022] [Revised: 10/10/2022] [Accepted: 10/24/2022] [Indexed: 10/06/2023] Open
Abstract
The revolution of artificial intelligence and its impacts on our daily life has led to tremendous interest in the field and its related subtypes: machine learning and deep learning. Scientists and developers have designed machine learning- and deep learning-based algorithms to perform various tasks related to tumor pathologies, such as tumor detection, classification, grading with variant stages, diagnostic forecasting, recognition of pathological attributes, pathogenesis, and genomic mutations. Pathologists are interested in artificial intelligence to improve the diagnosis precision impartiality and to minimize the workload combined with the time consumed, which affects the accuracy of the decision taken. Regrettably, there are already certain obstacles to overcome connected to artificial intelligence deployments, such as the applicability and validation of algorithms and computational technologies, in addition to the ability to train pathologists and doctors to use these machines and their willingness to accept the results. This review paper provides a survey of how machine learning and deep learning methods could be implemented into health care providers' routine tasks and the obstacles and opportunities for artificial intelligence application in tumor morphology.
Collapse
Affiliation(s)
- Alhassan Ali Ahmed
- Department of Bioinformatics and Computational Biology, Poznan University of Medical Sciences, 60-812 Poznan, Poland
- Doctoral School, Poznan University of Medical Sciences, 60-812 Poznan, Poland
| | - Mohamed Abouzid
- Doctoral School, Poznan University of Medical Sciences, 60-812 Poznan, Poland
- Department of Physical Pharmacy and Pharmacokinetics, Faculty of Pharmacy, Poznan University of Medical Sciences, Rokietnicka 3 St., 60-806 Poznan, Poland
| | - Elżbieta Kaczmarek
- Department of Bioinformatics and Computational Biology, Poznan University of Medical Sciences, 60-812 Poznan, Poland
| |
Collapse
|
20
|
Sussman L, Garcia-Robledo JE, Ordóñez-Reyes C, Forero Y, Mosquera AF, Ruíz-Patiño A, Chamorro DF, Cardona AF. Integration of artificial intelligence and precision oncology in Latin America. FRONTIERS IN MEDICAL TECHNOLOGY 2022; 4:1007822. [PMID: 36311461 PMCID: PMC9608820 DOI: 10.3389/fmedt.2022.1007822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Accepted: 09/21/2022] [Indexed: 11/07/2022] Open
Abstract
Next-generation medicine encompasses different concepts related to healthcare models and technological developments. In Latin America and the Caribbean, healthcare systems are quite different between countries, and cancer control is known to be insufficient and inefficient considering socioeconomically discrepancies. Despite advancements in knowledge about the biology of different oncological diseases, the disease remains a challenge in terms of diagnosis, treatment, and prognosis for clinicians and researchers. With the development of molecular biology, better diagnosis methods, and therapeutic tools in the last years, artificial intelligence (AI) has become important, because it could improve different clinical scenarios: predicting clinically relevant parameters, cancer diagnosis, cancer research, and accelerating the growth of personalized medicine. The incorporation of AI represents an important challenge in terms of diagnosis, treatment, and prognosis for clinicians and researchers in cancer care. Therefore, some studies about AI in Latin America and the Caribbean are being conducted with the aim to improve the performance of AI in those countries. This review introduces AI in cancer care in Latin America and the Caribbean, and the advantages and promising results that it has shown in this socio-demographic context.
Collapse
Affiliation(s)
- Liliana Sussman
- Department of Neurology, Fundación Universitaria de Ciencias de la Salud, Bogotá, Colombia,Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia
| | - Juan Esteban Garcia-Robledo
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,Division of Hematology/Oncology, Mayo Clinic, Scottsdale, AZ, United States
| | - Camila Ordóñez-Reyes
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,MolecularOncology and Biology Systems Research Group (Fox-G), Universidad el Bosque, Bogotá, Colombia
| | - Yency Forero
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,MolecularOncology and Biology Systems Research Group (Fox-G), Universidad el Bosque, Bogotá, Colombia
| | - Andrés F. Mosquera
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,MolecularOncology and Biology Systems Research Group (Fox-G), Universidad el Bosque, Bogotá, Colombia
| | - Alejandro Ruíz-Patiño
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,MolecularOncology and Biology Systems Research Group (Fox-G), Universidad el Bosque, Bogotá, Colombia
| | - Diego F. Chamorro
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,MolecularOncology and Biology Systems Research Group (Fox-G), Universidad el Bosque, Bogotá, Colombia
| | - Andrés F. Cardona
- Foundation for Clinical and Applied Cancer Research – FICMAC, Bogotá, Colombia,MolecularOncology and Biology Systems Research Group (Fox-G), Universidad el Bosque, Bogotá, Colombia,Direction of Research, Science and Education, Luis Carlos Sarmiento Angulo Cancer Treatment and Research Center (CTIC), Bogotá, Colombia,Correspondence: Andrés F. Cardona
| |
Collapse
|
21
|
Lung Cancer Recurrence Risk Prediction through Integrated Deep Learning Evaluation. Cancers (Basel) 2022; 14:cancers14174150. [PMID: 36077686 PMCID: PMC9454871 DOI: 10.3390/cancers14174150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 08/19/2022] [Accepted: 08/22/2022] [Indexed: 11/30/2022] Open
Abstract
Background: Prognostic risk factors for completely resected stage IA non-small-cell lung cancers (NSCLCs) have advanced minimally over recent decades. Although several biomarkers have been found to be associated with cancer recurrence, their added value to TNM staging and tumor grade are unclear. Methods: Features of preoperative low-dose CT image and histologic findings of hematoxylin- and eosin-stained tissue sections of resected lung tumor specimens were extracted from 182 stage IA NSCLC patients in the National Lung Screening Trial. These features were combined to predict the risk of tumor recurrence or progression through integrated deep learning evaluation (IDLE). Added values of IDLE to TNM staging and tumor grade in progression risk prediction and risk stratification were evaluated. Results: The 5-year AUC of IDLE was 0.817 ± 0.037 as compared to the AUC = 0.561 ± 0.042 and 0.573 ± 0.044 from the TNM stage and tumor grade, respectively. The IDLE score was significantly associated with cancer recurrence (p < 0.0001) even after adjusting for TNM staging and tumor grade. Synergy between chest CT image markers and histological markers was the driving force of the deep learning algorithm to produce a stronger prognostic predictor. Conclusions: Integrating markers from preoperative CT images and pathologist’s readings of resected lung specimens through deep learning can improve risk stratification of stage 1A NSCLC patients over TNM staging and tumor grade alone. Our study suggests that combining markers from nonoverlapping platforms can increase the cancer risk prediction accuracy.
Collapse
|
22
|
Orsulic S, John J, Walts AE, Gertych A. Computational pathology in ovarian cancer. Front Oncol 2022; 12:924945. [PMID: 35965569 PMCID: PMC9372445 DOI: 10.3389/fonc.2022.924945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Accepted: 06/27/2022] [Indexed: 11/30/2022] Open
Abstract
Histopathologic evaluations of tissue sections are key to diagnosing and managing ovarian cancer. Pathologists empirically assess and integrate visual information, such as cellular density, nuclear atypia, mitotic figures, architectural growth patterns, and higher-order patterns, to determine the tumor type and grade, which guides oncologists in selecting appropriate treatment options. Latent data embedded in pathology slides can be extracted using computational imaging. Computers can analyze digital slide images to simultaneously quantify thousands of features, some of which are visible with a manual microscope, such as nuclear size and shape, while others, such as entropy, eccentricity, and fractal dimensions, are quantitatively beyond the grasp of the human mind. Applications of artificial intelligence and machine learning tools to interpret digital image data provide new opportunities to explore and quantify the spatial organization of tissues, cells, and subcellular structures. In comparison to genomic, epigenomic, transcriptomic, and proteomic patterns, morphologic and spatial patterns are expected to be more informative as quantitative biomarkers of complex and dynamic tumor biology. As computational pathology is not limited to visual data, nuanced subvisual alterations that occur in the seemingly “normal” pre-cancer microenvironment could facilitate research in early cancer detection and prevention. Currently, efforts to maximize the utility of computational pathology are focused on integrating image data with other -omics platforms that lack spatial information, thereby providing a new way to relate the molecular, spatial, and microenvironmental characteristics of cancer. Despite a dire need for improvements in ovarian cancer prevention, early detection, and treatment, the ovarian cancer field has lagged behind other cancers in the application of computational pathology. The intent of this review is to encourage ovarian cancer research teams to apply existing and/or develop additional tools in computational pathology for ovarian cancer and actively contribute to advancing this important field.
Collapse
Affiliation(s)
- Sandra Orsulic
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA, United States
- Department of Obstetrics and Gynecology, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, United States
- Jonsson Comprehensive Cancer Center, University of California Los Angeles, Los Angeles, CA, United States
- *Correspondence: Sandra Orsulic,
| | - Joshi John
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA, United States
- Department of Psychiatry, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, United States
| | - Ann E. Walts
- Department of Pathology and Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, United States
| | - Arkadiusz Gertych
- Department of Pathology and Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, United States
- Department of Surgery, Cedars-Sinai Medical Center, Los Angeles, CA, United States
- Faculty of Biomedical Engineering, Silesian University of Technology, Zabrze, Poland
| |
Collapse
|
23
|
Xie J, Pu X, He J, Qiu Y, Lu C, Gao W, Wang X, Lu H, Shi J, Xu Y, Madabhushi A, Fan X, Chen J, Xu J. Survival prediction on intrahepatic cholangiocarcinoma with histomorphological analysis on the whole slide images. Comput Biol Med 2022; 146:105520. [DOI: 10.1016/j.compbiomed.2022.105520] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 04/07/2022] [Accepted: 04/11/2022] [Indexed: 01/06/2023]
|
24
|
Viswanathan VS, Toro P, Corredor G, Mukhopadhyay S, Madabhushi A. The state of the art for artificial intelligence in lung digital pathology. J Pathol 2022; 257:413-429. [PMID: 35579955 PMCID: PMC9254900 DOI: 10.1002/path.5966] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 04/26/2022] [Accepted: 05/15/2022] [Indexed: 12/03/2022]
Abstract
Lung diseases carry a significant burden of morbidity and mortality worldwide. The advent of digital pathology (DP) and an increase in computational power have led to the development of artificial intelligence (AI)-based tools that can assist pathologists and pulmonologists in improving clinical workflow and patient management. While previous works have explored the advances in computational approaches for breast, prostate, and head and neck cancers, there has been a growing interest in applying these technologies to lung diseases as well. The application of AI tools on radiology images for better characterization of indeterminate lung nodules, fibrotic lung disease, and lung cancer risk stratification has been well documented. In this article, we discuss methodologies used to build AI tools in lung DP, describing the various hand-crafted and deep learning-based unsupervised feature approaches. Next, we review AI tools across a wide spectrum of lung diseases including cancer, tuberculosis, idiopathic pulmonary fibrosis, and COVID-19. We discuss the utility of novel imaging biomarkers for different types of clinical problems including quantification of biomarkers like PD-L1, lung disease diagnosis, risk stratification, and prediction of response to treatments such as immune checkpoint inhibitors. We also look briefly at some emerging applications of AI tools in lung DP such as multimodal data analysis, 3D pathology, and transplant rejection. Lastly, we discuss the future of DP-based AI tools, describing the challenges with regulatory approval, developing reimbursement models, planning clinical deployment, and addressing AI biases. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.
Collapse
Affiliation(s)
| | - Paula Toro
- Department of PathologyCleveland ClinicClevelandOHUSA
| | - Germán Corredor
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
- Louis Stokes Cleveland VA Medical CenterClevelandOHUSA
| | | | - Anant Madabhushi
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
- Louis Stokes Cleveland VA Medical CenterClevelandOHUSA
| |
Collapse
|
25
|
Zhao Y, Qing B, Xu C, Zhao J, Liao Y, Cui P, Wang G, Cai S, Song Y, Cao L, Duan J. DNA Damage Response Gene-Based Subtypes Associated With Clinical Outcomes in Early-Stage Lung Adenocarcinoma. Front Mol Biosci 2022; 9:901829. [PMID: 35813819 PMCID: PMC9257065 DOI: 10.3389/fmolb.2022.901829] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 05/11/2022] [Indexed: 12/04/2022] Open
Abstract
DNA damage response (DDR) pathways play a crucial role in lung cancer. In this retrospective analysis, we aimed to develop a prognostic model and molecular subtype based on the expression profiles of DDR-related genes in early-stage lung adenocarcinoma (LUAD). A total of 1,785 lung adenocarcinoma samples from one RNA-seq dataset of The Cancer Genome Atlas (TCGA) and six microarray datasets of Gene Expression Omnibus (GEO) were included in the analysis. In the TCGA dataset, a DNA damage response gene (DRG)–based signature consisting of 16 genes was constructed to predict the clinical outcomes of LUAD patients. Patients in the low-DRG score group had better outcomes and lower genomic instability. Then, the same 16 genes were used to develop DRG-based molecular subtypes in the TCGA dataset to stratify early-stage LUAD into two subtypes (DRG1 and DRG2) which had significant differences in clinical outcomes. The Kappa test showed good consistency between molecular subtype and DRG (K = 0.61, p < 0.001). The DRG subtypes were significantly associated with prognosis in the six GEO datasets (pooled estimates of hazard ratio, OS: 0.48 (0.41–0.57), p < 0.01; DFS: 0.50 (0.41–0.62), p < 0.01). Furthermore, patients in the DRG2 group benefited more from adjuvant therapy than standard-of-care, which was not observed in the DRG1 group. In summary, we constructed a DRG-based molecular subtype that had the potential to predict the prognosis of early-stage LUAD and guide the selection of adjuvant therapy for early-stage LUAD patients.
Collapse
Affiliation(s)
- Yang Zhao
- Department of Thoracic Surgery, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Bei Qing
- Department of Thoracic Surgery, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Chunwei Xu
- Department of Respiratory Medicine, Jinling Hospital, Nanjing University School of Medicine, Nanjing, China
- *Correspondence: Liming Cao, ; Jianchun Duan,
| | - Jing Zhao
- Burning Rock Biotech, Guangzhou, China
| | | | - Peng Cui
- Burning Rock Biotech, Guangzhou, China
| | | | | | - Yong Song
- Department of Respiratory Medicine, Jinling Hospital, Nanjing University School of Medicine, Nanjing, China
| | - Liming Cao
- Department of Respiratory Medicine, Xiangya Hospital, Central South University, Changsha, China
- *Correspondence: Liming Cao, ; Jianchun Duan,
| | - Jianchun Duan
- CAMS Key Laboratory of Translational Research on Lung Cancer, State Key Laboratory of Molecular Oncology, Department of Medical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences Peking Union Medical College, Beijing, China
- *Correspondence: Liming Cao, ; Jianchun Duan,
| |
Collapse
|
26
|
Ding R, Prasanna P, Corredor G, Barrera C, Zens P, Lu C, Velu P, Leo P, Beig N, Li H, Toro P, Berezowska S, Baxi V, Balli D, Belete M, Rimm DL, Velcheti V, Schalper K, Madabhushi A. Image analysis reveals molecularly distinct patterns of TILs in NSCLC associated with treatment outcome. NPJ Precis Oncol 2022; 6:33. [PMID: 35661148 PMCID: PMC9166700 DOI: 10.1038/s41698-022-00277-5] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 04/18/2022] [Indexed: 12/12/2022] Open
Abstract
Despite known histological, biological, and clinical differences between lung adenocarcinoma (LUAD) and squamous cell carcinoma (LUSC), relatively little is known about the spatial differences in their corresponding immune contextures. Our study of over 1000 LUAD and LUSC tumors revealed that computationally derived patterns of tumor-infiltrating lymphocytes (TILs) on H&E images were different between LUAD (N = 421) and LUSC (N = 438), with TIL density being prognostic of overall survival in LUAD and spatial arrangement being more prognostically relevant in LUSC. In addition, the LUAD-specific TIL signature was associated with OS in an external validation set of 100 NSCLC treated with more than six different neoadjuvant chemotherapy regimens, and predictive of response to therapy in the clinical trial CA209-057 (n = 303). In LUAD, the prognostic TIL signature was primarily comprised of CD4+ T and CD8+ T cells, whereas in LUSC, the immune patterns were comprised of CD4+ T, CD8+ T, and CD20+ B cells. In both subtypes, prognostic TIL features were associated with transcriptomics-derived immune scores and biological pathways implicated in immune recognition, response, and evasion. Our results suggest the need for histologic subtype-specific TIL-based models for stratifying survival risk and predicting response to therapy. Our findings suggest that predictive models for response to therapy will need to account for the unique morphologic and molecular immune patterns as a function of histologic subtype of NSCLC.
Collapse
Grants
- UL1 TR002548 NCATS NIH HHS
- R01 CA216579 NCI NIH HHS
- UL1 TR001863 NCATS NIH HHS
- R03 CA219603 NCI NIH HHS
- C06 RR012463 NCRR NIH HHS
- U24 CA199374 NCI NIH HHS
- I01 BX004121 BLRD VA
- R43 EB028736 NIBIB NIH HHS
- U54 CA254566 NCI NIH HHS
- U01 CA239055 NCI NIH HHS
- R37 CA245154 NCI NIH HHS
- R01 CA220581 NCI NIH HHS
- P50 CA196530 NCI NIH HHS
- R01 CA202752 NCI NIH HHS
- R01 CA208236 NCI NIH HHS
- Research reported in this publication was supported by the National Cancer Institute under award numbers 1U24CA199374-01, R01CA202752-01A1, R01CA208236-01A1, R01 CA216579-01A1, R01 CA220581-01A1, 1U01 CA239055-01, 1U01CA248226-01, 1U54CA254566-01, National Heart, Lung and Blood Institute, 1R01HL15127701A1, National Institute for Biomedical Imaging and Bioengineering 1R43EB028736-01, National Center for Research Resources under award number 1 C06 RR12463-01, VA Merit Review Award IBX004121A from the United States Department of Veterans Affairs Biomedical Laboratory Research and Development Service, the Office of the Assistant Secretary of Defense for Health Affairs, through the Breast Cancer Research Program (W81XWH-19-1-0668), the Prostate Cancer Research Program (W81XWH-15-1-0558, W81XWH-20-1-0851), the Lung Cancer Research Program (W81XWH-18-1-0440, W81XWH-20-1-0595), the Peer Reviewed Cancer Research Program (W81XWH-18-1-0404), the Kidney Precision Medicine Project (KPMP) Glue Grant, the Ohio Third Frontier Technology Validation Fund, the Clinical and Translational Science Collaborative of Cleveland (UL1TR0002548) from the National Center for Advancing Translational Sciences (NCATS) component of the National Institutes of Health and NIH roadmap for Medical Research, The Wallace H. Coulter Foundation Program in the Department of Biomedical Engineering at Case Western Reserve University, and National Science Foundation Graduate Research Fellowship Program (CON501692).
- A scholarship of the Cancer Research Switzerland (MD-PhD-5088-06-2020).
- the National Cancer Institute under award numbers R03CA219603, R37CA245154, P50CA196530, the Lung Cancer Research Program W81XWH-16-1-0160 and the Stand Up To Cancer – American Cancer Society Lung Cancer Dream Team Translational Research Grants SU2C-AACR-DT1715 and SU2C-AACR-DT22-17
Collapse
Affiliation(s)
- Ruiwen Ding
- Case Western Reserve University, Cleveland, OH, USA
| | | | - Germán Corredor
- Case Western Reserve University, Cleveland, OH, USA
- Louis Stokes Cleveland VA Medical Center, Cleveland, OH, USA
| | | | - Philipp Zens
- Institute of Pathology, University of Bern, Bern, Switzerland
- Graduate School for Health Sciences, University of Bern, Bern, Switzerland
| | - Cheng Lu
- Case Western Reserve University, Cleveland, OH, USA
| | - Priya Velu
- Weill Cornell Medical College, New York, NY, USA
| | - Patrick Leo
- Case Western Reserve University, Cleveland, OH, USA
| | - Niha Beig
- Case Western Reserve University, Cleveland, OH, USA
| | - Haojia Li
- Case Western Reserve University, Cleveland, OH, USA
| | - Paula Toro
- Case Western Reserve University, Cleveland, OH, USA
| | - Sabina Berezowska
- Institute of Pathology, University of Bern, Bern, Switzerland
- Department of Laboratory Medicine and Pathology, Institute of Pathology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | | | | | | | | | | | | | - Anant Madabhushi
- Case Western Reserve University, Cleveland, OH, USA.
- Louis Stokes Cleveland VA Medical Center, Cleveland, OH, USA.
| |
Collapse
|
27
|
Thomas LB, Mastorides SM, Viswanadhan NA, Jakey CE, Borkowski AA. Artificial Intelligence: Review of Current and Future Applications in Medicine. Fed Pract 2022; 38:527-538. [PMID: 35136337 DOI: 10.12788/fp.0174] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Background The role of artificial intelligence (AI) in health care is expanding rapidly. Currently, there are at least 29 US Food and Drug Administration-approved AI health care devices that apply to numerous medical specialties and many more are in development. Observations With increasing expectations for all health care sectors to deliver timely, fiscally-responsible, high-quality health care, AI has potential utility in numerous areas, such as image analysis, improved workflow and efficiency, public health, and epidemiology, to aid in processing large volumes of patient and medical data. In this review, we describe basic terminology, principles, and general AI applications relating to health care. We then discuss current and future applications for a variety of medical specialties. Finally, we discuss the future potential of AI along with the potential risks and limitations of current AI technology. Conclusions AI can improve diagnostic accuracy, increase patient safety, assist with patient triage, monitor disease progression, and assist with treatment decisions.
Collapse
Affiliation(s)
- L Brannon Thomas
- James A. Haley Veterans' Hospital, Tampa, Florida.,University of South Florida, Morsani College of Medicine, Tampa
| | - Stephen M Mastorides
- James A. Haley Veterans' Hospital, Tampa, Florida.,University of South Florida, Morsani College of Medicine, Tampa
| | | | - Colleen E Jakey
- James A. Haley Veterans' Hospital, Tampa, Florida.,University of South Florida, Morsani College of Medicine, Tampa
| | - Andrew A Borkowski
- James A. Haley Veterans' Hospital, Tampa, Florida.,University of South Florida, Morsani College of Medicine, Tampa
| |
Collapse
|
28
|
Ye Z, Zhang Y, Liang Y, Lang J, Zhang X, Zang G, Yuan D, Tian G, Xiao M, Yang J. Cervical Cancer Metastasis and Recurrence Risk Prediction Based on Deep Convolutional Neural Network. Curr Bioinform 2022. [DOI: 10.2174/1574893616666210708143556] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Background:
Evaluating the risk of metastasis and recurrence of a cervical cancer patient is
critical for appropriate adjuvant therapy. However, current risk assessment models usually involve the
testing of tens to thousands of genes from patients’ tissue samples, which is expensive and timeconsuming.
Therefore, computer-aided diagnosis and prognosis prediction based on Hematoxylin and Eosin
(H&E) pathological images have received much attention recently.
Objective:
The prognosis of whether patients will have metastasis and recurrence can support accurate
treatment for patients in advance and help reduce patient loss. It is also important for guiding treatment
after surgery to be able to quickly and accurately predict the risk of metastasis and recurrence of a cervical
cancer patient.
Method:
To address this problem, we propose a hybrid method. Transfer learning is used to extract features,
and it is combined with traditional machine learning in order to analyze and determine whether
patients have the risks of metastasis and recurrence. First, the proposed model retrieved relevant patches
using a color-based method from H&E pathological images, which were then subjected to image preprocessing
steps such as image normalization and color homogenization. Based on the labeled patched
images, the Xception model with good classification performance was selected, and deep features of
patched pathological images were automatically extracted with transfer learning. After that, the extracted
features were combined to train a random forest model to predict the label of a new patched image.
Finally, a majority voting method was developed to predict the metastasis and recurrence risk of a patient
based on the predictions of patched images from the whole-slide H&E image.
Results:
In our experiment, the proposed model yielded an area under the receiver operating characteristic
curve of 0.82 for the whole-slide image. The experimental results showed that the high-level features
extracted by the deep convolutional neural network from the whole-slide image can be used to predict
the risk of recurrence and metastasis after surgical resection and help identify patients who might receive
additional benefit from adjuvant therapy.
Conclusion:
This paper explored the feasibility of predicting the risk of metastasis and recurrence from
cervical cancer whole slide H&E images through deep learning and random forest methods.
Collapse
Affiliation(s)
- Zixuan Ye
- School of Computer, Hunan University of Technology, Zhuzhou Hunan 412007, China
| | | | - Yuebin Liang
- Geneis (Beijing) Co. Ltd., Beijing 100102, China
| | - Jidong Lang
- Geneis (Beijing) Co. Ltd., Beijing 100102, China
| | - Xiaoli Zhang
- School of Computer, Hunan University of Technology, Zhuzhou Hunan 412007, China
| | | | - Dawei Yuan
- Geneis (Beijing) Co. Ltd., Beijing 100102, China
| | - Geng Tian
- School of Computer, Hunan University of Technology, Zhuzhou Hunan 412007, China
- Geneis (Beijing) Co. Ltd., Beijing 100102, China
| | - Mansheng Xiao
- School of Computer, Hunan University of Technology, Zhuzhou Hunan 412007, China
| | - Jialiang Yang
- School of Computer, Hunan University of Technology, Zhuzhou Hunan 412007, China
- Geneis (Beijing) Co. Ltd., Beijing 100102, China
- Academician Workstation, Changsha
Medical University, Changsha Hunan 410219, China
| |
Collapse
|
29
|
Chan LWC, Ding T, Shao H, Huang M, Hui WFY, Cho WCS, Wong SCC, Tong KW, Chiu KWH, Huang L, Zhou H. Augmented Features Synergize Radiomics in Post-Operative Survival Prediction and Adjuvant Therapy Recommendation for Non-Small Cell Lung Cancer. Front Oncol 2022; 12:659096. [PMID: 35174074 PMCID: PMC8841850 DOI: 10.3389/fonc.2022.659096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 01/03/2022] [Indexed: 11/16/2022] Open
Abstract
Background Owing to the cytotoxic effect, it is challenging for clinicians to decide whether post-operative adjuvant therapy is appropriate for a non-small cell lung cancer (NSCLC) patient. Radiomics has proven its promising ability in predicting survival but research on its actionable model, particularly for supporting the decision of adjuvant therapy, is limited. Methods Pre-operative contrast-enhanced CT images of 123 NSCLC cases were collected, including 76, 13, 16, and 18 cases from R01 and AMC cohorts of The Cancer Imaging Archive (TCIA), Jiangxi Cancer Hospital and Guangdong Provincial People’s Hospital respectively. From each tumor region, 851 radiomic features were extracted and two augmented features were derived therewith to estimate the likelihood of adjuvant therapy. Both Cox regression and machine learning models with the selected main and interaction effects of 853 features were trained using 76 cases from R01 cohort, and their test performances on survival prediction were compared using 47 cases from the AMC cohort and two hospitals. For those cases where adjuvant therapy was unnecessary, recommendations on adjuvant therapy were made again by the outperforming model and compared with those by IBM Watson for Oncology (WFO). Results The Cox model outperformed the machine learning model in predicting survival on the test set (C-Index: 0.765 vs. 0.675). The Cox model consists of 5 predictors, interestingly 4 of which are interactions with augmented features facilitating the modulation of adjuvant therapy option. While WFO recommended no adjuvant therapy for only 13.6% of cases that received unnecessary adjuvant therapy, the same recommendations by the identified Cox model were extended to 54.5% of cases (McNemar’s test p = 0.0003). Conclusions A Cox model with radiomic and augmented features could predict survival accurately and support the decision of adjuvant therapy for bettering the benefit of NSCLC patients.
Collapse
Affiliation(s)
- Lawrence Wing-Chi Chan
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- *Correspondence: Lawrence Wing-Chi Chan, ; William Chi-Shing Cho, ; Haiyu Zhou,
| | - Tong Ding
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Huiling Shao
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Mohan Huang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - William Fuk-Yuen Hui
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - William Chi-Shing Cho
- Department of Clinical Oncology, Queen Elizabeth Hospital, Hong Kong, Hong Kong SAR, China
- *Correspondence: Lawrence Wing-Chi Chan, ; William Chi-Shing Cho, ; Haiyu Zhou,
| | - Sze-Chuen Cesar Wong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Ka Wai Tong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Keith Wan-Hang Chiu
- Department of Diagnostic Radiology, University of Hong Kong, Hong Kong, Hong Kong SAR, China
| | - Luyu Huang
- Department of Thoracic Surgery, Guangdong Provincial People’s Hospital, Guangdong Academy of Medical Sciences, School of Medicine, South China University of Technology, The Second School of Clinical Medicine, Southern Medical University, Guangzhou, China
- Department of Thoracic Surgery, Jiangxi Lung Cancer Institute, Jiangxi Cancer Hospital, Nanchang, China
| | - Haiyu Zhou
- Department of Thoracic Surgery, Guangdong Provincial People’s Hospital, Guangdong Academy of Medical Sciences, School of Medicine, South China University of Technology, The Second School of Clinical Medicine, Southern Medical University, Guangzhou, China
- Department of Thoracic Surgery, Jiangxi Lung Cancer Institute, Jiangxi Cancer Hospital, Nanchang, China
- *Correspondence: Lawrence Wing-Chi Chan, ; William Chi-Shing Cho, ; Haiyu Zhou,
| |
Collapse
|
30
|
Li Y, Chen D, Wu X, Yang W, Chen Y. A narrative review of artificial intelligence-assisted histopathologic diagnosis and decision-making for non-small cell lung cancer: achievements and limitations. J Thorac Dis 2022; 13:7006-7020. [PMID: 35070383 PMCID: PMC8743410 DOI: 10.21037/jtd-21-806] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Accepted: 12/01/2021] [Indexed: 12/12/2022]
Abstract
Objective To summarize the current evidence regarding the applications, workflow, and limitations of artificial intelligence (AI) in the management of patients pathologically-diagnosed with lung cancer. Background Lung cancer is one of the most common cancers and the leading cause of cancer-related deaths worldwide. AI technologies have been applied to daily medical workflow and have achieved an excellent performance in predicting histopathologic subtypes, analyzing gene mutation profiles, and assisting in clinical decision-making for lung cancer treatment. More advanced deep learning for classifying pathologic images with minimal human interactions has been developed in addition to the conventional machine learning scheme. Methods Studies were identified by searching databases, including PubMed, EMBASE, Web of Science, and Cochrane Library, up to February 2021 without language restrictions. Conclusions A number of studies have evaluated AI pipelines and confirmed that AI is robust and efficacious in lung cancer diagnosis and decision-making, demonstrating that AI models are a useful tool for assisting oncologists in health management. Although several limitations that pose an obstacle for the widespread use of AI schemes persist, the unceasing refinement of AI techniques is poised to overcome such problems. Thus, AI technology is a promising tool for use in diagnosing and managing lung cancer.
Collapse
Affiliation(s)
- Yongzhong Li
- Department of Thoracic Surgery, the Second Affiliated Hospital of Soochow University, Suzhou, China
| | - Donglai Chen
- Department of Thoracic Surgery, Shanghai Pulmonary Hospital, Tongji University, School of Medicine, Shanghai, China
| | - Xuejie Wu
- Department of Thoracic Surgery, the Second Affiliated Hospital of Soochow University, Suzhou, China
| | - Wentao Yang
- Department of Thoracic Surgery, the Second Affiliated Hospital of Soochow University, Suzhou, China
| | - Yongbing Chen
- Department of Thoracic Surgery, the Second Affiliated Hospital of Soochow University, Suzhou, China
| |
Collapse
|
31
|
Digital pathology and artificial intelligence in translational medicine and clinical practice. Mod Pathol 2022; 35:23-32. [PMID: 34611303 PMCID: PMC8491759 DOI: 10.1038/s41379-021-00919-2] [Citation(s) in RCA: 154] [Impact Index Per Article: 77.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 08/18/2021] [Accepted: 08/30/2021] [Indexed: 02/07/2023]
Abstract
Traditional pathology approaches have played an integral role in the delivery of diagnosis, semi-quantitative or qualitative assessment of protein expression, and classification of disease. Technological advances and the increased focus on precision medicine have recently paved the way for the development of digital pathology-based approaches for quantitative pathologic assessments, namely whole slide imaging and artificial intelligence (AI)-based solutions, allowing us to explore and extract information beyond human visual perception. Within the field of immuno-oncology, the application of such methodologies in drug development and translational research have created invaluable opportunities for deciphering complex pathophysiology and the discovery of novel biomarkers and drug targets. With an increasing number of treatment options available for any given disease, practitioners face the growing challenge of selecting the most appropriate treatment for each patient. The ever-increasing utilization of AI-based approaches substantially expands our understanding of the tumor microenvironment, with digital approaches to patient stratification and selection for diagnostic assays supporting the identification of the optimal treatment regimen based on patient profiles. This review provides an overview of the opportunities and limitations around implementing AI-based methods in biomarker discovery and patient selection and discusses how advances in digital pathology and AI should be considered in the current landscape of translational medicine, touching on challenges this technology may face if adopted in clinical settings. The traditional role of pathologists in delivering accurate diagnoses or assessing biomarkers for companion diagnostics may be enhanced in precision, reproducibility, and scale by AI-powered analysis tools.
Collapse
|
32
|
He W, Li Q, Lu Y, Ju D, Gu Y, Zhao K, Dong C. Cancer treatment evolution from traditional methods to stem cells and gene therapy. Curr Gene Ther 2021; 22:368-385. [PMID: 34802404 DOI: 10.2174/1566523221666211119110755] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Revised: 06/25/2021] [Accepted: 09/16/2021] [Indexed: 12/24/2022]
Abstract
BACKGROUND Cancer, a malignant tumor, is caused by the failure of the mechanism that controls cell growth and proliferation. Late clinical symptoms often manifest as lumps, pain, ulcers, and bleeding. Systemic symptoms include weight loss, fatigue, and loss of appetite. It is a major disease that threatens human life and health. How to treat cancer is a long-standing problem that needs to be overcome in the history of medicine. METHOD Traditional tumor treatment methods are poorly targeted, and the side effects of treatment seriously damage the physical and mental health of patients. In recent years, with the advancement of medical science and technology, the research on gene combined with mesenchymal stem cells to treat tumors has been intensified. Mesenchymal stem cells carry genes to target cancer cells, which can achieve better therapeutic effects. DISCUSSION In the text, we systematically review the cancer treatment evolution from traditional methods to novel approaches that include immunotherapy, nanotherapy, stem cell theapy, and gene therapy. We provide the latest review of the application status, clinical trials and development prospects of mesenchymal stem cells and gene therapy for cancer, as well as their integration in cancer treatment. Mesenchymal stem cells are effective carriers carrying genes and provide new clinical ideas for tumor treatment. CONCLUSION This review focuses on the current status, application prospects and challenges of mesenchymal stem cell combined gene therapy for cancer, and provides new ideas for clinical research.
Collapse
Affiliation(s)
- Wenhua He
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| | - Qingxuan Li
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| | - Yan Lu
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| | - Dingyue Ju
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| | - Yu Gu
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| | - Kai Zhao
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| | - Chuanming Dong
- Department of Anatomy, Medical College of Nantong University, Nantong 226001. China
| |
Collapse
|
33
|
Williams S, Layard Horsfall H, Funnell JP, Hanrahan JG, Khan DZ, Muirhead W, Stoyanov D, Marcus HJ. Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm. Cancers (Basel) 2021; 13:cancers13195010. [PMID: 34638495 PMCID: PMC8508169 DOI: 10.3390/cancers13195010] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 10/02/2021] [Accepted: 10/03/2021] [Indexed: 01/01/2023] Open
Abstract
Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.
Collapse
Affiliation(s)
- Simon Williams
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
- Correspondence:
| | - Hugo Layard Horsfall
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Jonathan P. Funnell
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - John G. Hanrahan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danyal Z. Khan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - William Muirhead
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danail Stoyanov
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Hani J. Marcus
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| |
Collapse
|
34
|
Mi H, Bivalacqua TJ, Kates M, Seiler R, Black PC, Popel AS, Baras AS. Predictive models of response to neoadjuvant chemotherapy in muscle-invasive bladder cancer using nuclear morphology and tissue architecture. Cell Rep Med 2021; 2:100382. [PMID: 34622225 PMCID: PMC8484511 DOI: 10.1016/j.xcrm.2021.100382] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2021] [Revised: 04/30/2021] [Accepted: 07/29/2021] [Indexed: 12/20/2022]
Abstract
Characterizing likelihood of response to neoadjuvant chemotherapy (NAC) in muscle-invasive bladder cancer (MIBC) is an important yet unmet challenge. In this study, a machine-learning framework is developed using imaging of biopsy pathology specimens to generate models of likelihood of NAC response. Developed using cross-validation (evaluable N = 66) and an independent validation cohort (evaluable N = 56), our models achieve promising results (65%-73% accuracy). Interestingly, one model-using features derived from hematoxylin and eosin (H&E)-stained tissues in conjunction with clinico-demographic features-is able to stratify the cohort into likely responders in cross-validation and the validation cohort (response rate of 65% for predicted responder compared with the 41% baseline response rate in the validation cohort). The results suggest that computational approaches applied to routine pathology specimens of MIBC can capture differences between responders and non-responders to NAC and should therefore be considered in the future design of precision oncology for MIBC.
Collapse
Affiliation(s)
- Haoyang Mi
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Trinity J. Bivalacqua
- Department of Oncology, Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University, Baltimore, MD, USA
- James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Max Kates
- James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Roland Seiler
- Department of Urology, University Hospital Bern, Bern, Switzerland
| | - Peter C. Black
- Department of Urologic Sciences, University of British Columbia Faculty of Medicine, Vancouver, BC, Canada
| | - Aleksander S. Popel
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Oncology, Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University, Baltimore, MD, USA
| | - Alexander S. Baras
- Department of Oncology, Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University, Baltimore, MD, USA
- James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
35
|
Gomes J, Kong J, Kurc T, Melo ACMA, Ferreira R, Saltz JH, Teodoro G. Building robust pathology image analyses with uncertainty quantification. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 208:106291. [PMID: 34333205 DOI: 10.1016/j.cmpb.2021.106291] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 07/09/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE Computerized pathology image analysis is an important tool in research and clinical settings, which enables quantitative tissue characterization and can assist a pathologist's evaluation. The aim of our study is to systematically quantify and minimize uncertainty in output of computer based pathology image analysis. METHODS Uncertainty quantification (UQ) and sensitivity analysis (SA) methods, such as Variance-Based Decomposition (VBD) and Morris One-At-a-Time (MOAT), are employed to track and quantify uncertainty in a real-world application with large Whole Slide Imaging datasets - 943 Breast Invasive Carcinoma (BRCA) and 381 Lung Squamous Cell Carcinoma (LUSC) patients. Because these studies are compute intensive, high-performance computing systems and efficient UQ/SA methods were combined to provide efficient execution. UQ/SA has been able to highlight parameters of the application that impact the results, as well as nuclear features that carry most of the uncertainty. Using this information, we built a method for selecting stable features that minimize application output uncertainty. RESULTS The results show that input parameter variations significantly impact all stages (segmentation, feature computation, and survival analysis) of the use case application. We then identified and classified features according to their robustness to parameter variation, and using the proposed features selection strategy, for instance, patient grouping stability in survival analysis has been improved from in 17% and 34% for BRCA and LUSC, respectively. CONCLUSIONS This strategy created more robust analyses, demonstrating that SA and UQ are important methods that may increase confidence digital pathology.
Collapse
Affiliation(s)
- Jeremias Gomes
- Department of Computer Science, University of Brasília, Brasília, Brazil
| | - Jun Kong
- Biomedical Informatics Department, Emory University, Atlanta, USA; Department of Biomedical Engineering, Emory-Georgia Institute of Technology, Atlanta, USA; Department of Mathematics and Statistics, Georgia State University, Atlanta, USA
| | - Tahsin Kurc
- Biomedical Informatics Department, Stony Brook University, Stony Brook, USA; Scientific Data Group, Oak Ridge National Laboratory, Oak Ridge, USA
| | - Alba C M A Melo
- Department of Computer Science, University of Brasília, Brasília, Brazil
| | - Renato Ferreira
- Department of Computer Science, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Joel H Saltz
- Biomedical Informatics Department, Stony Brook University, Stony Brook, USA
| | - George Teodoro
- Department of Computer Science, University of Brasília, Brasília, Brazil; Biomedical Informatics Department, Stony Brook University, Stony Brook, USA; Department of Computer Science, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil.
| |
Collapse
|
36
|
Li H, Bera K, Toro P, Fu P, Zhang Z, Lu C, Feldman M, Ganesan S, Goldstein LJ, Davidson NE, Glasgow A, Harbhajanka A, Gilmore H, Madabhushi A. Collagen fiber orientation disorder from H&E images is prognostic for early stage breast cancer: clinical trial validation. NPJ Breast Cancer 2021; 7:104. [PMID: 34362928 PMCID: PMC8346522 DOI: 10.1038/s41523-021-00310-z] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2020] [Accepted: 06/25/2021] [Indexed: 02/06/2023] Open
Abstract
Collagen fiber organization has been found to be implicated in breast cancer prognosis. In this study, we evaluated whether computerized features of Collagen Fiber Orientation Disorder in Tumor-associated Stroma (CFOD-TS) on Hematoxylin & Eosin (H&E) slide images were prognostic of Disease Free Survival (DFS) in early stage Estrogen Receptor Positive (ER+) Invasive Breast Cancers (IBC). A Cox regression model named MCFOD-TS, was constructed using cohort St (N = 78) to predict DFS based on CFOD-TS features. The prognostic performance of MCFOD-TS was validated on cohort Sv (N = 219), a prospective clinical trial dataset (ECOG 2197). MCFOD-TS was prognostic of DFS in both St and Sv, independent of clinicopathological variables. Additionally, the molecular pathways regarding cell cycle regulation were identified as being significantly associated with MCFOD-TS derived risk scores. Our results also found that collagen fiber organization was more ordered in patients with short DFS. Our study provided a H&E image-based pipeline to derive a potential prognostic biomarker for early stage ER+ IBC without the need of special collagen staining or advanced microscopy techniques.
Collapse
Affiliation(s)
- Haojia Li
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH, USA.
| | - Kaustav Bera
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH, USA
| | - Paula Toro
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH, USA
| | - PingFu Fu
- Case Western Reserve University, Department of Population and Quantitative Health Sciences, School of Medicine, Cleveland, OH, USA
| | - Zelin Zhang
- Nanjing University of Information Science and Technology, Jiangsu Key Laboratory of Big Data Analysis Technique, Nanjing, China
| | - Cheng Lu
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH, USA
| | - Michael Feldman
- University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Shridar Ganesan
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| | | | - Nancy E Davidson
- Fred Hutchinson Cancer Research Center, University of Washington, and Seattle Cancer Care Alliance, Seattle, WA, USA
| | - Akisha Glasgow
- University Hospitals Cleveland Medical Center, Cleveland, OH, USA
| | | | - Hannah Gilmore
- University Hospitals Cleveland Medical Center, Cleveland, OH, USA
| | - Anant Madabhushi
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH, USA. .,Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, OH, USA.
| |
Collapse
|
37
|
Corredor G, Toro P, Bera K, Rasmussen D, Viswanathan VS, Buzzy C, Fu P, Barton LM, Stroberg E, Duval E, Gilmore H, Mukhopadhyay S, Madabhushi A. Computational pathology reveals unique spatial patterns of immune response in H&E images from COVID-19 autopsies: preliminary findings. J Med Imaging (Bellingham) 2021; 8:017501. [PMID: 34268443 DOI: 10.1117/1.jmi.8.s1.017501] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 06/28/2021] [Indexed: 12/22/2022] Open
Abstract
Purpose: We used computerized image analysis and machine learning approaches to characterize spatial arrangement features of the immune response from digitized autopsied H&E tissue images of the lung in coronavirus disease 2019 (COVID-19) patients. Additionally, we applied our approach to tease out potential morphometric differences from autopsies of patients who succumbed to COVID-19 versus H1N1. Approach: H&E lung whole slide images from autopsy specimens of nine COVID-19 and two H1N1 patients were computationally interrogated. 606 image patches ( ∼ 55 per patient) of 1024 × 882 pixels were extracted from the 11 autopsied patient studies. A watershed-based segmentation approach in conjunction with a machine learning classifier was employed to identify two types of nuclei families: lymphocytes and non-lymphocytes (i.e., other nucleated cells such as pneumocytes, macrophages, and neutrophils). Based off the proximity of the individual nuclei, clusters for each nuclei family were constructed. For each of the resulting clusters, a series of quantitative measurements relating to architecture and density of nuclei clusters were calculated. A receiver operating characteristics-based feature selection method, violin plots, and the t-distributed stochastic neighbor embedding algorithm were employed to study differences in immune patterns. Results: In COVID-19, the immune response consistently showed multiple small-size lymphocyte clusters, suggesting that lymphocyte response is rather modest, possibly due to lymphocytopenia. In H1N1, we found larger lymphocyte clusters that were proximal to large clusters of non-lymphocytes, a possible reflection of increased prevalence of macrophages and other immune cells. Conclusion: Our study shows the potential of computational pathology to uncover immune response features that may not be obvious by routine histopathology visual inspection.
Collapse
Affiliation(s)
- Germán Corredor
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States.,Louis Stokes Cleveland VA Medical Center, Cleveland, Ohio, United States
| | - Paula Toro
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States
| | - Kaustav Bera
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States
| | - Dylan Rasmussen
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States
| | - Vidya Sankar Viswanathan
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States
| | - Christina Buzzy
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States
| | - Pingfu Fu
- Case Western Reserve University, Department of Population and Quantitative Health Sciences, Cleveland, Ohio, United States
| | - Lisa M Barton
- Oklahoma Office of the Chief Medical Examiner, Oklahoma City, Oklahoma, United States
| | - Edana Stroberg
- Oklahoma Office of the Chief Medical Examiner, Oklahoma City, Oklahoma, United States
| | - Eric Duval
- Oklahoma Office of the Chief Medical Examiner, Oklahoma City, Oklahoma, United States
| | - Hannah Gilmore
- University Hospitals, Department of Pathology, Cleveland, Ohio, United States
| | | | - Anant Madabhushi
- Case Western Reserve University, Center for Computational Imaging and Personalized Diagnostics, Cleveland, Ohio, United States.,Louis Stokes Cleveland VA Medical Center, Cleveland, Ohio, United States
| |
Collapse
|
38
|
DeepRePath: Identifying the Prognostic Features of Early-Stage Lung Adenocarcinoma Using Multi-Scale Pathology Images and Deep Convolutional Neural Networks. Cancers (Basel) 2021; 13:cancers13133308. [PMID: 34282757 PMCID: PMC8268823 DOI: 10.3390/cancers13133308] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Revised: 06/10/2021] [Accepted: 06/28/2021] [Indexed: 12/12/2022] Open
Abstract
Simple Summary Pathology images are vital for understanding solid cancers. In this study, we created DeepRePath using multi-scale pathology images with two-channel deep learning to predict the prognosis of patients with early-stage lung adenocarcinoma (LUAD). DeepRePath demonstrated that it could predict the recurrence of early-stage LUAD with average area under the curve scores of 0.77 and 0.76 in cohort I and cohort II (external validation set), respectively. Pathological features found to be associated with a high probability of recurrence included tumor necrosis, discohesive tumor cells, and atypical nuclei. In conclusion, DeepRePath can improve the treatment modality for patients with early-stage LUAD through recurrence prediction. Abstract The prognosis of patients with lung adenocarcinoma (LUAD), especially early-stage LUAD, is dependent on clinicopathological features. However, its predictive utility is limited. In this study, we developed and trained a DeepRePath model based on a deep convolutional neural network (CNN) using multi-scale pathology images to predict the prognosis of patients with early-stage LUAD. DeepRePath was pre-trained with 1067 hematoxylin and eosin-stained whole-slide images of LUAD from the Cancer Genome Atlas. DeepRePath was further trained and validated using two separate CNNs and multi-scale pathology images of 393 resected lung cancer specimens from patients with stage I and II LUAD. Of the 393 patients, 95 patients developed recurrence after surgical resection. The DeepRePath model showed average area under the curve (AUC) scores of 0.77 and 0.76 in cohort I and cohort II (external validation set), respectively. Owing to low performance, DeepRePath cannot be used as an automated tool in a clinical setting. When gradient-weighted class activation mapping was used, DeepRePath indicated the association between atypical nuclei, discohesive tumor cells, and tumor necrosis in pathology images showing recurrence. Despite the limitations associated with a relatively small number of patients, the DeepRePath model based on CNNs with transfer learning could predict recurrence after the curative resection of early-stage LUAD using multi-scale pathology images.
Collapse
|
39
|
Peyster EG, Arabyarmohammadi S, Janowczyk A, Azarianpour-Esfahani S, Sekulic M, Cassol C, Blower L, Parwani A, Lal P, Feldman MD, Margulies KB, Madabhushi A. An automated computational image analysis pipeline for histological grading of cardiac allograft rejection. Eur Heart J 2021; 42:2356-2369. [PMID: 33982079 PMCID: PMC8216729 DOI: 10.1093/eurheartj/ehab241] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 01/26/2021] [Accepted: 04/14/2021] [Indexed: 12/11/2022] Open
Abstract
AIM Allograft rejection is a serious concern in heart transplant medicine. Though endomyocardial biopsy with histological grading is the diagnostic standard for rejection, poor inter-pathologist agreement creates significant clinical uncertainty. The aim of this investigation is to demonstrate that cellular rejection grades generated via computational histological analysis are on-par with those provided by expert pathologists. METHODS AND RESULTS The study cohort consisted of 2472 endomyocardial biopsy slides originating from three major US transplant centres. The 'Computer-Assisted Cardiac Histologic Evaluation (CACHE)-Grader' pipeline was trained using an interpretable, biologically inspired, 'hand-crafted' feature extraction approach. From a menu of 154 quantitative histological features relating the density and orientation of lymphocytes, myocytes, and stroma, a model was developed to reproduce the 4-grade clinical standard for cellular rejection diagnosis. CACHE-grader interpretations were compared with independent pathologists and the 'grade of record', testing for non-inferiority (δ = 6%). Study pathologists achieved a 60.7% agreement [95% confidence interval (CI): 55.2-66.0%] with the grade of record, and pair-wise agreement among all human graders was 61.5% (95% CI: 57.0-65.8%). The CACHE-Grader met the threshold for non-inferiority, achieving a 65.9% agreement (95% CI: 63.4-68.3%) with the grade of record and a 62.6% agreement (95% CI: 60.3-64.8%) with all human graders. The CACHE-Grader demonstrated nearly identical performance in internal and external validation sets (66.1% vs. 65.8%), resilience to inter-centre variations in tissue processing/digitization, and superior sensitivity for high-grade rejection (74.4% vs. 39.5%, P < 0.001). CONCLUSION These results show that the CACHE-grader pipeline, derived using intuitive morphological features, can provide expert-quality rejection grading, performing within the range of inter-grader variability seen among human pathologists.
Collapse
Affiliation(s)
- Eliot G Peyster
- Cardiovascular Institute, University of Pennsylvania, 3400 Civic Center Blvd, Smilow TRC 11th floor, Philadelphia, PA 19104, USA
| | - Sara Arabyarmohammadi
- Department of Computer and Data Sciences, Case Western Reserve University, 10900 Euclid Avenue, Nord Hall Suite 500, Cleveland, OH 44106, USA
| | - Andrew Janowczyk
- Department of Biomedical Engineering, Case Western Reserve University, 10900 Euclid Avenue, Nord Hall Suite 500, Cleveland, OH 44106, USA
| | - Sepideh Azarianpour-Esfahani
- Department of Biomedical Engineering, Case Western Reserve University, 10900 Euclid Avenue, Nord Hall Suite 500, Cleveland, OH 44106, USA
| | - Miroslav Sekulic
- Department of Pathology, University Hospitals Cleveland Medical Center, 11100 Euclid Ave, Cleveland, OH 44106, USA
| | - Clarissa Cassol
- Department of Pathology, Ohio State University Wexner Medical Center, 450 W 10th Ave, Columbus, OH 43210, USA
| | - Luke Blower
- Department of Pathology, Ohio State University Wexner Medical Center, 450 W 10th Ave, Columbus, OH 43210, USA
| | - Anil Parwani
- Department of Pathology, Ohio State University Wexner Medical Center, 450 W 10th Ave, Columbus, OH 43210, USA
| | - Priti Lal
- Department of Pathology and Laboratory Medicine, University of Pennsylvania, 3400 Spruce Street 6 Founders, Philadelphia, PA 19104, USA
| | - Michael D Feldman
- Department of Pathology and Laboratory Medicine, University of Pennsylvania, 3400 Spruce Street 6 Founders, Philadelphia, PA 19104, USA
| | - Kenneth B Margulies
- Cardiovascular Institute, University of Pennsylvania, 3400 Civic Center Blvd, Smilow TRC 11th floor, Philadelphia, PA 19104, USA
| | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University, 10900 Euclid Avenue, Nord Hall Suite 500, Cleveland, OH 44106, USA
| |
Collapse
|
40
|
Abstract
PURPOSE OF REVIEW Pathology is the cornerstone of cancer care. Pathomics, which represents the use of artificial intelligence in digital pathology, is an emerging and promising field that will revolutionize medical and surgical pathology in the coming years. This review provides an overview of pathomics, its current and future applications and its most relevant applications in Head and Neck cancer care. RECENT FINDINGS The number of studies investigating the use of artificial intelligence in pathology is rapidly growing, especially as the utilization of deep learning has shown great potential with Whole Slide Images. Even though numerous steps still remain before its clinical use, Pathomics has been used for varied applications comprising of computer-assisted diagnosis, molecular anomalies prediction, tumor microenvironment and biomarker identification as well as prognosis evaluation. The majority of studies were performed on the most frequent cancers, notably breast, prostate, and lung. Interesting results were also found in Head and Neck cancers. SUMMARY Even if its use in Head and Neck cancer care is still low, Pathomics is a powerful tool to improve diagnosis, identify prognostic factors and new biomarkers. Important challenges lie ahead before its use in a clinical practice, notably the lack of information on how AI makes its decisions, the slow deployment of digital pathology, and the need for extensively validated data in order to obtain authorities approval. Regardless, pathomics will most likely improve pathology in general, including Head and Neck cancer care in the coming years.
Collapse
|
41
|
Xu J, Lu H, Li H, Yan C, Wang X, Zang M, Rooij DGD, Madabhushi A, Xu EY. Computerized spermatogenesis staging (CSS) of mouse testis sections via quantitative histomorphological analysis. Med Image Anal 2021; 70:101835. [PMID: 33676102 PMCID: PMC8046964 DOI: 10.1016/j.media.2020.101835] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 07/20/2020] [Accepted: 07/28/2020] [Indexed: 01/16/2023]
Abstract
Spermatogenesis in mammals is a cyclic process of spermatogenic cell development in the seminiferous epithelium that can be subdivided into 12 subsequent stages. Histological staging analysis of testis sections, specifically of seminiferous tubule cross-sections, is the only effective method to evaluate the quality of the spermatogenic process and to determine developmental defects leading to infertility. Such staging analysis, however, is tedious and time-consuming, and it may take a long time to become proficient. We now have developed a Computerized Staging system of Spermatogenesis (CSS) for mouse testis sections through learning of an expert with decades of experience in mouse testis staging. The development of the CSS system comprised three major parts: 1) Developing computational image analysis models for mouse testis sections; 2) Automated classification of each seminiferous tubule cross-section into three stage groups: Early Stages (ES: stages I-V), Middle Stages (MS: stages VI-VIII), and Late Stages (LS: stages IV-XII); 3) Automated classification of MS into distinct stages VI, VII-mVIII, and late VIII based on newly developed histomorphological features. A cohort of 40 H&E stained normal mouse testis sections was built according to three modules where 28 cross-sections were leveraged for developing tubule region segmentation, spermatogenic cells types and multi-concentric-layers segmentation models. The rest of 12 testis cross-sections, approximately 2314 tubules whose stages were manually annotated by two expert testis histologists, served as the basis for developing the CSS system. The CSS system's accuracy of mean and standard deviation (MSD) in identifying ES, MS, and LS were 0.93 ± 0.03, 0.94 ± 0.11, and 0.89 ± 0.05 and 0.85 ± 0.12, 0.88 ± 0.07, and 0.96 ± 0.04 for one with 5 years of experience, respectively. The CSS system's accuracy of MSD in identifying stages VI, VII-mVIII, and late VIII are 0.74 ± 0.03, 0.85 ± 0.04, and 0.78 ± 0.06 and 0.34 ± 0.18, 0.78 ± 0.16, and 0.44 ± 0.25 for one with 5 years of experience, respectively. In terms of time it takes to collect these data, it takes on average 3 hours for a histologist and 1.87 hours for the CSS system to finish evaluating an entire testis section (computed with a PC (I7-6800k 4.0 GHzwith 32GB of RAM & 256G SSD) and a Titan 1080Ti GPU). Therefore, the CSS system is more accurate and faster compared to a human histologist in staging, and further optimization and development will not only lead to a complete staging of all 12 stages of mouse spermatogenesis but also could aid in the future diagnosis of human infertility. Moreover, the top-ranking histomorphological features identified by the CSS classifier are consistent with the primary features used by histologists in discriminating stages VI, VII-mVIII, and late VIII.
Collapse
Affiliation(s)
- Jun Xu
- Jiangsu Key Laboratory of Big Data Analysis Technique and CICAEET, Nanjing University of Information Science and Technology, Nanjing 210044, China; School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China.
| | - Haoda Lu
- Jiangsu Key Laboratory of Big Data Analysis Technique and CICAEET, Nanjing University of Information Science and Technology, Nanjing 210044, China; School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China
| | - Haixin Li
- State Key Laboratory of Reproductive Medicine, Nanjing Medical University, Nanjing 211166, China
| | - Chaoyang Yan
- Jiangsu Key Laboratory of Big Data Analysis Technique and CICAEET, Nanjing University of Information Science and Technology, Nanjing 210044, China; School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China
| | - Xiangxue Wang
- Department of Biomedical Engineering, Case Western Reserve University, OH 44106-7207, USA
| | - Min Zang
- State Key Laboratory of Reproductive Medicine, Nanjing Medical University, Nanjing 211166, China
| | - Dirk G de Rooij
- Reproductive Biology Group, Division of Developmental Biology, Dept. of Biology, Faculty of Science, Utrecht University, Utrecht 3584 CH, The Netherlands; Center for Reproductive Medicine, Academic Medical Center, University of Amsterdam, Amsterdam 1105 AZ, The Netherlands
| | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University, OH 44106-7207, USA; Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, Ohio 44106-7207, USA
| | - Eugene Yujun Xu
- State Key Laboratory of Reproductive Medicine, Nanjing Medical University, Nanjing 211166, China; Department of Neurology, Center for Reproductive Sciences, Northwestern University Feinberg School of Medicine, IL 60611, USA.
| |
Collapse
|
42
|
Diao JA, Wang JK, Chui WF, Mountain V, Gullapally SC, Srinivasan R, Mitchell RN, Glass B, Hoffman S, Rao SK, Maheshwari C, Lahiri A, Prakash A, McLoughlin R, Kerner JK, Resnick MB, Montalto MC, Khosla A, Wapinski IN, Beck AH, Elliott HL, Taylor-Weiner A. Human-interpretable image features derived from densely mapped cancer pathology slides predict diverse molecular phenotypes. Nat Commun 2021; 12:1613. [PMID: 33712588 PMCID: PMC7955068 DOI: 10.1038/s41467-021-21896-9] [Citation(s) in RCA: 88] [Impact Index Per Article: 29.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 02/15/2021] [Indexed: 02/06/2023] Open
Abstract
Computational methods have made substantial progress in improving the accuracy and throughput of pathology workflows for diagnostic, prognostic, and genomic prediction. Still, lack of interpretability remains a significant barrier to clinical integration. We present an approach for predicting clinically-relevant molecular phenotypes from whole-slide histopathology images using human-interpretable image features (HIFs). Our method leverages >1.6 million annotations from board-certified pathologists across >5700 samples to train deep learning models for cell and tissue classification that can exhaustively map whole-slide images at two and four micron-resolution. Cell- and tissue-type model outputs are combined into 607 HIFs that quantify specific and biologically-relevant characteristics across five cancer types. We demonstrate that these HIFs correlate with well-known markers of the tumor microenvironment and can predict diverse molecular signatures (AUROC 0.601-0.864), including expression of four immune checkpoint proteins and homologous recombination deficiency, with performance comparable to 'black-box' methods. Our HIF-based approach provides a comprehensive, quantitative, and interpretable window into the composition and spatial architecture of the tumor microenvironment.
Collapse
Affiliation(s)
- James A Diao
- PathAI, Inc., Boston, MA, USA
- Program in Health Sciences and Technology, Harvard Medical School, Boston, MA, USA
| | - Jason K Wang
- PathAI, Inc., Boston, MA, USA
- Program in Health Sciences and Technology, Harvard Medical School, Boston, MA, USA
| | - Wan Fung Chui
- PathAI, Inc., Boston, MA, USA
- Program in Health Sciences and Technology, Harvard Medical School, Boston, MA, USA
| | | | | | | | - Richard N Mitchell
- Program in Health Sciences and Technology, Harvard Medical School, Boston, MA, USA
- Department of Pathology, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA
| | | | | | | | | | | | | | | | | | - Murray B Resnick
- PathAI, Inc., Boston, MA, USA
- Department of Pathology, Warren Alpert Medical School, Providence, RI, USA
| | | | | | | | | | | | | |
Collapse
|
43
|
Alvarez-Jimenez C, Sandino AA, Prasanna P, Gupta A, Viswanath SE, Romero E. Identifying Cross-Scale Associations between Radiomic and Pathomic Signatures of Non-Small Cell Lung Cancer Subtypes: Preliminary Results. Cancers (Basel) 2020; 12:cancers12123663. [PMID: 33297357 PMCID: PMC7762258 DOI: 10.3390/cancers12123663] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 11/12/2020] [Accepted: 11/13/2020] [Indexed: 12/18/2022] Open
Abstract
(1) Background: Despite the complementarity between radiology and histopathology, both from a diagnostic and a prognostic perspective, quantitative analyses of these modalities are usually performed in disconnected silos. This work presents initial results for differentiating two major non-small cell lung cancer (NSCLC) subtypes by exploring cross-scale associations between Computed Tomography (CT) images and corresponding digitized pathology images. (2) Methods: The analysis comprised three phases, (i) a multi-resolution cell density quantification to identify discriminant pathomic patterns for differentiating adenocarcinoma (ADC) and squamous cell carcinoma (SCC), (ii) radiomic characterization of CT images by using Haralick descriptors to quantify tumor textural heterogeneity as represented by gray-level co-occurrences to discriminate the two pathological subtypes, and (iii) quantitative correlation analysis between the multi-modal features to identify potential associations between them. This analysis was carried out using two publicly available digitized pathology databases (117 cases from TCGA and 54 cases from CPTAC) and a public radiological collection of CT images (101 cases from NSCLC-R). (3) Results: The top-ranked cell density pathomic features from the histopathology analysis were correlation, contrast, homogeneity, sum of entropy and difference of variance; which yielded a cross-validated AUC of 0.72 ± 0.02 on the training set (CPTAC) and hold-out validation AUC of 0.77 on the testing set (TCGA). Top-ranked co-occurrence radiomic features within NSCLC-R were contrast, correlation and sum of entropy which yielded a cross-validated AUC of 0.72 ± 0.01. Preliminary but significant cross-scale associations were identified between cell density statistics and CT intensity values using matched specimens available in the TCGA cohort, which were used to significantly improve the overall discriminatory performance of radiomic features in differentiating NSCLC subtypes (AUC = 0.78 ± 0.01). (4) Conclusions: Initial results suggest that cross-scale associations may exist between digital pathology and CT imaging which can be used to identify relevant radiomic and histopathology features to accurately distinguish lung adenocarcinomas from squamous cell carcinomas.
Collapse
Affiliation(s)
- Charlems Alvarez-Jimenez
- Computer Imaging and Medical Application Laboratory, Universidad Nacional de Colombia, Bogotá 111321, Colombia; (C.A.-J.); (A.A.S.)
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA;
| | - Alvaro A. Sandino
- Computer Imaging and Medical Application Laboratory, Universidad Nacional de Colombia, Bogotá 111321, Colombia; (C.A.-J.); (A.A.S.)
| | - Prateek Prasanna
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY 11794, USA;
| | - Amit Gupta
- Department of Radiology, University Hospitals Cleveland Medical Center, Cleveland, OH 44106, USA;
| | - Satish E. Viswanath
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA;
| | - Eduardo Romero
- Computer Imaging and Medical Application Laboratory, Universidad Nacional de Colombia, Bogotá 111321, Colombia; (C.A.-J.); (A.A.S.)
- Correspondence:
| |
Collapse
|
44
|
Lu C, Koyuncu C, Corredor G, Prasanna P, Leo P, Wang X, Janowczyk A, Bera K, Lewis J, Velcheti V, Madabhushi A. Feature-driven local cell graph (FLocK): New computational pathology-based descriptors for prognosis of lung cancer and HPV status of oropharyngeal cancers. Med Image Anal 2020; 68:101903. [PMID: 33352373 DOI: 10.1016/j.media.2020.101903] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 10/26/2020] [Accepted: 11/09/2020] [Indexed: 01/02/2023]
Abstract
Local spatial arrangement of nuclei in histopathology images of different cancer subtypes has been shown to have prognostic value. In order to capture localized nuclear architectural information, local cell cluster graph-based measurements have been proposed. However, conventional ways of cell graph construction only utilize nuclear spatial proximity, and do not differentiate between different cell types while constructing the graph. In this paper, we present feature-driven local cell cluster graph (FLocK), a new approach to constructing local cell graphs by simultaneously considering spatial proximity and attributes of the individual nuclei (e.g. shape, size, texture). In addition, we have designed a new set of quantitative graph-derived metrics to be extracted from FLocKs, in turn capturing the interplay between different proximally located clusters of nuclei. We have evaluated the efficacy of FLocK features extracted from H&E stained tissue images in two clinical applications: to classify short-term vs. long-term survival among patients of early stage non-small cell lung cancer (ES-NSCLC), and also to predict human papillomavirus (HPV) status of oropharyngeal squamous cell carcinoma (OP-SCCs). In the classification of long-term vs. short-term survival among patients of ES-NSCLC (training cohort, n = 434), the top 10 discriminative FLocK features related to the variation of FLocK size and intersected FLocK distance were identified, via Minimum Redundancy and Maximum Relevance (MRMR) selection, in 100 runs of 10-fold cross-validation, and in conjunction with a linear discriminant classifier yielded a mean AUC of 0.68 for predicting survival in the training cohort. This is better than other state-of-art histomorphometric and deep learning classifiers (cell cluster graphs (AUC = 0.62), global cell graph (AUC = 0.56), nuclear shape (AUC = 0.54), nuclear orientation (AUC = 0.61), AlexNet (AUC = 0.55), ResNet (AUC = 0.56)). The FLocK-based classifier yielded an AUC of 0.70 in an independent testing cohort (n = 150). The patients identified as "high-risk" had significantly poorer overall survival in the testing cohort, with a hazard ratio (95% confidence interval) of 2.24 (1.24-4.05), p = 0.01144). In the classification of HPV status of OP-SCC, the top three FLocK features pertaining to the portion of intersected FLocKs were used to construct a classifier, which yielded an AUC of 0.80 in the training cohort (n = 50), and an accuracy of 0.78 in an independent testing cohort (n = 35). The combination of FLocK measurements with cell cluster graphs, nuclear orientation, and nuclear shape improved the training AUC to 0.87, 0.91 and 0.85, respectively. Deep learning approaches yielded marginally better performance than the FLocK-based classifier in this application, with AUC = 0.78 for AlexNet, AUC = 0.81 for ResNet, and AUC = 0.76 for FLocK-based classifier in the testing cohort. However, the combination of two hand-crafted features: FLocK and nuclear orientation yielded a better performance (AUC = 0.84). FLocK provides a unique and quantitative way to analyze histology images of solid tumors and interrogate tumor morphology from a different aspect than existing histomorphometrics. The source code can be accessed at https://github.com/hacylu/FLocK.
Collapse
Affiliation(s)
- Cheng Lu
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Can Koyuncu
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - German Corredor
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Prateek Prasanna
- Department of Biomedical Informatics, Stony Brook University, New York, NY, USA
| | - Patrick Leo
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - XiangXue Wang
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Andrew Janowczyk
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA; Precision Oncology Center, Lausanne University Hospital, Switzerland
| | - Kaustav Bera
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - James Lewis
- Department of Pathology, Microbiology, and Immunology, Vanderbilt University Medical Center, Nashville, TN, USA
| | | | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA; Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, OH, USA.
| |
Collapse
|
45
|
Bera K, Katz I, Madabhushi A. Reimagining T Staging Through Artificial Intelligence and Machine Learning Image Processing Approaches in Digital Pathology. JCO Clin Cancer Inform 2020; 4:1039-1050. [PMID: 33166198 PMCID: PMC7713520 DOI: 10.1200/cci.20.00110] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/21/2020] [Indexed: 02/06/2023] Open
Abstract
Tumor stage and grade, visually assessed by pathologists from evaluation of pathology images in conjunction with radiographic imaging techniques, have been linked to outcome, progression, and survival for a number of cancers. The gold standard of staging in oncology has been the TNM (tumor-node-metastasis) staging system. Though histopathological grading has shown prognostic significance, it is subjective and limited by interobserver variability even among experienced surgical pathologists. Recently, artificial intelligence (AI) approaches have been applied to pathology images toward diagnostic-, prognostic-, and treatment prediction-related tasks in cancer. AI approaches have the potential to overcome the limitations of conventional TNM staging and tumor grading approaches, providing a direct prognostic prediction of disease outcome independent of tumor stage and grade. Broadly speaking, these AI approaches involve extracting patterns from images that are then compared against previously defined disease signatures. These patterns are typically categorized as either (1) handcrafted, which involve domain-inspired attributes, such as nuclear shape, or (2) deep learning (DL)-based representations, which tend to be more abstract. DL approaches have particularly gained considerable popularity because of the minimal domain knowledge needed for training, mostly only requiring annotated examples corresponding to the categories of interest. In this article, we discuss AI approaches for digital pathology, especially as they relate to disease prognosis, prediction of genomic and molecular alterations in the tumor, and prediction of treatment response in oncology. We also discuss some of the potential challenges with validation, interpretability, and reimbursement that must be addressed before widespread clinical deployment. The article concludes with a brief discussion of potential future opportunities in the field of AI for digital pathology and oncology.
Collapse
Affiliation(s)
- Kaustav Bera
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH
- Maimonides Medical Center, Department of Internal Medicine, Brooklyn, NY
| | - Ian Katz
- Southern Sun Pathology, Sydney, Australia, and University of Queensland, Brisbane, Australia
| | - Anant Madabhushi
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, OH
- Louis Stokes Veterans Affairs Medical Center, Cleveland, OH
| |
Collapse
|
46
|
A prognostic model for overall survival of patients with early-stage non-small cell lung cancer: a multicentre, retrospective study. LANCET DIGITAL HEALTH 2020; 2:e594-e606. [PMID: 33163952 PMCID: PMC7646741 DOI: 10.1016/s2589-7500(20)30225-9] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Background Intratumoural heterogeneity has been previously shown to be related to clonal evolution and genetic instability and associated with tumour progression. Phenotypically, it is reflected in the diversity of appearance and morphology within cell populations. Computer-extracted features relating to tumour cellular diversity on routine tissue images might correlate with outcome. This study investigated the prognostic ability of computer-extracted features of tumour cellular diversity (CellDiv) from haematoxylin and eosin (H&E)-stained histology images of non-small cell lung carcinomas (NSCLCs). Methods In this multicentre, retrospective study, we included 1057 patients with early-stage NSCLC with corresponding diagnostic histology slides and overall survival information from four different centres. CellDiv features quantifying local cellular morphological diversity from H&E-stained histology images were extracted from the tumour epithelium region. A Cox proportional hazards model based on CellDiv was used to construct risk scores for lung adenocarcinoma (LUAD; 270 patients) and lung squamous cell carcinoma (LUSC; 216 patients) separately using data from two of the cohorts, and was validated in the two remaining independent cohorts (comprising 236 patients with LUAD and 335 patients with LUSC). We used multivariable Cox regression analysis to examine the predictive ability of CellDiv features for 5-year overall survival, controlling for the effects of clinical and pathological parameters. We did a gene set enrichment and Gene Ontology analysis on 405 patients to identify associations with differentially expressed biological pathways implicated in lung cancer pathogenesis. Findings For prognosis of patients with early-stage LUSC, the CellDiv LUSC model included 11 discriminative CellDiv features, whereas for patients with early-stage LUAD, the model included 23 features. In the independent validation cohorts, patients predicted to be at a higher risk by the univariable CellDiv model had significantly worse 5-year overall survival (hazard ratio 1·48 [95% CI 1·06–2·08]; p=0·022 for The Cancer Genome Atlas [TCGA] LUSC group, 2·24 [1·04–4·80]; p=0·039 for the University of Bern LUSC group, and 1·62 [1·15–2·30]; p=0·0058 for the TCGA LUAD group). The identified CellDiv features were also found to be strongly associated with apoptotic signalling and cell differentiation pathways. Interpretation CellDiv features were strongly prognostic of 5-year overall survival in patients with early-stage NSCLC and also associated with apoptotic signalling and cell differentiation pathways. The CellDiv-based risk stratification model could potentially help to determine which patients with early-stage NSCLC might receive added benefit from adjuvant therapy. Funding National Institue of Health and US Department of Defense.
Collapse
|
47
|
Sakamoto T, Furukawa T, Lami K, Pham HHN, Uegami W, Kuroda K, Kawai M, Sakanashi H, Cooper LAD, Bychkov A, Fukuoka J. A narrative review of digital pathology and artificial intelligence: focusing on lung cancer. Transl Lung Cancer Res 2020; 9:2255-2276. [PMID: 33209648 PMCID: PMC7653145 DOI: 10.21037/tlcr-20-591] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
The emergence of whole slide imaging technology allows for pathology diagnosis on a computer screen. The applications of digital pathology are expanding, from supporting remote institutes suffering from a shortage of pathologists to routine use in daily diagnosis including that of lung cancer. Through practice and research large archival databases of digital pathology images have been developed that will facilitate the development of artificial intelligence (AI) methods for image analysis. Currently, several AI applications have been reported in the field of lung cancer; these include the segmentation of carcinoma foci, detection of lymph node metastasis, counting of tumor cells, and prediction of gene mutations. Although the integration of AI algorithms into clinical practice remains a significant challenge, we have implemented tumor cell count for genetic analysis, a helpful application for routine use. Our experience suggests that pathologists often overestimate the contents of tumor cells, and the use of AI-based analysis increases the accuracy and makes the tasks less tedious. However, there are several difficulties encountered in the practical use of AI in clinical diagnosis. These include the lack of sufficient annotated data for the development and validation of AI systems, the explainability of black box AI models, such as those based on deep learning that offer the most promising performance, and the difficulty in defining the ground truth data for training and validation owing to inherent ambiguity in most applications. All of these together present significant challenges in the development and clinical translation of AI methods in the practice of pathology. Additional research on these problems will help in resolving the barriers to the clinical use of AI. Helping pathologists in developing knowledge of the working and limitations of AI will benefit the use of AI in both diagnostics and research.
Collapse
Affiliation(s)
- Taro Sakamoto
- Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Tomoi Furukawa
- Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Kris Lami
- Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Hoa Hoang Ngoc Pham
- Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Wataru Uegami
- Department of Pathology, Kameda Medical Center, Kamogawa, Chiba, Japan
| | - Kishio Kuroda
- Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Masataka Kawai
- Department of Pathology, Interdisciplinary Graduate School of Medicine and Engineering, University of Yamanashi, Yamanashi, Japan
| | - Hidenori Sakanashi
- Configurable Learning Mechanism Research Team, National Institute of Advanced Industrial Science and Technology, Tokyo, Japan
| | | | - Andrey Bychkov
- Department of Pathology, Kameda Medical Center, Kamogawa, Chiba, Japan
| | - Junya Fukuoka
- Department of Pathology, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan.,Department of Pathology, Kameda Medical Center, Kamogawa, Chiba, Japan
| |
Collapse
|
48
|
Wu Z, Wang L, Li C, Cai Y, Liang Y, Mo X, Lu Q, Dong L, Liu Y. DeepLRHE: A Deep Convolutional Neural Network Framework to Evaluate the Risk of Lung Cancer Recurrence and Metastasis From Histopathology Images. Front Genet 2020; 11:768. [PMID: 33193560 PMCID: PMC7477356 DOI: 10.3389/fgene.2020.00768] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Accepted: 06/29/2020] [Indexed: 12/21/2022] Open
Abstract
It is critical for patients who cannot undergo eradicable surgery to predict the risk of lung cancer recurrence and metastasis; therefore, the physicians can design the appropriate adjuvant therapy plan. However, traditional circulating tumor cell (CTC) detection or next-generation sequencing (NGS)-based methods are usually expensive and time-inefficient, which urge the need for more efficient computational models. In this study, we have established a convolutional neural network (CNN) framework called DeepLRHE to predict the recurrence risk of lung cancer by analyzing histopathological images of patients. The steps for using DeepLRHE include automatic tumor region identification, image normalization, biomarker identification, and sample classification. In practice, we used 110 lung cancer samples downloaded from The Cancer Genome Atlas (TCGA) database to train and validate our CNN model and 101 samples as independent test dataset. The area under the receiver operating characteristic (ROC) curve (AUC) for test dataset was 0.79, suggesting a relatively good prediction performance. Our study demonstrates that the features extracted from histopathological images could be well used to predict lung cancer recurrence after surgical resection and help classify patients who should receive additional adjuvant therapy.
Collapse
Affiliation(s)
- Zhijun Wu
- Department of Oncology, The First People's Hospital of Changde City, Changde, China
| | - Lin Wang
- Department of Oncology, Hainan General Hospital, Haikou, China
| | - Churong Li
- Sichuan Cancer Hospital and Institute, The Affiliated Cancer Hospital, School of Medicine, UESTC, Chengdu, China
| | | | | | - Xiaofei Mo
- Geneis (Beijing) Co., Ltd., Beijing, China
| | | | - Lixin Dong
- The First Hospital of Qinhuangdao, Qinhuangdao, China
| | | |
Collapse
|
49
|
Deng S, Zhang X, Yan W, Chang EIC, Fan Y, Lai M, Xu Y. Deep learning in digital pathology image analysis: a survey. Front Med 2020; 14:470-487. [PMID: 32728875 DOI: 10.1007/s11684-020-0782-9] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2019] [Accepted: 03/05/2020] [Indexed: 12/21/2022]
Abstract
Deep learning (DL) has achieved state-of-the-art performance in many digital pathology analysis tasks. Traditional methods usually require hand-crafted domain-specific features, and DL methods can learn representations without manually designed features. In terms of feature extraction, DL approaches are less labor intensive compared with conventional machine learning methods. In this paper, we comprehensively summarize recent DL-based image analysis studies in histopathology, including different tasks (e.g., classification, semantic segmentation, detection, and instance segmentation) and various applications (e.g., stain normalization, cell/gland/region structure analysis). DL methods can provide consistent and accurate outcomes. DL is a promising tool to assist pathologists in clinical diagnosis.
Collapse
Affiliation(s)
- Shujian Deng
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | - Xin Zhang
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | - Wen Yan
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | | | - Yubo Fan
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | - Maode Lai
- Department of Pathology, School of Medicine, Zhejiang University, Hangzhou, 310007, China
| | - Yan Xu
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China.
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China.
- Microsoft Research Asia, Beijing, 100080, China.
| |
Collapse
|
50
|
Koike Y, Aokage K, Ikeda K, Nakai T, Tane K, Miyoshi T, Sugano M, Kojima M, Fujii S, Kuwata T, Ochiai A, Tanaka T, Suzuki K, Tsuboi M, Ishii G. Machine learning-based histological classification that predicts recurrence of peripheral lung squamous cell carcinoma. Lung Cancer 2020; 147:252-258. [PMID: 32763506 DOI: 10.1016/j.lungcan.2020.07.011] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2020] [Revised: 07/03/2020] [Accepted: 07/07/2020] [Indexed: 12/25/2022]
Abstract
BACKGROUND Cancer tissue is composed of both a cancer cell component and a stromal component. The aim of this study was to investigate if the component ratio predicts a prognosis for lung squamous cell carcinoma (SqCC) patients by using a machine learning method. METHODS A total of 135 peripheral SqCC cases (tumor size: 3-5 cm) were enrolled in this study. The areas of the cancer cell component, the necrotic component, and the stromal component were accurately measured via a machine learning method. Each case was divided into the following three subtypes: 1) predominant cancer cell, 2) predominant necrosis, and 3) predominant stroma. The study examined if a particular subtype had prognostic significance. RESULTS The number of cases per subtype of predominant cancer cell, predominant necrosis, and predominant stroma was 59, 6, and 70, respectively. Patients with the predominant stroma subtype had a significantly shorter recurrence free survival (RFS) than did those with the predominant cancer cell subtype (5-yr RFS: 42.3 % vs. 84.3 %,p < 0.01). Also, in pathological stage I patients, the 5-year RFS rate for the predominant stroma subtype was significantly shorter (5-yr RFS: 64.3 % vs. 88.4 %, p < 0.01). In the multivariate analysis of p-stage I patients, the predominant stroma subtype was confirmed to be an independent prognostic factor for RFS (p < 0.01). CONCLUSION Using machine learning, the study confirmed that the predominant stroma subtype was an independent factor for RFS, suggesting that the ratio of the stromal component correlates with the malignant potential of SqCC.
Collapse
Affiliation(s)
- Yutaro Koike
- Division of Pathology, Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba, Japan; Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Kashiwa, Japan; Department of Thoracic Surgery, National Cancer Center Hospital East, Kashiwa, Chiba, Japan.
| | - Keiju Aokage
- Department of Thoracic Surgery, National Cancer Center Hospital East, Kashiwa, Chiba, Japan
| | - Kosuke Ikeda
- Division of Pathology, Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba, Japan
| | - Tokiko Nakai
- Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Kashiwa, Japan
| | - Kenta Tane
- Department of Thoracic Surgery, National Cancer Center Hospital East, Kashiwa, Chiba, Japan
| | - Tomohiro Miyoshi
- Department of Thoracic Surgery, National Cancer Center Hospital East, Kashiwa, Chiba, Japan
| | - Masato Sugano
- Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Kashiwa, Japan
| | - Motohiro Kojima
- Division of Pathology, Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba, Japan
| | - Satoshi Fujii
- Division of Pathology, Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba, Japan
| | - Takeshi Kuwata
- Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Kashiwa, Japan
| | - Atsushi Ochiai
- Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba, Japan
| | - Toshiyuki Tanaka
- Department of Applied Physics and Physico-Informatics, Faculty of Science and Technology, Keio University, Japan
| | - Kenji Suzuki
- Department of General Thoracic Surgery, Juntendo University School of Medicine, Tokyo, Japan
| | - Masahiro Tsuboi
- Department of Thoracic Surgery, National Cancer Center Hospital East, Kashiwa, Chiba, Japan
| | - Genichiro Ishii
- Division of Pathology, Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba, Japan; Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Kashiwa, Japan.
| |
Collapse
|