1
|
Wang S, Wang T, Yang L, Yang DM, Fujimoto J, Yi F, Luo X, Yang Y, Yao B, Lin S, Moran C, Kalhor N, Weissferdt A, Minna J, Xie Y, Wistuba II, Mao Y, Xiao G. ConvPath: A software tool for lung adenocarcinoma digital pathological image analysis aided by a convolutional neural network. EBioMedicine 2019; 50:103-110. [PMID: 31767541 PMCID: PMC6921240 DOI: 10.1016/j.ebiom.2019.10.033] [Citation(s) in RCA: 55] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 10/16/2019] [Accepted: 10/16/2019] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND The spatial distributions of different types of cells could reveal a cancer cell's growth pattern, its relationships with the tumor microenvironment and the immune response of the body, all of which represent key "hallmarks of cancer". However, the process by which pathologists manually recognize and localize all the cells in pathology slides is extremely labor intensive and error prone. METHODS In this study, we developed an automated cell type classification pipeline, ConvPath, which includes nuclei segmentation, convolutional neural network-based tumor cell, stromal cell, and lymphocyte classification, and extraction of tumor microenvironment-related features for lung cancer pathology images. To facilitate users in leveraging this pipeline for their research, all source scripts for ConvPath software are available at https://qbrc.swmed.edu/projects/cnn/. FINDINGS The overall classification accuracy was 92.9% and 90.1% in training and independent testing datasets, respectively. By identifying cells and classifying cell types, this pipeline can convert a pathology image into a "spatial map" of tumor, stromal and lymphocyte cells. From this spatial map, we can extract features that characterize the tumor micro-environment. Based on these features, we developed an image feature-based prognostic model and validated the model in two independent cohorts. The predicted risk group serves as an independent prognostic factor, after adjusting for clinical variables that include age, gender, smoking status, and stage. INTERPRETATION The analysis pipeline developed in this study could convert the pathology image into a "spatial map" of tumor cells, stromal cells and lymphocytes. This could greatly facilitate and empower comprehensive analysis of the spatial organization of cells, as well as their roles in tumor progression and metastasis.
Collapse
Affiliation(s)
- Shidan Wang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX
| | - Tao Wang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX; Center for the Genetics of Host Defense, University of Texas Southwestern Medical Center, Dallas, TX
| | - Lin Yang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX; Department of Pathology, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences (CHCAMS), China
| | - Donghan M Yang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX
| | - Junya Fujimoto
- Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Faliu Yi
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX
| | - Xin Luo
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX
| | - Yikun Yang
- Department of Thoracic Surgery, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences (CHCAMS), China
| | - Bo Yao
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX
| | - ShinYi Lin
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX
| | - Cesar Moran
- Department of Pathology, Division of Pathology/Lab Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Neda Kalhor
- Department of Pathology, Division of Pathology/Lab Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Annikka Weissferdt
- Department of Pathology, Division of Pathology/Lab Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX
| | - John Minna
- Hamon Center for Therapeutic Oncology Research, Department of Internal Medicine and Department of Pharmacology, University of Texas Southwestern Medical Center, Dallas, TX; Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, TX
| | - Yang Xie
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX; Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX; Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, TX
| | - Ignacio I Wistuba
- Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Yousheng Mao
- Department of Thoracic Surgery, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences (CHCAMS), China
| | - Guanghua Xiao
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX; Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX; Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, TX.
| |
Collapse
|
2
|
Wang S, Yang DM, Rong R, Zhan X, Fujimoto J, Liu H, Minna J, Wistuba II, Xie Y, Xiao G. Artificial Intelligence in Lung Cancer Pathology Image Analysis. Cancers (Basel) 2019; 11:E1673. [PMID: 31661863 PMCID: PMC6895901 DOI: 10.3390/cancers11111673] [Citation(s) in RCA: 97] [Impact Index Per Article: 19.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Revised: 10/17/2019] [Accepted: 10/21/2019] [Indexed: 12/12/2022] Open
Abstract
OBJECTIVE Accurate diagnosis and prognosis are essential in lung cancer treatment selection and planning. With the rapid advance of medical imaging technology, whole slide imaging (WSI) in pathology is becoming a routine clinical procedure. An interplay of needs and challenges exists for computer-aided diagnosis based on accurate and efficient analysis of pathology images. Recently, artificial intelligence, especially deep learning, has shown great potential in pathology image analysis tasks such as tumor region identification, prognosis prediction, tumor microenvironment characterization, and metastasis detection. MATERIALS AND METHODS In this review, we aim to provide an overview of current and potential applications for AI methods in pathology image analysis, with an emphasis on lung cancer. RESULTS We outlined the current challenges and opportunities in lung cancer pathology image analysis, discussed the recent deep learning developments that could potentially impact digital pathology in lung cancer, and summarized the existing applications of deep learning algorithms in lung cancer diagnosis and prognosis. DISCUSSION AND CONCLUSION With the advance of technology, digital pathology could have great potential impacts in lung cancer patient care. We point out some promising future directions for lung cancer pathology image analysis, including multi-task learning, transfer learning, and model interpretation.
Collapse
Affiliation(s)
- Shidan Wang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - Donghan M Yang
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - Ruichen Rong
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - Xiaowei Zhan
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - Junya Fujimoto
- Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA.
| | - Hongyu Liu
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - John Minna
- Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
- Hamon Center for Therapeutic Oncology Research, UT Southwestern Medical Center, Dallas, TX 75390, USA.
- Departments of Internal Medicine and Pharmacology, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - Ignacio Ivan Wistuba
- Department of Translational Molecular Pathology, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA.
| | - Yang Xie
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
- Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
- Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| | - Guanghua Xiao
- Quantitative Biomedical Research Center, Department of Population and Data Sciences, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
- Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
- Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| |
Collapse
|
3
|
Taverna G, Grizzi F, Colombo P, Seveso M, Giusti G, Proietti S, Fiorini G, Lughezzani G, Casale P, Buffi N, Lazzari M, Guazzoni G. Two-dimensional neovascular complexity is significantly higher in nontumor prostate tissue than in low-risk prostate cancer. Korean J Urol 2015; 56:435-42. [PMID: 26078840 PMCID: PMC4462633 DOI: 10.4111/kju.2015.56.6.435] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2015] [Accepted: 04/29/2015] [Indexed: 12/24/2022] Open
Abstract
Purpose Prostate cancer is the most frequent cancer in men in Europe. A major focus in urology is the identification of new biomarkers with improved accuracy in patients with low-risk prostate cancer. Here, we evaluated two-dimensional neovascular complexity in prostate tumor and nontumor biopsy cores by use of a computer-aided image analysis system and assessed the correlations between the results and selected clinical and pathological parameters of prostate carcinoma. Materials and Methods A total of 280 prostate biopsy sections from a homogeneous series of 70 patients with low-risk prostate cancer (Gleason score 3+3, prostate-specific antigen [PSA]<10 ng/mL, and clinical stage T1c) who underwent systematic biopsy sampling and subsequent radical prostatectomy were analyzed. For each biopsy, 2-µm sections were treated with CD34 antibodies and were digitized by using an image analysis system that automatically estimates the surface fractal dimension. Results Our results showed that biopsy sections without cancer were significantly more vascularized than were tumors. No correlations were found between the vascular surface fractal dimension and patient's age, PSA and free-to-total PSA ratios, pathological stage, Gleason score, tumor volume, vascular invasion, capsular penetration, surgical margins, and biochemical recurrence. Conclusions The value of angiogenesis in prostate cancer is still controversial. Our findings suggest that low-risk prostate cancer tissues are less vascularized than are nontumor tissues. Further studies are necessary to understand whether angiogenesis is a hallmark of intermediate- and high-risk prostate cancer.
Collapse
Affiliation(s)
- Gianluigi Taverna
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Fabio Grizzi
- Department of Inflammation and Immunology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Piergiuseppe Colombo
- Department of Pathology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Mauro Seveso
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Guido Giusti
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Silvia Proietti
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Girolamo Fiorini
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Giovanni Lughezzani
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Paolo Casale
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Nicolò Buffi
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Massimo Lazzari
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| | - Giorgio Guazzoni
- Department of Urology, Humanitas Clinical and Research Hospital, Rozzano, Milan, Italy
| |
Collapse
|