4
|
Feng S, Yu X, Liang W, Li X, Zhong W, Hu W, Zhang H, Feng Z, Song M, Zhang J, Zhang X. Development of a Deep Learning Model to Assist With Diagnosis of Hepatocellular Carcinoma. Front Oncol 2021; 11:762733. [PMID: 34926264 PMCID: PMC8671137 DOI: 10.3389/fonc.2021.762733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Accepted: 11/08/2021] [Indexed: 11/20/2022] Open
Abstract
Background An accurate pathological diagnosis of hepatocellular carcinoma (HCC), one of the malignant tumors with the highest mortality rate, is time-consuming and heavily reliant on the experience of a pathologist. In this report, we proposed a deep learning model that required minimal noise reduction or manual annotation by an experienced pathologist for HCC diagnosis and classification. Methods We collected a whole-slide image of hematoxylin and eosin-stained pathological slides from 592 HCC patients at the First Affiliated Hospital, College of Medicine, Zhejiang University between 2015 and 2020. We propose a noise-specific deep learning model. The model was trained initially with 137 cases cropped into multiple-scaled datasets. Patch screening and dynamic label smoothing strategies are adopted to handle the histopathological liver image with noise annotation from the perspective of input and output. The model was then tested in an independent cohort of 455 cases with comparable tumor types and differentiations. Results Exhaustive experiments demonstrated that our two-step method achieved 87.81% pixel-level accuracy and 98.77% slide-level accuracy in the test dataset. Furthermore, the generalization performance of our model was also verified using The Cancer Genome Atlas dataset, which contains 157 HCC pathological slides, and achieved an accuracy of 87.90%. Conclusions The noise-specific histopathological classification model of HCC based on deep learning is effective for the dataset with noisy annotation, and it significantly improved the pixel-level accuracy of the regular convolutional neural network (CNN) model. Moreover, the model also has an advantage in detecting well-differentiated HCC and microvascular invasion.
Collapse
Affiliation(s)
- Shi Feng
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
| | - Xiaotian Yu
- Department of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Wenjie Liang
- Department of Radiology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
| | - Xuejie Li
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
| | - Weixiang Zhong
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
| | - Wanwan Hu
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
| | - Han Zhang
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
| | - Zunlei Feng
- Department of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Mingli Song
- Department of Computer Science and Technology, Zhejiang University, Hangzhou, China
- *Correspondence: Jing Zhang, ; Mingli Song, ; Xiuming Zhang,
| | - Jing Zhang
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
- *Correspondence: Jing Zhang, ; Mingli Song, ; Xiuming Zhang,
| | - Xiuming Zhang
- Department of Pathology, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, China
- *Correspondence: Jing Zhang, ; Mingli Song, ; Xiuming Zhang,
| |
Collapse
|
5
|
Janssen BV, Theijse R, van Roessel S, de Ruiter R, Berkel A, Huiskens J, Busch OR, Wilmink JW, Kazemier G, Valkema P, Farina A, Verheij J, de Boer OJ, Besselink MG. Artificial Intelligence-Based Segmentation of Residual Tumor in Histopathology of Pancreatic Cancer after Neoadjuvant Treatment. Cancers (Basel) 2021; 13:cancers13205089. [PMID: 34680241 PMCID: PMC8533716 DOI: 10.3390/cancers13205089] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 10/07/2021] [Accepted: 10/09/2021] [Indexed: 12/31/2022] Open
Abstract
Simple Summary The use of neoadjuvant therapy (NAT) in patients with pancreatic ductal adenocarcinoma (PDAC) is increasing. Objective quantification of the histopathological response to NAT may be used to guide adjuvant treatment and compare the efficacy of neoadjuvant regimens. However, current tumor response scoring (TRS) systems suffer from interobserver variability, originating from subjective definitions, the sometimes challenging histology, and response heterogeneity throughout the tumor bed. This study investigates if artificial intelligence-based segmentation of residual tumor burden in histopathology of PDAC after NAT may offer a more objective and reproducible TRS solution. Abstract Background: Histologic examination of resected pancreatic cancer after neoadjuvant therapy (NAT) is used to assess the effect of NAT and may guide the choice for adjuvant treatment. However, evaluating residual tumor burden in pancreatic cancer is challenging given tumor response heterogeneity and challenging histomorphology. Artificial intelligence techniques may offer a more reproducible approach. Methods: From 64 patients, one H&E-stained slide of resected pancreatic cancer after NAT was digitized. Three separate classes were manually outlined in each slide (i.e., tumor, normal ducts, and remaining epithelium). Corresponding segmentation masks and patches were generated and distributed over training, validation, and test sets. Modified U-nets with varying encoders were trained, and F1 scores were obtained to express segmentation accuracy. Results: The highest mean segmentation accuracy was obtained using modified U-nets with a DenseNet161 encoder. Tumor tissue was segmented with a high mean F1 score of 0.86, while the overall multiclass average F1 score was 0.82. Conclusions: This study shows that artificial intelligence-based assessment of residual tumor burden is feasible given the promising obtained F1 scores for tumor segmentation. This model could be developed into a tool for the objective evaluation of the response to NAT and may potentially guide the choice for adjuvant treatment.
Collapse
Affiliation(s)
- Boris V. Janssen
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Rutger Theijse
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Stijn van Roessel
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
| | - Rik de Ruiter
- SAS Institute Besloten Vennootschap, 1272 PC Huizen, The Netherlands; (R.d.R.); (A.B.); (J.H.)
| | - Antonie Berkel
- SAS Institute Besloten Vennootschap, 1272 PC Huizen, The Netherlands; (R.d.R.); (A.B.); (J.H.)
| | - Joost Huiskens
- SAS Institute Besloten Vennootschap, 1272 PC Huizen, The Netherlands; (R.d.R.); (A.B.); (J.H.)
| | - Olivier R. Busch
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
| | - Johanna W. Wilmink
- Department of Medical Oncology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands;
| | - Geert Kazemier
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, Vrije Universiteit, 1081 HV Amsterdam, The Netherlands;
| | - Pieter Valkema
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Arantza Farina
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Joanne Verheij
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Onno J. de Boer
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Marc G. Besselink
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
- Correspondence: ; Tel.: +31-20-444-4444
| |
Collapse
|
6
|
Demir FB, Tuncer T, Kocamaz AF, Ertam F. A survival classification method for hepatocellular carcinoma patients with chaotic Darcy optimization method based feature selection. Med Hypotheses 2020; 139:109626. [PMID: 32087492 DOI: 10.1016/j.mehy.2020.109626] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2020] [Revised: 02/10/2020] [Accepted: 02/12/2020] [Indexed: 12/18/2022]
Abstract
Survey is one of the crucial data retrieval methods in the literature. However, surveys often contain missing data and redundant features. Therefore, missing feature completion and feature selection have been widely used for knowledge extraction from surveys. We have a hypothesis to solve these two problems. To implement our hypothesis, a classification method is presented. Our proposed method consists of missing feature completion with a statistical moment (average) and feature selection using a novel swarm optimization method. Firstly, an average based supervised feature completion method is applied to Hepatocellular Carcinoma survey (HCC). The used HCC survey consists of 49 features. To select meaningful features, a chaotic Darcy optimization based feature selection method is presented and this method selects 31 most discriminative features of the completed HCC dataset. 0.9879 accuracy rate was obtained by using the proposed chaotic Darcy optimization-based HCC survival classification method.
Collapse
Affiliation(s)
- Fahrettin Burak Demir
- Department of Computer Sciences, Vahap Kucuk Vocational School, Malatya Turgut Ozal University, Malatya, Turkey.
| | - Turker Tuncer
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey.
| | - Adnan Fatih Kocamaz
- Department of Computer Engineering, Engineering Faculty, Inonu University, Malatya, Turkey.
| | - Fatih Ertam
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey.
| |
Collapse
|
7
|
Azer SA. Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review. World J Gastrointest Oncol 2019; 11:1218-1230. [PMID: 31908726 PMCID: PMC6937442 DOI: 10.4251/wjgo.v11.i12.1218] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2019] [Revised: 07/09/2019] [Accepted: 10/03/2019] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Artificial intelligence, such as convolutional neural networks (CNNs), has been used in the interpretation of images and the diagnosis of hepatocellular cancer (HCC) and liver masses. CNN, a machine-learning algorithm similar to deep learning, has demonstrated its capability to recognise specific features that can detect pathological lesions. AIM To assess the use of CNNs in examining HCC and liver masses images in the diagnosis of cancer and evaluating the accuracy level of CNNs and their performance. METHODS The databases PubMed, EMBASE, and the Web of Science and research books were systematically searched using related keywords. Studies analysing pathological anatomy, cellular, and radiological images on HCC or liver masses using CNNs were identified according to the study protocol to detect cancer, differentiating cancer from other lesions, or staging the lesion. The data were extracted as per a predefined extraction. The accuracy level and performance of the CNNs in detecting cancer or early stages of cancer were analysed. The primary outcomes of the study were analysing the type of cancer or liver mass and identifying the type of images that showed optimum accuracy in cancer detection. RESULTS A total of 11 studies that met the selection criteria and were consistent with the aims of the study were identified. The studies demonstrated the ability to differentiate liver masses or differentiate HCC from other lesions (n = 6), HCC from cirrhosis or development of new tumours (n = 3), and HCC nuclei grading or segmentation (n = 2). The CNNs showed satisfactory levels of accuracy. The studies aimed at detecting lesions (n = 4), classification (n = 5), and segmentation (n = 2). Several methods were used to assess the accuracy of CNN models used. CONCLUSION The role of CNNs in analysing images and as tools in early detection of HCC or liver masses has been demonstrated in these studies. While a few limitations have been identified in these studies, overall there was an optimal level of accuracy of the CNNs used in segmentation and classification of liver cancers images.
Collapse
Affiliation(s)
- Samy A Azer
- Department of Medical Education, King Saud University College of Medicine, Riyadh 11461, Saudi Arabia
| |
Collapse
|