1
|
Ding Y, Dhawan G, Jones C, Ness T, Nichols E, Krasnogor N, Reynolds NJ. An open source pipeline for quantitative immunohistochemistry image analysis of inflammatory skin disease using artificial intelligence. J Eur Acad Dermatol Venereol 2023; 37:605-614. [PMID: 36367625 PMCID: PMC10947200 DOI: 10.1111/jdv.18726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Accepted: 08/17/2022] [Indexed: 11/13/2022]
Abstract
BACKGROUND The application of artificial intelligence (AI) to whole slide images has the potential to improve research reliability and ultimately diagnostic efficiency and service capacity. Image annotation plays a key role in AI and digital pathology. However, the work-streams required for tissue-specific (skin) and immunostain-specific annotation has not been extensively studied compared with the development of AI algorithms. OBJECTIVES The objective of this study is to develop a common workflow for annotating whole slide images of biopsies from inflammatory skin disease immunostained with a variety of epidermal and dermal markers prior to the development of the AI-assisted analysis pipeline. METHODS A total of 45 slides containing 3-5 sections each were scanned using Aperio AT2 slide scanner (Leica Biosystems). These slides were annotated by hand using a commonly used image analysis tool which resulted in more than 4000 images blocks. We used deep learning (DL) methodology to first sequentially segment (epidermis and upper dermis), with the exclusion of common artefacts and second to quantify the immunostained signal in those two compartments of skin biopsies and the ratio of positive cells. RESULTS We validated two DL models using 10-fold validation runs and by comparing to ground truth manually annotated data. The models achieved an average (global) accuracy of 95.0% for the segmentation of epidermis and dermis and 86.1% for the segmentation of positive/negative cells. CONCLUSIONS The application of two DL models in sequence facilitates accurate segmentation of epidermal and dermal structures, exclusion of common artefacts and enables the quantitative analysis of the immunostained signal. However, inaccurate annotation of the slides for training the DL model can decrease the accuracy of the output. Our open source code will facilitate further external validation across different immunostaining platforms and slide scanners.
Collapse
Affiliation(s)
- Yuchun Ding
- Interdisciplinary Computing and Complex Biosystems Research Group, School of Computing ScienceNewcastle UniversityNewcastle upon TyneUK
| | - Gaurav Dhawan
- Institute of Translational and Clinical MedicineNewcastle University Medical SchoolNewcastle upon TyneUK
- Department of Dermatology, Royal Victoria InfirmaryNewcastle Hospitals NHS Foundation TrustNewcastle upon TyneUK
| | - Claire Jones
- MRC/EPSRC, Molecular Pathology Node, Department of PathologyNewcastle Hospitals NHS Foundation TrustNewcastle upon TyneUK
| | - Thomas Ness
- MRC/EPSRC, Molecular Pathology Node, Department of PathologyNewcastle Hospitals NHS Foundation TrustNewcastle upon TyneUK
| | - Esme Nichols
- Institute of Translational and Clinical MedicineNewcastle University Medical SchoolNewcastle upon TyneUK
- Department of Dermatology, Royal Victoria InfirmaryNewcastle Hospitals NHS Foundation TrustNewcastle upon TyneUK
| | - Natalio Krasnogor
- Interdisciplinary Computing and Complex Biosystems Research Group, School of Computing ScienceNewcastle UniversityNewcastle upon TyneUK
| | - Nick J. Reynolds
- Institute of Translational and Clinical MedicineNewcastle University Medical SchoolNewcastle upon TyneUK
- Department of Dermatology, Royal Victoria InfirmaryNewcastle Hospitals NHS Foundation TrustNewcastle upon TyneUK
| |
Collapse
|
2
|
Ginghina O, Hudita A, Zamfir M, Spanu A, Mardare M, Bondoc I, Buburuzan L, Georgescu SE, Costache M, Negrei C, Nitipir C, Galateanu B. Liquid Biopsy and Artificial Intelligence as Tools to Detect Signatures of Colorectal Malignancies: A Modern Approach in Patient's Stratification. Front Oncol 2022; 12:856575. [PMID: 35356214 PMCID: PMC8959149 DOI: 10.3389/fonc.2022.856575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 02/16/2022] [Indexed: 01/19/2023] Open
Abstract
Colorectal cancer (CRC) is the second most frequently diagnosed type of cancer and a major worldwide public health concern. Despite the global efforts in the development of modern therapeutic strategies, CRC prognosis is strongly correlated with the stage of the disease at diagnosis. Early detection of CRC has a huge impact in decreasing mortality while pre-lesion detection significantly reduces the incidence of the pathology. Even though the management of CRC patients is based on robust diagnostic methods such as serum tumor markers analysis, colonoscopy, histopathological analysis of tumor tissue, and imaging methods (computer tomography or magnetic resonance), these strategies still have many limitations and do not fully satisfy clinical needs due to their lack of sensitivity and/or specificity. Therefore, improvements of the current practice would substantially impact the management of CRC patients. In this view, liquid biopsy is a promising approach that could help clinicians screen for disease, stratify patients to the best treatment, and monitor treatment response and resistance mechanisms in the tumor in a regular and minimally invasive manner. Liquid biopsies allow the detection and analysis of different tumor-derived circulating markers such as cell-free nucleic acids (cfNA), circulating tumor cells (CTCs), and extracellular vesicles (EVs) in the bloodstream. The major advantage of this approach is its ability to trace and monitor the molecular profile of the patient's tumor and to predict personalized treatment in real-time. On the other hand, the prospective use of artificial intelligence (AI) in medicine holds great promise in oncology, for the diagnosis, treatment, and prognosis prediction of disease. AI has two main branches in the medical field: (i) a virtual branch that includes medical imaging, clinical assisted diagnosis, and treatment, as well as drug research, and (ii) a physical branch that includes surgical robots. This review summarizes findings relevant to liquid biopsy and AI in CRC for better management and stratification of CRC patients.
Collapse
Affiliation(s)
- Octav Ginghina
- Department II, University of Medicine and Pharmacy “Carol Davila” Bucharest, Bucharest, Romania
- Department of Surgery, “Sf. Ioan” Clinical Emergency Hospital, Bucharest, Romania
| | - Ariana Hudita
- Department of Biochemistry and Molecular Biology, University of Bucharest, Bucharest, Romania
| | - Marius Zamfir
- Department of Surgery, “Sf. Ioan” Clinical Emergency Hospital, Bucharest, Romania
| | - Andrada Spanu
- Department of Surgery, “Sf. Ioan” Clinical Emergency Hospital, Bucharest, Romania
| | - Mara Mardare
- Department of Surgery, “Sf. Ioan” Clinical Emergency Hospital, Bucharest, Romania
| | - Irina Bondoc
- Department of Surgery, “Sf. Ioan” Clinical Emergency Hospital, Bucharest, Romania
| | | | - Sergiu Emil Georgescu
- Department of Biochemistry and Molecular Biology, University of Bucharest, Bucharest, Romania
| | - Marieta Costache
- Department of Biochemistry and Molecular Biology, University of Bucharest, Bucharest, Romania
| | - Carolina Negrei
- Department of Toxicology, University of Medicine and Pharmacy “Carol Davila” Bucharest, Bucharest, Romania
| | - Cornelia Nitipir
- Department II, University of Medicine and Pharmacy “Carol Davila” Bucharest, Bucharest, Romania
- Department of Oncology, Elias University Emergency Hospital, Bucharest, Romania
| | - Bianca Galateanu
- Department of Biochemistry and Molecular Biology, University of Bucharest, Bucharest, Romania
| |
Collapse
|
3
|
Janssen BV, Theijse R, van Roessel S, de Ruiter R, Berkel A, Huiskens J, Busch OR, Wilmink JW, Kazemier G, Valkema P, Farina A, Verheij J, de Boer OJ, Besselink MG. Artificial Intelligence-Based Segmentation of Residual Tumor in Histopathology of Pancreatic Cancer after Neoadjuvant Treatment. Cancers (Basel) 2021; 13:cancers13205089. [PMID: 34680241 PMCID: PMC8533716 DOI: 10.3390/cancers13205089] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 10/07/2021] [Accepted: 10/09/2021] [Indexed: 12/31/2022] Open
Abstract
Simple Summary The use of neoadjuvant therapy (NAT) in patients with pancreatic ductal adenocarcinoma (PDAC) is increasing. Objective quantification of the histopathological response to NAT may be used to guide adjuvant treatment and compare the efficacy of neoadjuvant regimens. However, current tumor response scoring (TRS) systems suffer from interobserver variability, originating from subjective definitions, the sometimes challenging histology, and response heterogeneity throughout the tumor bed. This study investigates if artificial intelligence-based segmentation of residual tumor burden in histopathology of PDAC after NAT may offer a more objective and reproducible TRS solution. Abstract Background: Histologic examination of resected pancreatic cancer after neoadjuvant therapy (NAT) is used to assess the effect of NAT and may guide the choice for adjuvant treatment. However, evaluating residual tumor burden in pancreatic cancer is challenging given tumor response heterogeneity and challenging histomorphology. Artificial intelligence techniques may offer a more reproducible approach. Methods: From 64 patients, one H&E-stained slide of resected pancreatic cancer after NAT was digitized. Three separate classes were manually outlined in each slide (i.e., tumor, normal ducts, and remaining epithelium). Corresponding segmentation masks and patches were generated and distributed over training, validation, and test sets. Modified U-nets with varying encoders were trained, and F1 scores were obtained to express segmentation accuracy. Results: The highest mean segmentation accuracy was obtained using modified U-nets with a DenseNet161 encoder. Tumor tissue was segmented with a high mean F1 score of 0.86, while the overall multiclass average F1 score was 0.82. Conclusions: This study shows that artificial intelligence-based assessment of residual tumor burden is feasible given the promising obtained F1 scores for tumor segmentation. This model could be developed into a tool for the objective evaluation of the response to NAT and may potentially guide the choice for adjuvant treatment.
Collapse
Affiliation(s)
- Boris V. Janssen
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Rutger Theijse
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Stijn van Roessel
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
| | - Rik de Ruiter
- SAS Institute Besloten Vennootschap, 1272 PC Huizen, The Netherlands; (R.d.R.); (A.B.); (J.H.)
| | - Antonie Berkel
- SAS Institute Besloten Vennootschap, 1272 PC Huizen, The Netherlands; (R.d.R.); (A.B.); (J.H.)
| | - Joost Huiskens
- SAS Institute Besloten Vennootschap, 1272 PC Huizen, The Netherlands; (R.d.R.); (A.B.); (J.H.)
| | - Olivier R. Busch
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
| | - Johanna W. Wilmink
- Department of Medical Oncology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands;
| | - Geert Kazemier
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, Vrije Universiteit, 1081 HV Amsterdam, The Netherlands;
| | - Pieter Valkema
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Arantza Farina
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Joanne Verheij
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Onno J. de Boer
- Department of Pathology, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (P.V.); (A.F.); (J.V.); (O.J.d.B.)
| | - Marc G. Besselink
- Department of Surgery, Amsterdam UMC, Cancer Center Amsterdam, University of Amsterdam, 1081 HV Amsterdam, The Netherlands; (B.V.J.); (R.T.); (S.v.R.); (O.R.B.)
- Correspondence: ; Tel.: +31-20-444-4444
| |
Collapse
|
4
|
Kudou M, Kosuga T, Otsuji E. Artificial intelligence in gastrointestinal cancer: Recent advances and future perspectives. Artif Intell Gastroenterol 2020; 1:71-85. [DOI: 10.35712/aig.v1.i4.71] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/19/2020] [Revised: 10/28/2020] [Accepted: 11/12/2020] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) using machine or deep learning algorithms is attracting increasing attention because of its more accurate image recognition ability and prediction performance than human-aid analyses. The application of AI models to gastrointestinal (GI) clinical oncology has been investigated for the past decade. AI has the capacity to automatically detect and diagnose GI tumors with similar diagnostic accuracy to expert clinicians. AI may also predict malignant potential, such as tumor histology, metastasis, patient survival, resistance to cancer treatments and the molecular biology of tumors, through image analyses of radiological or pathological imaging data using complex deep learning models beyond human cognition. The introduction of AI-assisted diagnostic systems into clinical settings is expected in the near future. However, limitations associated with the evaluation of GI tumors by AI models have yet to be resolved. Recent studies on AI-assisted diagnostic models of gastric and colorectal cancers in the endoscopic, pathological, and radiological fields were herein reviewed. The limitations and future perspectives for the application of AI systems in clinical settings have also been discussed. With the establishment of a multidisciplinary team containing AI experts in each medical institution and prospective studies, AI-assisted medical systems will become a promising tool for GI cancer.
Collapse
Affiliation(s)
- Michihiro Kudou
- Division of Digestive Surgery, Department of Surgery, Kyoto Prefectural University of Medicine, Kyoto 602-8566, Japan
- Department of Surgery, Kyoto Okamoto Memorial Hospital, Kyoto 613-0034, Japan
| | - Toshiyuki Kosuga
- Division of Digestive Surgery, Department of Surgery, Kyoto Prefectural University of Medicine, Kyoto 602-8566, Japan
- Department of Surgery, Saiseikai Shiga Hospital, Ritto 520-3046, Japan
| | - Eigo Otsuji
- Division of Digestive Surgery, Department of Surgery, Kyoto Prefectural University of Medicine, Kyoto 602-8566, Japan
| |
Collapse
|
5
|
Wang Y, Nie H, He X, Liao Z, Zhou Y, Zhou J, Ou C. The emerging role of super enhancer-derived noncoding RNAs in human cancer. Theranostics 2020; 10:11049-11062. [PMID: 33042269 PMCID: PMC7532672 DOI: 10.7150/thno.49168] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2020] [Accepted: 08/23/2020] [Indexed: 02/06/2023] Open
Abstract
Super enhancers (SEs) are large clusters of adjacent enhancers that drive the expression of genes which regulate cellular identity; SE regions can be enriched with a high density of transcription factors, co-factors, and enhancer-associated epigenetic modifications. Through enhanced activation of their target genes, SEs play an important role in various diseases and conditions, including cancer. Recent studies have shown that SEs not only activate the transcriptional expression of coding genes to directly regulate biological functions, but also drive the transcriptional expression of non-coding RNAs (ncRNAs) to indirectly regulate biological functions. SE-derived ncRNAs play critical roles in tumorigenesis, including malignant proliferation, metastasis, drug resistance, and inflammatory response. Moreover, the abnormal expression of SE-derived ncRNAs is closely related to the clinical and pathological characterization of tumors. In this review, we summarize the functions and roles of SE-derived ncRNAs in tumorigenesis and discuss their prospective applications in tumor therapy. A deeper understanding of the potential mechanism underlying the action of SE-derived ncRNAs in tumorigenesis may provide new strategies for the early diagnosis of tumors and targeted therapy.
Collapse
|