1
|
Kassab M, Jehanzaib M, Başak K, Demir D, Keles GE, Turan M. FFPE++: Improving the quality of formalin-fixed paraffin-embedded tissue imaging via contrastive unpaired image-to-image translation. Med Image Anal 2024; 91:102992. [PMID: 37852162 DOI: 10.1016/j.media.2023.102992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 04/29/2023] [Accepted: 10/02/2023] [Indexed: 10/20/2023]
Abstract
Formalin-fixation and paraffin-embedding (FFPE) is a technique for preparing and preserving tissue specimens that has been utilized in histopathology since the late 19th century. This process is further complicated by FFPE preparation steps such as fixation, processing, embedding, microtomy, staining, and coverslipping, which often results in artifacts due to the complex histological and cytological characteristics of a tissue specimen. The term "artifacts" includes, but is not limited to, staining inconsistencies, tissue folds, chattering, pen marks, blurring, air bubbles, and contamination. The presence of artifacts may interfere with pathological diagnosis in disease detection, subtyping, grading, and choice of therapy. In this study, we propose FFPE++, an unpaired image-to-image translation method based on contrastive learning with a mixed channel-spatial attention module and self-regularization loss that drastically corrects the aforementioned artifacts in FFPE tissue sections. Turing tests were performed by 10 board-certified pathologists with more than 10 years of experience. These tests which were performed for ovarian carcinoma, lung adenocarcinoma, lung squamous cell carcinoma, and papillary thyroid carcinoma, demonstrate the clear superiority of the proposed method in many clinical aspects compared with standard FFPE images. Based on the qualitative experiments and feedback from the Turing tests, we believe that FFPE++ can contribute to substantial diagnostic and prognostic accuracy in clinical pathology in the future and can also improve the performance of AI tools in digital pathology. The code and dataset are publicly available at https://github.com/DeepMIALab/FFPEPlus.
Collapse
Affiliation(s)
- Mohamad Kassab
- Department of Computer Engineering, Bogazici University, Istanbul, Turkey
| | - Muhammad Jehanzaib
- Department of Computer Engineering, Bogazici University, Istanbul, Turkey
| | - Kayhan Başak
- Sağlık Bilimleri University, Kartal Dr.Lütfi Kırdar City Hospital, Department of Pathology, Istanbul, Turkey
| | - Derya Demir
- Faculty of Medicine, Department of Pathology, Ege University, Izmir, Turkey
| | | | - Mehmet Turan
- Department of Computer Engineering, Bogazici University, Istanbul, Turkey.
| |
Collapse
|
2
|
Gu Q, Meroueh C, Levernier J, Kroneman T, Flotte T, Hart S. Using an anomaly detection approach for the segmentation of colorectal cancer tumors in whole slide images. J Pathol Inform 2023; 14:100336. [PMID: 37811333 PMCID: PMC10550750 DOI: 10.1016/j.jpi.2023.100336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 09/13/2023] [Accepted: 09/19/2023] [Indexed: 10/10/2023] Open
Abstract
Colorectal cancer (CRC) is the second most commonly diagnosed cancer in the United States. Genetic testing is critical in assisting in the early detection of CRC and selection of individualized treatment plans, which have shown to improve the survival rate of CRC patients. The tissue slide review (TSR), a tumor tissue macro-dissection procedure, is a required pre-analytical step to perform genetic testing. Due to the subjective nature of the process, major discrepancies in CRC diagnostics by pathologists are reported, and metrics for quality are often only qualitative. Progressive context encoder anomaly detection (P-CEAD) is an anomaly detection approach to detect tumor tissue from whole slide images (WSIs), since tumor tissue is by its nature, an anomaly. P-CEAD-based CRC tumor segmentation achieves a 71% 26% sensitivity, 92% 7% specificity, and 63% 23% F1 score. The proposed approach provides an automated CRC tumor segmentation pipeline with a quantitatively reproducible quality compared with the conventional manual tumor segmentation procedure.
Collapse
Affiliation(s)
- Qiangqiang Gu
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55901, United States
| | - Chady Meroueh
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55901, United States
| | - Jacob Levernier
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55901, United States
| | - Trynda Kroneman
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55901, United States
| | - Thomas Flotte
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55901, United States
| | - Steven Hart
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55901, United States
- Department of Quantitative Health Science, Mayo Clinic, Rochester, MN 55901, United States
| |
Collapse
|
3
|
Clunie DA, Flanders A, Taylor A, Erickson B, Bialecki B, Brundage D, Gutman D, Prior F, Seibert JA, Perry J, Gichoya JW, Kirby J, Andriole K, Geneslaw L, Moore S, Fitzgerald TJ, Tellis W, Xiao Y, Farahani K, Luo J, Rosenthal A, Kandarpa K, Rosen R, Goetz K, Babcock D, Xu B, Hsiao J. Report of the Medical Image De-Identification (MIDI) Task Group - Best Practices and Recommendations. ARXIV 2023:arXiv:2303.10473v2. [PMID: 37033463 PMCID: PMC10081345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Subscribe] [Scholar Register] [Indexed: 04/11/2023]
Affiliation(s)
| | | | | | | | | | | | | | - Fred Prior
- University of Arkansas for Medical Sciences
| | | | | | | | - Justin Kirby
- Frederick National Laboratory for Cancer Research
| | | | | | | | | | | | - Ying Xiao
- University of Pennsylvania Health System
| | | | - James Luo
- National Heart, Lung, and Blood Institute (NHLBI)
| | - Alex Rosenthal
- National Institute of Allergy and Infectious Diseases (NIAID)
| | - Kris Kandarpa
- National Institute of Biomedical Imaging and Bioengineering (NIBIB)
| | - Rebecca Rosen
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD)
| | | | - Debra Babcock
- National Institute of Neurological Disorders and Stroke (NINDS)
| | - Ben Xu
- National Institute on Alcohol Abuse and Alcoholism (NIAAA)
| | | |
Collapse
|
4
|
Jiang J, Tekin B, Yuan L, Armasu S, Winham SJ, Goode EL, Liu H, Huang Y, Guo R, Wang C. Computational tumor stroma reaction evaluation led to novel prognosis-associated fibrosis and molecular signature discoveries in high-grade serous ovarian carcinoma. Front Med (Lausanne) 2022; 9:994467. [PMID: 36160147 PMCID: PMC9490262 DOI: 10.3389/fmed.2022.994467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 08/15/2022] [Indexed: 11/28/2022] Open
Abstract
Background As one of the key criteria to differentiate benign vs. malignant tumors in ovarian and other solid cancers, tumor-stroma reaction (TSR) is long observed by pathologists and has been found correlated with patient prognosis. However, paucity of study aims to overcome subjective bias or automate TSR evaluation for enabling association analysis to a large cohort. Materials and methods Serving as positive and negative sets of TSR studies, H&E slides of primary tumors of high-grade serous ovarian carcinoma (HGSOC) (n = 291) and serous borderline ovarian tumor (SBOT) (n = 15) were digitally scanned. Three pathologist-defined quantification criteria were used to characterize the extents of TSR. Scores for each criterion were annotated (0/1/2 as none-low/intermediate/high) in the training set consisting of 18,265 H&E patches. Serial of deep learning (DL) models were trained to identify tumor vs. stroma regions and predict TSR scores. After cross-validation and independent validations, the trained models were generalized to the entire HGSOC cohort and correlated with clinical characteristics. In a subset of cases tumor transcriptomes were available, gene- and pathway-level association studies were conducted with TSR scores. Results The trained models accurately identified the tumor stroma tissue regions and predicted TSR scores. Within tumor stroma interface region, TSR fibrosis scores were strongly associated with patient prognosis. Cancer signaling aberrations associated 14 KEGG pathways were also found positively correlated with TSR-fibrosis score. Conclusion With the aid of DL, TSR evaluation could be generalized to large cohort to enable prognostic association analysis and facilitate discovering novel gene and pathways associated with disease progress.
Collapse
Affiliation(s)
- Jun Jiang
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
| | - Burak Tekin
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, United States
| | - Lin Yuan
- Pathology Center, Shanghai General Hospital, Shanghai, China
| | - Sebastian Armasu
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
| | - Stacey J. Winham
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
| | - Ellen L. Goode
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
| | - Hongfang Liu
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, United States
- Hongfang Liu,
| | - Yajue Huang
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, United States
- Yajue Huang,
| | - Ruifeng Guo
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, United States
- Ruifeng Guo,
| | - Chen Wang
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, United States
- *Correspondence: Chen Wang,
| |
Collapse
|
5
|
Cornish TC. Artificial intelligence for automating the measurement of histologic image biomarkers. J Clin Invest 2021; 131:147966. [PMID: 33855974 DOI: 10.1172/jci147966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Artificial intelligence has been applied to histopathology for decades, but the recent increase in interest is attributable to well-publicized successes in the application of deep-learning techniques, such as convolutional neural networks, for image analysis. Recently, generative adversarial networks (GANs) have provided a method for performing image-to-image translation tasks on histopathology images, including image segmentation. In this issue of the JCI, Koyuncu et al. applied GANs to whole-slide images of p16-positive oropharyngeal squamous cell carcinoma (OPSCC) to automate the calculation of a multinucleation index (MuNI) for prognostication in p16-positive OPSCC. Multivariable analysis showed that the MuNI was prognostic for disease-free survival, overall survival, and metastasis-free survival. These results are promising, as they present a prognostic method for p16-positive OPSCC and highlight methods for using deep learning to measure image biomarkers from histopathologic samples in an inherently explainable manner.
Collapse
|