1
|
Lalmalani RM, Lim CXY, Oh CC. Artificial intelligence in dermatopathology: a systematic review. Clin Exp Dermatol 2025; 50:251-259. [PMID: 39226138 DOI: 10.1093/ced/llae361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 02/29/2024] [Accepted: 08/26/2024] [Indexed: 09/05/2024]
Abstract
Medical research, driven by advancing technologies like artificial intelligence (AI), is transforming healthcare. Dermatology, known for its visual nature, benefits from AI, especially in dermatopathology with digitized slides. This review explores AI's role, challenges, opportunities and future potential in enhancing dermatopathological diagnosis and care. Adhering to PRISMA and Cochrane Handbook standards, this systematic review explored AI's function in dermatopathology. It employed an interdisciplinary method, encompassing diverse study types and comprehensive database searches. Inclusion criteria encompassed peer-reviewed articles from 2000 to 2023, with a focus on practical AI use in dermatopathology. Numerous studies have investigated AI's potential in dermatopathology. We reviewed 112 papers. Notable applications include AI classifying histopathological images of naevi and melanomas, although challenges exist regarding subtype differentiation and generalizability. AI achieved high accuracy in melanoma recognition from formalin-fixed paraffin-embedded samples but faced limitations due to small datasets. Deep learning algorithms showed diagnostic accuracy for specific skin conditions, but challenges persisted, such as small sample sizes and the need for prospective validation. This systematic review underscores AI's potential in enhancing dermatopathology for better diagnosis and patient care. Addressing challenges like limited datasets and potential biases is essential. Future directions involve expanding datasets, conducting validation studies, promoting interdisciplinary collaboration, and creating patient-centred AI tools in dermatopathology to enhance accuracy, accessibility and patient-focused care.
Collapse
Affiliation(s)
| | - Clarissa Xin Yu Lim
- Department of Dermatology, Singapore General Hospital, Singapore, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Choon Chiat Oh
- Department of Dermatology, Singapore General Hospital, Singapore, Singapore
- Duke-NUS Medical School, Singhealth, Singapore, Singapore
| |
Collapse
|
2
|
Shenouda M, Gudmundsson E, Li F, Straus CM, Kindler HL, Dudek AZ, Stinchcombe T, Wang X, Starkey A, Armato Iii SG. Convolutional Neural Networks for Segmentation of Pleural Mesothelioma: Analysis of Probability Map Thresholds (CALGB 30901, Alliance). JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01092-z. [PMID: 39266911 DOI: 10.1007/s10278-024-01092-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 02/28/2024] [Accepted: 02/29/2024] [Indexed: 09/14/2024]
Abstract
The purpose of this study was to evaluate the impact of probability map threshold on pleural mesothelioma (PM) tumor delineations generated using a convolutional neural network (CNN). One hundred eighty-six CT scans from 48 PM patients were segmented by a VGG16/U-Net CNN. A radiologist modified the contours generated at a 0.5 probability threshold. Percent difference of tumor volume and overlap using the Dice Similarity Coefficient (DSC) were compared between the reference standard provided by the radiologist and CNN outputs for thresholds ranging from 0.001 to 0.9. CNN-derived contours consistently yielded smaller tumor volumes than radiologist contours. Reducing the probability threshold from 0.5 to 0.01 decreased the absolute percent volume difference, on average, from 42.93% to 26.60%. Median and mean DSC ranged from 0.57 to 0.59, with a peak at a threshold of 0.2; no distinct threshold was found for percent volume difference. The CNN exhibited deficiencies with specific disease presentations, such as severe pleural effusion or disease in the pleural fissure. No single output threshold in the CNN probability maps was optimal for both tumor volume and DSC. This study emphasized the importance of considering both figures of merit when evaluating deep learning-based tumor segmentations across probability thresholds. This work underscores the need to simultaneously assess tumor volume and spatial overlap when evaluating CNN performance. While automated segmentations may yield comparable tumor volumes to that of the reference standard, the spatial region delineated by the CNN at a specific threshold is equally important.
Collapse
Affiliation(s)
- Mena Shenouda
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | | | - Feng Li
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | | | - Hedy L Kindler
- Department of Medicine, The University of Chicago, Chicago, IL, 60637, USA
| | - Arkadiusz Z Dudek
- Metro Minnesota Community Oncology Research Consortium, St. Louis Park, MN, 55416, USA
| | | | - Xiaofei Wang
- Alliance Statistics and Data Management Center, Duke University, Durham, NC, 27710, USA
| | - Adam Starkey
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | - Samuel G Armato Iii
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA.
| |
Collapse
|
3
|
Al-Moussally F, Alamin F, Khan S, Gopalan PK. Sarcomatoid Mesothelioma With New Pancreatic Lesions Presenting As Acute Pancreatitis: A Case Report. Cureus 2024; 16:e64088. [PMID: 39114201 PMCID: PMC11305595 DOI: 10.7759/cureus.64088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/08/2024] [Indexed: 08/10/2024] Open
Abstract
Sarcomatoid mesothelioma is a rare, aggressive malignancy that usually follows asbestos exposure. It is the least common subtype of mesotheliomas, following epithelial and biphasic subtypes. Pleural mesothelioma can metastasize, with the liver, kidneys, adrenal glands, and opposite lungs being the most commonly reported sites for metastasis. Metastasis of the pancreas is extremely rare, which is why the authors of this case report intend to present the case of a 78-year-old male who was found to have acute pancreatitis, most likely secondary to metastatic lesions.
Collapse
Affiliation(s)
- Feras Al-Moussally
- Internal Medicine, University of Central Florida College of Medicine, Kissimmee, USA
| | - Faris Alamin
- Internal Medicine, University of Central Florida-HCA Osceola Hospital, Orlando, USA
| | - Saud Khan
- Internal Medicine, University of Central Florida-HCA Osceola Hospital, Orlando, USA
| | - Priya K Gopalan
- Hematology/Oncology, Orlando VA Medical Center, Orlando, USA
| |
Collapse
|
4
|
Liu X, Li F, Xu J, Ma J, Duan X, Mao R, Chen M, Chen Z, Huang Y, Jiang J, Huang B, Ye Z. Deep learning model to differentiate Crohn's disease from intestinal tuberculosis using histopathological whole slide images from intestinal specimens. Virchows Arch 2024; 484:965-976. [PMID: 38332051 DOI: 10.1007/s00428-024-03740-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/29/2023] [Accepted: 01/13/2024] [Indexed: 02/10/2024]
Abstract
Crohn's disease (CD) and intestinal tuberculosis (ITB) share similar histopathological characteristics, and differential diagnosis can be a dilemma for pathologists. This study aimed to apply deep learning (DL) to analyze whole slide images (WSI) of surgical resection specimens to distinguish CD from ITB. Overall, 1973 WSI from 85 cases from 3 centers were obtained. The DL model was established in internal training and validated in external test cohort, evaluated by area under receiver operator characteristic curve (AUC). Diagnostic results of pathologists were compared with those of the DL model using DeLong's test. DL model had case level AUC of 0.886, 0.893 and slide level AUC of 0.954, 0.827 in training and test cohorts. Attention maps highlighted discriminative areas and top 10 features were extracted from CD and ITB. DL model's diagnostic efficiency (AUC = 0.886) was better than junior pathologists (*1 AUC = 0.701, P = 0.088; *2 AUC = 0.861, P = 0.788) and inferior to senior GI pathologists (*3 AUC = 0.910, P = 0.800; *4 AUC = 0.946, P = 0.507) in training cohort. In the test cohort, model (AUC = 0.893) outperformed senior non-GI pathologists (*5 AUC = 0.782, P = 0.327; *6 AUC = 0.821, P = 0.516). We developed a DL model for the classification of CD and ITB, improving pathological diagnosis accuracy effectively.
Collapse
Affiliation(s)
- Xinning Liu
- Department of Pathology, The First Affiliated Hospital, Sun Yat-sen University, No. 58 Zhongshan Road 2, Guangzhou, 510080, Guangdong, People's Republic of China
- Department of Pathology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, Guangdong, People's Republic of China
| | - Fei Li
- Medical AI Lab, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, Guangdong, People's Republic of China
| | - Jie Xu
- Department of Pathology, The Seventh Affiliated Hospital, Sun Yat-sen University, Shenzhen, Guangdong, People's Republic of China
| | - Jinting Ma
- Medical AI Lab, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, Guangdong, People's Republic of China
| | - Xiaoyu Duan
- Department of Pathology, The First Affiliated Hospital, Sun Yat-sen University, No. 58 Zhongshan Road 2, Guangzhou, 510080, Guangdong, People's Republic of China
| | - Ren Mao
- Department of Gastroenterology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, People's Republic of China
| | - Minhu Chen
- Department of Gastroenterology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, People's Republic of China
| | - Zhihui Chen
- Department of Gastrointestinal and Pancreatic Surgery, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, People's Republic of China
| | - Yan Huang
- Department of Pathology, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, People's Republic of China
| | - Jingyi Jiang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, Guangdong, People's Republic of China
| | - Bingsheng Huang
- Medical AI Lab, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, 1066 Xueyuan Avenue, Shenzhen, 518000, Guangdong, People's Republic of China.
| | - Ziyin Ye
- Department of Pathology, The First Affiliated Hospital, Sun Yat-sen University, No. 58 Zhongshan Road 2, Guangzhou, 510080, Guangdong, People's Republic of China.
| |
Collapse
|
5
|
Eastwood M, Sailem H, Marc ST, Gao X, Offman J, Karteris E, Fernandez AM, Jonigk D, Cookson W, Moffatt M, Popat S, Minhas F, Robertus JL. MesoGraph: Automatic profiling of mesothelioma subtypes from histological images. Cell Rep Med 2023; 4:101226. [PMID: 37816348 PMCID: PMC10591053 DOI: 10.1016/j.xcrm.2023.101226] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 06/08/2023] [Accepted: 09/14/2023] [Indexed: 10/12/2023]
Abstract
Mesothelioma is classified into three histological subtypes, epithelioid, sarcomatoid, and biphasic, according to the relative proportions of epithelioid and sarcomatoid tumor cells present. Current guidelines recommend that the sarcomatoid component of each mesothelioma is quantified, as a higher percentage of sarcomatoid pattern in biphasic mesothelioma shows poorer prognosis. In this work, we develop a dual-task graph neural network (GNN) architecture with ranking loss to learn a model capable of scoring regions of tissue down to cellular resolution. This allows quantitative profiling of a tumor sample according to the aggregate sarcomatoid association score. Tissue is represented by a cell graph with both cell-level morphological and regional features. We use an external multicentric test set from Mesobank, on which we demonstrate the predictive performance of our model. We additionally validate our model predictions through an analysis of the typical morphological features of cells according to their predicted score.
Collapse
Affiliation(s)
- Mark Eastwood
- Tissue Image Analytics Center, University of Warwick, Coventry, UK.
| | - Heba Sailem
- Institute of Biomedical Engineering, University of Oxford, Oxford, UK; Kings College London, London, UK
| | | | - Xiaohong Gao
- Department of Computer Science, University of Middlesex, London, UK
| | - Judith Offman
- Kings College London, London, UK; Wolfson Institute of Population Health, Queen Mary University of London, London, UK
| | - Emmanouil Karteris
- College of Health, Medicine and Life Sciences, Brunel University London, London, UK
| | | | - Danny Jonigk
- German Center for Lung Research (DZL), BREATH, Hanover, Germany; Institute of Pathology, Medical Faculty of RWTH Aachen University, Aachen, Germany
| | - William Cookson
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Miriam Moffatt
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Sanjay Popat
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Fayyaz Minhas
- Tissue Image Analytics Center, University of Warwick, Coventry, UK; Warwick Cancer Research Centre, University of Warwick, Coventry, UK
| | | |
Collapse
|
6
|
Eastwood M, Marc ST, Gao X, Sailem H, Offman J, Karteris E, Fernandez AM, Jonigk D, Cookson W, Moffatt M, Popat S, Minhas F, Robertus JL. Malignant Mesothelioma subtyping via sampling driven multiple instance prediction on tissue image and cell morphology data. Artif Intell Med 2023; 143:102628. [PMID: 37673586 DOI: 10.1016/j.artmed.2023.102628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 06/30/2023] [Accepted: 07/14/2023] [Indexed: 09/08/2023]
Abstract
Malignant Mesothelioma is a difficult to diagnose and highly lethal cancer usually associated with asbestos exposure. It can be broadly classified into three subtypes: Epithelioid, Sarcomatoid, and a hybrid Biphasic subtype in which significant components of both of the previous subtypes are present. Early diagnosis and identification of the subtype informs treatment and can help improve patient outcome. However, the subtyping of malignant mesothelioma, and specifically the recognition of transitional features from routine histology slides has a high level of inter-observer variability. In this work, we propose an end-to-end multiple instance learning (MIL) approach for malignant mesothelioma subtyping. This uses an adaptive instance-based sampling scheme for training deep convolutional neural networks on bags of image patches that allows learning on a wider range of relevant instances compared to max or top-N based MIL approaches. We also investigate augmenting the instance representation to include aggregate cellular morphology features from cell segmentation. The proposed MIL approach enables identification of malignant mesothelial subtypes of specific tissue regions. From this a continuous characterisation of a sample according to predominance of sarcomatoid vs epithelioid regions is possible, thus avoiding the arbitrary and highly subjective categorisation by currently used subtypes. Instance scoring also enables studying tumor heterogeneity and identifying patterns associated with different subtypes. We have evaluated the proposed method on a dataset of 234 tissue micro-array cores with an AUROC of 0.89±0.05 for this task. The dataset and developed methodology is available for the community at: https://github.com/measty/PINS.
Collapse
Affiliation(s)
- Mark Eastwood
- Tissue Image Analytics Center, University of Warwick, United Kingdom.
| | - Silviu Tudor Marc
- Department of Computer Science, University of Middlesex, United Kingdom
| | - Xiaohong Gao
- Department of Computer Science, University of Middlesex, United Kingdom
| | - Heba Sailem
- Institute of Biomedical Engineering, University of Oxford, United Kingdom; Kings College London, United Kingdom
| | - Judith Offman
- Kings College London, United Kingdom; Wolfson Institute of Population Health, Queen Mary University of London, United Kingdom
| | | | | | - Danny Jonigk
- German Center for Lung Research (DZL), BREATH, Hanover, Germany; Institute of Pathology, Medical Faculty of RWTH Aachen University, Aachen, Germany
| | - William Cookson
- National Heart and Lung Institute, Imperial College London, United Kingdom
| | - Miriam Moffatt
- National Heart and Lung Institute, Imperial College London, United Kingdom
| | - Sanjay Popat
- National Heart and Lung Institute, Imperial College London, United Kingdom
| | - Fayyaz Minhas
- Tissue Image Analytics Center, University of Warwick, United Kingdom
| | - Jan Lukas Robertus
- National Heart and Lung Institute, Imperial College London, United Kingdom
| |
Collapse
|
7
|
Viswanathan VS, Toro P, Corredor G, Mukhopadhyay S, Madabhushi A. The state of the art for artificial intelligence in lung digital pathology. J Pathol 2022; 257:413-429. [PMID: 35579955 PMCID: PMC9254900 DOI: 10.1002/path.5966] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 04/26/2022] [Accepted: 05/15/2022] [Indexed: 12/03/2022]
Abstract
Lung diseases carry a significant burden of morbidity and mortality worldwide. The advent of digital pathology (DP) and an increase in computational power have led to the development of artificial intelligence (AI)-based tools that can assist pathologists and pulmonologists in improving clinical workflow and patient management. While previous works have explored the advances in computational approaches for breast, prostate, and head and neck cancers, there has been a growing interest in applying these technologies to lung diseases as well. The application of AI tools on radiology images for better characterization of indeterminate lung nodules, fibrotic lung disease, and lung cancer risk stratification has been well documented. In this article, we discuss methodologies used to build AI tools in lung DP, describing the various hand-crafted and deep learning-based unsupervised feature approaches. Next, we review AI tools across a wide spectrum of lung diseases including cancer, tuberculosis, idiopathic pulmonary fibrosis, and COVID-19. We discuss the utility of novel imaging biomarkers for different types of clinical problems including quantification of biomarkers like PD-L1, lung disease diagnosis, risk stratification, and prediction of response to treatments such as immune checkpoint inhibitors. We also look briefly at some emerging applications of AI tools in lung DP such as multimodal data analysis, 3D pathology, and transplant rejection. Lastly, we discuss the future of DP-based AI tools, describing the challenges with regulatory approval, developing reimbursement models, planning clinical deployment, and addressing AI biases. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.
Collapse
Affiliation(s)
| | - Paula Toro
- Department of PathologyCleveland ClinicClevelandOHUSA
| | - Germán Corredor
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
- Louis Stokes Cleveland VA Medical CenterClevelandOHUSA
| | | | - Anant Madabhushi
- Department of Biomedical EngineeringCase Western Reserve UniversityClevelandOHUSA
- Louis Stokes Cleveland VA Medical CenterClevelandOHUSA
| |
Collapse
|
8
|
Eastwood M, Marc ST, Gao X, Sailem H, Offman J, Karteris E, Fernandez AM, Jonigk D, Cookson W, Moffatt M, Popat S, Minhas F, Robertus JL. Malignant Mesothelioma Subtyping of Tissue Images via Sampling Driven Multiple Instance Prediction. Artif Intell Med 2022. [DOI: 10.1007/978-3-031-09342-5_25] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
9
|
Chen SB, Novoa RA. Artificial intelligence for dermatopathology: Current trends and the road ahead. Semin Diagn Pathol 2022; 39:298-304. [DOI: 10.1053/j.semdp.2022.01.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Revised: 01/06/2022] [Accepted: 01/12/2022] [Indexed: 02/07/2023]
|
10
|
Boyraz B, Hung YP. Spindle Cell Tumors of the Pleura and the Peritoneum: Pathologic Diagnosis and Updates. APMIS 2021; 130:140-154. [PMID: 34942046 DOI: 10.1111/apm.13203] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 09/23/2021] [Indexed: 11/30/2022]
Abstract
A diverse group of both benign and malignant spindle cell tumors can involve the pleura or the peritoneum. Due to their rarity and overlapping morphologic features, these tumors can pose considerable diagnostic difficulty in surgical pathology. As these tumors differ in their prognosis and clinical management, their correct pathologic diagnosis is critical. In addition to histologic assessment, select immunohistochemical and molecular tools can aid the distinction among these tumors. In this review, we consider some of the major histologic differential diagnosis of spindle cell tumors involving these serosal membranes. This list of tumors includes: solitary fibrous tumor, inflammatory myofibroblastic tumor, desmoid fibromatosis, synovial sarcoma, sarcomatoid carcinoma, spindle cell melanoma, dedifferentiated liposarcoma, epithelioid hemangioendothelioma, and sarcomatoid mesothelioma. We describe their salient clinicopathologic and genetic findings, with a review on some of the recent discoveries on their molecular pathogenesis.
Collapse
Affiliation(s)
- Baris Boyraz
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Yin P Hung
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, United States of America
| |
Collapse
|