1
|
Mill L, Aust O, Ackermann JA, Burger P, Pascual M, Palumbo-Zerr K, Krönke G, Uderhardt S, Schett G, Clemen CS, Holtzhausen C, Jabari S, Schröder R, Maier A, Grüneboom A. Deep learning-based image analysis in muscle histopathology using photo-realistic synthetic data. COMMUNICATIONS MEDICINE 2025; 5:64. [PMID: 40050400 PMCID: PMC11885816 DOI: 10.1038/s43856-025-00777-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Accepted: 02/20/2025] [Indexed: 03/09/2025] Open
Abstract
BACKGROUND Artificial intelligence (AI), specifically Deep learning (DL), has revolutionized biomedical image analysis, but its efficacy is limited by the need for representative, high-quality large datasets with manual annotations. While latest research on synthetic data using AI-based generative models has shown promising results to tackle this problem, several challenges such as lack of interpretability and need for vast amounts of real data remain. This study aims to introduce a new approach-SYNTA-for the generation of photo-realistic synthetic biomedical image data to address the challenges associated with state-of-the art generative models and DL-based image analysis. METHODS The SYNTA method employs a fully parametric approach to create photo-realistic synthetic training datasets tailored to specific biomedical tasks. Its applicability is tested in the context of muscle histopathology and skeletal muscle analysis. This new approach is evaluated for two real-world datasets to validate its applicability to solve complex image analysis tasks on real data. RESULTS Here we show that SYNTA enables expert-level segmentation of unseen real-world biomedical data using only synthetic training data. By addressing the lack of representative and high-quality real-world training data, SYNTA achieves robust performance in muscle histopathology image analysis, offering a scalable, controllable and interpretable alternative to generative models such as Generative Adversarial Networks (GANs) or Diffusion Models. CONCLUSIONS SYNTA demonstrates great potential to accelerate and improve biomedical image analysis. Its ability to generate high-quality photo-realistic synthetic data reduces reliance on extensive collection of data and manual annotations, paving the way for advancements in histopathology and medical research.
Collapse
Affiliation(s)
- Leonid Mill
- MIRA Vision Microscopy GmbH, 73037, Göppingen, Germany.
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany.
| | - Oliver Aust
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Jochen A Ackermann
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Philipp Burger
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Monica Pascual
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Katrin Palumbo-Zerr
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Gerhard Krönke
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Stefan Uderhardt
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Georg Schett
- Department of Medicine 3 - Rheumatology and Immunology & Deutsches Zentrum für Immuntherapie, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and Universitätsklinikum Erlangen, 91054, Erlangen, Germany
| | - Christoph S Clemen
- Institute of Aerospace Medicine, German Aerospace Center (DLR), Cologne, Germany
- Institute of Vegetative Physiology, Medical Faculty, University of Cologne, Cologne, Germany
| | - Christian Holtzhausen
- Department of Neuropathology, Universitätsklinikum Erlangen, Friedrich-Alexander University Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Samir Jabari
- Department of Neuropathology, Universitätsklinikum Erlangen, Friedrich-Alexander University Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
- Klinikum Nuremberg, Institute of Pathology, Paracelsus Medical University, 90419, Nuremberg, Germany
| | - Rolf Schröder
- Department of Neuropathology, Universitätsklinikum Erlangen, Friedrich-Alexander University Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany
| | - Anika Grüneboom
- Leibniz-Institut für Analytische Wissenschaften - ISAS - e.V, 44139, Dortmund, Germany.
| |
Collapse
|
2
|
Launet L, Colomer A, Mosquera-Zamudio A, Monteagudo C, Naranjo V. The puzzling Spitz tumours: is artificial intelligence the key to their understanding? Histopathology 2025. [PMID: 39976082 DOI: 10.1111/his.15428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2025]
Abstract
Since their first description in 1948, Spitz tumours remain one of the most challenging diagnostic entities in dermatopathology due to their complex histological features and ambiguous clinical behaviour. In recent years, artificial intelligence (AI) solutions have demonstrated significant potential across a wide range of medical applications, including computational pathology, for decision-making in diagnosis, along with promising advances in prognosis and tumour classification. However, the application of AI to Spitz tumours remains relatively underexplored, with few studies addressing this field. Yet in this evolving technological landscape, could AI provide the insights needed to help resolve the diagnostic uncertainties surrounding Spitz tumours? How could this technology be leveraged to bridge the gap between histopathological uncertainty and clinical accuracy? This review aims to provide an overview of the current state of AI applications in Spitz tumour analysis, identify existing research gaps, and propose future directions to optimize the use of AI in understanding and diagnosing these complex tumours.
Collapse
Affiliation(s)
- Laëtitia Launet
- Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano, HUMAN-Tech, Universitat Politècnica de València, Valencia, Spain
| | - Adrián Colomer
- Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano, HUMAN-Tech, Universitat Politècnica de València, Valencia, Spain
| | - Andrés Mosquera-Zamudio
- Universitat de València, Valencia, Spain
- INCLIVA, Instituto de Investigación Sanitaria, Valencia, Spain
| | - Carlos Monteagudo
- Universitat de València, Valencia, Spain
- INCLIVA, Instituto de Investigación Sanitaria, Valencia, Spain
| | - Valery Naranjo
- Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano, HUMAN-Tech, Universitat Politècnica de València, Valencia, Spain
| |
Collapse
|
3
|
Maher NG, Danaei Mehr H, Cong C, Adegoke NA, Vergara IA, Liu S, Scolyer RA. Weakly supervised deep learning image analysis can differentiate melanoma from naevi on haematoxylin and eosin-stained histopathology slides. J Eur Acad Dermatol Venereol 2024; 38:2250-2258. [PMID: 39215631 DOI: 10.1111/jdv.20307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Accepted: 08/12/2024] [Indexed: 09/04/2024]
Abstract
BACKGROUND The broad histomorphological spectrum of melanocytic pathologies requires large data sets to develop accurate and generalisable deep learning (DL)-based diagnostic pathology classifiers. Weakly supervised DL promotes utilisation of larger training data sets compared to fully supervised (patch annotation) approaches. OBJECTIVES To evaluate weakly supervised DL image classifiers for discriminating melanomas from naevi on haematoxylin and eosin (H&E)-stained pathology slides. METHODS A representative H&E slide for 260 naevi and 260 melanomas from mucocutaneous sites at one tertiary institution was digitized. Clinicopathological features were recorded for each case including thickness and histological subtype. Whole-slide or whole-tissue section labels were applied. The ground truth was established by consensus diagnosis from two pathologists. Multiple-instance learning models, Trans-MIL, CLAM and DTFD-MIL were evaluated at 10×, 20× and 40× magnifications using stratified fivefold Monte Carlo cross-validation, with 80/10/10 splits for training/validation/test groups, to predict melanoma from naevus. Heatmaps were generated to understand model performance. RESULTS Naevi cases were younger (median age: 51 years; melanoma median age: 71.5 years), with more balanced sex distribution (males: 48.8%, melanoma male subgroup: 64.2%). The most frequent histological subtypes of naevi and melanomas were dysplastic compound (n = 99, 38.1%) and superficial spreading (n = 124, 47.7%), respectively. Average AUC (±1 SD) for Trans-MIL, CLAM and DTFD-MIL across test groups were 0.9952 ± 0.006, 0.9925 ± 0.0052 and 0.9708 ± 0.0328, at 20× magnification, respectively. Performance of the models varied according to the magnification used. Heatmaps from the two best performing models, Trans-MIL and CLAM, generally indicated attention on appropriate tissue regions for interpretation. CONCLUSIONS Weakly supervised DL on pathological slides of common mucocutaneous melanocytic tumours provides highly accurate diagnostic value for discrimination of melanomas and naevi. External validation and further assessment on less frequently occurring histologic subtypes and borderline cases using this method is required.
Collapse
Affiliation(s)
- Nigel G Maher
- Melanoma Institute Australia, The University of Sydney, Sydney, New South Wales, Australia
- Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- Tissue Pathology and Diagnostic Oncology, Royal Prince Alfred Hospital and NSW Health Pathology, Sydney, New South Wales, Australia
| | - Homay Danaei Mehr
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia
| | - Cong Cong
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia
| | - Nurudeen A Adegoke
- Melanoma Institute Australia, The University of Sydney, Sydney, New South Wales, Australia
- Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia
| | - Ismael A Vergara
- Melanoma Institute Australia, The University of Sydney, Sydney, New South Wales, Australia
- Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia
| | - Sidong Liu
- Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia
| | - Richard A Scolyer
- Melanoma Institute Australia, The University of Sydney, Sydney, New South Wales, Australia
- Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- Tissue Pathology and Diagnostic Oncology, Royal Prince Alfred Hospital and NSW Health Pathology, Sydney, New South Wales, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
4
|
Chatzopoulos K, Syrnioti A, Linos K. Spitz Melanocytic Tumors: A Fascinating 75-Year Journey. Genes (Basel) 2024; 15:195. [PMID: 38397186 PMCID: PMC10887813 DOI: 10.3390/genes15020195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 01/26/2024] [Accepted: 01/28/2024] [Indexed: 02/25/2024] Open
Abstract
Over the last 75 years, our understanding of Spitz lesions has undergone substantial evolution. Initially considered a specific type of melanoma, the perception has shifted towards recognizing Spitz lesions as a spectrum comprising Spitz nevi, Spitz melanocytomas, and Spitz melanomas. Spitz lesions are known for posing a significant diagnostic challenge regarding the distinction between benign neoplasms displaying atypical traits and melanomas. A comprehensive understanding of their molecular basis and genomic aberrations has significantly improved precision in classifying and diagnosing these challenging lesions. The primary aim of this review is to encapsulate the current understanding of the molecular pathogenesis and distinct clinicopathologic characteristics defining this intriguing set of tumors.
Collapse
Affiliation(s)
- Kyriakos Chatzopoulos
- Department of Pathology, Aristotle University, 54636 Thessaloniki, Greece; (K.C.); (A.S.)
| | - Antonia Syrnioti
- Department of Pathology, Aristotle University, 54636 Thessaloniki, Greece; (K.C.); (A.S.)
| | - Konstantinos Linos
- Department of Pathology and Laboratory Medicine, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY 10065, USA
| |
Collapse
|