1
|
Patel RH, Foltz EA, Witkowski A, Ludzik J. Analysis of Artificial Intelligence-Based Approaches Applied to Non-Invasive Imaging for Early Detection of Melanoma: A Systematic Review. Cancers (Basel) 2023; 15:4694. [PMID: 37835388 PMCID: PMC10571810 DOI: 10.3390/cancers15194694] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 09/05/2023] [Accepted: 09/19/2023] [Indexed: 10/15/2023] Open
Abstract
BACKGROUND Melanoma, the deadliest form of skin cancer, poses a significant public health challenge worldwide. Early detection is crucial for improved patient outcomes. Non-invasive skin imaging techniques allow for improved diagnostic accuracy; however, their use is often limited due to the need for skilled practitioners trained to interpret images in a standardized fashion. Recent innovations in artificial intelligence (AI)-based techniques for skin lesion image interpretation show potential for the use of AI in the early detection of melanoma. OBJECTIVE The aim of this study was to evaluate the current state of AI-based techniques used in combination with non-invasive diagnostic imaging modalities including reflectance confocal microscopy (RCM), optical coherence tomography (OCT), and dermoscopy. We also aimed to determine whether the application of AI-based techniques can lead to improved diagnostic accuracy of melanoma. METHODS A systematic search was conducted via the Medline/PubMed, Cochrane, and Embase databases for eligible publications between 2018 and 2022. Screening methods adhered to the 2020 version of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Included studies utilized AI-based algorithms for melanoma detection and directly addressed the review objectives. RESULTS We retrieved 40 papers amongst the three databases. All studies directly comparing the performance of AI-based techniques with dermatologists reported the superior or equivalent performance of AI-based techniques in improving the detection of melanoma. In studies directly comparing algorithm performance on dermoscopy images to dermatologists, AI-based algorithms achieved a higher ROC (>80%) in the detection of melanoma. In these comparative studies using dermoscopic images, the mean algorithm sensitivity was 83.01% and the mean algorithm specificity was 85.58%. Studies evaluating machine learning in conjunction with OCT boasted accuracy of 95%, while studies evaluating RCM reported a mean accuracy rate of 82.72%. CONCLUSIONS Our results demonstrate the robust potential of AI-based techniques to improve diagnostic accuracy and patient outcomes through the early identification of melanoma. Further studies are needed to assess the generalizability of these AI-based techniques across different populations and skin types, improve standardization in image processing, and further compare the performance of AI-based techniques with board-certified dermatologists to evaluate clinical applicability.
Collapse
Affiliation(s)
- Raj H. Patel
- Edward Via College of Osteopathic Medicine, VCOM-Louisiana, 4408 Bon Aire Dr, Monroe, LA 71203, USA
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
| | - Emilie A. Foltz
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
- Elson S. Floyd College of Medicine, Washington State University, Spokane, WA 99202, USA
| | - Alexander Witkowski
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
| | - Joanna Ludzik
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97239, USA (A.W.); (J.L.)
| |
Collapse
|
2
|
Cozzolino C, Buja A, Rugge M, Miatton A, Zorzi M, Vecchiato A, Del Fiore P, Tropea S, Brazzale A, Damiani G, dall'Olmo L, Rossi CR, Mocellin S. Machine learning to predict overall short-term mortality in cutaneous melanoma. Discov Oncol 2023; 14:13. [PMID: 36719475 PMCID: PMC9889591 DOI: 10.1007/s12672-023-00622-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 01/19/2023] [Indexed: 02/01/2023] Open
Abstract
BACKGROUND Cutaneous malignant melanoma (CMM) ranks among the ten most frequent malignancies, clinicopathological staging being of key importance to predict prognosis. Artificial intelligence (AI) has been recently applied to develop prognostically reliable staging systems for CMM. This study aims to provide a useful machine learning based tool to predict the overall CMM short-term survival. METHODS CMM records as collected at the Veneto Cancer Registry (RTV) and at the Veneto regional health service were considered. A univariate Cox regression validated the strength and direction of each independent variable with overall mortality. A range of machine learning models (Logistic Regression classifier, Support-Vector Machine, Random Forest, Gradient Boosting, and k-Nearest Neighbors) and a Deep Neural Network were then trained to predict the 3-years mortality probability. Five-fold cross-validation and Grid Search were performed to test the best data preprocessing procedures, features selection, and to optimize models hyperparameters. A final evaluation was carried out on a separate test set in terms of balanced accuracy, precision, recall and F1 score. The best model was deployed as online tool. RESULTS The univariate analysis confirmed the significant prognostic value of TNM staging. Adjunctive clinicopathological variables not included in the AJCC 8th melanoma staging system, i.e., sex, tumor site, histotype, growth phase, and age, were significantly linked to overall survival. Among the models, the Neural Network and the Random Forest models featured the best prognostic performance, achieving a balanced accuracy of 91% and 88%, respectively. According to the Gini importance score, age, T and M stages, mitotic count, and ulceration appeared to be the variables with the greatest impact on survival prediction. CONCLUSIONS Using data from patients with CMM, we developed an AI algorithm with high staging reliability, on top of which a web tool was implemented ( unipd.link/melanomaprediction ). Being essentially based on routinely recorded clinicopathological variables, it can already be implemented with minimal effort and further tested in the current clinical practice, an essential phase for validating the model's accuracy beyond the original research context.
Collapse
Affiliation(s)
- C Cozzolino
- Soft-Tissue, Peritoneum and Melanoma Surgical Oncology Unit, Veneto Institute of Oncology IOV-IRCCS, Via Gattamelata, 64, 35128, Padua, PD, Italy.
| | - A Buja
- Department of Cardiac, Thoracic, Vascular Sciences, and Public Health, University of Padua, Padua, Italy
| | - M Rugge
- Veneto Tumor Registry (RTV), Azienda Zero, Padua, Italy
- Pathology and Cytopathology Unit, Department of Medicine - DIMED, University of Padua, Padua, Italy
| | - A Miatton
- Department of Cardiac, Thoracic, Vascular Sciences, and Public Health, University of Padua, Padua, Italy
| | - M Zorzi
- Veneto Tumor Registry (RTV), Azienda Zero, Padua, Italy
| | - A Vecchiato
- Soft-Tissue, Peritoneum and Melanoma Surgical Oncology Unit, Veneto Institute of Oncology IOV-IRCCS, Via Gattamelata, 64, 35128, Padua, PD, Italy
| | - P Del Fiore
- Soft-Tissue, Peritoneum and Melanoma Surgical Oncology Unit, Veneto Institute of Oncology IOV-IRCCS, Via Gattamelata, 64, 35128, Padua, PD, Italy
| | - S Tropea
- Soft-Tissue, Peritoneum and Melanoma Surgical Oncology Unit, Veneto Institute of Oncology IOV-IRCCS, Via Gattamelata, 64, 35128, Padua, PD, Italy
| | - A Brazzale
- Department of Statistical Sciences, University of Padua, Padua, Italy
| | - G Damiani
- Clinical Dermatology, IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - L dall'Olmo
- Soft-Tissue, Peritoneum and Melanoma Surgical Oncology Unit, Veneto Institute of Oncology IOV-IRCCS, Via Gattamelata, 64, 35128, Padua, PD, Italy
- Department of Surgery, Oncology and Gastroenterology - DISCOG, University of Padua, Padua, Italy
| | - C R Rossi
- Department of Surgery, Oncology and Gastroenterology - DISCOG, University of Padua, Padua, Italy
| | - S Mocellin
- Soft-Tissue, Peritoneum and Melanoma Surgical Oncology Unit, Veneto Institute of Oncology IOV-IRCCS, Via Gattamelata, 64, 35128, Padua, PD, Italy
- Department of Surgery, Oncology and Gastroenterology - DISCOG, University of Padua, Padua, Italy
| |
Collapse
|
3
|
Vera J, Lai X, Baur A, Erdmann M, Gupta S, Guttà C, Heinzerling L, Heppt MV, Kazmierczak PM, Kunz M, Lischer C, Pützer BM, Rehm M, Ostalecki C, Retzlaff J, Witt S, Wolkenhauer O, Berking C. Melanoma 2.0. Skin cancer as a paradigm for emerging diagnostic technologies, computational modelling and artificial intelligence. Brief Bioinform 2022; 23:6761961. [PMID: 36252807 DOI: 10.1093/bib/bbac433] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 07/28/2022] [Accepted: 09/08/2022] [Indexed: 12/19/2022] Open
Abstract
We live in an unprecedented time in oncology. We have accumulated samples and cases in cohorts larger and more complex than ever before. New technologies are available for quantifying solid or liquid samples at the molecular level. At the same time, we are now equipped with the computational power necessary to handle this enormous amount of quantitative data. Computational models are widely used helping us to substantiate and interpret data. Under the label of systems and precision medicine, we are putting all these developments together to improve and personalize the therapy of cancer. In this review, we use melanoma as a paradigm to present the successful application of these technologies but also to discuss possible future developments in patient care linked to them. Melanoma is a paradigmatic case for disruptive improvements in therapies, with a considerable number of metastatic melanoma patients benefiting from novel therapies. Nevertheless, a large proportion of patients does not respond to therapy or suffers from adverse events. Melanoma is an ideal case study to deploy advanced technologies not only due to the medical need but also to some intrinsic features of melanoma as a disease and the skin as an organ. From the perspective of data acquisition, the skin is the ideal organ due to its accessibility and suitability for many kinds of advanced imaging techniques. We put special emphasis on the necessity of computational strategies to integrate multiple sources of quantitative data describing the tumour at different scales and levels.
Collapse
Affiliation(s)
- Julio Vera
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | - Xin Lai
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | - Andreas Baur
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | - Michael Erdmann
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | - Shailendra Gupta
- Department of Systems Biology and Bioinformatics, Institute of Computer Science, University of Rostock, Rostock 18051, Germany
| | - Cristiano Guttà
- Institute of Cell Biology and Immunology, University of Stuttgart, 70569 Stuttgart, Germany
| | - Lucie Heinzerling
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany.,Department of Dermatology, LMU University Hospital, Munich, Germany
| | - Markus V Heppt
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | | | - Manfred Kunz
- Department of Dermatology, Venereology and Allergology, University of Leipzig, 04103 Leipzig, Germany
| | - Christopher Lischer
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | - Brigitte M Pützer
- Institute of Experimental Gene Therapy and Cancer Research, Rostock University Medical Center, 18057 Rostock, Germany
| | - Markus Rehm
- Institute of Cell Biology and Immunology, University of Stuttgart, 70569 Stuttgart, Germany.,Stuttgart Research Center Systems Biology, University of Stuttgart, 70569 Stuttgart, Germany
| | - Christian Ostalecki
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | - Jimmy Retzlaff
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| | | | - Olaf Wolkenhauer
- Department of Systems Biology and Bioinformatics, Institute of Computer Science, University of Rostock, Rostock 18051, Germany
| | - Carola Berking
- Department of Dermatology, FAU Erlangen-Nürnberg, Universitätsklinikum Erlangen, Comprehensive Cancer Center Erlangen and Deutsches Zentrum Immuntherapie (DZI), 91054 Erlangen, Germany
| |
Collapse
|
4
|
Distinguish the Value of the Benign Nevus and Melanomas Using Machine Learning: A Meta-Analysis and Systematic Review. Mediators Inflamm 2022; 2022:1734327. [PMID: 36274972 PMCID: PMC9586788 DOI: 10.1155/2022/1734327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 09/22/2022] [Accepted: 10/01/2022] [Indexed: 11/26/2022] Open
Abstract
Background Melanomas, the most common human malignancy, are primarily diagnosed visually, beginning with an initial clinical screening and followed potentially by dermoscopic analysis, a biopsy, and histopathological examination. We aimed to systematically review the performance and quality of machine learning-based methods in distinguishing melanoma and benign nevus in the relevant literature. Method Four databases (Web of Science, PubMed, Embase, and the Cochrane library) were searched to retrieve the relevant studies published until March 26, 2022. The Predictive model Deviation Risk Assessment tool (PROBAST) was used to assess the deviation risk of opposing law. Result This systematic review included thirty researches with 114007 subjects and 71 machine learning models. The convolutional neural network was the main machine learning method. The pooled sensitivity was 85% (95% CI 82–87%), the specificity was 86% (82–88%), and the C-index was 0.87 (0.84–0.90). Conclusion The findings of our study showed that ML algorithms had high sensitivity and specificity for distinguishing between melanoma and benign nevi. This suggests that state-of-the-art ML-based algorithms for distinguishing melanoma from benign nevi may be ready for clinical use. However, a large proportion of the earlier published studies had methodological flaws, such as lack of external validation and lack of clinician comparisons. The results of these studies should be interpreted with caution.
Collapse
|
5
|
Melanoma Classification from Dermoscopy Images Using Ensemble of Convolutional Neural Networks. MATHEMATICS 2021. [DOI: 10.3390/math10010026] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Human skin is the most exposed part of the human body that needs constant protection and care from heat, light, dust, and direct exposure to other harmful radiation, such as UV rays. Skin cancer is one of the dangerous diseases found in humans. Melanoma is a form of skin cancer that begins in the cells (melanocytes) that control the pigment in human skin. Early detection and diagnosis of skin cancer, such as melanoma, is necessary to reduce the death rate due to skin cancer. In this paper, the classification of acral lentiginous melanoma, a type of melanoma with benign nevi, is being carried out. The proposed stacked ensemble method for melanoma classification uses different pre-trained models, such as Xception, Inceptionv3, InceptionResNet-V2, DenseNet121, and DenseNet201, by employing the concept of transfer learning and fine-tuning. The selection of pre-trained CNN architectures for transfer learning is based on models having the highest top-1 and top-5 accuracies on ImageNet. A novel stacked ensemble-based framework is presented to improve the generalizability and increase robustness by fusing fine-tuned pre-trained CNN models for acral lentiginous melanoma classification. The performance of the proposed method is evaluated by experimenting on a Figshare benchmark dataset. The impact of applying different augmentation techniques has also been analyzed through extensive experimentations. The results confirm that the proposed method outperforms state-of-the-art techniques and achieves an accuracy of 97.93%.
Collapse
|