1
|
Vardasca R, Mendes JG, Magalhaes C. Skin Cancer Image Classification Using Artificial Intelligence Strategies: A Systematic Review. J Imaging 2024; 10:265. [PMID: 39590729 PMCID: PMC11595075 DOI: 10.3390/jimaging10110265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2024] [Revised: 09/26/2024] [Accepted: 10/17/2024] [Indexed: 11/28/2024] Open
Abstract
The increasing incidence of and resulting deaths associated with malignant skin tumors are a public health problem that can be minimized if detection strategies are improved. Currently, diagnosis is heavily based on physicians' judgment and experience, which can occasionally lead to the worsening of the lesion or needless biopsies. Several non-invasive imaging modalities, e.g., confocal scanning laser microscopy or multiphoton laser scanning microscopy, have been explored for skin cancer assessment, which have been aligned with different artificial intelligence (AI) strategies to assist in the diagnostic task, based on several image features, thus making the process more reliable and faster. This systematic review concerns the implementation of AI methods for skin tumor classification with different imaging modalities, following the PRISMA guidelines. In total, 206 records were retrieved and qualitatively analyzed. Diagnostic potential was found for several techniques, particularly for dermoscopy images, with strategies yielding classification results close to perfection. Learning approaches based on support vector machines and artificial neural networks seem to be preferred, with a recent focus on convolutional neural networks. Still, detailed descriptions of training/testing conditions are lacking in some reports, hampering reproduction. The use of AI methods in skin cancer diagnosis is an expanding field, with future work aiming to construct optimal learning approaches and strategies. Ultimately, early detection could be optimized, improving patient outcomes, even in areas where healthcare is scarce.
Collapse
Affiliation(s)
- Ricardo Vardasca
- ISLA Santarem, Rua Teixeira Guedes 31, 2000-029 Santarem, Portugal
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Universidade do Porto, 4099-002 Porto, Portugal; (J.G.M.); (C.M.)
| | - Joaquim Gabriel Mendes
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Universidade do Porto, 4099-002 Porto, Portugal; (J.G.M.); (C.M.)
- Faculdade de Engenharia, Universidade do Porto, 4099-002 Porto, Portugal
| | - Carolina Magalhaes
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Universidade do Porto, 4099-002 Porto, Portugal; (J.G.M.); (C.M.)
- Faculdade de Engenharia, Universidade do Porto, 4099-002 Porto, Portugal
| |
Collapse
|
2
|
Trager MH, Gordon ER, Breneman A, Weng C, Samie FH. Artificial intelligence for nonmelanoma skin cancer. Clin Dermatol 2024; 42:466-476. [PMID: 38925444 DOI: 10.1016/j.clindermatol.2024.06.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/28/2024]
Abstract
Nonmelanoma skin cancers (NMSCs) are among the top five most common cancers globally. NMSC is an area with great potential for novel application of diagnostic tools including artificial intelligence (AI). In this scoping review, we aimed to describe the applications of AI in the diagnosis and treatment of NMSC. Twenty-nine publications described AI applications to dermatopathology including lesion classification and margin assessment. Twenty-five publications discussed AI use in clinical image analysis, showing that algorithms are not superior to dermatologists and may rely on unbalanced, nonrepresentative, and nontransparent training data sets. Sixteen publications described the use of AI in cutaneous surgery for NMSC including use in margin assessment during excisions and Mohs surgery, as well as predicting procedural complexity. Eleven publications discussed spectroscopy, confocal microscopy, thermography, and the AI algorithms that analyze and interpret their data. Ten publications pertained to AI applications for the discovery and use of NMSC biomarkers. Eight publications discussed the use of smartphones and AI, specifically how they enable clinicians and patients to have increased access to instant dermatologic assessments but with varying accuracies. Five publications discussed large language models and NMSC, including how they may facilitate or hinder patient education and medical decision-making. Three publications pertaining to the skin of color and AI for NMSC discussed concerns regarding limited diverse data sets for the training of convolutional neural networks. AI demonstrates tremendous potential to improve diagnosis, patient and clinician education, and management of NMSC. Despite excitement regarding AI, data sets are often not transparently reported, may include low-quality images, and may not include diverse skin types, limiting generalizability. AI may serve as a tool to increase access to dermatology services for patients in rural areas and save health care dollars. These benefits can only be achieved, however, with consideration of potential ethical costs.
Collapse
Affiliation(s)
- Megan H Trager
- Department of Dermatology, Columbia University Irving Medical Center, New York, NY, USA
| | - Emily R Gordon
- Columbia University Vagelos College of Physicians and Surgeons, New York, NY, USA
| | - Alyssa Breneman
- Department of Dermatology, Columbia University Irving Medical Center, New York, NY, USA
| | - Chunhua Weng
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY, USA
| | - Faramarz H Samie
- Department of Dermatology, Columbia University Irving Medical Center, New York, NY, USA.
| |
Collapse
|
3
|
Mirza FN, Haq Z, Abdi P, Diaz MJ, Libby TJ. Artificial Intelligence for Mohs and Dermatologic Surgery: A Systematic Review and Meta-Analysis. Dermatol Surg 2024; 50:799-806. [PMID: 38991503 DOI: 10.1097/dss.0000000000004297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
Abstract
BACKGROUND Over the past decade, several studies have shown that potential of artificial intelligence (AI) in dermatology. However, there has yet to be a systematic review evaluating the usage of AI specifically within the field of Mohs micrographic surgery (MMS). OBJECTIVE In this review, we aimed to comprehensively evaluate the current state, efficacy, and future implications of AI when applied to MMS for the treatment of nonmelanoma skin cancers (NMSC). MATERIALS AND METHODS A systematic review and meta-analysis was conducted following PRISMA guidelines across several databases, including PubMed/MEDLINE, Embase, and Cochrane libraries. A predefined protocol was registered in PROSPERO, with literature search involving specific keywords related to AI and Mohs surgery for NMSC. RESULTS From 23 studies evaluated, our results find that AI shows promise as a prediction tool for precisely identifying NMSC in tissue sections during MMS. Furthermore, high AUC and concordance values were also found across the various usages of AI in MMS, including margin control, surgical recommendations, similarity metrics, and in the prediction of stage and construction complexity. CONCLUSION The findings of this review suggest promising potential for AI to enhance the accuracy and efficiency of Mohs surgery, particularly for NMSC.
Collapse
Affiliation(s)
- Fatima N Mirza
- Department of Dermatology, Warren Alpert Medical School, Brown University, Providence, Rhode Island
| | - Zaim Haq
- Warren Alpert Medical School, Brown University, Providence, Rhode Island
| | - Parsa Abdi
- Memorial University of Newfoundland, Faculty of Medicine, St. Johns, Newfoundland & Labrador, Canada ; and
| | - Michael J Diaz
- University of Florida, College of Medicine, Gainesville, Florida
| | - Tiffany J Libby
- Department of Dermatology, Warren Alpert Medical School, Brown University, Providence, Rhode Island
| |
Collapse
|
4
|
Foltz EA, Witkowski A, Becker AL, Latour E, Lim JY, Hamilton A, Ludzik J. Artificial Intelligence Applied to Non-Invasive Imaging Modalities in Identification of Nonmelanoma Skin Cancer: A Systematic Review. Cancers (Basel) 2024; 16:629. [PMID: 38339380 PMCID: PMC10854803 DOI: 10.3390/cancers16030629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 01/28/2024] [Accepted: 01/29/2024] [Indexed: 02/12/2024] Open
Abstract
BACKGROUND The objective of this study is to systematically analyze the current state of the literature regarding novel artificial intelligence (AI) machine learning models utilized in non-invasive imaging for the early detection of nonmelanoma skin cancers. Furthermore, we aimed to assess their potential clinical relevance by evaluating the accuracy, sensitivity, and specificity of each algorithm and assessing for the risk of bias. METHODS Two reviewers screened the MEDLINE, Cochrane, PubMed, and Embase databases for peer-reviewed studies that focused on AI-based skin cancer classification involving nonmelanoma skin cancers and were published between 2018 and 2023. The search terms included skin neoplasms, nonmelanoma, basal-cell carcinoma, squamous-cell carcinoma, diagnostic techniques and procedures, artificial intelligence, algorithms, computer systems, dermoscopy, reflectance confocal microscopy, and optical coherence tomography. Based on the search results, only studies that directly answered the review objectives were included and the efficacy measures for each were recorded. A QUADAS-2 risk assessment for bias in included studies was then conducted. RESULTS A total of 44 studies were included in our review; 40 utilizing dermoscopy, 3 using reflectance confocal microscopy (RCM), and 1 for hyperspectral epidermal imaging (HEI). The average accuracy of AI algorithms applied to all imaging modalities combined was 86.80%, with the same average for dermoscopy. Only one of the three studies applying AI to RCM measured accuracy, with a result of 87%. Accuracy was not measured in regard to AI based HEI interpretation. CONCLUSION AI algorithms exhibited an overall favorable performance in the diagnosis of nonmelanoma skin cancer via noninvasive imaging techniques. Ultimately, further research is needed to isolate pooled diagnostic accuracy for nonmelanoma skin cancers as many testing datasets also include melanoma and other pigmented lesions.
Collapse
Affiliation(s)
- Emilie A. Foltz
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97201, USA
- Elson S. Floyd College of Medicine, Washington State University, Spokane, WA 99202, USA
| | - Alexander Witkowski
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97201, USA
| | - Alyssa L. Becker
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97201, USA
- John A. Burns School of Medicine, University of Hawai’i at Manoa, Honolulu, HI 96813, USA
| | - Emile Latour
- Biostatistics Shared Resource, Knight Cancer Institute, Oregon Health & Science University, Portland, OR 97201, USA
| | - Jeong Youn Lim
- Biostatistics Shared Resource, Knight Cancer Institute, Oregon Health & Science University, Portland, OR 97201, USA
| | - Andrew Hamilton
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97201, USA
| | - Joanna Ludzik
- Department of Dermatology, Oregon Health & Science University, Portland, OR 97201, USA
| |
Collapse
|
5
|
Yuan T, Jiang W, Ye Y, Hai Y, Yi D. Confocal microscopy based on dual blur depth measurement. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2023; 40:2002-2007. [PMID: 38038065 DOI: 10.1364/josaa.499900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 10/05/2023] [Indexed: 12/02/2023]
Abstract
In this paper, we propose a confocal microscopy based on dual blur depth measurement (DBCM). The first blur is defocus blur, and the second blur is artificial convolutional blur. First, the DBCM blurs the defocus image using a known Gaussian kernel and calculates the edge gradient ratio between it and the re-blurred image. Then, the axial measurement of edge positions is based on a calibration measurement curve. Finally, depth information is inferred from the edges using the original image. Experiments show that the DBCM can achieve depth measurement in a single image. In a 10×/0.25 objective, the error measured for a step sample of 4.7397 µm is 0.23 µm. The relative error rate is 4.8%.
Collapse
|
6
|
Luo N, Zhong X, Su L, Cheng Z, Ma W, Hao P. Artificial intelligence-assisted dermatology diagnosis: From unimodal to multimodal. Comput Biol Med 2023; 165:107413. [PMID: 37703714 DOI: 10.1016/j.compbiomed.2023.107413] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 08/02/2023] [Accepted: 08/28/2023] [Indexed: 09/15/2023]
Abstract
Artificial Intelligence (AI) is progressively permeating medicine, notably in the realm of assisted diagnosis. However, the traditional unimodal AI models, reliant on large volumes of accurately labeled data and single data type usage, prove insufficient to assist dermatological diagnosis. Augmenting these models with text data from patient narratives, laboratory reports, and image data from skin lesions, dermoscopy, and pathologies could significantly enhance their diagnostic capacity. Large-scale pre-training multimodal models offer a promising solution, exploiting the burgeoning reservoir of clinical data and amalgamating various data types. This paper delves into unimodal models' methodologies, applications, and shortcomings while exploring how multimodal models can enhance accuracy and reliability. Furthermore, integrating cutting-edge technologies like federated learning and multi-party privacy computing with AI can substantially mitigate patient privacy concerns in dermatological datasets and further fosters a move towards high-precision self-diagnosis. Diagnostic systems underpinned by large-scale pre-training multimodal models can facilitate dermatology physicians in formulating effective diagnostic and treatment strategies and herald a transformative era in healthcare.
Collapse
Affiliation(s)
- Nan Luo
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Xiaojing Zhong
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Luxin Su
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Zilin Cheng
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Wenyi Ma
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| | - Pingsheng Hao
- Hospital of Chengdu University of Traditional Chinese Medicine, No. 39 Shi-er-qiao Road, Chengdu, 610075, Sichuan, China.
| |
Collapse
|
7
|
Oshima Y, Haruki T, Koizumi K, Yonezawa S, Taketani A, Kadowaki M, Saito S. Practices, Potential, and Perspectives for Detecting Predisease Using Raman Spectroscopy. Int J Mol Sci 2023; 24:12170. [PMID: 37569541 PMCID: PMC10418989 DOI: 10.3390/ijms241512170] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 07/23/2023] [Accepted: 07/27/2023] [Indexed: 08/13/2023] Open
Abstract
Raman spectroscopy shows great potential for practical clinical applications. By analyzing the structure and composition of molecules through real-time, non-destructive measurements of the scattered light from living cells and tissues, it offers valuable insights. The Raman spectral data directly link to the molecular composition of the cells and tissues and provides a "molecular fingerprint" for various disease states. This review focuses on the practical and clinical applications of Raman spectroscopy, especially in the early detection of human diseases. Identifying predisease, which marks the transition from a healthy to a disease state, is crucial for effective interventions to prevent disease onset. Raman spectroscopy can reveal biological processes occurring during the transition states and may eventually detect the molecular dynamics in predisease conditions.
Collapse
Affiliation(s)
- Yusuke Oshima
- Faculty of Engineering, University of Toyama, Toyama 930-8555, Japan
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
- Faculty of Medicine, Oita University, Yufu 879-5593, Japan
| | - Takayuki Haruki
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
- Faculty of Sustainable Design, University of Toyama, Toyama 930-8555, Japan
| | - Keiichi Koizumi
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
- Division of Presymptomatic Disease, Institute of Natural Medicine, University of Toyama, Toyama 930-8555, Japan
| | - Shota Yonezawa
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
| | - Akinori Taketani
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
| | - Makoto Kadowaki
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
| | - Shigeru Saito
- Research Center for Pre-Disease Science, University of Toyama, Toyama 930-8555, Japan
| |
Collapse
|