1
|
Lyakhova UA, Lyakhov PA. Systematic review of approaches to detection and classification of skin cancer using artificial intelligence: Development and prospects. Comput Biol Med 2024; 178:108742. [PMID: 38875908 DOI: 10.1016/j.compbiomed.2024.108742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 06/03/2024] [Accepted: 06/08/2024] [Indexed: 06/16/2024]
Abstract
In recent years, there has been a significant improvement in the accuracy of the classification of pigmented skin lesions using artificial intelligence algorithms. Intelligent analysis and classification systems are significantly superior to visual diagnostic methods used by dermatologists and oncologists. However, the application of such systems in clinical practice is severely limited due to a lack of generalizability and risks of potential misclassification. Successful implementation of artificial intelligence-based tools into clinicopathological practice requires a comprehensive study of the effectiveness and performance of existing models, as well as further promising areas for potential research development. The purpose of this systematic review is to investigate and evaluate the accuracy of artificial intelligence technologies for detecting malignant forms of pigmented skin lesions. For the study, 10,589 scientific research and review articles were selected from electronic scientific publishers, of which 171 articles were included in the presented systematic review. All selected scientific articles are distributed according to the proposed neural network algorithms from machine learning to multimodal intelligent architectures and are described in the corresponding sections of the manuscript. This research aims to explore automated skin cancer recognition systems, from simple machine learning algorithms to multimodal ensemble systems based on advanced encoder-decoder models, visual transformers (ViT), and generative and spiking neural networks. In addition, as a result of the analysis, future directions of research, prospects, and potential for further development of automated neural network systems for classifying pigmented skin lesions are discussed.
Collapse
Affiliation(s)
- U A Lyakhova
- Department of Mathematical Modeling, North-Caucasus Federal University, 355017, Stavropol, Russia.
| | - P A Lyakhov
- Department of Mathematical Modeling, North-Caucasus Federal University, 355017, Stavropol, Russia; North-Caucasus Center for Mathematical Research, North-Caucasus Federal University, 355017, Stavropol, Russia.
| |
Collapse
|
2
|
Strzelecki M, Kociołek M, Strąkowska M, Kozłowski M, Grzybowski A, Szczypiński PM. Artificial intelligence in the detection of skin cancer: State of the art. Clin Dermatol 2024; 42:280-295. [PMID: 38181888 DOI: 10.1016/j.clindermatol.2023.12.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2024]
Abstract
The incidence of melanoma is increasing rapidly. This cancer has a good prognosis if detected early. For this reason, various systems of skin lesion image analysis, which support imaging diagnostics of this neoplasm, are developing very dynamically. To detect and recognize neoplastic lesions, such systems use various artificial intelligence (AI) algorithms. This area of computer science applications has recently undergone dynamic development, abounding in several solutions that are effective tools supporting diagnosticians in many medical specialties. In this contribution, a number of applications of different classes of AI algorithms for the detection of this skin melanoma are presented and evaluated. Both classic systems based on the analysis of dermatoscopic images as well as total body systems, enabling the analysis of the patient's whole body to detect moles and pathologic changes, are discussed. These increasingly popular applications that allow the analysis of lesion images using smartphones are also described. The quantitative evaluation of the discussed systems with particular emphasis on the method of validation of the implemented algorithms is presented. The advantages and limitations of AI in the analysis of lesion images are also discussed, and problems requiring a solution for more effective use of AI in dermatology are identified.
Collapse
Affiliation(s)
- Michał Strzelecki
- Institute of Electronics, Lodz University of Technology, Łódź, Poland.
| | - Marcin Kociołek
- Institute of Electronics, Lodz University of Technology, Łódź, Poland
| | - Maria Strąkowska
- Institute of Electronics, Lodz University of Technology, Łódź, Poland
| | - Michał Kozłowski
- Department of Mechatronics and Technical and IT Education, Faculty of Technical Science, University of Warmia and Mazury, Olsztyn, Poland
| | - Andrzej Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland
| | | |
Collapse
|
3
|
Sharafudeen M, S S VC. An Integrated Ensemble Network Model for Skin Abnormality Detection with Combined Textural Features. J Digit Imaging 2023; 36:1723-1738. [PMID: 37231287 PMCID: PMC10406737 DOI: 10.1007/s10278-023-00837-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Revised: 03/17/2023] [Accepted: 04/17/2023] [Indexed: 05/27/2023] Open
Abstract
Melanoma is the most lethal of all skin cancers. This necessitates the need for a machine learning-driven skin cancer detection system to help medical professionals with early detection. We propose an integrated multi-modal ensemble framework that combines deep convolution neural representations with extracted lesion characteristics and patient meta-data. This study intends to integrate transfer-learned image features, global and local textural information, and patient data using a custom generator to diagnose skin cancer accurately. The architecture combines multiple models in a weighted ensemble strategy, which was trained and validated on specific and distinct datasets, namely, HAM10000, BCN20000 + MSK, and the ISIC2020 challenge datasets. They were evaluated on the mean values of precision, recall or sensitivity, specificity, and balanced accuracy metrics. Sensitivity and specificity play a major role in diagnostics. The model achieved sensitivities of 94.15%, 86.69%, and 86.48% and specificity of 99.24%, 97.73%, and 98.51% for each dataset, respectively. Additionally, the accuracy on the malignant classes of the three datasets was 94%, 87.33%, and 89%, which is significantly higher than the physician recognition rate. The results demonstrate that our weighted voting integrated ensemble strategy outperforms existing models and could serve as an initial diagnostic tool for skin cancer.
Collapse
Affiliation(s)
- Misaj Sharafudeen
- Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Trivandrum, India
| | - Vinod Chandra S S
- Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Trivandrum, India
| |
Collapse
|
4
|
Hasan MK, Ahamad MA, Yap CH, Yang G. A survey, review, and future trends of skin lesion segmentation and classification. Comput Biol Med 2023; 155:106624. [PMID: 36774890 DOI: 10.1016/j.compbiomed.2023.106624] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 01/04/2023] [Accepted: 01/28/2023] [Indexed: 02/03/2023]
Abstract
The Computer-aided Diagnosis or Detection (CAD) approach for skin lesion analysis is an emerging field of research that has the potential to alleviate the burden and cost of skin cancer screening. Researchers have recently indicated increasing interest in developing such CAD systems, with the intention of providing a user-friendly tool to dermatologists to reduce the challenges encountered or associated with manual inspection. This article aims to provide a comprehensive literature survey and review of a total of 594 publications (356 for skin lesion segmentation and 238 for skin lesion classification) published between 2011 and 2022. These articles are analyzed and summarized in a number of different ways to contribute vital information regarding the methods for the development of CAD systems. These ways include: relevant and essential definitions and theories, input data (dataset utilization, preprocessing, augmentations, and fixing imbalance problems), method configuration (techniques, architectures, module frameworks, and losses), training tactics (hyperparameter settings), and evaluation criteria. We intend to investigate a variety of performance-enhancing approaches, including ensemble and post-processing. We also discuss these dimensions to reveal their current trends based on utilization frequencies. In addition, we highlight the primary difficulties associated with evaluating skin lesion segmentation and classification systems using minimal datasets, as well as the potential solutions to these difficulties. Findings, recommendations, and trends are disclosed to inform future research on developing an automated and robust CAD system for skin lesion analysis.
Collapse
Affiliation(s)
- Md Kamrul Hasan
- Department of Bioengineering, Imperial College London, UK; Department of Electrical and Electronic Engineering (EEE), Khulna University of Engineering & Technology (KUET), Khulna 9203, Bangladesh.
| | - Md Asif Ahamad
- Department of Electrical and Electronic Engineering (EEE), Khulna University of Engineering & Technology (KUET), Khulna 9203, Bangladesh.
| | - Choon Hwai Yap
- Department of Bioengineering, Imperial College London, UK.
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, UK; Cardiovascular Research Centre, Royal Brompton Hospital, UK.
| |
Collapse
|
5
|
Dobre EG, Surcel M, Constantin C, Ilie MA, Caruntu A, Caruntu C, Neagu M. Skin Cancer Pathobiology at a Glance: A Focus on Imaging Techniques and Their Potential for Improved Diagnosis and Surveillance in Clinical Cohorts. Int J Mol Sci 2023; 24:1079. [PMID: 36674595 PMCID: PMC9866322 DOI: 10.3390/ijms24021079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 01/02/2023] [Accepted: 01/03/2023] [Indexed: 01/08/2023] Open
Abstract
Early diagnosis is essential for completely eradicating skin cancer and maximizing patients' clinical benefits. Emerging optical imaging modalities such as reflectance confocal microscopy (RCM), optical coherence tomography (OCT), magnetic resonance imaging (MRI), near-infrared (NIR) bioimaging, positron emission tomography (PET), and their combinations provide non-invasive imaging data that may help in the early detection of cutaneous tumors and surgical planning. Hence, they seem appropriate for observing dynamic processes such as blood flow, immune cell activation, and tumor energy metabolism, which may be relevant for disease evolution. This review discusses the latest technological and methodological advances in imaging techniques that may be applied for skin cancer detection and monitoring. In the first instance, we will describe the principle and prospective clinical applications of the most commonly used imaging techniques, highlighting the challenges and opportunities of their implementation in the clinical setting. We will also highlight how imaging techniques may complement the molecular and histological approaches in sharpening the non-invasive skin characterization, laying the ground for more personalized approaches in skin cancer patients.
Collapse
Affiliation(s)
- Elena-Georgiana Dobre
- Faculty of Biology, University of Bucharest, Splaiul Independentei 91-95, 050095 Bucharest, Romania
| | - Mihaela Surcel
- Immunology Department, “Victor Babes” National Institute of Pathology, 050096 Bucharest, Romania
| | - Carolina Constantin
- Immunology Department, “Victor Babes” National Institute of Pathology, 050096 Bucharest, Romania
- Department of Pathology, Colentina University Hospital, 020125 Bucharest, Romania
| | | | - Ana Caruntu
- Department of Oral and Maxillofacial Surgery, “Carol Davila” Central Military Emergency Hospital, 010825 Bucharest, Romania
- Department of Oral and Maxillofacial Surgery, Faculty of Dental Medicine, “Titu Maiorescu” University, 031593 Bucharest, Romania
| | - Constantin Caruntu
- Department of Physiology, “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania
- Department of Dermatology, “Prof. N.C. Paulescu” National Institute of Diabetes, Nutrition and Metabolic Diseases, 011233 Bucharest, Romania
| | - Monica Neagu
- Faculty of Biology, University of Bucharest, Splaiul Independentei 91-95, 050095 Bucharest, Romania
- Immunology Department, “Victor Babes” National Institute of Pathology, 050096 Bucharest, Romania
- Department of Pathology, Colentina University Hospital, 020125 Bucharest, Romania
| |
Collapse
|