1
|
Semerci ZM, Toru HS, Çobankent Aytekin E, Tercanlı H, Chiorean DM, Albayrak Y, Cotoi OS. The Role of Artificial Intelligence in Early Diagnosis and Molecular Classification of Head and Neck Skin Cancers: A Multidisciplinary Approach. Diagnostics (Basel) 2024; 14:1477. [PMID: 39061614 PMCID: PMC11276319 DOI: 10.3390/diagnostics14141477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Revised: 07/01/2024] [Accepted: 07/09/2024] [Indexed: 07/28/2024] Open
Abstract
Cancer remains a significant global health concern, with increasing genetic and metabolic irregularities linked to its onset. Among various forms of cancer, skin cancer, including squamous cell carcinoma, basal cell carcinoma, and melanoma, is on the rise worldwide, often triggered by ultraviolet (UV) radiation. The propensity of skin cancer to metastasize highlights the importance of early detection for successful treatment. This narrative review explores the evolving role of artificial intelligence (AI) in diagnosing head and neck skin cancers from both radiological and pathological perspectives. In the past two decades, AI has made remarkable progress in skin cancer research, driven by advances in computational capabilities, digitalization of medical images, and radiomics data. AI has shown significant promise in image-based diagnosis across various medical domains. In dermatology, AI has played a pivotal role in refining diagnostic and treatment strategies, including genomic risk assessment. This technology offers substantial potential to aid primary clinicians in improving patient outcomes. Studies have demonstrated AI's effectiveness in identifying skin lesions, categorizing them, and assessing their malignancy, contributing to earlier interventions and better prognosis. The rising incidence and mortality rates of skin cancer, coupled with the high cost of treatment, emphasize the need for early diagnosis. Further research and integration of AI into clinical practice are warranted to maximize its benefits in skin cancer diagnosis and treatment.
Collapse
Affiliation(s)
- Zeliha Merve Semerci
- Department of Oral and Maxillofacial Radiology, Faculty of Dentistry, Akdeniz University, 07070 Antalya, Turkey; (Z.M.S.); (H.T.)
| | - Havva Serap Toru
- Department of Pathology, Faculty of Medicine, Akdeniz University, 07070 Antalya, Turkey
| | | | - Hümeyra Tercanlı
- Department of Oral and Maxillofacial Radiology, Faculty of Dentistry, Akdeniz University, 07070 Antalya, Turkey; (Z.M.S.); (H.T.)
| | - Diana Maria Chiorean
- Department of Pathology, County Clinical Hospital of Targu Mures, 540072 Targu Mures, Romania; (D.M.C.); (O.S.C.)
- Department of Pathophysiology, “George Emil Palade” University of Medicine, Pharmacy, Science, and Technology of Targu Mures, 38 Gheorghe Marinescu Street, 540142 Targu Mures, Romania
| | - Yalçın Albayrak
- Department of Electric and Electronic Engineering, Faculty of Engineering, Akdeniz University, 07010 Antalya, Turkey;
| | - Ovidiu Simion Cotoi
- Department of Pathology, County Clinical Hospital of Targu Mures, 540072 Targu Mures, Romania; (D.M.C.); (O.S.C.)
- Department of Pathophysiology, “George Emil Palade” University of Medicine, Pharmacy, Science, and Technology of Targu Mures, 38 Gheorghe Marinescu Street, 540142 Targu Mures, Romania
| |
Collapse
|
2
|
Zheng T, Chen W, Li S, Quan H, Zou M, Zheng S, Zhao Y, Gao X, Cui X. Learning how to detect: A deep reinforcement learning method for whole-slide melanoma histopathology images. Comput Med Imaging Graph 2023; 108:102275. [PMID: 37567046 DOI: 10.1016/j.compmedimag.2023.102275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2023] [Revised: 07/18/2023] [Accepted: 07/22/2023] [Indexed: 08/13/2023]
Abstract
Cutaneous melanoma represents one of the most life-threatening malignancies. Histopathological image analysis serves as a vital tool for early melanoma detection. Deep neural network (DNN) models are frequently employed to aid pathologists in enhancing the efficiency and accuracy of diagnoses. However, due to the paucity of well-annotated, high-resolution, whole-slide histopathology image (WSI) datasets, WSIs are typically fragmented into numerous patches during the model training and testing stages. This process disregards the inherent interconnectedness among patches, potentially impeding the models' performance. Additionally, the presence of excess, non-contributing patches extends processing times and introduces substantial computational burdens. To mitigate these issues, we draw inspiration from the clinical decision-making processes of dermatopathologists to propose an innovative, weakly supervised deep reinforcement learning framework, titled Fast medical decision-making in melanoma histopathology images (FastMDP-RL). This framework expedites model inference by reducing the number of irrelevant patches identified within WSIs. FastMDP-RL integrates two DNN-based agents: the search agent (SeAgent) and the decision agent (DeAgent). The SeAgent initiates actions, steered by the image features observed in the current viewing field at various magnifications. Simultaneously, the DeAgent provides labeling probabilities for each patch. We utilize multi-instance learning (MIL) to construct a teacher-guided model (MILTG), serving a dual purpose: rewarding the SeAgent and guiding the DeAgent. Our evaluations were conducted using two melanoma datasets: the publicly accessible TCIA-CM dataset and the proprietary MELSC dataset. Our experimental findings affirm FastMDP-RL's ability to expedite inference and accurately predict WSIs, even in the absence of pixel-level annotations. Moreover, our research investigates the WSI-based interactive environment, encompassing the design of agents, state and reward functions, and feature extractors suitable for melanoma tissue images. This investigation offers valuable insights and references for researchers engaged in related studies. The code is available at: https://github.com/titizheng/FastMDP-RL.
Collapse
Affiliation(s)
- Tingting Zheng
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Weixing Chen
- Shenzhen College of Advanced Technology, University of the Chinese Academy of Sciences, Beijing, China
| | - Shuqin Li
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Hao Quan
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Mingchen Zou
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Song Zheng
- National and Local Joint Engineering Research Center of Immunodermatological Theranostics, Department of Dermatology, The First Hospital of China Medical University, Shenyang, China
| | - Yue Zhao
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China; National and Local Joint Engineering Research Center of Immunodermatological Theranostics, Department of Dermatology, The First Hospital of China Medical University, Shenyang, China
| | - Xinghua Gao
- National and Local Joint Engineering Research Center of Immunodermatological Theranostics, Department of Dermatology, The First Hospital of China Medical University, Shenyang, China
| | - Xiaoyu Cui
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China.
| |
Collapse
|
3
|
Sikandar S, Mahum R, Ragab AE, Yayilgan SY, Shaikh S. SCDet: A Robust Approach for the Detection of Skin Lesions. Diagnostics (Basel) 2023; 13:diagnostics13111824. [PMID: 37296686 DOI: 10.3390/diagnostics13111824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 04/28/2023] [Accepted: 05/10/2023] [Indexed: 06/12/2023] Open
Abstract
Red, blue, white, pink, or black spots with irregular borders and small lesions on the skin are known as skin cancer that is categorized into two types: benign and malignant. Skin cancer can lead to death in advanced stages, however, early detection can increase the chances of survival of skin cancer patients. There exist several approaches developed by researchers to identify skin cancer at an early stage, however, they may fail to detect the tiniest tumours. Therefore, we propose a robust method for the diagnosis of skin cancer, namely SCDet, based on a convolutional neural network (CNN) having 32 layers for the detection of skin lesions. The images, having a size of 227 × 227, are fed to the image input layer, and then pair of convolution layers is utilized to withdraw the hidden patterns of the skin lesions for training. After that, batch normalization and ReLU layers are used. The performance of our proposed SCDet is computed using the evaluation matrices: precision 99.2%; recall 100%; sensitivity 100%; specificity 99.20%; and accuracy 99.6%. Moreover, the proposed technique is compared with the pre-trained models, i.e., VGG16, AlexNet, and SqueezeNet and it is observed that SCDet provides higher accuracy than these pre-trained models and identifies the tiniest skin tumours with maximum precision. Furthermore, our proposed model is faster than the pre-trained model as the depth of its architecture is not too high as compared to pre-trained models such as ResNet50. Additionally, our proposed model consumes fewer resources during training; therefore, it is better in terms of computational cost than the pre-trained models for the detection of skin lesions.
Collapse
Affiliation(s)
- Shahbaz Sikandar
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila 47050, Pakistan
| | - Rabbia Mahum
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila 47050, Pakistan
| | - Adham E Ragab
- Industrial Engineering Department, College of Engineering, King Saud University, Riyadh 11421, Saudi Arabia
| | - Sule Yildirim Yayilgan
- Department of Information Security and Communication Technology (IIK), Norwegian University of Science and Technology (NTNU), 2815 Gjøvik, Norway
| | - Sarang Shaikh
- Department of Information Security and Communication Technology (IIK), Norwegian University of Science and Technology (NTNU), 2815 Gjøvik, Norway
| |
Collapse
|
4
|
Skin Lesion Detection Using Hand-Crafted and DL-Based Features Fusion and LSTM. Diagnostics (Basel) 2022; 12:diagnostics12122974. [PMID: 36552983 PMCID: PMC9777409 DOI: 10.3390/diagnostics12122974] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 11/19/2022] [Accepted: 11/20/2022] [Indexed: 11/30/2022] Open
Abstract
The abnormal growth of cells in the skin causes two types of tumor: benign and malignant. Various methods, such as imaging and biopsies, are used by oncologists to assess the presence of skin cancer, but these are time-consuming and require extra human effort. However, some automated methods have been developed by researchers based on hand-crafted feature extraction from skin images. Nevertheless, these methods may fail to detect skin cancers at an early stage if they are tested on unseen data. Therefore, in this study, a novel and robust skin cancer detection model was proposed based on features fusion. First, our proposed model pre-processed the images using a GF filter to remove the noise. Second, the features were manually extracted by employing local binary patterns (LBP), and Inception V3 for automatic feature extraction. Aside from this, an Adam optimizer was utilized for the adjustments of learning rate. In the end, LSTM network was utilized on fused features for the classification of skin cancer into malignant and benign. Our proposed system employs the benefits of both ML- and DL-based algorithms. We utilized the skin lesion DermIS dataset, which is available on the Kaggle website and consists of 1000 images, out of which 500 belong to the benign class and 500 to the malignant class. The proposed methodology attained 99.4% accuracy, 98.7% precision, 98.66% recall, and a 98% F-score. We compared the performance of our features fusion-based method with existing segmentation-based and DL-based techniques. Additionally, we cross-validated the performance of our proposed model using 1000 images from International Skin Image Collection (ISIC), attaining 98.4% detection accuracy. The results show that our method provides significant results compared to existing techniques and outperforms them.
Collapse
|
5
|
Czajkowska J, Borak M. Computer-Aided Diagnosis Methods for High-Frequency Ultrasound Data Analysis: A Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:8326. [PMID: 36366024 PMCID: PMC9653964 DOI: 10.3390/s22218326] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/21/2022] [Accepted: 10/25/2022] [Indexed: 05/31/2023]
Abstract
Over the last few decades, computer-aided diagnosis systems have become a part of clinical practice. They have the potential to assist clinicians in daily diagnostic tasks. The image processing techniques are fast, repeatable, and robust, which helps physicians to detect, classify, segment, and measure various structures. The recent rapid development of computer methods for high-frequency ultrasound image analysis opens up new diagnostic paths in dermatology, allergology, cosmetology, and aesthetic medicine. This paper, being the first in this area, presents a research overview of high-frequency ultrasound image processing techniques, which have the potential to be a part of computer-aided diagnosis systems. The reviewed methods are categorized concerning the application, utilized ultrasound device, and image data-processing type. We present the bridge between diagnostic needs and already developed solutions and discuss their limitations and future directions in high-frequency ultrasound image analysis. A search was conducted of the technical literature from 2005 to September 2022, and in total, 31 studies describing image processing methods were reviewed. The quantitative and qualitative analysis included 39 algorithms, which were selected as the most effective in this field. They were completed by 20 medical papers and define the needs and opportunities for high-frequency ultrasound application and CAD development.
Collapse
Affiliation(s)
- Joanna Czajkowska
- Faculty of Biomedical Engineering, Silesian University of Technology, Roosevelta 40, 41-800 Zabrze, Poland
| | | |
Collapse
|
6
|
Advanced basal cell carcinoma: What dermatologists need to know about diagnosis. J Am Acad Dermatol 2022; 86:S1-S13. [PMID: 35577405 DOI: 10.1016/j.jaad.2022.03.023] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 03/07/2022] [Accepted: 03/09/2022] [Indexed: 12/07/2022]
Abstract
Basal cell carcinoma (BCC) is the most common human cancer, with approximately 3.6 million cases diagnosed each year. About 2000 deaths annually in the United States are attributed to basal and squamous cell skin cancers. There is a direct link between ultraviolet exposure and the development of BCC, as UV exposure damages DNA and induces mutations in tumor suppressor genes. Aberrations in the hedgehog pathway can also result in BCC, highlighted by the fact that most cases of sporadic BCCs have been found to have mutations in different genes involved in the hedgehog pathway. There are several genetic syndromes that are associated with BCCs, including basal cell nevus syndrome, xeroderma pigmentosum, Bazex-Dupré-Christol syndrome, Rombo syndrome, and Oley syndrome. Other risk factors include age, male gender, occupational hazards, radiation, and immunosuppression. BCCs are not typically staged but are instead stratified by their risk of recurring or metastasizing. Locally advanced BCCs are those tumors that are not amenable to surgery or radiation therapy.
Collapse
|
7
|
Kawaguchi M, Kato H, Noda Y, Kobayashi K, Miyazaki T, Hyodo F, Matsuo M. Imaging findings of malignant skin tumors: radiological-pathological correlation. Insights Imaging 2022; 13:52. [PMID: 35316414 PMCID: PMC8941041 DOI: 10.1186/s13244-022-01205-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 03/04/2022] [Indexed: 11/11/2022] Open
Abstract
Sometimes, radiologists encounter malignant skin tumors (MSTs) during image interpretation. As MSTs require different clinical management modalities for each histological subtype, accurate preoperative diagnosis is essential. The histological subtypes of MST can be easily assessed by visual inspection or biopsy. Therefore, the significant role of radiological imaging in MSTs is to evaluate the extent of local invasion, nodal involvement, and distant metastasis, and the histological estimation of MSTs by radiological imaging has not been reported until a few years ago. However, recent studies have revealed characteristic radiological features for differential diagnosis of MSTs, such as configuration, intratumoral homogeneity, signal intensity, cyst formation, and hemorrhage. Other important clinical data for determining the histological subtype of MST include age, gender, and site of occurrence. MSTs can be categorized as epidermal, melanocytic, adnexal, and mesenchymal tumors based on the origin and have distinctive characteristics. Hence, this review article was designed to describe the clinical and radiological features of MSTs.
Collapse
Affiliation(s)
- Masaya Kawaguchi
- Department of Radiology, Gifu University, 1-1 Yanagido, Gifu, 501-1194, Japan.
| | - Hiroki Kato
- Department of Radiology, Gifu University, 1-1 Yanagido, Gifu, 501-1194, Japan
| | - Yoshifumi Noda
- Department of Radiology, Gifu University, 1-1 Yanagido, Gifu, 501-1194, Japan
| | | | | | - Fuminori Hyodo
- Department of Radiology, Frontier Science for Imaging, Gifu University, Gifu, Japan
| | - Masayuki Matsuo
- Department of Radiology, Gifu University, 1-1 Yanagido, Gifu, 501-1194, Japan
| |
Collapse
|
8
|
InSiNet: a deep convolutional approach to skin cancer detection and segmentation. Med Biol Eng Comput 2022; 60:643-662. [PMID: 35028864 DOI: 10.1007/s11517-021-02473-0] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Accepted: 11/08/2021] [Indexed: 12/29/2022]
Abstract
Cancer is among the common causes of death around the world. Skin cancer is one of the most lethal types of cancer. Early diagnosis and treatment are vital in skin cancer. In addition to traditional methods, method such as deep learning is frequently used to diagnose and classify the disease. Expert experience plays a major role in diagnosing skin cancer. Therefore, for more reliable results in the diagnosis of skin lesions, deep learning algorithms can help in the correct diagnosis. In this study, we propose InSiNet, a deep learning-based convolutional neural network to detect benign and malignant lesions. The performance of the method is tested on International Skin Imaging Collaboration HAM10000 images (ISIC 2018), ISIC 2019, and ISIC 2020, under the same conditions. The computation time and accuracy comparison analysis was performed between the proposed algorithm and other machine learning techniques (GoogleNet, DenseNet-201, ResNet152V2, EfficientNetB0, RBF-support vector machine, logistic regression, and random forest). The results show that the developed InSiNet architecture outperforms the other methods achieving an accuracy of 94.59%, 91.89%, and 90.54% in ISIC 2018, 2019, and 2020 datasets, respectively. Since the deep learning algorithms eliminate the human factor during diagnosis, they can give reliable results in addition to traditional methods.
Collapse
|