1
|
Somyanonthanakul R, Warin K, Chaowchuen S, Jinaporntham S, Panichkitkosolkul W, Suebnukarn S. Survival estimation of oral cancer using fuzzy deep learning. BMC Oral Health 2024; 24:519. [PMID: 38698358 PMCID: PMC11067185 DOI: 10.1186/s12903-024-04279-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 04/19/2024] [Indexed: 05/05/2024] Open
Abstract
BACKGROUND Oral cancer is a deadly disease and a major cause of morbidity and mortality worldwide. The purpose of this study was to develop a fuzzy deep learning (FDL)-based model to estimate the survival time based on clinicopathologic data of oral cancer. METHODS Electronic medical records of 581 oral squamous cell carcinoma (OSCC) patients, treated with surgery with or without radiochemotherapy, were collected retrospectively from the Oral and Maxillofacial Surgery Clinic and the Regional Cancer Center from 2011 to 2019. The deep learning (DL) model was trained to classify survival time classes based on clinicopathologic data. Fuzzy logic was integrated into the DL model and trained to create FDL-based models to estimate the survival time classes. RESULTS The performance of the models was evaluated on a test dataset. The performance of the DL and FDL models for estimation of survival time achieved an accuracy of 0.74 and 0.97 and an area under the receiver operating characteristic (AUC) curve of 0.84 to 1.00 and 1.00, respectively. CONCLUSIONS The integration of fuzzy logic into DL models could improve the accuracy to estimate survival time based on clinicopathologic data of oral cancer.
Collapse
Affiliation(s)
| | - Kritsasith Warin
- Faculty of Dentistry, Thammasat University, Pathum Thani, Thailand.
| | | | | | | | | |
Collapse
|
2
|
AlSadhan NA, Alamri SA, Ben Ismail MM, Bchir O. Skin Cancer Recognition Using Unified Deep Convolutional Neural Networks. Cancers (Basel) 2024; 16:1246. [PMID: 38610924 PMCID: PMC11010922 DOI: 10.3390/cancers16071246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 03/13/2024] [Accepted: 03/19/2024] [Indexed: 04/14/2024] Open
Abstract
The incidence of skin cancer is rising globally, posing a significant public health threat. An early and accurate diagnosis is crucial for patient prognoses. However, discriminating between malignant melanoma and benign lesions, such as nevi and keratoses, remains a challenging task due to their visual similarities. Image-based recognition systems offer a promising solution to aid dermatologists and potentially reduce unnecessary biopsies. This research investigated the performance of four unified convolutional neural networks, namely, YOLOv3, YOLOv4, YOLOv5, and YOLOv7, in classifying skin lesions. Each model was trained on a benchmark dataset, and the obtained performances were compared based on lesion localization, classification accuracy, and inference time. In particular, YOLOv7 achieved superior performance with an Intersection over Union (IoU) of 86.3%, a mean Average Precision (mAP) of 75.4%, an F1-measure of 80%, and an inference time of 0.32 s per image. These findings demonstrated the potential of YOLOv7 as a valuable tool for aiding dermatologists in early skin cancer diagnosis and potentially reducing unnecessary biopsies.
Collapse
Affiliation(s)
- Nasser A. AlSadhan
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 12372, Saudi Arabia; (M.M.B.I.); (O.B.)
| | - Shatha Ali Alamri
- Faculty of Computers and Information Technology, University of Tabuk, Tabuk 47512, Saudi Arabia
| | - Mohamed Maher Ben Ismail
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 12372, Saudi Arabia; (M.M.B.I.); (O.B.)
| | - Ouiem Bchir
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 12372, Saudi Arabia; (M.M.B.I.); (O.B.)
| |
Collapse
|
3
|
Desale RP, Patil PS. An efficient multi-class classification of skin cancer using optimized vision transformer. Med Biol Eng Comput 2024; 62:773-789. [PMID: 37996627 DOI: 10.1007/s11517-023-02969-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Accepted: 11/07/2023] [Indexed: 11/25/2023]
Abstract
Skin cancer is a pervasive and deadly disease, prompting a surge in research efforts towards utilizing computer-based techniques to analyze skin lesion images to identify malignancies. This paper introduces an optimized vision transformer approach for effectively classifying skin tumors. The methodology begins with a pre-processing step aimed at preserving color constancy, eliminating hair artifacts, and reducing image noise. Here, a combination of techniques such as piecewise linear bottom hat filtering, adaptive median filtering, Gaussian filtering, and an enhanced gradient intensity method is used for pre-processing. Afterwards, the segmentation phase is initiated using the self-sparse watershed algorithm on the pre-processed image. Subsequently, the segmented image is passed through a feature extraction stage where the hybrid Walsh-Hadamard Karhunen-Loeve expansion technique is employed. The final step involves the application of an improved vision transformer for skin cancer classification. The entire methodology is implemented using the Python programming language, and the International Skin Imaging Collaboration (ISIC) 2019 database is utilized for experimentation. The experimental results demonstrate remarkable performance with the different performance metrics is accuracy 99.81%, precision 96.65%, sensitivity 98.21%, F-measure 97.42%, specificity 99.88%, recall 98.21%, Jaccard coefficient 98.54%, and Mathew's correlation coefficient (MCC) 98.89%. The proposed methodology outperforms the existing methodology.
Collapse
Affiliation(s)
- R P Desale
- E&TC Engineering Department, SSVPS's Bapusaheb Shivajirao Deore College of Engineering, Dhule, Maharashtra, 424005, India.
| | - P S Patil
- E&TC Engineering Department, SSVPS's Bapusaheb Shivajirao Deore College of Engineering, Dhule, Maharashtra, 424005, India
| |
Collapse
|
4
|
Almufareh MF, Tariq N, Humayun M, Khan FA. Melanoma identification and classification model based on fine-tuned convolutional neural network. Digit Health 2024; 10:20552076241253757. [PMID: 38798885 PMCID: PMC11119457 DOI: 10.1177/20552076241253757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 04/11/2024] [Indexed: 05/29/2024] Open
Abstract
Background Breakthroughs in skin cancer diagnostics have resulted from recent image recognition and Artificial Intelligence (AI) technology advancements. There has been growing recognition that skin cancer can be lethal to humans. For instance, melanoma is the most unpredictable and terrible form of skin cancer. Materials and Methodology This paper aims to support Internet of Medical Things (IoMT) applications by developing a robust image classification model for the early detection of melanoma, a deadly skin cancer. It presents a novel approach to melanoma detection using a Convolutional Neural Network (CNN)-based method that employs image classification techniques based on Deep Learning (DL). We analyze dermatoscopic images from publicly available datasets, including DermIS, DermQuest, DermIS&Quest, and ISIC2019. Our model applies convolutional and pooling layers to extract meaningful features, followed by fully connected layers for classification. Results The proposed CNN model achieves high accuracy demonstrates the model's effectiveness in distinguishing between malignant and benign skin lesions. We developed deep features and used transfer learning to improve the categorization accuracy of medical images. Soft-max classification layer and support vector machine have been used to assess the classification performance of deep features. The proposed model's efficacy is rigorously evaluated using benchmark datasets: DermIS, DermQuest, and ISIC2019, having 621, 1233, and 25000 images, respectively. Its performance is compared to current best practices showing an average of 5% improved detection accuracy in DermIS, 6% improvement in DermQuest, and 0.81% in ISIC2019 datasets. Conclusion Our study showcases the potential of CNN in melanoma detection, contributing to early diagnosis and improved patient outcomes. The developed model proves its capability to aid dermatologists in accurate decision-making, paving the way for enhanced skin cancer diagnosis.
Collapse
Affiliation(s)
- Maram F Almufareh
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakakah Al Jouf, Saudi Arabia
| | - Noshina Tariq
- Department of Avionics Engineering, Air University, Islamabad Pakistan
| | - Mamoona Humayun
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakakah Al Jouf, Saudi Arabia
| | - Farrukh Aslam Khan
- Center of Excellence in Information Assurance, King Saud University, Riyadh Saudi Arabia
| |
Collapse
|
5
|
Mohammadloo A, Asgari Y, Esmaeili-Bandboni A, Mazloomi MA, Ghasemi SF, Ameri S, Miri SR, Hamzelou S, Mahmoudi HR, Veisi-Malekshahi Z. The Potential of Circulating miR-193b, miR-146b-3p and miR-483-3p as Noninvasive Biomarkers in Cutaneous Melanoma Patients. Mol Biotechnol 2023:10.1007/s12033-023-00893-x. [PMID: 37934389 DOI: 10.1007/s12033-023-00893-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 09/04/2023] [Indexed: 11/08/2023]
Abstract
Melanoma is a destructive skin disease with few therapeutic options in the developed stage and therefore there is a critical need for reliable biomarkers for early diagnosis. In this context, microRNAs could play an important role as diagnostic biomarkers. Three datasets with accession numbers GSE31568, GSE61741 and GSE20994 were downloaded from the Gene Expression Omnibus (GEO) database. MATLAB software was used to analyze differentially expressed miRNAs between cutaneous melanoma plasma samples and normal plasma samples (control). Plasma levels of miR-193b, miR-146b-3p and miR-483-3p were evaluated by the RT-PCR method. Furthermore, linear regression followed by receiver operating characteristic analyses was performed to estimate whether selected plasma miRNAs were able to distinguish between cases and controls. Finally, the data were analyzed by unpaired Mann-Whitney U test using Graph pad prism 8 computer software. Specifically, miR-193b and miR-146b-3p were downregulated in the plasma of melanoma patients compared with control groups which were decreased 5 × [Formula: see text]-fold in miR-193b and 58-fold in miR-146b-3p, while miR-483-3p was upregulated 3.5-fold. After receiver operating characteristic (ROC) curve analysis, miR-193b with the most area under the curve (AUC: 1.00, 95% confidence interval 1.00-1.00, p < 0.0001) had the best discriminatory power, and miR-146b-3p had the large area under the curve (AUC: 0.96, 95% confidence interval 0.96-1.00, p < 0.0001) and consequently the high discriminatory power. Between these three miRNAs, miR-193b and miR-146b-3p had a high capacity to distinguish between melanoma patients and control groups that are appropriate to be applied in melanoma diagnosis as an early and noninvasive method.
Collapse
Affiliation(s)
- Atefeh Mohammadloo
- Department of Medical Biotechnology, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Yazdan Asgari
- Department of Medical Biotechnology, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Aghil Esmaeili-Bandboni
- Department of Medical Biotechnology, School of Paramedical Sciences, Guilan University of Medical Sciences, Rasht, Iran
- Medical Biotechnology Research Center, School of Paramedical Sciences, Guilan University of Medical Sciences, Rasht, Iran
| | - Mohammad Ali Mazloomi
- Department of Medical Biotechnology, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyedeh Fatemeh Ghasemi
- Department of Medical Biotechnology, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Sima Ameri
- Department of Medical Biotechnology, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Rouhollah Miri
- Cancer Research Center, Cancer Institute of Iran, Tehran University of Medical Science, Tehran, Iran
| | - Shahin Hamzelou
- Department of Dermatology, Razi Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Hamid Reza Mahmoudi
- Autoimmune Bullous Diseases Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Ziba Veisi-Malekshahi
- Department of Medical Biotechnology, School of Advanced Technologies in Medicine, Tehran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
6
|
Shaheen H, Singh MP. Skin lesion classification using HG-PSO and YOLOv7 based convolutional network in real time. Proc Inst Mech Eng H 2023; 237:1228-1239. [PMID: 37840254 DOI: 10.1177/09544119231198823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2023]
Abstract
Skin cancer is a chronic illness seen visually and further diagnosed with a dermoscopic examination. It is crucial to precisely localize and classify lesions from dermoscopic images to diagnose and treat skin cancers as soon as possible. This work presents melanoma identification, and the classification method significantly improves accuracy and precision. This work proposes a method Hybrid of Genetic and Particle swarm optimization (HG-PSO), and You only look once version 7 (YOLOv7) based convolutional network for skin cancer classification. The infected region is first located using optimized YOLOv7 object detection. Then color thresholding is applied to segment it, which is passed to the proposed convolutional network for classification. This work is tested on the Human Against Machine with 10,000 training images (HAM10000), International Skin Imaging Collaboration (ISIC)-2019, and Hospital Pedro Hispano (PH2) datasets, and the findings are compared to the state-of-the-art methods for classifying skin cancer. The proposed method achieves 98.86% accuracy, 99.00% average precision, 98.85% average recall, and 98.85% average F1-score on the HAM10000 dataset. It achieves 97.10% accuracy on ISIC-2019 datasets. The average precision obtained is 97.37%, the average recall is 97.13%, and the average F1-score is 97.13% on the ISIC-2019 dataset. It achieves a 97.7% accuracy on the PH2 dataset. The average precision obtained is 99.00%, the average recall is 96.00%, and the average F1-score is 97.00% on the PH2 dataset. The test time taken by this method on datasets HAM10000, ISIC-2019, and PH2 dataset is 2, 3, and 2 s, respectively, which may help give faster responses in telemedicine.
Collapse
Affiliation(s)
- Hera Shaheen
- Department of Computer Science and Engineering, National Institute of Technology Patna, Patna, Bihar, India
| | - Maheshwari Prasad Singh
- Department of Computer Science and Engineering, National Institute of Technology Patna, Patna, Bihar, India
| |
Collapse
|
7
|
Liu Q, Kawashima H, Rezaei sofla A. An optimal method for melanoma detection from dermoscopy images using reinforcement learning and support vector machine optimized by enhanced fish migration optimization algorithm. Heliyon 2023; 9:e21118. [PMID: 37886781 PMCID: PMC10597866 DOI: 10.1016/j.heliyon.2023.e21118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 09/28/2023] [Accepted: 10/16/2023] [Indexed: 10/28/2023] Open
Abstract
Early detection of melanoma is crucial in preventing death from this fatal skin cancer. Therefore, it would be valuable to develop a method that facilitates this process. The diagnosis of melanoma typically involves an invasive form of testing called a biopsy, as well as non-invasive intelligent approaches to diagnosis. In the present study a recent research, a novel approach has been developed for the optimal detection of melanoma cancer. The method uses reinforcement learning for segmenting the skin regions, followed by the extraction and selection of useful features using the Enhanced Fish Migration Optimizer (EFMO) algorithm. The outcomes get categorized on the basis of an optimized SVM on the basis of the EFMO algorithm. The recommended approach has been certified by applying it to the SIIM-ISIC dataset of Melanoma and comparing it with 12 other approaches. Simulations illustrated that the proposed method delivered the finest values compared to the others.
Collapse
Affiliation(s)
- Qianqian Liu
- Laboratory of Microbiology and Immunology, Graduate School of Pharmaceutical Sciences, Chiba University, Chiba 260-8675, Japan
| | - Hiroto Kawashima
- Laboratory of Microbiology and Immunology, Graduate School of Pharmaceutical Sciences, Chiba University, Chiba 260-8675, Japan
| | - Asad Rezaei sofla
- University of Tehran, Tehran, Iran
- College of Technical Engineering, The Islamic University, Najaf, Iraq
| |
Collapse
|
8
|
Cantisani C, Baja AV, Gargano L, Rossi G, Ardigò M, Soda G, Boostani M, Kiss N, Pellacani G. Optical Coherence Tomography as a Valuable Tool for the Evaluation of Cutaneous Kaposi Sarcoma Treated with Imiquimod 5% Cream. Diagnostics (Basel) 2023; 13:2901. [PMID: 37761269 PMCID: PMC10529460 DOI: 10.3390/diagnostics13182901] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 09/06/2023] [Accepted: 09/09/2023] [Indexed: 09/29/2023] Open
Abstract
Kaposi sarcoma (KS) is a rare disease that was not frequently identified before the widespread occurrence of AIDS. Even today, it remains a challenge for physicians to diagnose, particularly in its early stages, often requiring referral to specialists and further investigations. Dermoscopy, a non-invasive imaging technique, reveals a distinctive rainbow pattern that strongly indicates KS. Moreover, advanced imaging tools like optical coherence tomography (OCT) can provide additional information though specific disease-related patterns have not been fully established yet. These emerging techniques show promise in facilitating early diagnosis of skin-related KS and monitoring the effectiveness of treatments. However, biopsy remains the definitive method for confirming the disease. In this study, we present two cases of cutaneous Kaposi sarcoma, documented using OCT, both before and after treatment with imiquimod 5% cream. The study highlights the potential of OCT in evaluating disease progression and treatment response, as well as the usefulness of dermoscopy in detecting early indicators of KS. By integrating these advanced imaging techniques, the diagnosis and management of cutaneous KS could be improved, leading to timely interventions and better patient outcomes.
Collapse
Affiliation(s)
- Carmen Cantisani
- Dermatology Unit, Department of Clinical Internal Anesthesiological and Cardiovascular Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (A.-V.B.); (L.G.); (G.R.); (G.S.); (G.P.)
| | - Alexandru-Vasile Baja
- Dermatology Unit, Department of Clinical Internal Anesthesiological and Cardiovascular Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (A.-V.B.); (L.G.); (G.R.); (G.S.); (G.P.)
| | - Luca Gargano
- Dermatology Unit, Department of Clinical Internal Anesthesiological and Cardiovascular Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (A.-V.B.); (L.G.); (G.R.); (G.S.); (G.P.)
| | - Giovanni Rossi
- Dermatology Unit, Department of Clinical Internal Anesthesiological and Cardiovascular Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (A.-V.B.); (L.G.); (G.R.); (G.S.); (G.P.)
| | - Marco Ardigò
- Porphyria and Rare Diseases Unit, San Gallicano Dermatological Institute—IRCCS, 00144 Rome, Italy;
| | - Giuseppe Soda
- Dermatology Unit, Department of Clinical Internal Anesthesiological and Cardiovascular Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (A.-V.B.); (L.G.); (G.R.); (G.S.); (G.P.)
| | - Mehdi Boostani
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (M.B.); (N.K.)
| | - Norbert Kiss
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (M.B.); (N.K.)
| | - Giovanni Pellacani
- Dermatology Unit, Department of Clinical Internal Anesthesiological and Cardiovascular Sciences, “Sapienza” University of Rome, 00161 Rome, Italy; (A.-V.B.); (L.G.); (G.R.); (G.S.); (G.P.)
| |
Collapse
|
9
|
Radhika V, Chandana BS. MSCDNet-based multi-class classification of skin cancer using dermoscopy images. PeerJ Comput Sci 2023; 9:e1520. [PMID: 37705664 PMCID: PMC10495937 DOI: 10.7717/peerj-cs.1520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 07/18/2023] [Indexed: 09/15/2023]
Abstract
Background Skin cancer is a life-threatening disease, and early detection of skin cancer improves the chances of recovery. Skin cancer detection based on deep learning algorithms has recently grown popular. In this research, a new deep learning-based network model for the multiple skin cancer classification including melanoma, benign keratosis, melanocytic nevi, and basal cell carcinoma is presented. We propose an automatic Multi-class Skin Cancer Detection Network (MSCD-Net) model in this research. Methods The study proposes an efficient semantic segmentation deep learning model "DenseUNet" for skin lesion segmentation. The semantic skin lesions are segmented by using the DenseUNet model with a substantially deeper network and fewer trainable parameters. Some of the most relevant features are selected using Binary Dragonfly Algorithm (BDA). SqueezeNet-based classification can be made in the selected features. Results The performance of the proposed model is evaluated using the ISIC 2019 dataset. The DenseNet connections and UNet links are used by the proposed DenseUNet segmentation model, which produces low-level features and provides better segmentation results. The performance results of the proposed MSCD-Net model are superior to previous research in terms of effectiveness and efficiency on the standard ISIC 2019 dataset.
Collapse
Affiliation(s)
| | - B. Sai Chandana
- School of Computer Science Engineering, VIT-AP University, Amaravathi, India
| |
Collapse
|
10
|
Liutkus J, Kriukas A, Stragyte D, Mazeika E, Raudonis V, Galetzka W, Stang A, Valiukeviciene S. Accuracy of a Smartphone-Based Artificial Intelligence Application for Classification of Melanomas, Melanocytic Nevi, and Seborrheic Keratoses. Diagnostics (Basel) 2023; 13:2139. [PMID: 37443533 DOI: 10.3390/diagnostics13132139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 06/16/2023] [Accepted: 06/20/2023] [Indexed: 07/15/2023] Open
Abstract
Current artificial intelligence algorithms can classify melanomas at a level equivalent to that of experienced dermatologists. The objective of this study was to assess the accuracy of a smartphone-based "You Only Look Once" neural network model for the classification of melanomas, melanocytic nevi, and seborrheic keratoses. The algorithm was trained using 59,090 dermatoscopic images. Testing was performed on histologically confirmed lesions: 32 melanomas, 35 melanocytic nevi, and 33 seborrheic keratoses. The results of the algorithm's decisions were compared with those of two skilled dermatologists and five beginners in dermatoscopy. The algorithm's sensitivity and specificity for melanomas were 0.88 (0.71-0.96) and 0.87 (0.76-0.94), respectively. The algorithm surpassed the beginner dermatologists, who achieved a sensitivity of 0.83 (0.77-0.87). For melanocytic nevi, the algorithm outclassed each group of dermatologists, attaining a sensitivity of 0.77 (0.60-0.90). The algorithm's sensitivity for seborrheic keratoses was 0.52 (0.34-0.69). The smartphone-based "You Only Look Once" neural network model achieved a high sensitivity and specificity in the classification of melanomas and melanocytic nevi with an accuracy similar to that of skilled dermatologists. However, a bigger dataset is required in order to increase the algorithm's sensitivity for seborrheic keratoses.
Collapse
Affiliation(s)
- Jokubas Liutkus
- Department of Skin and Venereal Diseases, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania
- Department of Skin and Venereal Diseases, Hospital of Lithuanian University of Health Sciences Kauno Klinikos, 50161 Kaunas, Lithuania
| | - Arturas Kriukas
- Department of Skin and Venereal Diseases, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania
- Department of Skin and Venereal Diseases, Hospital of Lithuanian University of Health Sciences Kauno Klinikos, 50161 Kaunas, Lithuania
| | - Dominyka Stragyte
- Department of Skin and Venereal Diseases, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania
- Department of Skin and Venereal Diseases, Hospital of Lithuanian University of Health Sciences Kauno Klinikos, 50161 Kaunas, Lithuania
| | - Erikas Mazeika
- Department of Skin and Venereal Diseases, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania
- Department of Skin and Venereal Diseases, Hospital of Lithuanian University of Health Sciences Kauno Klinikos, 50161 Kaunas, Lithuania
| | - Vidas Raudonis
- Artificial Intelligence Center, Kaunas University of Technology, 51423 Kaunas, Lithuania
| | - Wolfgang Galetzka
- Institute of Medical Informatics, Biometrics and Epidemiology, University Hospital Essen, 45130 Essen, Germany
| | - Andreas Stang
- Institute of Medical Informatics, Biometrics and Epidemiology, University Hospital Essen, 45130 Essen, Germany
| | - Skaidra Valiukeviciene
- Department of Skin and Venereal Diseases, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania
- Department of Skin and Venereal Diseases, Hospital of Lithuanian University of Health Sciences Kauno Klinikos, 50161 Kaunas, Lithuania
| |
Collapse
|
11
|
Obayya M, Alhebri A, Maashi M, S. Salama A, Mustafa Hilal A, Alsaid MI, Osman AE, Alneil AA. Henry Gas Solubility Optimization Algorithm based Feature Extraction in Dermoscopic Images Analysis of Skin Cancer. Cancers (Basel) 2023; 15:cancers15072146. [PMID: 37046806 PMCID: PMC10093373 DOI: 10.3390/cancers15072146] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/27/2023] [Accepted: 03/30/2023] [Indexed: 04/08/2023] Open
Abstract
Artificial Intelligence (AI) techniques have changed the general perceptions about medical diagnostics, especially after the introduction and development of Convolutional Neural Networks (CNN) and advanced Deep Learning (DL) and Machine Learning (ML) approaches. In general, dermatologists visually inspect the images and assess the morphological variables such as borders, colors, and shapes to diagnose the disease. In this background, AI techniques make use of algorithms and computer systems to mimic the cognitive functions of the human brain and assist clinicians and researchers. In recent years, AI has been applied extensively in the domain of dermatology, especially for the detection and classification of skin cancer and other general skin diseases. In this research article, the authors propose an Optimal Multi-Attention Fusion Convolutional Neural Network-based Skin Cancer Diagnosis (MAFCNN-SCD) technique for the detection of skin cancer in dermoscopic images. The primary aim of the proposed MAFCNN-SCD technique is to classify skin cancer on dermoscopic images. In the presented MAFCNN-SCD technique, the data pre-processing is performed at the initial stage. Next, the MAFNet method is applied as a feature extractor with Henry Gas Solubility Optimization (HGSO) algorithm as a hyperparameter optimizer. Finally, the Deep Belief Network (DBN) method is exploited for the detection and classification of skin cancer. A sequence of simulations was conducted to establish the superior performance of the proposed MAFCNN-SCD approach. The comprehensive comparative analysis outcomes confirmed the supreme performance of the proposed MAFCNN-SCD technique over other methodologies.
Collapse
Affiliation(s)
- Marwa Obayya
- Department of Biomedical Engineering, College of Engineering, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia
| | - Adeeb Alhebri
- Department of Accounting, Applied College, King Khalid University, Mohail Asser 63311, Saudi Arabia
| | - Mashael Maashi
- Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia
| | - Ahmed S. Salama
- Department of Electrical Engineering, Faculty of Engineering & Technology, Future University in Egypt, New Cairo 11845, Egypt
| | - Anwer Mustafa Hilal
- Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam bin Abdulaziz University, Al Kharj 11942, Saudi Arabia
| | - Mohamed Ibrahim Alsaid
- Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam bin Abdulaziz University, Al Kharj 11942, Saudi Arabia
| | - Azza Elneil Osman
- Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam bin Abdulaziz University, Al Kharj 11942, Saudi Arabia
| | - Amani A. Alneil
- Department of Computer and Self Development, Preparatory Year Deanship, Prince Sattam bin Abdulaziz University, Al Kharj 11942, Saudi Arabia
| |
Collapse
|
12
|
Dweekat OY, Lam SS, McGrath L. Machine Learning Techniques, Applications, and Potential Future Opportunities in Pressure Injuries (Bedsores) Management: A Systematic Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:796. [PMID: 36613118 PMCID: PMC9819814 DOI: 10.3390/ijerph20010796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 12/21/2022] [Accepted: 12/27/2022] [Indexed: 06/17/2023]
Abstract
Pressure Injuries (PI) are one of the most common health conditions in the United States. Most acute or long-term care patients are at risk of developing PI. Machine Learning (ML) has been utilized to manage patients with PI, in which one systematic review describes how ML is used in PI management in 32 studies. This research, different from the previous systematic review, summarizes the previous contributions of ML in PI from January 2007 to July 2022, categorizes the studies according to medical specialties, analyzes gaps, and identifies opportunities for future research directions. PRISMA guidelines were adopted using the four most common databases (PubMed, Web of Science, Scopus, and Science Direct) and other resources, which result in 90 eligible studies. The reviewed articles are divided into three categories based on PI time of occurrence: before occurrence (48%); at time of occurrence (16%); and after occurrence (36%). Each category is further broken down into sub-fields based on medical specialties, which result in sixteen specialties. Each specialty is analyzed in terms of methods, inputs, and outputs. The most relevant and potentially useful applications and methods in PI management are outlined and discussed. This includes deep learning techniques and hybrid models, integration of existing risk assessment tools with ML that leads to a partnership between provider assessment and patients' Electronic Health Records (EHR).
Collapse
Affiliation(s)
- Odai Y. Dweekat
- Department of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY 13902, USA
| | - Sarah S. Lam
- Department of Systems Science and Industrial Engineering, Binghamton University, Binghamton, NY 13902, USA
| | - Lindsay McGrath
- Wound Ostomy Continence Nursing, ChristianaCare Health System, Newark, DE 19718, USA
| |
Collapse
|
13
|
Deep Neuro-Fuzzy System application trends, challenges, and future perspectives: a systematic survey. Artif Intell Rev 2023; 56:865-913. [PMID: 35431395 PMCID: PMC9005344 DOI: 10.1007/s10462-022-10188-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/05/2022] [Indexed: 02/02/2023]
Abstract
Deep neural networks (DNN) have remarkably progressed in applications involving large and complex datasets but have been criticized as a black-box. This downside has recently become a motivation for the research community to pursue the ideas of hybrid approaches, resulting in novel hybrid systems classified as deep neuro-fuzzy systems (DNFS). Studies regarding the implementation of DNFS have rapidly increased in the domains of computing, healthcare, transportation, and finance with high interpretability and reasonable accuracy. However, relatively few survey studies have been found in the literature to provide a comprehensive insight into this domain. Therefore, this study aims to perform a systematic review to evaluate the current progress, trends, arising issues, research gaps, challenges, and future scope related to DNFS studies. A study mapping process was prepared to guide a systematic search for publications related to DNFS published between 2015 and 2020 using five established scientific directories. As a result, a total of 105 studies were identified and critically analyzed to address research questions with the objectives: (i) to understand the concept of DNFS; (ii) to find out DNFS optimization methods; (iii) to visualize the intensity of work carried out in DNFS domain; and (iv) to highlight DNFS application subjects and domains. We believe that this study provides up-to-date guidance for future research in the DNFS domain, allowing for more effective advancement in techniques and processes. The analysis made in this review proves that DNFS-based research is actively growing with a substantial implementation and application scope in the future.
Collapse
|
14
|
Nawaz M, Nazir T, Masood M, Ali F, Khan MA, Tariq U, Sahar N, Damaševičius R. Melanoma segmentation: A framework of improved DenseNet77 and UNET convolutional neural network. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:2137-2153. [DOI: 10.1002/ima.22750] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 05/03/2022] [Indexed: 08/25/2024]
Abstract
AbstractMelanoma is the most fatal type of skin cancer which can cause the death of victims at the advanced stage. Extensive work has been presented by the researcher on computer vision for skin lesion localization. However, correct and effective melanoma segmentation is still a tough job because of the extensive variations found in the shape, color, and sizes of skin moles. Moreover, the presence of light and brightness variations further complicates the segmentation task. We have presented improved deep learning (DL)‐based approach, namely, the DenseNet77‐based UNET model. More clearly, we have introduced the DenseNet77 network at the encoder unit of the UNET approach to computing the more representative set of image features. The calculated keypoints are later segmented by the decoder of the UNET model. We have used two standard datasets, namely, the ISIC‐2017 and ISIC‐2018 to evaluate the performance of the proposed approach and acquired the segmentation accuracies of 99.21% and 99.51% for the ISIC‐2017 and ISIC‐2018 datasets, respectively. We have confirmed through both the quantitative and qualitative results that the proposed improved UNET approach is robust to skin lesions segmentation and can accurately recognize the moles of varying colors and sizes.
Collapse
Affiliation(s)
- Marriam Nawaz
- Department of Computer Science University of Engineering and Technology Taxila Pakistan
- Department of Software Engineering University of Enginering and Technology Taxila Pakistan
| | - Tahira Nazir
- Department of Computing Riphah International University Islamabad Pakistan
| | - Momina Masood
- Department of Computer Science University of Engineering and Technology Taxila Pakistan
| | - Farooq Ali
- Department of Computer Science University of Engineering and Technology Taxila Pakistan
| | | | - Usman Tariq
- College of Computer Engineering and Science Prince Sattam Bin Abdulaziz University Al‐Kharj Saudi Arabia
| | - Naveera Sahar
- Department of Computer Science University of Wah Wah Cantt Pakistan
| | | |
Collapse
|
15
|
MSeg-Net: A Melanoma Mole Segmentation Network Using CornerNet and Fuzzy -Means Clustering. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:7502504. [PMID: 36276999 PMCID: PMC9586776 DOI: 10.1155/2022/7502504] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 09/17/2022] [Indexed: 11/18/2022]
Abstract
Melanoma is a dangerous form of skin cancer that results in the demise of patients at the developed stage. Researchers have attempted to develop automated systems for the timely recognition of this deadly disease. However, reliable and precise identification of melanoma moles is a tedious and complex activity as there exist huge differences in the mass, structure, and color of the skin lesions. Additionally, the incidence of noise, blurring, and chrominance changes in the suspected images further enhance the complexity of the detection procedure. In the proposed work, we try to overcome the limitations of the existing work by presenting a deep learning (DL) model. Descriptively, after accomplishing the preprocessing task, we have utilized an object detection approach named CornerNet model to detect melanoma lesions. Then the localized moles are passed as input to the fuzzy K-means (FLM) clustering approach to perform the segmentation task. To assess the segmentation power of the proposed approach, two standard databases named ISIC-2017 and ISIC-2018 are employed. Extensive experimentation has been conducted to demonstrate the robustness of the proposed approach through both numeric and pictorial results. The proposed approach is capable of detecting and segmenting the moles of arbitrary shapes and orientations. Furthermore, the presented work can tackle the presence of noise, blurring, and brightness variations as well. We have attained the segmentation accuracy values of 99.32% and 99.63% over the ISIC-2017 and ISIC-2018 databases correspondingly which clearly depicts the effectiveness of our model for the melanoma mole segmentation.
Collapse
|
16
|
Singh SK, Abolghasemi V, Anisi MH. Skin Cancer Diagnosis Based on Neutrosophic Features with a Deep Neural Network. SENSORS (BASEL, SWITZERLAND) 2022; 22:6261. [PMID: 36016022 PMCID: PMC9412609 DOI: 10.3390/s22166261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 08/17/2022] [Accepted: 08/18/2022] [Indexed: 06/15/2023]
Abstract
Recent years evidenced an increase in the total number of skin cancer cases, and it is projected to grow exponentially. This paper proposes a computer-aided diagnosis system for the classification of a malignant lesion, where the acquired image is primarily pre-processed using novel methods. Digital artifacts such as hair follicles and blood vessels are removed, and thereafter, the image is enhanced using a novel method of histogram equalization. Henceforth, the pre-processed image undergoes the segmentation phase, where the suspected lesion is segmented using the Neutrosophic technique. The segmentation method employs a thresholding-based method along with a pentagonal neutrosophic structure to form a segmentation mask of the suspected skin lesion. The paper proposes a deep neural network base on Inception and residual blocks with softmax block after each residual block which makes the layer wider and easier to learn the key features more quickly. The proposed classifier was trained, tested, and validated over PH2, ISIC 2017, ISIC 2018, and ISIC 2019 datasets. The proposed segmentation model yields an accuracy mark of 99.50%, 99.33%, 98.56% and 98.04% for these datasets, respectively. These datasets are augmented to form a total of 103,554 images for training, which make the classifier produce enhanced classification results. Our experimental results confirm that the proposed classifier yields an accuracy score of 99.50%, 99.33%, 98.56%, and 98.04% for PH2, ISIC 2017, 2018, and 2019, respectively, which is better than most of the pre-existing classifiers.
Collapse
|
17
|
A Decision Support System for Melanoma Diagnosis from Dermoscopic Images. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12147007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Innovative technologies in dermatology allow for the early screening of skin cancer, which results in a reduction in the mortality rate and surgical treatments. The diagnosis of melanoma is complex not only because of the number of different lesions but because of the high similarity amongst skin lesions of different nature; hence, human vision and physician experience still play a major role. The adoption of automatic systems would aid clinical assessment and make the diagnosis reproducible by eliminating inter- and intra-observer variabilities. In our paper, we describe a computer-aided system for the early diagnosis of melanoma in dermoscopic images. A soft pre-processing phase is performed so as to avoid the loss of details both in texture, colors, and contours, and color-based image segmentation is later carried out using k-means. Features linked to both geometric properties and color characteristics are used to analyze skin lesions through a support vector machine classifier. The PH2 public database is used for the assessment of the procedure’s sensitivity, specificity, and accuracy. A statistical approach is carried out to establish the impact of image quality on performance. The obtained results show remarkable achievements, so our computer-aided approach should be suitable as a Decision Support System for melanoma detection.
Collapse
|
18
|
Martin-Gonzalez M, Azcarraga C, Martin-Gil A, Carpena-Torres C, Jaen P. Efficacy of a Deep Learning Convolutional Neural Network System for Melanoma Diagnosis in a Hospital Population. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19073892. [PMID: 35409575 PMCID: PMC8997631 DOI: 10.3390/ijerph19073892] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 03/19/2022] [Accepted: 03/21/2022] [Indexed: 02/04/2023]
Abstract
(1) Background: The purpose of this study was to evaluate the efficacy in terms of sensitivity, specificity, and accuracy of the quantusSKIN system, a new clinical tool based on deep learning, to distinguish between benign skin lesions and melanoma in a hospital population. (2) Methods: A retrospective study was performed using 232 dermoscopic images from the clinical database of the Ramón y Cajal University Hospital (Madrid, Spain). The skin lesions images, previously diagnosed as nevus (n = 177) or melanoma (n = 55), were analyzed by the quantusSKIN system, which offers a probabilistic percentage (diagnostic threshold) for melanoma diagnosis. The optimum diagnostic threshold, sensitivity, specificity, and accuracy of the quantusSKIN system to diagnose melanoma were quantified. (3) Results: The mean diagnostic threshold was statistically lower (p < 0.001) in the nevus group (27.12 ± 35.44%) compared with the melanoma group (72.50 ± 34.03%). The area under the ROC curve was 0.813. For a diagnostic threshold of 67.33%, a sensitivity of 0.691, a specificity of 0.802, and an accuracy of 0.776 were obtained. (4) Conclusions: The quantusSKIN system is proposed as a useful screening tool for melanoma detection to be incorporated in primary health care systems.
Collapse
Affiliation(s)
- Manuel Martin-Gonzalez
- Service of Dermatology, Hospital Universitario Ramón y Cajal, 28034 Madrid, Spain; (C.A.); (P.J.)
- Instituto Ramón y Cajal de Investigación Sanitaria, 28034 Madrid, Spain
- Correspondence:
| | - Carlos Azcarraga
- Service of Dermatology, Hospital Universitario Ramón y Cajal, 28034 Madrid, Spain; (C.A.); (P.J.)
| | - Alba Martin-Gil
- Ocupharm Research Group, Department of Optometry and Vision, Faculty of Optics and Optometry, Complutense University of Madrid, 28037 Madrid, Spain; (A.M.-G.); (C.C.-T.)
| | - Carlos Carpena-Torres
- Ocupharm Research Group, Department of Optometry and Vision, Faculty of Optics and Optometry, Complutense University of Madrid, 28037 Madrid, Spain; (A.M.-G.); (C.C.-T.)
| | - Pedro Jaen
- Service of Dermatology, Hospital Universitario Ramón y Cajal, 28034 Madrid, Spain; (C.A.); (P.J.)
- Instituto Ramón y Cajal de Investigación Sanitaria, 28034 Madrid, Spain
| |
Collapse
|
19
|
Popescu D, El-Khatib M, El-Khatib H, Ichim L. New Trends in Melanoma Detection Using Neural Networks: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:496. [PMID: 35062458 PMCID: PMC8778535 DOI: 10.3390/s22020496] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 12/28/2021] [Accepted: 01/05/2022] [Indexed: 12/29/2022]
Abstract
Due to its increasing incidence, skin cancer, and especially melanoma, is a serious health disease today. The high mortality rate associated with melanoma makes it necessary to detect the early stages to be treated urgently and properly. This is the reason why many researchers in this domain wanted to obtain accurate computer-aided diagnosis systems to assist in the early detection and diagnosis of such diseases. The paper presents a systematic review of recent advances in an area of increased interest for cancer prediction, with a focus on a comparative perspective of melanoma detection using artificial intelligence, especially neural network-based systems. Such structures can be considered intelligent support systems for dermatologists. Theoretical and applied contributions were investigated in the new development trends of multiple neural network architecture, based on decision fusion. The most representative articles covering the area of melanoma detection based on neural networks, published in journals and impact conferences, were investigated between 2015 and 2021, focusing on the interval 2018-2021 as new trends. Additionally presented are the main databases and trends in their use in teaching neural networks to detect melanomas. Finally, a research agenda was highlighted to advance the field towards the new trends.
Collapse
Affiliation(s)
- Dan Popescu
- Faculty of Automatic Control and Computers, University Politehnica of Bucharest, 060042 Bucharest, Romania; (M.E.-K.); (H.E.-K.); (L.I.)
| | | | | | | |
Collapse
|
20
|
Abstract
Artificial intelligence (AI) is a fascinating new technology that incorporates machine learning and neural networks to improve existing technology or create new ones. Potential applications of AI are introduced to aid in the fight against colorectal cancer (CRC). This includes how AI will affect the epidemiology of colorectal cancer and the new methods of mass information gathering like GeoAI, digital epidemiology and real-time information collection. Meanwhile, this review also examines existing tools for diagnosing disease like CT/MRI, endoscopes, genetics, and pathological assessments also benefitted greatly from implementation of deep learning. Finally, how treatment and treatment approaches to CRC can be enhanced when applying AI is under discussion. The power of AI regarding the therapeutic recommendation in colorectal cancer demonstrates much promise in clinical and translational field of oncology, which means better and personalized treatments for those in need.
Collapse
Affiliation(s)
- Chaoran Yu
- Department of General Surgery, Shanghai Ninth People’ Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025 People’s Republic of China
| | - Ernest Johann Helwig
- Tongji Medical College of Huazhong University of Science and Technology, Wuhan, 430030 People’s Republic of China
| |
Collapse
|
21
|
Skin Lesion Extraction Using Multiscale Morphological Local Variance Reconstruction Based Watershed Transform and Fast Fuzzy C-Means Clustering. Symmetry (Basel) 2021. [DOI: 10.3390/sym13112085] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Early identification of melanocytic skin lesions increases the survival rate for skin cancer patients. Automated melanocytic skin lesion extraction from dermoscopic images using the computer vision approach is a challenging task as the lesions present in the image can be of different colors, there may be a variation of contrast near the lesion boundaries, lesions may have different sizes and shapes, etc. Therefore, lesion extraction from dermoscopic images is a fundamental step for automated melanoma identification. In this article, a watershed transform based on the fast fuzzy c-means (FCM) clustering algorithm is proposed for the extraction of melanocytic skin lesion from dermoscopic images. Initially, the proposed method removes the artifacts from the dermoscopic images and enhances the texture regions. Further, it is filtered using a Gaussian filter and a local variance filter to enhance the lesion boundary regions. Later, the watershed transform based on MMLVR (multiscale morphological local variance reconstruction) is introduced to acquire the superpixels of the image with accurate boundary regions. Finally, the fast FCM clustering technique is implemented in the superpixels of the image to attain the final lesion extraction result. The proposed method is tested in the three publicly available skin lesion image datasets, i.e., ISIC 2016, ISIC 2017 and ISIC 2018. Experimental evaluation shows that the proposed method achieves a good result.
Collapse
|
22
|
Nawaz M, Mehmood Z, Nazir T, Naqvi RA, Rehman A, Iqbal M, Saba T. Skin cancer detection from dermoscopic images using deep learning and fuzzy k-means clustering. Microsc Res Tech 2021; 85:339-351. [PMID: 34448519 DOI: 10.1002/jemt.23908] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2021] [Revised: 07/09/2021] [Accepted: 07/25/2021] [Indexed: 11/09/2022]
Abstract
Melanoma skin cancer is the most life-threatening and fatal disease among the family of skin cancer diseases. Modern technological developments and research methodologies made it possible to detect and identify this kind of skin cancer more effectively; however, the automated localization and segmentation of skin lesion at earlier stages is still a challenging task due to the low contrast between melanoma moles and skin portion and a higher level of color similarity between melanoma-affected and -nonaffected areas. In this paper, we present a fully automated method for segmenting the skin melanoma at its earliest stage by employing a deep-learning-based approach, namely faster region-based convolutional neural networks (RCNN) along with fuzzy k-means clustering (FKM). Several clinical images are utilized to test the presented method so that it may help the dermatologist in diagnosing this life-threatening disease at its earliest stage. The presented method first preprocesses the dataset images to remove the noise and illumination problems and enhance the visual information before applying the faster-RCNN to obtain the feature vector of fixed length. After that, FKM has been employed to segment the melanoma-affected portion of skin with variable size and boundaries. The performance of the presented method is evaluated on the three standard datasets, namely ISBI-2016, ISIC-2017, and PH2, and the results show that the presented method outperforms the state-of-the-art approaches. The presented method attains an average accuracy of 95.40, 93.1, and 95.6% on the ISIC-2016, ISIC-2017, and PH2 datasets, respectively, which is showing its robustness to skin lesion recognition and segmentation.
Collapse
Affiliation(s)
- Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
| | - Zahid Mehmood
- Department of Computer Engineering, University of Engineering and Technology, Taxila, Pakistan
| | - Tahira Nazir
- Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
| | - Rizwan Ali Naqvi
- Department of Unmanned Vehicle Engineering, Sejong University, Seoul, South Korea
| | - Amjad Rehman
- Artificial Intelligence & Data Analytics (AIDA) Lab, CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Munwar Iqbal
- Department of Computer Engineering, University of Engineering and Technology, Taxila, Pakistan
| | - Tanzila Saba
- Artificial Intelligence & Data Analytics (AIDA) Lab, CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| |
Collapse
|
23
|
|
24
|
Stadelmann SA, Blüthgen C, Milanese G, Nguyen-Kim TDL, Maul JT, Dummer R, Frauenfelder T, Eberhard M. Lung Nodules in Melanoma Patients: Morphologic Criteria to Differentiate Non-Metastatic and Metastatic Lesions. Diagnostics (Basel) 2021; 11:diagnostics11050837. [PMID: 34066913 PMCID: PMC8148527 DOI: 10.3390/diagnostics11050837] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 04/28/2021] [Accepted: 05/05/2021] [Indexed: 12/01/2022] Open
Abstract
Lung nodules are frequent findings in chest computed tomography (CT) in patients with metastatic melanoma. In this study, we assessed the frequency and compared morphologic differences of metastases and benign nodules. We retrospectively evaluated 85 patients with melanoma (AJCC stage III or IV). Inclusion criteria were ≤20 lung nodules and follow-up using CT ≥183 days after baseline. Lung nodules were evaluated for size and morphology. Nodules with significant growth, nodule regression in line with RECIST assessment or histologic confirmation were judged to be metastases. A total of 438 lung nodules were evaluated, of which 68% were metastases. At least one metastasis was found in 78% of patients. A 10 mm diameter cut-off (used for RECIST) showed a specificity of 95% and a sensitivity of 20% for diagnosing metastases. Central location (n = 122) was more common in metastatic nodules (p = 0.009). Subsolid morphology (n = 53) was more frequent (p < 0.001), and calcifications (n = 13) were solely found in non-metastatic lung nodules (p < 0.001). Our data show that lung nodules are prevalent in about two-thirds of melanoma patients (AJCC stage III/IV) and the majority are metastases. Even though we found a few morphologic indicators for metastatic or non-metastatic lung nodules, morphology has limited value to predict the presence of lung metastases.
Collapse
Affiliation(s)
- Simone Alexandra Stadelmann
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (S.A.S.); (C.B.); (T.D.L.N.-K.); (T.F.)
| | - Christian Blüthgen
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (S.A.S.); (C.B.); (T.D.L.N.-K.); (T.F.)
| | - Gianluca Milanese
- Department of Medicine and Surgery (DiMeC), University of Parma, 43126 Parma, Italy;
| | - Thi Dan Linh Nguyen-Kim
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (S.A.S.); (C.B.); (T.D.L.N.-K.); (T.F.)
| | - Julia-Tatjana Maul
- Department of Dermatology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (J.-T.M.); (R.D.)
| | - Reinhard Dummer
- Department of Dermatology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (J.-T.M.); (R.D.)
| | - Thomas Frauenfelder
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (S.A.S.); (C.B.); (T.D.L.N.-K.); (T.F.)
| | - Matthias Eberhard
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland; (S.A.S.); (C.B.); (T.D.L.N.-K.); (T.F.)
- Correspondence: ; Tel.: +41-(0)44-255-9139; Fax: +41-(0)44-255-4443
| |
Collapse
|
25
|
Ningrum DNA, Yuan SP, Kung WM, Wu CC, Tzeng IS, Huang CY, Li JYC, Wang YC. Deep Learning Classifier with Patient's Metadata of Dermoscopic Images in Malignant Melanoma Detection. J Multidiscip Healthc 2021; 14:877-885. [PMID: 33907414 PMCID: PMC8071207 DOI: 10.2147/jmdh.s306284] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Accepted: 03/25/2021] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND Incidence of skin cancer is one of the global burdens of malignancies that increase each year, with melanoma being the deadliest one. Imaging-based automated skin cancer detection still remains challenging owing to variability in the skin lesions and limited standard dataset availability. Recent research indicates the potential of deep convolutional neural networks (CNN) in predicting outcomes from simple as well as highly complicated images. However, its implementation requires high-class computational facility, that is not feasible in low resource and remote areas of health care. There is potential in combining image and patient's metadata, but the study is still lacking. OBJECTIVE We want to develop malignant melanoma detection based on dermoscopic images and patient's metadata using an artificial intelligence (AI) model that will work on low-resource devices. METHODS We used an open-access dermatology repository of International Skin Imaging Collaboration (ISIC) Archive dataset consist of 23,801 biopsy-proven dermoscopic images. We tested performance for binary classification malignant melanomas vs nonmalignant melanomas. From 1200 sample images, we split the data for training (72%), validation (18%), and testing (10%). We compared CNN with image data only (CNN model) vs CNN for image data combined with an artificial neural network (ANN) for patient's metadata (CNN+ANN model). RESULTS The balanced accuracy for CNN+ANN model was higher (92.34%) than the CNN model (73.69%). Combination of the patient's metadata using ANN prevents the overfitting that occurs in the CNN model using dermoscopic images only. This small size (24 MB) of this model made it possible to run on a medium class computer without the need of cloud computing, suitable for deployment on devices with limited resources. CONCLUSION The CNN+ANN model can increase the accuracy of classification in malignant melanoma detection even with limited data and is promising for development as a screening device in remote and low resources health care.
Collapse
Affiliation(s)
- Dina Nur Anggraini Ningrum
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- Public Health Department, Universitas Negeri Semarang, Semarang City, Indonesia
| | - Sheng-Po Yuan
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- Department of Otorhinolaryngology, Shuang-Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Woon-Man Kung
- Department of Exercise and Health Promotion, College of Kinesiology and Health, Chinese Culture University, Taipei, Taiwan
| | - Chieh-Chen Wu
- Department of Exercise and Health Promotion, College of Kinesiology and Health, Chinese Culture University, Taipei, Taiwan
| | - I-Shiang Tzeng
- Department of Exercise and Health Promotion, College of Kinesiology and Health, Chinese Culture University, Taipei, Taiwan
- Department of Research, Taipei Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, New Taipei City, Taiwan
- Department of Statistics, National Taipei University, Taipei, Taiwan
| | - Chu-Ya Huang
- Taiwan College of Healthcare Executives, Taipei, Taiwan
| | - Jack Yu-Chuan Li
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- Department Dermatology, Wan Fang Hospital, Taipei, Taiwan
- Taipei Medical University Research Center of Cancer Translational Medicine, Taipei, Taiwan
| | - Yao-Chin Wang
- Graduate Institute of Injury Prevention and Control, College of Public Health, Taipei Medical University, Taipei, Taiwan
- Department of Emergency Medicine, Min-Sheng General Hospital, Taoyuan, Taiwan
| |
Collapse
|
26
|
An Architectural Multi-Agent System for a Pavement Monitoring System with Pothole Recognition in UAV Images. SENSORS 2020; 20:s20216205. [PMID: 33143311 PMCID: PMC7663208 DOI: 10.3390/s20216205] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 10/21/2020] [Accepted: 10/27/2020] [Indexed: 12/21/2022]
Abstract
In recent years, maintenance work on public transport routes has drastically decreased in many countries due to difficult economic situations. The various studies that have been conducted by groups of drivers and groups related to road safety concluded that accidents are increasing due to the poor conditions of road surfaces, even affecting the condition of vehicles through costly breakdowns. Currently, the processes of detecting any type of damage to a road are carried out manually or are based on the use of a road vehicle, which incurs a high labor cost. To solve this problem, many research centers are investigating image processing techniques to identify poor-condition road areas using deep learning algorithms. The main objective of this work is to design of a distributed platform that allows the detection of damage to transport routes using drones and to provide the results of the most important classifiers. A case study is presented using a multi-agent system based on PANGEA that coordinates the different parts of the architecture using techniques based on ubiquitous computing. The results obtained by means of the customization of the You Only Look Once (YOLO) v4 classifier are promising, reaching an accuracy of more than 95%. The images used have been published in a dataset for use by the scientific community.
Collapse
|