1
|
Saghir U, Singh SK, Hasan M. Skin Cancer Image Segmentation Based on Midpoint Analysis Approach. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:2581-2596. [PMID: 38627267 PMCID: PMC11522265 DOI: 10.1007/s10278-024-01106-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 02/16/2024] [Accepted: 03/27/2024] [Indexed: 10/30/2024]
Abstract
Skin cancer affects people of all ages and is a common disease. The death toll from skin cancer rises with a late diagnosis. An automated mechanism for early-stage skin cancer detection is required to diminish the mortality rate. Visual examination with scanning or imaging screening is a common mechanism for detecting this disease, but due to its similarity to other diseases, this mechanism shows the least accuracy. This article introduces an innovative segmentation mechanism that operates on the ISIC dataset to divide skin images into critical and non-critical sections. The main objective of the research is to segment lesions from dermoscopic skin images. The suggested framework is completed in two steps. The first step is to pre-process the image; for this, we have applied a bottom hat filter for hair removal and image enhancement by applying DCT and color coefficient. In the next phase, a background subtraction method with midpoint analysis is applied for segmentation to extract the region of interest and achieves an accuracy of 95.30%. The ground truth for the validation of segmentation is accomplished by comparing the segmented images with validation data provided with the ISIC dataset.
Collapse
Affiliation(s)
- Uzma Saghir
- Dept. of Computer Science & Engineering, Lovely Professional University, Punjab, 144001, India
| | - Shailendra Kumar Singh
- Dept. of Computer Science & Engineering, Lovely Professional University, Punjab, 144001, India.
| | - Moin Hasan
- Dept. of Computer Science & Engineering, Jain Deemed-to-be-University, Bengaluru, 562112, India
| |
Collapse
|
2
|
Arshad S, Amjad T, Hussain A, Qureshi I, Abbas Q. Dermo-Seg: ResNet-UNet Architecture and Hybrid Loss Function for Detection of Differential Patterns to Diagnose Pigmented Skin Lesions. Diagnostics (Basel) 2023; 13:2924. [PMID: 37761291 PMCID: PMC10527859 DOI: 10.3390/diagnostics13182924] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2023] [Revised: 08/29/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023] Open
Abstract
Convolutional neural network (CNN) models have been extensively applied to skin lesions segmentation due to their information discrimination capabilities. However, CNNs' struggle to capture the connection between long-range contexts when extracting deep semantic features from lesion images, resulting in a semantic gap that causes segmentation distortion in skin lesions. Therefore, detecting the presence of differential structures such as pigment networks, globules, streaks, negative networks, and milia-like cysts becomes difficult. To resolve these issues, we have proposed an approach based on semantic-based segmentation (Dermo-Seg) to detect differential structures of lesions using a UNet model with a transfer-learning-based ResNet-50 architecture and a hybrid loss function. The Dermo-Seg model uses ResNet-50 backbone architecture as an encoder in the UNet model. We have applied a combination of focal Tversky loss and IOU loss functions to handle the dataset's highly imbalanced class ratio. The obtained results prove that the intended model performs well compared to the existing models. The dataset was acquired from various sources, such as ISIC18, ISBI17, and HAM10000, to evaluate the Dermo-Seg model. We have dealt with the data imbalance present within each class at the pixel level using our hybrid loss function. The proposed model achieves a mean IOU score of 0.53 for streaks, 0.67 for pigment networks, 0.66 for globules, 0.58 for negative networks, and 0.53 for milia-like-cysts. Overall, the Dermo-Seg model is efficient in detecting different skin lesion structures and achieved 96.4% on the IOU index. Our Dermo-Seg system improves the IOU index compared to the most recent network.
Collapse
Affiliation(s)
- Sannia Arshad
- Department of Computer Science, Faculty of Basic and Applied Science, International Islamic University, Islamabad 44000, Pakistan; (S.A.); (T.A.)
| | - Tehmina Amjad
- Department of Computer Science, Faculty of Basic and Applied Science, International Islamic University, Islamabad 44000, Pakistan; (S.A.); (T.A.)
| | - Ayyaz Hussain
- Department of Computer Science, Quaid e Azam University, Islamabad 44000, Pakistan;
| | - Imran Qureshi
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia;
| | - Qaisar Abbas
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia;
| |
Collapse
|
3
|
Hasan MK, Ahamad MA, Yap CH, Yang G. A survey, review, and future trends of skin lesion segmentation and classification. Comput Biol Med 2023; 155:106624. [PMID: 36774890 DOI: 10.1016/j.compbiomed.2023.106624] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 01/04/2023] [Accepted: 01/28/2023] [Indexed: 02/03/2023]
Abstract
The Computer-aided Diagnosis or Detection (CAD) approach for skin lesion analysis is an emerging field of research that has the potential to alleviate the burden and cost of skin cancer screening. Researchers have recently indicated increasing interest in developing such CAD systems, with the intention of providing a user-friendly tool to dermatologists to reduce the challenges encountered or associated with manual inspection. This article aims to provide a comprehensive literature survey and review of a total of 594 publications (356 for skin lesion segmentation and 238 for skin lesion classification) published between 2011 and 2022. These articles are analyzed and summarized in a number of different ways to contribute vital information regarding the methods for the development of CAD systems. These ways include: relevant and essential definitions and theories, input data (dataset utilization, preprocessing, augmentations, and fixing imbalance problems), method configuration (techniques, architectures, module frameworks, and losses), training tactics (hyperparameter settings), and evaluation criteria. We intend to investigate a variety of performance-enhancing approaches, including ensemble and post-processing. We also discuss these dimensions to reveal their current trends based on utilization frequencies. In addition, we highlight the primary difficulties associated with evaluating skin lesion segmentation and classification systems using minimal datasets, as well as the potential solutions to these difficulties. Findings, recommendations, and trends are disclosed to inform future research on developing an automated and robust CAD system for skin lesion analysis.
Collapse
Affiliation(s)
- Md Kamrul Hasan
- Department of Bioengineering, Imperial College London, UK; Department of Electrical and Electronic Engineering (EEE), Khulna University of Engineering & Technology (KUET), Khulna 9203, Bangladesh.
| | - Md Asif Ahamad
- Department of Electrical and Electronic Engineering (EEE), Khulna University of Engineering & Technology (KUET), Khulna 9203, Bangladesh.
| | - Choon Hwai Yap
- Department of Bioengineering, Imperial College London, UK.
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, UK; Cardiovascular Research Centre, Royal Brompton Hospital, UK.
| |
Collapse
|
4
|
Oukil S, Kasmi R, Mokrani K, García-Zapirain B. Automatic segmentation and melanoma detection based on color and texture features in dermoscopic images. Skin Res Technol 2021; 28:203-211. [PMID: 34779062 PMCID: PMC9907597 DOI: 10.1111/srt.13111] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2021] [Accepted: 09/25/2021] [Indexed: 02/06/2023]
Abstract
PURPOSE Melanoma is known as the most aggressive form of skin cancer and one of the fastest growing malignant tumors worldwide. Several computer-aided diagnosis systems for melanoma have been proposed, still, the algorithms encounter difficulties in the early stage of lesions. This paper aims to discriminate melanoma and benign skin lesion in dermoscopic images. METHODS The proposed algorithm is based on the color and texture of skin lesions by introducing a novel feature extraction technique. The algorithm uses an automatic segmentation based on k-means generating a fairly accurate mask for each lesion. The feature extraction consists of the existing and novel color and texture attributes measuring how color and texture vary inside the lesion. To find the optimal results, all the attributes are extracted from lesions in five different color spaces (RGB, HSV, Lab, XYZ, and YCbCr) and used as the inputs for three classifiers (K nearest neighbors, support vector machine , and artificial neural network). RESULTS The PH2 set is used to assess the performance of the proposed algorithm. The results of our algorithm are compared to the results of published articles that used the same dataset, and it shows that the proposed method outperforms the state of the art by attaining a sensitivity of 99.25%, specificity of 99.58%, and accuracy of 99.51%. CONCLUSION The final results show that the colors combined with texture are powerful and relevant attributes for melanoma detection and show improvement over the state of the art.
Collapse
Affiliation(s)
- S Oukil
- LTII Laboratory University of Bejaia-Algeria, Faculty of Technology, University of Bejaia, Bejaia, Algeria
| | - R Kasmi
- LTII Laboratory University of Bejaia-Algeria, Faculty of Technology, University of Bejaia, Bejaia, Algeria.,Electrical Engineering Department, University of Bouira, Bouira, Algeria
| | - K Mokrani
- LTII Laboratory University of Bejaia-Algeria, Faculty of Technology, University of Bejaia, Bejaia, Algeria
| | | |
Collapse
|
5
|
Ramya J, Vijaylakshmi H, Mirza Saifuddin H. Segmentation of skin lesion images using discrete wavelet transform. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102839] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
6
|
Fujisawa Y, Inoue S, Nakamura Y. The Possibility of Deep Learning-Based, Computer-Aided Skin Tumor Classifiers. Front Med (Lausanne) 2019; 6:191. [PMID: 31508420 PMCID: PMC6719629 DOI: 10.3389/fmed.2019.00191] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2019] [Accepted: 08/13/2019] [Indexed: 11/13/2022] Open
Abstract
The incidence of skin tumors has steadily increased. Although most are benign and do not affect survival, some of the more malignant skin tumors present a lethal threat if a delay in diagnosis permits them to become advanced. Ideally, an inspection by an expert dermatologist would accurately detect malignant skin tumors in the early stage; however, it is not practical for every single patient to receive intensive screening by dermatologists. To overcome this issue, many studies are ongoing to develop dermatologist-level, computer-aided diagnostics. Whereas, many systems that can classify dermoscopic images at this dermatologist-equivalent level have been reported, a much fewer number of systems that can classify conventional clinical images have been reported thus far. Recently, the introduction of deep-learning technology, a method that automatically extracts a set of representative features for further classification has dramatically improved classification efficacy. This new technology has the potential to improve the computer classification accuracy of conventional clinical images to the level of skilled dermatologists. In this review, this new technology and present development of computer-aided skin tumor classifiers will be summarized.
Collapse
|
7
|
Roja Ramani D, Ranjani SS. An Efficient Melanoma Diagnosis Approach Using Integrated HMF Multi-Atlas Map Based Segmentation. J Med Syst 2019; 43:225. [PMID: 31190229 DOI: 10.1007/s10916-019-1315-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2019] [Accepted: 04/25/2019] [Indexed: 10/26/2022]
Abstract
Melanoma is a life threading disease when it grows outside the corium layer of the skin. Mortality rates of the Melanoma cases are maximum among the skin cancer patients. The cost required for the treatment of advanced melanoma cases is very high and the survival rate is low. Numerous computerized dermoscopy systems are developed based on the combination of shape, texture and color features to facilitate early diagnosis of melanoma. The availability and cost of the dermoscopic imaging system is still an issue. To mitigate this issue, this paper presented an integrated segmentation and Third Dimensional (3D) feature extraction approach for the accurate diagnosis of melanoma. A multi-atlas method is applied for the image segmentation. The patch-based label fusion model is expressed in a Bayesian framework to improve the segmentation accuracy. A depth map is obtained from the Two-dimensional (2D) dermoscopic image for reconstructing the 3D skin lesion represented as structure tensors. The 3D shape features including the relative depth features are obtained. Streaks are the significant morphological terms of the melanoma in the radial growth phase. The proposed method yields maximum segmentation accuracy, sensibility, specificity and minimum cost function than the existing segmentation technique and classifier.
Collapse
Affiliation(s)
- D Roja Ramani
- Department of Information Technology, Sethu Institute of Technology, Virudhunagar, India.
| | - S Siva Ranjani
- Department of Computer Science and Engineering, Sethu Institute of Technology, Virudhunagar, India
| |
Collapse
|
8
|
Mishra NK, Kaur R, Kasmi R, Hagerty JR, LeAnder R, Stanley RJ, Moss RH, Stoecker WV. Automatic lesion border selection in dermoscopy images using morphology and color features. Skin Res Technol 2019; 25:544-552. [PMID: 30868667 DOI: 10.1111/srt.12685] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2019] [Revised: 01/12/2019] [Accepted: 01/12/2019] [Indexed: 11/29/2022]
Abstract
PURPOSE We present a classifier for automatically selecting a lesion border for dermoscopy skin lesion images, to aid in computer-aided diagnosis of melanoma. Variation in photographic technique of dermoscopy images makes segmentation of skin lesions a difficult problem. No single algorithm provides an acceptable lesion border to allow further processing of skin lesions. METHODS We present a random forests border classifier model to select a lesion border from 12 segmentation algorithm borders, graded on a "good-enough" border basis. Morphology and color features inside and outside the automatic border are used to build the model. RESULTS For a random forests classifier applied to an 802-lesion test set, the model predicts a satisfactory border in 96.38% of cases, in comparison to the best single border algorithm, which detects a satisfactory border in 85.91% of cases. CONCLUSION The performance of the classifier-based automatic skin lesion finder is found to be better than any single algorithm used in this research.
Collapse
Affiliation(s)
| | - Ravneet Kaur
- Department of Electrical and Computer Engineering, Southern Illinois University Edwardsville, Edwardsville, Illinois
| | - Reda Kasmi
- Department of Electrical Engineering, University of Bejaia, Bejaia, Algeria.,Department of Electrical Engineering, University of Bouira, Bouira, Algeria
| | | | - Robert LeAnder
- Department of Electrical and Computer Engineering, Southern Illinois University Edwardsville, Edwardsville, Illinois
| | - Ronald J Stanley
- Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri
| | - Randy H Moss
- Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri
| | | |
Collapse
|
9
|
Riaz F, Naeem S, Nawaz R, Coimbra M. Active Contours Based Segmentation and Lesion Periphery Analysis for Characterization of Skin Lesions in Dermoscopy Images. IEEE J Biomed Health Inform 2019; 23:489-500. [DOI: 10.1109/jbhi.2018.2832455] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
10
|
Hagerty JR, Stanley RJ, Almubarak HA, Lama N, Kasmi R, Guo P, Drugge RJ, Rabinovitz HS, Oliviero M, Stoecker WV. Deep Learning and Handcrafted Method Fusion: Higher Diagnostic Accuracy for Melanoma Dermoscopy Images. IEEE J Biomed Health Inform 2019; 23:1385-1391. [PMID: 30624234 DOI: 10.1109/jbhi.2019.2891049] [Citation(s) in RCA: 66] [Impact Index Per Article: 13.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This paper presents an approach that combines conventional image processing with deep learning by fusing the features from the individual techniques. We hypothesize that the two techniques, with different error profiles, are synergistic. The conventional image processing arm uses three handcrafted biologically inspired image processing modules and one clinical information module. The image processing modules detect lesion features comparable to clinical dermoscopy information-atypical pigment network, color distribution, and blood vessels. The clinical module includes information submitted to the pathologist-patient age, gender, lesion location, size, and patient history. The deep learning arm utilizes knowledge transfer via a ResNet-50 network that is repurposed to predict the probability of melanoma classification. The classification scores of each individual module from both processing arms are then ensembled utilizing logistic regression to predict an overall melanoma probability. Using cross-validated results of melanoma classification measured by area under the receiver operator characteristic curve (AUC), classification accuracy of 0.94 was obtained for the fusion technique. In comparison, the ResNet-50 deep learning based classifier alone yields an AUC of 0.87 and conventional image processing based classifier yields an AUC of 0.90. Further study of fusion of conventional image processing techniques and deep learning is warranted.
Collapse
|
11
|
Harangi B. Skin lesion classification with ensembles of deep convolutional neural networks. J Biomed Inform 2018; 86:25-32. [DOI: 10.1016/j.jbi.2018.08.006] [Citation(s) in RCA: 175] [Impact Index Per Article: 29.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2018] [Revised: 06/14/2018] [Accepted: 08/07/2018] [Indexed: 11/25/2022]
|
12
|
Pathan S, Prabhu KG, Siddalingaswamy P. Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.07.010] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
13
|
Fan H, Xie F, Li Y, Jiang Z, Liu J. Automatic segmentation of dermoscopy images using saliency combined with Otsu threshold. Comput Biol Med 2017; 85:75-85. [DOI: 10.1016/j.compbiomed.2017.03.025] [Citation(s) in RCA: 70] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2016] [Revised: 03/01/2017] [Accepted: 03/24/2017] [Indexed: 11/16/2022]
|
14
|
Kaur R, LeAnder R, Mishra NK, Hagerty JR, Kasmi R, Stanley RJ, Celebi ME, Stoecker WV. Thresholding methods for lesion segmentation of basal cell carcinoma in dermoscopy images. Skin Res Technol 2016; 23:416-428. [DOI: 10.1111/srt.12352] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/18/2016] [Indexed: 11/30/2022]
Affiliation(s)
- R. Kaur
- Department of Electrical and Computer Engineering; Southern Illinois University Edwardsville; Edwardsville IL 62025 USA
| | - R. LeAnder
- Department of Electrical and Computer Engineering; Southern Illinois University Edwardsville; Edwardsville IL 62025 USA
| | | | | | - R. Kasmi
- Department of Electrical Engineering; University of Bejaia; Bejaia Algeria
| | - R. J. Stanley
- Department of Electrical and Computer Engineering; Missouri University of Science and Technology; Rolla MO 65209 USA
| | - M. E. Celebi
- Department of Computer Science; University of Central Arkansas; Conway AR 72035 USA
| | | |
Collapse
|
15
|
Kefel S, Pelin Kefel S, LeAnder RW, Kaur R, Kasmi R, Mishra NK, Rader RK, Cole JG, Woolsey ZT, Stoecker WV. Adaptable texture-based segmentation by variance and intensity for automatic detection of semitranslucent and pink blush areas in basal cell carcinoma. Skin Res Technol 2016; 22:412-422. [DOI: 10.1111/srt.12281] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/19/2015] [Indexed: 11/30/2022]
Affiliation(s)
- S. Kefel
- Department of Electrical and Computer Engineering; Southern Illinois University; Edwardsville IL USA
| | - S. Pelin Kefel
- Department of Electrical and Computer Engineering; Southern Illinois University; Edwardsville IL USA
| | - R. W. LeAnder
- Department of Electrical and Computer Engineering; Southern Illinois University; Edwardsville IL USA
| | - R. Kaur
- Department of Electrical and Computer Engineering; Southern Illinois University; Edwardsville IL USA
| | - R. Kasmi
- Department of Electrical Engineering; University of Bejaia; Bejaia Algeria
| | | | - R. K. Rader
- Stoecker & Associates; Rolla MO USA
- School of Medicine; University of Missouri; Columbia MO USA
| | | | | | - W. V. Stoecker
- Stoecker & Associates; Rolla MO USA
- School of Medicine; University of Missouri; Columbia MO USA
| |
Collapse
|