1
|
Qin J, Pei D, Guo Q, Cai X, Xie L, Zhang W. Intersection-union dual-stream cross-attention Lova-SwinUnet for skin cancer hair segmentation and image repair. Comput Biol Med 2024; 180:108931. [PMID: 39079414 DOI: 10.1016/j.compbiomed.2024.108931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 06/16/2024] [Accepted: 07/19/2024] [Indexed: 08/29/2024]
Abstract
Skin cancer images have hair occlusion problems, which greatly affects the accuracy of diagnosis and classification. Current dermoscopic hair removal methods use segmentation networks to locate hairs, and then uses repair networks to perform image repair. However, it is difficult to segment hair and capture the overall structure between hairs because of the hair being thin, unclear, and similar in color to the entire image. When conducting image restoration tasks, the only available images are those obstructed by hair, and there is no corresponding ground truth (supervised data) of the same scene without hair obstruction. In addition, the texture information and structural information used in existing repair methods are often insufficient, which leads to poor results in skin cancer image repair. To address these challenges, we propose the intersection-union dual-stream cross-attention Lova-SwinUnet (IUDC-LS). Firstly, we propose the Lova-SwinUnet module, which embeds Lovasz loss function into Swin-Unet, enabling the network to better capture features of various scales, thus obtaining better hair mask segmentation results. Secondly, we design the intersection-union (IU) module, which takes the mask results obtained in the previous step for pairwise intersection or union, and then overlays the results on the skin cancer image without hair to generate the labeled training data. This turns the unsupervised image repair task into the supervised one. Finally, we propose the dual-stream cross-attention (DC) module, which makes texture information and structure information interact with each other, and then uses cross-attention to make the network pay attention to the more important texture information and structure information in the fusion process of texture information and structure information, so as to improve the effect of image repair. The experimental results show that the PSNR index and SSIM index of the proposed method are increased by 5.4875 and 0.0401 compared with the other common methods. Experimental results unequivocally demonstrate the effectiveness of our approach, which serves as a potent tool for skin cancer detection, significantly surpassing the performance of comparable methods.
Collapse
Affiliation(s)
- Juanjuan Qin
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China.
| | - Dong Pei
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China.
| | - Qian Guo
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China.
| | - Xingjuan Cai
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China; State Key Laboratory for Novel Software Technology at Nanjing University, Nanjing University, Nanjing, China.
| | - Liping Xie
- Shanxi Key Laboratory of Big Data Analysis and Parallel Computing, Taiyuan University of Science and Technology, Taiyuan, China.
| | - Wensheng Zhang
- The Institute of Automation, Chinese Academy of Sciences (CAS), Beijing, China.
| |
Collapse
|
2
|
Kasmi R, Hagerty J, Young R, Lama N, Nepal J, Miinch J, Stoecker W, Stanley RJ. SharpRazor: Automatic removal of hair and ruler marks from dermoscopy images. Skin Res Technol 2023; 29:e13203. [PMID: 37113095 PMCID: PMC10234178 DOI: 10.1111/srt.13203] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 05/03/2022] [Indexed: 04/03/2023]
Abstract
BACKGROUND The removal of hair and ruler marks is critical in handcrafted image analysis of dermoscopic skin lesions. No other dermoscopic artifacts cause more problems in segmentation and structure detection. PURPOSE The aim of the work is to detect both white and black hair, artifacts and finally inpaint correctly the image. METHOD We introduce a new algorithm: SharpRazor, to detect hair and ruler marks and remove them from the image. Our multiple-filter approach detects hairs of varying widths within varying backgrounds, while avoiding detection of vessels and bubbles. The proposed algorithm utilizes grayscale plane modification, hair enhancement, segmentation using tri-directional gradients, and multiple filters for hair of varying widths. We develop an alternate entropy-based processing adaptive thresholding method. White or light-colored hair, and ruler marks are detected separately and added to the final hair mask. A classifier removes noise objects. Finally, a new technique of inpainting is presented, and this is utilized to remove the detected object from the lesion image. RESULTS The proposed algorithm is tested on two datasets, and compares with seven existing methods measuring accuracy, precision, recall, dice, and Jaccard scores. SharpRazor is shown to outperform existing methods. CONCLUSION The Shaprazor techniques show the promise to reach the purpose of removing and inpaint both dark and white hair in a wide variety of lesions.
Collapse
Affiliation(s)
- Reda Kasmi
- Faculty of Technology, Laboratoire de Technologie Industrielle et de l'Information (LTII)University of BejaiaBejaiaAlgeria
| | | | - Reagan Young
- Department of Electrical and Computer EngineeringMissouri University of Science and TechnologyRollaMissouriUSA
| | - Norsang Lama
- Department of Electrical and Computer EngineeringMissouri University of Science and TechnologyRollaMissouriUSA
| | - Januka Nepal
- Department of Electrical and Computer EngineeringMissouri University of Science and TechnologyRollaMissouriUSA
| | - Jessica Miinch
- Department of Electrical and Computer EngineeringMissouri University of Science and TechnologyRollaMissouriUSA
| | | | - R Joe Stanley
- Department of Electrical and Computer EngineeringMissouri University of Science and TechnologyRollaMissouriUSA
| |
Collapse
|
3
|
Ashour AS, El-Wahab BSA, Wahba MA, Mansour DEA, Hodeib AAE, Khedr RAEG, Hassan GFR. Cascaded Hough Transform-Based Hair Mask Generation and Harmonic Inpainting for Automated Hair Removal from Dermoscopy Images. Diagnostics (Basel) 2022; 12:diagnostics12123040. [PMID: 36553047 PMCID: PMC9777124 DOI: 10.3390/diagnostics12123040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 07/21/2022] [Accepted: 07/22/2022] [Indexed: 12/10/2022] Open
Abstract
Restoring information obstructed by hair is one of the main issues for the accurate analysis and segmentation of skin images. For retrieving pixels obstructed by hair, the proposed system converts dermoscopy images into the L*a*b* color space, then principal component analysis (PCA) is applied to produce grayscale images. Afterward, the contrast-limited adaptive histogram equalization (CLAHE) and the average filter are implemented to enhance the grayscale image. Subsequently, the binary image is generated using the iterative thresholding method. After that, the Hough transform (HT) is applied to each image block to generate the hair mask. Finally, the hair pixels are removed by harmonic inpainting. The performance of the proposed automated hair removal was evaluated by applying the proposed system to the International Skin Imaging Collaboration (ISIC) dermoscopy dataset as well as to clinical images. Six performance evaluation metrics were measured, namely the mean squared error (MSE), the peak signal-to-noise ratio (PSNR), the signal-to-noise ratio (SNR), the structural similarity index (SSIM), the universal quality image index (UQI), and the correlation (C). Using the clinical dataset, the system achieved MSE, PSNR, SNR, SSIM, UQI, and C values of 34.7957, 66.98, 42.39, 0.9813, 0.9801, and 0.9985, respectively. The results demonstrated that the proposed system could satisfy the medical diagnostic requirements and achieve the best performance compared to the state-of-art.
Collapse
Affiliation(s)
- Amira S. Ashour
- Department of Electronics and Electrical Communications Engineering, Faculty of Engineering, Tanta University, Tanta 31511, Egypt
- Correspondence: (A.S.A.); (D.-E.A.M.)
| | - Basant S. Abd El-Wahab
- Department of Electronics and Electrical Communications Engineering, Faculty of Engineering, Tanta University, Tanta 31511, Egypt
| | - Maram A. Wahba
- Department of Electronics and Electrical Communications Engineering, Faculty of Engineering, Tanta University, Tanta 31511, Egypt
| | - Diaa-Eldin A. Mansour
- Department of Electrical Power and Machines Engineering, Faculty of Engineering, Tanta University, Tanta 31511, Egypt
- Correspondence: (A.S.A.); (D.-E.A.M.)
| | - Abeer Abd Elhakam Hodeib
- Department of Dermatology and Venereology, Faculty of Medicine, Tanta University, Tanta 31511, Egypt
| | | | - Ghada F. R. Hassan
- Department of Dermatology and Venereology, Faculty of Medicine, Tanta University, Tanta 31511, Egypt
| |
Collapse
|
4
|
Song X, Guo S, Han L, Wang L, Yang W, Wang G, Anil Baris C. Research on hair removal algorithm of dermatoscopic images based on maximum variance fuzzy clustering and optimization Criminisi algorithm. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
5
|
System for the Recognizing of Pigmented Skin Lesions with Fusion and Analysis of Heterogeneous Data Based on a Multimodal Neural Network. Cancers (Basel) 2022; 14:cancers14071819. [PMID: 35406591 PMCID: PMC8997449 DOI: 10.3390/cancers14071819] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 03/30/2022] [Accepted: 03/30/2022] [Indexed: 02/07/2023] Open
Abstract
Simple Summary Skin cancer is one of the most common cancers in humans. This study aims to create a system for recognizing pigmented skin lesions by analyzing heterogeneous data based on a multimodal neural network. Fusing patient statistics and multidimensional visual data allows for finding additional links between dermoscopic images and medical diagnostic results, significantly improving neural network classification accuracy. The use by specialists of the proposed system of neural network recognition of pigmented skin lesions will enhance the efficiency of diagnosis compared to visual diagnostic methods. Abstract Today, skin cancer is one of the most common malignant neoplasms in the human body. Diagnosis of pigmented lesions is challenging even for experienced dermatologists due to the wide range of morphological manifestations. Artificial intelligence technologies are capable of equaling and even surpassing the capabilities of a dermatologist in terms of efficiency. The main problem of implementing intellectual analysis systems is low accuracy. One of the possible ways to increase this indicator is using stages of preliminary processing of visual data and the use of heterogeneous data. The article proposes a multimodal neural network system for identifying pigmented skin lesions with a preliminary identification, and removing hair from dermatoscopic images. The novelty of the proposed system lies in the joint use of the stage of preliminary cleaning of hair structures and a multimodal neural network system for the analysis of heterogeneous data. The accuracy of pigmented skin lesions recognition in 10 diagnostically significant categories in the proposed system was 83.6%. The use of the proposed system by dermatologists as an auxiliary diagnostic method will minimize the impact of the human factor, assist in making medical decisions, and expand the possibilities of early detection of skin cancer.
Collapse
|
6
|
Bardou D, Bouaziz H, Lv L, Zhang T. Hair removal in dermoscopy images using variational autoencoders. Skin Res Technol 2022; 28:445-454. [PMID: 35254677 PMCID: PMC9907627 DOI: 10.1111/srt.13145] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 01/17/2022] [Indexed: 01/23/2023]
Abstract
BACKGROUND In recent years, melanoma is rising at a faster rate compared to other cancers. Although it is the most serious type of skin cancer, the diagnosis at early stages makes it curable. Dermoscopy is a reliable medical technique used to detect melanoma by using a dermoscope to examine the skin. In the last few decades, digital imaging devices have made great progress which allowed capturing and storing high-quality images from these examinations. The stored images are now being standardized and used for the automatic detection of melanoma. However, when the hair covers the skin, this makes the task challenging. Therefore, it is important to eliminate the hair to get accurate results. METHODS In this paper, we propose a simple yet efficient method for hair removal using a variational autoencoder without the need for paired samples. The encoder takes as input a dermoscopy image and builds a latent distribution that ignores hair as it is considered noise, while the decoder reconstructs a hair-free image. Both encoder and decoder use a decent convolutional neural networks architecture that provides high performance. The construction of our model comprises two stages of training. In the first stage, the model has trained on hair-occluded images to output hair-free images, and in the second stage, it is optimized using hair-free images to preserve the image textures. Although the variational autoencoder produces hair-free images, it does not maintain the quality of the generated images. Thus, we explored the use of three-loss functions including the structural similarity index (SSIM), L1-norm, and L2-norm to improve the visual quality of the generated images. RESULTS The evaluation of the hair-free reconstructed images is carried out using t-distributed stochastic neighbor embedding (SNE) feature mapping by visualizing the distribution of the real hair-free images and the synthesized hair-free images. The conducted experiments on the publicly available dataset HAM10000 show that our method is very efficient.
Collapse
Affiliation(s)
- Dalal Bardou
- Department of Computer Science and Mathematics University of Abbes Laghrour Khenchela Algeria
| | - Hamida Bouaziz
- Mécatronique Laboratory Department of Computer Science Jijel University Jijel Algeria
| | - Laishui Lv
- School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing China
| | - Ting Zhang
- School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing China
| |
Collapse
|
7
|
Baig R, Bibi M, Hamid A, Kausar S, Khalid S. Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review. Curr Med Imaging 2021; 16:513-533. [PMID: 32484086 DOI: 10.2174/1573405615666190129120449] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 12/17/2018] [Accepted: 01/02/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND Automated intelligent systems for unbiased diagnosis are primary requirement for the pigment lesion analysis. It has gained the attention of researchers in the last few decades. These systems involve multiple phases such as pre-processing, feature extraction, segmentation, classification and post processing. It is crucial to accurately localize and segment the skin lesion. It is observed that recent enhancements in machine learning algorithms and dermoscopic techniques reduced the misclassification rate therefore, the focus towards computer aided systems increased exponentially in recent years. Computer aided diagnostic systems are reliable source for dermatologists to analyze the type of cancer, but it is widely acknowledged that even higher accuracy is needed for computer aided diagnostic systems to be adopted practically in the diagnostic process of life threatening diseases. INTRODUCTION Skin cancer is one of the most threatening cancers. It occurs by the abnormal multiplication of cells. The core three types of skin cells are: Squamous, Basal and Melanocytes. There are two wide classes of skin cancer; Melanocytic and non-Melanocytic. It is difficult to differentiate between benign and malignant melanoma, therefore dermatologists sometimes misclassify the benign and malignant melanoma. Melanoma is estimated as 19th most frequent cancer, it is riskier than the Basel and Squamous carcinoma because it rapidly spreads throughout the body. Hence, to lower the death risk, it is critical to diagnose the correct type of cancer in early rudimentary phases. It can occur on any part of body, but it has higher probability to occur on chest, back and legs. METHODS The paper presents a review of segmentation and classification techniques for skin lesion detection. Dermoscopy and its features are discussed briefly. After that Image pre-processing techniques are described. A thorough review of segmentation and classification phases of skin lesion detection using deep learning techniques is presented Literature is discussed and a comparative analysis of discussed methods is presented. CONCLUSION In this paper, we have presented the survey of more than 100 papers and comparative analysis of state of the art techniques, model and methodologies. Malignant melanoma is one of the most threating and deadliest cancers. Since the last few decades, researchers are putting extra attention and effort in accurate diagnosis of melanoma. The main challenges of dermoscopic skin lesion images are: low contrasts, multiple lesions, irregular and fuzzy borders, blood vessels, regression, hairs, bubbles, variegated coloring and other kinds of distortions. The lack of large training dataset makes these problems even more challenging. Due to recent advancement in the paradigm of deep learning, and specially the outstanding performance in medical imaging, it has become important to review the deep learning algorithms performance in skin lesion segmentation. Here, we have discussed the results of different techniques on the basis of different evaluation parameters such as Jaccard coefficient, sensitivity, specificity and accuracy. And the paper listed down the major achievements in this domain with the detailed discussion of the techniques. In future, it is expected to improve results by utilizing the capabilities of deep learning frameworks with other pre and post processing techniques so reliable and accurate diagnostic systems can be built.
Collapse
Affiliation(s)
- Ramsha Baig
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Maryam Bibi
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Anmol Hamid
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Sumaira Kausar
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Shahzad Khalid
- Department of Computer Engineering, Bahria University, Islamabad, Pakistan
| |
Collapse
|
8
|
Attia M, Hossny M, Zhou H, Nahavandi S, Asadi H, Yazdabadi A. Realistic hair simulator for skin lesion images: A novel benchemarking tool. Artif Intell Med 2020; 108:101933. [PMID: 32972662 DOI: 10.1016/j.artmed.2020.101933] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2019] [Revised: 06/05/2020] [Accepted: 07/13/2020] [Indexed: 11/15/2022]
Abstract
Automated skin lesion analysis is one of the trending fields that has gained attention among the dermatologists and health care practitioners. Skin lesion restoration is an essential pre-processing step for lesion enhancements for accurate automated analysis and diagnosis by both dermatologists and computer-aided diagnosis tools. Hair occlusion is one of the most popular artifacts in dermatoscopic images. It can negatively impact the skin lesions diagnosis by both dermatologists and automated computer diagnostic tools. Digital hair removal is a non-invasive method for image enhancement for decrease the hair-occlusion artifact in previously captured images. Several hair removal methods were proposed for skin delineation and removal without standardized benchmarking techniques. Manual annotation is one of the main challenges that hinder the validation of these proposed methods on a large number of images or against benchmarking datasets for comparison purposes. In the presented work, we propose a photo-realistic hair simulator based on context-aware image synthesis using image-to-image translation techniques via conditional adversarial generative networks for generation of different hair occlusions in skin images, along with ground-truth mask for hair location. Hair-occluded image is synthesized using the latent structure of any input hair-free image by deep encoding the input image into a latent vector of features. The locations of required hair are highlighted using white pixels on the input image. Then, these deep encoded features are used to reconstruct the synthetic highly realistic hair-occluded image. Besides, we explored using three loss functions including L1-norm, L2-norm and structural similarity index (SSIM) to maximize the image synthesis visual quality. For the evaluation of the generated samples, the t-SNE feature mapping and Bland-Altman test are used as visualization tools for the experimental results. The results show the superior performance of our proposed method compared to previous methods for hair synthesis with plausible colours and preserving the integrity of the lesion texture. The proposed method can be used to generate benchmarking datasets for comparing the performance of digital hair removal methods. The code is available online at: https://github.com/attiamohammed/realhair.
Collapse
Affiliation(s)
- Mohamed Attia
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia; Medical Research Institute, Alexandria University, Egypt.
| | - Mohammed Hossny
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Hailing Zhou
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Hamed Asadi
- School of Medicine, Melbourne University, Australia.
| | | |
Collapse
|
9
|
Skin Lesion Segmentation from Dermoscopic Images Using Convolutional Neural Network. SENSORS 2020; 20:s20061601. [PMID: 32183041 PMCID: PMC7147706 DOI: 10.3390/s20061601] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Revised: 02/26/2020] [Accepted: 03/09/2020] [Indexed: 12/23/2022]
Abstract
Clinical treatment of skin lesion is primarily dependent on timely detection and delimitation of lesion boundaries for accurate cancerous region localization. Prevalence of skin cancer is on the higher side, especially that of melanoma, which is aggressive in nature due to its high metastasis rate. Therefore, timely diagnosis is critical for its treatment before the onset of malignancy. To address this problem, medical imaging is used for the analysis and segmentation of lesion boundaries from dermoscopic images. Various methods have been used, ranging from visual inspection to the textural analysis of the images. However, accuracy of these methods is low for proper clinical treatment because of the sensitivity involved in surgical procedures or drug application. This presents an opportunity to develop an automated model with good accuracy so that it may be used in a clinical setting. This paper proposes an automated method for segmenting lesion boundaries that combines two architectures, the U-Net and the ResNet, collectively called Res-Unet. Moreover, we also used image inpainting for hair removal, which improved the segmentation results significantly. We trained our model on the ISIC 2017 dataset and validated it on the ISIC 2017 test set as well as the PH2 dataset. Our proposed model attained a Jaccard Index of 0.772 on the ISIC 2017 test set and 0.854 on the PH2 dataset, which are comparable results to the current available state-of-the-art techniques.
Collapse
|
10
|
Abstract
OBJECTIVE Dermoscopy is a useful technique for improving the diagnostic accuracy of various types of skin disorders. In China, dermoscopy has been widely accepted, and domestic researchers have made tremendous progress in the field of dermoscopy. The main purpose of this review is to summarize the current status of dermoscopy in China and identify its future directions. DATA SOURCES Articles included in this review were obtained by searching the following databases: Wanfang, China National Knowledge Infrastructure, PubMed, and the Web of Science. We focused on research published before 2019 with keywords including dermoscopy, dermoscopic, dermoscope and trichoscopy. STUDY SELECTION A total of 50 studies were selected. Of these studies, 20 studies were in Chinese and 30 in English, research samples of all the studies were collected from Chinese populations. RESULTS Since 2000, more than 380 articles about dermoscopy have been published in domestic or foreign journals. Dermoscopy can improve the diagnostic accuracy of neoplastic diseases, evaluating the therapeutic effect of treatment, and determining the treatment endpoint, and it can also assist in the differential diagnosis of inflammatory diseases and in the assessment of the severity of the disease. In addition, researches about the applications of dermoscopy during surgical treatment have been published. Training courses aiming to improve the diagnostic ability of dermatologists, either face-to-face or online, have been offered. The Chinese Skin Image Database, launched in 2017 as a work platform for dermatologists, has promoted the development of dermoscopy in China. Computer-aided diagnostic systems based on the Chinese population are ready for use. In the future, cooperation, resource sharing, talent development, image management, and computer-aided diagnosis will be important directions for the development of dermoscopy in China. CONCLUSION Dermoscopy has been widely used and developed in China, however, it still needs to address more challenges in the future.
Collapse
|
11
|
Attia M, Hossny M, Zhou H, Nahavandi S, Asadi H, Yazdabadi A. Digital hair segmentation using hybrid convolutional and recurrent neural networks architecture. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 177:17-30. [PMID: 31319945 DOI: 10.1016/j.cmpb.2019.05.010] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/20/2019] [Revised: 04/17/2019] [Accepted: 05/13/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Skin melanoma is one of the major health problems in many countries. Dermatologists usually diagnose melanoma by visual inspection of moles. Digital hair removal can provide a non-invasive way to remove hair and hair-like regions as a pre-processing step for skin lesion images. Hair removal has two main steps: hair segmentation and hair gaps inpainting. However, hair segmentation is a challenging task which requires manual tuning of thresholding parameters. Hard-coded threshold leads to over-segmentation (false positives) which in return changes the textural integrity of lesions and or under-segmentation (false negatives) which leaves hair traces and artefacts which affect subsequent diagnosis. Additionally, dermal hair exhibits different characteristics: thin; overlapping; faded; occluded and overlaid on textured lesions. METHODS In this presented paper, we proposed a deep learning approach based on a hybrid network of convolutional and recurrent layers for hair segmentation using weakly labelled data. We utilised the deep encoded features for accurate detection and delineation of hair in skin images. The encoded features are then fed into recurrent neural network layers to encode the spatial dependencies between disjointed patches. Experiments are conducted on a publicly available dataset, called "Towards Melanoma Detection: Challenge". We chose two metrics to evaluate the produced segmentation masks. The first metric is the Jaccard Index which penalises false positives and false negatives. The second metric is the tumour disturb pattern which assesses the overall effect over the lesion texture due to unnecessary inpainting as a result of over segmentation. The qualitative and quantitative evaluations are employed to compare the proposed technique with state-of-the-art methods. RESULTS The proposed approach showed superior segmentation accuracy as demonstrated by a Jaccard Index of 77.8% in comparison to a 66.5% reported by the state-of-the-art method. We also achieved tumour disturb pattern as low as 14% compared to 23% for the state-of-the-art method. CONCLUSION The hybrid architecture for segmentation was able to accurately delineate and segment the hair from the background including lesions and the skin using weakly labelled ground truth for training.
Collapse
Affiliation(s)
- Mohamed Attia
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Mohammed Hossny
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Hailing Zhou
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Australia.
| | - Hamed Asadi
- School of Medicine, Melbourne University, Australia.
| | | |
Collapse
|
12
|
Garcia-Arroyo JL, Garcia-Zapirain B. Segmentation of skin lesions in dermoscopy images using fuzzy classification of pixels and histogram thresholding. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 168:11-19. [PMID: 30527129 DOI: 10.1016/j.cmpb.2018.11.001] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2018] [Revised: 10/25/2018] [Accepted: 11/08/2018] [Indexed: 05/17/2023]
Abstract
BACKGROUND AND OBJECTIVE To ensure proper functioning of a Computer Aided Diagnosis (CAD) system for melanoma detection in dermoscopy images, it is important to accurately detect the border of the lesion. This paper proposes a method developed by the authors to address this problem. METHODS The algorithm for segmentation of skin lesions in dermoscopy images is based on fuzzy classification of pixels and subsequent histogram thresholding. RESULTS This method participated in the 2016 and 2017 ISBI (International Symposium on Biomedical Imaging) Challenges, hosted by the ISIC (International Skin Imaging Collaboration). It was tested against two public databases containing 379 and 600 images respectively, and compared using the same defined metrics (Accuracy, Dice Coefficient, Jaccard Index, Sensitivity and Specificity) with the rest of participating state-of-the-art work, obtaining good results: (0.934, 0.869, 0.791, 0.870 and 0.978) and (0.884, 0.760, 0.665, 0.869 and 0.923) respectively, ranking 9th and 15th out of a total of 21 and 28 participants respectively using the Jaccard Index (which was the indicator used as a basis for ranking) and the 1st in the 2017 Challenge using the Sensitivity. CONCLUSION The method has been proven to be robust and reliable. It's main contribution is the very design of the algorithm, highly innovative, which could also be used to deal with other segmentation problems of a similar nature.
Collapse
Affiliation(s)
- Jose Luis Garcia-Arroyo
- Deustotech-LIFE Unit (eVIDA), University of Deusto Avda. Universidades, 24. 48007 Bilbao, Spain.
| | - Begonya Garcia-Zapirain
- Deustotech-LIFE Unit (eVIDA), University of Deusto Avda. Universidades, 24. 48007 Bilbao, Spain.
| |
Collapse
|
13
|
Guarracino MR, Maddalena L. SDI+: A Novel Algorithm for Segmenting Dermoscopic Images. IEEE J Biomed Health Inform 2018; 23:481-488. [PMID: 29994446 DOI: 10.1109/jbhi.2018.2808970] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Malignant skin lesions are among the most common types of cancer, and automated systems for their early detection are of fundamental importance. We propose SDI+, an unsupervised algorithm for the segmentation of skin lesions in dermoscopic images. It is articulated into three steps, aimed at extracting preliminary information on possible confounding factors, accurately segmenting the lesion, and post-processing the result. The overall method achieves high accuracy on dark skin lesions and can handle several cases where confounding factors could inhibit a clear understanding by a human operator. We present extensive experimental results and comparisons achieved by the SDI+ algorithm on the ISIC 2017 dataset, highlighting the advantages and disadvantages.
Collapse
|
14
|
Hair detection and lesion segmentation in dermoscopic images using domain knowledge. Med Biol Eng Comput 2018; 56:2051-2065. [DOI: 10.1007/s11517-018-1837-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Accepted: 04/23/2018] [Indexed: 10/16/2022]
|
15
|
Pathan S, Prabhu KG, Siddalingaswamy P. Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.07.010] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
16
|
Hair segmentation using adaptive threshold from edge and branch length measures. Comput Biol Med 2017; 89:314-324. [DOI: 10.1016/j.compbiomed.2017.08.020] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2017] [Revised: 08/19/2017] [Accepted: 08/20/2017] [Indexed: 11/18/2022]
|
17
|
Xie F, Fan H, Li Y, Jiang Z, Meng R, Bovik A. Melanoma Classification on Dermoscopy Images Using a Neural Network Ensemble Model. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:849-858. [PMID: 27913337 DOI: 10.1109/tmi.2016.2633551] [Citation(s) in RCA: 87] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We develop a novel method for classifying melanocytic tumors as benign or malignant by the analysis of digital dermoscopy images. The algorithm follows three steps: first, lesions are extracted using a self-generating neural network (SGNN); second, features descriptive of tumor color, texture and border are extracted; and third, lesion objects are classified using a classifier based on a neural network ensemble model. In clinical situations, lesions occur that are too large to be entirely contained within the dermoscopy image. To deal with this difficult presentation, new border features are proposed, which are able to effectively characterize border irregularities on both complete lesions and incomplete lesions. In our model, a network ensemble classifier is designed that combines back propagation (BP) neural networks with fuzzy neural networks to achieve improved performance. Experiments are carried out on two diverse dermoscopy databases that include images of both the xanthous and caucasian races. The results show that classification accuracy is greatly enhanced by the use of the new border features and the proposed classifier model.
Collapse
|
18
|
Computational methods for pigmented skin lesion classification in images: review and future trends. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2482-6] [Citation(s) in RCA: 104] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
19
|
Oliveira RB, Filho ME, Ma Z, Papa JP, Pereira AS, Tavares JMRS. Computational methods for the image segmentation of pigmented skin lesions: A review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 131:127-141. [PMID: 27265054 DOI: 10.1016/j.cmpb.2016.03.032] [Citation(s) in RCA: 86] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2015] [Revised: 03/03/2016] [Accepted: 03/30/2016] [Indexed: 06/05/2023]
Abstract
BACKGROUND AND OBJECTIVES Because skin cancer affects millions of people worldwide, computational methods for the segmentation of pigmented skin lesions in images have been developed in order to assist dermatologists in their diagnosis. This paper aims to present a review of the current methods, and outline a comparative analysis with regards to several of the fundamental steps of image processing, such as image acquisition, pre-processing and segmentation. METHODS Techniques that have been proposed to achieve these tasks were identified and reviewed. As to the image segmentation task, the techniques were classified according to their principle. RESULTS The techniques employed in each step are explained, and their strengths and weaknesses are identified. In addition, several of the reviewed techniques are applied to macroscopic and dermoscopy images in order to exemplify their results. CONCLUSIONS The image segmentation of skin lesions has been addressed successfully in many studies; however, there is a demand for new methodologies in order to improve the efficiency.
Collapse
Affiliation(s)
- Roberta B Oliveira
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - Mercedes E Filho
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - Zhen Ma
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - João P Papa
- Departamento de Computação, Faculdade de Ciências, Universidade Estadual Paulista, av. Eng. Luiz Edmundo Carrijo Coube, 14-01, 17033-360 Bauru, SP, Brazil
| | - Aledir S Pereira
- Departamento de Ciências de Computação e Estatística, Instituto de Biociências, Letras e Ciências Exatas, Universidade Estadual Paulista, rua Cristóvão Colombo, 2265, 15054-000 São José do Rio Preto, SP, Brazil
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal.
| |
Collapse
|
20
|
Xie F, Lu Y, Bovik AC, Jiang Z, Meng R. Application-Driven No-Reference Quality Assessment for Dermoscopy Images With Multiple Distortions. IEEE Trans Biomed Eng 2016; 63:1248-56. [DOI: 10.1109/tbme.2015.2493580] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
21
|
Maglogiannis I, Delibasis K. Hair removal on dermoscopy images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2015:2960-3. [PMID: 26736913 DOI: 10.1109/embc.2015.7319013] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Digital Dermoscopy is a tool commonly used by dermatologists for assisting the diagnosis of skin lesions. The presence of hair in such dermoscopic images frequently occludes significant diagnostic information and reduces their value. In this work we propose algorithms that successfully identify and remove hair from the dermoscopic images. The proposed algorithms consist of two parts; the first deals with the identification of hair, while the second part concerns the image restoration using interpolation. For the evaluation of the algorithms we used ground truth images with synthetic hair and compared the results with the commonly used in the literature DullRazor tool. According to the experimental results the proposed hair removal algorithms can be used successfully in the detection and removal of both dark and light colored hair.
Collapse
|
22
|
Abuzaghleh O, Barkana BD, Faezipour M. Noninvasive Real-Time Automated Skin Lesion Analysis System for Melanoma Early Detection and Prevention. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2015; 3:2900310. [PMID: 27170906 PMCID: PMC4848099 DOI: 10.1109/jtehm.2015.2419612] [Citation(s) in RCA: 103] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/08/2014] [Revised: 01/05/2015] [Accepted: 03/21/2015] [Indexed: 11/11/2022]
Abstract
Melanoma spreads through metastasis, and therefore, it has been proved to be very fatal. Statistical evidence has revealed that the majority of deaths resulting from skin cancer are as a result of melanoma. Further investigations have shown that the survival rates in patients depend on the stage of the cancer; early detection and intervention of melanoma implicate higher chances of cure. Clinical diagnosis and prognosis of melanoma are challenging, since the processes are prone to misdiagnosis and inaccuracies due to doctors’ subjectivity. Malignant melanomas are asymmetrical, have irregular borders, notched edges, and color variations, so analyzing the shape, color, and texture of the skin lesion is important for the early detection and prevention of melanoma. This paper proposes the two major components of a noninvasive real-time automated skin lesion analysis system for the early detection and prevention of melanoma. The first component is a real-time alert to help users prevent skinburn caused by sunlight; a novel equation to compute the time for skin to burn is thereby introduced. The second component is an automated image analysis module, which contains image acquisition, hair detection and exclusion, lesion segmentation, feature extraction, and classification. The proposed system uses PH2 Dermoscopy image database from Pedro Hispano Hospital for the development and testing purposes. The image database contains a total of 200 dermoscopy images of lesions, including benign, atypical, and melanoma cases. The experimental results show that the proposed system is efficient, achieving classification of the benign, atypical, and melanoma images with accuracy of 96.3%, 95.7%, and 97.5%, respectively.
Collapse
|
23
|
Xie F, Li Y, Meng R, Jiang Z. No-reference hair occlusion assessment for dermoscopy images based on distribution feature. Comput Biol Med 2015; 59:106-115. [PMID: 25701625 DOI: 10.1016/j.compbiomed.2015.01.023] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2014] [Revised: 01/29/2015] [Accepted: 01/30/2015] [Indexed: 10/24/2022]
Abstract
The presence of hair is a common quality problem for dermoscopy images, which may influence the accuracy of lesion analysis. In this paper, a novel no-reference hair occlusion assessment method is proposed according to the distribution feature of hairs in the dermoscopy image. Firstly, the image is adaptively enhanced by simple linear iterative clustering (SLIC) combined with isotropic nonlinear filtering (INF). Then, hairs are extracted from the image by an automatic threshold and meanwhile the postprocessing is used to refine the hair through re-extracting omissive hairs and filtering false hairs. Finally, the degree of hair occlusion is evaluated by an objective metric based on the hair distribution. A series of experiments was carried out on both simulated images and real images. The result shows that the proposed local adaptive hair detection method can work well on both sparse hair and dense hair, and the designed metric can effectively evaluate the degree of hair occlusion.
Collapse
Affiliation(s)
- Fengying Xie
- Image Processing Center, School of Astronautics, BeiHang University, Beijing 100191, China.
| | - Yang Li
- Image Processing Center, School of Astronautics, BeiHang University, Beijing 100191, China.
| | - Rusong Meng
- General Hospital of the Air Force, PLA, Beijing 100036, China.
| | - Zhiguo Jiang
- Image Processing Center, School of Astronautics, BeiHang University, Beijing 100191, China.
| |
Collapse
|
24
|
Maglogiannis I, Delibasis KK. Enhancing classification accuracy utilizing globules and dots features in digital dermoscopy. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2015; 118:124-133. [PMID: 25540998 DOI: 10.1016/j.cmpb.2014.12.001] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2014] [Revised: 10/14/2014] [Accepted: 12/01/2014] [Indexed: 06/04/2023]
Abstract
The interest in image dermoscopy has been significantly increased recently and skin lesion images are nowadays routinely acquired for a number of skin disorders. An important finding in the assessment of a skin lesion severity is the existence of dark dots and globules, which are hard to locate and count using existing image software tools. In this work we present a novel methodology for detecting/segmenting and count dark dots and globules from dermoscopy images. Segmentation is performed using a multi-resolution approach based on inverse non-linear diffusion. Subsequently, a number of features are extracted from the segmented dots/globules and their diagnostic value in automatic classification of dermoscopy images of skin lesions into melanoma and non-malignant nevus is evaluated. The proposed algorithm is applied to a number of images with skin lesions with known histo-pathology. Results show that the proposed algorithm is very effective in automatically segmenting dark dots and globules. Furthermore, it was found that the features extracted from the segmented dots/globules can enhance the performance of classification algorithms that discriminate between malignant and benign skin lesions, when they are combined with other region-based descriptors.
Collapse
|
25
|
Mirzaalian H, Lee TK, Hamarneh G. Hair enhancement in dermoscopic images using dual-channel quaternion tubularness filters and MRF-based multilabel optimization. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2014; 23:5486-5496. [PMID: 25312927 DOI: 10.1109/tip.2014.2362054] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Hair occlusion is one of the main challenges facing automatic lesion segmentation and feature extraction for skin cancer applications. We propose a novel method for simultaneously enhancing both light and dark hairs with variable widths, from dermoscopic images, without the prior knowledge of the hair color. We measure hair tubularness using a quaternion color curvature filter. We extract optimal hair features (tubularness, scale, and orientation) using Markov random field theory and multilabel optimization. We also develop a novel dual-channel matched filter to enhance hair pixels in the dermoscopic images while suppressing irrelevant skin pixels. We evaluate the hair enhancement capabilities of our method on hair-occluded images generated via our new hair simulation algorithm. Since hair enhancement is an intermediate step in a computer-aided diagnosis system for analyzing dermoscopic images, we validate our method and compare it to other methods by studying its effect on: 1) hair segmentation accuracy; 2) image inpainting quality; and 3) image classification accuracy. The validation results on 40 real clinical dermoscopic images and 94 synthetic data demonstrate that our approach outperforms competing hair enhancement methods.
Collapse
|
26
|
Toossi MTB, Pourreza HR, Zare H, Sigari MH, Layegh P, Azimi A. An effective hair removal algorithm for dermoscopy images. Skin Res Technol 2013; 19:230-5. [DOI: 10.1111/srt.12015] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/09/2012] [Indexed: 11/28/2022]
Affiliation(s)
- Mohammad Taghi Bahreyni Toossi
- Medical Physics Research Center, Medical Physics Department; Faculty of Medicine; Mashhad University of Medical Sciences; Mashhad Iran
| | - Hamid Reza Pourreza
- Computer Engineering Department; Ferdowsi University of Mashhad; Mashhad Iran
| | - Hoda Zare
- Medical Physics Research Center, Medical Physics Department; Faculty of Medicine; Mashhad University of Medical Sciences; Mashhad Iran
- Radiologic Technology Department; Faculty of Paramedical Sciences; Mashhad University of Medical Sciences; Mashhad Iran
| | - Mohamad-Hoseyn Sigari
- Control & Intelligent Processing Center of Excellence (CIPCE); School of Electrical & Computer Engineering; College of Engineering, University of Tehran; Tehran Iran
| | - Pouran Layegh
- Department of Dermatology; Research Center for Cutaneous Leishmaniasis; Qaem Hospital, Faculty of Medicine, Mashhad University of Medical Sciences; Mashhad Iran
| | - Abbas Azimi
- Department of Optometry; Faculty of Paramedical Sciences; Mashhad University of Medical Sciences; Mashhad Iran
| |
Collapse
|
27
|
Computerized analysis of pigmented skin lesions: A review. Artif Intell Med 2012; 56:69-90. [DOI: 10.1016/j.artmed.2012.08.002] [Citation(s) in RCA: 238] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2012] [Revised: 08/02/2012] [Accepted: 08/19/2012] [Indexed: 11/20/2022]
|
28
|
Afonso A, Silveira M. Hair detection in dermoscopic images using percolation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2012; 2012:4378-4381. [PMID: 23366897 DOI: 10.1109/embc.2012.6346936] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The automatic analysis of dermoscopy images is often impaired by artifacts such as air bubbles, specular reflections or dark hair covering the skin lesions. Consequently, an important pre-processing step includes their detection and elimination. The most common and probably the most compromising of these artifacts is the presence of hair and therefore specific algorithms are required for its detection. This paper proposes a method for the detection of hair in dermoscopy images based on an efficient percolation algorithm for image processing recently proposed in [1]. The percolation algorithm locally processes image points by taking into account the intensity and connectivity of neighboring pixels. A cluster of connected points is thus obtained and the shape of this cluster is subsequently analyzed. If the cluster has a shape that is approximately linear then the image point is classified as hair. The performance of the proposed method was investigated on real dermoscopy images and compared with the DullRazor software [2]. Our results indicate that the method provides effective hair detection outperforming the DullRazor method by more than 10%, both in terms of false positive and false negative rates.
Collapse
Affiliation(s)
- Ana Afonso
- Institute for Systems and Robotics-Instituto Superior Tecnico, Av. Rovisco Pais, 1, 1049-001 Lisboa, Portugal.
| | | |
Collapse
|
29
|
Abbas Q, Garcia IF, Emre Celebi M, Ahmad W. A Feature-Preserving Hair Removal Algorithm for Dermoscopy Images. Skin Res Technol 2011; 19:e27-36. [DOI: 10.1111/j.1600-0846.2011.00603.x] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/20/2011] [Indexed: 11/30/2022]
Affiliation(s)
| | - Irene Fondón Garcia
- Department of Signal Theory and Communications; School of Engineering Path of Discovery s/n C. P.; Seville; Spain
| | - M. Emre Celebi
- Department of Computer Science; Louisiana State University; Shreveport; Louisiana; USA
| | | |
Collapse
|
30
|
Abbas Q, Fondón I, Rashid M. Unsupervised skin lesions border detection via two-dimensional image analysis. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2011; 104:e1-e15. [PMID: 20663582 DOI: 10.1016/j.cmpb.2010.06.016] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2009] [Revised: 06/25/2010] [Accepted: 06/28/2010] [Indexed: 05/29/2023]
Abstract
The skin cancer was analyzed by dermoscopy helpful for dermatologists. The classification of melanoma and carcinoma such as basal cell, squamous cell, and merkel cell carcinomas tumors can be increased the sensitivity and specificity. The detection of an automated border is an important step for the correctness of subsequent phases in the computerized melanoma recognition systems. The artifacts such as, dermoscopy-gel, specular reflection and outline (skin lines, blood vessels, and hair or ruler markings) were also contained in the dermoscopic images. In this paper, we present an unsupervised approach for multiple lesion segmentation, modification of Region-based Active Contours (RACs) as well as artifact diminution steps. Iterative thresholding is applied to initialize level set automatically; the stability of curves is enforced by maximum smoothing constraints on Courant-Friedreichs-Lewy (CFL) function. The work has been tested on dermoscopic database of 320 images. The border detection error is quantified by five distinct statistical metrics and manually used to determine the borders from a dermatologist as the ground truth. The segmentation results were compared with other state-of-the-art methods along with the evaluation criteria. The unsupervised border detection system increased the true detection rate (TDR) is 4.31% and reduced the false positive rate (FPR) of 5.28%.
Collapse
Affiliation(s)
- Qaisar Abbas
- Department of Computer Science and Technology, Huazhong University of Science and Technology, 1037 Luoyu Road, Wuhan 430074, China.
| | | | | |
Collapse
|
31
|
|
32
|
Wighton P, Lee TK, Lui H, McLean DI, Atkins MS. Generalizing Common Tasks in Automated Skin Lesion Diagnosis. ACTA ACUST UNITED AC 2011; 15:622-9. [DOI: 10.1109/titb.2011.2150758] [Citation(s) in RCA: 62] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
33
|
Fiorese M, Peserico E, Silletti A. VirtualShave: automated hair removal from digital dermatoscopic images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2011; 2011:5145-5148. [PMID: 22255497 DOI: 10.1109/iembs.2011.6091274] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
VirtualShave is a novel tool to remove hair from digital dermatoscopic images. First, individual hairs are identified using a top-hat filter followed by morphological postprocessing. Then, they are replaced through PDE-based inpainting with an estimate of the underlying occluded skin. VirtualShave's performance is comparable to that of a human operator removing hair manually, and the resulting images are almost indistinguishable from those of hair-free skin.
Collapse
|