1
|
Ragab M, Choudhry H, Al-Rabia MW, Binyamin SS, Aldarmahi AA, Mansour RF. Early and accurate detection of melanoma skin cancer using hybrid level set approach. Front Physiol 2022; 13:965630. [PMID: 36545278 PMCID: PMC9760861 DOI: 10.3389/fphys.2022.965630] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Accepted: 11/21/2022] [Indexed: 12/12/2022] Open
Abstract
Digital dermoscopy is used to identify cancer in skin lesions, and sun exposure is one of the leading causes of melanoma. It is crucial to distinguish between healthy skin and malignant lesions when using computerised lesion detection and classification. Lesion segmentation influences categorization accuracy and precision. This study introduces a novel way of classifying lesions. Hair filters, gel, bubbles, and specular reflection are all options. An improved levelling method is employed in an innovative method for detecting and removing cancerous hairs. The lesion is distinguished from the surrounding skin by the adaptive sigmoidal function; this function considers the severity of localised lesions. An improved technique for identifying a lesion from surrounding tissue is proposed in the article, followed by a classifier and available features that resulted in 94.40% accuracy and 93% success. According to research, the best method for selecting features and classifications can produce more accurate predictions before and during treatment. When the recommended strategy is put to the test using the Melanoma Skin Cancer Dataset, the recommended technique outperforms the alternative.
Collapse
Affiliation(s)
- Mahmoud Ragab
- Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia,Centre for Artificial Intelligence in Precision Medicines, King Abdulaziz University, Jeddah, Saudi Arabia,Mathematics Department, Faculty of Science, Al-Azhar University, Nasr City, Egypt,*Correspondence: Mahmoud Ragab,
| | - Hani Choudhry
- Centre for Artificial Intelligence in Precision Medicines, King Abdulaziz University, Jeddah, Saudi Arabia,Biochemistry Department, Faculty of Science, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Mohammed W. Al-Rabia
- Department of Medical Microbiology and Parasitology, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia,Health Promotion Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Sami Saeed Binyamin
- Computer and Information Technology Department, The Applied College, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Ahmed A. Aldarmahi
- Basic Science Department, College of Science and Health Professions, King Saud Bin Abdulaziz University for Health Sciences, Jeddah, Saudi Arabia,King Abdullah International Medical Research Center, Ministry of National Guard—Health Affairs, Jeddah, Saudi Arabia
| | - Romany F. Mansour
- Department of Mathematics, Faculty of Science, New Valley University, El-Kharga, Egypt
| |
Collapse
|
2
|
A Dermoscopic Inspired System for Localization and Malignancy Classification of Melanocytic Lesions. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This study aims at developing a clinically oriented automated diagnostic tool for distinguishing malignant melanocytic lesions from benign melanocytic nevi in diverse image databases. Due to the presence of artifacts, smooth lesion boundaries, and subtlety in diagnostic features, the accuracy of such systems gets hampered. Thus, the proposed framework improves the accuracy of melanoma detection by combining the clinical aspects of dermoscopy. Two methods have been adopted for achieving the aforementioned objective. Firstly, artifact removal and lesion localization are performed. In the second step, various clinically significant features such as shape, color, texture, and pigment network are detected. Features are further reduced by checking their individual significance (i.e., hypothesis testing). These reduced feature vectors are then classified using SVM classifier. Features specific to the domain have been used for this design as opposed to features of the abstract images. The domain knowledge of an expert gets enhanced by this methodology. The proposed approach is implemented on a multi-source dataset (PH2 + ISBI 2016 and 2017) of 515 annotated images, thereby resulting in sensitivity, specificity and accuracy of 83.8%, 88.3%, and 86%, respectively. The experimental results are promising, and can be applied to detect asymmetry, pigment network, colors, and texture of the lesions.
Collapse
|
3
|
Egger J, Wild D, Weber M, Bedoya CAR, Karner F, Prutsch A, Schmied M, Dionysio C, Krobath D, Jin Y, Gsaxner C, Li J, Pepe A. Studierfenster: an Open Science Cloud-Based Medical Imaging Analysis Platform. J Digit Imaging 2022; 35:340-355. [PMID: 35064372 PMCID: PMC8782222 DOI: 10.1007/s10278-021-00574-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 12/14/2021] [Accepted: 12/16/2021] [Indexed: 02/06/2023] Open
Abstract
Imaging modalities such as computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in diagnostics, clinical studies, and treatment planning. Automatic algorithms for image analysis have thus become an invaluable tool in medicine. Examples of this are two- and three-dimensional visualizations, image segmentation, and the registration of all anatomical structure and pathology types. In this context, we introduce Studierfenster (www.studierfenster.at): a free, non-commercial open science client-server framework for (bio-)medical image analysis. Studierfenster offers a wide range of capabilities, including the visualization of medical data (CT, MRI, etc.) in two-dimensional (2D) and three-dimensional (3D) space in common web browsers, such as Google Chrome, Mozilla Firefox, Safari, or Microsoft Edge. Other functionalities are the calculation of medical metrics (dice score and Hausdorff distance), manual slice-by-slice outlining of structures in medical images, manual placing of (anatomical) landmarks in medical imaging data, visualization of medical data in virtual reality (VR), and a facial reconstruction and registration of medical data for augmented reality (AR). More sophisticated features include the automatic cranial implant design with a convolutional neural network (CNN), the inpainting of aortic dissections with a generative adversarial network, and a CNN for automatic aortic landmark detection in CT angiography images. A user study with medical and non-medical experts in medical image analysis was performed, to evaluate the usability and the manual functionalities of Studierfenster. When participants were asked about their overall impression of Studierfenster in an ISO standard (ISO-Norm) questionnaire, a mean of 6.3 out of 7.0 possible points were achieved. The evaluation also provided insights into the results achievable with Studierfenster in practice, by comparing these with two ground truth segmentations performed by a physician of the Medical University of Graz in Austria. In this contribution, we presented an online environment for (bio-)medical image analysis. In doing so, we established a client-server-based architecture, which is able to process medical data, especially 3D volumes. Our online environment is not limited to medical applications for humans. Rather, its underlying concept could be interesting for researchers from other fields, in applying the already existing functionalities or future additional implementations of further image processing applications. An example could be the processing of medical acquisitions like CT or MRI from animals [Clinical Pharmacology & Therapeutics, 84(4):448–456, 68], which get more and more common, as veterinary clinics and centers get more and more equipped with such imaging devices. Furthermore, applications in entirely non-medical research in which images/volumes need to be processed are also thinkable, such as those in optical measuring techniques, astronomy, or archaeology.
Collapse
Affiliation(s)
- Jan Egger
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
- Computer Algorithms for Medicine Laboratory, Graz, Austria.
- Institute for Artificial Intelligence in Medicine, AI-guided Therapies, University Hospital Essen, Girardetstraße 2, 45131, Essen, Germany.
| | - Daniel Wild
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Maximilian Weber
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Christopher A Ramirez Bedoya
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Florian Karner
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Alexander Prutsch
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Michael Schmied
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Christina Dionysio
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Dominik Krobath
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Yuan Jin
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
- Research Center for Connected Healthcare Big Data, ZhejiangLab, 311121, Hangzhou, Zhejiang, China
| | - Christina Gsaxner
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| | - Jianning Li
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
- Institute for Artificial Intelligence in Medicine, AI-guided Therapies, University Hospital Essen, Girardetstraße 2, 45131, Essen, Germany
| | - Antonio Pepe
- Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia
- Computer Algorithms for Medicine Laboratory, Graz, Austria
| |
Collapse
|
4
|
Abstract
Recently, the incidence of skin cancer has increased considerably and is seriously threatening human health. Automatic detection of this disease, where early detection is critical to human life, is quite challenging. Factors such as undesirable residues (hair, ruler markers), indistinct boundaries, variable contrast, shape differences, and color differences in the skin lesion images make automatic analysis quite difficult. To overcome these challenges, a highly effective segmentation method based on a fully convolutional network (FCN) is presented in this paper. The proposed improved FCN (iFCN) architecture is used for the segmentation of full-resolution skin lesion images without any pre- or post-processing. It is to support the residual structure of the FCN architecture with spatial information. This situation, which creates a more advanced residual system, enables more precise detection of details on the edges of the lesion, and an analysis independent of skin color can be performed. It offers two contributions: determining the center of the lesion and clarifying the edge details despite the undesirable effects. Two publicly available datasets, the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 Challenge and PH2 datasets, are used to evaluate the performance of the iFCN method. The mean Jaccard index is 78.34%, the mean Dice score is 88.64%, and the mean accuracy value is 95.30% for the proposed method for the ISBI 2017 test dataset. Furthermore, the mean Jaccard index is 87.1%, the mean Dice score is 93.02%, and the mean accuracy value is 96.92% for the proposed method for the PH2 test dataset.
Collapse
Affiliation(s)
- Şaban Öztürk
- Technology Faculty, Electrical and Electronics Engineering, Amasya University, Amasya, Turkey.
| | - Umut Özkaya
- Engineering and Natural Science Faculty, Electrical and Electronics Engineering, Konya Technical University, Konya, Turkey
| |
Collapse
|
5
|
Okuboyejo D, Olugbara OO. Segmentation of Melanocytic Lesion Images Using Gamma Correction with Clustering of Keypoint Descriptors. Diagnostics (Basel) 2021; 11:1366. [PMID: 34441300 PMCID: PMC8391259 DOI: 10.3390/diagnostics11081366] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 07/26/2021] [Accepted: 07/27/2021] [Indexed: 01/14/2023] Open
Abstract
The early detection of skin cancer, especially through the examination of lesions with malignant characteristics, has been reported to significantly decrease the potential fatalities. Segmentation of the regions that contain the actual lesions is one of the most widely used steps for achieving an automated diagnostic process of skin lesions. However, accurate segmentation of skin lesions has proven to be a challenging task in medical imaging because of the intrinsic factors such as the existence of undesirable artifacts and the complexity surrounding the seamless acquisition of lesion images. In this paper, we have introduced a novel algorithm based on gamma correction with clustering of keypoint descriptors for accurate segmentation of lesion areas in dermoscopy images. The algorithm was tested on dermoscopy images acquired from the publicly available dataset of Pedro Hispano hospital to achieve compelling equidistant sensitivity, specificity, and accuracy scores of 87.29%, 99.54%, and 96.02%, respectively. Moreover, the validation of the algorithm on a subset of heavily noised skin lesion images collected from the public dataset of International Skin Imaging Collaboration has yielded the equidistant sensitivity, specificity, and accuracy scores of 80.59%, 100.00%, and 94.98%, respectively. The performance results are propitious when compared to those obtained with existing modern algorithms using the same standard benchmark datasets and performance evaluation indices.
Collapse
Affiliation(s)
| | - Oludayo O. Olugbara
- ICT and Society Research Group, South Africa Luban Workshop, Durban University of Technology, Durban 4000, South Africa;
| |
Collapse
|
6
|
|
7
|
Baig R, Bibi M, Hamid A, Kausar S, Khalid S. Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review. Curr Med Imaging 2021; 16:513-533. [PMID: 32484086 DOI: 10.2174/1573405615666190129120449] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 12/17/2018] [Accepted: 01/02/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND Automated intelligent systems for unbiased diagnosis are primary requirement for the pigment lesion analysis. It has gained the attention of researchers in the last few decades. These systems involve multiple phases such as pre-processing, feature extraction, segmentation, classification and post processing. It is crucial to accurately localize and segment the skin lesion. It is observed that recent enhancements in machine learning algorithms and dermoscopic techniques reduced the misclassification rate therefore, the focus towards computer aided systems increased exponentially in recent years. Computer aided diagnostic systems are reliable source for dermatologists to analyze the type of cancer, but it is widely acknowledged that even higher accuracy is needed for computer aided diagnostic systems to be adopted practically in the diagnostic process of life threatening diseases. INTRODUCTION Skin cancer is one of the most threatening cancers. It occurs by the abnormal multiplication of cells. The core three types of skin cells are: Squamous, Basal and Melanocytes. There are two wide classes of skin cancer; Melanocytic and non-Melanocytic. It is difficult to differentiate between benign and malignant melanoma, therefore dermatologists sometimes misclassify the benign and malignant melanoma. Melanoma is estimated as 19th most frequent cancer, it is riskier than the Basel and Squamous carcinoma because it rapidly spreads throughout the body. Hence, to lower the death risk, it is critical to diagnose the correct type of cancer in early rudimentary phases. It can occur on any part of body, but it has higher probability to occur on chest, back and legs. METHODS The paper presents a review of segmentation and classification techniques for skin lesion detection. Dermoscopy and its features are discussed briefly. After that Image pre-processing techniques are described. A thorough review of segmentation and classification phases of skin lesion detection using deep learning techniques is presented Literature is discussed and a comparative analysis of discussed methods is presented. CONCLUSION In this paper, we have presented the survey of more than 100 papers and comparative analysis of state of the art techniques, model and methodologies. Malignant melanoma is one of the most threating and deadliest cancers. Since the last few decades, researchers are putting extra attention and effort in accurate diagnosis of melanoma. The main challenges of dermoscopic skin lesion images are: low contrasts, multiple lesions, irregular and fuzzy borders, blood vessels, regression, hairs, bubbles, variegated coloring and other kinds of distortions. The lack of large training dataset makes these problems even more challenging. Due to recent advancement in the paradigm of deep learning, and specially the outstanding performance in medical imaging, it has become important to review the deep learning algorithms performance in skin lesion segmentation. Here, we have discussed the results of different techniques on the basis of different evaluation parameters such as Jaccard coefficient, sensitivity, specificity and accuracy. And the paper listed down the major achievements in this domain with the detailed discussion of the techniques. In future, it is expected to improve results by utilizing the capabilities of deep learning frameworks with other pre and post processing techniques so reliable and accurate diagnostic systems can be built.
Collapse
Affiliation(s)
- Ramsha Baig
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Maryam Bibi
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Anmol Hamid
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Sumaira Kausar
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Shahzad Khalid
- Department of Computer Engineering, Bahria University, Islamabad, Pakistan
| |
Collapse
|
8
|
A High-Accuracy Mathematical Morphology and Multilayer Perceptron-Based Approach for Melanoma Detection. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10031098] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
According to the World Health Organization (WHO), melanoma is the most severe type of skin cancer and is the leading cause of death from skin cancer worldwide. Certain features of melanoma include size, shape, color, or texture changes of a mole. In this work, a novel, robust and efficient method for the detection and classification of melanoma in simple and dermatological images is proposed. It is achieved by using HSV (Hue, Saturation, Value) color space along with mathematical morphology and a Gaussian filter to detect the region of interest and estimate four descriptors: symmetry, edge, color, and size. Although these descriptors have been used for several years, the way they are computed for this proposal is one of the things that enhances the results. Subsequently, a multilayer perceptron is employed to classify between malignant and benign melanoma. Three datasets of simple and dermatological images commonly used in the literature were employed to train and evaluate the performance of the proposed method. According to k-fold cross-validation, the method outperforms three state-of-art works, achieving an accuracy of 98.5% and 98.6%, a sensitivity of 96.68% and 98.05%, and a specificity of 98.15%, and 98.01%, in simple and dermatological images, respectively. The results have proven that its use as an assistive device for the detection of melanoma would improve reliability levels compared to conventional methods.
Collapse
|
9
|
Abstract
OBJECTIVE Dermoscopy is a useful technique for improving the diagnostic accuracy of various types of skin disorders. In China, dermoscopy has been widely accepted, and domestic researchers have made tremendous progress in the field of dermoscopy. The main purpose of this review is to summarize the current status of dermoscopy in China and identify its future directions. DATA SOURCES Articles included in this review were obtained by searching the following databases: Wanfang, China National Knowledge Infrastructure, PubMed, and the Web of Science. We focused on research published before 2019 with keywords including dermoscopy, dermoscopic, dermoscope and trichoscopy. STUDY SELECTION A total of 50 studies were selected. Of these studies, 20 studies were in Chinese and 30 in English, research samples of all the studies were collected from Chinese populations. RESULTS Since 2000, more than 380 articles about dermoscopy have been published in domestic or foreign journals. Dermoscopy can improve the diagnostic accuracy of neoplastic diseases, evaluating the therapeutic effect of treatment, and determining the treatment endpoint, and it can also assist in the differential diagnosis of inflammatory diseases and in the assessment of the severity of the disease. In addition, researches about the applications of dermoscopy during surgical treatment have been published. Training courses aiming to improve the diagnostic ability of dermatologists, either face-to-face or online, have been offered. The Chinese Skin Image Database, launched in 2017 as a work platform for dermatologists, has promoted the development of dermoscopy in China. Computer-aided diagnostic systems based on the Chinese population are ready for use. In the future, cooperation, resource sharing, talent development, image management, and computer-aided diagnosis will be important directions for the development of dermoscopy in China. CONCLUSION Dermoscopy has been widely used and developed in China, however, it still needs to address more challenges in the future.
Collapse
|
10
|
Talavera-Martínez L, Bibiloni P, González-Hidalgo M. Computational texture features of dermoscopic images and their link to the descriptive terminology: A survey. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 182:105049. [PMID: 31494412 DOI: 10.1016/j.cmpb.2019.105049] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 08/12/2019] [Accepted: 08/23/2019] [Indexed: 06/10/2023]
Abstract
Computer-extracted texture features are relevant to diagnose cutaneous lesions such as melanomas. Our goal is to set a relationship between a well-established descriptive terminology, which describes the attributes of dermoscopic structures based on their aspect rather than their underlying causes, and the computational methods to extract texture-based features. By tackling this problem, we can ascertain what indicators used by dermatologists are reflected in the extracted texture features. We first review the state-of-the-art models for texture extraction in dermoscopic images. By comparing the methods' performance and goals, we conclude that (I) a single color space does not seem to give performances as good as using several ones, thus the latter is reasonable (II) the optimal number of extracted features seems to vary depending on the method's goal, and extracting a large number of features can lead to a loss of models robustness (III) methods such as GLCM, Sobel or Law energy filters are mainly used to capture local properties to detect specific dermoscopic structures (IV) methods that extract local and global features, like Gabor wavelets or SPT, tend to be used to analyze the presence of certain patterns of dermoscopic structures, e.g. globular, reticular, etc.
Collapse
Affiliation(s)
- Lidia Talavera-Martínez
- Universitat de les Illes Balears, SCOPIA Research Group, Palma 07122, Spain; Balearic Islands Health Research Institute (IdISBa), Palma 07010, Spain.
| | - Pedro Bibiloni
- Universitat de les Illes Balears, SCOPIA Research Group, Palma 07122, Spain; Balearic Islands Health Research Institute (IdISBa), Palma 07010, Spain.
| | - Manuel González-Hidalgo
- Universitat de les Illes Balears, SCOPIA Research Group, Palma 07122, Spain; Balearic Islands Health Research Institute (IdISBa), Palma 07010, Spain.
| |
Collapse
|
11
|
Ünver HM, Ayan E. Skin Lesion Segmentation in Dermoscopic Images with Combination of YOLO and GrabCut Algorithm. Diagnostics (Basel) 2019; 9:E72. [PMID: 31295856 PMCID: PMC6787581 DOI: 10.3390/diagnostics9030072] [Citation(s) in RCA: 67] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 06/26/2019] [Accepted: 07/08/2019] [Indexed: 01/22/2023] Open
Abstract
Skin lesion segmentation has a critical role in the early and accurate diagnosis of skin cancer by computerized systems. However, automatic segmentation of skin lesions in dermoscopic images is a challenging task owing to difficulties including artifacts (hairs, gel bubbles, ruler markers), indistinct boundaries, low contrast and varying sizes and shapes of the lesion images. This paper proposes a novel and effective pipeline for skin lesion segmentation in dermoscopic images combining a deep convolutional neural network named as You Only Look Once (YOLO) and the GrabCut algorithm. This method performs lesion segmentation using a dermoscopic image in four steps: 1. Removal of hairs on the lesion, 2. Detection of the lesion location, 3. Segmentation of the lesion area from the background, 4. Post-processing with morphological operators. The method was evaluated on two publicly well-known datasets, that is the PH2 and the ISBI 2017 (Skin Lesion Analysis Towards Melanoma Detection Challenge Dataset). The proposed pipeline model has achieved a 90% sensitivity rate on the ISBI 2017 dataset, outperforming other deep learning-based methods. The method also obtained close results according to the results obtained from other methods in the literature in terms of metrics of accuracy, specificity, Dice coefficient, and Jaccard index.
Collapse
Affiliation(s)
- Halil Murat Ünver
- Department of Computer Engineering, Kırıkkale University, 71451 Kırıkkale, Turkey
| | - Enes Ayan
- Department of Computer Engineering, Kırıkkale University, 71451 Kırıkkale, Turkey.
| |
Collapse
|
12
|
Garcia-Arroyo JL, Garcia-Zapirain B. Segmentation of skin lesions in dermoscopy images using fuzzy classification of pixels and histogram thresholding. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 168:11-19. [PMID: 30527129 DOI: 10.1016/j.cmpb.2018.11.001] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2018] [Revised: 10/25/2018] [Accepted: 11/08/2018] [Indexed: 05/17/2023]
Abstract
BACKGROUND AND OBJECTIVE To ensure proper functioning of a Computer Aided Diagnosis (CAD) system for melanoma detection in dermoscopy images, it is important to accurately detect the border of the lesion. This paper proposes a method developed by the authors to address this problem. METHODS The algorithm for segmentation of skin lesions in dermoscopy images is based on fuzzy classification of pixels and subsequent histogram thresholding. RESULTS This method participated in the 2016 and 2017 ISBI (International Symposium on Biomedical Imaging) Challenges, hosted by the ISIC (International Skin Imaging Collaboration). It was tested against two public databases containing 379 and 600 images respectively, and compared using the same defined metrics (Accuracy, Dice Coefficient, Jaccard Index, Sensitivity and Specificity) with the rest of participating state-of-the-art work, obtaining good results: (0.934, 0.869, 0.791, 0.870 and 0.978) and (0.884, 0.760, 0.665, 0.869 and 0.923) respectively, ranking 9th and 15th out of a total of 21 and 28 participants respectively using the Jaccard Index (which was the indicator used as a basis for ranking) and the 1st in the 2017 Challenge using the Sensitivity. CONCLUSION The method has been proven to be robust and reliable. It's main contribution is the very design of the algorithm, highly innovative, which could also be used to deal with other segmentation problems of a similar nature.
Collapse
Affiliation(s)
- Jose Luis Garcia-Arroyo
- Deustotech-LIFE Unit (eVIDA), University of Deusto Avda. Universidades, 24. 48007 Bilbao, Spain.
| | - Begonya Garcia-Zapirain
- Deustotech-LIFE Unit (eVIDA), University of Deusto Avda. Universidades, 24. 48007 Bilbao, Spain.
| |
Collapse
|
13
|
Al-Masni MA, Al-Antari MA, Choi MT, Han SM, Kim TS. Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 162:221-231. [PMID: 29903489 DOI: 10.1016/j.cmpb.2018.05.027] [Citation(s) in RCA: 137] [Impact Index Per Article: 22.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Revised: 04/30/2018] [Accepted: 05/17/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVE Automatic segmentation of skin lesions in dermoscopy images is still a challenging task due to the large shape variations and indistinct boundaries of the lesions. Accurate segmentation of skin lesions is a key prerequisite step for any computer-aided diagnostic system to recognize skin melanoma. METHODS In this paper, we propose a novel segmentation methodology via full resolution convolutional networks (FrCN). The proposed FrCN method directly learns the full resolution features of each individual pixel of the input data without the need for pre- or post-processing operations such as artifact removal, low contrast adjustment, or further enhancement of the segmented skin lesion boundaries. We evaluated the proposed method using two publicly available databases, the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 Challenge and PH2 datasets. To evaluate the proposed method, we compared the segmentation performance with the latest deep learning segmentation approaches such as the fully convolutional network (FCN), U-Net, and SegNet. RESULTS Our results showed that the proposed FrCN method segmented the skin lesions with an average Jaccard index of 77.11% and an overall segmentation accuracy of 94.03% for the ISBI 2017 test dataset and 84.79% and 95.08%, respectively, for the PH2 dataset. In comparison to FCN, U-Net, and SegNet, the proposed FrCN outperformed them by 4.94%, 15.47%, and 7.48% for the Jaccard index and 1.31%, 3.89%, and 2.27% for the segmentation accuracy, respectively. Furthermore, the proposed FrCN achieved a segmentation accuracy of 95.62% for some representative clinical benign cases, 90.78% for the melanoma cases, and 91.29% for the seborrheic keratosis cases in the ISBI 2017 test dataset, exhibiting better performance than those of FCN, U-Net, and SegNet. CONCLUSIONS We conclude that using the full spatial resolutions of the input image could enable to learn better specific and prominent features, leading to an improvement in the segmentation performance.
Collapse
Affiliation(s)
- Mohammed A Al-Masni
- Department of Biomedical Engineering, College of Electronics and Information, Kyung Hee University, Yongin, Republic of Korea.
| | - Mugahed A Al-Antari
- Department of Biomedical Engineering, College of Electronics and Information, Kyung Hee University, Yongin, Republic of Korea.
| | - Mun-Taek Choi
- School of Mechanical Engineering, Sungkyunkwan University, Republic of Korea.
| | - Seung-Moo Han
- Department of Biomedical Engineering, College of Electronics and Information, Kyung Hee University, Yongin, Republic of Korea.
| | - Tae-Seong Kim
- Department of Biomedical Engineering, College of Electronics and Information, Kyung Hee University, Yongin, Republic of Korea.
| |
Collapse
|
14
|
Hair detection and lesion segmentation in dermoscopic images using domain knowledge. Med Biol Eng Comput 2018; 56:2051-2065. [DOI: 10.1007/s11517-018-1837-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Accepted: 04/23/2018] [Indexed: 10/16/2022]
|
15
|
Pathan S, Prabhu KG, Siddalingaswamy P. Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.07.010] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
16
|
Computer Based Melanocytic and Nevus Image Enhancement and Segmentation. BIOMED RESEARCH INTERNATIONAL 2016; 2016:2082589. [PMID: 27774454 PMCID: PMC5059650 DOI: 10.1155/2016/2082589] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2015] [Accepted: 07/18/2016] [Indexed: 01/25/2023]
Abstract
Digital dermoscopy aids dermatologists in monitoring potentially cancerous skin lesions. Melanoma is the 5th common form of skin cancer that is rare but the most dangerous. Melanoma is curable if it is detected at an early stage. Automated segmentation of cancerous lesion from normal skin is the most critical yet tricky part in computerized lesion detection and classification. The effectiveness and accuracy of lesion classification are critically dependent on the quality of lesion segmentation. In this paper, we have proposed a novel approach that can automatically preprocess the image and then segment the lesion. The system filters unwanted artifacts including hairs, gel, bubbles, and specular reflection. A novel approach is presented using the concept of wavelets for detection and inpainting the hairs present in the cancer images. The contrast of lesion with the skin is enhanced using adaptive sigmoidal function that takes care of the localized intensity distribution within a given lesion's images. We then present a segmentation approach to precisely segment the lesion from the background. The proposed approach is tested on the European database of dermoscopic images. Results are compared with the competitors to demonstrate the superiority of the suggested approach.
Collapse
|
17
|
Computational methods for pigmented skin lesion classification in images: review and future trends. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2482-6] [Citation(s) in RCA: 104] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
18
|
Oliveira RB, Filho ME, Ma Z, Papa JP, Pereira AS, Tavares JMRS. Computational methods for the image segmentation of pigmented skin lesions: A review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 131:127-141. [PMID: 27265054 DOI: 10.1016/j.cmpb.2016.03.032] [Citation(s) in RCA: 86] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2015] [Revised: 03/03/2016] [Accepted: 03/30/2016] [Indexed: 06/05/2023]
Abstract
BACKGROUND AND OBJECTIVES Because skin cancer affects millions of people worldwide, computational methods for the segmentation of pigmented skin lesions in images have been developed in order to assist dermatologists in their diagnosis. This paper aims to present a review of the current methods, and outline a comparative analysis with regards to several of the fundamental steps of image processing, such as image acquisition, pre-processing and segmentation. METHODS Techniques that have been proposed to achieve these tasks were identified and reviewed. As to the image segmentation task, the techniques were classified according to their principle. RESULTS The techniques employed in each step are explained, and their strengths and weaknesses are identified. In addition, several of the reviewed techniques are applied to macroscopic and dermoscopy images in order to exemplify their results. CONCLUSIONS The image segmentation of skin lesions has been addressed successfully in many studies; however, there is a demand for new methodologies in order to improve the efficiency.
Collapse
Affiliation(s)
- Roberta B Oliveira
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - Mercedes E Filho
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - Zhen Ma
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - João P Papa
- Departamento de Computação, Faculdade de Ciências, Universidade Estadual Paulista, av. Eng. Luiz Edmundo Carrijo Coube, 14-01, 17033-360 Bauru, SP, Brazil
| | - Aledir S Pereira
- Departamento de Ciências de Computação e Estatística, Instituto de Biociências, Letras e Ciências Exatas, Universidade Estadual Paulista, rua Cristóvão Colombo, 2265, 15054-000 São José do Rio Preto, SP, Brazil
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, rua Dr. Roberto Frias, 4200-465 Porto, Portugal.
| |
Collapse
|
19
|
Ma Z, Tavares JMRS. A Novel Approach to Segment Skin Lesions in Dermoscopic Images Based on a Deformable Model. IEEE J Biomed Health Inform 2015; 20:615-23. [PMID: 25585429 DOI: 10.1109/jbhi.2015.2390032] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Dermoscopy is an imaging technique that has been widely used in the diagnosis of skin lesions. However, its accuracy largely depends on the dermatologist's experience; thus, computer-aided diagnosis techniques are required. In this paper, a novel approach based on a deformable model is proposed to handle the segmentation of skin lesions in dermoscopic images. The RGB color space is converted so that the color information contained in the images can be used effectively to differentiate normal skin and skin lesions; and the differences in the color channels are combined together to define the speed function and the stopping criterion of the deformable model. This novel approach is robust against the noise, and provides an effective and flexible segmentation. Two image databases were used to test the performance of the novel approach and the segmentation results obtained were satisfactory. Quantitative analysis on 250 dermoscopic images showed that the novel algorithm outperformed other state-of-the-art algorithms. Also, using comparative data, the reliability and the implementation issues of the approach are discussed in this paper.
Collapse
|
20
|
Lahmiri S, Boukadoum M. Hybrid Discrete Wavelet Transform and Gabor Filter Banks Processing for Features Extraction from Biomedical Images. J Med Eng 2013; 2013:104684. [PMID: 27006906 PMCID: PMC4782617 DOI: 10.1155/2013/104684] [Citation(s) in RCA: 40] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2012] [Revised: 03/12/2013] [Accepted: 03/27/2013] [Indexed: 11/24/2022] Open
Abstract
A new methodology for automatic feature extraction from biomedical images and subsequent classification is presented. The approach exploits the spatial orientation of high-frequency textural features of the processed image as determined by a two-step process. First, the two-dimensional discrete wavelet transform (DWT) is applied to obtain the HH high-frequency subband image. Then, a Gabor filter bank is applied to the latter at different frequencies and spatial orientations to obtain new Gabor-filtered image whose entropy and uniformity are computed. Finally, the obtained statistics are fed to a support vector machine (SVM) binary classifier. The approach was validated on mammograms, retina, and brain magnetic resonance (MR) images. The obtained classification accuracies show better performance in comparison to common approaches that use only the DWT or Gabor filter banks for feature extraction.
Collapse
Affiliation(s)
- Salim Lahmiri
- Department of Computer Science, University of Quebec at Montreal, 201 President-Kennedy, Local PK-4150, Montreal, QC, Canada H2X 3Y7
| | - Mounir Boukadoum
- Department of Computer Science, University of Quebec at Montreal, 201 President-Kennedy, Local PK-4150, Montreal, QC, Canada H2X 3Y7
| |
Collapse
|
21
|
Abbas Q, Garcia IF, Emre Celebi M, Ahmad W, Mushtaq Q. Unified approach for lesion border detection based on mixture modeling and local entropy thresholding. Skin Res Technol 2013; 19:314-9. [PMID: 23573804 DOI: 10.1111/srt.12047] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/06/2013] [Indexed: 11/29/2022]
Abstract
BACKGROUND/PURPOSE Computer-aided design (CAD) methods are highly valuable for the analysis of skin lesions using digital dermoscopy due to low rate of diagnostic accuracy of expert dermatologist. In computerized diagnostic methods, automatic border detection is the first and crucial step. METHOD In this study, a novel unified approach is proposed for automatic border detection (ABD). A preprocessing step is performed by normalized smoothing filter (NSF) to reduce background noise. Mixture models technique is then utilized to initially segment the lesion area roughly. Afterward, local entropy thresholding is performed to extract the lesion candidate pixels and the lesion border is smoothed using morphological reconstruction. RESULTS The overall ABD system is tested on a set of 100 dermoscopy images with ground truth. A comparative study was conducted with the other three state-of-the-art methods using statistical metrics. This ABD technique has the minimal average error probability rate of 5%, true detection of 92.10% and false positive rate of 6.41%. CONCLUSION Results demonstrate that the proposed method segments the lesion area accurately. Sample dataset and execute software are available online and can be downloaded from: http://cs.ntu.edu.pk/research.
Collapse
Affiliation(s)
- Qaisar Abbas
- Department of Computer Science, COMSATS Institute of Information Technology, Sahiwal, Pakistan.
| | | | | | | | | |
Collapse
|
22
|
Computerized analysis of pigmented skin lesions: A review. Artif Intell Med 2012; 56:69-90. [DOI: 10.1016/j.artmed.2012.08.002] [Citation(s) in RCA: 238] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2012] [Revised: 08/02/2012] [Accepted: 08/19/2012] [Indexed: 11/20/2022]
|
23
|
Abbas Q, Garcia IF, Emre Celebi M, Ahmad W, Mushtaq Q. A perceptually oriented method for contrast enhancement and segmentation of dermoscopy images. Skin Res Technol 2012; 19:e490-7. [DOI: 10.1111/j.1600-0846.2012.00670.x] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/04/2012] [Indexed: 01/23/2023]
Affiliation(s)
| | - Irene Fondón Garcia
- Department of Signal Theory and Communications; School of Engineering Path of Discovery; Seville; Spain
| | - M. Emre Celebi
- Department of Computer Science; Louisiana State University; Shreveport; Louisiana; USA
| | | | | |
Collapse
|
24
|
Emre Celebi M, Wen Q, Hwang S, Iyatomi H, Schaefer G. Lesion border detection in dermoscopy images using ensembles of thresholding methods. Skin Res Technol 2012; 19:e252-8. [PMID: 22676490 DOI: 10.1111/j.1600-0846.2012.00636.x] [Citation(s) in RCA: 123] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/26/2012] [Indexed: 11/27/2022]
Abstract
BACKGROUND Dermoscopy is one of the major imaging modalities used in the diagnosis of melanoma and other pigmented skin lesions. Due to the difficulty and subjectivity of human interpretation, automated analysis of dermoscopy images has become an important research area. Border detection is often the first step in this analysis. In many cases, the lesion can be roughly separated from the background skin using a thresholding method applied to the blue channel. However, no single thresholding method appears to be robust enough to successfully handle the wide variety of dermoscopy images encountered in clinical practice. METHODS In this article, we present an automated method for detecting lesion borders in dermoscopy images using ensembles of thres holding methods. CONCLUSION Experiments on a difficult set of 90 images demonstrate that the proposed method is robust, fast, and accurate when compared to nine state-of-the-art methods.
Collapse
Affiliation(s)
- M Emre Celebi
- Department of Computer Science, Louisiana State University, Shreveport, LA, USA.
| | | | | | | | | |
Collapse
|
25
|
Abbas Q, Emre Celebi M, Garcia IF, Ahmad W. Melanoma recognition framework based on expert definition of ABCD for dermoscopic images. Skin Res Technol 2012; 19:e93-102. [DOI: 10.1111/j.1600-0846.2012.00614.x] [Citation(s) in RCA: 47] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/26/2012] [Indexed: 11/29/2022]
Affiliation(s)
| | - M. Emre Celebi
- Department of Computer Science; Louisiana State University; Shreveport; LA; USA
| | - Irene Fondón Garcia
- Department of Signal Theory and Communications; School of Engineering Path of Discovery; s/n C. P; 41092; Seville; Spain
| | | |
Collapse
|
26
|
Lesack K, Naugler C. Performance of a simple chromatin-rich segmentation algorithm in quantifying basal cell carcinoma from histology images. BMC Res Notes 2012; 5:35. [PMID: 22251818 PMCID: PMC3398325 DOI: 10.1186/1756-0500-5-35] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2011] [Accepted: 01/17/2012] [Indexed: 12/26/2022] Open
Abstract
Background The use of digital imaging and algorithm-assisted identification of regions of interest is revolutionizing the practice of anatomic pathology. Currently automated methods for extracting the tumour regions in basal cell carcinomas are lacking. In this manuscript a colour-deconvolution based tumour extraction algorithm is presented. Findings Haematoxylin and eosin stained basal cell carcinoma histology slides were digitized and analyzed using the open source image analysis program ImageJ. The pixels belonging to tumours were identified by the algorithm, and the performance of the algorithm was evaluated by comparing the pixels identified as malignant with a manually determined dataset. The algorithm achieved superior results with the nodular tumour subtype. Pre-processing using colour deconvolution resulted in a slight decrease in sensitivity, but a significant increase in specificity. The overall sensitivity and specificity of the algorithm was 91.0% and 86.4% respectively, resulting in a positive predictive value of 63.3% and a negative predictive value of 94.2% Conclusions The proposed image analysis algorithm demonstrates the feasibility of automatically extracting tumour regions from digitized basal cell carcinoma histology slides. The proposed algorithm may be adaptable to other stain combinations and tumour types.
Collapse
Affiliation(s)
- Kyle Lesack
- Department of Pathology and Laboratory Medicine, University of Calgary and Calgary Laboratory Services, C414, Diagnostic and Scientific Centre 9, 3535 Research Road NW, Calgary, AB T2L 2 K8, Canada.
| | | |
Collapse
|