1
|
Yin W, Zhou D, Nie R. DI-UNet: dual-branch interactive U-Net for skin cancer image segmentation. J Cancer Res Clin Oncol 2023; 149:15511-15524. [PMID: 37646827 DOI: 10.1007/s00432-023-05319-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Accepted: 08/18/2023] [Indexed: 09/01/2023]
Abstract
PURPOSE Skin disease is a prevalent type of physical ailment that can manifest in multitude of forms. Many internal diseases can be directly reflected on the skin, and if left unattended, skin diseases can potentially develop into skin cancer. Accurate and effective segmentation of skin lesions, especially melanoma, is critical for early detection and diagnosis of skin cancer. However, the complex color variations, boundary ambiguity, and scale variations in skin lesion regions present significant challenges for precise segmentation. METHODS We propose a novel approach for melanoma segmentation using a dual-branch interactive U-Net architecture. Two distinct sampling strategies are simultaneously integrated into the network, creating a vertical dual-branch structure. Meanwhile, we introduce a novel dual-channel symmetrical convolution block (DCS-Conv), which employs a symmetrical design, enabling the network to exhibit a horizontal dual-branch structure. The combination of the vertical and horizontal distribution of the dual-branch structure enhances both the depth and width of the network, providing greater diversity and rich multiscale cascade features. Additionally, this paper introduces a novel module called the residual fuse-and-select module (RFS module), which leverages self-attention mechanisms to focus on the specific skin cancer features and reduce irrelevant artifacts, further improving the segmentation accuracy. RESULTS We evaluated our approach on two publicly skin cancer datasets, ISIC2016 and PH2, and achieved state-of-the-art results, surpassing previous outcomes in terms of segmentation accuracy and overall performance. CONCLUSION Our proposed approach holds tremendous potential to aid dermatologists in clinical decision-making.
Collapse
Affiliation(s)
- Wen Yin
- School of Information Science and Engineering, Yunnan University, Kunming, 650504, China
| | - Dongming Zhou
- School of Information Science and Engineering, Yunnan University, Kunming, 650504, China.
| | - Rencan Nie
- School of Information Science and Engineering, Yunnan University, Kunming, 650504, China
| |
Collapse
|
2
|
Nazari S, Garcia R. Automatic Skin Cancer Detection Using Clinical Images: A Comprehensive Review. Life (Basel) 2023; 13:2123. [PMID: 38004263 PMCID: PMC10672549 DOI: 10.3390/life13112123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 10/21/2023] [Accepted: 10/23/2023] [Indexed: 11/26/2023] Open
Abstract
Skin cancer has become increasingly common over the past decade, with melanoma being the most aggressive type. Hence, early detection of skin cancer and melanoma is essential in dermatology. Computational methods can be a valuable tool for assisting dermatologists in identifying skin cancer. Most research in machine learning for skin cancer detection has focused on dermoscopy images due to the existence of larger image datasets. However, general practitioners typically do not have access to a dermoscope and must rely on naked-eye examinations or standard clinical images. By using standard, off-the-shelf cameras to detect high-risk moles, machine learning has also proven to be an effective tool. The objective of this paper is to provide a comprehensive review of image-processing techniques for skin cancer detection using clinical images. In this study, we evaluate 51 state-of-the-art articles that have used machine learning methods to detect skin cancer over the past decade, focusing on clinical datasets. Even though several studies have been conducted in this field, there are still few publicly available clinical datasets with sufficient data that can be used as a benchmark, especially when compared to the existing dermoscopy databases. In addition, we observed that the available artifact removal approaches are not quite adequate in some cases and may also have a negative impact on the models. Moreover, the majority of the reviewed articles are working with single-lesion images and do not consider typical mole patterns and temporal changes in the lesions of each patient.
Collapse
|
3
|
Chabi Adjobo E, Sanda Mahama AT, Gouton P, Tossa J. Automatic Localization of Five Relevant Dermoscopic Structures Based on YOLOv8 for Diagnosis Improvement. J Imaging 2023; 9:148. [PMID: 37504825 PMCID: PMC10381143 DOI: 10.3390/jimaging9070148] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 07/12/2023] [Accepted: 07/18/2023] [Indexed: 07/29/2023] Open
Abstract
The automatic detection of dermoscopic features is a task that provides the specialists with an image with indications about the different patterns present in it. This information can help them fully understand the image and improve their decisions. However, the automatic analysis of dermoscopic features can be a difficult task because of their small size. Some work was performed in this area, but the results can be improved. The objective of this work is to improve the precision of the automatic detection of dermoscopic features. To achieve this goal, an algorithm named yolo-dermoscopic-features is proposed. The algorithm consists of four points: (i) generate annotations in the JSON format for supervised learning of the model; (ii) propose a model based on the latest version of Yolo; (iii) pre-train the model for the segmentation of skin lesions; (iv) train five models for the five dermoscopic features. The experiments are performed on the ISIC 2018 task2 dataset. After training, the model is evaluated and compared to the performance of two methods. The proposed method allows us to reach average performances of 0.9758, 0.954, 0.9724, 0.938, and 0.9692, respectively, for the Dice similarity coefficient, Jaccard similarity coefficient, precision, recall, and average precision. Furthermore, comparing to other methods, the proposed method reaches a better Jaccard similarity coefficient of 0.954 and, thus, presents the best similarity with the annotations made by specialists. This method can also be used to automatically annotate images and, therefore, can be a solution to the lack of features annotation in the dataset.
Collapse
Affiliation(s)
- Esther Chabi Adjobo
- Imagerie et Vision Artificielle (ImVia), University of Bourgogne Franche-Comté, 21078 Dijon, France
- Institut de Mathématiques et de Sciences Physiques (IMSP), University of Abomey-Calavi, Abomey-Calavi BP 2549, Benin
| | - Amadou Tidjani Sanda Mahama
- Imagerie et Vision Artificielle (ImVia), University of Bourgogne Franche-Comté, 21078 Dijon, France
- Institut de Mathématiques et de Sciences Physiques (IMSP), University of Abomey-Calavi, Abomey-Calavi BP 2549, Benin
| | - Pierre Gouton
- Imagerie et Vision Artificielle (ImVia), University of Bourgogne Franche-Comté, 21078 Dijon, France
| | - Joël Tossa
- Institut de Mathématiques et de Sciences Physiques (IMSP), University of Abomey-Calavi, Abomey-Calavi BP 2549, Benin
| |
Collapse
|
4
|
Malignant melanoma diagnosis applying a machine learning method based on the combination of nonlinear and texture features. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
5
|
Bhuiyan MR, Abdullah J. Detection on Cell Cancer Using the Deep Transfer Learning and Histogram Based Image Focus Quality Assessment. SENSORS (BASEL, SWITZERLAND) 2022; 22:7007. [PMID: 36146356 PMCID: PMC9504738 DOI: 10.3390/s22187007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 08/15/2022] [Accepted: 08/26/2022] [Indexed: 06/16/2023]
Abstract
In recent years, the number of studies using whole-slide imaging (WSIs) of histopathology slides has expanded significantly. For the development and validation of artificial intelligence (AI) systems, glass slides from retrospective cohorts including patient follow-up data have been digitized. It has become crucial to determine that the quality of such resources meets the minimum requirements for the development of AI in the future. The need for automated quality control is one of the obstacles preventing the clinical implementation of digital pathology work processes. As a consequence of the inaccuracy of scanners in determining the focus of the image, the resulting visual blur can render the scanned slide useless. Moreover, when scanned at a resolution of 20× or higher, the resulting picture size of a scanned slide is often enormous. Therefore, for digital pathology to be clinically relevant, computational algorithms must be used to rapidly and reliably measure the picture's focus quality and decide if an image requires re-scanning. We propose a metric for evaluating the quality of digital pathology images that uses a sum of even-derivative filter bases to generate a human visual-system-like kernel, which is described as the inverse of the lens' point spread function. This kernel is then used for a digital pathology image to change high-frequency image data degraded by the scanner's optics and assess the patch-level focus quality. Through several studies, we demonstrate that our technique correlates with ground-truth z-level data better than previous methods, and is computationally efficient. Using deep learning techniques, our suggested system is able to identify positive and negative cancer cells in images. We further expand our technique to create a local slide-level focus quality heatmap, which can be utilized for automated slide quality control, and we illustrate our method's value in clinical scan quality control by comparing it to subjective slide quality ratings. The proposed method, GoogleNet, VGGNet, and ResNet had accuracy values of 98.5%, 94.5%, 94.00%, and 95.00% respectively.
Collapse
|
6
|
A Dermoscopic Inspired System for Localization and Malignancy Classification of Melanocytic Lesions. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This study aims at developing a clinically oriented automated diagnostic tool for distinguishing malignant melanocytic lesions from benign melanocytic nevi in diverse image databases. Due to the presence of artifacts, smooth lesion boundaries, and subtlety in diagnostic features, the accuracy of such systems gets hampered. Thus, the proposed framework improves the accuracy of melanoma detection by combining the clinical aspects of dermoscopy. Two methods have been adopted for achieving the aforementioned objective. Firstly, artifact removal and lesion localization are performed. In the second step, various clinically significant features such as shape, color, texture, and pigment network are detected. Features are further reduced by checking their individual significance (i.e., hypothesis testing). These reduced feature vectors are then classified using SVM classifier. Features specific to the domain have been used for this design as opposed to features of the abstract images. The domain knowledge of an expert gets enhanced by this methodology. The proposed approach is implemented on a multi-source dataset (PH2 + ISBI 2016 and 2017) of 515 annotated images, thereby resulting in sensitivity, specificity and accuracy of 83.8%, 88.3%, and 86%, respectively. The experimental results are promising, and can be applied to detect asymmetry, pigment network, colors, and texture of the lesions.
Collapse
|
7
|
Ain QU, Al-Sahaf H, Xue B, Zhang M. Generating Knowledge-Guided Discriminative Features Using Genetic Programming for Melanoma Detection. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE 2021. [DOI: 10.1109/tetci.2020.2983426] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
8
|
Baig R, Bibi M, Hamid A, Kausar S, Khalid S. Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review. Curr Med Imaging 2021; 16:513-533. [PMID: 32484086 DOI: 10.2174/1573405615666190129120449] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 12/17/2018] [Accepted: 01/02/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND Automated intelligent systems for unbiased diagnosis are primary requirement for the pigment lesion analysis. It has gained the attention of researchers in the last few decades. These systems involve multiple phases such as pre-processing, feature extraction, segmentation, classification and post processing. It is crucial to accurately localize and segment the skin lesion. It is observed that recent enhancements in machine learning algorithms and dermoscopic techniques reduced the misclassification rate therefore, the focus towards computer aided systems increased exponentially in recent years. Computer aided diagnostic systems are reliable source for dermatologists to analyze the type of cancer, but it is widely acknowledged that even higher accuracy is needed for computer aided diagnostic systems to be adopted practically in the diagnostic process of life threatening diseases. INTRODUCTION Skin cancer is one of the most threatening cancers. It occurs by the abnormal multiplication of cells. The core three types of skin cells are: Squamous, Basal and Melanocytes. There are two wide classes of skin cancer; Melanocytic and non-Melanocytic. It is difficult to differentiate between benign and malignant melanoma, therefore dermatologists sometimes misclassify the benign and malignant melanoma. Melanoma is estimated as 19th most frequent cancer, it is riskier than the Basel and Squamous carcinoma because it rapidly spreads throughout the body. Hence, to lower the death risk, it is critical to diagnose the correct type of cancer in early rudimentary phases. It can occur on any part of body, but it has higher probability to occur on chest, back and legs. METHODS The paper presents a review of segmentation and classification techniques for skin lesion detection. Dermoscopy and its features are discussed briefly. After that Image pre-processing techniques are described. A thorough review of segmentation and classification phases of skin lesion detection using deep learning techniques is presented Literature is discussed and a comparative analysis of discussed methods is presented. CONCLUSION In this paper, we have presented the survey of more than 100 papers and comparative analysis of state of the art techniques, model and methodologies. Malignant melanoma is one of the most threating and deadliest cancers. Since the last few decades, researchers are putting extra attention and effort in accurate diagnosis of melanoma. The main challenges of dermoscopic skin lesion images are: low contrasts, multiple lesions, irregular and fuzzy borders, blood vessels, regression, hairs, bubbles, variegated coloring and other kinds of distortions. The lack of large training dataset makes these problems even more challenging. Due to recent advancement in the paradigm of deep learning, and specially the outstanding performance in medical imaging, it has become important to review the deep learning algorithms performance in skin lesion segmentation. Here, we have discussed the results of different techniques on the basis of different evaluation parameters such as Jaccard coefficient, sensitivity, specificity and accuracy. And the paper listed down the major achievements in this domain with the detailed discussion of the techniques. In future, it is expected to improve results by utilizing the capabilities of deep learning frameworks with other pre and post processing techniques so reliable and accurate diagnostic systems can be built.
Collapse
Affiliation(s)
- Ramsha Baig
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Maryam Bibi
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Anmol Hamid
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Sumaira Kausar
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Shahzad Khalid
- Department of Computer Engineering, Bahria University, Islamabad, Pakistan
| |
Collapse
|
9
|
Talavera-Martínez L, Bibiloni P, González-Hidalgo M. Computational texture features of dermoscopic images and their link to the descriptive terminology: A survey. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 182:105049. [PMID: 31494412 DOI: 10.1016/j.cmpb.2019.105049] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 08/12/2019] [Accepted: 08/23/2019] [Indexed: 06/10/2023]
Abstract
Computer-extracted texture features are relevant to diagnose cutaneous lesions such as melanomas. Our goal is to set a relationship between a well-established descriptive terminology, which describes the attributes of dermoscopic structures based on their aspect rather than their underlying causes, and the computational methods to extract texture-based features. By tackling this problem, we can ascertain what indicators used by dermatologists are reflected in the extracted texture features. We first review the state-of-the-art models for texture extraction in dermoscopic images. By comparing the methods' performance and goals, we conclude that (I) a single color space does not seem to give performances as good as using several ones, thus the latter is reasonable (II) the optimal number of extracted features seems to vary depending on the method's goal, and extracting a large number of features can lead to a loss of models robustness (III) methods such as GLCM, Sobel or Law energy filters are mainly used to capture local properties to detect specific dermoscopic structures (IV) methods that extract local and global features, like Gabor wavelets or SPT, tend to be used to analyze the presence of certain patterns of dermoscopic structures, e.g. globular, reticular, etc.
Collapse
Affiliation(s)
- Lidia Talavera-Martínez
- Universitat de les Illes Balears, SCOPIA Research Group, Palma 07122, Spain; Balearic Islands Health Research Institute (IdISBa), Palma 07010, Spain.
| | - Pedro Bibiloni
- Universitat de les Illes Balears, SCOPIA Research Group, Palma 07122, Spain; Balearic Islands Health Research Institute (IdISBa), Palma 07010, Spain.
| | - Manuel González-Hidalgo
- Universitat de les Illes Balears, SCOPIA Research Group, Palma 07122, Spain; Balearic Islands Health Research Institute (IdISBa), Palma 07010, Spain.
| |
Collapse
|
10
|
Tan TY, Zhang L, Lim CP. Intelligent skin cancer diagnosis using improved particle swarm optimization and deep learning models. Appl Soft Comput 2019. [DOI: 10.1016/j.asoc.2019.105725] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
11
|
Munir K, Elahi H, Ayub A, Frezza F, Rizzi A. Cancer Diagnosis Using Deep Learning: A Bibliographic Review. Cancers (Basel) 2019; 11:E1235. [PMID: 31450799 PMCID: PMC6770116 DOI: 10.3390/cancers11091235] [Citation(s) in RCA: 137] [Impact Index Per Article: 27.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2019] [Revised: 06/30/2019] [Accepted: 08/14/2019] [Indexed: 01/06/2023] Open
Abstract
In this paper, we first describe the basics of the field of cancer diagnosis, which includes steps of cancer diagnosis followed by the typical classification methods used by doctors, providing a historical idea of cancer classification techniques to the readers. These methods include Asymmetry, Border, Color and Diameter (ABCD) method, seven-point detection method, Menzies method, and pattern analysis. They are used regularly by doctors for cancer diagnosis, although they are not considered very efficient for obtaining better performance. Moreover, considering all types of audience, the basic evaluation criteria are also discussed. The criteria include the receiver operating characteristic curve (ROC curve), Area under the ROC curve (AUC), F1 score, accuracy, specificity, sensitivity, precision, dice-coefficient, average accuracy, and Jaccard index. Previously used methods are considered inefficient, asking for better and smarter methods for cancer diagnosis. Artificial intelligence and cancer diagnosis are gaining attention as a way to define better diagnostic tools. In particular, deep neural networks can be successfully used for intelligent image analysis. The basic framework of how this machine learning works on medical imaging is provided in this study, i.e., pre-processing, image segmentation and post-processing. The second part of this manuscript describes the different deep learning techniques, such as convolutional neural networks (CNNs), generative adversarial models (GANs), deep autoencoders (DANs), restricted Boltzmann's machine (RBM), stacked autoencoders (SAE), convolutional autoencoders (CAE), recurrent neural networks (RNNs), long short-term memory (LTSM), multi-scale convolutional neural network (M-CNN), multi-instance learning convolutional neural network (MIL-CNN). For each technique, we provide Python codes, to allow interested readers to experiment with the cited algorithms on their own diagnostic problems. The third part of this manuscript compiles the successfully applied deep learning models for different types of cancers. Considering the length of the manuscript, we restrict ourselves to the discussion of breast cancer, lung cancer, brain cancer, and skin cancer. The purpose of this bibliographic review is to provide researchers opting to work in implementing deep learning and artificial neural networks for cancer diagnosis a knowledge from scratch of the state-of-the-art achievements.
Collapse
Affiliation(s)
- Khushboo Munir
- Department of Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Via Eudossiana 18, 00184 Rome, Italy.
| | - Hassan Elahi
- Department of Mechanical and Aerospace Engineering (DIMA), Sapienza University of Rome, Via Eudossiana 18, 00184 Rome, Italy
| | - Afsheen Ayub
- Department of Basic and Applied Science for Engineering (SBAI), Sapienza University of Rome, Via Antonio Scarpa 14/16, 00161 Rome, Italy
| | - Fabrizio Frezza
- Department of Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Via Eudossiana 18, 00184 Rome, Italy
| | - Antonello Rizzi
- Department of Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Via Eudossiana 18, 00184 Rome, Italy
| |
Collapse
|
12
|
Barata C, Celebi ME, Marques JS. A Survey of Feature Extraction in Dermoscopy Image Analysis of Skin Cancer. IEEE J Biomed Health Inform 2019; 23:1096-1109. [DOI: 10.1109/jbhi.2018.2845939] [Citation(s) in RCA: 81] [Impact Index Per Article: 16.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
13
|
Pathan S, Gopalakrishna Prabhu K, Siddalingaswamy P. Automated detection of melanocytes related pigmented skin lesions: A clinical framework. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2019.02.013] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
14
|
Kawahara J, Hamarneh G. Fully Convolutional Neural Networks to Detect Clinical Dermoscopic Features. IEEE J Biomed Health Inform 2019; 23:578-585. [DOI: 10.1109/jbhi.2018.2831680] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
15
|
Celebi ME, Codella N, Halpern A. Dermoscopy Image Analysis: Overview and Future Directions. IEEE J Biomed Health Inform 2019; 23:474-478. [DOI: 10.1109/jbhi.2019.2895803] [Citation(s) in RCA: 76] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
16
|
Warsi F, Khanam R, Kamya S, Suárez-Araujo CP. An efficient 3D color-texture feature and neural network technique for melanoma detection. INFORMATICS IN MEDICINE UNLOCKED 2019. [DOI: 10.1016/j.imu.2019.100176] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022] Open
|
17
|
What Is the Role of Annotations in the Detection of Dermoscopic Structures? PATTERN RECOGNITION AND IMAGE ANALYSIS 2019. [DOI: 10.1007/978-3-030-31321-0_1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
18
|
Ferrante di Ruffano L, Takwoingi Y, Dinnes J, Chuchu N, Bayliss SE, Davenport C, Matin RN, Godfrey K, O'Sullivan C, Gulati A, Chan SA, Durack A, O'Connell S, Gardiner MD, Bamber J, Deeks JJ, Williams HC. Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults. Cochrane Database Syst Rev 2018; 12:CD013186. [PMID: 30521691 PMCID: PMC6517147 DOI: 10.1002/14651858.cd013186] [Citation(s) in RCA: 44] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
BACKGROUND Early accurate detection of all skin cancer types is essential to guide appropriate management and to improve morbidity and survival. Melanoma and cutaneous squamous cell carcinoma (cSCC) are high-risk skin cancers which have the potential to metastasise and ultimately lead to death, whereas basal cell carcinoma (BCC) is usually localised with potential to infiltrate and damage surrounding tissue. Anxiety around missing early curable cases needs to be balanced against inappropriate referral and unnecessary excision of benign lesions. Computer-assisted diagnosis (CAD) systems use artificial intelligence to analyse lesion data and arrive at a diagnosis of skin cancer. When used in unreferred settings ('primary care'), CAD may assist general practitioners (GPs) or other clinicians to more appropriately triage high-risk lesions to secondary care. Used alongside clinical and dermoscopic suspicion of malignancy, CAD may reduce unnecessary excisions without missing melanoma cases. OBJECTIVES To determine the accuracy of CAD systems for diagnosing cutaneous invasive melanoma and atypical intraepidermal melanocytic variants, BCC or cSCC in adults, and to compare its accuracy with that of dermoscopy. SEARCH METHODS We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials (CENTRAL); MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. SELECTION CRITERIA Studies of any design that evaluated CAD alone, or in comparison with dermoscopy, in adults with lesions suspicious for melanoma or BCC or cSCC, and compared with a reference standard of either histological confirmation or clinical follow-up. DATA COLLECTION AND ANALYSIS Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). We contacted authors of included studies where information related to the target condition or diagnostic threshold were missing. We estimated summary sensitivities and specificities separately by type of CAD system, using the bivariate hierarchical model. We compared CAD with dermoscopy using (a) all available CAD data (indirect comparisons), and (b) studies providing paired data for both tests (direct comparisons). We tested the contribution of human decision-making to the accuracy of CAD diagnoses in a sensitivity analysis by removing studies that gave CAD results to clinicians to guide diagnostic decision-making. MAIN RESULTS We included 42 studies, 24 evaluating digital dermoscopy-based CAD systems (Derm-CAD) in 23 study cohorts with 9602 lesions (1220 melanomas, at least 83 BCCs, 9 cSCCs), providing 32 datasets for Derm-CAD and seven for dermoscopy. Eighteen studies evaluated spectroscopy-based CAD (Spectro-CAD) in 16 study cohorts with 6336 lesions (934 melanomas, 163 BCC, 49 cSCCs), providing 32 datasets for Spectro-CAD and six for dermoscopy. These consisted of 15 studies using multispectral imaging (MSI), two studies using electrical impedance spectroscopy (EIS) and one study using diffuse-reflectance spectroscopy. Studies were incompletely reported and at unclear to high risk of bias across all domains. Included studies inadequately address the review question, due to an abundance of low-quality studies, poor reporting, and recruitment of highly selected groups of participants.Across all CAD systems, we found considerable variation in the hardware and software technologies used, the types of classification algorithm employed, methods used to train the algorithms, and which lesion morphological features were extracted and analysed across all CAD systems, and even between studies evaluating CAD systems. Meta-analysis found CAD systems had high sensitivity for correct identification of cutaneous invasive melanoma and atypical intraepidermal melanocytic variants in highly selected populations, but with low and very variable specificity, particularly for Spectro-CAD systems. Pooled data from 22 studies estimated the sensitivity of Derm-CAD for the detection of melanoma as 90.1% (95% confidence interval (CI) 84.0% to 94.0%) and specificity as 74.3% (95% CI 63.6% to 82.7%). Pooled data from eight studies estimated the sensitivity of multispectral imaging CAD (MSI-CAD) as 92.9% (95% CI 83.7% to 97.1%) and specificity as 43.6% (95% CI 24.8% to 64.5%). When applied to a hypothetical population of 1000 lesions at the mean observed melanoma prevalence of 20%, Derm-CAD would miss 20 melanomas and would lead to 206 false-positive results for melanoma. MSI-CAD would miss 14 melanomas and would lead to 451 false diagnoses for melanoma. Preliminary findings suggest CAD systems are at least as sensitive as assessment of dermoscopic images for the diagnosis of invasive melanoma and atypical intraepidermal melanocytic variants. We are unable to make summary statements about the use of CAD in unreferred populations, or its accuracy in detecting keratinocyte cancers, or its use in any setting as a diagnostic aid, because of the paucity of studies. AUTHORS' CONCLUSIONS In highly selected patient populations all CAD types demonstrate high sensitivity, and could prove useful as a back-up for specialist diagnosis to assist in minimising the risk of missing melanomas. However, the evidence base is currently too poor to understand whether CAD system outputs translate to different clinical decision-making in practice. Insufficient data are available on the use of CAD in community settings, or for the detection of keratinocyte cancers. The evidence base for individual systems is too limited to draw conclusions on which might be preferred for practice. Prospective comparative studies are required that evaluate the use of already evaluated CAD systems as diagnostic aids, by comparison to face-to-face dermoscopy, and in participant populations that are representative of those in which the test would be used in practice.
Collapse
Affiliation(s)
| | - Yemisi Takwoingi
- University of BirminghamInstitute of Applied Health ResearchEdgbaston CampusBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Jacqueline Dinnes
- University of BirminghamInstitute of Applied Health ResearchEdgbaston CampusBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Naomi Chuchu
- University of BirminghamInstitute of Applied Health ResearchEdgbaston CampusBirminghamUKB15 2TT
| | - Susan E Bayliss
- University of BirminghamInstitute of Applied Health ResearchEdgbaston CampusBirminghamUKB15 2TT
| | - Clare Davenport
- University of BirminghamInstitute of Applied Health ResearchEdgbaston CampusBirminghamUKB15 2TT
| | - Rubeta N Matin
- Churchill HospitalDepartment of DermatologyOld RoadHeadingtonOxfordUKOX3 7LE
| | - Kathie Godfrey
- The University of Nottinghamc/o Cochrane Skin GroupNottinghamUK
| | | | - Abha Gulati
- Barts Health NHS TrustDepartment of DermatologyWhitechapelLondonUKE11BB
| | - Sue Ann Chan
- City HospitalBirmingham Skin CentreDudley RdBirminghamUKB18 7QH
| | - Alana Durack
- Addenbrooke’s Hospital, Cambridge University Hospitals NHS Foundation TrustDermatologyHills RoadCambridgeUKCB2 0QQ
| | - Susan O'Connell
- Cardiff and Vale University Health BoardCEDAR Healthcare Technology Research CentreCardiff Medicentre, University Hospital of Wales, Heath Park CampusCardiffWalesUKCF144UJ
| | | | - Jeffrey Bamber
- Institute of Cancer Research and The Royal Marsden NHS Foundation TrustJoint Department of Physics15 Cotswold RoadSuttonUKSM2 5NG
| | - Jonathan J Deeks
- University of BirminghamInstitute of Applied Health ResearchEdgbaston CampusBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Hywel C Williams
- University of NottinghamCentre of Evidence Based DermatologyQueen's Medical CentreDerby RoadNottinghamUKNG7 2UH
| | | | | |
Collapse
|
19
|
Tan TY, Zhang L, Neoh SC, Lim CP. Intelligent skin cancer detection using enhanced particle swarm optimization. Knowl Based Syst 2018. [DOI: 10.1016/j.knosys.2018.05.042] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
20
|
Pathan S, Prabhu KG, Siddalingaswamy P. A methodological approach to classify typical and atypical pigment network patterns for melanoma diagnosis. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.03.017] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
21
|
Hair detection and lesion segmentation in dermoscopic images using domain knowledge. Med Biol Eng Comput 2018; 56:2051-2065. [DOI: 10.1007/s11517-018-1837-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Accepted: 04/23/2018] [Indexed: 10/16/2022]
|
22
|
Garcia-Arroyo JL, Garcia-Zapirain B. Recognition of pigment network pattern in dermoscopy images based on fuzzy classification of pixels. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 153:61-69. [PMID: 29157462 DOI: 10.1016/j.cmpb.2017.10.005] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2017] [Revised: 09/01/2017] [Accepted: 10/02/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND AND OBJECTIVE One of the most relevant dermoscopic patterns is the pigment network. An innovative method of pattern recognition is presented for its detection in dermoscopy images. METHODS It consists of two steps. In the first one, by means of a supervised machine learning process and after performing the extraction of different colour and texture features, a fuzzy classification of pixels into the three categories present in the pattern's definition ("net", "hole" and "other") is carried out. This enables the three corresponding fuzzy sets to be created and, as a result, the three probability images that map them out are generated. In the second step, the pigment network pattern is characterised from a parameterisation process -derived from the system specification- and the subsequent extraction of different features calculated from the combinations of image masks extracted from the probability images, corresponding to the alpha-cuts obtained from the fuzzy sets. RESULTS The method was tested on a database of 875 images -by far the largest used in the state of the art to detect pigment network- extracted from a public Atlas of Dermoscopy, obtaining AUC results of 0.912 and 88%% accuracy, with 90.71%% sensitivity and 83.44%% specificity. CONCLUSION The main contribution of this method is the very design of the algorithm, highly innovative, which could also be used to deal with other pattern recognition problems of a similar nature. Other contributions are: 1. The good performance in discriminating between the pattern and the disturbing artefacts -which means that no prior preprocessing is required in this method- and between the pattern and other dermoscopic patterns; 2. It puts forward a new methodological approach for work of this kind, introducing the system specification as a required step prior to algorithm design and development, being this specification the basis for a required parameterisation -in the form of configurable parameters (with their value ranges) and set threshold values- of the algorithm and the subsequent conducting of the experiments.
Collapse
Affiliation(s)
- Jose Luis Garcia-Arroyo
- Deustotech-LIFE Unit (eVIDA Research Group), University of Deusto Avda. Universidades, 24, 48007 Bilbao, Spain.
| | - Begonya Garcia-Zapirain
- Deustotech-LIFE Unit (eVIDA Research Group), University of Deusto Avda. Universidades, 24, 48007 Bilbao, Spain.
| |
Collapse
|
23
|
Pathan S, Prabhu KG, Siddalingaswamy P. Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.07.010] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
24
|
Sabbaghi S, Aldeen M, Garnavi R. A deep bag-of-features model for the classification of melanomas in dermoscopy images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:1369-1372. [PMID: 28268580 DOI: 10.1109/embc.2016.7590962] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Deep learning and unsupervised feature learning have received great attention in past years for their ability to transform input data into high level representations using machine learning techniques. Such interest has been growing steadily in the field of medical image diagnosis, particularly in melanoma classification. In this paper, a novel application of deep learning (stacked sparse auto-encoders) is presented for skin lesion classification task. The stacked sparse auto-encoder discovers latent information features in input images (pixel intensities). These high-level features are subsequently fed into a classifier for classifying dermoscopy images. In addition, we proposed a new deep neural network architecture based on bag-of-features (BoF) model, which learns high-level image representation and maps images into BoF space. Then, we examine how using this deep representation of BoF, compared with pixel intensities of images, can improve the classification accuracy. The proposed method is evaluated on a test set of 244 skin images. To test the performance of the proposed method, the area under the receiver operating characteristics curve (AUC) is utilized. The proposed method is found to achieve 95% accuracy.
Collapse
|
25
|
|
26
|
Riaz F, Hassan A, Nisar R, Dinis-Ribeiro M, Coimbra MT. Content-Adaptive Region-Based Color Texture Descriptors for Medical Images. IEEE J Biomed Health Inform 2017; 21:162-171. [DOI: 10.1109/jbhi.2015.2492464] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
27
|
Computational methods for pigmented skin lesion classification in images: review and future trends. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2482-6] [Citation(s) in RCA: 104] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
28
|
Machado M, Pereira J, Fonseca-Pinto R. Reticular pattern detection in dermoscopy: an approach using Curvelet Transform. ACTA ACUST UNITED AC 2016. [DOI: 10.1590/2446-4740.00315] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Affiliation(s)
| | | | - Rui Fonseca-Pinto
- Instituto de Telecomunicações, Portugal; Polytechnic Institute of Leiria, Portugal
| |
Collapse
|
29
|
Alfed N, Khelifi F, Bouridane A, Seker H. Pigment network-based skin cancer detection. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2015:7214-7. [PMID: 26737956 DOI: 10.1109/embc.2015.7320056] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Diagnosing skin cancer in its early stages is a challenging task for dermatologists given the fact that the chance for a patient's survival is higher and hence the process of analyzing skin images and making decisions should be time efficient. Therefore, diagnosing the disease using automated and computerized systems has nowadays become essential. This paper proposes an efficient system for skin cancer detection on dermoscopic images. It has been shown that the statistical characteristics of the pigment network, extracted from the dermoscopic image, could be used as efficient discriminating features for cancer detection. The proposed system has been assessed on a dataset of 200 dermoscopic images of the `Hospital Pedro Hispano' [1] and the results of cross-validation have shown high detection accuracy.
Collapse
|
30
|
Machado M, Pereira J, Fonseca-Pinto R. Classification of reticular pattern and streaks in dermoscopic images based on texture analysis. J Med Imaging (Bellingham) 2015; 2:044503. [PMID: 26719848 DOI: 10.1117/1.jmi.2.4.044503] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2015] [Accepted: 11/30/2015] [Indexed: 11/14/2022] Open
Abstract
The early detection of melanoma is one of the greatest challenges in clinical practice of dermatology, and the reticular pattern is one of the most important dermoscopic structures to improve melanocytic lesion diagnosis. A texture-based approach is developed for the automatic detection of reticular patterns, whose output will assist clinical decision-making. Feature selection was based on the use of two algorithms by means of the classical graylevel co-occurrence matrix and Laws energy masks optimized on a set of 104 dermoscopy images. The AdaBoost (adaptive boosting) approach to machine learning was used within this strategy. Results suggest superiority of LEM for reticular pattern detection in dermoscopic images, achieving a sensitivity of 90.16% and a specificity of 86.67%. The use of automatic classification in dermoscopy to support clinicians is a strong tool to assist diagnosis; however, the use of automatic classification as a complementary tool in clinical routine requires algorithms with high levels of sensitivity and specificity. The results presented in this work will contribute to achieving this goal.
Collapse
Affiliation(s)
- Marlene Machado
- Instituto de Telecomunicações, Multimedia Signal Processing Group , Morro do Lena, Alto do Vieiro, Campus 2, IPLeiria, Leiria 2411-901, Portugal
| | - Jorge Pereira
- Instituto de Telecomunicações, Multimedia Signal Processing Group , Morro do Lena, Alto do Vieiro, Campus 2, IPLeiria, Leiria 2411-901, Portugal
| | - Rui Fonseca-Pinto
- Instituto de Telecomunicações, Multimedia Signal Processing Group , Morro do Lena, Alto do Vieiro, Campus 2, IPLeiria, Leiria 2411-901, Portugal ; Polytechnic Institute of Leiria, School of Technology and Management , Morro do Lena, Alto do Vieiro, Campus 2, Apartado 4163, Leiria 2411-901, Portugal
| |
Collapse
|
31
|
Guerra-Rosas E, Álvarez-Borrego J. Methodology for diagnosing of skin cancer on images of dermatologic spots by spectral analysis. BIOMEDICAL OPTICS EXPRESS 2015; 6:3876-91. [PMID: 26504638 PMCID: PMC4605047 DOI: 10.1364/boe.6.003876] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2015] [Revised: 07/21/2015] [Accepted: 08/24/2015] [Indexed: 05/21/2023]
Abstract
In this paper a new methodology for the diagnosing of skin cancer on images of dermatologic spots using image processing is presented. Currently skin cancer is one of the most frequent diseases in humans. This methodology is based on Fourier spectral analysis by using filters such as the classic, inverse and k-law nonlinear. The sample images were obtained by a medical specialist and a new spectral technique is developed to obtain a quantitative measurement of the complex pattern found in cancerous skin spots. Finally a spectral index is calculated to obtain a range of spectral indices defined for skin cancer. Our results show a confidence level of 95.4%.
Collapse
Affiliation(s)
- Esperanza Guerra-Rosas
- Departamento de Investigación en Física, Universidad de Sonora (UNISON), Luis Encinas y Rosales S/N, Col. Centro, Hermosillo, Sonora, C.P. 83000, Mexico ;
| | - Josué Álvarez-Borrego
- Centro de Investigación Científica y de Educación Superior de Ensenada (CICESE), División de Física Aplicada, Departamento de Óptica, Carretera Ensenada-Tijuana No. 3918, Fraccionamiento Zona Playitas, Ensenada, Baja California, C.P. 22860, Mexico ;
| |
Collapse
|
32
|
Lázár I, Hajdu A. Segmentation of retinal vessels by means of directional response vector similarity and region growing. Comput Biol Med 2015; 66:209-21. [PMID: 26432200 DOI: 10.1016/j.compbiomed.2015.09.008] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2015] [Revised: 09/08/2015] [Accepted: 09/09/2015] [Indexed: 10/23/2022]
Abstract
This paper presents a novel retinal vessel segmentation method. Opposed to the general approach in similar directional methods, where only the maximal or summed responses of a pixel are used, here, the directional responses of a pixel are considered as a vector. The segmentation method is a unique region growing procedure which combines a hysteresis thresholding scheme with the response vector similarity of adjacent pixels. A vessel score map is constructed as the combination of the statistical measures of the response vectors and its local maxima to provide the seeds for the region growing procedure. A nearest neighbor classifier based on a rotation invariant response vector similarity measure is used to filter the seed points. Many techniques in the literature that capture the Gaussian-like cross-section of vessels suffer from the drawback of giving false high responses to the steep intensity transitions at the boundary of the optic disc and bright lesions. To overcome this issue, we also propose a symmetry constrained multiscale matched filtering technique. The proposed vessel segmentation method has been tested on three publicly available image sets, where its performance proved to be competitive with the state-of-the-art and comparable to the accuracy of a human observer, as well.
Collapse
Affiliation(s)
- István Lázár
- Faculty of Informatics, University of Debrecen, 4010 Debrecen, Hungary.
| | - András Hajdu
- Faculty of Informatics, University of Debrecen, 4010 Debrecen, Hungary.
| |
Collapse
|
33
|
Ruela M, Barata C, Marques JS, Rozeira J. A system for the detection of melanomas in dermoscopy images using shape and symmetry features. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION 2015. [DOI: 10.1080/21681163.2015.1029080] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
34
|
Abuzaghleh O, Barkana BD, Faezipour M. Noninvasive Real-Time Automated Skin Lesion Analysis System for Melanoma Early Detection and Prevention. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2015; 3:2900310. [PMID: 27170906 PMCID: PMC4848099 DOI: 10.1109/jtehm.2015.2419612] [Citation(s) in RCA: 103] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/08/2014] [Revised: 01/05/2015] [Accepted: 03/21/2015] [Indexed: 11/11/2022]
Abstract
Melanoma spreads through metastasis, and therefore, it has been proved to be very fatal. Statistical evidence has revealed that the majority of deaths resulting from skin cancer are as a result of melanoma. Further investigations have shown that the survival rates in patients depend on the stage of the cancer; early detection and intervention of melanoma implicate higher chances of cure. Clinical diagnosis and prognosis of melanoma are challenging, since the processes are prone to misdiagnosis and inaccuracies due to doctors’ subjectivity. Malignant melanomas are asymmetrical, have irregular borders, notched edges, and color variations, so analyzing the shape, color, and texture of the skin lesion is important for the early detection and prevention of melanoma. This paper proposes the two major components of a noninvasive real-time automated skin lesion analysis system for the early detection and prevention of melanoma. The first component is a real-time alert to help users prevent skinburn caused by sunlight; a novel equation to compute the time for skin to burn is thereby introduced. The second component is an automated image analysis module, which contains image acquisition, hair detection and exclusion, lesion segmentation, feature extraction, and classification. The proposed system uses PH2 Dermoscopy image database from Pedro Hispano Hospital for the development and testing purposes. The image database contains a total of 200 dermoscopy images of lesions, including benign, atypical, and melanoma cases. The experimental results show that the proposed system is efficient, achieving classification of the benign, atypical, and melanoma images with accuracy of 96.3%, 95.7%, and 97.5%, respectively.
Collapse
|
35
|
Hames SC, Sinnya S, Tan JM, Morze C, Sahebian A, Soyer HP, Prow TW. Automated detection of actinic keratoses in clinical photographs. PLoS One 2015; 10:e0112447. [PMID: 25615930 PMCID: PMC4304708 DOI: 10.1371/journal.pone.0112447] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2014] [Accepted: 10/06/2014] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Clinical diagnosis of actinic keratosis is known to have intra- and inter-observer variability, and there is currently no non-invasive and objective measure to diagnose these lesions. OBJECTIVE The aim of this pilot study was to determine if automatically detecting and circumscribing actinic keratoses in clinical photographs is feasible. METHODS Photographs of the face and dorsal forearms were acquired in 20 volunteers from two groups: the first with at least on actinic keratosis present on the face and each arm, the second with no actinic keratoses. The photographs were automatically analysed using colour space transforms and morphological features to detect erythema. The automated output was compared with a senior consultant dermatologist's assessment of the photographs, including the intra-observer variability. Performance was assessed by the correlation between total lesions detected by automated method and dermatologist, and whether the individual lesions detected were in the same location as the dermatologist identified lesions. Additionally, the ability to limit false positives was assessed by automatic assessment of the photographs from the no actinic keratosis group in comparison to the high actinic keratosis group. RESULTS The correlation between the automatic and dermatologist counts was 0.62 on the face and 0.51 on the arms, compared to the dermatologist's intra-observer variation of 0.83 and 0.93 for the same. Sensitivity of automatic detection was 39.5% on the face, 53.1% on the arms. Positive predictive values were 13.9% on the face and 39.8% on the arms. Significantly more lesions (p<0.0001) were detected in the high actinic keratosis group compared to the no actinic keratosis group. CONCLUSIONS The proposed method was inferior to assessment by the dermatologist in terms of sensitivity and positive predictive value. However, this pilot study used only a single simple feature and was still able to achieve sensitivity of detection of 53.1% on the arms.This suggests that image analysis is a feasible avenue of investigation for overcoming variability in clinical assessment. Future studies should focus on more sophisticated features to improve sensitivity for actinic keratoses without erythema and limit false positives associated with the anatomical structures on the face.
Collapse
Affiliation(s)
- Samuel C. Hames
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| | - Sudipta Sinnya
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| | - Jean-Marie Tan
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| | - Conrad Morze
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| | - Azadeh Sahebian
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| | - H. Peter Soyer
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| | - Tarl W. Prow
- Dermatology Research Center, School of Medicine, University of Queensland, Translational Research Institute, Princess Alexandra Hospital, Brisbane, Australia
| |
Collapse
|
36
|
García Arroyo JL, García Zapirain B. Detection of pigment network in dermoscopy images using supervised machine learning and structural analysis. Comput Biol Med 2014; 44:144-57. [DOI: 10.1016/j.compbiomed.2013.11.002] [Citation(s) in RCA: 50] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2013] [Revised: 10/30/2013] [Accepted: 11/03/2013] [Indexed: 11/29/2022]
|
37
|
|
38
|
Barata C, Ruela M, Mendonça T, Marques JS. A Bag-of-Features Approach for the Classification of Melanomas in Dermoscopy Images: The Role of Color and Texture Descriptors. SERIES IN BIOENGINEERING 2014. [DOI: 10.1007/978-3-642-39608-3_3] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
39
|
|
40
|
|
41
|
What Is the Role of Color in Dermoscopy Analysis? PATTERN RECOGNITION AND IMAGE ANALYSIS 2013. [DOI: 10.1007/978-3-642-38628-2_97] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|