1
|
Hanlon KL, Wei G, Correa-Selm L, Grichnik JM. Dermoscopy and skin imaging light sources: a comparison and review of spectral power distribution and color consistency. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:080902. [PMID: 36452032 PMCID: PMC9360608 DOI: 10.1117/1.jbo.27.8.080902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 07/15/2022] [Indexed: 06/17/2023]
Abstract
SIGNIFICANCE Dermoscopes incorporate light, polarizers, and optical magnification into a handheld tool that is commonly used by dermatologists to evaluate skin findings. Diagnostic accuracy is improved when dermoscopes are used, and some major artificial intelligence (AI) projects have been accomplished using dermocopic images. Color rendering consistency and fidelity are crucial for clinical diagnostics, AI, and image processing applications. AIM With many devices available on the market, our objective was to measure the emission spectra of various dermoscopes, compare them with other light sources, and illustrate variations in reflected colors from images of a reference sample. APPROACH A spectrometer measured the spectral power distribution (SPD) produced by four dermoscope models and three alternate light sources, illustrating differences in the emission spectra. Most dermoscopes use light-emitting diodes (LEDs), which are inconsistent when compared with one another. An LED was compared with halogen, xenon-arc, and daylight sources. Images of a micro ColorChecker were acquired from several sources, and three specific colors were selected to compare in CIELAB color space. Color consistency and color fidelity measured by color rendering index (CRI) and TM-30-18 graphical vectors show variation in saturation and chroma fidelity. RESULTS A marked degree of variation was observed in both the emission and reflected light coming from different dermoscopes and compared with other sources. The same chromophores appeared differently depending on the light source used. CONCLUSIONS A lack of uniform illumination resulted in inconsistent image color and likely impacted metamerism and visibility of skin chromophores in real-world settings. Artificial light in skin examinations, especially LEDs, may present challenges for the visual separation of specific colors. Attention to LEDs SPD may be important, especially as the field increases dependency on machine/computer vision.
Collapse
Affiliation(s)
- Katharine L. Hanlon
- University of South Florida, Department of Dermatology and Cutaneous Surgery, Tampa, Florida, United States
- Moffitt Cancer Center, Cutaneous Oncology, Tampa, Florida, United States
| | - Grace Wei
- University of South Florida, Morsani College of Medicine, Tampa, Florida, United States
| | - Lilia Correa-Selm
- University of South Florida, Department of Dermatology and Cutaneous Surgery, Tampa, Florida, United States
- Moffitt Cancer Center, Cutaneous Oncology, Tampa, Florida, United States
| | - James M. Grichnik
- University of South Florida, Department of Dermatology and Cutaneous Surgery, Tampa, Florida, United States
- Moffitt Cancer Center, Cutaneous Oncology, Tampa, Florida, United States
| |
Collapse
|
2
|
Cugmas B, Štruc E, Kovče U, Lužar K, Olivry T. Evaluation of native canine skin color by smartphone-based dermatoscopy. Skin Res Technol 2022; 28:299-304. [PMID: 35064590 PMCID: PMC9907669 DOI: 10.1111/srt.13130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Accepted: 12/18/2021] [Indexed: 11/30/2022]
Abstract
BACKGROUND Human skin color, predominantly determined by the chromophores of melanin, hemoglobin, and exogenous carotenoids, is often measured to serve various medical and cosmetic applications. Although colorimetry has been used to evaluate the skin erythema in allergic dogs, the native canine skin color remains unknown. METHODS We measured the skin color in 101 healthy dogs using a calibrated optical system with a smartphone and a mobile dermatoscope DermLite DL1. The results were retrieved in the CIELAB color system and compared to the human color ranges. RESULTS The lightness (L*) of canine skin ranged from 28.5 to 78.3, which is slightly broader than that of human skin. There was a difference of 3.9 in redness (a*) between canine and human skin, but this variation could be attributed to the similarly valued colorimetric error of the optical system. Nonetheless, the skin yellowness was significantly different for dogs and humans (respective median b* of 12.3 versus 16.6, p < 0.01). This difference might be due to canids not being able to accumulate typically yellowish carotenoids. Furthermore, the native canine skin color did not exhibit a typical dependence between the coordinates of lightness (L*) and yellowness (b*), known as the individual typology angle, °ITA. CONCLUSION We reported the first dataset of the native canine skin color in the CIELAB color space. We discovered a similarity in skin lightness and a difference in skin yellowness. However, further studies are needed for a more precise comparison of skin redness.
Collapse
Affiliation(s)
- Blaž Cugmas
- Biophotonics laboratory, Institute of Atomic Physics and Spectroscopy, University of Latvia, Rīga, Latvia.,Veterinary clinic Zamba, Vets4science Ltd, Celje, Slovenia
| | | | - Urška Kovče
- Veterinary clinic Zamba, Vets4science Ltd, Celje, Slovenia
| | - Katja Lužar
- Veterinary clinic Zamba, Vets4science Ltd, Celje, Slovenia
| | - Thierry Olivry
- Department of Clinical Sciences, College of Veterinary Medicine, NC State University, Raleigh, North Carolina, USA
| |
Collapse
|
3
|
Baig R, Bibi M, Hamid A, Kausar S, Khalid S. Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review. Curr Med Imaging 2021; 16:513-533. [PMID: 32484086 DOI: 10.2174/1573405615666190129120449] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 12/17/2018] [Accepted: 01/02/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND Automated intelligent systems for unbiased diagnosis are primary requirement for the pigment lesion analysis. It has gained the attention of researchers in the last few decades. These systems involve multiple phases such as pre-processing, feature extraction, segmentation, classification and post processing. It is crucial to accurately localize and segment the skin lesion. It is observed that recent enhancements in machine learning algorithms and dermoscopic techniques reduced the misclassification rate therefore, the focus towards computer aided systems increased exponentially in recent years. Computer aided diagnostic systems are reliable source for dermatologists to analyze the type of cancer, but it is widely acknowledged that even higher accuracy is needed for computer aided diagnostic systems to be adopted practically in the diagnostic process of life threatening diseases. INTRODUCTION Skin cancer is one of the most threatening cancers. It occurs by the abnormal multiplication of cells. The core three types of skin cells are: Squamous, Basal and Melanocytes. There are two wide classes of skin cancer; Melanocytic and non-Melanocytic. It is difficult to differentiate between benign and malignant melanoma, therefore dermatologists sometimes misclassify the benign and malignant melanoma. Melanoma is estimated as 19th most frequent cancer, it is riskier than the Basel and Squamous carcinoma because it rapidly spreads throughout the body. Hence, to lower the death risk, it is critical to diagnose the correct type of cancer in early rudimentary phases. It can occur on any part of body, but it has higher probability to occur on chest, back and legs. METHODS The paper presents a review of segmentation and classification techniques for skin lesion detection. Dermoscopy and its features are discussed briefly. After that Image pre-processing techniques are described. A thorough review of segmentation and classification phases of skin lesion detection using deep learning techniques is presented Literature is discussed and a comparative analysis of discussed methods is presented. CONCLUSION In this paper, we have presented the survey of more than 100 papers and comparative analysis of state of the art techniques, model and methodologies. Malignant melanoma is one of the most threating and deadliest cancers. Since the last few decades, researchers are putting extra attention and effort in accurate diagnosis of melanoma. The main challenges of dermoscopic skin lesion images are: low contrasts, multiple lesions, irregular and fuzzy borders, blood vessels, regression, hairs, bubbles, variegated coloring and other kinds of distortions. The lack of large training dataset makes these problems even more challenging. Due to recent advancement in the paradigm of deep learning, and specially the outstanding performance in medical imaging, it has become important to review the deep learning algorithms performance in skin lesion segmentation. Here, we have discussed the results of different techniques on the basis of different evaluation parameters such as Jaccard coefficient, sensitivity, specificity and accuracy. And the paper listed down the major achievements in this domain with the detailed discussion of the techniques. In future, it is expected to improve results by utilizing the capabilities of deep learning frameworks with other pre and post processing techniques so reliable and accurate diagnostic systems can be built.
Collapse
Affiliation(s)
- Ramsha Baig
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Maryam Bibi
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Anmol Hamid
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Sumaira Kausar
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Shahzad Khalid
- Department of Computer Engineering, Bahria University, Islamabad, Pakistan
| |
Collapse
|
4
|
Cugmas B, Štruc E. Accuracy of an Affordable Smartphone-Based Teledermoscopy System for Color Measurements in Canine Skin. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6234. [PMID: 33142901 PMCID: PMC7662536 DOI: 10.3390/s20216234] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 10/30/2020] [Accepted: 10/30/2020] [Indexed: 12/17/2022]
Abstract
Quality smartphone cameras and affordable dermatoscopes have enabled teledermoscopy to become a popular medical and veterinary tool for analyzing skin lesions such as melanoma and erythema. However, smartphones acquire images in an unknown RGB color space, which prevents a standardized colorimetric skin analysis. In this work, we supplemented a typical veterinary teledermoscopy system with a conventional color calibration procedure, and we studied two mid-priced smartphones in evaluating native and erythematous canine skin color. In a laboratory setting with the ColorChecker, the teledermoscopy system reached CIELAB-based color differences ΔE of 1.8-6.6 (CIE76) and 1.1-4.5 (CIE94). Intra- and inter-smartphone variability resulted in the color differences (CIE76) of 0.1, and 2.0-3.9, depending on the selected color range. Preliminary clinical measurements showed that canine skin is less red and yellow (lower a* and b* for ΔE of 10.7) than standard Caucasian human skin. Estimating the severity of skin erythema with an erythema index led to errors between 0.5-3%. After constructing a color calibration model for each smartphone, we expedited clinical measurements without losing colorimetric accuracy by introducing a simple image normalization on a white standard. To conclude, the calibrated teledermoscopy system is fast and accurate enough for various colorimetric applications in veterinary dermatology.
Collapse
Affiliation(s)
- Blaž Cugmas
- Biophotonics Laboratory, Institute of Atomic Physics and Spectroscopy, University of Latvia, 19 Rainis Blvd., LV-1586 Rīga, Latvia
| | - Eva Štruc
- Vetamplify SIA, Veterinary Services, 57/59–32 Krišjāņa Valdemāra Str., LV-1010 Rīga, Latvia;
| |
Collapse
|
5
|
Image Quality Assessment of Digital Image Capturing Devices for Melanoma Detection. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10082876] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
The fast-growing incidence of skin cancer, especially melanoma, is the guiding principle for intense development of various digital image-capturing devices providing easier recognition of melanoma by dermatologists. Handheld and digital dermoscopy, following of mole changes with smartphones and digital analysing of mole images, is based on evaluation of the colours, shape and deep structures in the skin moles. Incorrect colour information of an image, under- or overexposed images, lack of sharpness and low resolution of the images, can lead to melanoma misdiagnosis. The purpose of our study was to determine the colour error in the image according to the given lighting conditions and different camera settings. We focused on measuring the image quality parameters of smartphones and high-resolution cameras to compare them with the results of state-of-the-art dermoscopy device systems. We applied standardised measuring methods. The spatial frequency response method was applied for measuring the sharpness and resolution of the tested camera systems. Colour images with known reference values were captured from the test target, to evaluate colour error as a CIELAB (Commission Internationale de l’Eclairage) ΔE*ab colour difference as seen by a human observer. The results of our measurements yielded two significant findings. First, all tested cameras produced inaccurate colours when operating in automatic mode, and second, the amount of sharpening was too intensive. These deficiencies can be eliminated through adjusting the camera parameters manually or by image post-production. The presented two-step camera calibration procedure improves the colour accuracy of captured clinical and dermoscopy images significantly.
Collapse
|
6
|
A comparative study of features selection for skin lesion detection from dermoscopic images. ACTA ACUST UNITED AC 2019. [DOI: 10.1007/s13721-019-0209-1] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
7
|
Barata C, Celebi ME, Marques JS. A Survey of Feature Extraction in Dermoscopy Image Analysis of Skin Cancer. IEEE J Biomed Health Inform 2019; 23:1096-1109. [DOI: 10.1109/jbhi.2018.2845939] [Citation(s) in RCA: 81] [Impact Index Per Article: 16.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
8
|
Celebi ME, Codella N, Halpern A. Dermoscopy Image Analysis: Overview and Future Directions. IEEE J Biomed Health Inform 2019; 23:474-478. [DOI: 10.1109/jbhi.2019.2895803] [Citation(s) in RCA: 76] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
9
|
Pathan S, Prabhu KG, Siddalingaswamy P. Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.07.010] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
10
|
Rastgoo M, Garcia R, Morel O, Marzani F. Automatic differentiation of melanoma from dysplastic nevi. Comput Med Imaging Graph 2015; 43:44-52. [PMID: 25797605 DOI: 10.1016/j.compmedimag.2015.02.011] [Citation(s) in RCA: 67] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2014] [Revised: 02/11/2015] [Accepted: 02/25/2015] [Indexed: 11/23/2022]
Abstract
Malignant melanoma causes the majority of deaths related to skin cancer. Nevertheless, it is the most treatable one, depending on its early diagnosis. The early prognosis is a challenging task for both clinicians and dermatologist, due to the characteristic similarities of melanoma with other skin lesions such as dysplastic nevi. In the past decades, several computerized lesion analysis algorithms have been proposed by the research community for detection of melanoma. These algorithms mostly focus on differentiating melanoma from benign lesions and few have considered the case of melanoma against dysplastic nevi. In this paper, we consider the most challenging task and propose an automatic framework for differentiation of melanoma from dysplastic nevi. The proposed framework also considers combination and comparison of several texture features beside the well used colour and shape features based on "ABCD" clinical rule in the literature. Focusing on dermoscopy images, we evaluate the performance of the framework using two feature extraction approaches, global and local (bag of words) and three classifiers such as support vector machine, gradient boosting and random forest. Our evaluation revealed the potential of texture features and random forest as an almost independent classifier. Using texture features and random forest for differentiation of melanoma and dysplastic nevi, the framework achieved the highest sensitivity of 98% and specificity of 70%.
Collapse
Affiliation(s)
- Mojdeh Rastgoo
- Computer Vision and Robotics Group, Universitat de Girona, Campus Montilivi, Edifici PIV, s/n, 17071 Girona, Spain; Le2i-UMR CNRS 6306, Université de Bourgogne, BP 47870, 21078 Dijon, France.
| | - Rafael Garcia
- Computer Vision and Robotics Group, Universitat de Girona, Campus Montilivi, Edifici PIV, s/n, 17071 Girona, Spain
| | - Olivier Morel
- Le2i-UMR CNRS 6306, Université de Bourgogne, BP 47870, 21078 Dijon, France
| | - Franck Marzani
- Le2i-UMR CNRS 6306, Université de Bourgogne, BP 47870, 21078 Dijon, France
| |
Collapse
|
11
|
Barata C, Celebi ME, Marques JS. Improving dermoscopy image classification using color constancy. IEEE J Biomed Health Inform 2014; 19:1146-52. [PMID: 25073179 DOI: 10.1109/jbhi.2014.2336473] [Citation(s) in RCA: 54] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Robustness is one of the most important characteristics of computer-aided diagnosis systems designed for dermoscopy images. However, it is difficult to ensure this characteristic if the systems operate with multisource images acquired under different setups. Changes in the illumination and acquisition devices alter the color of images and often reduce the performance of the systems. Thus, it is important to normalize the colors of dermoscopy images before training and testing any system. In this paper, we investigate four color constancy algorithms: Gray World, max-RGB, Shades of Gray, and General Gray World. Our results show that color constancy improves the classification of multisource images, increasing the sensitivity of a bag-of-features system from 71.0% to 79.7% and the specificity from 55.2% to 76% using only 1-D RGB histograms as features.
Collapse
|
12
|
Charrière R, Hébert M, Trémeau A, Destouches N. Color calibration of an RGB camera mounted in front of a microscope with strong color distortion. APPLIED OPTICS 2013; 52:5262-5271. [PMID: 23872775 DOI: 10.1364/ao.52.005262] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/08/2013] [Accepted: 06/24/2013] [Indexed: 06/02/2023]
Abstract
This paper aims at showing that performing color calibration of an RGB camera can be achieved even in the case where the optical system before the camera introduces strong color distortion. In the present case, the optical system is a microscope containing a halogen lamp, with a nonuniform irradiance on the viewed surface. The calibration method proposed in this work is based on an existing method, but it is preceded by a three-step preprocessing of the RGB images aiming at extracting relevant color information from the strongly distorted images, taking especially into account the nonuniform irradiance map and the perturbing texture due to the surface topology of the standard color calibration charts when observed at micrometric scale. The proposed color calibration process consists first in computing the average color of the color-chart patches viewed under the microscope; then computing white balance, gamma correction, and saturation enhancement; and finally applying a third-order polynomial regression color calibration transform. Despite the nonusual conditions for color calibration, fairly good performance is achieved from a 48 patch Lambertian color chart, since an average CIE-94 color difference on the color-chart colors lower than 2.5 units is obtained.
Collapse
Affiliation(s)
- Renée Charrière
- Université de Lyon, Université Jean Monnet de Saint Etienne, CNRS UMR 5516, Laboratoire Hubert Curien, F-42000 Saint Etienne, France.
| | | | | | | |
Collapse
|
13
|
Computerized analysis of pigmented skin lesions: A review. Artif Intell Med 2012; 56:69-90. [DOI: 10.1016/j.artmed.2012.08.002] [Citation(s) in RCA: 238] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2012] [Revised: 08/02/2012] [Accepted: 08/19/2012] [Indexed: 11/20/2022]
|