1
|
Park H, Park SR, Lee S, Hwang J, Lee M, Jang SI, Jung Y, Yeon Y, Kang N, Suh BF, Kim E. Development and application of artificial intelligence-based facial skin image diagnosis system: Changes in facial skin characteristics with ageing in Korean women. Int J Cosmet Sci 2024; 46:199-208. [PMID: 37881146 DOI: 10.1111/ics.12924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 10/04/2023] [Accepted: 10/17/2023] [Indexed: 10/27/2023]
Abstract
OBJECTIVE To develop and validate an artificial intelligence (AI)-based diagnostic system for analysing facial skin images using expert judgements and explore its feasibility for skin ageing research, specifically by evaluating facial skin changes in Korean women of various ages. METHODS Our AI-based facial skin diagnosis system (Dr. AMORE®) uses facial images of Korean women to analyse wrinkles, pigmentation, skin pores, and other skin red spots. The system is trained using clinical expert evaluations and deep learning. We assessed the system's precision and sensitivity by analysing the correlation between the diagnoses by the AI system and those of the experts. We used 120 images of Korean women aged 10-60 years to evaluate the changes in various facial skin characteristics with ageing. RESULTS The precision and sensitivity of the developed system were excellent (>0.9%), and the diagnosis scores using the detected area and intensity of each item were correlated significantly higher with the visual evaluation results of the clinical experts (>0.8, p < 0.001). We also analysed facial images of Korean women aged 10-60 years to quantify changes in the scores of wrinkles, pigmentation, and skin pores with age. We identified the age group with the most significant changes as 20s to 30s. Analysis of the detailed skin characteristics of each item showed that wrinkles and pigmentation changed significantly in the 20s-30s, and skin pores increased significantly in the 10s-20s. There was no significant correlation with age or change according to the age group for skin red spots. CONCLUSION Developed AI-based facial skin diagnosis system can automatically diagnose skin conditions based on clinical expert judgement using only photographic images and analyse various items in detail, quantitatively, and visually. This AI system can provide new and useful approaches in research areas that require a lot of resources and different characterizations, such as the study of facial skin ageing.
Collapse
Affiliation(s)
- Hyeokgon Park
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Sae-Ra Park
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Sangran Lee
- AI Solution Team, AMOREPACIFIC, Seoul, Korea
| | | | - Myeongryeol Lee
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Sue Im Jang
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Yuchul Jung
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Yeongmin Yeon
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Nayoung Kang
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Byung-Fhy Suh
- AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Eunjoo Kim
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| |
Collapse
|
2
|
Morales R, Martinez-Arroyo A, Aguilar E. Robust Deep Neural Network for Learning in Noisy Multi-Label Food Images. SENSORS (BASEL, SWITZERLAND) 2024; 24:2034. [PMID: 38610246 PMCID: PMC11014385 DOI: 10.3390/s24072034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/17/2024] [Accepted: 03/20/2024] [Indexed: 04/14/2024]
Abstract
Deep networks can facilitate the monitoring of a balanced diet to help prevent various health problems related to eating disorders. Large, diverse, and clean data are essential for learning these types of algorithms. Although data can be collected automatically, the data cleaning process is time-consuming. This study aims to provide the model with the ability to learn even when the data are not completely clean. For this purpose, we extend the Attentive Feature MixUp method to enable its learning on noisy multi-label food data. The extension was based on the hypothesis that during the MixUp phase, when a pair of images are mixed, the resulting soft labels should be different for each ingredient, being larger for ingredients that are mixed with the background because they are better distinguished than when they are mixed with other ingredients. Furthermore, to address data perturbation, the incorporation of the Laplace approximation as a post-hoc method was analyzed. The evaluation of the proposed method was performed on two food datasets, where a notable performance improvement was obtained in terms of Jaccard index and F1 score, which validated the hypothesis raised. With the proposed MixUp, our method reduces the memorization of noisy multi-labels, thereby improving its performance.
Collapse
Affiliation(s)
- Roberto Morales
- Departamento de Ingeniería y Sistemas de Computación, Universidad Católica del Norte, Av. Angamos 0610, Antofagasta 1270709, Chile;
| | - Angela Martinez-Arroyo
- Centro de Investigación del Comportamiento Alimentario, Escuela Nutrición y Dietética, Universidad de Valparaíso, Av. Gran Bretaña. Playa Ancha, Valparaíso 2360102, Chile;
| | - Eduardo Aguilar
- Departamento de Ingeniería y Sistemas de Computación, Universidad Católica del Norte, Av. Angamos 0610, Antofagasta 1270709, Chile;
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes 585, 08007 Barcelona, Spain
| |
Collapse
|
3
|
Abbasi EY, Deng Z, Magsi AH, Ali Q, Kumar K, Zubedi A. Optimizing Skin Cancer Survival Prediction with Ensemble Techniques. Bioengineering (Basel) 2023; 11:43. [PMID: 38247920 PMCID: PMC10813432 DOI: 10.3390/bioengineering11010043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 12/22/2023] [Accepted: 12/27/2023] [Indexed: 01/23/2024] Open
Abstract
The advancement in cancer research using high throughput technology and artificial intelligence (AI) is gaining momentum to improve disease diagnosis and targeted therapy. However, the complex and imbalanced data with high dimensionality pose significant challenges for computational approaches and multi-omics data analysis. This study focuses on predicting skin cancer and analyzing overall survival probability. We employ the Kaplan-Meier estimator and Cox proportional hazards regression model, utilizing high-throughput machine learning (ML)-based ensemble methods. Our proposed ML-based ensemble techniques are applied to a publicly available dataset from the ICGC Data Portal, specifically targeting skin cutaneous melanoma cancers (SKCM). We used eight baseline classifiers, namely, random forest (RF), decision tree (DT), gradient boosting (GB), AdaBoost, Gaussian naïve Bayes (GNB), extra tree (ET), logistic regression (LR), and light gradient boosting machine (Light GBM or LGBM). The study evaluated the performance of the proposed ensemble methods and survival analysis on SKCM. The proposed methods demonstrated promising results, outperforming other algorithms and models in terms of accuracy compared to traditional methods. Specifically, the RF classifier exhibited outstanding precision results. Additionally, four different ensemble methods (stacking, bagging, boosting, and voting) were created and trained to achieve optimal results. The performance was evaluated and interpreted using accuracy, precision, recall, F1 score, confusion matrix, and ROC curves, where the voting method achieved a promising accuracy of 99%. On the other hand, the RF classifier achieved an outstanding accuracy of 99%, which exhibits the best performance. We compared our proposed study with the existing state-of-the-art techniques and found significant improvements in several key aspects. Our approach not only demonstrated superior performance in terms of accuracy but also showcased remarkable efficiency. Thus, this research work contributes to diagnosing SKCM with high accuracy.
Collapse
Affiliation(s)
- Erum Yousef Abbasi
- State Key Laboratory of Wireless Network Positioning and Communication Engineering Integration Research, School of Electronics Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China;
| | - Zhongliang Deng
- State Key Laboratory of Wireless Network Positioning and Communication Engineering Integration Research, School of Electronics Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China;
| | - Arif Hussain Magsi
- State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China;
| | - Qasim Ali
- Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro 76062, Pakistan;
| | - Kamlesh Kumar
- School of Electronics Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China;
| | - Asma Zubedi
- School of Economics and Management, Beijing University of Posts and Telecommunications, Beijing 100876, China;
| |
Collapse
|
4
|
Jung G, Kim S, Lee J, Yoo S. Deep learning-based pigment analysis model trained with optical approach and ground truth assistance. JOURNAL OF BIOPHOTONICS 2023; 16:e202300231. [PMID: 37602740 DOI: 10.1002/jbio.202300231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 08/14/2023] [Accepted: 08/15/2023] [Indexed: 08/22/2023]
Abstract
This study introduces an integrated training method combining the optical approach with ground truth for skin pigment analysis. Deep learning is increasingly applied to skin pigment analysis, primarily melanin and hemoglobin. While regression analysis is a widely used training method to predict ground truth-like outputs, the input image resolution is restricted by computational resources. The optical approach-based regression method can alleviate this problem, but compromises performance. We propose a strategy to overcome the limitation of image resolution while preserving performance by incorporating ground truth within the optical approach-based learning structure. The proposed model decomposes skin images into melanin, hemoglobin, and shading maps, reconstructing them by solving the forward problem with reference to the ground truth for pigments. Evaluation against the VISIA system, a professional diagnostic equipment, yields correlation coefficients of 0.978 for melanin and 0.975 for hemoglobin. Furthermore, our model can produce pigment-modified images for applications like simulating treatment effects.
Collapse
Affiliation(s)
- Geunho Jung
- AI R&D Center, Lululab Inc., Seoul, Republic of Korea
| | - Semin Kim
- AI R&D Center, Lululab Inc., Seoul, Republic of Korea
| | - Jongha Lee
- AI R&D Center, Lululab Inc., Seoul, Republic of Korea
| | - Sangwook Yoo
- AI R&D Center, Lululab Inc., Seoul, Republic of Korea
| |
Collapse
|
5
|
Moon CI, Lee J, Baek YS, Lee O. Psoriasis severity classification based on adaptive multi-scale features for multi-severity disease. Sci Rep 2023; 13:17331. [PMID: 37833444 PMCID: PMC10575863 DOI: 10.1038/s41598-023-44478-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 10/09/2023] [Indexed: 10/15/2023] Open
Abstract
Psoriasis is a skin disease that causes lesions of various sizes across the body and can persist for years with cyclic deterioration and improvement. During treatment, and a multiple-severity disease, with irregular severity within the observation area may be found. The current psoriasis evaluation is based on the subjective evaluation criteria of the clinician using the psoriasis area and severity index (PASI). We proposed a novel psoriasis evaluation method that detects representative regions as evaluation criteria, and extracts severity features to improve the evaluation performance of various types of psoriasis, including multiple-severity diseases. We generated multiple-severity disease images using CutMix and proposed a hierarchical multi-scale deformable attention module (MS-DAM) that can adaptively detect representative regions of irregular and complex patterns in multiple-severity disease analyses. EfficientNet B1 with MS-DAM exhibited the best classification performance with an F1-score of 0.93. Compared with the performance of the six existing self-attention methods, the proposed MS-DAM showed more than 5% higher accuracy than that of multiscale channel attention module (MS-CAM). Using the gradient-weighted activation mapping method, we confirmed that the proposed method works at par with human visual perception. We performed a more objective, effective, and accurate analysis of psoriasis severity using the proposed method.
Collapse
Affiliation(s)
- Cho-I Moon
- Department of Software Convergence, Graduate School, Soonchunhyang University, 22, Soonchunhyang-ro, Asan, Chungnam-do, 31538, Republic of Korea
| | - Jiwon Lee
- Department of Software Convergence, Graduate School, Soonchunhyang University, 22, Soonchunhyang-ro, Asan, Chungnam-do, 31538, Republic of Korea
| | - Yoo Sang Baek
- Department of Dermatology, Guro Hospital, Korea University College of Medicine, Seoul, 08308, Republic of Korea
| | - Onesok Lee
- Department of Software Convergence, Graduate School, Soonchunhyang University, 22, Soonchunhyang-ro, Asan, Chungnam-do, 31538, Republic of Korea.
- Department of Medical IT Engineering, College of Medical Sciences, Soonchunhyang University, 22, Soonchunhyang-ro, Asan, Chungnam-do, 31538, Republic of Korea.
| |
Collapse
|
6
|
Attar R, Hurault G, Wang Z, Mokhtari R, Pan K, Olabi B, Earp E, Steele L, Williams HC, Tanaka RJ. Reliable Detection of Eczema Areas for Fully Automated Assessment of Eczema Severity from Digital Camera Images. JID INNOVATIONS 2023; 3:100213. [PMID: 37719662 PMCID: PMC10504536 DOI: 10.1016/j.xjidi.2023.100213] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 05/19/2023] [Accepted: 05/22/2023] [Indexed: 09/19/2023] Open
Abstract
Assessing the severity of eczema in clinical research requires face-to-face skin examination by trained staff. Such approaches are resource-intensive for participants and staff, challenging during pandemics, and prone to inter- and intra-observer variation. Computer vision algorithms have been proposed to automate the assessment of eczema severity using digital camera images. However, they often require human intervention to detect eczema lesions and cannot automatically assess eczema severity from real-world images in an end-to-end pipeline. We developed a model to detect eczema lesions from images using data augmentation and pixel-level segmentation of eczema lesions on 1,345 images provided by dermatologists. We evaluated the quality of the obtained segmentation compared with that of the clinicians, the robustness to varying imaging conditions encountered in real-life images, such as lighting, focus, and blur, and the performance of downstream severity prediction when using the detected eczema lesions. The quality and robustness of eczema lesion detection increased by approximately 25% and 40%, respectively, compared with that of our previous eczema detection model. The performance of the downstream severity prediction remained unchanged. Use of skin segmentation as an alternative to eczema segmentation that requires specialist labeling showed the performance on par with when eczema segmentation is used.
Collapse
Affiliation(s)
- Rahman Attar
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Guillem Hurault
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Zihao Wang
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Ricardo Mokhtari
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Kevin Pan
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Bayanne Olabi
- Biosciences Institute, Faculty of Medical Sciences, Newcastle University, Newcastle, United Kingdom
| | - Eleanor Earp
- Department of Dermatology, Lauriston Building, Edinburgh, United Kingdom
| | - Lloyd Steele
- Department of Dermatology, Royal London Hospital, Barts Health NHS Trust, London, United Kingdom
| | - Hywel C. Williams
- Centre of Evidence Based Dermatology, University of Nottingham, Nottingham, United Kingdom
| | - Reiko J. Tanaka
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
7
|
E H, He J, Hu T, Yuan L, Zhang R, Zhang S, Wang Y, Song M, Wang L. KFWC: A Knowledge-Driven Deep Learning Model for Fine-grained Classification of Wet-AMD. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 229:107312. [PMID: 36584638 DOI: 10.1016/j.cmpb.2022.107312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 12/11/2022] [Accepted: 12/13/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND AND OBJECTIVES Automated diagnosis using deep neural networks can help ophthalmologists detect the blinding eye disease wet Age-related Macular Degeneration (AMD). Wet-AMD has two similar subtypes, Neovascular AMD and Polypoidal Choroidal Vasculopathy (PCV). However, due to the difficulty in data collection and the similarity between images, most studies have only achieved the coarse-grained classification of wet-AMD rather than a fine-grained one of wet-AMD subtypes. Therefore, designing and building a deep learning model to diagnose neovascular AMD and PCV is a great challenge. METHODS To solve this issue, in this paper, we propose a Knowledge-driven Fine-grained Wet-AMD Classification Model (KFWC) to enhance the model's accuracy in the fine-grained disease classification with insufficient data. We innovatively introduced a two-stage method. In the first stage, we present prior knowledge of 10 lesion signs through pre-training; in the second stage, the model implements the classification task with the help of human knowledge. With the pre-training of priori knowledge of 10 lesion signs from input images, KFWC locates the powerful image features in the fine-grained disease classification task and therefore achieves better classification. RESULTS To demonstrate the effectiveness of KFWC, we conduct a series of experiments on a clinical dataset collected in cooperation with a Grade III Level A ophthalmology hospital in China. The AUC score of KFWC reaches 99.71%, with 6.69% over the best baseline and 4.14% over ophthalmologists. KFWC can also provide good interpretability and effectively alleviate the pressure of data collection and annotation in the field of fine-grained disease classification for wet-AMD. CONCLUSIONS The model proposed in this paper effectively solves the difficulties of small data volume and high image similarity in the wet-AMD fine-grained classification task through a knowledge-driven approach. Besides, this method effectively relieves the pressure of data collection and annotation in the field of fine-grained classification. In the diagnosis of wet-AMD, KFWC is superior to previous work and human ophthalmologists.
Collapse
Affiliation(s)
- Haihong E
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Jiawen He
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Tianyi Hu
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Lifei Yuan
- Hebei Provincial Eye Hospital, Hebei, 054001, China
| | - Ruru Zhang
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | | | - Yanhui Wang
- Hebei Provincial Eye Hospital, Hebei, 054001, China
| | - Meina Song
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Lifei Wang
- Hebei Provincial Eye Hospital, Hebei, 054001, China.
| |
Collapse
|
8
|
Multiclass Skin Lesion Classification Using a Novel Lightweight Deep Learning Framework for Smart Healthcare. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12052677] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Skin lesion classification has recently attracted significant attention. Regularly, physicians take much time to analyze the skin lesions because of the high similarity between these skin lesions. An automated classification system using deep learning can assist physicians in detecting the skin lesion type and enhance the patient’s health. The skin lesion classification has become a hot research area with the evolution of deep learning architecture. In this study, we propose a novel method using a new segmentation approach and wide-ShuffleNet for skin lesion classification. First, we calculate the entropy-based weighting and first-order cumulative moment (EW-FCM) of the skin image. These values are used to separate the lesion from the background. Then, we input the segmentation result into a new deep learning structure wide-ShuffleNet and determine the skin lesion type. We evaluated the proposed method on two large datasets: HAM10000 and ISIC2019. Based on our numerical results, EW-FCM and wide-ShuffleNet achieve more accuracy than state-of-the-art approaches. Additionally, the proposed method is superior lightweight and suitable with a small system like a mobile healthcare system.
Collapse
|