1
|
Yu Z, Flament F, Jiang R, Houghton J, Kroely C, Cabut N, Haykal D, Sehgal C, Jablonski NG, Jean A, Aarabi P. The relevance and accuracy of an AI algorithm-based descriptor on 23 facial attributes in a diverse female US population. Skin Res Technol 2024; 30:e13690. [PMID: 38716749 PMCID: PMC11077572 DOI: 10.1111/srt.13690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Accepted: 03/18/2024] [Indexed: 05/12/2024]
Abstract
BACKGROUND The response of AI in situations that mimic real life scenarios is poorly explored in populations of high diversity. OBJECTIVE To assess the accuracy and validate the relevance of an automated, algorithm-based analysis geared toward facial attributes devoted to the adornment routines of women. METHODS In a cross-sectional study, two diversified groups presenting similar distributions such as age, ancestry, skin phototype, and geographical location was created from the selfie images of 1041 female in a US population. 521 images were analyzed as part of a new training dataset aimed to improve the original algorithm and 520 were aimed to validate the performance of the AI. From a total 23 facial attributes (16 continuous and 7 categorical), all images were analyzed by 24 make-up experts and by the automated descriptor tool. RESULTS For all facial attributes, the new and the original automated tool both surpassed the grading of the experts on a diverse population of women. For the 16 continuous attributes, the gradings obtained by the new system strongly correlated with the assessment made by make-up experts (r ≥ 0.80; p < 0.0001) and supported by a low error rate. For the seven categorical attributes, the overall accuracy of the AI-facial descriptor was improved via enrichment of the training dataset. However, some weaker performance in spotting specific facial attributes were noted. CONCLUSION In conclusion, the AI-automatic facial descriptor tool was deemed accurate for analysis of facial attributes for diverse women although some skin complexion, eye color, and hair features required some further finetuning.
Collapse
Affiliation(s)
- Zhi Yu
- Modiface – A L'Oréal Group CompanyTorontoCanada
| | | | | | | | | | | | | | | | - Nina G Jablonski
- Department of AnthropologyThe Pennsylvania State University, University ParkPennsylvaniaUSA
| | | | | |
Collapse
|
2
|
Li T, Ma X, Li Z, Yu N, Song J, Ma Z, Ying H, Zhou B, Huang J, Wu L, Long X. Facial adult female acne in China: An analysis based on artificial intelligence over one million. Skin Res Technol 2024; 30:e13693. [PMID: 38572573 PMCID: PMC10993051 DOI: 10.1111/srt.13693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 02/19/2024] [Indexed: 04/05/2024]
Abstract
BACKGROUND To further clarify the acne profile of Chinese adult women, we included 1,156,703 adult women. An artificial intelligence algorithm was used to analyze images taken by high-resolution mobile phones to further explore acne levels in Chinese adult women. METHOD In this study, we assessed the severity of acne by evaluating patients' selfies through a smartphone application. Furthermore, we gathered basic user information through a questionnaire, including details such as age, gender, skin sensitivity, and dietary habits. RESULTS This study showed a gradual decrease in acne severity from the age of 25 years. A trough was reached between the ages of 40 and 44, followed by a gradual increase in acne severity. In terms of skin problems and acne severity, we have found that oily skin, hypersensitive skin, frequent makeup application and unhealthy dietary habits can affect the severity of acne. For environment and acne severity, we observed that developed city levels, cold seasons and high altitude and strong radiation affect acne severity in adult women. For the results of the AI analyses, the severity of blackheads, pores, dark circles and skin roughness were positively associated with acne severity in adult women. CONCLUSIONS AI analysis of high-res phone images in Chinese adult women reveals acne severity trends. Severity decreases after 25, hits a low at 40-44, then gradually rises. Skin type, sensitivity, makeup, diet, urbanization, seasons, altitude, and radiation impact acne. Blackheads, pores, dark circles, and skin roughness are linked to acne severity. These findings inform personalized skincare and public health strategies for adult women.
Collapse
Affiliation(s)
- Tian‐Hao Li
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| | - Xu‐Da Ma
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| | - Zi‐Ming Li
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| | - Nan‐Ze Yu
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| | - Jin‐Yan Song
- Hangzhou C2H4 Internet Technology Co., LtdHangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Zi‐Tao Ma
- Hangzhou C2H4 Internet Technology Co., LtdHangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Han‐Ting Ying
- Hangzhou C2H4 Internet Technology Co., LtdHangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Beibei Zhou
- Hangzhou C2H4 Internet Technology Co., LtdHangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Jiu‐Zuo Huang
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| | - Liang Wu
- Hangzhou C2H4 Internet Technology Co., LtdHangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Xiao Long
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeBeijingChina
| |
Collapse
|
3
|
Park H, Park SR, Lee S, Hwang J, Lee M, Jang SI, Jung Y, Yeon Y, Kang N, Suh BF, Kim E. Development and application of artificial intelligence-based facial skin image diagnosis system: Changes in facial skin characteristics with ageing in Korean women. Int J Cosmet Sci 2024; 46:199-208. [PMID: 37881146 DOI: 10.1111/ics.12924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 10/04/2023] [Accepted: 10/17/2023] [Indexed: 10/27/2023]
Abstract
OBJECTIVE To develop and validate an artificial intelligence (AI)-based diagnostic system for analysing facial skin images using expert judgements and explore its feasibility for skin ageing research, specifically by evaluating facial skin changes in Korean women of various ages. METHODS Our AI-based facial skin diagnosis system (Dr. AMORE®) uses facial images of Korean women to analyse wrinkles, pigmentation, skin pores, and other skin red spots. The system is trained using clinical expert evaluations and deep learning. We assessed the system's precision and sensitivity by analysing the correlation between the diagnoses by the AI system and those of the experts. We used 120 images of Korean women aged 10-60 years to evaluate the changes in various facial skin characteristics with ageing. RESULTS The precision and sensitivity of the developed system were excellent (>0.9%), and the diagnosis scores using the detected area and intensity of each item were correlated significantly higher with the visual evaluation results of the clinical experts (>0.8, p < 0.001). We also analysed facial images of Korean women aged 10-60 years to quantify changes in the scores of wrinkles, pigmentation, and skin pores with age. We identified the age group with the most significant changes as 20s to 30s. Analysis of the detailed skin characteristics of each item showed that wrinkles and pigmentation changed significantly in the 20s-30s, and skin pores increased significantly in the 10s-20s. There was no significant correlation with age or change according to the age group for skin red spots. CONCLUSION Developed AI-based facial skin diagnosis system can automatically diagnose skin conditions based on clinical expert judgement using only photographic images and analyse various items in detail, quantitatively, and visually. This AI system can provide new and useful approaches in research areas that require a lot of resources and different characterizations, such as the study of facial skin ageing.
Collapse
Affiliation(s)
- Hyeokgon Park
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Sae-Ra Park
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Sangran Lee
- AI Solution Team, AMOREPACIFIC, Seoul, Korea
| | | | - Myeongryeol Lee
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Sue Im Jang
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Yuchul Jung
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Yeongmin Yeon
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Nayoung Kang
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Byung-Fhy Suh
- AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| | - Eunjoo Kim
- Clinical Research Lab, AMOREPACIFIC Research and Innovation Center, Yongin, Korea
| |
Collapse
|
4
|
Park SR, Park H, Lee S, Hwang J, Suh BF, Kim E. Facial age evaluated by artificial intelligence system, Dr.AMORE®: An objective, intuitive, and reliable new skin diagnosis technology. J Cosmet Dermatol 2023. [PMID: 38149689 DOI: 10.1111/jocd.16146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 11/29/2023] [Accepted: 12/04/2023] [Indexed: 12/28/2023]
Affiliation(s)
- Sae-Ra Park
- Clinical Research Lab, AMOREPACIFIC R&I Center, Yongin-si, Korea
| | - Hyeokgon Park
- Clinical Research Lab, AMOREPACIFIC R&I Center, Yongin-si, Korea
| | - Sangran Lee
- AI Solution Team, AMOREPACIFIC Corporation, Seoul, Korea
| | - Joongwon Hwang
- AI Solution Team, AMOREPACIFIC Corporation, Seoul, Korea
| | | | - Eunjoo Kim
- Clinical Research Lab, AMOREPACIFIC R&I Center, Yongin-si, Korea
| |
Collapse
|
5
|
Li T, Ma X, Li Z, Yu N, Song J, Ma Z, Ying H, Zhou B, Huang J, Wu L, Long X. Artificial intelligence analysis of over a million Chinese men and women reveals level of dark circle in the facial skin aging process. Skin Res Technol 2023; 29:e13492. [PMID: 38009029 PMCID: PMC10603312 DOI: 10.1111/srt.13492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 09/19/2023] [Indexed: 11/28/2023]
Abstract
BACKGROUND To better compare the progression of dark circles and the aging process in Chinese skin. A total of 100 589 Chinese males and 1 838 997 Chinese females aged 18 to 85, without facial skin conditions, and who had access to a smartphone with a high-resolution camera all took selfies. METHOD Using a smartphone application with a built-in artificial intelligence algorithm, facial skin diagnostic evaluated the selfies and score the severity of the dark circles with four other facial indicators (including skin type, Pores, Acne vulgaris, and Blackheads). Basic information was collected with online questionnaire, including their age, gender, skin sensitivity, and dietary habits. RESULTS In users between the age of 18 and 59, the prevalence of comprehensive, pigmented, and structural type of dark circles all rose with age. However, between the age of 60 and 85, the intensity of all types of dark circles diminished. Besides, vascular dark circles progressively worsen from the age of 18 to their peak at 39, and then gradually decline with age. Females typically have more pronounced black circles under their eyes than males in China. Bad eating habits, urbanization, regular cosmetics use, and sensitive skin positively correlate with severe dark circles. Vascular, comprehensive dark circles were worse in spring. Both pigmented and structural dark circles were worse in the summer. The results indicated that the intensity of dark circles was influenced by oily skin, wide pores, severe blackheads, and severe acne. CONCLUSIONS Chinese men and women differed noticeably in the prevalence of each face aging indicator and the appearance of aging dark circles. Selfies could be automatically graded and examined by artificial intelligence, which is a quick and private method for quantifying signs of facial aging and identifying major problems for different populations. Artificial intelligence would assist in the development of individualized preventive and therapeutic interventions.
Collapse
Affiliation(s)
- Tian‐Hao Li
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeDongcheng‐quBeijingChina
| | - Xu‐Da Ma
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeDongcheng‐quBeijingChina
| | - Zi‐Ming Li
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeDongcheng‐quBeijingChina
| | - Nan‐Ze Yu
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeDongcheng‐quBeijingChina
| | - Jin‐Yan Song
- Hangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Zi‐Tao Ma
- Hangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Han‐ting Ying
- Hangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Beibei Zhou
- Hangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Jiu‐Zuo Huang
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeDongcheng‐quBeijingChina
| | - Liang Wu
- Hangzhou C2H4 Internet Technology Co., LtdHangzhouChina
| | - Xiao Long
- Department of Plastic and Reconstructive SurgeryPeking Union Medical College HospitalChinese Academy of Medical Sciences and Peking Union Medical CollegeDongcheng‐quBeijingChina
| |
Collapse
|
6
|
Flament F, Saint-Leger D. Photoaging's portrait: The road map towards its photoprotection. Int J Cosmet Sci 2023; 45 Suppl 1:33-44. [PMID: 37638664 DOI: 10.1111/ics.12903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 04/19/2023] [Accepted: 04/26/2023] [Indexed: 08/29/2023]
Abstract
OBJECTIVE To summarize key research published by the author's group, dealing with skin photoaging and its photoprotection. MATERIALS AND METHODS Two methodologies (standard photographs and selfies imaging) resulting from referential skin ageing atlases were applied on 2487 subjects of different ancestries, ages and gender. These aimed at first to best assess and grade the variable severities of some facial signs (texture/wrinkles, pigmentary spots, sagging and vascular disorders) that occur progressively during the photoaging process. Second, such methodologies were used to record the benefits brought by a photoprotective regimen (671 women and men). RESULTS In all studied ancestries, each facial sign show an increase severity along decades, at its own pace, some showing a linear like progression, whereas some plateau at early ages. These changes differed according to skin innate colour (phototype) and with individual behaviours vis-à-vis sun exposures, more so among European women than North-East Asian women. An effect of gender (less severe alterations) was observed on Chinese men, as compared to Chinese women. Pigmentary disorders were found hallmarks of photo-aged North-East Asian women. Globally, photoaging impact the apparent age of the different subjects. The counteracting effects of strong topical Photoprotective regimens were evidenced along a 6-month seasonality in Chinese and French women or 1-year period in Brazilian women with phototypes II to VI. Photoprotection led to a more even skin complexion among Indian subjects with pigment irregularities. CONCLUSION Two factors clearly hamper a better assessment of the efficiency of photoprotection of the sun-induced cutaneous ageing: short durations (months) of the studies with regard to the global fate of photoaging by decades and the number of studied subjects, limited to hundreds for practical reasons. The methodology based on the automatic analysis of facial signs through selfies images could theoretically bypass both factors, allowing thousands of subjects to be studied along years.
Collapse
|
7
|
Yokoyama E, Francois G, Harrar M, Bachatene C, Udodaira K, Trévisan S, Nicolas A, Velleman D, Flament F. Video-based paired comparison to evaluate some cosmetic products under camera movement for dynamic performance. Int J Cosmet Sci 2023; 45:480-487. [PMID: 36919483 DOI: 10.1111/ics.12857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 02/09/2023] [Accepted: 03/10/2023] [Indexed: 03/16/2023]
Abstract
OBJECTIVE Until now, standardized evaluation of cosmetic effects was conducted mainly in still conditions such as pictures. In real life, the consumers' experience of their cosmetics' effects is dynamic and some of the benefits can be better observed under movement. In order to capture motion-related performance of cosmetics, we developed a video-based paired comparison on an online platform. METHODS We validated this new tool through the evaluation of eyeshadow with high light reflection and colour gradation, especially visible under motion according to the observer point of view. This formula was compared with two marketed benchmarks. The three products were applied sequentially on the eyelid of eight Japanese women. Videos were taken in standardized light, speed and face position with a rotating camera around the face. The videos were uploaded on an online secured platform and eyelid 3D effect, highlight and colour gradation were evaluated through paired comparison test by 60 Japanese women from home on their PC or tablets. Those results were compared with picture-based paired comparison by the same observers. RESULTS Video-based paired comparison provided higher discrimination of products compared to picture-based comparison. CONCLUSION As compared to still camera acquisition, the evaluation of cosmetics based on videos is closer to real-life experience and can bring higher discrimination, especially for motion-related attributes.
Collapse
Affiliation(s)
| | | | - Margalith Harrar
- L'Oréal Research & Innovation, Centre Charles Zviak, Saint-Ouen, France
| | | | | | | | | | | | | |
Collapse
|
8
|
Flament F, Jiang R, Houghton J, Cassier M, Amar D, Delaunay C, Balooch G, Bouhadana E, Aarabi P, Passeron T. Objective and automatic grading system of facial signs from smartphones' pictures in South African men: Validation versus dermatologists and characterization of changes with age. Skin Res Technol 2023; 29:e13257. [PMID: 37113093 PMCID: PMC10234158 DOI: 10.1111/srt.13257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 12/02/2022] [Indexed: 04/29/2023]
Abstract
OBJECTIVE To evaluate the capacity of the automatic detection system to accurately grade, from selfie pictures, the severity of eight facial signs in South African men. METHODS Selfie pictures (obtained from frontal and back cameras) of 281 South African men differently aged (20-70 years) were obtained and analyzed by an automatic artificial intelligence (AI)-based automatic grading system. Data were compared with the clinical gradings made by experts and dermatologists. RESULTS In all facial signs, both series of gradings were found highly correlated with, however, different coefficients (0.59-0.95), those of marionette lines and cheek pores being of lower values. No differences were observed between data obtained by frontal and back cameras. With age, in most cases, gradings show up to the 50-59 year age-class, linear-like changes. When compared to men of other ancestries, South African men present lower wrinkles/texture, pigmentation, and ptosis/sagging scores till 50-59 years, albeit not much different in the cheek pores sign. The early onset (mean age) of visibility of wrinkles/texture for South African men were (i.e., reaching grade >1) 39 and 45 years for ptosis/sagging. CONCLUSION This study completes and enlarges the previous works conducted on men of other ancestries by showing some South African specificities and slight differences with men of comparable phototypes (Afro American).
Collapse
Affiliation(s)
| | - Ruowei Jiang
- ModiFace ‐ A L'Oréal Group CompanyTorontoOntarioCanada
| | - Jeff Houghton
- ModiFace ‐ A L'Oréal Group CompanyTorontoOntarioCanada
| | | | - David Amar
- L'Oréal Research and InnovationClichyFrance
| | | | | | | | - Parham Aarabi
- ModiFace ‐ A L'Oréal Group CompanyTorontoOntarioCanada
| | - Thierry Passeron
- Department of Dermatology, Université Côte d'AzurCHU NiceNiceFrance
- Université Côte d'AzurINSERM, U1065, C3MNiceFrance
| |
Collapse
|
9
|
Maudet A, Le Bec J, Flament F, Mirassou L, Caron J, Negre C, Delaunay C, Balooch G, Jang E. Analysis of images supplied by Skincam® can record the changes of some scar features that occur over time. Comparisons with the assessments of dermatologist and patients' perception. J Cosmet Dermatol 2023; 22:1334-1343. [PMID: 36606386 DOI: 10.1111/jocd.15575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 11/12/2022] [Accepted: 12/06/2022] [Indexed: 01/07/2023]
Abstract
OBJECTIVE The objective of the study was to assess in vivo the validity of a new imaging device in quantifying the scarring process over time and to compare its data with the expertise of dermatologist and patients' self-appraisals. MATERIALS AND METHODS A total of 37 Korean women, aged 20-50 year, with closed scars of different types, were enrolled after a dermatological evaluation. All subjects applied daily a hydrating cream on their scars for 2 months. Images of scars at different times (Day 0, Day 28, and Day 56) were taken and further analyzed, yielding various parameters such as color, luminance, size, volume, and depth of each scar. A dermatologist visually graded, at each time point, the clinical aspect of the scar, and patients were asked to answer to some questions dealing with their self-examination of their scar. RESULTS The changes in some scar features that occurred during the application period were quantified and statistically differed from the D0 baseline value. Scars became of reduced size, lighter (Increased luminance), less red, less deep, and less voluminous. Some of these parameters (volume, lightness, smoothness, texture regularity) were statistically different at D28 whereas some others (area, depth, redness) showed significant changes at D56 . Dermatologist expertise and patients' assessments were in high agreement. CONCLUSION This methodological approach that uses a dedicated camera associated with image analysis, despite some inherent limits (size of the scar), appears as a valuable aid to surgeons in the management of scars, in the follow-up of a given procedure or treatment. Beyond scar management, this approach may be extended to other skin disorders such as acne.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | - Eunjoo Jang
- Jamsil Gowoonsesang dermatologic clinic, Seoul, South Korea
| |
Collapse
|
10
|
Flament F, Jiang R, Houghton J, Zhang Y, Kroely C, Jablonski NG, Jean A, Clarke J, Steeg J, Sehgal C, McParland J, Delaunay C, Passeron T. Accuracy and clinical relevance of an automated, algorithm-based analysis of facial signs from selfie images of women in the United States of various ages, ancestries and phototypes: A cross-sectional observational study. J Eur Acad Dermatol Venereol 2023; 37:176-183. [PMID: 35986708 PMCID: PMC10087370 DOI: 10.1111/jdv.18541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 07/27/2022] [Indexed: 12/15/2022]
Abstract
BACKGROUND Real-life validation is necessary to ensure our artificial intelligence (AI) skin diagnostic tool is inclusive across a diverse and representative US population of various ages, ancestries and skin phototypes. OBJECTIVES To explore the relevance and accuracy of an automated, algorithm-based analysis of facial signs in representative women of different ancestries, ages and phototypes, living in the same country. METHODS In a cross-sectional study of selfie images of 1041 US women, algorithm-based analyses of seven facial signs were automatically graded by an AI-based algorithm and by 50 US dermatologists of various profiles (age, gender, ancestry, geographical location). For automated analysis and dermatologist assessment, the same referential skin atlas was used to standardize the grading scales. The average values and their variability were compared with respect to age, ancestry and phototype. RESULTS For five signs, the grading obtained by the automated system were strongly correlated with dermatologists' assessments (r ≥ 0.75); cheek skin pores were moderately correlated (r = 0.63) and pigmentation signs, especially for the darkest skin tones, were weakly correlated (r = 0.40) to the dermatologist assessments. Age and ancestry had no effect on the correlations. In many cases, the automated system performed better than the dermatologist-assessed clinical grading due to 0.3-0.5 grading unit differences among the dermatologist panel that were not related to any individual characteristic (e.g. gender, age, ancestry, location). The use of phototypes, as discontinuous categorical variables, is likely a limiting factor in the assessments of grading, whether obtained by automated analysis or clinical assessment of the images. CONCLUSIONS The AI-based automatic procedure is accurate and clinically relevant for analysing facial signs in a diverse and inclusive population of US women, as confirmed by a diverse panel of dermatologists, although skin tone requires further improvement.
Collapse
Affiliation(s)
| | - Ruowei Jiang
- ModiFace - A L'Oréal Group Company, Toronto, Ontario, Canada
| | - Jeff Houghton
- ModiFace - A L'Oréal Group Company, Toronto, Ontario, Canada
| | - Yuze Zhang
- ModiFace - A L'Oréal Group Company, Toronto, Ontario, Canada
| | | | - Nina G Jablonski
- Department of Anthropology, The Pennsylvania State University, University Park, State College, Pennsylvania, USA
| | | | - Jeffrey Clarke
- Evaluative Criteria Incorporated, Tarrytown, New York, USA
| | - Jason Steeg
- Evaluative Criteria Incorporated, Tarrytown, New York, USA
| | | | | | | | - Thierry Passeron
- Department of Dermatology, Université Côte d'Azur, CHU Nice, Nice, France.,Université Côte d'Azur, INSERM, U1065, C3M, Nice, France
| |
Collapse
|
11
|
Ye C, Flament F, Wang Y, Sun H, Yang G, Jiang Y, Delaunay C, Saint-Leger D. Structural and Functional age-related changes in some facial signs of Chinese men. A Pilot study. Int J Cosmet Sci 2022; 44:530-541. [PMID: 35841376 DOI: 10.1111/ics.12802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/05/2022] [Accepted: 07/14/2022] [Indexed: 11/28/2022]
Abstract
OBJECTIVE To associate, on the same Chinese male subjects, changes in facial aging signs with some biomechanical skin properties. METHODS The severities of 20 facial aging signs of 219 differently aged Chinese men (20-65y) were graded in blind by trained experts through standardized photographs, using a referential skin Atlas dedicated to Asian men. On each subject, the mechanical properties were assessed on the cheek area (left or right at random) by the validated suction technique Cutometer®. Finally, the skin color parameters were assessed on images from VISIA-CR device. RESULTS Clinically speaking, the severity of almost all facial aging signs increases from 30y to 65y, in a linear like progression, whereas the 20-30y shows weak increases. Skin color shows slight but progressive decreases in Luminance and ITA, whereas the yellow and red components slightly increased between 40y and 65y. At the exception of skin firmness, the skin mechanical properties show a clear decline during the 30-50y period and plateau beyond. CONCLUSION The present study suggests that the 20-30y period, albeit more clinically "silent" than the other periods of age, seems to be an age-range during which early alterations of some dermal elements' onset. Deeper in vivo investigating techniques (Echography, Multiphotonic microscopy) are needed to confirm such hypothesis.
Collapse
Affiliation(s)
- Chengda Ye
- L'Oréal Research and Innovation, Shanghai, China
| | | | - Yang Wang
- L'Oréal Research and Innovation, Shanghai, China
| | - Hua Sun
- China-norm Quality Technical Service, Shanghai, China
| | | | - Yanwen Jiang
- China-norm Quality Technical Service, Shanghai, China
| | | | | |
Collapse
|
12
|
Flament F, Velleman D, Yamashita E, Nicolas A, Yokoyama E, Chibout S, Jiang R, Houghton J, Kroely C, Cassier M. A 5‐hour follow‐up of the behavior of some foundations through automatically analyzed selfie pictures. Int J Cosmet Sci 2022; 44:431-439. [DOI: 10.1111/ics.12786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 04/19/2022] [Accepted: 05/06/2022] [Indexed: 11/28/2022]
Affiliation(s)
| | | | | | | | | | | | - Ruowei Jiang
- ModiFace – A L'Oréal Group Company Toronto Canada
| | | | | | | |
Collapse
|
13
|
Flament F, Zhang Y, Jiang R, Trehin C, Cassier M, Delaunay C, Balooch G, Kroely C. Objective and automatic grading system of facial signs from selfie pictures of South African women: Characterization of changes with age and sun‐exposures. Skin Res Technol 2022; 28:596-603. [PMID: 35490368 PMCID: PMC9907676 DOI: 10.1111/srt.13153] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Accepted: 03/09/2022] [Indexed: 12/11/2022]
Abstract
OBJECTIVE To evaluate the capacity of the automatic detection system to accurately grade, from smartphones' selfie pictures, the severity of fifteen facial signs in South African women and their changes related to age and sun-exposure habits. METHODS A two-steps approach was conducted based on self-taken selfie images. At first, to assess on 306 South African women (20-69 years) enrolled in Pretoria area (25.74°S, 28.22°E), age changes on fifteen facial signs measured by an artificial intelligence (AI)-based automatic grading system previously validated by experts/dermatologists. Second, as these South African panelists were recruited according to their usual behavior toward sun-exposure, that is, nonsun-phobic (NSP, N = 151) and sun-phobic (SP, N = 155) and through their regular and early use of a photo-protective product, to characterize the facial photo-damages. RESULTS (1) The automatic scores showed significant changes with age, by decade, of sagging and wrinkles/texture (p < 0.05) after 20 and 30 years, respectively. Pigmentation cluster scores presented no significant changes with age whereas cheek skin pores enlarged at a low extent with two plateaus at thirties and fifties. (2) After 60 years, a significantly increased severity of wrinkles/texture and sagging was observed in NSP versus SP women (p < 0.05). A trend of an increased pigmentation of the eye contour (p = 0.06) was observed after 50 years. CONCLUSION This work illustrates specific impacts of aging and sun-exposures on facial signs of South African women, when compared to previous experiments conducted in Europe or East Asia. Results significantly confirm the importance of sun-avoidance coupled with photo-protective measures to avoid long-term skin damages. In inclusive epidemiological studies that aim at investigating large human panels in very different contexts, the AI-based system offers a fast, affordable and confidential approach in the detection and quantification of facial signs and their dependency with ages, environments, and lifestyles.
Collapse
Affiliation(s)
| | - Yuze Zhang
- ModiFace–A L'Oréal Group Company Toronto Ontario Canada
| | - Ruowei Jiang
- ModiFace–A L'Oréal Group Company Toronto Ontario Canada
| | | | | | | | | | | |
Collapse
|
14
|
Flament F, Jacquet L, Ye C, Amar D, Kerob D, Jiang R, Zhang Y, Kroely C, Delaunay C, Passeron T. Artificial Intelligence analysis of over half a million European and Chinese women reveals striking differences in the facial skin aging process. J Eur Acad Dermatol Venereol 2022; 36:1136-1142. [DOI: 10.1111/jdv.18073] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 01/28/2022] [Accepted: 02/23/2022] [Indexed: 12/01/2022]
Affiliation(s)
- F. Flament
- L’Oréal Research and Innovation Clichy France
| | - L. Jacquet
- Vichy International Levallois‐Perret France
| | - C. Ye
- L’Oréal Research and Innovation Shanghai China
| | - D. Amar
- L’Oréal Research and Innovation Shanghai China
| | - D. Kerob
- Vichy International Levallois‐Perret France
| | - R. Jiang
- ModiFace – A L'Oréal Group Company Toronto Canada
| | - Y. Zhang
- ModiFace – A L'Oréal Group Company Toronto Canada
| | - C. Kroely
- L’Oréal CDO – Digital Service Factory Clichy France
| | - C. Delaunay
- L’Oréal Research and Innovation Clichy France
| | - T. Passeron
- Université Côte d’Azur CHU Nice Department of Dermatology Nice France
- Université Côte d’Azur INSERM U1065, C3M Nice France
| |
Collapse
|
15
|
Yap MH, Batool N, Ng CC, Rogers M, Walker K. A Survey on Facial Wrinkles Detection and Inpainting: Datasets, Methods, and Challenges. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE 2021. [DOI: 10.1109/tetci.2021.3075723] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
16
|
Flament F, Ye C, Mercurio DG, Abric A, Sewraj P, Velleman D, Yamamoto S, Prunel A, Colomb L. Evaluating the respective weights of some facial signs on the perceived radiance/glow in differently aged women of six countries. Skin Res Technol 2021; 27:1116-1127. [PMID: 34197658 DOI: 10.1111/srt.13071] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 05/14/2021] [Indexed: 12/12/2022]
Abstract
OBJECTIVES To evaluate the impact of Facial radiance or Glow on the perception of age (PA) and to assess which facial signs most influence PA. MATERIAL AND METHODS The faces of 1058 differently aged women (18-80 years) of six different ethnicities/countries (China, Japan, Korea, India, South Africa, and Brazil) were photographed under standard conditions. These allowed to focus on 20 different facial signs that were further graded by experts, using referential Atlases dedicated to facial aging. In each of the six countries, 100 local women were recruited as naïve panels to express their perceptions on Glow and Age on each full-face photograph (blind coded) of the local studied woman. RESULTS A decreased Glow/Radiance appears clearly associated with an increased perceived age in all studied subjects, especially among Chinese, Japanese, and South African women. With regard facial signs, Skin texture (Wrinkles of all kinds), Ptosis/Sagging, and Pigmentation signs prevail in almost all women at the exception of South African women where Pigmentation signs and Cheek skin pores largely predominate in the perception of both Glow and PA. Pigmentation signs are of a very high weight among Chinese and Japanese women. CONCLUSION Despite some collective agreements, the present study shows some specificities within the women of the six ethnicities/countries. PA, a core index of antiaging strategies, goes along with facial Glow in almost all studied women. The duller the facial skin, the older it is perceived.
Collapse
Affiliation(s)
| | - Chengda Ye
- L'Oréal Research and Innovation, Shanghai, China
| | | | | | - Poonam Sewraj
- L'Oréal Research and Innovation, Johannesburg, South Africa
| | | | | | - Anne Prunel
- L'Oréal Research and Innovation, Tokyo, Japan.,L'Oréal Korean Innovation Center, Seoul, Korea
| | - Loic Colomb
- L'Oréal Research and Innovation, Clichy, France
| |
Collapse
|
17
|
Flament F, Galliano A, Abric A, Matoschitz CM, Bammer M, Kampus M, Kanda-Diwidi D, Chibout S, Cassier M, Delaunay C. Skin moisture assessment using Hydration Sensor Patches coupled with smartphones via Near Field Communication (NFC). A pilot study with the first generation of patches that allow self-recordings of skin hydration. Skin Res Technol 2021; 27:959-965. [PMID: 33998713 DOI: 10.1111/srt.13049] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 03/23/2021] [Indexed: 02/06/2023]
Abstract
OBJECTIVES To evaluate the potency of a new skin hydration sensor patch in the fast self-recording of skin hydration. MATERIAL AND METHODS The Skin Hydration Sensor Patch (SHSP) turns the user's smartphone into a wireless skin moisture measuring device. The SHSP combines a capacitive measurement unit and Near Field Communication technology (NFC) for transmitting data and energy. The probe is fixed onto the back of the smartphone and pressed to the skin for a few seconds where the application immediately calculates the capacitance value. Once recorded, the probe is then immediately taken off from the skin. In a first study, this system was compared to the Corneometer® technique, in vivo, on various skin sites of 23 healthy French women. In a second study, 20 women with moderate dry skin on face and forearm self-recorded, through the SHSP the changes in skin hydration induced by a Xanthan gel containing 3% (w/w) of Glycerol, along 24 hours. A questionnaire based on 5 types of questions was established to be filled by subjects about their perception of the use of this new system. RESULTS In the first study, the values recorded by the SHSP were found highly correlated with those provided by the Corneometer® . The second study allowed to observe significant differences in skin hydration of both sites at all times, as compared to values obtained before the application of the gel. Differences between both sites were observed, the face being less hydrated than forearm. From a practical aspect, the self-recordings on the face show a higher variability (approx. 10% than those of the forearm). The questionnaire led to positive answers on almost all points. CONCLUSION This SHSP appears as a promising approach in the field of connected skin-related devices. As such, it opens or enlarges a new paradigm in the relationships between a consumer and a cosmetic product.
Collapse
Affiliation(s)
| | | | | | | | - Manfred Bammer
- AIT - Austrian Institute of Technology, Wr. Neustadt, Austria
| | - Miha Kampus
- USP Indicator Solutions, Klagenfurt, Austria
| | | | | | | | | |
Collapse
|
18
|
Flament F, Zhang Y, Yu Z, Jiang R, Houghton J, Sarda Duthil L, Arcin V, Daniel R, Perrier JC, Niviere J, Moyano G, Thenin A, Garcia MS, Adam AS, Chibout S, Blin X, Delaunay C, Aarabi P. Developing an Artificial Intelligence (A.I)-based descriptor of facial appearance that fits with the assessments of makeup experts. Skin Res Technol 2021; 27:1081-1091. [PMID: 33998717 DOI: 10.1111/srt.13061] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 04/20/2021] [Indexed: 12/30/2022]
Abstract
OBJECTIVE To develop an A.I-based automatic descriptor that detects and grades, from selfie pictures, 23 facial signs, hairs included, as a help to making-up procedures. MATERIAL AND METHODS The selfie images taken in very different conditions by 3326 women and men were used to create (90% of dataset) and validate (10% of dataset) a new algorithm architecture to appraise and grade 23 different facial signs such as lips, nose, eye color, eyebrows, eyelashes, and hair color as defined by makeup artists. Each selfie image was annotated by 12 experts and defined references to train Artificial Intelligence (A.I)-based algorithm. RESULTS As some the 23 signs present a continuous or discontinuous feature, these were analyzed by two different statistical approaches. The results provided by the automatic descriptor system were not only in good agreement with the expert's assessments but were even found of a better precision and reproducibility. This automatic descriptor system has proven a good and robust accuracy despite the very variable conditions in the acquisition of selfie pictures. CONCLUSION Such automatic descriptor system seems providing a valuable help in making-up procedures and may extend to other activities such as Skincare or Haircare. As such it should allow large investigations to better evaluate the consumers' needs of esthetical improvements.
Collapse
Affiliation(s)
| | - Yuze Zhang
- ModiFace - A L'Oréal Group Company, Toronto, ON, Canada
| | - Zhi Yu
- ModiFace - A L'Oréal Group Company, Toronto, ON, Canada
| | - Ruowei Jiang
- ModiFace - A L'Oréal Group Company, Toronto, ON, Canada
| | - Jeff Houghton
- ModiFace - A L'Oréal Group Company, Toronto, ON, Canada
| | | | - Vincent Arcin
- L'Oréal CDO - Digital Service Factory, Clichy, France
| | | | | | | | | | - Audrey Thenin
- L'Oréal Operations - Innovation Packaging, Levallois, France
| | | | | | | | - Xavier Blin
- L'Oréal Research and Innovation, Clichy, France
| | | | - Pahram Aarabi
- ModiFace - A L'Oréal Group Company, Toronto, ON, Canada
| |
Collapse
|