Inter-observer agreement on acne severity based on facial photographs

Development and validation of an artificial intelligence-powered acne grading system incorporating lesion identification

Background

The management of acne requires the consideration of its severity; however, a universally adopted evaluation system for clinical practice is lacking. Artificial intelligence (AI) evaluation systems hold the promise of enhancing the efficiency and reproducibility of assessments. Artificial intelligence (AI) evaluation systems offer the potential to enhance the efficiency and reproducibility of assessments in this domain. While the identification of skin lesions represents a crucial component of acne evaluation, existing AI systems often overlook lesion identification or fail to integrate it with severity assessment. This study aimed to develop an AI-powered acne grading system and compare its performance with physician image-based scoring.

Methods

A total of 1,501 acne patients were included in the study, and standardized pictures were obtained using the VISIA system. The initial evaluation involved 40 stratified sampled frontal photos assessed by seven dermatologists. Subsequently, the three doctors with the highest inter-rater agreement annotated the remaining 1,461 images, which served as the dataset for the development of the AI system. The dataset was randomly divided into two groups: 276 images were allocated for training the acne lesion identification platform, and 1,185 images were used to assess the severity of acne.

Results

The average precision of our model for skin lesion identification was 0.507 and the average recall was 0.775. The AI severity grading system achieved good agreement with the true label (linear weighted kappa = 0.652). After integrating the lesion identification results into the severity assessment with fixed weights and learnable weights, the kappa rose to 0.737 and 0.696, respectively, and the entire evaluation on a Linux workstation with a Tesla K40m GPU took less than 0.1s per picture.

Conclusion

This study developed a system that detects various types of acne lesions and correlates them well with acne severity grading, and the good accuracy and efficiency make this approach potentially an effective clinical decision support tool.

Akne

Akne ist eine chronische Erkrankung mit hoher Prävalenz unter Jugendlichen. Pathogenetische Hauptfaktoren (und ihre klinischen Korrelate) sind gesteigerte Talgproduktion (Seborrhoe), follikuläre Hyperkeratose (Komedonen) und perifollikuläre Entzündungsvorgänge (Papulopusteln). Die Krankheit wird von endogenen (Androgene, IGF-1, neuroendokrine Faktoren) und exogenen (Propionibacterium acnes, Diät, mechanische Irritation, Inhaltsstoffe medizinischer oder kosmetischer Externa) Einflüssen moduliert. Akne geht mit zum Teil hoher Morbidität einher und kann bereits bei leichter Ausprägung eine erhebliche Verschlechterung der Lebensqualität bewirken. Zu Therapie stehen wirksame topische und systemische Behandlungsverfahren zur Verfügung. Eine optimale Behandlung erfordert eine stadiengerechtes Management und kontinuierliche ärztliche Begleitung der Patienten über den erforderlichen Behandlungszeitraum.

Guidelines of care for the management of acne vulgaris

Acne is one of the most common disorders treated by dermatologists and other health care providers. While it most often affects adolescents, it is not uncommon in adults and can also be seen in children. This evidence-based guideline addresses important clinical questions that arise in its management. Issues from grading of acne to the topical and systemic management of the disease are reviewed. Suggestions on use are provided based on available evidence.

[A therapeutic algorithm in acne: why?]

The acne is one of the cutaneous affections the most frequently seen by the dermatologist in his or her office. But it is also one of the affections, for which the therapeutic decisions vary more for patients of identical severity. This justifies firstly to be able to have a scale of severity of acne easily usable in an office, in order to homogenize our evaluation of severity of acne, and thus to be able to propose a prescription adapted to the severity of acne patient taking of course account of the recent recommendations of the AFSSAPS.