1
|
Strzelecki M, Kociołek M, Strąkowska M, Kozłowski M, Grzybowski A, Szczypiński PM. Artificial intelligence in the detection of skin cancer: State of the art. Clin Dermatol 2024; 42:280-295. [PMID: 38181888 DOI: 10.1016/j.clindermatol.2023.12.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2024]
Abstract
The incidence of melanoma is increasing rapidly. This cancer has a good prognosis if detected early. For this reason, various systems of skin lesion image analysis, which support imaging diagnostics of this neoplasm, are developing very dynamically. To detect and recognize neoplastic lesions, such systems use various artificial intelligence (AI) algorithms. This area of computer science applications has recently undergone dynamic development, abounding in several solutions that are effective tools supporting diagnosticians in many medical specialties. In this contribution, a number of applications of different classes of AI algorithms for the detection of this skin melanoma are presented and evaluated. Both classic systems based on the analysis of dermatoscopic images as well as total body systems, enabling the analysis of the patient's whole body to detect moles and pathologic changes, are discussed. These increasingly popular applications that allow the analysis of lesion images using smartphones are also described. The quantitative evaluation of the discussed systems with particular emphasis on the method of validation of the implemented algorithms is presented. The advantages and limitations of AI in the analysis of lesion images are also discussed, and problems requiring a solution for more effective use of AI in dermatology are identified.
Collapse
Affiliation(s)
- Michał Strzelecki
- Institute of Electronics, Lodz University of Technology, Łódź, Poland.
| | - Marcin Kociołek
- Institute of Electronics, Lodz University of Technology, Łódź, Poland
| | - Maria Strąkowska
- Institute of Electronics, Lodz University of Technology, Łódź, Poland
| | - Michał Kozłowski
- Department of Mechatronics and Technical and IT Education, Faculty of Technical Science, University of Warmia and Mazury, Olsztyn, Poland
| | - Andrzej Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland
| | | |
Collapse
|
2
|
Gefeller O, Kaiser I, Brockmann EM, Uter W, Pfahlberg AB. The Level of Agreement between Self-Assessments and Examiner Assessments of Melanocytic Nevus Counts: Findings from an Evaluation of 4548 Double Assessments. Curr Oncol 2024; 31:2221-2232. [PMID: 38668067 PMCID: PMC11048774 DOI: 10.3390/curroncol31040164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 04/04/2024] [Accepted: 04/11/2024] [Indexed: 04/28/2024] Open
Abstract
Cutaneous melanoma (CM) is a candidate for screening programs because its prognosis is excellent when diagnosed at an early disease stage. Targeted screening of those at high risk for developing CM, a cost-effective alternative to population-wide screening, requires valid procedures to identify the high-risk group. Self-assessment of the number of nevi has been suggested as a component of such procedures, but its validity has not yet been established. We analyzed the level of agreement between self-assessments and examiner assessments of the number of melanocytic nevi in the area between the wrist and the shoulder of both arms based on 4548 study subjects in whom mutually blinded double counting of nevi was performed. Nevus counting followed the IARC protocol. Study subjects received written instructions, photographs, a mirror, and a "nevometer" to support self-assessment of nevi larger than 2 mm. Nevus counts were categorized based on the quintiles of the distribution into five levels, defining a nevus score. Cohen's weighted kappa coefficient (κ) was estimated to measure the level of agreement. In the total sample, the agreement between self-assessments and examiner assessments was moderate (weighted κ = 0.596). Self-assessed nevus counts were higher than those determined by trained examiners (mean difference: 3.33 nevi). The level of agreement was independent of sociodemographic and cutaneous factors; however, participants' eye color had a significant impact on the level of agreement. Our findings show that even with comprehensive guidance, only a moderate level of agreement between self-assessed and examiner-assessed nevus counts can be achieved. Self-assessed nevus information does not appear to be reliable enough to be used in individual risk assessment to target screening activities.
Collapse
Affiliation(s)
- Olaf Gefeller
- Department of Medical Informatics, Biometry and Epidemiology, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054 Erlangen, Germany; (I.K.); (W.U.); (A.B.P.)
| | | | | | | | | |
Collapse
|
3
|
Ortner VK, Kilov K, Mondragón AC, Fredman G, Omland SH, Manole I, Laugesen CAP, Havsager S, Johansen B, Duvold T, Isberg AP, Andersen AD, Zibert JR, Hædersdal M. Mobile health technologies in an interventional hybrid study on actinic keratosis: Results from an early phase randomized controlled trial investigating the safety and efficacy of a cytosolic phospholipase A2 inhibitor gel in photodamaged skin. Exp Dermatol 2024; 33:e15068. [PMID: 38610094 DOI: 10.1111/exd.15068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 03/15/2024] [Accepted: 03/19/2024] [Indexed: 04/14/2024]
Abstract
Hybrid trials are a new trend in dermatological research that leverage mobile health technologies to decentralize a subset of clinical trial elements and thereby reduce the number of in-clinic visits. In a Phase I/IIa randomized controlled hybrid trial, the safety and efficacy of an anti-proliferative and anti-inflammatory drug inhibiting cytosolic phospholipase A2 (AVX001) was tested using 1%, 3% or vehicle gel in 60 patients with actinic keratosis (AK) and assessed in-clinic as well as remotely. Over the course of 12 weeks, patients were assessed in-clinic at baseline, end of treatment (EOT) and end of study (EOS), as well as 9 times remotely on a weekly to biweekly basis. Safety outcomes comprising local skin reactions (LSR; 0-5), adverse events (AE) and cosmesis, were graded in-clinic and remotely using patient-obtained smartphone photographs (PSPs) and questionnaires; efficacy was assessed in-clinic based on clinically visible clearance of AK target area of >50%. A total of 55 participants (91.7%) completed the treatment course. The average submission rate of PSPs was high (≥85%), of which 93% were of sufficient quality. No serious AE were reported and only two experienced temporary LSR >2 (scale 0-4) and cosmesis remained stable throughout the study. Based on the mild AE and LSR profile, daily application of AVX001 gel for 1 month appears safe, tolerable, and cosmetically acceptable for use in patients with AK. At EOT, AVX001 achieved a subtle treatment response with clearance of AK target area of >50% in 18% of patients. Remote and in-clinic assessments of LSRs were in high agreement, suggesting that the use of mobile health technologies in early-phase hybrid studies of AK does not compromise patient safety.
Collapse
Affiliation(s)
- Vinzent Kevin Ortner
- Department of Dermatology, Copenhagen University Hospital, Bispebjerg and Frederiksberg, Copenhagen, Denmark
| | | | | | - Gabriella Fredman
- Department of Dermatology, Copenhagen University Hospital, Bispebjerg and Frederiksberg, Copenhagen, Denmark
| | - Silje Haukali Omland
- Department of Dermatology, Copenhagen University Hospital, Bispebjerg and Frederiksberg, Copenhagen, Denmark
| | - Ionela Manole
- Studies&Me A/S, Copenhagen, Denmark
- 2nd Department of Dermatology, Colentina Clinical Hospital, Bucharest, Romania
| | | | | | - Berit Johansen
- Coegin Pharma AB, Lund, Sweden
- Department of Biology, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
| | | | | | | | - John R Zibert
- Studies&Me A/S, Copenhagen, Denmark
- Coegin Pharma AB, Lund, Sweden
| | - Merete Hædersdal
- Department of Dermatology, Copenhagen University Hospital, Bispebjerg and Frederiksberg, Copenhagen, Denmark
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
4
|
Joly-Chevrier M, Nguyen AXL, Liang L, Lesko-Krleza M, Lefrançois P. The State of Artificial Intelligence in Skin Cancer Publications. J Cutan Med Surg 2024; 28:146-152. [PMID: 38323537 PMCID: PMC11015717 DOI: 10.1177/12034754241229361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
BACKGROUND Artificial intelligence (AI) in skin cancer is a promising research field to assist physicians and to provide support to patients remotely. Physicians' awareness to new developments in AI research is important to define the best practices and scope of integrating AI-enabled technologies within a clinical setting. OBJECTIVES To analyze the characteristics and trends of AI skin cancer publications from dermatology journals. METHODS AI skin cancer publications were retrieved in June 2022 from the Web of Science. Publications were screened by title, abstract, and keywords to assess eligibility. Publications were fully reviewed. Publications were divided between nonmelanoma skin cancer (NMSC), melanoma, and skin cancer studies. The primary measured outcome was the number of citations. The secondary measured outcomes were articles' general characteristics and features related to AI. RESULTS A total of 168 articles were included: 25 on NMSC, 77 on melanoma, and 66 on skin cancer. The most common types of skin cancers were melanoma (134, 79.8%), basal cell carcinoma (61, 36.3%), and squamous cell carcinoma (45, 26.9%). All articles were published between 2000 and 2022, with 49 (29.2%) of them being published in 2021. Original studies that developed or assessed an algorithm predominantly used supervised learning (66, 97.0%) and deep neural networks (42, 67.7%). The most used imaging modalities were standard dermoscopy (76, 45.2%) and clinical images (39, 23.2%). CONCLUSIONS Most publications focused on developing or assessing screening technologies with mainly deep neural network algorithms. This indicates the eminent need for dermatologists to label or annotate images used by novel AI systems.
Collapse
Affiliation(s)
| | | | - Laurence Liang
- Faculty of Engineering, McGill University, Montreal, QC, Canada
| | - Michael Lesko-Krleza
- Division of Computer Engineering, Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada
| | - Philippe Lefrançois
- Division of Dermatology, Department of Medicine, McGill University, Montreal, QC, Canada
- Division of Dermatology, Department of Medicine, Jewish General Hospital, Montreal, QC, Canada
- Lady Davis Institute for Medical Research, Montreal, QC, Canada
| |
Collapse
|
5
|
Alomary SA, Mackenzie E, Khan S, Rao BK. Mobile apps in dermatology: Bridging innovation and care. Skin Res Technol 2024; 30:e13640. [PMID: 38424722 PMCID: PMC10904765 DOI: 10.1111/srt.13640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 02/19/2024] [Indexed: 03/02/2024]
Affiliation(s)
- Simona A. Alomary
- Department of DermatologyRutgers New Jersey Medical SchoolNewarkNew JerseyUSA
| | - Elyse Mackenzie
- Department of DermatologyRutgers Robert Wood Johnson Medical SchoolPiscatawayNew JerseyUSA
| | - Samavia Khan
- Department of DermatologyRutgers Robert Wood Johnson Medical SchoolPiscatawayNew JerseyUSA
| | - Babar K. Rao
- Department of DermatologyRutgers Robert Wood Johnson Medical SchoolPiscatawayNew JerseyUSA
| |
Collapse
|
6
|
Sangers TE, Kittler H, Blum A, Braun RP, Barata C, Cartocci A, Combalia M, Esdaile B, Guitera P, Haenssle HA, Kvorning N, Lallas A, Navarrete-Dechent C, Navarini AA, Podlipnik S, Rotemberg V, Soyer HP, Tognetti L, Tschandl P, Malvehy J. Position statement of the EADV Artificial Intelligence (AI) Task Force on AI-assisted smartphone apps and web-based services for skin disease. J Eur Acad Dermatol Venereol 2024; 38:22-30. [PMID: 37766502 DOI: 10.1111/jdv.19521] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Accepted: 09/08/2023] [Indexed: 09/29/2023]
Abstract
BACKGROUND As the use of smartphones continues to surge globally, mobile applications (apps) have become a powerful tool for healthcare engagement. Prominent among these are dermatology apps powered by Artificial Intelligence (AI), which provide immediate diagnostic guidance and educational resources for skin diseases, including skin cancer. OBJECTIVE This article, authored by the EADV AI Task Force, seeks to offer insights and recommendations for the present and future deployment of AI-assisted smartphone applications (apps) and web-based services for skin diseases with emphasis on skin cancer detection. METHODS An initial position statement was drafted on a comprehensive literature review, which was subsequently refined through two rounds of digital discussions and meticulous feedback by the EADV AI Task Force, ensuring its accuracy, clarity and relevance. RESULTS Eight key considerations were identified, including risks associated with inaccuracy and improper user education, a decline in professional skills, the influence of non-medical commercial interests, data security, direct and indirect costs, regulatory approval and the necessity of multidisciplinary implementation. Following these considerations, three main recommendations were formulated: (1) to ensure user trust, app developers should prioritize transparency in data quality, accuracy, intended use, privacy and costs; (2) Apps and web-based services should ensure a uniform user experience for diverse groups of patients; (3) European authorities should adopt a rigorous and consistent regulatory framework for dermatology apps to ensure their safety and accuracy for users. CONCLUSIONS The utilisation of AI-assisted smartphone apps and web-based services in diagnosing and treating skin diseases has the potential to greatly benefit patients in their dermatology journeys. By prioritising innovation, fostering collaboration and implementing effective regulations, we can ensure the successful integration of these apps into clinical practice.
Collapse
Affiliation(s)
- Tobias E Sangers
- Department of Dermatology, Leiden University Medical Center, Leiden, The Netherlands
| | - Harald Kittler
- Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - Andreas Blum
- Public, Private and Teaching Practice of Dermatology Konstanz, Konstanz, Germany
| | - Ralph P Braun
- Department of Dermatology, University Hospital Zurich, Zurich, Switzerland
| | - Catarina Barata
- Institute for Systems and Robotics, LARSyS, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal
| | | | | | - Ben Esdaile
- Department of Dermatology, Whittington NHS Trust, London, UK
| | - Pascale Guitera
- Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- Sydney Melanoma Diagnostic Centre, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
- Melanoma Institute Australia, The University of Sydney, Sydney, New South Wales, Australia
| | - Holger A Haenssle
- Department of Dermatology, Heidelberg University Medical Center, Heidelberg, Germany
| | - Niels Kvorning
- Department of Plastic Surgery, Herlev Hospital, Herlev, Denmark
| | - Aimilios Lallas
- First Department of Dermatology, Faculty of Health Sciences, School of Medicine, Aristotle University, Thessaloniki, Greece
| | - Cristian Navarrete-Dechent
- Melanoma and Skin Cancer Unit, Department of Dermatology, Escuela de Medicina, Pontifica Universidad Catolica de Chile, Santiago, Chile
| | - Alexander A Navarini
- Department of Dermatology and Department of Biomedical Engineering, University Hospital of Basel, Basel, Switzerland
| | - Sebastian Podlipnik
- Department of Dermatology, Hospital Clínic, University of Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Veronica Rotemberg
- Division of Dermatology, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - H Peter Soyer
- Frazer Institute, Dermatology Research Centre, The University of Queensland, Brisbane, Queensland, Australia
| | - Linda Tognetti
- Dermatology Unit, Department of Medical, Surgical and Neurosciences, University of Siena, Siena, Italy
| | - Philipp Tschandl
- Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - Josep Malvehy
- Melanoma Unit, Dermatology Department, Hospital Clínic de Barcelona, IDIBAPS, Universitat de Barcelona, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Enfermedades Raras (CIBERER), Barcelona, Spain
| |
Collapse
|
7
|
Krishnan G, Singh S, Pathania M, Gosavi S, Abhishek S, Parchani A, Dhar M. Artificial intelligence in clinical medicine: catalyzing a sustainable global healthcare paradigm. Front Artif Intell 2023; 6:1227091. [PMID: 37705603 PMCID: PMC10497111 DOI: 10.3389/frai.2023.1227091] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 08/09/2023] [Indexed: 09/15/2023] Open
Abstract
As the demand for quality healthcare increases, healthcare systems worldwide are grappling with time constraints and excessive workloads, which can compromise the quality of patient care. Artificial intelligence (AI) has emerged as a powerful tool in clinical medicine, revolutionizing various aspects of patient care and medical research. The integration of AI in clinical medicine has not only improved diagnostic accuracy and treatment outcomes, but also contributed to more efficient healthcare delivery, reduced costs, and facilitated better patient experiences. This review article provides an extensive overview of AI applications in history taking, clinical examination, imaging, therapeutics, prognosis and research. Furthermore, it highlights the critical role AI has played in transforming healthcare in developing nations.
Collapse
Affiliation(s)
- Gokul Krishnan
- Department of Internal Medicine, Kasturba Medical College, Manipal, India
| | - Shiana Singh
- Department of Emergency Medicine, All India Institute of Medical Sciences, Rishikesh, India
| | - Monika Pathania
- Department of Geriatric Medicine, All India Institute of Medical Sciences, Rishikesh, India
| | - Siddharth Gosavi
- Department of Internal Medicine, Kasturba Medical College, Manipal, India
| | - Shuchi Abhishek
- Department of Internal Medicine, Kasturba Medical College, Manipal, India
| | - Ashwin Parchani
- Department of Geriatric Medicine, All India Institute of Medical Sciences, Rishikesh, India
| | - Minakshi Dhar
- Department of Geriatric Medicine, All India Institute of Medical Sciences, Rishikesh, India
| |
Collapse
|
8
|
Challenging Patterns of Atypical Dermatofibromas and Promising Diagnostic Tools for Differential Diagnosis of Malignant Lesions. Diagnostics (Basel) 2023; 13:diagnostics13040671. [PMID: 36832159 PMCID: PMC9955442 DOI: 10.3390/diagnostics13040671] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 02/07/2023] [Accepted: 02/08/2023] [Indexed: 02/15/2023] Open
Abstract
Dermatofibroma (DF) or fibrous histiocytoma is one of the most frequent benign cutaneous soft-tissue lesions, characterized by a post-inflammatory tissue reaction associated with fibrosis of the dermis. Clinically DFs have a polymorphous clinical aspect from the solitary, firm, single nodules to multiple papules with a relatively smooth surface. However, multiple atypical clinicopathological variants of DFs have been reported and, therefore, clinical recognition may become challenging, leading to a more burdensome identification and sometimes to misdiagnosis. Dermoscopy is considered an important tool in DFs diagnosis, as it improves diagnostic accuracy for clinically amelanotic nodules. Although typical dermoscopic patterns are most frequently seen in clinical practice, there have also been some atypical variants described, mimicking some underlying recurrent and sometimes harmful skin afflictions. Usually, no treatment is required, although an appropriate work-up may be necessary in specific cases, such as in the presence of atypical variants or a history of recent changes. This narrative review's aim is to summarize current evidence regarding clinical presentation, positive and differential diagnosis of atypical dermatofibromas and also to raise awareness about the importance of specific characteristics of atypical variants to better differentiate them from malignant conditions.
Collapse
|
9
|
Leal-Costa C, Lopez-Villegas A, Perez-Heredia M, Baena-Lopez MA, Hernandez-Montoya CJ, Lopez-Liria R. Patients' Experiences and Communication with Teledermatology versus Face-to-Face Dermatology. J Clin Med 2022; 11:jcm11195528. [PMID: 36233398 PMCID: PMC9573490 DOI: 10.3390/jcm11195528] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Revised: 09/12/2022] [Accepted: 09/16/2022] [Indexed: 11/16/2022] Open
Abstract
(1) Background: Teledermatology (TD) has exponentially grown since the onset of COVID-19, as the Face-to-Face Dermatology (F-F/D) modality changed within Public Health Systems. Although studies have been conducted on health results, we did not find any that analyzed the experiences of individuals who received care through TD. Therefore, the main objective of the study was to analyze the experiences of dermatology patients and the communication with health personnel. (2) Methods: A multicenter, controlled, randomized, non-blinded clinical trial was designed. Data were collected during the six months of follow-up. Four-hundred and fifty patients participated in the present study, who were assigned to two different groups: TD and F-F/D. The sociodemographic and clinical characteristics of the participants were collected. The ‘Generic Short Patient Experiences Questionnaire’ (GS-PEQ) was used to assess patients’ experiences, and the Healthcare Communication Questionnaire (HCCQ) was used to measure the communication of patients with healthcare professionals. (3) Results: After six months of follow-up, 450 patients completed the study (TD = 225; F-F/D = 225) of which 53.3% were women, with an average age of 52.16 (SD = 19.97). The main reasons for the consultations were skin lesions (51.56%) located on the head and neck (46.8%), followed by the legs (20.7%). According to the GS-PEQ, TD users indicated having a greater confidence in the professional skills of the doctors (p < 0.01). However, the F-F/D group indicated having received more adequate information about their diagnosis/afflictions (p < 0.01), were more involved in the decisions related to their treatment (p < 0.01), and more satisfied with the help and treatment received (p < 0.01). Regarding the HCCQ, the TD group obtained better assessments with respect to if the patients had been treated in a rude and hasty manner, if the health professionals had addressed them with a smile, and if these could adequately manage the reason for the consultation (p < 0.01). (4) Conclusions: The results of the study generally showed positive experiences and communication. The TD group indicated having received less information about the diagnosis, were less involved in the decisions, and were less satisfied with the help and treatment received. However, they indicated having more confidence on the professional skills of the doctors, and that the work at the institution was better organized. In addition, they perceived better communication skills of the health professionals, although less respect for their privacy.
Collapse
Affiliation(s)
| | - Antonio Lopez-Villegas
- Laboratory for Research, Education and Planning in Critical and Intensive Care Medicine, CTS-609 Research Group, Poniente University Hospital, 04700 El Ejido-Almeria, Spain
- Correspondence:
| | - Mercedes Perez-Heredia
- Research Management Department, Primary Care District Poniente of Almería, 04700 El Ejido-Almeria, Spain
| | | | | | - Remedios Lopez-Liria
- Health Research Centre, Department of Nursing, Physiotherapy and Medicine, University of Almería, La Cañada de San Urbano, 04120 Almeria, Spain
| |
Collapse
|
10
|
Over-Detection of Melanoma-Suspect Lesions by a CE-Certified Smartphone App: Performance in Comparison to Dermatologists, 2D and 3D Convolutional Neural Networks in a Prospective Data Set of 1204 Pigmented Skin Lesions Involving Patients' Perception. Cancers (Basel) 2022; 14:cancers14153829. [PMID: 35954491 PMCID: PMC9367531 DOI: 10.3390/cancers14153829] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 07/20/2022] [Accepted: 08/05/2022] [Indexed: 11/30/2022] Open
Abstract
Simple Summary Early detection and resection of cutaneous melanoma are crucial for a good prognosis. However, visual distinction of early melanomas from benign nevi remains challenging. New artificial intelligence-based approaches for risk stratification of pigmented skin lesions provide screening methods for laypersons with increasing use of smartphone applications (apps). Our study aims to prospectively investigate the diagnostic accuracy of a CE-certified smartphone app, SkinVision®, in melanoma recognition. Based on classification into three different risk scores, the app provides a recommendation to consult a dermatologist. In addition, both patients’ and dermatologists’ perspectives towards AI-based mobile health apps were evaluated. We observed that the app classified a significantly higher number of lesions as high-risk than dermatologists, which would have led to a clinically harmful number of unnecessary excisions. The diagnostic performance of the app in dichotomous classification of 1204 pigmented skin lesions (risk classification for nevus vs. melanoma) remained below advertised rates with low sensitivity (41.3–83.3%) and specificity (60.0–82.9%). The confidence in the app was low among both patients and dermatologists, and no patient favored an assessment by the app alone. Although smartphone apps are a potential medium for increasing awareness of melanoma screening in the lay population, they should be evaluated for certification with prospective real-world evidence. Abstract The exponential increase in algorithm-based mobile health (mHealth) applications (apps) for melanoma screening is a reaction to a growing market. However, the performance of available apps remains to be investigated. In this prospective study, we investigated the diagnostic accuracy of a class 1 CE-certified smartphone app in melanoma risk stratification and its patient and dermatologist satisfaction. Pigmented skin lesions ≥ 3 mm and any suspicious smaller lesions were assessed by the smartphone app SkinVision® (SkinVision® B.V., Amsterdam, the Netherlands, App-Version 6.8.1), 2D FotoFinder ATBM® master (FotoFinder ATBM® Systems GmbH, Bad Birnbach, Germany, Version 3.3.1.0), 3D Vectra® WB360 (Canfield Scientific, Parsippany, NJ, USA, Version 4.7.1) total body photography (TBP) devices, and dermatologists. The high-risk score of the smartphone app was compared with the two gold standards: histological diagnosis, or if not available, the combination of dermatologists’, 2D and 3D risk assessments. A total of 1204 lesions among 114 patients (mean age 59 years; 51% females (55 patients at high-risk for developing a melanoma, 59 melanoma patients)) were included. The smartphone app’s sensitivity, specificity, and area under the receiver operating characteristics (AUROC) varied between 41.3–83.3%, 60.0–82.9%, and 0.62–0.72% according to two study-defined reference standards. Additionally, all patients and dermatologists completed a newly created questionnaire for preference and trust of screening type. The smartphone app was rated as trustworthy by 36% (20/55) of patients at high-risk for melanoma, 49% (29/59) of melanoma patients, and 8.8% (10/114) of dermatologists. Most of the patients rated the 2D TBP imaging (93% (51/55) resp. 88% (52/59)) and the 3D TBP imaging (91% (50/55) resp. 90% (53/59)) as trustworthy. A skin cancer screening by combination of dermatologist and smartphone app was favored by only 1.8% (1/55) resp. 3.4% (2/59) of the patients; no patient preferred an assessment by a smartphone app alone. The diagnostic accuracy in clinical practice was not as reliable as previously advertised and the satisfaction with smartphone apps for melanoma risk stratification was scarce. MHealth apps might be a potential medium to increase awareness for melanoma screening in the lay population, but healthcare professionals and users should be alerted to the potential harm of over-detection and poor performance. In conclusion, we suggest further robust evidence-based evaluation before including market-approved apps in self-examination for public health benefits.
Collapse
|