Artificial Intelligence in Skin Cancer Diagnostics: The Patients' Perspective

Patient and dermatologists' perspectives on augmented intelligence for melanoma screening: A prospective study

BACKGROUND

Artificial intelligence (AI) shows promising potential to enhance human decision-making as synergistic augmented intelligence (AuI), but requires critical evaluation for skin cancer screening in a real-world setting.

OBJECTIVES

To investigate the perspectives of patients and dermatologists after skin cancer screening by human, artificial and augmented intelligence.

METHODS

A prospective comparative cohort study conducted at the University Hospital Basel included 205 patients (at high-risk of developing melanoma, with resected or advanced disease) and 8 dermatologists. Patients underwent skin cancer screening by a dermatologist with subsequent 2D and 3D total-body photography (TBP). Any suspicious and all melanocytic skin lesions ≥3 mm were imaged with digital dermoscopes and classified by corresponding convolutional neural networks (CNNs). Excisions were performed based on dermatologist's melanoma suspicion, study-defined elevated CNN risk-scores and/or melanoma suspicion by AuI. Subsequently, all patients and dermatologists were surveyed about their experience using questionnaires, including quantification of patient's safety sense following different examinations (subjective safety score (SSS): 0-10).

RESULTS

Most patients believed AI could improve diagnostic performance (95.5%, n = 192/201). In total, 83.4% preferred AuI-based skin cancer screening compared to examination by AI or dermatologist alone (3D-TBP: 61.3%; 2D-TBP: 22.1%, n = 199). Regarding SSS, AuI induced a significantly higher feeling of safety than AI (mean-SSS (mSSS): 9.5 vs. 7.7, p < 0.0001) or dermatologist screening alone (mSSS: 9.5 vs. 9.1, p = 0.001). Most dermatologists expressed high trust in AI examination results (3D-TBP: 90.2%; 2D-TBP: 96.1%, n = 205). In 68.3% of the examinations, dermatologists felt that diagnostic accuracy improved through additional AI-assessment (n = 140/205). Especially beginners (<2 years' dermoscopic experience; 61.8%, n = 94/152) felt AI facilitated their clinical work compared to experts (>5 years' dermoscopic experience; 20.9%, n = 9/43). Contrarily, in divergent risk assessments, only 1.5% of dermatologists trusted a benign CNN-classification more than personal malignancy suspicion (n = 3/205).

CONCLUSIONS

While patients already prefer AuI with 3D-TBP for melanoma recognition, dermatologists continue to rely largely on their own decision-making despite high confidence in AI-results.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT04605822).

Health consumers' ethical concerns towards artificial intelligence in Australian emergency departments

OBJECTIVES

To investigate health consumers' ethical concerns towards the use of artificial intelligence (AI) in EDs.

METHODS

Qualitative semi-structured interviews with health consumers, recruited via health consumer networks and community groups, interviews conducted between January and August 2022.

RESULTS

We interviewed 28 health consumers about their perceptions towards the ethical use of AI in EDs. The results discussed in this paper highlight the challenges and barriers for the effective and ethical implementation of AI from the perspective of Australian health consumers. Most health consumers are more likely to support AI health tools in EDs if they continue to be involved in the decision-making process. There is considerably more approval of AI tools that support clinical decision-making, as opposed to replacing it. There is mixed sentiment about the acceptability of AI tools influencing clinical decision-making and judgement. Health consumers are mostly supportive of the use of their data to train and develop AI tools but are concerned with who has access. Addressing bias and discrimination in AI is an important consideration for some health consumers. Robust regulation and governance are critical for health consumers to trust and accept the use of AI.

CONCLUSION

Health consumers view AI as an emerging technology that they want to see comprehensively regulated to ensure it functions safely and securely with EDs. Without considerations made for the ethical design, implementation and use of AI technologies, health consumer trust and acceptance in the use of these tools will be limited.

Emerging research trends in artificial intelligence for cancer diagnostic systems: A comprehensive review

This review article offers a comprehensive analysis of current developments in the application of machine learning for cancer diagnostic systems. The effectiveness of machine learning approaches has become evident in improving the accuracy and speed of cancer detection, addressing the complexities of large and intricate medical datasets. This review aims to evaluate modern machine learning techniques employed in cancer diagnostics, covering various algorithms, including supervised and unsupervised learning, as well as deep learning and federated learning methodologies. Data acquisition and preprocessing methods for different types of data, such as imaging, genomics, and clinical records, are discussed. The paper also examines feature extraction and selection techniques specific to cancer diagnosis. Model training, evaluation metrics, and performance comparison methods are explored. Additionally, the review provides insights into the applications of machine learning in various cancer types and discusses challenges related to dataset limitations, model interpretability, multi-omics integration, and ethical considerations. The emerging field of explainable artificial intelligence (XAI) in cancer diagnosis is highlighted, emphasizing specific XAI techniques proposed to improve cancer diagnostics. These techniques include interactive visualization of model decisions and feature importance analysis tailored for enhanced clinical interpretation, aiming to enhance both diagnostic accuracy and transparency in medical decision-making. The paper concludes by outlining future directions, including personalized medicine, federated learning, deep learning advancements, and ethical considerations. This review aims to guide researchers, clinicians, and policymakers in the development of efficient and interpretable machine learning-based cancer diagnostic systems.

Prospective multicenter study using artificial intelligence to improve dermoscopic melanoma diagnosis in patient care

BACKGROUND

Early detection of melanoma, a potentially lethal type of skin cancer with high prevalence worldwide, improves patient prognosis. In retrospective studies, artificial intelligence (AI) has proven to be helpful for enhancing melanoma detection. However, there are few prospective studies confirming these promising results. Existing studies are limited by low sample sizes, too homogenous datasets, or lack of inclusion of rare melanoma subtypes, preventing a fair and thorough evaluation of AI and its generalizability, a crucial aspect for its application in the clinical setting.

METHODS

Therefore, we assessed "All Data are Ext" (ADAE), an established open-source ensemble algorithm for detecting melanomas, by comparing its diagnostic accuracy to that of dermatologists on a prospectively collected, external, heterogeneous test set comprising eight distinct hospitals, four different camera setups, rare melanoma subtypes, and special anatomical sites. We advanced the algorithm with real test-time augmentation (R-TTA, i.e., providing real photographs of lesions taken from multiple angles and averaging the predictions), and evaluated its generalization capabilities.

RESULTS

Overall, the AI shows higher balanced accuracy than dermatologists (0.798, 95% confidence interval (CI) 0.779-0.814 vs. 0.781, 95% CI 0.760-0.802; p = 4.0e-145), obtaining a higher sensitivity (0.921, 95% CI 0.900-0.942 vs. 0.734, 95% CI 0.701-0.770; p = 3.3e-165) at the cost of a lower specificity (0.673, 95% CI 0.641-0.702 vs. 0.828, 95% CI 0.804-0.852; p = 3.3e-165).

CONCLUSION

As the algorithm exhibits a significant performance advantage on our heterogeneous dataset exclusively comprising melanoma-suspicious lesions, AI may offer the potential to support dermatologists, particularly in diagnosing challenging cases.

Artificial intelligence and machine learning a new frontier in the diagnosis of ocular adnexal tumors: A review

In our article, we explore the transformative potential of Artificial Intelligence and Machine Learning in oculo-oncology, focusing on the diagnosis and management of ocular adnexal tumors. Delving into the intricacies of adnexal conditions such as conjunctival melanoma and squamous conjunctival carcinoma, the study emphasizes recent breakthroughs, such as Artificial Intelligence-driven early detection methods. While acknowledging challenges like the scarcity of specialized datasets and issues in standardizing image capture, the research underscores encouraging patient acceptance, as demonstrated in melanoma diagnosis studies. The abstract calls for overcoming obstacles, conducting clinical trials, establishing global regulatory norms and fostering collaboration between ophthalmologists and Artificial Intelligence experts. Overall, the article envisions Artificial Intelligence's imminent transformative impact on ocular and periocular cancer diagnosis.

Disseminate Cutaneous Vasculitis Associated with Durvalumab Treatment-Case Report, Mini-Review on Cutaneous Side Effects of Immune Checkpoint Inhibitor Therapies with Machine Learning Perspectives

Durvalumab is an IgG1 monoclonal antibody that has efficacy in many advanced-stage cancers, especially in small-cell lung cancer. The efficacy of durvalumab can be enhanced by chemotherapy. Cutaneous side effects due to treatment with durvalumab are usually self-limiting and easily manageable. We present a clinical case of a female patient aged 61, with small-cell lung carcinoma in stage III B, cT3N2M, who developed a disseminated cutaneous vasculitis after seven months of durvalumab monotherapy, having previously been treated with polychemotherapy according to oncological protocols. To the best of our knowledge, based on a comprehensive search in leading databases, like Web of Science, Scopus, PubMed and some others, ours is the first published case of disseminated cutaneous vasculitis as a result of Durvalumab treatment. Anticancer immunotherapy targeting immune checkpoint inhibition (ICI) has transformed the treatment and evolution of patients with multiple varieties of hematologic cancers. In this context, the cutaneous side effects due to immune checkpoint inhibitor therapies are very few in the scientific literature. Based on this need, we have performed a mini-review of cutaneous side effects due to immune checkpoint inhibitor therapies that treat actual aspects in this sense. We also present some artificial intelligence challenges and future perspectives in the combination of human reasoning and reasoning based on Artificial Intelligence for study of the very rare Disseminate cutaneous vasculitis associated with Durvalumab treatment.

Patients' Attitudes Toward the Use of Artificial Intelligence as a Diagnostic Tool in Radiology in Saudi Arabia: Cross-Sectional Study

BACKGROUND

Artificial intelligence (AI) is widely used in various medical fields, including diagnostic radiology as a tool for greater efficiency, precision, and accuracy. The integration of AI as a radiological diagnostic tool has the potential to mitigate delays in diagnosis, which could, in turn, impact patients' prognosis and treatment outcomes. The literature shows conflicting results regarding patients' attitudes to AI as a diagnostic tool. To the best of our knowledge, no similar study has been conducted in Saudi Arabia.

OBJECTIVE

The objectives of this study are to examine patients' attitudes toward the use of AI as a tool in diagnostic radiology at King Khalid University Hospital, Saudi Arabia. Additionally, we sought to explore potential associations between patients' attitudes and various sociodemographic factors.

METHODS

This descriptive-analytical cross-sectional study was conducted in a tertiary care hospital. Data were collected from patients scheduled for radiological imaging through a validated self-administered questionnaire. The main outcome was to measure patients' attitudes to the use of AI in radiology by calculating mean scores of 5 factors, distrust and accountability (factor 1), procedural knowledge (factor 2), personal interaction and communication (factor 3), efficiency (factor 4), and methods of providing information to patients (factor 5). Data were analyzed using the student t test, one-way analysis of variance followed by post hoc and multivariable analysis.

RESULTS

A total of 382 participants (n=273, 71.5% women and n=109, 28.5% men) completed the surveys and were included in the analysis. The mean age of the respondents was 39.51 (SD 13.26) years. Participants favored physicians over AI for procedural knowledge, personal interaction, and being informed. However, the participants demonstrated a neutral attitude for distrust and accountability and for efficiency. Marital status was found to be associated with distrust and accountability, procedural knowledge, and personal interaction. Associations were also found between self-reported health status and being informed and between the field of specialization and distrust and accountability.

CONCLUSIONS

Patients were keen to understand the work of AI in radiology but favored personal interaction with a radiologist. Patients were impartial toward AI replacing radiologists and the efficiency of AI, which should be a consideration in future policy development and integration. Future research involving multicenter studies in different regions of Saudi Arabia is required.

Systematic review of approaches to detection and classification of skin cancer using artificial intelligence: Development and prospects

In recent years, there has been a significant improvement in the accuracy of the classification of pigmented skin lesions using artificial intelligence algorithms. Intelligent analysis and classification systems are significantly superior to visual diagnostic methods used by dermatologists and oncologists. However, the application of such systems in clinical practice is severely limited due to a lack of generalizability and risks of potential misclassification. Successful implementation of artificial intelligence-based tools into clinicopathological practice requires a comprehensive study of the effectiveness and performance of existing models, as well as further promising areas for potential research development. The purpose of this systematic review is to investigate and evaluate the accuracy of artificial intelligence technologies for detecting malignant forms of pigmented skin lesions. For the study, 10,589 scientific research and review articles were selected from electronic scientific publishers, of which 171 articles were included in the presented systematic review. All selected scientific articles are distributed according to the proposed neural network algorithms from machine learning to multimodal intelligent architectures and are described in the corresponding sections of the manuscript. This research aims to explore automated skin cancer recognition systems, from simple machine learning algorithms to multimodal ensemble systems based on advanced encoder-decoder models, visual transformers (ViT), and generative and spiking neural networks. In addition, as a result of the analysis, future directions of research, prospects, and potential for further development of automated neural network systems for classifying pigmented skin lesions are discussed.

Multi-Level Ethical Considerations of Artificial Intelligence Health Monitoring for People Living with Parkinson's Disease

Artificial intelligence (AI) has garnered tremendous attention in health care, and many hope that AI can enhance our health system's ability to care for people with chronic and degenerative conditions, including Parkinson's Disease (PD). This paper reports the themes and lessons derived from a qualitative study with people living with PD, family caregivers, and health care providers regarding the ethical dimensions of using AI to monitor, assess, and predict PD symptoms and progression. Thematic analysis identified ethical concerns at four intersecting levels: personal, interpersonal, professional/institutional, and societal levels. Reflecting on potential benefits of predictive algorithms that can continuously collect and process longitudinal data, participants expressed a desire for more timely, ongoing, and accurate information that could enhance management of day-to-day fluctuations and facilitate clinical and personal care as their disease progresses. Nonetheless, they voiced concerns about intersecting ethical questions around evolving illness identities, familial and professional care relationships, privacy, and data ownership/governance. The multi-layer analysis provides a helpful way to understand the ethics of using AI in monitoring and managing PD and other chronic/degenerative conditions.

Empowering health care consumers & understanding patients' perspectives on AI integration in oncology and surgery: A perspective

Introduction

Artificial intelligence (AI) is transforming oncology and surgery by improving diagnostics, personalizing treatments, and enhancing surgical precision. Patients appreciate AI for its potential to provide accurate prognoses and tailored therapies. However, AI's implementation raises ethical concerns, data privacy issues, and the need for transparent communication between patients and health care providers. This study aims to understand patients' perspectives on AI integration in oncology and surgery to foster a balanced and patient-centered approach.

Methods

The study utilized a comprehensive literature review and analysis of existing research on AI applications in oncology and surgery. The focus was on examining patient perceptions, ethical considerations, and the potential benefits and risks associated with AI integration. Data was collected from peer-reviewed journals, conference proceedings, and expert opinions to provide a broad understanding of the topic. The perspectives of patients was also emphasized to highlight the nuances of their acceptance and concerns regarding AI in their health care.

Results

Patients generally perceive AI in oncology and surgery as beneficial, appreciating its potential for more accurate diagnoses, personalized treatment plans, and improved surgical outcomes. They particularly value AI's role in providing timely and precise diagnostics, which can lead to better prognoses and reduced anxiety. However, concerns about data privacy, ethical implications, and the reliability of AI systems were prevalent. Consequently, trust in AI and health care providers was deemed as a crucial factor for patient acceptance. Additionally, the need for transparent communication and ethical safeguards was also highlighted to address these concerns effectively.

Conclusion

The integration of AI in oncology and surgeryholds significant promise for enhancing patient care and outcomes. Patients view AI as a valuable tool that can provide accurate prognoses and personalized treatments. However, addressing ethical concerns, ensuring data privacy, and building trust through transparent communication are essential for successful AI integration. Future initiatives should focus on refining AI algorithms, establishing robust ethical guidelines, and enhancing patient education to harmonize technological advancements with patient-centered care principles.

Assessing Public Knowledge and Acceptance of Using Artificial Intelligence Doctors as a Partial Alternative to Human Doctors in Saudi Arabia: A Cross-Sectional Study

Objective To assess the public acceptance of using artificial intelligence (AI) doctors to diagnose and treat patients as a partial alternative to human physicians in Saudi Arabia. Methodology An observational cross-sectional study was conducted from January to March 2024. A link to an online questionnaire was distributed through social media applications to citizens and residents aged 18 years and older across various regions in Saudi Arabia. The sample size was calculated using the Raosoft online survey size calculator, which estimated that the minimum sample size should be 385. Results Of the 386 participants surveyed, 85.8% reported being aware of AI, and 47.9% reported having some knowledge about different AI fields in daily life. However, almost one-third (32.9%) reported a lack of knowledge about the use of AI in healthcare. In terms of acceptance, 52.3% of respondents indicated they felt comfortable with the use of AI tools as partial alternatives to human doctors, and 30.8% believed AI is useful in the field of health. The most common concern (63.7%) about the use of AI tools accessible to patients was the difficulty of describing symptoms using these tools. Conclusion The findings of this study provide valuable insights into the public's knowledge and acceptance of AI in medicine within the Saudi Arabian context. Overall, this study underscores the importance of proactively addressing the public's concerns and knowledge gaps regarding AI in healthcare. By fostering greater understanding and acceptance, healthcare stakeholders can better harness the potential of AI to improve patient outcomes and enhance the efficiency of medical services in Saudi Arabia.

Facilitating public involvement in research about healthcare AI: A scoping review of empirical methods

OBJECTIVE

With the recent increase in research into public views on healthcare artificial intelligence (HCAI), the objective of this review is to examine the methods of empirical studies on public views on HCAI. We map how studies provided participants with information about HCAI, and we examine the extent to which studies framed publics as active contributors to HCAI governance.

MATERIALS AND METHODS

We searched 5 academic databases and Google Advanced for empirical studies investigating public views on HCAI. We extracted information including study aims, research instruments, and recommendations.

RESULTS

Sixty-two studies were included. Most were quantitative (N = 42). Most (N = 47) reported providing participants with background information about HCAI. Despite this, studies often reported participants' lack of prior knowledge about HCAI as a limitation. Over three quarters (N = 48) of the studies made recommendations that envisaged public views being used to guide governance of AI.

DISCUSSION

Provision of background information is an important component of facilitating research with publics on HCAI. The high proportion of studies reporting participants' lack of knowledge about HCAI as a limitation reflects the need for more guidance on how information should be presented. A minority of studies adopted technocratic positions that construed publics as passive beneficiaries of AI, rather than as active stakeholders in HCAI design and implementation.

CONCLUSION

This review draws attention to how public roles in HCAI governance are constructed in empirical studies. To facilitate active participation, we recommend that research with publics on HCAI consider methodological designs that expose participants to diverse information sources.

Transformer-based framework for multi-class segmentation of skin cancer from histopathology images

Introduction

Non-melanoma skin cancer comprising Basal cell carcinoma (BCC), Squamous cell carcinoma (SCC), and Intraepidermal carcinoma (IEC) has the highest incidence rate among skin cancers. Intelligent decision support systems may address the issue of the limited number of subject experts and help in mitigating the parity of health services between urban centers and remote areas.

Method

In this research, we propose a transformer-based model for the segmentation of histopathology images not only into inflammation and cancers such as BCC, SCC, and IEC but also to identify skin tissues and boundaries that are important in decision-making. Accurate segmentation of these tissue types will eventually lead to accurate detection and classification of non-melanoma skin cancer. The segmentation according to tissue types and their visual representation before classification enhances the trust of pathologists and doctors being relatable to how most pathologists approach this problem. The visualization of the confidence of the model in its prediction through uncertainty maps is also what distinguishes this study from most deep learning methods.

Results

The evaluation of proposed system is carried out using publicly available dataset. The application of our proposed segmentation system demonstrated good performance with an F1 score of 0.908, mean intersection over union (mIoU) of 0.653, and average accuracy of 83.1%, advocating that the system can be used as a decision support system successfully and has the potential of subsequently maturing into a fully automated system.

Discussion

This study is an attempt to automate the segmentation of the most occurring non-melanoma skin cancer using a transformer-based deep learning technique applied to histopathology skin images. Highly accurate segmentation and visual representation of histopathology images according to tissue types by the proposed system implies that the system can be used for skin-related routine pathology tasks including cancer and other anomaly detection, their classification, and measurement of surgical margins in the case of cancer cases.

Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust

The rapid advancement of artificial intelligence (AI) has impacted society in many aspects. Alongside this progress, concerns such as privacy violation, discriminatory bias, and safety risks have also surfaced, highlighting the need for the development of ethical, responsible, and socially beneficial AI. In response, the concept of trustworthy AI has gained prominence, and several guidelines for developing trustworthy AI have been proposed. Against this background, we demonstrate the significance of psychological research in identifying factors that contribute to the formation of trust in AI. Specifically, we review research findings on interpersonal, human-automation, and human-AI trust from the perspective of a three-dimension framework (i.e., the trustor, the trustee, and their interactive context). The framework synthesizes common factors related to trust formation and maintenance across different trust types. These factors point out the foundational requirements for building trustworthy AI and provide pivotal guidance for its development that also involves communication, education, and training for users. We conclude by discussing how the insights in trust research can help enhance AI's trustworthiness and foster its adoption and application.

Comparing preferences for skin cancer screening: AI-enabled app vs dermatologist

BACKGROUND AND AIM

Skin cancer is a major public health issue. While self-examinations and professional screenings are recommended, they are rarely performed. Mobile health (mHealth) apps utilising artificial intelligence (AI) for skin cancer screening offer a potential solution to aid self-examinations; however, their uptake is low. Therefore, the aim of this research was to examine provider and user characteristics influencing people's decisions to seek skin cancer screening performed by a mHealth app or a dermatologist.

METHODS

Two forced-choice conjoint experiments with Nmain = 1591 and Nreplication = 308 participants from the United States were conducted online to investigate preferences for screening providers. In addition to the provider type (mHealth app vs dermatologist), the following provider attributes were manipulated: costs, expertise, privacy policy, and result details. Subsequently, a questionnaire assessed various user characteristics, including demographics, attitudes toward AI technology and medical mistrust.

RESULTS

Outcomes were consistent across the two studies. The provider type was the most influential factor, with the dermatologist being selected more often than the mHealth app. Cost, expertise, and privacy policy also significantly impacted decisions. Demographic subgroup analyses showed rather consistent preference trends across various age, gender, and ethnicity groups. Individuals with greater medical mistrust were more inclined to choose the mHealth app. Trust, accuracy, and quality ratings were higher for the dermatologist, whether selected or not.

CONCLUSION

Our results offer valuable insights for technology developers, healthcare providers, and policymakers, contributing to unlocking the potential of skin cancer screening apps in bridging healthcare gaps in underserved communities.

Performance of Commercial Dermatoscopic Systems That Incorporate Artificial Intelligence for the Identification of Melanoma in General Practice: A Systematic Review

BACKGROUND

Cutaneous melanoma remains an increasing global public health burden, particularly in fair-skinned populations. Advancing technologies, particularly artificial intelligence (AI), may provide an additional tool for clinicians to help detect malignancies with a more accurate success rate. This systematic review aimed to report the performance metrics of commercially available convolutional neural networks (CNNs) tasked with detecting MM.

METHODS

A systematic literature search was performed using CINAHL, Medline, Scopus, ScienceDirect and Web of Science databases.

RESULTS

A total of 16 articles reporting MM were included in this review. The combined number of melanomas detected was 1160, and non-melanoma lesions were 33,010. The performance of market-approved technology and clinician performance for classifying melanoma was highly heterogeneous, with sensitivity ranging from 16.4 to 100.0%, specificity between 40.0 and 98.3% and accuracy between 44.0 and 92.0%. Less heterogeneity was observed when clinicians worked in unison with AI, with sensitivity ranging between 83.3 and 100.0%, specificity between 83.7 and 87.3%, and accuracy between 86.4 and 86.9%.

CONCLUSION

Instead of focusing on the performance of AI versus clinicians for classifying melanoma, more consistent performance has been obtained when clinicians' work is supported by AI, facilitating management decisions and improving health outcomes.

Patient Perspectives on the Use of Artificial Intelligence in Health Care: A Scoping Review

Purpose

Artificial intelligence (AI) technology is being rapidly adopted into many different branches of medicine. Although research has started to highlight the impact of AI on health care, the focus on patient perspectives of AI is scarce. This scoping review aimed to explore the literature on adult patients' perspectives on the use of an array of AI technologies in the health care setting for design and deployment.

Methods

This scoping review followed Arksey and O'Malley's framework and Preferred Reporting Items for Systematic Reviews and Meta-Analysis for Scoping Reviews (PRISMA-ScR). To evaluate patient perspectives, we conducted a comprehensive literature search using eight interdisciplinary electronic databases, including grey literature. Articles published from 2015 to 2022 that focused on patient views regarding AI technology in health care were included. Thematic analysis was performed on the extracted articles.

Results

Of the 10,571 imported studies, 37 articles were included and extracted. From the 33 peer-reviewed and 4 grey literature articles, the following themes on AI emerged: (i) Patient attitudes, (ii) Influences on patient attitudes, (iii) Considerations for design, and (iv) Considerations for use.

Conclusions

Patients are key stakeholders essential to the uptake of AI in health care. The findings indicate that patients' needs and expectations are not fully considered in the application of AI in health care. Therefore, there is a need for patient voices in the development of AI in health care.

Choosing human over AI doctors? How comparative trust associations and knowledge relate to risk and benefit perceptions of AI in healthcare

The development of artificial intelligence (AI) in healthcare is accelerating rapidly. Beyond the urge for technological optimization, public perceptions and preferences regarding the application of such technologies remain poorly understood. Risk and benefit perceptions of novel technologies are key drivers for successful implementation. Therefore, it is crucial to understand the factors that condition these perceptions. In this study, we draw on the risk perception and human-AI interaction literature to examine how explicit (i.e., deliberate) and implicit (i.e., automatic) comparative trust associations with AI versus physicians, and knowledge about AI, relate to likelihood perceptions of risks and benefits of AI in healthcare and preferences for the integration of AI in healthcare. We use survey data (N = 378) to specify a path model. Results reveal that the path for implicit comparative trust associations on relative preferences for AI over physicians is only significant through risk, but not through benefit perceptions. This finding is reversed for AI knowledge. Explicit comparative trust associations relate to AI preference through risk and benefit perceptions. These findings indicate that risk perceptions of AI in healthcare might be driven more strongly by affect-laden factors than benefit perceptions, which in turn might depend more on reflective cognition. Implications of our findings and directions for future research are discussed considering the conceptualization of trust as heuristic and dual-process theories of judgment and decision-making. Regarding the design and implementation of AI-based healthcare technologies, our findings suggest that a holistic integration of public viewpoints is warranted.

Federated Learning for Decentralized Artificial Intelligence in Melanoma Diagnostics

Importance

The development of artificial intelligence (AI)-based melanoma classifiers typically calls for large, centralized datasets, requiring hospitals to give away their patient data, which raises serious privacy concerns. To address this concern, decentralized federated learning has been proposed, where classifier development is distributed across hospitals.

Objective

To investigate whether a more privacy-preserving federated learning approach can achieve comparable diagnostic performance to a classical centralized (ie, single-model) and ensemble learning approach for AI-based melanoma diagnostics.

Design, Setting, and Participants

This multicentric, single-arm diagnostic study developed a federated model for melanoma-nevus classification using histopathological whole-slide images prospectively acquired at 6 German university hospitals between April 2021 and February 2023 and benchmarked it using both a holdout and an external test dataset. Data analysis was performed from February to April 2023.

Exposures

All whole-slide images were retrospectively analyzed by an AI-based classifier without influencing routine clinical care.

Main Outcomes and Measures

The area under the receiver operating characteristic curve (AUROC) served as the primary end point for evaluating the diagnostic performance. Secondary end points included balanced accuracy, sensitivity, and specificity.

Results

The study included 1025 whole-slide images of clinically melanoma-suspicious skin lesions from 923 patients, consisting of 388 histopathologically confirmed invasive melanomas and 637 nevi. The median (range) age at diagnosis was 58 (18-95) years for the training set, 57 (18-93) years for the holdout test dataset, and 61 (18-95) years for the external test dataset; the median (range) Breslow thickness was 0.70 (0.10-34.00) mm, 0.70 (0.20-14.40) mm, and 0.80 (0.30-20.00) mm, respectively. The federated approach (0.8579; 95% CI, 0.7693-0.9299) performed significantly worse than the classical centralized approach (0.9024; 95% CI, 0.8379-0.9565) in terms of AUROC on a holdout test dataset (pairwise Wilcoxon signed-rank, P < .001) but performed significantly better (0.9126; 95% CI, 0.8810-0.9412) than the classical centralized approach (0.9045; 95% CI, 0.8701-0.9331) on an external test dataset (pairwise Wilcoxon signed-rank, P < .001). Notably, the federated approach performed significantly worse than the ensemble approach on both the holdout (0.8867; 95% CI, 0.8103-0.9481) and external test dataset (0.9227; 95% CI, 0.8941-0.9479).

Conclusions and Relevance

The findings of this diagnostic study suggest that federated learning is a viable approach for the binary classification of invasive melanomas and nevi on a clinically representative distributed dataset. Federated learning can improve privacy protection in AI-based melanoma diagnostics while simultaneously promoting collaboration across institutions and countries. Moreover, it may have the potential to be extended to other image classification tasks in digital cancer histopathology and beyond.

Basic principles of artificial intelligence in dermatology explained using melanoma

The use of artificial intelligence (AI) continues to establish itself in the most diverse areas of medicine at an increasingly fast pace. Nevertheless, many healthcare professionals lack the basic technical understanding of how this technology works, which severely limits its application in clinical settings and research. Thus, we would like to discuss the functioning and classification of AI using melanoma as an example in this review to build an understanding of the technology behind AI. For this purpose, elaborate illustrations are used that quickly reveal the technology involved. Previous reviews tend to focus on the potential applications of AI, thereby missing the opportunity to develop a deeper understanding of the subject matter that is so important for clinical application. Malignant melanoma has become a significant burden for healthcare systems. If discovered early, a better prognosis can be expected, which is why skin cancer screening has become increasingly popular and is supported by health insurance. The number of experts remains finite, reducing their availability and leading to longer waiting times. Therefore, innovative ideas need to be implemented to provide the necessary care. Thus, machine learning offers the ability to recognize melanomas from images at a level comparable to experienced dermatologists under optimized conditions.

Grundprinzipien der künstlichen Intelligenz in der Dermatologie erklärt am Beispiel des Melanoms

Der Einsatz von künstlicher Intelligenz (KI) setzt sich in den verschiedensten Bereichen der Medizin immer schneller durch. Dennoch fehlt vielen medizinischen Kollegen das technische Grundverständnis für die Funktionsweise dieser Technologie, was ihre Anwendung in Klinik und Forschung stark einschränkt. Daher möchten wir in dieser Übersichtsarbeit die Funktionsweise und Klassifizierung der KI am Beispiel des Melanoms erörtern, um ein Verständnis für die Technologie hinter der KI zu schaffen. Dazu werden ausführliche Illustrationen verwendet, die die Technologie schnell erklären. Bisherige Übersichten konzentrieren sich eher auf die potenziellen Anwendungen der KI und verpassen die Gelegenheit, ein tieferes Verständnis für die Materie herauszuarbeiten, das für die klinische Anwendung so wichtig ist. Das maligne Melanom ist zu einer erheblichen Belastung für die Gesundheitssysteme geworden. Bei frühzeitiger Entdeckung ist eine bessere Prognose zu erwarten, weshalb das Hautkrebs‐Screening immer populärer und von den Krankenkassen unterstützt wird. Die Zahl der Fachärzte ist jedoch begrenzt, was ihre Verfügbarkeit einschränkt und zu längeren Wartezeiten führt. Daher müssen innovative Ideen umgesetzt werden, um die notwendige Versorgung zu gewährleisten. Das maschinelle Lernen bietet die Möglichkeit, Melanome auf Bildern zu erkennen, und zwar auf einem Niveau, das mit dem von erfahrenen Dermatologen – unter optimierten Bedingungen – vergleichbar ist.

Trust and acceptability of data-driven clinical recommendations in everyday practice: A scoping review

BACKGROUND

Increasing attention is being given to the analysis of large health datasets to derive new clinical decision support systems (CDSS). However, few data-driven CDSS are being adopted into clinical practice. Trust in these tools is believed to be fundamental for acceptance and uptake but to date little attention has been given to defining or evaluating trust in clinical settings.

OBJECTIVES

A scoping review was conducted to explore how and where acceptability and trustworthiness of data-driven CDSS have been assessed from the health professional's perspective.

METHODS

Medline, Embase, PsycInfo, Web of Science, Scopus, ACM Digital, IEEE Xplore and Google Scholar were searched in March 2022 using terms expanded from: "data-driven" AND "clinical decision support" AND "acceptability". Included studies focused on healthcare practitioner-facing data-driven CDSS, relating directly to clinical care. They included trust or a proxy as an outcome, or in the discussion. The preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews (PRISMA-ScR) is followed in the reporting of this review.

RESULTS

3291 papers were screened, with 85 primary research studies eligible for inclusion. Studies covered a diverse range of clinical specialisms and intended contexts, but hypothetical systems (24) outnumbered those in clinical use (18). Twenty-five studies measured trust, via a wide variety of quantitative, qualitative and mixed methods. A further 24 discussed themes of trust without it being explicitly evaluated, and from these, themes of transparency, explainability, and supporting evidence were identified as factors influencing healthcare practitioner trust in data-driven CDSS.

CONCLUSION

There is a growing body of research on data-driven CDSS, but few studies have explored stakeholder perceptions in depth, with limited focused research on trustworthiness. Further research on healthcare practitioner acceptance, including requirements for transparency and explainability, should inform clinical implementation.

An efficient multi-class classification of skin cancer using optimized vision transformer

Skin cancer is a pervasive and deadly disease, prompting a surge in research efforts towards utilizing computer-based techniques to analyze skin lesion images to identify malignancies. This paper introduces an optimized vision transformer approach for effectively classifying skin tumors. The methodology begins with a pre-processing step aimed at preserving color constancy, eliminating hair artifacts, and reducing image noise. Here, a combination of techniques such as piecewise linear bottom hat filtering, adaptive median filtering, Gaussian filtering, and an enhanced gradient intensity method is used for pre-processing. Afterwards, the segmentation phase is initiated using the self-sparse watershed algorithm on the pre-processed image. Subsequently, the segmented image is passed through a feature extraction stage where the hybrid Walsh-Hadamard Karhunen-Loeve expansion technique is employed. The final step involves the application of an improved vision transformer for skin cancer classification. The entire methodology is implemented using the Python programming language, and the International Skin Imaging Collaboration (ISIC) 2019 database is utilized for experimentation. The experimental results demonstrate remarkable performance with the different performance metrics is accuracy 99.81%, precision 96.65%, sensitivity 98.21%, F-measure 97.42%, specificity 99.88%, recall 98.21%, Jaccard coefficient 98.54%, and Mathew's correlation coefficient (MCC) 98.89%. The proposed methodology outperforms the existing methodology.

Acceptance of Medical Artificial Intelligence in Skin Cancer Screening: Choice-Based Conjoint Survey

BACKGROUND

There is great interest in using artificial intelligence (AI) to screen for skin cancer. This is fueled by a rising incidence of skin cancer and an increasing scarcity of trained dermatologists. AI systems capable of identifying melanoma could save lives, enable immediate access to screenings, and reduce unnecessary care and health care costs. While such AI-based systems are useful from a public health perspective, past research has shown that individual patients are very hesitant about being examined by an AI system.

OBJECTIVE

The aim of this study was two-fold: (1) to determine the relative importance of the provider (in-person physician, physician via teledermatology, AI, personalized AI), costs of screening (free, 10€, 25€, 40€; 1€=US $1.09), and waiting time (immediate, 1 day, 1 week, 4 weeks) as attributes contributing to patients' choices of a particular mode of skin cancer screening; and (2) to investigate whether sociodemographic characteristics, especially age, were systematically related to participants' individual choices.

METHODS

A choice-based conjoint analysis was used to examine the acceptance of medical AI for a skin cancer screening from the patient's perspective. Participants responded to 12 choice sets, each containing three screening variants, where each variant was described through the attributes of provider, costs, and waiting time. Furthermore, the impacts of sociodemographic characteristics (age, gender, income, job status, and educational background) on the choices were assessed.

RESULTS

Among the 383 clicks on the survey link, a total of 126 (32.9%) respondents completed the online survey. The conjoint analysis showed that the three attributes had more or less equal importance in contributing to the participants' choices, with provider being the most important attribute. Inspecting the individual part-worths of conjoint attributes showed that treatment by a physician was the most preferred modality, followed by electronic consultation with a physician and personalized AI; the lowest scores were found for the three AI levels. Concerning the relationship between sociodemographic characteristics and relative importance, only age showed a significant positive association to the importance of the attribute provider (r=0.21, P=.02), in which younger participants put less importance on the provider than older participants. All other correlations were not significant.

CONCLUSIONS

This study adds to the growing body of research using choice-based experiments to investigate the acceptance of AI in health contexts. Future studies are needed to explore the reasons why AI is accepted or rejected and whether sociodemographic characteristics are associated with this decision.

Patient perspectives on informed consent for medical AI: A web-based experiment

Objective

Despite the increasing use of AI applications as a clinical decision support tool in healthcare, patients are often unaware of their use in the physician's decision-making process. This study aims to determine whether doctors should disclose the use of AI tools in diagnosis and what kind of information should be provided.

Methods

A survey experiment with 1000 respondents in South Korea was conducted to estimate the patients' perceived importance of information regarding the use of an AI tool in diagnosis in deciding whether to receive the treatment.

Results

The study found that the use of an AI tool increases the perceived importance of information related to its use, compared with when a physician consults with a human radiologist. Information regarding the AI tool when AI is used was perceived by participants either as more important than or similar to the regularly disclosed information regarding short-term effects when AI is not used. Further analysis revealed that gender, age, and income have a statistically significant effect on the perceived importance of every piece of AI information.

Conclusions

This study supports the disclosure of AI use in diagnosis during the informed consent process. However, the disclosure should be tailored to the individual patient's needs, as patient preferences for information regarding AI use vary across gender, age and income levels. It is recommended that ethical guidelines be developed for informed consent when using AI in diagnoses that go beyond mere legal requirements.

Applications of natural language processing at emergency department triage: A narrative review

INTRODUCTION

Natural language processing (NLP) uses various computational methods to analyse and understand human language, and has been applied to data acquired at Emergency Department (ED) triage to predict various outcomes. The objective of this scoping review is to evaluate how NLP has been applied to data acquired at ED triage, assess if NLP based models outperform humans or current risk stratification techniques when predicting outcomes, and assess if incorporating free-text improve predictive performance of models when compared to predictive models that use only structured data.

METHODS

All English language peer-reviewed research that applied an NLP technique to free-text obtained at ED triage was eligible for inclusion. We excluded studies focusing solely on disease surveillance, and studies that used information obtained after triage. We searched the electronic databases MEDLINE, Embase, Cochrane Database of Systematic Reviews, Web of Science, and Scopus for medical subject headings and text keywords related to NLP and triage. Databases were last searched on 01/01/2022. Risk of bias in studies was assessed using the Prediction model Risk of Bias Assessment Tool (PROBAST). Due to the high level of heterogeneity between studies and high risk of bias, a metanalysis was not conducted. Instead, a narrative synthesis is provided.

RESULTS

In total, 3730 studies were screened, and 20 studies were included. The population size varied greatly between studies ranging from 1.8 million patients to 598 triage notes. The most common outcomes assessed were prediction of triage score, prediction of admission, and prediction of critical illness. NLP models achieved high accuracy in predicting need for admission, triage score, critical illness, and mapping free-text chief complaints to structured fields. Incorporating both structured data and free-text data improved results when compared to models that used only structured data. However, the majority of studies (80%) were assessed to have a high risk of bias, and only one study reported the deployment of an NLP model into clinical practice.

CONCLUSION

Unstructured free-text triage notes have been used by NLP models to predict clinically relevant outcomes. However, the majority of studies have a high risk of bias, most research is retrospective, and there are few examples of implementation into clinical practice. Future work is needed to prospectively assess if applying NLP to data acquired at ED triage improves ED outcomes when compared to usual clinical practice.

Multi-stakeholder preferences for the use of artificial intelligence in healthcare: A systematic review and thematic analysis

INTRODUCTION

Despite the proliferation of Artificial Intelligence (AI) technology over the last decade, clinician, patient, and public perceptions of its use in healthcare raise a number of ethical, legal and social questions. We systematically review the literature on attitudes towards the use of AI in healthcare from patients, the general public and health professionals' perspectives to understand these issues from multiple perspectives.

METHODOLOGY

A search for original research articles using qualitative, quantitative, and mixed methods published between 1 Jan 2001 to 24 Aug 2021 was conducted on six bibliographic databases. Data were extracted and classified into different themes representing views on: (i) knowledge and familiarity of AI, (ii) AI benefits, risks, and challenges, (iii) AI acceptability, (iv) AI development, (v) AI implementation, (vi) AI regulations, and (vii) Human - AI relationship.

RESULTS

The final search identified 7,490 different records of which 105 publications were selected based on predefined inclusion/exclusion criteria. While the majority of patients, the general public and health professionals generally had a positive attitude towards the use of AI in healthcare, all groups indicated some perceived risks and challenges. Commonly perceived risks included data privacy; reduced professional autonomy; algorithmic bias; healthcare inequities; and greater burnout to acquire AI-related skills. While patients had mixed opinions on whether healthcare workers suffer from job loss due to the use of AI, health professionals strongly indicated that AI would not be able to completely replace them in their professions. Both groups shared similar doubts about AI's ability to deliver empathic care. The need for AI validation, transparency, explainability, and patient and clinical involvement in the development of AI was emphasised. To help successfully implement AI in health care, most participants envisioned that an investment in training and education campaigns was necessary, especially for health professionals. Lack of familiarity, lack of trust, and regulatory uncertainties were identified as factors hindering AI implementation. Regarding AI regulations, key themes included data access and data privacy. While the general public and patients exhibited a willingness to share anonymised data for AI development, there remained concerns about sharing data with insurance or technology companies. One key domain under this theme was the question of who should be held accountable in the case of adverse events arising from using AI.

CONCLUSIONS

While overall positivity persists in attitudes and preferences toward AI use in healthcare, some prevalent problems require more attention. There is a need to go beyond addressing algorithm-related issues to look at the translation of legislation and guidelines into practice to ensure fairness, accountability, transparency, and ethics in AI.

Understanding patient views and acceptability of predictive software in osteoporosis identification

INTRODUCTION

Research into patient and public views on predictive software and its use in healthcare is relatively new. This study aimed to understand older adults' acceptability of an opportunistic bone density assessment for osteoporosis diagnosis (IBEX BH), views on its integration into healthcare, and views on predictive software and AI in healthcare.

METHODS

Focus groups were conducted with participants aged over 50 years, based in South West England. Data were analysed using thematic analysis. Analysis was informed by the theoretical framework of acceptability.

RESULTS

Two focus groups were undertaken with a total of 14 participants. Overall, the participants were generally positive about the IBEX BH software, and predictive software's in general stating 'it sounds like a brilliant idea'. Although participants did not understand the intricacies of the software, they did not feel they needed to. Concerns about IBEX BH focussed more on the clinical indications of the software (e.g. more scans or medications), with participants expressing less trust in results if they indicated medication. Questions were also raised about how and who would receive the results of this software. Individual choice was evident in these discussions, however most indicated the preferences for spoken communication 'But I would expect that these results would be given by a human to another human.'

CONCLUSIONS

Focus group participants were generally accepting of the use of predictive software in healthcare.

IMPLICATIONS FOR PRACTICE

Thought and care needs to be taken when integrating predictive software into practice. Focusses on empowering patients, providing information on processes and results are key.

Perspectives on artificial intelligence in healthcare from a Patient and Public Involvement Panel in Japan: an exploratory study

Patients and members of the public are the end users of healthcare, but little is known about their views on the use of artificial intelligence (AI) in healthcare, particularly in the Japanese context. This paper reports on an exploratory two-part workshop conducted with members of a Patient and Public Involvement Panel in Japan, which was designed to identify their expectations and concerns about the use of AI in healthcare broadly. 55 expectations and 52 concerns were elicited from workshop participants, who were then asked to cluster and title these expectations and concerns. Thematic content analysis was used to identify 12 major themes from this data. Participants had notable expectations around improved hospital administration, improved quality of care and patient experience, and positive changes in roles and relationships, and reductions in costs and disparities. These were counterbalanced by concerns about problematic changes to healthcare and a potential loss of autonomy, as well as risks around accountability and data management, and the possible emergence of new disparities. The findings reflect participants' expectations for AI as a possible solution for long-standing issues in healthcare, though their overall balanced view of AI mirrors findings reported in other contexts. Thus, this paper offers initial, novel insights into perspectives on AI in healthcare from the Japanese context. Moreover, the findings are used to argue for the importance of involving patient and public stakeholders in deliberation on AI in healthcare.

Perceptions of Artificial Intelligence-Assisted Care for Children With a Respiratory Complaint

OBJECTIVES

To evaluate caregiver opinions on the use of artificial intelligence (AI)-assisted medical decision-making for children with a respiratory complaint in the emergency department (ED).

METHODS

We surveyed a sample of caregivers of children presenting to a pediatric ED with a respiratory complaint. We assessed caregiver opinions with respect to AI, defined as "specialized computer programs" that "help make decisions about the best way to care for children." We performed multivariable logistic regression to identify factors associated with discomfort with AI-assisted decision-making.

RESULTS

Of 279 caregivers who were approached, 254 (91.0%) participated. Most indicated they would want to know if AI was being used for their child's health care (93.5%) and were extremely or somewhat comfortable with the use of AI in deciding the need for blood (87.9%) and viral testing (87.6%), interpreting chest radiography (84.6%), and determining need for hospitalization (78.9%). In multivariable analysis, caregiver age of 30 to 37 years (adjusted odds ratio [aOR] 3.67, 95% confidence interval [CI] 1.43-9.38; relative to 18-29 years) and a diagnosis of bronchospasm (aOR 5.77, 95% CI 1.24-30.28 relative to asthma) were associated with greater discomfort with AI. Caregivers with children being admitted to the hospital (aOR 0.23, 95% CI 0.09-0.50) had less discomfort with AI.

CONCLUSIONS

Caregivers were receptive toward the use of AI-assisted decision-making. Some subgroups (caregivers aged 30-37 years with children discharged from the ED) demonstrated greater discomfort with AI. Engaging with these subgroups should be considered when developing AI applications for acute care.

Explainability agreement between dermatologists and five visual explanations techniques in deep neural networks for melanoma AI classification

Introduction

The use of deep convolutional neural networks for analyzing skin lesion images has shown promising results. The identification of skin cancer by faster and less expensive means can lead to an early diagnosis, saving lives and avoiding treatment costs. However, to implement this technology in a clinical context, it is important for specialists to understand why a certain model makes a prediction; it must be explainable. Explainability techniques can be used to highlight the patterns of interest for a prediction.

Methods

Our goal was to test five different techniques: Grad-CAM, Grad-CAM++, Score-CAM, Eigen-CAM, and LIME, to analyze the agreement rate between features highlighted by the visual explanation maps to 3 important clinical criteria for melanoma classification: asymmetry, border irregularity, and color heterogeneity (ABC rule) in 100 melanoma images. Two dermatologists scored the visual maps and the clinical images using a semi-quantitative scale, and the results were compared. They also ranked their preferable techniques.

Results

We found that the techniques had different agreement rates and acceptance. In the overall analysis, Grad-CAM showed the best total+partial agreement rate (93.6%), followed by LIME (89.8%), Grad-CAM++ (88.0%), Eigen-CAM (86.4%), and Score-CAM (84.6%). Dermatologists ranked their favorite options: Grad-CAM and Grad-CAM++, followed by Score-CAM, LIME, and Eigen-CAM.

Discussion

Saliency maps are one of the few methods that can be used for visual explanations. The evaluation of explainability with humans is ideal to assess the understanding and applicability of these methods. Our results demonstrated that there is a significant agreement between clinical features used by dermatologists to diagnose melanomas and visual explanation techniques, especially Grad-Cam.

Saliency-Enhanced Content-Based Image Retrieval for Diagnosis Support in Dermatology Consultation: Reader Study

BACKGROUND

Previous research studies have demonstrated that medical content image retrieval can play an important role by assisting dermatologists in skin lesion diagnosis. However, current state-of-the-art approaches have not been adopted in routine consultation, partly due to the lack of interpretability limiting trust by clinical users.

OBJECTIVE

This study developed a new image retrieval architecture for polarized or dermoscopic imaging guided by interpretable saliency maps. This approach provides better feature extraction, leading to better quantitative retrieval performance as well as providing interpretability for an eventual real-world implementation.

METHODS

Content-based image retrieval (CBIR) algorithms rely on the comparison of image features embedded by convolutional neural network (CNN) against a labeled data set. Saliency maps are computer vision-interpretable methods that highlight the most relevant regions for the prediction made by a neural network. By introducing a fine-tuning stage that includes saliency maps to guide feature extraction, the accuracy of image retrieval is optimized. We refer to this approach as saliency-enhanced CBIR (SE-CBIR). A reader study was designed at the University Hospital Zurich Dermatology Clinic to evaluate SE-CBIR's retrieval accuracy as well as the impact of the participant's confidence on the diagnosis.

RESULTS

SE-CBIR improved the retrieval accuracy by 7% (77% vs 84%) when doing single-lesion retrieval against traditional CBIR. The reader study showed an overall increase in classification accuracy of 22% (62% vs 84%) when the participant is provided with SE-CBIR retrieved images. In addition, the overall confidence in the lesion's diagnosis increased by 24%. Finally, the use of SE-CBIR as a support tool helped the participants reduce the number of nonmelanoma lesions previously diagnosed as melanoma (overdiagnosis) by 53%.

CONCLUSIONS

SE-CBIR presents better retrieval accuracy compared to traditional CBIR CNN-based approaches. Furthermore, we have shown how these support tools can help dermatologists and residents improve diagnosis accuracy and confidence. Additionally, by introducing interpretable methods, we should expect increased acceptance and use of these tools in routine consultation.

The ethics of advancing artificial intelligence in healthcare: analyzing ethical considerations for Japan's innovative AI hospital system

Public and private investments into developing digital health technologies-including artificial intelligence (AI)-are intensifying globally. Japan is a key case study given major governmental investments, in part through a Cross-Ministerial Strategic Innovation Promotion Program (SIP) for an "Innovative AI Hospital System." Yet, there has been little critical examination of the SIP Research Plan, particularly from an ethics approach. This paper reports on an analysis of the Plan to identify the extent to which it addressed ethical considerations set out in the World Health Organization's 2021 Guidance on the Ethics and Governance of Artificial Intelligence for Health. A coding framework was created based on the six ethical principles proposed in the Guidance and was used as the basis for a content analysis. 101 references to aspects of the framework were identified in the Plan, but attention to the ethical principles was found to be uneven, ranging from the strongest focus on the potential benefits of AI to healthcare professionals and patients (n = 44; Principle 2), to no consideration of the need for responsive or sustainable AI (n = 0; Principle 6). Ultimately, the findings show that the Plan reflects insufficient consideration of the ethical issues that arise from developing and implementing AI for healthcare purposes. This case study is used to argue that, given the ethical complexity of the use of digital health technologies, consideration of the full range of ethical concerns put forward by the WHO must urgently be made visible in future plans for AI in healthcare.

Transformer-Based Approach to Melanoma Detection

Melanoma is a malignant cancer type which develops when DNA damage occurs (mainly due to environmental factors such as ultraviolet rays). Often, melanoma results in intense and aggressive cell growth that, if not caught in time, can bring one toward death. Thus, early identification at the initial stage is fundamental to stopping the spread of cancer. In this paper, a ViT-based architecture able to classify melanoma versus non-cancerous lesions is presented. The proposed predictive model is trained and tested on public skin cancer data from the ISIC challenge, and the obtained results are highly promising. Different classifier configurations are considered and analyzed in order to find the most discriminating one. The best one reached an accuracy of 0.948, sensitivity of 0.928, specificity of 0.967, and AUROC of 0.948.

Assessment of Diagnostic Performance of Dermatologists Cooperating With a Convolutional Neural Network in a Prospective Clinical Study: Human With Machine

Importance

Studies suggest that convolutional neural networks (CNNs) perform equally to trained dermatologists in skin lesion classification tasks. Despite the approval of the first neural networks for clinical use, prospective studies demonstrating benefits of human with machine cooperation are lacking.

Objective

To assess whether dermatologists benefit from cooperation with a market-approved CNN in classifying melanocytic lesions.

Design, Setting, and Participants

In this prospective diagnostic 2-center study, dermatologists performed skin cancer screenings using naked-eye examination and dermoscopy. Dermatologists graded suspect melanocytic lesions by the probability of malignancy (range 0-1, threshold for malignancy ≥0.5) and indicated management decisions (no action, follow-up, excision). Next, dermoscopic images of suspect lesions were assessed by a market-approved CNN, Moleanalyzer Pro (FotoFinder Systems). The CNN malignancy scores (range 0-1, threshold for malignancy ≥0.5) were transferred to dermatologists with the request to re-evaluate lesions and revise initial decisions in consideration of CNN results. Reference diagnoses were based on histopathologic examination in 125 (54.8%) lesions or, in the case of nonexcised lesions, on clinical follow-up data and expert consensus. Data were collected from October 2020 to October 2021.

Main Outcomes and Measures

Primary outcome measures were diagnostic sensitivity and specificity of dermatologists alone and dermatologists cooperating with the CNN. Accuracy and receiver operator characteristic area under the curve (ROC AUC) were considered as additional measures.

Results

A total of 22 dermatologists detected 228 suspect melanocytic lesions (190 nevi, 38 melanomas) in 188 patients (mean [range] age, 53.4 [19-91] years; 97 [51.6%] male patients). Diagnostic sensitivity and specificity significantly improved when dermatologists additionally integrated CNN results into decision-making (mean sensitivity from 84.2% [95% CI, 69.6%-92.6%] to 100.0% [95% CI, 90.8%-100.0%]; P = .03; mean specificity from 72.1% [95% CI, 65.3%-78.0%] to 83.7% [95% CI, 77.8%-88.3%]; P < .001; mean accuracy from 74.1% [95% CI, 68.1%-79.4%] to 86.4% [95% CI, 81.3%-90.3%]; P < .001; and mean ROC AUC from 0.895 [95% CI, 0.836-0.954] to 0.968 [95% CI, 0.948-0.988]; P = .005). In addition, the CNN alone achieved a comparable sensitivity, higher specificity, and higher diagnostic accuracy compared with dermatologists alone in classifying melanocytic lesions. Moreover, unnecessary excisions of benign nevi were reduced by 19.2%, from 104 (54.7%) of 190 benign nevi to 84 nevi when dermatologists cooperated with the CNN (P < .001). Most lesions were examined by dermatologists with 2 to 5 years (96, 42.1%) or less than 2 years of experience (78, 34.2%); others (54, 23.7%) were evaluated by dermatologists with more than 5 years of experience. Dermatologists with less dermoscopy experience cooperating with the CNN had the most diagnostic improvement compared with more experienced dermatologists.

Conclusions and Relevance

In this prospective diagnostic study, these findings suggest that dermatologists may improve their performance when they cooperate with the market-approved CNN and that a broader application of this human with machine approach could be beneficial for dermatologists and patients.

Perspectives of Youths on the Ethical Use of Artificial Intelligence in Health Care Research and Clinical Care

Importance

Understanding the views and values of patients is of substantial importance to developing the ethical parameters of artificial intelligence (AI) use in medicine. Thus far, there is limited study on the views of children and youths. Their perspectives contribute meaningfully to the integration of AI in medicine.

Objective

To explore the moral attitudes and views of children and youths regarding research and clinical care involving health AI at the point of care.

Design, Setting, and Participants

This qualitative study recruited participants younger than 18 years during a 1-year period (October 2021 to March 2022) at a large urban pediatric hospital. A total of 44 individuals who were receiving or had previously received care at a hospital or rehabilitation clinic contacted the research team, but 15 were found to be ineligible. Of the 29 who consented to participate, 1 was lost to follow-up, resulting in 28 participants who completed the interview.

Exposures

Participants were interviewed using vignettes on 3 main themes: (1) health data research, (2) clinical AI trials, and (3) clinical use of AI.

Main Outcomes and Measures

Thematic description of values surrounding health data research, interventional AI research, and clinical use of AI.

Results

The 28 participants included 6 children (ages, 10-12 years) and 22 youths (ages, 13-17 years) (16 female, 10 male, and 3 trans/nonbinary/gender diverse). Mean (SD) age was 15 (2) years. Participants were highly engaged and quite knowledgeable about AI. They expressed a positive view of research intended to help others and had strong feelings about the uses of their health data for AI. Participants expressed appreciation for the vulnerability of potential participants in interventional AI trials and reinforced the importance of respect for their preferences regardless of their decisional capacity. A strong theme for the prospective use of clinical AI was the desire to maintain bedside interaction between the patient and their physician.

Conclusions and Relevance

In this study, children and youths reported generally positive views of AI, expressing strong interest and advocacy for their involvement in AI research and inclusion of their voices for shared decision-making with AI in clinical care. These findings suggest the need for more engagement of children and youths in health care AI research and integration.

Preparing for an Artificial Intelligence-Enabled Future: Patient Perspectives on Engagement and Health Care Professional Training for Adopting Artificial Intelligence Technologies in Health Care Settings

BACKGROUND

As new technologies emerge, there is a significant shift in the way care is delivered on a global scale. Artificial intelligence (AI) technologies have been rapidly and inexorably used to optimize patient outcomes, reduce health system costs, improve workflow efficiency, and enhance population health. Despite the widespread adoption of AI technologies, the literature on patient engagement and their perspectives on how AI will affect clinical care is scarce. Minimal patient engagement can limit the optimization of these novel technologies and contribute to suboptimal use in care settings.

OBJECTIVE

We aimed to explore patients' views on what skills they believe health care professionals should have in preparation for this AI-enabled future and how we can better engage patients when adopting and deploying AI technologies in health care settings.

METHODS

Semistructured interviews were conducted from August 2020 to December 2021 with 12 individuals who were a patient in any Canadian health care setting. Interviews were conducted until thematic saturation occurred. A thematic analysis approach outlined by Braun and Clarke was used to inductively analyze the data and identify overarching themes.

RESULTS

Among the 12 patients interviewed, 8 (67%) were from urban settings and 4 (33%) were from rural settings. A majority of the participants were very comfortable with technology (n=6, 50%) and somewhat familiar with AI (n=7, 58%). In total, 3 themes emerged: cultivating patients' trust, fostering patient engagement, and establishing data governance and validation of AI technologies.

CONCLUSIONS

With the rapid surge of AI solutions, there is a critical need to understand patient values in advancing the quality of care and contributing to an equitable health system. Our study demonstrated that health care professionals play a synergetic role in the future of AI and digital technologies. Patient engagement is vital in addressing underlying health inequities and fostering an optimal care experience. Future research is warranted to understand and capture the diverse perspectives of patients with various racial, ethnic, and socioeconomic backgrounds.

The Use of Artificial Intelligence in Clinical Care: A Values-Based Guide for Shared Decision Making

Clinical applications of artificial intelligence (AI) in healthcare, including in the field of oncology, have the potential to advance diagnosis and treatment. The literature suggests that patient values should be considered in decision making when using AI in clinical care; however, there is a lack of practical guidance for clinicians on how to approach these conversations and incorporate patient values into clinical decision making. We provide a practical, values-based guide for clinicians to assist in critical reflection and the incorporation of patient values into shared decision making when deciding to use AI in clinical care. Values that are relevant to patients, identified in the literature, include trust, privacy and confidentiality, non-maleficence, safety, accountability, beneficence, autonomy, transparency, compassion, equity, justice, and fairness. The guide offers questions for clinicians to consider when adopting the potential use of AI in their practice; explores illness understanding between the patient and clinician; encourages open dialogue of patient values; reviews all clinically appropriate options; and makes a shared decision of what option best meets the patient's values. The guide can be used for diverse clinical applications of AI.

Outlier detection in dermatology: Performance of different convolutional neural networks for binary classification of inflammatory skin diseases

BACKGROUND

Artificial intelligence (AI) and convolutional neural networks (CNNs) represent rising trends in modern medicine. However, comprehensive data on the performance of AI practices in clinical dermatologic images are non-existent. Furthermore, the role of professional data selection for training remains unknown.

OBJECTIVES

The aims of this study were to develop AI applications for outlier detection of dermatological pathologies, to evaluate CNN architectures' performance on dermatological images and to investigate the role of professional pre-processing of the training data, serving as one of the first anchor points regarding data selection criteria in dermatological AI-based binary classification tasks of non-melanoma pathologies.

METHODS

Six state-of-the-art CNN architectures were evaluated for their accuracy, sensitivity and specificity for five dermatological diseases and using five data subsets, including data selected by two dermatologists, one with 5 and the other with 11 years of clinical experience.

RESULTS

Overall, 150 CNNs were evaluated on up to 4051 clinical images. The best accuracy was reached for onychomycosis (accuracy = 1.000), followed by bullous pemphigoid (accuracy = 0.951) and lupus erythematosus (accuracy = 0.912). The CNNs InceptionV3, Xception and ResNet50 achieved the best accuracy in 9, 8 and 6 out of 25 data sets, respectively (36.0%, 32.0% and 24.0%). On average, the data set provided by the senior physician and the data set provided in accordance with both dermatologists performed the best (accuracy = 0.910).

CONCLUSIONS

This AI approach for the detection of outliers in dermatological diagnoses represents one of the first studies to evaluate the performance of different CNNs for binary decisions in clinical non-dermatoscopic images of a variety of dermatological diseases other than melanoma. The selection of images by an experienced dermatologist during pre-processing had substantial benefits for the performance of the CNNs. These comparative results might guide future AI approaches to dermatology diagnostics, and the evaluated CNNs might be applicable for the future training of dermatology residents.

Artificial intelligence-based clinical decision support in pediatrics

Machine learning models may be integrated into clinical decision support (CDS) systems to identify children at risk of specific diagnoses or clinical deterioration to provide evidence-based recommendations. This use of artificial intelligence models in clinical decision support (AI-CDS) may have several advantages over traditional "rule-based" CDS models in pediatric care through increased model accuracy, with fewer false alerts and missed patients. AI-CDS tools must be appropriately developed, provide insight into the rationale behind decisions, be seamlessly integrated into care pathways, be intuitive to use, answer clinically relevant questions, respect the content expertise of the healthcare provider, and be scientifically sound. While numerous machine learning models have been reported in pediatric care, their integration into AI-CDS remains incompletely realized to date. Important challenges in the application of AI models in pediatric care include the relatively lower rates of clinically significant outcomes compared to adults, and the lack of sufficiently large datasets available necessary for the development of machine learning models. In this review article, we summarize key concepts related to AI-CDS, its current application to pediatric care, and its potential benefits and risks. IMPACT: The performance of clinical decision support may be enhanced by the utilization of machine learning-based algorithms to improve the predictive performance of underlying models. Artificial intelligence-based clinical decision support (AI-CDS) uses models that are experientially improved through training and are particularly well suited toward high-dimensional data. The application of AI-CDS toward pediatric care remains limited currently but represents an important area of future research.

Parental Perceptions on Use of Artificial Intelligence in Pediatric Acute Care

BACKGROUND

Family engagement is critical in the implementation of artificial intelligence (AI)-based clinical decision support tools, which will play an increasing role in health care in the future. We sought to understand parental perceptions of computer-assisted health care of children in the emergency department (ED).

METHODS

We conducted a population-weighted household panel survey of parents with minor children in their home in a large US city to evaluate perceptions of the use of computer programs for the care of children with respiratory illness. We identified demographics associated with discomfort with AI using survey-weighted logistic regression.

RESULTS

Surveys were completed by 1620 parents (panel response rate = 49.7%). Most respondents were comfortable with the use of computer programs to determine the need for antibiotics (77.6%) or bloodwork (76.5%), and to interpret radiographs (77.5%). In multivariable analysis, Black non-Hispanic parents reported greater discomfort with AI relative to White non-Hispanic parents (odds ratio [OR] 1.67, 95% confidence interval [CI] 1.03-2.70) as did younger parents (18-25 years) relative to parents ≥46 years (OR 2.48, 95% CI 1.31-4.67). The greatest perceived benefits of computer programs were finding something a human would miss (64.2%, 95% CI 60.9%-67.4%) and obtaining a more rapid diagnosis (59.6%; 56.2%-62.9%). Areas of greatest concern were diagnostic errors (63.0%, 95% CI 59.6%-66.4%), and recommending incorrect treatment (58.9%, 95% CI 55.5%-62.3%).

CONCLUSIONS

Parents were generally receptive to computer-assisted management of children with respiratory illnesses in the ED, though reservations emerged. Black non-Hispanic and younger parents were more likely to express discomfort about AI.

[The Rise of Artificial Intelligence - High Prediction Accuracy in Early Detection of Pigmented Melanoma]

The incidence of malignant melanoma is increasing worldwide. If detected early, melanoma is highly treatable, so early detection is vital.Skin cancer early detection has improved significantly in recent decades, for example by the introduction of screening in 2008 and dermoscopy. Nevertheless, in particular visual detection of early melanomas remains challenging because they show many morphological overlaps with nevi. Hence, there continues to be a high medical need to further develop methods for early skin cancer detection in order to be able to reliably diagnosemelanomas at a very early stage.Routine diagnostics for melanoma detection include visual whole body inspection, often supplemented by dermoscopy, which can significantly increase the diagnostic accuracy of experienced dermatologists. A procedure that is additionally offered in some practices and clinics is wholebody photography combined with digital dermoscopy for the early detection of malignant melanoma, especially for monitoring high-risk patients.In recent decades, numerous noninvasive adjunctive diagnostic techniques were developed for the examination of suspicious pigmented moles, that may have the potential to allow improved and, in some cases, automated evaluation of these lesions. First, confocal laser microscopy should be mentioned here, as well as electrical impedance spectroscopy, multiphoton laser tomography, multispectral analysis, Raman spectroscopy or optical coherence tomography. These diagnostic techniques usually focus on high sensitivity to avoid malignant melanoma being overlooked. However, this usually implies lower specificity, which may lead to unnecessary excision of benign lesions in screening. Also, some of the procedures are time-consuming and costly, which also limits their applicability in skin cancer screening. In the near future, the use of artificial intelligence might change skin cancer diagnostics in many ways. The most promising approach may be the analysis of routine macroscopic and dermoscopic images by artificial intelligence.For the classification of pigmented skin lesions based on macroscopic and dermoscopic images, artificial intelligence, especially in form of neural networks, has achieved comparable diagnostic accuracies to dermatologists under experimental conditions in numerous studies. In particular, it achieved high accuracies in the binary melanoma/nevus classification task, but it also performed comparably well to dermatologists in multiclass differentiation of various skin diseases. However, proof of the basic applicability and utility of such systems in clinical practice is still pending. Prerequisites that remain to be established to enable translation of such diagnostic systems into dermatological routine are means that allow users to comprehend the system's decisions as well as a uniformly high performance of the algorithms on image data from other hospitals and practices.At present, hints are accumulating that computer-aided diagnosis systems could provide their greatest benefit as assistance systems, since studies indicate that a combination of human and machine achieves the best results. Diagnostic systems based on artificial intelligence are capable of detecting morphological characteristics quickly, quantitatively, objectively and reproducibly, and could thus provide a more objective analytical basis - in addition to medical experience.

Artificial intelligence in Dermatopathology

INTRODUCTION

Ever evolving research in medical field has reached an exciting stage with advent of newer technologies. With the introduction of digital microscopy, pathology has transitioned to become more digitally oriented speciality. The potential of artificial intelligence (AI) in dermatopathology is to aid the diagnosis, and it requires dermatopathologists' guidance for efficient functioning of artificial intelligence.

METHOD

Comprehensive literature search was performed using electronic online databases "PubMed" and "Google Scholar." Articles published in English language were considered for the review.

RESULTS

Convolutional neural network, a type of deep neural network, is considered as an ideal tool in image recognition, processing, classification, and segmentation. Implementation of AI in tumor pathology is involved in the diagnosis, grading, staging, and prognostic prediction as well as in identification of genetic or pathological features. In this review, we attempt to discuss the use of AI in dermatopathology, the attitude of patients and clinicians, its challenges, limitation, and potential opportunities in future implementation.

Artificial Intelligence and Advanced Melanoma: Treatment Management Implications

Artificial intelligence (AI), a field of research in which computers are applied to mimic humans, is continuously expanding and influencing many aspects of our lives. From electric cars to search motors, AI helps us manage our daily lives by simplifying functions and activities that would be more complex otherwise. Even in the medical field, and specifically in oncology, many studies in recent years have highlighted the possible helping role that AI could play in clinical and therapeutic patient management. In specific contexts, clinical decisions are supported by "intelligent" machines and the development of specific softwares that assist the specialist in the management of the oncology patient. Melanoma, a highly heterogeneous disease influenced by several genetic and environmental factors, to date is still difficult to manage clinically in its advanced stages. Therapies often fail, due to the establishment of intrinsic or secondary resistance, making clinical decisions complex. In this sense, although much work still needs to be conducted, numerous evidence shows that AI (through the processing of large available data) could positively influence the management of the patient with advanced melanoma, helping the clinician in the most favorable therapeutic choice and avoiding unnecessary treatments that are sure to fail. In this review, the most recent applications of AI in melanoma will be described, focusing especially on the possible finding of this field in the management of drug treatments.

Artificial intelligence in the detection of skin cancer

Recent advances in artificial intelligence (AI) in dermatology have demonstrated the potential to improve the accuracy of skin cancer detection. These capabilities may augment current diagnostic processes and improve the approach to the management of skin cancer. To explain this technology, we discuss fundamental terminology, potential benefits, and limitations of AI, and commercial applications relevant to dermatologists. A clear understanding of the technology may help to reduce physician concerns about AI and promote its use in the clinical setting. Ultimately, the development and validation of AI technologies, their approval by regulatory agencies, and widespread adoption by dermatologists and other clinicians may enhance patient care. Technology-augmented detection of skin cancer has the potential to improve quality of life, reduce health care costs by reducing unnecessary procedures, and promote greater access to high-quality skin assessment. Dermatologists play a critical role in the responsible development and deployment of AI capabilities applied to skin cancer.

Perspective Toward Machine Learning Implementation in Pediatric Medicine: Mixed Methods Study

Background

Given the costs of machine learning implementation, a systematic approach to prioritizing which models to implement into clinical practice may be valuable.

Objective

The primary objective was to determine the health care attributes respondents at 2 pediatric institutions rate as important when prioritizing machine learning model implementation. The secondary objective was to describe their perspectives on implementation using a qualitative approach.

Methods

In this mixed methods study, we distributed a survey to health system leaders, physicians, and data scientists at 2 pediatric institutions. We asked respondents to rank the following 5 attributes in terms of implementation usefulness: the clinical problem was common, the clinical problem caused substantial morbidity and mortality, risk stratification led to different actions that could reasonably improve patient outcomes, reducing physician workload, and saving money. Important attributes were those ranked as first or second most important. Individual qualitative interviews were conducted with a subsample of respondents.

Results

Among 613 eligible respondents, 275 (44.9%) responded. Qualitative interviews were conducted with 17 respondents. The most common important attributes were risk stratification leading to different actions (205/275, 74.5%) and clinical problem causing substantial morbidity or mortality (177/275, 64.4%). The attributes considered least important were reducing physician workload and saving money. Qualitative interviews consistently prioritized implementations that improved patient outcomes.

Conclusions

Respondents prioritized machine learning model implementation where risk stratification would lead to different actions and clinical problems that caused substantial morbidity and mortality. Implementations that improved patient outcomes were prioritized. These results can help provide a framework for machine learning model implementation.

Artificial intelligence in melanoma: A systematic review

BACKGROUND

Melanoma accounts for the majority of skin cancer deaths. Artificial intelligence has been applied in many types of cancers, and in melanoma in recent years. However, no systematic review summarized the application of artificial intelligence in melanoma.

AIMS

This study aims to systematically review previously published articles to explore the application of artificial intelligence in melanoma.

MATERIALS & METHODS

PubMed database was used to search the eligible publications on August 1, 2020. The query term was "artificial intelligence" and "melanoma."

RESULTS

A total of 51 articles were included in this review. Artificial intelligence technique is mainly used in the evaluation of dermoscopic images, other image segmentation and processing, and artificial intelligence diagnosis system.

DISCUSSION

Artificial intelligence is also applied in metastasis prediction, drug response prediction, and prognosis of melanoma. Besides, patients' perspectives of artificial intelligence and collaboration of human and artificial intelligence in melanoma also attracted attention. The query term might not include all articles, and we could not examine the algorithms that were built without publication.

CONCLUSION

The performance of artificial intelligence in melanoma is satisfactory and the future for potential applications is enormous.

Predicting attitudes towards screening for neurodegenerative diseases using OCT and artificial intelligence: Findings from a literature review

Recent developments in artificial intelligence (AI) and machine learning raise the possibility of screening and early diagnosis for neurodegenerative diseases, using 3D scans of the retina. The eventual value of such screening will depend not only on scientific metrics such as specificity and sensitivity but, critically, also on public attitudes and uptake. Differential screening rates for various screening programmes in England indicate that multiple factors influence uptake. In this narrative literature review, some of these potential factors are explored in relation to predicting uptake of an early screening tool for neurodegenerative diseases using AI. These include: awareness of the disease, perceived risk, social influence, the use of AI, previous screening experience, socioeconomic status, health literacy, uncontrollable mortality risk, and demographic factors. The review finds the strongest and most consistent predictors to be ethnicity, social influence, the use of AI, and previous screening experience. Furthermore, it is likely that factors also interact to predict the uptake of such a tool. However, further experimental work is needed both to validate these predictions and explore interactions between the significant predictors.

Over-Detection of Melanoma-Suspect Lesions by a CE-Certified Smartphone App: Performance in Comparison to Dermatologists, 2D and 3D Convolutional Neural Networks in a Prospective Data Set of 1204 Pigmented Skin Lesions Involving Patients' Perception

Simple Summary

Early detection and resection of cutaneous melanoma are crucial for a good prognosis. However, visual distinction of early melanomas from benign nevi remains challenging. New artificial intelligence-based approaches for risk stratification of pigmented skin lesions provide screening methods for laypersons with increasing use of smartphone applications (apps). Our study aims to prospectively investigate the diagnostic accuracy of a CE-certified smartphone app, SkinVision^®, in melanoma recognition. Based on classification into three different risk scores, the app provides a recommendation to consult a dermatologist. In addition, both patients’ and dermatologists’ perspectives towards AI-based mobile health apps were evaluated. We observed that the app classified a significantly higher number of lesions as high-risk than dermatologists, which would have led to a clinically harmful number of unnecessary excisions. The diagnostic performance of the app in dichotomous classification of 1204 pigmented skin lesions (risk classification for nevus vs. melanoma) remained below advertised rates with low sensitivity (41.3–83.3%) and specificity (60.0–82.9%). The confidence in the app was low among both patients and dermatologists, and no patient favored an assessment by the app alone. Although smartphone apps are a potential medium for increasing awareness of melanoma screening in the lay population, they should be evaluated for certification with prospective real-world evidence.

Abstract

The exponential increase in algorithm-based mobile health (mHealth) applications (apps) for melanoma screening is a reaction to a growing market. However, the performance of available apps remains to be investigated. In this prospective study, we investigated the diagnostic accuracy of a class 1 CE-certified smartphone app in melanoma risk stratification and its patient and dermatologist satisfaction. Pigmented skin lesions ≥ 3 mm and any suspicious smaller lesions were assessed by the smartphone app SkinVision^® (SkinVision^® B.V., Amsterdam, the Netherlands, App-Version 6.8.1), 2D FotoFinder ATBM^® master (FotoFinder ATBM^® Systems GmbH, Bad Birnbach, Germany, Version 3.3.1.0), 3D Vectra^® WB360 (Canfield Scientific, Parsippany, NJ, USA, Version 4.7.1) total body photography (TBP) devices, and dermatologists. The high-risk score of the smartphone app was compared with the two gold standards: histological diagnosis, or if not available, the combination of dermatologists’, 2D and 3D risk assessments. A total of 1204 lesions among 114 patients (mean age 59 years; 51% females (55 patients at high-risk for developing a melanoma, 59 melanoma patients)) were included. The smartphone app’s sensitivity, specificity, and area under the receiver operating characteristics (AUROC) varied between 41.3–83.3%, 60.0–82.9%, and 0.62–0.72% according to two study-defined reference standards. Additionally, all patients and dermatologists completed a newly created questionnaire for preference and trust of screening type. The smartphone app was rated as trustworthy by 36% (20/55) of patients at high-risk for melanoma, 49% (29/59) of melanoma patients, and 8.8% (10/114) of dermatologists. Most of the patients rated the 2D TBP imaging (93% (51/55) resp. 88% (52/59)) and the 3D TBP imaging (91% (50/55) resp. 90% (53/59)) as trustworthy. A skin cancer screening by combination of dermatologist and smartphone app was favored by only 1.8% (1/55) resp. 3.4% (2/59) of the patients; no patient preferred an assessment by a smartphone app alone. The diagnostic accuracy in clinical practice was not as reliable as previously advertised and the satisfaction with smartphone apps for melanoma risk stratification was scarce. MHealth apps might be a potential medium to increase awareness for melanoma screening in the lay population, but healthcare professionals and users should be alerted to the potential harm of over-detection and poor performance. In conclusion, we suggest further robust evidence-based evaluation before including market-approved apps in self-examination for public health benefits.