1
|
Guermazi D, Shah A, Yumeen S, Vance T, Saliba E. Skinformatics: Navigating the big data landscape of dermatology. J Eur Acad Dermatol Venereol 2024. [PMID: 39254192 DOI: 10.1111/jdv.20319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2024] [Accepted: 08/20/2024] [Indexed: 09/11/2024]
Abstract
Big data and associated approaches to analyse it are on the rise, especially in healthcare settings. This growth is also seen with unique applications in the field of dermatology. While big data offer a plethora of opportunity for improving our current understanding of disease and ability to deliver care, as with any technology innovation, the potential pitfalls should be addressed. In this piece, we highlight opportunities and challenges associated with big data in dermatology. Opportunities include large and novel data sources that may offer a wealth of information, automated detection, classification and diagnostics and improved public health monitoring. Challenges include data quality, issues of interpretability and disparities within artificial intelligence (AI) training data sets. Clinicians and researchers in the field should be aware of these developments within the field of big data to understand how best it may be used toward improving patient care and health outcomes, particularly in the field of dermatology.
Collapse
Affiliation(s)
- Dorra Guermazi
- Brown University, Division of Biology and Medicine, Providence, Rhode Island, USA
| | - Asghar Shah
- Brown University, Division of Biology and Medicine, Providence, Rhode Island, USA
| | - Sara Yumeen
- Department of Dermatology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
| | - Terrence Vance
- Department of Dermatology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
| | - Elie Saliba
- Department of Dermatology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
- Department of Dermatology, Gilbert and Rose-Marie Chagoury School of Medicine, Lebanese American University, Beirut, Lebanon
| |
Collapse
|
2
|
Smith P, Johnson CE, Haran K, Orcales F, Kranyak A, Bhutani T, Riera-Monroig J, Liao W. Advancing Psoriasis Care through Artificial Intelligence: A Comprehensive Review. CURRENT DERMATOLOGY REPORTS 2024; 13:141-147. [PMID: 39301276 PMCID: PMC11412311 DOI: 10.1007/s13671-024-00434-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/30/2024] [Indexed: 09/22/2024]
Abstract
Purpose of Review Machine learning (ML), a subset of artificial intelligence (AI), has been vital in advancing tasks such as image classification and speech recognition. Its integration into clinical medicine, particularly dermatology, offers a significant leap in healthcare delivery. Recent Findings This review examines the impact of ML on psoriasis-a condition heavily reliant on visual assessments for diagnosis and treatment. The review highlights five areas where ML is reshaping psoriasis care: diagnosis of psoriasis through clinical and dermoscopic images, skin severity quantification, psoriasis biomarker identification, precision medicine enhancement, and AI-driven education strategies. These advancements promise to improve patient outcomes, especially in regions lacking specialist care. However, the success of AI in dermatology hinges on dermatologists' oversight to ensure that ML's potential is fully realized in patient care, preserving the essential human element in medicine. Summary This collaboration between AI and human expertise could define the future of dermatological treatments, making personalized care more accessible and precise.
Collapse
Affiliation(s)
- Payton Smith
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Chandler E Johnson
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Kathryn Haran
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Faye Orcales
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Allison Kranyak
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Tina Bhutani
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Josep Riera-Monroig
- Dermatology Department, Hospital Clínic de Barcelona, Universitat de Barcelona, Barcelona, Spain
| | - Wilson Liao
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| |
Collapse
|
3
|
Gottfrois P, Zhu J, Steiger A, Amruthalingam L, Kind AB, Heinzelmann V, Mang C, Navarini AA, Mueller SM. AI-powered visual diagnosis of vulvar lichen sclerosus: A pilot study. J Eur Acad Dermatol Venereol 2024. [PMID: 39194285 DOI: 10.1111/jdv.20306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Accepted: 08/12/2024] [Indexed: 08/29/2024]
Abstract
BACKGROUND Vulvar lichen sclerosus (VLS) is a chronic inflammatory skin condition associated with significant impairment of quality of life and potential risk of malignant transformation. However, diagnosis of VLS is often delayed due to its variable clinical presentation and shame-related late consultation. Machine learning (ML)-trained image recognition software could potentially facilitate early diagnosis of VLS. OBJECTIVE To develop a ML-trained image-based model for the detection of VLS. METHODS Images of both VLS and non-VLS anogenital skin were collected, anonymized, and selected. In the VLS images, 10 typical skin signs (whitening, hyperkeratosis, purpura/ecchymosis, erosion/ulcers/excoriation, erythema, labial fusion, narrowing of the introitus, labia minora resorption, posterior commissure (fourchette) band formation and atrophic shiny skin) were manually labelled. A deep convolutional neural network was built using the training set as input data and then evaluated using the test set, where the developed algorithm was run three times and the results were then averaged. RESULTS A total of 684 VLS images and 403 non-VLS images (70% healthy vulva and 30% with other vulvar diseases) were included after the selection process. A deep learning algorithm was developed by training on 775 images (469 VLS and 306 non-VLS) and testing on 312 images (215 VLS and 97 non-VLS). This algorithm performed accurately in discriminating between VLS and non-VLS cases (including healthy individuals and non-VLS dermatoses), with mean values of 0.94, 0.99 and 0.95 for recall, precision and accuracy, respectively. CONCLUSION This pilot project demonstrated that our image-based deep learning model can effectively discriminate between VLS and non-VLS skin, representing a promising tool for future use by clinicians and possibly patients. However, prospective studies are needed to validate the applicability and accuracy of our model in a real-world setting.
Collapse
Affiliation(s)
- Philippe Gottfrois
- Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland
| | - Jie Zhu
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | - Alexandra Steiger
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | | | - Andre B Kind
- Department of Gynecology, University Hospital of Basel, Basel, Switzerland
| | - Viola Heinzelmann
- Department of Gynecology, University Hospital of Basel, Basel, Switzerland
| | - Claudia Mang
- Department of Gynecology, University Hospital of Basel, Basel, Switzerland
| | | | - Simon M Mueller
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| |
Collapse
|
4
|
Romero-Morelos P, Herrera-López E, González-Yebra B. Development, Application and Utility of a Machine Learning Approach for Melanoma and Non-Melanoma Lesion Classification Using Counting Box Fractal Dimension. Diagnostics (Basel) 2024; 14:1132. [PMID: 38893659 PMCID: PMC11171650 DOI: 10.3390/diagnostics14111132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 04/16/2024] [Accepted: 05/09/2024] [Indexed: 06/21/2024] Open
Abstract
The diagnosis and identification of melanoma are not always accurate, even for experienced dermatologists. Histopathology continues to be the gold standard, assessing specific parameters such as the Breslow index. However, it remains invasive and may lack effectiveness. Therefore, leveraging mathematical modeling and informatics has been a pursuit of diagnostic methods favoring early detection. Fractality, a mathematical parameter quantifying complexity and irregularity, has proven useful in melanoma diagnosis. Nonetheless, no studies have implemented this metric to feed artificial intelligence algorithms for the automatic classification of dermatological lesions, including melanoma. Hence, this study aimed to determine the combined utility of fractal dimension and unsupervised low-computational-requirements machine learning models in classifying melanoma and non-melanoma lesions. We analyzed 39,270 dermatological lesions obtained from the International Skin Imaging Collaboration. Box-counting fractal dimensions were calculated for these lesions. Fractal values were used to implement classification methods by unsupervised machine learning based on principal component analysis and iterated K-means (100 iterations). A clear separation was observed, using only fractal dimension values, between benign or malignant lesions (sensibility 72.4% and specificity 50.1%) and melanoma or non-melanoma lesions (sensibility 72.8% and specificity 50%) and subsequently, the classification quality based on the machine learning model was ≈80% for both benign and malignant or melanoma and non-melanoma lesions. However, the grouping of metastatic melanoma versus non-metastatic melanoma was less effective, probably due to the small sample size included in MM lesions. Nevertheless, we could suggest a decision algorithm based on fractal dimension for dermatological lesion discrimination. On the other hand, it was also determined that the fractal dimension is sufficient to generate unsupervised artificial intelligence models that allow for a more efficient classification of dermatological lesions.
Collapse
Affiliation(s)
- Pablo Romero-Morelos
- Department of Research, State University of the Valley of Ecatepec, Ecatepec 55210, México State, Mexico; (P.R.-M.); (E.H.-L.)
- National Laboratory of Artificial Intelligence and Data Science, CONAHCyT (LNC-IACD), Ecatepec 55210, México State, Mexico
| | - Elizabeth Herrera-López
- Department of Research, State University of the Valley of Ecatepec, Ecatepec 55210, México State, Mexico; (P.R.-M.); (E.H.-L.)
- National Laboratory of Artificial Intelligence and Data Science, CONAHCyT (LNC-IACD), Ecatepec 55210, México State, Mexico
| | - Beatriz González-Yebra
- Department of Medicine and Nutrition, Division of Health Sciences, University of Guanajuato, Campus León, León 37670, Guanajuato, Mexico
| |
Collapse
|
5
|
VanBerlo B, Hoey J, Wong A. A survey of the impact of self-supervised pretraining for diagnostic tasks in medical X-ray, CT, MRI, and ultrasound. BMC Med Imaging 2024; 24:79. [PMID: 38580932 PMCID: PMC10998380 DOI: 10.1186/s12880-024-01253-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 03/18/2024] [Indexed: 04/07/2024] Open
Abstract
Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed tomography, magnetic resonance, and ultrasound imaging, concentrating on studies that compare self-supervised pretraining to fully supervised learning for diagnostic tasks such as classification and segmentation. The most pertinent finding is that self-supervised pretraining generally improves downstream task performance compared to full supervision, most prominently when unlabelled examples greatly outnumber labelled examples. Based on the aggregate evidence, recommendations are provided for practitioners considering using self-supervised learning. Motivated by limitations identified in current research, directions and practices for future study are suggested, such as integrating clinical knowledge with theoretically justified self-supervised learning methods, evaluating on public datasets, growing the modest body of evidence for ultrasound, and characterizing the impact of self-supervised pretraining on generalization.
Collapse
Affiliation(s)
- Blake VanBerlo
- Cheriton School of Computer Science, 200 University Ave W, N2L 3G1, Waterloo, Canada.
| | - Jesse Hoey
- Cheriton School of Computer Science, 200 University Ave W, N2L 3G1, Waterloo, Canada
| | - Alexander Wong
- Department of Systems Design Engineering, 200 University Ave W, N2L 3G1, Waterloo, Canada
| |
Collapse
|
6
|
Ribeiro RDPES, von Wangenheim A. Automated Image Quality and Protocol Adherence Assessment of Examinations in Teledermatology: First Results. Telemed J E Health 2024; 30:994-1005. [PMID: 37930716 DOI: 10.1089/tmj.2023.0155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2023] Open
Abstract
Introduction: Image quality and acquisition protocol adherence assessment is a neglected area in teledermatology. We examine if it is feasible to use deep learning methods to automate the assessment of the adherence of examinations to image acquisition protocols. In this study, we focused on the quality criteria of two image acquisition protocols: (1) approximation image and (2) panoramic image, as these are present in all teledermatology examination protocols currently used by the Santa Catarina State Integrated Telemedicine and Telehealth System (STT/SC). Methods: We use a data set of 36,102 teledermatological examinations performed at the STT/SC during 2021. As our validation process, we adopted standard machine learning metrics and an inter-rater agreement (IRA) study with 11 dermatologists. For the approximation image protocol, we used the Mask-Region based Convolutional Neural Network (RCNN) Object Detection Deep Learning (DL) architecture to identify the presence of a lesion identification tag and a ruler used to provide a frame reference of the lesion. For the panoramic image protocol, we used DensePose, a pose estimation DL, architecture to assess the presence of a whole patient body and its orientation. A combination of the two approaches was additionally validated through an IRA study between specialists. Results: Mask-RCNN achieved a score of 96% mean average precision (mAP), while DensePose presented 75% mAP. IRA achieved a level of agreement of 96.68% with the Krippendorff alpha score. Conclusions: Our results show the feasibility of using deep learning to automate the image quality and protocol adherence assessment in teledermatology, before the specialist's manual analysis of the examination.
Collapse
Affiliation(s)
- Rodrigo de Paula E Silva Ribeiro
- Department of Informatics and Statistics, Federal University of Santa Catarina, Florianópolis, Santa Catarina, Brazil
- Image Processing and Computer Graphics Lab, INCoD, Federal University of Santa Catarina, Florianópolis, Santa Catarina, Brazil
| | - Aldo von Wangenheim
- Department of Informatics and Statistics, Federal University of Santa Catarina, Florianópolis, Santa Catarina, Brazil
- Image Processing and Computer Graphics Lab, INCoD, Federal University of Santa Catarina, Florianópolis, Santa Catarina, Brazil
| |
Collapse
|
7
|
Hassan AM, Biaggi-Ondina A, Asaad M, Morris N, Liu J, Selber JC, Butler CE. Artificial Intelligence Modeling to Predict Periprosthetic Infection and Explantation following Implant-Based Reconstruction. Plast Reconstr Surg 2023; 152:929-938. [PMID: 36862958 DOI: 10.1097/prs.0000000000010345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/04/2023]
Abstract
BACKGROUND Despite improvements in prosthesis design and surgical techniques, periprosthetic infection and explantation rates following implant-based reconstruction (IBR) remain relatively high. Artificial intelligence is an extremely powerful predictive tool that involves machine learning (ML) algorithms. We sought to develop, validate, and evaluate the use of ML algorithms to predict complications of IBR. METHODS A comprehensive review of patients who underwent IBR from January of 2018 to December of 2019 was conducted. Nine supervised ML algorithms were developed to predict periprosthetic infection and explantation. Patient data were randomly divided into training (80%) and testing (20%) sets. RESULTS The authors identified 481 patients (694 reconstructions) with a mean ± SD age of 50.0 ± 11.5 years, mean ± SD body mass index of 26.7 ± 4.8 kg/m 2 , and median follow-up time of 16.1 months (range, 11.9 to 3.2 months). Periprosthetic infection developed in 113 of the reconstructions (16.3%), and explantation was required with 82 (11.8%) of them. ML demonstrated good discriminatory performance in predicting periprosthetic infection and explantation (area under the receiver operating characteristic curve, 0.73 and 0.78, respectively), and identified nine and 12 significant predictors of periprosthetic infection and explantation, respectively. CONCLUSIONS ML algorithms trained using readily available perioperative clinical data accurately predict periprosthetic infection and explantation following IBR. The authors' findings support incorporating ML models into perioperative assessment of patients undergoing IBR to provide data-driven, patient-specific risk assessment to aid individualized patient counseling, shared decision-making, and presurgical optimization.
Collapse
Affiliation(s)
- Abbas M Hassan
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| | - Andrea Biaggi-Ondina
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| | - Malke Asaad
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| | - Natalie Morris
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| | - Jun Liu
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| | - Jesse C Selber
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| | - Charles E Butler
- From the Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center
| |
Collapse
|
8
|
Thompson LJ, Furmanchuk A, Liszewski W, Kho A, West DP, Liebovitz DM, Nardone B, Gerami P. Machine learning identification of patient clusters for cutaneous melanoma. Ital J Dermatol Venerol 2023; 158:388-394. [PMID: 37750845 DOI: 10.23736/s2784-8671.23.07631-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/27/2023]
Abstract
BACKGROUND Cutaneous melanoma is a cancer arising in melanocyte skin cells and is the deadliest form of skin cancer worldwide. Although some risk factors are known, accurate prediction of disease progression and probability for metastasis are difficult to ascertain, given the complexity of the disease and the absence of reliable predictive markers. Since early detection and treatment are essential to enhance survival, this study utilizing machine learning (ML) aims to further delineate additional risk factors associated with cutaneous melanoma. METHODS A Bayesian Gaussian Mixture ML model was created with data from 2056 patients diagnosed with cutaneous melanoma and then used to group the patients into six Clusters based on a Silhouette Score analysis. A t-distributed stochastic neighbor embedding (t-SNE) model was used to visualize the six Clusters. RESULTS Statistical analysis revealed that Cluster 4 showed a significantly higher rate of metastatic disease, as well as higher Breslow depth at diagnosis, compared to the other five Clusters. Compared to the other five Clusters, patients represented in Cluster 4 also had lower healthcare utilization, fewer dermatology clinic visits, fewer primary care providers, and less frequent colonoscopies and mammograms, and were more likely to smoke and less likely to have a prior diagnosis of basal cell carcinoma. CONCLUSIONS This study uncovers gaps in healthcare utilization of services among patient groups with cutaneous melanoma as well as possible implications for management of disease progression. Data-driven analyses emphasize the importance of routine clinic visits to dermatologists and/or primary care physicians (PCPs) for early detection and management of cutaneous melanoma. The findings from this study demonstrate that unsupervised ML methodology may serve to define the best candidate patients to benefit from enhanced dermatology/primary care which, in turn, is expected to improve outcomes for cutaneous melanoma.
Collapse
Affiliation(s)
- Leo J Thompson
- Department of Dermatology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Institute for Augmented Intelligence in Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Al'ona Furmanchuk
- Department of Medicine (General Internal Medicine), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Walter Liszewski
- Department of Dermatology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Abel Kho
- Institute for Augmented Intelligence in Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Department of Medicine (General Internal Medicine), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Dennis P West
- Department of Dermatology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - David M Liebovitz
- Institute for Augmented Intelligence in Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Department of Medicine (General Internal Medicine), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Beatrice Nardone
- Department of Dermatology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA -
- Institute for Augmented Intelligence in Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Department of Medicine (General Internal Medicine), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Pedram Gerami
- Department of Dermatology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| |
Collapse
|
9
|
Greenfield DA, Feizpour A, Evans CL. Quantifying Inflammatory Response and Drug-Aided Resolution in an Atopic Dermatitis Model with Deep Learning. J Invest Dermatol 2023; 143:1430-1438.e4. [PMID: 36804151 DOI: 10.1016/j.jid.2023.01.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 12/12/2022] [Accepted: 01/01/2023] [Indexed: 02/19/2023]
Abstract
Noninvasive quantification of dermal diseases aids efficacy studies and paves the way for broader enrollment in clinical studies across varied demographics. Related to atopic dermatitis, accurate quantification of the onset and resolution of inflammatory flare ups in the skin remains challenging because the commonly used macroscale cues do not necessarily represent the underlying inflammation at the cellular level. Although atopic dermatitis affects over 10% of Americans, the genetic underpinnings and cellular-level phenomena causing the physical manifestation of the disease require more clarity. Current gold standards of quantification are often invasive, requiring biopsies followed by laboratory analysis. This represents a gap in our ability to diagnose and study skin inflammatory disease as well as develop improved topical therapeutic treatments. This need can be addressed through noninvasive imaging methods and the use of modern quantitative approaches to streamline the generation of relevant insights. This work reports the noninvasive image-based quantification of inflammation in an atopic dermatitis mouse model on the basis of cellular-level deep learning analysis of coherent anti-Stokes Raman scattering and stimulated Raman scattering imaging. This quantification method allows for timepoint-specific disease scores using morphological and physiological measurements. The outcomes we show set the stage for applying this workflow to future clinical studies.
Collapse
Affiliation(s)
- Daniel A Greenfield
- Wellman Center for Photomedicine, Harvard Medical School/Massachusetts General Hospital, Boston, Massachusetts, USA; Biophysics PhD Program, Harvard University, The Graduate School of Arts and Sciences, Boston, Massachusetts, USA
| | - Amin Feizpour
- Wellman Center for Photomedicine, Harvard Medical School/Massachusetts General Hospital, Boston, Massachusetts, USA
| | - Conor L Evans
- Wellman Center for Photomedicine, Harvard Medical School/Massachusetts General Hospital, Boston, Massachusetts, USA; Biophysics PhD Program, Harvard University, The Graduate School of Arts and Sciences, Boston, Massachusetts, USA.
| |
Collapse
|
10
|
Asaad M, Lu SC, Hassan AM, Kambhampati P, Mitchell D, Chang EI, Yu P, Hanasono MM, Sidey-Gibbons C. The Use of Machine Learning for Predicting Complications of Free-Flap Head and Neck Reconstruction. Ann Surg Oncol 2023; 30:2343-2352. [PMID: 36719569 DOI: 10.1245/s10434-022-13053-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Accepted: 12/22/2022] [Indexed: 02/01/2023]
Abstract
BACKGROUND Machine learning has been increasingly used for surgical outcome prediction, yet applications in head and neck reconstruction are not well-described. In this study, we developed and evaluated the performance of ML algorithms in predicting postoperative complications in head and neck free-flap reconstruction. METHODS We conducted a comprehensive review of patients who underwent microvascular head and neck reconstruction between January 2005 and December 2018. Data were used to develop and evaluate nine supervised ML algorithms in predicting overall complications, major recipient-site complication, and total flap loss. RESULTS We identified 4000 patients who met inclusion criteria. Overall, 33.7% of patients experienced a complication, 26.5% experienced a major recipient-site complication, and 1.7% suffered total flap loss. The k-nearest neighbors algorithm demonstrated the best overall performance for predicting any complication (AUROC = 0.61, sensitivity = 0.60). Regularized regression had the best performance for predicting major recipient-site complications (AUROC = 0.68, sensitivity = 0.66), and decision trees were the best predictors of total flap loss (AUROC = 0.66, sensitivity = 0.50). CONCLUSIONS ML accurately identified patients at risk of experiencing postsurgical complications, including total flap loss. Predictions from ML models may provide insight in the perioperative setting and facilitate shared decision making.
Collapse
Affiliation(s)
- Malke Asaad
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Sheng-Chieh Lu
- Department of Symptom Research, MD Anderson Center for INSPiRED Cancer Care, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Abbas M Hassan
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Praneeth Kambhampati
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
- Baylor College of Medicine, Houston, TX, USA
| | - David Mitchell
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
- McGovern Medical School, Houston, TX, USA.
| | - Edward I Chang
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Peirong Yu
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Matthew M Hanasono
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - C Sidey-Gibbons
- Department of Symptom Research, MD Anderson Center for INSPiRED Cancer Care, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
11
|
Thieme AH, Zheng Y, Machiraju G, Sadee C, Mittermaier M, Gertler M, Salinas JL, Srinivasan K, Gyawali P, Carrillo-Perez F, Capodici A, Uhlig M, Habenicht D, Löser A, Kohler M, Schuessler M, Kaul D, Gollrad J, Ma J, Lippert C, Billick K, Bogoch I, Hernandez-Boussard T, Geldsetzer P, Gevaert O. A deep-learning algorithm to classify skin lesions from mpox virus infection. Nat Med 2023; 29:738-747. [PMID: 36864252 PMCID: PMC10033450 DOI: 10.1038/s41591-023-02225-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 01/19/2023] [Indexed: 03/04/2023]
Abstract
Undetected infection and delayed isolation of infected individuals are key factors driving the monkeypox virus (now termed mpox virus or MPXV) outbreak. To enable earlier detection of MPXV infection, we developed an image-based deep convolutional neural network (named MPXV-CNN) for the identification of the characteristic skin lesions caused by MPXV. We assembled a dataset of 139,198 skin lesion images, split into training/validation and testing cohorts, comprising non-MPXV images (n = 138,522) from eight dermatological repositories and MPXV images (n = 676) from the scientific literature, news articles, social media and a prospective cohort of the Stanford University Medical Center (n = 63 images from 12 patients, all male). In the validation and testing cohorts, the sensitivity of the MPXV-CNN was 0.83 and 0.91, the specificity was 0.965 and 0.898 and the area under the curve was 0.967 and 0.966, respectively. In the prospective cohort, the sensitivity was 0.89. The classification performance of the MPXV-CNN was robust across various skin tones and body regions. To facilitate the usage of the algorithm, we developed a web-based app by which the MPXV-CNN can be accessed for patient guidance. The capability of the MPXV-CNN for identifying MPXV lesions has the potential to aid in MPXV outbreak mitigation.
Collapse
Affiliation(s)
- Alexander H Thieme
- Department of Medicine, Stanford University, Stanford, CA, USA.
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA.
- Department of Radiation Oncology, Charité-Universitätsmedizin Berlin, Berlin, Germany.
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, BIH Biomedical Innovation Academy, BIH Charité Digital Clinician Scientist Program, Berlin, Berlin, Germany.
| | - Yuanning Zheng
- Department of Medicine, Stanford University, Stanford, CA, USA
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA
| | - Gautam Machiraju
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
| | - Chris Sadee
- Department of Medicine, Stanford University, Stanford, CA, USA
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA
| | - Mirja Mittermaier
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, BIH Biomedical Innovation Academy, BIH Charité Digital Clinician Scientist Program, Berlin, Berlin, Germany
- Department of Infectious Diseases and Respiratory Medicine, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Maximilian Gertler
- Institute of Tropical Medicine and International Health, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Jorge L Salinas
- Division of Infectious Diseases and Geographic Medicine, Department of Medicine, Stanford University, Stanford, CA, USA
| | - Krithika Srinivasan
- Division of Infectious Diseases and Geographic Medicine, Department of Medicine, Stanford University, Stanford, CA, USA
| | | | - Francisco Carrillo-Perez
- Department of Medicine, Stanford University, Stanford, CA, USA
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA
- Department of Architecture and Computer Technology (ATC), University of Granada, Granada, Spain
| | - Angelo Capodici
- Department of Medicine, Stanford University, Stanford, CA, USA
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA
- Department of Biomedical and Neuromotor Science, Alma Mater Studiorum-University of Bologna, Bologna, Italy
| | - Maximilian Uhlig
- Department of Medicine, Justus-Liebig-Universität Gießen, Gießen, Germany
| | | | - Anastassia Löser
- Department of Radiotherapy, University Medical Center Schleswig-Holstein, Lübeck, Germany
| | - Maja Kohler
- Heidelberg Institute of Global Health, Heidelberg University Hospital, Heidelberg, Germany
- University Basel, Department of Psychology, Center for Cognitive and Decision Sciences, Basel, Switzerland
| | | | - David Kaul
- Department of Radiation Oncology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Johannes Gollrad
- Department of Radiation Oncology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Jackie Ma
- Department of Artificial Intelligence, Fraunhofer Heinrich Hertz Institute, Berlin, Germany
| | - Christoph Lippert
- Digital Health & Machine Learning, Hasso Plattner Institute, University of Potsdam, Potsdam, Germany
- Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Kendall Billick
- Division of Dermatology, Toronto Western Hospital, University Health Network, Toronto, Ontario, Canada
| | - Isaac Bogoch
- Division of Infectious Diseases, Toronto General Hospital, University Health Network, Toronto, Ontario, Canada
| | - Tina Hernandez-Boussard
- Department of Medicine, Stanford University, Stanford, CA, USA
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA
- Department of Surgery, Stanford University, Stanford, CA, USA
| | - Pascal Geldsetzer
- Division of Primary Care and Population Health, Department of Medicine, Stanford University, Stanford, CA, USA
- Chan Zuckerberg Biohub, San Francisco, CA, USA
| | - Olivier Gevaert
- Department of Medicine, Stanford University, Stanford, CA, USA
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Biomedical Data Science, Stanford University, Stanford, USA
| |
Collapse
|
12
|
Diagnostic error, uncertainty, and overdiagnosis in melanoma. Pathology 2023; 55:206-213. [PMID: 36642569 PMCID: PMC10373372 DOI: 10.1016/j.pathol.2022.12.345] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 12/16/2022] [Accepted: 12/19/2022] [Indexed: 12/31/2022]
Abstract
Diagnostic error can be defined as deviation from a gold standard diagnosis, typically defined in terms of expert opinion, although sometimes in terms of unexpected events that might occur in follow-up (such as progression and death from disease). Although diagnostic error does exist for melanoma, deviations from gold standard diagnosis, certainly among appropriately trained and experienced practitioners, are likely to be the result of uncertainty and lack of specific criteria, and differences of opinion, rather than lack of diagnostic skills. In this review, the concept of diagnostic error will be considered in relation to diagnostic uncertainty, and the concept of overdiagnosis in melanoma will be presented and discussed.
Collapse
|
13
|
Caffery LJ, Janda M, Miller R, Abbott LM, Arnold C, Caccetta T, Guitera P, Shumack S, Fernández-Peñas P, Mar V, Soyer HP. Informing a position statement on the use of artificial intelligence in dermatology in Australia. Australas J Dermatol 2023; 64:e11-e20. [PMID: 36380357 DOI: 10.1111/ajd.13946] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 10/06/2022] [Accepted: 10/17/2022] [Indexed: 11/17/2022]
Abstract
Artificial Intelligence (AI) is the ability for computers to simulate human intelligence. In dermatology, there is substantial interest in using AI to identify skin lesions from images. Due to increasing research and interest in the use of AI, the Australasian College of Dermatologists has developed a position statement to inform its members of appropriate use of AI. This article presents the ACD Position Statement on the use of AI in dermatology, and provides explanatory information that was used to inform the development of this statement.
Collapse
Affiliation(s)
- Liam J Caffery
- Centre for Online Health, The University of Queensland, Brisbane, Queensland, Australia.,Centre for Health Services Research, The University of Queensland, Brisbane, Queensland, Australia.,The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| | - Monika Janda
- Centre for Health Services Research, The University of Queensland, Brisbane, Queensland, Australia
| | - Robert Miller
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - Lisa M Abbott
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia.,Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia
| | - Chris Arnold
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia.,Australasian Society of Cosmetic Dermatologists, South Yarra, Victoria, Australia.,BioGrid Australia, Parkville, Victoria, Australia
| | - Tony Caccetta
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - Pascale Guitera
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - Stephen Shumack
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia.,The University of Sydney, Sydney, New South Wales, Australia
| | - Pablo Fernández-Peñas
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia.,The University of Sydney, Sydney, New South Wales, Australia
| | - Victoria Mar
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia.,Victorian Melanoma Service, Alfred Health, Victoria, Australia.,School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - H Peter Soyer
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| |
Collapse
|
14
|
Lovis C, Weber J, Liopyris K, Braun RP, Marghoob AA, Quigley EA, Nelson K, Prentice K, Duhaime E, Halpern AC, Rotemberg V. Agreement Between Experts and an Untrained Crowd for Identifying Dermoscopic Features Using a Gamified App: Reader Feasibility Study. JMIR Med Inform 2023; 11:e38412. [PMID: 36652282 PMCID: PMC9892985 DOI: 10.2196/38412] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 09/28/2022] [Accepted: 10/16/2022] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Dermoscopy is commonly used for the evaluation of pigmented lesions, but agreement between experts for identification of dermoscopic structures is known to be relatively poor. Expert labeling of medical data is a bottleneck in the development of machine learning (ML) tools, and crowdsourcing has been demonstrated as a cost- and time-efficient method for the annotation of medical images. OBJECTIVE The aim of this study is to demonstrate that crowdsourcing can be used to label basic dermoscopic structures from images of pigmented lesions with similar reliability to a group of experts. METHODS First, we obtained labels of 248 images of melanocytic lesions with 31 dermoscopic "subfeatures" labeled by 20 dermoscopy experts. These were then collapsed into 6 dermoscopic "superfeatures" based on structural similarity, due to low interrater reliability (IRR): dots, globules, lines, network structures, regression structures, and vessels. These images were then used as the gold standard for the crowd study. The commercial platform DiagnosUs was used to obtain annotations from a nonexpert crowd for the presence or absence of the 6 superfeatures in each of the 248 images. We replicated this methodology with a group of 7 dermatologists to allow direct comparison with the nonexpert crowd. The Cohen κ value was used to measure agreement across raters. RESULTS In total, we obtained 139,731 ratings of the 6 dermoscopic superfeatures from the crowd. There was relatively lower agreement for the identification of dots and globules (the median κ values were 0.526 and 0.395, respectively), whereas network structures and vessels showed the highest agreement (the median κ values were 0.581 and 0.798, respectively). This pattern was also seen among the expert raters, who had median κ values of 0.483 and 0.517 for dots and globules, respectively, and 0.758 and 0.790 for network structures and vessels. The median κ values between nonexperts and thresholded average-expert readers were 0.709 for dots, 0.719 for globules, 0.714 for lines, 0.838 for network structures, 0.818 for regression structures, and 0.728 for vessels. CONCLUSIONS This study confirmed that IRR for different dermoscopic features varied among a group of experts; a similar pattern was observed in a nonexpert crowd. There was good or excellent agreement for each of the 6 superfeatures between the crowd and the experts, highlighting the similar reliability of the crowd for labeling dermoscopic images. This confirms the feasibility and dependability of using crowdsourcing as a scalable solution to annotate large sets of dermoscopic images, with several potential clinical and educational applications, including the development of novel, explainable ML tools.
Collapse
Affiliation(s)
| | - Jochen Weber
- Dermatology Section, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Konstantinos Liopyris
- Department of Dermatology, Andreas Syggros Hospital of Cutaneous and Venereal Diseases, University of Athens, Athens, Greece
| | - Ralph P Braun
- Department of Dermatology, University Hospital Zurich, Zurich, Switzerland
| | - Ashfaq A Marghoob
- Dermatology Section, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Elizabeth A Quigley
- Dermatology Section, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Kelly Nelson
- Department of Dermatology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | | | | | - Allan C Halpern
- Dermatology Section, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Veronica Rotemberg
- Dermatology Section, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| |
Collapse
|
15
|
Oliveira B, Torres HR, Morais P, Veloso F, Baptista AL, Fonseca JC, Vilaça JL. A multi-task convolutional neural network for classification and segmentation of chronic venous disorders. Sci Rep 2023; 13:761. [PMID: 36641527 PMCID: PMC9840616 DOI: 10.1038/s41598-022-27089-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 12/26/2022] [Indexed: 01/16/2023] Open
Abstract
Chronic Venous Disorders (CVD) of the lower limbs are one of the most prevalent medical conditions, affecting 35% of adults in Europe and North America. Due to the exponential growth of the aging population and the worsening of CVD with age, it is expected that the healthcare costs and the resources needed for the treatment of CVD will increase in the coming years. The early diagnosis of CVD is fundamental in treatment planning, while the monitoring of its treatment is fundamental to assess a patient's condition and quantify the evolution of CVD. However, correct diagnosis relies on a qualitative approach through visual recognition of the various venous disorders, being time-consuming and highly dependent on the physician's expertise. In this paper, we propose a novel automatic strategy for the joint segmentation and classification of CVDs. The strategy relies on a multi-task deep learning network, denominated VENet, that simultaneously solves segmentation and classification tasks, exploiting the information of both tasks to increase learning efficiency, ultimately improving their performance. The proposed method was compared against state-of-the-art strategies in a dataset of 1376 CVD images. Experiments showed that the VENet achieved a classification performance of 96.4%, 96.4%, and 97.2% for accuracy, precision, and recall, respectively, and a segmentation performance of 75.4%, 76.7.0%, 76.7% for the Dice coefficient, precision, and recall, respectively. The joint formulation increased the robustness of both tasks when compared to the conventional classification or segmentation strategies, proving its added value, mainly for the segmentation of small lesions.
Collapse
Affiliation(s)
- Bruno Oliveira
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Campus de Gualtar, 4710-057, Braga, Portugal. .,ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal. .,Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal. .,2Ai - School of Technology, IPCA, Barcelos, Portugal. .,LASI-Associate Laboratory of Intelligent Systems, 4800-058, Guimarães, Portugal.
| | - Helena R Torres
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Campus de Gualtar, 4710-057, Braga, Portugal.,ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal.,Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal.,2Ai - School of Technology, IPCA, Barcelos, Portugal.,LASI-Associate Laboratory of Intelligent Systems, 4800-058, Guimarães, Portugal
| | - Pedro Morais
- 2Ai - School of Technology, IPCA, Barcelos, Portugal.,LASI-Associate Laboratory of Intelligent Systems, 4800-058, Guimarães, Portugal
| | - Fernando Veloso
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Campus de Gualtar, 4710-057, Braga, Portugal.,ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal.,2Ai - School of Technology, IPCA, Barcelos, Portugal.,LASI-Associate Laboratory of Intelligent Systems, 4800-058, Guimarães, Portugal.,Department of Mechanical Engineering, School of Engineering, University of Minho, Guimarães, Portugal
| | | | - Jaime C Fonseca
- Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal.,LASI-Associate Laboratory of Intelligent Systems, 4800-058, Guimarães, Portugal
| | - João L Vilaça
- 2Ai - School of Technology, IPCA, Barcelos, Portugal.,LASI-Associate Laboratory of Intelligent Systems, 4800-058, Guimarães, Portugal
| |
Collapse
|
16
|
Yanagisawa Y, Shido K, Kojima K, Yamasaki K. Convolutional neural network-based skin image segmentation model to improve classification of skin diseases in conventional and non-standardized picture images. J Dermatol Sci 2023; 109:30-36. [PMID: 36658056 DOI: 10.1016/j.jdermsci.2023.01.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 12/07/2022] [Accepted: 01/10/2023] [Indexed: 01/13/2023]
Abstract
BACKGROUND For dermatological practices, non-standardized conventional photo images are taken and collected as a mixture of variable fields of the image view, including close-up images focusing on designated lesions and long-shot images including normal skin and background of the body surface. Computer-aided detection/diagnosis (CAD) models trained using non-standardized conventional photo images exhibit lower performance rates than CAD models that detect lesions in a localized small area, such as dermoscopic images. OBJECTIVE We aimed to develop a convolutional neural network (CNN) model for skin image segmentation to generate a skin disease image dataset suitable for CAD of multiple skin disease classification. METHODS We trained a DeepLabv3 + -based CNN segmentation model to detect skin and lesion areas and segmented out areas that satisfy the following conditions: more than 80% of the image will be the skin area, and more than 10% of the image will be the lesion area. RESULTS The generated CNN-segmented image database was examined using CAD of skin disease classification and achieved approximately 90% sensitivity and specificity to differentiate atopic dermatitis from malignant diseases and complications, such as mycosis fungoides, impetigo, and herpesvirus infection. The accuracy of skin disease classification in the CNN-segmented image dataset was almost equal to that of the manually cropped image dataset and higher than that of the original image dataset. CONCLUSION Our CNN segmentation model, which automatically extracts lesions and segmented images of the skin area regardless of image fields, will reduce the burden of physician annotation and improve CAD performance.
Collapse
Affiliation(s)
| | - Kosuke Shido
- Department of Dermatology, Tohoku University Graduate School of Medicine, Sendai, Japan
| | - Kaname Kojima
- Tohoku Medical Megabank Organization, Tohoku University, Sendai, Japan.
| | - Kenshi Yamasaki
- Department of Dermatology, Tohoku University Graduate School of Medicine, Sendai, Japan.
| |
Collapse
|
17
|
Park S, Chien AL, Lin B, Li K. FACES: A Deep-Learning-Based Parametric Model to Improve Rosacea Diagnoses. APPLIED SCIENCES (BASEL, SWITZERLAND) 2023; 13:970. [PMID: 38282829 PMCID: PMC10817774 DOI: 10.3390/app13020970] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/30/2024]
Abstract
Rosacea is a chronic inflammatory skin disorder that causes visible blood vessels and redness on the nose, chin, cheeks, and forehead. However, visual assessment, the current standard method used to identify rosacea, is often subjective among clinicians and results in high variation. Recent advances in artificial intelligence have allowed for the effective detection of various skin diseases with high accuracy and consistency. In this study, we develop a new methodology, coined "five accurate CNNs-based evaluation system (FACES)", to identify and classify rosacea more efficiently. First, 19 CNN-based models that have been widely used for image classification were trained and tested via training and validation data sets. Next, the five best performing models were selected based on accuracy, which served as a weight value for FACES. At the same time, we also applied a majority rule to five selected models to detect rosacea. The results exhibited that the performance of FACES was superior to that of the five individual CNN-based models and the majority rule in terms of accuracy, sensitivity, specificity, and precision. In particular, the accuracy and sensitivity of FACES were the highest, and the specificity and precision were higher than most of the individual models. To improve the performance of our system, future studies must consider patient details, such as age, gender, and race, and perform comparison tests between our model system and clinicians.
Collapse
Affiliation(s)
- Seungman Park
- Department of Mechanical Engineering, University of Nevada, Las Vegas, NV 89154, USA
| | - Anna L. Chien
- Department of Dermatology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Beiyu Lin
- Department of Computer Science, University of Nevada, Las Vegas, NV 89154, USA
| | - Keva Li
- Molecular and Cellular Biology, Johns Hopkins University, Baltimore, MD 21218, USA
| |
Collapse
|
18
|
Jalaboi R, Faye F, Orbes-Arteaga M, Jørgensen D, Winther O, Galimzianova A. DermX: An end-to-end framework for explainable automated dermatological diagnosis. Med Image Anal 2023; 83:102647. [PMID: 36272237 DOI: 10.1016/j.media.2022.102647] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 08/17/2022] [Accepted: 09/27/2022] [Indexed: 11/06/2022]
Abstract
Dermatological diagnosis automation is essential in addressing the high prevalence of skin diseases and critical shortage of dermatologists. Despite approaching expert-level diagnosis performance, convolutional neural network (ConvNet) adoption in clinical practice is impeded by their limited explainability, and by subjective, expensive explainability validations. We introduce DermX, an end-to-end framework for explainable automated dermatological diagnosis. DermX is a clinically-inspired explainable dermatological diagnosis ConvNet, trained using DermXDB, a 554 image dataset annotated by eight dermatologists with diagnoses, supporting explanations, and explanation attention maps. DermX+ extends DermX with guided attention training for explanation attention maps. Both methods achieve near-expert diagnosis performance, with DermX, DermX+, and dermatologist F1 scores of 0.79, 0.79, and 0.87, respectively. We assess the explanation performance in terms of identification and localization by comparing model-selected with dermatologist-selected explanations, and gradient-weighted class-activation maps with dermatologist explanation maps, respectively. DermX obtained an identification F1 score of 0.77, while DermX+ obtained 0.79. The localization F1 score is 0.39 for DermX and 0.35 for DermX+. These results show that explainability does not necessarily come at the expense of predictive power, as our high-performance models provide expert-inspired explanations for their diagnoses without lowering their diagnosis performance.
Collapse
Affiliation(s)
- Raluca Jalaboi
- Department of Applied Mathematics and Computer Science at the Technical University of Denmark, Richard Petersens Plads, Building 324, DK-2800 Kongens Lyngby, Denmark; Omhu A/S, Silkegade 8 st, DK-1113 Copenhagen C, Denmark.
| | - Frederik Faye
- Omhu A/S, Silkegade 8 st, DK-1113 Copenhagen C, Denmark
| | | | - Dan Jørgensen
- Omhu A/S, Silkegade 8 st, DK-1113 Copenhagen C, Denmark
| | - Ole Winther
- Department of Applied Mathematics and Computer Science at the Technical University of Denmark, Richard Petersens Plads, Building 324, DK-2800 Kongens Lyngby, Denmark; Bioinformatics Centre, Department of Biology, University of Copenhagen, Copenhagen, Denmark; Center for Genomic Medicine, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
| | | |
Collapse
|
19
|
Puri P, Comfere N, Drage LA, Shamim H, Bezalel SA, Pittelkow MR, Davis MDP, Wang M, Mangold AR, Tollefson MM, Lehman JS, Meves A, Yiannias JA, Otley CC, Carter RE, Sokumbi O, Hall MR, Bridges AG, Murphree DH. Deep learning for dermatologists: Part II. Current applications. J Am Acad Dermatol 2022; 87:1352-1360. [PMID: 32428608 PMCID: PMC7669658 DOI: 10.1016/j.jaad.2020.05.053] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2020] [Revised: 05/07/2020] [Accepted: 05/08/2020] [Indexed: 01/14/2023]
Abstract
Because of a convergence of the availability of large data sets, graphics-specific computer hardware, and important theoretical advancements, artificial intelligence has recently contributed to dramatic progress in medicine. One type of artificial intelligence known as deep learning has been particularly impactful for medical image analysis. Deep learning applications have shown promising results in dermatology and other specialties, including radiology, cardiology, and ophthalmology. The modern clinician will benefit from an understanding of the basic features of deep learning to effectively use new applications and to better gauge their utility and limitations. In this second article of a 2-part series, we review the existing and emerging clinical applications of deep learning in dermatology and discuss future opportunities and limitations. Part 1 of this series offered an introduction to the basic concepts of deep learning to facilitate effective communication between clinicians and technical experts.
Collapse
Affiliation(s)
- Pranav Puri
- Mayo Clinic Alix School of Medicine, Scottsdale, Arizona; Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota
| | - Nneka Comfere
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota; Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, Minnesota.
| | - Lisa A Drage
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Huma Shamim
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Spencer A Bezalel
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Mark R Pittelkow
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Scottsdale, Arizona
| | - Mark D P Davis
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Michael Wang
- Department of Dermatology, University of California San Francisco, San Francisco, California
| | - Aaron R Mangold
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Scottsdale, Arizona
| | - Megha M Tollefson
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Julia S Lehman
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota; Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, Minnesota
| | - Alexander Meves
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | | | - Clark C Otley
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Rickey E Carter
- Department of Health Sciences Research, Division of Biomedical Statistics and Informatics, Mayo Clinic, Jacksonville, Florida
| | - Olayemi Sokumbi
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Jacksonville, Florida; Department of Laboratory Medicine and Pathology, Mayo Clinic, Jacksonville, Florida
| | - Matthew R Hall
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Jacksonville, Florida
| | - Alina G Bridges
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Dermatology, Mayo Clinic, Rochester, Minnesota; Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, Minnesota
| | - Dennis H Murphree
- Mayo Clinic Office of Artificial Intelligence in Dermatology, Rochester, Minnesota; Department of Health Sciences Research, Division of Digital Health Sciences, Mayo Clinic, Rochester, Minnesota
| |
Collapse
|
20
|
Qiao B, Jumai K, Ainiwaer J, Niyaz M, Zhang Y, Ma Y, Zhang L, Luh W, Sheyhidin I. A novel transfer-learning based physician-level general and subtype classifier for non-small cell lung cancer. Heliyon 2022; 8:e11981. [PMID: 36506384 PMCID: PMC9727670 DOI: 10.1016/j.heliyon.2022.e11981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 03/29/2022] [Accepted: 11/22/2022] [Indexed: 12/03/2022] Open
Abstract
Confirming histological patterns of lung carcinoma is important for determining the prognosis and the next steps of treatment for a patient. Confirming the histologic patterns (subtype) of lung adenocarcinoma is important for determining the prognosis and treatment options for a patient. The task is challenging, and often requires the input of experienced pathologists, who by themselves lack interobserver concordance. A computer-aided diagnosis holds the potential to accelerate the time to diagnosis. As many adenocarcinoma tissue samples contain multiple histologic patterns, accurate computer-aided diagnosis requires annotations manually labeled by pathologists. We propose a method that merges weak supervised learning and Integrated Learning using Transfer Learning using two datasets: The Cancer Genome Atlas (TCGA), and the Clinical Proteomic Tumor Analysis Consortium (CPTAC) to reduce the need for manual annotation by a pathologist while maintaining accuracy. Whole-slide images (WSI) are first determined to be either adenocarcinoma or squamous cell carcinoma, then further identify the subtypes by generating weak classifiers for each subtype, then using integrated learning to create a strong classifier. Our model was evaluated with independent datasets from the CPTAC dataset and a dataset from a private hospital. It can achieve AUC values of 0.86, 0.91, 0.82, 0.77, 0.96, 0.98 in Acinar, LPA, Micropapillary, Papillary, Solid, and Normal, respectively.
Collapse
Affiliation(s)
- Bingzhang Qiao
- Department of Thoracic Surgery, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China
| | - Kawuli Jumai
- Department of Thoracic Surgery, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China
| | - Julaiti Ainiwaer
- Department of Thoracic Surgery, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China
| | - Madinyat Niyaz
- Clinical Medicine Research Institute, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China
| | - Yingxin Zhang
- Jiaxing Qingge Medical Technologies Co. Ltd., Zhejiang, 314006, China
| | - Yuqing Ma
- Department of Pathology, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China
| | - Liwei Zhang
- Department of Thoracic Surgery, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China
| | - Wesley Luh
- New York University, New York, NY 10003,Singularity.ai, San Jose, CA 95129
| | - Ilyar Sheyhidin
- Department of Thoracic Surgery, First Affiliated Hospital of Xinjiang Medical University, No.137 Liyu Shan Road, Urumqi, Xinjiang 830054, China,Corresponding author.
| |
Collapse
|
21
|
Dubuc A, Zitouni A, Thomas C, Kémoun P, Cousty S, Monsarrat P, Laurencin S. Improvement of Mucosal Lesion Diagnosis with Machine Learning Based on Medical and Semiological Data: An Observational Study. J Clin Med 2022; 11:jcm11216596. [PMID: 36362822 PMCID: PMC9654969 DOI: 10.3390/jcm11216596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 11/01/2022] [Accepted: 11/02/2022] [Indexed: 11/09/2022] Open
Abstract
Despite artificial intelligence used in skin dermatology diagnosis is booming, application in oral pathology remains to be developed. Early diagnosis and therefore early management, remain key points in the successful management of oral mucosa cancers. The objective was to develop and evaluate a machine learning algorithm that allows the prediction of oral mucosa lesions diagnosis. This cohort study included patients followed between January 2015 and December 2020 in the oral mucosal pathology consultation of the Toulouse University Hospital. Photographs and demographic and medical data were collected from each patient to constitute clinical cases. A machine learning model was then developed and optimized and compared to 5 models classically used in the field. A total of 299 patients representing 1242 records of oral mucosa lesions were used to train and evaluate machine learning models. Our model reached a mean accuracy of 0.84 for diagnostic prediction. The specificity and sensitivity range from 0.89 to 1.00 and 0.72 to 0.92, respectively. The other models were proven to be less efficient in performing this task. These results suggest the utility of machine learning-based tools in diagnosing oral mucosal lesions with high accuracy. Moreover, the results of this study confirm that the consideration of clinical data and medical history, in addition to the lesion itself, appears to play an important role.
Collapse
Affiliation(s)
- Antoine Dubuc
- School of Dental Medicine and CHU de Toulouse—Toulouse Institute of Oral Medicine and Science, 31062 Toulouse, France
- Center for Epidemiology and Research in POPulation Health (CERPOP), UMR 1295, Paul Sabatier University, 31062 Toulouse, France
| | - Anissa Zitouni
- Oral Surgery and Oral Medicine Department, CHU Limoges, 87000 Limoges, France
| | - Charlotte Thomas
- School of Dental Medicine and CHU de Toulouse—Toulouse Institute of Oral Medicine and Science, 31062 Toulouse, France
- InCOMM, I2MC, UMR 1297, Paul Sabatier University, 31062 Toulouse, France
| | - Philippe Kémoun
- School of Dental Medicine and CHU de Toulouse—Toulouse Institute of Oral Medicine and Science, 31062 Toulouse, France
- RESTORE Research Center, Université de Toulouse, INSERM, CNRS, EFS, ENVT, Université P. Sabatier, CHU de Toulouse, 31300 Toulouse, France
| | - Sarah Cousty
- School of Dental Medicine and CHU de Toulouse—Toulouse Institute of Oral Medicine and Science, 31062 Toulouse, France
- LAPLACE, UMR 5213 CNRS, Paul Sabatier University, 31062 Toulouse, France
| | - Paul Monsarrat
- School of Dental Medicine and CHU de Toulouse—Toulouse Institute of Oral Medicine and Science, 31062 Toulouse, France
- RESTORE Research Center, Université de Toulouse, INSERM, CNRS, EFS, ENVT, Université P. Sabatier, CHU de Toulouse, 31300 Toulouse, France
- Artificial and Natural Intelligence Toulouse Institute ANITI, 31013 Toulouse, France
| | - Sara Laurencin
- School of Dental Medicine and CHU de Toulouse—Toulouse Institute of Oral Medicine and Science, 31062 Toulouse, France
- Center for Epidemiology and Research in POPulation Health (CERPOP), UMR 1295, Paul Sabatier University, 31062 Toulouse, France
- Correspondence:
| |
Collapse
|
22
|
Zhang S, Wang Y, Zheng Q, Li J, Huang J, Long X. Artificial intelligence in melanoma: A systematic review. J Cosmet Dermatol 2022; 21:5993-6004. [PMID: 36001057 DOI: 10.1111/jocd.15323] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 08/12/2022] [Accepted: 08/19/2022] [Indexed: 12/27/2022]
Abstract
BACKGROUND Melanoma accounts for the majority of skin cancer deaths. Artificial intelligence has been applied in many types of cancers, and in melanoma in recent years. However, no systematic review summarized the application of artificial intelligence in melanoma. AIMS This study aims to systematically review previously published articles to explore the application of artificial intelligence in melanoma. MATERIALS & METHODS PubMed database was used to search the eligible publications on August 1, 2020. The query term was "artificial intelligence" and "melanoma." RESULTS A total of 51 articles were included in this review. Artificial intelligence technique is mainly used in the evaluation of dermoscopic images, other image segmentation and processing, and artificial intelligence diagnosis system. DISCUSSION Artificial intelligence is also applied in metastasis prediction, drug response prediction, and prognosis of melanoma. Besides, patients' perspectives of artificial intelligence and collaboration of human and artificial intelligence in melanoma also attracted attention. The query term might not include all articles, and we could not examine the algorithms that were built without publication. CONCLUSION The performance of artificial intelligence in melanoma is satisfactory and the future for potential applications is enormous.
Collapse
Affiliation(s)
- Shu Zhang
- Department of Dermatology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Yuanzhuo Wang
- Department of Dermatology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Qingyue Zheng
- Department of Dermatology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Jiarui Li
- Department of Medical Oncology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Jiuzuo Huang
- Department of Plastic Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Xiao Long
- Department of Plastic Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| |
Collapse
|
23
|
Alonso-Belmonte C, Montero-Vilchez T, Arias-Santiago S, Buendía-Eisman A. [Translated article] Current State of Skin Cancer Prevention: A Systematic Review. ACTAS DERMO-SIFILIOGRAFICAS 2022. [DOI: 10.1016/j.ad.2022.04.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
|
24
|
Situación actual de la prevención del cáncer de piel: una revisión sistemática. ACTAS DERMO-SIFILIOGRAFICAS 2022; 113:781-791. [DOI: 10.1016/j.ad.2022.04.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Revised: 04/03/2022] [Accepted: 04/12/2022] [Indexed: 11/20/2022] Open
|
25
|
Escalé-Besa A, Fuster-Casanovas A, Börve A, Yélamos O, Fustà-Novell X, Esquius Rafat M, Marin-Gomez FX, Vidal-Alaball J. Using Artificial Intelligence as a Diagnostic Decision Support Tool in Skin Disease: Protocol for an Observational Prospective Cohort Study. JMIR Res Protoc 2022. [PMID: 36044249 PMCID: PMC9475422 DOI: 10.2196/37531 ] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Dermatological conditions are a relevant health problem. Each person has an average of 1.6 skin diseases per year, and consultations for skin pathology represent 20% of the total annual visits to primary care and around 35% are referred to a dermatology specialist. Machine learning (ML) models can be a good tool to help primary care professionals, as it can analyze and optimize complex sets of data. In addition, ML models are increasingly being applied to dermatology as a diagnostic decision support tool using image analysis, especially for skin cancer detection and classification. OBJECTIVE This study aims to perform a prospective validation of an image analysis ML model as a diagnostic decision support tool for the diagnosis of dermatological conditions. METHODS In this prospective study, 100 consecutive patients who visit a participant general practitioner (GP) with a skin problem in central Catalonia were recruited. Data collection was planned to last 7 months. Anonymized pictures of skin diseases were taken and introduced to the ML model interface (capable of screening for 44 different skin diseases), which returned the top 5 diagnoses by probability. The same image was also sent as a teledermatology consultation following the current stablished workflow. The GP, ML model, and dermatologist's assessments will be compared to calculate the precision, sensitivity, specificity, and accuracy of the ML model. The results will be represented globally and individually for each skin disease class using a confusion matrix and one-versus-all methodology. The time taken to make the diagnosis will also be taken into consideration. RESULTS Patient recruitment began in June 2021 and lasted for 5 months. Currently, all patients have been recruited and the images have been shown to the GPs and dermatologists. The analysis of the results has already started. CONCLUSIONS This study will provide information about ML models' effectiveness and limitations. External testing is essential for regulating these diagnostic systems to deploy ML models in a primary care practice setting.
Collapse
Affiliation(s)
- Anna Escalé-Besa
- Centre d'Atenció Primària Navàs-Balsareny, Institut Català de la Salut, Navàs, Spain
| | - Aïna Fuster-Casanovas
- Unitat de Suport a la Recerca de la Catalunya Central, Fundació Institut Universitari per a la Recerca a l'Atenció Primària de Salut Jordi Gol i Gurina, Sant Fruitós de Bages, Spain
- Health Promotion in Rural Areas Research Group, Gerència Territorial de la Catalunya Central, Institut Català de la Salut, Sant Fruitós de Bages, Spain
| | - Alexander Börve
- iDoc24 Inc, San Francisco, CA, United States
- Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Oriol Yélamos
- Dermatology Department, Hospital de la Santa Creu i Sant Pau, Universitat Autònoma de Barcelona, Barcelona, Spain
| | | | | | - Francesc X Marin-Gomez
- Servei d'Atenció Primària Osona, Gerència Territorial de Barcelona, Institut Català de la Salut, Vic, Spain
| | - Josep Vidal-Alaball
- Unitat de Suport a la Recerca de la Catalunya Central, Fundació Institut Universitari per a la Recerca a l'Atenció Primària de Salut Jordi Gol i Gurina, Sant Fruitós de Bages, Spain
- Health Promotion in Rural Areas Research Group, Gerència Territorial de la Catalunya Central, Institut Català de la Salut, Sant Fruitós de Bages, Spain
- Faculty of Medicine, University of Vic-Central University of Catalonia, Vic, Spain
| |
Collapse
|
26
|
Escalé-Besa A, Fuster-Casanovas A, Börve A, Yélamos O, Fustà-Novell X, Esquius Rafat M, Marin-Gomez FX, Vidal-Alaball J. Using Artificial Intelligence as a Diagnostic Decision Support Tool in Skin Disease: Protocol for an Observational Prospective Cohort Study. JMIR Res Protoc 2022; 11:e37531. [PMID: 36044249 PMCID: PMC9475422 DOI: 10.2196/37531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 05/11/2022] [Accepted: 05/12/2022] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Dermatological conditions are a relevant health problem. Each person has an average of 1.6 skin diseases per year, and consultations for skin pathology represent 20% of the total annual visits to primary care and around 35% are referred to a dermatology specialist. Machine learning (ML) models can be a good tool to help primary care professionals, as it can analyze and optimize complex sets of data. In addition, ML models are increasingly being applied to dermatology as a diagnostic decision support tool using image analysis, especially for skin cancer detection and classification. OBJECTIVE This study aims to perform a prospective validation of an image analysis ML model as a diagnostic decision support tool for the diagnosis of dermatological conditions. METHODS In this prospective study, 100 consecutive patients who visit a participant general practitioner (GP) with a skin problem in central Catalonia were recruited. Data collection was planned to last 7 months. Anonymized pictures of skin diseases were taken and introduced to the ML model interface (capable of screening for 44 different skin diseases), which returned the top 5 diagnoses by probability. The same image was also sent as a teledermatology consultation following the current stablished workflow. The GP, ML model, and dermatologist's assessments will be compared to calculate the precision, sensitivity, specificity, and accuracy of the ML model. The results will be represented globally and individually for each skin disease class using a confusion matrix and one-versus-all methodology. The time taken to make the diagnosis will also be taken into consideration. RESULTS Patient recruitment began in June 2021 and lasted for 5 months. Currently, all patients have been recruited and the images have been shown to the GPs and dermatologists. The analysis of the results has already started. CONCLUSIONS This study will provide information about ML models' effectiveness and limitations. External testing is essential for regulating these diagnostic systems to deploy ML models in a primary care practice setting.
Collapse
Affiliation(s)
- Anna Escalé-Besa
- Centre d'Atenció Primària Navàs-Balsareny, Institut Català de la Salut, Navàs, Spain
| | - Aïna Fuster-Casanovas
- Unitat de Suport a la Recerca de la Catalunya Central, Fundació Institut Universitari per a la Recerca a l'Atenció Primària de Salut Jordi Gol i Gurina, Sant Fruitós de Bages, Spain
- Health Promotion in Rural Areas Research Group, Gerència Territorial de la Catalunya Central, Institut Català de la Salut, Sant Fruitós de Bages, Spain
| | - Alexander Börve
- iDoc24 Inc, San Francisco, CA, United States
- Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Oriol Yélamos
- Dermatology Department, Hospital de la Santa Creu i Sant Pau, Universitat Autònoma de Barcelona, Barcelona, Spain
| | | | | | - Francesc X Marin-Gomez
- Servei d'Atenció Primària Osona, Gerència Territorial de Barcelona, Institut Català de la Salut, Vic, Spain
| | - Josep Vidal-Alaball
- Unitat de Suport a la Recerca de la Catalunya Central, Fundació Institut Universitari per a la Recerca a l'Atenció Primària de Salut Jordi Gol i Gurina, Sant Fruitós de Bages, Spain
- Health Promotion in Rural Areas Research Group, Gerència Territorial de la Catalunya Central, Institut Català de la Salut, Sant Fruitós de Bages, Spain
- Faculty of Medicine, University of Vic-Central University of Catalonia, Vic, Spain
| |
Collapse
|
27
|
Aldhyani THH, Verma A, Al-Adhaileh MH, Koundal D. Multi-Class Skin Lesion Classification Using a Lightweight Dynamic Kernel Deep-Learning-Based Convolutional Neural Network. Diagnostics (Basel) 2022; 12:diagnostics12092048. [PMID: 36140447 PMCID: PMC9497471 DOI: 10.3390/diagnostics12092048] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 08/20/2022] [Accepted: 08/22/2022] [Indexed: 11/16/2022] Open
Abstract
Skin is the primary protective layer of the internal organs of the body. Nowadays, due to increasing pollution and multiple other factors, various types of skin diseases are growing globally. With variable shapes and multiple types, the classification of skin lesions is a challenging task. Motivated by this spreading deformity in society, a lightweight and efficient model is proposed for the highly accurate classification of skin lesions. Dynamic-sized kernels are used in layers to obtain the best results, resulting in very few trainable parameters. Further, both ReLU and leakyReLU activation functions are purposefully used in the proposed model. The model accurately classified all of the classes of the HAM10000 dataset. The model achieved an overall accuracy of 97.85%, which is much better than multiple state-of-the-art heavy models. Further, our work is compared with some popular state-of-the-art and recent existing models.
Collapse
Affiliation(s)
- Theyazn H. H. Aldhyani
- Applied College in Abqaiq, King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia
- Correspondence:
| | - Amit Verma
- School of Computer Science, University of Petroleum & Energy Studies, Dehradun 248007, India
| | - Mosleh Hmoud Al-Adhaileh
- Deanship of E-Learning and Distance Education, King Faisal University, P.O. Box 4000, Al-Ahsa 31982, Saudi Arabia
| | - Deepika Koundal
- School of Computer Science, University of Petroleum & Energy Studies, Dehradun 248007, India
| |
Collapse
|
28
|
Shoham G, Berl A, Shir‐az O, Shabo S, Shalom A. Predicting Mohs surgery complexity by applying machine learning to patient demographics and tumor characteristics. Exp Dermatol 2022; 31:1029-1035. [PMID: 35213063 PMCID: PMC9543558 DOI: 10.1111/exd.14550] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 02/14/2022] [Accepted: 02/20/2022] [Indexed: 11/27/2022]
Abstract
Mohs micrographic surgery (MMS) is considered the gold standard for difficult-to-treat malignant skin tumors, whose incidence is on the rise. Currently, there are no agreed upon classifiers to predict complex MMS procedures. Such classifiers could enable better patient scheduling, reduce staff burnout and improve patient education. Our goal was to create an accessible and interpretable classifier(s) that would predict complex MMS procedures. A retrospective study applying machine learning models to a dataset of 8644 MMS procedures to predict complex wound reconstruction and number of MMS procedure stages. Each procedure record contained preoperative data on patient demographics, estimated clinical tumor size prior to surgery (mean diameter), tumor characteristics and tumor location, and postoperative procedure outcomes included the wound reconstruction technique and the number of MMS stages performed in order to achieve tumor-free margins. For the number of stages complexity classification model, the area under the receiver operating characteristic curve (AUROC) was 0.79 (good performance), with model accuracy of 77%, sensitivity of 71%, specificity of 77%, positive prediction value (PPV) of 14% and negative prediction value (NPV) of 98%. The results for the wound reconstruction complexity classification model were 0.84 for the AUROC (excellent performance), with model accuracy of 75%, sensitivity of 72%, specificity of 76%, PPV of 39% and NPV of 93%. The ML models we created predict the complexity of the components that comprise the MMS procedure. Using the accessible and interpretable tool we provide online, clinicians can improve the management and well-being of their patients. Study limitation is that models are based on data generated from a single surgeon.
Collapse
Affiliation(s)
- Gon Shoham
- Department of Plastic SurgeryMeir Medical CenterKfar SabaIsrael
- Sackler Faculty of MedicineTel Aviv UniversityTel AvivIsrael
- The Department of Biomedical EngineeringThe Iby and Aladar Fleischman Faculty of EngineeringTel Aviv UniversityTel AvivIsrael
| | - Ariel Berl
- Department of Plastic SurgeryMeir Medical CenterKfar SabaIsrael
| | - Ofir Shir‐az
- Department of Plastic SurgeryMeir Medical CenterKfar SabaIsrael
| | - Sharon Shabo
- Department of Plastic SurgeryMeir Medical CenterKfar SabaIsrael
| | - Avshalom Shalom
- Department of Plastic SurgeryMeir Medical CenterKfar SabaIsrael
- Sackler Faculty of MedicineTel Aviv UniversityTel AvivIsrael
| |
Collapse
|
29
|
Fitzsimmons L, Dewan M, Dexheimer JW. Diversity in Machine Learning: A Systematic Review of Text-Based Diagnostic Applications. Appl Clin Inform 2022; 13:569-582. [PMID: 35613914 DOI: 10.1055/s-0042-1749119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022] Open
Abstract
OBJECTIVE As the storage of clinical data has transitioned into electronic formats, medical informatics has become increasingly relevant in providing diagnostic aid. The purpose of this review is to evaluate machine learning models that use text data for diagnosis and to assess the diversity of the included study populations. METHODS We conducted a systematic literature review on three public databases. Two authors reviewed every abstract for inclusion. Articles were included if they used or developed machine learning algorithms to aid in diagnosis. Articles focusing on imaging informatics were excluded. RESULTS From 2,260 identified papers, we included 78. Of the machine learning models used, neural networks were relied upon most frequently (44.9%). Studies had a median population of 661.5 patients, and diseases and disorders of 10 different body systems were studied. Of the 35.9% (N = 28) of papers that included race data, 57.1% (N = 16) of study populations were majority White, 14.3% were majority Asian, and 7.1% were majority Black. In 75% (N = 21) of papers, White was the largest racial group represented. Of the papers included, 43.6% (N = 34) included the sex ratio of the patient population. DISCUSSION With the power to build robust algorithms supported by massive quantities of clinical data, machine learning is shaping the future of diagnostics. Limitations of the underlying data create potential biases, especially if patient demographics are unknown or not included in the training. CONCLUSION As the movement toward clinical reliance on machine learning accelerates, both recording demographic information and using diverse training sets should be emphasized. Extrapolating algorithms to demographics beyond the original study population leaves large gaps for potential biases.
Collapse
Affiliation(s)
- Lane Fitzsimmons
- College of Agriculture and Life Science, Cornell University, Ithaca, New York, United States
| | - Maya Dewan
- Division of Critical Care Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States.,Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States
| | - Judith W Dexheimer
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.,Division of Emergency Medicine; Division of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
| |
Collapse
|
30
|
Willem T, Krammer S, Böhm A, French LE, Hartmann D, Lasser T, Buyx A. Risks and benefits of dermatological machine learning healthcare applications – an overview and ethical analysis. J Eur Acad Dermatol Venereol 2022; 36:1660-1668. [DOI: 10.1111/jdv.18192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 04/07/2022] [Indexed: 11/30/2022]
Affiliation(s)
- Theresa Willem
- Technical University of Munich School of Medicine, Institute of History and Ethics in Medicine Germany
- Technical University of Munich School of Social Sciences and Technology, Department of Science, Technology and Society (STS)
| | - Sebastian Krammer
- Ludwig Maximilian University of Munich Department of Dermatology and Allergology Munich Germany
| | - Anne‐Sophie Böhm
- Ludwig Maximilian University of Munich Department of Dermatology and Allergology Munich Germany
| | - Lars E. French
- Ludwig Maximilian University of Munich Department of Dermatology and Allergology Munich Germany
- Dr. Philip Frost Department of Dermatology and Cutaneous Surgery University of Miami Miller School of Medicine Miami FL USA
| | - Daniela Hartmann
- Ludwig Maximilian University of Munich Department of Dermatology and Allergology Munich Germany
| | - Tobias Lasser
- Technical University of Munich School of Computation, Information and Technology, Department of Informatics Germany
- Technical University of Munich Institute of Biomedical Engineering Germany Munich
| | - Alena Buyx
- Technical University of Munich School of Medicine, Institute of History and Ethics in Medicine Germany
| |
Collapse
|
31
|
Novel Machine Learning Approach for the Prediction of Hernia Recurrence, Surgical Complication, and 30-Day Readmission after Abdominal Wall Reconstruction. J Am Coll Surg 2022; 234:918-927. [DOI: 10.1097/xcs.0000000000000141] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
32
|
Melanoma Classification Using a Novel Deep Convolutional Neural Network with Dermoscopic Images. SENSORS 2022; 22:s22031134. [PMID: 35161878 PMCID: PMC8838143 DOI: 10.3390/s22031134] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 01/18/2022] [Accepted: 01/27/2022] [Indexed: 02/01/2023]
Abstract
Automatic melanoma detection from dermoscopic skin samples is a very challenging task. However, using a deep learning approach as a machine vision tool can overcome some challenges. This research proposes an automated melanoma classifier based on a deep convolutional neural network (DCNN) to accurately classify malignant vs. benign melanoma. The structure of the DCNN is carefully designed by organizing many layers that are responsible for extracting low to high-level features of the skin images in a unique fashion. Other vital criteria in the design of DCNN are the selection of multiple filters and their sizes, employing proper deep learning layers, choosing the depth of the network, and optimizing hyperparameters. The primary objective is to propose a lightweight and less complex DCNN than other state-of-the-art methods to classify melanoma skin cancer with high efficiency. For this study, dermoscopic images containing different cancer samples were obtained from the International Skin Imaging Collaboration datastores (ISIC 2016, ISIC2017, and ISIC 2020). We evaluated the model based on accuracy, precision, recall, specificity, and F1-score. The proposed DCNN classifier achieved accuracies of 81.41%, 88.23%, and 90.42% on the ISIC 2016, 2017, and 2020 datasets, respectively, demonstrating high performance compared with the other state-of-the-art networks. Therefore, this proposed approach could provide a less complex and advanced framework for automating the melanoma diagnostic process and expediting the identification process to save a life.
Collapse
|
33
|
Pettit RW, Fullem R, Cheng C, Amos CI. Artificial intelligence, machine learning, and deep learning for clinical outcome prediction. Emerg Top Life Sci 2021; 5:ETLS20210246. [PMID: 34927670 PMCID: PMC8786279 DOI: 10.1042/etls20210246] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 12/03/2021] [Accepted: 12/07/2021] [Indexed: 12/12/2022]
Abstract
AI is a broad concept, grouping initiatives that use a computer to perform tasks that would usually require a human to complete. AI methods are well suited to predict clinical outcomes. In practice, AI methods can be thought of as functions that learn the outcomes accompanying standardized input data to produce accurate outcome predictions when trialed with new data. Current methods for cleaning, creating, accessing, extracting, augmenting, and representing data for training AI clinical prediction models are well defined. The use of AI to predict clinical outcomes is a dynamic and rapidly evolving arena, with new methods and applications emerging. Extraction or accession of electronic health care records and combining these with patient genetic data is an area of present attention, with tremendous potential for future growth. Machine learning approaches, including decision tree methods of Random Forest and XGBoost, and deep learning techniques including deep multi-layer and recurrent neural networks, afford unique capabilities to accurately create predictions from high dimensional, multimodal data. Furthermore, AI methods are increasing our ability to accurately predict clinical outcomes that previously were difficult to model, including time-dependent and multi-class outcomes. Barriers to robust AI-based clinical outcome model deployment include changing AI product development interfaces, the specificity of regulation requirements, and limitations in ensuring model interpretability, generalizability, and adaptability over time.
Collapse
Affiliation(s)
- Rowland W. Pettit
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
| | - Robert Fullem
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, U.S.A
| | - Chao Cheng
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
| | - Christopher I. Amos
- Institute for Clinical and Translational Research, Baylor College of Medicine, Houston, TX, U.S.A
- Section of Epidemiology and Population Sciences, Department of Medicine, Baylor College of Medicine, Houston, TX, U.S.A
- Dan L Duncan Comprehensive Cancer Center, Baylor College of Medicine, Houston, TX, U.S.A
| |
Collapse
|
34
|
Ma EZ, Hoegler KM, Zhou AE. Bioinformatic and Machine Learning Applications in Melanoma Risk Assessment and Prognosis: A Literature Review. Genes (Basel) 2021; 12:1751. [PMID: 34828357 PMCID: PMC8621295 DOI: 10.3390/genes12111751] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 10/19/2021] [Accepted: 10/28/2021] [Indexed: 12/20/2022] Open
Abstract
Over 100,000 people are diagnosed with cutaneous melanoma each year in the United States. Despite recent advancements in metastatic melanoma treatment, such as immunotherapy, there are still over 7000 melanoma-related deaths each year. Melanoma is a highly heterogenous disease, and many underlying genetic drivers have been identified since the introduction of next-generation sequencing. Despite clinical staging guidelines, the prognosis of metastatic melanoma is variable and difficult to predict. Bioinformatic and machine learning analyses relying on genetic, clinical, and histopathologic inputs have been increasingly used to risk stratify melanoma patients with high accuracy. This literature review summarizes the key genetic drivers of melanoma and recent applications of bioinformatic and machine learning models in the risk stratification of melanoma patients. A robustly validated risk stratification tool can potentially guide the physician management of melanoma patients and ultimately improve patient outcomes.
Collapse
Affiliation(s)
| | | | - Albert E. Zhou
- Department of Dermatology, University of Maryland School of Medicine, Baltimore, MD 21230, USA; (E.Z.M.); (K.M.H.)
| |
Collapse
|
35
|
Moran KR, Turner EL, Dunson D, Herring AH. Bayesian hierarchical factor regression models to infer cause of death from verbal autopsy data. J R Stat Soc Ser C Appl Stat 2021; 70:532-557. [PMID: 34334826 PMCID: PMC8320757 DOI: 10.1111/rssc.12468] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
In low-resource settings where vital registration of death is not routine it is often of critical interest to determine and study the cause of death (COD) for individuals and the cause-specific mortality fraction (CSMF) for populations. Post-mortem autopsies, considered the gold standard for COD assignment, are often difficult or impossible to implement due to deaths occurring outside the hospital, expense, and/or cultural norms. For this reason, Verbal Autopsies (VAs) are commonly conducted, consisting of a questionnaire administered to next of kin recording demographic information, known medical conditions, symptoms, and other factors for the decedent. This article proposes a novel class of hierarchical factor regression models that avoid restrictive assumptions of standard methods, allow both the mean and covariance to vary with COD category, and can include covariate information on the decedent, region, or events surrounding death. Taking a Bayesian approach to inference, this work develops an MCMC algorithm and validates the FActor Regression for Verbal Autopsy (FARVA) model in simulation experiments. An application of FARVA to real VA data shows improved goodness-of-fit and better predictive performance in inferring COD and CSMF over competing methods. Code and a user manual are made available at https://github.com/kelrenmor/farva.
Collapse
Affiliation(s)
- Kelly R. Moran
- Statistical Sciences Group, Los Alamos National Laboratory, Los Alamos, NM, USA
| | - Elizabeth L. Turner
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
- Duke Global Health Institute, Duke University, Durham, NC, USA
| | - David Dunson
- Department of Statistical Science, Duke University, Durham, NC, USA
- Department of Mathematics, Duke University, Durham, NC, USA
| | - Amy H. Herring
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
- Duke Global Health Institute, Duke University, Durham, NC, USA
- Department of Statistical Science, Duke University, Durham, NC, USA
| |
Collapse
|
36
|
Zhao Z, Wu CM, Zhang S, He F, Liu F, Wang B, Huang Y, Shi W, Jian D, Xie H, Yeh CY, Li J. A Novel Convolutional Neural Network for the Diagnosis and Classification of Rosacea: Usability Study. JMIR Med Inform 2021; 9:e23415. [PMID: 33720027 PMCID: PMC8077711 DOI: 10.2196/23415] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Revised: 11/30/2020] [Accepted: 12/12/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Rosacea is a chronic inflammatory disease with variable clinical presentations, including transient flushing, fixed erythema, papules, pustules, and phymatous changes on the central face. Owing to the diversity in the clinical manifestations of rosacea, the lack of objective biochemical examinations, and nonspecificity in histopathological findings, accurate identification of rosacea is a big challenge. Artificial intelligence has emerged as a potential tool in the identification and evaluation of some skin diseases such as melanoma, basal cell carcinoma, and psoriasis. OBJECTIVE The objective of our study was to utilize a convolutional neural network (CNN) to differentiate the clinical photos of patients with rosacea (taken from 3 different angles) from those of patients with other skin diseases such as acne, seborrheic dermatitis, and eczema that could be easily confused with rosacea. METHODS In this study, 24,736 photos comprising of 18,647 photos of patients with rosacea and 6089 photos of patients with other skin diseases such as acne, facial seborrheic dermatitis, and eczema were included and analyzed by our CNN model based on ResNet-50. RESULTS The CNN in our study achieved an overall accuracy and precision of 0.914 and 0.898, with an area under the receiver operating characteristic curve of 0.972 for the detection of rosacea. The accuracy of classifying 3 subtypes of rosacea, that is, erythematotelangiectatic rosacea, papulopustular rosacea, and phymatous rosacea was 83.9%, 74.3%, and 80.0%, respectively. Moreover, the accuracy and precision of our CNN to distinguish rosacea from acne reached 0.931 and 0.893, respectively. For the differentiation between rosacea, seborrheic dermatitis, and eczema, the overall accuracy of our CNN was 0.757 and the precision was 0.667. Finally, by comparing the CNN diagnosis with the diagnoses by dermatologists of different expertise levels, we found that our CNN system is capable of identifying rosacea with a performance superior to that of resident doctors or attending physicians and comparable to that of experienced dermatologists. CONCLUSIONS The findings of our study showed that by assessing clinical images, the CNN system in our study could identify rosacea with accuracy and precision comparable to that of an experienced dermatologist.
Collapse
Affiliation(s)
- Zhixiang Zhao
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | | | - Shuping Zhang
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Fanping He
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Fangfen Liu
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Ben Wang
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Yingxue Huang
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Wei Shi
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Dan Jian
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Hongfu Xie
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | | | - Ji Li
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital of Central South University, Changsha, China
- Key Laboratory of Organ Injury, Aging and Regenerative Medicine of Hunan Province, Changsha, China
| |
Collapse
|
37
|
Mehrabi JN, Baugh EG, Fast A, Lentsch G, Balu M, Lee BA, Kelly KM. A Clinical Perspective on the Automated Analysis of Reflectance Confocal Microscopy in Dermatology. Lasers Surg Med 2021; 53:1011-1019. [PMID: 33476062 DOI: 10.1002/lsm.23376] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Revised: 10/30/2020] [Accepted: 12/25/2020] [Indexed: 01/03/2023]
Abstract
BACKGROUND AND OBJECTIVES Non-invasive optical imaging has the potential to provide a diagnosis without the need for biopsy. One such technology is reflectance confocal microscopy (RCM), which uses low power, near-infrared laser light to enable real-time in vivo visualization of superficial human skin from the epidermis down to the papillary dermis. Although RCM has great potential as a diagnostic tool, there is a need for the development of reliable image analysis programs, as acquired grayscale images can be difficult and time-consuming to visually assess. The purpose of this review is to provide a clinical perspective on the current state of artificial intelligence (AI) for the analysis and diagnostic utility of RCM imaging. STUDY DESIGN/MATERIALS AND METHODS A systematic PubMed search was conducted with additional relevant literature obtained from reference lists. RESULTS Algorithms used for skin stratification, classification of pigmented lesions, and the quantification of photoaging were reviewed. Image segmentation, statistical methods, and machine learning techniques are among the most common methods used to analyze RCM image stacks. The poor visual contrast within RCM images and difficulty navigating image stacks were mediated by machine learning algorithms, which allowed the identification of specific skin layers. CONCLUSIONS AI analysis of RCM images has the potential to increase the clinical utility of this emerging technology. A number of different techniques have been utilized but further refinements are necessary to allow consistent accurate assessments for diagnosis. The automated detection of skin cancers requires more development, but future applications are truly boundless, and it is compelling to envision the role that AI will have in the practice of dermatology. Lasers Surg. Med. © 2020 Wiley Periodicals LLC.
Collapse
Affiliation(s)
- Joseph N Mehrabi
- Department of Dermatology, University of California, Irvine, California, 92697
| | - Erica G Baugh
- Department of Dermatology, University of California, Irvine, California, 92697
| | - Alexander Fast
- Beckman Laser Institute, University of California Irvine, Irvine, California, 92612
| | - Griffin Lentsch
- Beckman Laser Institute, University of California Irvine, Irvine, California, 92612
| | - Mihaela Balu
- Beckman Laser Institute, University of California Irvine, Irvine, California, 92612
| | - Bonnie A Lee
- Department of Dermatology, University of California, Irvine, California, 92697
| | - Kristen M Kelly
- Department of Dermatology, University of California, Irvine, California, 92697.,Beckman Laser Institute, University of California Irvine, Irvine, California, 92612
| |
Collapse
|
38
|
Kothapalli A, Staecker H, Mellott AJ. Supervised machine learning for automated classification of human Wharton's Jelly cells and mechanosensory hair cells. PLoS One 2021; 16:e0245234. [PMID: 33417611 PMCID: PMC7793269 DOI: 10.1371/journal.pone.0245234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 12/23/2020] [Indexed: 11/23/2022] Open
Abstract
Tissue engineering and gene therapy strategies offer new ways to repair permanent damage to mechanosensory hair cells (MHCs) by differentiating human Wharton's Jelly cells (HWJCs). Conventionally, these strategies require the classification of each cell as differentiated or undifferentiated. Automated classification tools, however, may serve as a novel method to rapidly classify these cells. In this paper, images from previous work, where HWJCs were differentiated into MHC-like cells, were examined. Various cell features were extracted from these images, and those which were pertinent to classification were identified. Different machine learning models were then developed, some using all extracted data and some using only certain features. To evaluate model performance, the area under the curve (AUC) of the receiver operating characteristic curve was primarily used. This paper found that limiting algorithms to certain features consistently improved performance. The top performing model, a voting classifier model consisting of two logistic regressions, a support vector machine, and a random forest classifier, obtained an AUC of 0.9638. Ultimately, this paper illustrates the viability of a novel machine learning pipeline to automate the classification of undifferentiated and differentiated cells. In the future, this research could aid in automated strategies that determine the viability of MHC-like cells after differentiation.
Collapse
Affiliation(s)
- Abihith Kothapalli
- Blue Valley West High School, Overland Park, KS, United States of America
| | - Hinrich Staecker
- Department of Otolaryngology, Head and Neck Surgery, University of Kansas Medical Center, Kansas City, KS, United States of America
| | - Adam J. Mellott
- Department of Plastic Surgery, University of Kansas Medical Center, Kansas City, KS, United States of America
| |
Collapse
|
39
|
Affiliation(s)
- Carrie L Kovarik
- Perelman School of Medicine, Department of Dermatology, University of Pennsylvania, Philadelphia
| |
Collapse
|
40
|
Eapen BR. Artificial Intelligence in Dermatology: A Practical Introduction to a Paradigm Shift. Indian Dermatol Online J 2020; 11:881-889. [PMID: 33344334 PMCID: PMC7735013 DOI: 10.4103/idoj.idoj_388_20] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Revised: 07/27/2020] [Accepted: 09/13/2020] [Indexed: 12/13/2022] Open
Abstract
Artificial Intelligence (AI) has surpassed dermatologists in skin cancer detection, but dermatology still lags behind radiology in its broader adoption. Building and using AI applications are becoming increasingly accessible. However, complex use cases may still require specialized expertise for design and deployment. AI has many applications in dermatology ranging from fundamental research, diagnostics, therapeutics, and cosmetic dermatology. The lack of standardization of images and privacy concerns are the foremost challenges stifling AI adoption. Dermatologists have a significant role to play in standardized data collection, curating data for machine learning, clinically validating AI solutions, and ultimately adopting this paradigm shift that is changing the way we practice.
Collapse
Affiliation(s)
- Bell R. Eapen
- Information Systems, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
41
|
Thomsen K, Christensen AL, Iversen L, Lomholt HB, Winther O. Deep Learning for Diagnostic Binary Classification of Multiple-Lesion Skin Diseases. Front Med (Lausanne) 2020; 7:574329. [PMID: 33072786 PMCID: PMC7536339 DOI: 10.3389/fmed.2020.574329] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Accepted: 08/24/2020] [Indexed: 11/13/2022] Open
Abstract
Background: Diagnosis of skin diseases is often challenging and computer-aided diagnostic tools are urgently needed to underpin decision making. Objective: To develop a convolutional neural network model to classify clinically relevant selected multiple-lesion skin diseases, this in accordance to the STARD guidelines. Methods: This was an image-based retrospective study using multi-task learning for binary classification. A VGG-16 model was trained on 16,543 non-standardized images. Image data was distributed in training set (80%), validation set (10%), and test set (10%). All images were collected from a clinical database of a Danish population attending one dermatological department. Included was patients categorized with ICD-10 codes related to acne, rosacea, psoriasis, eczema, and cutaneous t-cell lymphoma. Results: Acne was distinguished from rosacea with a sensitivity of 85.42% CI 72.24–93.93% and a specificity of 89.53% CI 83.97–93.68%, cutaneous t-cell lymphoma was distinguished from eczema with a sensitivity of 74.29% CI 67.82–80.05% and a specificity of 84.09% CI 80.83–86.99%, and psoriasis from eczema with a sensitivity of 81.79% CI 78.51–84.76% and a specificity of 73.57% CI 69.76–77.13%. All results were based on the test set. Conclusion: The performance rates reported were equal or superior to those reported for general practitioners with dermatological training, indicating that computer-aided diagnostic models based on convolutional neural network may potentially be employed for diagnosing multiple-lesion skin diseases.
Collapse
Affiliation(s)
- Kenneth Thomsen
- Department of Dermatology and Venereology, Aarhus University Hospital, Aarhus, Denmark
| | - Anja Liljedahl Christensen
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark
| | - Lars Iversen
- Department of Dermatology and Venereology, Aarhus University Hospital, Aarhus, Denmark
| | | | - Ole Winther
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Lyngby, Denmark.,Center for Genomic Medicine, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark.,Department of Biology, Bioinformatics Centre, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
42
|
Chan S, Reddy V, Myers B, Thibodeaux Q, Brownstone N, Liao W. Machine Learning in Dermatology: Current Applications, Opportunities, and Limitations. Dermatol Ther (Heidelb) 2020; 10:365-386. [PMID: 32253623 PMCID: PMC7211783 DOI: 10.1007/s13555-020-00372-0] [Citation(s) in RCA: 81] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Indexed: 12/14/2022] Open
Abstract
Machine learning (ML) has the potential to improve the dermatologist's practice from diagnosis to personalized treatment. Recent advancements in access to large datasets (e.g., electronic medical records, image databases, omics), faster computing, and cheaper data storage have encouraged the development of ML algorithms with human-like intelligence in dermatology. This article is an overview of the basics of ML, current applications of ML, and potential limitations and considerations for further development of ML. We have identified five current areas of applications for ML in dermatology: (1) disease classification using clinical images; (2) disease classification using dermatopathology images; (3) assessment of skin diseases using mobile applications and personal monitoring devices; (4) facilitating large-scale epidemiology research; and (5) precision medicine. The purpose of this review is to provide a guide for dermatologists to help demystify the fundamentals of ML and its wide range of applications in order to better evaluate its potential opportunities and challenges.
Collapse
Affiliation(s)
- Stephanie Chan
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Vidhatha Reddy
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Bridget Myers
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Quinn Thibodeaux
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Nicholas Brownstone
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA
| | - Wilson Liao
- Department of Dermatology, University of California San Francisco, San Francisco, CA, USA.
| |
Collapse
|
43
|
Ghoshal UC, Rai S, Kulkarni A, Gupta A. Prediction of outcome of treatment of acute severe ulcerative colitis using principal component analysis and artificial intelligence. JGH OPEN 2020; 4:889-897. [PMID: 33102760 PMCID: PMC7578272 DOI: 10.1002/jgh3.12342] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 01/26/2020] [Accepted: 03/13/2020] [Indexed: 12/17/2022]
Abstract
Background and Aim About 15% patients with acute severe ulcerative colitis (UC) fail to respond to medical treatment and may require colectomy. An early prediction of response may help the treating team and the patients and their family to prepare for alternative treatment options. Methods Data of 263 patients (mean age 37.0 ± 14.0-years, 176, 77% male) with acute severe UC admitted during a 12-year period were used to study predictors of response using univariate analysis, multivariate linear principal component analysis (PCA), and nonlinear artificial neural network (ANN). Results Of 263 patients, 231 (87.8%) responded to the initial medical treatment that included oral prednisolone (n = 14, 5.3%), intravenous (IV) hydrocortisone (n = 238, 90.5%), IV cyclosporine (n = 9, 3.4%), and inflixmab (n = 2, 0.7%), and 28 (10.6%) did not respond and the remaining 4 (1.5%) died, all of whom did were also nonresponders. Nonresponding patients had to stay longer in the hospital and died more often. On univariate analysis, the presence of complications, the need for use of cyclosporin, lower Hb, platelets, albumin, serum potassium, and higher C-reactive protein were predictors of nonresponse. Hb and albumin were strong predictive factors on both PCA and ANN. Though the nonlinear modeling using ANN had a good predictive accuracy for the response, its accuracy for predicting nonresponse was lower. Conclusion It is possible to predict the response to medical treatment in patients with UC using linear and nonlinear modeling technique. Serum albumin and Hb are strong predictive factors.
Collapse
Affiliation(s)
- Uday C Ghoshal
- Department of GastroenterologySanjay Gandhi Postgraduate Institute of Medical SciencesLucknowIndia
| | - Sushmita Rai
- Department of GastroenterologySanjay Gandhi Postgraduate Institute of Medical SciencesLucknowIndia
| | - Akshay Kulkarni
- Department of GastroenterologySanjay Gandhi Postgraduate Institute of Medical SciencesLucknowIndia
| | - Ankur Gupta
- Department of GastroenterologySanjay Gandhi Postgraduate Institute of Medical SciencesLucknowIndia
| |
Collapse
|
44
|
Gomolin A, Netchiporouk E, Gniadecki R, Litvinov IV. Artificial Intelligence Applications in Dermatology: Where Do We Stand? Front Med (Lausanne) 2020; 7:100. [PMID: 32296706 PMCID: PMC7136423 DOI: 10.3389/fmed.2020.00100] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2019] [Accepted: 03/05/2020] [Indexed: 12/17/2022] Open
Abstract
Artificial intelligence (AI) has become a progressively prevalent Research Topic in medicine and is increasingly being applied to dermatology. There is a need to understand this technology's progress to help guide and shape the future for medical care providers and recipients. We reviewed the literature to evaluate the types of publications on the subject, the specific dermatological topics addressed by AI, and the most challenging barriers to its implementation. A substantial number of original articles and commentaries have been published to date and only few detailed reviews exist. Most AI applications focus on differentiating between benign and malignant skin lesions, however; others exist pertaining to ulcers, inflammatory skin diseases, allergen exposure, dermatopathology, and gene expression profiling. Applications commonly analyze and classify images, however, other tools such as risk assessment calculators are becoming increasingly available. Although many applications are technologically feasible, important implementation barriers have been identified including systematic biases, difficulty of standardization, interpretability, and acceptance by physicians and patients alike. This review provides insight into future research needs and possibilities. There is a strong need for clinical investigation in dermatology providing evidence of success overcoming the identified barriers. With these research goals in mind, an appropriate role for AI in dermatology may be achieved in not so distant future.
Collapse
Affiliation(s)
- Arieh Gomolin
- Division of Dermatology, McGill University Health Centre, Montreal, QC, Canada
| | - Elena Netchiporouk
- Division of Dermatology, McGill University Health Centre, Montreal, QC, Canada
| | - Robert Gniadecki
- Division of Dermatology, University of Alberta, Edmonton, AB, Canada
| | - Ivan V Litvinov
- Division of Dermatology, McGill University Health Centre, Montreal, QC, Canada
| |
Collapse
|
45
|
Abstract
Artificial Intelligence (AI), although well established in many areas of everyday life, has only recently been trialed in the diagnosis and management of common clinical conditions. This editorial review highlights progress to date and suggests further improvements in and trials of AI in the management of conditions such as hypertension.
Collapse
|