1
|
Wen D, Soltan A, Trucco E, Matin RN. From data to diagnosis: skin cancer image datasets for artificial intelligence. Clin Exp Dermatol 2024; 49:675-685. [PMID: 38549552 DOI: 10.1093/ced/llae112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 02/11/2024] [Accepted: 03/25/2024] [Indexed: 06/26/2024]
Abstract
Artificial intelligence (AI) solutions for skin cancer diagnosis continue to gain momentum, edging closer towards broad clinical use. These AI models, particularly deep-learning architectures, require large digital image datasets for development. This review provides an overview of the datasets used to develop AI algorithms and highlights the importance of dataset transparency for the evaluation of algorithm generalizability across varying populations and settings. Current challenges for curation of clinically valuable datasets are detailed, which include dataset shifts arising from demographic variations and differences in data collection methodologies, along with inconsistencies in labelling. These shifts can lead to differential algorithm performance, compromise of clinical utility, and the propagation of discriminatory biases when developed algorithms are implemented in mismatched populations. Limited representation of rare skin cancers and minoritized groups in existing datasets are highlighted, which can further skew algorithm performance. Strategies to address these challenges are presented, which include improving transparency, representation and interoperability. Federated learning and generative methods, which may improve dataset size and diversity without compromising privacy, are also examined. Lastly, we discuss model-level techniques that may address biases entrained through the use of datasets derived from routine clinical care. As the role of AI in skin cancer diagnosis becomes more prominent, ensuring the robustness of underlying datasets is increasingly important.
Collapse
Affiliation(s)
- David Wen
- Department of Dermatology, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
- Oxford University Clinical Academic Graduate School, University of Oxford, Oxford, UK
| | - Andrew Soltan
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
- Oxford Cancer and Haematology Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
- Department of Oncology, University of Oxford, Oxford, UK
| | - Emanuele Trucco
- VAMPIRE Project, Computing, School of Science and Engineering, University of Dundee, Dundee, UK
| | - Rubeta N Matin
- Department of Dermatology, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
- Artificial Intelligence Working Party Group, British Association of Dermatologists, London, UK
| |
Collapse
|
2
|
Primiero CA, Rezze GG, Caffery LJ, Carrera C, Podlipnik S, Espinosa N, Puig S, Janda M, Soyer HP, Malvehy J. A Narrative Review: Opportunities and Challenges in Artificial Intelligence Skin Image Analyses Using Total Body Photography. J Invest Dermatol 2024; 144:1200-1207. [PMID: 38231164 DOI: 10.1016/j.jid.2023.11.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 09/19/2023] [Accepted: 11/09/2023] [Indexed: 01/18/2024]
Abstract
Artificial intelligence (AI) algorithms for skin lesion classification have reported accuracy at par with and even outperformance of expert dermatologists in experimental settings. However, the majority of algorithms do not represent real-world clinical approach where skin phenotype and clinical background information are considered. We review the current state of AI for skin lesion classification and present opportunities and challenges when applied to total body photography (TBP). AI in TBP analysis presents opportunities for intrapatient assessment of skin phenotype and holistic risk assessment by incorporating patient-level metadata, although challenges exist for protecting patient privacy in algorithm development and improving explainable AI methods.
Collapse
Affiliation(s)
- Clare A Primiero
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; Dermatology Research Centre, Frazer Institute, The University of Queensland, Brisbane, Australia
| | - Gisele Gargantini Rezze
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Liam J Caffery
- Dermatology Research Centre, Frazer Institute, The University of Queensland, Brisbane, Australia; Centre of Health Services Research, Faculty of Medicine, The University of Queensland, Brisbane, Australia; Centre for Online Health, The University of Queensland, Brisbane, Australia
| | - Cristina Carrera
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; Medicine Department, University of Barcelona, Barcelona, Spain; CIBER de Enfermedades raras, Instituto de Salud Carlos III, Barcelona, Spain
| | - Sebastian Podlipnik
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; CIBER de Enfermedades raras, Instituto de Salud Carlos III, Barcelona, Spain
| | - Natalia Espinosa
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Susana Puig
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; Medicine Department, University of Barcelona, Barcelona, Spain; CIBER de Enfermedades raras, Instituto de Salud Carlos III, Barcelona, Spain
| | - Monika Janda
- Centre of Health Services Research, Faculty of Medicine, The University of Queensland, Brisbane, Australia
| | - H Peter Soyer
- Dermatology Research Centre, Frazer Institute, The University of Queensland, Brisbane, Australia; Dermatology Department, Princess Alexandra Hospital, Brisbane, Australia
| | - Josep Malvehy
- Dermatology Department, Hospital Clinic and Fundació Clínic per la Recerca Biomèdica - Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain; Medicine Department, University of Barcelona, Barcelona, Spain; CIBER de Enfermedades raras, Instituto de Salud Carlos III, Barcelona, Spain.
| |
Collapse
|
3
|
Diaz MJ, Tran JT. Potential Benefits of Non-Fungible Tokens (NFTs) and Blockchain Technology in Dermatology. Dermatol Pract Concept 2024; 14:dpc.1401a61. [PMID: 38364421 PMCID: PMC10868896 DOI: 10.5826/dpc.1401a61] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/29/2023] [Indexed: 02/18/2024] Open
Affiliation(s)
- Michael Joseph Diaz
- College of Medicine, University of Florida, Gainesville, Florida, United States
| | - Jasmine Thuy Tran
- School of Medicine, Indiana University, Indianapolis, Indiana, United States
| |
Collapse
|
4
|
Miragall MF, Knoedler S, Kauke-Navarro M, Saadoun R, Grabenhorst A, Grill FD, Ritschl LM, Fichter AM, Safi AF, Knoedler L. Face the Future-Artificial Intelligence in Oral and Maxillofacial Surgery. J Clin Med 2023; 12:6843. [PMID: 37959310 PMCID: PMC10649053 DOI: 10.3390/jcm12216843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 10/24/2023] [Accepted: 10/28/2023] [Indexed: 11/15/2023] Open
Abstract
Artificial intelligence (AI) has emerged as a versatile health-technology tool revolutionizing medical services through the implementation of predictive, preventative, individualized, and participatory approaches. AI encompasses different computational concepts such as machine learning, deep learning techniques, and neural networks. AI also presents a broad platform for improving preoperative planning, intraoperative workflow, and postoperative patient outcomes in the field of oral and maxillofacial surgery (OMFS). The purpose of this review is to present a comprehensive summary of the existing scientific knowledge. The authors thoroughly reviewed English-language PubMed/MEDLINE and Embase papers from their establishment to 1 December 2022. The search terms were (1) "OMFS" OR "oral and maxillofacial" OR "oral and maxillofacial surgery" OR "oral surgery" AND (2) "AI" OR "artificial intelligence". The search format was tailored to each database's syntax. To find pertinent material, each retrieved article and systematic review's reference list was thoroughly examined. According to the literature, AI is already being used in certain areas of OMFS, such as radiographic image quality improvement, diagnosis of cysts and tumors, and localization of cephalometric landmarks. Through additional research, it may be possible to provide practitioners in numerous disciplines with additional assistance to enhance preoperative planning, intraoperative screening, and postoperative monitoring. Overall, AI carries promising potential to advance the field of OMFS and generate novel solution possibilities for persisting clinical challenges. Herein, this review provides a comprehensive summary of AI in OMFS and sheds light on future research efforts. Further, the advanced analysis of complex medical imaging data can support surgeons in preoperative assessments, virtual surgical simulations, and individualized treatment strategies. AI also assists surgeons during intraoperative decision-making by offering immediate feedback and guidance to enhance surgical accuracy and reduce complication rates, for instance by predicting the risk of bleeding.
Collapse
Affiliation(s)
- Maximilian F. Miragall
- Department of Oral and Maxillofacial Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Samuel Knoedler
- Division of Plastic Surgery, Department of Surgery, Yale New Haven Hospital, Yale School of Medicine, New Haven, CT 06510, USA
| | - Martin Kauke-Navarro
- Division of Plastic Surgery, Department of Surgery, Yale New Haven Hospital, Yale School of Medicine, New Haven, CT 06510, USA
| | - Rakan Saadoun
- Department of Plastic Surgery, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Alex Grabenhorst
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Florian D. Grill
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Lucas M. Ritschl
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Andreas M. Fichter
- Department of Oral and Maxillofacial Surgery, School of Medicine, Technical University of Munich, 81675 Munich, Germany
| | - Ali-Farid Safi
- Craniologicum, Center for Cranio-Maxillo-Facial Surgery, 3011 Bern, Switzerland;
- Faculty of Medicine, University of Bern, 3010 Bern, Switzerland
| | - Leonard Knoedler
- Division of Plastic Surgery, Department of Surgery, Yale New Haven Hospital, Yale School of Medicine, New Haven, CT 06510, USA
- Department of Plastic, Hand and Reconstructive Surgery, University Hospital Regensburg, 93053 Regensburg, Germany
| |
Collapse
|
5
|
Hernández-Rodríguez JC, Durán-López L, Domínguez-Morales JP, Ortiz-Álvarez J, Conejo-Mir J, Pereyra-Rodriguez JJ. Prediction of melanoma Breslow thickness using deep transfer learning algorithms. Clin Exp Dermatol 2023; 48:752-758. [PMID: 36970775 DOI: 10.1093/ced/llad107] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/10/2023] [Indexed: 07/20/2023]
Abstract
BACKGROUND The distinction between in situ melanoma (MIS) and invasive melanoma is challenging even for expert dermatologists. The use of pretrained convolutional neural networks (CNNs) as ancillary decision systems needs further research. AIM To develop, validate and compare three deep transfer learning (DTL) algorithms to predict MIS vs. invasive melanoma and melanoma with a Breslow thickness (BT) of < 0.8 mm vs. ≥ 0.8 mm. METHODS A dataset of 1315 dermoscopic images of histopathologically confirmed melanomas was created from Virgen del Rocio University Hospital and open repositories of the International Skin Imaging Collaboration archive and Polesie S et al. (Dermatol Pract Concept 2021; 11:e2021079). The images were labelled as MIS or invasive melanoma and < 0.8 mm or ≥ 0.8 mm of BT. We conducted three trainings, and overall means for receiver operating characteristic (ROC) curves, sensitivity, specificity, positive and negative predictive value, and balanced diagnostic accuracy outcomes were evaluated on the test set with ResNetV2, EfficientNetB6 and InceptionV3. The results of 10 dermatologists were compared with the algorithms. Grad-CAM gradient maps were generated, highlighting relevant areas considered by the CNNs within the images. RESULTS EfficientNetB6 achieved the highest diagnostic accuracy for the comparison between MIS vs. invasive melanoma (61%) and BT < 0.8 mm vs. ≥ 0.8 mm (75%). For the BT comparison, ResNetV2 with an area under the ROC curve of 0.76 and InceptionV3 with an area under the ROC curve of 0.75, outperformed the results obtained by the dermatologist group with an area under the ROC curve of 0.70. CONCLUSION EfficientNetB6 recorded the best prediction results, outperforming the dermatologists for the comparison of 0.8 mm of BT. DTL could be an ancillary aid to support dermatologists' decisions in the near future.
Collapse
Affiliation(s)
| | - Lourdes Durán-López
- Robotics and Technology of Computers Laboratory, University of Seville, Seville, Spain
| | | | - Juan Ortiz-Álvarez
- Department of Dermatology, Virgen del Rocio University Hospital, Seville, Spain
| | - Julián Conejo-Mir
- Department of Dermatology, Virgen del Rocio University Hospital, Seville, Spain
- Department of Medicine, Faculty of Medicine
| | - Jose-Juan Pereyra-Rodriguez
- Department of Dermatology, Virgen del Rocio University Hospital, Seville, Spain
- Department of Medicine, Faculty of Medicine
| |
Collapse
|
6
|
Mirikharaji Z, Abhishek K, Bissoto A, Barata C, Avila S, Valle E, Celebi ME, Hamarneh G. A survey on deep learning for skin lesion segmentation. Med Image Anal 2023; 88:102863. [PMID: 37343323 DOI: 10.1016/j.media.2023.102863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 02/01/2023] [Accepted: 05/31/2023] [Indexed: 06/23/2023]
Abstract
Skin cancer is a major public health problem that could benefit from computer-aided diagnosis to reduce the burden of this common disease. Skin lesion segmentation from images is an important step toward achieving this goal. However, the presence of natural and artificial artifacts (e.g., hair and air bubbles), intrinsic factors (e.g., lesion shape and contrast), and variations in image acquisition conditions make skin lesion segmentation a challenging task. Recently, various researchers have explored the applicability of deep learning models to skin lesion segmentation. In this survey, we cross-examine 177 research papers that deal with deep learning-based segmentation of skin lesions. We analyze these works along several dimensions, including input data (datasets, preprocessing, and synthetic data generation), model design (architecture, modules, and losses), and evaluation aspects (data annotation requirements and segmentation performance). We discuss these dimensions both from the viewpoint of select seminal works, and from a systematic viewpoint, examining how those choices have influenced current trends, and how their limitations should be addressed. To facilitate comparisons, we summarize all examined works in a comprehensive table as well as an interactive table available online3.
Collapse
Affiliation(s)
- Zahra Mirikharaji
- Medical Image Analysis Lab, School of Computing Science, Simon Fraser University, Burnaby V5A 1S6, Canada
| | - Kumar Abhishek
- Medical Image Analysis Lab, School of Computing Science, Simon Fraser University, Burnaby V5A 1S6, Canada
| | - Alceu Bissoto
- RECOD.ai Lab, Institute of Computing, University of Campinas, Av. Albert Einstein 1251, Campinas 13083-852, Brazil
| | - Catarina Barata
- Institute for Systems and Robotics, Instituto Superior Técnico, Avenida Rovisco Pais, Lisbon 1049-001, Portugal
| | - Sandra Avila
- RECOD.ai Lab, Institute of Computing, University of Campinas, Av. Albert Einstein 1251, Campinas 13083-852, Brazil
| | - Eduardo Valle
- RECOD.ai Lab, School of Electrical and Computing Engineering, University of Campinas, Av. Albert Einstein 400, Campinas 13083-952, Brazil
| | - M Emre Celebi
- Department of Computer Science and Engineering, University of Central Arkansas, 201 Donaghey Ave., Conway, AR 72035, USA.
| | - Ghassan Hamarneh
- Medical Image Analysis Lab, School of Computing Science, Simon Fraser University, Burnaby V5A 1S6, Canada.
| |
Collapse
|
7
|
Fassbind B, Langenbucher A, Streich A. Automated cornea diagnosis using deep convolutional neural networks based on cornea topography maps. Sci Rep 2023; 13:6566. [PMID: 37085580 PMCID: PMC10121572 DOI: 10.1038/s41598-023-33793-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Accepted: 04/19/2023] [Indexed: 04/23/2023] Open
Abstract
Cornea topography maps allow ophthalmologists to screen and diagnose cornea pathologies. We aim to automatically identify any cornea abnormalities based on such cornea topography maps, with focus on diagnosing keratoconus. To do so, we represent the OCT scans as images and apply Convolutional Neural Networks (CNNs) for the automatic analysis. The model is based on a state-of-the-art ConvNeXt CNN architecture with weights fine-tuned for the given specific application using the cornea scans dataset. A set of 1940 consecutive screening scans from the Saarland University Hospital Clinic for Ophthalmology was annotated and used for model training and validation. All scans were recorded with a CASIA2 anterior segment Optical Coherence Tomography (OCT) scanner. The proposed model achieves a sensitivity of 98.46% and a specificity of 91.96% when distinguishing between healthy and pathological corneas. Our approach enables the screening of cornea pathologies and the classification of common pathologies like keratoconus. Furthermore, the approach is independent of the topography scanner and enables the visualization of those scan regions which drive the model's decisions.
Collapse
Affiliation(s)
- Benjamin Fassbind
- Department of Computer Science, Lucerne University of Applied Sciences and Arts, Rotkreuz/Zug, 6343, Switzerland.
| | - Achim Langenbucher
- Department of Experimental Ophthalmology, Saarland University, Homburg/Saar, 66123, Germany
| | - Andreas Streich
- Department of Computer Science, Lucerne University of Applied Sciences and Arts, Rotkreuz/Zug, 6343, Switzerland
| |
Collapse
|
8
|
Ding Y, Yi Z, Li M, long J, Lei S, Guo Y, Fan P, Zuo C, Wang Y. HI-MViT: A lightweight model for explainable skin disease classification based on modified MobileViT. Digit Health 2023; 9:20552076231207197. [PMID: 37846401 PMCID: PMC10576942 DOI: 10.1177/20552076231207197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 09/26/2023] [Indexed: 10/18/2023] Open
Abstract
Objective To develop an explainable lightweight skin disease high-precision classification model that can be deployed to the mobile terminal. Methods In this study, we present HI-MViT, a lightweight network for explainable skin disease classification based on Modified MobileViT. HI-MViT is mainly composed of ordinary convolution, Improved-MV2, MobileViT block, global pooling, and fully connected layers. Improved-MV2 uses the combination of shortcut and depth classifiable convolution to substantially decrease the amount of computation while ensuring the efficient implementation of information interaction and memory. The MobileViT block can efficiently encode local and global information. In addition, semantic feature dimensionality reduction visualization and class activation mapping visualization methods are used for HI-MViT to further understand the attention area of the model when learning skin lesion images. Results The International Skin Imaging Collaboration has assembled and made available the ISIC series dataset. Experiments using the HI-MViT model on the ISIC-2018 dataset achieved scores of 0.931, 0.932, 0.961, and 0.977 on F1-Score, Accuracy, Average Precision (AP), and area under the curve (AUC). Compared with the top five algorithms of ISIC-2018 Task 3, Marco's average F1-Score, AP, and AUC have increased by 6.9%, 6.8%, and 0.8% compared with the suboptimal performance model. Compared with ConvNeXt, the most competitive convolutional neural network architecture, our model is 5.0%, 3.4%, 2.3%, and 2.2% higher in F1-Score, Accuracy, AP, and AUC, respectively. The experiments on the ISIC-2017 dataset also achieved excellent results, and all indicators were better than the top five algorithms of ISIC-2017 Task 3. Using the trained model to test on the PH2 dataset, an excellent performance score is obtained, which shows that it has good generalization performance. Conclusions The skin disease classification model HI-MViT proposed in this article shows excellent classification performance and generalization performance in experiments. It demonstrates how the classification outcomes can be applied to dermatologists' computer-assisted diagnostics, enabling medical professionals to classify various dermoscopic images more rapidly and reliably.
Collapse
Affiliation(s)
- Yuhan Ding
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China
| | - Zhenglin Yi
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
- Departments of Urology, Xiangya Hospital, Central South University, Changsha, China
| | - Mengjuan Li
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Jianhong long
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Shaorong Lei
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Yu Guo
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Pengju Fan
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Chenchen Zuo
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Yongjie Wang
- Department of Burns and Plastic Surgery, Xiangya Hospital, Central South University, Changsha, Hunan, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| |
Collapse
|
9
|
Eapen BR, Kaliyadan F, Ashique KT. DICODerma: A Practical Approach for Metadata Management of Images in Dermatology. J Digit Imaging 2022; 35:1231-1237. [PMID: 35488074 PMCID: PMC9054111 DOI: 10.1007/s10278-022-00636-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Revised: 03/07/2022] [Accepted: 04/10/2022] [Indexed: 11/29/2022] Open
Abstract
Clinical images are vital for diagnosing and monitoring skin diseases, and their importance has increased with the growing popularity of machine learning. Lack of standards has stifled innovation in dermatological imaging, unlike other image-intensive specialties such as radiology. We investigate the meta-requirements for utilizing the popular DICOM standard for metadata management of images in dermatology. We propose practical design solutions and provide open-source tools to integrate dermatologists’ workflow with enterprise imaging systems. Using the tool, dermatologists can tag, search, organize and convert clinical images to the DICOM format. We believe that our less disruptive approach will improve the adoption of standards in the specialty.
Collapse
Affiliation(s)
- Bell Raj Eapen
- McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L8, Canada.
| | - Feroze Kaliyadan
- Department of Dermatology, Sree Narayana Institute of Medical Sciences, Kunnukara, Kerala, India
| | | |
Collapse
|
10
|
Lee KJ, Betz-Stablein B, Stark MS, Janda M, McInerney-Leo AM, Caffery LJ, Gillespie N, Yanes T, Soyer HP. The Future of Precision Prevention for Advanced Melanoma. Front Med (Lausanne) 2022; 8:818096. [PMID: 35111789 PMCID: PMC8801740 DOI: 10.3389/fmed.2021.818096] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 12/22/2021] [Indexed: 12/16/2022] Open
Abstract
Precision prevention of advanced melanoma is fast becoming a realistic prospect, with personalized, holistic risk stratification allowing patients to be directed to an appropriate level of surveillance, ranging from skin self-examinations to regular total body photography with sequential digital dermoscopic imaging. This approach aims to address both underdiagnosis (a missed or delayed melanoma diagnosis) and overdiagnosis (the diagnosis and treatment of indolent lesions that would not have caused a problem). Holistic risk stratification considers several types of melanoma risk factors: clinical phenotype, comprehensive imaging-based phenotype, familial and polygenic risks. Artificial intelligence computer-aided diagnostics combines these risk factors to produce a personalized risk score, and can also assist in assessing the digital and molecular markers of individual lesions. However, to ensure uptake and efficient use of AI systems, researchers will need to carefully consider how best to incorporate privacy and standardization requirements, and above all address consumer trust concerns.
Collapse
Affiliation(s)
- Katie J. Lee
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Brigid Betz-Stablein
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Mitchell S. Stark
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Monika Janda
- Centre for Health Services Research, School of Medicine, The University of Queensland, Brisbane, QLD, Australia
| | - Aideen M. McInerney-Leo
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Liam J. Caffery
- Centre for Health Services Research, School of Medicine, The University of Queensland, Brisbane, QLD, Australia
| | - Nicole Gillespie
- The University of Queensland Business School, Faculty of Business, Economics and Law, The University of Queensland, Brisbane, QLD, Australia
| | - Tatiane Yanes
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - H. Peter Soyer
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
- Department of Dermatology, Princess Alexandra Hospital, Brisbane, QLD, Australia
- *Correspondence: H. Peter Soyer
| |
Collapse
|
11
|
Abstract
Dermatology and medicine are producing data at an increasing rate that are progressively difficult to sort and manage. Artificial intelligence (AI) and machine learning are examples of tools that may have the capability to produce significant and meaningful results from these data. Currently, AI and machine learning have a variety of applications in medicine including, but not limited to, diagnostics, patient management, preventive medicine, and genomic analysis. Although the role of AI in dermatology is greater than ever, its use is still extremely limited. As AI is continually developed and implemented, it is essential that stakeholders understand AI terminology, applications, limitations, and projected uses in dermatology. With the continued development of AI technology, however, its implementation may afford greater dermatologist efficiency, greater increased patient access to dermatologic care, and improved patient outcomes.
Collapse
Affiliation(s)
- Chandler W Rundle
- Department of Dermatology, University of Colorado School of Medicine, Denver, Colorado, USA
| | - Parker Hollingsworth
- Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Robert P Dellavalle
- Department of Dermatology, University of Colorado School of Medicine, Denver, Colorado, USA; Department of Public Health, University of Colorado School of Medicine, Denver, Colorado, USA; Dermatology Service, US Department of Veterans Affairs, Eastern Colorado Health Care System, Aurora, Colorado, USA.
| |
Collapse
|
12
|
Wen D, Khan SM, Ji Xu A, Ibrahim H, Smith L, Caballero J, Zepeda L, de Blas Perez C, Denniston AK, Liu X, Matin RN. Characteristics of publicly available skin cancer image datasets: a systematic review. LANCET DIGITAL HEALTH 2021; 4:e64-e74. [PMID: 34772649 DOI: 10.1016/s2589-7500(21)00252-1] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 08/26/2021] [Accepted: 10/21/2021] [Indexed: 12/17/2022]
Abstract
Publicly available skin image datasets are increasingly used to develop machine learning algorithms for skin cancer diagnosis. However, the total number of datasets and their respective content is currently unclear. This systematic review aimed to identify and evaluate all publicly available skin image datasets used for skin cancer diagnosis by exploring their characteristics, data access requirements, and associated image metadata. A combined MEDLINE, Google, and Google Dataset search identified 21 open access datasets containing 106 950 skin lesion images, 17 open access atlases, eight regulated access datasets, and three regulated access atlases. Images and accompanying data from open access datasets were evaluated by two independent reviewers. Among the 14 datasets that reported country of origin, most (11 [79%]) originated from Europe, North America, and Oceania exclusively. Most datasets (19 [91%]) contained dermoscopic images or macroscopic photographs only. Clinical information was available regarding age for 81 662 images (76·4%), sex for 82 848 (77·5%), and body site for 79 561 (74·4%). Subject ethnicity data were available for 1415 images (1·3%), and Fitzpatrick skin type data for 2236 (2·1%). There was limited and variable reporting of characteristics and metadata among datasets, with substantial under-representation of darker skin types. This is the first systematic review to characterise publicly available skin image datasets, highlighting limited applicability to real-life clinical settings and restricted population representation, precluding generalisability. Quality standards for characteristics and metadata reporting for skin image datasets are needed.
Collapse
Affiliation(s)
- David Wen
- Oxford University Clinical Academic Graduate School, University of Oxford, Oxford, UK; Institute of Clinical Sciences, University of Birmingham, Birmingham, UK; Royal Berkshire Hospital, Royal Berkshire NHS Foundation Trust, Reading, UK
| | - Saad M Khan
- Royal Berkshire Hospital, Royal Berkshire NHS Foundation Trust, Reading, UK
| | - Antonio Ji Xu
- Department of Dermatology, Churchill Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Hussein Ibrahim
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK; Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK; Centre for Regulatory Science and Innovation, Birmingham Health Partners, Birmingham, UK
| | | | | | | | | | - Alastair K Denniston
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK; Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK; Centre for Regulatory Science and Innovation, Birmingham Health Partners, Birmingham, UK; Health Data Research UK, London, UK; National Institute for Health Research Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust, London, UK; UCL Institute of Ophthalmology, London, UK
| | - Xiaoxuan Liu
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK; Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK; Centre for Regulatory Science and Innovation, Birmingham Health Partners, Birmingham, UK; Health Data Research UK, London, UK
| | - Rubeta N Matin
- Department of Dermatology, Churchill Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford, UK.
| |
Collapse
|
13
|
Caffery L, Weber J, Kurtansky N, Clunie D, Langer S, Shih G, Halpern A, Rotemberg V. DICOM in Dermoscopic Research: an Experience Report and a Way Forward. J Digit Imaging 2021; 34:967-973. [PMID: 34244881 DOI: 10.1007/s10278-021-00483-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Revised: 05/27/2021] [Accepted: 06/21/2021] [Indexed: 11/27/2022] Open
Affiliation(s)
- Liam Caffery
- Centre for Online Health, The University of Queensland, Brisbane, Australia.
| | - Jochen Weber
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Nicholas Kurtansky
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | | | | | | | - Allan Halpern
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Veronica Rotemberg
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
14
|
Roth CJ, Clunie DA, Vining DJ, Berkowitz SJ, Berlin A, Bissonnette JP, Clark SD, Cornish TC, Eid M, Gaskin CM, Goel AK, Jacobs GC, Kwan D, Luviano DM, McBee MP, Miller K, Hafiz AM, Obcemea C, Parwani AV, Rotemberg V, Silver EL, Storm ES, Tcheng JE, Thullner KS, Folio LR. Multispecialty Enterprise Imaging Workgroup Consensus on Interactive Multimedia Reporting Current State and Road to the Future: HIMSS-SIIM Collaborative White Paper. J Digit Imaging 2021; 34:495-522. [PMID: 34131793 PMCID: PMC8329131 DOI: 10.1007/s10278-021-00450-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 03/05/2021] [Accepted: 03/19/2021] [Indexed: 12/20/2022] Open
Abstract
Diagnostic and evidential static image, video clip, and sound multimedia are captured during routine clinical care in cardiology, dermatology, ophthalmology, pathology, physiatry, radiation oncology, radiology, endoscopic procedural specialties, and other medical disciplines. Providers typically describe the multimedia findings in contemporaneous electronic health record clinical notes or associate a textual interpretative report. Visual communication aids commonly used to connect, synthesize, and supplement multimedia and descriptive text outside medicine remain technically challenging to integrate into patient care. Such beneficial interactive elements may include hyperlinks between text, multimedia elements, alphanumeric and geometric annotations, tables, graphs, timelines, diagrams, anatomic maps, and hyperlinks to external educational references that patients or provider consumers may find valuable. This HIMSS-SIIM Enterprise Imaging Community workgroup white paper outlines the current and desired clinical future state of interactive multimedia reporting (IMR). The workgroup adopted a consensus definition of IMR as “interactive medical documentation that combines clinical images, videos, sound, imaging metadata, and/or image annotations with text, typographic emphases, tables, graphs, event timelines, anatomic maps, hyperlinks, and/or educational resources to optimize communication between medical professionals, and between medical professionals and their patients.” This white paper also serves as a precursor for future efforts toward solving technical issues impeding routine interactive multimedia report creation and ingestion into electronic health records.
Collapse
Affiliation(s)
| | | | - David J Vining
- Department of Abdominal Imaging, MD Anderson Cancer Center, Houston, TX, USA
| | - Seth J Berkowitz
- Department of Radiology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Alejandro Berlin
- Radiation Medicine Program, Princess Margaret Cancer Centre - University Health Network, Department of Radiation Oncology, University of Toronto, Toronto, ON, Canada
| | - Jean-Pierre Bissonnette
- Departments of Radiation Oncology and Medical Biophysics, University of Toronto, Toronto, ON, Canada
| | - Shawn D Clark
- University of Miami Hospitals and Clinics, Miami, FL, USA
| | - Toby C Cornish
- Department of Pathology, University of Colorado School of Medicine, Aurora, CO, USA
| | - Monief Eid
- eHealth & Digital Transformation Agency, Ministry of Health, Riyadh, Saudi Arabia
| | - Cree M Gaskin
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, USA
| | | | | | - David Kwan
- Health Technology and Information Management, Ontario Health (Cancer Care Ontario), Toronto, ON, Canada
| | - Damien M Luviano
- Department of Surgery, Virginia Tech Carilion School of Medicine, Roanoke, VA, USA
| | - Morgan P McBee
- Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC, USA
| | | | - Abdul Moiz Hafiz
- Division of Cardiology, Southern Illinois University School of Medicine, Springfield, IL, USA
| | - Ceferino Obcemea
- Radiation Research Program, National Cancer Institute, Bethesda, MD, USA
| | - Anil V Parwani
- Department of Pathology, The Ohio State University, Columbus, OH, USA
| | - Veronica Rotemberg
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | | | - Erik S Storm
- Department of Radiology and Medical Education, Salem VA Medical Center, Salem, VA, USA
| | - James E Tcheng
- Department of Medicine, Division of Cardiology, Duke University, Durham, NC, USA
| | | | - Les R Folio
- Lead CT Radiologist, NIH Clinical Center, Bethesda, MD, USA
| |
Collapse
|
15
|
Shah SIH, Peristeras APV, Magnisalis I. Government Big Data Ecosystem: Definitions, Types of Data, Actors, and Roles and the Impact in Public Administrations. ACM JOURNAL OF DATA AND INFORMATION QUALITY 2021. [DOI: 10.1145/3425709] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
The public sector, private firms, business community, and civil society are generating data that are high in volume, veracity, and velocity and come from a diversity of sources. This type of data is today known as big data. Public administrations pursue big data as “new oil” and implement data-centric policies to collect, generate, process, share, exploit, and protect data for promoting good governance, transparency, innovative digital services, and citizens’ engagement in public policy. All of the above constitute the Government Big Data Ecosystem (GBDE). Despite the great interest in this ecosystem, there is a lack of clear definitions, the various important types of government data remain vague, the different actors and their roles are not well defined, while the impact in key public administration sectors is not yet deeply understood and assessed. Such research and literature gaps impose a crucial obstacle for a better understanding of the prospects and nascent issues in exploiting GBDE. With this study, we aim to start filling the above-mentioned gaps by organizing our findings from an extended Systematic Literature Review into a framework to organise and address the above-mentioned challenges. Our goal is to contribute in this fast-evolving area by bringing some clarity and establishing common understanding around key elements of the emerging GBDE.
Collapse
Affiliation(s)
| | | | - Ioannis Magnisalis
- School of Science & Technology, International Hellenic University, Thessaloniki, Greece
| |
Collapse
|
16
|
Koh U, Betz-Stablein B, O'Hara M, Horsham C, Curiel-Lewandrowski C, Soyer HP, Janda M. Development of a Checklist Tool to Assess the Quality of Skin Lesion Images Acquired by Consumers Using Sequential Mobile Teledermoscopy. Dermatology 2021; 238:27-34. [PMID: 33849022 DOI: 10.1159/000515158] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Accepted: 01/29/2021] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Mobile teledermoscopy is an emerging technology that involves imaging and digitally sending dermoscopic images of skin lesions to a clinician for assessment. High-quality, consistent images are required for accurate telediagnoses when monitoring lesions over time. To date there are no tools to assess the quality of sequential images taken by consumers using mobile teledermoscopy. The purpose of this study was to develop a tool to assess the quality of images acquired by consumers. METHODS Participants imaged skin lesions that they felt were concerning at baseline, 1-, and 2-months. A checklist to assess the quality of consumer sequential imaging of skin lesions was developed based on the International Skin Imaging Collaboration guidelines. A scale was implemented to grade the quality of the images: 0 (low) to 18 (very high). Intra- and inter-reliability of the checklist was assessed using Bland-Altman analysis. Using this checklist, the consistency with which 85 sets of images were scored by 2 evaluators were compared using Kappa statistics. Items with a low Kappa value <0.4 were removed. RESULTS After reliability testing, 5 of the items were removed due to low Kappa values (<0.4) and the final checklist included 13 items surveying: lesion selection; image orientation; lighting; field of view; focus and depth of view. Participants had a mean age of 41 years (range 19-73), and 67% were female. Most participants (84%, n = 71/85) were able to select and image the correct lesion over time for both the dermoscopic and overview images. Younger participants (<40 years old) scored significantly higher (8.1 ± 2.1) on the imaging checklist compared to older participants (7.1 ± 2.4; p = 0.037). Participants had most difficulty with consistent image orientation. CONCLUSIONS This checklist could be used as a triage tool to filter images acquired by consumers prior to telediagnosis evaluation, which would improve the efficiency and accuracy of teledermatology and teledermoscopy processes. It may also be used to provide feedback to the consumers to improve image acquisition over time.
Collapse
Affiliation(s)
- Uyen Koh
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| | - Brigid Betz-Stablein
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia
| | - Montana O'Hara
- Centre of Health Services Research, Faculty of Medicine, The University of Queensland, Brisbane, Queensland, Australia
| | - Caitlin Horsham
- Centre of Health Services Research, Faculty of Medicine, The University of Queensland, Brisbane, Queensland, Australia
| | - Clara Curiel-Lewandrowski
- Department of Dermatology and the University of Arizona Cancer Center Skin Cancer Institute, University of Arizona, Tucson, Arizona, USA
| | - H Peter Soyer
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Queensland, Australia.,Department of Dermatology, Princess Alexandra Hospital, Brisbane, Queensland, Australia
| | - Monika Janda
- Centre of Health Services Research, Faculty of Medicine, The University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|
17
|
Kutner A, Love D, Markova A, Rossi A, Lee E, Nehal K, Lacouture M, Rotemberg V. Supporting Virtual Dermatology Consultation in the Setting of COVID-19. J Digit Imaging 2021; 34:284-289. [PMID: 33689061 PMCID: PMC7945608 DOI: 10.1007/s10278-021-00425-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Revised: 06/19/2020] [Accepted: 01/11/2021] [Indexed: 11/24/2022] Open
Abstract
While telemedicine has been utilized with more frequency over the past two decades, there remained significant barriers to its broad implementation. The COVID-19 global pandemic served as a stimulus for rapid expansion and implementation of telemedicine services across medical institutions worldwide in order to maximize patient care delivery, minimize exposure risk among healthcare providers and patients alike, and avoid overcrowding of patient care facilities. In this experience report, we highlight the teledermatology initiatives executed by the Dermatology Service at Memorial Sloan Kettering Cancer Center in New York City, with particular emphasis on image ingestion and potential for future automation and improvement.
Collapse
Affiliation(s)
- Allison Kutner
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Danielle Love
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Alina Markova
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Anthony Rossi
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Erica Lee
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Kishwer Nehal
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Mario Lacouture
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA
| | - Veronica Rotemberg
- Memorial Sloan Kettering Cancer Center, 1250 York Avenue, 10065, New York, NY, USA.
| |
Collapse
|
18
|
Caffery LJ, Rotemberg V, Weber J, Soyer HP, Malvehy J, Clunie D. The Role of DICOM in Artificial Intelligence for Skin Disease. Front Med (Lausanne) 2021; 7:619787. [PMID: 33644087 PMCID: PMC7902872 DOI: 10.3389/fmed.2020.619787] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Accepted: 12/31/2020] [Indexed: 01/19/2023] Open
Abstract
There is optimism that artificial intelligence (AI) will result in positive clinical outcomes, which is driving research and investment in the use of AI for skin disease. At present, AI for skin disease is embedded in research and development and not practiced widely in clinical dermatology. Clinical dermatology is also undergoing a technological transformation in terms of the development and adoption of standards that optimizes the quality use of imaging. Digital Imaging and Communications in Medicine (DICOM) is the international standard for medical imaging. DICOM is a continually evolving standard. There is considerable effort being invested in developing dermatology-specific extensions to the DICOM standard. The ability to encode relevant metadata and afford interoperability with the digital health ecosystem (e.g., image repositories, electronic medical records) has driven the initial impetus in the adoption of DICOM for dermatology. DICOM has a dedicated working group whose role is to develop a mechanism to support AI workflows and encode AI artifacts. DICOM can improve AI workflows by encoding derived objects (e.g., secondary images, visual explainability maps, AI algorithm output) and the efficient curation of multi-institutional datasets for machine learning training, testing, and validation. This can be achieved using DICOM mechanisms such as standardized image formats and metadata, metadata-based image retrieval, and de-identification protocols. DICOM can address several important technological and workflow challenges for the implementation of AI. However, many other technological, ethical, regulatory, medicolegal, and workforce barriers will need to be addressed before DICOM and AI can be used effectively in dermatology.
Collapse
Affiliation(s)
- Liam J Caffery
- Centre for Online, Centre for Health Services Research, The University of Queensland, Brisbane, QLD, Australia.,Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Veronica Rotemberg
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Jochen Weber
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - H Peter Soyer
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia.,Department of Dermatology, Princess Alexandra Hospital, Brisbane, QLD, Australia
| | - Josep Malvehy
- Department of Dermatology, Institut d'Investigacions Biomèdiques August Pi i Sunyer, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
| | | |
Collapse
|
19
|
Rotemberg V, Kurtansky N, Betz-Stablein B, Caffery L, Chousakos E, Codella N, Combalia M, Dusza S, Guitera P, Gutman D, Halpern A, Helba B, Kittler H, Kose K, Langer S, Lioprys K, Malvehy J, Musthaq S, Nanda J, Reiter O, Shih G, Stratigos A, Tschandl P, Weber J, Soyer HP. A patient-centric dataset of images and metadata for identifying melanomas using clinical context. Sci Data 2021; 8:34. [PMID: 33510154 PMCID: PMC7843971 DOI: 10.1038/s41597-021-00815-z] [Citation(s) in RCA: 76] [Impact Index Per Article: 25.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Accepted: 12/18/2020] [Indexed: 11/09/2022] Open
Abstract
Prior skin image datasets have not addressed patient-level information obtained from multiple skin lesions from the same patient. Though artificial intelligence classification algorithms have achieved expert-level performance in controlled studies examining single images, in practice dermatologists base their judgment holistically from multiple lesions on the same patient. The 2020 SIIM-ISIC Melanoma Classification challenge dataset described herein was constructed to address this discrepancy between prior challenges and clinical practice, providing for each image in the dataset an identifier allowing lesions from the same patient to be mapped to one another. This patient-level contextual information is frequently used by clinicians to diagnose melanoma and is especially useful in ruling out false positives in patients with many atypical nevi. The dataset represents 2,056 patients (20.8% with at least one melanoma, 79.2% with zero melanomas) from three continents with an average of 16 lesions per patient, consisting of 33,126 dermoscopic images and 584 (1.8%) histopathologically confirmed melanomas compared with benign melanoma mimickers.
Collapse
Affiliation(s)
- Veronica Rotemberg
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
| | - Nicholas Kurtansky
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Brigid Betz-Stablein
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Australia
| | - Liam Caffery
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Australia
| | - Emmanouil Chousakos
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.,University of Athens Medical School, Athens, Greece
| | | | - Marc Combalia
- Melanoma Unit, Dermatology Department, Hospital Cĺınic Barcelona, Universitat de Barcelona, IDIBAPS, Barcelona, Spain
| | - Stephen Dusza
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Pascale Guitera
- Melanoma Institute Australia and Sydney Melanoma Diagnostic Center, Sydney, Australia
| | - David Gutman
- Emory University School of Medicine, Department of Biomedical Informatics, Atlanta, GA, USA
| | - Allan Halpern
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | | | - Harald Kittler
- Medical University of Vienna, Department of Dermatology, Vienna, Austria
| | - Kivanc Kose
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Steve Langer
- Division of Radiology Informatics, Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | | | - Josep Malvehy
- Melanoma Unit, Dermatology Department, Hospital Cĺınic Barcelona, Universitat de Barcelona, IDIBAPS, Barcelona, Spain
| | - Shenara Musthaq
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.,SUNY Downstate Medical School, New York, NY, USA
| | - Jabpani Nanda
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.,Stony Brook Medical School, Stony Brook, NY, USA
| | - Ofer Reiter
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA.,Rabin Medical Center, Tel Aviv, Israel
| | - George Shih
- Department of Radiology, Weill Cornell Medical College, New York, NY, USA
| | | | - Philipp Tschandl
- Medical University of Vienna, Department of Dermatology, Vienna, Austria
| | - Jochen Weber
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - H Peter Soyer
- The University of Queensland Diamantina Institute, The University of Queensland, Dermatology Research Centre, Brisbane, Australia
| |
Collapse
|
20
|
Chen X, Lu Q, Chen C, Jiang G. Recent developments in dermoscopy for dermatology. J Cosmet Dermatol 2020; 20:1611-1617. [PMID: 33197276 DOI: 10.1111/jocd.13846] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Revised: 10/29/2020] [Accepted: 11/10/2020] [Indexed: 11/27/2022]
Abstract
BACKGROUND Dermoscopy is considered to be a bridge between clinical observation and histopathological examination, allowing the in vivo examination of skin microstructures that are not visible to the naked eye, from the epidermis to the superficial dermis. Dermoscopy has undergone rapid development, witnessing the history from natural light to polarized light, from handheld dermoscopy to videodermoscopy, and from classic dermoscopy to digital dermoscopy. Its application extends from the initial differential diagnosis of pigmented skin diseases (melanocytic and nonmelanocytic) to general dermatology, including appendage (nail and hair) abnormalities and diseases related to infection and inflammation. AIMS We aimed to provide the latest developments in dermoscopy from the perspective of handheld dermoscopy, videodermoscopy, fluorescence-advanced videodermatoscopy, polarized transilluminating dermoscopy, and digital dermoscopy. METHODS In this review, we searched the PubMed, Embase, Web of Science, and Cochrane Library databases for reviews, case reports, and observational studies on dermoscopy. RESULTS We provided an updated review of dermoscopy based on published literature. CONCLUSION Dermoscopy is an indispensable diagnostic tool in dermatology, and it is expected to be further developed in the future.
Collapse
Affiliation(s)
- Xi Chen
- Department of Dermatology, Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
| | - Quansheng Lu
- Department of Dermatology, People's Hospital of Jiawang District of Xuzhou, Xuzhou, China
| | - Can Chen
- Hebei Medical University, Shijiazhuang, China
| | - Guan Jiang
- Department of Dermatology, Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
| |
Collapse
|
21
|
Basu K, Sinha R, Ong A, Basu T. Artificial Intelligence: How is It Changing Medical Sciences and Its Future? Indian J Dermatol 2020; 65:365-370. [PMID: 33165420 PMCID: PMC7640807 DOI: 10.4103/ijd.ijd_421_20] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Artificially intelligent computer systems are used extensively in medical sciences. Common applications include diagnosing patients, end-to-end drug discovery and development, improving communication between physician and patient, transcribing medical documents, such as prescriptions, and remotely treating patients. While computer systems often execute tasks more efficiently than humans, more recently, state-of-the-art computer algorithms have achieved accuracies which are at par with human experts in the field of medical sciences. Some speculate that it is only a matter of time before humans are completely replaced in certain roles within the medical sciences. The motivation of this article is to discuss the ways in which artificial intelligence is changing the landscape of medical science and to separate hype from reality.
Collapse
Affiliation(s)
| | | | - Aihui Ong
- Whistle Labs, San Francisco, CA, USA
| | - Treena Basu
- Department of Mathematics, Occidental College, Los Angeles, CA, USA
| |
Collapse
|
22
|
Navarrete-Dechent C, Liopyris K, Molenda MA, Braun R, Curiel-Lewandrowski C, Dusza SW, Guitera P, Hofmann-Wellenhof R, Kittler H, Lallas A, Malvehy J, Marchetti MA, Oliviero M, Pellacani G, Puig S, Soyer HP, Tejasvi T, Thomas L, Tschandl P, Scope A, Marghoob AA, Halpern AC. Human surface anatomy terminology for dermatology: a Delphi consensus from the International Skin Imaging Collaboration. J Eur Acad Dermatol Venereol 2020; 34:2659-2663. [PMID: 32770737 DOI: 10.1111/jdv.16855] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Accepted: 07/29/2020] [Indexed: 01/05/2023]
Abstract
BACKGROUND There is no internationally vetted set of anatomic terms to describe human surface anatomy. OBJECTIVE To establish expert consensus on a standardized set of terms that describe clinically relevant human surface anatomy. METHODS We conducted a Delphi consensus on surface anatomy terminology between July 2017 and July 2019. The initial survey included 385 anatomic terms, organized in seven levels of hierarchy. If agreement exceeded the 75% established threshold, the term was considered 'accepted' and included in the final list. Terms added by the participants were passed on to the next round of consensus. Terms with <75% agreement were included in subsequent surveys along with alternative terms proposed by participants until agreement was reached on all terms. RESULTS The Delphi included 21 participants. We found consensus (≥75% agreement) on 361/385 (93.8%) terms and eliminated one term in the first round. Of 49 new terms suggested by participants, 45 were added via consensus. To adjust for a recently published International Classification of Diseases-Surface Topography list of terms, a third survey including 111 discrepant terms was sent to participants. Finally, a total of 513 terms reached agreement via the Delphi method. CONCLUSIONS We have established a set of 513 clinically relevant terms for denoting human surface anatomy, towards the use of standardized terminology in dermatologic documentation.
Collapse
Affiliation(s)
- C Navarrete-Dechent
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA.,Department of Dermatology, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - K Liopyris
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA.,Andreas Syggros Hospital of Cutaneous & Venereal Diseases, University of Athens, Athens, Greece
| | | | - R Braun
- Department of Dermatology, University Hospital Zürich, Zurich, Switzerland
| | - C Curiel-Lewandrowski
- Department of Dermatology, The University of Arizona Cancer Center, University of Arizona, Tucson, AZ, USA
| | - S W Dusza
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - P Guitera
- Melanoma Institute Australia, The University of Sydney, Sydney, NSW, Australia
| | | | - H Kittler
- Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - A Lallas
- First Department of Dermatology, Aristotle University, Thessaloniki, Greece
| | - J Malvehy
- Melanoma Unit, Department of Dermatology, Hospital Clinic, Institut d'Investigacions Biomediques August Pi i Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain.,CIBER de Enfermedades Raras, Instituto de Salud Carlos III, Barcelona, Spain
| | - M A Marchetti
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - M Oliviero
- Dermatology Associates, Plantation, FL, USA
| | - G Pellacani
- Department of Dermatology, University of Modena and Reggio Emilia, Modena, Italy
| | - S Puig
- Melanoma Unit, Department of Dermatology, Hospital Clinic, Institut d'Investigacions Biomediques August Pi i Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain.,CIBER de Enfermedades Raras, Instituto de Salud Carlos III, Barcelona, Spain
| | - H P Soyer
- Dermatology Research Center, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, Australia
| | - T Tejasvi
- Department of Dermatology, University of Michigan, Ann Arbor, MI, USA
| | - L Thomas
- Service de Dermatologie, Centre Hospitalier Lyon Sud, Lyon 1 University and Cancer Research Center of Lyons INSERM U1052 - CNRS UMR5286, Lyon, France
| | - P Tschandl
- Department of Dermatology, Medical University of Vienna, Vienna, Austria
| | - A Scope
- The Kittner Skin Cancer Screening and Research Institute, Sheba Medical Center, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - A A Marghoob
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - A C Halpern
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
23
|
Abbott LM, Miller R, Janda M, Bennett H, Taylor ML, Arnold C, Shumack S, Soyer HP, Caffery LJ. A review of literature supporting the development of practice guidelines for teledermatology in Australia. Australas J Dermatol 2020; 61:e174-e183. [PMID: 32232852 DOI: 10.1111/ajd.13249] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Revised: 11/11/2019] [Accepted: 01/12/2020] [Indexed: 01/18/2023]
Abstract
Despite the potential of teledermatology to increase access to dermatology services and improve patient care, it is not widely practised in Australia. In an effort to increase uptake of teledermatology, Australian-specific practice guidelines for teledermatology are being developed by the Australasian College of Dermatologist. This paper reports finding from literature reviews that were undertaken to inform the development of these guidelines. Results cover the following sections: Modalities of teledermatology; Patient selection and consent; Imaging; Quality and safety; Privacy and security; Communication; and Documentation and retention. The document educates providers about the benefits and limitations of telehealth while articulating how to enhance patient care and reduce risk when practicing teledermatology.
Collapse
Affiliation(s)
- Lisa M Abbott
- Sydney Law School, University of Sydney, Sydney, New South Wales, Australia.,The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - Robert Miller
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - Monika Janda
- Centre for Health Services Research, The University of Queensland, Brisbane, Queensland, Australia
| | - Haley Bennett
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - Monica L Taylor
- Centre for Online Health, The University of Queensland, Brisbane, Queensland, Australia
| | - Chris Arnold
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia.,Hodgson Associates, Melbourne, Victoria, Australia
| | - Stephen Shumack
- The Australasian College of Dermatologists, Sydney, New South Wales, Australia
| | - H Peter Soyer
- The University of Queensland Diamantina Institute, Brisbane, Queensland, Australia
| | - Liam J Caffery
- Centre for Online Health, The University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|
24
|
In response to, “How I learned to stop worrying and love machine learning”. Clin Dermatol 2019; 37:291-292. [DOI: 10.1016/j.clindermatol.2019.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
25
|
Tung JK, Nambudiri VE. Beyond Bitcoin: potential applications of blockchain technology in dermatology. Br J Dermatol 2018; 179:1013-1014. [PMID: 29947078 DOI: 10.1111/bjd.16922] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
- J K Tung
- Harvard Medical School, Boston, MA, U.S.A.,Department of Dermatology, Brigham and Women's Hospital, 221 Longwood Ave, Boston, MA, 02115, U.S.A
| | - V E Nambudiri
- Harvard Medical School, Boston, MA, U.S.A.,Department of Dermatology, Brigham and Women's Hospital, 221 Longwood Ave, Boston, MA, 02115, U.S.A
| |
Collapse
|
26
|
Rayner JE, Laino AM, Nufer KL, Adams L, Raphael AP, Menzies SW, Soyer HP. Clinical Perspective of 3D Total Body Photography for Early Detection and Screening of Melanoma. Front Med (Lausanne) 2018; 5:152. [PMID: 29911103 PMCID: PMC5992425 DOI: 10.3389/fmed.2018.00152] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2018] [Accepted: 05/02/2018] [Indexed: 11/28/2022] Open
Abstract
Melanoma incidence continues to increase across many populations globally and there is significant mortality associated with advanced disease. However, if detected early, patients have a very promising prognosis. The methods that have been utilized for early detection include clinician and patient skin examinations, dermoscopy (static and sequential imaging), and total body photography via 2D imaging. Total body photography has recently witnessed an evolution from 2D imaging with the ability to now create a 3D representation of the patient linked with dermoscopy images of individual lesions. 3D total body photography is a particularly beneficial screening tool for patients at high risk due to their personal or family history or those with multiple dysplastic naevi—the latter can make monitoring especially difficult without the assistance of technology. In this perspective, we discuss clinical examples utilizing 3D total body photography, associated advantages and limitations, and future directions of the technology. The optimal system for melanoma screening should improve diagnostic accuracy, be time and cost efficient, and accessible to patients across all demographic and socioeconomic groups. 3D total body photography has the potential to address these criteria and, most importantly, optimize crucial early detection.
Collapse
Affiliation(s)
- Jenna E Rayner
- Dermatology Research Centre, The University of Queensland, The University of Queensland Diamantina Institute, Brisbane, QLD, Australia.,Dermatology Department, Princess Alexandra Hospital, Brisbane, QLD, Australia
| | - Antonia M Laino
- Dermatology Research Centre, The University of Queensland, The University of Queensland Diamantina Institute, Brisbane, QLD, Australia.,Dermatology Department, Princess Alexandra Hospital, Brisbane, QLD, Australia
| | - Kaitlin L Nufer
- Dermatology Research Centre, The University of Queensland, The University of Queensland Diamantina Institute, Brisbane, QLD, Australia
| | - Laura Adams
- Dermatology Research Centre, The University of Queensland, The University of Queensland Diamantina Institute, Brisbane, QLD, Australia
| | - Anthony P Raphael
- Dermatology Research Centre, The University of Queensland, The University of Queensland Diamantina Institute, Brisbane, QLD, Australia
| | - Scott W Menzies
- Sydney Melanoma Diagnostic Centre, Royal Prince Alfred Hospital, Camperdown, NSW, Australia.,Sydney Medical School, The University of Sydney, Sydney, NSW, Australia
| | - H Peter Soyer
- Dermatology Research Centre, The University of Queensland, The University of Queensland Diamantina Institute, Brisbane, QLD, Australia.,Dermatology Department, Princess Alexandra Hospital, Brisbane, QLD, Australia
| |
Collapse
|
27
|
Clunie D, Hosseinzadeh D, Wintell M, De Mena D, Lajara N, Garcia-Rojo M, Bueno G, Saligrama K, Stearrett A, Toomey D, Abels E, Apeldoorn FV, Langevin S, Nichols S, Schmid J, Horchner U, Beckwith B, Parwani A, Pantanowitz L. Digital Imaging and Communications in Medicine Whole Slide Imaging Connectathon at Digital Pathology Association Pathology Visions 2017. J Pathol Inform 2018; 9:6. [PMID: 29619278 PMCID: PMC5869966 DOI: 10.4103/jpi.jpi_1_18] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2018] [Accepted: 02/05/2018] [Indexed: 11/06/2022] Open
Abstract
As digital pathology systems for clinical diagnostic work applications become mainstream, interoperability between these systems from different vendors becomes critical. For the first time, multiple digital pathology vendors have publicly revealed the use of the digital imaging and communications in medicine (DICOM) standard file format and network protocol to communicate between separate whole slide acquisition, storage, and viewing components. Note the use of DICOM for clinical diagnostic applications is still to be validated in the United States. The successful demonstration shows that the DICOM standard is fundamentally sound, though many lessons were learned. These lessons will be incorporated as incremental improvements in the standard, provide more detailed profiles to constrain variation for specific use cases, and offer educational material for implementers. Future Connectathon events will expand the scope to include more devices and vendors, as well as more ambitious use cases including laboratory information system integration and annotation for image analysis, as well as more geographic diversity. Users should request DICOM features in all purchases and contracts. It is anticipated that the growth of DICOM-compliant manufacturers will likely also ease DICOM for pathology becoming a recognized standard and as such the regulatory pathway for digital pathology products.
Collapse
Affiliation(s)
| | | | - Mikael Wintell
- Department of Regional Health, Region Västra Götalandsregionen, Sweden
| | - David De Mena
- Department of Pathology/UGC Anatomía Patológica, Hospital Universitario Puerta del Mar, Cádiz, Spain
| | - Nieves Lajara
- VISILAB, Grupo de Visión y Sistemas Inteligentes, E.T.S. Ingenieros Industriales, Universidad De Castilla-La Mancha, Ciudad Real, Spain
| | - Marcial Garcia-Rojo
- Department of Pathology/UGC Anatomía Patológica, Hospital Universitario Puerta del Mar, Cádiz, Spain
| | - Gloria Bueno
- VISILAB, Grupo de Visión y Sistemas Inteligentes, E.T.S. Ingenieros Industriales, Universidad De Castilla-La Mancha, Ciudad Real, Spain
| | | | | | | | - Esther Abels
- Philips Digital Pathology Solutions, Best, The Netherlands
| | | | | | | | | | | | - Bruce Beckwith
- Department of Pathology, North Shore Medical Center, Salem, MA, USA
| | - Anil Parwani
- Department of Pathology, Ohio State University, Columbus, OH, USA
| | - Liron Pantanowitz
- Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| |
Collapse
|